2023-07-09T01:55:44.572 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T01:55:44.573 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258 --owner scheduled_rishabh@teuthology --name rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/orig.config.yaml 2023-07-09T01:55:44.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:55:44.703 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258 branch: wip-rishabh-2023Jul9 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7331258' kernel: client: branch: testing flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-2023Jul9 ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 35b2d86cfd512f15ace2077050d20c8669933212 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 35b2d86cfd512f15ace2077050d20c8669933212 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul9 sha1: 35b2d86cfd512f15ace2077050d20c8669933212 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 35b2d86cfd512f15ace2077050d20c8669933212 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul9 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 35b2d86cfd512f15ace2077050d20c8669933212 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNb5m0fWJWMgfekhzFMSSRi0tDoW9NldytSVIT87hG1H4558e9pBEHzcH44ohGExahrdouYBBthQ89E67WpA6tk= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUISXnKBKQ2cR4u244Tk/vUZUCdZCv0mM9QS/GlwYer2Jy9DKFQapK4stXCBMPo7NChKjszTYzr2mTpZdvXfS8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-08_23:33:40 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-09T01:55:44.704 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa; will attempt to use it 2023-07-09T01:55:44.705 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks 2023-07-09T01:55:44.705 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-09T01:55:44.707 INFO:teuthology.task.internal:Checking packages... 2023-07-09T01:55:44.735 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '35b2d86cfd512f15ace2077050d20c8669933212' 2023-07-09T01:55:44.735 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-09T01:55:44.736 INFO:teuthology.packaging:ref: None 2023-07-09T01:55:44.736 INFO:teuthology.packaging:tag: None 2023-07-09T01:55:44.736 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul9 2023-07-09T01:55:44.736 INFO:teuthology.packaging:sha1: 35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T01:55:44.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-2023Jul9 2023-07-09T01:55:44.874 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T01:55:44.875 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-09T01:55:44.882 INFO:teuthology.task.internal:no buildpackages task found 2023-07-09T01:55:44.882 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-09T01:55:44.900 INFO:teuthology.task.internal:Saving configuration 2023-07-09T01:55:44.917 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-09T01:55:44.923 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T01:55:44.952 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 01:49:47.206365', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBLvwM6QmT2zcUWo9nj/UDbXnrn+q/8fShE92gjAxBCu'} 2023-07-09T01:55:44.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 01:49:47.205171', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMKkaMBDzAvsPgz+ojtf4weUBboVU1mErjO35Z2pzRL'} 2023-07-09T01:55:44.978 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-09T01:55:44.985 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-09T01:55:44.985 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-09T01:55:44.985 INFO:teuthology.run_tasks:Running task console_log... 2023-07-09T01:55:45.068 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f36dffd7280>, signals=[15]) 2023-07-09T01:55:45.069 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-09T01:55:45.076 INFO:teuthology.task.internal:Opening connections... 2023-07-09T01:55:45.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T01:55:45.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:55:45.156 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T01:55:45.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:55:45.231 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-09T01:55:45.238 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-07-09T01:55:45.245 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-07-09T01:55:45.245 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-07-09T01:55:45.292 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-09T01:55:45.292 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu" 2023-07-09T01:55:45.292 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="22.04" 2023-07-09T01:55:45.293 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-09T01:55:45.293 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=jammy 2023-07-09T01:55:45.293 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu 2023-07-09T01:55:45.293 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian 2023-07-09T01:55:45.293 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-09T01:55:45.293 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-09T01:55:45.293 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-09T01:55:45.294 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-09T01:55:45.294 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=jammy 2023-07-09T01:55:45.294 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-07-09T01:55:45.317 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-07-09T01:55:45.321 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-07-09T01:55:45.322 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-07-09T01:55:45.368 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-09T01:55:45.368 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2023-07-09T01:55:45.369 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04" 2023-07-09T01:55:45.369 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-09T01:55:45.369 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy 2023-07-09T01:55:45.369 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2023-07-09T01:55:45.369 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2023-07-09T01:55:45.369 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-09T01:55:45.369 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-09T01:55:45.370 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-09T01:55:45.370 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-09T01:55:45.370 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy 2023-07-09T01:55:45.370 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-07-09T01:55:45.392 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-09T01:55:45.407 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-09T01:55:45.423 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-09T01:55:45.423 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-07-09T01:55:45.426 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2023-07-09T01:55:45.433 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-09T01:55:45.439 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-09T01:55:45.440 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-07-09T01:55:45.478 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2023-07-09T01:55:45.491 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-09T01:55:45.552 INFO:teuthology.run_tasks:Running task kernel... 2023-07-09T01:55:45.571 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-09T01:55:45.572 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-09T01:55:45.572 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-09T01:55:45.572 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-09T01:55:45.573 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-09T01:55:45.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T01:55:45.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-09T01:55:45.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T01:55:45.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-09T01:55:45.783 DEBUG:teuthology.task.kernel:sha1 for client.0 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T01:55:45.784 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-09T01:55:45.784 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-07-09T01:55:45.790 INFO:teuthology.orchestra.run.smithi045.stdout:5.15.0-56-generic 2023-07-09T01:55:45.790 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T01:55:45.791 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-09T01:55:45.791 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-07-09T01:55:45.791 DEBUG:teuthology.orchestra.run.smithi045:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-09T01:55:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-09T01:55:45.887 DEBUG:teuthology.task.kernel:sha1 for client.1 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T01:55:45.888 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-09T01:55:45.888 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-07-09T01:55:45.893 INFO:teuthology.orchestra.run.smithi155.stdout:5.15.0-56-generic 2023-07-09T01:55:45.894 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T01:55:45.894 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-09T01:55:45.894 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-07-09T01:55:45.895 DEBUG:teuthology.orchestra.run.smithi155:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-09T01:55:45.953 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-09T01:55:45.984 INFO:teuthology.orchestra.run.smithi045.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-09T01:55:45.985 INFO:teuthology.orchestra.run.smithi045.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-09T01:55:45.985 INFO:teuthology.orchestra.run.smithi045.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-09T01:55:45.985 INFO:teuthology.orchestra.run.smithi045.stderr:hint: 2023-07-09T01:55:45.985 INFO:teuthology.orchestra.run.smithi045.stderr:hint: git config --global init.defaultBranch 2023-07-09T01:55:45.985 INFO:teuthology.orchestra.run.smithi045.stderr:hint: 2023-07-09T01:55:45.986 INFO:teuthology.orchestra.run.smithi045.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-09T01:55:45.986 INFO:teuthology.orchestra.run.smithi045.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-09T01:55:45.986 INFO:teuthology.orchestra.run.smithi045.stderr:hint: 2023-07-09T01:55:45.986 INFO:teuthology.orchestra.run.smithi045.stderr:hint: git branch -m 2023-07-09T01:55:45.986 INFO:teuthology.orchestra.run.smithi045.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-09T01:55:45.988 DEBUG:teuthology.orchestra.run.smithi045:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-09T01:55:46.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-09T01:55:46.082 INFO:teuthology.orchestra.run.smithi155.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-09T01:55:46.082 INFO:teuthology.orchestra.run.smithi155.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-09T01:55:46.083 INFO:teuthology.orchestra.run.smithi155.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-09T01:55:46.083 INFO:teuthology.orchestra.run.smithi155.stderr:hint: 2023-07-09T01:55:46.083 INFO:teuthology.orchestra.run.smithi155.stderr:hint: git config --global init.defaultBranch 2023-07-09T01:55:46.083 INFO:teuthology.orchestra.run.smithi155.stderr:hint: 2023-07-09T01:55:46.083 INFO:teuthology.orchestra.run.smithi155.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-09T01:55:46.083 INFO:teuthology.orchestra.run.smithi155.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-09T01:55:46.083 INFO:teuthology.orchestra.run.smithi155.stderr:hint: 2023-07-09T01:55:46.084 INFO:teuthology.orchestra.run.smithi155.stderr:hint: git branch -m 2023-07-09T01:55:46.084 INFO:teuthology.orchestra.run.smithi155.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-09T01:55:46.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-09T01:55:46.114 DEBUG:teuthology.orchestra.run.smithi045:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-09T01:55:46.153 DEBUG:teuthology.orchestra.run.smithi155:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-09T01:55:46.210 DEBUG:teuthology.orchestra.run.smithi155:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-09T01:56:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-09T01:56:26.563 INFO:teuthology.orchestra.run.smithi045.stderr: * [new branch] main -> origin/main 2023-07-09T01:56:26.590 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190312 -> 20190312 2023-07-09T01:56:26.590 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190416 -> 20190416 2023-07-09T01:56:26.591 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190514 -> 20190514 2023-07-09T01:56:26.591 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190618 -> 20190618 2023-07-09T01:56:26.591 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190717 -> 20190717 2023-07-09T01:56:26.591 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190815 -> 20190815 2023-07-09T01:56:26.591 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190923 -> 20190923 2023-07-09T01:56:26.591 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20191022 -> 20191022 2023-07-09T01:56:26.591 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20191215 -> 20191215 2023-07-09T01:56:26.594 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200122 -> 20200122 2023-07-09T01:56:26.594 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200316 -> 20200316 2023-07-09T01:56:26.594 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200421 -> 20200421 2023-07-09T01:56:26.595 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200519 -> 20200519 2023-07-09T01:56:26.595 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200619 -> 20200619 2023-07-09T01:56:26.595 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200721 -> 20200721 2023-07-09T01:56:26.595 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200817 -> 20200817 2023-07-09T01:56:26.595 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200918 -> 20200918 2023-07-09T01:56:26.595 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201022 -> 20201022 2023-07-09T01:56:26.595 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201118 -> 20201118 2023-07-09T01:56:26.596 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201218 -> 20201218 2023-07-09T01:56:26.596 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210208 -> 20210208 2023-07-09T01:56:26.596 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210315 -> 20210315 2023-07-09T01:56:26.596 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210511 -> 20210511 2023-07-09T01:56:26.596 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210716 -> 20210716 2023-07-09T01:56:26.596 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210818 -> 20210818 2023-07-09T01:56:26.596 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210919 -> 20210919 2023-07-09T01:56:26.596 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20211027 -> 20211027 2023-07-09T01:56:26.597 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20211216 -> 20211216 2023-07-09T01:56:26.597 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220209 -> 20220209 2023-07-09T01:56:26.597 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220310 -> 20220310 2023-07-09T01:56:26.597 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220411 -> 20220411 2023-07-09T01:56:26.597 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220509 -> 20220509 2023-07-09T01:56:26.597 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220610 -> 20220610 2023-07-09T01:56:26.597 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220708 -> 20220708 2023-07-09T01:56:26.597 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220815 -> 20220815 2023-07-09T01:56:26.598 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220913 -> 20220913 2023-07-09T01:56:26.598 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221012 -> 20221012 2023-07-09T01:56:26.598 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221109 -> 20221109 2023-07-09T01:56:26.598 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221214 -> 20221214 2023-07-09T01:56:26.598 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230117 -> 20230117 2023-07-09T01:56:26.598 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230210 -> 20230210 2023-07-09T01:56:26.598 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230310 -> 20230310 2023-07-09T01:56:26.598 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230404 -> 20230404 2023-07-09T01:56:26.599 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230515 -> 20230515 2023-07-09T01:56:26.599 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230625 -> 20230625 2023-07-09T01:56:29.565 INFO:teuthology.orchestra.run.smithi155.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-09T01:56:29.566 INFO:teuthology.orchestra.run.smithi155.stderr: * [new branch] main -> origin/main 2023-07-09T01:56:29.594 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190312 -> 20190312 2023-07-09T01:56:29.594 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190416 -> 20190416 2023-07-09T01:56:29.595 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190514 -> 20190514 2023-07-09T01:56:29.595 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190618 -> 20190618 2023-07-09T01:56:29.595 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190717 -> 20190717 2023-07-09T01:56:29.595 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190815 -> 20190815 2023-07-09T01:56:29.597 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190923 -> 20190923 2023-07-09T01:56:29.597 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20191022 -> 20191022 2023-07-09T01:56:29.597 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20191215 -> 20191215 2023-07-09T01:56:29.597 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200122 -> 20200122 2023-07-09T01:56:29.597 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200316 -> 20200316 2023-07-09T01:56:29.598 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200421 -> 20200421 2023-07-09T01:56:29.598 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200519 -> 20200519 2023-07-09T01:56:29.598 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200619 -> 20200619 2023-07-09T01:56:29.598 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200721 -> 20200721 2023-07-09T01:56:29.598 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200817 -> 20200817 2023-07-09T01:56:29.598 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200918 -> 20200918 2023-07-09T01:56:29.598 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20201022 -> 20201022 2023-07-09T01:56:29.599 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20201118 -> 20201118 2023-07-09T01:56:29.599 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20201218 -> 20201218 2023-07-09T01:56:29.599 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210208 -> 20210208 2023-07-09T01:56:29.599 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210315 -> 20210315 2023-07-09T01:56:29.599 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210511 -> 20210511 2023-07-09T01:56:29.599 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210716 -> 20210716 2023-07-09T01:56:29.599 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210818 -> 20210818 2023-07-09T01:56:29.600 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210919 -> 20210919 2023-07-09T01:56:29.601 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20211027 -> 20211027 2023-07-09T01:56:29.601 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20211216 -> 20211216 2023-07-09T01:56:29.602 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220209 -> 20220209 2023-07-09T01:56:29.602 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220310 -> 20220310 2023-07-09T01:56:29.602 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220411 -> 20220411 2023-07-09T01:56:29.602 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220509 -> 20220509 2023-07-09T01:56:29.602 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220610 -> 20220610 2023-07-09T01:56:29.602 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220708 -> 20220708 2023-07-09T01:56:29.603 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220815 -> 20220815 2023-07-09T01:56:29.603 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220913 -> 20220913 2023-07-09T01:56:29.603 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20221012 -> 20221012 2023-07-09T01:56:29.603 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20221109 -> 20221109 2023-07-09T01:56:29.603 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20221214 -> 20221214 2023-07-09T01:56:29.603 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230117 -> 20230117 2023-07-09T01:56:29.603 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230210 -> 20230210 2023-07-09T01:56:29.604 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230310 -> 20230310 2023-07-09T01:56:29.604 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230404 -> 20230404 2023-07-09T01:56:29.604 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230515 -> 20230515 2023-07-09T01:56:29.604 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230625 -> 20230625 2023-07-09T01:56:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:Updating files: 48% (1437/2977) Updating files: 49% (1459/2977) Updating files: 50% (1489/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1952/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 81% (2429/2977) Updating files: 82% (2442/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-09T01:56:30.016 INFO:teuthology.orchestra.run.smithi045.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-09T01:56:30.035 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-09T01:56:30.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T01:56:30.252 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ 2023-07-09T01:56:30.252 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ --input-file=- 2023-07-09T01:56:30.254 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-07-09T01:56:31.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09 01:56:31 URL:https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb [38588998/38588998] -> "/tmp/linux-image.deb" [1] 2023-07-09T01:56:31.763 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2023-07-09 01:56:31-- 2023-07-09T01:56:31.763 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 1.5s 2023-07-09T01:56:31.763 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 37M in 1.3s (27.3 MB/s) 2023-07-09T01:56:31.766 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-09T01:56:31.766 DEBUG:teuthology.orchestra.run.smithi045:> sudo dpkg -i /tmp/linux-image.deb 2023-07-09T01:56:32.052 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-image-6.4.0-g84139c18d56f. 2023-07-09T01:56:32.871 INFO:teuthology.orchestra.run.smithi155.stderr:Updating files: 49% (1481/2977) Updating files: 50% (1489/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1954/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2444/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-09T01:56:32.875 INFO:teuthology.orchestra.run.smithi155.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-09T01:56:32.893 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-09T01:56:32.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T01:56:33.107 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ 2023-07-09T01:56:33.108 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ --input-file=- 2023-07-09T01:56:33.110 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi155.front.sepia.ceph.com to complete... 2023-07-09T01:56:34.052 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-09T01:56:34.056 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-09T01:56:34.203 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-09T01:56:34.946 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09 01:56:34 URL:https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb [38588998/38588998] -> "/tmp/linux-image.deb" [1] 2023-07-09T01:56:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:FINISHED --2023-07-09 01:56:34-- 2023-07-09T01:56:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:Total wall clock time: 1.6s 2023-07-09T01:56:34.947 INFO:teuthology.orchestra.run.smithi155.stderr:Downloaded: 1 files, 37M in 1.4s (25.5 MB/s) 2023-07-09T01:56:34.950 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-09T01:56:34.950 DEBUG:teuthology.orchestra.run.smithi155:> sudo dpkg -i /tmp/linux-image.deb 2023-07-09T01:56:35.213 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-image-6.4.0-g84139c18d56f. 2023-07-09T01:56:37.198 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-09T01:56:37.202 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-09T01:56:37.313 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-09T01:56:37.505 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-09T01:56:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T01:56:40.750 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-09T01:56:40.852 INFO:teuthology.orchestra.run.smithi155.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T01:56:57.267 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-07-09T01:56:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-09T01:56:57.302 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-07-09T01:56:57.615 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T01:56:57.629 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T01:56:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-09T01:56:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-09T01:56:58.030 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-09T01:56:58.035 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-09T01:56:58.188 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-09T01:56:58.189 INFO:teuthology.orchestra.run.smithi045.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-09T01:56:58.189 INFO:teuthology.orchestra.run.smithi045.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-09T01:56:58.231 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-07-09T01:56:58.413 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-deb -c /tmp/linux-image.deb 2023-07-09T01:56:58.420 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./ 2023-07-09T01:56:58.421 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./boot/ 2023-07-09T01:56:58.421 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4323582 2023-06-30 10:38 ./boot/System.map-6.4.0-g84139c18d56f 2023-07-09T01:56:58.430 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 167337 2023-06-30 10:38 ./boot/config-6.4.0-g84139c18d56f 2023-07-09T01:56:58.431 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11237632 2023-06-30 10:38 ./boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T01:56:58.448 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/ 2023-07-09T01:56:58.448 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/ 2023-07-09T01:56:58.448 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postinst.d/ 2023-07-09T01:56:58.449 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postrm.d/ 2023-07-09T01:56:58.449 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/preinst.d/ 2023-07-09T01:56:58.449 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/prerm.d/ 2023-07-09T01:56:58.449 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/ 2023-07-09T01:56:58.449 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/ 2023-07-09T01:56:58.449 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/ 2023-07-09T01:56:58.449 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/ 2023-07-09T01:56:58.450 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/ 2023-07-09T01:56:58.450 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/ 2023-07-09T01:56:58.450 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ 2023-07-09T01:56:58.450 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 490385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-09T01:56:58.452 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-09T01:56:58.452 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-09T01:56:58.452 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-09T01:56:58.453 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 92385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-09T01:56:58.453 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-09T01:56:58.453 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 152241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-09T01:56:58.453 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-09T01:56:58.453 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-09T01:56:58.453 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-09T01:56:58.453 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-09T01:56:58.454 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-09T01:56:58.454 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-09T01:56:58.454 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-09T01:56:58.454 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-09T01:56:58.454 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-09T01:56:58.454 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-09T01:56:58.454 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-09T01:56:58.454 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-09T01:56:58.455 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-09T01:56:58.455 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/ 2023-07-09T01:56:58.455 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/ 2023-07-09T01:56:58.455 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/ 2023-07-09T01:56:58.455 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-09T01:56:58.456 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpuid.ko 2023-07-09T01:56:58.456 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/msr.ko 2023-07-09T01:56:58.456 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/ 2023-07-09T01:56:58.456 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 346513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-09T01:56:58.456 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 972233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-09T01:56:58.456 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2209953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-09T01:56:58.463 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ 2023-07-09T01:56:58.463 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/af_alg.ko 2023-07-09T01:56:58.463 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_hash.ko 2023-07-09T01:56:58.463 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_skcipher.ko 2023-07-09T01:56:58.464 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-09T01:56:58.464 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-09T01:56:58.464 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-09T01:56:58.464 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/ 2023-07-09T01:56:58.464 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-09T01:56:58.464 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/ 2023-07-09T01:56:58.465 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-09T01:56:58.465 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-09T01:56:58.465 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-09T01:56:58.465 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-09T01:56:58.465 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-09T01:56:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-09T01:56:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-09T01:56:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-09T01:56:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-09T01:56:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-09T01:56:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-09T01:56:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-09T01:56:58.466 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-09T01:56:58.467 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-09T01:56:58.467 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-09T01:56:58.467 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-09T01:56:58.467 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-09T01:56:58.467 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-09T01:56:58.467 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cryptd.ko 2023-07-09T01:56:58.468 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-09T01:56:58.468 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_simd.ko 2023-07-09T01:56:58.468 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-09T01:56:58.468 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-09T01:56:58.469 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-09T01:56:58.469 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-09T01:56:58.469 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-09T01:56:58.469 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-09T01:56:58.470 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-09T01:56:58.470 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-09T01:56:58.470 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lrw.ko 2023-07-09T01:56:58.470 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-09T01:56:58.470 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-09T01:56:58.471 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-09T01:56:58.471 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-09T01:56:58.471 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-09T01:56:58.471 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-09T01:56:58.471 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-09T01:56:58.471 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-09T01:56:58.471 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-09T01:56:58.472 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 149193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-09T01:56:58.472 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-09T01:56:58.472 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-09T01:56:58.472 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-09T01:56:58.472 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-09T01:56:58.472 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-09T01:56:58.473 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-09T01:56:58.473 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-09T01:56:58.473 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xts.ko 2023-07-09T01:56:58.473 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-09T01:56:58.473 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ 2023-07-09T01:56:58.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ 2023-07-09T01:56:58.474 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_extlog.ko 2023-07-09T01:56:58.474 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-09T01:56:58.474 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-09T01:56:58.475 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/ 2023-07-09T01:56:58.475 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/einj.ko 2023-07-09T01:56:58.475 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-09T01:56:58.475 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-09T01:56:58.475 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-09T01:56:58.475 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-09T01:56:58.476 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 98369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-09T01:56:58.476 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ 2023-07-09T01:56:58.476 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-09T01:56:58.476 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 88625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci.ko 2023-07-09T01:56:58.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-09T01:56:58.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci.ko 2023-07-09T01:56:58.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-09T01:56:58.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-09T01:56:58.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-09T01:56:58.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-09T01:56:58.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-09T01:56:58.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-09T01:56:58.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-09T01:56:58.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-09T01:56:58.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-09T01:56:58.480 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-09T01:56:58.480 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-09T01:56:58.480 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-09T01:56:58.480 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-09T01:56:58.481 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-09T01:56:58.481 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-09T01:56:58.481 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-09T01:56:58.482 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-09T01:56:58.482 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-09T01:56:58.482 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_legacy.ko 2023-07-09T01:56:58.482 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-09T01:56:58.483 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-09T01:56:58.483 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-09T01:56:58.483 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-09T01:56:58.483 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-09T01:56:58.483 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-09T01:56:58.483 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-09T01:56:58.483 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-09T01:56:58.483 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-09T01:56:58.484 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-09T01:56:58.484 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-09T01:56:58.484 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-09T01:56:58.484 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-09T01:56:58.484 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_radisys.ko 2023-07-09T01:56:58.484 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-09T01:56:58.484 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rz1000.ko 2023-07-09T01:56:58.485 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-09T01:56:58.485 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-09T01:56:58.485 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-09T01:56:58.485 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-09T01:56:58.485 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-09T01:56:58.485 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-09T01:56:58.485 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-09T01:56:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-09T01:56:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-09T01:56:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-09T01:56:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-09T01:56:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-09T01:56:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-09T01:56:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-09T01:56:58.486 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-09T01:56:58.487 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-09T01:56:58.487 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-09T01:56:58.487 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-09T01:56:58.487 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-09T01:56:58.487 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-09T01:56:58.487 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ 2023-07-09T01:56:58.487 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-09T01:56:58.487 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/ 2023-07-09T01:56:58.488 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 121681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-09T01:56:58.488 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/ 2023-07-09T01:56:58.488 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/ 2023-07-09T01:56:58.488 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-09T01:56:58.488 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/ 2023-07-09T01:56:58.488 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 968129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-09T01:56:58.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 173225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-09T01:56:58.530 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/ 2023-07-09T01:56:58.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-09T01:56:58.530 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 114169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-09T01:56:58.530 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/ 2023-07-09T01:56:58.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 110361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-09T01:56:58.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-09T01:56:58.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 257529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-09T01:56:58.531 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/ 2023-07-09T01:56:58.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 98193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-09T01:56:58.531 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/ 2023-07-09T01:56:58.531 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-09T01:56:58.531 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ 2023-07-09T01:56:58.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/applicom.ko 2023-07-09T01:56:58.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-09T01:56:58.532 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/ 2023-07-09T01:56:58.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-09T01:56:58.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-09T01:56:58.532 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-09T01:56:58.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-09T01:56:58.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-09T01:56:58.533 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ 2023-07-09T01:56:58.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-09T01:56:58.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 147705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-09T01:56:58.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-09T01:56:58.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 139057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-09T01:56:58.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-09T01:56:58.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-09T01:56:58.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-09T01:56:58.534 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/ 2023-07-09T01:56:58.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-09T01:56:58.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/nvram.ko 2023-07-09T01:56:58.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-09T01:56:58.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-09T01:56:58.535 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/ 2023-07-09T01:56:58.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-09T01:56:58.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-09T01:56:58.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-09T01:56:58.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-09T01:56:58.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-09T01:56:58.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-09T01:56:58.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-09T01:56:58.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/ 2023-07-09T01:56:58.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-09T01:56:58.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-09T01:56:58.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-09T01:56:58.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/ 2023-07-09T01:56:58.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-palmas.ko 2023-07-09T01:56:58.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-si5351.ko 2023-07-09T01:56:58.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-twl6040.ko 2023-07-09T01:56:58.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-wm831x.ko 2023-07-09T01:56:58.539 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/ 2023-07-09T01:56:58.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-09T01:56:58.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-09T01:56:58.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-09T01:56:58.539 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ 2023-07-09T01:56:58.540 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ 2023-07-09T01:56:58.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-09T01:56:58.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 231713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-09T01:56:58.540 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/ 2023-07-09T01:56:58.540 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/ 2023-07-09T01:56:58.540 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-09T01:56:58.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 396457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-09T01:56:58.541 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-09T01:56:58.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-09T01:56:58.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-09T01:56:58.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-09T01:56:58.541 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/ 2023-07-09T01:56:58.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-09T01:56:58.541 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/ 2023-07-09T01:56:58.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-09T01:56:58.542 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ 2023-07-09T01:56:58.542 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/ 2023-07-09T01:56:58.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-09T01:56:58.542 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ 2023-07-09T01:56:58.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-09T01:56:58.543 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ 2023-07-09T01:56:58.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-09T01:56:58.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-09T01:56:58.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-09T01:56:58.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-09T01:56:58.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-09T01:56:58.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-09T01:56:58.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-09T01:56:58.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-09T01:56:58.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-09T01:56:58.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-09T01:56:58.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-09T01:56:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-09T01:56:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-09T01:56:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/ 2023-07-09T01:56:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-gpio.ko 2023-07-09T01:56:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max14577.ko 2023-07-09T01:56:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max77693.ko 2023-07-09T01:56:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max8997.ko 2023-07-09T01:56:58.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-palmas.ko 2023-07-09T01:56:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-09T01:56:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-09T01:56:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/ 2023-07-09T01:56:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-09T01:56:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/ 2023-07-09T01:56:58.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-09T01:56:58.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-09T01:56:58.547 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/ 2023-07-09T01:56:58.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-09T01:56:58.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-09T01:56:58.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-arizona.ko 2023-07-09T01:56:58.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9052.ko 2023-07-09T01:56:58.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9055.ko 2023-07-09T01:56:58.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-dln2.ko 2023-07-09T01:56:58.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-09T01:56:58.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-generic.ko 2023-07-09T01:56:58.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-09T01:56:58.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-09T01:56:58.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-kempld.ko 2023-07-09T01:56:58.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-09T01:56:58.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max7300.ko 2023-07-09T01:56:58.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max730x.ko 2023-07-09T01:56:58.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max732x.ko 2023-07-09T01:56:58.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-09T01:56:58.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-09T01:56:58.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-09T01:56:58.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-09T01:56:58.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch.ko 2023-07-09T01:56:58.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-09T01:56:58.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-09T01:56:58.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-09T01:56:58.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-09T01:56:58.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-09T01:56:58.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-vx855.ko 2023-07-09T01:56:58.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-09T01:56:58.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-09T01:56:58.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-09T01:56:58.552 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/ 2023-07-09T01:56:58.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-a4tech.ko 2023-07-09T01:56:58.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-apple.ko 2023-07-09T01:56:58.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-09T01:56:58.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-09T01:56:58.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-09T01:56:58.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-belkin.ko 2023-07-09T01:56:58.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cherry.ko 2023-07-09T01:56:58.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-chicony.ko 2023-07-09T01:56:58.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cp2112.ko 2023-07-09T01:56:58.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cypress.ko 2023-07-09T01:56:58.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-09T01:56:58.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-09T01:56:58.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-09T01:56:58.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-09T01:56:58.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ezkey.ko 2023-07-09T01:56:58.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-09T01:56:58.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-generic.ko 2023-07-09T01:56:58.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-09T01:56:58.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-09T01:56:58.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-09T01:56:58.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-09T01:56:58.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-09T01:56:58.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-09T01:56:58.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-09T01:56:58.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kensington.ko 2023-07-09T01:56:58.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-09T01:56:58.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-09T01:56:58.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-09T01:56:58.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-09T01:56:58.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-09T01:56:58.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lg-g15.ko 2023-07-09T01:56:58.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-09T01:56:58.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-09T01:56:58.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech.ko 2023-07-09T01:56:58.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-magicmouse.ko 2023-07-09T01:56:58.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-microsoft.ko 2023-07-09T01:56:58.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-monterey.ko 2023-07-09T01:56:58.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-09T01:56:58.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ntrig.ko 2023-07-09T01:56:58.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-09T01:56:58.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-09T01:56:58.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-09T01:56:58.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-09T01:56:58.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-09T01:56:58.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-09T01:56:58.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-09T01:56:58.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-09T01:56:58.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-09T01:56:58.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-09T01:56:58.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-09T01:56:58.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-09T01:56:58.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-09T01:56:58.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-09T01:56:58.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-09T01:56:58.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-09T01:56:58.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-09T01:56:58.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-09T01:56:58.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-09T01:56:58.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-09T01:56:58.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-09T01:56:58.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-09T01:56:58.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-09T01:56:58.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-09T01:56:58.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-09T01:56:58.566 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-09T01:56:58.566 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-09T01:56:58.566 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-09T01:56:58.566 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-09T01:56:58.567 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-09T01:56:58.567 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-09T01:56:58.567 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-09T01:56:58.568 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-09T01:56:58.568 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-09T01:56:58.568 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-09T01:56:58.568 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-09T01:56:58.568 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-09T01:56:58.568 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-09T01:56:58.569 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-09T01:56:58.569 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 261881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid.ko 2023-07-09T01:56:58.569 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-09T01:56:58.569 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/ 2023-07-09T01:56:58.569 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-09T01:56:58.569 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-09T01:56:58.569 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-09T01:56:58.569 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 217401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-09T01:56:58.570 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/ 2023-07-09T01:56:58.570 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-09T01:56:58.570 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-09T01:56:58.570 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 292697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-09T01:56:58.570 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ 2023-07-09T01:56:58.570 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-09T01:56:58.570 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-09T01:56:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-09T01:56:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-09T01:56:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-09T01:56:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-09T01:56:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-09T01:56:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-09T01:56:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-09T01:56:58.571 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-09T01:56:58.572 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-09T01:56:58.572 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-09T01:56:58.572 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-09T01:56:58.572 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-09T01:56:58.572 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-09T01:56:58.572 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-09T01:56:58.572 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 65321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-09T01:56:58.573 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-09T01:56:58.573 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-09T01:56:58.573 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-09T01:56:58.573 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-09T01:56:58.573 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-09T01:56:58.573 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-09T01:56:58.573 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-09T01:56:58.574 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-09T01:56:58.574 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-09T01:56:58.574 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-09T01:56:58.574 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-09T01:56:58.574 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-09T01:56:58.574 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-09T01:56:58.574 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-09T01:56:58.575 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-09T01:56:58.575 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc2103.ko 2023-07-09T01:56:58.575 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-09T01:56:58.575 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-09T01:56:58.575 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-09T01:56:58.576 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-09T01:56:58.576 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-09T01:56:58.576 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-09T01:56:58.577 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-09T01:56:58.577 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-09T01:56:58.577 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-09T01:56:58.577 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-09T01:56:58.578 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hih6130.ko 2023-07-09T01:56:58.578 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-09T01:56:58.578 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-09T01:56:58.578 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-09T01:56:58.579 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-09T01:56:58.579 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-09T01:56:58.579 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-09T01:56:58.580 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-09T01:56:58.580 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-09T01:56:58.580 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/jc42.ko 2023-07-09T01:56:58.580 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-09T01:56:58.581 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-09T01:56:58.581 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-09T01:56:58.581 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-09T01:56:58.581 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-09T01:56:58.581 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-09T01:56:58.582 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-09T01:56:58.582 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-09T01:56:58.582 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-09T01:56:58.582 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-09T01:56:58.582 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-09T01:56:58.582 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-09T01:56:58.582 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-09T01:56:58.582 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-09T01:56:58.583 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-09T01:56:58.583 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-09T01:56:58.583 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-09T01:56:58.583 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-09T01:56:58.583 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-09T01:56:58.583 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-09T01:56:58.583 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-09T01:56:58.584 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-09T01:56:58.584 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-09T01:56:58.584 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-09T01:56:58.584 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-09T01:56:58.584 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-09T01:56:58.584 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-09T01:56:58.585 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-09T01:56:58.585 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-09T01:56:58.585 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-09T01:56:58.585 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-09T01:56:58.585 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-09T01:56:58.585 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-09T01:56:58.586 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-09T01:56:58.586 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-09T01:56:58.586 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-09T01:56:58.586 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 114753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-09T01:56:58.586 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-09T01:56:58.586 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-09T01:56:58.586 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-09T01:56:58.586 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-09T01:56:58.587 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-09T01:56:58.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ 2023-07-09T01:56:58.587 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-09T01:56:58.587 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-09T01:56:58.587 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-09T01:56:58.587 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-09T01:56:58.588 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-09T01:56:58.588 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-09T01:56:58.588 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-09T01:56:58.588 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 79465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-09T01:56:58.588 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-09T01:56:58.588 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-09T01:56:58.589 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-09T01:56:58.589 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-09T01:56:58.589 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-09T01:56:58.589 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-09T01:56:58.589 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-09T01:56:58.589 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-09T01:56:58.589 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-09T01:56:58.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-09T01:56:58.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-09T01:56:58.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-09T01:56:58.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smm665.ko 2023-07-09T01:56:58.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-09T01:56:58.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-09T01:56:58.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-09T01:56:58.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-09T01:56:58.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-09T01:56:58.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-09T01:56:58.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-09T01:56:58.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-09T01:56:58.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-09T01:56:58.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-09T01:56:58.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-09T01:56:58.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-09T01:56:58.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-09T01:56:58.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-09T01:56:58.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-09T01:56:58.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-09T01:56:58.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-09T01:56:58.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-09T01:56:58.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-09T01:56:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-09T01:56:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-09T01:56:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-09T01:56:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-09T01:56:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/ 2023-07-09T01:56:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/ 2023-07-09T01:56:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-09T01:56:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-09T01:56:58.594 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/ 2023-07-09T01:56:58.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-09T01:56:58.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-09T01:56:58.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-09T01:56:58.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-09T01:56:58.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-09T01:56:58.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-09T01:56:58.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-09T01:56:58.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-09T01:56:58.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-09T01:56:58.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-09T01:56:58.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-09T01:56:58.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-09T01:56:58.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-09T01:56:58.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-09T01:56:58.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-09T01:56:58.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-09T01:56:58.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-09T01:56:58.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-09T01:56:58.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-09T01:56:58.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-09T01:56:58.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-09T01:56:58.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-09T01:56:58.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-09T01:56:58.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-09T01:56:58.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-09T01:56:58.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-09T01:56:58.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-09T01:56:58.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-09T01:56:58.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-09T01:56:58.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-09T01:56:58.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-09T01:56:58.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-09T01:56:58.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-09T01:56:58.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-09T01:56:58.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-09T01:56:58.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-09T01:56:58.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-09T01:56:58.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-09T01:56:58.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-09T01:56:58.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-09T01:56:58.599 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/ 2023-07-09T01:56:58.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-09T01:56:58.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-09T01:56:58.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-09T01:56:58.600 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ 2023-07-09T01:56:58.600 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ 2023-07-09T01:56:58.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 264521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-09T01:56:58.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 849289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-09T01:56:58.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-09T01:56:58.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 320385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-09T01:56:58.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 96969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-09T01:56:58.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 271697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-09T01:56:58.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-09T01:56:58.601 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ 2023-07-09T01:56:58.601 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-09T01:56:58.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 492561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-09T01:56:58.602 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/ 2023-07-09T01:56:58.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 419217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-09T01:56:58.602 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/ 2023-07-09T01:56:58.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 738161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-09T01:56:58.603 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ 2023-07-09T01:56:58.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 296665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-09T01:56:58.604 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-09T01:56:58.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 153681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-09T01:56:58.604 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/ 2023-07-09T01:56:58.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 169017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-09T01:56:58.605 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ 2023-07-09T01:56:58.605 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-09T01:56:58.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-09T01:56:58.606 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ 2023-07-09T01:56:58.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-09T01:56:58.606 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ 2023-07-09T01:56:58.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-09T01:56:58.607 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ 2023-07-09T01:56:58.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-09T01:56:58.607 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ 2023-07-09T01:56:58.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-09T01:56:58.607 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ 2023-07-09T01:56:58.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/evbug.ko 2023-07-09T01:56:58.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ff-memless.ko 2023-07-09T01:56:58.608 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ 2023-07-09T01:56:58.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-09T01:56:58.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-09T01:56:58.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-09T01:56:58.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-09T01:56:58.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-09T01:56:58.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-09T01:56:58.609 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/ 2023-07-09T01:56:58.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-09T01:56:58.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-09T01:56:58.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-09T01:56:58.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-09T01:56:58.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-09T01:56:58.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-09T01:56:58.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-09T01:56:58.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8323.ko 2023-07-09T01:56:58.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8333.ko 2023-07-09T01:56:58.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-09T01:56:58.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-09T01:56:58.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-09T01:56:58.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-09T01:56:58.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-09T01:56:58.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-09T01:56:58.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt1070.ko 2023-07-09T01:56:58.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt2160.ko 2023-07-09T01:56:58.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-09T01:56:58.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/stowaway.ko 2023-07-09T01:56:58.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-09T01:56:58.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-09T01:56:58.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-09T01:56:58.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-09T01:56:58.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-09T01:56:58.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/matrix-keymap.ko 2023-07-09T01:56:58.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/ 2023-07-09T01:56:58.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-09T01:56:58.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-09T01:56:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-09T01:56:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-09T01:56:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-09T01:56:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 334505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/psmouse.ko 2023-07-09T01:56:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-09T01:56:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-09T01:56:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-09T01:56:58.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-09T01:56:58.614 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/ 2023-07-09T01:56:58.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-09T01:56:58.614 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ 2023-07-09T01:56:58.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-09T01:56:58.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-09T01:56:58.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ct82c710.ko 2023-07-09T01:56:58.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-09T01:56:58.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/parkbd.ko 2023-07-09T01:56:58.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/pcips2.ko 2023-07-09T01:56:58.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ps2mult.ko 2023-07-09T01:56:58.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-09T01:56:58.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serport.ko 2023-07-09T01:56:58.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-09T01:56:58.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/ 2023-07-09T01:56:58.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/ 2023-07-09T01:56:58.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-09T01:56:58.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/ 2023-07-09T01:56:58.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-88pm860x.ko 2023-07-09T01:56:58.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-adp5520.ko 2023-07-09T01:56:58.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-bd2802.ko 2023-07-09T01:56:58.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-09T01:56:58.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da903x.ko 2023-07-09T01:56:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da9052.ko 2023-07-09T01:56:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-gpio.ko 2023-07-09T01:56:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-09T01:56:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3533.ko 2023-07-09T01:56:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm355x.ko 2023-07-09T01:56:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3642.ko 2023-07-09T01:56:58.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-09T01:56:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp8788.ko 2023-07-09T01:56:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-max8997.ko 2023-07-09T01:56:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-mc13783.ko 2023-07-09T01:56:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-09T01:56:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca9532.ko 2023-07-09T01:56:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca955x.ko 2023-07-09T01:56:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca963x.ko 2023-07-09T01:56:58.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-09T01:56:58.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-tca6507.ko 2023-07-09T01:56:58.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-09T01:56:58.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm8350.ko 2023-07-09T01:56:58.619 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ 2023-07-09T01:56:58.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-09T01:56:58.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-09T01:56:58.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-09T01:56:58.620 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-09T01:56:58.620 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-09T01:56:58.620 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-09T01:56:58.621 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-09T01:56:58.621 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-09T01:56:58.621 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/ 2023-07-09T01:56:58.622 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/ 2023-07-09T01:56:58.622 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 631833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-09T01:56:58.622 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-09T01:56:58.622 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bufio.ko 2023-07-09T01:56:58.623 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-09T01:56:58.623 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 154273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-09T01:56:58.623 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 105673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-09T01:56:58.624 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-09T01:56:58.624 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-era.ko 2023-07-09T01:56:58.624 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-09T01:56:58.625 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-09T01:56:58.625 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log.ko 2023-07-09T01:56:58.625 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-mirror.ko 2023-07-09T01:56:58.625 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-09T01:56:58.626 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-09T01:56:58.626 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-09T01:56:58.626 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-region-hash.ko 2023-07-09T01:56:58.627 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-09T01:56:58.627 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-09T01:56:58.627 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-snapshot.ko 2023-07-09T01:56:58.627 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-09T01:56:58.627 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 182185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-09T01:56:58.628 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-09T01:56:58.628 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-zero.ko 2023-07-09T01:56:58.628 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-09T01:56:58.628 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-09T01:56:58.629 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-09T01:56:58.629 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/ 2023-07-09T01:56:58.629 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 192841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-09T01:56:58.629 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-09T01:56:58.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-09T01:56:58.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 157993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-09T01:56:58.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 392889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-09T01:56:58.630 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/ 2023-07-09T01:56:58.630 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/ 2023-07-09T01:56:58.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 174497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-09T01:56:58.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-09T01:56:58.630 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-09T01:56:58.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-09T01:56:58.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-09T01:56:58.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-09T01:56:58.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-09T01:56:58.631 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ 2023-07-09T01:56:58.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm800.ko 2023-07-09T01:56:58.631 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm805.ko 2023-07-09T01:56:58.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm80x.ko 2023-07-09T01:56:58.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona-i2c.ko 2023-07-09T01:56:58.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 121833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona.ko 2023-07-09T01:56:58.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/bcm590xx.ko 2023-07-09T01:56:58.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-09T01:56:58.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/dln2.ko 2023-07-09T01:56:58.632 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/janz-cmodio.ko 2023-07-09T01:56:58.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/kempld-core.ko 2023-07-09T01:56:58.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-core.ko 2023-07-09T01:56:58.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-09T01:56:58.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lp3943.ko 2023-07-09T01:56:58.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-09T01:56:58.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-09T01:56:58.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/max8907.ko 2023-07-09T01:56:58.633 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-09T01:56:58.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-09T01:56:58.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/menf21bmc.ko 2023-07-09T01:56:58.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-09T01:56:58.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-09T01:56:58.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633.ko 2023-07-09T01:56:58.634 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-09T01:56:58.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/retu-mfd.ko 2023-07-09T01:56:58.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/si476x-core.ko 2023-07-09T01:56:58.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-09T01:56:58.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-09T01:56:58.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps65010.ko 2023-07-09T01:56:58.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps6507x.ko 2023-07-09T01:56:58.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-09T01:56:58.635 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-09T01:56:58.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-09T01:56:58.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wm8994.ko 2023-07-09T01:56:58.636 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ 2023-07-09T01:56:58.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-09T01:56:58.636 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot.ko 2023-07-09T01:56:58.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/ 2023-07-09T01:56:58.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-09T01:56:58.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-09T01:56:58.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-09T01:56:58.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-09T01:56:58.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/ 2023-07-09T01:56:58.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-09T01:56:58.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/core.ko 2023-07-09T01:56:58.638 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/ 2023-07-09T01:56:58.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-09T01:56:58.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ds1682.ko 2023-07-09T01:56:58.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/dummy-irq.ko 2023-07-09T01:56:58.638 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/ 2023-07-09T01:56:58.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/echo.ko 2023-07-09T01:56:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/ 2023-07-09T01:56:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-09T01:56:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-09T01:56:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-09T01:56:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-09T01:56:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-09T01:56:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/ 2023-07-09T01:56:58.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 152073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-09T01:56:58.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hmc6352.ko 2023-07-09T01:56:58.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-09T01:56:58.640 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ 2023-07-09T01:56:58.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-09T01:56:58.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ics932s401.ko 2023-07-09T01:56:58.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-09T01:56:58.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-09T01:56:58.641 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/ 2023-07-09T01:56:58.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-09T01:56:58.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-09T01:56:58.641 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/ 2023-07-09T01:56:58.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-09T01:56:58.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-09T01:56:58.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 304465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-09T01:56:58.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/phantom.ko 2023-07-09T01:56:58.642 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/ 2023-07-09T01:56:58.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-09T01:56:58.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-09T01:56:58.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-09T01:56:58.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-09T01:56:58.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-09T01:56:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/ 2023-07-09T01:56:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 180817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-09T01:56:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ 2023-07-09T01:56:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/ 2023-07-09T01:56:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 487993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-09T01:56:58.643 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/ 2023-07-09T01:56:58.644 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/ 2023-07-09T01:56:58.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-09T01:56:58.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-09T01:56:58.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-09T01:56:58.644 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-09T01:56:58.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 447289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-09T01:56:58.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-09T01:56:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-09T01:56:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ 2023-07-09T01:56:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/ 2023-07-09T01:56:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-09T01:56:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-09T01:56:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 130489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-09T01:56:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-09T01:56:58.645 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ 2023-07-09T01:56:58.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-09T01:56:58.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-09T01:56:58.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-09T01:56:58.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-09T01:56:58.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/ 2023-07-09T01:56:58.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-09T01:56:58.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/ 2023-07-09T01:56:58.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-09T01:56:58.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/ 2023-07-09T01:56:58.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-09T01:56:58.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/ 2023-07-09T01:56:58.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-09T01:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/ 2023-07-09T01:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-09T01:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-09T01:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-09T01:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/ 2023-07-09T01:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-09T01:56:58.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-09T01:56:58.649 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-09T01:56:58.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-09T01:56:58.649 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-09T01:56:58.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-09T01:56:58.649 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-09T01:56:58.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-09T01:56:58.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-09T01:56:58.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/ 2023-07-09T01:56:58.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-09T01:56:58.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 176817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-09T01:56:58.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-09T01:56:58.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1422209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-09T01:56:58.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 127993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-09T01:56:58.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-09T01:56:58.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 131241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-09T01:56:58.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 312097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-09T01:56:58.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/ 2023-07-09T01:56:58.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-09T01:56:58.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 323601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-09T01:56:58.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/ 2023-07-09T01:56:58.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-09T01:56:58.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 193433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-09T01:56:58.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-09T01:56:58.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 345929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-09T01:56:58.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-09T01:56:58.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1038969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-09T01:56:58.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-09T01:56:58.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-09T01:56:58.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-09T01:56:58.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-09T01:56:58.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/ 2023-07-09T01:56:58.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-09T01:56:58.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 203537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-09T01:56:58.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/ 2023-07-09T01:56:58.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-09T01:56:58.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-09T01:56:58.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-09T01:56:58.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-09T01:56:58.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-09T01:56:58.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-09T01:56:58.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-09T01:56:58.746 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/ 2023-07-09T01:56:58.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-09T01:56:58.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-09T01:56:58.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-09T01:56:58.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-09T01:56:58.747 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/ 2023-07-09T01:56:58.747 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-09T01:56:58.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 281033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-09T01:56:58.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-09T01:56:58.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-09T01:56:58.748 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/ 2023-07-09T01:56:58.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-09T01:56:58.748 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ 2023-07-09T01:56:58.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-09T01:56:58.748 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-09T01:56:58.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-09T01:56:58.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-09T01:56:58.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 584001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-09T01:56:58.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-09T01:56:58.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 246321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-09T01:56:58.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-09T01:56:58.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 922401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-09T01:56:58.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-09T01:56:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 301689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-09T01:56:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/ 2023-07-09T01:56:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 514641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-09T01:56:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-09T01:56:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-09T01:56:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-09T01:56:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 734081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-09T01:56:58.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-09T01:56:58.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 151865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-09T01:56:58.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-09T01:56:58.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/ 2023-07-09T01:56:58.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-09T01:56:58.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-09T01:56:58.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-09T01:56:58.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/ 2023-07-09T01:56:58.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-09T01:56:58.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 710481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-09T01:56:58.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 280513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-09T01:56:58.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-09T01:56:58.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-09T01:56:58.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1054153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-09T01:56:58.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ 2023-07-09T01:56:58.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-09T01:56:58.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-09T01:56:58.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-09T01:56:58.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 95665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-09T01:56:58.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/ 2023-07-09T01:56:58.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-09T01:56:58.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-09T01:56:58.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ 2023-07-09T01:56:58.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-09T01:56:58.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-09T01:56:58.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/ 2023-07-09T01:56:58.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 150905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-09T01:56:58.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/ 2023-07-09T01:56:58.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 136785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-09T01:56:58.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/ 2023-07-09T01:56:58.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-09T01:56:58.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-09T01:56:58.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/ 2023-07-09T01:56:58.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-09T01:56:58.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 227113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-09T01:56:58.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-09T01:56:58.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-09T01:56:58.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 671393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-09T01:56:58.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/ 2023-07-09T01:56:58.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-09T01:56:58.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/ 2023-07-09T01:56:58.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-09T01:56:58.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-09T01:56:58.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-09T01:56:58.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-09T01:56:58.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/ 2023-07-09T01:56:58.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-09T01:56:58.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-09T01:56:58.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/ 2023-07-09T01:56:58.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 893097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-09T01:56:58.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/ 2023-07-09T01:56:58.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-09T01:56:58.758 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/ 2023-07-09T01:56:58.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-09T01:56:58.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-09T01:56:58.758 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/ 2023-07-09T01:56:58.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-09T01:56:58.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-09T01:56:58.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-09T01:56:58.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-09T01:56:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/ 2023-07-09T01:56:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-09T01:56:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-09T01:56:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-09T01:56:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-09T01:56:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 480865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-09T01:56:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/ 2023-07-09T01:56:58.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-09T01:56:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-09T01:56:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-09T01:56:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-09T01:56:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/ 2023-07-09T01:56:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-09T01:56:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/ 2023-07-09T01:56:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-09T01:56:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/ 2023-07-09T01:56:58.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-09T01:56:58.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-09T01:56:58.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/ 2023-07-09T01:56:58.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-09T01:56:58.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-09T01:56:58.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/ 2023-07-09T01:56:58.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-09T01:56:58.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/ 2023-07-09T01:56:58.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/defxx.ko 2023-07-09T01:56:58.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/ 2023-07-09T01:56:58.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 216913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-09T01:56:58.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-09T01:56:58.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/ 2023-07-09T01:56:58.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 234553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-09T01:56:58.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/ 2023-07-09T01:56:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-09T01:56:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-09T01:56:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ 2023-07-09T01:56:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-09T01:56:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-09T01:56:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-09T01:56:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/ 2023-07-09T01:56:58.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-09T01:56:58.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-09T01:56:58.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-09T01:56:58.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-09T01:56:58.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-09T01:56:58.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-09T01:56:58.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-09T01:56:58.764 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/ 2023-07-09T01:56:58.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-09T01:56:58.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-09T01:56:58.765 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ 2023-07-09T01:56:58.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-09T01:56:58.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-09T01:56:58.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-09T01:56:58.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-09T01:56:58.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-09T01:56:58.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-09T01:56:58.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-09T01:56:58.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-09T01:56:58.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-09T01:56:58.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-09T01:56:58.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-09T01:56:58.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-09T01:56:58.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-09T01:56:58.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 92249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-09T01:56:58.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-09T01:56:58.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-09T01:56:58.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-09T01:56:58.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-09T01:56:58.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-09T01:56:58.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/ 2023-07-09T01:56:58.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/plip.ko 2023-07-09T01:56:58.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ 2023-07-09T01:56:58.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-09T01:56:58.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-09T01:56:58.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-09T01:56:58.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-09T01:56:58.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-09T01:56:58.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-09T01:56:58.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-09T01:56:58.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-09T01:56:58.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sb1000.ko 2023-07-09T01:56:58.769 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/ 2023-07-09T01:56:58.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-09T01:56:58.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-09T01:56:58.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-09T01:56:58.769 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/ 2023-07-09T01:56:58.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-09T01:56:58.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-09T01:56:58.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-09T01:56:58.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-09T01:56:58.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-09T01:56:58.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-09T01:56:58.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-09T01:56:58.770 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/ 2023-07-09T01:56:58.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 120497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-09T01:56:58.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/ 2023-07-09T01:56:58.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 290161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-09T01:56:58.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/ 2023-07-09T01:56:58.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-09T01:56:58.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ 2023-07-09T01:56:58.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-09T01:56:58.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/ 2023-07-09T01:56:58.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/ 2023-07-09T01:56:58.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 256953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-09T01:56:58.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-09T01:56:58.772 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/ 2023-07-09T01:56:58.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-09T01:56:58.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-09T01:56:58.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-09T01:56:58.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-09T01:56:58.772 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/ 2023-07-09T01:56:58.773 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/ 2023-07-09T01:56:58.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-09T01:56:58.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-09T01:56:58.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-09T01:56:58.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pci-stub.ko 2023-07-09T01:56:58.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-09T01:56:58.773 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/ 2023-07-09T01:56:58.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-09T01:56:58.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia.ko 2023-07-09T01:56:58.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-09T01:56:58.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-09T01:56:58.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-09T01:56:58.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-09T01:56:58.774 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/ 2023-07-09T01:56:58.774 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/ 2023-07-09T01:56:58.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-09T01:56:58.775 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/ 2023-07-09T01:56:58.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-09T01:56:58.775 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/ 2023-07-09T01:56:58.775 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/ 2023-07-09T01:56:58.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-09T01:56:58.775 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/ 2023-07-09T01:56:58.775 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/ 2023-07-09T01:56:58.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-09T01:56:58.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-09T01:56:58.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-09T01:56:58.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-09T01:56:58.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-09T01:56:58.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-09T01:56:58.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-09T01:56:58.776 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ 2023-07-09T01:56:58.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-09T01:56:58.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-09T01:56:58.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-09T01:56:58.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-09T01:56:58.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-09T01:56:58.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-09T01:56:58.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-09T01:56:58.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-09T01:56:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-09T01:56:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-09T01:56:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-09T01:56:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-09T01:56:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-09T01:56:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/ 2023-07-09T01:56:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-09T01:56:58.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-09T01:56:58.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-09T01:56:58.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-09T01:56:58.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-09T01:56:58.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-09T01:56:58.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-09T01:56:58.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-09T01:56:58.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-09T01:56:58.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-09T01:56:58.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-09T01:56:58.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-09T01:56:58.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-09T01:56:58.780 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/ 2023-07-09T01:56:58.780 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ 2023-07-09T01:56:58.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-09T01:56:58.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-09T01:56:58.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-09T01:56:58.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-09T01:56:58.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-09T01:56:58.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-09T01:56:58.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9030_battery.ko 2023-07-09T01:56:58.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9052-battery.ko 2023-07-09T01:56:58.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-09T01:56:58.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-09T01:56:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-09T01:56:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-09T01:56:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/gpio-charger.ko 2023-07-09T01:56:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-09T01:56:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-09T01:56:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max14577_charger.ko 2023-07-09T01:56:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17040_battery.ko 2023-07-09T01:56:58.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17042_battery.ko 2023-07-09T01:56:58.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8903_charger.ko 2023-07-09T01:56:58.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8925_power.ko 2023-07-09T01:56:58.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-09T01:56:58.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/sbs-battery.ko 2023-07-09T01:56:58.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/test_power.ko 2023-07-09T01:56:58.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-09T01:56:58.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-09T01:56:58.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_power.ko 2023-07-09T01:56:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm8350_power.ko 2023-07-09T01:56:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/ 2023-07-09T01:56:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-09T01:56:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-09T01:56:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/ 2023-07-09T01:56:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/ 2023-07-09T01:56:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-09T01:56:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-09T01:56:58.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-09T01:56:58.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-09T01:56:58.785 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ 2023-07-09T01:56:58.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-09T01:56:58.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-09T01:56:58.785 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/ 2023-07-09T01:56:58.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-09T01:56:58.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-09T01:56:58.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-09T01:56:58.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-09T01:56:58.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9052.ko 2023-07-09T01:56:58.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9055.ko 2023-07-09T01:56:58.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9063.ko 2023-07-09T01:56:58.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-09T01:56:58.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-09T01:56:58.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-09T01:56:58.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-09T01:56:58.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-09T01:56:58.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-09T01:56:58.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-09T01:56:58.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-09T01:56:58.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-09T01:56:58.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-09T01:56:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-09T01:56:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-09T01:56:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-09T01:56:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-09T01:56:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-09T01:56:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-09T01:56:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-09T01:56:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-09T01:56:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-09T01:56:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8907.ko 2023-07-09T01:56:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8925.ko 2023-07-09T01:56:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8997.ko 2023-07-09T01:56:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8998.ko 2023-07-09T01:56:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-09T01:56:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-09T01:56:58.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-palmas.ko 2023-07-09T01:56:58.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-09T01:56:58.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-09T01:56:58.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-09T01:56:58.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-09T01:56:58.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-09T01:56:58.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-09T01:56:58.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-09T01:56:58.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-09T01:56:58.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-09T01:56:58.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-09T01:56:58.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-09T01:56:58.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-09T01:56:58.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-09T01:56:58.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-09T01:56:58.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-09T01:56:58.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-09T01:56:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-09T01:56:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-09T01:56:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-09T01:56:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ 2023-07-09T01:56:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-09T01:56:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-09T01:56:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-09T01:56:58.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 135169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-09T01:56:58.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-09T01:56:58.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/ 2023-07-09T01:56:58.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 272353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-09T01:56:58.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-09T01:56:58.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/ 2023-07-09T01:56:58.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 356201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-09T01:56:58.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-09T01:56:58.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/ 2023-07-09T01:56:58.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-09T01:56:58.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-09T01:56:58.794 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/ 2023-07-09T01:56:58.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-09T01:56:58.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-09T01:56:58.794 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/ 2023-07-09T01:56:58.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 246897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-09T01:56:58.794 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/ 2023-07-09T01:56:58.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1172185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-09T01:56:58.795 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/ 2023-07-09T01:56:58.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 237169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-09T01:56:58.795 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/ 2023-07-09T01:56:58.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-09T01:56:58.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-09T01:56:58.795 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/ 2023-07-09T01:56:58.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 308889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-09T01:56:58.796 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/ 2023-07-09T01:56:58.796 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-09T01:56:58.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-09T01:56:58.796 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-09T01:56:58.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-09T01:56:58.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-09T01:56:58.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-09T01:56:58.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-09T01:56:58.797 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/ 2023-07-09T01:56:58.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 212401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-09T01:56:58.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-09T01:56:58.797 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/ 2023-07-09T01:56:58.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-09T01:56:58.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 155089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-09T01:56:58.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fdomain.ko 2023-07-09T01:56:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/ 2023-07-09T01:56:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 262073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-09T01:56:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 201793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-09T01:56:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-09T01:56:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-09T01:56:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/imm.ko 2023-07-09T01:56:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-09T01:56:58.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 266521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-09T01:56:58.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-09T01:56:58.799 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/ 2023-07-09T01:56:58.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 317249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-09T01:56:58.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-09T01:56:58.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-09T01:56:58.799 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/ 2023-07-09T01:56:58.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 308313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-09T01:56:58.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 140225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-09T01:56:58.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-09T01:56:58.800 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/ 2023-07-09T01:56:58.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 213041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-09T01:56:58.800 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/ 2023-07-09T01:56:58.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2193865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-09T01:56:58.800 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/ 2023-07-09T01:56:58.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-09T01:56:58.800 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-09T01:56:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 310729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-09T01:56:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-09T01:56:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/ 2023-07-09T01:56:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 659577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-09T01:56:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/ 2023-07-09T01:56:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-09T01:56:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-09T01:56:58.801 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/ 2023-07-09T01:56:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-09T01:56:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-09T01:56:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-09T01:56:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-09T01:56:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/ 2023-07-09T01:56:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 361433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-09T01:56:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-09T01:56:58.802 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ppa.ko 2023-07-09T01:56:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-09T01:56:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/ 2023-07-09T01:56:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1850945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-09T01:56:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-09T01:56:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/ 2023-07-09T01:56:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 558865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-09T01:56:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qlogicfas408.ko 2023-07-09T01:56:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-09T01:56:58.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 238737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-09T01:56:58.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 171865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-09T01:56:58.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 270161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-09T01:56:58.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-09T01:56:58.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-09T01:56:58.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-09T01:56:58.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-09T01:56:58.804 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-09T01:56:58.805 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-09T01:56:58.805 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-09T01:56:58.805 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 162121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-09T01:56:58.805 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-09T01:56:58.805 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-09T01:56:58.805 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-09T01:56:58.805 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/xen-scsifront.ko 2023-07-09T01:56:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ 2023-07-09T01:56:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 127025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-09T01:56:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/ 2023-07-09T01:56:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/ 2023-07-09T01:56:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 733905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-09T01:56:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/ 2023-07-09T01:56:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-09T01:56:58.806 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-09T01:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-09T01:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 920793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-09T01:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-09T01:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-09T01:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/ 2023-07-09T01:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-09T01:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/ 2023-07-09T01:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/ 2023-07-09T01:56:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-09T01:56:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-09T01:56:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-09T01:56:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-09T01:56:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-09T01:56:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-09T01:56:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-09T01:56:58.808 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-09T01:56:58.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-09T01:56:58.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-09T01:56:58.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-09T01:56:58.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-09T01:56:58.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-09T01:56:58.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-09T01:56:58.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-09T01:56:58.809 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-09T01:56:58.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-09T01:56:58.810 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ 2023-07-09T01:56:58.810 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ 2023-07-09T01:56:58.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-09T01:56:58.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/moxa.ko 2023-07-09T01:56:58.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/mxser.ko 2023-07-09T01:56:58.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-09T01:56:58.810 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-09T01:56:58.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-09T01:56:58.811 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/ 2023-07-09T01:56:58.811 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/ 2023-07-09T01:56:58.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-09T01:56:58.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-09T01:56:58.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-09T01:56:58.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_uart.ko 2023-07-09T01:56:58.811 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-09T01:56:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-09T01:56:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/ 2023-07-09T01:56:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-09T01:56:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/rp2.ko 2023-07-09T01:56:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-09T01:56:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-09T01:56:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/ 2023-07-09T01:56:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ 2023-07-09T01:56:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 519393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-09T01:56:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ 2023-07-09T01:56:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-09T01:56:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-09T01:56:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/ 2023-07-09T01:56:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-09T01:56:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-09T01:56:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-09T01:56:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-09T01:56:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_mf624.ko 2023-07-09T01:56:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_netx.ko 2023-07-09T01:56:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-09T01:56:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-09T01:56:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-09T01:56:58.814 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/ 2023-07-09T01:56:58.815 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/ 2023-07-09T01:56:58.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-09T01:56:58.815 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ 2023-07-09T01:56:58.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 142529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-09T01:56:58.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-09T01:56:58.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-09T01:56:58.815 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-09T01:56:58.815 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/ 2023-07-09T01:56:58.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-09T01:56:58.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-09T01:56:58.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-09T01:56:58.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-09T01:56:58.816 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ 2023-07-09T01:56:58.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ulpi.ko 2023-07-09T01:56:58.816 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/ 2023-07-09T01:56:58.816 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-09T01:56:58.817 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/ 2023-07-09T01:56:58.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-09T01:56:58.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-09T01:56:58.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 441593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-09T01:56:58.817 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/ 2023-07-09T01:56:58.817 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/ 2023-07-09T01:56:58.817 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-09T01:56:58.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-09T01:56:58.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-09T01:56:58.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-09T01:56:58.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-09T01:56:58.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-09T01:56:58.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 91929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-09T01:56:58.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-09T01:56:58.818 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 118017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-09T01:56:58.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-09T01:56:58.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-09T01:56:58.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-09T01:56:58.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-09T01:56:58.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-09T01:56:58.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-09T01:56:58.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-09T01:56:58.819 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-09T01:56:58.820 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/ 2023-07-09T01:56:58.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-09T01:56:58.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-09T01:56:58.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-09T01:56:58.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-09T01:56:58.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-09T01:56:58.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-09T01:56:58.820 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-09T01:56:58.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-09T01:56:58.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-09T01:56:58.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-09T01:56:58.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-09T01:56:58.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-09T01:56:58.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-09T01:56:58.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-09T01:56:58.821 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 157009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-09T01:56:58.822 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/ 2023-07-09T01:56:58.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-09T01:56:58.822 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-09T01:56:58.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 157665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-09T01:56:58.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-09T01:56:58.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-09T01:56:58.822 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-09T01:56:58.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-09T01:56:58.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-09T01:56:58.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-09T01:56:58.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-09T01:56:58.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 65793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-09T01:56:58.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-09T01:56:58.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-09T01:56:58.823 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 146001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-09T01:56:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ 2023-07-09T01:56:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-09T01:56:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-09T01:56:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-09T01:56:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-09T01:56:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-09T01:56:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811_cs.ko 2023-07-09T01:56:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-09T01:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-09T01:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/ 2023-07-09T01:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-09T01:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-09T01:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ 2023-07-09T01:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-09T01:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-09T01:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-09T01:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cytherm.ko 2023-07-09T01:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ehset.ko 2023-07-09T01:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-09T01:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-09T01:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-09T01:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-09T01:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-09T01:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-09T01:56:58.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-09T01:56:58.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-09T01:56:58.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/lvstest.ko 2023-07-09T01:56:58.827 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/ 2023-07-09T01:56:58.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-09T01:56:58.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-09T01:56:58.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-09T01:56:58.827 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-09T01:56:58.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-09T01:56:58.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbtest.ko 2023-07-09T01:56:58.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-09T01:56:58.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-09T01:56:58.828 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/ 2023-07-09T01:56:58.828 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/usbmon.ko 2023-07-09T01:56:58.828 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/ 2023-07-09T01:56:58.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-09T01:56:58.829 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/ 2023-07-09T01:56:58.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-09T01:56:58.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-09T01:56:58.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-09T01:56:58.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-09T01:56:58.829 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ 2023-07-09T01:56:58.829 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-09T01:56:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-09T01:56:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-09T01:56:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-09T01:56:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-09T01:56:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-09T01:56:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-09T01:56:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-09T01:56:58.830 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-09T01:56:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/f81232.ko 2023-07-09T01:56:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 174841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-09T01:56:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-09T01:56:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 136945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-09T01:56:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-09T01:56:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-09T01:56:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-09T01:56:58.831 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-09T01:56:58.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-09T01:56:58.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-09T01:56:58.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-09T01:56:58.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-09T01:56:58.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-09T01:56:58.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-09T01:56:58.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/metro-usb.ko 2023-07-09T01:56:58.832 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-09T01:56:58.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-09T01:56:58.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mxuport.ko 2023-07-09T01:56:58.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-09T01:56:58.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-09T01:56:58.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-09T01:56:58.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-09T01:56:58.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-09T01:56:58.833 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-09T01:56:58.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-09T01:56:58.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-09T01:56:58.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-09T01:56:58.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-09T01:56:58.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-09T01:56:58.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-09T01:56:58.834 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-09T01:56:58.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-09T01:56:58.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-09T01:56:58.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-09T01:56:58.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-09T01:56:58.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-09T01:56:58.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usbserial.ko 2023-07-09T01:56:58.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-09T01:56:58.835 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-09T01:56:58.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-09T01:56:58.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-09T01:56:58.836 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ 2023-07-09T01:56:58.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-09T01:56:58.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-09T01:56:58.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-09T01:56:58.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-09T01:56:58.836 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-09T01:56:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-09T01:56:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-09T01:56:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-09T01:56:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-09T01:56:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-09T01:56:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-09T01:56:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-09T01:56:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-09T01:56:58.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-09T01:56:58.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 177153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-09T01:56:58.838 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/ 2023-07-09T01:56:58.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 65761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-09T01:56:58.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-09T01:56:58.838 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 105401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-09T01:56:58.838 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/ 2023-07-09T01:56:58.838 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/ 2023-07-09T01:56:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 145817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-09T01:56:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-09T01:56:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-09T01:56:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-09T01:56:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/ 2023-07-09T01:56:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 96017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-09T01:56:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-09T01:56:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-09T01:56:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-09T01:56:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/ 2023-07-09T01:56:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/ 2023-07-09T01:56:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-09T01:56:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-09T01:56:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-09T01:56:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-09T01:56:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-09T01:56:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-09T01:56:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-09T01:56:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/bd6107.ko 2023-07-09T01:56:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-09T01:56:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-09T01:56:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-09T01:56:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-09T01:56:58.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-09T01:56:58.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-09T01:56:58.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-09T01:56:58.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-09T01:56:58.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-09T01:56:58.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-09T01:56:58.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-09T01:56:58.842 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-09T01:56:58.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-09T01:56:58.843 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/ 2023-07-09T01:56:58.843 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ 2023-07-09T01:56:58.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-09T01:56:58.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-09T01:56:58.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-09T01:56:58.843 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-09T01:56:58.843 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/ 2023-07-09T01:56:58.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-09T01:56:58.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-09T01:56:58.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-09T01:56:58.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-09T01:56:58.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-09T01:56:58.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-09T01:56:58.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-09T01:56:58.844 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-09T01:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-09T01:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-09T01:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-09T01:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-09T01:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ 2023-07-09T01:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/acquirewdt.ko 2023-07-09T01:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/advantechwdt.ko 2023-07-09T01:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-09T01:56:58.846 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-09T01:56:58.846 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-09T01:56:58.846 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-09T01:56:58.846 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-09T01:56:58.846 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-09T01:56:58.846 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/dw_wdt.ko 2023-07-09T01:56:58.846 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-09T01:56:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-09T01:56:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-09T01:56:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-09T01:56:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-09T01:56:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-09T01:56:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-09T01:56:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-09T01:56:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-09T01:56:58.848 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-09T01:56:58.848 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-09T01:56:58.848 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-09T01:56:58.848 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-09T01:56:58.848 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-09T01:56:58.848 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-09T01:56:58.848 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-09T01:56:58.848 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-09T01:56:58.849 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-09T01:56:58.849 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-09T01:56:58.849 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-09T01:56:58.849 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/retu_wdt.ko 2023-07-09T01:56:58.849 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-09T01:56:58.849 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-09T01:56:58.849 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-09T01:56:58.849 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-09T01:56:58.850 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-09T01:56:58.850 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-09T01:56:58.850 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-09T01:56:58.850 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-09T01:56:58.850 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-09T01:56:58.850 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-09T01:56:58.850 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-09T01:56:58.850 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-09T01:56:58.851 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-09T01:56:58.851 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-09T01:56:58.851 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-09T01:56:58.851 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-09T01:56:58.851 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-09T01:56:58.851 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-09T01:56:58.851 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/ 2023-07-09T01:56:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-09T01:56:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-09T01:56:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-09T01:56:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/ 2023-07-09T01:56:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 176353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-09T01:56:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-09T01:56:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-scsiback.ko 2023-07-09T01:56:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/ 2023-07-09T01:56:58.853 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-09T01:56:58.853 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ 2023-07-09T01:56:58.853 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/ 2023-07-09T01:56:58.853 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 165513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-09T01:56:58.853 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/ 2023-07-09T01:56:58.853 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/adfs.ko 2023-07-09T01:56:58.853 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/ 2023-07-09T01:56:58.853 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 162625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-09T01:56:58.854 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/ 2023-07-09T01:56:58.854 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 924297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/kafs.ko 2023-07-09T01:56:58.854 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/ 2023-07-09T01:56:58.854 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/autofs4.ko 2023-07-09T01:56:58.854 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/ 2023-07-09T01:56:58.854 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-09T01:56:58.854 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/ 2023-07-09T01:56:58.854 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/bfs.ko 2023-07-09T01:56:58.855 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-09T01:56:58.855 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/ 2023-07-09T01:56:58.855 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 3447409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-09T01:56:58.855 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/ 2023-07-09T01:56:58.855 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 300025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-09T01:56:58.855 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ 2023-07-09T01:56:58.855 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1308201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-09T01:56:58.855 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/ 2023-07-09T01:56:58.856 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-09T01:56:58.856 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/ 2023-07-09T01:56:58.856 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 105969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/configfs.ko 2023-07-09T01:56:58.856 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/ 2023-07-09T01:56:58.856 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-09T01:56:58.856 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/ 2023-07-09T01:56:58.856 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 631425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-09T01:56:58.857 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/ 2023-07-09T01:56:58.857 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/efs.ko 2023-07-09T01:56:58.857 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/ 2023-07-09T01:56:58.857 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1473049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-09T01:56:58.857 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/ 2023-07-09T01:56:58.857 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-09T01:56:58.857 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/ 2023-07-09T01:56:58.857 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/freevxfs.ko 2023-07-09T01:56:58.858 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/ 2023-07-09T01:56:58.858 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 218713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-09T01:56:58.858 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/ 2023-07-09T01:56:58.858 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-09T01:56:58.858 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/ 2023-07-09T01:56:58.858 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1221129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-09T01:56:58.858 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/ 2023-07-09T01:56:58.858 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-09T01:56:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/ 2023-07-09T01:56:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 221561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-09T01:56:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/ 2023-07-09T01:56:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 193585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/hpfs.ko 2023-07-09T01:56:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/ 2023-07-09T01:56:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-09T01:56:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/ 2023-07-09T01:56:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 420425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-09T01:56:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/ 2023-07-09T01:56:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 276953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-09T01:56:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/ 2023-07-09T01:56:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-09T01:56:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/ 2023-07-09T01:56:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 128665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-09T01:56:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/ 2023-07-09T01:56:58.860 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/ 2023-07-09T01:56:58.861 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-09T01:56:58.861 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/ 2023-07-09T01:56:58.861 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-09T01:56:58.861 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/ 2023-07-09T01:56:58.861 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 117705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-09T01:56:58.861 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1002089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-09T01:56:58.861 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv2.ko 2023-07-09T01:56:58.861 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-09T01:56:58.862 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2003425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-09T01:56:58.862 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/ 2023-07-09T01:56:58.862 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-09T01:56:58.862 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-09T01:56:58.862 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/ 2023-07-09T01:56:58.862 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1407977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-09T01:56:58.862 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/ 2023-07-09T01:56:58.863 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 589433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-09T01:56:58.863 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/ 2023-07-09T01:56:58.863 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-09T01:56:58.863 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-09T01:56:58.863 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-09T01:56:58.863 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-09T01:56:58.863 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-09T01:56:58.863 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-09T01:56:58.864 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-09T01:56:58.864 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-09T01:56:58.864 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-09T01:56:58.864 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-09T01:56:58.864 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-09T01:56:58.864 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_ascii.ko 2023-07-09T01:56:58.864 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-09T01:56:58.864 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-09T01:56:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-09T01:56:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-09T01:56:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-09T01:56:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-09T01:56:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-09T01:56:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-09T01:56:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-09T01:56:58.865 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-09T01:56:58.866 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-09T01:56:58.866 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-09T01:56:58.866 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-09T01:56:58.866 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-09T01:56:58.866 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-09T01:56:58.866 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-09T01:56:58.866 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-09T01:56:58.866 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-09T01:56:58.867 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-09T01:56:58.867 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 142673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-09T01:56:58.867 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 165745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-09T01:56:58.867 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 118121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-09T01:56:58.867 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-09T01:56:58.867 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-09T01:56:58.867 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-09T01:56:58.867 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-09T01:56:58.868 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-09T01:56:58.868 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-09T01:56:58.868 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-09T01:56:58.868 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-09T01:56:58.868 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-09T01:56:58.868 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-09T01:56:58.868 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-09T01:56:58.868 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-09T01:56:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-09T01:56:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-09T01:56:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-09T01:56:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-09T01:56:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ 2023-07-09T01:56:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 219081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ntfs.ko 2023-07-09T01:56:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ 2023-07-09T01:56:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ 2023-07-09T01:56:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 241241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-09T01:56:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ 2023-07-09T01:56:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 439625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-09T01:56:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ 2023-07-09T01:56:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-09T01:56:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2511665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-09T01:56:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-09T01:56:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-09T01:56:58.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-09T01:56:58.871 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/ 2023-07-09T01:56:58.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/omfs.ko 2023-07-09T01:56:58.871 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/ 2023-07-09T01:56:58.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 320689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-09T01:56:58.871 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ 2023-07-09T01:56:58.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-09T01:56:58.872 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/ 2023-07-09T01:56:58.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/qnx4.ko 2023-07-09T01:56:58.872 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/ 2023-07-09T01:56:58.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/qnx6.ko 2023-07-09T01:56:58.872 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/ 2023-07-09T01:56:58.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_tree.ko 2023-07-09T01:56:58.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v1.ko 2023-07-09T01:56:58.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v2.ko 2023-07-09T01:56:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/ 2023-07-09T01:56:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 530697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-09T01:56:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/ 2023-07-09T01:56:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-09T01:56:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/ 2023-07-09T01:56:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/ 2023-07-09T01:56:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2622729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-09T01:56:58.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/ 2023-07-09T01:56:58.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-09T01:56:58.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-09T01:56:58.874 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/ 2023-07-09T01:56:58.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 131689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-09T01:56:58.874 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/ 2023-07-09T01:56:58.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-09T01:56:58.874 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/ 2023-07-09T01:56:58.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 248257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-09T01:56:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ 2023-07-09T01:56:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 160857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-09T01:56:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/ 2023-07-09T01:56:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 3854977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-09T01:56:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/ 2023-07-09T01:56:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/ 2023-07-09T01:56:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/locktorture.ko 2023-07-09T01:56:58.875 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/ 2023-07-09T01:56:58.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/test_udelay.ko 2023-07-09T01:56:58.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-09T01:56:58.876 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ 2023-07-09T01:56:58.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-09T01:56:58.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc7.ko 2023-07-09T01:56:58.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-09T01:56:58.876 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/ 2023-07-09T01:56:58.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-09T01:56:58.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-09T01:56:58.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/interval_tree_test.ko 2023-07-09T01:56:58.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-09T01:56:58.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-09T01:56:58.877 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/ 2023-07-09T01:56:58.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-09T01:56:58.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-09T01:56:58.877 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/ 2023-07-09T01:56:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-09T01:56:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/memory-notifier-error-inject.ko 2023-07-09T01:56:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/notifier-error-inject.ko 2023-07-09T01:56:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/percpu_test.ko 2023-07-09T01:56:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/pm-notifier-error-inject.ko 2023-07-09T01:56:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/ 2023-07-09T01:56:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 142369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-09T01:56:58.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/rbtree_test.ko 2023-07-09T01:56:58.879 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/ 2023-07-09T01:56:58.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-09T01:56:58.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-kstrtox.ko 2023-07-09T01:56:58.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-string_helpers.ko 2023-07-09T01:56:58.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4760825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_bpf.ko 2023-07-09T01:56:58.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_firmware.ko 2023-07-09T01:56:58.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_module.ko 2023-07-09T01:56:58.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_user_copy.ko 2023-07-09T01:56:58.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-09T01:56:58.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-09T01:56:58.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-09T01:56:58.880 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/ 2023-07-09T01:56:58.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/xz_dec_test.ko 2023-07-09T01:56:58.880 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/ 2023-07-09T01:56:58.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-09T01:56:58.881 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ 2023-07-09T01:56:58.881 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/ 2023-07-09T01:56:58.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-09T01:56:58.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-09T01:56:58.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-09T01:56:58.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-09T01:56:58.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-09T01:56:58.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-09T01:56:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-09T01:56:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-09T01:56:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/ 2023-07-09T01:56:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-09T01:56:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-09T01:56:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-09T01:56:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-09T01:56:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-09T01:56:58.883 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/ 2023-07-09T01:56:58.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-09T01:56:58.883 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/ 2023-07-09T01:56:58.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 191801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-09T01:56:58.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-09T01:56:58.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-09T01:56:58.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-09T01:56:58.883 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/ 2023-07-09T01:56:58.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 652553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-09T01:56:58.884 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/ 2023-07-09T01:56:58.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-09T01:56:58.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 769841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-09T01:56:58.884 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ 2023-07-09T01:56:58.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-09T01:56:58.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-09T01:56:58.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-09T01:56:58.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-09T01:56:58.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-09T01:56:58.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-09T01:56:58.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-09T01:56:58.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-09T01:56:58.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-09T01:56:58.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-09T01:56:58.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-09T01:56:58.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-09T01:56:58.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-09T01:56:58.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-09T01:56:58.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-09T01:56:58.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-09T01:56:58.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-09T01:56:58.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-09T01:56:58.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-09T01:56:58.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-09T01:56:58.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-09T01:56:58.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-09T01:56:58.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-09T01:56:58.887 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/ 2023-07-09T01:56:58.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1030233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-09T01:56:58.887 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/ 2023-07-09T01:56:58.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-09T01:56:58.888 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/ 2023-07-09T01:56:58.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-09T01:56:58.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-09T01:56:58.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-09T01:56:58.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-09T01:56:58.888 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/ 2023-07-09T01:56:58.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 380473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-09T01:56:58.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-09T01:56:58.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-09T01:56:58.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-09T01:56:58.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-09T01:56:58.889 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/ 2023-07-09T01:56:58.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/hsr.ko 2023-07-09T01:56:58.889 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ 2023-07-09T01:56:58.889 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ 2023-07-09T01:56:58.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-09T01:56:58.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 245857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-09T01:56:58.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-09T01:56:58.890 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ 2023-07-09T01:56:58.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-09T01:56:58.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-09T01:56:58.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-09T01:56:58.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-09T01:56:58.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-09T01:56:58.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-09T01:56:58.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-09T01:56:58.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-09T01:56:58.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-09T01:56:58.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-09T01:56:58.891 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ 2023-07-09T01:56:58.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-09T01:56:58.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-09T01:56:58.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-09T01:56:58.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-09T01:56:58.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-09T01:56:58.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-09T01:56:58.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-09T01:56:58.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-09T01:56:58.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-09T01:56:58.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-09T01:56:58.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-09T01:56:58.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-09T01:56:58.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-09T01:56:58.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-09T01:56:58.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-09T01:56:58.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-09T01:56:58.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-09T01:56:58.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-09T01:56:58.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-09T01:56:58.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-09T01:56:58.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-09T01:56:58.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-09T01:56:58.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-09T01:56:58.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-09T01:56:58.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-09T01:56:58.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-09T01:56:58.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-09T01:56:58.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-09T01:56:58.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-09T01:56:58.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-09T01:56:58.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-09T01:56:58.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-09T01:56:58.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-09T01:56:58.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-09T01:56:58.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-09T01:56:58.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-09T01:56:58.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-09T01:56:58.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-09T01:56:58.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-09T01:56:58.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-09T01:56:58.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-09T01:56:58.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-09T01:56:58.897 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ 2023-07-09T01:56:58.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-09T01:56:58.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-09T01:56:58.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-09T01:56:58.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_gre.ko 2023-07-09T01:56:58.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 91481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-09T01:56:58.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-09T01:56:58.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-09T01:56:58.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-09T01:56:58.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/mip6.ko 2023-07-09T01:56:58.898 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ 2023-07-09T01:56:58.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-09T01:56:58.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-09T01:56:58.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-09T01:56:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-09T01:56:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-09T01:56:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-09T01:56:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-09T01:56:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-09T01:56:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-09T01:56:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-09T01:56:58.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-09T01:56:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-09T01:56:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-09T01:56:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-09T01:56:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-09T01:56:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-09T01:56:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-09T01:56:58.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-09T01:56:58.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-09T01:56:58.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-09T01:56:58.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-09T01:56:58.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-09T01:56:58.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-09T01:56:58.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-09T01:56:58.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-09T01:56:58.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-09T01:56:58.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-09T01:56:58.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-09T01:56:58.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/ 2023-07-09T01:56:58.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-09T01:56:58.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/ 2023-07-09T01:56:58.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 120753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-09T01:56:58.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-09T01:56:58.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-09T01:56:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-09T01:56:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-09T01:56:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-09T01:56:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-09T01:56:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/ 2023-07-09T01:56:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/lapb.ko 2023-07-09T01:56:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/ 2023-07-09T01:56:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-09T01:56:58.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 267209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc2.ko 2023-07-09T01:56:58.904 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/ 2023-07-09T01:56:58.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 280401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-09T01:56:58.904 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/ 2023-07-09T01:56:58.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-09T01:56:58.904 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ 2023-07-09T01:56:58.904 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ 2023-07-09T01:56:58.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 117977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-09T01:56:58.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-09T01:56:58.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-09T01:56:58.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-09T01:56:58.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-09T01:56:58.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-09T01:56:58.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-09T01:56:58.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 105129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-09T01:56:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 114393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-09T01:56:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-09T01:56:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-09T01:56:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 114681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-09T01:56:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 114329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-09T01:56:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-09T01:56:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 116217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-09T01:56:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-09T01:56:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ 2023-07-09T01:56:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 410337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-09T01:56:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-09T01:56:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-09T01:56:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-09T01:56:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-09T01:56:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-09T01:56:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-09T01:56:58.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-09T01:56:58.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-09T01:56:58.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-09T01:56:58.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-09T01:56:58.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-09T01:56:58.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-09T01:56:58.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-09T01:56:58.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-09T01:56:58.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 397737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-09T01:56:58.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-09T01:56:58.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-09T01:56:58.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-09T01:56:58.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 117737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-09T01:56:58.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-09T01:56:58.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-09T01:56:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-09T01:56:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-09T01:56:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-09T01:56:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 65737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-09T01:56:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-09T01:56:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-09T01:56:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-09T01:56:58.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-09T01:56:58.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-09T01:56:58.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-09T01:56:58.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 91777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-09T01:56:58.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-09T01:56:58.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-09T01:56:58.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-09T01:56:58.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-09T01:56:58.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-09T01:56:58.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-09T01:56:58.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 584713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-09T01:56:58.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-09T01:56:58.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-09T01:56:58.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-09T01:56:58.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-09T01:56:58.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-09T01:56:58.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-09T01:56:58.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-09T01:56:58.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-09T01:56:58.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-09T01:56:58.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-09T01:56:58.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-09T01:56:58.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-09T01:56:58.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-09T01:56:58.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-09T01:56:58.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-09T01:56:58.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-09T01:56:58.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-09T01:56:58.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-09T01:56:58.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_osf.ko 2023-07-09T01:56:58.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-09T01:56:58.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-09T01:56:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-09T01:56:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-09T01:56:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-09T01:56:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_synproxy.ko 2023-07-09T01:56:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tproxy.ko 2023-07-09T01:56:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/x_tables.ko 2023-07-09T01:56:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-09T01:56:58.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-09T01:56:58.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-09T01:56:58.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-09T01:56:58.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-09T01:56:58.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-09T01:56:58.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-09T01:56:58.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-09T01:56:58.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-09T01:56:58.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-09T01:56:58.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-09T01:56:58.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-09T01:56:58.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-09T01:56:58.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-09T01:56:58.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-09T01:56:58.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-09T01:56:58.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-09T01:56:58.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-09T01:56:58.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-09T01:56:58.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-09T01:56:58.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-09T01:56:58.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-09T01:56:58.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-09T01:56:58.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-09T01:56:58.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-09T01:56:58.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-09T01:56:58.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-09T01:56:58.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-09T01:56:58.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-09T01:56:58.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-09T01:56:58.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-09T01:56:58.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-09T01:56:58.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-09T01:56:58.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-09T01:56:58.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-09T01:56:58.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-09T01:56:58.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-09T01:56:58.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-09T01:56:58.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-09T01:56:58.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-09T01:56:58.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-09T01:56:58.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-09T01:56:58.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-09T01:56:58.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-09T01:56:58.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-09T01:56:58.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-09T01:56:58.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-09T01:56:58.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-09T01:56:58.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-09T01:56:58.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-09T01:56:58.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-09T01:56:58.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-09T01:56:58.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-09T01:56:58.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-09T01:56:58.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-09T01:56:58.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-09T01:56:58.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-09T01:56:58.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-09T01:56:58.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-09T01:56:58.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-09T01:56:58.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-09T01:56:58.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-09T01:56:58.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-09T01:56:58.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-09T01:56:58.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-09T01:56:58.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-09T01:56:58.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-09T01:56:58.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-09T01:56:58.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-09T01:56:58.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpudp.ko 2023-07-09T01:56:58.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-09T01:56:58.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-09T01:56:58.924 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/ 2023-07-09T01:56:58.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-09T01:56:58.925 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/ 2023-07-09T01:56:58.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-09T01:56:58.925 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/ 2023-07-09T01:56:58.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 378153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-09T01:56:58.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-09T01:56:58.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-09T01:56:58.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-09T01:56:58.926 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/ 2023-07-09T01:56:58.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-09T01:56:58.926 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/ 2023-07-09T01:56:58.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 110073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/phonet.ko 2023-07-09T01:56:58.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/pn_pep.ko 2023-07-09T01:56:58.926 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/ 2023-07-09T01:56:58.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 249033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-09T01:56:58.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 165081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-09T01:56:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-09T01:56:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/ 2023-07-09T01:56:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 807465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/rxrpc.ko 2023-07-09T01:56:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/ 2023-07-09T01:56:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-09T01:56:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-09T01:56:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-09T01:56:58.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-09T01:56:58.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-09T01:56:58.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-09T01:56:58.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-09T01:56:58.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-09T01:56:58.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-09T01:56:58.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-09T01:56:58.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-09T01:56:58.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-09T01:56:58.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_cgroup.ko 2023-07-09T01:56:58.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-09T01:56:58.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-09T01:56:58.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-09T01:56:58.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-09T01:56:58.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-09T01:56:58.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-09T01:56:58.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-09T01:56:58.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-09T01:56:58.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-09T01:56:58.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-09T01:56:58.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-09T01:56:58.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-09T01:56:58.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-09T01:56:58.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-09T01:56:58.931 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq_codel.ko 2023-07-09T01:56:58.931 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-09T01:56:58.931 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-09T01:56:58.931 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-09T01:56:58.931 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-09T01:56:58.931 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-09T01:56:58.931 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-09T01:56:58.931 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-09T01:56:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-09T01:56:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-09T01:56:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-09T01:56:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-09T01:56:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-09T01:56:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-09T01:56:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-09T01:56:58.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-09T01:56:58.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-09T01:56:58.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-09T01:56:58.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-09T01:56:58.933 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/ 2023-07-09T01:56:58.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 929385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-09T01:56:58.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-09T01:56:58.933 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/ 2023-07-09T01:56:58.934 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/ 2023-07-09T01:56:58.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 328057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-09T01:56:58.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-09T01:56:58.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1426529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-09T01:56:58.934 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/ 2023-07-09T01:56:58.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 681721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-09T01:56:58.934 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/ 2023-07-09T01:56:58.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-09T01:56:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 855089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-09T01:56:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/ 2023-07-09T01:56:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-09T01:56:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/ 2023-07-09T01:56:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-09T01:56:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-09T01:56:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 92689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-09T01:56:58.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-09T01:56:58.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-09T01:56:58.936 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/ 2023-07-09T01:56:58.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/x25.ko 2023-07-09T01:56:58.936 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/ 2023-07-09T01:56:58.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_algo.ko 2023-07-09T01:56:58.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-09T01:56:58.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_user.ko 2023-07-09T01:56:58.936 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/ 2023-07-09T01:56:58.937 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/ 2023-07-09T01:56:58.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-09T01:56:58.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 637389 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-09T01:56:58.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 623128 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-09T01:56:58.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7605 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-09T01:56:58.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.alias.bin 2023-07-09T01:56:58.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9788 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-09T01:56:58.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68530 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-09T01:56:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 146380 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-09T01:56:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 232618 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-09T01:56:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 210 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-09T01:56:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-09T01:56:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 879 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-09T01:56:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 251868 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-09T01:56:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 306661 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-09T01:56:58.938 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/ 2023-07-09T01:56:58.939 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/ 2023-07-09T01:56:58.939 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/ 2023-07-09T01:56:58.939 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/ 2023-07-09T01:56:58.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 170 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/changelog.Debian.gz 2023-07-09T01:56:58.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 691 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/copyright 2023-07-09T01:56:58.940 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-09T01:56:58.940 INFO:teuthology.task.kernel:searching for kernel 6.4.0-g84139c18d56f 2023-07-09T01:56:58.940 DEBUG:teuthology.orchestra.run.smithi045:> egrep '(submenu|menuentry.*6.4.0-g84139c18d56f).*{' /boot/grub/grub.cfg 2023-07-09T01:56:58.947 INFO:teuthology.orchestra.run.smithi045.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T01:56:58.947 INFO:teuthology.orchestra.run.smithi045.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T01:56:58.947 INFO:teuthology.orchestra.run.smithi045.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T01:56:58.948 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-09T01:56:58.948 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-g84139c18d56f 2023-07-09T01:56:58.948 DEBUG:teuthology.orchestra.run.smithi045:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-09T01:56:58.993 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-07-09T01:56:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-07-09T01:56:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-09T01:56:59.584 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-07-09T01:56:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T01:56:59.764 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T01:57:00.026 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2023-07-09T01:57:00.033 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-09T01:57:00.039 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-09T01:57:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-09T01:57:00.054 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2023-07-09T01:57:00.087 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-09T01:57:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-09T01:57:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-09T01:57:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-09T01:57:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-09T01:57:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-07-09T01:57:00.365 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T01:57:00.380 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T01:57:00.697 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-09T01:57:00.707 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-09T01:57:00.769 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-09T01:57:00.774 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-09T01:57:00.919 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-09T01:57:00.919 INFO:teuthology.orchestra.run.smithi155.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-09T01:57:00.919 INFO:teuthology.orchestra.run.smithi155.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-09T01:57:00.966 INFO:teuthology.orchestra.run.smithi155.stderr:done 2023-07-09T01:57:01.142 DEBUG:teuthology.orchestra.run.smithi155:> dpkg-deb -c /tmp/linux-image.deb 2023-07-09T01:57:01.191 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./ 2023-07-09T01:57:01.191 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./boot/ 2023-07-09T01:57:01.191 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 4323582 2023-06-30 10:38 ./boot/System.map-6.4.0-g84139c18d56f 2023-07-09T01:57:01.203 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 167337 2023-06-30 10:38 ./boot/config-6.4.0-g84139c18d56f 2023-07-09T01:57:01.204 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11237632 2023-06-30 10:38 ./boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T01:57:01.222 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/ 2023-07-09T01:57:01.223 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/ 2023-07-09T01:57:01.223 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postinst.d/ 2023-07-09T01:57:01.223 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postrm.d/ 2023-07-09T01:57:01.223 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/preinst.d/ 2023-07-09T01:57:01.223 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/prerm.d/ 2023-07-09T01:57:01.224 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/ 2023-07-09T01:57:01.224 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/ 2023-07-09T01:57:01.224 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/ 2023-07-09T01:57:01.224 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/ 2023-07-09T01:57:01.224 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/ 2023-07-09T01:57:01.224 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/ 2023-07-09T01:57:01.224 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ 2023-07-09T01:57:01.225 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 490385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-09T01:57:01.226 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-09T01:57:01.227 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-09T01:57:01.227 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-09T01:57:01.227 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 92385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-09T01:57:01.227 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 106729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-09T01:57:01.227 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 152241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-09T01:57:01.227 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-09T01:57:01.227 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-09T01:57:01.228 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-09T01:57:01.228 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-09T01:57:01.228 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-09T01:57:01.228 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-09T01:57:01.228 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-09T01:57:01.228 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-09T01:57:01.228 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-09T01:57:01.229 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-09T01:57:01.229 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-09T01:57:01.229 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-09T01:57:01.229 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-09T01:57:01.229 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/ 2023-07-09T01:57:01.229 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/ 2023-07-09T01:57:01.229 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/ 2023-07-09T01:57:01.229 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-09T01:57:01.230 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpuid.ko 2023-07-09T01:57:01.230 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/msr.ko 2023-07-09T01:57:01.230 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/ 2023-07-09T01:57:01.230 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 346513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-09T01:57:01.230 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 972233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-09T01:57:01.231 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2209953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-09T01:57:01.240 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ 2023-07-09T01:57:01.240 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/af_alg.ko 2023-07-09T01:57:01.240 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_hash.ko 2023-07-09T01:57:01.240 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_skcipher.ko 2023-07-09T01:57:01.240 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-09T01:57:01.241 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-09T01:57:01.241 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-09T01:57:01.241 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/ 2023-07-09T01:57:01.241 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-09T01:57:01.241 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/ 2023-07-09T01:57:01.241 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-09T01:57:01.241 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-09T01:57:01.241 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-09T01:57:01.242 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-09T01:57:01.242 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-09T01:57:01.242 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-09T01:57:01.242 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-09T01:57:01.242 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-09T01:57:01.242 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-09T01:57:01.242 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-09T01:57:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-09T01:57:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-09T01:57:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-09T01:57:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-09T01:57:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-09T01:57:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-09T01:57:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-09T01:57:01.243 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-09T01:57:01.244 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cryptd.ko 2023-07-09T01:57:01.244 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-09T01:57:01.244 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_simd.ko 2023-07-09T01:57:01.244 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-09T01:57:01.244 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-09T01:57:01.244 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-09T01:57:01.244 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-09T01:57:01.244 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-09T01:57:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-09T01:57:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-09T01:57:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-09T01:57:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lrw.ko 2023-07-09T01:57:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-09T01:57:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-09T01:57:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-09T01:57:01.246 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-09T01:57:01.246 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-09T01:57:01.246 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-09T01:57:01.246 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-09T01:57:01.246 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-09T01:57:01.246 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-09T01:57:01.246 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 149193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-09T01:57:01.246 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-09T01:57:01.247 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-09T01:57:01.247 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-09T01:57:01.247 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-09T01:57:01.247 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-09T01:57:01.247 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-09T01:57:01.247 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-09T01:57:01.247 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xts.ko 2023-07-09T01:57:01.247 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-09T01:57:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ 2023-07-09T01:57:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ 2023-07-09T01:57:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_extlog.ko 2023-07-09T01:57:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-09T01:57:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-09T01:57:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/ 2023-07-09T01:57:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/einj.ko 2023-07-09T01:57:01.248 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-09T01:57:01.249 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-09T01:57:01.249 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-09T01:57:01.249 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-09T01:57:01.249 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 98369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-09T01:57:01.249 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ 2023-07-09T01:57:01.249 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-09T01:57:01.249 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 88625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci.ko 2023-07-09T01:57:01.250 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-09T01:57:01.250 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci.ko 2023-07-09T01:57:01.250 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-09T01:57:01.250 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-09T01:57:01.250 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-09T01:57:01.250 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-09T01:57:01.250 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-09T01:57:01.250 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-09T01:57:01.251 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-09T01:57:01.251 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-09T01:57:01.251 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-09T01:57:01.251 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-09T01:57:01.251 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-09T01:57:01.251 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-09T01:57:01.251 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-09T01:57:01.251 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-09T01:57:01.252 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-09T01:57:01.252 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-09T01:57:01.252 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-09T01:57:01.252 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-09T01:57:01.252 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_legacy.ko 2023-07-09T01:57:01.252 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-09T01:57:01.252 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-09T01:57:01.253 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-09T01:57:01.253 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-09T01:57:01.253 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-09T01:57:01.253 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-09T01:57:01.253 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-09T01:57:01.253 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-09T01:57:01.253 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-09T01:57:01.253 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-09T01:57:01.254 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-09T01:57:01.254 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-09T01:57:01.254 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-09T01:57:01.254 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_radisys.ko 2023-07-09T01:57:01.254 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-09T01:57:01.254 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rz1000.ko 2023-07-09T01:57:01.254 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-09T01:57:01.254 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-09T01:57:01.255 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-09T01:57:01.255 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-09T01:57:01.255 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-09T01:57:01.255 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-09T01:57:01.255 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-09T01:57:01.255 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-09T01:57:01.255 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-09T01:57:01.255 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-09T01:57:01.256 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-09T01:57:01.256 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-09T01:57:01.256 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-09T01:57:01.256 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-09T01:57:01.256 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-09T01:57:01.256 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-09T01:57:01.256 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-09T01:57:01.256 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-09T01:57:01.257 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-09T01:57:01.257 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-09T01:57:01.257 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ 2023-07-09T01:57:01.257 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-09T01:57:01.257 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/ 2023-07-09T01:57:01.257 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 121681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-09T01:57:01.257 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/ 2023-07-09T01:57:01.258 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/ 2023-07-09T01:57:01.258 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 113617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-09T01:57:01.258 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/ 2023-07-09T01:57:01.258 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 968129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-09T01:57:01.298 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 173225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-09T01:57:01.299 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/ 2023-07-09T01:57:01.299 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 94297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-09T01:57:01.299 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 114169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-09T01:57:01.299 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/ 2023-07-09T01:57:01.299 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 110361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-09T01:57:01.299 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-09T01:57:01.300 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 257529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-09T01:57:01.300 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/ 2023-07-09T01:57:01.300 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 98193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-09T01:57:01.300 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/ 2023-07-09T01:57:01.300 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-09T01:57:01.300 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ 2023-07-09T01:57:01.301 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/applicom.ko 2023-07-09T01:57:01.301 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-09T01:57:01.301 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/ 2023-07-09T01:57:01.301 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-09T01:57:01.301 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-09T01:57:01.301 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-09T01:57:01.301 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-09T01:57:01.302 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-09T01:57:01.302 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ 2023-07-09T01:57:01.302 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-09T01:57:01.302 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 147705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-09T01:57:01.302 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-09T01:57:01.302 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 139057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-09T01:57:01.302 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-09T01:57:01.303 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-09T01:57:01.303 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-09T01:57:01.303 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/ 2023-07-09T01:57:01.303 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 84121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-09T01:57:01.303 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/nvram.ko 2023-07-09T01:57:01.303 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-09T01:57:01.303 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-09T01:57:01.303 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/ 2023-07-09T01:57:01.304 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-09T01:57:01.304 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-09T01:57:01.304 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-09T01:57:01.304 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-09T01:57:01.304 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-09T01:57:01.304 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-09T01:57:01.304 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-09T01:57:01.305 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/ 2023-07-09T01:57:01.305 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-09T01:57:01.305 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-09T01:57:01.305 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-09T01:57:01.305 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/ 2023-07-09T01:57:01.305 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-palmas.ko 2023-07-09T01:57:01.305 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-si5351.ko 2023-07-09T01:57:01.305 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-twl6040.ko 2023-07-09T01:57:01.306 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-wm831x.ko 2023-07-09T01:57:01.306 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/ 2023-07-09T01:57:01.306 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-09T01:57:01.306 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-09T01:57:01.306 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-09T01:57:01.306 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ 2023-07-09T01:57:01.306 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ 2023-07-09T01:57:01.306 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-09T01:57:01.307 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 231713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-09T01:57:01.307 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/ 2023-07-09T01:57:01.307 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/ 2023-07-09T01:57:01.307 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-09T01:57:01.307 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 396457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-09T01:57:01.307 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-09T01:57:01.307 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-09T01:57:01.308 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-09T01:57:01.308 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-09T01:57:01.308 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/ 2023-07-09T01:57:01.308 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-09T01:57:01.308 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/ 2023-07-09T01:57:01.308 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-09T01:57:01.308 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ 2023-07-09T01:57:01.308 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/ 2023-07-09T01:57:01.309 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-09T01:57:01.309 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ 2023-07-09T01:57:01.309 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 122649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-09T01:57:01.309 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ 2023-07-09T01:57:01.309 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 75521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-09T01:57:01.309 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-09T01:57:01.309 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-09T01:57:01.310 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-09T01:57:01.310 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-09T01:57:01.310 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-09T01:57:01.310 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-09T01:57:01.310 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-09T01:57:01.310 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-09T01:57:01.310 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-09T01:57:01.310 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-09T01:57:01.311 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-09T01:57:01.311 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-09T01:57:01.311 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/ 2023-07-09T01:57:01.311 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-gpio.ko 2023-07-09T01:57:01.313 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max14577.ko 2023-07-09T01:57:01.313 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max77693.ko 2023-07-09T01:57:01.313 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max8997.ko 2023-07-09T01:57:01.314 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-palmas.ko 2023-07-09T01:57:01.314 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-09T01:57:01.314 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-09T01:57:01.314 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/ 2023-07-09T01:57:01.314 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-09T01:57:01.314 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/ 2023-07-09T01:57:01.314 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-09T01:57:01.314 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-09T01:57:01.315 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/ 2023-07-09T01:57:01.315 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-09T01:57:01.315 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-09T01:57:01.315 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-arizona.ko 2023-07-09T01:57:01.315 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9052.ko 2023-07-09T01:57:01.315 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9055.ko 2023-07-09T01:57:01.315 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-dln2.ko 2023-07-09T01:57:01.316 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-09T01:57:01.316 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-generic.ko 2023-07-09T01:57:01.316 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-09T01:57:01.316 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-09T01:57:01.316 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-kempld.ko 2023-07-09T01:57:01.316 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-09T01:57:01.316 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max7300.ko 2023-07-09T01:57:01.316 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max730x.ko 2023-07-09T01:57:01.317 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max732x.ko 2023-07-09T01:57:01.317 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-09T01:57:01.317 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-09T01:57:01.317 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-09T01:57:01.317 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-09T01:57:01.317 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch.ko 2023-07-09T01:57:01.317 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-09T01:57:01.317 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-09T01:57:01.318 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-09T01:57:01.318 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-09T01:57:01.318 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-09T01:57:01.318 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-vx855.ko 2023-07-09T01:57:01.318 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-09T01:57:01.318 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-09T01:57:01.318 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-09T01:57:01.319 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/ 2023-07-09T01:57:01.319 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-a4tech.ko 2023-07-09T01:57:01.319 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-apple.ko 2023-07-09T01:57:01.319 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-09T01:57:01.319 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-09T01:57:01.319 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-09T01:57:01.319 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-belkin.ko 2023-07-09T01:57:01.319 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cherry.ko 2023-07-09T01:57:01.320 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-chicony.ko 2023-07-09T01:57:01.320 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cp2112.ko 2023-07-09T01:57:01.320 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cypress.ko 2023-07-09T01:57:01.320 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-09T01:57:01.320 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-09T01:57:01.320 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-09T01:57:01.320 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-09T01:57:01.320 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ezkey.ko 2023-07-09T01:57:01.321 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-09T01:57:01.321 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-generic.ko 2023-07-09T01:57:01.321 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-09T01:57:01.321 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-09T01:57:01.321 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-09T01:57:01.321 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-09T01:57:01.321 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-09T01:57:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-09T01:57:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-09T01:57:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kensington.ko 2023-07-09T01:57:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-09T01:57:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-09T01:57:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-09T01:57:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-09T01:57:01.322 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-09T01:57:01.323 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lg-g15.ko 2023-07-09T01:57:01.323 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-09T01:57:01.323 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 100681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-09T01:57:01.323 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech.ko 2023-07-09T01:57:01.323 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-magicmouse.ko 2023-07-09T01:57:01.323 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-microsoft.ko 2023-07-09T01:57:01.323 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-monterey.ko 2023-07-09T01:57:01.323 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-09T01:57:01.324 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ntrig.ko 2023-07-09T01:57:01.324 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-09T01:57:01.324 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-09T01:57:01.324 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-09T01:57:01.324 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-09T01:57:01.324 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-09T01:57:01.324 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-09T01:57:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-09T01:57:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-09T01:57:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-09T01:57:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-09T01:57:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-09T01:57:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-09T01:57:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-09T01:57:01.325 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-09T01:57:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-09T01:57:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-09T01:57:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-09T01:57:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-09T01:57:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-09T01:57:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-09T01:57:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-09T01:57:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-09T01:57:01.327 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-09T01:57:01.327 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-09T01:57:01.327 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-09T01:57:01.327 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-09T01:57:01.327 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-09T01:57:01.327 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-09T01:57:01.327 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-09T01:57:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-09T01:57:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-09T01:57:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-09T01:57:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-09T01:57:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-09T01:57:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-09T01:57:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 143585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-09T01:57:01.328 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-09T01:57:01.329 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-09T01:57:01.329 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-09T01:57:01.329 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 261881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid.ko 2023-07-09T01:57:01.329 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-09T01:57:01.329 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/ 2023-07-09T01:57:01.329 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 125425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-09T01:57:01.329 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-09T01:57:01.329 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-09T01:57:01.330 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 217401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-09T01:57:01.330 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/ 2023-07-09T01:57:01.330 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-09T01:57:01.330 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-09T01:57:01.330 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 292697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-09T01:57:01.330 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ 2023-07-09T01:57:01.330 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-09T01:57:01.331 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-09T01:57:01.331 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-09T01:57:01.331 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-09T01:57:01.331 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-09T01:57:01.331 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-09T01:57:01.331 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-09T01:57:01.331 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 97977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-09T01:57:01.331 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-09T01:57:01.332 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-09T01:57:01.332 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-09T01:57:01.332 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-09T01:57:01.332 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-09T01:57:01.332 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-09T01:57:01.332 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-09T01:57:01.332 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-09T01:57:01.332 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-09T01:57:01.333 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-09T01:57:01.333 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-09T01:57:01.333 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-09T01:57:01.333 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-09T01:57:01.333 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-09T01:57:01.333 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-09T01:57:01.333 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-09T01:57:01.333 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-09T01:57:01.334 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-09T01:57:01.334 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-09T01:57:01.334 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-09T01:57:01.334 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 99601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-09T01:57:01.334 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-09T01:57:01.334 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-09T01:57:01.334 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-09T01:57:01.335 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc2103.ko 2023-07-09T01:57:01.335 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-09T01:57:01.335 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-09T01:57:01.335 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 94641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-09T01:57:01.335 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-09T01:57:01.335 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-09T01:57:01.335 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-09T01:57:01.335 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-09T01:57:01.336 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-09T01:57:01.336 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-09T01:57:01.336 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-09T01:57:01.336 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hih6130.ko 2023-07-09T01:57:01.336 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-09T01:57:01.336 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-09T01:57:01.336 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-09T01:57:01.336 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-09T01:57:01.337 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-09T01:57:01.337 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-09T01:57:01.337 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-09T01:57:01.337 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 129025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-09T01:57:01.337 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/jc42.ko 2023-07-09T01:57:01.337 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-09T01:57:01.337 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-09T01:57:01.337 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-09T01:57:01.338 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-09T01:57:01.338 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-09T01:57:01.338 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-09T01:57:01.338 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-09T01:57:01.338 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-09T01:57:01.338 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-09T01:57:01.338 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-09T01:57:01.339 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-09T01:57:01.339 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-09T01:57:01.339 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-09T01:57:01.339 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-09T01:57:01.339 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 108841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-09T01:57:01.339 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-09T01:57:01.339 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-09T01:57:01.339 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-09T01:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-09T01:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-09T01:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-09T01:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-09T01:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-09T01:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-09T01:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-09T01:57:01.340 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-09T01:57:01.341 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-09T01:57:01.341 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-09T01:57:01.341 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-09T01:57:01.341 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-09T01:57:01.341 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-09T01:57:01.341 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-09T01:57:01.341 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-09T01:57:01.342 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-09T01:57:01.342 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-09T01:57:01.342 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-09T01:57:01.342 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 114753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-09T01:57:01.342 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-09T01:57:01.342 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-09T01:57:01.342 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 82337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-09T01:57:01.342 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-09T01:57:01.343 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-09T01:57:01.343 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ 2023-07-09T01:57:01.343 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-09T01:57:01.343 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-09T01:57:01.343 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-09T01:57:01.343 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-09T01:57:01.343 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-09T01:57:01.343 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-09T01:57:01.344 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-09T01:57:01.344 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-09T01:57:01.344 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-09T01:57:01.344 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-09T01:57:01.344 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-09T01:57:01.344 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-09T01:57:01.344 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-09T01:57:01.345 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-09T01:57:01.345 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-09T01:57:01.345 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-09T01:57:01.345 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-09T01:57:01.345 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-09T01:57:01.345 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-09T01:57:01.345 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-09T01:57:01.346 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smm665.ko 2023-07-09T01:57:01.346 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-09T01:57:01.346 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-09T01:57:01.346 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-09T01:57:01.346 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-09T01:57:01.346 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-09T01:57:01.346 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-09T01:57:01.346 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-09T01:57:01.347 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-09T01:57:01.347 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-09T01:57:01.347 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-09T01:57:01.347 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-09T01:57:01.347 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-09T01:57:01.347 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-09T01:57:01.347 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-09T01:57:01.347 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-09T01:57:01.348 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-09T01:57:01.348 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-09T01:57:01.348 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 101457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-09T01:57:01.348 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 119505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-09T01:57:01.348 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-09T01:57:01.348 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-09T01:57:01.348 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-09T01:57:01.349 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-09T01:57:01.349 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/ 2023-07-09T01:57:01.349 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/ 2023-07-09T01:57:01.349 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-09T01:57:01.349 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-09T01:57:01.349 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/ 2023-07-09T01:57:01.349 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-09T01:57:01.349 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-09T01:57:01.350 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-09T01:57:01.350 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-09T01:57:01.350 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-09T01:57:01.350 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-09T01:57:01.350 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-09T01:57:01.350 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-09T01:57:01.350 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-09T01:57:01.350 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-09T01:57:01.351 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-09T01:57:01.351 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-09T01:57:01.351 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-09T01:57:01.351 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-09T01:57:01.351 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-09T01:57:01.351 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-09T01:57:01.351 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-09T01:57:01.351 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-09T01:57:01.352 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-09T01:57:01.352 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-09T01:57:01.352 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-09T01:57:01.352 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-09T01:57:01.352 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-09T01:57:01.352 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-09T01:57:01.352 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-09T01:57:01.353 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-09T01:57:01.353 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-09T01:57:01.353 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-09T01:57:01.353 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-09T01:57:01.353 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-09T01:57:01.353 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-09T01:57:01.353 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-09T01:57:01.353 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-09T01:57:01.354 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-09T01:57:01.354 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-09T01:57:01.354 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-09T01:57:01.354 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-09T01:57:01.354 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-09T01:57:01.354 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-09T01:57:01.354 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-09T01:57:01.354 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/ 2023-07-09T01:57:01.355 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-09T01:57:01.355 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-09T01:57:01.355 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-09T01:57:01.355 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ 2023-07-09T01:57:01.355 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ 2023-07-09T01:57:01.355 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 264521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-09T01:57:01.355 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 849289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-09T01:57:01.355 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-09T01:57:01.356 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 320385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-09T01:57:01.356 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 96969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-09T01:57:01.356 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 271697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-09T01:57:01.356 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-09T01:57:01.356 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ 2023-07-09T01:57:01.356 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-09T01:57:01.356 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 492561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-09T01:57:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/ 2023-07-09T01:57:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 419217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-09T01:57:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/ 2023-07-09T01:57:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 738161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-09T01:57:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ 2023-07-09T01:57:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 296665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-09T01:57:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-09T01:57:01.357 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 153681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-09T01:57:01.358 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/ 2023-07-09T01:57:01.358 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 169017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-09T01:57:01.358 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ 2023-07-09T01:57:01.358 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-09T01:57:01.358 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 263177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-09T01:57:01.358 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ 2023-07-09T01:57:01.358 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 100225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-09T01:57:01.358 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ 2023-07-09T01:57:01.359 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 111993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-09T01:57:01.359 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ 2023-07-09T01:57:01.359 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 129081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-09T01:57:01.359 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ 2023-07-09T01:57:01.359 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 129553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-09T01:57:01.359 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ 2023-07-09T01:57:01.359 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/evbug.ko 2023-07-09T01:57:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ff-memless.ko 2023-07-09T01:57:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ 2023-07-09T01:57:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-09T01:57:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-09T01:57:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-09T01:57:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-09T01:57:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-09T01:57:01.360 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-09T01:57:01.361 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/ 2023-07-09T01:57:01.361 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-09T01:57:01.361 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-09T01:57:01.361 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-09T01:57:01.361 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-09T01:57:01.361 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-09T01:57:01.361 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-09T01:57:01.361 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-09T01:57:01.362 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8323.ko 2023-07-09T01:57:01.362 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8333.ko 2023-07-09T01:57:01.362 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-09T01:57:01.362 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-09T01:57:01.362 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-09T01:57:01.362 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-09T01:57:01.362 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-09T01:57:01.362 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-09T01:57:01.363 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt1070.ko 2023-07-09T01:57:01.363 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt2160.ko 2023-07-09T01:57:01.363 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-09T01:57:01.363 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/stowaway.ko 2023-07-09T01:57:01.363 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-09T01:57:01.363 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-09T01:57:01.363 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-09T01:57:01.364 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-09T01:57:01.364 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-09T01:57:01.364 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/matrix-keymap.ko 2023-07-09T01:57:01.364 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/ 2023-07-09T01:57:01.364 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-09T01:57:01.364 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-09T01:57:01.364 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 123681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-09T01:57:01.364 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-09T01:57:01.365 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-09T01:57:01.365 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 334505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/psmouse.ko 2023-07-09T01:57:01.365 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-09T01:57:01.365 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-09T01:57:01.365 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-09T01:57:01.365 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-09T01:57:01.365 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/ 2023-07-09T01:57:01.365 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 108209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-09T01:57:01.366 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ 2023-07-09T01:57:01.366 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-09T01:57:01.366 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-09T01:57:01.366 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ct82c710.ko 2023-07-09T01:57:01.366 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-09T01:57:01.366 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/parkbd.ko 2023-07-09T01:57:01.366 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/pcips2.ko 2023-07-09T01:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ps2mult.ko 2023-07-09T01:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-09T01:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serport.ko 2023-07-09T01:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-09T01:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/ 2023-07-09T01:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/ 2023-07-09T01:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-09T01:57:01.367 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/ 2023-07-09T01:57:01.368 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-88pm860x.ko 2023-07-09T01:57:01.368 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-adp5520.ko 2023-07-09T01:57:01.368 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-bd2802.ko 2023-07-09T01:57:01.368 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-09T01:57:01.368 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da903x.ko 2023-07-09T01:57:01.368 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da9052.ko 2023-07-09T01:57:01.368 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-gpio.ko 2023-07-09T01:57:01.368 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-09T01:57:01.369 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3533.ko 2023-07-09T01:57:01.369 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm355x.ko 2023-07-09T01:57:01.369 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3642.ko 2023-07-09T01:57:01.369 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-09T01:57:01.369 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp8788.ko 2023-07-09T01:57:01.369 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-max8997.ko 2023-07-09T01:57:01.369 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-mc13783.ko 2023-07-09T01:57:01.369 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-09T01:57:01.370 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca9532.ko 2023-07-09T01:57:01.370 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca955x.ko 2023-07-09T01:57:01.370 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca963x.ko 2023-07-09T01:57:01.370 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-09T01:57:01.370 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-tca6507.ko 2023-07-09T01:57:01.370 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-09T01:57:01.370 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm8350.ko 2023-07-09T01:57:01.371 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ 2023-07-09T01:57:01.371 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-09T01:57:01.371 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-09T01:57:01.371 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-09T01:57:01.371 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-09T01:57:01.371 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-09T01:57:01.371 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-09T01:57:01.371 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-09T01:57:01.372 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-09T01:57:01.372 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/ 2023-07-09T01:57:01.372 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/ 2023-07-09T01:57:01.372 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 631833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-09T01:57:01.372 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-09T01:57:01.372 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 86145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bufio.ko 2023-07-09T01:57:01.372 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-09T01:57:01.372 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 154273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-09T01:57:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 105673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-09T01:57:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-09T01:57:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-era.ko 2023-07-09T01:57:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-09T01:57:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-09T01:57:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log.ko 2023-07-09T01:57:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-mirror.ko 2023-07-09T01:57:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 77617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-09T01:57:01.374 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-09T01:57:01.374 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-09T01:57:01.374 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-region-hash.ko 2023-07-09T01:57:01.374 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-09T01:57:01.374 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-09T01:57:01.374 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 108913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-snapshot.ko 2023-07-09T01:57:01.374 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-09T01:57:01.375 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 182185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-09T01:57:01.375 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-09T01:57:01.375 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-zero.ko 2023-07-09T01:57:01.375 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-09T01:57:01.375 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-09T01:57:01.375 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-09T01:57:01.375 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/ 2023-07-09T01:57:01.375 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 192841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-09T01:57:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-09T01:57:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 111465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-09T01:57:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 157993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-09T01:57:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 392889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-09T01:57:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/ 2023-07-09T01:57:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/ 2023-07-09T01:57:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 174497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-09T01:57:01.377 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-09T01:57:01.377 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-09T01:57:01.377 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-09T01:57:01.377 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 123305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-09T01:57:01.377 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-09T01:57:01.377 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-09T01:57:01.377 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ 2023-07-09T01:57:01.377 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm800.ko 2023-07-09T01:57:01.378 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm805.ko 2023-07-09T01:57:01.378 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm80x.ko 2023-07-09T01:57:01.378 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona-i2c.ko 2023-07-09T01:57:01.378 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 121833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona.ko 2023-07-09T01:57:01.378 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/bcm590xx.ko 2023-07-09T01:57:01.378 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-09T01:57:01.378 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/dln2.ko 2023-07-09T01:57:01.378 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/janz-cmodio.ko 2023-07-09T01:57:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/kempld-core.ko 2023-07-09T01:57:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-core.ko 2023-07-09T01:57:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-09T01:57:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lp3943.ko 2023-07-09T01:57:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-09T01:57:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-09T01:57:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/max8907.ko 2023-07-09T01:57:01.379 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-09T01:57:01.380 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-09T01:57:01.380 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/menf21bmc.ko 2023-07-09T01:57:01.380 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-09T01:57:01.380 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-09T01:57:01.380 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633.ko 2023-07-09T01:57:01.380 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-09T01:57:01.380 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/retu-mfd.ko 2023-07-09T01:57:01.381 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/si476x-core.ko 2023-07-09T01:57:01.381 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-09T01:57:01.381 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-09T01:57:01.381 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps65010.ko 2023-07-09T01:57:01.381 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps6507x.ko 2023-07-09T01:57:01.381 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-09T01:57:01.381 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-09T01:57:01.381 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-09T01:57:01.382 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wm8994.ko 2023-07-09T01:57:01.382 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ 2023-07-09T01:57:01.382 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-09T01:57:01.382 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot.ko 2023-07-09T01:57:01.382 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/ 2023-07-09T01:57:01.382 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-09T01:57:01.382 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-09T01:57:01.382 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-09T01:57:01.383 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-09T01:57:01.383 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/ 2023-07-09T01:57:01.383 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-09T01:57:01.383 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/core.ko 2023-07-09T01:57:01.383 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/ 2023-07-09T01:57:01.383 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-09T01:57:01.383 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ds1682.ko 2023-07-09T01:57:01.384 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/dummy-irq.ko 2023-07-09T01:57:01.384 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/ 2023-07-09T01:57:01.384 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/echo.ko 2023-07-09T01:57:01.384 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/ 2023-07-09T01:57:01.384 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-09T01:57:01.384 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-09T01:57:01.384 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-09T01:57:01.384 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-09T01:57:01.385 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-09T01:57:01.385 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/ 2023-07-09T01:57:01.385 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 152073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-09T01:57:01.385 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hmc6352.ko 2023-07-09T01:57:01.385 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-09T01:57:01.385 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ 2023-07-09T01:57:01.385 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-09T01:57:01.385 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ics932s401.ko 2023-07-09T01:57:01.386 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-09T01:57:01.386 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-09T01:57:01.386 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/ 2023-07-09T01:57:01.386 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-09T01:57:01.386 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-09T01:57:01.386 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/ 2023-07-09T01:57:01.386 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 124569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-09T01:57:01.386 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-09T01:57:01.387 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 304465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-09T01:57:01.387 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/phantom.ko 2023-07-09T01:57:01.387 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/ 2023-07-09T01:57:01.387 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-09T01:57:01.387 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-09T01:57:01.387 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-09T01:57:01.387 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-09T01:57:01.388 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-09T01:57:01.388 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/ 2023-07-09T01:57:01.388 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 180817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-09T01:57:01.388 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ 2023-07-09T01:57:01.388 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/ 2023-07-09T01:57:01.388 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 487993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-09T01:57:01.447 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/ 2023-07-09T01:57:01.447 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/ 2023-07-09T01:57:01.447 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-09T01:57:01.448 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-09T01:57:01.448 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-09T01:57:01.448 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-09T01:57:01.448 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 447289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-09T01:57:01.448 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-09T01:57:01.448 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-09T01:57:01.448 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ 2023-07-09T01:57:01.449 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/ 2023-07-09T01:57:01.449 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-09T01:57:01.449 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-09T01:57:01.449 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 130489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-09T01:57:01.449 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-09T01:57:01.449 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ 2023-07-09T01:57:01.449 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-09T01:57:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-09T01:57:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-09T01:57:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 99049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-09T01:57:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/ 2023-07-09T01:57:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-09T01:57:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/ 2023-07-09T01:57:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-09T01:57:01.450 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/ 2023-07-09T01:57:01.451 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-09T01:57:01.451 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/ 2023-07-09T01:57:01.451 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-09T01:57:01.451 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/ 2023-07-09T01:57:01.451 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-09T01:57:01.451 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-09T01:57:01.451 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 87345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-09T01:57:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/ 2023-07-09T01:57:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-09T01:57:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 97321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-09T01:57:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-09T01:57:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 104585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-09T01:57:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-09T01:57:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-09T01:57:01.452 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-09T01:57:01.453 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-09T01:57:01.453 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-09T01:57:01.453 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/ 2023-07-09T01:57:01.453 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-09T01:57:01.453 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 176817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-09T01:57:01.453 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-09T01:57:01.453 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1422209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-09T01:57:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 127993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-09T01:57:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-09T01:57:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 131241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-09T01:57:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 312097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-09T01:57:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/ 2023-07-09T01:57:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-09T01:57:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 323601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-09T01:57:01.454 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/ 2023-07-09T01:57:01.455 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-09T01:57:01.455 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 193433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-09T01:57:01.455 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-09T01:57:01.455 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 345929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-09T01:57:01.455 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-09T01:57:01.455 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1038969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-09T01:57:01.455 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-09T01:57:01.455 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 166113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-09T01:57:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-09T01:57:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-09T01:57:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/ 2023-07-09T01:57:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-09T01:57:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 203537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-09T01:57:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/ 2023-07-09T01:57:01.456 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-09T01:57:01.457 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-09T01:57:01.457 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-09T01:57:01.457 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 141161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-09T01:57:01.457 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-09T01:57:01.457 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-09T01:57:01.457 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-09T01:57:01.457 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/ 2023-07-09T01:57:01.458 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-09T01:57:01.458 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-09T01:57:01.458 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-09T01:57:01.458 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-09T01:57:01.458 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/ 2023-07-09T01:57:01.458 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-09T01:57:01.458 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 281033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-09T01:57:01.458 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-09T01:57:01.459 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-09T01:57:01.459 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/ 2023-07-09T01:57:01.459 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-09T01:57:01.459 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ 2023-07-09T01:57:01.459 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-09T01:57:01.459 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-09T01:57:01.459 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 295713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-09T01:57:01.459 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-09T01:57:01.460 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 584001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-09T01:57:01.460 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-09T01:57:01.460 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 246321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-09T01:57:01.460 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-09T01:57:01.460 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 922401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-09T01:57:01.460 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-09T01:57:01.460 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 301689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-09T01:57:01.461 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/ 2023-07-09T01:57:01.461 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 514641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-09T01:57:01.461 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-09T01:57:01.461 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 93593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-09T01:57:01.461 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-09T01:57:01.461 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 734081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-09T01:57:01.461 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-09T01:57:01.461 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 151865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-09T01:57:01.462 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 86921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-09T01:57:01.462 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/ 2023-07-09T01:57:01.462 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-09T01:57:01.462 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-09T01:57:01.462 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 122681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-09T01:57:01.462 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/ 2023-07-09T01:57:01.462 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-09T01:57:01.463 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 710481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-09T01:57:01.463 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 280513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-09T01:57:01.463 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-09T01:57:01.463 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-09T01:57:01.463 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1054153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-09T01:57:01.463 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ 2023-07-09T01:57:01.463 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-09T01:57:01.463 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-09T01:57:01.464 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-09T01:57:01.464 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 95665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-09T01:57:01.464 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/ 2023-07-09T01:57:01.464 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-09T01:57:01.464 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 108809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-09T01:57:01.464 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ 2023-07-09T01:57:01.464 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-09T01:57:01.465 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-09T01:57:01.465 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/ 2023-07-09T01:57:01.465 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 150905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-09T01:57:01.465 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/ 2023-07-09T01:57:01.465 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 136785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-09T01:57:01.465 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/ 2023-07-09T01:57:01.465 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-09T01:57:01.465 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-09T01:57:01.466 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/ 2023-07-09T01:57:01.466 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-09T01:57:01.466 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 227113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-09T01:57:01.466 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 87081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-09T01:57:01.466 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-09T01:57:01.466 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 671393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-09T01:57:01.466 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/ 2023-07-09T01:57:01.466 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-09T01:57:01.467 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/ 2023-07-09T01:57:01.467 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-09T01:57:01.467 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-09T01:57:01.467 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-09T01:57:01.467 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 189817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-09T01:57:01.467 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/ 2023-07-09T01:57:01.467 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-09T01:57:01.467 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 104241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-09T01:57:01.468 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/ 2023-07-09T01:57:01.468 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 893097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-09T01:57:01.468 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/ 2023-07-09T01:57:01.468 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-09T01:57:01.468 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/ 2023-07-09T01:57:01.468 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-09T01:57:01.468 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-09T01:57:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/ 2023-07-09T01:57:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-09T01:57:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-09T01:57:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-09T01:57:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-09T01:57:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/ 2023-07-09T01:57:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-09T01:57:01.469 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-09T01:57:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-09T01:57:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-09T01:57:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 480865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-09T01:57:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/ 2023-07-09T01:57:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 103457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-09T01:57:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 166121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-09T01:57:01.470 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-09T01:57:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-09T01:57:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/ 2023-07-09T01:57:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-09T01:57:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/ 2023-07-09T01:57:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 86465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-09T01:57:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/ 2023-07-09T01:57:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-09T01:57:01.471 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-09T01:57:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/ 2023-07-09T01:57:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-09T01:57:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-09T01:57:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/ 2023-07-09T01:57:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-09T01:57:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/ 2023-07-09T01:57:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/defxx.ko 2023-07-09T01:57:01.472 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/ 2023-07-09T01:57:01.473 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 216913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-09T01:57:01.473 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 77169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-09T01:57:01.473 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/ 2023-07-09T01:57:01.473 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 234553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-09T01:57:01.473 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/ 2023-07-09T01:57:01.473 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-09T01:57:01.473 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-09T01:57:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ 2023-07-09T01:57:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-09T01:57:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-09T01:57:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-09T01:57:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/ 2023-07-09T01:57:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-09T01:57:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-09T01:57:01.474 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-09T01:57:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-09T01:57:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-09T01:57:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-09T01:57:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-09T01:57:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/ 2023-07-09T01:57:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-09T01:57:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-09T01:57:01.475 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ 2023-07-09T01:57:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-09T01:57:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-09T01:57:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-09T01:57:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-09T01:57:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-09T01:57:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-09T01:57:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-09T01:57:01.476 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-09T01:57:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-09T01:57:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-09T01:57:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-09T01:57:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 75865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-09T01:57:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-09T01:57:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 92249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-09T01:57:01.477 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-09T01:57:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-09T01:57:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-09T01:57:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-09T01:57:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-09T01:57:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/ 2023-07-09T01:57:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/plip.ko 2023-07-09T01:57:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ 2023-07-09T01:57:01.478 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-09T01:57:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-09T01:57:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-09T01:57:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-09T01:57:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-09T01:57:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-09T01:57:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-09T01:57:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-09T01:57:01.479 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sb1000.ko 2023-07-09T01:57:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/ 2023-07-09T01:57:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-09T01:57:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-09T01:57:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-09T01:57:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/ 2023-07-09T01:57:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 104985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-09T01:57:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-09T01:57:01.480 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-09T01:57:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-09T01:57:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-09T01:57:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-09T01:57:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-09T01:57:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/ 2023-07-09T01:57:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 120497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-09T01:57:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/ 2023-07-09T01:57:01.481 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 290161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-09T01:57:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/ 2023-07-09T01:57:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 143801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-09T01:57:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ 2023-07-09T01:57:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-09T01:57:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/ 2023-07-09T01:57:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/ 2023-07-09T01:57:01.482 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 256953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-09T01:57:01.483 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-09T01:57:01.483 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/ 2023-07-09T01:57:01.483 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 129129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-09T01:57:01.483 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-09T01:57:01.483 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-09T01:57:01.483 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-09T01:57:01.483 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/ 2023-07-09T01:57:01.484 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/ 2023-07-09T01:57:01.484 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-09T01:57:01.484 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-09T01:57:01.484 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-09T01:57:01.484 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pci-stub.ko 2023-07-09T01:57:01.484 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-09T01:57:01.484 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/ 2023-07-09T01:57:01.485 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-09T01:57:01.485 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 143713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia.ko 2023-07-09T01:57:01.485 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-09T01:57:01.485 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-09T01:57:01.485 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-09T01:57:01.485 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 112913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-09T01:57:01.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/ 2023-07-09T01:57:01.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/ 2023-07-09T01:57:01.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-09T01:57:01.486 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/ 2023-07-09T01:57:01.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-09T01:57:01.486 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/ 2023-07-09T01:57:01.486 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/ 2023-07-09T01:57:01.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-09T01:57:01.486 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/ 2023-07-09T01:57:01.486 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/ 2023-07-09T01:57:01.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-09T01:57:01.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-09T01:57:01.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-09T01:57:01.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-09T01:57:01.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-09T01:57:01.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-09T01:57:01.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-09T01:57:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ 2023-07-09T01:57:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-09T01:57:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-09T01:57:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-09T01:57:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-09T01:57:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-09T01:57:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 106393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-09T01:57:01.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-09T01:57:01.489 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-09T01:57:01.489 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-09T01:57:01.489 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-09T01:57:01.489 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-09T01:57:01.489 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-09T01:57:01.489 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-09T01:57:01.489 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/ 2023-07-09T01:57:01.489 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-09T01:57:01.490 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-09T01:57:01.490 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-09T01:57:01.490 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-09T01:57:01.490 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-09T01:57:01.490 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-09T01:57:01.490 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-09T01:57:01.490 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-09T01:57:01.491 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-09T01:57:01.491 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-09T01:57:01.491 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-09T01:57:01.491 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-09T01:57:01.491 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-09T01:57:01.491 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/ 2023-07-09T01:57:01.491 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ 2023-07-09T01:57:01.492 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-09T01:57:01.492 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-09T01:57:01.492 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-09T01:57:01.492 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-09T01:57:01.492 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-09T01:57:01.492 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-09T01:57:01.492 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9030_battery.ko 2023-07-09T01:57:01.492 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9052-battery.ko 2023-07-09T01:57:01.493 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-09T01:57:01.493 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-09T01:57:01.493 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-09T01:57:01.493 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-09T01:57:01.493 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/gpio-charger.ko 2023-07-09T01:57:01.493 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-09T01:57:01.493 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-09T01:57:01.493 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max14577_charger.ko 2023-07-09T01:57:01.494 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17040_battery.ko 2023-07-09T01:57:01.494 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17042_battery.ko 2023-07-09T01:57:01.494 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8903_charger.ko 2023-07-09T01:57:01.494 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8925_power.ko 2023-07-09T01:57:01.494 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-09T01:57:01.494 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/sbs-battery.ko 2023-07-09T01:57:01.494 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/test_power.ko 2023-07-09T01:57:01.494 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-09T01:57:01.495 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-09T01:57:01.495 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_power.ko 2023-07-09T01:57:01.495 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm8350_power.ko 2023-07-09T01:57:01.495 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/ 2023-07-09T01:57:01.495 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-09T01:57:01.495 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-09T01:57:01.495 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/ 2023-07-09T01:57:01.495 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/ 2023-07-09T01:57:01.496 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-09T01:57:01.496 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-09T01:57:01.496 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-09T01:57:01.496 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-09T01:57:01.496 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ 2023-07-09T01:57:01.496 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 64609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-09T01:57:01.496 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-09T01:57:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/ 2023-07-09T01:57:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-09T01:57:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-09T01:57:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-09T01:57:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-09T01:57:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9052.ko 2023-07-09T01:57:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9055.ko 2023-07-09T01:57:01.497 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9063.ko 2023-07-09T01:57:01.498 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-09T01:57:01.498 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-09T01:57:01.498 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-09T01:57:01.498 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-09T01:57:01.498 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-09T01:57:01.498 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-09T01:57:01.498 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-09T01:57:01.498 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-09T01:57:01.499 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-09T01:57:01.499 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-09T01:57:01.499 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-09T01:57:01.499 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-09T01:57:01.499 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-09T01:57:01.499 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-09T01:57:01.499 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-09T01:57:01.499 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-09T01:57:01.500 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-09T01:57:01.500 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-09T01:57:01.500 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-09T01:57:01.500 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8907.ko 2023-07-09T01:57:01.500 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8925.ko 2023-07-09T01:57:01.500 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8997.ko 2023-07-09T01:57:01.500 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8998.ko 2023-07-09T01:57:01.501 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-09T01:57:01.501 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-09T01:57:01.501 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-palmas.ko 2023-07-09T01:57:01.501 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-09T01:57:01.501 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-09T01:57:01.501 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-09T01:57:01.501 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-09T01:57:01.501 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-09T01:57:01.502 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-09T01:57:01.502 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-09T01:57:01.502 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-09T01:57:01.502 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-09T01:57:01.502 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-09T01:57:01.502 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-09T01:57:01.502 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-09T01:57:01.502 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-09T01:57:01.503 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-09T01:57:01.503 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-09T01:57:01.503 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-09T01:57:01.503 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-09T01:57:01.503 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-09T01:57:01.503 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-09T01:57:01.503 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ 2023-07-09T01:57:01.503 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 77641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-09T01:57:01.504 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-09T01:57:01.504 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-09T01:57:01.504 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 135169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-09T01:57:01.504 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-09T01:57:01.504 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/ 2023-07-09T01:57:01.504 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 272353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-09T01:57:01.504 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 100617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-09T01:57:01.505 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/ 2023-07-09T01:57:01.505 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 356201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-09T01:57:01.505 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 295801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-09T01:57:01.505 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/ 2023-07-09T01:57:01.505 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 189321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-09T01:57:01.505 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-09T01:57:01.505 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/ 2023-07-09T01:57:01.505 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 106569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-09T01:57:01.506 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-09T01:57:01.506 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/ 2023-07-09T01:57:01.506 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 246897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-09T01:57:01.506 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/ 2023-07-09T01:57:01.506 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1172185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-09T01:57:01.506 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/ 2023-07-09T01:57:01.506 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 237169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-09T01:57:01.506 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/ 2023-07-09T01:57:01.507 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 115393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-09T01:57:01.507 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-09T01:57:01.507 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/ 2023-07-09T01:57:01.507 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 308889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-09T01:57:01.507 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/ 2023-07-09T01:57:01.507 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-09T01:57:01.507 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-09T01:57:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-09T01:57:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 101449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-09T01:57:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 141873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-09T01:57:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 75529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-09T01:57:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-09T01:57:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/ 2023-07-09T01:57:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 212401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-09T01:57:01.508 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-09T01:57:01.509 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/ 2023-07-09T01:57:01.509 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-09T01:57:01.509 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 155089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-09T01:57:01.509 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fdomain.ko 2023-07-09T01:57:01.509 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/ 2023-07-09T01:57:01.509 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 262073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-09T01:57:01.509 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 201793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-09T01:57:01.510 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-09T01:57:01.510 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-09T01:57:01.510 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/imm.ko 2023-07-09T01:57:01.510 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-09T01:57:01.510 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 266521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-09T01:57:01.510 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 101881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-09T01:57:01.510 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/ 2023-07-09T01:57:01.510 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 317249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-09T01:57:01.511 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-09T01:57:01.511 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-09T01:57:01.511 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/ 2023-07-09T01:57:01.511 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 308313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-09T01:57:01.511 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 140225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-09T01:57:01.511 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-09T01:57:01.511 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/ 2023-07-09T01:57:01.511 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 213041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-09T01:57:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/ 2023-07-09T01:57:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2193865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-09T01:57:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/ 2023-07-09T01:57:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-09T01:57:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-09T01:57:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 310729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-09T01:57:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 84697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-09T01:57:01.512 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/ 2023-07-09T01:57:01.513 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 659577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-09T01:57:01.513 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/ 2023-07-09T01:57:01.513 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 119929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-09T01:57:01.513 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-09T01:57:01.513 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/ 2023-07-09T01:57:01.513 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-09T01:57:01.513 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-09T01:57:01.513 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-09T01:57:01.514 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-09T01:57:01.514 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/ 2023-07-09T01:57:01.514 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 361433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-09T01:57:01.514 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 123489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-09T01:57:01.514 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ppa.ko 2023-07-09T01:57:01.514 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-09T01:57:01.514 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/ 2023-07-09T01:57:01.515 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1850945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-09T01:57:01.515 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-09T01:57:01.515 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/ 2023-07-09T01:57:01.515 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 558865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-09T01:57:01.515 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qlogicfas408.ko 2023-07-09T01:57:01.515 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-09T01:57:01.515 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 238737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-09T01:57:01.515 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 171865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-09T01:57:01.516 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 270161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-09T01:57:01.516 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 94353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-09T01:57:01.516 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-09T01:57:01.516 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-09T01:57:01.516 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-09T01:57:01.516 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 115785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-09T01:57:01.516 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-09T01:57:01.516 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-09T01:57:01.517 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 162121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-09T01:57:01.517 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-09T01:57:01.517 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-09T01:57:01.517 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-09T01:57:01.517 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/xen-scsifront.ko 2023-07-09T01:57:01.517 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ 2023-07-09T01:57:01.517 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 127025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-09T01:57:01.517 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/ 2023-07-09T01:57:01.518 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/ 2023-07-09T01:57:01.518 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 733905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-09T01:57:01.518 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/ 2023-07-09T01:57:01.518 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-09T01:57:01.518 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-09T01:57:01.518 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-09T01:57:01.518 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 920793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-09T01:57:01.519 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-09T01:57:01.519 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 122537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-09T01:57:01.519 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/ 2023-07-09T01:57:01.519 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 75641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-09T01:57:01.519 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/ 2023-07-09T01:57:01.519 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/ 2023-07-09T01:57:01.519 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-09T01:57:01.519 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-09T01:57:01.520 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-09T01:57:01.520 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-09T01:57:01.520 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-09T01:57:01.520 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-09T01:57:01.520 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-09T01:57:01.520 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-09T01:57:01.520 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-09T01:57:01.520 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-09T01:57:01.521 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-09T01:57:01.521 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-09T01:57:01.521 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-09T01:57:01.521 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-09T01:57:01.521 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-09T01:57:01.521 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-09T01:57:01.521 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-09T01:57:01.522 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ 2023-07-09T01:57:01.522 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ 2023-07-09T01:57:01.522 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-09T01:57:01.522 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/moxa.ko 2023-07-09T01:57:01.522 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/mxser.ko 2023-07-09T01:57:01.522 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 107545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-09T01:57:01.522 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-09T01:57:01.522 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-09T01:57:01.523 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/ 2023-07-09T01:57:01.523 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/ 2023-07-09T01:57:01.523 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-09T01:57:01.523 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-09T01:57:01.523 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-09T01:57:01.523 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_uart.ko 2023-07-09T01:57:01.523 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-09T01:57:01.523 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-09T01:57:01.524 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/ 2023-07-09T01:57:01.524 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 103017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-09T01:57:01.524 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/rp2.ko 2023-07-09T01:57:01.524 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-09T01:57:01.524 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 100185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-09T01:57:01.524 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/ 2023-07-09T01:57:01.524 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ 2023-07-09T01:57:01.524 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 519393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-09T01:57:01.525 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ 2023-07-09T01:57:01.525 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-09T01:57:01.525 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-09T01:57:01.525 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/ 2023-07-09T01:57:01.525 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-09T01:57:01.525 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-09T01:57:01.525 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-09T01:57:01.525 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-09T01:57:01.526 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_mf624.ko 2023-07-09T01:57:01.526 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_netx.ko 2023-07-09T01:57:01.526 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-09T01:57:01.526 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-09T01:57:01.526 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-09T01:57:01.526 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/ 2023-07-09T01:57:01.526 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/ 2023-07-09T01:57:01.526 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-09T01:57:01.527 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ 2023-07-09T01:57:01.527 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 142529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-09T01:57:01.527 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-09T01:57:01.527 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-09T01:57:01.527 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-09T01:57:01.527 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/ 2023-07-09T01:57:01.527 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-09T01:57:01.528 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-09T01:57:01.528 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-09T01:57:01.528 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-09T01:57:01.528 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ 2023-07-09T01:57:01.528 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ulpi.ko 2023-07-09T01:57:01.528 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/ 2023-07-09T01:57:01.528 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-09T01:57:01.528 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/ 2023-07-09T01:57:01.529 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-09T01:57:01.529 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-09T01:57:01.529 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 441593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-09T01:57:01.529 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/ 2023-07-09T01:57:01.529 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/ 2023-07-09T01:57:01.529 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-09T01:57:01.529 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-09T01:57:01.529 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-09T01:57:01.530 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-09T01:57:01.530 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-09T01:57:01.530 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-09T01:57:01.530 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-09T01:57:01.530 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-09T01:57:01.530 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 118017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-09T01:57:01.530 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-09T01:57:01.531 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-09T01:57:01.531 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-09T01:57:01.531 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-09T01:57:01.531 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 84193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-09T01:57:01.531 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-09T01:57:01.531 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-09T01:57:01.531 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-09T01:57:01.531 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/ 2023-07-09T01:57:01.532 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-09T01:57:01.532 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-09T01:57:01.532 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-09T01:57:01.532 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-09T01:57:01.532 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-09T01:57:01.532 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-09T01:57:01.532 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-09T01:57:01.532 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-09T01:57:01.533 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-09T01:57:01.533 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-09T01:57:01.533 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-09T01:57:01.533 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-09T01:57:01.533 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-09T01:57:01.533 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-09T01:57:01.533 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 157009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-09T01:57:01.533 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/ 2023-07-09T01:57:01.534 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-09T01:57:01.534 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-09T01:57:01.534 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 157665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-09T01:57:01.534 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-09T01:57:01.534 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-09T01:57:01.534 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-09T01:57:01.534 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-09T01:57:01.534 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-09T01:57:01.535 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 75017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-09T01:57:01.535 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-09T01:57:01.535 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-09T01:57:01.535 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-09T01:57:01.535 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-09T01:57:01.535 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 146001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-09T01:57:01.535 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ 2023-07-09T01:57:01.536 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-09T01:57:01.536 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-09T01:57:01.536 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 87625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-09T01:57:01.536 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-09T01:57:01.536 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-09T01:57:01.536 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811_cs.ko 2023-07-09T01:57:01.536 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-09T01:57:01.536 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-09T01:57:01.537 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/ 2023-07-09T01:57:01.537 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-09T01:57:01.537 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-09T01:57:01.537 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ 2023-07-09T01:57:01.537 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-09T01:57:01.537 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-09T01:57:01.537 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-09T01:57:01.537 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cytherm.ko 2023-07-09T01:57:01.538 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ehset.ko 2023-07-09T01:57:01.538 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-09T01:57:01.538 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-09T01:57:01.538 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-09T01:57:01.538 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-09T01:57:01.538 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-09T01:57:01.538 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-09T01:57:01.539 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-09T01:57:01.539 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-09T01:57:01.539 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/lvstest.ko 2023-07-09T01:57:01.539 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/ 2023-07-09T01:57:01.539 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 64841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-09T01:57:01.539 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-09T01:57:01.539 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-09T01:57:01.539 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-09T01:57:01.540 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-09T01:57:01.540 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbtest.ko 2023-07-09T01:57:01.540 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-09T01:57:01.540 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-09T01:57:01.540 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/ 2023-07-09T01:57:01.540 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/usbmon.ko 2023-07-09T01:57:01.540 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/ 2023-07-09T01:57:01.540 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 295049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-09T01:57:01.541 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/ 2023-07-09T01:57:01.541 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-09T01:57:01.541 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-09T01:57:01.541 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-09T01:57:01.541 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-09T01:57:01.541 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ 2023-07-09T01:57:01.541 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-09T01:57:01.541 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-09T01:57:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-09T01:57:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-09T01:57:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-09T01:57:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-09T01:57:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-09T01:57:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-09T01:57:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-09T01:57:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/f81232.ko 2023-07-09T01:57:01.543 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 174841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-09T01:57:01.543 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-09T01:57:01.543 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 136945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-09T01:57:01.543 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 124465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-09T01:57:01.543 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-09T01:57:01.543 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-09T01:57:01.543 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-09T01:57:01.543 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-09T01:57:01.544 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 107417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-09T01:57:01.544 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-09T01:57:01.544 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-09T01:57:01.544 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-09T01:57:01.544 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-09T01:57:01.544 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/metro-usb.ko 2023-07-09T01:57:01.544 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-09T01:57:01.545 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-09T01:57:01.545 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mxuport.ko 2023-07-09T01:57:01.545 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-09T01:57:01.545 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-09T01:57:01.545 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-09T01:57:01.545 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 189337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-09T01:57:01.545 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-09T01:57:01.545 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-09T01:57:01.546 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-09T01:57:01.546 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-09T01:57:01.546 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-09T01:57:01.546 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-09T01:57:01.546 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-09T01:57:01.546 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-09T01:57:01.546 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-09T01:57:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-09T01:57:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-09T01:57:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-09T01:57:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-09T01:57:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-09T01:57:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 122913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usbserial.ko 2023-07-09T01:57:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-09T01:57:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-09T01:57:01.548 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-09T01:57:01.548 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-09T01:57:01.548 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ 2023-07-09T01:57:01.548 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-09T01:57:01.548 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-09T01:57:01.548 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-09T01:57:01.548 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-09T01:57:01.548 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-09T01:57:01.549 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-09T01:57:01.549 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-09T01:57:01.549 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-09T01:57:01.549 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-09T01:57:01.549 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-09T01:57:01.549 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-09T01:57:01.549 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-09T01:57:01.549 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-09T01:57:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-09T01:57:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 177153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-09T01:57:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/ 2023-07-09T01:57:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-09T01:57:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-09T01:57:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 105401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-09T01:57:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/ 2023-07-09T01:57:01.550 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/ 2023-07-09T01:57:01.551 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 145817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-09T01:57:01.551 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-09T01:57:01.551 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 97969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-09T01:57:01.551 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 75249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-09T01:57:01.551 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/ 2023-07-09T01:57:01.551 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 96017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-09T01:57:01.551 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-09T01:57:01.551 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-09T01:57:01.552 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-09T01:57:01.552 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/ 2023-07-09T01:57:01.552 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/ 2023-07-09T01:57:01.552 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-09T01:57:01.552 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-09T01:57:01.552 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-09T01:57:01.552 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-09T01:57:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-09T01:57:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-09T01:57:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-09T01:57:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/bd6107.ko 2023-07-09T01:57:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-09T01:57:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-09T01:57:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-09T01:57:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-09T01:57:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-09T01:57:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-09T01:57:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-09T01:57:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-09T01:57:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-09T01:57:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-09T01:57:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-09T01:57:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-09T01:57:01.555 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-09T01:57:01.555 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/ 2023-07-09T01:57:01.555 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ 2023-07-09T01:57:01.555 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-09T01:57:01.555 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-09T01:57:01.555 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-09T01:57:01.555 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-09T01:57:01.555 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/ 2023-07-09T01:57:01.556 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-09T01:57:01.556 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-09T01:57:01.556 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-09T01:57:01.556 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-09T01:57:01.556 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-09T01:57:01.556 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-09T01:57:01.556 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-09T01:57:01.556 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-09T01:57:01.557 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-09T01:57:01.557 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-09T01:57:01.557 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-09T01:57:01.557 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 101513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-09T01:57:01.557 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ 2023-07-09T01:57:01.557 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/acquirewdt.ko 2023-07-09T01:57:01.557 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/advantechwdt.ko 2023-07-09T01:57:01.558 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-09T01:57:01.558 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-09T01:57:01.558 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-09T01:57:01.558 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-09T01:57:01.558 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-09T01:57:01.558 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-09T01:57:01.558 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/dw_wdt.ko 2023-07-09T01:57:01.558 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-09T01:57:01.559 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-09T01:57:01.559 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-09T01:57:01.559 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-09T01:57:01.559 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-09T01:57:01.559 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-09T01:57:01.559 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-09T01:57:01.559 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-09T01:57:01.559 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-09T01:57:01.560 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-09T01:57:01.560 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-09T01:57:01.560 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-09T01:57:01.560 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-09T01:57:01.560 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-09T01:57:01.560 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-09T01:57:01.560 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-09T01:57:01.560 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-09T01:57:01.561 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-09T01:57:01.561 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-09T01:57:01.561 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-09T01:57:01.561 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/retu_wdt.ko 2023-07-09T01:57:01.561 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-09T01:57:01.561 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-09T01:57:01.561 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-09T01:57:01.561 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-09T01:57:01.562 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-09T01:57:01.562 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-09T01:57:01.562 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-09T01:57:01.562 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-09T01:57:01.562 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-09T01:57:01.562 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-09T01:57:01.563 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-09T01:57:01.563 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-09T01:57:01.563 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-09T01:57:01.563 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-09T01:57:01.563 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-09T01:57:01.563 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-09T01:57:01.563 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-09T01:57:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-09T01:57:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/ 2023-07-09T01:57:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-09T01:57:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-09T01:57:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-09T01:57:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/ 2023-07-09T01:57:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 176353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-09T01:57:01.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-09T01:57:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-scsiback.ko 2023-07-09T01:57:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/ 2023-07-09T01:57:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-09T01:57:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ 2023-07-09T01:57:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/ 2023-07-09T01:57:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 165513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-09T01:57:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/ 2023-07-09T01:57:01.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/adfs.ko 2023-07-09T01:57:01.566 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/ 2023-07-09T01:57:01.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 162625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-09T01:57:01.566 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/ 2023-07-09T01:57:01.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 924297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/kafs.ko 2023-07-09T01:57:01.566 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/ 2023-07-09T01:57:01.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 100761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/autofs4.ko 2023-07-09T01:57:01.566 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/ 2023-07-09T01:57:01.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 64417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-09T01:57:01.567 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/ 2023-07-09T01:57:01.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/bfs.ko 2023-07-09T01:57:01.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-09T01:57:01.567 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/ 2023-07-09T01:57:01.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 3447409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-09T01:57:01.567 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/ 2023-07-09T01:57:01.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 300025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-09T01:57:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ 2023-07-09T01:57:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1308201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-09T01:57:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/ 2023-07-09T01:57:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 99337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-09T01:57:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/ 2023-07-09T01:57:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 105969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/configfs.ko 2023-07-09T01:57:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/ 2023-07-09T01:57:01.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-09T01:57:01.569 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/ 2023-07-09T01:57:01.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 631425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-09T01:57:01.569 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/ 2023-07-09T01:57:01.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/efs.ko 2023-07-09T01:57:01.569 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/ 2023-07-09T01:57:01.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1473049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-09T01:57:01.569 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/ 2023-07-09T01:57:01.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-09T01:57:01.570 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/ 2023-07-09T01:57:01.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/freevxfs.ko 2023-07-09T01:57:01.570 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/ 2023-07-09T01:57:01.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 218713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-09T01:57:01.570 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/ 2023-07-09T01:57:01.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-09T01:57:01.570 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/ 2023-07-09T01:57:01.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1221129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-09T01:57:01.571 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/ 2023-07-09T01:57:01.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 141241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-09T01:57:01.571 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/ 2023-07-09T01:57:01.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 221561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-09T01:57:01.571 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/ 2023-07-09T01:57:01.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 193585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/hpfs.ko 2023-07-09T01:57:01.571 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/ 2023-07-09T01:57:01.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-09T01:57:01.572 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/ 2023-07-09T01:57:01.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 420425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-09T01:57:01.572 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/ 2023-07-09T01:57:01.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 276953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-09T01:57:01.572 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/ 2023-07-09T01:57:01.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 87841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-09T01:57:01.573 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/ 2023-07-09T01:57:01.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 128665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-09T01:57:01.573 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/ 2023-07-09T01:57:01.573 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/ 2023-07-09T01:57:01.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-09T01:57:01.573 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/ 2023-07-09T01:57:01.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-09T01:57:01.573 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/ 2023-07-09T01:57:01.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 117705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-09T01:57:01.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1002089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-09T01:57:01.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv2.ko 2023-07-09T01:57:01.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 119289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-09T01:57:01.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2003425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-09T01:57:01.574 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/ 2023-07-09T01:57:01.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-09T01:57:01.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-09T01:57:01.575 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/ 2023-07-09T01:57:01.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1407977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-09T01:57:01.575 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/ 2023-07-09T01:57:01.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 589433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-09T01:57:01.575 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/ 2023-07-09T01:57:01.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-09T01:57:01.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-09T01:57:01.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-09T01:57:01.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-09T01:57:01.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-09T01:57:01.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-09T01:57:01.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-09T01:57:01.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-09T01:57:01.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-09T01:57:01.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-09T01:57:01.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-09T01:57:01.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_ascii.ko 2023-07-09T01:57:01.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-09T01:57:01.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-09T01:57:01.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-09T01:57:01.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-09T01:57:01.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-09T01:57:01.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-09T01:57:01.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-09T01:57:01.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-09T01:57:01.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-09T01:57:01.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-09T01:57:01.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-09T01:57:01.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-09T01:57:01.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-09T01:57:01.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-09T01:57:01.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-09T01:57:01.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-09T01:57:01.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-09T01:57:01.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-09T01:57:01.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 94137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-09T01:57:01.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 142673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-09T01:57:01.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 165745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-09T01:57:01.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 118121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-09T01:57:01.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-09T01:57:01.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-09T01:57:01.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-09T01:57:01.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-09T01:57:01.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-09T01:57:01.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-09T01:57:01.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-09T01:57:01.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-09T01:57:01.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-09T01:57:01.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-09T01:57:01.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-09T01:57:01.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-09T01:57:01.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-09T01:57:01.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-09T01:57:01.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-09T01:57:01.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-09T01:57:01.582 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ 2023-07-09T01:57:01.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 219081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ntfs.ko 2023-07-09T01:57:01.582 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ 2023-07-09T01:57:01.582 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ 2023-07-09T01:57:01.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 241241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-09T01:57:01.582 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ 2023-07-09T01:57:01.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 439625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-09T01:57:01.583 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ 2023-07-09T01:57:01.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-09T01:57:01.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2511665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-09T01:57:01.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-09T01:57:01.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-09T01:57:01.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-09T01:57:01.584 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/ 2023-07-09T01:57:01.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/omfs.ko 2023-07-09T01:57:01.584 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/ 2023-07-09T01:57:01.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 320689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-09T01:57:01.584 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ 2023-07-09T01:57:01.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-09T01:57:01.584 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/ 2023-07-09T01:57:01.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/qnx4.ko 2023-07-09T01:57:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/ 2023-07-09T01:57:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/qnx6.ko 2023-07-09T01:57:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/ 2023-07-09T01:57:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_tree.ko 2023-07-09T01:57:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v1.ko 2023-07-09T01:57:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v2.ko 2023-07-09T01:57:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/ 2023-07-09T01:57:01.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 530697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-09T01:57:01.586 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/ 2023-07-09T01:57:01.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-09T01:57:01.586 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/ 2023-07-09T01:57:01.586 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/ 2023-07-09T01:57:01.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2622729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-09T01:57:01.615 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/ 2023-07-09T01:57:01.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-09T01:57:01.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-09T01:57:01.615 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/ 2023-07-09T01:57:01.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 131689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-09T01:57:01.615 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/ 2023-07-09T01:57:01.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-09T01:57:01.616 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/ 2023-07-09T01:57:01.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 248257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-09T01:57:01.616 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ 2023-07-09T01:57:01.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 160857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-09T01:57:01.616 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/ 2023-07-09T01:57:01.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 3854977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-09T01:57:01.617 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/ 2023-07-09T01:57:01.617 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/ 2023-07-09T01:57:01.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/locktorture.ko 2023-07-09T01:57:01.617 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/ 2023-07-09T01:57:01.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/test_udelay.ko 2023-07-09T01:57:01.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-09T01:57:01.617 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ 2023-07-09T01:57:01.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-09T01:57:01.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc7.ko 2023-07-09T01:57:01.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-09T01:57:01.618 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/ 2023-07-09T01:57:01.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-09T01:57:01.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-09T01:57:01.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/interval_tree_test.ko 2023-07-09T01:57:01.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-09T01:57:01.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-09T01:57:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/ 2023-07-09T01:57:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-09T01:57:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-09T01:57:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/ 2023-07-09T01:57:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-09T01:57:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/memory-notifier-error-inject.ko 2023-07-09T01:57:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/notifier-error-inject.ko 2023-07-09T01:57:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/percpu_test.ko 2023-07-09T01:57:01.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/pm-notifier-error-inject.ko 2023-07-09T01:57:01.620 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/ 2023-07-09T01:57:01.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 142369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-09T01:57:01.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/rbtree_test.ko 2023-07-09T01:57:01.620 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/ 2023-07-09T01:57:01.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-09T01:57:01.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-kstrtox.ko 2023-07-09T01:57:01.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-string_helpers.ko 2023-07-09T01:57:01.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 4760825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_bpf.ko 2023-07-09T01:57:01.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_firmware.ko 2023-07-09T01:57:01.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_module.ko 2023-07-09T01:57:01.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_user_copy.ko 2023-07-09T01:57:01.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-09T01:57:01.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-09T01:57:01.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-09T01:57:01.622 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/ 2023-07-09T01:57:01.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/xz_dec_test.ko 2023-07-09T01:57:01.622 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/ 2023-07-09T01:57:01.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-09T01:57:01.622 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ 2023-07-09T01:57:01.622 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/ 2023-07-09T01:57:01.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-09T01:57:01.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-09T01:57:01.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-09T01:57:01.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-09T01:57:01.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-09T01:57:01.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-09T01:57:01.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-09T01:57:01.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-09T01:57:01.623 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/ 2023-07-09T01:57:01.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-09T01:57:01.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-09T01:57:01.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-09T01:57:01.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-09T01:57:01.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-09T01:57:01.624 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/ 2023-07-09T01:57:01.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-09T01:57:01.625 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/ 2023-07-09T01:57:01.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 191801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-09T01:57:01.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-09T01:57:01.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-09T01:57:01.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-09T01:57:01.625 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/ 2023-07-09T01:57:01.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 652553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-09T01:57:01.625 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/ 2023-07-09T01:57:01.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-09T01:57:01.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 769841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-09T01:57:01.626 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ 2023-07-09T01:57:01.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-09T01:57:01.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-09T01:57:01.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-09T01:57:01.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-09T01:57:01.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-09T01:57:01.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-09T01:57:01.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-09T01:57:01.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-09T01:57:01.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-09T01:57:01.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-09T01:57:01.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-09T01:57:01.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-09T01:57:01.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-09T01:57:01.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-09T01:57:01.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-09T01:57:01.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-09T01:57:01.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-09T01:57:01.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-09T01:57:01.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-09T01:57:01.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-09T01:57:01.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-09T01:57:01.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-09T01:57:01.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-09T01:57:01.629 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/ 2023-07-09T01:57:01.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1030233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-09T01:57:01.629 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/ 2023-07-09T01:57:01.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 124729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-09T01:57:01.630 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/ 2023-07-09T01:57:01.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 189745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-09T01:57:01.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-09T01:57:01.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-09T01:57:01.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-09T01:57:01.630 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/ 2023-07-09T01:57:01.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 380473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-09T01:57:01.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-09T01:57:01.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-09T01:57:01.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-09T01:57:01.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-09T01:57:01.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/ 2023-07-09T01:57:01.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 99825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/hsr.ko 2023-07-09T01:57:01.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ 2023-07-09T01:57:01.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ 2023-07-09T01:57:01.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-09T01:57:01.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 245857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-09T01:57:01.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-09T01:57:01.632 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ 2023-07-09T01:57:01.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-09T01:57:01.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-09T01:57:01.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-09T01:57:01.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-09T01:57:01.633 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-09T01:57:01.633 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-09T01:57:01.633 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-09T01:57:01.633 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-09T01:57:01.633 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-09T01:57:01.633 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-09T01:57:01.633 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ 2023-07-09T01:57:01.633 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-09T01:57:01.634 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-09T01:57:01.634 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-09T01:57:01.634 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-09T01:57:01.634 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-09T01:57:01.634 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-09T01:57:01.634 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-09T01:57:01.634 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-09T01:57:01.634 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-09T01:57:01.635 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-09T01:57:01.635 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-09T01:57:01.635 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-09T01:57:01.635 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-09T01:57:01.635 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-09T01:57:01.635 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-09T01:57:01.635 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-09T01:57:01.635 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-09T01:57:01.636 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-09T01:57:01.636 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-09T01:57:01.636 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-09T01:57:01.636 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-09T01:57:01.636 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-09T01:57:01.636 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-09T01:57:01.636 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-09T01:57:01.637 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-09T01:57:01.637 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-09T01:57:01.637 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-09T01:57:01.637 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-09T01:57:01.637 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-09T01:57:01.637 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-09T01:57:01.637 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-09T01:57:01.637 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-09T01:57:01.638 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-09T01:57:01.638 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-09T01:57:01.638 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-09T01:57:01.638 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-09T01:57:01.638 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-09T01:57:01.638 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-09T01:57:01.638 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-09T01:57:01.638 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-09T01:57:01.639 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-09T01:57:01.639 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-09T01:57:01.639 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ 2023-07-09T01:57:01.639 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-09T01:57:01.639 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-09T01:57:01.639 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-09T01:57:01.639 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_gre.ko 2023-07-09T01:57:01.640 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-09T01:57:01.640 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-09T01:57:01.640 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-09T01:57:01.640 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-09T01:57:01.640 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/mip6.ko 2023-07-09T01:57:01.640 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ 2023-07-09T01:57:01.640 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-09T01:57:01.640 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-09T01:57:01.641 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-09T01:57:01.641 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-09T01:57:01.641 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-09T01:57:01.641 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-09T01:57:01.641 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-09T01:57:01.641 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-09T01:57:01.641 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-09T01:57:01.641 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-09T01:57:01.642 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-09T01:57:01.642 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-09T01:57:01.642 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-09T01:57:01.642 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-09T01:57:01.642 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-09T01:57:01.642 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-09T01:57:01.642 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-09T01:57:01.642 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-09T01:57:01.643 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-09T01:57:01.643 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-09T01:57:01.643 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-09T01:57:01.643 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-09T01:57:01.643 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-09T01:57:01.643 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-09T01:57:01.643 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-09T01:57:01.644 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-09T01:57:01.644 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-09T01:57:01.644 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-09T01:57:01.644 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/ 2023-07-09T01:57:01.644 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-09T01:57:01.644 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/ 2023-07-09T01:57:01.644 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 120753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-09T01:57:01.645 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-09T01:57:01.645 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-09T01:57:01.645 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-09T01:57:01.645 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-09T01:57:01.645 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-09T01:57:01.645 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-09T01:57:01.645 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/ 2023-07-09T01:57:01.645 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/lapb.ko 2023-07-09T01:57:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/ 2023-07-09T01:57:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-09T01:57:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 267209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc2.ko 2023-07-09T01:57:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/ 2023-07-09T01:57:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 280401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-09T01:57:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/ 2023-07-09T01:57:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-09T01:57:01.646 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ 2023-07-09T01:57:01.647 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ 2023-07-09T01:57:01.647 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 117977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-09T01:57:01.647 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-09T01:57:01.647 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-09T01:57:01.647 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-09T01:57:01.647 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-09T01:57:01.647 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 103121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-09T01:57:01.647 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 104593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-09T01:57:01.648 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 105129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-09T01:57:01.648 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 114393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-09T01:57:01.648 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-09T01:57:01.648 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 111161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-09T01:57:01.648 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 114681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-09T01:57:01.648 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 114329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-09T01:57:01.648 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 113153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-09T01:57:01.649 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 116217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-09T01:57:01.649 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-09T01:57:01.649 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ 2023-07-09T01:57:01.649 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 410337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-09T01:57:01.649 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-09T01:57:01.649 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-09T01:57:01.649 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-09T01:57:01.649 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-09T01:57:01.650 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-09T01:57:01.650 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-09T01:57:01.650 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-09T01:57:01.650 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-09T01:57:01.650 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-09T01:57:01.650 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-09T01:57:01.650 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-09T01:57:01.650 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-09T01:57:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-09T01:57:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-09T01:57:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 397737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-09T01:57:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-09T01:57:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-09T01:57:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-09T01:57:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 117737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-09T01:57:01.651 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-09T01:57:01.652 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-09T01:57:01.652 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 108329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-09T01:57:01.652 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-09T01:57:01.652 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-09T01:57:01.652 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-09T01:57:01.652 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-09T01:57:01.652 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-09T01:57:01.653 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-09T01:57:01.653 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 86993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-09T01:57:01.653 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-09T01:57:01.653 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-09T01:57:01.653 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-09T01:57:01.653 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-09T01:57:01.653 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-09T01:57:01.653 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-09T01:57:01.654 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-09T01:57:01.654 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-09T01:57:01.654 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-09T01:57:01.654 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 584713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-09T01:57:01.654 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-09T01:57:01.654 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-09T01:57:01.654 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-09T01:57:01.654 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-09T01:57:01.655 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-09T01:57:01.655 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-09T01:57:01.655 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-09T01:57:01.655 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-09T01:57:01.655 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-09T01:57:01.655 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-09T01:57:01.655 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-09T01:57:01.655 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-09T01:57:01.656 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-09T01:57:01.656 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-09T01:57:01.656 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-09T01:57:01.656 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-09T01:57:01.656 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-09T01:57:01.656 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-09T01:57:01.656 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_osf.ko 2023-07-09T01:57:01.656 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-09T01:57:01.657 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-09T01:57:01.657 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-09T01:57:01.657 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-09T01:57:01.657 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-09T01:57:01.657 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_synproxy.ko 2023-07-09T01:57:01.657 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tproxy.ko 2023-07-09T01:57:01.657 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/x_tables.ko 2023-07-09T01:57:01.658 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-09T01:57:01.658 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-09T01:57:01.658 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-09T01:57:01.658 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-09T01:57:01.658 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-09T01:57:01.658 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-09T01:57:01.658 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-09T01:57:01.658 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-09T01:57:01.659 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-09T01:57:01.659 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-09T01:57:01.659 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-09T01:57:01.659 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-09T01:57:01.659 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-09T01:57:01.659 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-09T01:57:01.659 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-09T01:57:01.659 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-09T01:57:01.660 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-09T01:57:01.660 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-09T01:57:01.660 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-09T01:57:01.660 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-09T01:57:01.660 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-09T01:57:01.660 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-09T01:57:01.660 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-09T01:57:01.660 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-09T01:57:01.661 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-09T01:57:01.661 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-09T01:57:01.661 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-09T01:57:01.661 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-09T01:57:01.661 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-09T01:57:01.661 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-09T01:57:01.661 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-09T01:57:01.662 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-09T01:57:01.662 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-09T01:57:01.662 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-09T01:57:01.662 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-09T01:57:01.662 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-09T01:57:01.662 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-09T01:57:01.662 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-09T01:57:01.662 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-09T01:57:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-09T01:57:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-09T01:57:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-09T01:57:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-09T01:57:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-09T01:57:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-09T01:57:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-09T01:57:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-09T01:57:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-09T01:57:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-09T01:57:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-09T01:57:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-09T01:57:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-09T01:57:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-09T01:57:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-09T01:57:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-09T01:57:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-09T01:57:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-09T01:57:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-09T01:57:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-09T01:57:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-09T01:57:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-09T01:57:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-09T01:57:01.666 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-09T01:57:01.666 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-09T01:57:01.666 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-09T01:57:01.666 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-09T01:57:01.666 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-09T01:57:01.666 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-09T01:57:01.666 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-09T01:57:01.666 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpudp.ko 2023-07-09T01:57:01.667 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-09T01:57:01.667 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-09T01:57:01.667 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/ 2023-07-09T01:57:01.667 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-09T01:57:01.667 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/ 2023-07-09T01:57:01.667 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-09T01:57:01.667 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/ 2023-07-09T01:57:01.667 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 378153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-09T01:57:01.668 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-09T01:57:01.668 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-09T01:57:01.668 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-09T01:57:01.668 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/ 2023-07-09T01:57:01.668 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-09T01:57:01.668 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/ 2023-07-09T01:57:01.668 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 110073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/phonet.ko 2023-07-09T01:57:01.668 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/pn_pep.ko 2023-07-09T01:57:01.669 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/ 2023-07-09T01:57:01.669 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 249033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-09T01:57:01.669 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 165081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-09T01:57:01.669 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-09T01:57:01.669 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/ 2023-07-09T01:57:01.669 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 807465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/rxrpc.ko 2023-07-09T01:57:01.669 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/ 2023-07-09T01:57:01.669 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-09T01:57:01.670 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-09T01:57:01.670 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-09T01:57:01.670 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-09T01:57:01.670 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-09T01:57:01.670 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-09T01:57:01.670 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-09T01:57:01.670 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-09T01:57:01.671 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-09T01:57:01.671 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-09T01:57:01.671 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-09T01:57:01.671 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-09T01:57:01.671 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_cgroup.ko 2023-07-09T01:57:01.671 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-09T01:57:01.671 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-09T01:57:01.671 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-09T01:57:01.672 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-09T01:57:01.672 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-09T01:57:01.672 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-09T01:57:01.672 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-09T01:57:01.672 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-09T01:57:01.672 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-09T01:57:01.672 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-09T01:57:01.672 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-09T01:57:01.673 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-09T01:57:01.673 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-09T01:57:01.673 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-09T01:57:01.673 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq_codel.ko 2023-07-09T01:57:01.673 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-09T01:57:01.673 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-09T01:57:01.673 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-09T01:57:01.673 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-09T01:57:01.674 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-09T01:57:01.674 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-09T01:57:01.674 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-09T01:57:01.674 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-09T01:57:01.674 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-09T01:57:01.674 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-09T01:57:01.674 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-09T01:57:01.674 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-09T01:57:01.675 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-09T01:57:01.675 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-09T01:57:01.675 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-09T01:57:01.675 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-09T01:57:01.675 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-09T01:57:01.675 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-09T01:57:01.675 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/ 2023-07-09T01:57:01.675 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 929385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-09T01:57:01.676 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-09T01:57:01.676 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/ 2023-07-09T01:57:01.676 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/ 2023-07-09T01:57:01.676 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 328057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-09T01:57:01.676 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-09T01:57:01.676 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1426529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-09T01:57:01.676 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/ 2023-07-09T01:57:01.677 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 681721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-09T01:57:01.677 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/ 2023-07-09T01:57:01.677 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-09T01:57:01.677 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 855089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-09T01:57:01.677 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/ 2023-07-09T01:57:01.677 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-09T01:57:01.677 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/ 2023-07-09T01:57:01.677 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-09T01:57:01.678 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-09T01:57:01.678 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 92689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-09T01:57:01.678 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-09T01:57:01.678 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-09T01:57:01.678 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/ 2023-07-09T01:57:01.678 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 125225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/x25.ko 2023-07-09T01:57:01.678 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/ 2023-07-09T01:57:01.678 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_algo.ko 2023-07-09T01:57:01.679 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-09T01:57:01.679 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 101993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_user.ko 2023-07-09T01:57:01.679 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/ 2023-07-09T01:57:01.679 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/ 2023-07-09T01:57:01.679 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-09T01:57:01.679 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 637389 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-09T01:57:01.679 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 623128 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-09T01:57:01.679 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7605 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-09T01:57:01.680 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.alias.bin 2023-07-09T01:57:01.680 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9788 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-09T01:57:01.680 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68530 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-09T01:57:01.680 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 146380 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-09T01:57:01.680 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 232618 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-09T01:57:01.680 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 210 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-09T01:57:01.680 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-09T01:57:01.681 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 879 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-09T01:57:01.681 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 251868 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-09T01:57:01.681 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 306661 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-09T01:57:01.681 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/ 2023-07-09T01:57:01.681 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/ 2023-07-09T01:57:01.681 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/ 2023-07-09T01:57:01.681 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/ 2023-07-09T01:57:01.681 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 170 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/changelog.Debian.gz 2023-07-09T01:57:01.682 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 691 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/copyright 2023-07-09T01:57:01.682 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-09T01:57:01.683 INFO:teuthology.task.kernel:searching for kernel 6.4.0-g84139c18d56f 2023-07-09T01:57:01.683 DEBUG:teuthology.orchestra.run.smithi155:> egrep '(submenu|menuentry.*6.4.0-g84139c18d56f).*{' /boot/grub/grub.cfg 2023-07-09T01:57:01.690 INFO:teuthology.orchestra.run.smithi155.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T01:57:01.690 INFO:teuthology.orchestra.run.smithi155.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T01:57:01.690 INFO:teuthology.orchestra.run.smithi155.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T01:57:01.691 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-09T01:57:01.691 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-g84139c18d56f 2023-07-09T01:57:01.691 DEBUG:teuthology.orchestra.run.smithi155:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-09T01:57:01.734 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi155.front.sepia.ceph.com to complete... 2023-07-09T01:57:02.108 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2023-07-09T01:57:02.109 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-09T01:57:02.134 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2023-07-09T01:57:02.322 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T01:57:02.327 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T01:57:02.575 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-09T01:57:02.580 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-09T01:57:02.623 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-09T01:57:02.629 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-09T01:57:02.756 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-09T01:57:02.756 INFO:teuthology.orchestra.run.smithi155.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-09T01:57:02.756 INFO:teuthology.orchestra.run.smithi155.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-09T01:57:02.775 INFO:teuthology.orchestra.run.smithi155.stderr:done 2023-07-09T01:57:31.458 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-09T01:57:31.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-09T01:57:31.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:57:33.909 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-09T01:57:33.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-09T01:57:33.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:57:49.812 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-09T01:57:52.368 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-09T01:57:58.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-09T01:57:58.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:58:01.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-09T01:58:01.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:58:04.432 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-07-09T01:58:16.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-09T01:58:16.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:58:58.864 DEBUG:teuthology.orchestra.remote:timed out 2023-07-09T01:59:10.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-09T01:59:10.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:59:11.106 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-07-09T01:59:11.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-09T01:59:11.776 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-g84139c18d56f"... 2023-07-09T01:59:11.776 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-07-09T01:59:11.824 INFO:teuthology.orchestra.run.smithi045.stdout:6.4.0-g84139c18d56f 2023-07-09T01:59:11.824 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-09T01:59:11.825 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-09T01:59:11.825 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-09T01:59:12.826 DEBUG:teuthology.parallel:result is None 2023-07-09T01:59:16.447 DEBUG:teuthology.orchestra.remote:timed out 2023-07-09T01:59:31.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-09T01:59:31.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:59:31.769 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-07-09T01:59:32.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-09T01:59:32.426 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-g84139c18d56f"... 2023-07-09T01:59:32.426 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2023-07-09T01:59:32.479 INFO:teuthology.orchestra.run.smithi155.stdout:6.4.0-g84139c18d56f 2023-07-09T01:59:32.479 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-09T01:59:32.479 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-09T01:59:32.480 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-09T01:59:33.480 DEBUG:teuthology.parallel:result is None 2023-07-09T01:59:33.481 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-09T01:59:33.488 INFO:teuthology.task.internal:Creating test directory... 2023-07-09T01:59:33.489 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-09T01:59:33.492 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-09T01:59:33.501 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-09T01:59:33.509 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-09T01:59:33.518 INFO:teuthology.task.internal:Creating archive directory... 2023-07-09T01:59:33.518 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-09T01:59:33.547 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-09T01:59:33.571 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-09T01:59:33.577 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-09T01:59:33.577 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-09T01:59:33.607 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-09T01:59:33.681 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T01:59:33.687 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T01:59:33.702 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T01:59:33.704 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T01:59:33.707 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-09T01:59:33.713 INFO:teuthology.task.internal:Configuring sudo... 2023-07-09T01:59:33.714 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-09T01:59:33.717 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-09T01:59:33.739 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-09T01:59:33.751 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-09T01:59:33.752 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-09T01:59:33.787 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-09T01:59:33.796 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-09T01:59:33.845 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-09T01:59:33.901 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T01:59:33.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-09T01:59:33.979 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-09T01:59:33.988 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-09T01:59:34.040 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T01:59:34.041 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-09T01:59:34.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-07-09T01:59:34.118 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2023-07-09T01:59:34.270 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-09T01:59:34.277 INFO:teuthology.task.internal:Starting timer... 2023-07-09T01:59:34.277 INFO:teuthology.run_tasks:Running task pcp... 2023-07-09T01:59:34.289 INFO:teuthology.run_tasks:Running task selinux... 2023-07-09T01:59:34.299 DEBUG:teuthology.task.selinux:Excluding smithi045: OS 'ubuntu' does not support SELinux 2023-07-09T01:59:34.299 DEBUG:teuthology.task.selinux:Excluding smithi155: OS 'ubuntu' does not support SELinux 2023-07-09T01:59:34.300 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-09T01:59:34.300 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-09T01:59:34.300 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-09T01:59:34.300 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-09T01:59:34.337 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-09T01:59:34.338 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-09T01:59:34.359 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-09T01:59:34.360 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-09T02:08:01.115 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2023-07-09T02:08:01.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-09T02:08:01.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:08:01.196 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-07-09T02:08:01.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-09T02:08:01.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-09T02:08:01.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:08:01.425 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-07-09T02:08:01.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-07-09T02:08:01.583 INFO:teuthology.run_tasks:Running task clock... 2023-07-09T02:08:01.595 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-09T02:08:01.596 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-09T02:08:01.597 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T02:08:01.601 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-09T02:08:01.601 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T02:08:01.638 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-09T02:08:01.639 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Command line: ntpd -gq 2023-07-09T02:08:01.639 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: ---------------------------------------------------- 2023-07-09T02:08:01.639 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: ntp-4 is maintained by Network Time Foundation, 2023-07-09T02:08:01.639 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-09T02:08:01.639 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: corporation. Support and training for ntp-4 are 2023-07-09T02:08:01.639 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: available at https://www.nwtime.org/support 2023-07-09T02:08:01.639 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: ---------------------------------------------------- 2023-07-09T02:08:01.640 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: proto: precision = 0.043 usec (-24) 2023-07-09T02:08:01.640 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: basedate set to 2022-02-04 2023-07-09T02:08:01.640 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: gps base set to 2022-02-06 (week 2196) 2023-07-09T02:08:01.641 INFO:teuthology.orchestra.run.smithi045.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-09T02:08:01.641 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-09T02:08:01.641 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: restrict ::: KOD does nothing without LIMITED. 2023-07-09T02:08:01.642 INFO:teuthology.orchestra.run.smithi045.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-09T02:08:01.643 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Listen and drop on 0 v6wildcard [::]:123 2023-07-09T02:08:01.643 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-09T02:08:01.643 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Listen normally on 2 lo 127.0.0.1:123 2023-07-09T02:08:01.643 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Listen normally on 3 ens1f0 172.21.15.45:123 2023-07-09T02:08:01.643 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Listen normally on 4 lo [::1]:123 2023-07-09T02:08:01.643 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12be%3]:123 2023-07-09T02:08:01.643 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:01 ntpd[27276]: Listening on routing socket on fd #22 for interface updates 2023-07-09T02:08:01.665 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-09T02:08:01.666 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Command line: ntpd -gq 2023-07-09T02:08:01.666 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: ---------------------------------------------------- 2023-07-09T02:08:01.666 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: ntp-4 is maintained by Network Time Foundation, 2023-07-09T02:08:01.666 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-09T02:08:01.666 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: corporation. Support and training for ntp-4 are 2023-07-09T02:08:01.666 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: available at https://www.nwtime.org/support 2023-07-09T02:08:01.666 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: ---------------------------------------------------- 2023-07-09T02:08:01.667 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: proto: precision = 0.042 usec (-24) 2023-07-09T02:08:01.667 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: basedate set to 2022-02-04 2023-07-09T02:08:01.667 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: gps base set to 2022-02-06 (week 2196) 2023-07-09T02:08:01.668 INFO:teuthology.orchestra.run.smithi155.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-09T02:08:01.668 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-09T02:08:01.668 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: restrict ::: KOD does nothing without LIMITED. 2023-07-09T02:08:01.669 INFO:teuthology.orchestra.run.smithi155.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-09T02:08:01.669 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Listen and drop on 0 v6wildcard [::]:123 2023-07-09T02:08:01.670 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-09T02:08:01.670 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Listen normally on 2 lo 127.0.0.1:123 2023-07-09T02:08:01.670 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Listen normally on 3 enp3s0f1 172.21.15.155:123 2023-07-09T02:08:01.670 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Listen normally on 4 lo [::1]:123 2023-07-09T02:08:01.670 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6ded%5]:123 2023-07-09T02:08:01.670 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:01 ntpd[27375]: Listening on routing socket on fd #22 for interface updates 2023-07-09T02:08:02.639 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:02 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:02.639 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:02 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:04.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:04 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:04.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:04 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:04.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:04 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:04.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:04 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:04.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:04 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:04.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:04 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:05.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:05.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:05.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:05.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:05.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:05.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:05.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:05.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:05.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:05.669 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:05.669 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:05.670 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:05.670 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:05.670 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:05 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:06.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:06.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:06.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:06.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:06.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:06.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:06.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:06.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:06.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:06.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:06.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:06.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:06.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:06.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:06.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:06.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:06.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:06.643 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:06 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:06.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:06 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:06.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:06 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:06.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:06 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:06.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:06 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:06.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:06 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:06.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:06 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:07.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:07.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:07.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:07.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:07.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:07.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:07.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:07.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:07.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:07.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:07.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:07.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:07 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:08.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:08.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:08.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:08.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:08.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:08.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:08.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:08.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:08.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:08.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:08.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:08.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:08.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:08.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:08.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:08.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:08.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:08.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:08 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:08.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:08 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:08.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:08 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:08.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:08 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:08.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:08 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:08.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:08 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:08.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:08 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:09.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:09.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:09.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:09.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:09.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:09.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:09.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:09.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:09.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:09.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:09.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:09.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:09 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:10.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:10.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:10.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:10.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:10.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:10.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:10.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:10.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:10.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:10.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:10.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:10.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:10.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:10.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:10.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:10.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:10.643 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:10.643 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:10 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:10.666 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:10 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:10.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:10 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:10.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:10 ntpd[27375]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:10.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:10 ntpd[27375]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:10.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:10 ntpd[27375]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:10.667 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:10 ntpd[27375]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:10.668 INFO:teuthology.orchestra.run.smithi155.stdout: 9 Jul 02:08:10 ntpd[27375]: ntpd: time slew -0.000931 s 2023-07-09T02:08:10.668 INFO:teuthology.orchestra.run.smithi155.stdout:ntpd: time slew -0.000931s 2023-07-09T02:08:10.668 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:10 ntpd[27375]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-09T02:08:10.669 INFO:teuthology.orchestra.run.smithi155.stderr: 9 Jul 02:08:10 ntpd[27375]: can't open /var/log/ntpstats/loopstats.20230709: Permission denied 2023-07-09T02:08:10.823 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2023-07-09T02:08:10.823 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2023-07-09T02:08:10.823 INFO:teuthology.orchestra.run.smithi155.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T02:08:10.824 INFO:teuthology.orchestra.run.smithi155.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T02:08:10.824 INFO:teuthology.orchestra.run.smithi155.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T02:08:10.824 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T02:08:12.640 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:12.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:12.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:12.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:12.641 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:12.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:12.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T02:08:12.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T02:08:12.642 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T02:08:12.643 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T02:08:12.643 INFO:teuthology.orchestra.run.smithi045.stdout: 9 Jul 02:08:12 ntpd[27276]: ntpd: time slew -0.001670 s 2023-07-09T02:08:12.643 INFO:teuthology.orchestra.run.smithi045.stdout:ntpd: time slew -0.001670s 2023-07-09T02:08:12.644 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-09T02:08:12.645 INFO:teuthology.orchestra.run.smithi045.stderr: 9 Jul 02:08:12 ntpd[27276]: can't open /var/log/ntpstats/loopstats.20230709: Permission denied 2023-07-09T02:08:12.755 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-07-09T02:08:12.755 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-07-09T02:08:12.756 INFO:teuthology.orchestra.run.smithi045.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T02:08:12.756 INFO:teuthology.orchestra.run.smithi045.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T02:08:12.756 INFO:teuthology.orchestra.run.smithi045.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T02:08:12.756 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T02:08:12.757 INFO:teuthology.run_tasks:Running task install... 2023-07-09T02:08:12.766 DEBUG:teuthology.task.install:project ceph 2023-07-09T02:08:12.767 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}} 2023-07-09T02:08:12.767 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'} 2023-07-09T02:08:12.767 INFO:teuthology.task.install:Using flavor: default 2023-07-09T02:08:12.773 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-09T02:08:12.774 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-09T02:08:12.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-key list | grep Ceph 2023-07-09T02:08:12.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-key list | grep Ceph 2023-07-09T02:08:12.884 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-09T02:08:12.909 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-09T02:08:12.937 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-09T02:08:12.938 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph.com (release key) 2023-07-09T02:08:12.939 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-09T02:08:12.939 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-09T02:08:12.939 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T02:08:12.971 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-09T02:08:12.971 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph.com (release key) 2023-07-09T02:08:12.971 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-09T02:08:12.972 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-09T02:08:12.972 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T02:08:13.087 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default/ 2023-07-09T02:08:13.087 INFO:teuthology.task.install.deb:Package version is 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T02:08:13.192 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default/ 2023-07-09T02:08:13.192 INFO:teuthology.task.install.deb:Package version is 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T02:08:13.259 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:08:13.260 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-09T02:08:13.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2023-07-09T02:08:13.368 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:08:13.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-09T02:08:13.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-07-09T02:08:13.467 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-09T02:08:13.474 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-07-09T02:08:13.548 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-07-09T02:08:13.573 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-07-09T02:08:13.577 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy InRelease 2023-07-09T02:08:13.586 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-07-09T02:08:13.614 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-09T02:08:13.651 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-09T02:08:13.687 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-09T02:08:13.697 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy InRelease 2023-07-09T02:08:13.702 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-09T02:08:13.733 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-09T02:08:13.735 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2023-07-09T02:08:13.771 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-09T02:08:13.784 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-07-09T02:08:13.807 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-09T02:08:13.895 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2023-07-09T02:08:14.098 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 365 kB in 1s (612 kB/s) 2023-07-09T02:08:14.138 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-07-09T02:08:14.434 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 365 kB in 1s (451 kB/s) 2023-07-09T02:08:14.965 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-07-09T02:08:14.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4759-g35b2d86c-1jammy cephadm=18.0.0-4759-g35b2d86c-1jammy ceph-mds=18.0.0-4759-g35b2d86c-1jammy ceph-mgr=18.0.0-4759-g35b2d86c-1jammy ceph-common=18.0.0-4759-g35b2d86c-1jammy ceph-fuse=18.0.0-4759-g35b2d86c-1jammy ceph-test=18.0.0-4759-g35b2d86c-1jammy ceph-volume=18.0.0-4759-g35b2d86c-1jammy radosgw=18.0.0-4759-g35b2d86c-1jammy python3-rados=18.0.0-4759-g35b2d86c-1jammy python3-rgw=18.0.0-4759-g35b2d86c-1jammy python3-cephfs=18.0.0-4759-g35b2d86c-1jammy python3-rbd=18.0.0-4759-g35b2d86c-1jammy libcephfs2=18.0.0-4759-g35b2d86c-1jammy libcephfs-dev=18.0.0-4759-g35b2d86c-1jammy librados2=18.0.0-4759-g35b2d86c-1jammy librbd1=18.0.0-4759-g35b2d86c-1jammy rbd-fuse=18.0.0-4759-g35b2d86c-1jammy python3-cephfs=18.0.0-4759-g35b2d86c-1jammy cephfs-shell=18.0.0-4759-g35b2d86c-1jammy cephfs-top=18.0.0-4759-g35b2d86c-1jammy cephfs-mirror=18.0.0-4759-g35b2d86c-1jammy 2023-07-09T02:08:15.056 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-07-09T02:08:15.211 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2023-07-09T02:08:15.212 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2023-07-09T02:08:15.330 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-07-09T02:08:15.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4759-g35b2d86c-1jammy cephadm=18.0.0-4759-g35b2d86c-1jammy ceph-mds=18.0.0-4759-g35b2d86c-1jammy ceph-mgr=18.0.0-4759-g35b2d86c-1jammy ceph-common=18.0.0-4759-g35b2d86c-1jammy ceph-fuse=18.0.0-4759-g35b2d86c-1jammy ceph-test=18.0.0-4759-g35b2d86c-1jammy ceph-volume=18.0.0-4759-g35b2d86c-1jammy radosgw=18.0.0-4759-g35b2d86c-1jammy python3-rados=18.0.0-4759-g35b2d86c-1jammy python3-rgw=18.0.0-4759-g35b2d86c-1jammy python3-cephfs=18.0.0-4759-g35b2d86c-1jammy python3-rbd=18.0.0-4759-g35b2d86c-1jammy libcephfs2=18.0.0-4759-g35b2d86c-1jammy libcephfs-dev=18.0.0-4759-g35b2d86c-1jammy librados2=18.0.0-4759-g35b2d86c-1jammy librbd1=18.0.0-4759-g35b2d86c-1jammy rbd-fuse=18.0.0-4759-g35b2d86c-1jammy python3-cephfs=18.0.0-4759-g35b2d86c-1jammy cephfs-shell=18.0.0-4759-g35b2d86c-1jammy cephfs-top=18.0.0-4759-g35b2d86c-1jammy cephfs-mirror=18.0.0-4759-g35b2d86c-1jammy 2023-07-09T02:08:15.352 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2023-07-09T02:08:15.352 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-09T02:08:15.352 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-09T02:08:15.353 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-09T02:08:15.353 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-09T02:08:15.354 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-09T02:08:15.354 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-09T02:08:15.354 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2023-07-09T02:08:15.354 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-09T02:08:15.356 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-09T02:08:15.356 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-09T02:08:15.356 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-09T02:08:15.356 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-09T02:08:15.356 INFO:teuthology.orchestra.run.smithi155.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-09T02:08:15.356 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-09T02:08:15.357 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-09T02:08:15.357 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-09T02:08:15.357 INFO:teuthology.orchestra.run.smithi155.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-09T02:08:15.358 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-09T02:08:15.358 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-09T02:08:15.358 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-09T02:08:15.358 INFO:teuthology.orchestra.run.smithi155.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-09T02:08:15.359 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-09T02:08:15.359 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-09T02:08:15.359 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-09T02:08:15.359 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-09T02:08:15.359 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-09T02:08:15.360 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-09T02:08:15.360 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-09T02:08:15.360 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-09T02:08:15.360 INFO:teuthology.orchestra.run.smithi155.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-09T02:08:15.360 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2023-07-09T02:08:15.360 INFO:teuthology.orchestra.run.smithi155.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-09T02:08:15.361 INFO:teuthology.orchestra.run.smithi155.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-09T02:08:15.361 INFO:teuthology.orchestra.run.smithi155.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-09T02:08:15.361 INFO:teuthology.orchestra.run.smithi155.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-09T02:08:15.361 INFO:teuthology.orchestra.run.smithi155.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-09T02:08:15.361 INFO:teuthology.orchestra.run.smithi155.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-09T02:08:15.361 INFO:teuthology.orchestra.run.smithi155.stdout: python3-watchdog 2023-07-09T02:08:15.362 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2023-07-09T02:08:15.362 INFO:teuthology.orchestra.run.smithi155.stdout: btrfs-tools 2023-07-09T02:08:15.426 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-07-09T02:08:15.494 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2023-07-09T02:08:15.495 INFO:teuthology.orchestra.run.smithi155.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-09T02:08:15.495 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-09T02:08:15.495 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-09T02:08:15.495 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-09T02:08:15.496 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-09T02:08:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-09T02:08:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-09T02:08:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-09T02:08:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-09T02:08:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-09T02:08:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-09T02:08:15.497 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-09T02:08:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-09T02:08:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-09T02:08:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-09T02:08:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-09T02:08:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-09T02:08:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-09T02:08:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-09T02:08:15.498 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-09T02:08:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-09T02:08:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-09T02:08:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-09T02:08:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-09T02:08:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-09T02:08:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-09T02:08:15.499 INFO:teuthology.orchestra.run.smithi155.stdout: socat xmlstarlet 2023-07-09T02:08:15.562 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 115 newly installed, 0 to remove and 207 not upgraded. 2023-07-09T02:08:15.562 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 182 MB of archives. 2023-07-09T02:08:15.563 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 819 MB of additional disk space will be used. 2023-07-09T02:08:15.563 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-09T02:08:15.580 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-09T02:08:15.584 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-07-09T02:08:15.584 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-07-09T02:08:15.589 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-09T02:08:15.631 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-09T02:08:15.640 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-09T02:08:15.656 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-09T02:08:15.659 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-09T02:08:15.669 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-09T02:08:15.704 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-09T02:08:15.707 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-09T02:08:15.714 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-09T02:08:15.719 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4759-g35b2d86c-1jammy [3,433 kB] 2023-07-09T02:08:15.731 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-07-09T02:08:15.732 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-09T02:08:15.732 INFO:teuthology.orchestra.run.smithi045.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-09T02:08:15.732 INFO:teuthology.orchestra.run.smithi045.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-09T02:08:15.732 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-09T02:08:15.734 INFO:teuthology.orchestra.run.smithi045.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-09T02:08:15.734 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-09T02:08:15.734 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-07-09T02:08:15.734 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-09T02:08:15.734 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-09T02:08:15.734 INFO:teuthology.orchestra.run.smithi045.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-09T02:08:15.734 INFO:teuthology.orchestra.run.smithi045.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-09T02:08:15.735 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-09T02:08:15.735 INFO:teuthology.orchestra.run.smithi045.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-09T02:08:15.735 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-09T02:08:15.735 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-09T02:08:15.735 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-09T02:08:15.735 INFO:teuthology.orchestra.run.smithi045.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-09T02:08:15.735 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-09T02:08:15.736 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-09T02:08:15.736 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-09T02:08:15.736 INFO:teuthology.orchestra.run.smithi045.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-09T02:08:15.736 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-09T02:08:15.736 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-09T02:08:15.736 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-09T02:08:15.736 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-09T02:08:15.737 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-09T02:08:15.737 INFO:teuthology.orchestra.run.smithi045.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-09T02:08:15.737 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-09T02:08:15.737 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-09T02:08:15.737 INFO:teuthology.orchestra.run.smithi045.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-09T02:08:15.737 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-07-09T02:08:15.738 INFO:teuthology.orchestra.run.smithi045.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-09T02:08:15.738 INFO:teuthology.orchestra.run.smithi045.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-09T02:08:15.738 INFO:teuthology.orchestra.run.smithi045.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-09T02:08:15.738 INFO:teuthology.orchestra.run.smithi045.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-09T02:08:15.738 INFO:teuthology.orchestra.run.smithi045.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-09T02:08:15.738 INFO:teuthology.orchestra.run.smithi045.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-09T02:08:15.738 INFO:teuthology.orchestra.run.smithi045.stdout: python3-watchdog 2023-07-09T02:08:15.739 INFO:teuthology.orchestra.run.smithi045.stdout:Recommended packages: 2023-07-09T02:08:15.739 INFO:teuthology.orchestra.run.smithi045.stdout: btrfs-tools 2023-07-09T02:08:15.752 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-09T02:08:15.794 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-09T02:08:15.870 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-09T02:08:15.871 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-09T02:08:15.872 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-09T02:08:15.875 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-09T02:08:15.875 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-09T02:08:15.877 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-09T02:08:15.878 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-09T02:08:15.878 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-09T02:08:15.878 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-09T02:08:15.880 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-07-09T02:08:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-09T02:08:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-09T02:08:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-09T02:08:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-09T02:08:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-09T02:08:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-09T02:08:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-09T02:08:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-09T02:08:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-09T02:08:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-09T02:08:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-09T02:08:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-09T02:08:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-09T02:08:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-09T02:08:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-09T02:08:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-09T02:08:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-09T02:08:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-09T02:08:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-09T02:08:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-09T02:08:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-09T02:08:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-09T02:08:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-09T02:08:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-09T02:08:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-09T02:08:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-09T02:08:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: socat xmlstarlet 2023-07-09T02:08:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-09T02:08:15.948 INFO:teuthology.orchestra.run.smithi045.stdout:0 upgraded, 115 newly installed, 0 to remove and 207 not upgraded. 2023-07-09T02:08:15.948 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 182 MB of archives. 2023-07-09T02:08:15.949 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 819 MB of additional disk space will be used. 2023-07-09T02:08:15.949 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-09T02:08:15.966 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-09T02:08:15.979 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-09T02:08:16.002 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-09T02:08:16.004 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-09T02:08:16.005 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-09T02:08:16.006 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-09T02:08:16.009 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-09T02:08:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-09T02:08:16.010 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-09T02:08:16.017 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-09T02:08:16.020 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-09T02:08:16.022 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-09T02:08:16.023 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-09T02:08:16.026 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-09T02:08:16.042 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4759-g35b2d86c-1jammy [3,094 kB] 2023-07-09T02:08:16.043 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-09T02:08:16.045 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-09T02:08:16.055 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-09T02:08:16.078 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-09T02:08:16.091 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-09T02:08:16.093 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-09T02:08:16.096 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-09T02:08:16.100 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-09T02:08:16.106 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4759-g35b2d86c-1jammy [3,433 kB] 2023-07-09T02:08:16.115 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-09T02:08:16.127 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-09T02:08:16.139 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-09T02:08:16.152 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4759-g35b2d86c-1jammy [662 kB] 2023-07-09T02:08:16.153 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-09T02:08:16.166 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4759-g35b2d86c-1jammy [345 kB] 2023-07-09T02:08:16.171 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-09T02:08:16.175 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-09T02:08:16.180 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-09T02:08:16.181 INFO:teuthology.orchestra.run.smithi155.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-09T02:08:16.184 INFO:teuthology.orchestra.run.smithi155.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-09T02:08:16.186 INFO:teuthology.orchestra.run.smithi155.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4759-g35b2d86c-1jammy [22.9 kB] 2023-07-09T02:08:16.186 INFO:teuthology.orchestra.run.smithi155.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4759-g35b2d86c-1jammy [170 kB] 2023-07-09T02:08:16.189 INFO:teuthology.orchestra.run.smithi155.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4759-g35b2d86c-1jammy [49.0 kB] 2023-07-09T02:08:16.189 INFO:teuthology.orchestra.run.smithi155.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4759-g35b2d86c-1jammy [318 kB] 2023-07-09T02:08:16.192 INFO:teuthology.orchestra.run.smithi155.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-09T02:08:16.194 INFO:teuthology.orchestra.run.smithi155.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-09T02:08:16.199 INFO:teuthology.orchestra.run.smithi155.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4759-g35b2d86c-1jammy [6,060 kB] 2023-07-09T02:08:16.235 INFO:teuthology.orchestra.run.smithi155.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-09T02:08:16.257 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-09T02:08:16.259 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-09T02:08:16.259 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-09T02:08:16.262 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-09T02:08:16.262 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-09T02:08:16.263 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-09T02:08:16.263 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-09T02:08:16.264 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-09T02:08:16.299 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-09T02:08:16.299 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-09T02:08:16.372 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-09T02:08:16.375 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-09T02:08:16.377 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-09T02:08:16.378 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-09T02:08:16.383 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-09T02:08:16.387 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-09T02:08:16.388 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-09T02:08:16.390 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-09T02:08:16.392 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-09T02:08:16.416 INFO:teuthology.orchestra.run.smithi155.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-09T02:08:16.417 INFO:teuthology.orchestra.run.smithi155.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-09T02:08:16.419 INFO:teuthology.orchestra.run.smithi155.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-09T02:08:16.420 INFO:teuthology.orchestra.run.smithi155.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-09T02:08:16.420 INFO:teuthology.orchestra.run.smithi155.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-09T02:08:16.422 INFO:teuthology.orchestra.run.smithi155.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-09T02:08:16.428 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-09T02:08:16.443 INFO:teuthology.orchestra.run.smithi155.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-09T02:08:16.445 INFO:teuthology.orchestra.run.smithi155.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-09T02:08:16.445 INFO:teuthology.orchestra.run.smithi155.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-09T02:08:16.463 INFO:teuthology.orchestra.run.smithi155.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4759-g35b2d86c-1jammy [102 kB] 2023-07-09T02:08:16.463 INFO:teuthology.orchestra.run.smithi155.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-09T02:08:16.464 INFO:teuthology.orchestra.run.smithi155.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4759-g35b2d86c-1jammy [430 kB] 2023-07-09T02:08:16.478 INFO:teuthology.orchestra.run.smithi155.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4759-g35b2d86c-1jammy [22.3 MB] 2023-07-09T02:08:16.499 INFO:teuthology.orchestra.run.smithi155.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-09T02:08:16.537 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-09T02:08:16.538 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-09T02:08:16.538 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-09T02:08:16.539 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-09T02:08:16.541 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-09T02:08:16.546 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-09T02:08:16.546 INFO:teuthology.orchestra.run.smithi045.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-09T02:08:16.553 INFO:teuthology.orchestra.run.smithi155.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-09T02:08:16.554 INFO:teuthology.orchestra.run.smithi045.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-09T02:08:16.555 INFO:teuthology.orchestra.run.smithi045.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-09T02:08:16.559 INFO:teuthology.orchestra.run.smithi155.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-09T02:08:16.559 INFO:teuthology.orchestra.run.smithi045.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-09T02:08:16.565 INFO:teuthology.orchestra.run.smithi155.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-09T02:08:16.576 INFO:teuthology.orchestra.run.smithi155.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-09T02:08:16.579 INFO:teuthology.orchestra.run.smithi155.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-09T02:08:16.585 INFO:teuthology.orchestra.run.smithi155.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-09T02:08:16.595 INFO:teuthology.orchestra.run.smithi045.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-09T02:08:16.614 INFO:teuthology.orchestra.run.smithi155.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-09T02:08:16.620 INFO:teuthology.orchestra.run.smithi155.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-09T02:08:16.625 INFO:teuthology.orchestra.run.smithi155.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-09T02:08:16.626 INFO:teuthology.orchestra.run.smithi155.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-09T02:08:16.670 INFO:teuthology.orchestra.run.smithi155.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-09T02:08:16.682 INFO:teuthology.orchestra.run.smithi045.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-09T02:08:16.700 INFO:teuthology.orchestra.run.smithi045.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4759-g35b2d86c-1jammy [3,094 kB] 2023-07-09T02:08:16.767 INFO:teuthology.orchestra.run.smithi155.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-09T02:08:16.769 INFO:teuthology.orchestra.run.smithi155.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-09T02:08:16.781 INFO:teuthology.orchestra.run.smithi045.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-09T02:08:16.782 INFO:teuthology.orchestra.run.smithi045.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-09T02:08:16.783 INFO:teuthology.orchestra.run.smithi045.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-09T02:08:16.784 INFO:teuthology.orchestra.run.smithi045.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-09T02:08:16.784 INFO:teuthology.orchestra.run.smithi045.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-09T02:08:16.785 INFO:teuthology.orchestra.run.smithi045.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-09T02:08:16.796 INFO:teuthology.orchestra.run.smithi155.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-09T02:08:16.806 INFO:teuthology.orchestra.run.smithi155.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-09T02:08:16.807 INFO:teuthology.orchestra.run.smithi155.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-09T02:08:16.807 INFO:teuthology.orchestra.run.smithi045.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-09T02:08:16.807 INFO:teuthology.orchestra.run.smithi155.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-09T02:08:16.808 INFO:teuthology.orchestra.run.smithi155.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-09T02:08:16.809 INFO:teuthology.orchestra.run.smithi045.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-09T02:08:16.810 INFO:teuthology.orchestra.run.smithi045.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-09T02:08:16.811 INFO:teuthology.orchestra.run.smithi155.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-09T02:08:16.812 INFO:teuthology.orchestra.run.smithi155.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-09T02:08:16.826 INFO:teuthology.orchestra.run.smithi155.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-09T02:08:16.861 INFO:teuthology.orchestra.run.smithi155.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-09T02:08:16.863 INFO:teuthology.orchestra.run.smithi045.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-09T02:08:16.882 INFO:teuthology.orchestra.run.smithi045.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-09T02:08:16.895 INFO:teuthology.orchestra.run.smithi155.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-09T02:08:16.910 INFO:teuthology.orchestra.run.smithi045.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-09T02:08:16.920 INFO:teuthology.orchestra.run.smithi045.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-09T02:08:16.926 INFO:teuthology.orchestra.run.smithi045.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-09T02:08:16.934 INFO:teuthology.orchestra.run.smithi045.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-09T02:08:16.937 INFO:teuthology.orchestra.run.smithi045.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-09T02:08:16.942 INFO:teuthology.orchestra.run.smithi045.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-09T02:08:16.952 INFO:teuthology.orchestra.run.smithi155.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-09T02:08:16.958 INFO:teuthology.orchestra.run.smithi155.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-09T02:08:16.967 INFO:teuthology.orchestra.run.smithi045.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-09T02:08:16.974 INFO:teuthology.orchestra.run.smithi045.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-09T02:08:16.979 INFO:teuthology.orchestra.run.smithi045.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-09T02:08:17.014 INFO:teuthology.orchestra.run.smithi045.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-09T02:08:17.116 INFO:teuthology.orchestra.run.smithi045.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-09T02:08:17.123 INFO:teuthology.orchestra.run.smithi045.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4759-g35b2d86c-1jammy [662 kB] 2023-07-09T02:08:17.126 INFO:teuthology.orchestra.run.smithi045.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-09T02:08:17.127 INFO:teuthology.orchestra.run.smithi045.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-09T02:08:17.147 INFO:teuthology.orchestra.run.smithi045.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-09T02:08:17.155 INFO:teuthology.orchestra.run.smithi045.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-09T02:08:17.156 INFO:teuthology.orchestra.run.smithi045.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-09T02:08:17.156 INFO:teuthology.orchestra.run.smithi045.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-09T02:08:17.157 INFO:teuthology.orchestra.run.smithi045.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-09T02:08:17.159 INFO:teuthology.orchestra.run.smithi045.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-09T02:08:17.159 INFO:teuthology.orchestra.run.smithi045.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-09T02:08:17.206 INFO:teuthology.orchestra.run.smithi045.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-09T02:08:17.245 INFO:teuthology.orchestra.run.smithi045.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-09T02:08:17.250 INFO:teuthology.orchestra.run.smithi045.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-09T02:08:17.299 INFO:teuthology.orchestra.run.smithi045.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-09T02:08:17.304 INFO:teuthology.orchestra.run.smithi045.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4759-g35b2d86c-1jammy [345 kB] 2023-07-09T02:08:17.306 INFO:teuthology.orchestra.run.smithi045.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-09T02:08:17.311 INFO:teuthology.orchestra.run.smithi045.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4759-g35b2d86c-1jammy [22.9 kB] 2023-07-09T02:08:17.311 INFO:teuthology.orchestra.run.smithi045.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4759-g35b2d86c-1jammy [170 kB] 2023-07-09T02:08:17.313 INFO:teuthology.orchestra.run.smithi045.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4759-g35b2d86c-1jammy [49.0 kB] 2023-07-09T02:08:17.314 INFO:teuthology.orchestra.run.smithi045.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4759-g35b2d86c-1jammy [318 kB] 2023-07-09T02:08:17.323 INFO:teuthology.orchestra.run.smithi045.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4759-g35b2d86c-1jammy [6,060 kB] 2023-07-09T02:08:17.473 INFO:teuthology.orchestra.run.smithi155.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4759-g35b2d86c-1jammy [6,825 kB] 2023-07-09T02:08:17.779 INFO:teuthology.orchestra.run.smithi155.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4759-g35b2d86c-1jammy [226 kB] 2023-07-09T02:08:17.784 INFO:teuthology.orchestra.run.smithi155.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4759-g35b2d86c-1jammy [114 kB] 2023-07-09T02:08:17.799 INFO:teuthology.orchestra.run.smithi155.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4759-g35b2d86c-1jammy [1,476 kB] 2023-07-09T02:08:17.873 INFO:teuthology.orchestra.run.smithi155.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4759-g35b2d86c-1jammy [9,879 kB] 2023-07-09T02:08:17.973 INFO:teuthology.orchestra.run.smithi045.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4759-g35b2d86c-1jammy [102 kB] 2023-07-09T02:08:17.978 INFO:teuthology.orchestra.run.smithi045.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4759-g35b2d86c-1jammy [430 kB] 2023-07-09T02:08:18.032 INFO:teuthology.orchestra.run.smithi045.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4759-g35b2d86c-1jammy [22.3 MB] 2023-07-09T02:08:18.330 INFO:teuthology.orchestra.run.smithi155.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4759-g35b2d86c-1jammy [31.6 MB] 2023-07-09T02:08:19.783 INFO:teuthology.orchestra.run.smithi155.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4759-g35b2d86c-1jammy [3,600 B] 2023-07-09T02:08:19.784 INFO:teuthology.orchestra.run.smithi155.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4759-g35b2d86c-1jammy [816 kB] 2023-07-09T02:08:19.800 INFO:teuthology.orchestra.run.smithi155.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4759-g35b2d86c-1jammy [2,136 kB] 2023-07-09T02:08:19.913 INFO:teuthology.orchestra.run.smithi155.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4759-g35b2d86c-1jammy [218 kB] 2023-07-09T02:08:19.920 INFO:teuthology.orchestra.run.smithi155.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4759-g35b2d86c-1jammy [125 kB] 2023-07-09T02:08:19.925 INFO:teuthology.orchestra.run.smithi155.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4759-g35b2d86c-1jammy [1,842 kB] 2023-07-09T02:08:20.007 INFO:teuthology.orchestra.run.smithi155.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4759-g35b2d86c-1jammy [8,615 kB] 2023-07-09T02:08:20.422 INFO:teuthology.orchestra.run.smithi155.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4759-g35b2d86c-1jammy [3,730 B] 2023-07-09T02:08:20.422 INFO:teuthology.orchestra.run.smithi155.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4759-g35b2d86c-1jammy [47.3 MB] 2023-07-09T02:08:20.622 INFO:teuthology.orchestra.run.smithi045.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4759-g35b2d86c-1jammy [6,825 kB] 2023-07-09T02:08:21.429 INFO:teuthology.orchestra.run.smithi045.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4759-g35b2d86c-1jammy [226 kB] 2023-07-09T02:08:21.470 INFO:teuthology.orchestra.run.smithi045.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4759-g35b2d86c-1jammy [114 kB] 2023-07-09T02:08:21.473 INFO:teuthology.orchestra.run.smithi045.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4759-g35b2d86c-1jammy [1,476 kB] 2023-07-09T02:08:21.654 INFO:teuthology.orchestra.run.smithi045.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4759-g35b2d86c-1jammy [9,879 kB] 2023-07-09T02:08:22.522 INFO:teuthology.orchestra.run.smithi155.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4759-g35b2d86c-1jammy [231 kB] 2023-07-09T02:08:22.524 INFO:teuthology.orchestra.run.smithi155.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4759-g35b2d86c-1jammy [217 kB] 2023-07-09T02:08:22.525 INFO:teuthology.orchestra.run.smithi155.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4759-g35b2d86c-1jammy [23.8 kB] 2023-07-09T02:08:22.526 INFO:teuthology.orchestra.run.smithi155.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4759-g35b2d86c-1jammy [13.2 kB] 2023-07-09T02:08:22.527 INFO:teuthology.orchestra.run.smithi155.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4759-g35b2d86c-1jammy [28.4 kB] 2023-07-09T02:08:22.527 INFO:teuthology.orchestra.run.smithi155.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4759-g35b2d86c-1jammy [12.0 MB] 2023-07-09T02:08:22.922 INFO:teuthology.orchestra.run.smithi045.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4759-g35b2d86c-1jammy [31.6 MB] 2023-07-09T02:08:23.062 INFO:teuthology.orchestra.run.smithi155.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4759-g35b2d86c-1jammy [82.1 kB] 2023-07-09T02:08:23.623 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 182 MB in 8s (24.1 MB/s) 2023-07-09T02:08:23.731 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-09T02:08:23.801 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132931 files and directories currently installed.) 2023-07-09T02:08:23.804 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-09T02:08:23.847 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-09T02:08:24.291 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-09T02:08:24.305 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-09T02:08:24.341 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-09T02:08:24.600 INFO:teuthology.orchestra.run.smithi045.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4759-g35b2d86c-1jammy [3,600 B] 2023-07-09T02:08:24.600 INFO:teuthology.orchestra.run.smithi045.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4759-g35b2d86c-1jammy [816 kB] 2023-07-09T02:08:24.637 INFO:teuthology.orchestra.run.smithi045.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4759-g35b2d86c-1jammy [2,136 kB] 2023-07-09T02:08:24.661 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cmd2. 2023-07-09T02:08:24.674 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-09T02:08:24.711 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-09T02:08:24.744 INFO:teuthology.orchestra.run.smithi045.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4759-g35b2d86c-1jammy [218 kB] 2023-07-09T02:08:24.749 INFO:teuthology.orchestra.run.smithi045.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4759-g35b2d86c-1jammy [125 kB] 2023-07-09T02:08:24.751 INFO:teuthology.orchestra.run.smithi045.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4759-g35b2d86c-1jammy [1,842 kB] 2023-07-09T02:08:24.852 INFO:teuthology.orchestra.run.smithi045.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4759-g35b2d86c-1jammy [8,615 kB] 2023-07-09T02:08:25.030 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-09T02:08:25.044 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-09T02:08:25.130 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-09T02:08:25.281 INFO:teuthology.orchestra.run.smithi045.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4759-g35b2d86c-1jammy [3,730 B] 2023-07-09T02:08:25.281 INFO:teuthology.orchestra.run.smithi045.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4759-g35b2d86c-1jammy [47.3 MB] 2023-07-09T02:08:25.442 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-09T02:08:25.456 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-09T02:08:25.500 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-09T02:08:25.862 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-09T02:08:25.876 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-09T02:08:25.920 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-09T02:08:26.256 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-09T02:08:26.271 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-09T02:08:26.314 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-09T02:08:26.701 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-09T02:08:26.716 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T02:08:26.760 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:08:27.138 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-09T02:08:27.152 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T02:08:27.196 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:08:27.532 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-09T02:08:27.547 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T02:08:27.591 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:08:27.614 INFO:teuthology.orchestra.run.smithi045.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4759-g35b2d86c-1jammy [231 kB] 2023-07-09T02:08:27.616 INFO:teuthology.orchestra.run.smithi045.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4759-g35b2d86c-1jammy [217 kB] 2023-07-09T02:08:27.628 INFO:teuthology.orchestra.run.smithi045.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4759-g35b2d86c-1jammy [23.8 kB] 2023-07-09T02:08:27.629 INFO:teuthology.orchestra.run.smithi045.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4759-g35b2d86c-1jammy [13.2 kB] 2023-07-09T02:08:27.629 INFO:teuthology.orchestra.run.smithi045.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4759-g35b2d86c-1jammy [28.4 kB] 2023-07-09T02:08:27.630 INFO:teuthology.orchestra.run.smithi045.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4759-g35b2d86c-1jammy [12.0 MB] 2023-07-09T02:08:27.893 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-09T02:08:27.908 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-09T02:08:27.944 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-09T02:08:28.206 INFO:teuthology.orchestra.run.smithi045.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4759-g35b2d86c-1jammy [82.1 kB] 2023-07-09T02:08:28.255 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librados2. 2023-07-09T02:08:28.269 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../011-librados2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:28.313 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librados2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:28.732 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librbd1. 2023-07-09T02:08:28.746 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../012-librbd1_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:28.791 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librbd1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:28.799 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 182 MB in 12s (14.8 MB/s) 2023-07-09T02:08:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-09T02:08:29.019 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132931 files and directories currently installed.) 2023-07-09T02:08:29.023 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-09T02:08:29.070 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-09T02:08:29.229 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs2. 2023-07-09T02:08:29.243 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:29.278 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:29.406 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-09T02:08:29.420 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-09T02:08:29.465 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-09T02:08:29.539 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rados. 2023-07-09T02:08:29.553 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:29.598 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rados (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:29.735 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cmd2. 2023-07-09T02:08:29.752 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-09T02:08:29.793 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-09T02:08:29.917 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-09T02:08:29.931 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:29.975 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-argparse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:30.104 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-09T02:08:30.118 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-09T02:08:30.204 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-09T02:08:30.228 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cephfs. 2023-07-09T02:08:30.242 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:30.286 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cephfs (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:30.531 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-09T02:08:30.546 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-09T02:08:30.555 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-09T02:08:30.571 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:30.589 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-09T02:08:30.605 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:30.924 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-prettytable. 2023-07-09T02:08:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-09T02:08:30.938 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-09T02:08:30.950 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-09T02:08:30.982 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-09T02:08:30.993 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-09T02:08:31.243 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rbd. 2023-07-09T02:08:31.257 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:31.262 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-09T02:08:31.277 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-09T02:08:31.302 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rbd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:31.312 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-09T02:08:31.647 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-09T02:08:31.662 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-09T02:08:31.704 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-09T02:08:31.774 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-09T02:08:31.788 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T02:08:31.840 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:08:31.999 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librgw2. 2023-07-09T02:08:32.013 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../021-librgw2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:32.049 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librgw2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:32.252 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-09T02:08:32.267 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T02:08:32.418 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:08:32.551 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rgw. 2023-07-09T02:08:32.565 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:32.609 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:32.755 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-09T02:08:32.770 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T02:08:32.804 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:08:32.954 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-09T02:08:32.968 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-09T02:08:33.012 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-09T02:08:33.140 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-09T02:08:33.155 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-09T02:08:33.198 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-09T02:08:33.323 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libradosstriper1. 2023-07-09T02:08:33.338 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:33.381 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libradosstriper1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:33.543 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librados2. 2023-07-09T02:08:33.558 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../011-librados2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:33.602 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librados2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:33.718 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-common. 2023-07-09T02:08:33.732 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:33.767 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:34.021 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librbd1. 2023-07-09T02:08:34.036 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../012-librbd1_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:34.070 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librbd1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:34.432 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs2. 2023-07-09T02:08:34.446 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:34.482 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:34.750 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rados. 2023-07-09T02:08:34.765 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:34.809 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rados (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:34.948 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-base. 2023-07-09T02:08:34.962 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:35.015 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-base (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:35.103 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-09T02:08:35.118 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:35.161 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-argparse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:35.413 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cephfs. 2023-07-09T02:08:35.428 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cephfs (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:35.701 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-09T02:08:35.715 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-09T02:08:35.733 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-09T02:08:35.747 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:35.776 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-09T02:08:35.782 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:36.054 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cheroot. 2023-07-09T02:08:36.068 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-09T02:08:36.112 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-09T02:08:36.119 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-prettytable. 2023-07-09T02:08:36.134 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-09T02:08:36.177 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-09T02:08:36.424 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-09T02:08:36.429 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rbd. 2023-07-09T02:08:36.438 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-09T02:08:36.444 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:36.482 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-09T02:08:36.488 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rbd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:36.785 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-09T02:08:36.801 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-09T02:08:36.824 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-09T02:08:36.839 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-09T02:08:36.843 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-09T02:08:36.882 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-09T02:08:37.154 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-09T02:08:37.168 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-09T02:08:37.193 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librgw2. 2023-07-09T02:08:37.207 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../021-librgw2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:37.212 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-09T02:08:37.243 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librgw2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:37.474 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempora. 2023-07-09T02:08:37.487 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-09T02:08:37.523 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-09T02:08:37.645 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rgw. 2023-07-09T02:08:37.660 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:37.703 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:37.809 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-portend. 2023-07-09T02:08:37.825 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-09T02:08:37.867 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-09T02:08:38.039 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-09T02:08:38.054 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-09T02:08:38.098 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-09T02:08:38.165 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-09T02:08:38.176 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-09T02:08:38.220 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-09T02:08:38.383 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libradosstriper1. 2023-07-09T02:08:38.398 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:38.441 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libradosstriper1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:38.523 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-09T02:08:38.537 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-09T02:08:38.572 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-09T02:08:38.795 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-common. 2023-07-09T02:08:38.809 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:38.844 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:38.934 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-natsort. 2023-07-09T02:08:38.948 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-09T02:08:38.992 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-09T02:08:39.579 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-logutils. 2023-07-09T02:08:39.593 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-09T02:08:39.637 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-09T02:08:39.923 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-09T02:08:39.937 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-09T02:08:39.973 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-09T02:08:40.142 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-base. 2023-07-09T02:08:40.157 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:40.209 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-base (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:40.225 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-mako. 2023-07-09T02:08:40.239 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-09T02:08:40.284 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-09T02:08:40.603 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-09T02:08:40.618 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-09T02:08:40.661 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-09T02:08:40.887 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-09T02:08:40.901 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-09T02:08:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-09T02:08:40.964 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-09T02:08:40.979 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-09T02:08:41.022 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-09T02:08:41.248 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cheroot. 2023-07-09T02:08:41.263 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-09T02:08:41.308 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-09T02:08:41.325 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webob. 2023-07-09T02:08:41.339 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-09T02:08:41.375 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-09T02:08:41.575 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-09T02:08:41.590 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-09T02:08:41.634 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-09T02:08:41.677 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-waitress. 2023-07-09T02:08:41.692 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-09T02:08:41.730 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-09T02:08:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-09T02:08:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-09T02:08:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-09T02:08:42.006 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempita. 2023-07-09T02:08:42.020 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-09T02:08:42.064 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-09T02:08:42.289 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-09T02:08:42.304 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-09T02:08:42.347 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-09T02:08:42.406 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-paste. 2023-07-09T02:08:42.421 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-09T02:08:42.467 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-09T02:08:42.650 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempora. 2023-07-09T02:08:42.665 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-09T02:08:42.713 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-09T02:08:42.753 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-09T02:08:42.767 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-09T02:08:42.811 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-09T02:08:42.969 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-portend. 2023-07-09T02:08:42.984 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-09T02:08:43.019 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-09T02:08:43.097 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-09T02:08:43.112 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-09T02:08:43.155 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-09T02:08:43.305 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-09T02:08:43.321 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-09T02:08:43.363 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-09T02:08:43.442 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webtest. 2023-07-09T02:08:43.457 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-09T02:08:43.499 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-09T02:08:43.699 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-09T02:08:43.714 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-09T02:08:43.757 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-09T02:08:43.810 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pecan. 2023-07-09T02:08:43.825 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-09T02:08:43.869 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-09T02:08:44.061 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-natsort. 2023-07-09T02:08:44.076 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-09T02:08:44.119 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-09T02:08:44.240 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-certifi. 2023-07-09T02:08:44.254 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-09T02:08:44.298 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-09T02:08:44.422 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-logutils. 2023-07-09T02:08:44.437 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-09T02:08:44.480 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-09T02:08:44.601 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-idna. 2023-07-09T02:08:44.615 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-09T02:08:44.659 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-09T02:08:44.792 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-09T02:08:44.806 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-09T02:08:44.849 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-09T02:08:44.922 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-urllib3. 2023-07-09T02:08:44.935 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-09T02:08:44.970 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-09T02:08:45.145 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-mako. 2023-07-09T02:08:45.159 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-09T02:08:45.202 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-09T02:08:45.265 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests. 2023-07-09T02:08:45.279 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-09T02:08:45.314 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-09T02:08:45.539 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-09T02:08:45.554 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-09T02:08:45.588 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-09T02:08:45.592 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-09T02:08:45.607 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-09T02:08:45.651 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-09T02:08:45.849 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-09T02:08:45.865 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-09T02:08:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-09T02:08:45.962 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-09T02:08:45.979 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:46.020 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:46.210 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webob. 2023-07-09T02:08:46.226 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-09T02:08:46.277 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-09T02:08:46.399 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-09T02:08:46.414 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:46.458 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:46.638 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-waitress. 2023-07-09T02:08:46.653 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-09T02:08:46.699 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-09T02:08:47.007 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempita. 2023-07-09T02:08:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-09T02:08:47.065 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-09T02:08:47.351 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-paste. 2023-07-09T02:08:47.366 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-09T02:08:47.372 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-openssl. 2023-07-09T02:08:47.384 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-09T02:08:47.409 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-09T02:08:47.427 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-09T02:08:47.705 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr. 2023-07-09T02:08:47.720 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:47.755 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-09T02:08:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-09T02:08:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-09T02:08:48.100 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mon. 2023-07-09T02:08:48.114 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:48.115 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-09T02:08:48.131 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-09T02:08:48.158 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mon (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:48.173 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-09T02:08:48.451 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webtest. 2023-07-09T02:08:48.466 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-09T02:08:48.893 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-09T02:08:48.952 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-osd. 2023-07-09T02:08:48.967 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:49.011 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-osd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:49.413 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pecan. 2023-07-09T02:08:49.428 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-09T02:08:49.471 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-09T02:08:49.834 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-certifi. 2023-07-09T02:08:49.849 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-09T02:08:49.892 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-09T02:08:50.197 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph. 2023-07-09T02:08:50.211 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../061-ceph_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:50.220 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-idna. 2023-07-09T02:08:50.235 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-09T02:08:50.256 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:50.278 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-09T02:08:50.541 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-fuse. 2023-07-09T02:08:50.555 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:50.582 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-urllib3. 2023-07-09T02:08:50.596 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-09T02:08:50.599 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:50.638 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-09T02:08:50.936 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mds. 2023-07-09T02:08:50.951 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:50.966 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests. 2023-07-09T02:08:50.982 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-09T02:08:50.994 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mds (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:51.025 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-09T02:08:51.336 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-09T02:08:51.351 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-09T02:08:51.364 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephadm. 2023-07-09T02:08:51.379 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../064-cephadm_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:51.394 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-09T02:08:51.422 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:51.663 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-09T02:08:51.678 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:51.713 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:51.734 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-09T02:08:51.748 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-09T02:08:51.783 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-09T02:08:52.078 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-09T02:08:52.092 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-09T02:08:52.117 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-09T02:08:52.133 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:52.135 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-09T02:08:52.176 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:52.495 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-openssl. 2023-07-09T02:08:52.511 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-09T02:08:52.554 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-09T02:08:52.848 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr. 2023-07-09T02:08:52.863 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:52.906 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:53.049 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-babel. 2023-07-09T02:08:53.063 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-09T02:08:53.098 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-09T02:08:53.268 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mon. 2023-07-09T02:08:53.282 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:53.325 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mon (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:53.368 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jinja2. 2023-07-09T02:08:53.381 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-09T02:08:53.411 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-09T02:08:53.721 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-09T02:08:53.735 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:53.780 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:54.066 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-09T02:08:54.080 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-09T02:08:54.124 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-09T02:08:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-osd. 2023-07-09T02:08:54.219 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:54.262 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-osd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:54.410 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-09T02:08:54.424 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-09T02:08:54.468 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-09T02:08:54.956 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-routes. 2023-07-09T02:08:54.970 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-09T02:08:55.013 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-09T02:08:55.341 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-09T02:08:55.356 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:55.399 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:55.715 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph. 2023-07-09T02:08:55.730 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../061-ceph_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:55.774 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:55.803 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-09T02:08:55.816 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-09T02:08:55.852 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-09T02:08:56.118 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-fuse. 2023-07-09T02:08:56.133 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:56.176 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:56.322 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-joblib. 2023-07-09T02:08:56.336 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-09T02:08:56.381 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-09T02:08:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mds. 2023-07-09T02:08:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mds (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:56.742 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-09T02:08:56.756 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-09T02:08:56.800 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-09T02:08:56.999 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephadm. 2023-07-09T02:08:57.014 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../064-cephadm_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:08:57.058 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:57.095 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn. 2023-07-09T02:08:57.109 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-09T02:08:57.153 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-09T02:08:57.359 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-09T02:08:57.375 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-09T02:08:57.418 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-09T02:08:57.720 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-09T02:08:57.736 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-09T02:08:57.778 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-09T02:08:57.828 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-09T02:08:57.841 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:57.886 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:58.725 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-babel. 2023-07-09T02:08:58.739 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-09T02:08:58.788 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-09T02:08:58.865 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cachetools. 2023-07-09T02:08:58.879 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-09T02:08:58.922 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-09T02:08:59.127 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jinja2. 2023-07-09T02:08:59.142 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-09T02:08:59.186 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-09T02:08:59.251 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-09T02:08:59.268 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-09T02:08:59.308 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-09T02:08:59.539 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-09T02:08:59.553 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:08:59.597 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:08:59.636 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-09T02:08:59.652 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-09T02:08:59.694 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-09T02:08:59.925 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-09T02:08:59.940 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-09T02:08:59.985 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-09T02:08:59.987 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rsa. 2023-07-09T02:08:59.996 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-09T02:09:00.030 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-09T02:09:00.297 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-09T02:09:00.312 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-09T02:09:00.346 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-09T02:09:00.402 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-google-auth. 2023-07-09T02:09:00.417 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-09T02:09:00.460 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-09T02:09:00.599 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-routes. 2023-07-09T02:09:00.614 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-09T02:09:00.657 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-09T02:09:00.838 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-09T02:09:00.854 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-09T02:09:00.897 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-09T02:09:01.027 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-09T02:09:01.042 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:01.085 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:01.208 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-websocket. 2023-07-09T02:09:01.222 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-09T02:09:01.266 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-09T02:09:01.514 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-09T02:09:01.528 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-09T02:09:01.580 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-09T02:09:01.585 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-09T02:09:01.601 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-09T02:09:01.644 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-09T02:09:02.050 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-joblib. 2023-07-09T02:09:02.065 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-09T02:09:02.108 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-09T02:09:02.290 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-09T02:09:02.304 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:02.365 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:02.428 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-09T02:09:02.443 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-09T02:09:02.481 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-09T02:09:02.684 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-09T02:09:02.698 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-09T02:09:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-09T02:09:02.790 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn. 2023-07-09T02:09:02.804 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-09T02:09:02.848 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-09T02:09:03.071 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-09T02:09:03.085 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-09T02:09:03.129 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-09T02:09:03.382 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package jq. 2023-07-09T02:09:03.395 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-09T02:09:03.440 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-09T02:09:03.522 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-09T02:09:03.536 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:03.580 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:03.692 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package socat. 2023-07-09T02:09:03.705 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-09T02:09:03.750 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-09T02:09:04.145 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package xmlstarlet. 2023-07-09T02:09:04.159 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-09T02:09:04.203 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-09T02:09:04.516 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-test. 2023-07-09T02:09:04.531 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:04.565 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-test (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:04.650 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cachetools. 2023-07-09T02:09:04.666 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-09T02:09:04.708 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-09T02:09:05.011 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-09T02:09:05.027 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-09T02:09:05.069 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-09T02:09:05.405 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-09T02:09:05.421 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-09T02:09:05.464 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-09T02:09:05.766 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rsa. 2023-07-09T02:09:05.781 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-09T02:09:05.824 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-09T02:09:06.213 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-google-auth. 2023-07-09T02:09:06.228 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-09T02:09:06.271 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-09T02:09:06.336 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-volume. 2023-07-09T02:09:06.352 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:06.395 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-volume (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:06.557 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-09T02:09:06.573 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-09T02:09:06.617 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-09T02:09:06.809 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-09T02:09:06.823 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:06.867 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-mirror (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:06.926 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-websocket. 2023-07-09T02:09:06.942 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-09T02:09:06.985 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-09T02:09:07.170 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-colorama. 2023-07-09T02:09:07.184 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-09T02:09:07.229 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-09T02:09:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-09T02:09:07.345 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-09T02:09:07.387 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-09T02:09:07.481 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-shell. 2023-07-09T02:09:07.495 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:07.534 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-shell (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:07.775 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-top. 2023-07-09T02:09:07.791 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:07.833 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-top (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:08.085 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-09T02:09:08.086 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-09T02:09:08.098 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:08.100 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:08.143 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:08.144 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs-dev (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:08.412 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-09T02:09:08.426 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-09T02:09:08.461 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-09T02:09:08.521 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package nvme-cli. 2023-07-09T02:09:08.537 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-09T02:09:08.579 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-09T02:09:08.773 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-09T02:09:08.788 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-09T02:09:08.831 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-09T02:09:08.942 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-09T02:09:08.957 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-09T02:09:09.024 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-09T02:09:09.084 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package jq. 2023-07-09T02:09:09.100 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-09T02:09:09.143 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-09T02:09:09.379 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package socat. 2023-07-09T02:09:09.393 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-09T02:09:09.436 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-09T02:09:09.462 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-09T02:09:09.476 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-09T02:09:09.520 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-09T02:09:09.740 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package xmlstarlet. 2023-07-09T02:09:09.754 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-09T02:09:09.797 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-09T02:09:09.818 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastescript. 2023-07-09T02:09:09.829 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-09T02:09:09.873 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-09T02:09:10.126 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-test. 2023-07-09T02:09:10.140 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:10.184 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-test (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:10.435 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pluggy. 2023-07-09T02:09:10.450 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-09T02:09:10.501 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-09T02:09:10.870 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-psutil. 2023-07-09T02:09:10.885 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-09T02:09:10.936 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-09T02:09:11.281 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-py. 2023-07-09T02:09:11.296 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-09T02:09:11.347 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-09T02:09:11.676 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pygments. 2023-07-09T02:09:11.691 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-09T02:09:11.734 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-09T02:09:12.037 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-volume. 2023-07-09T02:09:12.053 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:12.087 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-volume (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:12.179 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-09T02:09:12.193 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-09T02:09:12.237 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-09T02:09:12.500 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-09T02:09:12.516 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:12.540 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-toml. 2023-07-09T02:09:12.554 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-09T02:09:12.558 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-mirror (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:12.598 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-09T02:09:12.870 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-colorama. 2023-07-09T02:09:12.885 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-09T02:09:12.901 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pytest. 2023-07-09T02:09:12.915 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-09T02:09:12.928 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-09T02:09:12.959 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-09T02:09:13.189 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-shell. 2023-07-09T02:09:13.205 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:13.239 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-shell (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:13.304 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplejson. 2023-07-09T02:09:13.318 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-09T02:09:13.362 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-09T02:09:13.466 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-top. 2023-07-09T02:09:13.482 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T02:09:13.524 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-top (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:13.631 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-09T02:09:13.646 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-09T02:09:13.689 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-09T02:09:13.777 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-09T02:09:13.793 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:13.835 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs-dev (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:14.305 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package nvme-cli. 2023-07-09T02:09:14.320 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-09T02:09:14.372 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-09T02:09:14.410 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package radosgw. 2023-07-09T02:09:14.424 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../113-radosgw_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:14.468 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking radosgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:14.751 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-09T02:09:14.767 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-09T02:09:14.817 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-09T02:09:15.029 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package rbd-fuse. 2023-07-09T02:09:15.043 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:15.088 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking rbd-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:15.314 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-09T02:09:15.327 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-09T02:09:15.378 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-09T02:09:15.379 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-09T02:09:15.634 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-09T02:09:15.756 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastescript. 2023-07-09T02:09:15.772 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-09T02:09:15.793 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-09T02:09:15.823 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-09T02:09:16.052 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-09T02:09:16.209 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pluggy. 2023-07-09T02:09:16.225 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-09T02:09:16.276 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-09T02:09:16.514 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-09T02:09:16.595 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-psutil. 2023-07-09T02:09:16.611 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-09T02:09:16.645 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-09T02:09:16.998 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-py. 2023-07-09T02:09:17.014 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-09T02:09:17.048 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-09T02:09:17.238 INFO:teuthology.orchestra.run.smithi155.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-09T02:09:17.285 INFO:teuthology.orchestra.run.smithi155.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-09T02:09:17.337 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:17.342 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pygments. 2023-07-09T02:09:17.358 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-09T02:09:17.392 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-09T02:09:17.855 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-09T02:09:17.870 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-09T02:09:17.881 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user cephadm....done 2023-07-09T02:09:17.913 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-09T02:09:18.042 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-09T02:09:18.166 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-toml. 2023-07-09T02:09:18.180 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-09T02:09:18.216 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-09T02:09:18.328 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-09T02:09:18.519 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pytest. 2023-07-09T02:09:18.534 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-09T02:09:18.577 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-09T02:09:18.587 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-09T02:09:18.696 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-09T02:09:18.899 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplejson. 2023-07-09T02:09:18.912 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-09T02:09:18.930 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-09T02:09:18.946 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-09T02:09:19.207 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-09T02:09:19.216 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-09T02:09:19.222 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-09T02:09:19.257 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-09T02:09:19.341 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-09T02:09:19.659 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-09T02:09:19.968 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package radosgw. 2023-07-09T02:09:19.983 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../113-radosgw_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:20.026 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking radosgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:20.029 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-09T02:09:20.312 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-09T02:09:20.563 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-09T02:09:20.613 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package rbd-fuse. 2023-07-09T02:09:20.627 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T02:09:20.671 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking rbd-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:20.831 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-09T02:09:20.947 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-09T02:09:21.099 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-09T02:09:21.209 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-09T02:09:21.335 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-09T02:09:21.399 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-09T02:09:21.606 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-09T02:09:21.667 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-argparse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:21.945 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-09T02:09:22.046 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-09T02:09:22.069 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-09T02:09:22.362 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-09T02:09:22.604 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-09T02:09:22.714 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-09T02:09:22.923 INFO:teuthology.orchestra.run.smithi045.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-09T02:09:22.937 INFO:teuthology.orchestra.run.smithi045.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-09T02:09:22.980 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:23.090 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-09T02:09:23.216 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-09T02:09:23.492 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-09T02:09:23.540 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user cephadm....done 2023-07-09T02:09:23.701 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-09T02:09:23.768 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-09T02:09:23.978 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-09T02:09:24.086 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-09T02:09:24.270 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-09T02:09:24.396 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-09T02:09:24.664 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-09T02:09:24.779 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-09T02:09:24.932 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-09T02:09:25.030 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-09T02:09:25.041 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-09T02:09:25.166 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-09T02:09:25.290 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-09T02:09:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-09T02:09:25.608 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-09T02:09:25.736 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-09T02:09:26.012 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-09T02:09:26.034 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-09T02:09:26.280 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-09T02:09:26.293 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-09T02:09:26.573 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-09T02:09:26.687 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-09T02:09:26.941 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-09T02:09:26.979 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-09T02:09:27.192 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-09T02:09:27.280 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-09T02:09:27.459 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-argparse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:27.623 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-09T02:09:27.735 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-09T02:09:27.836 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-09T02:09:27.883 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-09T02:09:28.009 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:28.088 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-09T02:09:28.310 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-idna (3.3-1) ... 2023-07-09T02:09:28.357 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-09T02:09:28.481 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-09T02:09:28.669 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-09T02:09:28.848 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-09T02:09:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-09T02:09:29.217 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-09T02:09:29.502 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-09T02:09:29.803 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-09T02:09:29.891 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:09:30.025 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-09T02:09:30.294 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-09T02:09:30.428 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-09T02:09:30.513 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-09T02:09:30.544 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-09T02:09:30.797 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-09T02:09:30.846 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-09T02:09:30.915 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-09T02:09:31.049 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-09T02:09:31.097 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-09T02:09:31.350 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-09T02:09:31.365 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:09:31.491 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-09T02:09:31.642 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-09T02:09:31.760 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-09T02:09:31.952 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-09T02:09:32.002 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-09T02:09:32.219 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-09T02:09:32.379 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-09T02:09:32.503 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-09T02:09:32.689 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-09T02:09:32.746 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-09T02:09:33.000 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-09T02:09:33.014 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-09T02:09:33.282 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-09T02:09:33.382 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-09T02:09:33.407 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-09T02:09:33.650 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-09T02:09:33.692 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-09T02:09:33.776 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:33.818 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-09T02:09:34.070 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-idna (3.3-1) ... 2023-07-09T02:09:34.127 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-09T02:09:34.420 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-09T02:09:34.436 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-09T02:09:34.687 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-09T02:09:35.113 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-09T02:09:35.365 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-09T02:09:35.491 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-09T02:09:35.700 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:09:35.818 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-09T02:09:35.893 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-09T02:09:36.102 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-09T02:09:36.160 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-09T02:09:36.228 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-09T02:09:36.354 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-09T02:09:36.419 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:09:36.521 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-09T02:09:36.672 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-09T02:09:36.829 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-09T02:09:36.923 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-09T02:09:37.140 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-09T02:09:37.174 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:09:37.300 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-09T02:09:37.418 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-09T02:09:37.423 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-09T02:09:37.550 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-09T02:09:37.719 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-09T02:09:37.825 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-09T02:09:37.987 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-09T02:09:38.102 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-09T02:09:38.272 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-09T02:09:38.378 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-09T02:09:38.547 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-09T02:09:38.754 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-09T02:09:38.807 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-09T02:09:39.030 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-09T02:09:39.083 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-09T02:09:39.208 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-09T02:09:39.382 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-09T02:09:39.502 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-09T02:09:39.508 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librados2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:39.602 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-09T02:09:39.634 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librgw2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:39.845 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:39.887 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-09T02:09:39.947 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:40.083 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libradosstriper1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:40.205 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-09T02:09:40.207 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-09T02:09:40.481 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-09T02:09:40.500 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librbd1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:40.626 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-modules-core (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:40.880 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-09T02:09:41.020 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:41.141 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-09T02:09:41.268 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-09T02:09:41.295 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-09T02:09:41.295 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-09T02:09:41.677 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-09T02:09:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-09T02:09:41.986 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs-dev (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:42.087 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rados (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:42.188 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-top (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:42.339 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-09T02:09:42.538 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T02:09:42.672 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-09T02:09:42.990 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-09T02:09:43.291 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-09T02:09:43.575 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-09T02:09:43.610 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rbd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:43.701 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-09T02:09:43.736 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up rbd-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:43.837 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:43.938 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cephfs (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:43.977 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-09T02:09:44.064 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-shell (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:44.190 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:44.245 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-09T02:09:44.522 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-09T02:09:44.718 INFO:teuthology.orchestra.run.smithi155.stdout:Adding group ceph....done 2023-07-09T02:09:44.930 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-09T02:09:45.093 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user ceph....done 2023-07-09T02:09:45.223 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-09T02:09:45.280 INFO:teuthology.orchestra.run.smithi155.stdout:Setting system user ceph properties....done 2023-07-09T02:09:45.300 INFO:teuthology.orchestra.run.smithi155.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-09T02:09:45.436 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-09T02:09:45.584 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-09T02:09:45.709 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librados2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:45.835 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librgw2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:45.870 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-09T02:09:46.049 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:46.165 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:46.266 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libradosstriper1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:46.383 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-09T02:09:46.615 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-mirror (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:46.676 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librbd1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:46.777 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-modules-core (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:46.815 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-09T02:09:46.816 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-09T02:09:46.903 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:47.133 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-09T02:09:47.133 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-09T02:09:47.508 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-test (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:47.634 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up radosgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs-dev (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:47.899 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-09T02:09:47.899 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-09T02:09:47.933 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rados (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:48.075 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-top (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:48.186 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-09T02:09:48.964 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-base (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:49.332 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-09T02:09:49.517 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rbd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:49.649 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up rbd-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:49.775 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:49.902 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cephfs (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:50.010 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-shell (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:50.012 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mds (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:50.111 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:50.252 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-09T02:09:50.253 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-09T02:09:50.673 INFO:teuthology.orchestra.run.smithi045.stdout:Adding group ceph....done 2023-07-09T02:09:50.964 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:51.040 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user ceph....done 2023-07-09T02:09:51.178 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-09T02:09:51.178 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-09T02:09:51.193 INFO:teuthology.orchestra.run.smithi045.stdout:Setting system user ceph properties....done 2023-07-09T02:09:51.213 INFO:teuthology.orchestra.run.smithi045.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-09T02:09:51.359 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-09T02:09:51.774 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-09T02:09:51.850 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-osd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:52.185 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-09T02:09:52.186 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-09T02:09:52.537 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-mirror (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-09T02:09:52.752 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-09T02:09:52.892 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:53.018 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:53.152 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mon (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:53.344 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-09T02:09:53.345 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-09T02:09:53.455 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-test (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:53.564 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up radosgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:53.831 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-09T02:09:53.832 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-09T02:09:54.012 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:54.154 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:54.289 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-dashboard (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:54.424 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-volume (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:54.525 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-09T02:09:54.833 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-base (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:55.185 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-09T02:09:55.650 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-09T02:09:55.957 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mds (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:56.128 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-09T02:09:56.130 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-09T02:09:56.188 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-09T02:09:56.188 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-09T02:09:56.206 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2023-07-09T02:09:56.364 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2023-07-09T02:09:56.364 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2023-07-09T02:09:56.506 INFO:teuthology.orchestra.run.smithi155.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-09T02:09:56.506 INFO:teuthology.orchestra.run.smithi155.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-09T02:09:56.506 INFO:teuthology.orchestra.run.smithi155.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-09T02:09:56.506 INFO:teuthology.orchestra.run.smithi155.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-09T02:09:56.506 INFO:teuthology.orchestra.run.smithi155.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-09T02:09:56.507 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2023-07-09T02:09:56.507 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-09T02:09:56.507 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-09T02:09:56.507 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-09T02:09:56.507 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-09T02:09:56.508 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-09T02:09:56.509 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-09T02:09:56.509 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2023-07-09T02:09:56.509 INFO:teuthology.orchestra.run.smithi155.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-09T02:09:56.509 INFO:teuthology.orchestra.run.smithi155.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-09T02:09:56.510 INFO:teuthology.orchestra.run.smithi155.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-09T02:09:56.510 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-09T02:09:56.510 INFO:teuthology.orchestra.run.smithi155.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-09T02:09:56.511 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2023-07-09T02:09:56.511 INFO:teuthology.orchestra.run.smithi155.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-09T02:09:56.511 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-09T02:09:56.512 INFO:teuthology.orchestra.run.smithi155.stdout: libengine-pkcs11-openssl 2023-07-09T02:09:56.555 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2023-07-09T02:09:56.555 INFO:teuthology.orchestra.run.smithi155.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-09T02:09:56.555 INFO:teuthology.orchestra.run.smithi155.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-09T02:09:56.556 INFO:teuthology.orchestra.run.smithi155.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-09T02:09:56.556 INFO:teuthology.orchestra.run.smithi155.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-09T02:09:56.557 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-09T02:09:56.557 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-09T02:09:56.557 INFO:teuthology.orchestra.run.smithi155.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-09T02:09:56.558 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2023-07-09T02:09:56.558 INFO:teuthology.orchestra.run.smithi155.stdout: libssl3 2023-07-09T02:09:56.612 INFO:teuthology.orchestra.run.smithi155.stdout:1 upgraded, 39 newly installed, 0 to remove and 206 not upgraded. 2023-07-09T02:09:56.613 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 54.6 MB of archives. 2023-07-09T02:09:56.613 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-09T02:09:56.613 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-09T02:09:56.713 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-09T02:09:56.768 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-09T02:09:56.781 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-09T02:09:56.781 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-09T02:09:56.781 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-09T02:09:56.781 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-09T02:09:56.782 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-09T02:09:56.782 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-09T02:09:56.782 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-09T02:09:56.817 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-09T02:09:56.817 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-09T02:09:56.850 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:56.867 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-09T02:09:57.069 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-09T02:09:57.070 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-09T02:09:57.158 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-09T02:09:57.161 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-09T02:09:57.161 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-09T02:09:57.164 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-09T02:09:57.164 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-09T02:09:57.168 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-09T02:09:57.170 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-09T02:09:57.177 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-09T02:09:57.211 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-09T02:09:57.362 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-09T02:09:57.362 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-09T02:09:57.372 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-09T02:09:57.393 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-09T02:09:57.396 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-09T02:09:57.397 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-09T02:09:57.398 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-09T02:09:57.398 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-09T02:09:57.410 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-09T02:09:57.412 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-09T02:09:57.598 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-09T02:09:57.615 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-09T02:09:57.616 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-09T02:09:57.616 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-09T02:09:57.634 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-09T02:09:57.635 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-09T02:09:57.734 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-09T02:09:57.735 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-09T02:09:57.792 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-osd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:58.111 INFO:teuthology.orchestra.run.smithi155.stdout:Preconfiguring packages ... 2023-07-09T02:09:58.129 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-09T02:09:58.129 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-09T02:09:58.277 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 54.6 MB in 1s (46.7 MB/s) 2023-07-09T02:09:58.423 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package flex. 2023-07-09T02:09:58.498 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139904 files and directories currently installed.) 2023-07-09T02:09:58.501 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-09T02:09:58.547 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-09T02:09:58.852 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:58.953 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:59.096 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mon (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:09:59.124 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-09T02:09:59.302 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-09T02:09:59.313 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-09T02:09:59.313 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-09T02:09:59.706 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T02:10:00.014 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:10:00.165 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:10:00.235 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package bison. 2023-07-09T02:10:00.299 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-dashboard (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:10:00.309 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139977 files and directories currently installed.) 2023-07-09T02:10:00.314 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-09T02:10:00.363 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-09T02:10:00.442 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-volume (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T02:10:00.568 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-09T02:10:00.763 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-09T02:10:00.777 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-09T02:10:00.822 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-09T02:10:01.166 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package dump. 2023-07-09T02:10:01.180 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-09T02:10:01.224 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking dump (0.4b47-3) ... 2023-07-09T02:10:01.604 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package indent. 2023-07-09T02:10:01.619 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-09T02:10:01.663 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-09T02:10:01.703 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-09T02:10:01.925 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-09T02:10:01.940 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-09T02:10:01.983 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-09T02:10:02.182 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-09T02:10:02.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-09T02:10:02.264 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-07-09T02:10:02.337 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-09T02:10:02.352 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-09T02:10:02.395 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-09T02:10:02.422 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-07-09T02:10:02.423 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-07-09T02:10:02.569 INFO:teuthology.orchestra.run.smithi045.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-09T02:10:02.570 INFO:teuthology.orchestra.run.smithi045.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-09T02:10:02.570 INFO:teuthology.orchestra.run.smithi045.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-09T02:10:02.571 INFO:teuthology.orchestra.run.smithi045.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-09T02:10:02.571 INFO:teuthology.orchestra.run.smithi045.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-09T02:10:02.571 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-07-09T02:10:02.571 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-09T02:10:02.572 INFO:teuthology.orchestra.run.smithi045.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-09T02:10:02.572 INFO:teuthology.orchestra.run.smithi045.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-09T02:10:02.573 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-09T02:10:02.573 INFO:teuthology.orchestra.run.smithi045.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-09T02:10:02.573 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-09T02:10:02.573 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-07-09T02:10:02.574 INFO:teuthology.orchestra.run.smithi045.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-09T02:10:02.574 INFO:teuthology.orchestra.run.smithi045.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-09T02:10:02.575 INFO:teuthology.orchestra.run.smithi045.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-09T02:10:02.575 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-09T02:10:02.575 INFO:teuthology.orchestra.run.smithi045.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-09T02:10:02.576 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-07-09T02:10:02.576 INFO:teuthology.orchestra.run.smithi045.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-09T02:10:02.576 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-09T02:10:02.576 INFO:teuthology.orchestra.run.smithi045.stdout: libengine-pkcs11-openssl 2023-07-09T02:10:02.617 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-07-09T02:10:02.618 INFO:teuthology.orchestra.run.smithi045.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-09T02:10:02.618 INFO:teuthology.orchestra.run.smithi045.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-09T02:10:02.618 INFO:teuthology.orchestra.run.smithi045.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-09T02:10:02.618 INFO:teuthology.orchestra.run.smithi045.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-09T02:10:02.618 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-09T02:10:02.619 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-09T02:10:02.619 INFO:teuthology.orchestra.run.smithi045.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-09T02:10:02.619 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-07-09T02:10:02.619 INFO:teuthology.orchestra.run.smithi045.stdout: libssl3 2023-07-09T02:10:02.647 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-09T02:10:02.663 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-09T02:10:02.674 INFO:teuthology.orchestra.run.smithi045.stdout:1 upgraded, 39 newly installed, 0 to remove and 206 not upgraded. 2023-07-09T02:10:02.674 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 54.6 MB of archives. 2023-07-09T02:10:02.674 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-09T02:10:02.675 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-09T02:10:02.697 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-09T02:10:02.775 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-09T02:10:02.831 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-09T02:10:02.838 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-09T02:10:02.839 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-09T02:10:02.841 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-09T02:10:02.842 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-09T02:10:02.842 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-09T02:10:02.843 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-09T02:10:02.844 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-09T02:10:02.881 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-09T02:10:02.882 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-09T02:10:02.933 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-09T02:10:03.018 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-09T02:10:03.033 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-09T02:10:03.076 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-09T02:10:03.248 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-09T02:10:03.250 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-09T02:10:03.251 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-09T02:10:03.253 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-09T02:10:03.254 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-09T02:10:03.258 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-09T02:10:03.260 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-09T02:10:03.267 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-09T02:10:03.303 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-09T02:10:03.328 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-09T02:10:03.343 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-09T02:10:03.386 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-09T02:10:03.459 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-09T02:10:03.460 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-09T02:10:03.470 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-09T02:10:03.492 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-09T02:10:03.495 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-09T02:10:03.496 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-09T02:10:03.497 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-09T02:10:03.497 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-09T02:10:03.509 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-09T02:10:03.511 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-09T02:10:03.622 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjson-perl. 2023-07-09T02:10:03.638 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-09T02:10:03.680 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-09T02:10:03.699 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-09T02:10:03.717 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-09T02:10:03.717 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-09T02:10:03.717 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-09T02:10:03.735 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-09T02:10:03.736 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-09T02:10:03.834 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-09T02:10:03.835 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-09T02:10:03.967 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-09T02:10:03.982 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-09T02:10:04.017 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-09T02:10:04.226 INFO:teuthology.orchestra.run.smithi045.stdout:Preconfiguring packages ... 2023-07-09T02:10:04.380 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 54.6 MB in 1s (45.2 MB/s) 2023-07-09T02:10:04.509 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package flex. 2023-07-09T02:10:04.584 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139904 files and directories currently installed.) 2023-07-09T02:10:04.588 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-09T02:10:04.633 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-09T02:10:05.186 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-09T02:10:05.363 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-09T02:10:05.419 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-09T02:10:05.434 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-09T02:10:05.478 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T02:10:05.730 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-09T02:10:05.745 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-09T02:10:05.770 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T02:10:05.788 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T02:10:06.116 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-09T02:10:06.131 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-09T02:10:06.174 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T02:10:06.339 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package bison. 2023-07-09T02:10:06.416 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139977 files and directories currently installed.) 2023-07-09T02:10:06.419 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-09T02:10:06.466 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-09T02:10:06.502 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-09T02:10:06.517 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-09T02:10:06.552 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-09T02:10:06.884 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-09T02:10:06.898 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-09T02:10:06.914 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-09T02:10:06.928 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-09T02:10:06.942 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-09T02:10:06.972 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-09T02:10:07.270 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package dump. 2023-07-09T02:10:07.284 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-09T02:10:07.328 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking dump (0.4b47-3) ... 2023-07-09T02:10:07.416 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-09T02:10:07.432 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:07.475 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:07.598 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package indent. 2023-07-09T02:10:07.613 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-09T02:10:07.656 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-09T02:10:07.802 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-09T02:10:07.818 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:07.860 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T02:10:07.909 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-09T02:10:07.924 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-09T02:10:07.969 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-09T02:10:08.130 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-09T02:10:08.145 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:08.188 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T02:10:08.305 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-09T02:10:08.319 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-09T02:10:08.363 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-09T02:10:08.440 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-09T02:10:08.455 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-09T02:10:08.507 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T02:10:08.623 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-09T02:10:08.639 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-09T02:10:08.674 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-09T02:10:08.993 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-09T02:10:09.009 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-09T02:10:09.010 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-09T02:10:09.025 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-09T02:10:09.051 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-09T02:10:09.069 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-09T02:10:09.304 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-09T02:10:09.319 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-09T02:10:09.362 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-09T02:10:09.363 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package modemmanager. 2023-07-09T02:10:09.378 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-09T02:10:09.422 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T02:10:09.614 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjson-perl. 2023-07-09T02:10:09.630 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-09T02:10:09.689 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-09T02:10:09.993 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-09T02:10:10.008 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-09T02:10:10.051 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-09T02:10:10.086 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager. 2023-07-09T02:10:10.101 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-09T02:10:10.143 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-09T02:10:10.709 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ppp. 2023-07-09T02:10:10.724 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-09T02:10:11.106 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-09T02:10:11.396 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pptp-linux. 2023-07-09T02:10:11.410 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-09T02:10:11.437 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-09T02:10:11.447 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-09T02:10:11.452 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-09T02:10:11.495 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T02:10:11.699 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-09T02:10:11.716 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-09T02:10:11.756 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-09T02:10:11.772 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-09T02:10:11.814 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T02:10:12.100 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-09T02:10:12.108 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-09T02:10:12.116 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-09T02:10:12.158 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T02:10:12.453 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-09T02:10:12.468 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-09T02:10:12.503 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-09T02:10:12.511 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-common (238) ... 2023-07-09T02:10:12.519 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-09T02:10:12.564 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-09T02:10:12.814 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-09T02:10:12.830 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:12.873 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:12.888 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-09T02:10:12.905 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-09T02:10:12.947 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-09T02:10:13.378 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-common. 2023-07-09T02:10:13.392 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-09T02:10:13.445 INFO:teuthology.orchestra.run.smithi155.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-09T02:10:13.477 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-common (238) ... 2023-07-09T02:10:13.725 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-09T02:10:13.740 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:13.792 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:13.918 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-14. 2023-07-09T02:10:13.934 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:13.979 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:14.111 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-09T02:10:14.127 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:14.169 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T02:10:14.463 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-09T02:10:14.479 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:14.524 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T02:10:14.774 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-09T02:10:14.790 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-09T02:10:14.832 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T02:10:15.013 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql. 2023-07-09T02:10:15.027 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-09T02:10:15.062 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql (14+238) ... 2023-07-09T02:10:15.306 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client. 2023-07-09T02:10:15.319 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-09T02:10:15.321 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-09T02:10:15.334 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-09T02:10:15.364 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client (14+238) ... 2023-07-09T02:10:15.377 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-09T02:10:15.608 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-09T02:10:15.622 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-09T02:10:15.658 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-09T02:10:15.730 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package modemmanager. 2023-07-09T02:10:15.745 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-09T02:10:15.788 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T02:10:15.961 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl8.6. 2023-07-09T02:10:15.975 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-09T02:10:16.019 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-09T02:10:16.280 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl. 2023-07-09T02:10:16.294 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-09T02:10:16.342 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-09T02:10:16.378 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager. 2023-07-09T02:10:16.393 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-09T02:10:16.444 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-09T02:10:16.691 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package wpasupplicant. 2023-07-09T02:10:16.706 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-09T02:10:16.749 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-09T02:10:16.968 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ppp. 2023-07-09T02:10:16.984 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-09T02:10:17.070 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-09T02:10:17.085 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-09T02:10:17.240 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-09T02:10:17.350 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-09T02:10:17.625 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-09T02:10:17.641 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-09T02:10:17.664 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package pptp-linux. 2023-07-09T02:10:17.679 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-09T02:10:17.692 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-09T02:10:17.723 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-09T02:10:17.950 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-common (238) ... 2023-07-09T02:10:18.025 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-09T02:10:18.039 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-09T02:10:18.084 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-09T02:10:18.156 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-09T02:10:18.299 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-09T02:10:18.378 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-09T02:10:18.393 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-09T02:10:18.400 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:18.437 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client-common (238) ... 2023-07-09T02:10:18.501 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-09T02:10:18.627 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-09T02:10:18.740 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-09T02:10:18.753 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:18.757 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:18.799 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:19.353 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-common. 2023-07-09T02:10:19.368 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-09T02:10:19.430 INFO:teuthology.orchestra.run.smithi045.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-09T02:10:19.460 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-common (238) ... 2023-07-09T02:10:19.760 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-09T02:10:19.850 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-09T02:10:19.902 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-14. 2023-07-09T02:10:19.918 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T02:10:19.964 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:20.223 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-09T02:10:20.223 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-09T02:10:20.970 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-09T02:10:21.014 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql. 2023-07-09T02:10:21.028 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-09T02:10:21.072 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql (14+238) ... 2023-07-09T02:10:21.096 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T02:10:21.222 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-09T02:10:21.308 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client. 2023-07-09T02:10:21.322 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-09T02:10:21.349 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-09T02:10:21.358 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client (14+238) ... 2023-07-09T02:10:21.473 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-09T02:10:21.576 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-09T02:10:21.591 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-09T02:10:21.600 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-09T02:10:21.635 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-09T02:10:21.717 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-09T02:10:21.979 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package tcl8.6. 2023-07-09T02:10:21.994 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-09T02:10:22.037 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-09T02:10:22.298 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package tcl. 2023-07-09T02:10:22.313 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-09T02:10:22.361 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-09T02:10:22.381 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-09T02:10:22.507 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up dump (0.4b47-3) ... 2023-07-09T02:10:22.602 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-09T02:10:22.667 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T02:10:22.676 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package wpasupplicant. 2023-07-09T02:10:22.692 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-09T02:10:22.725 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-09T02:10:22.776 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-09T02:10:22.894 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-09T02:10:23.020 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-09T02:10:23.063 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-09T02:10:23.079 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-09T02:10:23.121 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-09T02:10:23.146 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-09T02:10:23.236 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-09T02:10:23.307 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-09T02:10:23.431 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-09T02:10:23.508 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-09T02:10:23.524 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-09T02:10:23.576 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-09T02:10:23.607 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-09T02:10:23.734 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T02:10:23.843 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-09T02:10:23.859 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client-common (238) ... 2023-07-09T02:10:23.994 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client (14+238) ... 2023-07-09T02:10:24.063 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-09T02:10:24.120 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-09T02:10:24.190 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-09T02:10:24.316 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:24.442 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-09T02:10:24.568 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-09T02:10:24.735 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:24.778 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:24.778 INFO:teuthology.orchestra.run.smithi155.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-09T02:10:24.778 INFO:teuthology.orchestra.run.smithi155.stdout:which means they are currently configured by ifupdown: 2023-07-09T02:10:24.779 INFO:teuthology.orchestra.run.smithi155.stdout:- enp3s0f1 2023-07-09T02:10:24.779 INFO:teuthology.orchestra.run.smithi155.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-09T02:10:24.779 INFO:teuthology.orchestra.run.smithi155.stdout:remove their configuration from /etc/network/interfaces. 2023-07-09T02:10:24.779 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:24.910 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-09T02:10:25.356 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-09T02:10:25.750 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-09T02:10:25.784 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-09T02:10:25.850 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-09T02:10:26.255 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-09T02:10:26.255 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-09T02:10:26.581 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T02:10:26.691 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-09T02:10:26.808 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-09T02:10:26.934 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-common (238) ... 2023-07-09T02:10:27.003 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-09T02:10:27.103 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T02:10:27.221 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-09T02:10:27.347 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-09T02:10:27.473 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-09T02:10:27.599 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-09T02:10:27.725 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-09T02:10:28.135 INFO:teuthology.orchestra.run.smithi155.stdout:Adding user postgres to group ssl-cert 2023-07-09T02:10:28.347 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-09T02:10:28.368 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:28.368 INFO:teuthology.orchestra.run.smithi155.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-09T02:10:28.473 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up dump (0.4b47-3) ... 2023-07-09T02:10:28.569 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-09T02:10:28.634 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T02:10:28.643 INFO:teuthology.orchestra.run.smithi155.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-09T02:10:28.643 INFO:teuthology.orchestra.run.smithi155.stdout:Removing obsolete dictionary files: 2023-07-09T02:10:28.759 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-09T02:10:28.902 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-09T02:10:29.019 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-09T02:10:29.137 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-09T02:10:29.211 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-09T02:10:29.280 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-09T02:10:29.406 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-09T02:10:29.444 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-09T02:10:29.582 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-09T02:10:29.700 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T02:10:29.818 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-09T02:10:29.944 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:29.986 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client (14+238) ... 2023-07-09T02:10:30.144 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-09T02:10:30.277 INFO:teuthology.orchestra.run.smithi155.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-09T02:10:30.308 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-09T02:10:30.360 INFO:teuthology.orchestra.run.smithi155.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-09T02:10:30.360 INFO:teuthology.orchestra.run.smithi155.stdout:This user must also own the server process. 2023-07-09T02:10:30.360 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:30.361 INFO:teuthology.orchestra.run.smithi155.stdout:The database cluster will be initialized with locale "en_US". 2023-07-09T02:10:30.361 INFO:teuthology.orchestra.run.smithi155.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-09T02:10:30.361 INFO:teuthology.orchestra.run.smithi155.stdout:The default text search configuration will be set to "english". 2023-07-09T02:10:30.361 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:30.361 INFO:teuthology.orchestra.run.smithi155.stdout:Data page checksums are disabled. 2023-07-09T02:10:30.361 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:30.361 INFO:teuthology.orchestra.run.smithi155.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-09T02:10:30.362 INFO:teuthology.orchestra.run.smithi155.stdout:creating subdirectories ... ok 2023-07-09T02:10:30.362 INFO:teuthology.orchestra.run.smithi155.stdout:selecting dynamic shared memory implementation ... posix 2023-07-09T02:10:30.385 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default max_connections ... 100 2023-07-09T02:10:30.420 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default shared_buffers ... 128MB 2023-07-09T02:10:30.431 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default time zone ... Etc/UTC 2023-07-09T02:10:30.432 INFO:teuthology.orchestra.run.smithi155.stdout:creating configuration files ... ok 2023-07-09T02:10:30.608 INFO:teuthology.orchestra.run.smithi155.stdout:running bootstrap script ... ok 2023-07-09T02:10:30.813 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-09T02:10:30.815 INFO:teuthology.orchestra.run.smithi045.stdout:which means they are currently configured by ifupdown: 2023-07-09T02:10:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:- ens1f0 2023-07-09T02:10:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-09T02:10:30.816 INFO:teuthology.orchestra.run.smithi045.stdout:remove their configuration from /etc/network/interfaces. 2023-07-09T02:10:30.816 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:30.953 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-09T02:10:31.251 INFO:teuthology.orchestra.run.smithi155.stdout:performing post-bootstrap initialization ... ok 2023-07-09T02:10:31.377 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-09T02:10:31.770 INFO:teuthology.orchestra.run.smithi155.stdout:syncing data to disk ... ok 2023-07-09T02:10:31.819 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-09T02:10:32.367 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-09T02:10:32.631 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T02:10:32.774 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-09T02:10:32.909 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-09T02:10:33.034 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-common (238) ... 2023-07-09T02:10:34.249 INFO:teuthology.orchestra.run.smithi045.stdout:Adding user postgres to group ssl-cert 2023-07-09T02:10:34.528 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:34.529 INFO:teuthology.orchestra.run.smithi045.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-09T02:10:34.815 INFO:teuthology.orchestra.run.smithi045.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-09T02:10:34.816 INFO:teuthology.orchestra.run.smithi045.stdout:Removing obsolete dictionary files: 2023-07-09T02:10:35.417 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T02:10:35.548 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-09T02:10:35.583 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-09T02:10:35.694 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql (14+238) ... 2023-07-09T02:10:35.828 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T02:10:35.938 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T02:10:36.054 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T02:10:36.190 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-09T02:10:36.190 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-09T02:10:36.429 INFO:teuthology.orchestra.run.smithi045.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-09T02:10:36.454 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-09T02:10:36.510 INFO:teuthology.orchestra.run.smithi045.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-09T02:10:36.510 INFO:teuthology.orchestra.run.smithi045.stdout:This user must also own the server process. 2023-07-09T02:10:36.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:36.510 INFO:teuthology.orchestra.run.smithi045.stdout:The database cluster will be initialized with locale "en_US". 2023-07-09T02:10:36.511 INFO:teuthology.orchestra.run.smithi045.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-09T02:10:36.511 INFO:teuthology.orchestra.run.smithi045.stdout:The default text search configuration will be set to "english". 2023-07-09T02:10:36.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:36.511 INFO:teuthology.orchestra.run.smithi045.stdout:Data page checksums are disabled. 2023-07-09T02:10:36.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:36.511 INFO:teuthology.orchestra.run.smithi045.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-09T02:10:36.512 INFO:teuthology.orchestra.run.smithi045.stdout:creating subdirectories ... ok 2023-07-09T02:10:36.512 INFO:teuthology.orchestra.run.smithi045.stdout:selecting dynamic shared memory implementation ... posix 2023-07-09T02:10:36.535 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default max_connections ... 100 2023-07-09T02:10:36.570 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default shared_buffers ... 128MB 2023-07-09T02:10:36.584 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default time zone ... Etc/UTC 2023-07-09T02:10:36.585 INFO:teuthology.orchestra.run.smithi045.stdout:creating configuration files ... ok 2023-07-09T02:10:36.769 INFO:teuthology.orchestra.run.smithi045.stdout:running bootstrap script ... ok 2023-07-09T02:10:37.040 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-09T02:10:37.350 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-09T02:10:37.408 INFO:teuthology.orchestra.run.smithi045.stdout:performing post-bootstrap initialization ... ok 2023-07-09T02:10:37.510 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-09T02:10:37.940 INFO:teuthology.orchestra.run.smithi045.stdout:syncing data to disk ... ok 2023-07-09T02:10:38.491 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-09T02:10:38.896 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-09T02:10:38.987 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-09T02:10:39.692 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-09T02:10:39.696 DEBUG:teuthology.parallel:result is None 2023-07-09T02:10:41.580 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T02:10:41.680 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-09T02:10:41.806 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql (14+238) ... 2023-07-09T02:10:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T02:10:42.058 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T02:10:42.333 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-09T02:10:42.334 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-09T02:10:43.111 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-09T02:10:43.405 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-09T02:10:43.565 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-09T02:10:45.218 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-09T02:10:45.318 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-09T02:10:46.008 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-09T02:10:46.012 DEBUG:teuthology.parallel:result is None 2023-07-09T02:10:46.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T02:10:46.351 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-query -W -f '${Version}' ceph 2023-07-09T02:10:46.374 INFO:teuthology.orchestra.run.smithi045.stdout:18.0.0-4759-g35b2d86c-1jammy 2023-07-09T02:10:46.375 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T02:10:46.375 INFO:teuthology.task.install:The correct ceph version 18.0.0-4759-g35b2d86c-1jammy is installed. 2023-07-09T02:10:46.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T02:10:46.519 DEBUG:teuthology.orchestra.run.smithi155:> dpkg-query -W -f '${Version}' ceph 2023-07-09T02:10:46.543 INFO:teuthology.orchestra.run.smithi155.stdout:18.0.0-4759-g35b2d86c-1jammy 2023-07-09T02:10:46.544 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T02:10:46.544 INFO:teuthology.task.install:The correct ceph version 18.0.0-4759-g35b2d86c-1jammy is installed. 2023-07-09T02:10:46.544 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-09T02:10:46.545 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:46.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-09T02:10:46.569 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:46.570 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-09T02:10:46.607 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-09T02:10:46.609 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:46.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-07-09T02:10:46.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-09T02:10:46.701 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:46.702 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2023-07-09T02:10:46.724 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-09T02:10:46.788 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-09T02:10:46.789 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:46.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-09T02:10:46.814 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-09T02:10:46.881 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:46.882 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-09T02:10:46.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-09T02:10:46.971 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-09T02:10:46.972 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:46.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-07-09T02:10:46.994 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-09T02:10:47.058 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:47.058 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2023-07-09T02:10:47.080 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-09T02:10:47.143 INFO:teuthology.run_tasks:Running task ceph... 2023-07-09T02:10:47.226 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-09T02:10:47.227 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-07-09T02:10:47.231 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2023-07-09T02:10:47.252 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-09T02:10:47.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-09T02:10:47.298 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-09T02:10:47.320 INFO:tasks.ceph:Creating extra log directories... 2023-07-09T02:10:47.321 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-09T02:10:47.369 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-09T02:10:47.404 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-09T02:10:47.404 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-09T02:10:47.405 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-09T02:10:47.405 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:47.406 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-09T02:10:47.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-09T02:10:47.535 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:47.536 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-09T02:10:47.545 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-09T02:10:47.655 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-09T02:10:47.655 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-09T02:10:47.656 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258', 'branch': 'wip-rishabh-2023Jul9', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7331258', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul9'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul9', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul9', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '35b2d86cfd512f15ace2077050d20c8669933212', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNb5m0fWJWMgfekhzFMSSRi0tDoW9NldytSVIT87hG1H4558e9pBEHzcH44ohGExahrdouYBBthQ89E67WpA6tk=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUISXnKBKQ2cR4u244Tk/vUZUCdZCv0mM9QS/GlwYer2Jy9DKFQapK4stXCBMPo7NChKjszTYzr2mTpZdvXfS8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-08_23:33:40', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-09T02:10:47.657 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-09T02:10:47.664 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-09T02:10:47.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-07-09T02:10:47.714 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2023-07-09T02:10:47.744 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:47.745 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-07-09T02:10:47.793 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-09T02:10:47.793 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-07-09T02:10:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-09T02:10:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T02:10:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 905 Links: 1 2023-07-09T02:10:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T02:10:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-07-09 02:04:24.705345125 +0000 2023-07-09T02:10:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-07-09 02:04:24.301348734 +0000 2023-07-09T02:10:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-07-09 02:04:24.301348734 +0000 2023-07-09T02:10:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-07-09 02:04:24.301348734 +0000 2023-07-09T02:10:47.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-09T02:10:47.913 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-07-09T02:10:47.913 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-07-09T02:10:47.913 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000274402 s, 1.9 MB/s 2023-07-09T02:10:47.915 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-09T02:10:47.972 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-07-09T02:10:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-09T02:10:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T02:10:48.023 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-07-09T02:10:48.023 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T02:10:48.023 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-07-09 02:04:25.357339302 +0000 2023-07-09T02:10:48.024 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-07-09 02:04:24.941343016 +0000 2023-07-09T02:10:48.024 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-07-09 02:04:24.941343016 +0000 2023-07-09T02:10:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-07-09 02:04:24.941343016 +0000 2023-07-09T02:10:48.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-09T02:10:48.089 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-07-09T02:10:48.090 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-07-09T02:10:48.090 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000288092 s, 1.8 MB/s 2023-07-09T02:10:48.091 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-09T02:10:48.145 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-07-09T02:10:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-09T02:10:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T02:10:48.199 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 938 Links: 1 2023-07-09T02:10:48.199 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T02:10:48.199 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-07-09 02:04:25.997333585 +0000 2023-07-09T02:10:48.199 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-07-09 02:04:25.609337050 +0000 2023-07-09T02:10:48.200 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-07-09 02:04:25.609337050 +0000 2023-07-09T02:10:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-07-09 02:04:25.609337050 +0000 2023-07-09T02:10:48.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-09T02:10:48.261 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-07-09T02:10:48.262 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-07-09T02:10:48.262 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00026558 s, 1.9 MB/s 2023-07-09T02:10:48.263 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-09T02:10:48.317 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-07-09T02:10:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-09T02:10:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T02:10:48.371 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 957 Links: 1 2023-07-09T02:10:48.371 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T02:10:48.372 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-07-09 02:04:26.645327797 +0000 2023-07-09T02:10:48.372 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-07-09 02:04:26.245331370 +0000 2023-07-09T02:10:48.372 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-07-09 02:04:26.245331370 +0000 2023-07-09T02:10:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-07-09 02:04:26.245331370 +0000 2023-07-09T02:10:48.373 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-09T02:10:48.433 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-07-09T02:10:48.434 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-07-09T02:10:48.434 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000245546 s, 2.1 MB/s 2023-07-09T02:10:48.435 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-09T02:10:48.492 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:48.492 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:48.493 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2023-07-09T02:10:48.502 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-09T02:10:48.502 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2023-07-09T02:10:48.551 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-09T02:10:48.551 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T02:10:48.552 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-07-09T02:10:48.552 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T02:10:48.552 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-07-09 02:04:23.160172151 +0000 2023-07-09T02:10:48.552 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-07-09 02:04:22.772175613 +0000 2023-07-09T02:10:48.552 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-07-09 02:04:22.772175613 +0000 2023-07-09T02:10:48.552 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-07-09 02:04:22.772175613 +0000 2023-07-09T02:10:48.553 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-09T02:10:48.614 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-07-09T02:10:48.614 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-07-09T02:10:48.614 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000381492 s, 1.3 MB/s 2023-07-09T02:10:48.615 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-09T02:10:48.670 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2023-07-09T02:10:48.723 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-09T02:10:48.724 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T02:10:48.724 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 921 Links: 1 2023-07-09T02:10:48.724 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T02:10:48.724 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-07-09 02:04:23.868165836 +0000 2023-07-09T02:10:48.724 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-07-09 02:04:23.448169582 +0000 2023-07-09T02:10:48.725 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-07-09 02:04:23.448169582 +0000 2023-07-09T02:10:48.725 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-07-09 02:04:23.448169582 +0000 2023-07-09T02:10:48.725 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-09T02:10:48.790 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-07-09T02:10:48.791 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-07-09T02:10:48.791 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000384921 s, 1.3 MB/s 2023-07-09T02:10:48.793 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-09T02:10:48.852 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2023-07-09T02:10:48.903 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-09T02:10:48.903 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T02:10:48.903 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-07-09T02:10:48.904 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T02:10:48.904 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-07-09 02:04:24.548159769 +0000 2023-07-09T02:10:48.904 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-07-09 02:04:24.132163481 +0000 2023-07-09T02:10:48.904 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-07-09 02:04:24.132163481 +0000 2023-07-09T02:10:48.904 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-07-09 02:04:24.132163481 +0000 2023-07-09T02:10:48.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-09T02:10:48.966 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-07-09T02:10:48.966 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-07-09T02:10:48.966 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000391358 s, 1.3 MB/s 2023-07-09T02:10:48.967 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-09T02:10:49.024 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2023-07-09T02:10:49.075 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-09T02:10:49.075 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T02:10:49.075 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-07-09T02:10:49.076 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T02:10:49.076 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-07-09 02:04:25.208153882 +0000 2023-07-09T02:10:49.076 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-07-09 02:04:24.808157450 +0000 2023-07-09T02:10:49.076 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-07-09 02:04:24.808157450 +0000 2023-07-09T02:10:49.076 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-07-09 02:04:24.808157450 +0000 2023-07-09T02:10:49.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-09T02:10:49.141 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-07-09T02:10:49.141 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-07-09T02:10:49.141 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.00039881 s, 1.3 MB/s 2023-07-09T02:10:49.143 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-09T02:10:49.200 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:49.201 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-09T02:10:49.201 INFO:tasks.ceph:Generating config... 2023-07-09T02:10:49.202 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-09T02:10:49.202 INFO:tasks.ceph:[client] debug client = 20 2023-07-09T02:10:49.203 INFO:tasks.ceph:[client] debug ms = 1 2023-07-09T02:10:49.203 INFO:tasks.ceph:[client] pid file = 2023-07-09T02:10:49.203 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-09T02:10:49.203 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-09T02:10:49.203 INFO:tasks.ceph:[client.0] debug client = 20 2023-07-09T02:10:49.204 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-07-09T02:10:49.204 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-07-09T02:10:49.204 INFO:tasks.ceph:[client.1] debug client = 20 2023-07-09T02:10:49.204 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-07-09T02:10:49.204 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-07-09T02:10:49.205 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-09T02:10:49.205 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-09T02:10:49.205 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-09T02:10:49.205 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-09T02:10:49.205 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-09T02:10:49.206 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-09T02:10:49.206 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-09T02:10:49.206 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-09T02:10:49.206 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-09T02:10:49.206 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-09T02:10:49.207 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-09T02:10:49.207 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-09T02:10:49.207 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-09T02:10:49.207 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-09T02:10:49.207 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-09T02:10:49.207 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-09T02:10:49.208 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-09T02:10:49.208 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-07-09T02:10:49.208 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-07-09T02:10:49.208 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-07-09T02:10:49.208 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-09T02:10:49.209 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-09T02:10:49.209 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-09T02:10:49.209 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-09T02:10:49.209 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-09T02:10:49.209 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-09T02:10:49.210 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-09T02:10:49.210 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-09T02:10:49.210 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-09T02:10:49.210 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-09T02:10:49.210 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-07-09T02:10:49.211 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-09T02:10:49.211 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-09T02:10:49.211 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-09T02:10:49.211 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-07-09T02:10:49.213 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-07-09T02:10:49.213 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-07-09T02:10:49.214 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-09T02:10:49.214 INFO:tasks.ceph:Setting up mon.a... 2023-07-09T02:10:49.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-09T02:10:49.263 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-07-09T02:10:49.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-09T02:10:49.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T02:10:49.350 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2023-07-09T02:10:49.351 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-09T02:10:49.352 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:49.352 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-09T02:10:49.406 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:49.502 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:49.503 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid baf8f4e1-db15-4e56-a3ea-d65b4f02f49e 2023-07-09T02:10:49.503 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2023-07-09T02:10:49.503 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-07-09T02:10:49.503 INFO:teuthology.orchestra.run.smithi045.stdout:fsid baf8f4e1-db15-4e56-a3ea-d65b4f02f49e 2023-07-09T02:10:49.503 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-07-09T02:10:49.503440+0000 2023-07-09T02:10:49.504 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-07-09T02:10:49.503440+0000 2023-07-09T02:10:49.504 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2023-07-09T02:10:49.504 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-07-09T02:10:49.504 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-07-09T02:10:49.504 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2023-07-09T02:10:49.504 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2023-07-09T02:10:49.504 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-09T02:10:49.506 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-09T02:10:49.558 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID baf8f4e1-db15-4e56-a3ea-d65b4f02f49e... 2023-07-09T02:10:49.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-09T02:10:49.604 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-09T02:10:49.648 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-07-09T02:10:49.648 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-07-09T02:10:49.648 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-09T02:10:49.648 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-07-09T02:10:49.649 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.649 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-07-09T02:10:49.649 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.649 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-07-09T02:10:49.649 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.650 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-07-09T02:10:49.650 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-07-09T02:10:49.650 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.650 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-07-09T02:10:49.650 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-07-09T02:10:49.650 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.651 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-09T02:10:49.651 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-07-09T02:10:49.651 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.651 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-07-09T02:10:49.651 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-09T02:10:49.651 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.651 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-07-09T02:10:49.652 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.652 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-07-09T02:10:49.652 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-07-09T02:10:49.652 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-07-09T02:10:49.652 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-07-09T02:10:49.652 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-07-09T02:10:49.652 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-07-09T02:10:49.652 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-07-09T02:10:49.653 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-09T02:10:49.653 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-09T02:10:49.653 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-07-09T02:10:49.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.653 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-09T02:10:49.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.653 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-07-09T02:10:49.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.654 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-07-09T02:10:49.654 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.654 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-07-09T02:10:49.654 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-07-09T02:10:49.654 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-07-09T02:10:49.654 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-07-09T02:10:49.654 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on skipped message = False 2023-07-09T02:10:49.654 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = baf8f4e1-db15-4e56-a3ea-d65b4f02f49e 2023-07-09T02:10:49.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.655 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-07-09T02:10:49.655 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-07-09T02:10:49.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.655 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-07-09T02:10:49.655 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-07-09T02:10:49.655 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-07-09T02:10:49.656 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.656 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-07-09T02:10:49.656 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-07-09T02:10:49.656 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.656 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-07-09T02:10:49.656 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-07-09T02:10:49.656 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-07-09T02:10:49.656 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.657 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-07-09T02:10:49.657 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-07-09T02:10:49.657 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.657 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-07-09T02:10:49.657 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.657 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-07-09T02:10:49.657 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.658 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-07-09T02:10:49.658 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.658 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-07-09T02:10:49.658 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-07-09T02:10:49.658 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.658 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-07-09T02:10:49.658 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-07-09T02:10:49.659 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2023-07-09T02:10:49.659 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2023-07-09T02:10:49.659 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2023-07-09T02:10:49.659 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-07-09T02:10:49.659 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-07-09T02:10:49.659 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2023-07-09T02:10:49.659 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2023-07-09T02:10:49.659 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-07-09T02:10:49.660 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-07-09T02:10:49.660 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2023-07-09T02:10:49.660 INFO:teuthology.orchestra.run.smithi045.stdout: memstore device bytes = 200000000 2023-07-09T02:10:49.660 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-07-09T02:10:49.660 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-07-09T02:10:49.660 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-07-09T02:10:49.660 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 1.0 2023-07-09T02:10:49.661 INFO:teuthology.orchestra.run.smithi045.stdout: osd mon report interval = 5 2023-07-09T02:10:49.661 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = memstore 2023-07-09T02:10:49.661 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-07-09T02:10:49.661 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.661 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-07-09T02:10:49.661 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-07-09T02:10:49.661 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-07-09T02:10:49.661 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-07-09T02:10:49.662 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-07-09T02:10:49.662 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-07-09T02:10:49.662 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-07-09T02:10:49.662 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-07-09T02:10:49.662 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.662 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-07-09T02:10:49.662 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-07-09T02:10:49.662 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-07-09T02:10:49.663 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-07-09T02:10:49.663 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-07-09T02:10:49.663 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-07-09T02:10:49.663 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-07-09T02:10:49.663 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-07-09T02:10:49.663 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-07-09T02:10:49.664 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-07-09T02:10:49.664 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-07-09T02:10:49.664 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.668 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-09T02:10:49.668 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-07-09T02:10:49.669 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-07-09T02:10:49.669 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.669 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-07-09T02:10:49.669 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-09T02:10:49.670 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-09T02:10:49.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.670 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-07-09T02:10:49.670 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-07-09T02:10:49.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.670 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-07-09T02:10:49.670 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-07-09T02:10:49.671 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull ratio = 0.6 2023-07-09T02:10:49.671 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.7 2023-07-09T02:10:49.671 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.6 2023-07-09T02:10:49.671 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:10:49.671 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-07-09T02:10:49.671 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-07-09T02:10:49.672 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-07-09T02:10:49.672 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-07-09T02:10:49.672 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-09T02:10:49.673 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-09T02:10:49.673 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-07-09T02:10:49.673 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-07-09T02:10:49.673 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-07-09T02:10:49.673 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-07-09T02:10:49.673 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-07-09T02:10:49.673 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-07-09T02:10:49.673 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-07-09T02:10:49.674 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-07-09T02:10:49.674 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-07-09T02:10:49.674 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-07-09T02:10:49.674 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-07-09T02:10:49.674 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-07-09T02:10:49.674 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-07-09T02:10:49.674 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:10:49.675 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-07-09T02:10:49.675 INFO:teuthology.orchestra.run.smithi045.stdout: debug objectcacher = 20 2023-07-09T02:10:49.675 INFO:teuthology.orchestra.run.smithi045.stdout: debug objecter = 20 2023-07-09T02:10:49.675 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-07-09T02:10:49.675 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-07-09T02:10:49.675 INFO:teuthology.orchestra.run.smithi045.stdout: debug objectcacher = 20 2023-07-09T02:10:49.675 INFO:teuthology.orchestra.run.smithi045.stdout: debug objecter = 20 2023-07-09T02:10:49.677 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-07-09T02:10:49.678 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-07-09T02:10:49.678 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-07-09T02:10:49.679 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-07-09T02:10:49.679 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-07-09T02:10:49.679 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-07-09T02:10:49.679 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-07-09T02:10:49.679 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-07-09T02:10:49.679 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-07-09T02:10:49.680 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-07-09T02:10:49.680 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-07-09T02:10:49.681 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2023-07-09T02:10:49.682 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2023-07-09T02:10:49.682 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-09T02:10:49.682 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2023-07-09T02:10:49.682 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.683 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2023-07-09T02:10:49.683 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.683 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2023-07-09T02:10:49.683 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.683 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2023-07-09T02:10:49.683 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2023-07-09T02:10:49.683 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.684 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2023-07-09T02:10:49.684 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2023-07-09T02:10:49.684 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.684 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-09T02:10:49.684 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2023-07-09T02:10:49.684 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.684 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2023-07-09T02:10:49.684 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-09T02:10:49.685 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.685 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2023-07-09T02:10:49.685 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.685 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2023-07-09T02:10:49.685 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2023-07-09T02:10:49.685 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2023-07-09T02:10:49.685 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2023-07-09T02:10:49.686 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2023-07-09T02:10:49.686 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2023-07-09T02:10:49.687 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2023-07-09T02:10:49.687 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-09T02:10:49.687 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-09T02:10:49.687 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2023-07-09T02:10:49.687 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.687 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-09T02:10:49.688 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.688 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2023-07-09T02:10:49.688 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.688 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2023-07-09T02:10:49.688 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.688 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2023-07-09T02:10:49.688 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2023-07-09T02:10:49.689 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2023-07-09T02:10:49.689 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.45,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-07-09T02:10:49.689 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on skipped message = False 2023-07-09T02:10:49.689 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = baf8f4e1-db15-4e56-a3ea-d65b4f02f49e 2023-07-09T02:10:49.689 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.689 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2023-07-09T02:10:49.689 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2023-07-09T02:10:49.689 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.690 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2023-07-09T02:10:49.690 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2023-07-09T02:10:49.690 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2023-07-09T02:10:49.690 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.690 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2023-07-09T02:10:49.690 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2023-07-09T02:10:49.690 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.691 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2023-07-09T02:10:49.691 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2023-07-09T02:10:49.691 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2023-07-09T02:10:49.691 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.691 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2023-07-09T02:10:49.691 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2023-07-09T02:10:49.691 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.691 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2023-07-09T02:10:49.692 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.692 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2023-07-09T02:10:49.692 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.692 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2023-07-09T02:10:49.692 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.693 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2023-07-09T02:10:49.693 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2023-07-09T02:10:49.693 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.693 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2023-07-09T02:10:49.693 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2023-07-09T02:10:49.693 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2023-07-09T02:10:49.693 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2023-07-09T02:10:49.694 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2023-07-09T02:10:49.694 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2023-07-09T02:10:49.694 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2023-07-09T02:10:49.694 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2023-07-09T02:10:49.694 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2023-07-09T02:10:49.694 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-07-09T02:10:49.694 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2023-07-09T02:10:49.695 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2023-07-09T02:10:49.695 INFO:teuthology.orchestra.run.smithi155.stdout: memstore device bytes = 200000000 2023-07-09T02:10:49.695 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2023-07-09T02:10:49.695 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2023-07-09T02:10:49.695 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2023-07-09T02:10:49.695 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 1.0 2023-07-09T02:10:49.695 INFO:teuthology.orchestra.run.smithi155.stdout: osd mon report interval = 5 2023-07-09T02:10:49.695 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = memstore 2023-07-09T02:10:49.696 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2023-07-09T02:10:49.696 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.696 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2023-07-09T02:10:49.696 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-07-09T02:10:49.697 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2023-07-09T02:10:49.697 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-07-09T02:10:49.697 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-07-09T02:10:49.697 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-07-09T02:10:49.698 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-07-09T02:10:49.698 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2023-07-09T02:10:49.698 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.698 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2023-07-09T02:10:49.698 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-07-09T02:10:49.698 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-07-09T02:10:49.698 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2023-07-09T02:10:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-07-09T02:10:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2023-07-09T02:10:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2023-07-09T02:10:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-07-09T02:10:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2023-07-09T02:10:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2023-07-09T02:10:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-07-09T02:10:49.699 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.700 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-09T02:10:49.700 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2023-07-09T02:10:49.700 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2023-07-09T02:10:49.700 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.700 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2023-07-09T02:10:49.700 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-09T02:10:49.700 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-09T02:10:49.701 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.701 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2023-07-09T02:10:49.701 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2023-07-09T02:10:49.701 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.701 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2023-07-09T02:10:49.701 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2023-07-09T02:10:49.701 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull ratio = 0.6 2023-07-09T02:10:49.701 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.7 2023-07-09T02:10:49.702 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.6 2023-07-09T02:10:49.702 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-07-09T02:10:49.702 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2023-07-09T02:10:49.702 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2023-07-09T02:10:49.702 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2023-07-09T02:10:49.702 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2023-07-09T02:10:49.702 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-09T02:10:49.703 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-09T02:10:49.703 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2023-07-09T02:10:49.703 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2023-07-09T02:10:49.703 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-07-09T02:10:49.703 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2023-07-09T02:10:49.704 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2023-07-09T02:10:49.704 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2023-07-09T02:10:49.704 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2023-07-09T02:10:49.704 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2023-07-09T02:10:49.704 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2023-07-09T02:10:49.704 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-07-09T02:10:49.704 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2023-07-09T02:10:49.705 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-07-09T02:10:49.705 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2023-07-09T02:10:49.705 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2023-07-09T02:10:49.705 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2023-07-09T02:10:49.705 INFO:teuthology.orchestra.run.smithi155.stdout: debug objectcacher = 20 2023-07-09T02:10:49.705 INFO:teuthology.orchestra.run.smithi155.stdout: debug objecter = 20 2023-07-09T02:10:49.705 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2023-07-09T02:10:49.705 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2023-07-09T02:10:49.706 INFO:teuthology.orchestra.run.smithi155.stdout: debug objectcacher = 20 2023-07-09T02:10:49.706 INFO:teuthology.orchestra.run.smithi155.stdout: debug objecter = 20 2023-07-09T02:10:49.706 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2023-07-09T02:10:49.706 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2023-07-09T02:10:49.706 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2023-07-09T02:10:49.706 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-07-09T02:10:49.706 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2023-07-09T02:10:49.706 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2023-07-09T02:10:49.707 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2023-07-09T02:10:49.707 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2023-07-09T02:10:49.707 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2023-07-09T02:10:49.707 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2023-07-09T02:10:49.707 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2023-07-09T02:10:49.707 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-09T02:10:49.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-09T02:10:49.783 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-09T02:10:49.783 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:49.784 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-09T02:10:49.793 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:49.793 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-09T02:10:49.849 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:10:49.849 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:49.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-09T02:10:49.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T02:10:49.927 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:49.927 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:49.977 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:10:49.977 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:49.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-09T02:10:49.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T02:10:50.015 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:50.015 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:50.066 INFO:tasks.ceph:Setting up mon nodes... 2023-07-09T02:10:50.066 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-09T02:10:50.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-09T02:10:50.126 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-09T02:10:50.132 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-09T02:10:50.190 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-09T02:10:50.208 INFO:tasks.ceph:Setting up mds nodes... 2023-07-09T02:10:50.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-09T02:10:50.268 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-09T02:10:50.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-09T02:10:50.293 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-09T02:10:50.394 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-09T02:10:50.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-09T02:10:50.420 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-09T02:10:50.477 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-09T02:10:50.482 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-09T02:10:50.502 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-09T02:10:50.605 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-09T02:10:50.609 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-09T02:10:50.630 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-09T02:10:50.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-09T02:10:50.676 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-09T02:10:50.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-09T02:10:50.782 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-09T02:10:50.799 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-09T02:10:50.842 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-09T02:10:50.859 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-09T02:10:50.946 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-09T02:10:50.963 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-09T02:10:50.964 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-09T02:10:50.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-09T02:10:50.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:50.986 INFO:tasks.ceph:role: osd.0 2023-07-09T02:10:50.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:10:50.986 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-09T02:10:51.052 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T02:10:51.052 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T02:10:51.052 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T02:10:51.052 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T02:10:51.053 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T02:10:51.053 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-07-09T02:10:51.053 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T02:10:51.053 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T02:10:51.053 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T02:10:51.053 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T02:10:51.076 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-07-09T02:10:51.110 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-07-09T02:10:51.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-09T02:10:51.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-09T02:10:51.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:10:51.248 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T02:10:51.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-09T02:10:51.308 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:51.309 INFO:tasks.ceph:role: osd.1 2023-07-09T02:10:51.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:10:51.309 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-09T02:10:51.373 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T02:10:51.373 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T02:10:51.373 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T02:10:51.374 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T02:10:51.374 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T02:10:51.374 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-07-09T02:10:51.374 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T02:10:51.374 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T02:10:51.374 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T02:10:51.374 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T02:10:51.398 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-07-09T02:10:51.400 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-07-09T02:10:51.401 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-09T02:10:51.466 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-09T02:10:51.529 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T02:10:51.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:10:51.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-09T02:10:51.597 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:51.598 INFO:tasks.ceph:role: osd.2 2023-07-09T02:10:51.598 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:10:51.598 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-09T02:10:51.664 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T02:10:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T02:10:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T02:10:51.664 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T02:10:51.665 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T02:10:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-07-09T02:10:51.665 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T02:10:51.665 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T02:10:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T02:10:51.665 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T02:10:51.688 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-07-09T02:10:51.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-07-09T02:10:51.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-09T02:10:51.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-09T02:10:51.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:10:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T02:10:51.827 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-09T02:10:51.889 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:51.890 INFO:tasks.ceph:role: osd.3 2023-07-09T02:10:51.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:10:51.890 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-09T02:10:51.953 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T02:10:51.953 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T02:10:51.953 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T02:10:51.954 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T02:10:51.954 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T02:10:51.954 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-07-09T02:10:51.954 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T02:10:51.954 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T02:10:51.954 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T02:10:51.954 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T02:10:51.978 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-07-09T02:10:51.980 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-07-09T02:10:51.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-09T02:10:52.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-09T02:10:52.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:10:52.111 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T02:10:52.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:52.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.237+0000 7f4052d20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-09T02:10:52.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.241+0000 7f4052d20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-09T02:10:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.241+0000 7f4052d20640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-07-09T02:10:52.257 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-09T02:10:52.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:52.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.377+0000 7f3c4ad20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-09T02:10:52.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.377+0000 7f3c4ad20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-09T02:10:52.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.377+0000 7f3c4ad20640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-07-09T02:10:52.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-09T02:10:52.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:52.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.509+0000 7f27b1919640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-09T02:10:52.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.509+0000 7f27b1919640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-09T02:10:52.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.509+0000 7f27b1919640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-07-09T02:10:52.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-09T02:10:52.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:52.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.641+0000 7f15869c8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-09T02:10:52.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.641+0000 7f15869c8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-09T02:10:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:52.641+0000 7f15869c8640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-07-09T02:10:52.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-09T02:10:52.679 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-09T02:10:52.702 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:52.702 INFO:tasks.ceph:role: osd.4 2023-07-09T02:10:52.703 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:10:52.703 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-09T02:10:52.775 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T02:10:52.775 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T02:10:52.776 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T02:10:52.776 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T02:10:52.776 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T02:10:52.777 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-07-09T02:10:52.778 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T02:10:52.778 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T02:10:52.778 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T02:10:52.779 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T02:10:53.250 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-07-09T02:10:53.252 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-07-09T02:10:53.253 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-09T02:10:53.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-09T02:10:53.438 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T02:10:53.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:10:53.441 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-09T02:10:53.508 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:53.509 INFO:tasks.ceph:role: osd.5 2023-07-09T02:10:53.509 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:10:53.509 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-09T02:10:53.583 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T02:10:53.584 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T02:10:53.584 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T02:10:53.584 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T02:10:53.584 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T02:10:53.585 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-07-09T02:10:53.585 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T02:10:53.585 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T02:10:53.585 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T02:10:53.585 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T02:10:54.011 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-07-09T02:10:54.014 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-07-09T02:10:54.015 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-09T02:10:54.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-09T02:10:54.133 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T02:10:54.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:10:54.134 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-09T02:10:54.202 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:54.203 INFO:tasks.ceph:role: osd.6 2023-07-09T02:10:54.203 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:10:54.203 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-09T02:10:54.274 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T02:10:54.274 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T02:10:54.275 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T02:10:54.275 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T02:10:54.275 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T02:10:54.275 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-07-09T02:10:54.275 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T02:10:54.275 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T02:10:54.275 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T02:10:54.276 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T02:10:54.738 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-07-09T02:10:54.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-07-09T02:10:54.744 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-09T02:10:54.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-09T02:10:54.923 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T02:10:54.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:10:54.924 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-09T02:10:54.988 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T02:10:54.988 INFO:tasks.ceph:role: osd.7 2023-07-09T02:10:54.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:10:54.989 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-09T02:10:55.063 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T02:10:55.063 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T02:10:55.063 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T02:10:55.063 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T02:10:55.063 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T02:10:55.064 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-07-09T02:10:55.064 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T02:10:55.064 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T02:10:55.064 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T02:10:55.064 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T02:10:55.545 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-07-09T02:10:55.549 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-07-09T02:10:55.550 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-09T02:10:55.691 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-09T02:10:55.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:10:55.714 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T02:10:55.715 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:55.846 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:55.843+0000 7f6891051640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-09T02:10:55.847 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:55.847+0000 7f6891051640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-09T02:10:55.849 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:55.847+0000 7f6891051640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-07-09T02:10:55.868 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-09T02:10:55.889 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:55.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:55.987+0000 7f8d03a2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-09T02:10:55.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:55.991+0000 7f8d03a2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-09T02:10:55.997 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:55.995+0000 7f8d03a2b640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-07-09T02:10:56.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-09T02:10:56.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:56.132 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:56.131+0000 7f91ced15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-09T02:10:56.133 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:56.131+0000 7f91ced15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-09T02:10:56.134 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:56.131+0000 7f91ced15640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-07-09T02:10:56.151 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-09T02:10:56.173 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:56.272 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:56.271+0000 7fea9f1da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-09T02:10:56.273 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:56.271+0000 7fea9f1da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-09T02:10:56.274 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:10:56.275+0000 7fea9f1da640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-07-09T02:10:56.290 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-09T02:10:56.316 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-09T02:10:56.317 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:56.317 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-09T02:10:56.343 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:56.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-09T02:10:56.426 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:56.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-09T02:10:56.496 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:56.498 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-09T02:10:56.568 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:56.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-09T02:10:56.650 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:56.652 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-09T02:10:56.721 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:56.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-09T02:10:56.792 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:56.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-09T02:10:56.820 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:56.821 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-09T02:10:56.885 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:56.886 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-09T02:10:56.960 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:56.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-09T02:10:57.024 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:57.025 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-09T02:10:57.089 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:57.090 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-09T02:10:57.156 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:57.156 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-09T02:10:57.221 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:57.221 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-09T02:10:57.232 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:57.233 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-09T02:10:57.289 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:57.289 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-09T02:10:57.299 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:57.299 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-09T02:10:57.361 INFO:tasks.ceph:Adding keys to all mons... 2023-07-09T02:10:57.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-09T02:10:57.367 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-09T02:10:57.412 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-07-09T02:10:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ== 2023-07-09T02:10:57.413 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-07-09T02:10:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q== 2023-07-09T02:10:57.413 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-07-09T02:10:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw== 2023-07-09T02:10:57.413 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-07-09T02:10:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ== 2023-07-09T02:10:57.414 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-07-09T02:10:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw== 2023-07-09T02:10:57.414 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-07-09T02:10:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg== 2023-07-09T02:10:57.414 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-07-09T02:10:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q== 2023-07-09T02:10:57.414 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-07-09T02:10:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA== 2023-07-09T02:10:57.415 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-07-09T02:10:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg== 2023-07-09T02:10:57.415 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-07-09T02:10:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA== 2023-07-09T02:10:57.415 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-07-09T02:10:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g== 2023-07-09T02:10:57.415 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-07-09T02:10:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA== 2023-07-09T02:10:57.416 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-07-09T02:10:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA== 2023-07-09T02:10:57.416 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-07-09T02:10:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ== 2023-07-09T02:10:57.416 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:10:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:10:57.417 INFO:teuthology.orchestra.run.smithi045.stdout:[client.2] 2023-07-09T02:10:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ== 2023-07-09T02:10:57.417 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-07-09T02:10:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w== 2023-07-09T02:10:57.417 INFO:teuthology.orchestra.run.smithi045.stdout:[client.3] 2023-07-09T02:10:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA== 2023-07-09T02:10:57.423 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2023-07-09T02:10:57.424 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ== 2023-07-09T02:10:57.424 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-07-09T02:10:57.424 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q== 2023-07-09T02:10:57.424 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2023-07-09T02:10:57.424 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw== 2023-07-09T02:10:57.424 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2023-07-09T02:10:57.425 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ== 2023-07-09T02:10:57.425 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2023-07-09T02:10:57.425 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw== 2023-07-09T02:10:57.425 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2023-07-09T02:10:57.425 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg== 2023-07-09T02:10:57.425 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2023-07-09T02:10:57.426 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q== 2023-07-09T02:10:57.426 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2023-07-09T02:10:57.426 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA== 2023-07-09T02:10:57.426 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-07-09T02:10:57.426 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg== 2023-07-09T02:10:57.427 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2023-07-09T02:10:57.427 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA== 2023-07-09T02:10:57.427 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2023-07-09T02:10:57.427 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g== 2023-07-09T02:10:57.427 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2023-07-09T02:10:57.427 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA== 2023-07-09T02:10:57.428 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2023-07-09T02:10:57.428 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA== 2023-07-09T02:10:57.428 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2023-07-09T02:10:57.428 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ== 2023-07-09T02:10:57.428 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2023-07-09T02:10:57.428 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:10:57.429 INFO:teuthology.orchestra.run.smithi155.stdout:[client.2] 2023-07-09T02:10:57.429 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ== 2023-07-09T02:10:57.429 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2023-07-09T02:10:57.429 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w== 2023-07-09T02:10:57.429 INFO:teuthology.orchestra.run.smithi155.stdout:[client.3] 2023-07-09T02:10:57.429 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA== 2023-07-09T02:10:57.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T02:10:57.474 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T02:10:57.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T02:10:57.536 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T02:10:57.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T02:10:57.600 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T02:10:57.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:57.662 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:57.718 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:57.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:57.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:57.794 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:57.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:57.854 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:57.908 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T02:10:57.912 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T02:10:57.967 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T02:10:57.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T02:10:58.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T02:10:58.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T02:10:58.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:58.095 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:58.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:58.153 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:58.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:58.211 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:58.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:58.270 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T02:10:58.325 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T02:10:58.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T02:10:58.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T02:10:58.391 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T02:10:58.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T02:10:58.453 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T02:10:58.509 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T02:10:58.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T02:10:58.571 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-09T02:10:58.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-09T02:10:58.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T02:10:58.709 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-09T02:10:58.731 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-09T02:10:58.751 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T02:10:58.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-09T02:10:58.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-09T02:10:58.957 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T02:10:59.073 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-09T02:10:59.096 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:59.100 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-09T02:10:59.150 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-09T02:10:59.151 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-09T02:10:59.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-09T02:10:59.160 INFO:tasks.ceph.mon.a:Started 2023-07-09T02:10:59.161 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-09T02:10:59.161 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-09T02:10:59.202 INFO:tasks.ceph.mon.b:Started 2023-07-09T02:10:59.203 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-09T02:10:59.203 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-09T02:10:59.206 INFO:tasks.ceph.mon.c:Started 2023-07-09T02:10:59.207 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-09T02:10:59.207 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-09T02:10:59.208 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-09T02:10:59.211 INFO:tasks.ceph.mgr.y:Started 2023-07-09T02:10:59.211 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-09T02:10:59.212 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-09T02:10:59.215 INFO:tasks.ceph.mgr.x:Started 2023-07-09T02:10:59.215 INFO:tasks.ceph:Setting crush tunables to default 2023-07-09T02:10:59.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-07-09T02:10:59.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f56a5b59640 1 Processor -- start 2023-07-09T02:10:59.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f56a5b59640 1 -- start start 2023-07-09T02:10:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f56a5b59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 0x7f56a00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:10:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f56a5b59640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f56a00cd120 0x7f56a00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:10:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f56a5b59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a0160a50 con 0x7f56a015c060 2023-07-09T02:10:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f56a5b59640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a015c430 con 0x7f56a00cd120 2023-07-09T02:10:59.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f56a5b59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a015fb60 con 0x7f56a00d2620 2023-07-09T02:10:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f569f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f56a015c060 0x7f56a00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35084/0 (socket says 172.21.15.45:35084) 2023-07-09T02:10:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.357+0000 7f569f7fe640 1 -- 172.21.15.45:0/1697780828 learned_addr learned my addr 172.21.15.45:0/1697780828 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:10:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569ffff640 1 --2- 172.21.15.45:0/1697780828 >> v2:172.21.15.155:3300/0 conn(0x7f56a00cd120 0x7f56a00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:10:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569effd640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 0x7f56a00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:10:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569ffff640 1 -- 172.21.15.45:0/1697780828 >> v2:172.21.15.155:3300/0 conn(0x7f56a00cd120 msgr2=0x7f56a00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-09T02:10:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569ffff640 1 -- 172.21.15.45:0/1697780828 >> v2:172.21.15.155:3300/0 conn(0x7f56a00cd120 msgr2=0x7f56a00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T02:10:59.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569ffff640 1 --2- 172.21.15.45:0/1697780828 >> v2:172.21.15.155:3300/0 conn(0x7f56a00cd120 0x7f56a00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T02:10:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569ffff640 1 --2- 172.21.15.45:0/1697780828 >> v2:172.21.15.155:3300/0 conn(0x7f56a00cd120 0x7f56a00cee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T02:10:59.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569effd640 1 -- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 msgr2=0x7f56a00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-09T02:10:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569effd640 1 -- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 msgr2=0x7f56a00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T02:10:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569effd640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 0x7f56a00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T02:10:59.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.361+0000 7f569effd640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 0x7f56a00b4ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T02:10:59.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902146399 0 0) 0x7f56a0160a50 con 0x7f56a015c060 2023-07-09T02:10:59.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5688003530 con 0x7f56a015c060 2023-07-09T02:10:59.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4294636053 0 0) 0x7f5688003530 con 0x7f56a015c060 2023-07-09T02:10:59.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 msgr2=0x7f56a00b4ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T02:10:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 0x7f56a00b4ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 >> v2:172.21.15.155:3300/0 conn(0x7f56a00cd120 msgr2=0x7f56a00cee30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T02:10:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 --2- 172.21.15.45:0/1697780828 >> v2:172.21.15.155:3300/0 conn(0x7f56a00cd120 0x7f56a00cee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a015fe40 con 0x7f56a015c060 2023-07-09T02:10:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f5690001680 con 0x7f56a015c060 2023-07-09T02:10:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 >> v1:172.21.15.45:6789/0 conn(0x7f56a015c060 legacy=0x7f56a00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:10:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f5688003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:10:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56880047d0 0x7f5688004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:10:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 0x7f5688005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:10:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a015c430 con 0x7f5688003980 2023-07-09T02:10:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a015fb60 con 0x7f56880047d0 2023-07-09T02:10:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568800ba90 con 0x7f56a00d2620 2023-07-09T02:10:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569effd640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56880047d0 0x7f5688004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:10:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569ffff640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 0x7f5688005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:10:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569f7fe640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f5688003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:10:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569effd640 1 -- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 msgr2=0x7f5688005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:10:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569effd640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56a00d2620 0x7f5688005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569effd640 1 -- 172.21.15.45:0/1697780828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 msgr2=0x7f5688003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:10:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569effd640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5688003980 0x7f5688003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.513+0000 7f569effd640 1 -- 172.21.15.45:0/1697780828 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688003530 con 0x7f56880047d0 2023-07-09T02:10:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.517+0000 7f569effd640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56880047d0 0x7f5688004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5694000ee0 tx=0x7f569401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa599ff09ac308f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:10:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.517+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940aa650 con 0x7f56880047d0 2023-07-09T02:10:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.517+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56940aa7b0 con 0x7f56880047d0 2023-07-09T02:10:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.517+0000 7f569e7fc640 1 -- 172.21.15.45:0/1697780828 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940aab60 con 0x7f56880047d0 2023-07-09T02:10:59.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f56a5b59640 1 -- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56880047d0 msgr2=0x7f5688004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:10:59.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f56a5b59640 1 --2- 172.21.15.45:0/1697780828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56880047d0 0x7f5688004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5694000ee0 tx=0x7f569401c4a0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f569ffff640 1 -- 172.21.15.45:0/1697780828 reap_dead start 2023-07-09T02:10:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f56a5b59640 1 -- 172.21.15.45:0/1697780828 shutdown_connections 2023-07-09T02:10:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f56a5b59640 1 -- 172.21.15.45:0/1697780828 >> 172.21.15.45:0/1697780828 conn(0x7f56a00698e0 msgr2=0x7f56a0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:10:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f56a5b59640 1 -- 172.21.15.45:0/1697780828 shutdown_connections 2023-07-09T02:10:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f56a5b59640 1 -- 172.21.15.45:0/1697780828 wait complete. 2023-07-09T02:10:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f56a5b59640 1 Processor -- start 2023-07-09T02:10:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.521+0000 7f56a5b59640 1 -- start start 2023-07-09T02:10:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56880047d0 0x7f56a00ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:10:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a00c8be0 0x7f56a00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:10:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00b35d0 0x7f56a01486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:10:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a01496b0 con 0x7f56a00b35d0 2023-07-09T02:10:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00b3a40 con 0x7f56a00c8be0 2023-07-09T02:10:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00cbe50 con 0x7f56880047d0 2023-07-09T02:10:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00b35d0 0x7f56a01486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:10:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56880047d0 0x7f56a00ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:10:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a00c8be0 0x7f56a00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:10:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56880047d0 0x7f56a00ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:36718/0 (socket says 172.21.15.45:36718) 2023-07-09T02:10:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569f7fe640 1 -- 172.21.15.45:0/4249904026 learned_addr learned my addr 172.21.15.45:0/4249904026 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:10:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569effd640 1 -- 172.21.15.45:0/4249904026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56880047d0 msgr2=0x7f56a00ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:10:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569effd640 1 --2- 172.21.15.45:0/4249904026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56880047d0 0x7f56a00ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569effd640 1 -- 172.21.15.45:0/4249904026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00b35d0 msgr2=0x7f56a01486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:10:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569effd640 1 --2- 172.21.15.45:0/4249904026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00b35d0 0x7f56a01486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569effd640 1 -- 172.21.15.45:0/4249904026 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a01493d0 con 0x7f56a00c8be0 2023-07-09T02:10:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569ffff640 1 --2- 172.21.15.45:0/4249904026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00b35d0 0x7f56a01486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:10:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f569effd640 1 --2- 172.21.15.45:0/4249904026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a00c8be0 0x7f56a00b3090 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56940ab000 tx=0x7f5688005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:10:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f5687fff640 1 -- 172.21.15.45:0/4249904026 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940aab20 con 0x7f56a00c8be0 2023-07-09T02:10:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f5687fff640 1 -- 172.21.15.45:0/4249904026 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56940aac80 con 0x7f56a00c8be0 2023-07-09T02:10:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f5687fff640 1 -- 172.21.15.45:0/4249904026 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940bf450 con 0x7f56a00c8be0 2023-07-09T02:10:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a00cc0d0 con 0x7f56a00c8be0 2023-07-09T02:10:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a00cc690 con 0x7f56a00c8be0 2023-07-09T02:10:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f5687fff640 1 -- 172.21.15.45:0/4249904026 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f56940bf8d0 con 0x7f56a00c8be0 2023-07-09T02:10:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f5687fff640 1 -- 172.21.15.45:0/4249904026 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f56940b37b0 con 0x7f56a00c8be0 2023-07-09T02:10:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.525+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a004d7d0 con 0x7f56a00c8be0 2023-07-09T02:10:59.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.557+0000 7f5687fff640 1 -- 172.21.15.45:0/4249904026 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f569400f040 con 0x7f56a00c8be0 2023-07-09T02:10:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.621+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f56a015ae60 con 0x7f56a00c8be0 2023-07-09T02:10:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f5687fff640 1 -- 172.21.15.45:0/4249904026 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f56940059a0 con 0x7f56a00c8be0 2023-07-09T02:10:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-07-09T02:10:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a00c8be0 msgr2=0x7f56a00b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:10:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 --2- 172.21.15.45:0/4249904026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a00c8be0 0x7f56a00b3090 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56940ab000 tx=0x7f5688005800 comp rx=0 tx=0).stop 2023-07-09T02:10:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 shutdown_connections 2023-07-09T02:10:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 --2- 172.21.15.45:0/4249904026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00b35d0 0x7f56a01486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 --2- 172.21.15.45:0/4249904026 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56a00c8be0 0x7f56a00b3090 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 --2- 172.21.15.45:0/4249904026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f56880047d0 0x7f56a00ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:10:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 >> 172.21.15.45:0/4249904026 conn(0x7f56a00698e0 msgr2=0x7f56a00d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:10:59.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 shutdown_connections 2023-07-09T02:10:59.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:10:59.625+0000 7f56a5b59640 1 -- 172.21.15.45:0/4249904026 wait complete. 2023-07-09T02:10:59.647 INFO:tasks.ceph:check_enable_crimson: False 2023-07-09T02:10:59.647 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-09T02:10:59.647 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:59.648 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-09T02:10:59.669 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:59.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-09T02:10:59.720 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:10:59.717+0000 7fd835e46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T02:10:59.733 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:59.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-09T02:10:59.759 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:10:59.755+0000 7f77bd341180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T02:10:59.797 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:10:59.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-09T02:10:59.862 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:59.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-09T02:10:59.885 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:59.885 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-09T02:10:59.946 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:10:59.947 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-09T02:11:00.013 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:00.014 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-09T02:11:00.074 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-07-09T02:11:00.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.251+0000 7ff1cbffa640 1 Processor -- start 2023-07-09T02:11:00.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.251+0000 7ff1cbffa640 1 -- start start 2023-07-09T02:11:00.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1cbffa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1c415c060 0x7ff1c40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1cbffa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1c40cd120 0x7ff1c40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1cbffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40d2450 0x7ff1c40d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1cbffa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c40d28f0 con 0x7ff1c40cd120 2023-07-09T02:11:00.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1cbffa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c4160a50 con 0x7ff1c415c060 2023-07-09T02:11:00.256 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1cbffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c415c430 con 0x7ff1c40d2450 2023-07-09T02:11:00.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1ca597640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40d2450 0x7ff1c40d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1ca597640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40d2450 0x7ff1c40d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37242/0 (socket says 172.21.15.155:37242) 2023-07-09T02:11:00.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1ca597640 1 -- 172.21.15.155:0/2762701915 learned_addr learned my addr 172.21.15.155:0/2762701915 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:00.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1c9d96640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1c415c060 0x7ff1c40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.257 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1c9595640 1 --2- 172.21.15.155:0/2762701915 >> v2:172.21.15.45:3300/0 conn(0x7ff1c40cd120 0x7ff1c40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1ca597640 1 -- 172.21.15.155:0/2762701915 >> v2:172.21.15.155:3300/0 conn(0x7ff1c415c060 msgr2=0x7ff1c40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:00.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1ca597640 1 --2- 172.21.15.155:0/2762701915 >> v2:172.21.15.155:3300/0 conn(0x7ff1c415c060 0x7ff1c40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1ca597640 1 -- 172.21.15.155:0/2762701915 >> v2:172.21.15.45:3300/0 conn(0x7ff1c40cd120 msgr2=0x7ff1c40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:00.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1ca597640 1 --2- 172.21.15.155:0/2762701915 >> v2:172.21.15.45:3300/0 conn(0x7ff1c40cd120 0x7ff1c40d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.258 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.255+0000 7ff1ca597640 1 -- 172.21.15.155:0/2762701915 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c415fb60 con 0x7ff1c40d2450 2023-07-09T02:11:00.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1ca597640 1 --2- 172.21.15.155:0/2762701915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40d2450 0x7ff1c40d0610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40d3ad0 tx=0x7ff1bc01c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81b45750c70b30a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:00.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1c8d94640 1 -- 172.21.15.155:0/2762701915 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0a5560 con 0x7ff1c40d2450 2023-07-09T02:11:00.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1c8d94640 1 -- 172.21.15.155:0/2762701915 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0a56c0 con 0x7ff1c40d2450 2023-07-09T02:11:00.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1c8d94640 1 -- 172.21.15.155:0/2762701915 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0a5a50 con 0x7ff1c40d2450 2023-07-09T02:11:00.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 -- 172.21.15.155:0/2762701915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40d2450 msgr2=0x7ff1c40d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 --2- 172.21.15.155:0/2762701915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40d2450 0x7ff1c40d0610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40d3ad0 tx=0x7ff1bc01c6e0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 -- 172.21.15.155:0/2762701915 shutdown_connections 2023-07-09T02:11:00.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 --2- 172.21.15.155:0/2762701915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40d2450 0x7ff1c40d0610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 --2- 172.21.15.155:0/2762701915 >> v2:172.21.15.45:3300/0 conn(0x7ff1c40cd120 0x7ff1c40d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 --2- 172.21.15.155:0/2762701915 >> v2:172.21.15.155:3300/0 conn(0x7ff1c415c060 0x7ff1c40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 -- 172.21.15.155:0/2762701915 >> 172.21.15.155:0/2762701915 conn(0x7ff1c40698e0 msgr2=0x7ff1c4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:00.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 -- 172.21.15.155:0/2762701915 shutdown_connections 2023-07-09T02:11:00.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 -- 172.21.15.155:0/2762701915 wait complete. 2023-07-09T02:11:00.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 Processor -- start 2023-07-09T02:11:00.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.259+0000 7ff1cbffa640 1 -- start start 2023-07-09T02:11:00.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40cd120 0x7ff1c4156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1c40d2450 0x7ff1c415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c415c060 0x7ff1c406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4156980 con 0x7ff1c40d2450 2023-07-09T02:11:00.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4156c60 con 0x7ff1c415c060 2023-07-09T02:11:00.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4156f40 con 0x7ff1c40cd120 2023-07-09T02:11:00.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40cd120 0x7ff1c4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1ca597640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c415c060 0x7ff1c406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40cd120 0x7ff1c4156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37244/0 (socket says 172.21.15.155:37244) 2023-07-09T02:11:00.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 -- 172.21.15.155:0/121025905 learned_addr learned my addr 172.21.15.155:0/121025905 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:00.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9595640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1c40d2450 0x7ff1c415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 -- 172.21.15.155:0/121025905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c415c060 msgr2=0x7ff1c406ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c415c060 0x7ff1c406ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 -- 172.21.15.155:0/121025905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1c40d2450 msgr2=0x7ff1c415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1c40d2450 0x7ff1c415c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 -- 172.21.15.155:0/121025905 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc009b30 con 0x7ff1c40cd120 2023-07-09T02:11:00.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1ca597640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c415c060 0x7ff1c406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:00.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1c9d96640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40cd120 0x7ff1c4156120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000e870 tx=0x7ff1c000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:00.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1ba7fc640 1 -- 172.21.15.155:0/121025905 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0009510 con 0x7ff1c40cd120 2023-07-09T02:11:00.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1ba7fc640 1 -- 172.21.15.155:0/121025905 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000eec0 con 0x7ff1c40cd120 2023-07-09T02:11:00.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c4157220 con 0x7ff1c40cd120 2023-07-09T02:11:00.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1ba7fc640 1 -- 172.21.15.155:0/121025905 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000cb40 con 0x7ff1c40cd120 2023-07-09T02:11:00.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c415cb70 con 0x7ff1c40cd120 2023-07-09T02:11:00.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1ba7fc640 1 -- 172.21.15.155:0/121025905 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff1c00059a0 con 0x7ff1c40cd120 2023-07-09T02:11:00.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1ba7fc640 1 -- 172.21.15.155:0/121025905 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff1c00137b0 con 0x7ff1c40cd120 2023-07-09T02:11:00.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.263+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c404d7d0 con 0x7ff1c40cd120 2023-07-09T02:11:00.269 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.267+0000 7ff1ba7fc640 1 -- 172.21.15.155:0/121025905 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff1c0021060 con 0x7ff1c40cd120 2023-07-09T02:11:00.272 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:00.269+0000 7fd835e46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T02:11:00.333 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.331+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7ff1c406baa0 con 0x7ff1c40cd120 2023-07-09T02:11:00.335 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:00.335+0000 7f77bd341180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T02:11:00.339 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1ba7fc640 1 -- 172.21.15.155:0/121025905 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff1c0017070 con 0x7ff1c40cd120 2023-07-09T02:11:00.339 INFO:teuthology.orchestra.run.smithi155.stdout:0 2023-07-09T02:11:00.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40cd120 msgr2=0x7ff1c4156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40cd120 0x7ff1c4156120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000e870 tx=0x7ff1c000ec70 comp rx=0 tx=0).stop 2023-07-09T02:11:00.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 shutdown_connections 2023-07-09T02:11:00.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1c415c060 0x7ff1c406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1c40d2450 0x7ff1c415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 --2- 172.21.15.155:0/121025905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1c40cd120 0x7ff1c4156120 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 >> 172.21.15.155:0/121025905 conn(0x7ff1c40698e0 msgr2=0x7ff1c40cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:00.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 shutdown_connections 2023-07-09T02:11:00.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.339+0000 7ff1cbffa640 1 -- 172.21.15.155:0/121025905 wait complete. 2023-07-09T02:11:00.360 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-07-09T02:11:00.490 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:00.489+0000 7fd835e46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T02:11:00.496 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b35834640 1 Processor -- start 2023-07-09T02:11:00.497 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b35834640 1 -- start start 2023-07-09T02:11:00.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b35834640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2b3015b270 0x7f2b300719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b35834640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b300cd040 0x7f2b300cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b35834640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b300cd9e0 con 0x7f2b300afed0 2023-07-09T02:11:00.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b35834640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b30071550 con 0x7f2b300cd040 2023-07-09T02:11:00.498 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b35834640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3015e440 con 0x7f2b3015b270 2023-07-09T02:11:00.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b2effd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f2b300afed0 0x7f2b3015db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:33318/0 (socket says 172.21.15.155:33318) 2023-07-09T02:11:00.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b2effd640 1 -- 172.21.15.155:0/979576042 learned_addr learned my addr 172.21.15.155:0/979576042 (peer_addr_for_me v1:172.21.15.155:0/0) 2023-07-09T02:11:00.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.495+0000 7f2b2e7fc640 1 --2- 172.21.15.155:0/979576042 >> v2:172.21.15.155:3300/0 conn(0x7f2b3015b270 0x7f2b300719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2f7fe640 1 --2- 172.21.15.155:0/979576042 >> v2:172.21.15.45:3300/0 conn(0x7f2b300cd040 0x7f2b300cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.499 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2dffb640 1 -- 172.21.15.155:0/979576042 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895745338 0 0) 0x7f2b300cd9e0 con 0x7f2b300afed0 2023-07-09T02:11:00.500 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2dffb640 1 -- 172.21.15.155:0/979576042 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b18003530 con 0x7f2b300afed0 2023-07-09T02:11:00.500 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2f7fe640 1 -- 172.21.15.155:0/979576042 >> v2:172.21.15.155:3300/0 conn(0x7f2b3015b270 msgr2=0x7f2b300719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:00.500 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2f7fe640 1 --2- 172.21.15.155:0/979576042 >> v2:172.21.15.155:3300/0 conn(0x7f2b3015b270 0x7f2b300719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.500 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2f7fe640 1 -- 172.21.15.155:0/979576042 >> v1:172.21.15.155:6789/0 conn(0x7f2b300afed0 legacy=0x7f2b3015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.500 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2f7fe640 1 -- 172.21.15.155:0/979576042 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3015e720 con 0x7f2b300cd040 2023-07-09T02:11:00.501 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2f7fe640 1 --2- 172.21.15.155:0/979576042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300cd040 0x7f2b300cd4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b300cde90 tx=0x7f2b2801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c162dec67e974fbc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:00.502 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2dffb640 1 -- 172.21.15.155:0/979576042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280a57d0 con 0x7f2b300cd040 2023-07-09T02:11:00.502 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2dffb640 1 -- 172.21.15.155:0/979576042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b280a5930 con 0x7f2b300cd040 2023-07-09T02:11:00.502 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.499+0000 7f2b2dffb640 1 -- 172.21.15.155:0/979576042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280a5cc0 con 0x7f2b300cd040 2023-07-09T02:11:00.503 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- 172.21.15.155:0/979576042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300cd040 msgr2=0x7f2b300cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.503 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 --2- 172.21.15.155:0/979576042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300cd040 0x7f2b300cd4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b300cde90 tx=0x7f2b2801c910 comp rx=0 tx=0).stop 2023-07-09T02:11:00.503 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- 172.21.15.155:0/979576042 shutdown_connections 2023-07-09T02:11:00.503 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 --2- 172.21.15.155:0/979576042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300cd040 0x7f2b300cd4a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.503 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 --2- 172.21.15.155:0/979576042 >> v2:172.21.15.155:3300/0 conn(0x7f2b3015b270 0x7f2b300719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- 172.21.15.155:0/979576042 >> 172.21.15.155:0/979576042 conn(0x7f2b3006d140 msgr2=0x7f2b3006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:00.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- 172.21.15.155:0/979576042 shutdown_connections 2023-07-09T02:11:00.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- 172.21.15.155:0/979576042 wait complete. 2023-07-09T02:11:00.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 Processor -- start 2023-07-09T02:11:00.505 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- start start 2023-07-09T02:11:00.506 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b300afed0 0x7f2b30153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b300cd040 0x7f2b3015d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3015b270 0x7f2b3015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3015a020 con 0x7f2b3015b270 2023-07-09T02:11:00.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3015a300 con 0x7f2b300cd040 2023-07-09T02:11:00.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.503+0000 7f2b35834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3013d830 con 0x7f2b300afed0 2023-07-09T02:11:00.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b300cd040 0x7f2b3015d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.507 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2effd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b300afed0 0x7f2b30153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.508 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b300cd040 0x7f2b3015d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34504/0 (socket says 172.21.15.155:34504) 2023-07-09T02:11:00.508 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2effd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b300afed0 0x7f2b30153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37250/0 (socket says 172.21.15.155:37250) 2023-07-09T02:11:00.508 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3015b270 0x7f2b3015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.508 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 -- 172.21.15.155:0/684477687 learned_addr learned my addr 172.21.15.155:0/684477687 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:00.508 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 -- 172.21.15.155:0/684477687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b300afed0 msgr2=0x7f2b30153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.508 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 --2- 172.21.15.155:0/684477687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b300afed0 0x7f2b30153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.508 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 -- 172.21.15.155:0/684477687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3015b270 msgr2=0x7f2b3015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 --2- 172.21.15.155:0/684477687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3015b270 0x7f2b3015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.509 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 -- 172.21.15.155:0/684477687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28009a70 con 0x7f2b300cd040 2023-07-09T02:11:00.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b2e7fc640 1 --2- 172.21.15.155:0/684477687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b300cd040 0x7f2b3015d0e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400e870 tx=0x7f2b2400ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:00.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b17fff640 1 -- 172.21.15.155:0/684477687 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24009510 con 0x7f2b300cd040 2023-07-09T02:11:00.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b17fff640 1 -- 172.21.15.155:0/684477687 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2400eec0 con 0x7f2b300cd040 2023-07-09T02:11:00.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b17fff640 1 -- 172.21.15.155:0/684477687 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400cb40 con 0x7f2b300cd040 2023-07-09T02:11:00.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3013db10 con 0x7f2b300cd040 2023-07-09T02:11:00.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b30153bc0 con 0x7f2b300cd040 2023-07-09T02:11:00.510 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b17fff640 1 -- 172.21.15.155:0/684477687 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2b240059a0 con 0x7f2b300cd040 2023-07-09T02:11:00.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b17fff640 1 -- 172.21.15.155:0/684477687 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2b24013820 con 0x7f2b300cd040 2023-07-09T02:11:00.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.507+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3004d7d0 con 0x7f2b300cd040 2023-07-09T02:11:00.511 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.511+0000 7f2b17fff640 1 -- 172.21.15.155:0/684477687 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2b24021060 con 0x7f2b300cd040 2023-07-09T02:11:00.545 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:00.543+0000 7f77bd341180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T02:11:00.578 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.575+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f2b3006f3a0 con 0x7f2b300cd040 2023-07-09T02:11:00.582 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b17fff640 1 -- 172.21.15.155:0/684477687 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b24017070 con 0x7f2b300cd040 2023-07-09T02:11:00.583 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:11:00.583 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b300cd040 msgr2=0x7f2b3015d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.584 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 --2- 172.21.15.155:0/684477687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b300cd040 0x7f2b3015d0e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400e870 tx=0x7f2b2400ec70 comp rx=0 tx=0).stop 2023-07-09T02:11:00.584 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 shutdown_connections 2023-07-09T02:11:00.584 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 --2- 172.21.15.155:0/684477687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b3015b270 0x7f2b3015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.584 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 --2- 172.21.15.155:0/684477687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b300cd040 0x7f2b3015d0e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.584 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 --2- 172.21.15.155:0/684477687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b300afed0 0x7f2b30153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.584 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 >> 172.21.15.155:0/684477687 conn(0x7f2b3006d140 msgr2=0x7f2b300b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:00.585 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 shutdown_connections 2023-07-09T02:11:00.585 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.583+0000 7f2b35834640 1 -- 172.21.15.155:0/684477687 wait complete. 2023-07-09T02:11:00.603 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-07-09T02:11:00.739 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc581034640 1 Processor -- start 2023-07-09T02:11:00.739 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc581034640 1 -- start start 2023-07-09T02:11:00.740 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc581034640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc57c0d2620 0x7fc57c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.740 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc581034640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc57c0cd120 0x7fc57c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.740 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc581034640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c160a50 con 0x7fc57c15c060 2023-07-09T02:11:00.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc581034640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c15c430 con 0x7fc57c0d2620 2023-07-09T02:11:00.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc581034640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c15fb60 con 0x7fc57c0cd120 2023-07-09T02:11:00.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc57b59e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc57c0cd120 0x7fc57c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc57ad9d640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc57c15c060 0x7fc57c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:33320/0 (socket says 172.21.15.155:33320) 2023-07-09T02:11:00.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc57ad9d640 1 -- 172.21.15.155:0/3767174599 learned_addr learned my addr 172.21.15.155:0/3767174599 (peer_addr_for_me v1:172.21.15.155:0/0) 2023-07-09T02:11:00.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc57a59c640 1 --2- 172.21.15.155:0/3767174599 >> v2:172.21.15.45:3300/0 conn(0x7fc57c0d2620 0x7fc57c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc579d9b640 1 -- 172.21.15.155:0/3767174599 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470678424 0 0) 0x7fc57c160a50 con 0x7fc57c15c060 2023-07-09T02:11:00.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc57b59e640 1 -- 172.21.15.155:0/3767174599 >> v2:172.21.15.45:3300/0 conn(0x7fc57c0d2620 msgr2=0x7fc57c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:00.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc57b59e640 1 --2- 172.21.15.155:0/3767174599 >> v2:172.21.15.45:3300/0 conn(0x7fc57c0d2620 0x7fc57c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc57b59e640 1 -- 172.21.15.155:0/3767174599 >> v1:172.21.15.155:6789/0 conn(0x7fc57c15c060 legacy=0x7fc57c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.739+0000 7fc57b59e640 1 -- 172.21.15.155:0/3767174599 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c15fe40 con 0x7fc57c0cd120 2023-07-09T02:11:00.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc57b59e640 1 --2- 172.21.15.155:0/3767174599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 0x7fc57c0cee30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc57c06b120 tx=0x7fc57401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ecfe4e7aa3cff73 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:00.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc579d9b640 1 -- 172.21.15.155:0/3767174599 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740a59a0 con 0x7fc57c0cd120 2023-07-09T02:11:00.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc579d9b640 1 -- 172.21.15.155:0/3767174599 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740a5b00 con 0x7fc57c0cd120 2023-07-09T02:11:00.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc579d9b640 1 -- 172.21.15.155:0/3767174599 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740a5e90 con 0x7fc57c0cd120 2023-07-09T02:11:00.745 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc581034640 1 -- 172.21.15.155:0/3767174599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 msgr2=0x7fc57c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.745 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc581034640 1 --2- 172.21.15.155:0/3767174599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 0x7fc57c0cee30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc57c06b120 tx=0x7fc57401c8e0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.745 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc581034640 1 -- 172.21.15.155:0/3767174599 shutdown_connections 2023-07-09T02:11:00.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc581034640 1 --2- 172.21.15.155:0/3767174599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 0x7fc57c0cee30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc581034640 1 --2- 172.21.15.155:0/3767174599 >> v2:172.21.15.45:3300/0 conn(0x7fc57c0d2620 0x7fc57c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc581034640 1 -- 172.21.15.155:0/3767174599 >> 172.21.15.155:0/3767174599 conn(0x7fc57c0698e0 msgr2=0x7fc57c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:00.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc581034640 1 -- 172.21.15.155:0/3767174599 shutdown_connections 2023-07-09T02:11:00.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.743+0000 7fc581034640 1 -- 172.21.15.155:0/3767174599 wait complete. 2023-07-09T02:11:00.747 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 Processor -- start 2023-07-09T02:11:00.747 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 -- start start 2023-07-09T02:11:00.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 0x7fc57c14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc57c0d2620 0x7fc57c159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57c15c060 0x7fc57c154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c14f3d0 con 0x7fc57c15c060 2023-07-09T02:11:00.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c15a3e0 con 0x7fc57c0cd120 2023-07-09T02:11:00.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c15a6c0 con 0x7fc57c0d2620 2023-07-09T02:11:00.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 0x7fc57c14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc57c0d2620 0x7fc57c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc57c0d2620 0x7fc57c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37252/0 (socket says 172.21.15.155:37252) 2023-07-09T02:11:00.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 -- 172.21.15.155:0/1817971057 learned_addr learned my addr 172.21.15.155:0/1817971057 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:00.749 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57b59e640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57c15c060 0x7fc57c154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 -- 172.21.15.155:0/1817971057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 msgr2=0x7fc57c14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 0x7fc57c14ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 -- 172.21.15.155:0/1817971057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57c15c060 msgr2=0x7fc57c154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57c15c060 0x7fc57c154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 -- 172.21.15.155:0/1817971057 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009a70 con 0x7fc57c0d2620 2023-07-09T02:11:00.751 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57ad9d640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 0x7fc57c14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:00.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc57a59c640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc57c0d2620 0x7fc57c159900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc57000e900 tx=0x7fc57000edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:00.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc5637fe640 1 -- 172.21.15.155:0/1817971057 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570009690 con 0x7fc57c0d2620 2023-07-09T02:11:00.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc5637fe640 1 -- 172.21.15.155:0/1817971057 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000ca00 con 0x7fc57c0d2620 2023-07-09T02:11:00.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc5637fe640 1 -- 172.21.15.155:0/1817971057 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000cdb0 con 0x7fc57c0d2620 2023-07-09T02:11:00.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c0b59f0 con 0x7fc57c0d2620 2023-07-09T02:11:00.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c15ac80 con 0x7fc57c0d2620 2023-07-09T02:11:00.752 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc5637fe640 1 -- 172.21.15.155:0/1817971057 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc570005ca0 con 0x7fc57c0d2620 2023-07-09T02:11:00.753 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.747+0000 7fc5637fe640 1 -- 172.21.15.155:0/1817971057 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc570006440 con 0x7fc57c0d2620 2023-07-09T02:11:00.753 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.751+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c160690 con 0x7fc57c0d2620 2023-07-09T02:11:00.753 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.751+0000 7fc5637fe640 1 -- 172.21.15.155:0/1817971057 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc570021060 con 0x7fc57c0d2620 2023-07-09T02:11:00.818 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.819+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7fc57c04d7d0 con 0x7fc57c0d2620 2023-07-09T02:11:00.825 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc5637fe640 1 -- 172.21.15.155:0/1817971057 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc570029020 con 0x7fc57c0d2620 2023-07-09T02:11:00.825 INFO:teuthology.orchestra.run.smithi155.stdout:2 2023-07-09T02:11:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc57c0d2620 msgr2=0x7fc57c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc57c0d2620 0x7fc57c159900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc57000e900 tx=0x7fc57000edc0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.826 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 shutdown_connections 2023-07-09T02:11:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57c15c060 0x7fc57c154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc57c0d2620 0x7fc57c159900 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 --2- 172.21.15.155:0/1817971057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc57c0cd120 0x7fc57c14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 >> 172.21.15.155:0/1817971057 conn(0x7fc57c0698e0 msgr2=0x7fc57c0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 shutdown_connections 2023-07-09T02:11:00.827 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.823+0000 7fc581034640 1 -- 172.21.15.155:0/1817971057 wait complete. 2023-07-09T02:11:00.843 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-07-09T02:11:00.979 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72dce6d640 1 Processor -- start 2023-07-09T02:11:00.980 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72dce6d640 1 -- start start 2023-07-09T02:11:00.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72dce6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d815c060 0x7f72d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72dce6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72d80cd120 0x7f72d80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72dce6d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d8160a50 con 0x7f72d80d2450 2023-07-09T02:11:00.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72dce6d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d80d28f0 con 0x7f72d80cd120 2023-07-09T02:11:00.981 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72dce6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80cfe40 con 0x7f72d815c060 2023-07-09T02:11:00.982 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d5d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72d80cd120 0x7f72d80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.982 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d815c060 0x7f72d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d5d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72d80cd120 0x7f72d80d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34546/0 (socket says 172.21.15.155:34546) 2023-07-09T02:11:00.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d815c060 0x7f72d80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37266/0 (socket says 172.21.15.155:37266) 2023-07-09T02:11:00.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d5d9b640 1 -- 172.21.15.155:0/2693435324 learned_addr learned my addr 172.21.15.155:0/2693435324 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:00.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d5d9b640 1 -- 172.21.15.155:0/2693435324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d815c060 msgr2=0x7f72d80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:00.983 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d5d9b640 1 --2- 172.21.15.155:0/2693435324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d815c060 0x7f72d80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.984 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d5d9b640 1 -- 172.21.15.155:0/2693435324 >> v1:172.21.15.155:6789/0 conn(0x7f72d80d2450 legacy=0x7f72d80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.984 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d5d9b640 1 -- 172.21.15.155:0/2693435324 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d815c430 con 0x7f72d80cd120 2023-07-09T02:11:00.984 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.979+0000 7f72d659c640 1 --2- 172.21.15.155:0/2693435324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d815c060 0x7f72d80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:00.984 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72d5d9b640 1 --2- 172.21.15.155:0/2693435324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80d1f10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009870 tx=0x7f72cc01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfd30ea57383be4b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:00.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72d559a640 1 -- 172.21.15.155:0/2693435324 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0a7070 con 0x7f72d80cd120 2023-07-09T02:11:00.985 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72d559a640 1 -- 172.21.15.155:0/2693435324 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0ab430 con 0x7f72d80cd120 2023-07-09T02:11:00.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72d559a640 1 -- 172.21.15.155:0/2693435324 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0ab7c0 con 0x7f72d80cd120 2023-07-09T02:11:00.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72dce6d640 1 -- 172.21.15.155:0/2693435324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 msgr2=0x7f72d80d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72dce6d640 1 --2- 172.21.15.155:0/2693435324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80d1f10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009870 tx=0x7f72cc01c510 comp rx=0 tx=0).stop 2023-07-09T02:11:00.986 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72dce6d640 1 -- 172.21.15.155:0/2693435324 shutdown_connections 2023-07-09T02:11:00.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72dce6d640 1 --2- 172.21.15.155:0/2693435324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80d1f10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72dce6d640 1 --2- 172.21.15.155:0/2693435324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d815c060 0x7f72d80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72dce6d640 1 -- 172.21.15.155:0/2693435324 >> 172.21.15.155:0/2693435324 conn(0x7f72d80698e0 msgr2=0x7f72d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:00.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72dce6d640 1 -- 172.21.15.155:0/2693435324 shutdown_connections 2023-07-09T02:11:00.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.983+0000 7f72dce6d640 1 -- 172.21.15.155:0/2693435324 wait complete. 2023-07-09T02:11:00.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72dce6d640 1 Processor -- start 2023-07-09T02:11:00.988 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72dce6d640 1 -- start start 2023-07-09T02:11:00.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72dce6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72dce6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d80d2450 0x7f72d80b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72dce6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72d815c060 0x7f72d815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:00.989 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72dce6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80b1e00 con 0x7f72d815c060 2023-07-09T02:11:00.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72dce6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80b1bd0 con 0x7f72d80cd120 2023-07-09T02:11:00.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72dce6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d815e910 con 0x7f72d80d2450 2023-07-09T02:11:00.990 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34560/0 (socket says 172.21.15.155:34560) 2023-07-09T02:11:00.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 -- 172.21.15.155:0/2558845161 learned_addr learned my addr 172.21.15.155:0/2558845161 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:00.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d5d9b640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d80d2450 0x7f72d80b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.991 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d6d9d640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72d815c060 0x7f72d815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:00.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 -- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d80d2450 msgr2=0x7f72d80b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d80d2450 0x7f72d80b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 -- 172.21.15.155:0/2558845161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72d815c060 msgr2=0x7f72d815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:00.992 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72d815c060 0x7f72d815c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:00.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 -- 172.21.15.155:0/2558845161 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c8009420 con 0x7f72d80cd120 2023-07-09T02:11:00.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d5d9b640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d80d2450 0x7f72d80b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:00.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.987+0000 7f72d659c640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80b1690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72c800e980 tx=0x7f72c800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:00.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72c6ffd640 1 -- 172.21.15.155:0/2558845161 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c800ca00 con 0x7f72d80cd120 2023-07-09T02:11:00.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72c6ffd640 1 -- 172.21.15.155:0/2558845161 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c800cb60 con 0x7f72d80cd120 2023-07-09T02:11:00.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72c6ffd640 1 -- 172.21.15.155:0/2558845161 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8013470 con 0x7f72d80cd120 2023-07-09T02:11:00.993 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72dce6d640 1 -- 172.21.15.155:0/2558845161 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc0094d0 con 0x7f72d80cd120 2023-07-09T02:11:00.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72dce6d640 1 -- 172.21.15.155:0/2558845161 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d815eed0 con 0x7f72d80cd120 2023-07-09T02:11:00.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72c6ffd640 1 -- 172.21.15.155:0/2558845161 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72c8005ca0 con 0x7f72d80cd120 2023-07-09T02:11:00.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72c6ffd640 1 -- 172.21.15.155:0/2558845161 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f72c8006840 con 0x7f72d80cd120 2023-07-09T02:11:00.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72c4ff9640 1 -- 172.21.15.155:0/2558845161 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b0005260 con 0x7f72d80cd120 2023-07-09T02:11:00.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:00.991+0000 7f72c6ffd640 1 -- 172.21.15.155:0/2558845161 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f72c8021060 con 0x7f72d80cd120 2023-07-09T02:11:01.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.059+0000 7f72c4ff9640 1 -- 172.21.15.155:0/2558845161 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f72b0005550 con 0x7f72d80cd120 2023-07-09T02:11:01.064 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c6ffd640 1 -- 172.21.15.155:0/2558845161 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72c8029020 con 0x7f72d80cd120 2023-07-09T02:11:01.064 INFO:teuthology.orchestra.run.smithi155.stdout:3 2023-07-09T02:11:01.065 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 -- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 msgr2=0x7f72d80b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80b1690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72c800e980 tx=0x7f72c800ee40 comp rx=0 tx=0).stop 2023-07-09T02:11:01.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 -- 172.21.15.155:0/2558845161 shutdown_connections 2023-07-09T02:11:01.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72d815c060 0x7f72d815c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.066 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72d80d2450 0x7f72d80b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 --2- 172.21.15.155:0/2558845161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72d80cd120 0x7f72d80b1690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 -- 172.21.15.155:0/2558845161 >> 172.21.15.155:0/2558845161 conn(0x7f72d80698e0 msgr2=0x7f72d81576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:01.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 -- 172.21.15.155:0/2558845161 shutdown_connections 2023-07-09T02:11:01.067 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.063+0000 7f72c4ff9640 1 -- 172.21.15.155:0/2558845161 wait complete. 2023-07-09T02:11:01.085 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-07-09T02:11:01.148 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.145+0000 7fd835e46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T02:11:01.195 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.195+0000 7f77bd341180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T02:11:01.213 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.213+0000 7fd835e46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T02:11:01.222 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.219+0000 7f8797848640 1 Processor -- start 2023-07-09T02:11:01.222 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f8797848640 1 -- start start 2023-07-09T02:11:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f8797848640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f879015c060 0x7f87900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f8797848640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87900cd120 0x7f87900d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f8797848640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8790160a50 con 0x7f87900d2450 2023-07-09T02:11:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f8797848640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87900d28d0 con 0x7f87900cd120 2023-07-09T02:11:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f8797848640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87900cfe40 con 0x7f879015c060 2023-07-09T02:11:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f87955e4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f879015c060 0x7f87900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f87955e4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f879015c060 0x7f87900b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34574/0 (socket says 172.21.15.155:34574) 2023-07-09T02:11:01.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f87955e4640 1 -- 172.21.15.155:0/1552628753 learned_addr learned my addr 172.21.15.155:0/1552628753 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:01.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f8794de3640 1 --2- 172.21.15.155:0/1552628753 >> v2:172.21.15.45:3300/0 conn(0x7f87900cd120 0x7f87900d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.225 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f87955e4640 1 -- 172.21.15.155:0/1552628753 >> v2:172.21.15.45:3300/0 conn(0x7f87900cd120 msgr2=0x7f87900d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:01.226 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f87955e4640 1 --2- 172.21.15.155:0/1552628753 >> v2:172.21.15.45:3300/0 conn(0x7f87900cd120 0x7f87900d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.226 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f87955e4640 1 -- 172.21.15.155:0/1552628753 >> v1:172.21.15.155:6789/0 conn(0x7f87900d2450 legacy=0x7f87900d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.226 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.223+0000 7f87955e4640 1 -- 172.21.15.155:0/1552628753 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879015c430 con 0x7f879015c060 2023-07-09T02:11:01.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f87955e4640 1 --2- 172.21.15.155:0/1552628753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 0x7f87900b4ed0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f87900d3ad0 tx=0x7f878c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e8495df4b05641f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:01.227 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8787fff640 1 -- 172.21.15.155:0/1552628753 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0ab5f0 con 0x7f879015c060 2023-07-09T02:11:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8787fff640 1 -- 172.21.15.155:0/1552628753 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c0ab750 con 0x7f879015c060 2023-07-09T02:11:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8787fff640 1 -- 172.21.15.155:0/1552628753 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0abae0 con 0x7f879015c060 2023-07-09T02:11:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 -- 172.21.15.155:0/1552628753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 msgr2=0x7f87900b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 --2- 172.21.15.155:0/1552628753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 0x7f87900b4ed0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f87900d3ad0 tx=0x7f878c01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 -- 172.21.15.155:0/1552628753 shutdown_connections 2023-07-09T02:11:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 --2- 172.21.15.155:0/1552628753 >> v2:172.21.15.45:3300/0 conn(0x7f87900cd120 0x7f87900d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 --2- 172.21.15.155:0/1552628753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 0x7f87900b4ed0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 -- 172.21.15.155:0/1552628753 >> 172.21.15.155:0/1552628753 conn(0x7f87900698e0 msgr2=0x7f8790069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 -- 172.21.15.155:0/1552628753 shutdown_connections 2023-07-09T02:11:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 -- 172.21.15.155:0/1552628753 wait complete. 2023-07-09T02:11:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.227+0000 7f8797848640 1 Processor -- start 2023-07-09T02:11:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 -- start start 2023-07-09T02:11:01.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87900cd120 0x7f8790153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87900d2450 0x7f87900ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 0x7f87900b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900b1e20 con 0x7f87900d2450 2023-07-09T02:11:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900cbc40 con 0x7f879015c060 2023-07-09T02:11:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87900cafc0 con 0x7f87900cd120 2023-07-09T02:11:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f87955e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87900cd120 0x7f8790153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8795de5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 0x7f87900b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.233 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f87955e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87900cd120 0x7f8790153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37294/0 (socket says 172.21.15.155:37294) 2023-07-09T02:11:01.233 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f87955e4640 1 -- 172.21.15.155:0/1821450788 learned_addr learned my addr 172.21.15.155:0/1821450788 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:01.234 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8794de3640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87900d2450 0x7f87900ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.235 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8795de5640 1 -- 172.21.15.155:0/1821450788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87900cd120 msgr2=0x7f8790153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.235 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8795de5640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87900cd120 0x7f8790153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.235 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8795de5640 1 -- 172.21.15.155:0/1821450788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87900d2450 msgr2=0x7f87900ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.235 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8795de5640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87900d2450 0x7f87900ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.235 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8795de5640 1 -- 172.21.15.155:0/1821450788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c0094d0 con 0x7f879015c060 2023-07-09T02:11:01.235 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8794de3640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87900d2450 0x7f87900ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:01.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8795de5640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 0x7f87900b7dd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f878800c700 tx=0x7f878800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:01.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8785ffb640 1 -- 172.21.15.155:0/1821450788 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788003b80 con 0x7f879015c060 2023-07-09T02:11:01.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8785ffb640 1 -- 172.21.15.155:0/1821450788 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8788003ce0 con 0x7f879015c060 2023-07-09T02:11:01.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87900cb2a0 con 0x7f879015c060 2023-07-09T02:11:01.236 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8785ffb640 1 -- 172.21.15.155:0/1821450788 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800aa30 con 0x7f879015c060 2023-07-09T02:11:01.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8785ffb640 1 -- 172.21.15.155:0/1821450788 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f87880050d0 con 0x7f879015c060 2023-07-09T02:11:01.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87900cb860 con 0x7f879015c060 2023-07-09T02:11:01.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8785ffb640 1 -- 172.21.15.155:0/1821450788 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f8788005560 con 0x7f879015c060 2023-07-09T02:11:01.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.231+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879004d7d0 con 0x7f879015c060 2023-07-09T02:11:01.237 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.235+0000 7f8785ffb640 1 -- 172.21.15.155:0/1821450788 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8788005720 con 0x7f879015c060 2023-07-09T02:11:01.260 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.259+0000 7f77bd341180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T02:11:01.277 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.273+0000 7fd835e46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T02:11:01.302 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.299+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f879006baa0 con 0x7f879015c060 2023-07-09T02:11:01.307 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8785ffb640 1 -- 172.21.15.155:0/1821450788 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8788012470 con 0x7f879015c060 2023-07-09T02:11:01.307 INFO:teuthology.orchestra.run.smithi155.stdout:4 2023-07-09T02:11:01.308 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 msgr2=0x7f87900b7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.308 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 0x7f87900b7dd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f878800c700 tx=0x7f878800cbc0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.308 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 shutdown_connections 2023-07-09T02:11:01.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f879015c060 0x7f87900b7dd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87900d2450 0x7f87900ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 --2- 172.21.15.155:0/1821450788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87900cd120 0x7f8790153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 >> 172.21.15.155:0/1821450788 conn(0x7f87900698e0 msgr2=0x7f8790157630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:01.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 shutdown_connections 2023-07-09T02:11:01.309 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.307+0000 7f8797848640 1 -- 172.21.15.155:0/1821450788 wait complete. 2023-07-09T02:11:01.323 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.323+0000 7f77bd341180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T02:11:01.326 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-07-09T02:11:01.371 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.369+0000 7fd835e46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T02:11:01.415 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.415+0000 7f77bd341180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T02:11:01.433 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.433+0000 7fd835e46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T02:11:01.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.463+0000 7f2bc6d2c640 1 Processor -- start 2023-07-09T02:11:01.465 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.463+0000 7f2bc6d2c640 1 -- start start 2023-07-09T02:11:01.468 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc6d2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc015c060 0x7f2bc00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.469 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc6d2c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bc00cd120 0x7f2bc00d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.469 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc6d2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc0160a50 con 0x7f2bc00d2450 2023-07-09T02:11:01.469 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc6d2c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc00d28f0 con 0x7f2bc00cd120 2023-07-09T02:11:01.470 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc6d2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00cfe40 con 0x7f2bc015c060 2023-07-09T02:11:01.470 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc4ac8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc015c060 0x7f2bc00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.470 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc4ac8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc015c060 0x7f2bc00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37308/0 (socket says 172.21.15.155:37308) 2023-07-09T02:11:01.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc4ac8640 1 -- 172.21.15.155:0/1244241126 learned_addr learned my addr 172.21.15.155:0/1244241126 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:01.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bbffff640 1 --2- 172.21.15.155:0/1244241126 >> v2:172.21.15.45:3300/0 conn(0x7f2bc00cd120 0x7f2bc00d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc4ac8640 1 -- 172.21.15.155:0/1244241126 >> v2:172.21.15.45:3300/0 conn(0x7f2bc00cd120 msgr2=0x7f2bc00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:01.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc4ac8640 1 --2- 172.21.15.155:0/1244241126 >> v2:172.21.15.45:3300/0 conn(0x7f2bc00cd120 0x7f2bc00d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc4ac8640 1 -- 172.21.15.155:0/1244241126 >> v1:172.21.15.45:6789/0 conn(0x7f2bc00d2450 legacy=0x7f2bc00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc4ac8640 1 -- 172.21.15.155:0/1244241126 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc015c430 con 0x7f2bc015c060 2023-07-09T02:11:01.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.467+0000 7f2bc4ac8640 1 --2- 172.21.15.155:0/1244241126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc015c060 0x7f2bc00b4ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009870 tx=0x7f2bb401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=491af733ee4c629e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:01.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bbf7fe640 1 -- 172.21.15.155:0/1244241126 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40a7070 con 0x7f2bc015c060 2023-07-09T02:11:01.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bbf7fe640 1 -- 172.21.15.155:0/1244241126 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb40ab430 con 0x7f2bc015c060 2023-07-09T02:11:01.481 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bbf7fe640 1 -- 172.21.15.155:0/1244241126 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40ab7c0 con 0x7f2bc015c060 2023-07-09T02:11:01.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/1244241126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc015c060 msgr2=0x7f2bc00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.484 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 --2- 172.21.15.155:0/1244241126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc015c060 0x7f2bc00b4ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009870 tx=0x7f2bb401c510 comp rx=0 tx=0).stop 2023-07-09T02:11:01.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/1244241126 shutdown_connections 2023-07-09T02:11:01.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 --2- 172.21.15.155:0/1244241126 >> v2:172.21.15.45:3300/0 conn(0x7f2bc00cd120 0x7f2bc00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 --2- 172.21.15.155:0/1244241126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc015c060 0x7f2bc00b4ed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/1244241126 >> 172.21.15.155:0/1244241126 conn(0x7f2bc00698e0 msgr2=0x7f2bc0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:01.485 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/1244241126 shutdown_connections 2023-07-09T02:11:01.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/1244241126 wait complete. 2023-07-09T02:11:01.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 Processor -- start 2023-07-09T02:11:01.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.471+0000 7f2bc6d2c640 1 -- start start 2023-07-09T02:11:01.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc00cd120 0x7f2bc0153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc00d2450 0x7f2bc0158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bc015c060 0x7f2bc00ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.486 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0159f20 con 0x7f2bc015c060 2023-07-09T02:11:01.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc01539d0 con 0x7f2bc00d2450 2023-07-09T02:11:01.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0159680 con 0x7f2bc00cd120 2023-07-09T02:11:01.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc00cd120 0x7f2bc0153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bbffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc00d2450 0x7f2bc0158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc00cd120 0x7f2bc0153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37310/0 (socket says 172.21.15.155:37310) 2023-07-09T02:11:01.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 -- 172.21.15.155:0/833932961 learned_addr learned my addr 172.21.15.155:0/833932961 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:01.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc52c9640 1 --2- 172.21.15.155:0/833932961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bc015c060 0x7f2bc00ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.487 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 -- 172.21.15.155:0/833932961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc00d2450 msgr2=0x7f2bc0158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 --2- 172.21.15.155:0/833932961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc00d2450 0x7f2bc0158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 -- 172.21.15.155:0/833932961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bc015c060 msgr2=0x7f2bc00ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 --2- 172.21.15.155:0/833932961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bc015c060 0x7f2bc00ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 -- 172.21.15.155:0/833932961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40094d0 con 0x7f2bc00cd120 2023-07-09T02:11:01.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc4ac8640 1 --2- 172.21.15.155:0/833932961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc00cd120 0x7f2bc0153490 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40ad040 tx=0x7f2bb40192b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:01.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bbd7fa640 1 -- 172.21.15.155:0/833932961 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40bc070 con 0x7f2bc00cd120 2023-07-09T02:11:01.488 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bbd7fa640 1 -- 172.21.15.155:0/833932961 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb40b4420 con 0x7f2bc00cd120 2023-07-09T02:11:01.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bbd7fa640 1 -- 172.21.15.155:0/833932961 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40b47f0 con 0x7f2bc00cd120 2023-07-09T02:11:01.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc0159960 con 0x7f2bc00cd120 2023-07-09T02:11:01.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc015db40 con 0x7f2bc00cd120 2023-07-09T02:11:01.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bbd7fa640 1 -- 172.21.15.155:0/833932961 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2bb40b4c50 con 0x7f2bc00cd120 2023-07-09T02:11:01.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bbd7fa640 1 -- 172.21.15.155:0/833932961 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f2bb40c1c30 con 0x7f2bc00cd120 2023-07-09T02:11:01.489 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.475+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc015d9a0 con 0x7f2bc00cd120 2023-07-09T02:11:01.490 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.479+0000 7f77bd341180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T02:11:01.490 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.479+0000 7f2bbd7fa640 1 -- 172.21.15.155:0/833932961 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2bc015d9a0 con 0x7f2bc00cd120 2023-07-09T02:11:01.528 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.525+0000 7fd835e46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T02:11:01.548 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.547+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f2bc0160690 con 0x7f2bc00cd120 2023-07-09T02:11:01.553 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bbd7fa640 1 -- 172.21.15.155:0/833932961 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2bb40c1df0 con 0x7f2bc00cd120 2023-07-09T02:11:01.553 INFO:teuthology.orchestra.run.smithi155.stdout:5 2023-07-09T02:11:01.554 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc00cd120 msgr2=0x7f2bc0153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.554 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 --2- 172.21.15.155:0/833932961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc00cd120 0x7f2bc0153490 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40ad040 tx=0x7f2bb40192b0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.554 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 shutdown_connections 2023-07-09T02:11:01.554 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 --2- 172.21.15.155:0/833932961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bc015c060 0x7f2bc00ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.555 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 --2- 172.21.15.155:0/833932961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc00d2450 0x7f2bc0158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.555 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 --2- 172.21.15.155:0/833932961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc00cd120 0x7f2bc0153490 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.555 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 >> 172.21.15.155:0/833932961 conn(0x7f2bc00698e0 msgr2=0x7f2bc00b6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:01.555 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 shutdown_connections 2023-07-09T02:11:01.555 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.551+0000 7f2bc6d2c640 1 -- 172.21.15.155:0/833932961 wait complete. 2023-07-09T02:11:01.573 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-07-09T02:11:01.573 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.571+0000 7f77bd341180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T02:11:01.591 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.589+0000 7fd835e46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T02:11:01.635 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.635+0000 7f77bd341180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T02:11:01.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa71337640 1 Processor -- start 2023-07-09T02:11:01.712 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa71337640 1 -- start start 2023-07-09T02:11:01.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa71337640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c15c060 0x7faa6c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa71337640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa6c0d2620 0x7faa6c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa71337640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c160a50 con 0x7faa6c0cd120 2023-07-09T02:11:01.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa71337640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6c15c430 con 0x7faa6c0d2620 2023-07-09T02:11:01.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa71337640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c15fb60 con 0x7faa6c15c060 2023-07-09T02:11:01.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa6affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c15c060 0x7faa6c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa6affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c15c060 0x7faa6c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37316/0 (socket says 172.21.15.155:37316) 2023-07-09T02:11:01.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa6affd640 1 -- 172.21.15.155:0/3547368290 learned_addr learned my addr 172.21.15.155:0/3547368290 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:01.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa6affd640 1 -- 172.21.15.155:0/3547368290 >> v2:172.21.15.45:3300/0 conn(0x7faa6c0d2620 msgr2=0x7faa6c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:01.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa6affd640 1 --2- 172.21.15.155:0/3547368290 >> v2:172.21.15.45:3300/0 conn(0x7faa6c0d2620 0x7faa6c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa6affd640 1 -- 172.21.15.155:0/3547368290 >> v1:172.21.15.45:6789/0 conn(0x7faa6c0cd120 legacy=0x7faa6c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.711+0000 7faa6affd640 1 -- 172.21.15.155:0/3547368290 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c15fe40 con 0x7faa6c15c060 2023-07-09T02:11:01.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa6affd640 1 --2- 172.21.15.155:0/3547368290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c15c060 0x7faa6c0b4ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0098a0 tx=0x7faa5c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3409a2c5faec6e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:01.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa69ffb640 1 -- 172.21.15.155:0/3547368290 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c0aa670 con 0x7faa6c15c060 2023-07-09T02:11:01.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa69ffb640 1 -- 172.21.15.155:0/3547368290 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c0aa7d0 con 0x7faa6c15c060 2023-07-09T02:11:01.717 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa69ffb640 1 -- 172.21.15.155:0/3547368290 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c0aab60 con 0x7faa6c15c060 2023-07-09T02:11:01.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa71337640 1 -- 172.21.15.155:0/3547368290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c15c060 msgr2=0x7faa6c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa71337640 1 --2- 172.21.15.155:0/3547368290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c15c060 0x7faa6c0b4ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0098a0 tx=0x7faa5c01c510 comp rx=0 tx=0).stop 2023-07-09T02:11:01.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa71337640 1 -- 172.21.15.155:0/3547368290 shutdown_connections 2023-07-09T02:11:01.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa71337640 1 --2- 172.21.15.155:0/3547368290 >> v2:172.21.15.45:3300/0 conn(0x7faa6c0d2620 0x7faa6c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa71337640 1 --2- 172.21.15.155:0/3547368290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c15c060 0x7faa6c0b4ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa71337640 1 -- 172.21.15.155:0/3547368290 >> 172.21.15.155:0/3547368290 conn(0x7faa6c0698e0 msgr2=0x7faa6c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:01.718 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa71337640 1 -- 172.21.15.155:0/3547368290 shutdown_connections 2023-07-09T02:11:01.719 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.715+0000 7faa71337640 1 -- 172.21.15.155:0/3547368290 wait complete. 2023-07-09T02:11:01.719 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 Processor -- start 2023-07-09T02:11:01.719 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 -- start start 2023-07-09T02:11:01.720 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c0cd120 0x7faa6c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.720 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0d2620 0x7faa6c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.721 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa6c15c060 0x7faa6c1f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.721 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0d05f0 con 0x7faa6c0d2620 2023-07-09T02:11:01.721 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c1f4580 con 0x7faa6c15c060 2023-07-09T02:11:01.721 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c15a9d0 con 0x7faa6c0cd120 2023-07-09T02:11:01.721 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c0cd120 0x7faa6c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.721 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa6c15c060 0x7faa6c1f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.721 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa6c15c060 0x7faa6c1f4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34594/0 (socket says 172.21.15.155:34594) 2023-07-09T02:11:01.721 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c0cd120 0x7faa6c15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37322/0 (socket says 172.21.15.155:37322) 2023-07-09T02:11:01.722 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6b7fe640 1 -- 172.21.15.155:0/1428187202 learned_addr learned my addr 172.21.15.155:0/1428187202 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:01.722 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6a7fc640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0d2620 0x7faa6c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.723 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6affd640 1 -- 172.21.15.155:0/1428187202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa6c15c060 msgr2=0x7faa6c1f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.723 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6affd640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa6c15c060 0x7faa6c1f4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.723 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6affd640 1 -- 172.21.15.155:0/1428187202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0d2620 msgr2=0x7faa6c15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.723 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6affd640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0d2620 0x7faa6c15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.723 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6affd640 1 -- 172.21.15.155:0/1428187202 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c0094d0 con 0x7faa6c0cd120 2023-07-09T02:11:01.724 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6b7fe640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa6c15c060 0x7faa6c1f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:01.724 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa6affd640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c0cd120 0x7faa6c15a3a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0ab000 tx=0x7faa5c01ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:01.724 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa537fe640 1 -- 172.21.15.155:0/1428187202 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c0b3800 con 0x7faa6c0cd120 2023-07-09T02:11:01.724 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa537fe640 1 -- 172.21.15.155:0/1428187202 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c0b3960 con 0x7faa6c0cd120 2023-07-09T02:11:01.724 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa537fe640 1 -- 172.21.15.155:0/1428187202 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c0b3d10 con 0x7faa6c0cd120 2023-07-09T02:11:01.724 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c0b59f0 con 0x7faa6c0cd120 2023-07-09T02:11:01.724 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c0d0b20 con 0x7faa6c0cd120 2023-07-09T02:11:01.725 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa537fe640 1 -- 172.21.15.155:0/1428187202 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faa5c0bd6f0 con 0x7faa6c0cd120 2023-07-09T02:11:01.725 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.719+0000 7faa537fe640 1 -- 172.21.15.155:0/1428187202 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7faa5c0b23d0 con 0x7faa6c0cd120 2023-07-09T02:11:01.725 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.723+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c04d7d0 con 0x7faa6c0cd120 2023-07-09T02:11:01.725 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.723+0000 7faa537fe640 1 -- 172.21.15.155:0/1428187202 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faa5c0c3060 con 0x7faa6c0cd120 2023-07-09T02:11:01.753 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.753+0000 7fd835e46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T02:11:01.791 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.791+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7faa6c06baa0 con 0x7faa6c0cd120 2023-07-09T02:11:01.794 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.795+0000 7f77bd341180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T02:11:01.796 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa537fe640 1 -- 172.21.15.155:0/1428187202 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa5c0059a0 con 0x7faa6c0cd120 2023-07-09T02:11:01.796 INFO:teuthology.orchestra.run.smithi155.stdout:6 2023-07-09T02:11:01.797 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c0cd120 msgr2=0x7faa6c15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.797 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c0cd120 0x7faa6c15a3a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0ab000 tx=0x7faa5c01ad50 comp rx=0 tx=0).stop 2023-07-09T02:11:01.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 shutdown_connections 2023-07-09T02:11:01.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa6c15c060 0x7faa6c1f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa6c0d2620 0x7faa6c15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 --2- 172.21.15.155:0/1428187202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa6c0cd120 0x7faa6c15a3a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 >> 172.21.15.155:0/1428187202 conn(0x7faa6c0698e0 msgr2=0x7faa6c155370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:01.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 shutdown_connections 2023-07-09T02:11:01.798 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.795+0000 7faa71337640 1 -- 172.21.15.155:0/1428187202 wait complete. 2023-07-09T02:11:01.816 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-07-09T02:11:01.826 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:01.825+0000 7fd835e46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T02:11:01.867 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:01.867+0000 7f77bd341180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T02:11:01.956 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.951+0000 7f784d47b640 1 Processor -- start 2023-07-09T02:11:01.956 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.951+0000 7f784d47b640 1 -- start start 2023-07-09T02:11:01.956 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f784d47b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f784815c060 0x7f78480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.957 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f784d47b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78480d2620 0x7f78480cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.957 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f784d47b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7848160a50 con 0x7f78480cd120 2023-07-09T02:11:01.957 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f784d47b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784815c430 con 0x7f784815c060 2023-07-09T02:11:01.957 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f784d47b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784815fb60 con 0x7f78480d2620 2023-07-09T02:11:01.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f78477fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78480d2620 0x7f78480cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f78477fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78480d2620 0x7f78480cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34602/0 (socket says 172.21.15.155:34602) 2023-07-09T02:11:01.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f78477fe640 1 -- 172.21.15.155:0/2875382785 learned_addr learned my addr 172.21.15.155:0/2875382785 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:01.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f7846ffd640 1 --2- 172.21.15.155:0/2875382785 >> v2:172.21.15.45:3300/0 conn(0x7f784815c060 0x7f78480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.958 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f78477fe640 1 -- 172.21.15.155:0/2875382785 >> v2:172.21.15.45:3300/0 conn(0x7f784815c060 msgr2=0x7f78480b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:01.959 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f78477fe640 1 --2- 172.21.15.155:0/2875382785 >> v2:172.21.15.45:3300/0 conn(0x7f784815c060 0x7f78480b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.959 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f78477fe640 1 -- 172.21.15.155:0/2875382785 >> v1:172.21.15.45:6789/0 conn(0x7f78480cd120 legacy=0x7f78480d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.960 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f78477fe640 1 -- 172.21.15.155:0/2875382785 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784815fe40 con 0x7f78480d2620 2023-07-09T02:11:01.962 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.955+0000 7f78477fe640 1 --2- 172.21.15.155:0/2875382785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f78480cee30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f784808bca0 tx=0x7f784001c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a7a256c08776ece server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:01.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f7845ffb640 1 -- 172.21.15.155:0/2875382785 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400a5860 con 0x7f78480d2620 2023-07-09T02:11:01.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f7845ffb640 1 -- 172.21.15.155:0/2875382785 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400a59c0 con 0x7f78480d2620 2023-07-09T02:11:01.963 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f7845ffb640 1 -- 172.21.15.155:0/2875382785 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400a5d50 con 0x7f78480d2620 2023-07-09T02:11:01.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- 172.21.15.155:0/2875382785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 msgr2=0x7f78480cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 --2- 172.21.15.155:0/2875382785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f78480cee30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f784808bca0 tx=0x7f784001c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- 172.21.15.155:0/2875382785 shutdown_connections 2023-07-09T02:11:01.964 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 --2- 172.21.15.155:0/2875382785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f78480cee30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.965 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 --2- 172.21.15.155:0/2875382785 >> v2:172.21.15.45:3300/0 conn(0x7f784815c060 0x7f78480b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- 172.21.15.155:0/2875382785 >> 172.21.15.155:0/2875382785 conn(0x7f78480698e0 msgr2=0x7f7848069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:01.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- 172.21.15.155:0/2875382785 shutdown_connections 2023-07-09T02:11:01.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- 172.21.15.155:0/2875382785 wait complete. 2023-07-09T02:11:01.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 Processor -- start 2023-07-09T02:11:01.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- start start 2023-07-09T02:11:01.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78480cd120 0x7f7848149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.966 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f7848156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f784815c060 0x7f78480c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:01.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784814a4b0 con 0x7f784815c060 2023-07-09T02:11:01.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784814a790 con 0x7f78480d2620 2023-07-09T02:11:01.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f784d47b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784814aa70 con 0x7f78480cd120 2023-07-09T02:11:01.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.959+0000 7f78467fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f7848156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f7846ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78480cd120 0x7f7848149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.967 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78467fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f7848156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:34618/0 (socket says 172.21.15.155:34618) 2023-07-09T02:11:01.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78467fc640 1 -- 172.21.15.155:0/2539971323 learned_addr learned my addr 172.21.15.155:0/2539971323 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-07-09T02:11:01.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78477fe640 1 --2- 172.21.15.155:0/2539971323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f784815c060 0x7f78480c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:01.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78467fc640 1 -- 172.21.15.155:0/2539971323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78480cd120 msgr2=0x7f7848149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78467fc640 1 --2- 172.21.15.155:0/2539971323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78480cd120 0x7f7848149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78467fc640 1 -- 172.21.15.155:0/2539971323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f784815c060 msgr2=0x7f78480c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:01.968 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78467fc640 1 --2- 172.21.15.155:0/2539971323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f784815c060 0x7f78480c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:01.969 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78467fc640 1 -- 172.21.15.155:0/2539971323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009b30 con 0x7f78480d2620 2023-07-09T02:11:01.971 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f78467fc640 1 --2- 172.21.15.155:0/2539971323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f7848156a40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c4d0 tx=0x7f783c00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:01.971 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f782f7fe640 1 -- 172.21.15.155:0/2539971323 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0052d0 con 0x7f78480d2620 2023-07-09T02:11:01.971 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f782f7fe640 1 -- 172.21.15.155:0/2539971323 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c005430 con 0x7f78480d2620 2023-07-09T02:11:01.971 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78480b59f0 con 0x7f78480d2620 2023-07-09T02:11:01.971 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f782f7fe640 1 -- 172.21.15.155:0/2539971323 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c012830 con 0x7f78480d2620 2023-07-09T02:11:01.971 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7848158d10 con 0x7f78480d2620 2023-07-09T02:11:01.971 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f782f7fe640 1 -- 172.21.15.155:0/2539971323 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f783c012c90 con 0x7f78480d2620 2023-07-09T02:11:01.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f782f7fe640 1 -- 172.21.15.155:0/2539971323 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f783c011380 con 0x7f78480d2620 2023-07-09T02:11:01.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.963+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784804d7d0 con 0x7f78480d2620 2023-07-09T02:11:01.972 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:01.967+0000 7f782f7fe640 1 -- 172.21.15.155:0/2539971323 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f783c003600 con 0x7f78480d2620 2023-07-09T02:11:02.032 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.031+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f784806baa0 con 0x7f78480d2620 2023-07-09T02:11:02.037 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f782f7fe640 1 -- 172.21.15.155:0/2539971323 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f783c0037a0 con 0x7f78480d2620 2023-07-09T02:11:02.037 INFO:teuthology.orchestra.run.smithi155.stdout:7 2023-07-09T02:11:02.038 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 msgr2=0x7f7848156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:02.039 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 --2- 172.21.15.155:0/2539971323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f7848156a40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c4d0 tx=0x7f783c00c990 comp rx=0 tx=0).stop 2023-07-09T02:11:02.039 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 shutdown_connections 2023-07-09T02:11:02.039 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 --2- 172.21.15.155:0/2539971323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f784815c060 0x7f78480c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 --2- 172.21.15.155:0/2539971323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480d2620 0x7f7848156a40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 --2- 172.21.15.155:0/2539971323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78480cd120 0x7f7848149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 >> 172.21.15.155:0/2539971323 conn(0x7f78480698e0 msgr2=0x7f7848154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:02.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 shutdown_connections 2023-07-09T02:11:02.040 INFO:teuthology.orchestra.run.smithi155.stderr:2023-07-09T02:11:02.035+0000 7f784d47b640 1 -- 172.21.15.155:0/2539971323 wait complete. 2023-07-09T02:11:02.055 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-09T02:11:02.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-09T02:11:02.061 INFO:tasks.ceph.osd.0:Started 2023-07-09T02:11:02.062 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-09T02:11:02.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-09T02:11:02.066 INFO:tasks.ceph.osd.1:Started 2023-07-09T02:11:02.067 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-09T02:11:02.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-09T02:11:02.071 INFO:tasks.ceph.osd.2:Started 2023-07-09T02:11:02.072 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-09T02:11:02.072 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-09T02:11:02.077 INFO:tasks.ceph.osd.3:Started 2023-07-09T02:11:02.081 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-09T02:11:02.082 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-09T02:11:02.086 INFO:tasks.ceph.osd.4:Started 2023-07-09T02:11:02.086 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-09T02:11:02.087 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-09T02:11:02.090 INFO:tasks.ceph.osd.5:Started 2023-07-09T02:11:02.090 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-09T02:11:02.091 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-09T02:11:02.094 INFO:tasks.ceph.osd.6:Started 2023-07-09T02:11:02.094 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-09T02:11:02.094 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-09T02:11:02.098 INFO:tasks.ceph.osd.7:Started 2023-07-09T02:11:02.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:02.202 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-07-09T02:11:02.201+0000 7f26fc50b640 -1 Falling back to public interface 2023-07-09T02:11:02.203 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-07-09T02:11:02.203+0000 7ff14f33a640 -1 Falling back to public interface 2023-07-09T02:11:02.207 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-07-09T02:11:02.207+0000 7f24cb16e640 -1 Falling back to public interface 2023-07-09T02:11:02.217 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-07-09T02:11:02.215+0000 7f8d5bf19640 -1 Falling back to public interface 2023-07-09T02:11:02.220 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-07-09T02:11:02.219+0000 7f2402bd3640 -1 Falling back to public interface 2023-07-09T02:11:02.223 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-07-09T02:11:02.221+0000 7fc6aeaba640 -1 Falling back to public interface 2023-07-09T02:11:02.228 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-07-09T02:11:02.227+0000 7ff14f33a640 -1 osd.6 0 log_to_monitors true 2023-07-09T02:11:02.229 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-07-09T02:11:02.229+0000 7efc5e759640 -1 Falling back to public interface 2023-07-09T02:11:02.233 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-07-09T02:11:02.229+0000 7f8bdeb43640 -1 Falling back to public interface 2023-07-09T02:11:02.244 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-07-09T02:11:02.241+0000 7f26fc50b640 -1 osd.1 0 log_to_monitors true 2023-07-09T02:11:02.250 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-07-09T02:11:02.251+0000 7f24cb16e640 -1 osd.4 0 log_to_monitors true 2023-07-09T02:11:02.255 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-07-09T02:11:02.249+0000 7efc5e759640 -1 osd.3 0 log_to_monitors true 2023-07-09T02:11:02.256 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-07-09T02:11:02.249+0000 7fc6aeaba640 -1 osd.0 0 log_to_monitors true 2023-07-09T02:11:02.260 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-07-09T02:11:02.259+0000 7f8d5bf19640 -1 osd.7 0 log_to_monitors true 2023-07-09T02:11:02.263 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-07-09T02:11:02.261+0000 7f8bdeb43640 -1 osd.2 0 log_to_monitors true 2023-07-09T02:11:02.264 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-07-09T02:11:02.263+0000 7f2402bd3640 -1 osd.5 0 log_to_monitors true 2023-07-09T02:11:02.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb1a4fe1640 1 Processor -- start 2023-07-09T02:11:02.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb1a4fe1640 1 -- start start 2023-07-09T02:11:02.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb1a4fe1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1a015c060 0x7fb1a00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:02.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb1a4fe1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb1a00d2620 0x7fb1a00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:02.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb1a4fe1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a0160a50 con 0x7fb1a00cd120 2023-07-09T02:11:02.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb1a4fe1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a015c430 con 0x7fb1a015c060 2023-07-09T02:11:02.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb1a4fe1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a015fb60 con 0x7fb1a00d2620 2023-07-09T02:11:02.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb19e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1a015c060 0x7fb1a00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:02.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb197fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb1a00cd120 0x7fb1a00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39056/0 (socket says 172.21.15.45:39056) 2023-07-09T02:11:02.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb197fff640 1 -- 172.21.15.45:0/663126463 learned_addr learned my addr 172.21.15.45:0/663126463 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:02.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.317+0000 7fb19ed9d640 1 --2- 172.21.15.45:0/663126463 >> v2:172.21.15.155:3300/0 conn(0x7fb1a00d2620 0x7fb1a00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:02.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19dd9b640 1 -- 172.21.15.45:0/663126463 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556922015 0 0) 0x7fb1a0160a50 con 0x7fb1a00cd120 2023-07-09T02:11:02.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19dd9b640 1 -- 172.21.15.45:0/663126463 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb18c003530 con 0x7fb1a00cd120 2023-07-09T02:11:02.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19e59c640 1 -- 172.21.15.45:0/663126463 >> v2:172.21.15.155:3300/0 conn(0x7fb1a00d2620 msgr2=0x7fb1a00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:02.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19e59c640 1 --2- 172.21.15.45:0/663126463 >> v2:172.21.15.155:3300/0 conn(0x7fb1a00d2620 0x7fb1a00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19e59c640 1 -- 172.21.15.45:0/663126463 >> v1:172.21.15.45:6789/0 conn(0x7fb1a00cd120 legacy=0x7fb1a00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:02.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19e59c640 1 -- 172.21.15.45:0/663126463 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a015fe40 con 0x7fb1a015c060 2023-07-09T02:11:02.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19e59c640 1 --2- 172.21.15.45:0/663126463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a015c060 0x7fb1a00b4ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1a008bca0 tx=0x7fb19001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e73e3c89b347e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:02.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19dd9b640 1 -- 172.21.15.45:0/663126463 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900a7070 con 0x7fb1a015c060 2023-07-09T02:11:02.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19dd9b640 1 -- 172.21.15.45:0/663126463 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1900ab430 con 0x7fb1a015c060 2023-07-09T02:11:02.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb19dd9b640 1 -- 172.21.15.45:0/663126463 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1900ab7c0 con 0x7fb1a015c060 2023-07-09T02:11:02.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/663126463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a015c060 msgr2=0x7fb1a00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:02.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb1a4fe1640 1 --2- 172.21.15.45:0/663126463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a015c060 0x7fb1a00b4ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1a008bca0 tx=0x7fb19001c430 comp rx=0 tx=0).stop 2023-07-09T02:11:02.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/663126463 shutdown_connections 2023-07-09T02:11:02.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb1a4fe1640 1 --2- 172.21.15.45:0/663126463 >> v2:172.21.15.155:3300/0 conn(0x7fb1a00d2620 0x7fb1a00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb1a4fe1640 1 --2- 172.21.15.45:0/663126463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a015c060 0x7fb1a00b4ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/663126463 >> 172.21.15.45:0/663126463 conn(0x7fb1a00698e0 msgr2=0x7fb1a0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:02.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/663126463 shutdown_connections 2023-07-09T02:11:02.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.321+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/663126463 wait complete. 2023-07-09T02:11:02.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb1a4fe1640 1 Processor -- start 2023-07-09T02:11:02.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb1a4fe1640 1 -- start start 2023-07-09T02:11:02.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb1a4fe1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1a00cd120 0x7fb1a01f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:02.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb1a4fe1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a00d2620 0x7fb1a0152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:02.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb1a4fe1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a015c060 0x7fb1a01525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:02.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb1a4fe1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a0156400 con 0x7fb1a00d2620 2023-07-09T02:11:02.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb1a4fe1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a01f5a10 con 0x7fb1a015c060 2023-07-09T02:11:02.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb1a4fe1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a01f5780 con 0x7fb1a00cd120 2023-07-09T02:11:02.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a00d2620 0x7fb1a0152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:02.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a00d2620 0x7fb1a0152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43886/0 (socket says 172.21.15.45:43886) 2023-07-09T02:11:02.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 -- 172.21.15.45:0/376055663 learned_addr learned my addr 172.21.15.45:0/376055663 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:02.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb19ed9d640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a015c060 0x7fb1a01525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:02.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb19e59c640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1a00cd120 0x7fb1a01f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:02.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 -- 172.21.15.45:0/376055663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1a00cd120 msgr2=0x7fb1a01f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:02.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1a00cd120 0x7fb1a01f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 -- 172.21.15.45:0/376055663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a015c060 msgr2=0x7fb1a01525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:02.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a015c060 0x7fb1a01525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 -- 172.21.15.45:0/376055663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190009420 con 0x7fb1a00d2620 2023-07-09T02:11:02.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb197fff640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a00d2620 0x7fb1a0152090 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb188001ec0 tx=0x7fb18800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:02.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.325+0000 7fb196ffd640 1 -- 172.21.15.45:0/376055663 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188005d50 con 0x7fb1a00d2620 2023-07-09T02:11:02.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.329+0000 7fb196ffd640 1 -- 172.21.15.45:0/376055663 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188007070 con 0x7fb1a00d2620 2023-07-09T02:11:02.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.329+0000 7fb196ffd640 1 -- 172.21.15.45:0/376055663 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188007420 con 0x7fb1a00d2620 2023-07-09T02:11:02.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.329+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a00b59f0 con 0x7fb1a00d2620 2023-07-09T02:11:02.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.329+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a015a8c0 con 0x7fb1a00d2620 2023-07-09T02:11:02.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.329+0000 7fb196ffd640 1 -- 172.21.15.45:0/376055663 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb188012400 con 0x7fb1a00d2620 2023-07-09T02:11:02.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.329+0000 7fb196ffd640 1 -- 172.21.15.45:0/376055663 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb188012d80 con 0x7fb1a00d2620 2023-07-09T02:11:02.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.329+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a0156540 con 0x7fb1a00d2620 2023-07-09T02:11:02.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.329+0000 7fb196ffd640 1 -- 172.21.15.45:0/376055663 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb1a0156540 con 0x7fb1a00d2620 2023-07-09T02:11:02.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1a004d7d0 con 0x7fb1a00d2620 2023-07-09T02:11:02.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb196ffd640 1 -- 172.21.15.45:0/376055663 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb188020060 con 0x7fb1a00d2620 2023-07-09T02:11:02.394 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:02.394 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:02.034459+0000","last_up_change":"0.000000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:02.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a00d2620 msgr2=0x7fb1a0152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:02.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a00d2620 0x7fb1a0152090 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb188001ec0 tx=0x7fb18800c960 comp rx=0 tx=0).stop 2023-07-09T02:11:02.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 shutdown_connections 2023-07-09T02:11:02.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1a015c060 0x7fb1a01525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1a00d2620 0x7fb1a0152090 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 --2- 172.21.15.45:0/376055663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1a00cd120 0x7fb1a01f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:02.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 >> 172.21.15.45:0/376055663 conn(0x7fb1a00698e0 msgr2=0x7fb1a00d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:02.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 shutdown_connections 2023-07-09T02:11:02.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:02.393+0000 7fb1a4fe1640 1 -- 172.21.15.45:0/376055663 wait complete. 2023-07-09T02:11:02.414 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-09T02:11:02.414 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-09T02:11:02.523 INFO:tasks.ceph.mgr.x.smithi155.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T02:11:02.524 INFO:tasks.ceph.mgr.x.smithi155.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T02:11:02.524 INFO:tasks.ceph.mgr.x.smithi155.stderr: from numpy import show_config as show_numpy_config 2023-07-09T02:11:02.539 INFO:tasks.ceph.mgr.y.smithi045.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T02:11:02.540 INFO:tasks.ceph.mgr.y.smithi045.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T02:11:02.540 INFO:tasks.ceph.mgr.y.smithi045.stderr: from numpy import show_config as show_numpy_config 2023-07-09T02:11:02.573 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:02.571+0000 7f77bd341180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T02:11:02.602 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:02.601+0000 7fd835e46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T02:11:02.704 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:02.703+0000 7f77bd341180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T02:11:02.742 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:02.741+0000 7fd835e46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T02:11:02.882 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:02.879+0000 7f77bd341180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T02:11:02.918 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:02.917+0000 7fd835e46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T02:11:02.954 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:02.951+0000 7f77bd341180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T02:11:02.995 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:02.993+0000 7fd835e46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T02:11:03.092 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:03.091+0000 7f77bd341180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T02:11:03.142 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:03.137+0000 7fd835e46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T02:11:03.222 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:03.355 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa152c7b640 1 Processor -- start 2023-07-09T02:11:03.355 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa152c7b640 1 -- start start 2023-07-09T02:11:03.357 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa152c7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c15c2d0 0x7fa14c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:03.357 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa152c7b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa14c0694b0 0x7fa14c0698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:03.358 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa152c7b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14c069e10 con 0x7fa14c0cebc0 2023-07-09T02:11:03.358 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa152c7b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14c0cf030 con 0x7fa14c0694b0 2023-07-09T02:11:03.358 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa152c7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c0cd0d0 con 0x7fa14c15c2d0 2023-07-09T02:11:03.358 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa14bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa14c0cebc0 0x7fa14c0d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39072/0 (socket says 172.21.15.45:39072) 2023-07-09T02:11:03.359 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa14bfff640 1 -- 172.21.15.45:0/45964950 learned_addr learned my addr 172.21.15.45:0/45964950 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:03.359 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa151218640 1 --2- 172.21.15.45:0/45964950 >> v2:172.21.15.45:3300/0 conn(0x7fa14c0694b0 0x7fa14c0698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:03.359 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa150a17640 1 --2- 172.21.15.45:0/45964950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c15c2d0 0x7fa14c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:03.359 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa14b7fe640 1 -- 172.21.15.45:0/45964950 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085400253 0 0) 0x7fa14c069e10 con 0x7fa14c0cebc0 2023-07-09T02:11:03.359 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa14b7fe640 1 -- 172.21.15.45:0/45964950 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa13c003530 con 0x7fa14c0cebc0 2023-07-09T02:11:03.359 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa151218640 1 -- 172.21.15.45:0/45964950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c15c2d0 msgr2=0x7fa14c0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:03.360 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa151218640 1 --2- 172.21.15.45:0/45964950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c15c2d0 0x7fa14c0b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.360 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa151218640 1 -- 172.21.15.45:0/45964950 >> v1:172.21.15.45:6789/0 conn(0x7fa14c0cebc0 legacy=0x7fa14c0d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:03.360 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.353+0000 7fa151218640 1 -- 172.21.15.45:0/45964950 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c0cd3b0 con 0x7fa14c0694b0 2023-07-09T02:11:03.361 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa151218640 1 --2- 172.21.15.45:0/45964950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c0698d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa144009d90 tx=0x7fa14401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87894cf370132f75 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:03.362 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa14b7fe640 1 -- 172.21.15.45:0/45964950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440a59a0 con 0x7fa14c0694b0 2023-07-09T02:11:03.362 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa14b7fe640 1 -- 172.21.15.45:0/45964950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1440a5b00 con 0x7fa14c0694b0 2023-07-09T02:11:03.362 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa14b7fe640 1 -- 172.21.15.45:0/45964950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440a5e90 con 0x7fa14c0694b0 2023-07-09T02:11:03.362 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa152c7b640 1 -- 172.21.15.45:0/45964950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 msgr2=0x7fa14c0698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:03.362 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa152c7b640 1 --2- 172.21.15.45:0/45964950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c0698d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa144009d90 tx=0x7fa14401c8c0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.362 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa152c7b640 1 -- 172.21.15.45:0/45964950 shutdown_connections 2023-07-09T02:11:03.363 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa152c7b640 1 --2- 172.21.15.45:0/45964950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c0698d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.363 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa152c7b640 1 --2- 172.21.15.45:0/45964950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c15c2d0 0x7fa14c0b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.363 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa152c7b640 1 -- 172.21.15.45:0/45964950 >> 172.21.15.45:0/45964950 conn(0x7fa14c0d3620 msgr2=0x7fa14c0cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:03.363 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa152c7b640 1 -- 172.21.15.45:0/45964950 shutdown_connections 2023-07-09T02:11:03.363 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.357+0000 7fa152c7b640 1 -- 172.21.15.45:0/45964950 wait complete. 2023-07-09T02:11:03.366 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 Processor -- start 2023-07-09T02:11:03.366 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 -- start start 2023-07-09T02:11:03.366 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:03.366 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c0cebc0 0x7fa14c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:03.367 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa14c15c2d0 0x7fa14c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:03.367 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c15c8d0 con 0x7fa14c0694b0 2023-07-09T02:11:03.367 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c14e9d0 con 0x7fa14c15c2d0 2023-07-09T02:11:03.367 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c14ecb0 con 0x7fa14c0cebc0 2023-07-09T02:11:03.367 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:03.368 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c14be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43902/0 (socket says 172.21.15.45:43902) 2023-07-09T02:11:03.368 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 -- 172.21.15.45:0/2263406308 learned_addr learned my addr 172.21.15.45:0/2263406308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:03.368 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa151218640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa14c15c2d0 0x7fa14c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:03.368 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa14bfff640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c0cebc0 0x7fa14c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:03.368 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 -- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c0cebc0 msgr2=0x7fa14c15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:03.369 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c0cebc0 0x7fa14c15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.369 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 -- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa14c15c2d0 msgr2=0x7fa14c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:03.369 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa14c15c2d0 0x7fa14c15ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.369 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 -- 172.21.15.45:0/2263406308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144009a70 con 0x7fa14c0694b0 2023-07-09T02:11:03.369 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa151218640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa14c15c2d0 0x7fa14c15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:03.369 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa150a17640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c14be00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa14000e930 tx=0x7fa14000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:03.370 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa1497fa640 1 -- 172.21.15.45:0/2263406308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140009690 con 0x7fa14c0694b0 2023-07-09T02:11:03.370 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa1497fa640 1 -- 172.21.15.45:0/2263406308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000ca00 con 0x7fa14c0694b0 2023-07-09T02:11:03.370 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa1497fa640 1 -- 172.21.15.45:0/2263406308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000cd70 con 0x7fa14c0694b0 2023-07-09T02:11:03.370 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c14ef90 con 0x7fa14c0694b0 2023-07-09T02:11:03.370 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c14f550 con 0x7fa14c0694b0 2023-07-09T02:11:03.370 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa1497fa640 1 -- 172.21.15.45:0/2263406308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa140005ca0 con 0x7fa14c0694b0 2023-07-09T02:11:03.371 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.361+0000 7fa1497fa640 1 -- 172.21.15.45:0/2263406308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7fa140013c30 con 0x7fa14c0694b0 2023-07-09T02:11:03.371 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.365+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14c066f00 con 0x7fa14c0694b0 2023-07-09T02:11:03.371 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.365+0000 7fa1497fa640 1 -- 172.21.15.45:0/2263406308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa140021060 con 0x7fa14c0694b0 2023-07-09T02:11:03.426 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa14c0cdf00 con 0x7fa14c0694b0 2023-07-09T02:11:03.426 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa1497fa640 1 -- 172.21.15.45:0/2263406308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa140029020 con 0x7fa14c0694b0 2023-07-09T02:11:03.427 INFO:teuthology.misc.health.smithi045.stdout: 2023-07-09T02:11:03.427 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":11,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:03.036009+0000","last_up_change":"0.000000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:03.428 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 msgr2=0x7fa14c14be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:03.428 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c14be00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa14000e930 tx=0x7fa14000edf0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.428 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 shutdown_connections 2023-07-09T02:11:03.428 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa14c15c2d0 0x7fa14c15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.428 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa14c0cebc0 0x7fa14c15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.429 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 --2- 172.21.15.45:0/2263406308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa14c0694b0 0x7fa14c14be00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:03.429 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 >> 172.21.15.45:0/2263406308 conn(0x7fa14c0d3620 msgr2=0x7fa14c159960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:03.429 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 shutdown_connections 2023-07-09T02:11:03.429 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:03.425+0000 7fa152c7b640 1 -- 172.21.15.45:0/2263406308 wait complete. 2023-07-09T02:11:03.444 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-09T02:11:03.767 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:03.767+0000 7f77bd341180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T02:11:03.844 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:03.841+0000 7fd835e46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T02:11:03.851 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:03.851+0000 7f77bd341180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T02:11:03.935 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:03.933+0000 7fd835e46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T02:11:04.067 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:04.067+0000 7f77bd341180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T02:11:04.068 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-07-09T02:11:04.065+0000 7fc6aaa61640 -1 osd.0 0 waiting for initial osdmap 2023-07-09T02:11:04.069 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-07-09T02:11:04.069+0000 7f8bdaaea640 -1 osd.2 0 waiting for initial osdmap 2023-07-09T02:11:04.071 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-07-09T02:11:04.071+0000 7f23feb7a640 -1 osd.5 0 waiting for initial osdmap 2023-07-09T02:11:04.071 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-07-09T02:11:04.069+0000 7fc6a40a8640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T02:11:04.071 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-07-09T02:11:04.069+0000 7f8bd4131640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T02:11:04.073 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-07-09T02:11:04.071+0000 7f23f81c1640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T02:11:04.085 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-07-09T02:11:04.083+0000 7f24c792a640 -1 osd.4 0 waiting for initial osdmap 2023-07-09T02:11:04.086 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-07-09T02:11:04.087+0000 7ff14b2df640 -1 osd.6 0 waiting for initial osdmap 2023-07-09T02:11:04.087 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-07-09T02:11:04.087+0000 7f8d57ec0640 -1 osd.7 0 waiting for initial osdmap 2023-07-09T02:11:04.087 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-07-09T02:11:04.087+0000 7f24c075a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T02:11:04.088 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-07-09T02:11:04.085+0000 7efc5a6fe640 -1 osd.3 0 waiting for initial osdmap 2023-07-09T02:11:04.088 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-07-09T02:11:04.085+0000 7f26f84b0640 -1 osd.1 0 waiting for initial osdmap 2023-07-09T02:11:04.089 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-07-09T02:11:04.087+0000 7ff144926640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T02:11:04.089 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-07-09T02:11:04.087+0000 7f8d51507640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T02:11:04.090 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-07-09T02:11:04.089+0000 7efc53d45640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T02:11:04.091 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-07-09T02:11:04.089+0000 7f26f1af7640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T02:11:04.140 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:04.137+0000 7fd835e46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T02:11:04.160 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:04.159+0000 7f77bd341180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T02:11:04.228 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:04.225+0000 7fd835e46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T02:11:04.439 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:04.439+0000 7f77bd341180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T02:11:04.506 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:04.503+0000 7f77bd341180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T02:11:04.526 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:04.525+0000 7fd835e46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T02:11:04.601 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-07-09T02:11:04.597+0000 7fd835e46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T02:11:05.533 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:05.531+0000 7f7764cf3640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-09T02:11:05.535 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-07-09T02:11:05.535+0000 7f7764cf3640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-09T02:11:10.251 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:10.395 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f6424b59640 1 Processor -- start 2023-07-09T02:11:10.395 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f6424b59640 1 -- start start 2023-07-09T02:11:10.396 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f6424b59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f642015c2d0 0x7f64200b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.397 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f6424b59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 0x7f64200698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.397 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f6424b59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6420069e30 con 0x7f64200cebc0 2023-07-09T02:11:10.397 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f6424b59640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64200cf030 con 0x7f642015c2d0 2023-07-09T02:11:10.397 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f6424b59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64200cd0d0 con 0x7f64200694b0 2023-07-09T02:11:10.397 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f641e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f642015c2d0 0x7f64200b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.397 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f641e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f642015c2d0 0x7f64200b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43916/0 (socket says 172.21.15.45:43916) 2023-07-09T02:11:10.397 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f641e59c640 1 -- 172.21.15.45:0/809157163 learned_addr learned my addr 172.21.15.45:0/809157163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:10.398 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.393+0000 7f641ed9d640 1 --2- 172.21.15.45:0/809157163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 0x7f64200698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.398 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f641e59c640 1 -- 172.21.15.45:0/809157163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 msgr2=0x7f64200698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:10.398 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f641e59c640 1 --2- 172.21.15.45:0/809157163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 0x7f64200698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.399 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f641e59c640 1 -- 172.21.15.45:0/809157163 >> v1:172.21.15.155:6789/0 conn(0x7f64200cebc0 legacy=0x7f64200d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.399 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f641e59c640 1 -- 172.21.15.45:0/809157163 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64200cd3b0 con 0x7f642015c2d0 2023-07-09T02:11:10.400 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f641e59c640 1 --2- 172.21.15.45:0/809157163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f64200b57c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6410009870 tx=0x7f641001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f455a25072ea7aa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:10.400 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f641dd9b640 1 -- 172.21.15.45:0/809157163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100aa430 con 0x7f642015c2d0 2023-07-09T02:11:10.401 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f641dd9b640 1 -- 172.21.15.45:0/809157163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64100aa590 con 0x7f642015c2d0 2023-07-09T02:11:10.401 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f641dd9b640 1 -- 172.21.15.45:0/809157163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100aa920 con 0x7f642015c2d0 2023-07-09T02:11:10.401 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f6424b59640 1 -- 172.21.15.45:0/809157163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 msgr2=0x7f64200b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.402 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.397+0000 7f6424b59640 1 --2- 172.21.15.45:0/809157163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f64200b57c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6410009870 tx=0x7f641001c4b0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.402 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 -- 172.21.15.45:0/809157163 shutdown_connections 2023-07-09T02:11:10.402 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 --2- 172.21.15.45:0/809157163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 0x7f64200698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.402 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 --2- 172.21.15.45:0/809157163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f64200b57c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.402 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 -- 172.21.15.45:0/809157163 >> 172.21.15.45:0/809157163 conn(0x7f64200d3620 msgr2=0x7f64200cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:10.403 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 -- 172.21.15.45:0/809157163 shutdown_connections 2023-07-09T02:11:10.403 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 -- 172.21.15.45:0/809157163 wait complete. 2023-07-09T02:11:10.405 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 Processor -- start 2023-07-09T02:11:10.405 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 -- start start 2023-07-09T02:11:10.405 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 0x7f64200cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.405 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64200cebc0 0x7f642015d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.405 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f642015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.406 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64201529a0 con 0x7f642015c2d0 2023-07-09T02:11:10.406 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64200ca250 con 0x7f64200cebc0 2023-07-09T02:11:10.406 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6424b59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6420152100 con 0x7f64200694b0 2023-07-09T02:11:10.406 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f642015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.406 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f642015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43924/0 (socket says 172.21.15.45:43924) 2023-07-09T02:11:10.406 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641ed9d640 1 -- 172.21.15.45:0/3362522948 learned_addr learned my addr 172.21.15.45:0/3362522948 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:10.406 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641e59c640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 0x7f64200cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.407 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f6417fff640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64200cebc0 0x7f642015d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.407 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641ed9d640 1 -- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 msgr2=0x7f64200cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.407 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641ed9d640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 0x7f64200cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.407 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641ed9d640 1 -- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64200cebc0 msgr2=0x7f642015d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.407 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641ed9d640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64200cebc0 0x7f642015d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.407 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.401+0000 7f641ed9d640 1 -- 172.21.15.45:0/3362522948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100094d0 con 0x7f642015c2d0 2023-07-09T02:11:10.407 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f641ed9d640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f642015dd50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6418007e60 tx=0x7f641800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:10.408 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6416ffd640 1 -- 172.21.15.45:0/3362522948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418014420 con 0x7f642015c2d0 2023-07-09T02:11:10.408 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6416ffd640 1 -- 172.21.15.45:0/3362522948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64180145a0 con 0x7f642015c2d0 2023-07-09T02:11:10.409 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64201523e0 con 0x7f642015c2d0 2023-07-09T02:11:10.409 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6416ffd640 1 -- 172.21.15.45:0/3362522948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418014950 con 0x7f642015c2d0 2023-07-09T02:11:10.409 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64200ca4f0 con 0x7f642015c2d0 2023-07-09T02:11:10.409 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64200ca710 con 0x7f642015c2d0 2023-07-09T02:11:10.409 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6416ffd640 1 -- 172.21.15.45:0/3362522948 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6418014ab0 con 0x7f642015c2d0 2023-07-09T02:11:10.409 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6416ffd640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6400066280 0x7f6400068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.409 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f6416ffd640 1 -- 172.21.15.45:0/3362522948 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6418084110 con 0x7f642015c2d0 2023-07-09T02:11:10.410 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.405+0000 7f641e59c640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6400066280 0x7f6400068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.410 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.409+0000 7f641e59c640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6400066280 0x7f6400068730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64100ae000 tx=0x7f64100b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:10.413 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.413+0000 7f6416ffd640 1 -- 172.21.15.45:0/3362522948 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64180554e0 con 0x7f642015c2d0 2023-07-09T02:11:10.570 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6420066f00 con 0x7f642015c2d0 2023-07-09T02:11:10.571 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6416ffd640 1 -- 172.21.15.45:0/3362522948 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f6418055070 con 0x7f642015c2d0 2023-07-09T02:11:10.571 INFO:teuthology.misc.health.smithi045.stdout: 2023-07-09T02:11:10.571 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":17,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:09.093025+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:10.573 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6400066280 msgr2=0x7f6400068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.573 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6400066280 0x7f6400068730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64100ae000 tx=0x7f64100b5040 comp rx=0 tx=0).stop 2023-07-09T02:11:10.573 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 msgr2=0x7f642015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.573 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f642015dd50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6418007e60 tx=0x7f641800e4b0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.574 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 shutdown_connections 2023-07-09T02:11:10.574 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f642015c2d0 0x7f642015dd50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.574 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64200cebc0 0x7f642015d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.575 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6400066280 0x7f6400068730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.575 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 --2- 172.21.15.45:0/3362522948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64200694b0 0x7f64200cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.575 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 >> 172.21.15.45:0/3362522948 conn(0x7f64200d3620 msgr2=0x7f64200b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:10.575 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 shutdown_connections 2023-07-09T02:11:10.576 INFO:teuthology.misc.health.smithi045.stderr:2023-07-09T02:11:10.569+0000 7f6424b59640 1 -- 172.21.15.45:0/3362522948 wait complete. 2023-07-09T02:11:10.591 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-09T02:11:10.591 INFO:tasks.ceph:Creating RBD pool 2023-07-09T02:11:10.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-09T02:11:10.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.729+0000 7fee9786d640 1 Processor -- start 2023-07-09T02:11:10.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee9786d640 1 -- start start 2023-07-09T02:11:10.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee9786d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee90158e30 0x7fee9006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee9786d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee900caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee9786d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900ccf80 con 0x7fee9006fd10 2023-07-09T02:11:10.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee9786d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900cd540 con 0x7fee90158e30 2023-07-09T02:11:10.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee9786d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee900c8fb0 con 0x7fee9006c820 2023-07-09T02:11:10.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee94e08640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fee9006fd10 0x7fee9006c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39078/0 (socket says 172.21.15.45:39078) 2023-07-09T02:11:10.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee94e08640 1 -- 172.21.15.45:0/3390461943 learned_addr learned my addr 172.21.15.45:0/3390461943 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:10.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee95e0a640 1 --2- 172.21.15.45:0/3390461943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee900caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee95609640 1 --2- 172.21.15.45:0/3390461943 >> v2:172.21.15.155:3300/0 conn(0x7fee90158e30 0x7fee9006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee87fff640 1 -- 172.21.15.45:0/3390461943 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707126924 0 0) 0x7fee900ccf80 con 0x7fee9006fd10 2023-07-09T02:11:10.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee87fff640 1 -- 172.21.15.45:0/3390461943 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee7c003530 con 0x7fee9006fd10 2023-07-09T02:11:10.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee95e0a640 1 -- 172.21.15.45:0/3390461943 >> v2:172.21.15.155:3300/0 conn(0x7fee90158e30 msgr2=0x7fee9006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:10.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee95e0a640 1 --2- 172.21.15.45:0/3390461943 >> v2:172.21.15.155:3300/0 conn(0x7fee90158e30 0x7fee9006f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee95e0a640 1 -- 172.21.15.45:0/3390461943 >> v1:172.21.15.45:6789/0 conn(0x7fee9006fd10 legacy=0x7fee9006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.733+0000 7fee95e0a640 1 -- 172.21.15.45:0/3390461943 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900cbad0 con 0x7fee9006c820 2023-07-09T02:11:10.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee95e0a640 1 --2- 172.21.15.45:0/3390461943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee900caec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fee88009d90 tx=0x7fee8801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=335b17e1f58e454e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:10.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee87fff640 1 -- 172.21.15.45:0/3390461943 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880a5970 con 0x7fee9006c820 2023-07-09T02:11:10.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee87fff640 1 -- 172.21.15.45:0/3390461943 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee880a5ad0 con 0x7fee9006c820 2023-07-09T02:11:10.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee87fff640 1 -- 172.21.15.45:0/3390461943 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee880a5e60 con 0x7fee9006c820 2023-07-09T02:11:10.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 -- 172.21.15.45:0/3390461943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 msgr2=0x7fee900caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 --2- 172.21.15.45:0/3390461943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee900caec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fee88009d90 tx=0x7fee8801c890 comp rx=0 tx=0).stop 2023-07-09T02:11:10.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 -- 172.21.15.45:0/3390461943 shutdown_connections 2023-07-09T02:11:10.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 --2- 172.21.15.45:0/3390461943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee900caec0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 --2- 172.21.15.45:0/3390461943 >> v2:172.21.15.155:3300/0 conn(0x7fee90158e30 0x7fee9006f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 -- 172.21.15.45:0/3390461943 >> 172.21.15.45:0/3390461943 conn(0x7fee900694b0 msgr2=0x7fee900698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:10.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 -- 172.21.15.45:0/3390461943 shutdown_connections 2023-07-09T02:11:10.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 -- 172.21.15.45:0/3390461943 wait complete. 2023-07-09T02:11:10.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.737+0000 7fee9786d640 1 Processor -- start 2023-07-09T02:11:10.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 -- start start 2023-07-09T02:11:10.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee9014c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9006fd10 0x7fee901441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee90158e30 0x7fee90149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee900b00f0 con 0x7fee9006fd10 2023-07-09T02:11:10.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9014cfd0 con 0x7fee90158e30 2023-07-09T02:11:10.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee900b0300 con 0x7fee9006c820 2023-07-09T02:11:10.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9006fd10 0x7fee901441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9006fd10 0x7fee901441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43938/0 (socket says 172.21.15.45:43938) 2023-07-09T02:11:10.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 -- 172.21.15.45:0/2563740909 learned_addr learned my addr 172.21.15.45:0/2563740909 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:10.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee95609640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee9014c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee95e0a640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee90158e30 0x7fee90149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 -- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 msgr2=0x7fee9014c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee9014c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 -- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee90158e30 msgr2=0x7fee90149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:10.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee90158e30 0x7fee90149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:10.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 -- 172.21.15.45:0/2563740909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88009a70 con 0x7fee9006fd10 2023-07-09T02:11:10.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee94e08640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9006fd10 0x7fee901441c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c4d0 tx=0x7fee8000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:10.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee85ffb640 1 -- 172.21.15.45:0/2563740909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80005cf0 con 0x7fee9006fd10 2023-07-09T02:11:10.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee85ffb640 1 -- 172.21.15.45:0/2563740909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee80005e50 con 0x7fee9006fd10 2023-07-09T02:11:10.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee85ffb640 1 -- 172.21.15.45:0/2563740909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80007270 con 0x7fee9006fd10 2023-07-09T02:11:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee900b05e0 con 0x7fee9006fd10 2023-07-09T02:11:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee900b0de0 con 0x7fee9006fd10 2023-07-09T02:11:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.741+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee900b0b00 con 0x7fee9006fd10 2023-07-09T02:11:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.745+0000 7fee85ffb640 1 -- 172.21.15.45:0/2563740909 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee800073d0 con 0x7fee9006fd10 2023-07-09T02:11:10.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.745+0000 7fee85ffb640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee74066280 0x7fee74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:10.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.745+0000 7fee85ffb640 1 -- 172.21.15.45:0/2563740909 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee80082e10 con 0x7fee9006fd10 2023-07-09T02:11:10.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.745+0000 7fee95609640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee74066280 0x7fee74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:10.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.745+0000 7fee95609640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee74066280 0x7fee74068730 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee90150900 tx=0x7fee8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:10.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.749+0000 7fee85ffb640 1 -- 172.21.15.45:0/2563740909 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee80086030 con 0x7fee9006fd10 2023-07-09T02:11:10.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:10.905+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fee9004d7d0 con 0x7fee9006fd10 2023-07-09T02:11:11.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.109+0000 7fee85ffb640 1 -- 172.21.15.45:0/2563740909 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fee800170a0 con 0x7fee9006fd10 2023-07-09T02:11:11.111 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'rbd' created 2023-07-09T02:11:11.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee74066280 msgr2=0x7fee74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:11.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee74066280 0x7fee74068730 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee90150900 tx=0x7fee8c008040 comp rx=0 tx=0).stop 2023-07-09T02:11:11.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9006fd10 msgr2=0x7fee901441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:11.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9006fd10 0x7fee901441c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c4d0 tx=0x7fee8000c990 comp rx=0 tx=0).stop 2023-07-09T02:11:11.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 shutdown_connections 2023-07-09T02:11:11.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee90158e30 0x7fee90149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee9006fd10 0x7fee901441c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee74066280 0x7fee74068730 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 --2- 172.21.15.45:0/2563740909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee9006c820 0x7fee9014c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 >> 172.21.15.45:0/2563740909 conn(0x7fee900694b0 msgr2=0x7fee900c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 shutdown_connections 2023-07-09T02:11:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.113+0000 7fee9786d640 1 -- 172.21.15.45:0/2563740909 wait complete. 2023-07-09T02:11:11.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-09T02:11:11.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.273+0000 7f6cace9e640 1 Processor -- start 2023-07-09T02:11:11.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.273+0000 7f6cace9e640 1 -- start start 2023-07-09T02:11:11.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6cace9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca815a830 0x7f6ca815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:11.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6cace9e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ca80adb10 0x7f6ca80b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:11.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6cace9e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80b35c0 con 0x7f6ca815b140 2023-07-09T02:11:11.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6cace9e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80b15d0 con 0x7f6ca80adb10 2023-07-09T02:11:11.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6cace9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b1890 con 0x7f6ca815a830 2023-07-09T02:11:11.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6c9ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6ca815b140 0x7f6ca80ca9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39090/0 (socket says 172.21.15.45:39090) 2023-07-09T02:11:11.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6c9ffff640 1 -- 172.21.15.45:0/4237783 learned_addr learned my addr 172.21.15.45:0/4237783 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca659c640 1 --2- 172.21.15.45:0/4237783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca815a830 0x7f6ca815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca6d9d640 1 --2- 172.21.15.45:0/4237783 >> v2:172.21.15.155:3300/0 conn(0x7f6ca80adb10 0x7f6ca80b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca5d9b640 1 -- 172.21.15.45:0/4237783 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939671212 0 0) 0x7f6ca80b35c0 con 0x7f6ca815b140 2023-07-09T02:11:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca5d9b640 1 -- 172.21.15.45:0/4237783 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c94003530 con 0x7f6ca815b140 2023-07-09T02:11:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca659c640 1 -- 172.21.15.45:0/4237783 >> v2:172.21.15.155:3300/0 conn(0x7f6ca80adb10 msgr2=0x7f6ca80b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca659c640 1 --2- 172.21.15.45:0/4237783 >> v2:172.21.15.155:3300/0 conn(0x7f6ca80adb10 0x7f6ca80b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca659c640 1 -- 172.21.15.45:0/4237783 >> v1:172.21.15.45:6789/0 conn(0x7f6ca815b140 legacy=0x7f6ca80ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca659c640 1 -- 172.21.15.45:0/4237783 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80b3250 con 0x7f6ca815a830 2023-07-09T02:11:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.277+0000 7f6ca6d9d640 1 --2- 172.21.15.45:0/4237783 >> v2:172.21.15.155:3300/0 conn(0x7f6ca80adb10 0x7f6ca80b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:11.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6ca659c640 1 --2- 172.21.15.45:0/4237783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca815a830 0x7f6ca815ac00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c980097c0 tx=0x7f6c9801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84cd8f5013c3b0e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:11.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6ca5d9b640 1 -- 172.21.15.45:0/4237783 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980ab600 con 0x7f6ca815a830 2023-07-09T02:11:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6ca5d9b640 1 -- 172.21.15.45:0/4237783 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c980a7050 con 0x7f6ca815a830 2023-07-09T02:11:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6ca5d9b640 1 -- 172.21.15.45:0/4237783 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980ab980 con 0x7f6ca815a830 2023-07-09T02:11:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 -- 172.21.15.45:0/4237783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca815a830 msgr2=0x7f6ca815ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:11.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 --2- 172.21.15.45:0/4237783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca815a830 0x7f6ca815ac00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c980097c0 tx=0x7f6c9801c480 comp rx=0 tx=0).stop 2023-07-09T02:11:11.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 -- 172.21.15.45:0/4237783 shutdown_connections 2023-07-09T02:11:11.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 --2- 172.21.15.45:0/4237783 >> v2:172.21.15.155:3300/0 conn(0x7f6ca80adb10 0x7f6ca80b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 --2- 172.21.15.45:0/4237783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca815a830 0x7f6ca815ac00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 -- 172.21.15.45:0/4237783 >> 172.21.15.45:0/4237783 conn(0x7f6ca806ae60 msgr2=0x7f6ca806b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:11.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 -- 172.21.15.45:0/4237783 shutdown_connections 2023-07-09T02:11:11.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 -- 172.21.15.45:0/4237783 wait complete. 2023-07-09T02:11:11.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 Processor -- start 2023-07-09T02:11:11.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.281+0000 7f6cace9e640 1 -- start start 2023-07-09T02:11:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca80adb10 0x7f6ca8152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca815a830 0x7f6ca80ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:11.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ca815b140 0x7f6ca80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:11.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8071a70 con 0x7f6ca815a830 2023-07-09T02:11:11.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80714b0 con 0x7f6ca815b140 2023-07-09T02:11:11.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8071790 con 0x7f6ca80adb10 2023-07-09T02:11:11.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca815a830 0x7f6ca80ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:11.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca815a830 0x7f6ca80ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43954/0 (socket says 172.21.15.45:43954) 2023-07-09T02:11:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 -- 172.21.15.45:0/1885269440 learned_addr learned my addr 172.21.15.45:0/1885269440 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6ca659c640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca80adb10 0x7f6ca8152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6ca6d9d640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ca815b140 0x7f6ca80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 -- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca80adb10 msgr2=0x7f6ca8152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca80adb10 0x7f6ca8152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 -- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ca815b140 msgr2=0x7f6ca80acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ca815b140 0x7f6ca80acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:11.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 -- 172.21.15.45:0/1885269440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0009a70 con 0x7f6ca815a830 2023-07-09T02:11:11.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6ca6d9d640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ca815b140 0x7f6ca80acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:11.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9ffff640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca815a830 0x7f6ca80ac870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000c400 tx=0x7f6c9000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:11.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9effd640 1 -- 172.21.15.45:0/1885269440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90005cf0 con 0x7f6ca815a830 2023-07-09T02:11:11.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9effd640 1 -- 172.21.15.45:0/1885269440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90005e50 con 0x7f6ca815a830 2023-07-09T02:11:11.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9effd640 1 -- 172.21.15.45:0/1885269440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900072d0 con 0x7f6ca815a830 2023-07-09T02:11:11.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98009420 con 0x7f6ca815a830 2023-07-09T02:11:11.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca80cc5e0 con 0x7f6ca815a830 2023-07-09T02:11:11.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca80cc800 con 0x7f6ca815a830 2023-07-09T02:11:11.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.285+0000 7f6c9effd640 1 -- 172.21.15.45:0/1885269440 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c90007470 con 0x7f6ca815a830 2023-07-09T02:11:11.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.289+0000 7f6c9effd640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c88066280 0x7f6c88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:11.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.289+0000 7f6c9effd640 1 -- 172.21.15.45:0/1885269440 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f6c90082c40 con 0x7f6ca815a830 2023-07-09T02:11:11.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.289+0000 7f6ca659c640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c88066280 0x7f6c88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:11.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.289+0000 7f6ca659c640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c88066280 0x7f6c88068730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c980ad000 tx=0x7f6c980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.293+0000 7f6c9effd640 1 -- 172.21.15.45:0/1885269440 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c90050470 con 0x7f6ca815a830 2023-07-09T02:11:11.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:11.449+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6ca804d7d0 con 0x7f6ca815a830 2023-07-09T02:11:12.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.113+0000 7f6c9effd640 1 -- 172.21.15.45:0/1885269440 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6c90053a90 con 0x7f6ca815a830 2023-07-09T02:11:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-09T02:11:12.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c88066280 msgr2=0x7f6c88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c88066280 0x7f6c88068730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c980ad000 tx=0x7f6c980a6000 comp rx=0 tx=0).stop 2023-07-09T02:11:12.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca815a830 msgr2=0x7f6ca80ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca815a830 0x7f6ca80ac870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000c400 tx=0x7f6c9000c8c0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 shutdown_connections 2023-07-09T02:11:12.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ca815b140 0x7f6ca80acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ca815a830 0x7f6ca80ac870 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c88066280 0x7f6c88068730 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 --2- 172.21.15.45:0/1885269440 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ca80adb10 0x7f6ca8152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 >> 172.21.15.45:0/1885269440 conn(0x7f6ca806ae60 msgr2=0x7f6ca81599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 shutdown_connections 2023-07-09T02:11:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.117+0000 7f6cace9e640 1 -- 172.21.15.45:0/1885269440 wait complete. 2023-07-09T02:11:12.142 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-09T02:11:12.143 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:11:12.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:11:12.147 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:11:12.149 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:11:12.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:11:12.153 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:11:12.154 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:11:12.154 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:11:12.158 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:11:12.158 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:11:12.159 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:11:12.162 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:11:12.162 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-09T02:11:12.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:12.246 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:11:12.246 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:11:12.266 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:11:12.267 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:11:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bfa0b640 1 Processor -- start 2023-07-09T02:11:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bfa0b640 1 -- start start 2023-07-09T02:11:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bfa0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48b80d2620 0x7f48b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bfa0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48b80cd120 0x7f48b80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bfa0b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b8160a50 con 0x7f48b815c060 2023-07-09T02:11:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bfa0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b815c430 con 0x7f48b80d2620 2023-07-09T02:11:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bfa0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b815fb60 con 0x7f48b80cd120 2023-07-09T02:11:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bd7a7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f48b815c060 0x7f48b80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51876/0 (socket says 172.21.15.45:51876) 2023-07-09T02:11:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bd7a7640 1 -- 172.21.15.45:0/335362146 learned_addr learned my addr 172.21.15.45:0/335362146 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.313+0000 7f48bcfa6640 1 --2- 172.21.15.45:0/335362146 >> v2:172.21.15.45:3300/0 conn(0x7f48b80d2620 0x7f48b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48bdfa8640 1 --2- 172.21.15.45:0/335362146 >> v2:172.21.15.155:3300/0 conn(0x7f48b80cd120 0x7f48b80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48bcfa6640 1 -- 172.21.15.45:0/335362146 >> v2:172.21.15.155:3300/0 conn(0x7f48b80cd120 msgr2=0x7f48b80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48bcfa6640 1 --2- 172.21.15.45:0/335362146 >> v2:172.21.15.155:3300/0 conn(0x7f48b80cd120 0x7f48b80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48bcfa6640 1 -- 172.21.15.45:0/335362146 >> v1:172.21.15.45:6789/0 conn(0x7f48b815c060 legacy=0x7f48b80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48affff640 1 -- 172.21.15.45:0/335362146 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913173042 0 0) 0x7f48b8160a50 con 0x7f48b815c060 2023-07-09T02:11:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48bcfa6640 1 -- 172.21.15.45:0/335362146 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b815fe40 con 0x7f48b80d2620 2023-07-09T02:11:12.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48bcfa6640 1 --2- 172.21.15.45:0/335362146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b80d2620 0x7f48b80b4ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48b806b120 tx=0x7f48a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb67e587768010cd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48affff640 1 -- 172.21.15.45:0/335362146 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80a7070 con 0x7f48b80d2620 2023-07-09T02:11:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48affff640 1 -- 172.21.15.45:0/335362146 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a80ab430 con 0x7f48b80d2620 2023-07-09T02:11:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48affff640 1 -- 172.21.15.45:0/335362146 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a80ab7c0 con 0x7f48b80d2620 2023-07-09T02:11:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48bfa0b640 1 -- 172.21.15.45:0/335362146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b80d2620 msgr2=0x7f48b80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.317+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/335362146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b80d2620 0x7f48b80b4ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48b806b120 tx=0x7f48a801c430 comp rx=0 tx=0).stop 2023-07-09T02:11:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 -- 172.21.15.45:0/335362146 shutdown_connections 2023-07-09T02:11:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/335362146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b80d2620 0x7f48b80b4ed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/335362146 >> v2:172.21.15.155:3300/0 conn(0x7f48b80cd120 0x7f48b80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 -- 172.21.15.45:0/335362146 >> 172.21.15.45:0/335362146 conn(0x7f48b80698e0 msgr2=0x7f48b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 -- 172.21.15.45:0/335362146 shutdown_connections 2023-07-09T02:11:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 -- 172.21.15.45:0/335362146 wait complete. 2023-07-09T02:11:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 Processor -- start 2023-07-09T02:11:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 -- start start 2023-07-09T02:11:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48b80cd120 0x7f48b8154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48b80d2620 0x7f48b8156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b815c060 0x7f48b8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b81550e0 con 0x7f48b815c060 2023-07-09T02:11:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80cb1e0 con 0x7f48b80d2620 2023-07-09T02:11:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bfa0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80cb4c0 con 0x7f48b80cd120 2023-07-09T02:11:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b815c060 0x7f48b8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b815c060 0x7f48b8156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40134/0 (socket says 172.21.15.45:40134) 2023-07-09T02:11:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 -- 172.21.15.45:0/3392809157 learned_addr learned my addr 172.21.15.45:0/3392809157 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bcfa6640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48b80d2620 0x7f48b8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bd7a7640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48b80cd120 0x7f48b8154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 -- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48b80cd120 msgr2=0x7f48b8154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48b80cd120 0x7f48b8154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 -- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48b80d2620 msgr2=0x7f48b8156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48b80d2620 0x7f48b8156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 -- 172.21.15.45:0/3392809157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8009420 con 0x7f48b815c060 2023-07-09T02:11:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bd7a7640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48b80cd120 0x7f48b8154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.321+0000 7f48bdfa8640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b815c060 0x7f48b8156b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f48b000efc0 tx=0x7f48b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48adffb640 1 -- 172.21.15.45:0/3392809157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0014480 con 0x7f48b815c060 2023-07-09T02:11:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48adffb640 1 -- 172.21.15.45:0/3392809157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b000f040 con 0x7f48b815c060 2023-07-09T02:11:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48adffb640 1 -- 172.21.15.45:0/3392809157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0014820 con 0x7f48b815c060 2023-07-09T02:11:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b80b59f0 con 0x7f48b815c060 2023-07-09T02:11:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b80cba80 con 0x7f48b815c060 2023-07-09T02:11:12.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b804d7d0 con 0x7f48b815c060 2023-07-09T02:11:12.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48adffb640 1 -- 172.21.15.45:0/3392809157 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48b0014980 con 0x7f48b815c060 2023-07-09T02:11:12.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48adffb640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f489c066280 0x7f489c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48adffb640 1 -- 172.21.15.45:0/3392809157 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f48b00845c0 con 0x7f48b815c060 2023-07-09T02:11:12.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.325+0000 7f48bd7a7640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f489c066280 0x7f489c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.329+0000 7f48bd7a7640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f489c066280 0x7f489c068730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f48b4000f70 tx=0x7f48b4007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.329+0000 7f48adffb640 1 -- 172.21.15.45:0/3392809157 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48b0051cf0 con 0x7f48b815c060 2023-07-09T02:11:12.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.485+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48b806baa0 con 0x7f48b815c060 2023-07-09T02:11:12.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.485+0000 7f48adffb640 1 -- 172.21.15.45:0/3392809157 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14649 (secure 0 0 0) 0x7f48b0055310 con 0x7f48b815c060 2023-07-09T02:11:12.488 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:12.488 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:12.110206+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:12.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f489c066280 msgr2=0x7f489c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f489c066280 0x7f489c068730 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f48b4000f70 tx=0x7f48b4007cb0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b815c060 msgr2=0x7f48b8156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b815c060 0x7f48b8156b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f48b000efc0 tx=0x7f48b000c490 comp rx=0 tx=0).stop 2023-07-09T02:11:12.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 shutdown_connections 2023-07-09T02:11:12.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48b815c060 0x7f48b8156b80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48b80d2620 0x7f48b8156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f489c066280 0x7f489c068730 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 --2- 172.21.15.45:0/3392809157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48b80cd120 0x7f48b8154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 >> 172.21.15.45:0/3392809157 conn(0x7f48b80698e0 msgr2=0x7f48b80b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 shutdown_connections 2023-07-09T02:11:12.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.489+0000 7f48bfa0b640 1 -- 172.21.15.45:0/3392809157 wait complete. 2023-07-09T02:11:12.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:12.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f337aa6d640 1 Processor -- start 2023-07-09T02:11:12.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f337aa6d640 1 -- start start 2023-07-09T02:11:12.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f337aa6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f337415c060 0x7f33740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f337aa6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740d2620 0x7f33740cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f337aa6d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3374160a50 con 0x7f33740cd120 2023-07-09T02:11:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f337aa6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337415c430 con 0x7f337415c060 2023-07-09T02:11:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f337aa6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337415fb60 con 0x7f33740d2620 2023-07-09T02:11:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f3378809640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f337415c060 0x7f33740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f3378809640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f337415c060 0x7f33740b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40150/0 (socket says 172.21.15.45:40150) 2023-07-09T02:11:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f3378809640 1 -- 172.21.15.45:0/2253813290 learned_addr learned my addr 172.21.15.45:0/2253813290 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f337900a640 1 --2- 172.21.15.45:0/2253813290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740d2620 0x7f33740cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f3378809640 1 -- 172.21.15.45:0/2253813290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740d2620 msgr2=0x7f33740cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:12.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f3378809640 1 --2- 172.21.15.45:0/2253813290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740d2620 0x7f33740cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f3378809640 1 -- 172.21.15.45:0/2253813290 >> v1:172.21.15.45:6789/0 conn(0x7f33740cd120 legacy=0x7f33740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.661+0000 7f3378809640 1 -- 172.21.15.45:0/2253813290 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337415fe40 con 0x7f337415c060 2023-07-09T02:11:12.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f3378809640 1 --2- 172.21.15.45:0/2253813290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f33740b4ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3368009870 tx=0x7f336801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627199dc96947fd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:12.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f33737fe640 1 -- 172.21.15.45:0/2253813290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680aa670 con 0x7f337415c060 2023-07-09T02:11:12.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f33737fe640 1 -- 172.21.15.45:0/2253813290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680aa7d0 con 0x7f337415c060 2023-07-09T02:11:12.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f33737fe640 1 -- 172.21.15.45:0/2253813290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680aab60 con 0x7f337415c060 2023-07-09T02:11:12.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f337aa6d640 1 -- 172.21.15.45:0/2253813290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 msgr2=0x7f33740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f337aa6d640 1 --2- 172.21.15.45:0/2253813290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f33740b4ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3368009870 tx=0x7f336801c510 comp rx=0 tx=0).stop 2023-07-09T02:11:12.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f337aa6d640 1 -- 172.21.15.45:0/2253813290 shutdown_connections 2023-07-09T02:11:12.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f337aa6d640 1 --2- 172.21.15.45:0/2253813290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740d2620 0x7f33740cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f337aa6d640 1 --2- 172.21.15.45:0/2253813290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f33740b4ed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f337aa6d640 1 -- 172.21.15.45:0/2253813290 >> 172.21.15.45:0/2253813290 conn(0x7f33740698e0 msgr2=0x7f3374069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:12.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f337aa6d640 1 -- 172.21.15.45:0/2253813290 shutdown_connections 2023-07-09T02:11:12.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.665+0000 7f337aa6d640 1 -- 172.21.15.45:0/2253813290 wait complete. 2023-07-09T02:11:12.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 Processor -- start 2023-07-09T02:11:12.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 -- start start 2023-07-09T02:11:12.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740cd120 0x7f33740ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33740d2620 0x7f3374153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f3374154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33740cb750 con 0x7f337415c060 2023-07-09T02:11:12.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33740cab40 con 0x7f33740d2620 2023-07-09T02:11:12.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33740cae20 con 0x7f33740cd120 2023-07-09T02:11:12.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f3374154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f3374154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40154/0 (socket says 172.21.15.45:40154) 2023-07-09T02:11:12.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 -- 172.21.15.45:0/1340600883 learned_addr learned my addr 172.21.15.45:0/1340600883 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:12.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f3378809640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740cd120 0x7f33740ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f3373fff640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33740d2620 0x7f3374153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 -- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740cd120 msgr2=0x7f33740ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740cd120 0x7f33740ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 -- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33740d2620 msgr2=0x7f3374153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33740d2620 0x7f3374153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 -- 172.21.15.45:0/1340600883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680094d0 con 0x7f337415c060 2023-07-09T02:11:12.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337900a640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f3374154c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f336c007e30 tx=0x7f336c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:12.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f33717fa640 1 -- 172.21.15.45:0/1340600883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c014420 con 0x7f337415c060 2023-07-09T02:11:12.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f33717fa640 1 -- 172.21.15.45:0/1340600883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c0145a0 con 0x7f337415c060 2023-07-09T02:11:12.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f33717fa640 1 -- 172.21.15.45:0/1340600883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c014950 con 0x7f337415c060 2023-07-09T02:11:12.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33740b59f0 con 0x7f337415c060 2023-07-09T02:11:12.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.669+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33740cb3e0 con 0x7f337415c060 2023-07-09T02:11:12.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.673+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337404d7d0 con 0x7f337415c060 2023-07-09T02:11:12.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.673+0000 7f33717fa640 1 -- 172.21.15.45:0/1340600883 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f336c014ab0 con 0x7f337415c060 2023-07-09T02:11:12.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.673+0000 7f33717fa640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3358066280 0x7f3358068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:12.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.673+0000 7f33717fa640 1 -- 172.21.15.45:0/1340600883 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f336c0841f0 con 0x7f337415c060 2023-07-09T02:11:12.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.673+0000 7f3378809640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3358066280 0x7f3358068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:12.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.673+0000 7f3378809640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3358066280 0x7f3358068730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f33680ae000 tx=0x7f33680b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:12.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.677+0000 7f33717fa640 1 -- 172.21.15.45:0/1340600883 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f336c051a60 con 0x7f337415c060 2023-07-09T02:11:12.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.829+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f337406baa0 con 0x7f337415c060 2023-07-09T02:11:12.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.829+0000 7f33717fa640 1 -- 172.21.15.45:0/1340600883 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f336c055080 con 0x7f337415c060 2023-07-09T02:11:12.833 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:12.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3358066280 msgr2=0x7f3358068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3358066280 0x7f3358068730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f33680ae000 tx=0x7f33680b5040 comp rx=0 tx=0).stop 2023-07-09T02:11:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 msgr2=0x7f3374154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f3374154c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f336c007e30 tx=0x7f336c00e4b0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 shutdown_connections 2023-07-09T02:11:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f337415c060 0x7f3374154c90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33740d2620 0x7f3374153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3358066280 0x7f3358068730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 --2- 172.21.15.45:0/1340600883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33740cd120 0x7f33740ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 >> 172.21.15.45:0/1340600883 conn(0x7f33740698e0 msgr2=0x7f3374069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 shutdown_connections 2023-07-09T02:11:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:12.833+0000 7f337aa6d640 1 -- 172.21.15.45:0/1340600883 wait complete. 2023-07-09T02:11:12.854 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:13.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58ee13a640 1 Processor -- start 2023-07-09T02:11:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58ee13a640 1 -- start start 2023-07-09T02:11:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58ee13a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e80cecf0 0x7f58e80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58ee13a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e8069e30 con 0x7f58e8142500 2023-07-09T02:11:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58ee13a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e80cf320 con 0x7f58e80699f0 2023-07-09T02:11:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58ee13a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80cf140 con 0x7f58e80cecf0 2023-07-09T02:11:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f58e8142500 0x7f58e8160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51902/0 (socket says 172.21.15.45:51902) 2023-07-09T02:11:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e77fe640 1 -- 172.21.15.45:0/2767366668 learned_addr learned my addr 172.21.15.45:0/2767366668 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e6ffd640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e80cecf0 0x7f58e80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589052854 0 0) 0x7f58e8069e30 con 0x7f58e8142500 2023-07-09T02:11:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d0003530 con 0x7f58e8142500 2023-07-09T02:11:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 828720763 0 0) 0x7f58d0003530 con 0x7f58e8142500 2023-07-09T02:11:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e80cecf0 msgr2=0x7f58e80694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e80cecf0 0x7f58e80694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 >> v1:172.21.15.155:6789/0 conn(0x7f58e80699f0 legacy=0x7f58e80cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e815d590 con 0x7f58e8142500 2023-07-09T02:11:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f58d8001680 con 0x7f58e8142500 2023-07-09T02:11:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 >> v1:172.21.15.45:6789/0 conn(0x7f58e8142500 legacy=0x7f58e8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d00039b0 0x7f58d0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e80cecf0 0x7f58d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80cf140 con 0x7f58d0004d10 2023-07-09T02:11:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d000b990 con 0x7f58d00039b0 2023-07-09T02:11:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d000bb50 con 0x7f58e80cecf0 2023-07-09T02:11:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e7fff640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e6ffd640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e80cecf0 0x7f58d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e77fe640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d00039b0 0x7f58d0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e7fff640 1 -- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e80cecf0 msgr2=0x7f58d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:13.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e7fff640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e80cecf0 0x7f58d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e7fff640 1 -- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d00039b0 msgr2=0x7f58d0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:13.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e7fff640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58d00039b0 0x7f58d0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.001+0000 7f58e7fff640 1 -- 172.21.15.45:0/2767366668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0003530 con 0x7f58d0004d10 2023-07-09T02:11:13.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58e7fff640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58d0005180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f58e0002010 tx=0x7f58e001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33bd8156ee34259 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8007ea0 con 0x7f58d0004d10 2023-07-09T02:11:13.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e00a57d0 con 0x7f58d0004d10 2023-07-09T02:11:13.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58e67fc640 1 -- 172.21.15.45:0/2767366668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00a5b80 con 0x7f58d0004d10 2023-07-09T02:11:13.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58ee13a640 1 -- 172.21.15.45:0/2767366668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 msgr2=0x7f58d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58ee13a640 1 --2- 172.21.15.45:0/2767366668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58d0005180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f58e0002010 tx=0x7f58e001c8c0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58e7fff640 1 -- 172.21.15.45:0/2767366668 reap_dead start 2023-07-09T02:11:13.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58ee13a640 1 -- 172.21.15.45:0/2767366668 shutdown_connections 2023-07-09T02:11:13.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58ee13a640 1 -- 172.21.15.45:0/2767366668 >> 172.21.15.45:0/2767366668 conn(0x7f58e80650b0 msgr2=0x7f58e80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:13.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58ee13a640 1 -- 172.21.15.45:0/2767366668 shutdown_connections 2023-07-09T02:11:13.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.005+0000 7f58ee13a640 1 -- 172.21.15.45:0/2767366668 wait complete. 2023-07-09T02:11:13.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 Processor -- start 2023-07-09T02:11:13.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 -- start start 2023-07-09T02:11:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58e80c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e81f9820 0x7f58e80c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e80c5ca0 0x7f58e81f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e81409a0 con 0x7f58d0004d10 2023-07-09T02:11:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e81f9220 con 0x7f58e80c5ca0 2023-07-09T02:11:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80c6110 con 0x7f58e81f9820 2023-07-09T02:11:13.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58e80c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58e80c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40172/0 (socket says 172.21.15.45:40172) 2023-07-09T02:11:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 -- 172.21.15.45:0/3160786085 learned_addr learned my addr 172.21.15.45:0/3160786085 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e6ffd640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e81f9820 0x7f58e80c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e7fff640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e80c5ca0 0x7f58e81f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 -- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e81f9820 msgr2=0x7f58e80c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e81f9820 0x7f58e80c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 -- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e80c5ca0 msgr2=0x7f58e81f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e80c5ca0 0x7f58e81f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 -- 172.21.15.45:0/3160786085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e81f6860 con 0x7f58d0004d10 2023-07-09T02:11:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58e77fe640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58e80c6890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f58d80124c0 tx=0x7f58d8012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58cffff640 1 -- 172.21.15.45:0/3160786085 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8014750 con 0x7f58d0004d10 2023-07-09T02:11:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58cffff640 1 -- 172.21.15.45:0/3160786085 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d80148b0 con 0x7f58d0004d10 2023-07-09T02:11:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e81f6580 con 0x7f58d0004d10 2023-07-09T02:11:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58cffff640 1 -- 172.21.15.45:0/3160786085 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8014c60 con 0x7f58d0004d10 2023-07-09T02:11:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.009+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e81405c0 con 0x7f58d0004d10 2023-07-09T02:11:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.013+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e804d7d0 con 0x7f58d0004d10 2023-07-09T02:11:13.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.013+0000 7f58cffff640 1 -- 172.21.15.45:0/3160786085 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58d80153e0 con 0x7f58d0004d10 2023-07-09T02:11:13.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.013+0000 7f58cffff640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58d4066280 0x7f58d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.013+0000 7f58cffff640 1 -- 172.21.15.45:0/3160786085 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f58d8086500 con 0x7f58d0004d10 2023-07-09T02:11:13.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.013+0000 7f58e6ffd640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58d4066280 0x7f58d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.013+0000 7f58e6ffd640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58d4066280 0x7f58d4068730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f58e813f170 tx=0x7f58dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.017+0000 7f58cffff640 1 -- 172.21.15.45:0/3160786085 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58d8057750 con 0x7f58d0004d10 2023-07-09T02:11:13.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f58e806c250 con 0x7f58d0004d10 2023-07-09T02:11:13.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58cffff640 1 -- 172.21.15.45:0/3160786085 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f58d80572e0 con 0x7f58d0004d10 2023-07-09T02:11:13.176 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:13.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58d4066280 msgr2=0x7f58d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58d4066280 0x7f58d4068730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f58e813f170 tx=0x7f58dc008040 comp rx=0 tx=0).stop 2023-07-09T02:11:13.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 msgr2=0x7f58e80c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58e80c6890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f58d80124c0 tx=0x7f58d8012980 comp rx=0 tx=0).stop 2023-07-09T02:11:13.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 shutdown_connections 2023-07-09T02:11:13.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58e80c5ca0 0x7f58e81f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58d4066280 0x7f58d4068730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58e81f9820 0x7f58e80c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 --2- 172.21.15.45:0/3160786085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58d0004d10 0x7f58e80c6890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 >> 172.21.15.45:0/3160786085 conn(0x7f58e80650b0 msgr2=0x7f58e8070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:13.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 shutdown_connections 2023-07-09T02:11:13.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.173+0000 7f58ee13a640 1 -- 172.21.15.45:0/3160786085 wait complete. 2023-07-09T02:11:13.196 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:11:13.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.337+0000 7f1ff2b40640 1 Processor -- start 2023-07-09T02:11:13.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.337+0000 7f1ff2b40640 1 -- start start 2023-07-09T02:11:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.337+0000 7f1ff2b40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1fec15c060 0x7f1fec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.337+0000 7f1ff2b40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.337+0000 7f1ff2b40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec160a50 con 0x7f1fec0d2450 2023-07-09T02:11:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.337+0000 7f1ff2b40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec0d28f0 con 0x7f1fec15c060 2023-07-09T02:11:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.337+0000 7f1ff2b40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0cfe40 con 0x7f1fec0cd120 2023-07-09T02:11:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1febfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1febfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:34212/0 (socket says 172.21.15.45:34212) 2023-07-09T02:11:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1febfff640 1 -- 172.21.15.45:0/255863254 learned_addr learned my addr 172.21.15.45:0/255863254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1ff08dc640 1 --2- 172.21.15.45:0/255863254 >> v2:172.21.15.155:3300/0 conn(0x7f1fec15c060 0x7f1fec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1febfff640 1 -- 172.21.15.45:0/255863254 >> v2:172.21.15.155:3300/0 conn(0x7f1fec15c060 msgr2=0x7f1fec0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1febfff640 1 --2- 172.21.15.45:0/255863254 >> v2:172.21.15.155:3300/0 conn(0x7f1fec15c060 0x7f1fec0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1febfff640 1 -- 172.21.15.45:0/255863254 >> v1:172.21.15.155:6789/0 conn(0x7f1fec0d2450 legacy=0x7f1fec0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1febfff640 1 -- 172.21.15.45:0/255863254 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec15c430 con 0x7f1fec0cd120 2023-07-09T02:11:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.341+0000 7f1febfff640 1 --2- 172.21.15.45:0/255863254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec0d1f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009870 tx=0x7f1fd801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ffa0585ef5218b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1feb7fe640 1 -- 172.21.15.45:0/255863254 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80a7070 con 0x7f1fec0cd120 2023-07-09T02:11:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1feb7fe640 1 -- 172.21.15.45:0/255863254 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd80ab430 con 0x7f1fec0cd120 2023-07-09T02:11:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1feb7fe640 1 -- 172.21.15.45:0/255863254 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80ab7c0 con 0x7f1fec0cd120 2023-07-09T02:11:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- 172.21.15.45:0/255863254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 msgr2=0x7f1fec0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/255863254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec0d1f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009870 tx=0x7f1fd801c510 comp rx=0 tx=0).stop 2023-07-09T02:11:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- 172.21.15.45:0/255863254 shutdown_connections 2023-07-09T02:11:13.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/255863254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec0d1f10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/255863254 >> v2:172.21.15.155:3300/0 conn(0x7f1fec15c060 0x7f1fec0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- 172.21.15.45:0/255863254 >> 172.21.15.45:0/255863254 conn(0x7f1fec0698e0 msgr2=0x7f1fec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- 172.21.15.45:0/255863254 shutdown_connections 2023-07-09T02:11:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- 172.21.15.45:0/255863254 wait complete. 2023-07-09T02:11:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 Processor -- start 2023-07-09T02:11:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- start start 2023-07-09T02:11:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec0d2450 0x7f1fec153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec15c060 0x7f1fec157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1527f0 con 0x7f1fec0d2450 2023-07-09T02:11:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec152ad0 con 0x7f1fec15c060 2023-07-09T02:11:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff2b40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec152db0 con 0x7f1fec0cd120 2023-07-09T02:11:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1febfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec0d2450 0x7f1fec153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1febfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec0d2450 0x7f1fec153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40178/0 (socket says 172.21.15.45:40178) 2023-07-09T02:11:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1febfff640 1 -- 172.21.15.45:0/4124213159 learned_addr learned my addr 172.21.15.45:0/4124213159 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff08dc640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.345+0000 7f1ff10dd640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec15c060 0x7f1fec157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1febfff640 1 -- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 msgr2=0x7f1fec152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1febfff640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1febfff640 1 -- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec15c060 msgr2=0x7f1fec157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1febfff640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec15c060 0x7f1fec157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1febfff640 1 -- 172.21.15.45:0/4124213159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80094d0 con 0x7f1fec0d2450 2023-07-09T02:11:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1febfff640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec0d2450 0x7f1fec153890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80ad040 tx=0x7f1fd80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1fe97fa640 1 -- 172.21.15.45:0/4124213159 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80bc070 con 0x7f1fec0d2450 2023-07-09T02:11:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1fe97fa640 1 -- 172.21.15.45:0/4124213159 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd80b4420 con 0x7f1fec0d2450 2023-07-09T02:11:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1fe97fa640 1 -- 172.21.15.45:0/4124213159 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80b47f0 con 0x7f1fec0d2450 2023-07-09T02:11:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec153090 con 0x7f1fec0d2450 2023-07-09T02:11:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec152570 con 0x7f1fec0d2450 2023-07-09T02:11:13.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec04d7d0 con 0x7f1fec0d2450 2023-07-09T02:11:13.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1fe97fa640 1 -- 172.21.15.45:0/4124213159 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1fd80b4950 con 0x7f1fec0d2450 2023-07-09T02:11:13.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1fe97fa640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd0066280 0x7f1fd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1fe97fa640 1 -- 172.21.15.45:0/4124213159 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1fd811d2c0 con 0x7f1fec0d2450 2023-07-09T02:11:13.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.349+0000 7f1ff08dc640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd0066280 0x7f1fd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.353+0000 7f1ff08dc640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd0066280 0x7f1fd0068730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0cb1b0 tx=0x7f1fe0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.353+0000 7f1fe97fa640 1 -- 172.21.15.45:0/4124213159 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fd80eab30 con 0x7f1fec0d2450 2023-07-09T02:11:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.545+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fec0d08a0 con 0x7f1fec0d2450 2023-07-09T02:11:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.545+0000 7f1fe97fa640 1 -- 172.21.15.45:0/4124213159 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f1fd80ee150 con 0x7f1fec0d2450 2023-07-09T02:11:13.548 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:13.548 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-09T02:11:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-07-09T02:11:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd0066280 msgr2=0x7f1fd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd0066280 0x7f1fd0068730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0cb1b0 tx=0x7f1fe0009190 comp rx=0 tx=0).stop 2023-07-09T02:11:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec0d2450 msgr2=0x7f1fec153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec0d2450 0x7f1fec153890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80ad040 tx=0x7f1fd80192b0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 shutdown_connections 2023-07-09T02:11:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fec15c060 0x7f1fec157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fec0d2450 0x7f1fec153890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd0066280 0x7f1fd0068730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 --2- 172.21.15.45:0/4124213159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fec0cd120 0x7f1fec152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 >> 172.21.15.45:0/4124213159 conn(0x7f1fec0698e0 msgr2=0x7f1fec0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 shutdown_connections 2023-07-09T02:11:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.549+0000 7f1ff2b40640 1 -- 172.21.15.45:0/4124213159 wait complete. 2023-07-09T02:11:13.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:13.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.709+0000 7fe11fffa640 1 Processor -- start 2023-07-09T02:11:13.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.709+0000 7fe11fffa640 1 -- start start 2023-07-09T02:11:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.709+0000 7fe11fffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 0x7fe1180b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.709+0000 7fe11fffa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1180cd120 0x7fe1180cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.709+0000 7fe11fffa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118160a50 con 0x7fe11815c060 2023-07-09T02:11:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.709+0000 7fe11fffa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11815c430 con 0x7fe1180cd120 2023-07-09T02:11:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.709+0000 7fe11fffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11815fb60 con 0x7fe1180d2620 2023-07-09T02:11:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.709+0000 7fe11e597640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1180cd120 0x7fe1180cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11e597640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1180cd120 0x7fe1180cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40186/0 (socket says 172.21.15.45:40186) 2023-07-09T02:11:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11e597640 1 -- 172.21.15.45:0/4074645207 learned_addr learned my addr 172.21.15.45:0/4074645207 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11d595640 1 --2- 172.21.15.45:0/4074645207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 0x7fe1180b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11e597640 1 -- 172.21.15.45:0/4074645207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 msgr2=0x7fe1180b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11e597640 1 --2- 172.21.15.45:0/4074645207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 0x7fe1180b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11e597640 1 -- 172.21.15.45:0/4074645207 >> v1:172.21.15.155:6789/0 conn(0x7fe11815c060 legacy=0x7fe1180d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11e597640 1 -- 172.21.15.45:0/4074645207 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11815fe40 con 0x7fe1180cd120 2023-07-09T02:11:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11e597640 1 --2- 172.21.15.45:0/4074645207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cee30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe110009e50 tx=0x7fe11001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2448d1d9406f5c3e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11cd94640 1 -- 172.21.15.45:0/4074645207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a58a0 con 0x7fe1180cd120 2023-07-09T02:11:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11cd94640 1 -- 172.21.15.45:0/4074645207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100a5a00 con 0x7fe1180cd120 2023-07-09T02:11:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.713+0000 7fe11cd94640 1 -- 172.21.15.45:0/4074645207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a5d90 con 0x7fe1180cd120 2023-07-09T02:11:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- 172.21.15.45:0/4074645207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 msgr2=0x7fe1180cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 --2- 172.21.15.45:0/4074645207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cee30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe110009e50 tx=0x7fe11001c9e0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- 172.21.15.45:0/4074645207 shutdown_connections 2023-07-09T02:11:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 --2- 172.21.15.45:0/4074645207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cee30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 --2- 172.21.15.45:0/4074645207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 0x7fe1180b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- 172.21.15.45:0/4074645207 >> 172.21.15.45:0/4074645207 conn(0x7fe1180698e0 msgr2=0x7fe118069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- 172.21.15.45:0/4074645207 shutdown_connections 2023-07-09T02:11:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- 172.21.15.45:0/4074645207 wait complete. 2023-07-09T02:11:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 Processor -- start 2023-07-09T02:11:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- start start 2023-07-09T02:11:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 0x7fe118154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815c060 0x7fe1180cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180cb0f0 con 0x7fe1180cd120 2023-07-09T02:11:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180c9b10 con 0x7fe11815c060 2023-07-09T02:11:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11fffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180c9df0 con 0x7fe1180d2620 2023-07-09T02:11:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11dd96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11dd96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40188/0 (socket says 172.21.15.45:40188) 2023-07-09T02:11:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11dd96640 1 -- 172.21.15.45:0/3800669575 learned_addr learned my addr 172.21.15.45:0/3800669575 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11d595640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 0x7fe118154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.717+0000 7fe11e597640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815c060 0x7fe1180cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11dd96640 1 -- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 msgr2=0x7fe118154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11dd96640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 0x7fe118154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11dd96640 1 -- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815c060 msgr2=0x7fe1180cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11dd96640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815c060 0x7fe1180cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11dd96640 1 -- 172.21.15.45:0/3800669575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009b30 con 0x7fe1180cd120 2023-07-09T02:11:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11dd96640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cabb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c3c0 tx=0x7fe11400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe10e7fc640 1 -- 172.21.15.45:0/3800669575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140052d0 con 0x7fe1180cd120 2023-07-09T02:11:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe10e7fc640 1 -- 172.21.15.45:0/3800669575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114005430 con 0x7fe1180cd120 2023-07-09T02:11:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe10e7fc640 1 -- 172.21.15.45:0/3800669575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114003840 con 0x7fe1180cd120 2023-07-09T02:11:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1180b59f0 con 0x7fe1180cd120 2023-07-09T02:11:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1180ca3b0 con 0x7fe1180cd120 2023-07-09T02:11:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1180cef70 con 0x7fe1180cd120 2023-07-09T02:11:13.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe10e7fc640 1 -- 172.21.15.45:0/3800669575 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1140039a0 con 0x7fe1180cd120 2023-07-09T02:11:13.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe10e7fc640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0fc066280 0x7fe0fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:13.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.721+0000 7fe10e7fc640 1 -- 172.21.15.45:0/3800669575 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe114082f00 con 0x7fe1180cd120 2023-07-09T02:11:13.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.725+0000 7fe11d595640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0fc066280 0x7fe0fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:13.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.725+0000 7fe11d595640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0fc066280 0x7fe0fc068730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe1181575b0 tx=0x7fe108008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:13.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.725+0000 7fe10e7fc640 1 -- 172.21.15.45:0/3800669575 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1140506e0 con 0x7fe1180cd120 2023-07-09T02:11:13.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe11804d7d0 con 0x7fe1180cd120 2023-07-09T02:11:13.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe10e7fc640 1 -- 172.21.15.45:0/3800669575 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14636 (secure 0 0 0) 0x7fe114053d00 con 0x7fe1180cd120 2023-07-09T02:11:13.888 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:13.888 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:13.117013+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0fc066280 msgr2=0x7fe0fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0fc066280 0x7fe0fc068730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe1181575b0 tx=0x7fe108008040 comp rx=0 tx=0).stop 2023-07-09T02:11:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 msgr2=0x7fe1180cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cabb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe11400c3c0 tx=0x7fe11400c880 comp rx=0 tx=0).stop 2023-07-09T02:11:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 shutdown_connections 2023-07-09T02:11:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe11815c060 0x7fe1180cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0fc066280 0x7fe0fc068730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1180d2620 0x7fe118154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 --2- 172.21.15.45:0/3800669575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1180cd120 0x7fe1180cabb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 >> 172.21.15.45:0/3800669575 conn(0x7fe1180698e0 msgr2=0x7fe1180b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 shutdown_connections 2023-07-09T02:11:13.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:13.885+0000 7fe11fffa640 1 -- 172.21.15.45:0/3800669575 wait complete. 2023-07-09T02:11:13.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:13.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.053+0000 7f7ea9a93640 1 Processor -- start 2023-07-09T02:11:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.053+0000 7f7ea9a93640 1 -- start start 2023-07-09T02:11:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea9a93640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ea40cd120 0x7f7ea40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea9a93640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea4160a50 con 0x7f7ea415c060 2023-07-09T02:11:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea9a93640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea415c430 con 0x7f7ea40d2620 2023-07-09T02:11:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea9a93640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea415fb60 con 0x7f7ea40cd120 2023-07-09T02:11:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7ea415c060 0x7f7ea40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51910/0 (socket says 172.21.15.45:51910) 2023-07-09T02:11:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea37fe640 1 -- 172.21.15.45:0/1016650325 learned_addr learned my addr 172.21.15.45:0/1016650325 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea3fff640 1 --2- 172.21.15.45:0/1016650325 >> v2:172.21.15.45:3300/0 conn(0x7f7ea40cd120 0x7f7ea40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea27fc640 1 -- 172.21.15.45:0/1016650325 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948785863 0 0) 0x7f7ea4160a50 con 0x7f7ea415c060 2023-07-09T02:11:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea27fc640 1 -- 172.21.15.45:0/1016650325 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e8c003530 con 0x7f7ea415c060 2023-07-09T02:11:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea3fff640 1 -- 172.21.15.45:0/1016650325 >> v1:172.21.15.155:6789/0 conn(0x7f7ea40d2620 legacy=0x7f7ea40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea27fc640 1 -- 172.21.15.45:0/1016650325 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680541015 0 0) 0x7f7ea415c430 con 0x7f7ea40d2620 2023-07-09T02:11:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea3fff640 1 -- 172.21.15.45:0/1016650325 >> v1:172.21.15.45:6789/0 conn(0x7f7ea415c060 legacy=0x7f7ea40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.057+0000 7f7ea3fff640 1 -- 172.21.15.45:0/1016650325 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea415fe40 con 0x7f7ea40cd120 2023-07-09T02:11:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea3fff640 1 --2- 172.21.15.45:0/1016650325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea40b4ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009d90 tx=0x7f7e9c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9790bc71e04735f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea27fc640 1 -- 172.21.15.45:0/1016650325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0a59e0 con 0x7f7ea40cd120 2023-07-09T02:11:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea27fc640 1 -- 172.21.15.45:0/1016650325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0a5b40 con 0x7f7ea40cd120 2023-07-09T02:11:14.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea27fc640 1 -- 172.21.15.45:0/1016650325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0ad440 con 0x7f7ea40cd120 2023-07-09T02:11:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 -- 172.21.15.45:0/1016650325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 msgr2=0x7f7ea40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 --2- 172.21.15.45:0/1016650325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea40b4ed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009d90 tx=0x7f7e9c01c920 comp rx=0 tx=0).stop 2023-07-09T02:11:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 -- 172.21.15.45:0/1016650325 shutdown_connections 2023-07-09T02:11:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 --2- 172.21.15.45:0/1016650325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea40b4ed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 -- 172.21.15.45:0/1016650325 >> 172.21.15.45:0/1016650325 conn(0x7f7ea40698e0 msgr2=0x7f7ea4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 -- 172.21.15.45:0/1016650325 shutdown_connections 2023-07-09T02:11:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 -- 172.21.15.45:0/1016650325 wait complete. 2023-07-09T02:11:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 Processor -- start 2023-07-09T02:11:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.061+0000 7f7ea9a93640 1 -- start start 2023-07-09T02:11:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea415f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ea40d2620 0x7f7ea40c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ea415c060 0x7f7ea415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea415d030 con 0x7f7ea40cd120 2023-07-09T02:11:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea4156990 con 0x7f7ea415c060 2023-07-09T02:11:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea4154e60 con 0x7f7ea40d2620 2023-07-09T02:11:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea415f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40214/0 (socket says 172.21.15.45:40214) 2023-07-09T02:11:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 -- 172.21.15.45:0/3491174737 learned_addr learned my addr 172.21.15.45:0/3491174737 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea3fff640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ea415c060 0x7f7ea415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea2ffd640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ea40d2620 0x7f7ea40c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 -- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ea40d2620 msgr2=0x7f7ea40c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ea40d2620 0x7f7ea40c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 -- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ea415c060 msgr2=0x7f7ea415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ea415c060 0x7f7ea415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 -- 172.21.15.45:0/3491174737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c009a70 con 0x7f7ea40cd120 2023-07-09T02:11:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea3fff640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ea415c060 0x7f7ea415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea2ffd640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ea40d2620 0x7f7ea40c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea37fe640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea415f280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c3c0 tx=0x7f7e9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7e8bfff640 1 -- 172.21.15.45:0/3491174737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94005cf0 con 0x7f7ea40cd120 2023-07-09T02:11:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7e8bfff640 1 -- 172.21.15.45:0/3491174737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e94005e50 con 0x7f7ea40cd120 2023-07-09T02:11:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7e8bfff640 1 -- 172.21.15.45:0/3491174737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940072f0 con 0x7f7ea40cd120 2023-07-09T02:11:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea40b59f0 con 0x7f7ea40cd120 2023-07-09T02:11:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea415d280 con 0x7f7ea40cd120 2023-07-09T02:11:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea404d7d0 con 0x7f7ea40cd120 2023-07-09T02:11:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.065+0000 7f7e8bfff640 1 -- 172.21.15.45:0/3491174737 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e94007450 con 0x7f7ea40cd120 2023-07-09T02:11:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.069+0000 7f7e8bfff640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e90066280 0x7f7e90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.069+0000 7f7e8bfff640 1 -- 172.21.15.45:0/3491174737 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7e94083060 con 0x7f7ea40cd120 2023-07-09T02:11:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.069+0000 7f7ea2ffd640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e90066280 0x7f7e90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.069+0000 7f7ea2ffd640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e90066280 0x7f7e90068730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4151cd0 tx=0x7f7e98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.073+0000 7f7e8bfff640 1 -- 172.21.15.45:0/3491174737 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e940b3700 con 0x7f7ea40cd120 2023-07-09T02:11:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ea40b4c60 con 0x7f7ea40cd120 2023-07-09T02:11:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7e8bfff640 1 -- 172.21.15.45:0/3491174737 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e94017020 con 0x7f7ea40cd120 2023-07-09T02:11:14.231 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:14.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e90066280 msgr2=0x7f7e90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e90066280 0x7f7e90068730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4151cd0 tx=0x7f7e98009040 comp rx=0 tx=0).stop 2023-07-09T02:11:14.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 msgr2=0x7f7ea415f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea415f280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c3c0 tx=0x7f7e9400c880 comp rx=0 tx=0).stop 2023-07-09T02:11:14.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 shutdown_connections 2023-07-09T02:11:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ea415c060 0x7f7ea415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e90066280 0x7f7e90068730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ea40d2620 0x7f7ea40c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 --2- 172.21.15.45:0/3491174737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea40cd120 0x7f7ea415f280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 >> 172.21.15.45:0/3491174737 conn(0x7f7ea40698e0 msgr2=0x7f7ea40b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 shutdown_connections 2023-07-09T02:11:14.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.229+0000 7f7ea9a93640 1 -- 172.21.15.45:0/3491174737 wait complete. 2023-07-09T02:11:14.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:14.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.397+0000 7fdbe840b640 1 Processor -- start 2023-07-09T02:11:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.397+0000 7fdbe840b640 1 -- start start 2023-07-09T02:11:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe840b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdbe015c060 0x7fdbe00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe840b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdbe00cd120 0x7fdbe00d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe840b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe0160a50 con 0x7fdbe00d2450 2023-07-09T02:11:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe840b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe00d28d0 con 0x7fdbe015c060 2023-07-09T02:11:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe840b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe00cfe40 con 0x7fdbe00cd120 2023-07-09T02:11:14.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe69a8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdbe00d2450 0x7fdbe00d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51912/0 (socket says 172.21.15.45:51912) 2023-07-09T02:11:14.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe69a8640 1 -- 172.21.15.45:0/3596401889 learned_addr learned my addr 172.21.15.45:0/3596401889 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:14.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe61a7640 1 --2- 172.21.15.45:0/3596401889 >> v2:172.21.15.45:3300/0 conn(0x7fdbe015c060 0x7fdbe00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe59a6640 1 --2- 172.21.15.45:0/3596401889 >> v2:172.21.15.155:3300/0 conn(0x7fdbe00cd120 0x7fdbe00d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe51a5640 1 -- 172.21.15.45:0/3596401889 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009846314 0 0) 0x7fdbe0160a50 con 0x7fdbe00d2450 2023-07-09T02:11:14.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe51a5640 1 -- 172.21.15.45:0/3596401889 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbcc003530 con 0x7fdbe00d2450 2023-07-09T02:11:14.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe61a7640 1 -- 172.21.15.45:0/3596401889 >> v2:172.21.15.155:3300/0 conn(0x7fdbe00cd120 msgr2=0x7fdbe00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe61a7640 1 --2- 172.21.15.45:0/3596401889 >> v2:172.21.15.155:3300/0 conn(0x7fdbe00cd120 0x7fdbe00d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe61a7640 1 -- 172.21.15.45:0/3596401889 >> v1:172.21.15.45:6789/0 conn(0x7fdbe00d2450 legacy=0x7fdbe00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe61a7640 1 -- 172.21.15.45:0/3596401889 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe015c430 con 0x7fdbe015c060 2023-07-09T02:11:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.401+0000 7fdbe61a7640 1 --2- 172.21.15.45:0/3596401889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe015c060 0x7fdbe00b4ed0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdbe015fac0 tx=0x7fdbdc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2205f688e31d834 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe51a5640 1 -- 172.21.15.45:0/3596401889 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc004230 con 0x7fdbe015c060 2023-07-09T02:11:14.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe51a5640 1 -- 172.21.15.45:0/3596401889 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0a7050 con 0x7fdbe015c060 2023-07-09T02:11:14.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe51a5640 1 -- 172.21.15.45:0/3596401889 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc003620 con 0x7fdbe015c060 2023-07-09T02:11:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- 172.21.15.45:0/3596401889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe015c060 msgr2=0x7fdbe00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 --2- 172.21.15.45:0/3596401889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe015c060 0x7fdbe00b4ed0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdbe015fac0 tx=0x7fdbdc01c430 comp rx=0 tx=0).stop 2023-07-09T02:11:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- 172.21.15.45:0/3596401889 shutdown_connections 2023-07-09T02:11:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 --2- 172.21.15.45:0/3596401889 >> v2:172.21.15.155:3300/0 conn(0x7fdbe00cd120 0x7fdbe00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 --2- 172.21.15.45:0/3596401889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe015c060 0x7fdbe00b4ed0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- 172.21.15.45:0/3596401889 >> 172.21.15.45:0/3596401889 conn(0x7fdbe00698e0 msgr2=0x7fdbe0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:14.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- 172.21.15.45:0/3596401889 shutdown_connections 2023-07-09T02:11:14.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- 172.21.15.45:0/3596401889 wait complete. 2023-07-09T02:11:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 Processor -- start 2023-07-09T02:11:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- start start 2023-07-09T02:11:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe00cd120 0x7fdbe015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00d2450 0x7fdbe0151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe015c060 0x7fdbe015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00b48e0 con 0x7fdbe00d2450 2023-07-09T02:11:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe015e4e0 con 0x7fdbe015c060 2023-07-09T02:11:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.405+0000 7fdbe840b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe015e7c0 con 0x7fdbe00cd120 2023-07-09T02:11:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00d2450 0x7fdbe0151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00d2450 0x7fdbe0151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40218/0 (socket says 172.21.15.45:40218) 2023-07-09T02:11:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 -- 172.21.15.45:0/2272574219 learned_addr learned my addr 172.21.15.45:0/2272574219 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe61a7640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe00cd120 0x7fdbe015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe69a8640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe015c060 0x7fdbe015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 -- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe00cd120 msgr2=0x7fdbe015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe00cd120 0x7fdbe015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 -- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe015c060 msgr2=0x7fdbe015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe015c060 0x7fdbe015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 -- 172.21.15.45:0/2272574219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc009420 con 0x7fdbe00d2450 2023-07-09T02:11:14.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe69a8640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe015c060 0x7fdbe015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:14.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe59a6640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00d2450 0x7fdbe0151c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000d800 tx=0x7fdbd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbd6ffd640 1 -- 172.21.15.45:0/2272574219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0018070 con 0x7fdbe00d2450 2023-07-09T02:11:14.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbd6ffd640 1 -- 172.21.15.45:0/2272574219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd0004020 con 0x7fdbe00d2450 2023-07-09T02:11:14.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbd6ffd640 1 -- 172.21.15.45:0/2272574219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00041d0 con 0x7fdbe00d2450 2023-07-09T02:11:14.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe0152140 con 0x7fdbe00d2450 2023-07-09T02:11:14.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe00b4e10 con 0x7fdbe00d2450 2023-07-09T02:11:14.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe015e970 con 0x7fdbe00d2450 2023-07-09T02:11:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbd6ffd640 1 -- 172.21.15.45:0/2272574219 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdbd0004330 con 0x7fdbe00d2450 2023-07-09T02:11:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbd6ffd640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbc4066280 0x7fdbc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.409+0000 7fdbd6ffd640 1 -- 172.21.15.45:0/2272574219 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdbd00837f0 con 0x7fdbe00d2450 2023-07-09T02:11:14.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.413+0000 7fdbe61a7640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbc4066280 0x7fdbc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.413+0000 7fdbe61a7640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbc4066280 0x7fdbc4068730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0ad000 tx=0x7fdbdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.417+0000 7fdbd6ffd640 1 -- 172.21.15.45:0/2272574219 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbd0054a40 con 0x7fdbe00d2450 2023-07-09T02:11:14.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdbe01603d0 con 0x7fdbe00d2450 2023-07-09T02:11:14.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbd6ffd640 1 -- 172.21.15.45:0/2272574219 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdbd00545d0 con 0x7fdbe00d2450 2023-07-09T02:11:14.572 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:14.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbc4066280 msgr2=0x7fdbc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbc4066280 0x7fdbc4068730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0ad000 tx=0x7fdbdc008040 comp rx=0 tx=0).stop 2023-07-09T02:11:14.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00d2450 msgr2=0x7fdbe0151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00d2450 0x7fdbe0151c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000d800 tx=0x7fdbd000dcc0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 shutdown_connections 2023-07-09T02:11:14.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbe015c060 0x7fdbe015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00d2450 0x7fdbe0151c00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbc4066280 0x7fdbc4068730 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 --2- 172.21.15.45:0/2272574219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbe00cd120 0x7fdbe015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.568+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 >> 172.21.15.45:0/2272574219 conn(0x7fdbe00698e0 msgr2=0x7fdbe015b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:14.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.572+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 shutdown_connections 2023-07-09T02:11:14.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.572+0000 7fdbe840b640 1 -- 172.21.15.45:0/2272574219 wait complete. 2023-07-09T02:11:14.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:11:14.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.732+0000 7f7d6c8aa640 1 Processor -- start 2023-07-09T02:11:14.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.732+0000 7f7d6c8aa640 1 -- start start 2023-07-09T02:11:14.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6c8aa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7d680d2620 0x7f7d680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6c8aa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d680cd120 0x7f7d680cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6c8aa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d68160a50 con 0x7f7d6815c060 2023-07-09T02:11:14.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6c8aa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6815c430 con 0x7f7d680d2620 2023-07-09T02:11:14.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6c8aa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6815fb60 con 0x7f7d680cd120 2023-07-09T02:11:14.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7d6815c060 0x7f7d680d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51928/0 (socket says 172.21.15.45:51928) 2023-07-09T02:11:14.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6659c640 1 -- 172.21.15.45:0/205213055 learned_addr learned my addr 172.21.15.45:0/205213055 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:14.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d66d9d640 1 --2- 172.21.15.45:0/205213055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d680cd120 0x7f7d680cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d65d9b640 1 --2- 172.21.15.45:0/205213055 >> v2:172.21.15.155:3300/0 conn(0x7f7d680d2620 0x7f7d680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6559a640 1 -- 172.21.15.45:0/205213055 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965354381 0 0) 0x7f7d68160a50 con 0x7f7d6815c060 2023-07-09T02:11:14.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d6559a640 1 -- 172.21.15.45:0/205213055 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d50003530 con 0x7f7d6815c060 2023-07-09T02:11:14.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d66d9d640 1 -- 172.21.15.45:0/205213055 >> v2:172.21.15.155:3300/0 conn(0x7f7d680d2620 msgr2=0x7f7d680b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:14.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d66d9d640 1 --2- 172.21.15.45:0/205213055 >> v2:172.21.15.155:3300/0 conn(0x7f7d680d2620 0x7f7d680b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d66d9d640 1 -- 172.21.15.45:0/205213055 >> v1:172.21.15.45:6789/0 conn(0x7f7d6815c060 legacy=0x7f7d680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.736+0000 7f7d66d9d640 1 -- 172.21.15.45:0/205213055 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6815fe40 con 0x7f7d680cd120 2023-07-09T02:11:14.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d66d9d640 1 --2- 172.21.15.45:0/205213055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d680cd120 0x7f7d680cee30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009d90 tx=0x7f7d6001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba6c29983c8fdbff server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6559a640 1 -- 172.21.15.45:0/205213055 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d600a59e0 con 0x7f7d680cd120 2023-07-09T02:11:14.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6559a640 1 -- 172.21.15.45:0/205213055 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d600a5b40 con 0x7f7d680cd120 2023-07-09T02:11:14.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6559a640 1 -- 172.21.15.45:0/205213055 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d600ad440 con 0x7f7d680cd120 2023-07-09T02:11:14.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/205213055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d680cd120 msgr2=0x7f7d680cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/205213055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d680cd120 0x7f7d680cee30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009d90 tx=0x7f7d6001c920 comp rx=0 tx=0).stop 2023-07-09T02:11:14.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/205213055 shutdown_connections 2023-07-09T02:11:14.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/205213055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d680cd120 0x7f7d680cee30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/205213055 >> v2:172.21.15.155:3300/0 conn(0x7f7d680d2620 0x7f7d680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/205213055 >> 172.21.15.45:0/205213055 conn(0x7f7d680698e0 msgr2=0x7f7d68069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:14.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/205213055 shutdown_connections 2023-07-09T02:11:14.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/205213055 wait complete. 2023-07-09T02:11:14.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 Processor -- start 2023-07-09T02:11:14.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.740+0000 7f7d6c8aa640 1 -- start start 2023-07-09T02:11:14.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d680cd120 0x7f7d680b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d680d2620 0x7f7d68153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d6815c060 0x7f7d68153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68153eb0 con 0x7f7d680d2620 2023-07-09T02:11:14.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d680ccee0 con 0x7f7d680cd120 2023-07-09T02:11:14.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68152670 con 0x7f7d6815c060 2023-07-09T02:11:14.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d680d2620 0x7f7d68153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d680d2620 0x7f7d68153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40230/0 (socket says 172.21.15.45:40230) 2023-07-09T02:11:14.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 -- 172.21.15.45:0/3836043080 learned_addr learned my addr 172.21.15.45:0/3836043080 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:14.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6659c640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d680cd120 0x7f7d680b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d66d9d640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d6815c060 0x7f7d68153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 -- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d6815c060 msgr2=0x7f7d68153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d6815c060 0x7f7d68153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 -- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d680cd120 msgr2=0x7f7d680b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d680cd120 0x7f7d680b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 -- 172.21.15.45:0/3836043080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009a70 con 0x7f7d680d2620 2023-07-09T02:11:14.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d66d9d640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d6815c060 0x7f7d68153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:14.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6659c640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d680cd120 0x7f7d680b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:14.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d65d9b640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d680d2620 0x7f7d68153430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00e900 tx=0x7f7d5c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d56ffd640 1 -- 172.21.15.45:0/3836043080 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c009690 con 0x7f7d680d2620 2023-07-09T02:11:14.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d56ffd640 1 -- 172.21.15.45:0/3836043080 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c00ca00 con 0x7f7d680d2620 2023-07-09T02:11:14.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d56ffd640 1 -- 172.21.15.45:0/3836043080 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00cdb0 con 0x7f7d680d2620 2023-07-09T02:11:14.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d680b59f0 con 0x7f7d680d2620 2023-07-09T02:11:14.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d68152c30 con 0x7f7d680d2620 2023-07-09T02:11:14.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.744+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6804d7d0 con 0x7f7d680d2620 2023-07-09T02:11:14.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.748+0000 7f7d56ffd640 1 -- 172.21.15.45:0/3836043080 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d5c013470 con 0x7f7d680d2620 2023-07-09T02:11:14.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.748+0000 7f7d56ffd640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d48066280 0x7f7d48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:14.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.748+0000 7f7d56ffd640 1 -- 172.21.15.45:0/3836043080 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7d5c083ca0 con 0x7f7d680d2620 2023-07-09T02:11:14.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.748+0000 7f7d6659c640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d48066280 0x7f7d48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:14.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.748+0000 7f7d6659c640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d48066280 0x7f7d48068730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d580011f0 tx=0x7f7d58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:14.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.752+0000 7f7d56ffd640 1 -- 172.21.15.45:0/3836043080 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d5c0513d0 con 0x7f7d680d2620 2023-07-09T02:11:14.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.908+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7d6806baa0 con 0x7f7d680d2620 2023-07-09T02:11:14.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.908+0000 7f7d56ffd640 1 -- 172.21.15.45:0/3836043080 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7d5c021090 con 0x7f7d680d2620 2023-07-09T02:11:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:14.914 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:11:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:11:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:11:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:11:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:11:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:11:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:11:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:11:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:11:14.917 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:11:14.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d48066280 msgr2=0x7f7d48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d48066280 0x7f7d48068730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d580011f0 tx=0x7f7d58009040 comp rx=0 tx=0).stop 2023-07-09T02:11:14.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d680d2620 msgr2=0x7f7d68153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:14.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d680d2620 0x7f7d68153430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00e900 tx=0x7f7d5c00edc0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 shutdown_connections 2023-07-09T02:11:14.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d48066280 0x7f7d48068730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d6815c060 0x7f7d68153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d680d2620 0x7f7d68153430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 --2- 172.21.15.45:0/3836043080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d680cd120 0x7f7d680b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:14.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 >> 172.21.15.45:0/3836043080 conn(0x7f7d680698e0 msgr2=0x7f7d68158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:14.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 shutdown_connections 2023-07-09T02:11:14.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:14.912+0000 7f7d6c8aa640 1 -- 172.21.15.45:0/3836043080 wait complete. 2023-07-09T02:11:14.942 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:11:14.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:11:15.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0417559640 1 Processor -- start 2023-07-09T02:11:15.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0417559640 1 -- start start 2023-07-09T02:11:15.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0417559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04100b4ba0 0x7f04100cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:15.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0417559640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04100d19c0 con 0x7f04100cd060 2023-07-09T02:11:15.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0417559640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04100cf210 con 0x7f041015c480 2023-07-09T02:11:15.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0417559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041015c850 con 0x7f04100b4ba0 2023-07-09T02:11:15.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0414af4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f04100cd060 0x7f04100b4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51934/0 (socket says 172.21.15.45:51934) 2023-07-09T02:11:15.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0414af4640 1 -- 172.21.15.45:0/3852279912 learned_addr learned my addr 172.21.15.45:0/3852279912 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:15.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0415af6640 1 --2- 172.21.15.45:0/3852279912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04100b4ba0 0x7f04100cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:15.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0407fff640 1 -- 172.21.15.45:0/3852279912 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725010777 0 0) 0x7f04100d19c0 con 0x7f04100cd060 2023-07-09T02:11:15.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0407fff640 1 -- 172.21.15.45:0/3852279912 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03fc003530 con 0x7f04100cd060 2023-07-09T02:11:15.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0407fff640 1 -- 172.21.15.45:0/3852279912 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711376615 0 0) 0x7f04100cf210 con 0x7f041015c480 2023-07-09T02:11:15.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0407fff640 1 -- 172.21.15.45:0/3852279912 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04100d19c0 con 0x7f041015c480 2023-07-09T02:11:15.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0415af6640 1 -- 172.21.15.45:0/3852279912 >> v1:172.21.15.155:6789/0 conn(0x7f041015c480 legacy=0x7f04100d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:15.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0415af6640 1 -- 172.21.15.45:0/3852279912 >> v1:172.21.15.45:6789/0 conn(0x7f04100cd060 legacy=0x7f04100b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:15.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0407fff640 1 -- 172.21.15.45:0/3852279912 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3411562905 0 0) 0x7f03fc003530 con 0x7f04100cd060 2023-07-09T02:11:15.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.088+0000 7f0415af6640 1 -- 172.21.15.45:0/3852279912 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100cd4d0 con 0x7f04100b4ba0 2023-07-09T02:11:15.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0415af6640 1 --2- 172.21.15.45:0/3852279912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04100b4ba0 0x7f04100cecd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0408009dc0 tx=0x7f040801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c4561430d07400 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:15.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0407fff640 1 -- 172.21.15.45:0/3852279912 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400001680 con 0x7f04100b4ba0 2023-07-09T02:11:15.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0407fff640 1 -- 172.21.15.45:0/3852279912 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080a55c0 con 0x7f04100b4ba0 2023-07-09T02:11:15.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0407fff640 1 -- 172.21.15.45:0/3852279912 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080a5950 con 0x7f04100b4ba0 2023-07-09T02:11:15.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0417559640 1 -- 172.21.15.45:0/3852279912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04100b4ba0 msgr2=0x7f04100cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:15.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0417559640 1 --2- 172.21.15.45:0/3852279912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04100b4ba0 0x7f04100cecd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0408009dc0 tx=0x7f040801c890 comp rx=0 tx=0).stop 2023-07-09T02:11:15.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0417559640 1 -- 172.21.15.45:0/3852279912 shutdown_connections 2023-07-09T02:11:15.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0417559640 1 --2- 172.21.15.45:0/3852279912 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04100b4ba0 0x7f04100cecd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:15.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0417559640 1 -- 172.21.15.45:0/3852279912 >> 172.21.15.45:0/3852279912 conn(0x7f04100cf490 msgr2=0x7f04100cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:15.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0417559640 1 -- 172.21.15.45:0/3852279912 shutdown_connections 2023-07-09T02:11:15.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.092+0000 7f0417559640 1 -- 172.21.15.45:0/3852279912 wait complete. 2023-07-09T02:11:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 Processor -- start 2023-07-09T02:11:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 -- start start 2023-07-09T02:11:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04100b4ba0 0x7f0410151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04100cd060 0x7f041014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f041015c480 0x7f0410159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041015e2b0 con 0x7f04100b4ba0 2023-07-09T02:11:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041014f5c0 con 0x7f04100cd060 2023-07-09T02:11:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0410156550 con 0x7f041015c480 2023-07-09T02:11:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04100b4ba0 0x7f0410151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04100b4ba0 0x7f0410151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40244/0 (socket says 172.21.15.45:40244) 2023-07-09T02:11:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 -- 172.21.15.45:0/4145413435 learned_addr learned my addr 172.21.15.45:0/4145413435 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0415af6640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f041015c480 0x7f0410159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0414af4640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04100cd060 0x7f041014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 -- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f041015c480 msgr2=0x7f0410159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f041015c480 0x7f0410159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 -- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04100cd060 msgr2=0x7f041014f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04100cd060 0x7f041014f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 -- 172.21.15.45:0/4145413435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408009a70 con 0x7f04100b4ba0 2023-07-09T02:11:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0415af6640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f041015c480 0x7f0410159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f04152f5640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04100b4ba0 0x7f0410151ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c430 tx=0x7f040c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:15.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0405ffb640 1 -- 172.21.15.45:0/4145413435 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0052d0 con 0x7f04100b4ba0 2023-07-09T02:11:15.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0405ffb640 1 -- 172.21.15.45:0/4145413435 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c005450 con 0x7f04100b4ba0 2023-07-09T02:11:15.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0405ffb640 1 -- 172.21.15.45:0/4145413435 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c003840 con 0x7f04100b4ba0 2023-07-09T02:11:15.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0410156830 con 0x7f04100b4ba0 2023-07-09T02:11:15.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.096+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0410156170 con 0x7f04100b4ba0 2023-07-09T02:11:15.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.100+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041004d7d0 con 0x7f04100b4ba0 2023-07-09T02:11:15.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.100+0000 7f0405ffb640 1 -- 172.21.15.45:0/4145413435 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f040c0039a0 con 0x7f04100b4ba0 2023-07-09T02:11:15.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.100+0000 7f0405ffb640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f03f4066280 0x7f03f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:15.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.100+0000 7f0405ffb640 1 -- 172.21.15.45:0/4145413435 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f040c0830b0 con 0x7f04100b4ba0 2023-07-09T02:11:15.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.100+0000 7f0414af4640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f03f4066280 0x7f03f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:15.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.100+0000 7f0414af4640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f03f4066280 0x7f03f4068730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04100cc9f0 tx=0x7f0400009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.104+0000 7f0405ffb640 1 -- 172.21.15.45:0/4145413435 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f040c0507e0 con 0x7f04100b4ba0 2023-07-09T02:11:15.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:15.268+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f04100c62c0 con 0x7f04100b4ba0 2023-07-09T02:11:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.128+0000 7f0405ffb640 1 -- 172.21.15.45:0/4145413435 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f040c053e00 con 0x7f04100b4ba0 2023-07-09T02:11:16.133 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:11:16.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f03f4066280 msgr2=0x7f03f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:16.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f03f4066280 0x7f03f4068730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04100cc9f0 tx=0x7f0400009040 comp rx=0 tx=0).stop 2023-07-09T02:11:16.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04100b4ba0 msgr2=0x7f0410151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:16.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04100b4ba0 0x7f0410151ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c430 tx=0x7f040c00c8f0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 shutdown_connections 2023-07-09T02:11:16.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f03f4066280 0x7f03f4068730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f041015c480 0x7f0410159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04100cd060 0x7f041014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 --2- 172.21.15.45:0/4145413435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04100b4ba0 0x7f0410151ce0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 >> 172.21.15.45:0/4145413435 conn(0x7f04100cf490 msgr2=0x7f04100d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:16.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 shutdown_connections 2023-07-09T02:11:16.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.136+0000 7f0417559640 1 -- 172.21.15.45:0/4145413435 wait complete. 2023-07-09T02:11:16.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:11:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71e11e2640 1 Processor -- start 2023-07-09T02:11:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71e11e2640 1 -- start start 2023-07-09T02:11:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71e11e2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71dc15c410 0x7f71dc1608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71e11e2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0ced10 con 0x7f71dc0b4cf0 2023-07-09T02:11:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71e11e2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc15c7e0 con 0x7f71dc0b59b0 2023-07-09T02:11:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71e11e2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0cd1b0 con 0x7f71dc15c410 2023-07-09T02:11:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71dad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71dc15c410 0x7f71dc1608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:16.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71dad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71dc15c410 0x7f71dc1608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40246/0 (socket says 172.21.15.45:40246) 2023-07-09T02:11:16.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71dad9d640 1 -- 172.21.15.45:0/2672801325 learned_addr learned my addr 172.21.15.45:0/2672801325 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:16.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.312+0000 7f71db59e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f71dc0b4cf0 0x7f71dc0d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51950/0 (socket says 172.21.15.45:51950) 2023-07-09T02:11:16.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71dad9d640 1 -- 172.21.15.45:0/2672801325 >> v1:172.21.15.155:6789/0 conn(0x7f71dc0b59b0 legacy=0x7f71dc0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71dad9d640 1 -- 172.21.15.45:0/2672801325 >> v1:172.21.15.45:6789/0 conn(0x7f71dc0b4cf0 legacy=0x7f71dc0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71da59c640 1 -- 172.21.15.45:0/2672801325 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874191942 0 0) 0x7f71dc0ced10 con 0x7f71dc0b4cf0 2023-07-09T02:11:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71dad9d640 1 -- 172.21.15.45:0/2672801325 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc160de0 con 0x7f71dc15c410 2023-07-09T02:11:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71dad9d640 1 --2- 172.21.15.45:0/2672801325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc1608a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098a0 tx=0x7f71cc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de55fbce44b8e9be server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71da59c640 1 -- 172.21.15.45:0/2672801325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0aa620 con 0x7f71dc15c410 2023-07-09T02:11:16.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71da59c640 1 -- 172.21.15.45:0/2672801325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc0aa780 con 0x7f71dc15c410 2023-07-09T02:11:16.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71da59c640 1 -- 172.21.15.45:0/2672801325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0aab10 con 0x7f71dc15c410 2023-07-09T02:11:16.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71e11e2640 1 -- 172.21.15.45:0/2672801325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 msgr2=0x7f71dc1608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:16.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71e11e2640 1 --2- 172.21.15.45:0/2672801325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc1608a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098a0 tx=0x7f71cc01c4f0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71e11e2640 1 -- 172.21.15.45:0/2672801325 shutdown_connections 2023-07-09T02:11:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71e11e2640 1 --2- 172.21.15.45:0/2672801325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc1608a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71e11e2640 1 -- 172.21.15.45:0/2672801325 >> 172.21.15.45:0/2672801325 conn(0x7f71dc06a590 msgr2=0x7f71dc0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71e11e2640 1 -- 172.21.15.45:0/2672801325 shutdown_connections 2023-07-09T02:11:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.316+0000 7f71e11e2640 1 -- 172.21.15.45:0/2672801325 wait complete. 2023-07-09T02:11:16.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 Processor -- start 2023-07-09T02:11:16.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 -- start start 2023-07-09T02:11:16.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71dc0b4cf0 0x7f71dc153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71dc0b59b0 0x7f71dc15b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc15bcb0 con 0x7f71dc15c410 2023-07-09T02:11:16.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1544d0 con 0x7f71dc0b59b0 2023-07-09T02:11:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1547b0 con 0x7f71dc0b4cf0 2023-07-09T02:11:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:16.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc14ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40260/0 (socket says 172.21.15.45:40260) 2023-07-09T02:11:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 -- 172.21.15.45:0/1779675701 learned_addr learned my addr 172.21.15.45:0/1779675701 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71dad9d640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71dc0b4cf0 0x7f71dc153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71d3fff640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71dc0b59b0 0x7f71dc15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:16.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 -- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71dc0b4cf0 msgr2=0x7f71dc153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71dc0b4cf0 0x7f71dc153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 -- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71dc0b59b0 msgr2=0x7f71dc15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:16.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71dc0b59b0 0x7f71dc15b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 -- 172.21.15.45:0/1779675701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0094d0 con 0x7f71dc15c410 2023-07-09T02:11:16.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71db59e640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc14ef40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71d400c750 tx=0x7f71d400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71d37fe640 1 -- 172.21.15.45:0/1779675701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400ce60 con 0x7f71dc15c410 2023-07-09T02:11:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71d37fe640 1 -- 172.21.15.45:0/1779675701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d400a640 con 0x7f71dc15c410 2023-07-09T02:11:16.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71d37fe640 1 -- 172.21.15.45:0/1779675701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400a9b0 con 0x7f71dc15c410 2023-07-09T02:11:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.320+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc15ac90 con 0x7f71dc15c410 2023-07-09T02:11:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.324+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc15b250 con 0x7f71dc15c410 2023-07-09T02:11:16.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.324+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc15b440 con 0x7f71dc15c410 2023-07-09T02:11:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.324+0000 7f71d37fe640 1 -- 172.21.15.45:0/1779675701 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71d400ab10 con 0x7f71dc15c410 2023-07-09T02:11:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.328+0000 7f71d37fe640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71bc066280 0x7f71bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.328+0000 7f71d37fe640 1 -- 172.21.15.45:0/1779675701 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f71d40832b0 con 0x7f71dc15c410 2023-07-09T02:11:16.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.328+0000 7f71dad9d640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71bc066280 0x7f71bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:16.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.328+0000 7f71dad9d640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71bc066280 0x7f71bc068730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0ae000 tx=0x7f71cc0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:16.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.328+0000 7f71d37fe640 1 -- 172.21.15.45:0/1779675701 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71d40509a0 con 0x7f71dc15c410 2023-07-09T02:11:16.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:16.484+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f71dc04d7d0 con 0x7f71dc15c410 2023-07-09T02:11:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.132+0000 7f71d37fe640 1 -- 172.21.15.45:0/1779675701 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f71d4053fc0 con 0x7f71dc15c410 2023-07-09T02:11:17.136 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:11:17.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.140+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71bc066280 msgr2=0x7f71bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:17.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.140+0000 7f71e11e2640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71bc066280 0x7f71bc068730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0ae000 tx=0x7f71cc0b5040 comp rx=0 tx=0).stop 2023-07-09T02:11:17.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.140+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 msgr2=0x7f71dc14ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:17.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.140+0000 7f71e11e2640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc14ef40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71d400c750 tx=0x7f71d400cc10 comp rx=0 tx=0).stop 2023-07-09T02:11:17.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.148+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 shutdown_connections 2023-07-09T02:11:17.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.148+0000 7f71e11e2640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71dc15c410 0x7f71dc14ef40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.148+0000 7f71e11e2640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71dc0b59b0 0x7f71dc15b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.148+0000 7f71e11e2640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71bc066280 0x7f71bc068730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.148+0000 7f71e11e2640 1 --2- 172.21.15.45:0/1779675701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71dc0b4cf0 0x7f71dc153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.148+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 >> 172.21.15.45:0/1779675701 conn(0x7f71dc06a590 msgr2=0x7f71dc0b8480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:17.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.148+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 shutdown_connections 2023-07-09T02:11:17.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.148+0000 7f71e11e2640 1 -- 172.21.15.45:0/1779675701 wait complete. 2023-07-09T02:11:17.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:11:17.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0162ed8640 1 Processor -- start 2023-07-09T02:11:17.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0162ed8640 1 -- start start 2023-07-09T02:11:17.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0162ed8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f015c0d2620 0x7f015c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:17.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0162ed8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f015c0cd120 0x7f015c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:17.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0162ed8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015c160a50 con 0x7f015c15c060 2023-07-09T02:11:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0162ed8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c15c430 con 0x7f015c0cd120 2023-07-09T02:11:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0162ed8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c15fb60 con 0x7f015c0d2620 2023-07-09T02:11:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0161475640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f015c0cd120 0x7f015c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0161475640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f015c0cd120 0x7f015c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40274/0 (socket says 172.21.15.45:40274) 2023-07-09T02:11:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0161475640 1 -- 172.21.15.45:0/1294481474 learned_addr learned my addr 172.21.15.45:0/1294481474 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f015bfff640 1 --2- 172.21.15.45:0/1294481474 >> v2:172.21.15.155:3300/0 conn(0x7f015c0d2620 0x7f015c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:17.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0161475640 1 -- 172.21.15.45:0/1294481474 >> v2:172.21.15.155:3300/0 conn(0x7f015c0d2620 msgr2=0x7f015c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:17.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0161475640 1 --2- 172.21.15.45:0/1294481474 >> v2:172.21.15.155:3300/0 conn(0x7f015c0d2620 0x7f015c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0161475640 1 -- 172.21.15.45:0/1294481474 >> v1:172.21.15.155:6789/0 conn(0x7f015c15c060 legacy=0x7f015c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:17.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.320+0000 7f0161475640 1 -- 172.21.15.45:0/1294481474 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c15fe40 con 0x7f015c0cd120 2023-07-09T02:11:17.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0161475640 1 --2- 172.21.15.45:0/1294481474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0cd120 0x7f015c0cee30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f015c15fac0 tx=0x7f015401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527787e10116c53a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:17.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f015b7fe640 1 -- 172.21.15.45:0/1294481474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01540a5860 con 0x7f015c0cd120 2023-07-09T02:11:17.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f015b7fe640 1 -- 172.21.15.45:0/1294481474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01540a59c0 con 0x7f015c0cd120 2023-07-09T02:11:17.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f015b7fe640 1 -- 172.21.15.45:0/1294481474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01540a5d50 con 0x7f015c0cd120 2023-07-09T02:11:17.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0162ed8640 1 -- 172.21.15.45:0/1294481474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0cd120 msgr2=0x7f015c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:17.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0162ed8640 1 --2- 172.21.15.45:0/1294481474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0cd120 0x7f015c0cee30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f015c15fac0 tx=0x7f015401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0162ed8640 1 -- 172.21.15.45:0/1294481474 shutdown_connections 2023-07-09T02:11:17.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0162ed8640 1 --2- 172.21.15.45:0/1294481474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0cd120 0x7f015c0cee30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0162ed8640 1 --2- 172.21.15.45:0/1294481474 >> v2:172.21.15.155:3300/0 conn(0x7f015c0d2620 0x7f015c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0162ed8640 1 -- 172.21.15.45:0/1294481474 >> 172.21.15.45:0/1294481474 conn(0x7f015c0698e0 msgr2=0x7f015c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:17.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0162ed8640 1 -- 172.21.15.45:0/1294481474 shutdown_connections 2023-07-09T02:11:17.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.324+0000 7f0162ed8640 1 -- 172.21.15.45:0/1294481474 wait complete. 2023-07-09T02:11:17.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 Processor -- start 2023-07-09T02:11:17.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 -- start start 2023-07-09T02:11:17.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f015c0cd120 0x7f015c0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:17.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0d2620 0x7f015c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:17.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f015c15c060 0x7f015c0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:17.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c1526f0 con 0x7f015c0d2620 2023-07-09T02:11:17.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c152900 con 0x7f015c0cd120 2023-07-09T02:11:17.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c152be0 con 0x7f015c15c060 2023-07-09T02:11:17.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0d2620 0x7f015c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:17.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0d2620 0x7f015c151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40290/0 (socket says 172.21.15.45:40290) 2023-07-09T02:11:17.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 -- 172.21.15.45:0/3991795441 learned_addr learned my addr 172.21.15.45:0/3991795441 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:17.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0161475640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f015c15c060 0x7f015c0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:17.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0160c74640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f015c0cd120 0x7f015c0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:17.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 -- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f015c15c060 msgr2=0x7f015c0b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:17.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f015c15c060 0x7f015c0b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 -- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f015c0cd120 msgr2=0x7f015c0ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:17.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f015c0cd120 0x7f015c0ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:17.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 -- 172.21.15.45:0/3991795441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0154009b30 con 0x7f015c0d2620 2023-07-09T02:11:17.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f015bfff640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0d2620 0x7f015c151e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f014800e900 tx=0x7f014800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:17.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f01597fa640 1 -- 172.21.15.45:0/3991795441 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148009690 con 0x7f015c0d2620 2023-07-09T02:11:17.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f01597fa640 1 -- 172.21.15.45:0/3991795441 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014800ca00 con 0x7f015c0d2620 2023-07-09T02:11:17.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f01597fa640 1 -- 172.21.15.45:0/3991795441 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014800cdb0 con 0x7f015c0d2620 2023-07-09T02:11:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c0b59f0 con 0x7f015c0d2620 2023-07-09T02:11:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c1531a0 con 0x7f015c0d2620 2023-07-09T02:11:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.328+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c04d7d0 con 0x7f015c0d2620 2023-07-09T02:11:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.332+0000 7f01597fa640 1 -- 172.21.15.45:0/3991795441 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0148013470 con 0x7f015c0d2620 2023-07-09T02:11:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.332+0000 7f01597fa640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0140066280 0x7f0140068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.332+0000 7f01597fa640 1 -- 172.21.15.45:0/3991795441 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0148084240 con 0x7f015c0d2620 2023-07-09T02:11:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.332+0000 7f0160c74640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0140066280 0x7f0140068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:17.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.332+0000 7f0160c74640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0140066280 0x7f0140068730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0150000f70 tx=0x7f0150009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:17.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.336+0000 7f01597fa640 1 -- 172.21.15.45:0/3991795441 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01480517c0 con 0x7f015c0d2620 2023-07-09T02:11:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:17.532+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f015c0b18d0 con 0x7f015c0d2620 2023-07-09T02:11:17.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:11:17.664 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:11:18.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.180+0000 7f01597fa640 1 -- 172.21.15.45:0/3991795441 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0148054de0 con 0x7f015c0d2620 2023-07-09T02:11:18.184 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 3 and data pool 4 2023-07-09T02:11:18.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.184+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0140066280 msgr2=0x7f0140068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.184+0000 7f0162ed8640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0140066280 0x7f0140068730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0150000f70 tx=0x7f0150009040 comp rx=0 tx=0).stop 2023-07-09T02:11:18.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.184+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0d2620 msgr2=0x7f015c151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.184+0000 7f0162ed8640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0d2620 0x7f015c151e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f014800e900 tx=0x7f014800edc0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.184+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 shutdown_connections 2023-07-09T02:11:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.188+0000 7f0162ed8640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0140066280 0x7f0140068730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.188+0000 7f0162ed8640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f015c15c060 0x7f015c0b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.188+0000 7f0162ed8640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f015c0d2620 0x7f015c151e10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.188+0000 7f0162ed8640 1 --2- 172.21.15.45:0/3991795441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f015c0cd120 0x7f015c0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.188+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 >> 172.21.15.45:0/3991795441 conn(0x7f015c0698e0 msgr2=0x7f015c154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.188+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 shutdown_connections 2023-07-09T02:11:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.188+0000 7f0162ed8640 1 -- 172.21.15.45:0/3991795441 wait complete. 2023-07-09T02:11:18.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:18.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f9074de9640 1 Processor -- start 2023-07-09T02:11:18.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f9074de9640 1 -- start start 2023-07-09T02:11:18.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f9074de9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f90700d2620 0x7f90700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f9074de9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cd120 0x7f90700cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f9074de9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9070160a50 con 0x7f907015c060 2023-07-09T02:11:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f9074de9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907015c430 con 0x7f90700d2620 2023-07-09T02:11:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f9074de9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907015fb60 con 0x7f90700cd120 2023-07-09T02:11:18.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f906ed9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cd120 0x7f90700cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f906ed9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cd120 0x7f90700cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:34340/0 (socket says 172.21.15.45:34340) 2023-07-09T02:11:18.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f906ed9d640 1 -- 172.21.15.45:0/2325077753 learned_addr learned my addr 172.21.15.45:0/2325077753 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:18.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f906dd9b640 1 --2- 172.21.15.45:0/2325077753 >> v2:172.21.15.155:3300/0 conn(0x7f90700d2620 0x7f90700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f906ed9d640 1 -- 172.21.15.45:0/2325077753 >> v2:172.21.15.155:3300/0 conn(0x7f90700d2620 msgr2=0x7f90700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:18.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f906ed9d640 1 --2- 172.21.15.45:0/2325077753 >> v2:172.21.15.155:3300/0 conn(0x7f90700d2620 0x7f90700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f906ed9d640 1 -- 172.21.15.45:0/2325077753 >> v1:172.21.15.155:6789/0 conn(0x7f907015c060 legacy=0x7f90700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.360+0000 7f906ed9d640 1 -- 172.21.15.45:0/2325077753 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907015fe40 con 0x7f90700cd120 2023-07-09T02:11:18.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f906ed9d640 1 --2- 172.21.15.45:0/2325077753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cd120 0x7f90700cee30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9068009e50 tx=0x7f906801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f93b847e00049835 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:18.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f906d59a640 1 -- 172.21.15.45:0/2325077753 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680a58a0 con 0x7f90700cd120 2023-07-09T02:11:18.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f906d59a640 1 -- 172.21.15.45:0/2325077753 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90680a5a00 con 0x7f90700cd120 2023-07-09T02:11:18.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f906d59a640 1 -- 172.21.15.45:0/2325077753 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680a5d90 con 0x7f90700cd120 2023-07-09T02:11:18.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f9074de9640 1 -- 172.21.15.45:0/2325077753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cd120 msgr2=0x7f90700cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f9074de9640 1 --2- 172.21.15.45:0/2325077753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cd120 0x7f90700cee30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9068009e50 tx=0x7f906801c9e0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f9074de9640 1 -- 172.21.15.45:0/2325077753 shutdown_connections 2023-07-09T02:11:18.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f9074de9640 1 --2- 172.21.15.45:0/2325077753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cd120 0x7f90700cee30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f9074de9640 1 --2- 172.21.15.45:0/2325077753 >> v2:172.21.15.155:3300/0 conn(0x7f90700d2620 0x7f90700b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f9074de9640 1 -- 172.21.15.45:0/2325077753 >> 172.21.15.45:0/2325077753 conn(0x7f90700698e0 msgr2=0x7f9070069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:18.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f9074de9640 1 -- 172.21.15.45:0/2325077753 shutdown_connections 2023-07-09T02:11:18.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.364+0000 7f9074de9640 1 -- 172.21.15.45:0/2325077753 wait complete. 2023-07-09T02:11:18.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 Processor -- start 2023-07-09T02:11:18.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 -- start start 2023-07-09T02:11:18.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700cd120 0x7f9070151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700d2620 0x7f90700b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f907015c060 0x7f907015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90701f7c10 con 0x7f907015c060 2023-07-09T02:11:18.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90701f7ef0 con 0x7f90700cd120 2023-07-09T02:11:18.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90701f81d0 con 0x7f90700d2620 2023-07-09T02:11:18.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f907015c060 0x7f907015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f907015c060 0x7f907015af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40298/0 (socket says 172.21.15.45:40298) 2023-07-09T02:11:18.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 -- 172.21.15.45:0/274911542 learned_addr learned my addr 172.21.15.45:0/274911542 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:18.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906dd9b640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700d2620 0x7f90700b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906e59c640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700cd120 0x7f9070151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 -- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700d2620 msgr2=0x7f90700b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700d2620 0x7f90700b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 -- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700cd120 msgr2=0x7f9070151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700cd120 0x7f9070151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 -- 172.21.15.45:0/274911542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068009b30 con 0x7f907015c060 2023-07-09T02:11:18.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f906ed9d640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f907015c060 0x7f907015af00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f906801a610 tx=0x7f9068019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:18.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f905effd640 1 -- 172.21.15.45:0/274911542 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680b8670 con 0x7f907015c060 2023-07-09T02:11:18.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f905effd640 1 -- 172.21.15.45:0/274911542 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90680b87d0 con 0x7f907015c060 2023-07-09T02:11:18.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90700b59f0 con 0x7f907015c060 2023-07-09T02:11:18.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f905effd640 1 -- 172.21.15.45:0/274911542 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680b8b80 con 0x7f907015c060 2023-07-09T02:11:18.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.368+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90701f8790 con 0x7f907015c060 2023-07-09T02:11:18.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.372+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90701f8980 con 0x7f907015c060 2023-07-09T02:11:18.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.372+0000 7f905effd640 1 -- 172.21.15.45:0/274911542 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90680b8ce0 con 0x7f907015c060 2023-07-09T02:11:18.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.372+0000 7f905effd640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9050066280 0x7f9050068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.372+0000 7f905effd640 1 -- 172.21.15.45:0/274911542 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f906811f1c0 con 0x7f907015c060 2023-07-09T02:11:18.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.372+0000 7f906e59c640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9050066280 0x7f9050068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.372+0000 7f906e59c640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9050066280 0x7f9050068730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9060001770 tx=0x7f9060009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:18.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.376+0000 7f905effd640 1 -- 172.21.15.45:0/274911542 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90680ec780 con 0x7f907015c060 2023-07-09T02:11:18.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.540+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f907004d7d0 con 0x7f907015c060 2023-07-09T02:11:18.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.540+0000 7f905effd640 1 -- 172.21.15.45:0/274911542 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f90680efda0 con 0x7f907015c060 2023-07-09T02:11:18.544 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:18.545 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:17.534866+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9050066280 msgr2=0x7f9050068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9050066280 0x7f9050068730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9060001770 tx=0x7f9060009040 comp rx=0 tx=0).stop 2023-07-09T02:11:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f907015c060 msgr2=0x7f907015af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f907015c060 0x7f907015af00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f906801a610 tx=0x7f9068019780 comp rx=0 tx=0).stop 2023-07-09T02:11:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 shutdown_connections 2023-07-09T02:11:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f907015c060 0x7f907015af00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9050066280 0x7f9050068730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700d2620 0x7f90700b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 --2- 172.21.15.45:0/274911542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700cd120 0x7f9070151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 >> 172.21.15.45:0/274911542 conn(0x7f90700698e0 msgr2=0x7f90700b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 shutdown_connections 2023-07-09T02:11:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.544+0000 7f9074de9640 1 -- 172.21.15.45:0/274911542 wait complete. 2023-07-09T02:11:18.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:18.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19e2219640 1 Processor -- start 2023-07-09T02:11:18.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19e2219640 1 -- start start 2023-07-09T02:11:18.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19e2219640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f19dc15c060 0x7f19dc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19e2219640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0cd120 0x7f19dc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19e2219640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc160a50 con 0x7f19dc0d2450 2023-07-09T02:11:18.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19e2219640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0d28f0 con 0x7f19dc15c060 2023-07-09T02:11:18.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19e2219640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0cfe40 con 0x7f19dc0cd120 2023-07-09T02:11:18.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19dbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f19dc0d2450 0x7f19dc0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51952/0 (socket says 172.21.15.45:51952) 2023-07-09T02:11:18.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19dbfff640 1 -- 172.21.15.45:0/695713727 learned_addr learned my addr 172.21.15.45:0/695713727 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19db7fe640 1 --2- 172.21.15.45:0/695713727 >> v2:172.21.15.155:3300/0 conn(0x7f19dc15c060 0x7f19dc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19daffd640 1 --2- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0cd120 0x7f19dc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19da7fc640 1 -- 172.21.15.45:0/695713727 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270902117 0 0) 0x7f19dc160a50 con 0x7f19dc0d2450 2023-07-09T02:11:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19da7fc640 1 -- 172.21.15.45:0/695713727 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c4003530 con 0x7f19dc0d2450 2023-07-09T02:11:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19db7fe640 1 -- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0cd120 msgr2=0x7f19dc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19db7fe640 1 --2- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0cd120 0x7f19dc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19db7fe640 1 -- 172.21.15.45:0/695713727 >> v1:172.21.15.45:6789/0 conn(0x7f19dc0d2450 legacy=0x7f19dc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19db7fe640 1 -- 172.21.15.45:0/695713727 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc15c430 con 0x7f19dc15c060 2023-07-09T02:11:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.708+0000 7f19daffd640 1 --2- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0cd120 0x7f19dc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19db7fe640 1 --2- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 0x7f19dc0b4ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0097c0 tx=0x7f19cc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=501310ade70d3508 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19da7fc640 1 -- 172.21.15.45:0/695713727 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0ab600 con 0x7f19dc15c060 2023-07-09T02:11:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19da7fc640 1 -- 172.21.15.45:0/695713727 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc0a7050 con 0x7f19dc15c060 2023-07-09T02:11:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19da7fc640 1 -- 172.21.15.45:0/695713727 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0ab980 con 0x7f19dc15c060 2023-07-09T02:11:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19e2219640 1 -- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 msgr2=0x7f19dc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19e2219640 1 --2- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 0x7f19dc0b4ed0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0097c0 tx=0x7f19cc01c450 comp rx=0 tx=0).stop 2023-07-09T02:11:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19e2219640 1 -- 172.21.15.45:0/695713727 shutdown_connections 2023-07-09T02:11:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19e2219640 1 --2- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0cd120 0x7f19dc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19e2219640 1 --2- 172.21.15.45:0/695713727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 0x7f19dc0b4ed0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19e2219640 1 -- 172.21.15.45:0/695713727 >> 172.21.15.45:0/695713727 conn(0x7f19dc0698e0 msgr2=0x7f19dc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19e2219640 1 -- 172.21.15.45:0/695713727 shutdown_connections 2023-07-09T02:11:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.712+0000 7f19e2219640 1 -- 172.21.15.45:0/695713727 wait complete. 2023-07-09T02:11:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 Processor -- start 2023-07-09T02:11:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 -- start start 2023-07-09T02:11:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0cd120 0x7f19dc0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0d2450 0x7f19dc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 0x7f19dc0b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0b3ed0 con 0x7f19dc0cd120 2023-07-09T02:11:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0b28f0 con 0x7f19dc15c060 2023-07-09T02:11:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0b2bd0 con 0x7f19dc0d2450 2023-07-09T02:11:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0cd120 0x7f19dc0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0cd120 0x7f19dc0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40304/0 (socket says 172.21.15.45:40304) 2023-07-09T02:11:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 -- 172.21.15.45:0/48260841 learned_addr learned my addr 172.21.15.45:0/48260841 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19daffd640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0d2450 0x7f19dc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19dbfff640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 0x7f19dc0b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 -- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0d2450 msgr2=0x7f19dc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0d2450 0x7f19dc0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 -- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 msgr2=0x7f19dc0b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 0x7f19dc0b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 -- 172.21.15.45:0/48260841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0009420 con 0x7f19dc0cd120 2023-07-09T02:11:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19daffd640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0d2450 0x7f19dc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19db7fe640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0cd120 0x7f19dc0b3990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0ae040 tx=0x7f19cc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19c3fff640 1 -- 172.21.15.45:0/48260841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0b7450 con 0x7f19dc0cd120 2023-07-09T02:11:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19c3fff640 1 -- 172.21.15.45:0/48260841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc0b75d0 con 0x7f19dc0cd120 2023-07-09T02:11:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19c3fff640 1 -- 172.21.15.45:0/48260841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc0b7980 con 0x7f19dc0cd120 2023-07-09T02:11:18.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.716+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc009420 con 0x7f19dc0cd120 2023-07-09T02:11:18.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.720+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc0b3190 con 0x7f19dc0cd120 2023-07-09T02:11:18.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.720+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc04d7d0 con 0x7f19dc0cd120 2023-07-09T02:11:18.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.720+0000 7f19c3fff640 1 -- 172.21.15.45:0/48260841 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19cc0b7ae0 con 0x7f19dc0cd120 2023-07-09T02:11:18.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.720+0000 7f19c3fff640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f19c8066280 0x7f19c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:18.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.720+0000 7f19c3fff640 1 -- 172.21.15.45:0/48260841 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19cc11e5e0 con 0x7f19dc0cd120 2023-07-09T02:11:18.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.720+0000 7f19daffd640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f19c8066280 0x7f19c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:18.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.724+0000 7f19daffd640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f19c8066280 0x7f19c8068730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0cc2f0 tx=0x7f19d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.724+0000 7f19c3fff640 1 -- 172.21.15.45:0/48260841 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19cc0eb930 con 0x7f19dc0cd120 2023-07-09T02:11:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.880+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19dc15d840 con 0x7f19dc0cd120 2023-07-09T02:11:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.880+0000 7f19c3fff640 1 -- 172.21.15.45:0/48260841 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f19cc0eef50 con 0x7f19dc0cd120 2023-07-09T02:11:18.884 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:18.885 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:17.534866+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f19c8066280 msgr2=0x7f19c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f19c8066280 0x7f19c8068730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0cc2f0 tx=0x7f19d0008040 comp rx=0 tx=0).stop 2023-07-09T02:11:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0cd120 msgr2=0x7f19dc0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0cd120 0x7f19dc0b3990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0ae040 tx=0x7f19cc01ac90 comp rx=0 tx=0).stop 2023-07-09T02:11:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 shutdown_connections 2023-07-09T02:11:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19dc15c060 0x7f19dc0b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f19c8066280 0x7f19c8068730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19dc0d2450 0x7f19dc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 --2- 172.21.15.45:0/48260841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19dc0cd120 0x7f19dc0b3990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 >> 172.21.15.45:0/48260841 conn(0x7f19dc0698e0 msgr2=0x7f19dc0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:18.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 shutdown_connections 2023-07-09T02:11:18.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:18.884+0000 7f19e2219640 1 -- 172.21.15.45:0/48260841 wait complete. 2023-07-09T02:11:18.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:11:19.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2f711640 1 Processor -- start 2023-07-09T02:11:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2f711640 1 -- start start 2023-07-09T02:11:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2f711640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d2815c060 0x7f5d280b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2f711640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d28160a50 con 0x7f5d280d2620 2023-07-09T02:11:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2f711640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2815c430 con 0x7f5d280cd120 2023-07-09T02:11:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2f711640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815fb60 con 0x7f5d2815c060 2023-07-09T02:11:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2dcae640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d280d2620 0x7f5d280cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51956/0 (socket says 172.21.15.45:51956) 2023-07-09T02:11:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2dcae640 1 -- 172.21.15.45:0/2097397695 learned_addr learned my addr 172.21.15.45:0/2097397695 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2d4ad640 1 --2- 172.21.15.45:0/2097397695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d2815c060 0x7f5d280b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d1ffff640 1 -- 172.21.15.45:0/2097397695 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029785978 0 0) 0x7f5d28160a50 con 0x7f5d280d2620 2023-07-09T02:11:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2d4ad640 1 -- 172.21.15.45:0/2097397695 >> v1:172.21.15.155:6789/0 conn(0x7f5d280cd120 legacy=0x7f5d280d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2d4ad640 1 -- 172.21.15.45:0/2097397695 >> v1:172.21.15.45:6789/0 conn(0x7f5d280d2620 legacy=0x7f5d280cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.048+0000 7f5d2d4ad640 1 -- 172.21.15.45:0/2097397695 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2815fe40 con 0x7f5d2815c060 2023-07-09T02:11:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d2d4ad640 1 --2- 172.21.15.45:0/2097397695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d2815c060 0x7f5d280b4ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009820 tx=0x7f5d2401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d851566626bcdb82 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d1ffff640 1 -- 172.21.15.45:0/2097397695 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d240ab670 con 0x7f5d2815c060 2023-07-09T02:11:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d1ffff640 1 -- 172.21.15.45:0/2097397695 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d240ab7d0 con 0x7f5d2815c060 2023-07-09T02:11:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d1ffff640 1 -- 172.21.15.45:0/2097397695 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d240abb60 con 0x7f5d2815c060 2023-07-09T02:11:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d2f711640 1 -- 172.21.15.45:0/2097397695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d2815c060 msgr2=0x7f5d280b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d2f711640 1 --2- 172.21.15.45:0/2097397695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d2815c060 0x7f5d280b4ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009820 tx=0x7f5d2401c470 comp rx=0 tx=0).stop 2023-07-09T02:11:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d2f711640 1 -- 172.21.15.45:0/2097397695 shutdown_connections 2023-07-09T02:11:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d2f711640 1 --2- 172.21.15.45:0/2097397695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d2815c060 0x7f5d280b4ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d2f711640 1 -- 172.21.15.45:0/2097397695 >> 172.21.15.45:0/2097397695 conn(0x7f5d280698e0 msgr2=0x7f5d28069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d2f711640 1 -- 172.21.15.45:0/2097397695 shutdown_connections 2023-07-09T02:11:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.052+0000 7f5d2f711640 1 -- 172.21.15.45:0/2097397695 wait complete. 2023-07-09T02:11:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 Processor -- start 2023-07-09T02:11:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 -- start start 2023-07-09T02:11:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d280cd120 0x7f5d28155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d280d2620 0x7f5d2815f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2815c060 0x7f5d280ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28156590 con 0x7f5d2815c060 2023-07-09T02:11:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815c790 con 0x7f5d280d2620 2023-07-09T02:11:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2815ca70 con 0x7f5d280cd120 2023-07-09T02:11:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2815c060 0x7f5d280ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2815c060 0x7f5d280ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40320/0 (socket says 172.21.15.45:40320) 2023-07-09T02:11:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 -- 172.21.15.45:0/2989574521 learned_addr learned my addr 172.21.15.45:0/2989574521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2ccac640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d280d2620 0x7f5d2815f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2d4ad640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d280cd120 0x7f5d28155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 -- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d280cd120 msgr2=0x7f5d28155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d280cd120 0x7f5d28155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 -- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d280d2620 msgr2=0x7f5d2815f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d280d2620 0x7f5d2815f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 -- 172.21.15.45:0/2989574521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24009420 con 0x7f5d2815c060 2023-07-09T02:11:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2ccac640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d280d2620 0x7f5d2815f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:19.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2dcae640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2815c060 0x7f5d280ca970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d20002240 tx=0x7f5d2000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:19.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d1dffb640 1 -- 172.21.15.45:0/2989574521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000cea0 con 0x7f5d2815c060 2023-07-09T02:11:19.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d1dffb640 1 -- 172.21.15.45:0/2989574521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000a640 con 0x7f5d2815c060 2023-07-09T02:11:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d1dffb640 1 -- 172.21.15.45:0/2989574521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000a9f0 con 0x7f5d2815c060 2023-07-09T02:11:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d280b59f0 con 0x7f5d2815c060 2023-07-09T02:11:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.056+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2815d030 con 0x7f5d2815c060 2023-07-09T02:11:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.060+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2815d240 con 0x7f5d2815c060 2023-07-09T02:11:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.060+0000 7f5d1dffb640 1 -- 172.21.15.45:0/2989574521 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d2000ab50 con 0x7f5d2815c060 2023-07-09T02:11:19.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.060+0000 7f5d1dffb640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d0c0662b0 0x7f5d0c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:19.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.060+0000 7f5d1dffb640 1 -- 172.21.15.45:0/2989574521 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d20083180 con 0x7f5d2815c060 2023-07-09T02:11:19.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.060+0000 7f5d2d4ad640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d0c0662b0 0x7f5d0c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:19.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.064+0000 7f5d2d4ad640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d0c0662b0 0x7f5d0c068760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d240af000 tx=0x7f5d240a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:19.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.064+0000 7f5d1dffb640 1 -- 172.21.15.45:0/2989574521 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d200505f0 con 0x7f5d2815c060 2023-07-09T02:11:19.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:19.256+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5d2804d7d0 con 0x7f5d2815c060 2023-07-09T02:11:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.188+0000 7f5d1dffb640 1 -- 172.21.15.45:0/2989574521 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5d20053c10 con 0x7f5d2815c060 2023-07-09T02:11:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d0c0662b0 msgr2=0x7f5d0c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d0c0662b0 0x7f5d0c068760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d240af000 tx=0x7f5d240a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2815c060 msgr2=0x7f5d280ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2815c060 0x7f5d280ca970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d20002240 tx=0x7f5d2000cc50 comp rx=0 tx=0).stop 2023-07-09T02:11:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 shutdown_connections 2023-07-09T02:11:20.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d2815c060 0x7f5d280ca970 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d280d2620 0x7f5d2815f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d0c0662b0 0x7f5d0c068760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 --2- 172.21.15.45:0/2989574521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d280cd120 0x7f5d28155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 >> 172.21.15.45:0/2989574521 conn(0x7f5d280698e0 msgr2=0x7f5d280b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:20.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 shutdown_connections 2023-07-09T02:11:20.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.192+0000 7f5d2f711640 1 -- 172.21.15.45:0/2989574521 wait complete. 2023-07-09T02:11:20.217 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2023-07-09T02:11:20.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:11:20.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.364+0000 7f3efffd2640 1 Processor -- start 2023-07-09T02:11:20.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.364+0000 7f3efffd2640 1 -- start start 2023-07-09T02:11:20.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.364+0000 7f3efffd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef815c060 0x7f3ef80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:20.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.364+0000 7f3efffd2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3ef80d2620 0x7f3ef80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:20.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.364+0000 7f3efffd2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef8160a50 con 0x7f3ef80cd120 2023-07-09T02:11:20.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.364+0000 7f3efffd2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef815c430 con 0x7f3ef80d2620 2023-07-09T02:11:20.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.364+0000 7f3efffd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef815fb60 con 0x7f3ef815c060 2023-07-09T02:11:20.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.364+0000 7f3efd56d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3ef80cd120 0x7f3ef80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51964/0 (socket says 172.21.15.45:51964) 2023-07-09T02:11:20.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efd56d640 1 -- 172.21.15.45:0/3645223529 learned_addr learned my addr 172.21.15.45:0/3645223529 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:20.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efdd6e640 1 --2- 172.21.15.45:0/3645223529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef815c060 0x7f3ef80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:20.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efe56f640 1 --2- 172.21.15.45:0/3645223529 >> v2:172.21.15.155:3300/0 conn(0x7f3ef80d2620 0x7f3ef80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:20.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efcd6c640 1 -- 172.21.15.45:0/3645223529 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918475968 0 0) 0x7f3ef8160a50 con 0x7f3ef80cd120 2023-07-09T02:11:20.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efcd6c640 1 -- 172.21.15.45:0/3645223529 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee4003530 con 0x7f3ef80cd120 2023-07-09T02:11:20.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efdd6e640 1 -- 172.21.15.45:0/3645223529 >> v2:172.21.15.155:3300/0 conn(0x7f3ef80d2620 msgr2=0x7f3ef80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:20.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efdd6e640 1 --2- 172.21.15.45:0/3645223529 >> v2:172.21.15.155:3300/0 conn(0x7f3ef80d2620 0x7f3ef80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efdd6e640 1 -- 172.21.15.45:0/3645223529 >> v1:172.21.15.45:6789/0 conn(0x7f3ef80cd120 legacy=0x7f3ef80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:20.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efdd6e640 1 -- 172.21.15.45:0/3645223529 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef815fe40 con 0x7f3ef815c060 2023-07-09T02:11:20.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efe56f640 1 --2- 172.21.15.45:0/3645223529 >> v2:172.21.15.155:3300/0 conn(0x7f3ef80d2620 0x7f3ef80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:20.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.368+0000 7f3efdd6e640 1 --2- 172.21.15.45:0/3645223529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef815c060 0x7f3ef80b4ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40097f0 tx=0x7f3ef401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5cca86cc75b3e2e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:20.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efcd6c640 1 -- 172.21.15.45:0/3645223529 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40ab650 con 0x7f3ef815c060 2023-07-09T02:11:20.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efcd6c640 1 -- 172.21.15.45:0/3645223529 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef40ab7b0 con 0x7f3ef815c060 2023-07-09T02:11:20.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efcd6c640 1 -- 172.21.15.45:0/3645223529 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40abb40 con 0x7f3ef815c060 2023-07-09T02:11:20.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- 172.21.15.45:0/3645223529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef815c060 msgr2=0x7f3ef80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:20.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3645223529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef815c060 0x7f3ef80b4ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40097f0 tx=0x7f3ef401c450 comp rx=0 tx=0).stop 2023-07-09T02:11:20.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- 172.21.15.45:0/3645223529 shutdown_connections 2023-07-09T02:11:20.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3645223529 >> v2:172.21.15.155:3300/0 conn(0x7f3ef80d2620 0x7f3ef80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3645223529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef815c060 0x7f3ef80b4ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- 172.21.15.45:0/3645223529 >> 172.21.15.45:0/3645223529 conn(0x7f3ef80698e0 msgr2=0x7f3ef8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:20.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- 172.21.15.45:0/3645223529 shutdown_connections 2023-07-09T02:11:20.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- 172.21.15.45:0/3645223529 wait complete. 2023-07-09T02:11:20.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 Processor -- start 2023-07-09T02:11:20.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- start start 2023-07-09T02:11:20.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef80cd120 0x7f3ef80cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:20.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef80d2620 0x7f3ef80b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:20.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ef815c060 0x7f3ef80b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:20.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef815c690 con 0x7f3ef815c060 2023-07-09T02:11:20.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80ccf40 con 0x7f3ef80d2620 2023-07-09T02:11:20.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efffd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80b3540 con 0x7f3ef80cd120 2023-07-09T02:11:20.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efe56f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ef815c060 0x7f3ef80b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:20.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efe56f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ef815c060 0x7f3ef80b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40334/0 (socket says 172.21.15.45:40334) 2023-07-09T02:11:20.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.372+0000 7f3efe56f640 1 -- 172.21.15.45:0/3894942185 learned_addr learned my addr 172.21.15.45:0/3894942185 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:20.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efd56d640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef80d2620 0x7f3ef80b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:20.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efdd6e640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef80cd120 0x7f3ef80cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:20.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efe56f640 1 -- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef80cd120 msgr2=0x7f3ef80cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:20.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efe56f640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef80cd120 0x7f3ef80cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efe56f640 1 -- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef80d2620 msgr2=0x7f3ef80b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:20.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efe56f640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef80d2620 0x7f3ef80b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:20.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efe56f640 1 -- 172.21.15.45:0/3894942185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0009a70 con 0x7f3ef815c060 2023-07-09T02:11:20.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efe56f640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ef815c060 0x7f3ef80b2e70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000efc0 tx=0x7f3ef000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:20.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3eee7fc640 1 -- 172.21.15.45:0/3894942185 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0014480 con 0x7f3ef815c060 2023-07-09T02:11:20.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3eee7fc640 1 -- 172.21.15.45:0/3894942185 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef000f040 con 0x7f3ef815c060 2023-07-09T02:11:20.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3eee7fc640 1 -- 172.21.15.45:0/3894942185 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0014840 con 0x7f3ef815c060 2023-07-09T02:11:20.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef4009420 con 0x7f3ef815c060 2023-07-09T02:11:20.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef80b59f0 con 0x7f3ef815c060 2023-07-09T02:11:20.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef815c840 con 0x7f3ef815c060 2023-07-09T02:11:20.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.376+0000 7f3eee7fc640 1 -- 172.21.15.45:0/3894942185 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ef00149a0 con 0x7f3ef815c060 2023-07-09T02:11:20.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.380+0000 7f3eee7fc640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3edc0662b0 0x7f3edc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:20.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.380+0000 7f3eee7fc640 1 -- 172.21.15.45:0/3894942185 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ef0084c00 con 0x7f3ef815c060 2023-07-09T02:11:20.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.380+0000 7f3efdd6e640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3edc0662b0 0x7f3edc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:20.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.380+0000 7f3efdd6e640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3edc0662b0 0x7f3edc068760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40af000 tx=0x7f3ef40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:20.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.384+0000 7f3eee7fc640 1 -- 172.21.15.45:0/3894942185 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ef815c840 con 0x7f3ef815c060 2023-07-09T02:11:20.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:20.568+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3ef804d7d0 con 0x7f3ef815c060 2023-07-09T02:11:21.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3eee7fc640 1 -- 172.21.15.45:0/3894942185 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ef0018070 con 0x7f3ef815c060 2023-07-09T02:11:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3edc0662b0 msgr2=0x7f3edc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3edc0662b0 0x7f3edc068760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40af000 tx=0x7f3ef40a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ef815c060 msgr2=0x7f3ef80b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ef815c060 0x7f3ef80b2e70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000efc0 tx=0x7f3ef000c490 comp rx=0 tx=0).stop 2023-07-09T02:11:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 shutdown_connections 2023-07-09T02:11:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ef815c060 0x7f3ef80b2e70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ef80d2620 0x7f3ef80b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3edc0662b0 0x7f3edc068760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 --2- 172.21.15.45:0/3894942185 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ef80cd120 0x7f3ef80cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 >> 172.21.15.45:0/3894942185 conn(0x7f3ef80698e0 msgr2=0x7f3ef80b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 shutdown_connections 2023-07-09T02:11:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.192+0000 7f3efffd2640 1 -- 172.21.15.45:0/3894942185 wait complete. 2023-07-09T02:11:21.217 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:11:21.218 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:11:21.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.360+0000 7fb4542bd640 1 Processor -- start 2023-07-09T02:11:21.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.360+0000 7fb4542bd640 1 -- start start 2023-07-09T02:11:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.360+0000 7fb4542bd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb44c0d2620 0x7fb44c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.360+0000 7fb4542bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb44c0cd120 0x7fb44c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.360+0000 7fb4542bd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c160a50 con 0x7fb44c15c060 2023-07-09T02:11:21.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.360+0000 7fb4542bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c15c430 con 0x7fb44c0cd120 2023-07-09T02:11:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.360+0000 7fb4542bd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c15fb60 con 0x7fb44c0d2620 2023-07-09T02:11:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb45285a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb44c0cd120 0x7fb44c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb45285a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb44c0cd120 0x7fb44c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40342/0 (socket says 172.21.15.45:40342) 2023-07-09T02:11:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb45285a640 1 -- 172.21.15.45:0/16762719 learned_addr learned my addr 172.21.15.45:0/16762719 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:21.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb451858640 1 --2- 172.21.15.45:0/16762719 >> v2:172.21.15.155:3300/0 conn(0x7fb44c0d2620 0x7fb44c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb45285a640 1 -- 172.21.15.45:0/16762719 >> v2:172.21.15.155:3300/0 conn(0x7fb44c0d2620 msgr2=0x7fb44c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:21.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb45285a640 1 --2- 172.21.15.45:0/16762719 >> v2:172.21.15.155:3300/0 conn(0x7fb44c0d2620 0x7fb44c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb45285a640 1 -- 172.21.15.45:0/16762719 >> v1:172.21.15.155:6789/0 conn(0x7fb44c15c060 legacy=0x7fb44c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb45285a640 1 -- 172.21.15.45:0/16762719 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c15fe40 con 0x7fb44c0cd120 2023-07-09T02:11:21.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb45285a640 1 --2- 172.21.15.45:0/16762719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0cd120 0x7fb44c0cee30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb44c15fac0 tx=0x7fb44401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8524a4f33d025b5b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb451057640 1 -- 172.21.15.45:0/16762719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4440a5860 con 0x7fb44c0cd120 2023-07-09T02:11:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb451057640 1 -- 172.21.15.45:0/16762719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4440a59c0 con 0x7fb44c0cd120 2023-07-09T02:11:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.364+0000 7fb451057640 1 -- 172.21.15.45:0/16762719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4440a5d50 con 0x7fb44c0cd120 2023-07-09T02:11:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- 172.21.15.45:0/16762719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0cd120 msgr2=0x7fb44c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 --2- 172.21.15.45:0/16762719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0cd120 0x7fb44c0cee30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb44c15fac0 tx=0x7fb44401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- 172.21.15.45:0/16762719 shutdown_connections 2023-07-09T02:11:21.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 --2- 172.21.15.45:0/16762719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0cd120 0x7fb44c0cee30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 --2- 172.21.15.45:0/16762719 >> v2:172.21.15.155:3300/0 conn(0x7fb44c0d2620 0x7fb44c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- 172.21.15.45:0/16762719 >> 172.21.15.45:0/16762719 conn(0x7fb44c0698e0 msgr2=0x7fb44c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:21.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- 172.21.15.45:0/16762719 shutdown_connections 2023-07-09T02:11:21.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- 172.21.15.45:0/16762719 wait complete. 2023-07-09T02:11:21.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 Processor -- start 2023-07-09T02:11:21.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- start start 2023-07-09T02:11:21.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44c0cd120 0x7fb44c0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0d2620 0x7fb44c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44c15c060 0x7fb44c15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0b3a30 con 0x7fb44c0d2620 2023-07-09T02:11:21.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c15ad20 con 0x7fb44c15c060 2023-07-09T02:11:21.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb4542bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0c8d00 con 0x7fb44c0cd120 2023-07-09T02:11:21.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb451858640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0d2620 0x7fb44c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb451858640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0d2620 0x7fb44c159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40358/0 (socket says 172.21.15.45:40358) 2023-07-09T02:11:21.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb451858640 1 -- 172.21.15.45:0/2485127938 learned_addr learned my addr 172.21.15.45:0/2485127938 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:21.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb45285a640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44c15c060 0x7fb44c15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb452059640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44c0cd120 0x7fb44c0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb451858640 1 -- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44c0cd120 msgr2=0x7fb44c0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb451858640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44c0cd120 0x7fb44c0c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb451858640 1 -- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44c15c060 msgr2=0x7fb44c15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb451858640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44c15c060 0x7fb44c15d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb451858640 1 -- 172.21.15.45:0/2485127938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444009b30 con 0x7fb44c0d2620 2023-07-09T02:11:21.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.368+0000 7fb452059640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44c0cd120 0x7fb44c0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:21.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb451858640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0d2620 0x7fb44c159cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00d800 tx=0x7fb43c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:21.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb442ffd640 1 -- 172.21.15.45:0/2485127938 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00b6c0 con 0x7fb44c0d2620 2023-07-09T02:11:21.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb442ffd640 1 -- 172.21.15.45:0/2485127938 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c00b820 con 0x7fb44c0d2620 2023-07-09T02:11:21.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c0b59f0 con 0x7fb44c0d2620 2023-07-09T02:11:21.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb442ffd640 1 -- 172.21.15.45:0/2485127938 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00bbd0 con 0x7fb44c0d2620 2023-07-09T02:11:21.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c15aa40 con 0x7fb44c0d2620 2023-07-09T02:11:21.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c0b3be0 con 0x7fb44c0d2620 2023-07-09T02:11:21.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb442ffd640 1 -- 172.21.15.45:0/2485127938 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb43c00bd30 con 0x7fb44c0d2620 2023-07-09T02:11:21.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb442ffd640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb430066280 0x7fb430068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb442ffd640 1 -- 172.21.15.45:0/2485127938 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb43c084210 con 0x7fb44c0d2620 2023-07-09T02:11:21.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.372+0000 7fb452059640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb430066280 0x7fb430068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.376+0000 7fb452059640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb430066280 0x7fb430068730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb448000f70 tx=0x7fb448009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:21.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.376+0000 7fb442ffd640 1 -- 172.21.15.45:0/2485127938 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb43c055110 con 0x7fb44c0d2620 2023-07-09T02:11:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb44c04d7d0 con 0x7fb44c0d2620 2023-07-09T02:11:21.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb442ffd640 1 -- 172.21.15.45:0/2485127938 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fb43c054ca0 con 0x7fb44c0d2620 2023-07-09T02:11:21.571 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:21.571 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:11:17.535245+0000","modified":"2023-07-09T02:11:21.190690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T02:11:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-07-09T02:11:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb430066280 msgr2=0x7fb430068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb430066280 0x7fb430068730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb448000f70 tx=0x7fb448009040 comp rx=0 tx=0).stop 2023-07-09T02:11:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0d2620 msgr2=0x7fb44c159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0d2620 0x7fb44c159cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00d800 tx=0x7fb43c00dcc0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 shutdown_connections 2023-07-09T02:11:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44c15c060 0x7fb44c15d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb44c0d2620 0x7fb44c159cb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb430066280 0x7fb430068730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 --2- 172.21.15.45:0/2485127938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44c0cd120 0x7fb44c0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 >> 172.21.15.45:0/2485127938 conn(0x7fb44c0698e0 msgr2=0x7fb44c15b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:21.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 shutdown_connections 2023-07-09T02:11:21.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.568+0000 7fb4542bd640 1 -- 172.21.15.45:0/2485127938 wait complete. 2023-07-09T02:11:21.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.728+0000 7fd3a0be1640 1 Processor -- start 2023-07-09T02:11:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd3a0be1640 1 -- start start 2023-07-09T02:11:21.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd3a0be1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd39c15c1c0 0x7fd39c1607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd3a0be1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd39c0b58d0 0x7fd39c0d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd3a0be1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c0cefe0 con 0x7fd39c0d0980 2023-07-09T02:11:21.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd3a0be1640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0d2850 con 0x7fd39c0b58d0 2023-07-09T02:11:21.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd3a0be1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0cd0d0 con 0x7fd39c15c1c0 2023-07-09T02:11:21.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd393fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd39c0b58d0 0x7fd39c0d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd39ad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd39c0d0980 0x7fd39c0cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48778/0 (socket says 172.21.15.45:48778) 2023-07-09T02:11:21.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd39ad9d640 1 -- 172.21.15.45:0/1173707852 learned_addr learned my addr 172.21.15.45:0/1173707852 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:21.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd39a59c640 1 --2- 172.21.15.45:0/1173707852 >> v2:172.21.15.155:3300/0 conn(0x7fd39c15c1c0 0x7fd39c1607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd393fff640 1 -- 172.21.15.45:0/1173707852 >> v2:172.21.15.155:3300/0 conn(0x7fd39c15c1c0 msgr2=0x7fd39c1607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:21.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd393fff640 1 --2- 172.21.15.45:0/1173707852 >> v2:172.21.15.155:3300/0 conn(0x7fd39c15c1c0 0x7fd39c1607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd393fff640 1 -- 172.21.15.45:0/1173707852 >> v1:172.21.15.45:6789/0 conn(0x7fd39c0d0980 legacy=0x7fd39c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd393fff640 1 -- 172.21.15.45:0/1173707852 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c0cecd0 con 0x7fd39c0b58d0 2023-07-09T02:11:21.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.732+0000 7fd399d9b640 1 -- 172.21.15.45:0/1173707852 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674623521 0 0) 0x7fd39c0cefe0 con 0x7fd39c0d0980 2023-07-09T02:11:21.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd393fff640 1 --2- 172.21.15.45:0/1173707852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0b58d0 0x7fd39c0d2310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0d29e0 tx=0x7fd38401c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb43bcadcb25682b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:21.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd399d9b640 1 -- 172.21.15.45:0/1173707852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840ab600 con 0x7fd39c0b58d0 2023-07-09T02:11:21.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd399d9b640 1 -- 172.21.15.45:0/1173707852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3840a7050 con 0x7fd39c0b58d0 2023-07-09T02:11:21.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd399d9b640 1 -- 172.21.15.45:0/1173707852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840ab980 con 0x7fd39c0b58d0 2023-07-09T02:11:21.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 -- 172.21.15.45:0/1173707852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0b58d0 msgr2=0x7fd39c0d2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/1173707852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0b58d0 0x7fd39c0d2310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0d29e0 tx=0x7fd38401c320 comp rx=0 tx=0).stop 2023-07-09T02:11:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 -- 172.21.15.45:0/1173707852 shutdown_connections 2023-07-09T02:11:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/1173707852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0b58d0 0x7fd39c0d2310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/1173707852 >> v2:172.21.15.155:3300/0 conn(0x7fd39c15c1c0 0x7fd39c1607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 -- 172.21.15.45:0/1173707852 >> 172.21.15.45:0/1173707852 conn(0x7fd39c069980 msgr2=0x7fd39c069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 -- 172.21.15.45:0/1173707852 shutdown_connections 2023-07-09T02:11:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 -- 172.21.15.45:0/1173707852 wait complete. 2023-07-09T02:11:21.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 Processor -- start 2023-07-09T02:11:21.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.736+0000 7fd3a0be1640 1 -- start start 2023-07-09T02:11:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd39c0b58d0 0x7fd39c0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0d0980 0x7fd39c0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd39c15c1c0 0x7fd39c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c153d20 con 0x7fd39c0d0980 2023-07-09T02:11:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c1530e0 con 0x7fd39c0b58d0 2023-07-09T02:11:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c1553f0 con 0x7fd39c15c1c0 2023-07-09T02:11:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0d0980 0x7fd39c0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0d0980 0x7fd39c0b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46084/0 (socket says 172.21.15.45:46084) 2023-07-09T02:11:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 -- 172.21.15.45:0/2964106947 learned_addr learned my addr 172.21.15.45:0/2964106947 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd39a59c640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd39c0b58d0 0x7fd39c0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd39ad9d640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd39c15c1c0 0x7fd39c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 -- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd39c15c1c0 msgr2=0x7fd39c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd39c15c1c0 0x7fd39c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 -- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd39c0b58d0 msgr2=0x7fd39c0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd39c0b58d0 0x7fd39c0c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 -- 172.21.15.45:0/2964106947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384009420 con 0x7fd39c0d0980 2023-07-09T02:11:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd39ad9d640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd39c15c1c0 0x7fd39c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd393fff640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0d0980 0x7fd39c0b48a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd38401a9d0 tx=0x7fd3840190c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd392ffd640 1 -- 172.21.15.45:0/2964106947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840b4410 con 0x7fd39c0d0980 2023-07-09T02:11:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd392ffd640 1 -- 172.21.15.45:0/2964106947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3840b4570 con 0x7fd39c0d0980 2023-07-09T02:11:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c0d0110 con 0x7fd39c0d0980 2023-07-09T02:11:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd392ffd640 1 -- 172.21.15.45:0/2964106947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840b4920 con 0x7fd39c0d0980 2023-07-09T02:11:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c153660 con 0x7fd39c0d0980 2023-07-09T02:11:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.740+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c04d7d0 con 0x7fd39c0d0980 2023-07-09T02:11:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.744+0000 7fd392ffd640 1 -- 172.21.15.45:0/2964106947 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3840b2040 con 0x7fd39c0d0980 2023-07-09T02:11:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.744+0000 7fd392ffd640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd37c066280 0x7fd37c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.744+0000 7fd392ffd640 1 -- 172.21.15.45:0/2964106947 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd38411dc20 con 0x7fd39c0d0980 2023-07-09T02:11:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.744+0000 7fd39a59c640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd37c066280 0x7fd37c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.744+0000 7fd39a59c640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd37c066280 0x7fd37c068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009b60 tx=0x7fd38c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:21.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.748+0000 7fd392ffd640 1 -- 172.21.15.45:0/2964106947 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3840eb140 con 0x7fd39c0d0980 2023-07-09T02:11:21.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.900+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd39c06b830 con 0x7fd39c0d0980 2023-07-09T02:11:21.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd392ffd640 1 -- 172.21.15.45:0/2964106947 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fd3840ee760 con 0x7fd39c0d0980 2023-07-09T02:11:21.905 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:21.906 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:21.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd37c066280 msgr2=0x7fd37c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd37c066280 0x7fd37c068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009b60 tx=0x7fd38c009190 comp rx=0 tx=0).stop 2023-07-09T02:11:21.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0d0980 msgr2=0x7fd39c0b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0d0980 0x7fd39c0b48a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd38401a9d0 tx=0x7fd3840190c0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 shutdown_connections 2023-07-09T02:11:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd37c066280 0x7fd37c068730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd39c15c1c0 0x7fd39c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd39c0d0980 0x7fd39c0b48a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 --2- 172.21.15.45:0/2964106947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd39c0b58d0 0x7fd39c0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 >> 172.21.15.45:0/2964106947 conn(0x7fd39c069980 msgr2=0x7fd39c0b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 shutdown_connections 2023-07-09T02:11:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:21.904+0000 7fd3a0be1640 1 -- 172.21.15.45:0/2964106947 wait complete. 2023-07-09T02:11:21.928 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:11:21.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:11:22.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e1c76640 1 Processor -- start 2023-07-09T02:11:22.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e1c76640 1 -- start start 2023-07-09T02:11:22.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e1c76640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3dc15c870 0x7fe3dc0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e1c76640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe3dc06b950 0x7fe3dc0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e1c76640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc0b2090 con 0x7fe3dc0b1b50 2023-07-09T02:11:22.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e1c76640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc160520 con 0x7fe3dc15c870 2023-07-09T02:11:22.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e1c76640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc160800 con 0x7fe3dc06b950 2023-07-09T02:11:22.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e0c74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3dc15c870 0x7fe3dc0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3dbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe3dc0b1b50 0x7fe3dc06b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48788/0 (socket says 172.21.15.45:48788) 2023-07-09T02:11:22.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e0c74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3dc15c870 0x7fe3dc0b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46086/0 (socket says 172.21.15.45:46086) 2023-07-09T02:11:22.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3dbfff640 1 -- 172.21.15.45:0/3972701143 learned_addr learned my addr 172.21.15.45:0/3972701143 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:22.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e1475640 1 --2- 172.21.15.45:0/3972701143 >> v2:172.21.15.155:3300/0 conn(0x7fe3dc06b950 0x7fe3dc0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e0c74640 1 -- 172.21.15.45:0/3972701143 >> v2:172.21.15.155:3300/0 conn(0x7fe3dc06b950 msgr2=0x7fe3dc0d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:22.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e0c74640 1 --2- 172.21.15.45:0/3972701143 >> v2:172.21.15.155:3300/0 conn(0x7fe3dc06b950 0x7fe3dc0d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e0c74640 1 -- 172.21.15.45:0/3972701143 >> v1:172.21.15.45:6789/0 conn(0x7fe3dc0b1b50 legacy=0x7fe3dc06b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3e0c74640 1 -- 172.21.15.45:0/3972701143 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc160ae0 con 0x7fe3dc15c870 2023-07-09T02:11:22.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.068+0000 7fe3db7fe640 1 -- 172.21.15.45:0/3972701143 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226862663 0 0) 0x7fe3dc0b2090 con 0x7fe3dc0b1b50 2023-07-09T02:11:22.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e0c74640 1 --2- 172.21.15.45:0/3972701143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0b1610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0cfe90 tx=0x7fe3d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549ddb99bd02a5e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3db7fe640 1 -- 172.21.15.45:0/3972701143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00ac630 con 0x7fe3dc15c870 2023-07-09T02:11:22.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3db7fe640 1 -- 172.21.15.45:0/3972701143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d00ac790 con 0x7fe3dc15c870 2023-07-09T02:11:22.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3db7fe640 1 -- 172.21.15.45:0/3972701143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00acb20 con 0x7fe3dc15c870 2023-07-09T02:11:22.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e1c76640 1 -- 172.21.15.45:0/3972701143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 msgr2=0x7fe3dc0b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/3972701143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0b1610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc0cfe90 tx=0x7fe3d001c430 comp rx=0 tx=0).stop 2023-07-09T02:11:22.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e1c76640 1 -- 172.21.15.45:0/3972701143 shutdown_connections 2023-07-09T02:11:22.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/3972701143 >> v2:172.21.15.155:3300/0 conn(0x7fe3dc06b950 0x7fe3dc0d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/3972701143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0b1610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e1c76640 1 -- 172.21.15.45:0/3972701143 >> 172.21.15.45:0/3972701143 conn(0x7fe3dc070be0 msgr2=0x7fe3dc070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:22.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e1c76640 1 -- 172.21.15.45:0/3972701143 shutdown_connections 2023-07-09T02:11:22.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.072+0000 7fe3e1c76640 1 -- 172.21.15.45:0/3972701143 wait complete. 2023-07-09T02:11:22.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 Processor -- start 2023-07-09T02:11:22.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 -- start start 2023-07-09T02:11:22.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3dc06b950 0x7fe3dc14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3dc0b1b50 0x7fe3dc0cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0b5a30 con 0x7fe3dc15c870 2023-07-09T02:11:22.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc158d30 con 0x7fe3dc0b1b50 2023-07-09T02:11:22.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc159010 con 0x7fe3dc06b950 2023-07-09T02:11:22.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46088/0 (socket says 172.21.15.45:46088) 2023-07-09T02:11:22.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 -- 172.21.15.45:0/2354177225 learned_addr learned my addr 172.21.15.45:0/2354177225 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:22.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e0c74640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3dc06b950 0x7fe3dc14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3dbfff640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3dc0b1b50 0x7fe3dc0cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 -- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3dc06b950 msgr2=0x7fe3dc14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3dc06b950 0x7fe3dc14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 -- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3dc0b1b50 msgr2=0x7fe3dc0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3dc0b1b50 0x7fe3dc0cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 -- 172.21.15.45:0/2354177225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0009420 con 0x7fe3dc15c870 2023-07-09T02:11:22.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1475640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0cc520 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400efc0 tx=0x7fe3d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3d97fa640 1 -- 172.21.15.45:0/2354177225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4009ca0 con 0x7fe3dc15c870 2023-07-09T02:11:22.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3d97fa640 1 -- 172.21.15.45:0/2354177225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d400f040 con 0x7fe3dc15c870 2023-07-09T02:11:22.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3d97fa640 1 -- 172.21.15.45:0/2354177225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40146c0 con 0x7fe3dc15c870 2023-07-09T02:11:22.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc1592f0 con 0x7fe3dc15c870 2023-07-09T02:11:22.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.076+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc150250 con 0x7fe3dc15c870 2023-07-09T02:11:22.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.080+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc0b5be0 con 0x7fe3dc15c870 2023-07-09T02:11:22.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.080+0000 7fe3d97fa640 1 -- 172.21.15.45:0/2354177225 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3d4014820 con 0x7fe3dc15c870 2023-07-09T02:11:22.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.080+0000 7fe3d97fa640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe3c0066280 0x7fe3c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.080+0000 7fe3d97fa640 1 -- 172.21.15.45:0/2354177225 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3d4084cf0 con 0x7fe3dc15c870 2023-07-09T02:11:22.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.080+0000 7fe3e0c74640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe3c0066280 0x7fe3c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.084+0000 7fe3e0c74640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe3c0066280 0x7fe3c0068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00ae000 tx=0x7fe3d00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.084+0000 7fe3d97fa640 1 -- 172.21.15.45:0/2354177225 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3dc0b5be0 con 0x7fe3dc15c870 2023-07-09T02:11:22.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.240+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3dc0cda70 con 0x7fe3c0066280 2023-07-09T02:11:22.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.248+0000 7fe3d97fa640 1 -- 172.21.15.45:0/2354177225 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269616 (secure 0 0 0) 0x7fe3d00bd090 con 0x7fe3c0066280 2023-07-09T02:11:22.253 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:22.263 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:11:22.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe3c0066280 msgr2=0x7fe3c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe3c0066280 0x7fe3c0068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00ae000 tx=0x7fe3d00a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:22.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 msgr2=0x7fe3dc0cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0cc520 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400efc0 tx=0x7fe3d400c490 comp rx=0 tx=0).stop 2023-07-09T02:11:22.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 shutdown_connections 2023-07-09T02:11:22.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3dc15c870 0x7fe3dc0cc520 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3dc0b1b50 0x7fe3dc0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe3c0066280 0x7fe3c0068730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 --2- 172.21.15.45:0/2354177225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3dc06b950 0x7fe3dc14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 >> 172.21.15.45:0/2354177225 conn(0x7fe3dc070be0 msgr2=0x7fe3dc15cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:22.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 shutdown_connections 2023-07-09T02:11:22.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.252+0000 7fe3e1c76640 1 -- 172.21.15.45:0/2354177225 wait complete. 2023-07-09T02:11:22.268 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-07-09T02:11:22.264+0000 7fef95fda640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:11:22.275 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-07-09T02:11:20.526496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560819,"statfs":{"total":1600000000,"available":1598278952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.392687"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.259980+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:11:13.259980+0000","last_peered":"2023-07-09T02:11:13.259980+0000","last_clean":"2023-07-09T02:11:13.259980+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:11:13.259980+0000","last_undegraded":"2023-07-09T02:11:13.259980+0000","last_fullsized":"2023-07-09T02:11:13.259980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:09:14.974380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.127230+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:11:13.127230+0000","last_peered":"2023-07-09T02:11:13.127230+0000","last_clean":"2023-07-09T02:11:13.127230+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:11:13.127230+0000","last_undegraded":"2023-07-09T02:11:13.127230+0000","last_fullsized":"2023-07-09T02:11:13.127230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:52:06.589743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.259895+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:11:13.259895+0000","last_peered":"2023-07-09T02:11:13.259895+0000","last_clean":"2023-07-09T02:11:13.259895+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:11:13.259895+0000","last_undegraded":"2023-07-09T02:11:13.259895+0000","last_fullsized":"2023-07-09T02:11:13.259895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:54:23.462323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.257888+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:11:13.257888+0000","last_peered":"2023-07-09T02:11:13.257888+0000","last_clean":"2023-07-09T02:11:13.257888+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:11:13.257888+0000","last_undegraded":"2023-07-09T02:11:13.257888+0000","last_fullsized":"2023-07-09T02:11:13.257888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:56:31.112210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.127231+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:11:13.127231+0000","last_peered":"2023-07-09T02:11:13.127231+0000","last_clean":"2023-07-09T02:11:13.127231+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:11:13.127231+0000","last_undegraded":"2023-07-09T02:11:13.127231+0000","last_fullsized":"2023-07-09T02:11:13.127231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:41:55.613090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.257953+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:11:13.257953+0000","last_peered":"2023-07-09T02:11:13.257953+0000","last_clean":"2023-07-09T02:11:13.257953+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:11:13.257953+0000","last_undegraded":"2023-07-09T02:11:13.257953+0000","last_fullsized":"2023-07-09T02:11:13.257953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:52:06.589743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.259777+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:11:13.259777+0000","last_peered":"2023-07-09T02:11:13.259777+0000","last_clean":"2023-07-09T02:11:13.259777+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:11:13.259777+0000","last_undegraded":"2023-07-09T02:11:13.259777+0000","last_fullsized":"2023-07-09T02:11:13.259777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:41:53.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.257963+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:11:13.257963+0000","last_peered":"2023-07-09T02:11:13.257963+0000","last_clean":"2023-07-09T02:11:13.257963+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:11:13.257963+0000","last_undegraded":"2023-07-09T02:11:13.257963+0000","last_fullsized":"2023-07-09T02:11:13.257963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:41:53.126858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-07-09T02:11:13.259689+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:11:13.259689+0000","last_peered":"2023-07-09T02:11:13.259689+0000","last_clean":"2023-07-09T02:11:13.259689+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:11:13.259689+0000","last_undegraded":"2023-07-09T02:11:13.259689+0000","last_fullsized":"2023-07-09T02:11:13.259689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:56:31.112210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:17.130040+0000","last_change":"2023-07-09T02:11:17.130040+0000","last_active":"2023-07-09T02:11:17.130040+0000","last_peered":"2023-07-09T02:11:17.130040+0000","last_clean":"2023-07-09T02:11:17.130040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:17.130040+0000","last_undegraded":"2023-07-09T02:11:17.130040+0000","last_fullsized":"2023-07-09T02:11:17.130040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:11:16.127139+0000","last_change":"2023-07-09T02:11:16.127139+0000","last_active":"2023-07-09T02:11:16.127139+0000","last_peered":"2023-07-09T02:11:16.127139+0000","last_clean":"2023-07-09T02:11:16.127139+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:11:16.127139+0000","last_undegraded":"2023-07-09T02:11:16.127139+0000","last_fullsized":"2023-07-09T02:11:16.127139+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":642,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194670,"statfs":{"total":200000000,"available":199342093,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":65,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195246,"statfs":{"total":200000000,"available":199932461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":65,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195246,"statfs":{"total":200000000,"available":199932461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":65,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195246,"statfs":{"total":200000000,"available":199932461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":65,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195246,"statfs":{"total":200000000,"available":199932461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":65,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195246,"statfs":{"total":200000000,"available":199932461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":65,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195246,"statfs":{"total":200000000,"available":199932461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":642,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194670,"statfs":{"total":200000000,"available":199342093,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]}],"pool_statfs":[]}} 2023-07-09T02:11:22.281 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:11:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec5ec5c640 1 Processor -- start 2023-07-09T02:11:22.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec5ec5c640 1 -- start start 2023-07-09T02:11:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec5ec5c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec580d2620 0x7fec580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec5ec5c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec58160a50 con 0x7fec580cd120 2023-07-09T02:11:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec5ec5c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5815c430 con 0x7fec5815c060 2023-07-09T02:11:22.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec5ec5c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5815fb60 con 0x7fec580d2620 2023-07-09T02:11:22.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec5d1f9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fec580cd120 0x7fec580cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48792/0 (socket says 172.21.15.45:48792) 2023-07-09T02:11:22.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec5d1f9640 1 -- 172.21.15.45:0/1061015262 learned_addr learned my addr 172.21.15.45:0/1061015262 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:22.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec57fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec580d2620 0x7fec580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec57fff640 1 -- 172.21.15.45:0/1061015262 >> v1:172.21.15.155:6789/0 conn(0x7fec5815c060 legacy=0x7fec580d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:22.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec57fff640 1 -- 172.21.15.45:0/1061015262 >> v1:172.21.15.45:6789/0 conn(0x7fec580cd120 legacy=0x7fec580cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec577fe640 1 -- 172.21.15.45:0/1061015262 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884639102 0 0) 0x7fec58160a50 con 0x7fec580cd120 2023-07-09T02:11:22.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.456+0000 7fec57fff640 1 -- 172.21.15.45:0/1061015262 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5815fe40 con 0x7fec580d2620 2023-07-09T02:11:22.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec57fff640 1 --2- 172.21.15.45:0/1061015262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec580d2620 0x7fec580b4ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fec440097c0 tx=0x7fec4401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5846919ba2328b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec577fe640 1 -- 172.21.15.45:0/1061015262 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440ab610 con 0x7fec580d2620 2023-07-09T02:11:22.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec577fe640 1 -- 172.21.15.45:0/1061015262 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec440ab770 con 0x7fec580d2620 2023-07-09T02:11:22.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec577fe640 1 -- 172.21.15.45:0/1061015262 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440abb00 con 0x7fec580d2620 2023-07-09T02:11:22.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec5ec5c640 1 -- 172.21.15.45:0/1061015262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec580d2620 msgr2=0x7fec580b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec5ec5c640 1 --2- 172.21.15.45:0/1061015262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec580d2620 0x7fec580b4ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fec440097c0 tx=0x7fec4401c410 comp rx=0 tx=0).stop 2023-07-09T02:11:22.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec5ec5c640 1 -- 172.21.15.45:0/1061015262 shutdown_connections 2023-07-09T02:11:22.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec5ec5c640 1 --2- 172.21.15.45:0/1061015262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec580d2620 0x7fec580b4ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec5ec5c640 1 -- 172.21.15.45:0/1061015262 >> 172.21.15.45:0/1061015262 conn(0x7fec580698e0 msgr2=0x7fec58069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:22.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec5ec5c640 1 -- 172.21.15.45:0/1061015262 shutdown_connections 2023-07-09T02:11:22.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.460+0000 7fec5ec5c640 1 -- 172.21.15.45:0/1061015262 wait complete. 2023-07-09T02:11:22.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 Processor -- start 2023-07-09T02:11:22.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 -- start start 2023-07-09T02:11:22.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec580cd120 0x7fec5815e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec580d2620 0x7fec58166d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec5815c060 0x7fec5815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec58167290 con 0x7fec5815c060 2023-07-09T02:11:22.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5815f0e0 con 0x7fec580cd120 2023-07-09T02:11:22.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5815e840 con 0x7fec580d2620 2023-07-09T02:11:22.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec5815c060 0x7fec5815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec5815c060 0x7fec5815ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46114/0 (socket says 172.21.15.45:46114) 2023-07-09T02:11:22.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 -- 172.21.15.45:0/2139710557 learned_addr learned my addr 172.21.15.45:0/2139710557 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:22.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5c9f8640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec580cd120 0x7fec5815e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec57fff640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec580d2620 0x7fec58166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 -- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec580d2620 msgr2=0x7fec58166d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec580d2620 0x7fec58166d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 -- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec580cd120 msgr2=0x7fec5815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec580cd120 0x7fec5815e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 -- 172.21.15.45:0/2139710557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44009420 con 0x7fec5815c060 2023-07-09T02:11:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5d1f9640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec5815c060 0x7fec5815ab00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec50001570 tx=0x7fec5000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec557fa640 1 -- 172.21.15.45:0/2139710557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5000a640 con 0x7fec5815c060 2023-07-09T02:11:22.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec557fa640 1 -- 172.21.15.45:0/2139710557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5000a7c0 con 0x7fec5815c060 2023-07-09T02:11:22.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec557fa640 1 -- 172.21.15.45:0/2139710557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5000ab70 con 0x7fec5815c060 2023-07-09T02:11:22.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec580b59f0 con 0x7fec5815c060 2023-07-09T02:11:22.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.464+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5815ee00 con 0x7fec5815c060 2023-07-09T02:11:22.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.468+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5804d7d0 con 0x7fec5815c060 2023-07-09T02:11:22.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.468+0000 7fec557fa640 1 -- 172.21.15.45:0/2139710557 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec5000acd0 con 0x7fec5815c060 2023-07-09T02:11:22.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.468+0000 7fec557fa640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec3c066280 0x7fec3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.468+0000 7fec557fa640 1 -- 172.21.15.45:0/2139710557 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec500831d0 con 0x7fec5815c060 2023-07-09T02:11:22.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.468+0000 7fec5c9f8640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec3c066280 0x7fec3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.468+0000 7fec5c9f8640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec3c066280 0x7fec3c068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec580b1f20 tx=0x7fec4c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.472+0000 7fec557fa640 1 -- 172.21.15.45:0/2139710557 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec50050770 con 0x7fec5815c060 2023-07-09T02:11:22.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.624+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec580b5870 con 0x7fec3c066280 2023-07-09T02:11:22.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.632+0000 7fec557fa640 1 -- 172.21.15.45:0/2139710557 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280776 (secure 0 0 0) 0x7fec4c009550 con 0x7fec3c066280 2023-07-09T02:11:22.637 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:22.639 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:11:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec3c066280 msgr2=0x7fec3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec3c066280 0x7fec3c068730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec580b1f20 tx=0x7fec4c009060 comp rx=0 tx=0).stop 2023-07-09T02:11:22.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec5815c060 msgr2=0x7fec5815ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec5815c060 0x7fec5815ab00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec50001570 tx=0x7fec5000cca0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 shutdown_connections 2023-07-09T02:11:22.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec5815c060 0x7fec5815ab00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec3c066280 0x7fec3c068730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec580d2620 0x7fec58166d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 --2- 172.21.15.45:0/2139710557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec580cd120 0x7fec5815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 >> 172.21.15.45:0/2139710557 conn(0x7fec580698e0 msgr2=0x7fec580cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 shutdown_connections 2023-07-09T02:11:22.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.636+0000 7fec5ec5c640 1 -- 172.21.15.45:0/2139710557 wait complete. 2023-07-09T02:11:22.658 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-09T02:11:22.527058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560607,"statfs":{"total":1600000000,"available":1598061660,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001815"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562046+0000","last_change":"2023-07-09T02:11:18.173684+0000","last_active":"2023-07-09T02:11:19.562046+0000","last_peered":"2023-07-09T02:11:19.562046+0000","last_clean":"2023-07-09T02:11:19.562046+0000","last_became_active":"2023-07-09T02:11:18.173257+0000","last_became_peered":"2023-07-09T02:11:18.173257+0000","last_unstale":"2023-07-09T02:11:19.562046+0000","last_undegraded":"2023-07-09T02:11:19.562046+0000","last_fullsized":"2023-07-09T02:11:19.562046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:12:32.920112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172792+0000","last_change":"2023-07-09T02:11:18.184579+0000","last_active":"2023-07-09T02:11:19.172792+0000","last_peered":"2023-07-09T02:11:19.172792+0000","last_clean":"2023-07-09T02:11:19.172792+0000","last_became_active":"2023-07-09T02:11:18.183376+0000","last_became_peered":"2023-07-09T02:11:18.183376+0000","last_unstale":"2023-07-09T02:11:19.172792+0000","last_undegraded":"2023-07-09T02:11:19.172792+0000","last_fullsized":"2023-07-09T02:11:19.172792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564564+0000","last_change":"2023-07-09T02:11:18.185577+0000","last_active":"2023-07-09T02:11:19.564564+0000","last_peered":"2023-07-09T02:11:19.564564+0000","last_clean":"2023-07-09T02:11:19.564564+0000","last_became_active":"2023-07-09T02:11:18.178377+0000","last_became_peered":"2023-07-09T02:11:18.178377+0000","last_unstale":"2023-07-09T02:11:19.564564+0000","last_undegraded":"2023-07-09T02:11:19.564564+0000","last_fullsized":"2023-07-09T02:11:19.564564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:43.483055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563542+0000","last_change":"2023-07-09T02:11:18.181747+0000","last_active":"2023-07-09T02:11:19.563542+0000","last_peered":"2023-07-09T02:11:19.563542+0000","last_clean":"2023-07-09T02:11:19.563542+0000","last_became_active":"2023-07-09T02:11:18.181520+0000","last_became_peered":"2023-07-09T02:11:18.181520+0000","last_unstale":"2023-07-09T02:11:19.563542+0000","last_undegraded":"2023-07-09T02:11:19.563542+0000","last_fullsized":"2023-07-09T02:11:19.563542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:33:17.007038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171528+0000","last_change":"2023-07-09T02:11:18.177270+0000","last_active":"2023-07-09T02:11:19.171528+0000","last_peered":"2023-07-09T02:11:19.171528+0000","last_clean":"2023-07-09T02:11:19.171528+0000","last_became_active":"2023-07-09T02:11:18.177038+0000","last_became_peered":"2023-07-09T02:11:18.177038+0000","last_unstale":"2023-07-09T02:11:19.171528+0000","last_undegraded":"2023-07-09T02:11:19.171528+0000","last_fullsized":"2023-07-09T02:11:19.171528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564101+0000","last_change":"2023-07-09T02:11:18.173084+0000","last_active":"2023-07-09T02:11:19.564101+0000","last_peered":"2023-07-09T02:11:19.564101+0000","last_clean":"2023-07-09T02:11:19.564101+0000","last_became_active":"2023-07-09T02:11:18.172677+0000","last_became_peered":"2023-07-09T02:11:18.172677+0000","last_unstale":"2023-07-09T02:11:19.564101+0000","last_undegraded":"2023-07-09T02:11:19.564101+0000","last_fullsized":"2023-07-09T02:11:19.564101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563535+0000","last_change":"2023-07-09T02:11:18.185042+0000","last_active":"2023-07-09T02:11:19.563535+0000","last_peered":"2023-07-09T02:11:19.563535+0000","last_clean":"2023-07-09T02:11:19.563535+0000","last_became_active":"2023-07-09T02:11:18.184798+0000","last_became_peered":"2023-07-09T02:11:18.184798+0000","last_unstale":"2023-07-09T02:11:19.563535+0000","last_undegraded":"2023-07-09T02:11:19.563535+0000","last_fullsized":"2023-07-09T02:11:19.563535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:50.071215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172736+0000","last_change":"2023-07-09T02:11:18.186766+0000","last_active":"2023-07-09T02:11:19.172736+0000","last_peered":"2023-07-09T02:11:19.172736+0000","last_clean":"2023-07-09T02:11:19.172736+0000","last_became_active":"2023-07-09T02:11:18.186525+0000","last_became_peered":"2023-07-09T02:11:18.186525+0000","last_unstale":"2023-07-09T02:11:19.172736+0000","last_undegraded":"2023-07-09T02:11:19.172736+0000","last_fullsized":"2023-07-09T02:11:19.172736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170756+0000","last_change":"2023-07-09T02:11:18.177146+0000","last_active":"2023-07-09T02:11:19.170756+0000","last_peered":"2023-07-09T02:11:19.170756+0000","last_clean":"2023-07-09T02:11:19.170756+0000","last_became_active":"2023-07-09T02:11:18.176911+0000","last_became_peered":"2023-07-09T02:11:18.176911+0000","last_unstale":"2023-07-09T02:11:19.170756+0000","last_undegraded":"2023-07-09T02:11:19.170756+0000","last_fullsized":"2023-07-09T02:11:19.170756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:20.403700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172657+0000","last_change":"2023-07-09T02:11:18.174518+0000","last_active":"2023-07-09T02:11:19.172657+0000","last_peered":"2023-07-09T02:11:19.172657+0000","last_clean":"2023-07-09T02:11:19.172657+0000","last_became_active":"2023-07-09T02:11:18.174169+0000","last_became_peered":"2023-07-09T02:11:18.174169+0000","last_unstale":"2023-07-09T02:11:19.172657+0000","last_undegraded":"2023-07-09T02:11:19.172657+0000","last_fullsized":"2023-07-09T02:11:19.172657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564275+0000","last_change":"2023-07-09T02:11:18.181947+0000","last_active":"2023-07-09T02:11:19.564275+0000","last_peered":"2023-07-09T02:11:19.564275+0000","last_clean":"2023-07-09T02:11:19.564275+0000","last_became_active":"2023-07-09T02:11:18.181661+0000","last_became_peered":"2023-07-09T02:11:18.181661+0000","last_unstale":"2023-07-09T02:11:19.564275+0000","last_undegraded":"2023-07-09T02:11:19.564275+0000","last_fullsized":"2023-07-09T02:11:19.564275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561229+0000","last_change":"2023-07-09T02:11:18.169793+0000","last_active":"2023-07-09T02:11:19.561229+0000","last_peered":"2023-07-09T02:11:19.561229+0000","last_clean":"2023-07-09T02:11:19.561229+0000","last_became_active":"2023-07-09T02:11:18.169571+0000","last_became_peered":"2023-07-09T02:11:18.169571+0000","last_unstale":"2023-07-09T02:11:19.561229+0000","last_undegraded":"2023-07-09T02:11:19.561229+0000","last_fullsized":"2023-07-09T02:11:19.561229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:23.718200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561169+0000","last_change":"2023-07-09T02:11:18.176157+0000","last_active":"2023-07-09T02:11:19.561169+0000","last_peered":"2023-07-09T02:11:19.561169+0000","last_clean":"2023-07-09T02:11:19.561169+0000","last_became_active":"2023-07-09T02:11:18.175940+0000","last_became_peered":"2023-07-09T02:11:18.175940+0000","last_unstale":"2023-07-09T02:11:19.561169+0000","last_undegraded":"2023-07-09T02:11:19.561169+0000","last_fullsized":"2023-07-09T02:11:19.561169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:40.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172540+0000","last_change":"2023-07-09T02:11:18.180034+0000","last_active":"2023-07-09T02:11:19.172540+0000","last_peered":"2023-07-09T02:11:19.172540+0000","last_clean":"2023-07-09T02:11:19.172540+0000","last_became_active":"2023-07-09T02:11:18.179791+0000","last_became_peered":"2023-07-09T02:11:18.179791+0000","last_unstale":"2023-07-09T02:11:19.172540+0000","last_undegraded":"2023-07-09T02:11:19.172540+0000","last_fullsized":"2023-07-09T02:11:19.172540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563207+0000","last_change":"2023-07-09T02:11:18.181417+0000","last_active":"2023-07-09T02:11:19.563207+0000","last_peered":"2023-07-09T02:11:19.563207+0000","last_clean":"2023-07-09T02:11:19.563207+0000","last_became_active":"2023-07-09T02:11:18.181143+0000","last_became_peered":"2023-07-09T02:11:18.181143+0000","last_unstale":"2023-07-09T02:11:19.563207+0000","last_undegraded":"2023-07-09T02:11:19.563207+0000","last_fullsized":"2023-07-09T02:11:19.563207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564658+0000","last_change":"2023-07-09T02:11:18.173518+0000","last_active":"2023-07-09T02:11:19.564658+0000","last_peered":"2023-07-09T02:11:19.564658+0000","last_clean":"2023-07-09T02:11:19.564658+0000","last_became_active":"2023-07-09T02:11:18.173258+0000","last_became_peered":"2023-07-09T02:11:18.173258+0000","last_unstale":"2023-07-09T02:11:19.564658+0000","last_undegraded":"2023-07-09T02:11:19.564658+0000","last_fullsized":"2023-07-09T02:11:19.564658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:02.674569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170760+0000","last_change":"2023-07-09T02:11:18.177796+0000","last_active":"2023-07-09T02:11:19.170760+0000","last_peered":"2023-07-09T02:11:19.170760+0000","last_clean":"2023-07-09T02:11:19.170760+0000","last_became_active":"2023-07-09T02:11:18.177274+0000","last_became_peered":"2023-07-09T02:11:18.177274+0000","last_unstale":"2023-07-09T02:11:19.170760+0000","last_undegraded":"2023-07-09T02:11:19.170760+0000","last_fullsized":"2023-07-09T02:11:19.170760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:00:38.107933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564294+0000","last_change":"2023-07-09T02:11:18.185844+0000","last_active":"2023-07-09T02:11:19.564294+0000","last_peered":"2023-07-09T02:11:19.564294+0000","last_clean":"2023-07-09T02:11:19.564294+0000","last_became_active":"2023-07-09T02:11:18.182391+0000","last_became_peered":"2023-07-09T02:11:18.182391+0000","last_unstale":"2023-07-09T02:11:19.564294+0000","last_undegraded":"2023-07-09T02:11:19.564294+0000","last_fullsized":"2023-07-09T02:11:19.564294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561387+0000","last_change":"2023-07-09T02:11:18.179371+0000","last_active":"2023-07-09T02:11:19.561387+0000","last_peered":"2023-07-09T02:11:19.561387+0000","last_clean":"2023-07-09T02:11:19.561387+0000","last_became_active":"2023-07-09T02:11:18.179128+0000","last_became_peered":"2023-07-09T02:11:18.179128+0000","last_unstale":"2023-07-09T02:11:19.561387+0000","last_undegraded":"2023-07-09T02:11:19.561387+0000","last_fullsized":"2023-07-09T02:11:19.561387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:57:59.080342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563784+0000","last_change":"2023-07-09T02:11:18.184432+0000","last_active":"2023-07-09T02:11:19.563784+0000","last_peered":"2023-07-09T02:11:19.563784+0000","last_clean":"2023-07-09T02:11:19.563784+0000","last_became_active":"2023-07-09T02:11:18.183864+0000","last_became_peered":"2023-07-09T02:11:18.183864+0000","last_unstale":"2023-07-09T02:11:19.563784+0000","last_undegraded":"2023-07-09T02:11:19.563784+0000","last_fullsized":"2023-07-09T02:11:19.563784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564024+0000","last_change":"2023-07-09T02:11:18.188823+0000","last_active":"2023-07-09T02:11:19.564024+0000","last_peered":"2023-07-09T02:11:19.564024+0000","last_clean":"2023-07-09T02:11:19.564024+0000","last_became_active":"2023-07-09T02:11:18.188604+0000","last_became_peered":"2023-07-09T02:11:18.188604+0000","last_unstale":"2023-07-09T02:11:19.564024+0000","last_undegraded":"2023-07-09T02:11:19.564024+0000","last_fullsized":"2023-07-09T02:11:19.564024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:53:48.209148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170887+0000","last_change":"2023-07-09T02:11:18.175157+0000","last_active":"2023-07-09T02:11:19.170887+0000","last_peered":"2023-07-09T02:11:19.170887+0000","last_clean":"2023-07-09T02:11:19.170887+0000","last_became_active":"2023-07-09T02:11:18.174933+0000","last_became_peered":"2023-07-09T02:11:18.174933+0000","last_unstale":"2023-07-09T02:11:19.170887+0000","last_undegraded":"2023-07-09T02:11:19.170887+0000","last_fullsized":"2023-07-09T02:11:19.170887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561562+0000","last_change":"2023-07-09T02:11:18.176548+0000","last_active":"2023-07-09T02:11:19.561562+0000","last_peered":"2023-07-09T02:11:19.561562+0000","last_clean":"2023-07-09T02:11:19.561562+0000","last_became_active":"2023-07-09T02:11:18.176203+0000","last_became_peered":"2023-07-09T02:11:18.176203+0000","last_unstale":"2023-07-09T02:11:19.561562+0000","last_undegraded":"2023-07-09T02:11:19.561562+0000","last_fullsized":"2023-07-09T02:11:19.561562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563255+0000","last_change":"2023-07-09T02:11:18.191520+0000","last_active":"2023-07-09T02:11:19.563255+0000","last_peered":"2023-07-09T02:11:19.563255+0000","last_clean":"2023-07-09T02:11:19.563255+0000","last_became_active":"2023-07-09T02:11:18.191142+0000","last_became_peered":"2023-07-09T02:11:18.191142+0000","last_unstale":"2023-07-09T02:11:19.563255+0000","last_undegraded":"2023-07-09T02:11:19.563255+0000","last_fullsized":"2023-07-09T02:11:19.563255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:59.682786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170337+0000","last_change":"2023-07-09T02:11:18.178639+0000","last_active":"2023-07-09T02:11:19.170337+0000","last_peered":"2023-07-09T02:11:19.170337+0000","last_clean":"2023-07-09T02:11:19.170337+0000","last_became_active":"2023-07-09T02:11:18.177944+0000","last_became_peered":"2023-07-09T02:11:18.177944+0000","last_unstale":"2023-07-09T02:11:19.170337+0000","last_undegraded":"2023-07-09T02:11:19.170337+0000","last_fullsized":"2023-07-09T02:11:19.170337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170201+0000","last_change":"2023-07-09T02:11:18.177229+0000","last_active":"2023-07-09T02:11:19.170201+0000","last_peered":"2023-07-09T02:11:19.170201+0000","last_clean":"2023-07-09T02:11:19.170201+0000","last_became_active":"2023-07-09T02:11:18.174701+0000","last_became_peered":"2023-07-09T02:11:18.174701+0000","last_unstale":"2023-07-09T02:11:19.170201+0000","last_undegraded":"2023-07-09T02:11:19.170201+0000","last_fullsized":"2023-07-09T02:11:19.170201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172888+0000","last_change":"2023-07-09T02:11:18.184736+0000","last_active":"2023-07-09T02:11:19.172888+0000","last_peered":"2023-07-09T02:11:19.172888+0000","last_clean":"2023-07-09T02:11:19.172888+0000","last_became_active":"2023-07-09T02:11:18.183702+0000","last_became_peered":"2023-07-09T02:11:18.183702+0000","last_unstale":"2023-07-09T02:11:19.172888+0000","last_undegraded":"2023-07-09T02:11:19.172888+0000","last_fullsized":"2023-07-09T02:11:19.172888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170226+0000","last_change":"2023-07-09T02:11:18.179358+0000","last_active":"2023-07-09T02:11:19.170226+0000","last_peered":"2023-07-09T02:11:19.170226+0000","last_clean":"2023-07-09T02:11:19.170226+0000","last_became_active":"2023-07-09T02:11:18.179041+0000","last_became_peered":"2023-07-09T02:11:18.179041+0000","last_unstale":"2023-07-09T02:11:19.170226+0000","last_undegraded":"2023-07-09T02:11:19.170226+0000","last_fullsized":"2023-07-09T02:11:19.170226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561417+0000","last_change":"2023-07-09T02:11:18.188613+0000","last_active":"2023-07-09T02:11:19.561417+0000","last_peered":"2023-07-09T02:11:19.561417+0000","last_clean":"2023-07-09T02:11:19.561417+0000","last_became_active":"2023-07-09T02:11:18.188077+0000","last_became_peered":"2023-07-09T02:11:18.188077+0000","last_unstale":"2023-07-09T02:11:19.561417+0000","last_undegraded":"2023-07-09T02:11:19.561417+0000","last_fullsized":"2023-07-09T02:11:19.561417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563907+0000","last_change":"2023-07-09T02:11:18.184235+0000","last_active":"2023-07-09T02:11:19.563907+0000","last_peered":"2023-07-09T02:11:19.563907+0000","last_clean":"2023-07-09T02:11:19.563907+0000","last_became_active":"2023-07-09T02:11:18.183126+0000","last_became_peered":"2023-07-09T02:11:18.183126+0000","last_unstale":"2023-07-09T02:11:19.563907+0000","last_undegraded":"2023-07-09T02:11:19.563907+0000","last_fullsized":"2023-07-09T02:11:19.563907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561806+0000","last_change":"2023-07-09T02:11:18.183267+0000","last_active":"2023-07-09T02:11:19.561806+0000","last_peered":"2023-07-09T02:11:19.561806+0000","last_clean":"2023-07-09T02:11:19.561806+0000","last_became_active":"2023-07-09T02:11:18.182978+0000","last_became_peered":"2023-07-09T02:11:18.182978+0000","last_unstale":"2023-07-09T02:11:19.561806+0000","last_undegraded":"2023-07-09T02:11:19.561806+0000","last_fullsized":"2023-07-09T02:11:19.561806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563259+0000","last_change":"2023-07-09T02:11:18.178491+0000","last_active":"2023-07-09T02:11:19.563259+0000","last_peered":"2023-07-09T02:11:19.563259+0000","last_clean":"2023-07-09T02:11:19.563259+0000","last_became_active":"2023-07-09T02:11:18.178285+0000","last_became_peered":"2023-07-09T02:11:18.178285+0000","last_unstale":"2023-07-09T02:11:19.563259+0000","last_undegraded":"2023-07-09T02:11:19.563259+0000","last_fullsized":"2023-07-09T02:11:19.563259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:38:30.347354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561750+0000","last_change":"2023-07-09T02:11:18.177165+0000","last_active":"2023-07-09T02:11:19.561750+0000","last_peered":"2023-07-09T02:11:19.561750+0000","last_clean":"2023-07-09T02:11:19.561750+0000","last_became_active":"2023-07-09T02:11:18.176521+0000","last_became_peered":"2023-07-09T02:11:18.176521+0000","last_unstale":"2023-07-09T02:11:19.561750+0000","last_undegraded":"2023-07-09T02:11:19.561750+0000","last_fullsized":"2023-07-09T02:11:19.561750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563364+0000","last_change":"2023-07-09T02:11:17.152607+0000","last_active":"2023-07-09T02:11:19.563364+0000","last_peered":"2023-07-09T02:11:19.563364+0000","last_clean":"2023-07-09T02:11:19.563364+0000","last_became_active":"2023-07-09T02:11:17.152046+0000","last_became_peered":"2023-07-09T02:11:17.152046+0000","last_unstale":"2023-07-09T02:11:19.563364+0000","last_undegraded":"2023-07-09T02:11:19.563364+0000","last_fullsized":"2023-07-09T02:11:19.563364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:37.921896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172894+0000","last_change":"2023-07-09T02:11:18.182781+0000","last_active":"2023-07-09T02:11:19.172894+0000","last_peered":"2023-07-09T02:11:19.172894+0000","last_clean":"2023-07-09T02:11:19.172894+0000","last_became_active":"2023-07-09T02:11:18.182536+0000","last_became_peered":"2023-07-09T02:11:18.182536+0000","last_unstale":"2023-07-09T02:11:19.172894+0000","last_undegraded":"2023-07-09T02:11:19.172894+0000","last_fullsized":"2023-07-09T02:11:19.172894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:43.483055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171507+0000","last_change":"2023-07-09T02:11:17.146484+0000","last_active":"2023-07-09T02:11:19.171507+0000","last_peered":"2023-07-09T02:11:19.171507+0000","last_clean":"2023-07-09T02:11:19.171507+0000","last_became_active":"2023-07-09T02:11:17.146040+0000","last_became_peered":"2023-07-09T02:11:17.146040+0000","last_unstale":"2023-07-09T02:11:19.171507+0000","last_undegraded":"2023-07-09T02:11:19.171507+0000","last_fullsized":"2023-07-09T02:11:19.171507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:52.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171017+0000","last_change":"2023-07-09T02:11:18.177946+0000","last_active":"2023-07-09T02:11:19.171017+0000","last_peered":"2023-07-09T02:11:19.171017+0000","last_clean":"2023-07-09T02:11:19.171017+0000","last_became_active":"2023-07-09T02:11:18.177582+0000","last_became_peered":"2023-07-09T02:11:18.177582+0000","last_unstale":"2023-07-09T02:11:19.171017+0000","last_undegraded":"2023-07-09T02:11:19.171017+0000","last_fullsized":"2023-07-09T02:11:19.171017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563900+0000","last_change":"2023-07-09T02:11:17.154743+0000","last_active":"2023-07-09T02:11:19.563900+0000","last_peered":"2023-07-09T02:11:19.563900+0000","last_clean":"2023-07-09T02:11:19.563900+0000","last_became_active":"2023-07-09T02:11:17.154330+0000","last_became_peered":"2023-07-09T02:11:17.154330+0000","last_unstale":"2023-07-09T02:11:19.563900+0000","last_undegraded":"2023-07-09T02:11:19.563900+0000","last_fullsized":"2023-07-09T02:11:19.563900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:04.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561666+0000","last_change":"2023-07-09T02:11:18.184685+0000","last_active":"2023-07-09T02:11:19.561666+0000","last_peered":"2023-07-09T02:11:19.561666+0000","last_clean":"2023-07-09T02:11:19.561666+0000","last_became_active":"2023-07-09T02:11:18.184454+0000","last_became_peered":"2023-07-09T02:11:18.184454+0000","last_unstale":"2023-07-09T02:11:19.561666+0000","last_undegraded":"2023-07-09T02:11:19.561666+0000","last_fullsized":"2023-07-09T02:11:19.561666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563353+0000","last_change":"2023-07-09T02:11:17.152301+0000","last_active":"2023-07-09T02:11:19.563353+0000","last_peered":"2023-07-09T02:11:19.563353+0000","last_clean":"2023-07-09T02:11:19.563353+0000","last_became_active":"2023-07-09T02:11:17.151929+0000","last_became_peered":"2023-07-09T02:11:17.151929+0000","last_unstale":"2023-07-09T02:11:19.563353+0000","last_undegraded":"2023-07-09T02:11:19.563353+0000","last_fullsized":"2023-07-09T02:11:19.563353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:47:02.917368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563397+0000","last_change":"2023-07-09T02:11:17.153010+0000","last_active":"2023-07-09T02:11:19.563397+0000","last_peered":"2023-07-09T02:11:19.563397+0000","last_clean":"2023-07-09T02:11:19.563397+0000","last_became_active":"2023-07-09T02:11:17.152770+0000","last_became_peered":"2023-07-09T02:11:17.152770+0000","last_unstale":"2023-07-09T02:11:19.563397+0000","last_undegraded":"2023-07-09T02:11:19.563397+0000","last_fullsized":"2023-07-09T02:11:19.563397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172585+0000","last_change":"2023-07-09T02:11:18.180346+0000","last_active":"2023-07-09T02:11:19.172585+0000","last_peered":"2023-07-09T02:11:19.172585+0000","last_clean":"2023-07-09T02:11:19.172585+0000","last_became_active":"2023-07-09T02:11:18.180096+0000","last_became_peered":"2023-07-09T02:11:18.180096+0000","last_unstale":"2023-07-09T02:11:19.172585+0000","last_undegraded":"2023-07-09T02:11:19.172585+0000","last_fullsized":"2023-07-09T02:11:19.172585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563535+0000","last_change":"2023-07-09T02:11:17.152833+0000","last_active":"2023-07-09T02:11:19.563535+0000","last_peered":"2023-07-09T02:11:19.563535+0000","last_clean":"2023-07-09T02:11:19.563535+0000","last_became_active":"2023-07-09T02:11:17.152343+0000","last_became_peered":"2023-07-09T02:11:17.152343+0000","last_unstale":"2023-07-09T02:11:19.563535+0000","last_undegraded":"2023-07-09T02:11:19.563535+0000","last_fullsized":"2023-07-09T02:11:19.563535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564321+0000","last_change":"2023-07-09T02:11:18.177770+0000","last_active":"2023-07-09T02:11:19.564321+0000","last_peered":"2023-07-09T02:11:19.564321+0000","last_clean":"2023-07-09T02:11:19.564321+0000","last_became_active":"2023-07-09T02:11:18.177539+0000","last_became_peered":"2023-07-09T02:11:18.177539+0000","last_unstale":"2023-07-09T02:11:19.564321+0000","last_undegraded":"2023-07-09T02:11:19.564321+0000","last_fullsized":"2023-07-09T02:11:19.564321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564222+0000","last_change":"2023-07-09T02:11:17.150481+0000","last_active":"2023-07-09T02:11:19.564222+0000","last_peered":"2023-07-09T02:11:19.564222+0000","last_clean":"2023-07-09T02:11:19.564222+0000","last_became_active":"2023-07-09T02:11:17.149939+0000","last_became_peered":"2023-07-09T02:11:17.149939+0000","last_unstale":"2023-07-09T02:11:19.564222+0000","last_undegraded":"2023-07-09T02:11:19.564222+0000","last_fullsized":"2023-07-09T02:11:19.564222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:04:29.662449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563686+0000","last_change":"2023-07-09T02:11:18.184631+0000","last_active":"2023-07-09T02:11:19.563686+0000","last_peered":"2023-07-09T02:11:19.563686+0000","last_clean":"2023-07-09T02:11:19.563686+0000","last_became_active":"2023-07-09T02:11:18.184406+0000","last_became_peered":"2023-07-09T02:11:18.184406+0000","last_unstale":"2023-07-09T02:11:19.563686+0000","last_undegraded":"2023-07-09T02:11:19.563686+0000","last_fullsized":"2023-07-09T02:11:19.563686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:25:42.077683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173070+0000","last_change":"2023-07-09T02:11:17.149528+0000","last_active":"2023-07-09T02:11:19.173070+0000","last_peered":"2023-07-09T02:11:19.173070+0000","last_clean":"2023-07-09T02:11:19.173070+0000","last_became_active":"2023-07-09T02:11:17.148572+0000","last_became_peered":"2023-07-09T02:11:17.148572+0000","last_unstale":"2023-07-09T02:11:19.173070+0000","last_undegraded":"2023-07-09T02:11:19.173070+0000","last_fullsized":"2023-07-09T02:11:19.173070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:17.269625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171284+0000","last_change":"2023-07-09T02:11:18.175352+0000","last_active":"2023-07-09T02:11:19.171284+0000","last_peered":"2023-07-09T02:11:19.171284+0000","last_clean":"2023-07-09T02:11:19.171284+0000","last_became_active":"2023-07-09T02:11:18.175065+0000","last_became_peered":"2023-07-09T02:11:18.175065+0000","last_unstale":"2023-07-09T02:11:19.171284+0000","last_undegraded":"2023-07-09T02:11:19.171284+0000","last_fullsized":"2023-07-09T02:11:19.171284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561829+0000","last_change":"2023-07-09T02:11:17.151647+0000","last_active":"2023-07-09T02:11:19.561829+0000","last_peered":"2023-07-09T02:11:19.561829+0000","last_clean":"2023-07-09T02:11:19.561829+0000","last_became_active":"2023-07-09T02:11:17.151192+0000","last_became_peered":"2023-07-09T02:11:17.151192+0000","last_unstale":"2023-07-09T02:11:19.561829+0000","last_undegraded":"2023-07-09T02:11:19.561829+0000","last_fullsized":"2023-07-09T02:11:19.561829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564445+0000","last_change":"2023-07-09T02:11:18.175384+0000","last_active":"2023-07-09T02:11:19.564445+0000","last_peered":"2023-07-09T02:11:19.564445+0000","last_clean":"2023-07-09T02:11:19.564445+0000","last_became_active":"2023-07-09T02:11:18.174891+0000","last_became_peered":"2023-07-09T02:11:18.174891+0000","last_unstale":"2023-07-09T02:11:19.564445+0000","last_undegraded":"2023-07-09T02:11:19.564445+0000","last_fullsized":"2023-07-09T02:11:19.564445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564021+0000","last_change":"2023-07-09T02:11:17.153219+0000","last_active":"2023-07-09T02:11:19.564021+0000","last_peered":"2023-07-09T02:11:19.564021+0000","last_clean":"2023-07-09T02:11:19.564021+0000","last_became_active":"2023-07-09T02:11:17.152973+0000","last_became_peered":"2023-07-09T02:11:17.152973+0000","last_unstale":"2023-07-09T02:11:19.564021+0000","last_undegraded":"2023-07-09T02:11:19.564021+0000","last_fullsized":"2023-07-09T02:11:19.564021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:19.400799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564465+0000","last_change":"2023-07-09T02:11:18.175022+0000","last_active":"2023-07-09T02:11:19.564465+0000","last_peered":"2023-07-09T02:11:19.564465+0000","last_clean":"2023-07-09T02:11:19.564465+0000","last_became_active":"2023-07-09T02:11:18.174763+0000","last_became_peered":"2023-07-09T02:11:18.174763+0000","last_unstale":"2023-07-09T02:11:19.564465+0000","last_undegraded":"2023-07-09T02:11:19.564465+0000","last_fullsized":"2023-07-09T02:11:19.564465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564742+0000","last_change":"2023-07-09T02:11:17.151279+0000","last_active":"2023-07-09T02:11:19.564742+0000","last_peered":"2023-07-09T02:11:19.564742+0000","last_clean":"2023-07-09T02:11:19.564742+0000","last_became_active":"2023-07-09T02:11:17.149257+0000","last_became_peered":"2023-07-09T02:11:17.149257+0000","last_unstale":"2023-07-09T02:11:19.564742+0000","last_undegraded":"2023-07-09T02:11:19.564742+0000","last_fullsized":"2023-07-09T02:11:19.564742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:17.269625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564603+0000","last_change":"2023-07-09T02:11:18.183346+0000","last_active":"2023-07-09T02:11:19.564603+0000","last_peered":"2023-07-09T02:11:19.564603+0000","last_clean":"2023-07-09T02:11:19.564603+0000","last_became_active":"2023-07-09T02:11:18.179089+0000","last_became_peered":"2023-07-09T02:11:18.179089+0000","last_unstale":"2023-07-09T02:11:19.564603+0000","last_undegraded":"2023-07-09T02:11:19.564603+0000","last_fullsized":"2023-07-09T02:11:19.564603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:42.158617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561948+0000","last_change":"2023-07-09T02:11:17.140858+0000","last_active":"2023-07-09T02:11:19.561948+0000","last_peered":"2023-07-09T02:11:19.561948+0000","last_clean":"2023-07-09T02:11:19.561948+0000","last_became_active":"2023-07-09T02:11:17.140653+0000","last_became_peered":"2023-07-09T02:11:17.140653+0000","last_unstale":"2023-07-09T02:11:19.561948+0000","last_undegraded":"2023-07-09T02:11:19.561948+0000","last_fullsized":"2023-07-09T02:11:19.561948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170012+0000","last_change":"2023-07-09T02:11:18.182085+0000","last_active":"2023-07-09T02:11:19.170012+0000","last_peered":"2023-07-09T02:11:19.170012+0000","last_clean":"2023-07-09T02:11:19.170012+0000","last_became_active":"2023-07-09T02:11:18.181736+0000","last_became_peered":"2023-07-09T02:11:18.181736+0000","last_unstale":"2023-07-09T02:11:19.170012+0000","last_undegraded":"2023-07-09T02:11:19.170012+0000","last_fullsized":"2023-07-09T02:11:19.170012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563740+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:11:19.563740+0000","last_peered":"2023-07-09T02:11:19.563740+0000","last_clean":"2023-07-09T02:11:19.563740+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:11:19.563740+0000","last_undegraded":"2023-07-09T02:11:19.563740+0000","last_fullsized":"2023-07-09T02:11:19.563740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:34.571303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173020+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:11:19.173020+0000","last_peered":"2023-07-09T02:11:19.173020+0000","last_clean":"2023-07-09T02:11:19.173020+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:11:19.173020+0000","last_undegraded":"2023-07-09T02:11:19.173020+0000","last_fullsized":"2023-07-09T02:11:19.173020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:44.044640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562136+0000","last_change":"2023-07-09T02:11:17.149270+0000","last_active":"2023-07-09T02:11:19.562136+0000","last_peered":"2023-07-09T02:11:19.562136+0000","last_clean":"2023-07-09T02:11:19.562136+0000","last_became_active":"2023-07-09T02:11:17.148945+0000","last_became_peered":"2023-07-09T02:11:17.148945+0000","last_unstale":"2023-07-09T02:11:19.562136+0000","last_undegraded":"2023-07-09T02:11:19.562136+0000","last_fullsized":"2023-07-09T02:11:19.562136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563819+0000","last_change":"2023-07-09T02:11:18.179414+0000","last_active":"2023-07-09T02:11:19.563819+0000","last_peered":"2023-07-09T02:11:19.563819+0000","last_clean":"2023-07-09T02:11:19.563819+0000","last_became_active":"2023-07-09T02:11:18.179066+0000","last_became_peered":"2023-07-09T02:11:18.179066+0000","last_unstale":"2023-07-09T02:11:19.563819+0000","last_undegraded":"2023-07-09T02:11:19.563819+0000","last_fullsized":"2023-07-09T02:11:19.563819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:54:07.291526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563613+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:11:19.563613+0000","last_peered":"2023-07-09T02:11:19.563613+0000","last_clean":"2023-07-09T02:11:19.563613+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:11:19.563613+0000","last_undegraded":"2023-07-09T02:11:19.563613+0000","last_fullsized":"2023-07-09T02:11:19.563613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:12.245950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171634+0000","last_change":"2023-07-09T02:11:17.147946+0000","last_active":"2023-07-09T02:11:19.171634+0000","last_peered":"2023-07-09T02:11:19.171634+0000","last_clean":"2023-07-09T02:11:19.171634+0000","last_became_active":"2023-07-09T02:11:17.146310+0000","last_became_peered":"2023-07-09T02:11:17.146310+0000","last_unstale":"2023-07-09T02:11:19.171634+0000","last_undegraded":"2023-07-09T02:11:19.171634+0000","last_fullsized":"2023-07-09T02:11:19.171634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171398+0000","last_change":"2023-07-09T02:11:18.179015+0000","last_active":"2023-07-09T02:11:19.171398+0000","last_peered":"2023-07-09T02:11:19.171398+0000","last_clean":"2023-07-09T02:11:19.171398+0000","last_became_active":"2023-07-09T02:11:18.178737+0000","last_became_peered":"2023-07-09T02:11:18.178737+0000","last_unstale":"2023-07-09T02:11:19.171398+0000","last_undegraded":"2023-07-09T02:11:19.171398+0000","last_fullsized":"2023-07-09T02:11:19.171398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561247+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:11:19.561247+0000","last_peered":"2023-07-09T02:11:19.561247+0000","last_clean":"2023-07-09T02:11:19.561247+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:11:19.561247+0000","last_undegraded":"2023-07-09T02:11:19.561247+0000","last_fullsized":"2023-07-09T02:11:19.561247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:48:47.217353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171016+0000","last_change":"2023-07-09T02:11:17.149678+0000","last_active":"2023-07-09T02:11:19.171016+0000","last_peered":"2023-07-09T02:11:19.171016+0000","last_clean":"2023-07-09T02:11:19.171016+0000","last_became_active":"2023-07-09T02:11:17.149224+0000","last_became_peered":"2023-07-09T02:11:17.149224+0000","last_unstale":"2023-07-09T02:11:19.171016+0000","last_undegraded":"2023-07-09T02:11:19.171016+0000","last_fullsized":"2023-07-09T02:11:19.171016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170514+0000","last_change":"2023-07-09T02:11:18.173705+0000","last_active":"2023-07-09T02:11:19.170514+0000","last_peered":"2023-07-09T02:11:19.170514+0000","last_clean":"2023-07-09T02:11:19.170514+0000","last_became_active":"2023-07-09T02:11:18.173058+0000","last_became_peered":"2023-07-09T02:11:18.173058+0000","last_unstale":"2023-07-09T02:11:19.170514+0000","last_undegraded":"2023-07-09T02:11:19.170514+0000","last_fullsized":"2023-07-09T02:11:19.170514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173114+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:11:19.173114+0000","last_peered":"2023-07-09T02:11:19.173114+0000","last_clean":"2023-07-09T02:11:19.173114+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:11:19.173114+0000","last_undegraded":"2023-07-09T02:11:19.173114+0000","last_fullsized":"2023-07-09T02:11:19.173114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:38.598275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564792+0000","last_change":"2023-07-09T02:11:17.152808+0000","last_active":"2023-07-09T02:11:19.564792+0000","last_peered":"2023-07-09T02:11:19.564792+0000","last_clean":"2023-07-09T02:11:19.564792+0000","last_became_active":"2023-07-09T02:11:17.152237+0000","last_became_peered":"2023-07-09T02:11:17.152237+0000","last_unstale":"2023-07-09T02:11:19.564792+0000","last_undegraded":"2023-07-09T02:11:19.564792+0000","last_fullsized":"2023-07-09T02:11:19.564792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:04.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170528+0000","last_change":"2023-07-09T02:11:18.177324+0000","last_active":"2023-07-09T02:11:19.170528+0000","last_peered":"2023-07-09T02:11:19.170528+0000","last_clean":"2023-07-09T02:11:19.170528+0000","last_became_active":"2023-07-09T02:11:18.177090+0000","last_became_peered":"2023-07-09T02:11:18.177090+0000","last_unstale":"2023-07-09T02:11:19.170528+0000","last_undegraded":"2023-07-09T02:11:19.170528+0000","last_fullsized":"2023-07-09T02:11:19.170528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172710+0000","last_change":"2023-07-09T02:11:17.145585+0000","last_active":"2023-07-09T02:11:19.172710+0000","last_peered":"2023-07-09T02:11:19.172710+0000","last_clean":"2023-07-09T02:11:19.172710+0000","last_became_active":"2023-07-09T02:11:17.145273+0000","last_became_peered":"2023-07-09T02:11:17.145273+0000","last_unstale":"2023-07-09T02:11:19.172710+0000","last_undegraded":"2023-07-09T02:11:19.172710+0000","last_fullsized":"2023-07-09T02:11:19.172710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:52.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170719+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:11:19.170719+0000","last_peered":"2023-07-09T02:11:19.170719+0000","last_clean":"2023-07-09T02:11:19.170719+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:11:19.170719+0000","last_undegraded":"2023-07-09T02:11:19.170719+0000","last_fullsized":"2023-07-09T02:11:19.170719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:53.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170901+0000","last_change":"2023-07-09T02:11:18.173842+0000","last_active":"2023-07-09T02:11:19.170901+0000","last_peered":"2023-07-09T02:11:19.170901+0000","last_clean":"2023-07-09T02:11:19.170901+0000","last_became_active":"2023-07-09T02:11:18.173468+0000","last_became_peered":"2023-07-09T02:11:18.173468+0000","last_unstale":"2023-07-09T02:11:19.170901+0000","last_undegraded":"2023-07-09T02:11:19.170901+0000","last_fullsized":"2023-07-09T02:11:19.170901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170652+0000","last_change":"2023-07-09T02:11:17.150542+0000","last_active":"2023-07-09T02:11:19.170652+0000","last_peered":"2023-07-09T02:11:19.170652+0000","last_clean":"2023-07-09T02:11:19.170652+0000","last_became_active":"2023-07-09T02:11:17.149674+0000","last_became_peered":"2023-07-09T02:11:17.149674+0000","last_unstale":"2023-07-09T02:11:19.170652+0000","last_undegraded":"2023-07-09T02:11:19.170652+0000","last_fullsized":"2023-07-09T02:11:19.170652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563487+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:11:19.563487+0000","last_peered":"2023-07-09T02:11:19.563487+0000","last_clean":"2023-07-09T02:11:19.563487+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:11:19.563487+0000","last_undegraded":"2023-07-09T02:11:19.563487+0000","last_fullsized":"2023-07-09T02:11:19.563487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:36.132042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171354+0000","last_change":"2023-07-09T02:11:18.172690+0000","last_active":"2023-07-09T02:11:19.171354+0000","last_peered":"2023-07-09T02:11:19.171354+0000","last_clean":"2023-07-09T02:11:19.171354+0000","last_became_active":"2023-07-09T02:11:18.172472+0000","last_became_peered":"2023-07-09T02:11:18.172472+0000","last_unstale":"2023-07-09T02:11:19.171354+0000","last_undegraded":"2023-07-09T02:11:19.171354+0000","last_fullsized":"2023-07-09T02:11:19.171354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562080+0000","last_change":"2023-07-09T02:11:17.147493+0000","last_active":"2023-07-09T02:11:19.562080+0000","last_peered":"2023-07-09T02:11:19.562080+0000","last_clean":"2023-07-09T02:11:19.562080+0000","last_became_active":"2023-07-09T02:11:17.147154+0000","last_became_peered":"2023-07-09T02:11:17.147154+0000","last_unstale":"2023-07-09T02:11:19.562080+0000","last_undegraded":"2023-07-09T02:11:19.562080+0000","last_fullsized":"2023-07-09T02:11:19.562080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:41.155716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170433+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:11:19.170433+0000","last_peered":"2023-07-09T02:11:19.170433+0000","last_clean":"2023-07-09T02:11:19.170433+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:11:19.170433+0000","last_undegraded":"2023-07-09T02:11:19.170433+0000","last_fullsized":"2023-07-09T02:11:19.170433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:24.260899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561296+0000","last_change":"2023-07-09T02:11:18.188753+0000","last_active":"2023-07-09T02:11:19.561296+0000","last_peered":"2023-07-09T02:11:19.561296+0000","last_clean":"2023-07-09T02:11:19.561296+0000","last_became_active":"2023-07-09T02:11:18.188357+0000","last_became_peered":"2023-07-09T02:11:18.188357+0000","last_unstale":"2023-07-09T02:11:19.561296+0000","last_undegraded":"2023-07-09T02:11:19.561296+0000","last_fullsized":"2023-07-09T02:11:19.561296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171169+0000","last_change":"2023-07-09T02:11:17.148129+0000","last_active":"2023-07-09T02:11:19.171169+0000","last_peered":"2023-07-09T02:11:19.171169+0000","last_clean":"2023-07-09T02:11:19.171169+0000","last_became_active":"2023-07-09T02:11:17.147351+0000","last_became_peered":"2023-07-09T02:11:17.147351+0000","last_unstale":"2023-07-09T02:11:19.171169+0000","last_undegraded":"2023-07-09T02:11:19.171169+0000","last_fullsized":"2023-07-09T02:11:19.171169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:23.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563351+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:11:19.563351+0000","last_peered":"2023-07-09T02:11:19.563351+0000","last_clean":"2023-07-09T02:11:19.563351+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:11:19.563351+0000","last_undegraded":"2023-07-09T02:11:19.563351+0000","last_fullsized":"2023-07-09T02:11:19.563351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:34:59.152910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564671+0000","last_change":"2023-07-09T02:11:18.186426+0000","last_active":"2023-07-09T02:11:19.564671+0000","last_peered":"2023-07-09T02:11:19.564671+0000","last_clean":"2023-07-09T02:11:19.564671+0000","last_became_active":"2023-07-09T02:11:18.185002+0000","last_became_peered":"2023-07-09T02:11:18.185002+0000","last_unstale":"2023-07-09T02:11:19.564671+0000","last_undegraded":"2023-07-09T02:11:19.564671+0000","last_fullsized":"2023-07-09T02:11:19.564671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:50.071215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564465+0000","last_change":"2023-07-09T02:11:18.183661+0000","last_active":"2023-07-09T02:11:19.564465+0000","last_peered":"2023-07-09T02:11:19.564465+0000","last_clean":"2023-07-09T02:11:19.564465+0000","last_became_active":"2023-07-09T02:11:18.179450+0000","last_became_peered":"2023-07-09T02:11:18.179450+0000","last_unstale":"2023-07-09T02:11:19.564465+0000","last_undegraded":"2023-07-09T02:11:19.564465+0000","last_fullsized":"2023-07-09T02:11:19.564465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:59.682786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564201+0000","last_change":"2023-07-09T02:11:17.148909+0000","last_active":"2023-07-09T02:11:19.564201+0000","last_peered":"2023-07-09T02:11:19.564201+0000","last_clean":"2023-07-09T02:11:19.564201+0000","last_became_active":"2023-07-09T02:11:17.148562+0000","last_became_peered":"2023-07-09T02:11:17.148562+0000","last_unstale":"2023-07-09T02:11:19.564201+0000","last_undegraded":"2023-07-09T02:11:19.564201+0000","last_fullsized":"2023-07-09T02:11:19.564201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:40.581950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170351+0000","last_change":"2023-07-09T02:11:18.178124+0000","last_active":"2023-07-09T02:11:19.170351+0000","last_peered":"2023-07-09T02:11:19.170351+0000","last_clean":"2023-07-09T02:11:19.170351+0000","last_became_active":"2023-07-09T02:11:18.177847+0000","last_became_peered":"2023-07-09T02:11:18.177847+0000","last_unstale":"2023-07-09T02:11:19.170351+0000","last_undegraded":"2023-07-09T02:11:19.170351+0000","last_fullsized":"2023-07-09T02:11:19.170351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563246+0000","last_change":"2023-07-09T02:11:17.151493+0000","last_active":"2023-07-09T02:11:19.563246+0000","last_peered":"2023-07-09T02:11:19.563246+0000","last_clean":"2023-07-09T02:11:19.563246+0000","last_became_active":"2023-07-09T02:11:17.151257+0000","last_became_peered":"2023-07-09T02:11:17.151257+0000","last_unstale":"2023-07-09T02:11:19.563246+0000","last_undegraded":"2023-07-09T02:11:19.563246+0000","last_fullsized":"2023-07-09T02:11:19.563246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172989+0000","last_change":"2023-07-09T02:11:17.149719+0000","last_active":"2023-07-09T02:11:19.172989+0000","last_peered":"2023-07-09T02:11:19.172989+0000","last_clean":"2023-07-09T02:11:19.172989+0000","last_became_active":"2023-07-09T02:11:17.149186+0000","last_became_peered":"2023-07-09T02:11:17.149186+0000","last_unstale":"2023-07-09T02:11:19.172989+0000","last_undegraded":"2023-07-09T02:11:19.172989+0000","last_fullsized":"2023-07-09T02:11:19.172989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561896+0000","last_change":"2023-07-09T02:11:18.186079+0000","last_active":"2023-07-09T02:11:19.561896+0000","last_peered":"2023-07-09T02:11:19.561896+0000","last_clean":"2023-07-09T02:11:19.561896+0000","last_became_active":"2023-07-09T02:11:18.185856+0000","last_became_peered":"2023-07-09T02:11:18.185856+0000","last_unstale":"2023-07-09T02:11:19.561896+0000","last_undegraded":"2023-07-09T02:11:19.561896+0000","last_fullsized":"2023-07-09T02:11:19.561896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171447+0000","last_change":"2023-07-09T02:11:17.146351+0000","last_active":"2023-07-09T02:11:19.171447+0000","last_peered":"2023-07-09T02:11:19.171447+0000","last_clean":"2023-07-09T02:11:19.171447+0000","last_became_active":"2023-07-09T02:11:17.145568+0000","last_became_peered":"2023-07-09T02:11:17.145568+0000","last_unstale":"2023-07-09T02:11:19.171447+0000","last_undegraded":"2023-07-09T02:11:19.171447+0000","last_fullsized":"2023-07-09T02:11:19.171447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:29.284573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561696+0000","last_change":"2023-07-09T02:11:18.183284+0000","last_active":"2023-07-09T02:11:19.561696+0000","last_peered":"2023-07-09T02:11:19.561696+0000","last_clean":"2023-07-09T02:11:19.561696+0000","last_became_active":"2023-07-09T02:11:18.183050+0000","last_became_peered":"2023-07-09T02:11:18.183050+0000","last_unstale":"2023-07-09T02:11:19.561696+0000","last_undegraded":"2023-07-09T02:11:19.561696+0000","last_fullsized":"2023-07-09T02:11:19.561696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563207+0000","last_change":"2023-07-09T02:11:18.183153+0000","last_active":"2023-07-09T02:11:19.563207+0000","last_peered":"2023-07-09T02:11:19.563207+0000","last_clean":"2023-07-09T02:11:19.563207+0000","last_became_active":"2023-07-09T02:11:18.182933+0000","last_became_peered":"2023-07-09T02:11:18.182933+0000","last_unstale":"2023-07-09T02:11:19.563207+0000","last_undegraded":"2023-07-09T02:11:19.563207+0000","last_fullsized":"2023-07-09T02:11:19.563207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:14:03.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561657+0000","last_change":"2023-07-09T02:11:17.146135+0000","last_active":"2023-07-09T02:11:19.561657+0000","last_peered":"2023-07-09T02:11:19.561657+0000","last_clean":"2023-07-09T02:11:19.561657+0000","last_became_active":"2023-07-09T02:11:17.145915+0000","last_became_peered":"2023-07-09T02:11:17.145915+0000","last_unstale":"2023-07-09T02:11:19.561657+0000","last_undegraded":"2023-07-09T02:11:19.561657+0000","last_fullsized":"2023-07-09T02:11:19.561657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:23.165834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170884+0000","last_change":"2023-07-09T02:11:18.180129+0000","last_active":"2023-07-09T02:11:19.170884+0000","last_peered":"2023-07-09T02:11:19.170884+0000","last_clean":"2023-07-09T02:11:19.170884+0000","last_became_active":"2023-07-09T02:11:18.179900+0000","last_became_peered":"2023-07-09T02:11:18.179900+0000","last_unstale":"2023-07-09T02:11:19.170884+0000","last_undegraded":"2023-07-09T02:11:19.170884+0000","last_fullsized":"2023-07-09T02:11:19.170884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:39:27.300272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170132+0000","last_change":"2023-07-09T02:11:17.149525+0000","last_active":"2023-07-09T02:11:19.170132+0000","last_peered":"2023-07-09T02:11:19.170132+0000","last_clean":"2023-07-09T02:11:19.170132+0000","last_became_active":"2023-07-09T02:11:17.148867+0000","last_became_peered":"2023-07-09T02:11:17.148867+0000","last_unstale":"2023-07-09T02:11:19.170132+0000","last_undegraded":"2023-07-09T02:11:19.170132+0000","last_fullsized":"2023-07-09T02:11:19.170132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:10.806976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561518+0000","last_change":"2023-07-09T02:11:18.175561+0000","last_active":"2023-07-09T02:11:19.561518+0000","last_peered":"2023-07-09T02:11:19.561518+0000","last_clean":"2023-07-09T02:11:19.561518+0000","last_became_active":"2023-07-09T02:11:18.175290+0000","last_became_peered":"2023-07-09T02:11:18.175290+0000","last_unstale":"2023-07-09T02:11:19.561518+0000","last_undegraded":"2023-07-09T02:11:19.561518+0000","last_fullsized":"2023-07-09T02:11:19.561518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:11.809877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564748+0000","last_change":"2023-07-09T02:11:17.147564+0000","last_active":"2023-07-09T02:11:19.564748+0000","last_peered":"2023-07-09T02:11:19.564748+0000","last_clean":"2023-07-09T02:11:19.564748+0000","last_became_active":"2023-07-09T02:11:17.147326+0000","last_became_peered":"2023-07-09T02:11:17.147326+0000","last_unstale":"2023-07-09T02:11:19.564748+0000","last_undegraded":"2023-07-09T02:11:19.564748+0000","last_fullsized":"2023-07-09T02:11:19.564748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:43.621949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562107+0000","last_change":"2023-07-09T02:11:18.171391+0000","last_active":"2023-07-09T02:11:19.562107+0000","last_peered":"2023-07-09T02:11:19.562107+0000","last_clean":"2023-07-09T02:11:19.562107+0000","last_became_active":"2023-07-09T02:11:18.171141+0000","last_became_peered":"2023-07-09T02:11:18.171141+0000","last_unstale":"2023-07-09T02:11:19.562107+0000","last_undegraded":"2023-07-09T02:11:19.562107+0000","last_fullsized":"2023-07-09T02:11:19.562107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:38:47.066683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171145+0000","last_change":"2023-07-09T02:11:17.140030+0000","last_active":"2023-07-09T02:11:19.171145+0000","last_peered":"2023-07-09T02:11:19.171145+0000","last_clean":"2023-07-09T02:11:19.171145+0000","last_became_active":"2023-07-09T02:11:17.139783+0000","last_became_peered":"2023-07-09T02:11:17.139783+0000","last_unstale":"2023-07-09T02:11:19.171145+0000","last_undegraded":"2023-07-09T02:11:19.171145+0000","last_fullsized":"2023-07-09T02:11:19.171145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:10.806976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564215+0000","last_change":"2023-07-09T02:11:18.175178+0000","last_active":"2023-07-09T02:11:19.564215+0000","last_peered":"2023-07-09T02:11:19.564215+0000","last_clean":"2023-07-09T02:11:19.564215+0000","last_became_active":"2023-07-09T02:11:18.174561+0000","last_became_peered":"2023-07-09T02:11:18.174561+0000","last_unstale":"2023-07-09T02:11:19.564215+0000","last_undegraded":"2023-07-09T02:11:19.564215+0000","last_fullsized":"2023-07-09T02:11:19.564215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172908+0000","last_change":"2023-07-09T02:11:17.144465+0000","last_active":"2023-07-09T02:11:19.172908+0000","last_peered":"2023-07-09T02:11:19.172908+0000","last_clean":"2023-07-09T02:11:19.172908+0000","last_became_active":"2023-07-09T02:11:17.144209+0000","last_became_peered":"2023-07-09T02:11:17.144209+0000","last_unstale":"2023-07-09T02:11:19.172908+0000","last_undegraded":"2023-07-09T02:11:19.172908+0000","last_fullsized":"2023-07-09T02:11:19.172908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:41.155716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564419+0000","last_change":"2023-07-09T02:11:18.186664+0000","last_active":"2023-07-09T02:11:19.564419+0000","last_peered":"2023-07-09T02:11:19.564419+0000","last_clean":"2023-07-09T02:11:19.564419+0000","last_became_active":"2023-07-09T02:11:18.185338+0000","last_became_peered":"2023-07-09T02:11:18.185338+0000","last_unstale":"2023-07-09T02:11:19.564419+0000","last_undegraded":"2023-07-09T02:11:19.564419+0000","last_fullsized":"2023-07-09T02:11:19.564419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172826+0000","last_change":"2023-07-09T02:11:17.150027+0000","last_active":"2023-07-09T02:11:19.172826+0000","last_peered":"2023-07-09T02:11:19.172826+0000","last_clean":"2023-07-09T02:11:19.172826+0000","last_became_active":"2023-07-09T02:11:17.145284+0000","last_became_peered":"2023-07-09T02:11:17.145284+0000","last_unstale":"2023-07-09T02:11:19.172826+0000","last_undegraded":"2023-07-09T02:11:19.172826+0000","last_fullsized":"2023-07-09T02:11:19.172826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561623+0000","last_change":"2023-07-09T02:11:18.177328+0000","last_active":"2023-07-09T02:11:19.561623+0000","last_peered":"2023-07-09T02:11:19.561623+0000","last_clean":"2023-07-09T02:11:19.561623+0000","last_became_active":"2023-07-09T02:11:18.176878+0000","last_became_peered":"2023-07-09T02:11:18.176878+0000","last_unstale":"2023-07-09T02:11:19.561623+0000","last_undegraded":"2023-07-09T02:11:19.561623+0000","last_fullsized":"2023-07-09T02:11:19.561623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561894+0000","last_change":"2023-07-09T02:11:17.147704+0000","last_active":"2023-07-09T02:11:19.561894+0000","last_peered":"2023-07-09T02:11:19.561894+0000","last_clean":"2023-07-09T02:11:19.561894+0000","last_became_active":"2023-07-09T02:11:17.147468+0000","last_became_peered":"2023-07-09T02:11:17.147468+0000","last_unstale":"2023-07-09T02:11:19.561894+0000","last_undegraded":"2023-07-09T02:11:19.561894+0000","last_fullsized":"2023-07-09T02:11:19.561894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564070+0000","last_change":"2023-07-09T02:11:18.184106+0000","last_active":"2023-07-09T02:11:19.564070+0000","last_peered":"2023-07-09T02:11:19.564070+0000","last_clean":"2023-07-09T02:11:19.564070+0000","last_became_active":"2023-07-09T02:11:18.182276+0000","last_became_peered":"2023-07-09T02:11:18.182276+0000","last_unstale":"2023-07-09T02:11:19.564070+0000","last_undegraded":"2023-07-09T02:11:19.564070+0000","last_fullsized":"2023-07-09T02:11:19.564070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:11.809877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171522+0000","last_change":"2023-07-09T02:11:17.147610+0000","last_active":"2023-07-09T02:11:19.171522+0000","last_peered":"2023-07-09T02:11:19.171522+0000","last_clean":"2023-07-09T02:11:19.171522+0000","last_became_active":"2023-07-09T02:11:17.144411+0000","last_became_peered":"2023-07-09T02:11:17.144411+0000","last_unstale":"2023-07-09T02:11:19.171522+0000","last_undegraded":"2023-07-09T02:11:19.171522+0000","last_fullsized":"2023-07-09T02:11:19.171522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:35.049738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194642,"statfs":{"total":200000000,"available":199313742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":92,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195219,"statfs":{"total":200000000,"available":199905238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":93,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195219,"statfs":{"total":200000000,"available":199904270,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905800,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314940,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]}],"pool_statfs":[]}} 2023-07-09T02:11:22.664 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:11:22.665 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-09T02:11:22.665 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-09T02:11:22.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-09T02:11:22.666 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-09T02:11:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb189140640 1 Processor -- start 2023-07-09T02:11:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb189140640 1 -- start start 2023-07-09T02:11:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb189140640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1840cd120 0x7fb1840b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb189140640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb184160a50 con 0x7fb1840d2620 2023-07-09T02:11:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb189140640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18415c430 con 0x7fb18415c060 2023-07-09T02:11:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb189140640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18415fb60 con 0x7fb1840cd120 2023-07-09T02:11:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb17bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb1840d2620 0x7fb1840cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48798/0 (socket says 172.21.15.45:48798) 2023-07-09T02:11:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb17bfff640 1 -- 172.21.15.45:0/499391277 learned_addr learned my addr 172.21.15.45:0/499391277 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb18359e640 1 --2- 172.21.15.45:0/499391277 >> v2:172.21.15.45:3300/0 conn(0x7fb1840cd120 0x7fb1840b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb18259c640 1 -- 172.21.15.45:0/499391277 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437931506 0 0) 0x7fb184160a50 con 0x7fb1840d2620 2023-07-09T02:11:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb18259c640 1 -- 172.21.15.45:0/499391277 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb170003530 con 0x7fb1840d2620 2023-07-09T02:11:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb18359e640 1 -- 172.21.15.45:0/499391277 >> v1:172.21.15.155:6789/0 conn(0x7fb18415c060 legacy=0x7fb1840d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb18359e640 1 -- 172.21.15.45:0/499391277 >> v1:172.21.15.45:6789/0 conn(0x7fb1840d2620 legacy=0x7fb1840cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.840+0000 7fb18359e640 1 -- 172.21.15.45:0/499391277 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18415fe40 con 0x7fb1840cd120 2023-07-09T02:11:22.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb18359e640 1 --2- 172.21.15.45:0/499391277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840cd120 0x7fb1840b4ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009d90 tx=0x7fb17c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96225a06fa04d2c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb18259c640 1 -- 172.21.15.45:0/499391277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0a59a0 con 0x7fb1840cd120 2023-07-09T02:11:22.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb18259c640 1 -- 172.21.15.45:0/499391277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c0a5b00 con 0x7fb1840cd120 2023-07-09T02:11:22.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb18259c640 1 -- 172.21.15.45:0/499391277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0a5e90 con 0x7fb1840cd120 2023-07-09T02:11:22.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb189140640 1 -- 172.21.15.45:0/499391277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840cd120 msgr2=0x7fb1840b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb189140640 1 --2- 172.21.15.45:0/499391277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840cd120 0x7fb1840b4ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009d90 tx=0x7fb17c01c8e0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb189140640 1 -- 172.21.15.45:0/499391277 shutdown_connections 2023-07-09T02:11:22.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb189140640 1 --2- 172.21.15.45:0/499391277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840cd120 0x7fb1840b4ed0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb189140640 1 -- 172.21.15.45:0/499391277 >> 172.21.15.45:0/499391277 conn(0x7fb1840698e0 msgr2=0x7fb184069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:22.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb189140640 1 -- 172.21.15.45:0/499391277 shutdown_connections 2023-07-09T02:11:22.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.844+0000 7fb189140640 1 -- 172.21.15.45:0/499391277 wait complete. 2023-07-09T02:11:22.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 Processor -- start 2023-07-09T02:11:22.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 -- start start 2023-07-09T02:11:22.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1840cd120 0x7fb1841530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840d2620 0x7fb1841547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18415c060 0x7fb1841f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb184154d20 con 0x7fb1840d2620 2023-07-09T02:11:22.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18415cbe0 con 0x7fb18415c060 2023-07-09T02:11:22.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb184153740 con 0x7fb1840cd120 2023-07-09T02:11:22.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840d2620 0x7fb1841547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840d2620 0x7fb1841547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46128/0 (socket says 172.21.15.45:46128) 2023-07-09T02:11:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 -- 172.21.15.45:0/7234376 learned_addr learned my addr 172.21.15.45:0/7234376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb182d9d640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1840cd120 0x7fb1841530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb18359e640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18415c060 0x7fb1841f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 -- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1840cd120 msgr2=0x7fb1841530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1840cd120 0x7fb1841530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 -- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18415c060 msgr2=0x7fb1841f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:22.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18415c060 0x7fb1841f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:22.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 -- 172.21.15.45:0/7234376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c009a70 con 0x7fb1840d2620 2023-07-09T02:11:22.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb182d9d640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1840cd120 0x7fb1841530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:22.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17bfff640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840d2620 0x7fb1841547e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb16c001ec0 tx=0x7fb16c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17b7fe640 1 -- 172.21.15.45:0/7234376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c005d50 con 0x7fb1840d2620 2023-07-09T02:11:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17b7fe640 1 -- 172.21.15.45:0/7234376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c007070 con 0x7fb1840d2620 2023-07-09T02:11:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1840b59f0 con 0x7fb1840d2620 2023-07-09T02:11:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb17b7fe640 1 -- 172.21.15.45:0/7234376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c007420 con 0x7fb1840d2620 2023-07-09T02:11:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.848+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb184153d00 con 0x7fb1840d2620 2023-07-09T02:11:22.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.852+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18404d7d0 con 0x7fb1840d2620 2023-07-09T02:11:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.852+0000 7fb17b7fe640 1 -- 172.21.15.45:0/7234376 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb16c007580 con 0x7fb1840d2620 2023-07-09T02:11:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.852+0000 7fb17b7fe640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb164066280 0x7fb164068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:22.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.852+0000 7fb17b7fe640 1 -- 172.21.15.45:0/7234376 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb16c083450 con 0x7fb1840d2620 2023-07-09T02:11:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.852+0000 7fb182d9d640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb164066280 0x7fb164068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:22.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.852+0000 7fb182d9d640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb164066280 0x7fb164068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb17400a850 tx=0x7fb174008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:22.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:22.856+0000 7fb17b7fe640 1 -- 172.21.15.45:0/7234376 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb16c050860 con 0x7fb1840d2620 2023-07-09T02:11:23.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.048+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb1840cf0c0 con 0x7fb1840d2620 2023-07-09T02:11:23.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.048+0000 7fb17b7fe640 1 -- 172.21.15.45:0/7234376 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164249 (secure 0 0 0) 0x7fb16c017090 con 0x7fb1840d2620 2023-07-09T02:11:23.054 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:23.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb164066280 msgr2=0x7fb164068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb164066280 0x7fb164068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb17400a850 tx=0x7fb174008040 comp rx=0 tx=0).stop 2023-07-09T02:11:23.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840d2620 msgr2=0x7fb1841547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840d2620 0x7fb1841547e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb16c001ec0 tx=0x7fb16c00c960 comp rx=0 tx=0).stop 2023-07-09T02:11:23.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 shutdown_connections 2023-07-09T02:11:23.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18415c060 0x7fb1841f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1840d2620 0x7fb1841547e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb164066280 0x7fb164068730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 --2- 172.21.15.45:0/7234376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1840cd120 0x7fb1841530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 >> 172.21.15.45:0/7234376 conn(0x7fb1840698e0 msgr2=0x7fb1840b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:23.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 shutdown_connections 2023-07-09T02:11:23.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.052+0000 7fb189140640 1 -- 172.21.15.45:0/7234376 wait complete. 2023-07-09T02:11:23.074 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3807220831},{"type":"v1","addr":"172.21.15.155:6833","nonce":3807220831}]},"active_addr":"172.21.15.155:6833/3807220831","active_change":"2023-07-09T02:11:04.509888+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":2245864228}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":2117382527}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1759470764}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3614677547}]}]} 2023-07-09T02:11:23.079 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-09T02:11:23.079 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-09T02:11:23.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:23.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be8940640 1 Processor -- start 2023-07-09T02:11:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be8940640 1 -- start start 2023-07-09T02:11:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be8940640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4be40d2620 0x7f4be40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be8940640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4be40cd120 0x7f4be40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be8940640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be4160a50 con 0x7f4be415c060 2023-07-09T02:11:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be8940640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be415c430 con 0x7f4be40cd120 2023-07-09T02:11:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be8940640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be415fb60 con 0x7f4be40d2620 2023-07-09T02:11:23.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4be40cd120 0x7f4be40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be2d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4be40cd120 0x7f4be40cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46130/0 (socket says 172.21.15.45:46130) 2023-07-09T02:11:23.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be2d9d640 1 -- 172.21.15.45:0/3217205117 learned_addr learned my addr 172.21.15.45:0/3217205117 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be1d9b640 1 --2- 172.21.15.45:0/3217205117 >> v2:172.21.15.155:3300/0 conn(0x7f4be40d2620 0x7f4be40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be2d9d640 1 -- 172.21.15.45:0/3217205117 >> v2:172.21.15.155:3300/0 conn(0x7f4be40d2620 msgr2=0x7f4be40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be2d9d640 1 --2- 172.21.15.45:0/3217205117 >> v2:172.21.15.155:3300/0 conn(0x7f4be40d2620 0x7f4be40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be2d9d640 1 -- 172.21.15.45:0/3217205117 >> v1:172.21.15.155:6789/0 conn(0x7f4be415c060 legacy=0x7f4be40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.224+0000 7f4be2d9d640 1 -- 172.21.15.45:0/3217205117 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be415fe40 con 0x7f4be40cd120 2023-07-09T02:11:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be2d9d640 1 --2- 172.21.15.45:0/3217205117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40cd120 0x7f4be40cee30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4be415fac0 tx=0x7f4bdc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545fe679f6aa6a69 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be159a640 1 -- 172.21.15.45:0/3217205117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0a5860 con 0x7f4be40cd120 2023-07-09T02:11:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be159a640 1 -- 172.21.15.45:0/3217205117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc0a59c0 con 0x7f4be40cd120 2023-07-09T02:11:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be159a640 1 -- 172.21.15.45:0/3217205117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0a5d50 con 0x7f4be40cd120 2023-07-09T02:11:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be8940640 1 -- 172.21.15.45:0/3217205117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40cd120 msgr2=0x7f4be40cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be8940640 1 --2- 172.21.15.45:0/3217205117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40cd120 0x7f4be40cee30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4be415fac0 tx=0x7f4bdc01c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be8940640 1 -- 172.21.15.45:0/3217205117 shutdown_connections 2023-07-09T02:11:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be8940640 1 --2- 172.21.15.45:0/3217205117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40cd120 0x7f4be40cee30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be8940640 1 --2- 172.21.15.45:0/3217205117 >> v2:172.21.15.155:3300/0 conn(0x7f4be40d2620 0x7f4be40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be8940640 1 -- 172.21.15.45:0/3217205117 >> 172.21.15.45:0/3217205117 conn(0x7f4be40698e0 msgr2=0x7f4be4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be8940640 1 -- 172.21.15.45:0/3217205117 shutdown_connections 2023-07-09T02:11:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.228+0000 7f4be8940640 1 -- 172.21.15.45:0/3217205117 wait complete. 2023-07-09T02:11:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 Processor -- start 2023-07-09T02:11:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 -- start start 2023-07-09T02:11:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be40cd120 0x7f4be40c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40d2620 0x7f4be4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be415c060 0x7f4be415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40b3a30 con 0x7f4be40d2620 2023-07-09T02:11:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be415ad20 con 0x7f4be415c060 2023-07-09T02:11:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40c8d00 con 0x7f4be40cd120 2023-07-09T02:11:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40d2620 0x7f4be4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40d2620 0x7f4be4159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46142/0 (socket says 172.21.15.45:46142) 2023-07-09T02:11:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 -- 172.21.15.45:0/4195006226 learned_addr learned my addr 172.21.15.45:0/4195006226 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be259c640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be40cd120 0x7f4be40c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be2d9d640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be415c060 0x7f4be415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 -- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be40cd120 msgr2=0x7f4be40c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be40cd120 0x7f4be40c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 -- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be415c060 msgr2=0x7f4be415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be415c060 0x7f4be415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 -- 172.21.15.45:0/4195006226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc009b30 con 0x7f4be40d2620 2023-07-09T02:11:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be2d9d640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be415c060 0x7f4be415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be1d9b640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40d2620 0x7f4be4159cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800e930 tx=0x7f4bd800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4bd2ffd640 1 -- 172.21.15.45:0/4195006226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8009690 con 0x7f4be40d2620 2023-07-09T02:11:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4bd2ffd640 1 -- 172.21.15.45:0/4195006226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd800ca00 con 0x7f4be40d2620 2023-07-09T02:11:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be40b59f0 con 0x7f4be40d2620 2023-07-09T02:11:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4bd2ffd640 1 -- 172.21.15.45:0/4195006226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800cdb0 con 0x7f4be40d2620 2023-07-09T02:11:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.232+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be415aa40 con 0x7f4be40d2620 2023-07-09T02:11:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.236+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be40b3be0 con 0x7f4be40d2620 2023-07-09T02:11:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.236+0000 7f4bd2ffd640 1 -- 172.21.15.45:0/4195006226 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bd8013470 con 0x7f4be40d2620 2023-07-09T02:11:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.236+0000 7f4bd2ffd640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bc4066280 0x7f4bc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.236+0000 7f4bd2ffd640 1 -- 172.21.15.45:0/4195006226 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bd8083e90 con 0x7f4be40d2620 2023-07-09T02:11:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.236+0000 7f4be259c640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bc4066280 0x7f4bc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.236+0000 7f4be259c640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bc4066280 0x7f4bc4068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4007fd0 tx=0x7f4bd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.240+0000 7f4bd2ffd640 1 -- 172.21.15.45:0/4195006226 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bd8051470 con 0x7f4be40d2620 2023-07-09T02:11:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.400+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4be404d7d0 con 0x7f4be40d2620 2023-07-09T02:11:23.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.400+0000 7f4bd2ffd640 1 -- 172.21.15.45:0/4195006226 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f4bd8017090 con 0x7f4be40d2620 2023-07-09T02:11:23.403 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:23.404 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:23.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bc4066280 msgr2=0x7f4bc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bc4066280 0x7f4bc4068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4007fd0 tx=0x7f4bd4009040 comp rx=0 tx=0).stop 2023-07-09T02:11:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40d2620 msgr2=0x7f4be4159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40d2620 0x7f4be4159cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800e930 tx=0x7f4bd800edf0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 shutdown_connections 2023-07-09T02:11:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be415c060 0x7f4be415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4be40d2620 0x7f4be4159cb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bc4066280 0x7f4bc4068730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 --2- 172.21.15.45:0/4195006226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be40cd120 0x7f4be40c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 >> 172.21.15.45:0/4195006226 conn(0x7f4be40698e0 msgr2=0x7f4be415b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 shutdown_connections 2023-07-09T02:11:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.404+0000 7f4be8940640 1 -- 172.21.15.45:0/4195006226 wait complete. 2023-07-09T02:11:23.425 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-09T02:11:23.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:23.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc6de2640 1 Processor -- start 2023-07-09T02:11:23.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc6de2640 1 -- start start 2023-07-09T02:11:23.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc6de2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fadc015c060 0x7fadc00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc6de2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc00cd120 0x7fadc00d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc6de2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc0160a50 con 0x7fadc00d2450 2023-07-09T02:11:23.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc6de2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00d28f0 con 0x7fadc015c060 2023-07-09T02:11:23.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc6de2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00cfe40 con 0x7fadc00cd120 2023-07-09T02:11:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc537f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fadc00d2450 0x7fadc00d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48810/0 (socket says 172.21.15.45:48810) 2023-07-09T02:11:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc537f640 1 -- 172.21.15.45:0/4288600242 learned_addr learned my addr 172.21.15.45:0/4288600242 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadbffff640 1 --2- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc00cd120 0x7fadc00d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.564+0000 7fadc4b7e640 1 --2- 172.21.15.45:0/4288600242 >> v2:172.21.15.155:3300/0 conn(0x7fadc015c060 0x7fadc00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadbf7fe640 1 -- 172.21.15.45:0/4288600242 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339918720 0 0) 0x7fadc0160a50 con 0x7fadc00d2450 2023-07-09T02:11:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadbf7fe640 1 -- 172.21.15.45:0/4288600242 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb0003530 con 0x7fadc00d2450 2023-07-09T02:11:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadc4b7e640 1 -- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc00cd120 msgr2=0x7fadc00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:23.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadc4b7e640 1 --2- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc00cd120 0x7fadc00d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadc4b7e640 1 -- 172.21.15.45:0/4288600242 >> v1:172.21.15.45:6789/0 conn(0x7fadc00d2450 legacy=0x7fadc00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadc4b7e640 1 -- 172.21.15.45:0/4288600242 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc015c430 con 0x7fadc015c060 2023-07-09T02:11:23.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadbffff640 1 --2- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc00cd120 0x7fadc00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:23.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadc4b7e640 1 --2- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc015c060 0x7fadc00b4ed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fadb40097c0 tx=0x7fadb401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=517dadb6de3a3616 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:23.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadbf7fe640 1 -- 172.21.15.45:0/4288600242 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40ab600 con 0x7fadc015c060 2023-07-09T02:11:23.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadbf7fe640 1 -- 172.21.15.45:0/4288600242 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb40a7050 con 0x7fadc015c060 2023-07-09T02:11:23.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.568+0000 7fadbf7fe640 1 -- 172.21.15.45:0/4288600242 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40ab980 con 0x7fadc015c060 2023-07-09T02:11:23.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc015c060 msgr2=0x7fadc00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 --2- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc015c060 0x7fadc00b4ed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fadb40097c0 tx=0x7fadb401c450 comp rx=0 tx=0).stop 2023-07-09T02:11:23.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- 172.21.15.45:0/4288600242 shutdown_connections 2023-07-09T02:11:23.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 --2- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc00cd120 0x7fadc00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 --2- 172.21.15.45:0/4288600242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc015c060 0x7fadc00b4ed0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- 172.21.15.45:0/4288600242 >> 172.21.15.45:0/4288600242 conn(0x7fadc00698e0 msgr2=0x7fadc0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- 172.21.15.45:0/4288600242 shutdown_connections 2023-07-09T02:11:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- 172.21.15.45:0/4288600242 wait complete. 2023-07-09T02:11:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 Processor -- start 2023-07-09T02:11:23.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- start start 2023-07-09T02:11:23.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadc00cd120 0x7fadc00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00d2450 0x7fadc00cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc015c060 0x7fadc00b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00b3ed0 con 0x7fadc00cd120 2023-07-09T02:11:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00b28f0 con 0x7fadc00d2450 2023-07-09T02:11:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc6de2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00b2bd0 con 0x7fadc015c060 2023-07-09T02:11:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc4b7e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadc00cd120 0x7fadc00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc4b7e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadc00cd120 0x7fadc00b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46158/0 (socket says 172.21.15.45:46158) 2023-07-09T02:11:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.572+0000 7fadc4b7e640 1 -- 172.21.15.45:0/1239666926 learned_addr learned my addr 172.21.15.45:0/1239666926 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadbffff640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00d2450 0x7fadc00cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc537f640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc015c060 0x7fadc00b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc4b7e640 1 -- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc015c060 msgr2=0x7fadc00b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc4b7e640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc015c060 0x7fadc00b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc4b7e640 1 -- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00d2450 msgr2=0x7fadc00cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc4b7e640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00d2450 0x7fadc00cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc4b7e640 1 -- 172.21.15.45:0/1239666926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac009420 con 0x7fadc00cd120 2023-07-09T02:11:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadbffff640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00d2450 0x7fadc00cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc4b7e640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadc00cd120 0x7fadc00b3990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fadb40ae040 tx=0x7fadb401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadbd7fa640 1 -- 172.21.15.45:0/1239666926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40b7450 con 0x7fadc00cd120 2023-07-09T02:11:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadbd7fa640 1 -- 172.21.15.45:0/1239666926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb40b75d0 con 0x7fadc00cd120 2023-07-09T02:11:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadbd7fa640 1 -- 172.21.15.45:0/1239666926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40b7980 con 0x7fadc00cd120 2023-07-09T02:11:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb4009420 con 0x7fadc00cd120 2023-07-09T02:11:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00b3190 con 0x7fadc00cd120 2023-07-09T02:11:23.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc004d7d0 con 0x7fadc00cd120 2023-07-09T02:11:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadbd7fa640 1 -- 172.21.15.45:0/1239666926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fadb40b7ae0 con 0x7fadc00cd120 2023-07-09T02:11:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadbd7fa640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fada4066280 0x7fada4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.576+0000 7fadbd7fa640 1 -- 172.21.15.45:0/1239666926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fadb411e5e0 con 0x7fadc00cd120 2023-07-09T02:11:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.580+0000 7fadbffff640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fada4066280 0x7fada4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:23.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.580+0000 7fadbffff640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fada4066280 0x7fada4068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadc00cc2f0 tx=0x7fadac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:23.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.580+0000 7fadbd7fa640 1 -- 172.21.15.45:0/1239666926 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fadb40eb930 con 0x7fadc00cd120 2023-07-09T02:11:23.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.740+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadc015d840 con 0x7fadc00cd120 2023-07-09T02:11:23.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadbd7fa640 1 -- 172.21.15.45:0/1239666926 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fadb40eef50 con 0x7fadc00cd120 2023-07-09T02:11:23.746 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:23.747 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:23.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fada4066280 msgr2=0x7fada4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fada4066280 0x7fada4068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadc00cc2f0 tx=0x7fadac008040 comp rx=0 tx=0).stop 2023-07-09T02:11:23.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadc00cd120 msgr2=0x7fadc00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:23.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadc00cd120 0x7fadc00b3990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fadb40ae040 tx=0x7fadb401ac90 comp rx=0 tx=0).stop 2023-07-09T02:11:23.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 shutdown_connections 2023-07-09T02:11:23.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fada4066280 0x7fada4068730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc015c060 0x7fadc00b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc00d2450 0x7fadc00cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 --2- 172.21.15.45:0/1239666926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadc00cd120 0x7fadc00b3990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:23.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 >> 172.21.15.45:0/1239666926 conn(0x7fadc00698e0 msgr2=0x7fadc00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 shutdown_connections 2023-07-09T02:11:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:23.744+0000 7fadc6de2640 1 -- 172.21.15.45:0/1239666926 wait complete. 2023-07-09T02:11:23.768 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-09T02:11:23.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-09T02:11:23.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-09T02:11:23.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-09T02:11:23.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-09T02:11:23.772 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-09T02:11:23.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-09T02:11:23.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-09T02:11:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3e5d2640 1 Processor -- start 2023-07-09T02:11:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3e5d2640 1 -- start start 2023-07-09T02:11:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3e5d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f380b3ac0 0x7f0f380cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3e5d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0f380adb10 0x7f0f380cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3e5d2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3808a5c0 con 0x7f0f380cdf20 2023-07-09T02:11:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3e5d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3808a810 con 0x7f0f380b3ac0 2023-07-09T02:11:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3e5d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f380b0da0 con 0x7f0f380adb10 2023-07-09T02:11:24.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3cb6f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0f380cdf20 0x7f0f380cc620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48824/0 (socket says 172.21.15.45:48824) 2023-07-09T02:11:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f3cb6f640 1 -- 172.21.15.45:0/1270268654 learned_addr learned my addr 172.21.15.45:0/1270268654 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f37fff640 1 --2- 172.21.15.45:0/1270268654 >> v2:172.21.15.45:3300/0 conn(0x7f0f380b3ac0 0x7f0f380cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.016+0000 7f0f377fe640 1 --2- 172.21.15.45:0/1270268654 >> v2:172.21.15.155:3300/0 conn(0x7f0f380adb10 0x7f0f380cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.020+0000 7f0f377fe640 1 -- 172.21.15.45:0/1270268654 >> v2:172.21.15.45:3300/0 conn(0x7f0f380b3ac0 msgr2=0x7f0f380cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.020+0000 7f0f377fe640 1 --2- 172.21.15.45:0/1270268654 >> v2:172.21.15.45:3300/0 conn(0x7f0f380b3ac0 0x7f0f380cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.020+0000 7f0f377fe640 1 -- 172.21.15.45:0/1270268654 >> v1:172.21.15.45:6789/0 conn(0x7f0f380cdf20 legacy=0x7f0f380cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.020+0000 7f0f377fe640 1 -- 172.21.15.45:0/1270268654 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380c8c00 con 0x7f0f380adb10 2023-07-09T02:11:24.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.020+0000 7f10a1b80640 1 Processor -- start 2023-07-09T02:11:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.020+0000 7f10a1b80640 1 -- start start 2023-07-09T02:11:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f826d4bd640 1 Processor -- start 2023-07-09T02:11:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f826d4bd640 1 -- start start 2023-07-09T02:11:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f10a1b80640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f109c15bf30 0x7f109c0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f10a1b80640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c0cd9a0 0x7f109c0cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f10a1b80640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109c0cc940 con 0x7f109c15c300 2023-07-09T02:11:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f10a1b80640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c0ac340 con 0x7f109c15bf30 2023-07-09T02:11:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f10a1b80640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0ccbe0 con 0x7f109c0cd9a0 2023-07-09T02:11:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f0f377fe640 1 --2- 172.21.15.45:0/1270268654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 0x7f0f380cc0e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f3806b9a0 tx=0x7f0f2801cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491387579de83759 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f10a137f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f109c15c300 0x7f109c0c90a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48826/0 (socket says 172.21.15.45:48826) 2023-07-09T02:11:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f10a137f640 1 -- 172.21.15.45:0/1573548841 learned_addr learned my addr 172.21.15.45:0/1573548841 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f109bfff640 1 --2- 172.21.15.45:0/1573548841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c0cd9a0 0x7f109c0cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f0f36ffd640 1 -- 172.21.15.45:0/1270268654 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280ab600 con 0x7f0f380adb10 2023-07-09T02:11:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f0f36ffd640 1 -- 172.21.15.45:0/1270268654 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f280a7050 con 0x7f0f380adb10 2023-07-09T02:11:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f0f36ffd640 1 -- 172.21.15.45:0/1270268654 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280ab980 con 0x7f0f380adb10 2023-07-09T02:11:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f109bfff640 1 -- 172.21.15.45:0/1573548841 >> v2:172.21.15.45:3300/0 conn(0x7f109c15bf30 msgr2=0x7f109c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f109bfff640 1 --2- 172.21.15.45:0/1573548841 >> v2:172.21.15.45:3300/0 conn(0x7f109c15bf30 0x7f109c0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f109bfff640 1 -- 172.21.15.45:0/1573548841 >> v1:172.21.15.45:6789/0 conn(0x7f109c15c300 legacy=0x7f109c0c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f109bfff640 1 -- 172.21.15.45:0/1573548841 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0ccec0 con 0x7f109c0cd9a0 2023-07-09T02:11:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f826d4bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 0x7f82680b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f826d4bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82680ad1a0 0x7f82680ad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f826d4bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82680ccec0 con 0x7f82681565d0 2023-07-09T02:11:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f826d4bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82680cb0a0 con 0x7f82680ad1a0 2023-07-09T02:11:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f826d4bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82680b0940 con 0x7f82680aff90 2023-07-09T02:11:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f8266ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f82681565d0 0x7f82680ca990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48840/0 (socket says 172.21.15.45:48840) 2023-07-09T02:11:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f8266ffd640 1 -- 172.21.15.45:0/3922309909 learned_addr learned my addr 172.21.15.45:0/3922309909 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/1270268654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 msgr2=0x7f0f380cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f0f3e5d2640 1 --2- 172.21.15.45:0/1270268654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 0x7f0f380cc0e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f3806b9a0 tx=0x7f0f2801cec0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.024+0000 7f82667fc640 1 --2- 172.21.15.45:0/3922309909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 0x7f82680b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f82677fe640 1 --2- 172.21.15.45:0/3922309909 >> v2:172.21.15.45:3300/0 conn(0x7f82680ad1a0 0x7f82680ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f8265ffb640 1 -- 172.21.15.45:0/3922309909 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307248198 0 0) 0x7f82680ccec0 con 0x7f82681565d0 2023-07-09T02:11:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f8265ffb640 1 -- 172.21.15.45:0/3922309909 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8250003530 con 0x7f82681565d0 2023-07-09T02:11:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f82667fc640 1 -- 172.21.15.45:0/3922309909 >> v2:172.21.15.45:3300/0 conn(0x7f82680ad1a0 msgr2=0x7f82680ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f82667fc640 1 --2- 172.21.15.45:0/3922309909 >> v2:172.21.15.45:3300/0 conn(0x7f82680ad1a0 0x7f82680ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f82667fc640 1 -- 172.21.15.45:0/3922309909 >> v1:172.21.15.45:6789/0 conn(0x7f82681565d0 legacy=0x7f82680ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f82667fc640 1 -- 172.21.15.45:0/3922309909 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82680cd1a0 con 0x7f82680aff90 2023-07-09T02:11:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/1270268654 shutdown_connections 2023-07-09T02:11:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f0f3e5d2640 1 --2- 172.21.15.45:0/1270268654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 0x7f0f380cc0e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f0f3e5d2640 1 --2- 172.21.15.45:0/1270268654 >> v2:172.21.15.45:3300/0 conn(0x7f0f380b3ac0 0x7f0f380cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/1270268654 >> 172.21.15.45:0/1270268654 conn(0x7f0f3806ae90 msgr2=0x7f0f3806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/1270268654 shutdown_connections 2023-07-09T02:11:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/1270268654 wait complete. 2023-07-09T02:11:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f0f3e5d2640 1 Processor -- start 2023-07-09T02:11:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.028+0000 7f3e9189c640 1 Processor -- start 2023-07-09T02:11:24.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3e5d2640 1 -- start start 2023-07-09T02:11:24.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f109bfff640 1 --2- 172.21.15.45:0/1573548841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c0cd9a0 0x7f109c0cb2a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1094009d90 tx=0x7f109401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ead0c314b77bd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e9189c640 1 -- start start 2023-07-09T02:11:24.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f109b7fe640 1 -- 172.21.15.45:0/1573548841 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940a5810 con 0x7f109c0cd9a0 2023-07-09T02:11:24.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f109b7fe640 1 -- 172.21.15.45:0/1573548841 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10940a5970 con 0x7f109c0cd9a0 2023-07-09T02:11:24.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f109b7fe640 1 -- 172.21.15.45:0/1573548841 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940a5d00 con 0x7f109c0cd9a0 2023-07-09T02:11:24.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f82667fc640 1 --2- 172.21.15.45:0/3922309909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 0x7f82680b0400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f825c0097c0 tx=0x7f825c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b1cbf802c4f911d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f8265ffb640 1 -- 172.21.15.45:0/3922309909 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0ac620 con 0x7f82680aff90 2023-07-09T02:11:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f8265ffb640 1 -- 172.21.15.45:0/3922309909 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c0ac780 con 0x7f82680aff90 2023-07-09T02:11:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f8265ffb640 1 -- 172.21.15.45:0/3922309909 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0acb10 con 0x7f82680aff90 2023-07-09T02:11:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3e5d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 0x7f0f3816beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f10a1b80640 1 -- 172.21.15.45:0/1573548841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c0cd9a0 msgr2=0x7f109c0cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f10a1b80640 1 --2- 172.21.15.45:0/1573548841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c0cd9a0 0x7f109c0cb2a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1094009d90 tx=0x7f109401c990 comp rx=0 tx=0).stop 2023-07-09T02:11:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3e5d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f380b3ac0 0x7f0f380b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3e5d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f380cdf20 0x7f0f3806fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f10a1b80640 1 -- 172.21.15.45:0/1573548841 shutdown_connections 2023-07-09T02:11:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f10a1b80640 1 --2- 172.21.15.45:0/1573548841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c0cd9a0 0x7f109c0cb2a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f10a1b80640 1 --2- 172.21.15.45:0/1573548841 >> v2:172.21.15.45:3300/0 conn(0x7f109c15bf30 0x7f109c0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f10a1b80640 1 -- 172.21.15.45:0/1573548841 >> 172.21.15.45:0/1573548841 conn(0x7f109c0ce4b0 msgr2=0x7f109c0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f10a1b80640 1 -- 172.21.15.45:0/1573548841 shutdown_connections 2023-07-09T02:11:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f10a1b80640 1 -- 172.21.15.45:0/1573548841 wait complete. 2023-07-09T02:11:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e9189c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e840e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e9189c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e84052820 0x7f3e840366d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e9189c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e84033c30 con 0x7f3e84033e70 2023-07-09T02:11:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e9189c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e840e2af0 con 0x7f3e84052820 2023-07-09T02:11:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e9189c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84033950 con 0x7f3e840e1ef0 2023-07-09T02:11:24.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f37fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 0x7f0f3816beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f37fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 0x7f0f3816beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59408/0 (socket says 172.21.15.45:59408) 2023-07-09T02:11:24.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f377fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f380b3ac0 0x7f0f380b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f377fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f380b3ac0 0x7f0f380b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38462/0 (socket says 172.21.15.45:38462) 2023-07-09T02:11:24.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3cb6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f380cdf20 0x7f0f3806fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3cb6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f380cdf20 0x7f0f3806fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46194/0 (socket says 172.21.15.45:46194) 2023-07-09T02:11:24.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f37fff640 1 -- 172.21.15.45:0/147554759 learned_addr learned my addr 172.21.15.45:0/147554759 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3816c3f0 con 0x7f0f380cdf20 2023-07-09T02:11:24.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380c8510 con 0x7f0f380adb10 2023-07-09T02:11:24.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380c7f50 con 0x7f0f380b3ac0 2023-07-09T02:11:24.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f826d4bd640 1 -- 172.21.15.45:0/3922309909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 msgr2=0x7f82680b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f826d4bd640 1 --2- 172.21.15.45:0/3922309909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 0x7f82680b0400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f825c0097c0 tx=0x7f825c01c3c0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e8affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e840e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e8affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e840e2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38476/0 (socket says 172.21.15.45:38476) 2023-07-09T02:11:24.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e8affd640 1 -- 172.21.15.45:0/2892774872 learned_addr learned my addr 172.21.15.45:0/2892774872 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f826d4bd640 1 -- 172.21.15.45:0/3922309909 shutdown_connections 2023-07-09T02:11:24.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f826d4bd640 1 --2- 172.21.15.45:0/3922309909 >> v2:172.21.15.45:3300/0 conn(0x7f82680ad1a0 0x7f82680ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f826d4bd640 1 --2- 172.21.15.45:0/3922309909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 0x7f82680b0400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f826d4bd640 1 -- 172.21.15.45:0/3922309909 >> 172.21.15.45:0/3922309909 conn(0x7f826806ae90 msgr2=0x7f826806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f826d4bd640 1 -- 172.21.15.45:0/3922309909 shutdown_connections 2023-07-09T02:11:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f37fff640 1 -- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f380b3ac0 msgr2=0x7f0f380b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e8affd640 1 -- 172.21.15.45:0/2892774872 >> v2:172.21.15.155:3300/0 conn(0x7f3e84052820 msgr2=0x7f3e840366d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T02:11:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e8affd640 1 --2- 172.21.15.45:0/2892774872 >> v2:172.21.15.155:3300/0 conn(0x7f3e84052820 0x7f3e840366d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e8affd640 1 -- 172.21.15.45:0/2892774872 >> v1:172.21.15.45:6789/0 conn(0x7f3e84033e70 legacy=0x7f3e84052d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T02:11:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f37fff640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f380b3ac0 0x7f0f380b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f37fff640 1 -- 172.21.15.45:0/147554759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f380cdf20 msgr2=0x7f0f3806fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f37fff640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f380cdf20 0x7f0f3806fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f0f37fff640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28009420 con 0x7f0f380adb10 2023-07-09T02:11:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f2c69a19640 1 Processor -- start 2023-07-09T02:11:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f0f37fff640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 0x7f0f3816beb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00d800 tx=0x7f0f2c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00b6c0 con 0x7f0f380adb10 2023-07-09T02:11:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00b820 con 0x7f0f380adb10 2023-07-09T02:11:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00bb90 con 0x7f0f380adb10 2023-07-09T02:11:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f380c8230 con 0x7f0f380adb10 2023-07-09T02:11:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a1b80640 1 Processor -- start 2023-07-09T02:11:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a1b80640 1 -- start start 2023-07-09T02:11:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f3e8affd640 1 -- 172.21.15.45:0/2892774872 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840e2430 con 0x7f3e840e1ef0 2023-07-09T02:11:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f380c5a80 con 0x7f0f380adb10 2023-07-09T02:11:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.032+0000 7f826d4bd640 1 -- 172.21.15.45:0/3922309909 wait complete. 2023-07-09T02:11:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a1b80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c0cd9a0 0x7f109c0c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a1b80640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c15bf30 0x7f109c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a1b80640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f109c15c300 0x7f109c162d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a1b80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c1535e0 con 0x7f109c0cd9a0 2023-07-09T02:11:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a1b80640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0afd90 con 0x7f109c15c300 2023-07-09T02:11:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a1b80640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c14f070 con 0x7f109c15bf30 2023-07-09T02:11:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f826d4bd640 1 Processor -- start 2023-07-09T02:11:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f826d4bd640 1 -- start start 2023-07-09T02:11:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f109bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c15bf30 0x7f109c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f109bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c15bf30 0x7f109c155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38492/0 (socket says 172.21.15.45:38492) 2023-07-09T02:11:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f109bfff640 1 -- 172.21.15.45:0/3208231900 learned_addr learned my addr 172.21.15.45:0/3208231900 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a0b7e640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c0cd9a0 0x7f109c0c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a137f640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f109c15c300 0x7f109c162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a0b7e640 1 -- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c15bf30 msgr2=0x7f109c155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a0b7e640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f109c15bf30 0x7f109c155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a0b7e640 1 -- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f109c15c300 msgr2=0x7f109c162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a0b7e640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f109c15c300 0x7f109c162d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f10a0b7e640 1 -- 172.21.15.45:0/3208231900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094009a70 con 0x7f109c0cd9a0 2023-07-09T02:11:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f10a0b7e640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c0cd9a0 0x7f109c0c1200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f108c00b3f0 tx=0x7f108c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f2c00bcf0 con 0x7f0f380adb10 2023-07-09T02:11:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f380cb7a0 con 0x7f0f380adb10 2023-07-09T02:11:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f0f34ff9640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f24066350 0x7f0f24068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f2c0841a0 con 0x7f0f380adb10 2023-07-09T02:11:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f0f34ff9640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f0f2406eb80 0x7f0f24070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f24071640 con 0x7f0f2406eb80 2023-07-09T02:11:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f0f377fe640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f24066350 0x7f0f24068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f0f3cb6f640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f0f2406eb80 0x7f0f24070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f826d4bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82680ad1a0 0x7f82680c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f826d4bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 0x7f82680b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f826d4bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82681565d0 0x7f826814b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f826d4bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680c26a0 con 0x7f82681565d0 2023-07-09T02:11:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f826d4bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680c2980 con 0x7f82680ad1a0 2023-07-09T02:11:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f826d4bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82680c2c60 con 0x7f82680aff90 2023-07-09T02:11:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f8266ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82680ad1a0 0x7f82680c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f82667fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 0x7f82680b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f8266ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82680ad1a0 0x7f82680c1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59432/0 (socket says 172.21.15.45:59432) 2023-07-09T02:11:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f8266ffd640 1 -- 172.21.15.45:0/3785876652 learned_addr learned my addr 172.21.15.45:0/3785876652 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f82677fe640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82681565d0 0x7f826814b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c011830 con 0x7f109c0cd9a0 2023-07-09T02:11:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c011990 con 0x7f109c0cd9a0 2023-07-09T02:11:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c011d40 con 0x7f109c0cd9a0 2023-07-09T02:11:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c151650 con 0x7f109c0cd9a0 2023-07-09T02:11:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c0c1740 con 0x7f109c0cd9a0 2023-07-09T02:11:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f107c000fd0 con 0x7f109c0cd9a0 2023-07-09T02:11:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e8affd640 1 --2- 172.21.15.45:0/2892774872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e840e2f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c008870 tx=0x7f3e7c01e970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a95d00218d9493 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e89ffb640 1 -- 172.21.15.45:0/2892774872 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0a7a20 con 0x7f3e840e1ef0 2023-07-09T02:11:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e89ffb640 1 -- 172.21.15.45:0/2892774872 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0ab070 con 0x7f3e840e1ef0 2023-07-09T02:11:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e89ffb640 1 -- 172.21.15.45:0/2892774872 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0a7da0 con 0x7f3e840e1ef0 2023-07-09T02:11:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e9189c640 1 -- 172.21.15.45:0/2892774872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 msgr2=0x7f3e840e2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e9189c640 1 --2- 172.21.15.45:0/2892774872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e840e2f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c008870 tx=0x7f3e7c01e970 comp rx=0 tx=0).stop 2023-07-09T02:11:24.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e9189c640 1 -- 172.21.15.45:0/2892774872 shutdown_connections 2023-07-09T02:11:24.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e9189c640 1 --2- 172.21.15.45:0/2892774872 >> v2:172.21.15.155:3300/0 conn(0x7f3e84052820 0x7f3e840366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e9189c640 1 --2- 172.21.15.45:0/2892774872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e840e2f10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e9189c640 1 -- 172.21.15.45:0/2892774872 >> 172.21.15.45:0/2892774872 conn(0x7f3e840516d0 msgr2=0x7f3e84051ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e9189c640 1 -- 172.21.15.45:0/2892774872 shutdown_connections 2023-07-09T02:11:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.036+0000 7f2c69a19640 1 -- start start 2023-07-09T02:11:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c69a19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c69a19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2c640ada80 0x7f2c6406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c69a19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640c8fd0 con 0x7f2c6406b820 2023-07-09T02:11:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c69a19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c640c1e80 con 0x7f2c640ada80 2023-07-09T02:11:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c69a19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6406bca0 con 0x7f2c641582d0 2023-07-09T02:11:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c69218640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2c6406b820 0x7f2c640cad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48860/0 (socket says 172.21.15.45:48860) 2023-07-09T02:11:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c69218640 1 -- 172.21.15.45:0/773119214 learned_addr learned my addr 172.21.15.45:0/773119214 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c68a17640 1 --2- 172.21.15.45:0/773119214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c68a17640 1 -- 172.21.15.45:0/773119214 >> v2:172.21.15.155:3300/0 conn(0x7f2c640ada80 msgr2=0x7f2c6406b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c68a17640 1 --2- 172.21.15.45:0/773119214 >> v2:172.21.15.155:3300/0 conn(0x7f2c640ada80 0x7f2c6406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c68a17640 1 -- 172.21.15.45:0/773119214 >> v1:172.21.15.45:6789/0 conn(0x7f2c6406b820 legacy=0x7f2c640cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f2c68a17640 1 -- 172.21.15.45:0/773119214 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c640c8ca0 con 0x7f2c641582d0 2023-07-09T02:11:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f8266ffd640 1 -- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 msgr2=0x7f82680b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f8266ffd640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82680aff90 0x7f82680b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f8266ffd640 1 -- 172.21.15.45:0/3785876652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82681565d0 msgr2=0x7f826814b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f8266ffd640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82681565d0 0x7f826814b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f8266ffd640 1 -- 172.21.15.45:0/3785876652 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c009420 con 0x7f82680ad1a0 2023-07-09T02:11:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f0f3cb6f640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f0f2406eb80 0x7f0f24070f90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f0f377fe640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f24066350 0x7f0f24068800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f280ad000 tx=0x7f0f28004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.040+0000 7f3e9189c640 1 -- 172.21.15.45:0/2892774872 wait complete. 2023-07-09T02:11:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f8266ffd640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82680ad1a0 0x7f82680c1fe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f825800c450 tx=0x7f825800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258005cf0 con 0x7f82680ad1a0 2023-07-09T02:11:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258005e50 con 0x7f82680ad1a0 2023-07-09T02:11:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258007290 con 0x7f82680ad1a0 2023-07-09T02:11:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82680c2f40 con 0x7f82680ad1a0 2023-07-09T02:11:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826814ba90 con 0x7f82680ad1a0 2023-07-09T02:11:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f177d056640 1 Processor -- start 2023-07-09T02:11:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f3e9189c640 1 Processor -- start 2023-07-09T02:11:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f177d056640 1 -- start start 2023-07-09T02:11:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f3e9189c640 1 -- start start 2023-07-09T02:11:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82680adb40 con 0x7f82680ad1a0 2023-07-09T02:11:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f2c0516b0 con 0x7f0f380adb10 2023-07-09T02:11:24.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 <== osd.0 v2:172.21.15.45:6808/101265301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0f24071640 con 0x7f0f2406eb80 2023-07-09T02:11:24.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f9b91cbd640 1 Processor -- start 2023-07-09T02:11:24.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e9189c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e84033e70 0x7f3e84187da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e9189c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e84052820 0x7f3e8418bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f177d056640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780665c0 0x7f1778152600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f177d056640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f177806f400 0x7f177806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f177d056640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177815c630 con 0x7f17780b3a50 2023-07-09T02:11:24.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f177d056640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177806fde0 con 0x7f177806f400 2023-07-09T02:11:24.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f177d056640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1778152b40 con 0x7f17780665c0 2023-07-09T02:11:24.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e84033e70 0x7f3e84187da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e84033e70 0x7f3e84187da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59446/0 (socket says 172.21.15.45:59446) 2023-07-09T02:11:24.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f2c68a17640 1 --2- 172.21.15.45:0/773119214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640cc8b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c60010bf0 tx=0x7f2c60024d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5cecc48a0871da server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c5b7fe640 1 -- 172.21.15.45:0/773119214 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600adcf0 con 0x7f2c641582d0 2023-07-09T02:11:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c5b7fe640 1 -- 172.21.15.45:0/773119214 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c600b1070 con 0x7f2c641582d0 2023-07-09T02:11:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c5b7fe640 1 -- 172.21.15.45:0/773119214 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600b7620 con 0x7f2c641582d0 2023-07-09T02:11:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f108c01a400 con 0x7f109c0cd9a0 2023-07-09T02:11:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f10997fa640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1088066350 0x7f1088068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f108c085320 con 0x7f109c0cd9a0 2023-07-09T02:11:24.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e84052820 0x7f3e8418bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 -- 172.21.15.45:0/1897511099 learned_addr learned my addr 172.21.15.45:0/1897511099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e9189c640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e8418c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8404c370 con 0x7f3e84052820 2023-07-09T02:11:24.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8418c7c0 con 0x7f3e84033e70 2023-07-09T02:11:24.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8418caa0 con 0x7f3e840e1ef0 2023-07-09T02:11:24.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8b7fe640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e8418c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f10997fa640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f108806ec00 0x7f1088071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 --> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10880716c0 con 0x7f108806ec00 2023-07-09T02:11:24.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f108c0856d0 con 0x7f109c0cd9a0 2023-07-09T02:11:24.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f109bfff640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1088066350 0x7f1088068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f10a137f640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f108806ec00 0x7f1088071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 -- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 msgr2=0x7f3e8418c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e8418c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 -- 172.21.15.45:0/1897511099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e84052820 msgr2=0x7f3e8418bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e84052820 0x7f3e8418bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c008550 con 0x7f3e84033e70 2023-07-09T02:11:24.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8b7fe640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e840e1ef0 0x7f3e8418c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:24.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c69a19640 1 -- 172.21.15.45:0/773119214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 msgr2=0x7f2c640cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c69a19640 1 --2- 172.21.15.45:0/773119214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640cc8b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c60010bf0 tx=0x7f2c60024d50 comp rx=0 tx=0).stop 2023-07-09T02:11:24.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f176ffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780665c0 0x7f1778152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.044+0000 7f9b91cbd640 1 -- start start 2023-07-09T02:11:24.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b91cbd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c06b120 0x7f9b8c0d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b91cbd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c0ccf50 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b91cbd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c0cd1f0 con 0x7f9b8c0ceba0 2023-07-09T02:11:24.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b91cbd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0d0f70 con 0x7f9b8c06b120 2023-07-09T02:11:24.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b90cbb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c06b120 0x7f9b8c0d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b90cbb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c06b120 0x7f9b8c0d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38538/0 (socket says 172.21.15.45:38538) 2023-07-09T02:11:24.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b90cbb640 1 -- 172.21.15.45:0/3009074021 learned_addr learned my addr 172.21.15.45:0/3009074021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f4128056640 1 Processor -- start 2023-07-09T02:11:24.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f176ffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780665c0 0x7f1778152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38520/0 (socket says 172.21.15.45:38520) 2023-07-09T02:11:24.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f176ffff640 1 -- 172.21.15.45:0/1267200868 learned_addr learned my addr 172.21.15.45:0/1267200868 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e8affd640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e84033e70 0x7f3e84187da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0b3040 tx=0x7f3e7c01d1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b90cbb640 1 -- 172.21.15.45:0/3009074021 >> v1:172.21.15.155:6789/0 conn(0x7f9b8c0ceba0 legacy=0x7f9b8c0c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b90cbb640 1 -- 172.21.15.45:0/3009074021 >> v1:172.21.15.45:6789/0 conn(0x7f9b8c0b1be0 legacy=0x7f9b8c06b4f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T02:11:24.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f9b90cbb640 1 -- 172.21.15.45:0/3009074021 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c0d1250 con 0x7f9b8c06b120 2023-07-09T02:11:24.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82580073f0 con 0x7f82680ad1a0 2023-07-09T02:11:24.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f177759e640 1 --2- 172.21.15.45:0/1267200868 >> v2:172.21.15.45:3300/0 conn(0x7f177806f400 0x7f177806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c69a19640 1 -- 172.21.15.45:0/773119214 shutdown_connections 2023-07-09T02:11:24.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c69a19640 1 --2- 172.21.15.45:0/773119214 >> v2:172.21.15.155:3300/0 conn(0x7f2c640ada80 0x7f2c6406b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c69a19640 1 --2- 172.21.15.45:0/773119214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640cc8b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f2c69a19640 1 -- 172.21.15.45:0/773119214 >> 172.21.15.45:0/773119214 conn(0x7f2c640ce4b0 msgr2=0x7f2c640ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0a8d20 con 0x7f3e84033e70 2023-07-09T02:11:24.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c00b150 con 0x7f3e84033e70 2023-07-09T02:11:24.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0a8ea0 con 0x7f3e84033e70 2023-07-09T02:11:24.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8404bd20 con 0x7f3e84033e70 2023-07-09T02:11:24.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8403a600 con 0x7f3e84033e70 2023-07-09T02:11:24.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f10a137f640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f108806ec00 0x7f1088071010 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f824f7fe640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8254066350 0x7f8254068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8258083280 con 0x7f82680ad1a0 2023-07-09T02:11:24.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f824f7fe640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7f825406ec00 0x7f8254071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 --> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82540716c0 con 0x7f825406ec00 2023-07-09T02:11:24.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82580858a0 con 0x7f82680ad1a0 2023-07-09T02:11:24.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f4128056640 1 -- start start 2023-07-09T02:11:24.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f82667fc640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8254066350 0x7f8254068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f82677fe640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7f825406ec00 0x7f8254071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 <== osd.2 v2:172.21.15.45:6821/1123173164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f10880716c0 con 0x7f108806ec00 2023-07-09T02:11:24.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f176ffff640 1 -- 172.21.15.45:0/1267200868 >> v2:172.21.15.45:3300/0 conn(0x7f177806f400 msgr2=0x7f177806f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f176ffff640 1 --2- 172.21.15.45:0/1267200868 >> v2:172.21.15.45:3300/0 conn(0x7f177806f400 0x7f177806f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f176ffff640 1 -- 172.21.15.45:0/1267200868 >> v1:172.21.15.155:6789/0 conn(0x7f17780b3a50 legacy=0x7f17781590f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-09T02:11:24.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.048+0000 7f176ffff640 1 -- 172.21.15.45:0/1267200868 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17780b2ab0 con 0x7f17780665c0 2023-07-09T02:11:24.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e6c000fd0 con 0x7f3e84033e70 2023-07-09T02:11:24.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4128056640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41200ce120 0x7f412006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4128056640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f412006c8d0 0x7f41200ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4128056640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41200cea30 con 0x7f41200ccf40 2023-07-09T02:11:24.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4128056640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41200cac30 con 0x7f412006c8d0 2023-07-09T02:11:24.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4128056640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412015a3c0 con 0x7f41200ce120 2023-07-09T02:11:24.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f82667fc640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8254066350 0x7f8254068800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f825c0097c0 tx=0x7f825c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f82677fe640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7f825406ec00 0x7f8254071010 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f109bfff640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1088066350 0x7f1088068800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1094000f90 tx=0x7f10940a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4125df2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41200ce120 0x7f412006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4125df2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41200ce120 0x7f412006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59450/0 (socket says 172.21.15.45:59450) 2023-07-09T02:11:24.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4125df2640 1 -- 172.21.15.45:0/3684927504 learned_addr learned my addr 172.21.15.45:0/3684927504 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f2c69a19640 1 -- 172.21.15.45:0/773119214 shutdown_connections 2023-07-09T02:11:24.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f2c69a19640 1 -- 172.21.15.45:0/773119214 wait complete. 2023-07-09T02:11:24.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f41255f1640 1 --2- 172.21.15.45:0/3684927504 >> v2:172.21.15.45:3300/0 conn(0x7f412006c8d0 0x7f41200ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4125df2640 1 -- 172.21.15.45:0/3684927504 >> v2:172.21.15.45:3300/0 conn(0x7f412006c8d0 msgr2=0x7f41200ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4125df2640 1 --2- 172.21.15.45:0/3684927504 >> v2:172.21.15.45:3300/0 conn(0x7f412006c8d0 0x7f41200ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4125df2640 1 -- 172.21.15.45:0/3684927504 >> v1:172.21.15.155:6789/0 conn(0x7f41200ccf40 legacy=0x7f41200cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f4125df2640 1 -- 172.21.15.45:0/3684927504 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412006ddd0 con 0x7f41200ce120 2023-07-09T02:11:24.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.052+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 <== osd.1 v2:172.21.15.45:6800/3315000466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f82540716c0 con 0x7f825406ec00 2023-07-09T02:11:24.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b90cbb640 1 --2- 172.21.15.45:0/3009074021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c06b120 0x7f9b8c0d2330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009e80 tx=0x7f9b8401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63efd1ee1bc1278d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f41255f1640 1 --2- 172.21.15.45:0/3684927504 >> v2:172.21.15.45:3300/0 conn(0x7f412006c8d0 0x7f41200ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:24.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e7c00b500 con 0x7f3e84033e70 2023-07-09T02:11:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b8b7fe640 1 -- 172.21.15.45:0/3009074021 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840a57c0 con 0x7f9b8c06b120 2023-07-09T02:11:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b8b7fe640 1 -- 172.21.15.45:0/3009074021 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b840a5920 con 0x7f9b8c06b120 2023-07-09T02:11:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e73fff640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e740664b0 0x7f3e74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f2c69a19640 1 Processor -- start 2023-07-09T02:11:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f2c69a19640 1 -- start start 2023-07-09T02:11:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b91cbd640 1 -- 172.21.15.45:0/3009074021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c06b120 msgr2=0x7f9b8c0d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b8b7fe640 1 -- 172.21.15.45:0/3009074021 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840a57c0 con 0x7f9b8c06b120 2023-07-09T02:11:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b91cbd640 1 --2- 172.21.15.45:0/3009074021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c06b120 0x7f9b8c0d2330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009e80 tx=0x7f9b8401c8e0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b91cbd640 1 -- 172.21.15.45:0/3009074021 shutdown_connections 2023-07-09T02:11:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b91cbd640 1 --2- 172.21.15.45:0/3009074021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c06b120 0x7f9b8c0d2330 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009e80 tx=0x7f9b8401c8e0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b91cbd640 1 -- 172.21.15.45:0/3009074021 >> 172.21.15.45:0/3009074021 conn(0x7f9b8c0cf370 msgr2=0x7f9b8c0cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e7c11e0a0 con 0x7f3e84033e70 2023-07-09T02:11:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e73fff640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f3e7406ed60 0x7f3e74071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e74071820 con 0x7f3e7406ed60 2023-07-09T02:11:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e7c1206c0 con 0x7f3e84033e70 2023-07-09T02:11:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e8a7fc640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e740664b0 0x7f3e74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e8b7fe640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f3e7406ed60 0x7f3e74071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b91cbd640 1 -- 172.21.15.45:0/3009074021 shutdown_connections 2023-07-09T02:11:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f176ffff640 1 --2- 172.21.15.45:0/1267200868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780665c0 0x7f1778152600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1760009870 tx=0x7f176001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce3bb32f29f63c9e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177659c640 1 -- 172.21.15.45:0/1267200868 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600a89b0 con 0x7f17780665c0 2023-07-09T02:11:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177659c640 1 -- 172.21.15.45:0/1267200868 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17600a8b10 con 0x7f17780665c0 2023-07-09T02:11:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177659c640 1 -- 172.21.15.45:0/1267200868 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600a8ea0 con 0x7f17780665c0 2023-07-09T02:11:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177d056640 1 -- 172.21.15.45:0/1267200868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780665c0 msgr2=0x7f1778152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177d056640 1 --2- 172.21.15.45:0/1267200868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780665c0 0x7f1778152600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1760009870 tx=0x7f176001ed10 comp rx=0 tx=0).stop 2023-07-09T02:11:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177d056640 1 -- 172.21.15.45:0/1267200868 shutdown_connections 2023-07-09T02:11:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177d056640 1 --2- 172.21.15.45:0/1267200868 >> v2:172.21.15.45:3300/0 conn(0x7f177806f400 0x7f177806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177d056640 1 --2- 172.21.15.45:0/1267200868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780665c0 0x7f1778152600 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177d056640 1 -- 172.21.15.45:0/1267200868 >> 172.21.15.45:0/1267200868 conn(0x7f17780694b0 msgr2=0x7f17780698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177d056640 1 -- 172.21.15.45:0/1267200868 shutdown_connections 2023-07-09T02:11:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f9b91cbd640 1 -- 172.21.15.45:0/3009074021 wait complete. 2023-07-09T02:11:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f3e8b7fe640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f3e7406ed60 0x7f3e74071170 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f2c69a19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6406b820 0x7f2c640bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f2c69a19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c640ada80 0x7f2c640be200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f2c69a19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f2c69a19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640bc390 con 0x7f2c6406b820 2023-07-09T02:11:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f2c69a19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c64071e70 con 0x7f2c640ada80 2023-07-09T02:11:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f2c69a19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640c1490 con 0x7f2c641582d0 2023-07-09T02:11:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640bc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38540/0 (socket says 172.21.15.45:38540) 2023-07-09T02:11:24.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 -- 172.21.15.45:0/3222092172 learned_addr learned my addr 172.21.15.45:0/3222092172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c5bfff640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c640ada80 0x7f2c640be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f4125df2640 1 --2- 172.21.15.45:0/3684927504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41200ce120 0x7f412006d7c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f411c006fd0 tx=0x7f411c01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27193013311cc1c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 <== osd.3 v2:172.21.15.45:6814/2399948348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f3e74071820 con 0x7f3e7406ed60 2023-07-09T02:11:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 -- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c640ada80 msgr2=0x7f2c640be200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c640ada80 0x7f2c640be200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 -- 172.21.15.45:0/3222092172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6406b820 msgr2=0x7f2c640bdcc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T02:11:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c68a17640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6406b820 0x7f2c640bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6406b820 0x7f2c640bdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 -- 172.21.15.45:0/3222092172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c60010800 con 0x7f2c641582d0 2023-07-09T02:11:24.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69218640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640bc7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00c750 tx=0x7f2c5c00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f4124df0640 1 -- 172.21.15.45:0/3684927504 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0ab620 con 0x7f41200ce120 2023-07-09T02:11:24.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f4124df0640 1 -- 172.21.15.45:0/3684927504 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0ab780 con 0x7f41200ce120 2023-07-09T02:11:24.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f4124df0640 1 -- 172.21.15.45:0/3684927504 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0abb10 con 0x7f41200ce120 2023-07-09T02:11:24.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f4128056640 1 -- 172.21.15.45:0/3684927504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41200ce120 msgr2=0x7f412006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f4128056640 1 --2- 172.21.15.45:0/3684927504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41200ce120 0x7f412006d7c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f411c006fd0 tx=0x7f411c01c420 comp rx=0 tx=0).stop 2023-07-09T02:11:24.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00a850 con 0x7f2c641582d0 2023-07-09T02:11:24.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c00a9d0 con 0x7f2c641582d0 2023-07-09T02:11:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00ad80 con 0x7f2c641582d0 2023-07-09T02:11:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c640c1770 con 0x7f2c641582d0 2023-07-09T02:11:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c64071ab0 con 0x7f2c641582d0 2023-07-09T02:11:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c640c1310 con 0x7f2c641582d0 2023-07-09T02:11:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f3e8a7fc640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e740664b0 0x7f3e74068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e8418bbb0 tx=0x7f3e80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.056+0000 7f177d056640 1 -- 172.21.15.45:0/1267200868 wait complete. 2023-07-09T02:11:24.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f177d056640 1 Processor -- start 2023-07-09T02:11:24.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f177d056640 1 -- start start 2023-07-09T02:11:24.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f177d056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17780665c0 0x7f1778139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.060+0000 7f9b91cbd640 1 Processor -- start 2023-07-09T02:11:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f9b91cbd640 1 -- start start 2023-07-09T02:11:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f4128056640 1 -- 172.21.15.45:0/3684927504 shutdown_connections 2023-07-09T02:11:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f4128056640 1 --2- 172.21.15.45:0/3684927504 >> v2:172.21.15.45:3300/0 conn(0x7f412006c8d0 0x7f41200ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f4128056640 1 --2- 172.21.15.45:0/3684927504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41200ce120 0x7f412006d7c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f4128056640 1 -- 172.21.15.45:0/3684927504 >> 172.21.15.45:0/3684927504 conn(0x7f41200659d0 msgr2=0x7f41200d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f4128056640 1 -- 172.21.15.45:0/3684927504 shutdown_connections 2023-07-09T02:11:24.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f4128056640 1 -- 172.21.15.45:0/3684927504 wait complete. 2023-07-09T02:11:24.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f1776d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17780665c0 0x7f1778139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f1776d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17780665c0 0x7f1778139230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46258/0 (socket says 172.21.15.45:46258) 2023-07-09T02:11:24.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f1776d9d640 1 -- 172.21.15.45:0/1277564972 learned_addr learned my addr 172.21.15.45:0/1277564972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f177d056640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f177806f400 0x7f1778141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f177d056640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780b3a50 0x7f177806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f176ffff640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f177806f400 0x7f1778141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c5c012420 con 0x7f2c641582d0 2023-07-09T02:11:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f177d056640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17780af2d0 con 0x7f17780665c0 2023-07-09T02:11:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f177d056640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17781565b0 con 0x7f177806f400 2023-07-09T02:11:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f177d056640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1778139770 con 0x7f17780b3a50 2023-07-09T02:11:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f177759e640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780b3a50 0x7f177806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f4128056640 1 Processor -- start 2023-07-09T02:11:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f1776d9d640 1 -- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780b3a50 msgr2=0x7f177806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f1776d9d640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17780b3a50 0x7f177806cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f1776d9d640 1 -- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f177806f400 msgr2=0x7f1778141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f1776d9d640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f177806f400 0x7f1778141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f1776d9d640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600094d0 con 0x7f17780665c0 2023-07-09T02:11:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f9b91cbd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c0b1be0 0x7f9b8c150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f4128056640 1 -- start start 2023-07-09T02:11:24.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f9b91cbd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8c0ceba0 0x7f9b8c15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.064+0000 7f2c597fa640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c500662d0 0x7f2c50068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c5c0848d0 con 0x7f2c641582d0 2023-07-09T02:11:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f1776d9d640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17780665c0 0x7f1778139230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f176800b3e0 tx=0x7f176800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b91cbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b8c151240 0x7f9b8c1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b8bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8c0ceba0 0x7f9b8c15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c68a17640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c500662d0 0x7f2c50068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c597fa640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2c5006eb80 0x7f2c50070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 --> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c50071640 con 0x7f2c5006eb80 2023-07-09T02:11:24.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c5c084c40 con 0x7f2c641582d0 2023-07-09T02:11:24.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768011830 con 0x7f17780665c0 2023-07-09T02:11:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c5bfff640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2c5006eb80 0x7f2c50070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4128056640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412006c8d0 0x7f41200c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4128056640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41200ccf40 0x7f41200d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b8bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8c0ceba0 0x7f9b8c15eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59484/0 (socket says 172.21.15.45:59484) 2023-07-09T02:11:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b90cbb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c0b1be0 0x7f9b8c150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b90cbb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c0b1be0 0x7f9b8c150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38560/0 (socket says 172.21.15.45:38560) 2023-07-09T02:11:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b914bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b8c151240 0x7f9b8c1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b914bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b8c151240 0x7f9b8c1546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46274/0 (socket says 172.21.15.45:46274) 2023-07-09T02:11:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b8bfff640 1 -- 172.21.15.45:0/1315929129 learned_addr learned my addr 172.21.15.45:0/1315929129 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0b7b90 con 0x7f9b8c151240 2023-07-09T02:11:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412006c8d0 0x7f41200c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412006c8d0 0x7f41200c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59488/0 (socket says 172.21.15.45:59488) 2023-07-09T02:11:24.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0b7e30 con 0x7f9b8c0ceba0 2023-07-09T02:11:24.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4128056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41200ce120 0x7f4120153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c68a17640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c500662d0 0x7f2c50068780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2c600b8000 tx=0x7f2c600af070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c5bfff640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2c5006eb80 0x7f2c50070f90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f177d056640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1778141a70 con 0x7f17780665c0 2023-07-09T02:11:24.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f177d056640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1778155c80 con 0x7f17780665c0 2023-07-09T02:11:24.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17680119b0 con 0x7f17780665c0 2023-07-09T02:11:24.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768011d60 con 0x7f17780665c0 2023-07-09T02:11:24.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f177d056640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f175c000fd0 con 0x7f17780665c0 2023-07-09T02:11:24.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 <== osd.4 v2:172.21.15.155:6808/3680660905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f2c50071640 con 0x7f2c5006eb80 2023-07-09T02:11:24.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0b8110 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f41255f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41200ccf40 0x7f41200d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f41255f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41200ccf40 0x7f41200d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38566/0 (socket says 172.21.15.45:38566) 2023-07-09T02:11:24.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 -- 172.21.15.45:0/3941866087 learned_addr learned my addr 172.21.15.45:0/3941866087 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41200c5e90 con 0x7f41200ce120 2023-07-09T02:11:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41200c55f0 con 0x7f412006c8d0 2023-07-09T02:11:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41200c58d0 con 0x7f41200ccf40 2023-07-09T02:11:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 -- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41200ccf40 msgr2=0x7f41200d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41200ccf40 0x7f41200d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 -- 172.21.15.45:0/3941866087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41200ce120 msgr2=0x7f4120153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41200ce120 0x7f4120153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c009480 con 0x7f412006c8d0 2023-07-09T02:11:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f4125df2640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412006c8d0 0x7f41200c94f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f411c019030 tx=0x7f411c0191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.068+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0ab8f0 con 0x7f412006c8d0 2023-07-09T02:11:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41200c5bb0 con 0x7f412006c8d0 2023-07-09T02:11:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41200c9a30 con 0x7f412006c8d0 2023-07-09T02:11:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0aba50 con 0x7f412006c8d0 2023-07-09T02:11:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b90cbb640 1 -- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8c0ceba0 msgr2=0x7f9b8c15eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b90cbb640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8c0ceba0 0x7f9b8c15eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b90cbb640 1 -- 172.21.15.45:0/1315929129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b8c151240 msgr2=0x7f9b8c1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b90cbb640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b8c151240 0x7f9b8c1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b90cbb640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84009b30 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b8bfff640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b8c0ceba0 0x7f9b8c15eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:24.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f176801a400 con 0x7f17780665c0 2023-07-09T02:11:24.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b90cbb640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c0b1be0 0x7f9b8c150a10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b840ab000 tx=0x7f9b84019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840bd070 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b84009250 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b84003df0 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f410bfff640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4100000fd0 con 0x7f412006c8d0 2023-07-09T02:11:24.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f176f7fe640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1758066350 0x7f1758068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c0b5830 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c150f50 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17680843e0 con 0x7f17780665c0 2023-07-09T02:11:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f176ffff640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1758066350 0x7f1758068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f176f7fe640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7f175806ec00 0x7f1758071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17580716c0 con 0x7f175806ec00 2023-07-09T02:11:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1768084790 con 0x7f17780665c0 2023-07-09T02:11:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b8c071660 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.072+0000 7f177759e640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7f175806ec00 0x7f1758071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f177759e640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7f175806ec00 0x7f1758071010 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f176ffff640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1758066350 0x7f1758068800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17600b2000 tx=0x7f17600aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f9b914bc640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b8c151240 0x7f9b8c1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0abe00 con 0x7f412006c8d0 2023-07-09T02:11:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f411c003620 con 0x7f412006c8d0 2023-07-09T02:11:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41167fc640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4104066400 0x7f41040688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f411c11e2c0 con 0x7f412006c8d0 2023-07-09T02:11:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41255f1640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4104066400 0x7f41040688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41167fc640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f410406ecb0 0x7f41040710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4104071770 con 0x7f410406ecb0 2023-07-09T02:11:24.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f411c120810 con 0x7f412006c8d0 2023-07-09T02:11:24.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 <== osd.5 v2:172.21.15.155:6819/1199637530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f17580716c0 con 0x7f175806ec00 2023-07-09T02:11:24.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41265f3640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f410406ecb0 0x7f41040710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f41255f1640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4104066400 0x7f41040688b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41201552b0 tx=0x7f4110008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b84004040 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f9b897fa640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b78066380 0x7f9b78068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.076+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b8411f6a0 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f9b897fa640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f9b7806ec30 0x7f9b78071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b780716f0 con 0x7f9b7806ec30 2023-07-09T02:11:24.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b8411fa50 con 0x7f9b8c0b1be0 2023-07-09T02:11:24.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f41265f3640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f410406ecb0 0x7f41040710c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 --> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82680cd480 con 0x7f825406ec00 2023-07-09T02:11:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f9b8bfff640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b78066380 0x7f9b78068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f9b914bc640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f9b7806ec30 0x7f9b78071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f824f7fe640 1 -- 172.21.15.45:0/3785876652 <== osd.1 v2:172.21.15.45:6800/3315000466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8260009ad0 con 0x7f825406ec00 2023-07-09T02:11:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 <== osd.7 v2:172.21.15.155:6816/3747873244 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f4104071770 con 0x7f410406ecb0 2023-07-09T02:11:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7f825406ec00 msgr2=0x7f8254071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7f825406ec00 0x7f8254071010 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8254066350 msgr2=0x7f8254068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8254066350 0x7f8254068800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f825c0097c0 tx=0x7f825c0a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:24.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f9b8bfff640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b78066380 0x7f9b78068830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0c6090 tx=0x7f9b80009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 --> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f107c002cf0 con 0x7f108806ec00 2023-07-09T02:11:24.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f9b914bc640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f9b7806ec30 0x7f9b78071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82680ad1a0 msgr2=0x7f82680c1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 --2- 172.21.15.45:0/3785876652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82680ad1a0 0x7f82680c1fe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f825800c450 tx=0x7f825800c910 comp rx=0 tx=0).stop 2023-07-09T02:11:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f82677fe640 1 -- 172.21.15.45:0/3785876652 reap_dead start 2023-07-09T02:11:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 shutdown_connections 2023-07-09T02:11:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 >> 172.21.15.45:0/3785876652 conn(0x7f826806ae90 msgr2=0x7f82680af880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f10997fa640 1 -- 172.21.15.45:0/3208231900 <== osd.2 v2:172.21.15.45:6821/1123173164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f107c002cf0 con 0x7f108806ec00 2023-07-09T02:11:24.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 <== osd.6 v2:172.21.15.155:6800/4095749246 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9b780716f0 con 0x7f9b7806ec30 2023-07-09T02:11:24.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 shutdown_connections 2023-07-09T02:11:24.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.080+0000 7f826d4bd640 1 -- 172.21.15.45:0/3785876652 wait complete. 2023-07-09T02:11:24.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 --> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f3804e020 con 0x7f0f2406eb80 2023-07-09T02:11:24.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f108806ec00 msgr2=0x7f1088071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f108806ec00 0x7f1088071010 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1088066350 msgr2=0x7f1088068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1088066350 0x7f1088068800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1094000f90 tx=0x7f10940a7070 comp rx=0 tx=0).stop 2023-07-09T02:11:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c0cd9a0 msgr2=0x7f109c0c1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 --2- 172.21.15.45:0/3208231900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f109c0cd9a0 0x7f109c0c1200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f108c00b3f0 tx=0x7f108c00b8b0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a137f640 1 -- 172.21.15.45:0/3208231900 reap_dead start 2023-07-09T02:11:24.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f34ff9640 1 -- 172.21.15.45:0/147554759 <== osd.0 v2:172.21.15.45:6808/101265301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f3804e020 con 0x7f0f2406eb80 2023-07-09T02:11:24.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 shutdown_connections 2023-07-09T02:11:24.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 >> 172.21.15.45:0/3208231900 conn(0x7f109c0ce4b0 msgr2=0x7f109c0ad370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f0f2406eb80 msgr2=0x7f0f24070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f0f2406eb80 0x7f0f24070f90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 shutdown_connections 2023-07-09T02:11:24.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f10a1b80640 1 -- 172.21.15.45:0/3208231900 wait complete. 2023-07-09T02:11:24.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f24066350 msgr2=0x7f0f24068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f24066350 0x7f0f24068800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f280ad000 tx=0x7f0f28004740 comp rx=0 tx=0).stop 2023-07-09T02:11:24.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 msgr2=0x7f0f3816beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 --2- 172.21.15.45:0/147554759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f380adb10 0x7f0f3816beb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00d800 tx=0x7f0f2c00dcc0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3cb6f640 1 -- 172.21.15.45:0/147554759 reap_dead start 2023-07-09T02:11:24.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 shutdown_connections 2023-07-09T02:11:24.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 >> 172.21.15.45:0/147554759 conn(0x7f0f3806ae90 msgr2=0x7f0f38168950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 shutdown_connections 2023-07-09T02:11:24.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.084+0000 7f0f3e5d2640 1 -- 172.21.15.45:0/147554759 wait complete. 2023-07-09T02:11:24.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.088+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 --> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e6c002cc0 con 0x7f3e7406ed60 2023-07-09T02:11:24.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.088+0000 7f3e73fff640 1 -- 172.21.15.45:0/1897511099 <== osd.3 v2:172.21.15.45:6814/2399948348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e6c002cc0 con 0x7f3e7406ed60 2023-07-09T02:11:24.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.092+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 --> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c640cd890 con 0x7f2c5006eb80 2023-07-09T02:11:24.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f2c597fa640 1 -- 172.21.15.45:0/3222092172 <== osd.4 v2:172.21.15.155:6808/3680660905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c5400b980 con 0x7f2c5006eb80 2023-07-09T02:11:24.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f3e7406ed60 msgr2=0x7f3e74071170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f3e7406ed60 0x7f3e74071170 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e740664b0 msgr2=0x7f3e74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e740664b0 0x7f3e74068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e8418bbb0 tx=0x7f3e80008040 comp rx=0 tx=0).stop 2023-07-09T02:11:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e84033e70 msgr2=0x7f3e84187da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 --2- 172.21.15.45:0/1897511099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e84033e70 0x7f3e84187da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0b3040 tx=0x7f3e7c01d1b0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e8b7fe640 1 -- 172.21.15.45:0/1897511099 reap_dead start 2023-07-09T02:11:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 shutdown_connections 2023-07-09T02:11:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 >> 172.21.15.45:0/1897511099 conn(0x7f3e840516d0 msgr2=0x7f3e84035da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 shutdown_connections 2023-07-09T02:11:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.096+0000 7f3e9189c640 1 -- 172.21.15.45:0/1897511099 wait complete. 2023-07-09T02:11:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f177d056640 1 -- 172.21.15.45:0/1277564972 --> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f175c002cf0 con 0x7f175806ec00 2023-07-09T02:11:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2c5006eb80 msgr2=0x7f2c50070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69a19640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2c5006eb80 0x7f2c50070f90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c500662d0 msgr2=0x7f2c50068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69a19640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c500662d0 0x7f2c50068780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2c600b8000 tx=0x7f2c600af070 comp rx=0 tx=0).stop 2023-07-09T02:11:24.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 msgr2=0x7f2c640bc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69a19640 1 --2- 172.21.15.45:0/3222092172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c641582d0 0x7f2c640bc7c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00c750 tx=0x7f2c5c00cc10 comp rx=0 tx=0).stop 2023-07-09T02:11:24.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69218640 1 -- 172.21.15.45:0/3222092172 reap_dead start 2023-07-09T02:11:24.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f176f7fe640 1 -- 172.21.15.45:0/1277564972 <== osd.5 v2:172.21.15.155:6819/1199637530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f175c002cf0 con 0x7f175806ec00 2023-07-09T02:11:24.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 shutdown_connections 2023-07-09T02:11:24.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.100+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 >> 172.21.15.45:0/3222092172 conn(0x7f2c640ce4b0 msgr2=0x7f2c640c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 -- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7f175806ec00 msgr2=0x7f1758071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7f175806ec00 0x7f1758071010 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 shutdown_connections 2023-07-09T02:11:24.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 -- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1758066350 msgr2=0x7f1758068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1758066350 0x7f1758068800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17600b2000 tx=0x7f17600aa070 comp rx=0 tx=0).stop 2023-07-09T02:11:24.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f2c69a19640 1 -- 172.21.15.45:0/3222092172 wait complete. 2023-07-09T02:11:24.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 -- 172.21.15.45:0/1277564972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17780665c0 msgr2=0x7f1778139230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 --2- 172.21.15.45:0/1277564972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17780665c0 0x7f1778139230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f176800b3e0 tx=0x7f176800b8a0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f177759e640 1 -- 172.21.15.45:0/1277564972 reap_dead start 2023-07-09T02:11:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 -- 172.21.15.45:0/1277564972 shutdown_connections 2023-07-09T02:11:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 -- 172.21.15.45:0/1277564972 >> 172.21.15.45:0/1277564972 conn(0x7f17780694b0 msgr2=0x7f177815b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 -- 172.21.15.45:0/1277564972 shutdown_connections 2023-07-09T02:11:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f176d7fa640 1 -- 172.21.15.45:0/1277564972 wait complete. 2023-07-09T02:11:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f410bfff640 1 -- 172.21.15.45:0/3941866087 --> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4100002cc0 con 0x7f410406ecb0 2023-07-09T02:11:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 --> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b8c150f50 con 0x7f9b7806ec30 2023-07-09T02:11:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f9b897fa640 1 -- 172.21.15.45:0/1315929129 <== osd.6 v2:172.21.15.155:6800/4095749246 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9b8c150f50 con 0x7f9b7806ec30 2023-07-09T02:11:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.104+0000 7f41167fc640 1 -- 172.21.15.45:0/3941866087 <== osd.7 v2:172.21.15.155:6816/3747873244 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4100002cc0 con 0x7f410406ecb0 2023-07-09T02:11:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f9b7806ec30 msgr2=0x7f9b78071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f9b7806ec30 0x7f9b78071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f410406ecb0 msgr2=0x7f41040710c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f410406ecb0 0x7f41040710c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b78066380 msgr2=0x7f9b78068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b78066380 0x7f9b78068830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0c6090 tx=0x7f9b80009190 comp rx=0 tx=0).stop 2023-07-09T02:11:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4104066400 msgr2=0x7f41040688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4104066400 0x7f41040688b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f41201552b0 tx=0x7f4110008040 comp rx=0 tx=0).stop 2023-07-09T02:11:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412006c8d0 msgr2=0x7f41200c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 --2- 172.21.15.45:0/3941866087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412006c8d0 0x7f41200c94f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f411c019030 tx=0x7f411c0191c0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f41265f3640 1 -- 172.21.15.45:0/3941866087 reap_dead start 2023-07-09T02:11:24.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c0b1be0 msgr2=0x7f9b8c150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 --2- 172.21.15.45:0/1315929129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b8c0b1be0 0x7f9b8c150a10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b840ab000 tx=0x7f9b84019680 comp rx=0 tx=0).stop 2023-07-09T02:11:24.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 shutdown_connections 2023-07-09T02:11:24.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 >> 172.21.15.45:0/3941866087 conn(0x7f41200659d0 msgr2=0x7f412006b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b914bc640 1 -- 172.21.15.45:0/1315929129 reap_dead start 2023-07-09T02:11:24.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 shutdown_connections 2023-07-09T02:11:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 shutdown_connections 2023-07-09T02:11:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 >> 172.21.15.45:0/1315929129 conn(0x7f9b8c0cf370 msgr2=0x7f9b8c0b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 shutdown_connections 2023-07-09T02:11:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f9b91cbd640 1 -- 172.21.15.45:0/1315929129 wait complete. 2023-07-09T02:11:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.108+0000 7f4128056640 1 -- 172.21.15.45:0/3941866087 wait complete. 2023-07-09T02:11:24.164 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:24.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-09T02:11:24.165 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:24.166 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-09T02:11:24.166 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:24.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-09T02:11:24.167 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:24.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-09T02:11:24.169 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:24.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-09T02:11:24.170 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:24.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-09T02:11:24.171 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:24.171 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-09T02:11:24.172 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:24.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-09T02:11:24.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.444+0000 7fc115c48640 1 Processor -- start 2023-07-09T02:11:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.444+0000 7fc115c48640 1 -- start start 2023-07-09T02:11:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.444+0000 7fc115c48640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc110159150 0x7fc1100c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.444+0000 7fc115c48640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc110159520 con 0x7fc1100cb220 2023-07-09T02:11:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.444+0000 7fc115c48640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11015bc50 con 0x7fc1100c90a0 2023-07-09T02:11:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.444+0000 7fc115c48640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc110158520 con 0x7fc110159150 2023-07-09T02:11:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc110159150 0x7fc1100c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc110159150 0x7fc1100c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46286/0 (socket says 172.21.15.45:46286) 2023-07-09T02:11:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10f7fe640 1 -- 172.21.15.45:0/2486244288 learned_addr learned my addr 172.21.15.45:0/2486244288 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329713360 0 0) 0x7fc11015bc50 con 0x7fc1100c90a0 2023-07-09T02:11:24.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f8003530 con 0x7fc1100c90a0 2023-07-09T02:11:24.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860704672 0 0) 0x7fc110159520 con 0x7fc1100cb220 2023-07-09T02:11:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc11015bc50 con 0x7fc1100cb220 2023-07-09T02:11:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177589220 0 0) 0x7fc0f8003530 con 0x7fc1100c90a0 2023-07-09T02:11:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 >> v2:172.21.15.45:3300/0 conn(0x7fc110159150 msgr2=0x7fc1100c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 --2- 172.21.15.45:0/2486244288 >> v2:172.21.15.45:3300/0 conn(0x7fc110159150 0x7fc1100c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 >> v1:172.21.15.45:6789/0 conn(0x7fc1100cb220 legacy=0x7fc1100cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11015bf30 con 0x7fc1100c90a0 2023-07-09T02:11:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fc100001680 con 0x7fc1100c90a0 2023-07-09T02:11:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 >> v1:172.21.15.155:6789/0 conn(0x7fc1100c90a0 legacy=0x7fc1100cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f8003b60 0x7fc0f8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0f800bd80 0x7fc0f800e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0f800e760 0x7fc0f8010c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80114c0 con 0x7fc0f800bd80 2023-07-09T02:11:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8004800 con 0x7fc0f8003b60 2023-07-09T02:11:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80049c0 con 0x7fc0f800e760 2023-07-09T02:11:24.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10f7fe640 1 --2- 172.21.15.45:0/2486244288 >> v2:172.21.15.45:3300/0 conn(0x7fc110159150 0x7fc1100c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:24.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10effd640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0f800bd80 0x7fc0f800e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10f7fe640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f8003b60 0x7fc0f8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10effd640 1 -- 172.21.15.45:0/2486244288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0f800e760 msgr2=0x7fc0f8010c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10effd640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0f800e760 0x7fc0f8010c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10effd640 1 -- 172.21.15.45:0/2486244288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f8003b60 msgr2=0x7fc0f8003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10effd640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f8003b60 0x7fc0f8003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10effd640 1 -- 172.21.15.45:0/2486244288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8003530 con 0x7fc0f800bd80 2023-07-09T02:11:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.448+0000 7fc10ffff640 1 -- 172.21.15.45:0/2486244288 reap_dead start 2023-07-09T02:11:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc10effd640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0f800bd80 0x7fc0f800e160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc100007ee0 tx=0x7fc10001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d17979edb792b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7f3712c8a640 1 Processor -- start 2023-07-09T02:11:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000a6700 con 0x7fc0f800bd80 2023-07-09T02:11:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7f3712c8a640 1 -- start start 2023-07-09T02:11:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1000a6860 con 0x7fc0f800bd80 2023-07-09T02:11:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc10e7fc640 1 -- 172.21.15.45:0/2486244288 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000a6700 con 0x7fc0f800bd80 2023-07-09T02:11:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc115c48640 1 -- 172.21.15.45:0/2486244288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0f800bd80 msgr2=0x7fc0f800e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc115c48640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0f800bd80 0x7fc0f800e160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc100007ee0 tx=0x7fc10001ca20 comp rx=0 tx=0).stop 2023-07-09T02:11:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc115c48640 1 -- 172.21.15.45:0/2486244288 shutdown_connections 2023-07-09T02:11:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc115c48640 1 --2- 172.21.15.45:0/2486244288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0f800bd80 0x7fc0f800e160 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc115c48640 1 -- 172.21.15.45:0/2486244288 >> 172.21.15.45:0/2486244288 conn(0x7fc11006ae90 msgr2=0x7fc11006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc115c48640 1 -- 172.21.15.45:0/2486244288 shutdown_connections 2023-07-09T02:11:24.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3712c8a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f370c099f40 0x7f370c15e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3711c88640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f370c159f40 0x7f370c15da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48874/0 (socket says 172.21.15.45:48874) 2023-07-09T02:11:24.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3711487640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f370c099f40 0x7f370c15e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3711487640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f370c099f40 0x7f370c15e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46306/0 (socket says 172.21.15.45:46306) 2023-07-09T02:11:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3711487640 1 -- 172.21.15.45:0/3665648636 learned_addr learned my addr 172.21.15.45:0/3665648636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.456+0000 7fc115c48640 1 -- 172.21.15.45:0/2486244288 wait complete. 2023-07-09T02:11:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7fc115c48640 1 Processor -- start 2023-07-09T02:11:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3712c8a640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0d0020 0x7f370c15c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7fc115c48640 1 -- start start 2023-07-09T02:11:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3712c8a640 1 -- 172.21.15.45:0/3665648636 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c15b320 con 0x7f370c159f40 2023-07-09T02:11:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3712c8a640 1 -- 172.21.15.45:0/3665648636 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0d0500 con 0x7f370c099f40 2023-07-09T02:11:24.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3712489640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0d0020 0x7f370c15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7fc115c48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f800bd80 0x7fc1100ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7fc10f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f800bd80 0x7fc1100ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7fc10f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f800bd80 0x7fc1100ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59514/0 (socket says 172.21.15.45:59514) 2023-07-09T02:11:24.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7fc10f7fe640 1 -- 172.21.15.45:0/2100544894 learned_addr learned my addr 172.21.15.45:0/2100544894 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3712c8a640 1 -- 172.21.15.45:0/3665648636 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0d11c0 con 0x7f370c0d0020 2023-07-09T02:11:24.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896620015 0 0) 0x7f370c15b320 con 0x7f370c159f40 2023-07-09T02:11:24.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f8007940 con 0x7f370c159f40 2023-07-09T02:11:24.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3534777817 0 0) 0x7f36f8007940 con 0x7f370c159f40 2023-07-09T02:11:24.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0d0020 msgr2=0x7f370c15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0d0020 0x7f370c15c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 >> v2:172.21.15.45:3300/0 conn(0x7f370c099f40 msgr2=0x7f370c15e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 --2- 172.21.15.45:0/3665648636 >> v2:172.21.15.45:3300/0 conn(0x7f370c099f40 0x7f370c15e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0d14a0 con 0x7f370c159f40 2023-07-09T02:11:24.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f36fc001680 con 0x7f370c159f40 2023-07-09T02:11:24.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 >> v1:172.21.15.45:6789/0 conn(0x7f370c159f40 legacy=0x7f370c15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f8007d90 0x7f36f80081a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8008770 0x7f36f8008c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f8009180 0x7f36f80095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0d0500 con 0x7f36f8008770 2023-07-09T02:11:24.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0d11c0 con 0x7f36f8009180 2023-07-09T02:11:24.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f800bee0 con 0x7f36f8007d90 2023-07-09T02:11:24.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f3711c88640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f8007d90 0x7f36f80081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f3712489640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f8009180 0x7f36f80095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f3711487640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8008770 0x7f36f8008c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f3711c88640 1 -- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f8009180 msgr2=0x7f36f80095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f3711c88640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f8009180 0x7f36f80095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f3711c88640 1 -- 172.21.15.45:0/3665648636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8008770 msgr2=0x7f36f8008c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f3711c88640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8008770 0x7f36f8008c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f3711c88640 1 -- 172.21.15.45:0/3665648636 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0d14a0 con 0x7f36f8007d90 2023-07-09T02:11:24.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f26bc359640 1 Processor -- start 2023-07-09T02:11:24.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.460+0000 7f26bc359640 1 -- start start 2023-07-09T02:11:24.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26bc359640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26ac0e69b0 0x7f26ac0532f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26bc359640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26ac0e6d80 0x7f26ac0068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26bc359640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac006e30 con 0x7f26ac036590 2023-07-09T02:11:24.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26bc359640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ac04f7e0 con 0x7f26ac0e6d80 2023-07-09T02:11:24.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26bc359640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ac051060 con 0x7f26ac0e69b0 2023-07-09T02:11:24.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26b98f4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26ac0e6d80 0x7f26ac0068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26b98f4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26ac0e6d80 0x7f26ac0068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46330/0 (socket says 172.21.15.45:46330) 2023-07-09T02:11:24.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26b98f4640 1 -- 172.21.15.45:0/2947640 learned_addr learned my addr 172.21.15.45:0/2947640 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26ba0f5640 1 --2- 172.21.15.45:0/2947640 >> v2:172.21.15.155:3300/0 conn(0x7f26ac0e69b0 0x7f26ac0532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26b98f4640 1 -- 172.21.15.45:0/2947640 >> v2:172.21.15.155:3300/0 conn(0x7f26ac0e69b0 msgr2=0x7f26ac0532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26b98f4640 1 --2- 172.21.15.45:0/2947640 >> v2:172.21.15.155:3300/0 conn(0x7f26ac0e69b0 0x7f26ac0532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26b98f4640 1 -- 172.21.15.45:0/2947640 >> v1:172.21.15.155:6789/0 conn(0x7f26ac036590 legacy=0x7f26ac0369b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26b90f3640 1 -- 172.21.15.45:0/2947640 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379197785 0 0) 0x7f26ac006e30 con 0x7f26ac036590 2023-07-09T02:11:24.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.464+0000 7f26b98f4640 1 -- 172.21.15.45:0/2947640 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac04f500 con 0x7f26ac0e6d80 2023-07-09T02:11:24.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc115c48640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1101fb010 0x7fc1100b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc115c48640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1100b1ac0 0x7fc1100b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc115c48640 1 -- 172.21.15.45:0/2100544894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b2470 con 0x7fc1100b1ac0 2023-07-09T02:11:24.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc115c48640 1 -- 172.21.15.45:0/2100544894 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100cda00 con 0x7fc0f800bd80 2023-07-09T02:11:24.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc115c48640 1 -- 172.21.15.45:0/2100544894 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100cdce0 con 0x7fc1101fb010 2023-07-09T02:11:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc10ffff640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1100b1ac0 0x7fc1100b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc10effd640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1101fb010 0x7fc1100b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fe9ce876640 1 Processor -- start 2023-07-09T02:11:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc10f7fe640 1 -- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1101fb010 msgr2=0x7fc1100b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc10f7fe640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1101fb010 0x7fc1100b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc10f7fe640 1 -- 172.21.15.45:0/2100544894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1100b1ac0 msgr2=0x7fc1100b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc10f7fe640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1100b1ac0 0x7fc1100b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc10f7fe640 1 -- 172.21.15.45:0/2100544894 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100cdfc0 con 0x7fc0f800bd80 2023-07-09T02:11:24.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc10f7fe640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f800bd80 0x7fc1100ced80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1080046a0 tx=0x7fc108008410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fe9ce876640 1 -- start start 2023-07-09T02:11:24.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7f3711c88640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f8007d90 0x7f36f80081a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00c160 tx=0x7f36fc01f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93e56a81a5d3712e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc0f7fff640 1 -- 172.21.15.45:0/2100544894 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108010070 con 0x7fc0f800bd80 2023-07-09T02:11:24.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc115c48640 1 -- 172.21.15.45:0/2100544894 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1100ce2a0 con 0x7fc0f800bd80 2023-07-09T02:11:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc0f7fff640 1 -- 172.21.15.45:0/2100544894 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108011040 con 0x7fc0f800bd80 2023-07-09T02:11:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc0f7fff640 1 -- 172.21.15.45:0/2100544894 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108007c10 con 0x7fc0f800bd80 2023-07-09T02:11:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7fc115c48640 1 -- 172.21.15.45:0/2100544894 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1100ce860 con 0x7fc0f800bd80 2023-07-09T02:11:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc007270 con 0x7f36f8007d90 2023-07-09T02:11:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc0ab070 con 0x7f36f8007d90 2023-07-09T02:11:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7f3710c86640 1 -- 172.21.15.45:0/3665648636 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc007630 con 0x7f36f8007d90 2023-07-09T02:11:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f3712c8a640 1 -- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f8007d90 msgr2=0x7f36f80081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f3712c8a640 1 --2- 172.21.15.45:0/3665648636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f8007d90 0x7f36f80081a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00c160 tx=0x7f36fc01f310 comp rx=0 tx=0).stop 2023-07-09T02:11:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f3712489640 1 -- 172.21.15.45:0/3665648636 reap_dead start 2023-07-09T02:11:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.468+0000 7f26b98f4640 1 --2- 172.21.15.45:0/2947640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e6d80 0x7f26ac0068f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26b40684e0 tx=0x7f26b4096300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320cbe81fd2c4e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26b90f3640 1 -- 172.21.15.45:0/2947640 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4125600 con 0x7f26ac0e6d80 2023-07-09T02:11:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26b90f3640 1 -- 172.21.15.45:0/2947640 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4121050 con 0x7f26ac0e6d80 2023-07-09T02:11:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26b90f3640 1 -- 172.21.15.45:0/2947640 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4125600 con 0x7f26ac0e6d80 2023-07-09T02:11:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9ce876640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c80b2770 0x7fe9c8157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9ce876640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9c80cdd90 0x7fe9c80cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9ce876640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c80ccfd0 con 0x7fe9c80b0030 2023-07-09T02:11:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9ce876640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c80cd2b0 con 0x7fe9c80cdd90 2023-07-09T02:11:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9ce876640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80cd590 con 0x7fe9c80b2770 2023-07-09T02:11:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9ce075640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe9c80b0030 0x7fe9c80b04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:57882/0 (socket says 172.21.15.45:57882) 2023-07-09T02:11:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9ce075640 1 -- 172.21.15.45:0/2848260450 learned_addr learned my addr 172.21.15.45:0/2848260450 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9cd073640 1 --2- 172.21.15.45:0/2848260450 >> v2:172.21.15.45:3300/0 conn(0x7fe9c80cdd90 0x7fe9c80cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fc115c48640 1 -- 172.21.15.45:0/2100544894 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1100caad0 con 0x7fc0f800bd80 2023-07-09T02:11:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f3712c8a640 1 -- 172.21.15.45:0/3665648636 shutdown_connections 2023-07-09T02:11:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f3712c8a640 1 -- 172.21.15.45:0/3665648636 >> 172.21.15.45:0/3665648636 conn(0x7f370c0999f0 msgr2=0x7f370c0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f3712c8a640 1 -- 172.21.15.45:0/3665648636 shutdown_connections 2023-07-09T02:11:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26bc359640 1 -- 172.21.15.45:0/2947640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e6d80 msgr2=0x7f26ac0068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26bc359640 1 --2- 172.21.15.45:0/2947640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e6d80 0x7f26ac0068f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26b40684e0 tx=0x7f26b4096300 comp rx=0 tx=0).stop 2023-07-09T02:11:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117824569 0 0) 0x7fe9c80ccfd0 con 0x7fe9c80b0030 2023-07-09T02:11:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9b4003530 con 0x7fe9c80b0030 2023-07-09T02:11:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fc0f7fff640 1 -- 172.21.15.45:0/2100544894 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc108015a10 con 0x7fc0f800bd80 2023-07-09T02:11:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f3712c8a640 1 -- 172.21.15.45:0/3665648636 wait complete. 2023-07-09T02:11:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26bc359640 1 -- 172.21.15.45:0/2947640 shutdown_connections 2023-07-09T02:11:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26bc359640 1 --2- 172.21.15.45:0/2947640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e6d80 0x7f26ac0068f0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26b40684e0 tx=0x7f26b4096300 comp rx=0 tx=0).stop 2023-07-09T02:11:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26bc359640 1 --2- 172.21.15.45:0/2947640 >> v2:172.21.15.155:3300/0 conn(0x7f26ac0e69b0 0x7f26ac0532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26bc359640 1 -- 172.21.15.45:0/2947640 >> 172.21.15.45:0/2947640 conn(0x7f26ac051590 msgr2=0x7f26ac051990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26bc359640 1 -- 172.21.15.45:0/2947640 shutdown_connections 2023-07-09T02:11:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3105823419 0 0) 0x7fe9b4003530 con 0x7fe9c80b0030 2023-07-09T02:11:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c80b2770 msgr2=0x7fe9c8157e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-09T02:11:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9cc872640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c80b2770 0x7fe9c8157e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 >> v2:172.21.15.45:3300/0 conn(0x7fe9c80cdd90 msgr2=0x7fe9c80cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f26bc359640 1 -- 172.21.15.45:0/2947640 wait complete. 2023-07-09T02:11:24.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.472+0000 7f0dcceca640 1 Processor -- start 2023-07-09T02:11:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dcceca640 1 -- start start 2023-07-09T02:11:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 --2- 172.21.15.45:0/2848260450 >> v2:172.21.15.45:3300/0 conn(0x7fe9c80cdd90 0x7fe9c80cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c80cd870 con 0x7fe9c80b0030 2023-07-09T02:11:24.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fe9c0001a00 con 0x7fe9c80b0030 2023-07-09T02:11:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 >> v1:172.21.15.155:6789/0 conn(0x7fe9c80b0030 legacy=0x7fe9c80b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b4003980 0x7fe9b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9b40047d0 0x7fe9b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c80b2770 0x7fe9b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80cd2b0 con 0x7fe9b4003980 2023-07-09T02:11:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80cd590 con 0x7fe9b40047d0 2023-07-09T02:11:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b400bb50 con 0x7fe9c80b2770 2023-07-09T02:11:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd073640 1 --2- 172.21.15.45:0/2848260450 >> v2:172.21.15.45:3300/0 conn(0x7fe9c80cdd90 0x7fe9c80cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fc0f7fff640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0fc066300 0x7fc0fc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fc0f7fff640 1 -- 172.21.15.45:0/2100544894 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc108084990 con 0x7fc0f800bd80 2023-07-09T02:11:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26bc359640 1 Processor -- start 2023-07-09T02:11:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd073640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9b40047d0 0x7fe9b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9ce075640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c80b2770 0x7fe9b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fc10effd640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0fc066300 0x7fc0fc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd073640 1 -- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c80b2770 msgr2=0x7fe9b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd073640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c80b2770 0x7fe9b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd073640 1 -- 172.21.15.45:0/2848260450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b4003980 msgr2=0x7fe9b4003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T02:11:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f3712c8a640 1 Processor -- start 2023-07-09T02:11:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f3712c8a640 1 -- start start 2023-07-09T02:11:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26bc359640 1 -- start start 2023-07-09T02:11:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26bc359640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ac036590 0x7f26ac0d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26bc359640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ac0e69b0 0x7f26ac0e89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dcceca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc8158130 0x7f0dc806b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dcceca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0dc80cdd40 0x7f0dc80ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dcceca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0dc80caec0 0x7f0dc80cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dcceca640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc80cb880 con 0x7f0dc80cdd40 2023-07-09T02:11:24.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dcceca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc80ca460 con 0x7f0dc80caec0 2023-07-09T02:11:24.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dcceca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80ce2b0 con 0x7f0dc8158130 2023-07-09T02:11:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd874640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b4003980 0x7fe9b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26bc359640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e8f10 0x7f26ac054b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dc6ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0dc80cdd40 0x7f0dc80ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dc6ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0dc80cdd40 0x7f0dc80ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46382/0 (socket says 172.21.15.45:46382) 2023-07-09T02:11:24.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dc6ffd640 1 -- 172.21.15.45:0/1838677919 learned_addr learned my addr 172.21.15.45:0/1838677919 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26ba0f5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ac036590 0x7f26ac0d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26b98f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ac0e69b0 0x7f26ac0e89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26ba0f5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ac036590 0x7f26ac0d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59544/0 (socket says 172.21.15.45:59544) 2023-07-09T02:11:24.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26b98f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ac0e69b0 0x7f26ac0e89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38632/0 (socket says 172.21.15.45:38632) 2023-07-09T02:11:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dc77fe640 1 --2- 172.21.15.45:0/1838677919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc8158130 0x7f0dc806b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26bc359640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0d1080 con 0x7f26ac0e8f10 2023-07-09T02:11:24.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26bc359640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0e94d0 con 0x7f26ac036590 2023-07-09T02:11:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26bc359640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0e97b0 con 0x7f26ac0e69b0 2023-07-09T02:11:24.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7fc10effd640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0fc066300 0x7fc0fc0687b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1000af000 tx=0x7fc100005040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f3712c8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8007d90 0x7f370c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3712c8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0b6290 0x7f370c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3712c8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0ae7f0 0x7f370c14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26ba8f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e8f10 0x7f26ac054b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26ba8f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e8f10 0x7f26ac054b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46390/0 (socket says 172.21.15.45:46390) 2023-07-09T02:11:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f26ba8f6640 1 -- 172.21.15.45:0/2063096830 learned_addr learned my addr 172.21.15.45:0/2063096830 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26ba0f5640 1 -- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ac0e69b0 msgr2=0x7f26ac0e89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26ba0f5640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ac0e69b0 0x7f26ac0e89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26ba0f5640 1 -- 172.21.15.45:0/2063096830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e8f10 msgr2=0x7f26ac054b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26ba0f5640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e8f10 0x7f26ac054b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26ba0f5640 1 -- 172.21.15.45:0/2063096830 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b40738e0 con 0x7f26ac036590 2023-07-09T02:11:24.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dc7fff640 1 --2- 172.21.15.45:0/1838677919 >> v2:172.21.15.155:3300/0 conn(0x7f0dc80caec0 0x7f0dc80cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7f0dc77fe640 1 -- 172.21.15.45:0/1838677919 >> v2:172.21.15.155:3300/0 conn(0x7f0dc80caec0 msgr2=0x7f0dc80cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f0dc77fe640 1 --2- 172.21.15.45:0/1838677919 >> v2:172.21.15.155:3300/0 conn(0x7f0dc80caec0 0x7f0dc80cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f0dc77fe640 1 -- 172.21.15.45:0/1838677919 >> v2:172.21.15.45:3300/0 conn(0x7f0dc80cdd40 msgr2=0x7f0dc80ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f0dc77fe640 1 --2- 172.21.15.45:0/1838677919 >> v2:172.21.15.45:3300/0 conn(0x7f0dc80cdd40 0x7f0dc80ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f0dc77fe640 1 -- 172.21.15.45:0/1838677919 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc806b940 con 0x7f0dc8158130 2023-07-09T02:11:24.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3712c8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c14f6d0 con 0x7f36f8007d90 2023-07-09T02:11:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd073640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b4003980 0x7fe9b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd073640 1 -- 172.21.15.45:0/2848260450 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b4003530 con 0x7fe9b40047d0 2023-07-09T02:11:24.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3712c8a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c1500a0 con 0x7f370c0b6290 2023-07-09T02:11:24.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.476+0000 7fe9cd874640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9b4003980 0x7fe9b4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:24.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3712c8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c14eac0 con 0x7f370c0ae7f0 2023-07-09T02:11:24.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26ba0f5640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ac036590 0x7f26ac0d14a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26a400e870 tx=0x7f26a400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3712489640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0ae7f0 0x7f370c14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3712489640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0ae7f0 0x7f370c14c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38652/0 (socket says 172.21.15.45:38652) 2023-07-09T02:11:24.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3712489640 1 -- 172.21.15.45:0/2988756319 learned_addr learned my addr 172.21.15.45:0/2988756319 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3711c88640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8007d90 0x7f370c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26aaffd640 1 -- 172.21.15.45:0/2063096830 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40095d0 con 0x7f26ac036590 2023-07-09T02:11:24.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26aaffd640 1 -- 172.21.15.45:0/2063096830 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a400c940 con 0x7f26ac036590 2023-07-09T02:11:24.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26aaffd640 1 -- 172.21.15.45:0/2063096830 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a400ccb0 con 0x7f26ac036590 2023-07-09T02:11:24.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7ff0f65e6640 1 Processor -- start 2023-07-09T02:11:24.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26bc359640 1 -- 172.21.15.45:0/2063096830 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac0d0ca0 con 0x7f26ac036590 2023-07-09T02:11:24.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f26bc359640 1 -- 172.21.15.45:0/2063096830 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac0d2290 con 0x7f26ac036590 2023-07-09T02:11:24.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3711c88640 1 -- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0ae7f0 msgr2=0x7f370c14c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3711c88640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0ae7f0 0x7f370c14c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3711c88640 1 -- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0b6290 msgr2=0x7f370c14e150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T02:11:24.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3711c88640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0b6290 0x7f370c14e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3711c88640 1 -- 172.21.15.45:0/2988756319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c14eda0 con 0x7f36f8007d90 2023-07-09T02:11:24.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7fc0f7fff640 1 -- 172.21.15.45:0/2100544894 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc108051ea0 con 0x7fc0f800bd80 2023-07-09T02:11:24.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7f3711c88640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8007d90 0x7f370c14fb60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009000 tx=0x7f36f8009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7fe9cd073640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9b40047d0 0x7fe9b4004c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009ce0 tx=0x7fe9bc01cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54b7f4a11f5c7709 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.480+0000 7ff0f65e6640 1 -- start start 2023-07-09T02:11:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0a5800 con 0x7fe9b40047d0 2023-07-09T02:11:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc0a5960 con 0x7fe9b40047d0 2023-07-09T02:11:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9cc872640 1 -- 172.21.15.45:0/2848260450 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0a5d90 con 0x7fe9b40047d0 2023-07-09T02:11:24.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f65e6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e80e69b0 0x7ff0e80532f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f65e6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0e80e6d80 0x7ff0e80068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f65e6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e8036590 0x7ff0e80369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f37027fc640 1 -- 172.21.15.45:0/2988756319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0b7070 con 0x7f36f8007d90 2023-07-09T02:11:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f65e6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e804f7e0 con 0x7ff0e8036590 2023-07-09T02:11:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f65e6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e8036ef0 con 0x7ff0e80e6d80 2023-07-09T02:11:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f37027fc640 1 -- 172.21.15.45:0/2988756319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc007280 con 0x7f36f8007d90 2023-07-09T02:11:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f37027fc640 1 -- 172.21.15.45:0/2988756319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0075f0 con 0x7f36f8007d90 2023-07-09T02:11:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9ce876640 1 -- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9b40047d0 msgr2=0x7fe9b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9ce876640 1 --2- 172.21.15.45:0/2848260450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9b40047d0 0x7fe9b4004c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009ce0 tx=0x7fe9bc01cc50 comp rx=0 tx=0).stop 2023-07-09T02:11:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f65e6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e8006e30 con 0x7ff0e80e69b0 2023-07-09T02:11:24.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9ce075640 1 -- 172.21.15.45:0/2848260450 reap_dead start 2023-07-09T02:11:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c14f080 con 0x7f36f8007d90 2023-07-09T02:11:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c14e690 con 0x7f36f8007d90 2023-07-09T02:11:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f4005260 con 0x7f36f8007d90 2023-07-09T02:11:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f26bc359640 1 -- 172.21.15.45:0/2063096830 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac052db0 con 0x7f26ac036590 2023-07-09T02:11:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f26aaffd640 1 -- 172.21.15.45:0/2063096830 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26a4013470 con 0x7f26ac036590 2023-07-09T02:11:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9ce876640 1 -- 172.21.15.45:0/2848260450 shutdown_connections 2023-07-09T02:11:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9ce876640 1 -- 172.21.15.45:0/2848260450 >> 172.21.15.45:0/2848260450 conn(0x7fe9c80650b0 msgr2=0x7fe9c80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9ce876640 1 -- 172.21.15.45:0/2848260450 shutdown_connections 2023-07-09T02:11:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7fe9ce876640 1 -- 172.21.15.45:0/2848260450 wait complete. 2023-07-09T02:11:24.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f0dc77fe640 1 --2- 172.21.15.45:0/1838677919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc8158130 0x7f0dc806b400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80c1f10 tx=0x7f0db801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6835bcea9f364e6c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f5de5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e8036590 0x7ff0e80369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f5de5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e8036590 0x7ff0e80369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46414/0 (socket says 172.21.15.45:46414) 2023-07-09T02:11:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f5de5640 1 -- 172.21.15.45:0/1033788644 learned_addr learned my addr 172.21.15.45:0/1033788644 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f55e4640 1 --2- 172.21.15.45:0/1033788644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e80e69b0 0x7ff0e80532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f26aaffd640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2698066350 0x7f2698068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f98bdf12640 1 Processor -- start 2023-07-09T02:11:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f26aaffd640 1 -- 172.21.15.45:0/2063096830 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26a4083e10 con 0x7f26ac036590 2023-07-09T02:11:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f98bdf12640 1 -- start start 2023-07-09T02:11:24.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7f26b98f4640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2698066350 0x7f2698068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f4de3640 1 --2- 172.21.15.45:0/1033788644 >> v2:172.21.15.155:3300/0 conn(0x7ff0e80e6d80 0x7ff0e80068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f5de5640 1 -- 172.21.15.45:0/1033788644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e80e69b0 msgr2=0x7ff0e80532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f5de5640 1 --2- 172.21.15.45:0/1033788644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e80e69b0 0x7ff0e80532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f5de5640 1 -- 172.21.15.45:0/1033788644 >> v2:172.21.15.155:3300/0 conn(0x7ff0e80e6d80 msgr2=0x7ff0e80068f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f5de5640 1 --2- 172.21.15.45:0/1033788644 >> v2:172.21.15.155:3300/0 conn(0x7ff0e80e6d80 0x7ff0e80068f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.484+0000 7ff0f5de5640 1 -- 172.21.15.45:0/1033788644 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e8051060 con 0x7ff0e8036590 2023-07-09T02:11:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dc67fc640 1 -- 172.21.15.45:0/1838677919 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80ad660 con 0x7f0dc8158130 2023-07-09T02:11:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dc67fc640 1 -- 172.21.15.45:0/1838677919 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db80ad7c0 con 0x7f0dc8158130 2023-07-09T02:11:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dc67fc640 1 -- 172.21.15.45:0/1838677919 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80adb50 con 0x7f0dc8158130 2023-07-09T02:11:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f26b98f4640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2698066350 0x7f2698068800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00bd70 tx=0x7f26b4122000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7fe9ce876640 1 Processor -- start 2023-07-09T02:11:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 -- 172.21.15.45:0/1838677919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc8158130 msgr2=0x7f0dc806b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 --2- 172.21.15.45:0/1838677919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc8158130 0x7f0dc806b400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80c1f10 tx=0x7f0db801c3a0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7fe9ce876640 1 -- start start 2023-07-09T02:11:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 -- 172.21.15.45:0/1838677919 shutdown_connections 2023-07-09T02:11:24.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 --2- 172.21.15.45:0/1838677919 >> v2:172.21.15.155:3300/0 conn(0x7f0dc80caec0 0x7f0dc80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 --2- 172.21.15.45:0/1838677919 >> v2:172.21.15.45:3300/0 conn(0x7f0dc80cdd40 0x7f0dc80ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 --2- 172.21.15.45:0/1838677919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc8158130 0x7f0dc806b400 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 -- 172.21.15.45:0/1838677919 >> 172.21.15.45:0/1838677919 conn(0x7f0dc80ce4b0 msgr2=0x7f0dc80ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bdf12640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98b815c020 0x7f98b80b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bdf12640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f98b80ce990 0x7f98b80cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bdf12640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80b43f0 0x7f98b80b4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bdf12640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b80b4db0 con 0x7f98b815c020 2023-07-09T02:11:24.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bdf12640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b815fba0 con 0x7f98b80ce990 2023-07-09T02:11:24.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bdf12640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8071120 con 0x7f98b80b43f0 2023-07-09T02:11:24.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f37027fc640 1 -- 172.21.15.45:0/2988756319 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36fc0ad020 con 0x7f36f8007d90 2023-07-09T02:11:24.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 -- 172.21.15.45:0/1838677919 shutdown_connections 2023-07-09T02:11:24.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f0dcceca640 1 -- 172.21.15.45:0/1838677919 wait complete. 2023-07-09T02:11:24.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bd711640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80b43f0 0x7f98b80b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bcf10640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98b815c020 0x7f98b80b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bd711640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80b43f0 0x7f98b80b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38674/0 (socket says 172.21.15.45:38674) 2023-07-09T02:11:24.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bd711640 1 -- 172.21.15.45:0/4197786058 learned_addr learned my addr 172.21.15.45:0/4197786058 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98affff640 1 --2- 172.21.15.45:0/4197786058 >> v2:172.21.15.155:3300/0 conn(0x7f98b80ce990 0x7f98b80cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f844bfff640 1 Processor -- start 2023-07-09T02:11:24.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bcf10640 1 -- 172.21.15.45:0/4197786058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80b43f0 msgr2=0x7f98b80b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bcf10640 1 --2- 172.21.15.45:0/4197786058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80b43f0 0x7f98b80b4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f844bfff640 1 -- start start 2023-07-09T02:11:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bcf10640 1 -- 172.21.15.45:0/4197786058 >> v2:172.21.15.155:3300/0 conn(0x7f98b80ce990 msgr2=0x7f98b80cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bcf10640 1 --2- 172.21.15.45:0/4197786058 >> v2:172.21.15.155:3300/0 conn(0x7f98b80ce990 0x7f98b80cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98bcf10640 1 -- 172.21.15.45:0/4197786058 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8071400 con 0x7f98b815c020 2023-07-09T02:11:24.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f98affff640 1 --2- 172.21.15.45:0/4197786058 >> v2:172.21.15.155:3300/0 conn(0x7f98b80ce990 0x7f98b80cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:24.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f37027fc640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36f0066380 0x7f36f0068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.488+0000 7f37027fc640 1 -- 172.21.15.45:0/2988756319 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36fc120a20 con 0x7f36f8007d90 2023-07-09T02:11:24.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f3711487640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36f0066380 0x7f36f0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f26aaffd640 1 -- 172.21.15.45:0/2063096830 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26ac052db0 con 0x7f26ac036590 2023-07-09T02:11:24.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce876640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9b40047d0 0x7fe9c8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce876640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c814e210 0x7fe9c815a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce876640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c815a6a0 0x7fe9c814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce876640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c81491b0 con 0x7fe9c814e210 2023-07-09T02:11:24.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce876640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8149450 con 0x7fe9c815a6a0 2023-07-09T02:11:24.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce876640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c8149730 con 0x7fe9b40047d0 2023-07-09T02:11:24.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9cd874640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9b40047d0 0x7fe9c8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f0dcceca640 1 Processor -- start 2023-07-09T02:11:24.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c15bd20 0x7f844c160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9cd073640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c814e210 0x7fe9c815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9cd073640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c814e210 0x7fe9c815a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46434/0 (socket says 172.21.15.45:46434) 2023-07-09T02:11:24.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9cd073640 1 -- 172.21.15.45:0/2040874961 learned_addr learned my addr 172.21.15.45:0/2040874961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce075640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c815a6a0 0x7fe9c814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844bfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f844c0cae90 0x7f844c0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844bfff640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c0cc770 con 0x7f844c15c0f0 2023-07-09T02:11:24.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844bfff640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844c0cb830 con 0x7f844c0cae90 2023-07-09T02:11:24.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844bfff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0ca920 con 0x7f844c15bd20 2023-07-09T02:11:24.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f844c0cae90 0x7f844c0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c15bd20 0x7f844c160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f844c0cae90 0x7f844c0cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59594/0 (socket says 172.21.15.45:59594) 2023-07-09T02:11:24.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844b7fe640 1 -- 172.21.15.45:0/4250438000 learned_addr learned my addr 172.21.15.45:0/4250438000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f0dcceca640 1 -- start start 2023-07-09T02:11:24.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844affd640 1 -- 172.21.15.45:0/4250438000 >> v2:172.21.15.155:3300/0 conn(0x7f844c0cae90 msgr2=0x7f844c0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844affd640 1 --2- 172.21.15.45:0/4250438000 >> v2:172.21.15.155:3300/0 conn(0x7f844c0cae90 0x7f844c0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844affd640 1 -- 172.21.15.45:0/4250438000 >> v1:172.21.15.45:6789/0 conn(0x7f844c15c0f0 legacy=0x7f844c0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:24.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f844affd640 1 -- 172.21.15.45:0/4250438000 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c0cac00 con 0x7f844c15bd20 2023-07-09T02:11:24.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7ff0f5de5640 1 --2- 172.21.15.45:0/1033788644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8036590 0x7ff0e80369b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800bb60 tx=0x7ff0ec01c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a8f6e1a73017cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce075640 1 -- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9b40047d0 msgr2=0x7fe9c8159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce075640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9b40047d0 0x7fe9c8159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce075640 1 -- 172.21.15.45:0/2040874961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c814e210 msgr2=0x7fe9c815a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce075640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c814e210 0x7fe9c815a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce075640 1 -- 172.21.15.45:0/2040874961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8149a10 con 0x7fe9c815a6a0 2023-07-09T02:11:24.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce075640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c815a6a0 0x7fe9c814c780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9c806fd70 tx=0x7fe9c0011940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f0dcceca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc80caec0 0x7f0dc81fc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f3711487640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36f0066380 0x7f36f0068830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f370c1508c0 tx=0x7f3708008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ba7fc640 1 -- 172.21.15.45:0/2040874961 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0011e80 con 0x7fe9c815a6a0 2023-07-09T02:11:24.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ba7fc640 1 -- 172.21.15.45:0/2040874961 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0015470 con 0x7fe9c815a6a0 2023-07-09T02:11:24.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ba7fc640 1 -- 172.21.15.45:0/2040874961 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0015800 con 0x7fe9c815a6a0 2023-07-09T02:11:24.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c8149cf0 con 0x7fe9c815a6a0 2023-07-09T02:11:24.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c814ce90 con 0x7fe9c815a6a0 2023-07-09T02:11:24.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f0dcceca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc80cdd40 0x7f0dc8154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f0dcceca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc80b2570 0x7f0dc80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f0dcceca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc806ed00 con 0x7f0dc80b2570 2023-07-09T02:11:24.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f0dcceca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80c3a40 con 0x7f0dc80cdd40 2023-07-09T02:11:24.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.492+0000 7f0dcceca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc81fcea0 con 0x7f0dc80caec0 2023-07-09T02:11:24.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc80cdd40 0x7f0dc8154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc80caec0 0x7f0dc81fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc80caec0 0x7f0dc81fc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38710/0 (socket says 172.21.15.45:38710) 2023-07-09T02:11:24.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc77fe640 1 -- 172.21.15.45:0/1761825001 learned_addr learned my addr 172.21.15.45:0/1761825001 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc6ffd640 1 -- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc80caec0 msgr2=0x7f0dc81fc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc6ffd640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc80caec0 0x7f0dc81fc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc6ffd640 1 -- 172.21.15.45:0/1761825001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc80b2570 msgr2=0x7f0dc80ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc6ffd640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc80b2570 0x7f0dc80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc6ffd640 1 -- 172.21.15.45:0/1761825001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8009420 con 0x7f0dc80cdd40 2023-07-09T02:11:24.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dc6ffd640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc80cdd40 0x7f0dc8154290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00e600 tx=0x7f0dbc00eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0daffff640 1 -- 172.21.15.45:0/1761825001 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00c620 con 0x7f0dc80cdd40 2023-07-09T02:11:24.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0daffff640 1 -- 172.21.15.45:0/1761825001 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00c780 con 0x7f0dc80cdd40 2023-07-09T02:11:24.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0daffff640 1 -- 172.21.15.45:0/1761825001 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00cb10 con 0x7f0dc80cdd40 2023-07-09T02:11:24.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dcceca640 1 -- 172.21.15.45:0/1761825001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc81fd180 con 0x7f0dc80cdd40 2023-07-09T02:11:24.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7fe9ba7fc640 1 -- 172.21.15.45:0/2040874961 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9c0015960 con 0x7fe9c815a6a0 2023-07-09T02:11:24.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f0dcceca640 1 -- 172.21.15.45:0/1761825001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc80c36d0 con 0x7f0dc80cdd40 2023-07-09T02:11:24.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.496+0000 7f844affd640 1 --2- 172.21.15.45:0/4250438000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c15bd20 0x7f844c160600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84340097c0 tx=0x7f843401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6649910139db1e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f98bcf10640 1 --2- 172.21.15.45:0/4197786058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b815c020 0x7f98b80b57c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98b40097c0 tx=0x7f98b401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84210d611b68d41d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f8449ffb640 1 -- 172.21.15.45:0/4250438000 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340ab600 con 0x7f844c15bd20 2023-07-09T02:11:24.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f8449ffb640 1 -- 172.21.15.45:0/4250438000 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84340a7050 con 0x7f844c15bd20 2023-07-09T02:11:24.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f8449ffb640 1 -- 172.21.15.45:0/4250438000 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340ab980 con 0x7f844c15bd20 2023-07-09T02:11:24.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7fe9ba7fc640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066380 0x7fe9ac068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7fe9ba7fc640 1 -- 172.21.15.45:0/2040874961 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9c0086830 con 0x7fe9c815a6a0 2023-07-09T02:11:24.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0e7fff640 1 -- 172.21.15.45:0/1033788644 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0aa670 con 0x7ff0e8036590 2023-07-09T02:11:24.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7fe9cd874640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066380 0x7fe9ac068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f844bfff640 1 -- 172.21.15.45:0/4250438000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c15bd20 msgr2=0x7f844c160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f844bfff640 1 --2- 172.21.15.45:0/4250438000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c15bd20 0x7f844c160600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84340097c0 tx=0x7f843401c440 comp rx=0 tx=0).stop 2023-07-09T02:11:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f844bfff640 1 -- 172.21.15.45:0/4250438000 shutdown_connections 2023-07-09T02:11:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f844bfff640 1 --2- 172.21.15.45:0/4250438000 >> v2:172.21.15.155:3300/0 conn(0x7f844c0cae90 0x7f844c0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f844bfff640 1 --2- 172.21.15.45:0/4250438000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c15bd20 0x7f844c160600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f844bfff640 1 -- 172.21.15.45:0/4250438000 >> 172.21.15.45:0/4250438000 conn(0x7f844c0ce4b0 msgr2=0x7f844c0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f844bfff640 1 -- 172.21.15.45:0/4250438000 shutdown_connections 2023-07-09T02:11:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f37027fc640 1 -- 172.21.15.45:0/2988756319 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36fc0edea0 con 0x7f36f8007d90 2023-07-09T02:11:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f844bfff640 1 -- 172.21.15.45:0/4250438000 wait complete. 2023-07-09T02:11:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f98af7fe640 1 -- 172.21.15.45:0/4197786058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40ac630 con 0x7f98b815c020 2023-07-09T02:11:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f98af7fe640 1 -- 172.21.15.45:0/4197786058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b40ac790 con 0x7f98b815c020 2023-07-09T02:11:24.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f98af7fe640 1 -- 172.21.15.45:0/4197786058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40acb20 con 0x7f98b815c020 2023-07-09T02:11:24.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7fe9cd874640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066380 0x7fe9ac068830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4006fd0 tx=0x7fe9c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f0daffff640 1 -- 172.21.15.45:0/1761825001 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0dbc00cc70 con 0x7f0dc80cdd40 2023-07-09T02:11:24.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f0dcceca640 1 -- 172.21.15.45:0/1761825001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc80c3bd0 con 0x7f0dc80cdd40 2023-07-09T02:11:24.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0e7fff640 1 -- 172.21.15.45:0/1033788644 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0aa7d0 con 0x7ff0e8036590 2023-07-09T02:11:24.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0e7fff640 1 -- 172.21.15.45:0/1033788644 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0aab60 con 0x7ff0e8036590 2023-07-09T02:11:24.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f0daffff640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0db40662b0 0x7f0db4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f0daffff640 1 -- 172.21.15.45:0/1761825001 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0dbc083970 con 0x7f0dc80cdd40 2023-07-09T02:11:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1033788644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8036590 msgr2=0x7ff0e80369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1033788644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8036590 0x7ff0e80369b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800bb60 tx=0x7ff0ec01c630 comp rx=0 tx=0).stop 2023-07-09T02:11:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1033788644 shutdown_connections 2023-07-09T02:11:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1033788644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8036590 0x7ff0e80369b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1033788644 >> v2:172.21.15.155:3300/0 conn(0x7ff0e80e6d80 0x7ff0e80068f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1033788644 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e80e69b0 0x7ff0e80532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1033788644 >> 172.21.15.45:0/1033788644 conn(0x7ff0e8051590 msgr2=0x7ff0e8051990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7f0dc77fe640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0db40662b0 0x7f0db4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844bfff640 1 Processor -- start 2023-07-09T02:11:24.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.500+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1033788644 shutdown_connections 2023-07-09T02:11:24.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1033788644 wait complete. 2023-07-09T02:11:24.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844bfff640 1 -- start start 2023-07-09T02:11:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 -- 172.21.15.45:0/4197786058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b815c020 msgr2=0x7f98b80b57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 --2- 172.21.15.45:0/4197786058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b815c020 0x7f98b80b57c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98b40097c0 tx=0x7f98b401c410 comp rx=0 tx=0).stop 2023-07-09T02:11:24.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f0dc77fe640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0db40662b0 0x7f0db4068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0db801c3e0 tx=0x7f0db80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 -- 172.21.15.45:0/4197786058 shutdown_connections 2023-07-09T02:11:24.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 --2- 172.21.15.45:0/4197786058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80b43f0 0x7f98b80b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 --2- 172.21.15.45:0/4197786058 >> v2:172.21.15.155:3300/0 conn(0x7f98b80ce990 0x7f98b80cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 --2- 172.21.15.45:0/4197786058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b815c020 0x7f98b80b57c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 -- 172.21.15.45:0/4197786058 >> 172.21.15.45:0/4197786058 conn(0x7f98b806a140 msgr2=0x7f98b80cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 -- 172.21.15.45:0/4197786058 shutdown_connections 2023-07-09T02:11:24.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 -- 172.21.15.45:0/4197786058 wait complete. 2023-07-09T02:11:24.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c804e020 con 0x7fe9c815a6a0 2023-07-09T02:11:24.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c0cae90 0x7f844c151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c15bd20 0x7f844c15fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f844c15c0f0 0x7f844c0c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844bfff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0c7160 con 0x7f844c15c0f0 2023-07-09T02:11:24.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844bfff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c154160 con 0x7f844c15bd20 2023-07-09T02:11:24.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c0cae90 0x7f844c151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c0cae90 0x7f844c151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38712/0 (socket says 172.21.15.45:38712) 2023-07-09T02:11:24.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844affd640 1 -- 172.21.15.45:0/3087203922 learned_addr learned my addr 172.21.15.45:0/3087203922 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7ff0f65e6640 1 Processor -- start 2023-07-09T02:11:24.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0c73b0 con 0x7f844c0cae90 2023-07-09T02:11:24.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f98bdf12640 1 Processor -- start 2023-07-09T02:11:24.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844a7fc640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c15bd20 0x7f844c15fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844b7fe640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f844c15c0f0 0x7f844c0c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844a7fc640 1 -- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c0cae90 msgr2=0x7f844c151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844a7fc640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c0cae90 0x7f844c151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844a7fc640 1 -- 172.21.15.45:0/3087203922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f844c15c0f0 msgr2=0x7f844c0c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844a7fc640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f844c15c0f0 0x7f844c0c1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844a7fc640 1 -- 172.21.15.45:0/3087203922 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434009420 con 0x7f844c15bd20 2023-07-09T02:11:24.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7f844affd640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c0cae90 0x7f844c151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:24.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bdf12640 1 -- start start 2023-07-09T02:11:24.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f844a7fc640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c15bd20 0x7f844c15fa70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f843c00b410 tx=0x7f843c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.504+0000 7ff0f65e6640 1 -- start start 2023-07-09T02:11:24.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f65e6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e8036590 0x7ff0e80da9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f0daffff640 1 -- 172.21.15.45:0/1761825001 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0dbc050e00 con 0x7f0dc80cdd40 2023-07-09T02:11:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f65e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e80e69b0 0x7ff0e804a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f65e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e80e6d80 0x7ff0e804adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f65e6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e804b5e0 con 0x7ff0e80e69b0 2023-07-09T02:11:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f65e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80d78f0 con 0x7ff0e80e6d80 2023-07-09T02:11:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f65e6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80d7bd0 con 0x7ff0e8036590 2023-07-09T02:11:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e8036590 0x7ff0e80da9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e8036590 0x7ff0e80da9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38716/0 (socket says 172.21.15.45:38716) 2023-07-09T02:11:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 -- 172.21.15.45:0/1860618525 learned_addr learned my addr 172.21.15.45:0/1860618525 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f4de3640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e80e69b0 0x7ff0e804a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f5de5640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e80e6d80 0x7ff0e804adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 -- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e80e6d80 msgr2=0x7ff0e804adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e80e6d80 0x7ff0e804adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 -- 172.21.15.45:0/1860618525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e80e69b0 msgr2=0x7ff0e804a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e80e69b0 0x7ff0e804a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 -- 172.21.15.45:0/1860618525 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0094d0 con 0x7ff0e8036590 2023-07-09T02:11:24.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f4de3640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e80e69b0 0x7ff0e804a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:24.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f55e4640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e8036590 0x7ff0e80da9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00631c0 tx=0x7ff0f0073ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bdf12640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80b43f0 0x7f98b80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bdf12640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80ce990 0x7f98b80b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0e5ffb640 1 -- 172.21.15.45:0/1860618525 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f006ac20 con 0x7ff0e8036590 2023-07-09T02:11:24.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0e5ffb640 1 -- 172.21.15.45:0/1860618525 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f006ad80 con 0x7ff0e8036590 2023-07-09T02:11:24.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0e5ffb640 1 -- 172.21.15.45:0/1860618525 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0093440 con 0x7ff0e8036590 2023-07-09T02:11:24.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e80d7eb0 con 0x7ff0e8036590 2023-07-09T02:11:24.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bdf12640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c020 0x7f98b8156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bdf12640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80b7800 con 0x7f98b80ce990 2023-07-09T02:11:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bdf12640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80b6d30 con 0x7f98b80b43f0 2023-07-09T02:11:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bdf12640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b81f90b0 con 0x7f98b815c020 2023-07-09T02:11:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80b43f0 0x7f98b80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80b43f0 0x7f98b80cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59634/0 (socket says 172.21.15.45:59634) 2023-07-09T02:11:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 -- 172.21.15.45:0/1227654530 learned_addr learned my addr 172.21.15.45:0/1227654530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98affff640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80ce990 0x7f98b80b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bd711640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c020 0x7f98b8156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 -- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c020 msgr2=0x7f98b8156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c020 0x7f98b8156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 -- 172.21.15.45:0/1227654530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80ce990 msgr2=0x7f98b80b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80ce990 0x7f98b80b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 -- 172.21.15.45:0/1227654530 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8009420 con 0x7f98b80b43f0 2023-07-09T02:11:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bd711640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c020 0x7f98b8156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7f98bcf10640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80b43f0 0x7f98b80cbe00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98b401aac0 tx=0x7f98b40191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.508+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e804b2f0 con 0x7ff0e8036590 2023-07-09T02:11:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7fe9ba7fc640 1 -- 172.21.15.45:0/2040874961 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9c0053d20 con 0x7fe9c815a6a0 2023-07-09T02:11:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f98ad7fa640 1 -- 172.21.15.45:0/1227654530 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40b5610 con 0x7f98b80b43f0 2023-07-09T02:11:24.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f98ad7fa640 1 -- 172.21.15.45:0/1227654530 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b40b5790 con 0x7f98b80b43f0 2023-07-09T02:11:24.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f98ad7fa640 1 -- 172.21.15.45:0/1227654530 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40b5b40 con 0x7f98b80b43f0 2023-07-09T02:11:24.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e8005350 con 0x7ff0e8036590 2023-07-09T02:11:24.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7ff0e5ffb640 1 -- 172.21.15.45:0/1860618525 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0f00935a0 con 0x7ff0e8036590 2023-07-09T02:11:24.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f84437fe640 1 -- 172.21.15.45:0/3087203922 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c011830 con 0x7f844c15bd20 2023-07-09T02:11:24.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f84437fe640 1 -- 172.21.15.45:0/3087203922 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c011990 con 0x7f844c15bd20 2023-07-09T02:11:24.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f84437fe640 1 -- 172.21.15.45:0/3087203922 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c011d40 con 0x7f844c15bd20 2023-07-09T02:11:24.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c0c7690 con 0x7f844c15bd20 2023-07-09T02:11:24.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c15ffb0 con 0x7f844c15bd20 2023-07-09T02:11:24.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b4009420 con 0x7f98b80b43f0 2023-07-09T02:11:24.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7ff0e5ffb640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0d4066280 0x7ff0d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7ff0e5ffb640 1 -- 172.21.15.45:0/1860618525 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0f00fd9f0 con 0x7ff0e8036590 2023-07-09T02:11:24.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b81f8dc0 con 0x7f98b80b43f0 2023-07-09T02:11:24.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7ff0f4de3640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0d4066280 0x7ff0d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.512+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c04e020 con 0x7f844c15bd20 2023-07-09T02:11:24.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b808b620 con 0x7f98b80b43f0 2023-07-09T02:11:24.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7ff0f4de3640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0d4066280 0x7ff0d4068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80e1900 tx=0x7ff0e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f98ad7fa640 1 -- 172.21.15.45:0/1227654530 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98b40b3040 con 0x7f98b80b43f0 2023-07-09T02:11:24.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f84437fe640 1 -- 172.21.15.45:0/3087203922 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f843c01a400 con 0x7f844c15bd20 2023-07-09T02:11:24.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f84437fe640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f842c066350 0x7f842c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f84437fe640 1 -- 172.21.15.45:0/3087203922 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f843c083cc0 con 0x7f844c15bd20 2023-07-09T02:11:24.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f844affd640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f842c066350 0x7f842c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f98ad7fa640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066300 0x7f98a40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:24.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f98ad7fa640 1 -- 172.21.15.45:0/1227654530 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98b411dc80 con 0x7f98b80b43f0 2023-07-09T02:11:24.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7ff0e5ffb640 1 -- 172.21.15.45:0/1860618525 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0f00caf00 con 0x7ff0e8036590 2023-07-09T02:11:24.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.516+0000 7f98affff640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066300 0x7f98a40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:24.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.520+0000 7f98affff640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066300 0x7f98a40687b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f98b80b8850 tx=0x7f98a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.520+0000 7f844affd640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f842c066350 0x7f842c068800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f84340097c0 tx=0x7f84340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:24.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.520+0000 7f84437fe640 1 -- 172.21.15.45:0/3087203922 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f843c0511b0 con 0x7f844c15bd20 2023-07-09T02:11:24.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.524+0000 7f98ad7fa640 1 -- 172.21.15.45:0/1227654530 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98b40eb0e0 con 0x7f98b80b43f0 2023-07-09T02:11:24.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.808+0000 7fc115c48640 1 -- 172.21.15.45:0/2100544894 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc1100cea80 con 0x7fc0f800bd80 2023-07-09T02:11:24.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.808+0000 7fc0f7fff640 1 -- 172.21.15.45:0/2100544894 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1080554c0 con 0x7fc0f800bd80 2023-07-09T02:11:24.814 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-07-09T02:11:24.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 -- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0fc066300 msgr2=0x7fc0fc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0fc066300 0x7fc0fc0687b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1000af000 tx=0x7fc100005040 comp rx=0 tx=0).stop 2023-07-09T02:11:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 -- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f800bd80 msgr2=0x7fc1100ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f800bd80 0x7fc1100ced80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1080046a0 tx=0x7fc108008410 comp rx=0 tx=0).stop 2023-07-09T02:11:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 -- 172.21.15.45:0/2100544894 shutdown_connections 2023-07-09T02:11:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1100b1ac0 0x7fc1100b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0fc066300 0x7fc0fc0687b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1101fb010 0x7fc1100b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 --2- 172.21.15.45:0/2100544894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0f800bd80 0x7fc1100ced80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.812+0000 7fc0f5ffb640 1 -- 172.21.15.45:0/2100544894 >> 172.21.15.45:0/2100544894 conn(0x7fc11006ae90 msgr2=0x7fc1100c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.816+0000 7fc0f5ffb640 1 -- 172.21.15.45:0/2100544894 shutdown_connections 2023-07-09T02:11:24.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.816+0000 7fc0f5ffb640 1 -- 172.21.15.45:0/2100544894 wait complete. 2023-07-09T02:11:24.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.816+0000 7f26bc359640 1 -- 172.21.15.45:0/2063096830 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26ac052db0 con 0x7f26ac036590 2023-07-09T02:11:24.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.816+0000 7f26aaffd640 1 -- 172.21.15.45:0/2063096830 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26ac052db0 con 0x7f26ac036590 2023-07-09T02:11:24.823 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-07-09T02:11:24.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.824+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36f4005510 con 0x7f36f8007d90 2023-07-09T02:11:24.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.824+0000 7f26a8ef9640 1 -- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2698066350 msgr2=0x7f2698068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.824+0000 7f26a8ef9640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2698066350 0x7f2698068800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00bd70 tx=0x7f26b4122000 comp rx=0 tx=0).stop 2023-07-09T02:11:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.824+0000 7f37027fc640 1 -- 172.21.15.45:0/2988756319 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36fc0c1070 con 0x7f36f8007d90 2023-07-09T02:11:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.824+0000 7f26a8ef9640 1 -- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ac036590 msgr2=0x7f26ac0d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.824+0000 7f26a8ef9640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ac036590 0x7f26ac0d14a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26a400e870 tx=0x7f26a400ed30 comp rx=0 tx=0).stop 2023-07-09T02:11:24.830 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-07-09T02:11:24.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f26a8ef9640 1 -- 172.21.15.45:0/2063096830 shutdown_connections 2023-07-09T02:11:24.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f26a8ef9640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ac0e8f10 0x7f26ac054b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f26a8ef9640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2698066350 0x7f2698068800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f26a8ef9640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ac0e69b0 0x7f26ac0e89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f26a8ef9640 1 --2- 172.21.15.45:0/2063096830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ac036590 0x7f26ac0d14a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f26a8ef9640 1 -- 172.21.15.45:0/2063096830 >> 172.21.15.45:0/2063096830 conn(0x7f26ac051590 msgr2=0x7f26ac0532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36f0066380 msgr2=0x7f36f0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36f0066380 0x7f36f0068830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f370c1508c0 tx=0x7f3708008040 comp rx=0 tx=0).stop 2023-07-09T02:11:24.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8007d90 msgr2=0x7f370c14fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8007d90 0x7f370c14fb60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009000 tx=0x7f36f8009c10 comp rx=0 tx=0).stop 2023-07-09T02:11:24.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f26a8ef9640 1 -- 172.21.15.45:0/2063096830 shutdown_connections 2023-07-09T02:11:24.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f26a8ef9640 1 -- 172.21.15.45:0/2063096830 wait complete. 2023-07-09T02:11:24.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 shutdown_connections 2023-07-09T02:11:24.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36f0066380 0x7f36f0068830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f370c0ae7f0 0x7f370c14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f370c0b6290 0x7f370c14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 --2- 172.21.15.45:0/2988756319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36f8007d90 0x7f370c14fb60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 >> 172.21.15.45:0/2988756319 conn(0x7f370c0999f0 msgr2=0x7f370c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 shutdown_connections 2023-07-09T02:11:24.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.828+0000 7f3712c8a640 1 -- 172.21.15.45:0/2988756319 wait complete. 2023-07-09T02:11:24.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.836+0000 7f0dcceca640 1 -- 172.21.15.45:0/1761825001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0dc804e020 con 0x7f0dc80cdd40 2023-07-09T02:11:24.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.836+0000 7f0daffff640 1 -- 172.21.15.45:0/1761825001 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0dbc054420 con 0x7f0dc80cdd40 2023-07-09T02:11:24.838 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-07-09T02:11:24.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 -- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0db40662b0 msgr2=0x7f0db4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0db40662b0 0x7f0db4068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0db801c3e0 tx=0x7f0db80a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:24.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 -- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc80cdd40 msgr2=0x7f0dc8154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc80cdd40 0x7f0dc8154290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00e600 tx=0x7f0dbc00eac0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 -- 172.21.15.45:0/1761825001 shutdown_connections 2023-07-09T02:11:24.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dc80b2570 0x7f0dc80ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dc80cdd40 0x7f0dc8154290 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0db40662b0 0x7f0db4068760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 --2- 172.21.15.45:0/1761825001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dc80caec0 0x7f0dc81fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 -- 172.21.15.45:0/1761825001 >> 172.21.15.45:0/1761825001 conn(0x7f0dc80ce4b0 msgr2=0x7f0dc8165a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 -- 172.21.15.45:0/1761825001 shutdown_connections 2023-07-09T02:11:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.840+0000 7f0dadffb640 1 -- 172.21.15.45:0/1761825001 wait complete. 2023-07-09T02:11:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.844+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9c8149870 con 0x7fe9c815a6a0 2023-07-09T02:11:24.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.844+0000 7fe9ba7fc640 1 -- 172.21.15.45:0/2040874961 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9c8149870 con 0x7fe9c815a6a0 2023-07-09T02:11:24.850 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-07-09T02:11:24.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff0e8054520 con 0x7ff0e8036590 2023-07-09T02:11:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066380 msgr2=0x7fe9ac068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7ff0e5ffb640 1 -- 172.21.15.45:0/1860618525 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0f00ce520 con 0x7ff0e8036590 2023-07-09T02:11:24.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066380 0x7fe9ac068830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4006fd0 tx=0x7fe9c4008040 comp rx=0 tx=0).stop 2023-07-09T02:11:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c815a6a0 msgr2=0x7fe9c814c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c815a6a0 0x7fe9c814c780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9c806fd70 tx=0x7fe9c0011940 comp rx=0 tx=0).stop 2023-07-09T02:11:24.854 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-07-09T02:11:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f844c0c7b40 con 0x7f844c15bd20 2023-07-09T02:11:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7f84437fe640 1 -- 172.21.15.45:0/3087203922 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f843c015020 con 0x7f844c15bd20 2023-07-09T02:11:24.856 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-07-09T02:11:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 shutdown_connections 2023-07-09T02:11:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c815a6a0 0x7fe9c814c780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c814e210 0x7fe9c815a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066380 0x7fe9ac068830 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 --2- 172.21.15.45:0/2040874961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9b40047d0 0x7fe9c8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 >> 172.21.15.45:0/2040874961 conn(0x7fe9c80650b0 msgr2=0x7fe9c806ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-07-09T02:11:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 shutdown_connections 2023-07-09T02:11:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.848+0000 7fe9ce876640 1 -- 172.21.15.45:0/2040874961 wait complete. 2023-07-09T02:11:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f842c066350 msgr2=0x7f842c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f842c066350 0x7f842c068800 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f84340097c0 tx=0x7f84340a6000 comp rx=0 tx=0).stop 2023-07-09T02:11:24.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c15bd20 msgr2=0x7f844c15fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0d4066280 msgr2=0x7ff0d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0d4066280 0x7ff0d4068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80e1900 tx=0x7ff0e0008040 comp rx=0 tx=0).stop 2023-07-09T02:11:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c15bd20 0x7f844c15fa70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f843c00b410 tx=0x7f843c00b8d0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e8036590 msgr2=0x7ff0e80da9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e8036590 0x7ff0e80da9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00631c0 tx=0x7ff0f0073ed0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 shutdown_connections 2023-07-09T02:11:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f844c15c0f0 0x7f844c0c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c15bd20 0x7f844c15fa70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f842c066350 0x7f842c068800 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 --2- 172.21.15.45:0/3087203922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f844c0cae90 0x7f844c151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 >> 172.21.15.45:0/3087203922 conn(0x7f844c0ce4b0 msgr2=0x7f844c15c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 shutdown_connections 2023-07-09T02:11:24.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0e80e6d80 0x7ff0e804adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e80e69b0 0x7ff0e804a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0d4066280 0x7ff0d4068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 --2- 172.21.15.45:0/1860618525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0e8036590 0x7ff0e80da9c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 >> 172.21.15.45:0/1860618525 conn(0x7ff0e8051590 msgr2=0x7ff0e804fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 shutdown_connections 2023-07-09T02:11:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7f844bfff640 1 -- 172.21.15.45:0/3087203922 wait complete. 2023-07-09T02:11:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 shutdown_connections 2023-07-09T02:11:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.852+0000 7ff0f65e6640 1 -- 172.21.15.45:0/1860618525 wait complete. 2023-07-09T02:11:24.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.856+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f98b80661c0 con 0x7f98b80b43f0 2023-07-09T02:11:24.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.856+0000 7f98ad7fa640 1 -- 172.21.15.45:0/1227654530 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98b40a8090 con 0x7f98b80b43f0 2023-07-09T02:11:24.866 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-07-09T02:11:24.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066300 msgr2=0x7f98a40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066300 0x7f98a40687b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f98b80b8850 tx=0x7f98a8008040 comp rx=0 tx=0).stop 2023-07-09T02:11:24.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80b43f0 msgr2=0x7f98b80cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80b43f0 0x7f98b80cbe00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f98b401aac0 tx=0x7f98b40191b0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 shutdown_connections 2023-07-09T02:11:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066300 0x7f98a40687b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c020 0x7f98b8156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80ce990 0x7f98b80b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 --2- 172.21.15.45:0/1227654530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80b43f0 0x7f98b80cbe00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 >> 172.21.15.45:0/1227654530 conn(0x7f98b806a140 msgr2=0x7f98b80c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:24.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 shutdown_connections 2023-07-09T02:11:24.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:24.860+0000 7f98bdf12640 1 -- 172.21.15.45:0/1227654530 wait complete. 2023-07-09T02:11:24.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-07-09T02:11:24.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-07-09T02:11:24.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-07-09T02:11:24.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-07-09T02:11:24.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-07-09T02:11:24.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-07-09T02:11:24.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-07-09T02:11:25.859 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-09T02:11:25.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-09T02:11:25.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-09T02:11:25.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-09T02:11:25.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-09T02:11:25.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-09T02:11:25.895 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-09T02:11:25.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-09T02:11:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.080+0000 7fd0e04cb640 1 Processor -- start 2023-07-09T02:11:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.080+0000 7fd0e04cb640 1 -- start start 2023-07-09T02:11:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0e04cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80cb220 0x7fd0d8162d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0e04cb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d80cd420 con 0x7fd0d80c9270 2023-07-09T02:11:26.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0e04cb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d8159520 con 0x7fd0d8159150 2023-07-09T02:11:26.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0e04cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8158520 con 0x7fd0d80cb220 2023-07-09T02:11:26.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0dea68640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80cb220 0x7fd0d8162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0dea68640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80cb220 0x7fd0d8162d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38720/0 (socket says 172.21.15.45:38720) 2023-07-09T02:11:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0dea68640 1 -- 172.21.15.45:0/2734111663 learned_addr learned my addr 172.21.15.45:0/2734111663 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0dea68640 1 -- 172.21.15.45:0/2734111663 >> v1:172.21.15.155:6789/0 conn(0x7fd0d8159150 legacy=0x7fd0d80c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0dea68640 1 -- 172.21.15.45:0/2734111663 >> v1:172.21.15.45:6789/0 conn(0x7fd0d80c9270 legacy=0x7fd0d80cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:26.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.084+0000 7fd0dea68640 1 -- 172.21.15.45:0/2734111663 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d815bc50 con 0x7fd0d80cb220 2023-07-09T02:11:26.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0dea68640 1 --2- 172.21.15.45:0/2734111663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80cb220 0x7fd0d8162d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000c310 tx=0x7fd0d001ddc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57dc4e6ca1d1d33b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0dd265640 1 -- 172.21.15.45:0/2734111663 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00a6e80 con 0x7fd0d80cb220 2023-07-09T02:11:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0dd265640 1 -- 172.21.15.45:0/2734111663 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d000a0d0 con 0x7fd0d80cb220 2023-07-09T02:11:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0dd265640 1 -- 172.21.15.45:0/2734111663 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d000a480 con 0x7fd0d80cb220 2023-07-09T02:11:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0e04cb640 1 -- 172.21.15.45:0/2734111663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80cb220 msgr2=0x7fd0d8162d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0e04cb640 1 --2- 172.21.15.45:0/2734111663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80cb220 0x7fd0d8162d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000c310 tx=0x7fd0d001ddc0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0e04cb640 1 -- 172.21.15.45:0/2734111663 shutdown_connections 2023-07-09T02:11:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0e04cb640 1 --2- 172.21.15.45:0/2734111663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80cb220 0x7fd0d8162d30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0e04cb640 1 -- 172.21.15.45:0/2734111663 >> 172.21.15.45:0/2734111663 conn(0x7fd0d806ae90 msgr2=0x7fd0d806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0e04cb640 1 -- 172.21.15.45:0/2734111663 shutdown_connections 2023-07-09T02:11:26.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.092+0000 7fd0e04cb640 1 -- 172.21.15.45:0/2734111663 wait complete. 2023-07-09T02:11:26.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.096+0000 7fd0e04cb640 1 Processor -- start 2023-07-09T02:11:26.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.096+0000 7fd0e04cb640 1 -- start start 2023-07-09T02:11:26.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0e04cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80c9270 0x7fd0d8152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0e04cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0d80cb220 0x7fd0d80c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0e04cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0d8159150 0x7fd0d80c2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0de267640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80c9270 0x7fd0d8152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0de267640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80c9270 0x7fd0d8152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38732/0 (socket says 172.21.15.45:38732) 2023-07-09T02:11:26.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0de267640 1 -- 172.21.15.45:0/4232796023 learned_addr learned my addr 172.21.15.45:0/4232796023 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0dda66640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0d80cb220 0x7fd0d80c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0e04cb640 1 -- 172.21.15.45:0/4232796023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80c2aa0 con 0x7fd0d80cb220 2023-07-09T02:11:26.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0e04cb640 1 -- 172.21.15.45:0/4232796023 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8153cd0 con 0x7fd0d8159150 2023-07-09T02:11:26.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0dea68640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0d8159150 0x7fd0d80c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0e04cb640 1 -- 172.21.15.45:0/4232796023 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d814f520 con 0x7fd0d80c9270 2023-07-09T02:11:26.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0dda66640 1 -- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80c9270 msgr2=0x7fd0d8152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0dda66640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80c9270 0x7fd0d8152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0dda66640 1 -- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0d8159150 msgr2=0x7fd0d80c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0dda66640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0d8159150 0x7fd0d80c2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.100+0000 7fd0dda66640 1 -- 172.21.15.45:0/4232796023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d000c050 con 0x7fd0d80cb220 2023-07-09T02:11:26.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.104+0000 7fd0dda66640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0d80cb220 0x7fd0d80c2020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800b410 tx=0x7fd0c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.104+0000 7fd0ceffd640 1 -- 172.21.15.45:0/4232796023 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8004020 con 0x7fd0d80cb220 2023-07-09T02:11:26.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.104+0000 7fd0e04cb640 1 -- 172.21.15.45:0/4232796023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d8153430 con 0x7fd0d80cb220 2023-07-09T02:11:26.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.104+0000 7fd0e04cb640 1 -- 172.21.15.45:0/4232796023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d81539f0 con 0x7fd0d80cb220 2023-07-09T02:11:26.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.108+0000 7fd0ceffd640 1 -- 172.21.15.45:0/4232796023 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c8004180 con 0x7fd0d80cb220 2023-07-09T02:11:26.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.108+0000 7fd0ceffd640 1 -- 172.21.15.45:0/4232796023 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8011630 con 0x7fd0d80cb220 2023-07-09T02:11:26.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.108+0000 7fd0ceffd640 1 -- 172.21.15.45:0/4232796023 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0c8011850 con 0x7fd0d80cb220 2023-07-09T02:11:26.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.108+0000 7fd0ceffd640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd0bc0663d0 0x7fd0bc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.112+0000 7fd0ceffd640 1 -- 172.21.15.45:0/4232796023 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0c8083940 con 0x7fd0d80cb220 2023-07-09T02:11:26.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.112+0000 7fd0de267640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd0bc0663d0 0x7fd0bc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.112+0000 7fd0e04cb640 1 -- 172.21.15.45:0/4232796023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0005260 con 0x7fd0d80cb220 2023-07-09T02:11:26.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.120+0000 7fd0ceffd640 1 -- 172.21.15.45:0/4232796023 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0c8050ee0 con 0x7fd0d80cb220 2023-07-09T02:11:26.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.124+0000 7fd0de267640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd0bc0663d0 0x7fd0bc068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80ced90 tx=0x7fd0d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.152+0000 7fd373582640 1 Processor -- start 2023-07-09T02:11:26.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.152+0000 7fd373582640 1 -- start start 2023-07-09T02:11:26.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd373582640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd364055100 0x7fd364053df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd373582640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd364053960 con 0x7fd3640383a0 2023-07-09T02:11:26.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd373582640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd364053030 con 0x7fd3640e0820 2023-07-09T02:11:26.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd373582640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd364053310 con 0x7fd364055100 2023-07-09T02:11:26.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd370b1d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd3640383a0 0x7fd364039c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48888/0 (socket says 172.21.15.45:48888) 2023-07-09T02:11:26.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd370b1d640 1 -- 172.21.15.45:0/3034302513 learned_addr learned my addr 172.21.15.45:0/3034302513 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:26.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd371b1f640 1 --2- 172.21.15.45:0/3034302513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd364055100 0x7fd364053df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd363fff640 1 -- 172.21.15.45:0/3034302513 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830589123 0 0) 0x7fd364053960 con 0x7fd3640383a0 2023-07-09T02:11:26.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd363fff640 1 -- 172.21.15.45:0/3034302513 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd358007940 con 0x7fd3640383a0 2023-07-09T02:11:26.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd371b1f640 1 -- 172.21.15.45:0/3034302513 >> v1:172.21.15.155:6789/0 conn(0x7fd3640e0820 legacy=0x7fd3640549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd371b1f640 1 -- 172.21.15.45:0/3034302513 >> v1:172.21.15.45:6789/0 conn(0x7fd3640383a0 legacy=0x7fd364039c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.156+0000 7fd371b1f640 1 -- 172.21.15.45:0/3034302513 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3640535f0 con 0x7fd364055100 2023-07-09T02:11:26.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.160+0000 7f8737bd2640 1 Processor -- start 2023-07-09T02:11:26.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.160+0000 7f8737bd2640 1 -- start start 2023-07-09T02:11:26.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd371b1f640 1 --2- 172.21.15.45:0/3034302513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd364055100 0x7fd364053df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3680097f0 tx=0x7fd36801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b564fde71d23f19 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd363fff640 1 -- 172.21.15.45:0/3034302513 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3680ab400 con 0x7fd364055100 2023-07-09T02:11:26.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd363fff640 1 -- 172.21.15.45:0/3034302513 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680a7050 con 0x7fd364055100 2023-07-09T02:11:26.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd363fff640 1 -- 172.21.15.45:0/3034302513 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3680ab780 con 0x7fd364055100 2023-07-09T02:11:26.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd373582640 1 -- 172.21.15.45:0/3034302513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd364055100 msgr2=0x7fd364053df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd373582640 1 --2- 172.21.15.45:0/3034302513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd364055100 0x7fd364053df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3680097f0 tx=0x7fd36801c4c0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f8737bd2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f873006b120 0x7f873006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f8737bd2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87300cd300 con 0x7f87300b5810 2023-07-09T02:11:26.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873616f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f87300b5810 0x7f87300b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48900/0 (socket says 172.21.15.45:48900) 2023-07-09T02:11:26.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873616f640 1 -- 172.21.15.45:0/492012847 learned_addr learned my addr 172.21.15.45:0/492012847 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:26.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f8737bd2640 1 -- 172.21.15.45:0/492012847 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873006ba30 con 0x7f87300d23e0 2023-07-09T02:11:26.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f8737bd2640 1 -- 172.21.15.45:0/492012847 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8730071850 con 0x7f873006b120 2023-07-09T02:11:26.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873596e640 1 --2- 172.21.15.45:0/492012847 >> v2:172.21.15.155:3300/0 conn(0x7f873006b120 0x7f873006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd373582640 1 -- 172.21.15.45:0/3034302513 shutdown_connections 2023-07-09T02:11:26.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd373582640 1 --2- 172.21.15.45:0/3034302513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd364055100 0x7fd364053df0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd373582640 1 -- 172.21.15.45:0/3034302513 >> 172.21.15.45:0/3034302513 conn(0x7fd36400a780 msgr2=0x7fd364056e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873496c640 1 -- 172.21.15.45:0/492012847 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070709535 0 0) 0x7f87300cd300 con 0x7f87300b5810 2023-07-09T02:11:26.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873496c640 1 -- 172.21.15.45:0/492012847 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f871c003530 con 0x7f87300b5810 2023-07-09T02:11:26.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873496c640 1 -- 172.21.15.45:0/492012847 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934225637 0 0) 0x7f873006ba30 con 0x7f87300d23e0 2023-07-09T02:11:26.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873596e640 1 -- 172.21.15.45:0/492012847 >> v1:172.21.15.155:6789/0 conn(0x7f87300d23e0 legacy=0x7f87300cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873596e640 1 -- 172.21.15.45:0/492012847 >> v1:172.21.15.45:6789/0 conn(0x7f87300b5810 legacy=0x7f87300b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7f873596e640 1 -- 172.21.15.45:0/492012847 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300d0e80 con 0x7f873006b120 2023-07-09T02:11:26.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd373582640 1 -- 172.21.15.45:0/3034302513 shutdown_connections 2023-07-09T02:11:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.164+0000 7fd373582640 1 -- 172.21.15.45:0/3034302513 wait complete. 2023-07-09T02:11:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.168+0000 7fbf1b20b640 1 Processor -- start 2023-07-09T02:11:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.168+0000 7fd373582640 1 Processor -- start 2023-07-09T02:11:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.168+0000 7fbf1b20b640 1 -- start start 2023-07-09T02:11:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.168+0000 7fd373582640 1 -- start start 2023-07-09T02:11:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf1b20b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf0c0e03e0 0x7fbf0c051380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf1b20b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c056a80 con 0x7fbf0c039b80 2023-07-09T02:11:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf1b20b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c0518c0 con 0x7fbf0c038ec0 2023-07-09T02:11:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf1b20b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c039610 con 0x7fbf0c0e03e0 2023-07-09T02:11:26.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf13fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbf0c039b80 0x7fbf0c0387b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48916/0 (socket says 172.21.15.45:48916) 2023-07-09T02:11:26.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf13fff640 1 -- 172.21.15.45:0/4293445010 learned_addr learned my addr 172.21.15.45:0/4293445010 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356256914 0 0) 0x7fbf0c056a80 con 0x7fbf0c039b80 2023-07-09T02:11:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf04003530 con 0x7fbf0c039b80 2023-07-09T02:11:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443811413 0 0) 0x7fbf0c0518c0 con 0x7fbf0c038ec0 2023-07-09T02:11:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf0c056a80 con 0x7fbf0c038ec0 2023-07-09T02:11:26.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 16484766 0 0) 0x7fbf04003530 con 0x7fbf0c039b80 2023-07-09T02:11:26.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf0c0e03e0 msgr2=0x7fbf0c051380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-09T02:11:26.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf0c0e03e0 0x7fbf0c051380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 >> v1:172.21.15.155:6789/0 conn(0x7fbf0c038ec0 legacy=0x7fbf0c053250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c0567a0 con 0x7fbf0c039b80 2023-07-09T02:11:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fbf08001680 con 0x7fbf0c039b80 2023-07-09T02:11:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 >> v1:172.21.15.45:6789/0 conn(0x7fbf0c039b80 legacy=0x7fbf0c0387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf04003b70 0x7fbf04003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040047d0 0x7fbf04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14061100 con 0x7fbf04005180 2023-07-09T02:11:26.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c039610 con 0x7fbf040047d0 2023-07-09T02:11:26.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04010520 con 0x7fbf04003b70 2023-07-09T02:11:26.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf197a8640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7f7838e19640 1 Processor -- start 2023-07-09T02:11:26.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7f7838e19640 1 -- start start 2023-07-09T02:11:26.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.172+0000 7fbf13fff640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040047d0 0x7fbf04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd373582640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3640383a0 0x7fd3640377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd373582640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd364055100 0x7fd3640339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd373582640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3640e0820 0x7fd3640d8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd373582640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364020b60 con 0x7fd364055100 2023-07-09T02:11:26.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd373582640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364024630 con 0x7fd3640e0820 2023-07-09T02:11:26.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd373582640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd364024910 con 0x7fd3640383a0 2023-07-09T02:11:26.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f873596e640 1 --2- 172.21.15.45:0/492012847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873006b120 0x7f873006b4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8728009d90 tx=0x7f872801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb3c569a9fc5791e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fbf197a8640 1 -- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf04003b70 msgr2=0x7fbf04003f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T02:11:26.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd37131e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3640383a0 0x7fd3640377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd37131e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3640383a0 0x7fd3640377f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38768/0 (socket says 172.21.15.45:38768) 2023-07-09T02:11:26.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd37131e640 1 -- 172.21.15.45:0/1992266592 learned_addr learned my addr 172.21.15.45:0/1992266592 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd370b1d640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd364055100 0x7fd3640339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd371b1f640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3640e0820 0x7fd3640d8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fbf197a8640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf04003b70 0x7fbf04003f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fbf197a8640 1 -- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040047d0 msgr2=0x7fbf04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:26.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fbf197a8640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040047d0 0x7fbf04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fbf197a8640 1 -- 172.21.15.45:0/4293445010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c0567a0 con 0x7fbf04005180 2023-07-09T02:11:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd371b1f640 1 -- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3640383a0 msgr2=0x7fd3640377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd371b1f640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3640383a0 0x7fd3640377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd371b1f640 1 -- 172.21.15.45:0/1992266592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd364055100 msgr2=0x7fd3640339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd371b1f640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd364055100 0x7fd3640339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd371b1f640 1 -- 172.21.15.45:0/1992266592 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd368009420 con 0x7fd3640e0820 2023-07-09T02:11:26.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fbf13fff640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040047d0 0x7fbf04004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:26.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fab8d311640 1 Processor -- start 2023-07-09T02:11:26.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f7838e19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f783406b9a0 0x7f7834159150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f7838e19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78340cb220 0x7f78340c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f7838e19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78340c94f0 con 0x7f78340c8b60 2023-07-09T02:11:26.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f7838e19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7834158520 con 0x7f78340cb220 2023-07-09T02:11:26.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f7838e19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340cd420 con 0x7f783406b9a0 2023-07-09T02:11:26.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fab8d311640 1 -- start start 2023-07-09T02:11:26.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f783259c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f783406b9a0 0x7f7834159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f783259c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f783406b9a0 0x7f7834159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38800/0 (socket says 172.21.15.45:38800) 2023-07-09T02:11:26.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f783259c640 1 -- 172.21.15.45:0/4256345146 learned_addr learned my addr 172.21.15.45:0/4256345146 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7ff4e6fa9640 1 Processor -- start 2023-07-09T02:11:26.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f7832d9d640 1 --2- 172.21.15.45:0/4256345146 >> v2:172.21.15.155:3300/0 conn(0x7f78340cb220 0x7f78340c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7fd371b1f640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3640e0820 0x7fd3640d8170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd3680ab000 tx=0x7fd368019280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f783259c640 1 -- 172.21.15.45:0/4256345146 >> v2:172.21.15.155:3300/0 conn(0x7f78340cb220 msgr2=0x7f78340c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f783259c640 1 --2- 172.21.15.45:0/4256345146 >> v2:172.21.15.155:3300/0 conn(0x7f78340cb220 0x7f78340c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f783259c640 1 -- 172.21.15.45:0/4256345146 >> v1:172.21.15.155:6789/0 conn(0x7f78340c8b60 legacy=0x7f78340cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7f783259c640 1 -- 172.21.15.45:0/4256345146 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783415bc50 con 0x7f783406b9a0 2023-07-09T02:11:26.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.176+0000 7ff4e6fa9640 1 -- start start 2023-07-09T02:11:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fd361ffb640 1 -- 172.21.15.45:0/1992266592 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3680b4410 con 0x7fd3640e0820 2023-07-09T02:11:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fd361ffb640 1 -- 172.21.15.45:0/1992266592 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3680b4570 con 0x7fd3640e0820 2023-07-09T02:11:26.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fd361ffb640 1 -- 172.21.15.45:0/1992266592 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3680b48e0 con 0x7fd3640e0820 2023-07-09T02:11:26.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364020db0 con 0x7fd3640e0820 2023-07-09T02:11:26.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab8d311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 0x7fab80054650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab8d311640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab800072c0 0x7fab800366d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab8d311640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab80037030 con 0x7fab80036c10 2023-07-09T02:11:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab8d311640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab80007af0 con 0x7fab800072c0 2023-07-09T02:11:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab8d311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8004fba0 con 0x7fab800df4a0 2023-07-09T02:11:26.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3640d8840 con 0x7fd3640e0820 2023-07-09T02:11:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e6fa9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff4e0160350 0x7ff4e0161470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e6fa9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4e0160720 0x7ff4e0163f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e6fa9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e01649f0 con 0x7ff4e0164490 2023-07-09T02:11:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e6fa9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e0164cd0 con 0x7ff4e0160720 2023-07-09T02:11:26.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e6fa9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e0160c70 con 0x7ff4e0160350 2023-07-09T02:11:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7f873496c640 1 -- 172.21.15.45:0/492012847 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280a58d0 con 0x7f873006b120 2023-07-09T02:11:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7f873496c640 1 -- 172.21.15.45:0/492012847 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87280a5a30 con 0x7f873006b120 2023-07-09T02:11:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7f873496c640 1 -- 172.21.15.45:0/492012847 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280a5dc0 con 0x7f873006b120 2023-07-09T02:11:26.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab867fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab800072c0 0x7fab800366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab867fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab800072c0 0x7fab800366d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59682/0 (socket says 172.21.15.45:59682) 2023-07-09T02:11:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab867fc640 1 -- 172.21.15.45:0/2853206083 learned_addr learned my addr 172.21.15.45:0/2853206083 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e5fa7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff4e0160350 0x7ff4e0161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e5fa7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff4e0160350 0x7ff4e0161470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59684/0 (socket says 172.21.15.45:59684) 2023-07-09T02:11:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e5fa7640 1 -- 172.21.15.45:0/2396833706 learned_addr learned my addr 172.21.15.45:0/2396833706 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e5fa7640 1 -- 172.21.15.45:0/2396833706 >> v2:172.21.15.45:3300/0 conn(0x7ff4e0160720 msgr2=0x7ff4e0163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e5fa7640 1 --2- 172.21.15.45:0/2396833706 >> v2:172.21.15.45:3300/0 conn(0x7ff4e0160720 0x7ff4e0163f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e5fa7640 1 -- 172.21.15.45:0/2396833706 >> v1:172.21.15.155:6789/0 conn(0x7ff4e0164490 legacy=0x7ff4e00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:26.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7ff4e5fa7640 1 -- 172.21.15.45:0/2396833706 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0160f50 con 0x7ff4e0160350 2023-07-09T02:11:26.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab867fc640 1 -- 172.21.15.45:0/2853206083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 msgr2=0x7fab80054650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-09T02:11:26.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab867fc640 1 --2- 172.21.15.45:0/2853206083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 0x7fab80054650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab867fc640 1 -- 172.21.15.45:0/2853206083 >> v1:172.21.15.45:6789/0 conn(0x7fab80036c10 legacy=0x7fab80052820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:26.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fab867fc640 1 -- 172.21.15.45:0/2853206083 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8004fe80 con 0x7fab800072c0 2023-07-09T02:11:26.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fbf197a8640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0400b990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbf140631c0 tx=0x7fbf14099330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ea38685a93dbfe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7f8737bd2640 1 -- 172.21.15.45:0/492012847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873006b120 msgr2=0x7f873006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7f8737bd2640 1 --2- 172.21.15.45:0/492012847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873006b120 0x7f873006b4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8728009d90 tx=0x7f872801c920 comp rx=0 tx=0).stop 2023-07-09T02:11:26.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7f8737bd2640 1 -- 172.21.15.45:0/492012847 shutdown_connections 2023-07-09T02:11:26.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7f8737bd2640 1 --2- 172.21.15.45:0/492012847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873006b120 0x7f873006b4f0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8728009d90 tx=0x7f872801c920 comp rx=0 tx=0).stop 2023-07-09T02:11:26.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7f8737bd2640 1 -- 172.21.15.45:0/492012847 >> 172.21.15.45:0/492012847 conn(0x7f87300cf3b0 msgr2=0x7f87300cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.180+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3640057a0 con 0x7fd3640e0820 2023-07-09T02:11:26.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f783259c640 1 --2- 172.21.15.45:0/4256345146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f783406b9a0 0x7f7834159150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7828009870 tx=0x7f782801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b290bcd6ae7b1ddb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14122ce0 con 0x7fbf04005180 2023-07-09T02:11:26.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14122e40 con 0x7fbf04005180 2023-07-09T02:11:26.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf137fe640 1 -- 172.21.15.45:0/4293445010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1412a660 con 0x7fbf04005180 2023-07-09T02:11:26.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f8737bd2640 1 -- 172.21.15.45:0/492012847 shutdown_connections 2023-07-09T02:11:26.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf1b20b640 1 -- 172.21.15.45:0/4293445010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 msgr2=0x7fbf0400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf1b20b640 1 --2- 172.21.15.45:0/4293445010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0400b990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbf140631c0 tx=0x7fbf14099330 comp rx=0 tx=0).stop 2023-07-09T02:11:26.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf197a8640 1 -- 172.21.15.45:0/4293445010 reap_dead start 2023-07-09T02:11:26.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f783159a640 1 -- 172.21.15.45:0/4256345146 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280ab680 con 0x7f783406b9a0 2023-07-09T02:11:26.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f783159a640 1 -- 172.21.15.45:0/4256345146 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280ab7e0 con 0x7f783406b9a0 2023-07-09T02:11:26.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f783159a640 1 -- 172.21.15.45:0/4256345146 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280abb70 con 0x7f783406b9a0 2023-07-09T02:11:26.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f8737bd2640 1 -- 172.21.15.45:0/492012847 wait complete. 2023-07-09T02:11:26.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fd361ffb640 1 -- 172.21.15.45:0/1992266592 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3680b2040 con 0x7fd3640e0820 2023-07-09T02:11:26.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f7838e19640 1 -- 172.21.15.45:0/4256345146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f783406b9a0 msgr2=0x7f7834159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f7838e19640 1 --2- 172.21.15.45:0/4256345146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f783406b9a0 0x7f7834159150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7828009870 tx=0x7f782801c480 comp rx=0 tx=0).stop 2023-07-09T02:11:26.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7ff4e5fa7640 1 --2- 172.21.15.45:0/2396833706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0160350 0x7ff4e0161470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4e006e810 tx=0x7ff4d801c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b9b43b7ceafc1b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf1b20b640 1 -- 172.21.15.45:0/4293445010 shutdown_connections 2023-07-09T02:11:26.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf1b20b640 1 -- 172.21.15.45:0/4293445010 >> 172.21.15.45:0/4293445010 conn(0x7fbf0c00c220 msgr2=0x7fbf0c00c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf1b20b640 1 -- 172.21.15.45:0/4293445010 shutdown_connections 2023-07-09T02:11:26.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f7838e19640 1 -- 172.21.15.45:0/4256345146 shutdown_connections 2023-07-09T02:11:26.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f7838e19640 1 --2- 172.21.15.45:0/4256345146 >> v2:172.21.15.155:3300/0 conn(0x7f78340cb220 0x7f78340c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f7838e19640 1 --2- 172.21.15.45:0/4256345146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f783406b9a0 0x7f7834159150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f7838e19640 1 -- 172.21.15.45:0/4256345146 >> 172.21.15.45:0/4256345146 conn(0x7f783406ae90 msgr2=0x7f783406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fbf1b20b640 1 -- 172.21.15.45:0/4293445010 wait complete. 2023-07-09T02:11:26.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fab867fc640 1 --2- 172.21.15.45:0/2853206083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab800366d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009870 tx=0x7fab7c01c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea13a59e37717be9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f7838e19640 1 -- 172.21.15.45:0/4256345146 shutdown_connections 2023-07-09T02:11:26.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fd361ffb640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd350066280 0x7fd350068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fd361ffb640 1 -- 172.21.15.45:0/1992266592 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd36811da20 con 0x7fd3640e0820 2023-07-09T02:11:26.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7fd37131e640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd350066280 0x7fd350068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.184+0000 7f7838e19640 1 -- 172.21.15.45:0/4256345146 wait complete. 2023-07-09T02:11:26.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f8737bd2640 1 Processor -- start 2023-07-09T02:11:26.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f8737bd2640 1 -- start start 2023-07-09T02:11:26.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fd37131e640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd350066280 0x7fd350068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd36c079cc0 tx=0x7fd36c06c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fbf1b20b640 1 Processor -- start 2023-07-09T02:11:26.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fbf1b20b640 1 -- start start 2023-07-09T02:11:26.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f7838e19640 1 Processor -- start 2023-07-09T02:11:26.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f8737bd2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87300b5810 0x7f8730150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f8737bd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87300d23e0 0x7f8730158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f7838e19640 1 -- start start 2023-07-09T02:11:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f8737bd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87301593a0 0x7f8730150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f8737bd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87300c9010 con 0x7f87301593a0 2023-07-09T02:11:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f8737bd2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87301521a0 con 0x7f87300b5810 2023-07-09T02:11:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f8737bd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8730152440 con 0x7f87300d23e0 2023-07-09T02:11:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f873596e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87300b5810 0x7f8730150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f873596e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87300b5810 0x7f8730150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59692/0 (socket says 172.21.15.45:59692) 2023-07-09T02:11:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f873516d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87300d23e0 0x7f8730158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f873596e640 1 -- 172.21.15.45:0/2155008386 learned_addr learned my addr 172.21.15.45:0/2155008386 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7ff4e4fa5640 1 -- 172.21.15.45:0/2396833706 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d80a5870 con 0x7ff4e0160350 2023-07-09T02:11:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7ff4e4fa5640 1 -- 172.21.15.45:0/2396833706 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d80a59d0 con 0x7ff4e0160350 2023-07-09T02:11:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7ff4e4fa5640 1 -- 172.21.15.45:0/2396833706 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d80a5d60 con 0x7ff4e0160350 2023-07-09T02:11:26.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fab85ffb640 1 -- 172.21.15.45:0/2853206083 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0ab600 con 0x7fab800072c0 2023-07-09T02:11:26.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fab85ffb640 1 -- 172.21.15.45:0/2853206083 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c0a7050 con 0x7fab800072c0 2023-07-09T02:11:26.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fab85ffb640 1 -- 172.21.15.45:0/2853206083 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0ab980 con 0x7fab800072c0 2023-07-09T02:11:26.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f873616f640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87301593a0 0x7f8730150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fd361ffb640 1 -- 172.21.15.45:0/1992266592 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3680eaeb0 con 0x7fd3640e0820 2023-07-09T02:11:26.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fbf1b20b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0c17c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f7838e19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f783406b9a0 0x7f783406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fab8d311640 1 -- 172.21.15.45:0/2853206083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 msgr2=0x7fab800366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fab8d311640 1 --2- 172.21.15.45:0/2853206083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab800366d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009870 tx=0x7fab7c01c4f0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7f7838e19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78340c8b60 0x7f7834151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf1b20b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf0c0dcc20 0x7fbf0c0e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/2396833706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0160350 msgr2=0x7ff4e0161470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/2396833706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0160350 0x7ff4e0161470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4e006e810 tx=0x7ff4d801c990 comp rx=0 tx=0).stop 2023-07-09T02:11:26.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.188+0000 7fab8d311640 1 -- 172.21.15.45:0/2853206083 shutdown_connections 2023-07-09T02:11:26.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fab8d311640 1 --2- 172.21.15.45:0/2853206083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab800366d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fab8d311640 1 --2- 172.21.15.45:0/2853206083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 0x7fab80054650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fab8d311640 1 -- 172.21.15.45:0/2853206083 >> 172.21.15.45:0/2853206083 conn(0x7fab800516d0 msgr2=0x7fab80051ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7838e19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78340cb220 0x7f78341523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f873596e640 1 -- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87300d23e0 msgr2=0x7f8730158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f873596e640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87300d23e0 0x7f8730158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f873596e640 1 -- 172.21.15.45:0/2155008386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87301593a0 msgr2=0x7f8730150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f873596e640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87301593a0 0x7f8730150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f873596e640 1 -- 172.21.15.45:0/2155008386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728009a70 con 0x7f87300b5810 2023-07-09T02:11:26.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf1b20b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf0c0dd070 0x7fbf0c0e44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf1b20b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0e1590 con 0x7fbf04005180 2023-07-09T02:11:26.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf1b20b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c04e8c0 con 0x7fbf0c0dd070 2023-07-09T02:11:26.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf1b20b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c04eba0 con 0x7fbf0c0dcc20 2023-07-09T02:11:26.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0c17c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0c17c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46518/0 (socket says 172.21.15.45:46518) 2023-07-09T02:11:26.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 -- 172.21.15.45:0/86852379 learned_addr learned my addr 172.21.15.45:0/86852379 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/2396833706 shutdown_connections 2023-07-09T02:11:26.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/2396833706 >> v2:172.21.15.45:3300/0 conn(0x7ff4e0160720 0x7ff4e0163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/2396833706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0160350 0x7ff4e0161470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/2396833706 >> 172.21.15.45:0/2396833706 conn(0x7ff4e00ce4b0 msgr2=0x7ff4e00ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fab8d311640 1 -- 172.21.15.45:0/2853206083 shutdown_connections 2023-07-09T02:11:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f783406b9a0 0x7f783406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f783406b9a0 0x7f783406ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59700/0 (socket says 172.21.15.45:59700) 2023-07-09T02:11:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 -- 172.21.15.45:0/2897668148 learned_addr learned my addr 172.21.15.45:0/2897668148 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c6670 con 0x7f78340cb220 2023-07-09T02:11:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c6950 con 0x7f783406b9a0 2023-07-09T02:11:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7831d9b640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78340c8b60 0x7f7834151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c6c30 con 0x7f78340c8b60 2023-07-09T02:11:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf13fff640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf0c0dcc20 0x7fbf0c0e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f873596e640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87300b5810 0x7f8730150020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f872801a550 tx=0x7f87280196c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf197a8640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf0c0dd070 0x7fbf0c0e44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7832d9d640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78340cb220 0x7f78341523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 -- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78340c8b60 msgr2=0x7f7834151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78340c8b60 0x7f7834151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 -- 172.21.15.45:0/2897668148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78340cb220 msgr2=0x7f78341523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78340cb220 0x7f78341523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 -- 172.21.15.45:0/2897668148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280094d0 con 0x7f783406b9a0 2023-07-09T02:11:26.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 -- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf0c0dcc20 msgr2=0x7fbf0c0e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf0c0dcc20 0x7fbf0c0e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 -- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf0c0dd070 msgr2=0x7fbf0c0e44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf0c0dd070 0x7fbf0c0e44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 -- 172.21.15.45:0/86852379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c04ee80 con 0x7fbf04005180 2023-07-09T02:11:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f783259c640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f783406b9a0 0x7f783406ecc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f782801a0b0 tx=0x7f782801acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f87267fc640 1 -- 172.21.15.45:0/2155008386 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280ad650 con 0x7f87300b5810 2023-07-09T02:11:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f87267fc640 1 -- 172.21.15.45:0/2155008386 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87280ad7b0 con 0x7f87300b5810 2023-07-09T02:11:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f87267fc640 1 -- 172.21.15.45:0/2155008386 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280adb40 con 0x7f87300b5810 2023-07-09T02:11:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8730152720 con 0x7f87300b5810 2023-07-09T02:11:26.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87301558e0 con 0x7f87300b5810 2023-07-09T02:11:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/2396833706 shutdown_connections 2023-07-09T02:11:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7822ffd640 1 -- 172.21.15.45:0/2897668148 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280b4800 con 0x7f783406b9a0 2023-07-09T02:11:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7822ffd640 1 -- 172.21.15.45:0/2897668148 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280b4980 con 0x7f783406b9a0 2023-07-09T02:11:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7822ffd640 1 -- 172.21.15.45:0/2897668148 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280b4d30 con 0x7f783406b9a0 2023-07-09T02:11:26.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf18fa7640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0c17c4b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000b3c0 tx=0x7fbf0000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf117fa640 1 -- 172.21.15.45:0/86852379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00011620 con 0x7fbf04005180 2023-07-09T02:11:26.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf117fa640 1 -- 172.21.15.45:0/86852379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0000be90 con 0x7fbf04005180 2023-07-09T02:11:26.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf117fa640 1 -- 172.21.15.45:0/86852379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000119e0 con 0x7fbf04005180 2023-07-09T02:11:26.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c04f160 con 0x7fbf04005180 2023-07-09T02:11:26.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c0e0820 con 0x7fbf04005180 2023-07-09T02:11:26.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/2396833706 wait complete. 2023-07-09T02:11:26.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78340c6f10 con 0x7f783406b9a0 2023-07-09T02:11:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7834149c60 con 0x7f783406b9a0 2023-07-09T02:11:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7ff4e6fa9640 1 Processor -- start 2023-07-09T02:11:26.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fab8d311640 1 -- 172.21.15.45:0/2853206083 wait complete. 2023-07-09T02:11:26.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.192+0000 7fab8d311640 1 Processor -- start 2023-07-09T02:11:26.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7fab8d311640 1 -- start start 2023-07-09T02:11:26.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7f7730e5b640 1 Processor -- start 2023-07-09T02:11:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7f87267fc640 1 -- 172.21.15.45:0/2155008386 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87280adca0 con 0x7f87300b5810 2023-07-09T02:11:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7f87267fc640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066350 0x7f8714068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7f87267fc640 1 -- 172.21.15.45:0/2155008386 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f872811ec90 con 0x7f87300b5810 2023-07-09T02:11:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7ff4e6fa9640 1 -- start start 2023-07-09T02:11:26.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7ff4e6fa9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4e0160350 0x7ff4e00c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7ff4e6fa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e0160720 0x7ff4e015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7ff4e6fa9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0164490 0x7ff4e00ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7fab8d311640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab80188890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7ff4e6fa9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e015e440 con 0x7ff4e0160720 2023-07-09T02:11:26.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7fab8d311640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab80036c10 0x7fab800dfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7ff4e6fa9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e015ea00 con 0x7ff4e0164490 2023-07-09T02:11:26.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e6fa9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e00c49b0 con 0x7ff4e0160350 2023-07-09T02:11:26.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0164490 0x7ff4e00ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0164490 0x7ff4e00ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59728/0 (socket says 172.21.15.45:59728) 2023-07-09T02:11:26.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 -- 172.21.15.45:0/196647300 learned_addr learned my addr 172.21.15.45:0/196647300 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab80188890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab8d311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 0x7fab800e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab80188890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59736/0 (socket says 172.21.15.45:59736) 2023-07-09T02:11:26.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8718005260 con 0x7f87300b5810 2023-07-09T02:11:26.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7fbf117fa640 1 -- 172.21.15.45:0/86852379 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf00011b40 con 0x7fbf04005180 2023-07-09T02:11:26.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f873516d640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066350 0x7f8714068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 -- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4e0160350 msgr2=0x7ff4e00c4470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T02:11:26.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4e0160350 0x7ff4e00c4470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 -- 172.21.15.45:0/196647300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e0160720 msgr2=0x7ff4e015d1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T02:11:26.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e0160720 0x7ff4e015d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 -- 172.21.15.45:0/196647300 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d8009b30 con 0x7ff4e0164490 2023-07-09T02:11:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab8d311640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80189ec0 con 0x7fab80036c10 2023-07-09T02:11:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab8d311640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80188dd0 con 0x7fab800072c0 2023-07-09T02:11:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab8d311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab80188fd0 con 0x7fab800df4a0 2023-07-09T02:11:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 -- 172.21.15.45:0/2314966969 learned_addr learned my addr 172.21.15.45:0/2314966969 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab877fe640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 0x7fab800e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab867fc640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab80036c10 0x7fab800dfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7f7822ffd640 1 -- 172.21.15.45:0/2897668148 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78280c7390 con 0x7f783406b9a0 2023-07-09T02:11:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783404e020 con 0x7f783406b9a0 2023-07-09T02:11:26.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7ff4e67a8640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0164490 0x7ff4e00ab0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000b410 tx=0x7ff4d000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fbf117fa640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbef8066380 0x7fbef8068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fbf117fa640 1 -- 172.21.15.45:0/86852379 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf000839b0 con 0x7fbf04005180 2023-07-09T02:11:26.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef4005260 con 0x7fbf04005180 2023-07-09T02:11:26.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 -- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 msgr2=0x7fab800e00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 0x7fab800e00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 -- 172.21.15.45:0/2314966969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab80036c10 msgr2=0x7fab800dfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab80036c10 0x7fab800dfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 -- 172.21.15.45:0/2314966969 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c0094d0 con 0x7fab800072c0 2023-07-09T02:11:26.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.196+0000 7f7730e5b640 1 -- start start 2023-07-09T02:11:26.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f7730e5b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f7724056860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f7730e5b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240536b0 con 0x7f77240e0450 2023-07-09T02:11:26.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f7730e5b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240533d0 con 0x7f7724054490 2023-07-09T02:11:26.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f7730e5b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240515b0 con 0x7f7724038fc0 2023-07-09T02:11:26.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fbf13fff640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbef8066380 0x7fbef8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fab86ffd640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab80188890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab7800b3e0 tx=0x7fab7800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f7822ffd640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7814066350 0x7f7814068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f772b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f77240e0450 0x7f77240388b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48932/0 (socket says 172.21.15.45:48932) 2023-07-09T02:11:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f772b7fe640 1 -- 172.21.15.45:0/4090251253 learned_addr learned my addr 172.21.15.45:0/4090251253 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f772affd640 1 --2- 172.21.15.45:0/4090251253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f7724056860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7fbf13fff640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbef8066380 0x7fbef8068830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c050aa0 tx=0x7fbf08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f7822ffd640 1 -- 172.21.15.45:0/2897668148 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f782811e970 con 0x7f783406b9a0 2023-07-09T02:11:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f7831d9b640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7814066350 0x7f7814068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f873516d640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066350 0x7f8714068800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8730158910 tx=0x7f872c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f772affd640 1 -- 172.21.15.45:0/4090251253 >> v1:172.21.15.155:6789/0 conn(0x7f7724054490 legacy=0x7f7724054a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f772affd640 1 -- 172.21.15.45:0/4090251253 >> v1:172.21.15.45:6789/0 conn(0x7f77240e0450 legacy=0x7f77240388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.200+0000 7f772affd640 1 -- 172.21.15.45:0/4090251253 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7724051890 con 0x7f7724038fc0 2023-07-09T02:11:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7f7831d9b640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7814066350 0x7f7814068800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7834072020 tx=0x7f7824009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7fab6f7fe640 1 -- 172.21.15.45:0/2314966969 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78011830 con 0x7fab800072c0 2023-07-09T02:11:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab801892b0 con 0x7fab800072c0 2023-07-09T02:11:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7f772affd640 1 --2- 172.21.15.45:0/4090251253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f7724056860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77180097f0 tx=0x7f771801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=282e3604c3009750 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab80189870 con 0x7fab800072c0 2023-07-09T02:11:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7f87267fc640 1 -- 172.21.15.45:0/2155008386 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87280ec230 con 0x7f87300b5810 2023-07-09T02:11:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7f772a7fc640 1 -- 172.21.15.45:0/4090251253 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180ab600 con 0x7f7724038fc0 2023-07-09T02:11:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7f772a7fc640 1 -- 172.21.15.45:0/4090251253 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77180a7050 con 0x7f7724038fc0 2023-07-09T02:11:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7f772a7fc640 1 -- 172.21.15.45:0/4090251253 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180ab980 con 0x7f7724038fc0 2023-07-09T02:11:26.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7ff4d67fc640 1 -- 172.21.15.45:0/196647300 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0004020 con 0x7ff4e0164490 2023-07-09T02:11:26.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7fbf117fa640 1 -- 172.21.15.45:0/86852379 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf00015080 con 0x7fbf04005180 2023-07-09T02:11:26.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e00c3690 con 0x7ff4e0164490 2023-07-09T02:11:26.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e015e690 con 0x7ff4e0164490 2023-07-09T02:11:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab80005b30 con 0x7fab800072c0 2023-07-09T02:11:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7f7730e5b640 1 -- 172.21.15.45:0/4090251253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 msgr2=0x7f7724056860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.204+0000 7f7730e5b640 1 --2- 172.21.15.45:0/4090251253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f7724056860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77180097f0 tx=0x7f771801c3a0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7f7730e5b640 1 -- 172.21.15.45:0/4090251253 shutdown_connections 2023-07-09T02:11:26.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7f7730e5b640 1 --2- 172.21.15.45:0/4090251253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f7724056860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7f7730e5b640 1 -- 172.21.15.45:0/4090251253 >> 172.21.15.45:0/4090251253 conn(0x7f772400cfd0 msgr2=0x7f77240538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7f7730e5b640 1 -- 172.21.15.45:0/4090251253 shutdown_connections 2023-07-09T02:11:26.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e004e020 con 0x7ff4e0164490 2023-07-09T02:11:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7f7730e5b640 1 -- 172.21.15.45:0/4090251253 wait complete. 2023-07-09T02:11:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7ff4d67fc640 1 -- 172.21.15.45:0/196647300 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d0004180 con 0x7ff4e0164490 2023-07-09T02:11:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7ff4d67fc640 1 -- 172.21.15.45:0/196647300 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00044f0 con 0x7ff4e0164490 2023-07-09T02:11:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7fab6f7fe640 1 -- 172.21.15.45:0/2314966969 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab780091f0 con 0x7fab800072c0 2023-07-09T02:11:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7fab6f7fe640 1 -- 172.21.15.45:0/2314966969 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78011b90 con 0x7fab800072c0 2023-07-09T02:11:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7f7730e5b640 1 Processor -- start 2023-07-09T02:11:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7f7822ffd640 1 -- 172.21.15.45:0/2897668148 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78280ebdf0 con 0x7f783406b9a0 2023-07-09T02:11:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.208+0000 7f7730e5b640 1 -- start start 2023-07-09T02:11:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f7730e5b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f772404fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f7730e5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7724054490 0x7f77240daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f7730e5b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77240e0450 0x7f772404c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7ff4d67fc640 1 -- 172.21.15.45:0/196647300 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4d0011630 con 0x7ff4e0164490 2023-07-09T02:11:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f7730e5b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7724050b70 con 0x7f7724054490 2023-07-09T02:11:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f7730e5b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772404cab0 con 0x7f77240e0450 2023-07-09T02:11:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f7730e5b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7724036240 con 0x7f7724038fc0 2023-07-09T02:11:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77240e0450 0x7f772404c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7724054490 0x7f77240daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7724054490 0x7f77240daeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46554/0 (socket says 172.21.15.45:46554) 2023-07-09T02:11:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 -- 172.21.15.45:0/3992777876 learned_addr learned my addr 172.21.15.45:0/3992777876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772b7fe640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f772404fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7fab6f7fe640 1 -- 172.21.15.45:0/2314966969 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab78011cf0 con 0x7fab800072c0 2023-07-09T02:11:26.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7fab6f7fe640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab74066280 0x7fab74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7fab6f7fe640 1 -- 172.21.15.45:0/2314966969 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab78084420 con 0x7fab800072c0 2023-07-09T02:11:26.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 -- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 msgr2=0x7f772404fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f772404fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 -- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77240e0450 msgr2=0x7f772404c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77240e0450 0x7f772404c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 -- 172.21.15.45:0/3992777876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7718009420 con 0x7f7724054490 2023-07-09T02:11:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7ff4d67fc640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff4c4066280 0x7ff4c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7ff4d67fc640 1 -- 172.21.15.45:0/196647300 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4d0084040 con 0x7ff4e0164490 2023-07-09T02:11:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7fab867fc640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab74066280 0x7fab74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.212+0000 7f772affd640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7724054490 0x7f77240daeb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f77180097f0 tx=0x7f771801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.216+0000 7ff4e5fa7640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff4c4066280 0x7ff4c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.216+0000 7fab867fc640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab74066280 0x7fab74068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0ad000 tx=0x7fab7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.216+0000 7f7717fff640 1 -- 172.21.15.45:0/3992777876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180b37d0 con 0x7f7724054490 2023-07-09T02:11:26.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.216+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772404bca0 con 0x7f7724054490 2023-07-09T02:11:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.216+0000 7ff4d67fc640 1 -- 172.21.15.45:0/196647300 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4d00513a0 con 0x7ff4e0164490 2023-07-09T02:11:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.216+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77240505b0 con 0x7f7724054490 2023-07-09T02:11:26.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.216+0000 7fab6f7fe640 1 -- 172.21.15.45:0/2314966969 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab78055220 con 0x7fab800072c0 2023-07-09T02:11:26.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.220+0000 7ff4e5fa7640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff4c4066280 0x7ff4c4068730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80ae000 tx=0x7ff4d80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.220+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7724036010 con 0x7f7724054490 2023-07-09T02:11:26.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.228+0000 7f7717fff640 1 -- 172.21.15.45:0/3992777876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77180b3930 con 0x7f7724054490 2023-07-09T02:11:26.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.228+0000 7f7717fff640 1 -- 172.21.15.45:0/3992777876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180b3ce0 con 0x7f7724054490 2023-07-09T02:11:26.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.228+0000 7f7717fff640 1 -- 172.21.15.45:0/3992777876 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77180b2070 con 0x7f7724054490 2023-07-09T02:11:26.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.232+0000 7f7717fff640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7710066400 0x7f77100688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.232+0000 7f7717fff640 1 -- 172.21.15.45:0/3992777876 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f771811e200 con 0x7f7724054490 2023-07-09T02:11:26.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.232+0000 7f7717fff640 1 -- 172.21.15.45:0/3992777876 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7724036010 con 0x7f7724054490 2023-07-09T02:11:26.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.232+0000 7f772b7fe640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7710066400 0x7f77100688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.232+0000 7f772b7fe640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7710066400 0x7f77100688b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f772c02c430 tx=0x7f772c06c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.456+0000 7fd0e04cb640 1 -- 172.21.15.45:0/4232796023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd0c0005510 con 0x7fd0d80cb220 2023-07-09T02:11:26.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.456+0000 7fd0ceffd640 1 -- 172.21.15.45:0/4232796023 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0c8015090 con 0x7fd0d80cb220 2023-07-09T02:11:26.461 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:26.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 -- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd0bc0663d0 msgr2=0x7fd0bc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd0bc0663d0 0x7fd0bc068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80ced90 tx=0x7fd0d4009040 comp rx=0 tx=0).stop 2023-07-09T02:11:26.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 -- 172.21.15.45:0/4232796023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0d80cb220 msgr2=0x7fd0d80c2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0d80cb220 0x7fd0d80c2020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800b410 tx=0x7fd0c800b8d0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 -- 172.21.15.45:0/4232796023 shutdown_connections 2023-07-09T02:11:26.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0d8159150 0x7fd0d80c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0d80cb220 0x7fd0d80c2020 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd0bc0663d0 0x7fd0bc068880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 --2- 172.21.15.45:0/4232796023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0d80c9270 0x7fd0d8152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 -- 172.21.15.45:0/4232796023 >> 172.21.15.45:0/4232796023 conn(0x7fd0d806ae90 msgr2=0x7fd0d80c55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 -- 172.21.15.45:0/4232796023 shutdown_connections 2023-07-09T02:11:26.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.460+0000 7fd0ccff9640 1 -- 172.21.15.45:0/4232796023 wait complete. 2023-07-09T02:11:26.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-07-09T02:11:26.497 DEBUG:teuthology.parallel:result is None 2023-07-09T02:11:26.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.520+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd364024770 con 0x7fd3640e0820 2023-07-09T02:11:26.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.520+0000 7fd361ffb640 1 -- 172.21.15.45:0/1992266592 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd364024770 con 0x7fd3640e0820 2023-07-09T02:11:26.524 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:26.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.520+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbef4005510 con 0x7fbf04005180 2023-07-09T02:11:26.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.520+0000 7fbf117fa640 1 -- 172.21.15.45:0/86852379 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf00054810 con 0x7fbf04005180 2023-07-09T02:11:26.525 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd350066280 msgr2=0x7fd350068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd350066280 0x7fd350068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd36c079cc0 tx=0x7fd36c06c040 comp rx=0 tx=0).stop 2023-07-09T02:11:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3640e0820 msgr2=0x7fd3640d8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3640e0820 0x7fd3640d8170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd3680ab000 tx=0x7fd368019280 comp rx=0 tx=0).stop 2023-07-09T02:11:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 shutdown_connections 2023-07-09T02:11:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3640e0820 0x7fd3640d8170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd364055100 0x7fd3640339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd350066280 0x7fd350068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 --2- 172.21.15.45:0/1992266592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3640383a0 0x7fd3640377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 >> 172.21.15.45:0/1992266592 conn(0x7fd36400a780 msgr2=0x7fd3640549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 shutdown_connections 2023-07-09T02:11:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fd373582640 1 -- 172.21.15.45:0/1992266592 wait complete. 2023-07-09T02:11:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbef8066380 msgr2=0x7fbef8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbef8066380 0x7fbef8068830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c050aa0 tx=0x7fbf08009040 comp rx=0 tx=0).stop 2023-07-09T02:11:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 msgr2=0x7fbf0c17c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0c17c4b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000b3c0 tx=0x7fbf0000b4b0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 shutdown_connections 2023-07-09T02:11:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf0c0dd070 0x7fbf0c0e44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbef8066380 0x7fbef8068830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf0c0dcc20 0x7fbf0c0e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 --2- 172.21.15.45:0/86852379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf04005180 0x7fbf0c17c4b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 >> 172.21.15.45:0/86852379 conn(0x7fbf0c00c220 msgr2=0x7fbf0c006f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 shutdown_connections 2023-07-09T02:11:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.524+0000 7fbf1b20b640 1 -- 172.21.15.45:0/86852379 wait complete. 2023-07-09T02:11:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.544+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8718005510 con 0x7f87300b5810 2023-07-09T02:11:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.544+0000 7f87267fc640 1 -- 172.21.15.45:0/2155008386 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87280b2090 con 0x7f87300b5810 2023-07-09T02:11:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.544+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f78340c6a90 con 0x7f783406b9a0 2023-07-09T02:11:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.544+0000 7f7822ffd640 1 -- 172.21.15.45:0/2897668148 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78340c6a90 con 0x7f783406b9a0 2023-07-09T02:11:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066350 msgr2=0x7f8714068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066350 0x7f8714068800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8730158910 tx=0x7f872c009040 comp rx=0 tx=0).stop 2023-07-09T02:11:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87300b5810 msgr2=0x7f8730150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87300b5810 0x7f8730150020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f872801a550 tx=0x7f87280196c0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 shutdown_connections 2023-07-09T02:11:26.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87301593a0 0x7f8730150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066350 0x7f8714068800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87300d23e0 0x7f8730158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 --2- 172.21.15.45:0/2155008386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87300b5810 0x7f8730150020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 >> 172.21.15.45:0/2155008386 conn(0x7f87300cf3b0 msgr2=0x7f87300b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-07-09T02:11:26.553 DEBUG:teuthology.parallel:result is None 2023-07-09T02:11:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7814066350 msgr2=0x7f7814068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7814066350 0x7f7814068800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7834072020 tx=0x7f7824009040 comp rx=0 tx=0).stop 2023-07-09T02:11:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f783406b9a0 msgr2=0x7f783406ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f783406b9a0 0x7f783406ecc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f782801a0b0 tx=0x7f782801acc0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 shutdown_connections 2023-07-09T02:11:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f8737bd2640 1 -- 172.21.15.45:0/2155008386 wait complete. 2023-07-09T02:11:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 shutdown_connections 2023-07-09T02:11:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78340cb220 0x7f78341523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7814066350 0x7f7814068800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78340c8b60 0x7f7834151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 --2- 172.21.15.45:0/2897668148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f783406b9a0 0x7f783406ecc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 >> 172.21.15.45:0/2897668148 conn(0x7f783406ae90 msgr2=0x7f7834156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff4e015e820 con 0x7ff4e0164490 2023-07-09T02:11:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 shutdown_connections 2023-07-09T02:11:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7f7838e19640 1 -- 172.21.15.45:0/2897668148 wait complete. 2023-07-09T02:11:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7ff4d67fc640 1 -- 172.21.15.45:0/196647300 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4d0015020 con 0x7ff4e0164490 2023-07-09T02:11:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:26.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.548+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab800054d0 con 0x7fab800072c0 2023-07-09T02:11:26.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7fab6f7fe640 1 -- 172.21.15.45:0/2314966969 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab78054db0 con 0x7fab800072c0 2023-07-09T02:11:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:26.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff4c4066280 msgr2=0x7ff4c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff4c4066280 0x7ff4c4068730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80ae000 tx=0x7ff4d80a7070 comp rx=0 tx=0).stop 2023-07-09T02:11:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0164490 msgr2=0x7ff4e00ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0164490 0x7ff4e00ab0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000b410 tx=0x7ff4d000b8d0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 shutdown_connections 2023-07-09T02:11:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e0164490 0x7ff4e00ab0e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4e0160720 0x7ff4e015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff4c4066280 0x7ff4c4068730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 --2- 172.21.15.45:0/196647300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4e0160350 0x7ff4e00c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 >> 172.21.15.45:0/196647300 conn(0x7ff4e00ce4b0 msgr2=0x7ff4e00af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 shutdown_connections 2023-07-09T02:11:26.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7ff4e6fa9640 1 -- 172.21.15.45:0/196647300 wait complete. 2023-07-09T02:11:26.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab74066280 msgr2=0x7fab74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7fab8d311640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab74066280 0x7fab74068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0ad000 tx=0x7fab7c008040 comp rx=0 tx=0).stop 2023-07-09T02:11:26.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 msgr2=0x7fab80188890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.552+0000 7fab8d311640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab80188890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab7800b3e0 tx=0x7fab7800b8a0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 shutdown_connections 2023-07-09T02:11:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7fab8d311640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab74066280 0x7fab74068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7fab8d311640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab800df4a0 0x7fab800e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7fab8d311640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab80036c10 0x7fab800dfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7fab8d311640 1 --2- 172.21.15.45:0/2314966969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab800072c0 0x7fab80188890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 >> 172.21.15.45:0/2314966969 conn(0x7fab800516d0 msgr2=0x7fab800554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 shutdown_connections 2023-07-09T02:11:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7fab8d311640 1 -- 172.21.15.45:0/2314966969 wait complete. 2023-07-09T02:11:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7724036010 con 0x7f7724054490 2023-07-09T02:11:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.556+0000 7f7717fff640 1 -- 172.21.15.45:0/3992777876 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77180eb6a0 con 0x7f7724054490 2023-07-09T02:11:26.563 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-07-09T02:11:26.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7710066400 msgr2=0x7f77100688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7710066400 0x7f77100688b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f772c02c430 tx=0x7f772c06c040 comp rx=0 tx=0).stop 2023-07-09T02:11:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7724054490 msgr2=0x7f77240daeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7724054490 0x7f77240daeb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f77180097f0 tx=0x7f771801abe0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 shutdown_connections 2023-07-09T02:11:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77240e0450 0x7f772404c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7724054490 0x7f77240daeb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7710066400 0x7f77100688b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 --2- 172.21.15.45:0/3992777876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7724038fc0 0x7f772404fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 >> 172.21.15.45:0/3992777876 conn(0x7f772400cfd0 msgr2=0x7f77240549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 shutdown_connections 2023-07-09T02:11:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.560+0000 7f7730e5b640 1 -- 172.21.15.45:0/3992777876 wait complete. 2023-07-09T02:11:26.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-07-09T02:11:26.567 DEBUG:teuthology.parallel:result is None 2023-07-09T02:11:26.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-07-09T02:11:26.581 DEBUG:teuthology.parallel:result is None 2023-07-09T02:11:26.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-07-09T02:11:26.595 DEBUG:teuthology.parallel:result is None 2023-07-09T02:11:26.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-07-09T02:11:26.596 DEBUG:teuthology.parallel:result is None 2023-07-09T02:11:26.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-07-09T02:11:26.597 DEBUG:teuthology.parallel:result is None 2023-07-09T02:11:26.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-07-09T02:11:26.598 DEBUG:teuthology.parallel:result is None 2023-07-09T02:11:26.598 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-09T02:11:26.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:11:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16e89c5640 1 Processor -- start 2023-07-09T02:11:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16e89c5640 1 -- start start 2023-07-09T02:11:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16e89c5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e40ccc50 0x7f16e40c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16e89c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40cb0d0 0x7f16e40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16e89c5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e40cba70 con 0x7f16e415c110 2023-07-09T02:11:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16e89c5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e40cd4b0 con 0x7f16e40ccc50 2023-07-09T02:11:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16e89c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40c98c0 con 0x7f16e40cb0d0 2023-07-09T02:11:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16dbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e40ccc50 0x7f16e40c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16dbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e40ccc50 0x7f16e40c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46566/0 (socket says 172.21.15.45:46566) 2023-07-09T02:11:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16dbfff640 1 -- 172.21.15.45:0/1252450976 learned_addr learned my addr 172.21.15.45:0/1252450976 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16e2d9d640 1 --2- 172.21.15.45:0/1252450976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40cb0d0 0x7f16e40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16dbfff640 1 -- 172.21.15.45:0/1252450976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40cb0d0 msgr2=0x7f16e40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16dbfff640 1 --2- 172.21.15.45:0/1252450976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40cb0d0 0x7f16e40cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16dbfff640 1 -- 172.21.15.45:0/1252450976 >> v1:172.21.15.155:6789/0 conn(0x7f16e415c110 legacy=0x7f16e41607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.784+0000 7f16dbfff640 1 -- 172.21.15.45:0/1252450976 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40cd1d0 con 0x7f16e40ccc50 2023-07-09T02:11:26.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16dbfff640 1 --2- 172.21.15.45:0/1252450976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e40ccc50 0x7f16e40c9d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009870 tx=0x7f16cc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e2dbc19e0b4a6d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e1d9b640 1 -- 172.21.15.45:0/1252450976 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0aa670 con 0x7f16e40ccc50 2023-07-09T02:11:26.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e1d9b640 1 -- 172.21.15.45:0/1252450976 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc0aa7d0 con 0x7f16e40ccc50 2023-07-09T02:11:26.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e1d9b640 1 -- 172.21.15.45:0/1252450976 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0aab60 con 0x7f16e40ccc50 2023-07-09T02:11:26.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e89c5640 1 -- 172.21.15.45:0/1252450976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e40ccc50 msgr2=0x7f16e40c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1252450976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e40ccc50 0x7f16e40c9d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009870 tx=0x7f16cc01c510 comp rx=0 tx=0).stop 2023-07-09T02:11:26.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e89c5640 1 -- 172.21.15.45:0/1252450976 shutdown_connections 2023-07-09T02:11:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1252450976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40cb0d0 0x7f16e40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1252450976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e40ccc50 0x7f16e40c9d50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e89c5640 1 -- 172.21.15.45:0/1252450976 >> 172.21.15.45:0/1252450976 conn(0x7f16e40694b0 msgr2=0x7f16e40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e89c5640 1 -- 172.21.15.45:0/1252450976 shutdown_connections 2023-07-09T02:11:26.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.788+0000 7f16e89c5640 1 -- 172.21.15.45:0/1252450976 wait complete. 2023-07-09T02:11:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 Processor -- start 2023-07-09T02:11:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 -- start start 2023-07-09T02:11:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40cb0d0 0x7f16e40c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40ccc50 0x7f16e40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415c110 0x7f16e4158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40c65a0 con 0x7f16e415c110 2023-07-09T02:11:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40b3d20 con 0x7f16e40cb0d0 2023-07-09T02:11:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40c5fe0 con 0x7f16e40ccc50 2023-07-09T02:11:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415c110 0x7f16e4158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415c110 0x7f16e4158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46568/0 (socket says 172.21.15.45:46568) 2023-07-09T02:11:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 -- 172.21.15.45:0/1595050316 learned_addr learned my addr 172.21.15.45:0/1595050316 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16dbfff640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40ccc50 0x7f16e40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e259c640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40cb0d0 0x7f16e40c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 -- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40ccc50 msgr2=0x7f16e40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40ccc50 0x7f16e40c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 -- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40cb0d0 msgr2=0x7f16e40c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40cb0d0 0x7f16e40c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 -- 172.21.15.45:0/1595050316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0094d0 con 0x7f16e415c110 2023-07-09T02:11:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16dbfff640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40ccc50 0x7f16e40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e2d9d640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415c110 0x7f16e4158650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00efc0 tx=0x7f16dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16daffd640 1 -- 172.21.15.45:0/1595050316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc014480 con 0x7f16e415c110 2023-07-09T02:11:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16daffd640 1 -- 172.21.15.45:0/1595050316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc00f040 con 0x7f16e415c110 2023-07-09T02:11:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16daffd640 1 -- 172.21.15.45:0/1595050316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc014820 con 0x7f16e415c110 2023-07-09T02:11:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e40c62c0 con 0x7f16e415c110 2023-07-09T02:11:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.792+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e40b2550 con 0x7f16e415c110 2023-07-09T02:11:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.796+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e40b2740 con 0x7f16e415c110 2023-07-09T02:11:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.796+0000 7f16daffd640 1 -- 172.21.15.45:0/1595050316 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16dc014980 con 0x7f16e415c110 2023-07-09T02:11:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.796+0000 7f16daffd640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16c4066280 0x7f16c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.796+0000 7f16daffd640 1 -- 172.21.15.45:0/1595050316 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16dc084980 con 0x7f16e415c110 2023-07-09T02:11:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.796+0000 7f16e259c640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16c4066280 0x7f16c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.796+0000 7f16e259c640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16c4066280 0x7f16c4068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16d4000f70 tx=0x7f16d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.800+0000 7f16daffd640 1 -- 172.21.15.45:0/1595050316 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16dc051d60 con 0x7f16e415c110 2023-07-09T02:11:26.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.948+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16e40b20f0 con 0x7f16c4066280 2023-07-09T02:11:26.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.956+0000 7f16daffd640 1 -- 172.21.15.45:0/1595050316 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280790 (secure 0 0 0) 0x7f16d4001380 con 0x7f16c4066280 2023-07-09T02:11:26.975 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:26.976 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:11:26.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16c4066280 msgr2=0x7f16c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16c4066280 0x7f16c4068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16d4000f70 tx=0x7f16d4009040 comp rx=0 tx=0).stop 2023-07-09T02:11:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415c110 msgr2=0x7f16e4158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415c110 0x7f16e4158650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00efc0 tx=0x7f16dc00c490 comp rx=0 tx=0).stop 2023-07-09T02:11:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 shutdown_connections 2023-07-09T02:11:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415c110 0x7f16e4158650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16c4066280 0x7f16c4068730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16e40ccc50 0x7f16e40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 --2- 172.21.15.45:0/1595050316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16e40cb0d0 0x7f16e40c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:26.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 >> 172.21.15.45:0/1595050316 conn(0x7f16e40694b0 msgr2=0x7f16e40c4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:26.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 shutdown_connections 2023-07-09T02:11:26.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:26.960+0000 7f16e89c5640 1 -- 172.21.15.45:0/1595050316 wait complete. 2023-07-09T02:11:26.984 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T02:11:26.528147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560607,"statfs":{"total":1600000000,"available":1598061660,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.359346"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562046+0000","last_change":"2023-07-09T02:11:18.173684+0000","last_active":"2023-07-09T02:11:19.562046+0000","last_peered":"2023-07-09T02:11:19.562046+0000","last_clean":"2023-07-09T02:11:19.562046+0000","last_became_active":"2023-07-09T02:11:18.173257+0000","last_became_peered":"2023-07-09T02:11:18.173257+0000","last_unstale":"2023-07-09T02:11:19.562046+0000","last_undegraded":"2023-07-09T02:11:19.562046+0000","last_fullsized":"2023-07-09T02:11:19.562046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:12:32.920112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172792+0000","last_change":"2023-07-09T02:11:18.184579+0000","last_active":"2023-07-09T02:11:19.172792+0000","last_peered":"2023-07-09T02:11:19.172792+0000","last_clean":"2023-07-09T02:11:19.172792+0000","last_became_active":"2023-07-09T02:11:18.183376+0000","last_became_peered":"2023-07-09T02:11:18.183376+0000","last_unstale":"2023-07-09T02:11:19.172792+0000","last_undegraded":"2023-07-09T02:11:19.172792+0000","last_fullsized":"2023-07-09T02:11:19.172792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564564+0000","last_change":"2023-07-09T02:11:18.185577+0000","last_active":"2023-07-09T02:11:19.564564+0000","last_peered":"2023-07-09T02:11:19.564564+0000","last_clean":"2023-07-09T02:11:19.564564+0000","last_became_active":"2023-07-09T02:11:18.178377+0000","last_became_peered":"2023-07-09T02:11:18.178377+0000","last_unstale":"2023-07-09T02:11:19.564564+0000","last_undegraded":"2023-07-09T02:11:19.564564+0000","last_fullsized":"2023-07-09T02:11:19.564564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:43.483055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563542+0000","last_change":"2023-07-09T02:11:18.181747+0000","last_active":"2023-07-09T02:11:19.563542+0000","last_peered":"2023-07-09T02:11:19.563542+0000","last_clean":"2023-07-09T02:11:19.563542+0000","last_became_active":"2023-07-09T02:11:18.181520+0000","last_became_peered":"2023-07-09T02:11:18.181520+0000","last_unstale":"2023-07-09T02:11:19.563542+0000","last_undegraded":"2023-07-09T02:11:19.563542+0000","last_fullsized":"2023-07-09T02:11:19.563542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:33:17.007038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171528+0000","last_change":"2023-07-09T02:11:18.177270+0000","last_active":"2023-07-09T02:11:19.171528+0000","last_peered":"2023-07-09T02:11:19.171528+0000","last_clean":"2023-07-09T02:11:19.171528+0000","last_became_active":"2023-07-09T02:11:18.177038+0000","last_became_peered":"2023-07-09T02:11:18.177038+0000","last_unstale":"2023-07-09T02:11:19.171528+0000","last_undegraded":"2023-07-09T02:11:19.171528+0000","last_fullsized":"2023-07-09T02:11:19.171528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564101+0000","last_change":"2023-07-09T02:11:18.173084+0000","last_active":"2023-07-09T02:11:19.564101+0000","last_peered":"2023-07-09T02:11:19.564101+0000","last_clean":"2023-07-09T02:11:19.564101+0000","last_became_active":"2023-07-09T02:11:18.172677+0000","last_became_peered":"2023-07-09T02:11:18.172677+0000","last_unstale":"2023-07-09T02:11:19.564101+0000","last_undegraded":"2023-07-09T02:11:19.564101+0000","last_fullsized":"2023-07-09T02:11:19.564101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563535+0000","last_change":"2023-07-09T02:11:18.185042+0000","last_active":"2023-07-09T02:11:19.563535+0000","last_peered":"2023-07-09T02:11:19.563535+0000","last_clean":"2023-07-09T02:11:19.563535+0000","last_became_active":"2023-07-09T02:11:18.184798+0000","last_became_peered":"2023-07-09T02:11:18.184798+0000","last_unstale":"2023-07-09T02:11:19.563535+0000","last_undegraded":"2023-07-09T02:11:19.563535+0000","last_fullsized":"2023-07-09T02:11:19.563535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:50.071215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172736+0000","last_change":"2023-07-09T02:11:18.186766+0000","last_active":"2023-07-09T02:11:19.172736+0000","last_peered":"2023-07-09T02:11:19.172736+0000","last_clean":"2023-07-09T02:11:19.172736+0000","last_became_active":"2023-07-09T02:11:18.186525+0000","last_became_peered":"2023-07-09T02:11:18.186525+0000","last_unstale":"2023-07-09T02:11:19.172736+0000","last_undegraded":"2023-07-09T02:11:19.172736+0000","last_fullsized":"2023-07-09T02:11:19.172736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170756+0000","last_change":"2023-07-09T02:11:18.177146+0000","last_active":"2023-07-09T02:11:19.170756+0000","last_peered":"2023-07-09T02:11:19.170756+0000","last_clean":"2023-07-09T02:11:19.170756+0000","last_became_active":"2023-07-09T02:11:18.176911+0000","last_became_peered":"2023-07-09T02:11:18.176911+0000","last_unstale":"2023-07-09T02:11:19.170756+0000","last_undegraded":"2023-07-09T02:11:19.170756+0000","last_fullsized":"2023-07-09T02:11:19.170756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:20.403700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172657+0000","last_change":"2023-07-09T02:11:18.174518+0000","last_active":"2023-07-09T02:11:19.172657+0000","last_peered":"2023-07-09T02:11:19.172657+0000","last_clean":"2023-07-09T02:11:19.172657+0000","last_became_active":"2023-07-09T02:11:18.174169+0000","last_became_peered":"2023-07-09T02:11:18.174169+0000","last_unstale":"2023-07-09T02:11:19.172657+0000","last_undegraded":"2023-07-09T02:11:19.172657+0000","last_fullsized":"2023-07-09T02:11:19.172657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564275+0000","last_change":"2023-07-09T02:11:18.181947+0000","last_active":"2023-07-09T02:11:19.564275+0000","last_peered":"2023-07-09T02:11:19.564275+0000","last_clean":"2023-07-09T02:11:19.564275+0000","last_became_active":"2023-07-09T02:11:18.181661+0000","last_became_peered":"2023-07-09T02:11:18.181661+0000","last_unstale":"2023-07-09T02:11:19.564275+0000","last_undegraded":"2023-07-09T02:11:19.564275+0000","last_fullsized":"2023-07-09T02:11:19.564275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561229+0000","last_change":"2023-07-09T02:11:18.169793+0000","last_active":"2023-07-09T02:11:19.561229+0000","last_peered":"2023-07-09T02:11:19.561229+0000","last_clean":"2023-07-09T02:11:19.561229+0000","last_became_active":"2023-07-09T02:11:18.169571+0000","last_became_peered":"2023-07-09T02:11:18.169571+0000","last_unstale":"2023-07-09T02:11:19.561229+0000","last_undegraded":"2023-07-09T02:11:19.561229+0000","last_fullsized":"2023-07-09T02:11:19.561229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:23.718200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561169+0000","last_change":"2023-07-09T02:11:18.176157+0000","last_active":"2023-07-09T02:11:19.561169+0000","last_peered":"2023-07-09T02:11:19.561169+0000","last_clean":"2023-07-09T02:11:19.561169+0000","last_became_active":"2023-07-09T02:11:18.175940+0000","last_became_peered":"2023-07-09T02:11:18.175940+0000","last_unstale":"2023-07-09T02:11:19.561169+0000","last_undegraded":"2023-07-09T02:11:19.561169+0000","last_fullsized":"2023-07-09T02:11:19.561169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:40.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172540+0000","last_change":"2023-07-09T02:11:18.180034+0000","last_active":"2023-07-09T02:11:19.172540+0000","last_peered":"2023-07-09T02:11:19.172540+0000","last_clean":"2023-07-09T02:11:19.172540+0000","last_became_active":"2023-07-09T02:11:18.179791+0000","last_became_peered":"2023-07-09T02:11:18.179791+0000","last_unstale":"2023-07-09T02:11:19.172540+0000","last_undegraded":"2023-07-09T02:11:19.172540+0000","last_fullsized":"2023-07-09T02:11:19.172540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563207+0000","last_change":"2023-07-09T02:11:18.181417+0000","last_active":"2023-07-09T02:11:19.563207+0000","last_peered":"2023-07-09T02:11:19.563207+0000","last_clean":"2023-07-09T02:11:19.563207+0000","last_became_active":"2023-07-09T02:11:18.181143+0000","last_became_peered":"2023-07-09T02:11:18.181143+0000","last_unstale":"2023-07-09T02:11:19.563207+0000","last_undegraded":"2023-07-09T02:11:19.563207+0000","last_fullsized":"2023-07-09T02:11:19.563207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564658+0000","last_change":"2023-07-09T02:11:18.173518+0000","last_active":"2023-07-09T02:11:19.564658+0000","last_peered":"2023-07-09T02:11:19.564658+0000","last_clean":"2023-07-09T02:11:19.564658+0000","last_became_active":"2023-07-09T02:11:18.173258+0000","last_became_peered":"2023-07-09T02:11:18.173258+0000","last_unstale":"2023-07-09T02:11:19.564658+0000","last_undegraded":"2023-07-09T02:11:19.564658+0000","last_fullsized":"2023-07-09T02:11:19.564658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:02.674569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170760+0000","last_change":"2023-07-09T02:11:18.177796+0000","last_active":"2023-07-09T02:11:19.170760+0000","last_peered":"2023-07-09T02:11:19.170760+0000","last_clean":"2023-07-09T02:11:19.170760+0000","last_became_active":"2023-07-09T02:11:18.177274+0000","last_became_peered":"2023-07-09T02:11:18.177274+0000","last_unstale":"2023-07-09T02:11:19.170760+0000","last_undegraded":"2023-07-09T02:11:19.170760+0000","last_fullsized":"2023-07-09T02:11:19.170760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:00:38.107933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564294+0000","last_change":"2023-07-09T02:11:18.185844+0000","last_active":"2023-07-09T02:11:19.564294+0000","last_peered":"2023-07-09T02:11:19.564294+0000","last_clean":"2023-07-09T02:11:19.564294+0000","last_became_active":"2023-07-09T02:11:18.182391+0000","last_became_peered":"2023-07-09T02:11:18.182391+0000","last_unstale":"2023-07-09T02:11:19.564294+0000","last_undegraded":"2023-07-09T02:11:19.564294+0000","last_fullsized":"2023-07-09T02:11:19.564294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561387+0000","last_change":"2023-07-09T02:11:18.179371+0000","last_active":"2023-07-09T02:11:19.561387+0000","last_peered":"2023-07-09T02:11:19.561387+0000","last_clean":"2023-07-09T02:11:19.561387+0000","last_became_active":"2023-07-09T02:11:18.179128+0000","last_became_peered":"2023-07-09T02:11:18.179128+0000","last_unstale":"2023-07-09T02:11:19.561387+0000","last_undegraded":"2023-07-09T02:11:19.561387+0000","last_fullsized":"2023-07-09T02:11:19.561387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:57:59.080342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563784+0000","last_change":"2023-07-09T02:11:18.184432+0000","last_active":"2023-07-09T02:11:19.563784+0000","last_peered":"2023-07-09T02:11:19.563784+0000","last_clean":"2023-07-09T02:11:19.563784+0000","last_became_active":"2023-07-09T02:11:18.183864+0000","last_became_peered":"2023-07-09T02:11:18.183864+0000","last_unstale":"2023-07-09T02:11:19.563784+0000","last_undegraded":"2023-07-09T02:11:19.563784+0000","last_fullsized":"2023-07-09T02:11:19.563784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564024+0000","last_change":"2023-07-09T02:11:18.188823+0000","last_active":"2023-07-09T02:11:19.564024+0000","last_peered":"2023-07-09T02:11:19.564024+0000","last_clean":"2023-07-09T02:11:19.564024+0000","last_became_active":"2023-07-09T02:11:18.188604+0000","last_became_peered":"2023-07-09T02:11:18.188604+0000","last_unstale":"2023-07-09T02:11:19.564024+0000","last_undegraded":"2023-07-09T02:11:19.564024+0000","last_fullsized":"2023-07-09T02:11:19.564024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:53:48.209148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170887+0000","last_change":"2023-07-09T02:11:18.175157+0000","last_active":"2023-07-09T02:11:19.170887+0000","last_peered":"2023-07-09T02:11:19.170887+0000","last_clean":"2023-07-09T02:11:19.170887+0000","last_became_active":"2023-07-09T02:11:18.174933+0000","last_became_peered":"2023-07-09T02:11:18.174933+0000","last_unstale":"2023-07-09T02:11:19.170887+0000","last_undegraded":"2023-07-09T02:11:19.170887+0000","last_fullsized":"2023-07-09T02:11:19.170887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561562+0000","last_change":"2023-07-09T02:11:18.176548+0000","last_active":"2023-07-09T02:11:19.561562+0000","last_peered":"2023-07-09T02:11:19.561562+0000","last_clean":"2023-07-09T02:11:19.561562+0000","last_became_active":"2023-07-09T02:11:18.176203+0000","last_became_peered":"2023-07-09T02:11:18.176203+0000","last_unstale":"2023-07-09T02:11:19.561562+0000","last_undegraded":"2023-07-09T02:11:19.561562+0000","last_fullsized":"2023-07-09T02:11:19.561562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563255+0000","last_change":"2023-07-09T02:11:18.191520+0000","last_active":"2023-07-09T02:11:19.563255+0000","last_peered":"2023-07-09T02:11:19.563255+0000","last_clean":"2023-07-09T02:11:19.563255+0000","last_became_active":"2023-07-09T02:11:18.191142+0000","last_became_peered":"2023-07-09T02:11:18.191142+0000","last_unstale":"2023-07-09T02:11:19.563255+0000","last_undegraded":"2023-07-09T02:11:19.563255+0000","last_fullsized":"2023-07-09T02:11:19.563255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:59.682786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170337+0000","last_change":"2023-07-09T02:11:18.178639+0000","last_active":"2023-07-09T02:11:19.170337+0000","last_peered":"2023-07-09T02:11:19.170337+0000","last_clean":"2023-07-09T02:11:19.170337+0000","last_became_active":"2023-07-09T02:11:18.177944+0000","last_became_peered":"2023-07-09T02:11:18.177944+0000","last_unstale":"2023-07-09T02:11:19.170337+0000","last_undegraded":"2023-07-09T02:11:19.170337+0000","last_fullsized":"2023-07-09T02:11:19.170337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170201+0000","last_change":"2023-07-09T02:11:18.177229+0000","last_active":"2023-07-09T02:11:19.170201+0000","last_peered":"2023-07-09T02:11:19.170201+0000","last_clean":"2023-07-09T02:11:19.170201+0000","last_became_active":"2023-07-09T02:11:18.174701+0000","last_became_peered":"2023-07-09T02:11:18.174701+0000","last_unstale":"2023-07-09T02:11:19.170201+0000","last_undegraded":"2023-07-09T02:11:19.170201+0000","last_fullsized":"2023-07-09T02:11:19.170201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172888+0000","last_change":"2023-07-09T02:11:18.184736+0000","last_active":"2023-07-09T02:11:19.172888+0000","last_peered":"2023-07-09T02:11:19.172888+0000","last_clean":"2023-07-09T02:11:19.172888+0000","last_became_active":"2023-07-09T02:11:18.183702+0000","last_became_peered":"2023-07-09T02:11:18.183702+0000","last_unstale":"2023-07-09T02:11:19.172888+0000","last_undegraded":"2023-07-09T02:11:19.172888+0000","last_fullsized":"2023-07-09T02:11:19.172888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170226+0000","last_change":"2023-07-09T02:11:18.179358+0000","last_active":"2023-07-09T02:11:19.170226+0000","last_peered":"2023-07-09T02:11:19.170226+0000","last_clean":"2023-07-09T02:11:19.170226+0000","last_became_active":"2023-07-09T02:11:18.179041+0000","last_became_peered":"2023-07-09T02:11:18.179041+0000","last_unstale":"2023-07-09T02:11:19.170226+0000","last_undegraded":"2023-07-09T02:11:19.170226+0000","last_fullsized":"2023-07-09T02:11:19.170226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561417+0000","last_change":"2023-07-09T02:11:18.188613+0000","last_active":"2023-07-09T02:11:19.561417+0000","last_peered":"2023-07-09T02:11:19.561417+0000","last_clean":"2023-07-09T02:11:19.561417+0000","last_became_active":"2023-07-09T02:11:18.188077+0000","last_became_peered":"2023-07-09T02:11:18.188077+0000","last_unstale":"2023-07-09T02:11:19.561417+0000","last_undegraded":"2023-07-09T02:11:19.561417+0000","last_fullsized":"2023-07-09T02:11:19.561417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563907+0000","last_change":"2023-07-09T02:11:18.184235+0000","last_active":"2023-07-09T02:11:19.563907+0000","last_peered":"2023-07-09T02:11:19.563907+0000","last_clean":"2023-07-09T02:11:19.563907+0000","last_became_active":"2023-07-09T02:11:18.183126+0000","last_became_peered":"2023-07-09T02:11:18.183126+0000","last_unstale":"2023-07-09T02:11:19.563907+0000","last_undegraded":"2023-07-09T02:11:19.563907+0000","last_fullsized":"2023-07-09T02:11:19.563907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561806+0000","last_change":"2023-07-09T02:11:18.183267+0000","last_active":"2023-07-09T02:11:19.561806+0000","last_peered":"2023-07-09T02:11:19.561806+0000","last_clean":"2023-07-09T02:11:19.561806+0000","last_became_active":"2023-07-09T02:11:18.182978+0000","last_became_peered":"2023-07-09T02:11:18.182978+0000","last_unstale":"2023-07-09T02:11:19.561806+0000","last_undegraded":"2023-07-09T02:11:19.561806+0000","last_fullsized":"2023-07-09T02:11:19.561806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563259+0000","last_change":"2023-07-09T02:11:18.178491+0000","last_active":"2023-07-09T02:11:19.563259+0000","last_peered":"2023-07-09T02:11:19.563259+0000","last_clean":"2023-07-09T02:11:19.563259+0000","last_became_active":"2023-07-09T02:11:18.178285+0000","last_became_peered":"2023-07-09T02:11:18.178285+0000","last_unstale":"2023-07-09T02:11:19.563259+0000","last_undegraded":"2023-07-09T02:11:19.563259+0000","last_fullsized":"2023-07-09T02:11:19.563259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:38:30.347354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561750+0000","last_change":"2023-07-09T02:11:18.177165+0000","last_active":"2023-07-09T02:11:19.561750+0000","last_peered":"2023-07-09T02:11:19.561750+0000","last_clean":"2023-07-09T02:11:19.561750+0000","last_became_active":"2023-07-09T02:11:18.176521+0000","last_became_peered":"2023-07-09T02:11:18.176521+0000","last_unstale":"2023-07-09T02:11:19.561750+0000","last_undegraded":"2023-07-09T02:11:19.561750+0000","last_fullsized":"2023-07-09T02:11:19.561750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563364+0000","last_change":"2023-07-09T02:11:17.152607+0000","last_active":"2023-07-09T02:11:19.563364+0000","last_peered":"2023-07-09T02:11:19.563364+0000","last_clean":"2023-07-09T02:11:19.563364+0000","last_became_active":"2023-07-09T02:11:17.152046+0000","last_became_peered":"2023-07-09T02:11:17.152046+0000","last_unstale":"2023-07-09T02:11:19.563364+0000","last_undegraded":"2023-07-09T02:11:19.563364+0000","last_fullsized":"2023-07-09T02:11:19.563364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:37.921896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172894+0000","last_change":"2023-07-09T02:11:18.182781+0000","last_active":"2023-07-09T02:11:19.172894+0000","last_peered":"2023-07-09T02:11:19.172894+0000","last_clean":"2023-07-09T02:11:19.172894+0000","last_became_active":"2023-07-09T02:11:18.182536+0000","last_became_peered":"2023-07-09T02:11:18.182536+0000","last_unstale":"2023-07-09T02:11:19.172894+0000","last_undegraded":"2023-07-09T02:11:19.172894+0000","last_fullsized":"2023-07-09T02:11:19.172894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:43.483055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171507+0000","last_change":"2023-07-09T02:11:17.146484+0000","last_active":"2023-07-09T02:11:19.171507+0000","last_peered":"2023-07-09T02:11:19.171507+0000","last_clean":"2023-07-09T02:11:19.171507+0000","last_became_active":"2023-07-09T02:11:17.146040+0000","last_became_peered":"2023-07-09T02:11:17.146040+0000","last_unstale":"2023-07-09T02:11:19.171507+0000","last_undegraded":"2023-07-09T02:11:19.171507+0000","last_fullsized":"2023-07-09T02:11:19.171507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:52.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171017+0000","last_change":"2023-07-09T02:11:18.177946+0000","last_active":"2023-07-09T02:11:19.171017+0000","last_peered":"2023-07-09T02:11:19.171017+0000","last_clean":"2023-07-09T02:11:19.171017+0000","last_became_active":"2023-07-09T02:11:18.177582+0000","last_became_peered":"2023-07-09T02:11:18.177582+0000","last_unstale":"2023-07-09T02:11:19.171017+0000","last_undegraded":"2023-07-09T02:11:19.171017+0000","last_fullsized":"2023-07-09T02:11:19.171017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563900+0000","last_change":"2023-07-09T02:11:17.154743+0000","last_active":"2023-07-09T02:11:19.563900+0000","last_peered":"2023-07-09T02:11:19.563900+0000","last_clean":"2023-07-09T02:11:19.563900+0000","last_became_active":"2023-07-09T02:11:17.154330+0000","last_became_peered":"2023-07-09T02:11:17.154330+0000","last_unstale":"2023-07-09T02:11:19.563900+0000","last_undegraded":"2023-07-09T02:11:19.563900+0000","last_fullsized":"2023-07-09T02:11:19.563900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:04.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561666+0000","last_change":"2023-07-09T02:11:18.184685+0000","last_active":"2023-07-09T02:11:19.561666+0000","last_peered":"2023-07-09T02:11:19.561666+0000","last_clean":"2023-07-09T02:11:19.561666+0000","last_became_active":"2023-07-09T02:11:18.184454+0000","last_became_peered":"2023-07-09T02:11:18.184454+0000","last_unstale":"2023-07-09T02:11:19.561666+0000","last_undegraded":"2023-07-09T02:11:19.561666+0000","last_fullsized":"2023-07-09T02:11:19.561666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563353+0000","last_change":"2023-07-09T02:11:17.152301+0000","last_active":"2023-07-09T02:11:19.563353+0000","last_peered":"2023-07-09T02:11:19.563353+0000","last_clean":"2023-07-09T02:11:19.563353+0000","last_became_active":"2023-07-09T02:11:17.151929+0000","last_became_peered":"2023-07-09T02:11:17.151929+0000","last_unstale":"2023-07-09T02:11:19.563353+0000","last_undegraded":"2023-07-09T02:11:19.563353+0000","last_fullsized":"2023-07-09T02:11:19.563353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:47:02.917368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563397+0000","last_change":"2023-07-09T02:11:17.153010+0000","last_active":"2023-07-09T02:11:19.563397+0000","last_peered":"2023-07-09T02:11:19.563397+0000","last_clean":"2023-07-09T02:11:19.563397+0000","last_became_active":"2023-07-09T02:11:17.152770+0000","last_became_peered":"2023-07-09T02:11:17.152770+0000","last_unstale":"2023-07-09T02:11:19.563397+0000","last_undegraded":"2023-07-09T02:11:19.563397+0000","last_fullsized":"2023-07-09T02:11:19.563397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172585+0000","last_change":"2023-07-09T02:11:18.180346+0000","last_active":"2023-07-09T02:11:19.172585+0000","last_peered":"2023-07-09T02:11:19.172585+0000","last_clean":"2023-07-09T02:11:19.172585+0000","last_became_active":"2023-07-09T02:11:18.180096+0000","last_became_peered":"2023-07-09T02:11:18.180096+0000","last_unstale":"2023-07-09T02:11:19.172585+0000","last_undegraded":"2023-07-09T02:11:19.172585+0000","last_fullsized":"2023-07-09T02:11:19.172585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563535+0000","last_change":"2023-07-09T02:11:17.152833+0000","last_active":"2023-07-09T02:11:19.563535+0000","last_peered":"2023-07-09T02:11:19.563535+0000","last_clean":"2023-07-09T02:11:19.563535+0000","last_became_active":"2023-07-09T02:11:17.152343+0000","last_became_peered":"2023-07-09T02:11:17.152343+0000","last_unstale":"2023-07-09T02:11:19.563535+0000","last_undegraded":"2023-07-09T02:11:19.563535+0000","last_fullsized":"2023-07-09T02:11:19.563535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564321+0000","last_change":"2023-07-09T02:11:18.177770+0000","last_active":"2023-07-09T02:11:19.564321+0000","last_peered":"2023-07-09T02:11:19.564321+0000","last_clean":"2023-07-09T02:11:19.564321+0000","last_became_active":"2023-07-09T02:11:18.177539+0000","last_became_peered":"2023-07-09T02:11:18.177539+0000","last_unstale":"2023-07-09T02:11:19.564321+0000","last_undegraded":"2023-07-09T02:11:19.564321+0000","last_fullsized":"2023-07-09T02:11:19.564321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564222+0000","last_change":"2023-07-09T02:11:17.150481+0000","last_active":"2023-07-09T02:11:19.564222+0000","last_peered":"2023-07-09T02:11:19.564222+0000","last_clean":"2023-07-09T02:11:19.564222+0000","last_became_active":"2023-07-09T02:11:17.149939+0000","last_became_peered":"2023-07-09T02:11:17.149939+0000","last_unstale":"2023-07-09T02:11:19.564222+0000","last_undegraded":"2023-07-09T02:11:19.564222+0000","last_fullsized":"2023-07-09T02:11:19.564222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:04:29.662449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563686+0000","last_change":"2023-07-09T02:11:18.184631+0000","last_active":"2023-07-09T02:11:19.563686+0000","last_peered":"2023-07-09T02:11:19.563686+0000","last_clean":"2023-07-09T02:11:19.563686+0000","last_became_active":"2023-07-09T02:11:18.184406+0000","last_became_peered":"2023-07-09T02:11:18.184406+0000","last_unstale":"2023-07-09T02:11:19.563686+0000","last_undegraded":"2023-07-09T02:11:19.563686+0000","last_fullsized":"2023-07-09T02:11:19.563686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:25:42.077683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173070+0000","last_change":"2023-07-09T02:11:17.149528+0000","last_active":"2023-07-09T02:11:19.173070+0000","last_peered":"2023-07-09T02:11:19.173070+0000","last_clean":"2023-07-09T02:11:19.173070+0000","last_became_active":"2023-07-09T02:11:17.148572+0000","last_became_peered":"2023-07-09T02:11:17.148572+0000","last_unstale":"2023-07-09T02:11:19.173070+0000","last_undegraded":"2023-07-09T02:11:19.173070+0000","last_fullsized":"2023-07-09T02:11:19.173070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:17.269625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171284+0000","last_change":"2023-07-09T02:11:18.175352+0000","last_active":"2023-07-09T02:11:19.171284+0000","last_peered":"2023-07-09T02:11:19.171284+0000","last_clean":"2023-07-09T02:11:19.171284+0000","last_became_active":"2023-07-09T02:11:18.175065+0000","last_became_peered":"2023-07-09T02:11:18.175065+0000","last_unstale":"2023-07-09T02:11:19.171284+0000","last_undegraded":"2023-07-09T02:11:19.171284+0000","last_fullsized":"2023-07-09T02:11:19.171284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561829+0000","last_change":"2023-07-09T02:11:17.151647+0000","last_active":"2023-07-09T02:11:19.561829+0000","last_peered":"2023-07-09T02:11:19.561829+0000","last_clean":"2023-07-09T02:11:19.561829+0000","last_became_active":"2023-07-09T02:11:17.151192+0000","last_became_peered":"2023-07-09T02:11:17.151192+0000","last_unstale":"2023-07-09T02:11:19.561829+0000","last_undegraded":"2023-07-09T02:11:19.561829+0000","last_fullsized":"2023-07-09T02:11:19.561829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564445+0000","last_change":"2023-07-09T02:11:18.175384+0000","last_active":"2023-07-09T02:11:19.564445+0000","last_peered":"2023-07-09T02:11:19.564445+0000","last_clean":"2023-07-09T02:11:19.564445+0000","last_became_active":"2023-07-09T02:11:18.174891+0000","last_became_peered":"2023-07-09T02:11:18.174891+0000","last_unstale":"2023-07-09T02:11:19.564445+0000","last_undegraded":"2023-07-09T02:11:19.564445+0000","last_fullsized":"2023-07-09T02:11:19.564445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564021+0000","last_change":"2023-07-09T02:11:17.153219+0000","last_active":"2023-07-09T02:11:19.564021+0000","last_peered":"2023-07-09T02:11:19.564021+0000","last_clean":"2023-07-09T02:11:19.564021+0000","last_became_active":"2023-07-09T02:11:17.152973+0000","last_became_peered":"2023-07-09T02:11:17.152973+0000","last_unstale":"2023-07-09T02:11:19.564021+0000","last_undegraded":"2023-07-09T02:11:19.564021+0000","last_fullsized":"2023-07-09T02:11:19.564021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:19.400799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564465+0000","last_change":"2023-07-09T02:11:18.175022+0000","last_active":"2023-07-09T02:11:19.564465+0000","last_peered":"2023-07-09T02:11:19.564465+0000","last_clean":"2023-07-09T02:11:19.564465+0000","last_became_active":"2023-07-09T02:11:18.174763+0000","last_became_peered":"2023-07-09T02:11:18.174763+0000","last_unstale":"2023-07-09T02:11:19.564465+0000","last_undegraded":"2023-07-09T02:11:19.564465+0000","last_fullsized":"2023-07-09T02:11:19.564465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564742+0000","last_change":"2023-07-09T02:11:17.151279+0000","last_active":"2023-07-09T02:11:19.564742+0000","last_peered":"2023-07-09T02:11:19.564742+0000","last_clean":"2023-07-09T02:11:19.564742+0000","last_became_active":"2023-07-09T02:11:17.149257+0000","last_became_peered":"2023-07-09T02:11:17.149257+0000","last_unstale":"2023-07-09T02:11:19.564742+0000","last_undegraded":"2023-07-09T02:11:19.564742+0000","last_fullsized":"2023-07-09T02:11:19.564742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:17.269625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564603+0000","last_change":"2023-07-09T02:11:18.183346+0000","last_active":"2023-07-09T02:11:19.564603+0000","last_peered":"2023-07-09T02:11:19.564603+0000","last_clean":"2023-07-09T02:11:19.564603+0000","last_became_active":"2023-07-09T02:11:18.179089+0000","last_became_peered":"2023-07-09T02:11:18.179089+0000","last_unstale":"2023-07-09T02:11:19.564603+0000","last_undegraded":"2023-07-09T02:11:19.564603+0000","last_fullsized":"2023-07-09T02:11:19.564603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:42.158617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561948+0000","last_change":"2023-07-09T02:11:17.140858+0000","last_active":"2023-07-09T02:11:19.561948+0000","last_peered":"2023-07-09T02:11:19.561948+0000","last_clean":"2023-07-09T02:11:19.561948+0000","last_became_active":"2023-07-09T02:11:17.140653+0000","last_became_peered":"2023-07-09T02:11:17.140653+0000","last_unstale":"2023-07-09T02:11:19.561948+0000","last_undegraded":"2023-07-09T02:11:19.561948+0000","last_fullsized":"2023-07-09T02:11:19.561948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170012+0000","last_change":"2023-07-09T02:11:18.182085+0000","last_active":"2023-07-09T02:11:19.170012+0000","last_peered":"2023-07-09T02:11:19.170012+0000","last_clean":"2023-07-09T02:11:19.170012+0000","last_became_active":"2023-07-09T02:11:18.181736+0000","last_became_peered":"2023-07-09T02:11:18.181736+0000","last_unstale":"2023-07-09T02:11:19.170012+0000","last_undegraded":"2023-07-09T02:11:19.170012+0000","last_fullsized":"2023-07-09T02:11:19.170012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563740+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:11:19.563740+0000","last_peered":"2023-07-09T02:11:19.563740+0000","last_clean":"2023-07-09T02:11:19.563740+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:11:19.563740+0000","last_undegraded":"2023-07-09T02:11:19.563740+0000","last_fullsized":"2023-07-09T02:11:19.563740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:34.571303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173020+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:11:19.173020+0000","last_peered":"2023-07-09T02:11:19.173020+0000","last_clean":"2023-07-09T02:11:19.173020+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:11:19.173020+0000","last_undegraded":"2023-07-09T02:11:19.173020+0000","last_fullsized":"2023-07-09T02:11:19.173020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:44.044640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562136+0000","last_change":"2023-07-09T02:11:17.149270+0000","last_active":"2023-07-09T02:11:19.562136+0000","last_peered":"2023-07-09T02:11:19.562136+0000","last_clean":"2023-07-09T02:11:19.562136+0000","last_became_active":"2023-07-09T02:11:17.148945+0000","last_became_peered":"2023-07-09T02:11:17.148945+0000","last_unstale":"2023-07-09T02:11:19.562136+0000","last_undegraded":"2023-07-09T02:11:19.562136+0000","last_fullsized":"2023-07-09T02:11:19.562136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563819+0000","last_change":"2023-07-09T02:11:18.179414+0000","last_active":"2023-07-09T02:11:19.563819+0000","last_peered":"2023-07-09T02:11:19.563819+0000","last_clean":"2023-07-09T02:11:19.563819+0000","last_became_active":"2023-07-09T02:11:18.179066+0000","last_became_peered":"2023-07-09T02:11:18.179066+0000","last_unstale":"2023-07-09T02:11:19.563819+0000","last_undegraded":"2023-07-09T02:11:19.563819+0000","last_fullsized":"2023-07-09T02:11:19.563819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:54:07.291526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563613+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:11:19.563613+0000","last_peered":"2023-07-09T02:11:19.563613+0000","last_clean":"2023-07-09T02:11:19.563613+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:11:19.563613+0000","last_undegraded":"2023-07-09T02:11:19.563613+0000","last_fullsized":"2023-07-09T02:11:19.563613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:12.245950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171634+0000","last_change":"2023-07-09T02:11:17.147946+0000","last_active":"2023-07-09T02:11:19.171634+0000","last_peered":"2023-07-09T02:11:19.171634+0000","last_clean":"2023-07-09T02:11:19.171634+0000","last_became_active":"2023-07-09T02:11:17.146310+0000","last_became_peered":"2023-07-09T02:11:17.146310+0000","last_unstale":"2023-07-09T02:11:19.171634+0000","last_undegraded":"2023-07-09T02:11:19.171634+0000","last_fullsized":"2023-07-09T02:11:19.171634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171398+0000","last_change":"2023-07-09T02:11:18.179015+0000","last_active":"2023-07-09T02:11:19.171398+0000","last_peered":"2023-07-09T02:11:19.171398+0000","last_clean":"2023-07-09T02:11:19.171398+0000","last_became_active":"2023-07-09T02:11:18.178737+0000","last_became_peered":"2023-07-09T02:11:18.178737+0000","last_unstale":"2023-07-09T02:11:19.171398+0000","last_undegraded":"2023-07-09T02:11:19.171398+0000","last_fullsized":"2023-07-09T02:11:19.171398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561247+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:11:19.561247+0000","last_peered":"2023-07-09T02:11:19.561247+0000","last_clean":"2023-07-09T02:11:19.561247+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:11:19.561247+0000","last_undegraded":"2023-07-09T02:11:19.561247+0000","last_fullsized":"2023-07-09T02:11:19.561247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:48:47.217353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171016+0000","last_change":"2023-07-09T02:11:17.149678+0000","last_active":"2023-07-09T02:11:19.171016+0000","last_peered":"2023-07-09T02:11:19.171016+0000","last_clean":"2023-07-09T02:11:19.171016+0000","last_became_active":"2023-07-09T02:11:17.149224+0000","last_became_peered":"2023-07-09T02:11:17.149224+0000","last_unstale":"2023-07-09T02:11:19.171016+0000","last_undegraded":"2023-07-09T02:11:19.171016+0000","last_fullsized":"2023-07-09T02:11:19.171016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170514+0000","last_change":"2023-07-09T02:11:18.173705+0000","last_active":"2023-07-09T02:11:19.170514+0000","last_peered":"2023-07-09T02:11:19.170514+0000","last_clean":"2023-07-09T02:11:19.170514+0000","last_became_active":"2023-07-09T02:11:18.173058+0000","last_became_peered":"2023-07-09T02:11:18.173058+0000","last_unstale":"2023-07-09T02:11:19.170514+0000","last_undegraded":"2023-07-09T02:11:19.170514+0000","last_fullsized":"2023-07-09T02:11:19.170514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173114+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:11:19.173114+0000","last_peered":"2023-07-09T02:11:19.173114+0000","last_clean":"2023-07-09T02:11:19.173114+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:11:19.173114+0000","last_undegraded":"2023-07-09T02:11:19.173114+0000","last_fullsized":"2023-07-09T02:11:19.173114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:38.598275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564792+0000","last_change":"2023-07-09T02:11:17.152808+0000","last_active":"2023-07-09T02:11:19.564792+0000","last_peered":"2023-07-09T02:11:19.564792+0000","last_clean":"2023-07-09T02:11:19.564792+0000","last_became_active":"2023-07-09T02:11:17.152237+0000","last_became_peered":"2023-07-09T02:11:17.152237+0000","last_unstale":"2023-07-09T02:11:19.564792+0000","last_undegraded":"2023-07-09T02:11:19.564792+0000","last_fullsized":"2023-07-09T02:11:19.564792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:04.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170528+0000","last_change":"2023-07-09T02:11:18.177324+0000","last_active":"2023-07-09T02:11:19.170528+0000","last_peered":"2023-07-09T02:11:19.170528+0000","last_clean":"2023-07-09T02:11:19.170528+0000","last_became_active":"2023-07-09T02:11:18.177090+0000","last_became_peered":"2023-07-09T02:11:18.177090+0000","last_unstale":"2023-07-09T02:11:19.170528+0000","last_undegraded":"2023-07-09T02:11:19.170528+0000","last_fullsized":"2023-07-09T02:11:19.170528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172710+0000","last_change":"2023-07-09T02:11:17.145585+0000","last_active":"2023-07-09T02:11:19.172710+0000","last_peered":"2023-07-09T02:11:19.172710+0000","last_clean":"2023-07-09T02:11:19.172710+0000","last_became_active":"2023-07-09T02:11:17.145273+0000","last_became_peered":"2023-07-09T02:11:17.145273+0000","last_unstale":"2023-07-09T02:11:19.172710+0000","last_undegraded":"2023-07-09T02:11:19.172710+0000","last_fullsized":"2023-07-09T02:11:19.172710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:52.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170719+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:11:19.170719+0000","last_peered":"2023-07-09T02:11:19.170719+0000","last_clean":"2023-07-09T02:11:19.170719+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:11:19.170719+0000","last_undegraded":"2023-07-09T02:11:19.170719+0000","last_fullsized":"2023-07-09T02:11:19.170719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:53.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170901+0000","last_change":"2023-07-09T02:11:18.173842+0000","last_active":"2023-07-09T02:11:19.170901+0000","last_peered":"2023-07-09T02:11:19.170901+0000","last_clean":"2023-07-09T02:11:19.170901+0000","last_became_active":"2023-07-09T02:11:18.173468+0000","last_became_peered":"2023-07-09T02:11:18.173468+0000","last_unstale":"2023-07-09T02:11:19.170901+0000","last_undegraded":"2023-07-09T02:11:19.170901+0000","last_fullsized":"2023-07-09T02:11:19.170901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170652+0000","last_change":"2023-07-09T02:11:17.150542+0000","last_active":"2023-07-09T02:11:19.170652+0000","last_peered":"2023-07-09T02:11:19.170652+0000","last_clean":"2023-07-09T02:11:19.170652+0000","last_became_active":"2023-07-09T02:11:17.149674+0000","last_became_peered":"2023-07-09T02:11:17.149674+0000","last_unstale":"2023-07-09T02:11:19.170652+0000","last_undegraded":"2023-07-09T02:11:19.170652+0000","last_fullsized":"2023-07-09T02:11:19.170652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563487+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:11:19.563487+0000","last_peered":"2023-07-09T02:11:19.563487+0000","last_clean":"2023-07-09T02:11:19.563487+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:11:19.563487+0000","last_undegraded":"2023-07-09T02:11:19.563487+0000","last_fullsized":"2023-07-09T02:11:19.563487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:36.132042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171354+0000","last_change":"2023-07-09T02:11:18.172690+0000","last_active":"2023-07-09T02:11:19.171354+0000","last_peered":"2023-07-09T02:11:19.171354+0000","last_clean":"2023-07-09T02:11:19.171354+0000","last_became_active":"2023-07-09T02:11:18.172472+0000","last_became_peered":"2023-07-09T02:11:18.172472+0000","last_unstale":"2023-07-09T02:11:19.171354+0000","last_undegraded":"2023-07-09T02:11:19.171354+0000","last_fullsized":"2023-07-09T02:11:19.171354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562080+0000","last_change":"2023-07-09T02:11:17.147493+0000","last_active":"2023-07-09T02:11:19.562080+0000","last_peered":"2023-07-09T02:11:19.562080+0000","last_clean":"2023-07-09T02:11:19.562080+0000","last_became_active":"2023-07-09T02:11:17.147154+0000","last_became_peered":"2023-07-09T02:11:17.147154+0000","last_unstale":"2023-07-09T02:11:19.562080+0000","last_undegraded":"2023-07-09T02:11:19.562080+0000","last_fullsized":"2023-07-09T02:11:19.562080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:41.155716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170433+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:11:19.170433+0000","last_peered":"2023-07-09T02:11:19.170433+0000","last_clean":"2023-07-09T02:11:19.170433+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:11:19.170433+0000","last_undegraded":"2023-07-09T02:11:19.170433+0000","last_fullsized":"2023-07-09T02:11:19.170433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:24.260899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561296+0000","last_change":"2023-07-09T02:11:18.188753+0000","last_active":"2023-07-09T02:11:19.561296+0000","last_peered":"2023-07-09T02:11:19.561296+0000","last_clean":"2023-07-09T02:11:19.561296+0000","last_became_active":"2023-07-09T02:11:18.188357+0000","last_became_peered":"2023-07-09T02:11:18.188357+0000","last_unstale":"2023-07-09T02:11:19.561296+0000","last_undegraded":"2023-07-09T02:11:19.561296+0000","last_fullsized":"2023-07-09T02:11:19.561296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:20.535098+0000","last_change":"2023-07-09T02:11:17.148129+0000","last_active":"2023-07-09T02:11:20.535098+0000","last_peered":"2023-07-09T02:11:20.535098+0000","last_clean":"2023-07-09T02:11:20.535098+0000","last_became_active":"2023-07-09T02:11:17.147351+0000","last_became_peered":"2023-07-09T02:11:17.147351+0000","last_unstale":"2023-07-09T02:11:20.535098+0000","last_undegraded":"2023-07-09T02:11:20.535098+0000","last_fullsized":"2023-07-09T02:11:20.535098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:23.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563351+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:11:19.563351+0000","last_peered":"2023-07-09T02:11:19.563351+0000","last_clean":"2023-07-09T02:11:19.563351+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:11:19.563351+0000","last_undegraded":"2023-07-09T02:11:19.563351+0000","last_fullsized":"2023-07-09T02:11:19.563351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:34:59.152910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564671+0000","last_change":"2023-07-09T02:11:18.186426+0000","last_active":"2023-07-09T02:11:19.564671+0000","last_peered":"2023-07-09T02:11:19.564671+0000","last_clean":"2023-07-09T02:11:19.564671+0000","last_became_active":"2023-07-09T02:11:18.185002+0000","last_became_peered":"2023-07-09T02:11:18.185002+0000","last_unstale":"2023-07-09T02:11:19.564671+0000","last_undegraded":"2023-07-09T02:11:19.564671+0000","last_fullsized":"2023-07-09T02:11:19.564671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:50.071215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564465+0000","last_change":"2023-07-09T02:11:18.183661+0000","last_active":"2023-07-09T02:11:19.564465+0000","last_peered":"2023-07-09T02:11:19.564465+0000","last_clean":"2023-07-09T02:11:19.564465+0000","last_became_active":"2023-07-09T02:11:18.179450+0000","last_became_peered":"2023-07-09T02:11:18.179450+0000","last_unstale":"2023-07-09T02:11:19.564465+0000","last_undegraded":"2023-07-09T02:11:19.564465+0000","last_fullsized":"2023-07-09T02:11:19.564465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:59.682786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564201+0000","last_change":"2023-07-09T02:11:17.148909+0000","last_active":"2023-07-09T02:11:19.564201+0000","last_peered":"2023-07-09T02:11:19.564201+0000","last_clean":"2023-07-09T02:11:19.564201+0000","last_became_active":"2023-07-09T02:11:17.148562+0000","last_became_peered":"2023-07-09T02:11:17.148562+0000","last_unstale":"2023-07-09T02:11:19.564201+0000","last_undegraded":"2023-07-09T02:11:19.564201+0000","last_fullsized":"2023-07-09T02:11:19.564201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:40.581950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170351+0000","last_change":"2023-07-09T02:11:18.178124+0000","last_active":"2023-07-09T02:11:19.170351+0000","last_peered":"2023-07-09T02:11:19.170351+0000","last_clean":"2023-07-09T02:11:19.170351+0000","last_became_active":"2023-07-09T02:11:18.177847+0000","last_became_peered":"2023-07-09T02:11:18.177847+0000","last_unstale":"2023-07-09T02:11:19.170351+0000","last_undegraded":"2023-07-09T02:11:19.170351+0000","last_fullsized":"2023-07-09T02:11:19.170351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563246+0000","last_change":"2023-07-09T02:11:17.151493+0000","last_active":"2023-07-09T02:11:19.563246+0000","last_peered":"2023-07-09T02:11:19.563246+0000","last_clean":"2023-07-09T02:11:19.563246+0000","last_became_active":"2023-07-09T02:11:17.151257+0000","last_became_peered":"2023-07-09T02:11:17.151257+0000","last_unstale":"2023-07-09T02:11:19.563246+0000","last_undegraded":"2023-07-09T02:11:19.563246+0000","last_fullsized":"2023-07-09T02:11:19.563246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172989+0000","last_change":"2023-07-09T02:11:17.149719+0000","last_active":"2023-07-09T02:11:19.172989+0000","last_peered":"2023-07-09T02:11:19.172989+0000","last_clean":"2023-07-09T02:11:19.172989+0000","last_became_active":"2023-07-09T02:11:17.149186+0000","last_became_peered":"2023-07-09T02:11:17.149186+0000","last_unstale":"2023-07-09T02:11:19.172989+0000","last_undegraded":"2023-07-09T02:11:19.172989+0000","last_fullsized":"2023-07-09T02:11:19.172989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561896+0000","last_change":"2023-07-09T02:11:18.186079+0000","last_active":"2023-07-09T02:11:19.561896+0000","last_peered":"2023-07-09T02:11:19.561896+0000","last_clean":"2023-07-09T02:11:19.561896+0000","last_became_active":"2023-07-09T02:11:18.185856+0000","last_became_peered":"2023-07-09T02:11:18.185856+0000","last_unstale":"2023-07-09T02:11:19.561896+0000","last_undegraded":"2023-07-09T02:11:19.561896+0000","last_fullsized":"2023-07-09T02:11:19.561896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171447+0000","last_change":"2023-07-09T02:11:17.146351+0000","last_active":"2023-07-09T02:11:19.171447+0000","last_peered":"2023-07-09T02:11:19.171447+0000","last_clean":"2023-07-09T02:11:19.171447+0000","last_became_active":"2023-07-09T02:11:17.145568+0000","last_became_peered":"2023-07-09T02:11:17.145568+0000","last_unstale":"2023-07-09T02:11:19.171447+0000","last_undegraded":"2023-07-09T02:11:19.171447+0000","last_fullsized":"2023-07-09T02:11:19.171447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:29.284573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561696+0000","last_change":"2023-07-09T02:11:18.183284+0000","last_active":"2023-07-09T02:11:19.561696+0000","last_peered":"2023-07-09T02:11:19.561696+0000","last_clean":"2023-07-09T02:11:19.561696+0000","last_became_active":"2023-07-09T02:11:18.183050+0000","last_became_peered":"2023-07-09T02:11:18.183050+0000","last_unstale":"2023-07-09T02:11:19.561696+0000","last_undegraded":"2023-07-09T02:11:19.561696+0000","last_fullsized":"2023-07-09T02:11:19.561696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563207+0000","last_change":"2023-07-09T02:11:18.183153+0000","last_active":"2023-07-09T02:11:19.563207+0000","last_peered":"2023-07-09T02:11:19.563207+0000","last_clean":"2023-07-09T02:11:19.563207+0000","last_became_active":"2023-07-09T02:11:18.182933+0000","last_became_peered":"2023-07-09T02:11:18.182933+0000","last_unstale":"2023-07-09T02:11:19.563207+0000","last_undegraded":"2023-07-09T02:11:19.563207+0000","last_fullsized":"2023-07-09T02:11:19.563207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:14:03.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561657+0000","last_change":"2023-07-09T02:11:17.146135+0000","last_active":"2023-07-09T02:11:19.561657+0000","last_peered":"2023-07-09T02:11:19.561657+0000","last_clean":"2023-07-09T02:11:19.561657+0000","last_became_active":"2023-07-09T02:11:17.145915+0000","last_became_peered":"2023-07-09T02:11:17.145915+0000","last_unstale":"2023-07-09T02:11:19.561657+0000","last_undegraded":"2023-07-09T02:11:19.561657+0000","last_fullsized":"2023-07-09T02:11:19.561657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:23.165834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170884+0000","last_change":"2023-07-09T02:11:18.180129+0000","last_active":"2023-07-09T02:11:19.170884+0000","last_peered":"2023-07-09T02:11:19.170884+0000","last_clean":"2023-07-09T02:11:19.170884+0000","last_became_active":"2023-07-09T02:11:18.179900+0000","last_became_peered":"2023-07-09T02:11:18.179900+0000","last_unstale":"2023-07-09T02:11:19.170884+0000","last_undegraded":"2023-07-09T02:11:19.170884+0000","last_fullsized":"2023-07-09T02:11:19.170884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:39:27.300272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170132+0000","last_change":"2023-07-09T02:11:17.149525+0000","last_active":"2023-07-09T02:11:19.170132+0000","last_peered":"2023-07-09T02:11:19.170132+0000","last_clean":"2023-07-09T02:11:19.170132+0000","last_became_active":"2023-07-09T02:11:17.148867+0000","last_became_peered":"2023-07-09T02:11:17.148867+0000","last_unstale":"2023-07-09T02:11:19.170132+0000","last_undegraded":"2023-07-09T02:11:19.170132+0000","last_fullsized":"2023-07-09T02:11:19.170132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:10.806976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561518+0000","last_change":"2023-07-09T02:11:18.175561+0000","last_active":"2023-07-09T02:11:19.561518+0000","last_peered":"2023-07-09T02:11:19.561518+0000","last_clean":"2023-07-09T02:11:19.561518+0000","last_became_active":"2023-07-09T02:11:18.175290+0000","last_became_peered":"2023-07-09T02:11:18.175290+0000","last_unstale":"2023-07-09T02:11:19.561518+0000","last_undegraded":"2023-07-09T02:11:19.561518+0000","last_fullsized":"2023-07-09T02:11:19.561518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:11.809877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564748+0000","last_change":"2023-07-09T02:11:17.147564+0000","last_active":"2023-07-09T02:11:19.564748+0000","last_peered":"2023-07-09T02:11:19.564748+0000","last_clean":"2023-07-09T02:11:19.564748+0000","last_became_active":"2023-07-09T02:11:17.147326+0000","last_became_peered":"2023-07-09T02:11:17.147326+0000","last_unstale":"2023-07-09T02:11:19.564748+0000","last_undegraded":"2023-07-09T02:11:19.564748+0000","last_fullsized":"2023-07-09T02:11:19.564748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:43.621949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562107+0000","last_change":"2023-07-09T02:11:18.171391+0000","last_active":"2023-07-09T02:11:19.562107+0000","last_peered":"2023-07-09T02:11:19.562107+0000","last_clean":"2023-07-09T02:11:19.562107+0000","last_became_active":"2023-07-09T02:11:18.171141+0000","last_became_peered":"2023-07-09T02:11:18.171141+0000","last_unstale":"2023-07-09T02:11:19.562107+0000","last_undegraded":"2023-07-09T02:11:19.562107+0000","last_fullsized":"2023-07-09T02:11:19.562107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:38:47.066683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171145+0000","last_change":"2023-07-09T02:11:17.140030+0000","last_active":"2023-07-09T02:11:19.171145+0000","last_peered":"2023-07-09T02:11:19.171145+0000","last_clean":"2023-07-09T02:11:19.171145+0000","last_became_active":"2023-07-09T02:11:17.139783+0000","last_became_peered":"2023-07-09T02:11:17.139783+0000","last_unstale":"2023-07-09T02:11:19.171145+0000","last_undegraded":"2023-07-09T02:11:19.171145+0000","last_fullsized":"2023-07-09T02:11:19.171145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:10.806976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564215+0000","last_change":"2023-07-09T02:11:18.175178+0000","last_active":"2023-07-09T02:11:19.564215+0000","last_peered":"2023-07-09T02:11:19.564215+0000","last_clean":"2023-07-09T02:11:19.564215+0000","last_became_active":"2023-07-09T02:11:18.174561+0000","last_became_peered":"2023-07-09T02:11:18.174561+0000","last_unstale":"2023-07-09T02:11:19.564215+0000","last_undegraded":"2023-07-09T02:11:19.564215+0000","last_fullsized":"2023-07-09T02:11:19.564215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172908+0000","last_change":"2023-07-09T02:11:17.144465+0000","last_active":"2023-07-09T02:11:19.172908+0000","last_peered":"2023-07-09T02:11:19.172908+0000","last_clean":"2023-07-09T02:11:19.172908+0000","last_became_active":"2023-07-09T02:11:17.144209+0000","last_became_peered":"2023-07-09T02:11:17.144209+0000","last_unstale":"2023-07-09T02:11:19.172908+0000","last_undegraded":"2023-07-09T02:11:19.172908+0000","last_fullsized":"2023-07-09T02:11:19.172908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:41.155716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564419+0000","last_change":"2023-07-09T02:11:18.186664+0000","last_active":"2023-07-09T02:11:19.564419+0000","last_peered":"2023-07-09T02:11:19.564419+0000","last_clean":"2023-07-09T02:11:19.564419+0000","last_became_active":"2023-07-09T02:11:18.185338+0000","last_became_peered":"2023-07-09T02:11:18.185338+0000","last_unstale":"2023-07-09T02:11:19.564419+0000","last_undegraded":"2023-07-09T02:11:19.564419+0000","last_fullsized":"2023-07-09T02:11:19.564419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172826+0000","last_change":"2023-07-09T02:11:17.150027+0000","last_active":"2023-07-09T02:11:19.172826+0000","last_peered":"2023-07-09T02:11:19.172826+0000","last_clean":"2023-07-09T02:11:19.172826+0000","last_became_active":"2023-07-09T02:11:17.145284+0000","last_became_peered":"2023-07-09T02:11:17.145284+0000","last_unstale":"2023-07-09T02:11:19.172826+0000","last_undegraded":"2023-07-09T02:11:19.172826+0000","last_fullsized":"2023-07-09T02:11:19.172826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561623+0000","last_change":"2023-07-09T02:11:18.177328+0000","last_active":"2023-07-09T02:11:19.561623+0000","last_peered":"2023-07-09T02:11:19.561623+0000","last_clean":"2023-07-09T02:11:19.561623+0000","last_became_active":"2023-07-09T02:11:18.176878+0000","last_became_peered":"2023-07-09T02:11:18.176878+0000","last_unstale":"2023-07-09T02:11:19.561623+0000","last_undegraded":"2023-07-09T02:11:19.561623+0000","last_fullsized":"2023-07-09T02:11:19.561623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561894+0000","last_change":"2023-07-09T02:11:17.147704+0000","last_active":"2023-07-09T02:11:19.561894+0000","last_peered":"2023-07-09T02:11:19.561894+0000","last_clean":"2023-07-09T02:11:19.561894+0000","last_became_active":"2023-07-09T02:11:17.147468+0000","last_became_peered":"2023-07-09T02:11:17.147468+0000","last_unstale":"2023-07-09T02:11:19.561894+0000","last_undegraded":"2023-07-09T02:11:19.561894+0000","last_fullsized":"2023-07-09T02:11:19.561894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564070+0000","last_change":"2023-07-09T02:11:18.184106+0000","last_active":"2023-07-09T02:11:19.564070+0000","last_peered":"2023-07-09T02:11:19.564070+0000","last_clean":"2023-07-09T02:11:19.564070+0000","last_became_active":"2023-07-09T02:11:18.182276+0000","last_became_peered":"2023-07-09T02:11:18.182276+0000","last_unstale":"2023-07-09T02:11:19.564070+0000","last_undegraded":"2023-07-09T02:11:19.564070+0000","last_fullsized":"2023-07-09T02:11:19.564070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:11.809877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171522+0000","last_change":"2023-07-09T02:11:17.147610+0000","last_active":"2023-07-09T02:11:19.171522+0000","last_peered":"2023-07-09T02:11:19.171522+0000","last_clean":"2023-07-09T02:11:19.171522+0000","last_became_active":"2023-07-09T02:11:17.144411+0000","last_became_peered":"2023-07-09T02:11:17.144411+0000","last_unstale":"2023-07-09T02:11:19.171522+0000","last_undegraded":"2023-07-09T02:11:19.171522+0000","last_fullsized":"2023-07-09T02:11:19.171522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:35.049738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194642,"statfs":{"total":200000000,"available":199313742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":92,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195219,"statfs":{"total":200000000,"available":199905238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":93,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195219,"statfs":{"total":200000000,"available":199904270,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905800,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314940,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]}],"pool_statfs":[]}} 2023-07-09T02:11:26.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:11:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf1ede640 1 Processor -- start 2023-07-09T02:11:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf1ede640 1 -- start start 2023-07-09T02:11:27.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf1ede640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec0d0200 0x7fbcec15fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf1ede640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcec099df0 0x7fbcec160000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf1ede640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec06bfe0 con 0x7fbcec160540 2023-07-09T02:11:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf1ede640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec06d5d0 con 0x7fbcec099df0 2023-07-09T02:11:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf1ede640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec06da60 con 0x7fbcec0d0200 2023-07-09T02:11:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcebfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcec099df0 0x7fbcec160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf16dd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbcec160540 0x7fbcec06a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48944/0 (socket says 172.21.15.45:48944) 2023-07-09T02:11:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf16dd640 1 -- 172.21.15.45:0/2664633276 learned_addr learned my addr 172.21.15.45:0/2664633276 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcf0edc640 1 --2- 172.21.15.45:0/2664633276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec0d0200 0x7fbcec15fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcebfff640 1 -- 172.21.15.45:0/2664633276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec0d0200 msgr2=0x7fbcec15fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:27.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcebfff640 1 --2- 172.21.15.45:0/2664633276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec0d0200 0x7fbcec15fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcebfff640 1 -- 172.21.15.45:0/2664633276 >> v1:172.21.15.45:6789/0 conn(0x7fbcec160540 legacy=0x7fbcec06a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbcebfff640 1 -- 172.21.15.45:0/2664633276 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec06c230 con 0x7fbcec099df0 2023-07-09T02:11:27.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.172+0000 7fbceb7fe640 1 -- 172.21.15.45:0/2664633276 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668936673 0 0) 0x7fbcec06bfe0 con 0x7fbcec160540 2023-07-09T02:11:27.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcebfff640 1 --2- 172.21.15.45:0/2664633276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec099df0 0x7fbcec160000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80097c0 tx=0x7fbcd801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a22768930c3ea2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbceb7fe640 1 -- 172.21.15.45:0/2664633276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80ab600 con 0x7fbcec099df0 2023-07-09T02:11:27.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbceb7fe640 1 -- 172.21.15.45:0/2664633276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd80a7050 con 0x7fbcec099df0 2023-07-09T02:11:27.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbceb7fe640 1 -- 172.21.15.45:0/2664633276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80ab980 con 0x7fbcec099df0 2023-07-09T02:11:27.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcf1ede640 1 -- 172.21.15.45:0/2664633276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec099df0 msgr2=0x7fbcec160000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/2664633276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec099df0 0x7fbcec160000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80097c0 tx=0x7fbcd801c330 comp rx=0 tx=0).stop 2023-07-09T02:11:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcf1ede640 1 -- 172.21.15.45:0/2664633276 shutdown_connections 2023-07-09T02:11:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/2664633276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec099df0 0x7fbcec160000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/2664633276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec0d0200 0x7fbcec15fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcf1ede640 1 -- 172.21.15.45:0/2664633276 >> 172.21.15.45:0/2664633276 conn(0x7fbcec0999f0 msgr2=0x7fbcec0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcf1ede640 1 -- 172.21.15.45:0/2664633276 shutdown_connections 2023-07-09T02:11:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.176+0000 7fbcf1ede640 1 -- 172.21.15.45:0/2664633276 wait complete. 2023-07-09T02:11:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 Processor -- start 2023-07-09T02:11:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 -- start start 2023-07-09T02:11:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec099df0 0x7fbcec0c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec0d0200 0x7fbcec1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcec160540 0x7fbcec0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec0b2800 con 0x7fbcec0d0200 2023-07-09T02:11:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec159e60 con 0x7fbcec160540 2023-07-09T02:11:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec0b2a10 con 0x7fbcec099df0 2023-07-09T02:11:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec0d0200 0x7fbcec1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec0d0200 0x7fbcec1518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46582/0 (socket says 172.21.15.45:46582) 2023-07-09T02:11:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 -- 172.21.15.45:0/3677172567 learned_addr learned my addr 172.21.15.45:0/3677172567 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf0edc640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec099df0 0x7fbcec0c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf16dd640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcec160540 0x7fbcec0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 -- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec099df0 msgr2=0x7fbcec0c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec099df0 0x7fbcec0c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 -- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcec160540 msgr2=0x7fbcec0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcec160540 0x7fbcec0c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 -- 172.21.15.45:0/3677172567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd8009420 con 0x7fbcec0d0200 2023-07-09T02:11:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf0edc640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec099df0 0x7fbcec0c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcebfff640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec0d0200 0x7fbcec1518e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80ae040 tx=0x7fbcd80190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbce97fa640 1 -- 172.21.15.45:0/3677172567 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80b4840 con 0x7fbcec0d0200 2023-07-09T02:11:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbce97fa640 1 -- 172.21.15.45:0/3677172567 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd80b49a0 con 0x7fbcec0d0200 2023-07-09T02:11:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbce97fa640 1 -- 172.21.15.45:0/3677172567 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80b4d50 con 0x7fbcec0d0200 2023-07-09T02:11:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec0b2cf0 con 0x7fbcec0d0200 2023-07-09T02:11:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.180+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec159af0 con 0x7fbcec0d0200 2023-07-09T02:11:27.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.184+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec159ff0 con 0x7fbcec0d0200 2023-07-09T02:11:27.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.184+0000 7fbce97fa640 1 -- 172.21.15.45:0/3677172567 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbcd80b2040 con 0x7fbcec0d0200 2023-07-09T02:11:27.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.184+0000 7fbce97fa640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbcd00662b0 0x7fbcd0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.184+0000 7fbce97fa640 1 -- 172.21.15.45:0/3677172567 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbcd811dfb0 con 0x7fbcec0d0200 2023-07-09T02:11:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.184+0000 7fbcf0edc640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbcd00662b0 0x7fbcd0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.184+0000 7fbcf0edc640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbcd00662b0 0x7fbcd0068760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009bb0 tx=0x7fbce0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.188+0000 7fbce97fa640 1 -- 172.21.15.45:0/3677172567 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbcd80eb3a0 con 0x7fbcec0d0200 2023-07-09T02:11:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.340+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbcec0d1290 con 0x7fbcd00662b0 2023-07-09T02:11:27.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.348+0000 7fbce97fa640 1 -- 172.21.15.45:0/3677172567 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280790 (secure 0 0 0) 0x7fbce0011a70 con 0x7fbcd00662b0 2023-07-09T02:11:27.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:27.367 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:11:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbcd00662b0 msgr2=0x7fbcd0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbcd00662b0 0x7fbcd0068760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009bb0 tx=0x7fbce0008040 comp rx=0 tx=0).stop 2023-07-09T02:11:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec0d0200 msgr2=0x7fbcec1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec0d0200 0x7fbcec1518e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80ae040 tx=0x7fbcd80190d0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 shutdown_connections 2023-07-09T02:11:27.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcec160540 0x7fbcec0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcec0d0200 0x7fbcec1518e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbcd00662b0 0x7fbcd0068760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 --2- 172.21.15.45:0/3677172567 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcec099df0 0x7fbcec0c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 >> 172.21.15.45:0/3677172567 conn(0x7fbcec0999f0 msgr2=0x7fbcec06b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 shutdown_connections 2023-07-09T02:11:27.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.352+0000 7fbcf1ede640 1 -- 172.21.15.45:0/3677172567 wait complete. 2023-07-09T02:11:27.375 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T02:11:26.528147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1892,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560607,"statfs":{"total":1600000000,"available":1598061660,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.359346"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562046+0000","last_change":"2023-07-09T02:11:18.173684+0000","last_active":"2023-07-09T02:11:19.562046+0000","last_peered":"2023-07-09T02:11:19.562046+0000","last_clean":"2023-07-09T02:11:19.562046+0000","last_became_active":"2023-07-09T02:11:18.173257+0000","last_became_peered":"2023-07-09T02:11:18.173257+0000","last_unstale":"2023-07-09T02:11:19.562046+0000","last_undegraded":"2023-07-09T02:11:19.562046+0000","last_fullsized":"2023-07-09T02:11:19.562046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:12:32.920112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172792+0000","last_change":"2023-07-09T02:11:18.184579+0000","last_active":"2023-07-09T02:11:19.172792+0000","last_peered":"2023-07-09T02:11:19.172792+0000","last_clean":"2023-07-09T02:11:19.172792+0000","last_became_active":"2023-07-09T02:11:18.183376+0000","last_became_peered":"2023-07-09T02:11:18.183376+0000","last_unstale":"2023-07-09T02:11:19.172792+0000","last_undegraded":"2023-07-09T02:11:19.172792+0000","last_fullsized":"2023-07-09T02:11:19.172792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564564+0000","last_change":"2023-07-09T02:11:18.185577+0000","last_active":"2023-07-09T02:11:19.564564+0000","last_peered":"2023-07-09T02:11:19.564564+0000","last_clean":"2023-07-09T02:11:19.564564+0000","last_became_active":"2023-07-09T02:11:18.178377+0000","last_became_peered":"2023-07-09T02:11:18.178377+0000","last_unstale":"2023-07-09T02:11:19.564564+0000","last_undegraded":"2023-07-09T02:11:19.564564+0000","last_fullsized":"2023-07-09T02:11:19.564564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:43.483055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563542+0000","last_change":"2023-07-09T02:11:18.181747+0000","last_active":"2023-07-09T02:11:19.563542+0000","last_peered":"2023-07-09T02:11:19.563542+0000","last_clean":"2023-07-09T02:11:19.563542+0000","last_became_active":"2023-07-09T02:11:18.181520+0000","last_became_peered":"2023-07-09T02:11:18.181520+0000","last_unstale":"2023-07-09T02:11:19.563542+0000","last_undegraded":"2023-07-09T02:11:19.563542+0000","last_fullsized":"2023-07-09T02:11:19.563542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:33:17.007038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171528+0000","last_change":"2023-07-09T02:11:18.177270+0000","last_active":"2023-07-09T02:11:19.171528+0000","last_peered":"2023-07-09T02:11:19.171528+0000","last_clean":"2023-07-09T02:11:19.171528+0000","last_became_active":"2023-07-09T02:11:18.177038+0000","last_became_peered":"2023-07-09T02:11:18.177038+0000","last_unstale":"2023-07-09T02:11:19.171528+0000","last_undegraded":"2023-07-09T02:11:19.171528+0000","last_fullsized":"2023-07-09T02:11:19.171528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564101+0000","last_change":"2023-07-09T02:11:18.173084+0000","last_active":"2023-07-09T02:11:19.564101+0000","last_peered":"2023-07-09T02:11:19.564101+0000","last_clean":"2023-07-09T02:11:19.564101+0000","last_became_active":"2023-07-09T02:11:18.172677+0000","last_became_peered":"2023-07-09T02:11:18.172677+0000","last_unstale":"2023-07-09T02:11:19.564101+0000","last_undegraded":"2023-07-09T02:11:19.564101+0000","last_fullsized":"2023-07-09T02:11:19.564101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563535+0000","last_change":"2023-07-09T02:11:18.185042+0000","last_active":"2023-07-09T02:11:19.563535+0000","last_peered":"2023-07-09T02:11:19.563535+0000","last_clean":"2023-07-09T02:11:19.563535+0000","last_became_active":"2023-07-09T02:11:18.184798+0000","last_became_peered":"2023-07-09T02:11:18.184798+0000","last_unstale":"2023-07-09T02:11:19.563535+0000","last_undegraded":"2023-07-09T02:11:19.563535+0000","last_fullsized":"2023-07-09T02:11:19.563535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:50.071215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172736+0000","last_change":"2023-07-09T02:11:18.186766+0000","last_active":"2023-07-09T02:11:19.172736+0000","last_peered":"2023-07-09T02:11:19.172736+0000","last_clean":"2023-07-09T02:11:19.172736+0000","last_became_active":"2023-07-09T02:11:18.186525+0000","last_became_peered":"2023-07-09T02:11:18.186525+0000","last_unstale":"2023-07-09T02:11:19.172736+0000","last_undegraded":"2023-07-09T02:11:19.172736+0000","last_fullsized":"2023-07-09T02:11:19.172736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170756+0000","last_change":"2023-07-09T02:11:18.177146+0000","last_active":"2023-07-09T02:11:19.170756+0000","last_peered":"2023-07-09T02:11:19.170756+0000","last_clean":"2023-07-09T02:11:19.170756+0000","last_became_active":"2023-07-09T02:11:18.176911+0000","last_became_peered":"2023-07-09T02:11:18.176911+0000","last_unstale":"2023-07-09T02:11:19.170756+0000","last_undegraded":"2023-07-09T02:11:19.170756+0000","last_fullsized":"2023-07-09T02:11:19.170756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:20.403700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172657+0000","last_change":"2023-07-09T02:11:18.174518+0000","last_active":"2023-07-09T02:11:19.172657+0000","last_peered":"2023-07-09T02:11:19.172657+0000","last_clean":"2023-07-09T02:11:19.172657+0000","last_became_active":"2023-07-09T02:11:18.174169+0000","last_became_peered":"2023-07-09T02:11:18.174169+0000","last_unstale":"2023-07-09T02:11:19.172657+0000","last_undegraded":"2023-07-09T02:11:19.172657+0000","last_fullsized":"2023-07-09T02:11:19.172657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564275+0000","last_change":"2023-07-09T02:11:18.181947+0000","last_active":"2023-07-09T02:11:19.564275+0000","last_peered":"2023-07-09T02:11:19.564275+0000","last_clean":"2023-07-09T02:11:19.564275+0000","last_became_active":"2023-07-09T02:11:18.181661+0000","last_became_peered":"2023-07-09T02:11:18.181661+0000","last_unstale":"2023-07-09T02:11:19.564275+0000","last_undegraded":"2023-07-09T02:11:19.564275+0000","last_fullsized":"2023-07-09T02:11:19.564275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561229+0000","last_change":"2023-07-09T02:11:18.169793+0000","last_active":"2023-07-09T02:11:19.561229+0000","last_peered":"2023-07-09T02:11:19.561229+0000","last_clean":"2023-07-09T02:11:19.561229+0000","last_became_active":"2023-07-09T02:11:18.169571+0000","last_became_peered":"2023-07-09T02:11:18.169571+0000","last_unstale":"2023-07-09T02:11:19.561229+0000","last_undegraded":"2023-07-09T02:11:19.561229+0000","last_fullsized":"2023-07-09T02:11:19.561229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:23.718200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561169+0000","last_change":"2023-07-09T02:11:18.176157+0000","last_active":"2023-07-09T02:11:19.561169+0000","last_peered":"2023-07-09T02:11:19.561169+0000","last_clean":"2023-07-09T02:11:19.561169+0000","last_became_active":"2023-07-09T02:11:18.175940+0000","last_became_peered":"2023-07-09T02:11:18.175940+0000","last_unstale":"2023-07-09T02:11:19.561169+0000","last_undegraded":"2023-07-09T02:11:19.561169+0000","last_fullsized":"2023-07-09T02:11:19.561169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:40.879812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172540+0000","last_change":"2023-07-09T02:11:18.180034+0000","last_active":"2023-07-09T02:11:19.172540+0000","last_peered":"2023-07-09T02:11:19.172540+0000","last_clean":"2023-07-09T02:11:19.172540+0000","last_became_active":"2023-07-09T02:11:18.179791+0000","last_became_peered":"2023-07-09T02:11:18.179791+0000","last_unstale":"2023-07-09T02:11:19.172540+0000","last_undegraded":"2023-07-09T02:11:19.172540+0000","last_fullsized":"2023-07-09T02:11:19.172540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563207+0000","last_change":"2023-07-09T02:11:18.181417+0000","last_active":"2023-07-09T02:11:19.563207+0000","last_peered":"2023-07-09T02:11:19.563207+0000","last_clean":"2023-07-09T02:11:19.563207+0000","last_became_active":"2023-07-09T02:11:18.181143+0000","last_became_peered":"2023-07-09T02:11:18.181143+0000","last_unstale":"2023-07-09T02:11:19.563207+0000","last_undegraded":"2023-07-09T02:11:19.563207+0000","last_fullsized":"2023-07-09T02:11:19.563207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564658+0000","last_change":"2023-07-09T02:11:18.173518+0000","last_active":"2023-07-09T02:11:19.564658+0000","last_peered":"2023-07-09T02:11:19.564658+0000","last_clean":"2023-07-09T02:11:19.564658+0000","last_became_active":"2023-07-09T02:11:18.173258+0000","last_became_peered":"2023-07-09T02:11:18.173258+0000","last_unstale":"2023-07-09T02:11:19.564658+0000","last_undegraded":"2023-07-09T02:11:19.564658+0000","last_fullsized":"2023-07-09T02:11:19.564658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:02.674569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170760+0000","last_change":"2023-07-09T02:11:18.177796+0000","last_active":"2023-07-09T02:11:19.170760+0000","last_peered":"2023-07-09T02:11:19.170760+0000","last_clean":"2023-07-09T02:11:19.170760+0000","last_became_active":"2023-07-09T02:11:18.177274+0000","last_became_peered":"2023-07-09T02:11:18.177274+0000","last_unstale":"2023-07-09T02:11:19.170760+0000","last_undegraded":"2023-07-09T02:11:19.170760+0000","last_fullsized":"2023-07-09T02:11:19.170760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:00:38.107933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564294+0000","last_change":"2023-07-09T02:11:18.185844+0000","last_active":"2023-07-09T02:11:19.564294+0000","last_peered":"2023-07-09T02:11:19.564294+0000","last_clean":"2023-07-09T02:11:19.564294+0000","last_became_active":"2023-07-09T02:11:18.182391+0000","last_became_peered":"2023-07-09T02:11:18.182391+0000","last_unstale":"2023-07-09T02:11:19.564294+0000","last_undegraded":"2023-07-09T02:11:19.564294+0000","last_fullsized":"2023-07-09T02:11:19.564294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561387+0000","last_change":"2023-07-09T02:11:18.179371+0000","last_active":"2023-07-09T02:11:19.561387+0000","last_peered":"2023-07-09T02:11:19.561387+0000","last_clean":"2023-07-09T02:11:19.561387+0000","last_became_active":"2023-07-09T02:11:18.179128+0000","last_became_peered":"2023-07-09T02:11:18.179128+0000","last_unstale":"2023-07-09T02:11:19.561387+0000","last_undegraded":"2023-07-09T02:11:19.561387+0000","last_fullsized":"2023-07-09T02:11:19.561387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:57:59.080342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563784+0000","last_change":"2023-07-09T02:11:18.184432+0000","last_active":"2023-07-09T02:11:19.563784+0000","last_peered":"2023-07-09T02:11:19.563784+0000","last_clean":"2023-07-09T02:11:19.563784+0000","last_became_active":"2023-07-09T02:11:18.183864+0000","last_became_peered":"2023-07-09T02:11:18.183864+0000","last_unstale":"2023-07-09T02:11:19.563784+0000","last_undegraded":"2023-07-09T02:11:19.563784+0000","last_fullsized":"2023-07-09T02:11:19.563784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564024+0000","last_change":"2023-07-09T02:11:18.188823+0000","last_active":"2023-07-09T02:11:19.564024+0000","last_peered":"2023-07-09T02:11:19.564024+0000","last_clean":"2023-07-09T02:11:19.564024+0000","last_became_active":"2023-07-09T02:11:18.188604+0000","last_became_peered":"2023-07-09T02:11:18.188604+0000","last_unstale":"2023-07-09T02:11:19.564024+0000","last_undegraded":"2023-07-09T02:11:19.564024+0000","last_fullsized":"2023-07-09T02:11:19.564024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:53:48.209148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170887+0000","last_change":"2023-07-09T02:11:18.175157+0000","last_active":"2023-07-09T02:11:19.170887+0000","last_peered":"2023-07-09T02:11:19.170887+0000","last_clean":"2023-07-09T02:11:19.170887+0000","last_became_active":"2023-07-09T02:11:18.174933+0000","last_became_peered":"2023-07-09T02:11:18.174933+0000","last_unstale":"2023-07-09T02:11:19.170887+0000","last_undegraded":"2023-07-09T02:11:19.170887+0000","last_fullsized":"2023-07-09T02:11:19.170887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561562+0000","last_change":"2023-07-09T02:11:18.176548+0000","last_active":"2023-07-09T02:11:19.561562+0000","last_peered":"2023-07-09T02:11:19.561562+0000","last_clean":"2023-07-09T02:11:19.561562+0000","last_became_active":"2023-07-09T02:11:18.176203+0000","last_became_peered":"2023-07-09T02:11:18.176203+0000","last_unstale":"2023-07-09T02:11:19.561562+0000","last_undegraded":"2023-07-09T02:11:19.561562+0000","last_fullsized":"2023-07-09T02:11:19.561562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563255+0000","last_change":"2023-07-09T02:11:18.191520+0000","last_active":"2023-07-09T02:11:19.563255+0000","last_peered":"2023-07-09T02:11:19.563255+0000","last_clean":"2023-07-09T02:11:19.563255+0000","last_became_active":"2023-07-09T02:11:18.191142+0000","last_became_peered":"2023-07-09T02:11:18.191142+0000","last_unstale":"2023-07-09T02:11:19.563255+0000","last_undegraded":"2023-07-09T02:11:19.563255+0000","last_fullsized":"2023-07-09T02:11:19.563255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:59.682786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170337+0000","last_change":"2023-07-09T02:11:18.178639+0000","last_active":"2023-07-09T02:11:19.170337+0000","last_peered":"2023-07-09T02:11:19.170337+0000","last_clean":"2023-07-09T02:11:19.170337+0000","last_became_active":"2023-07-09T02:11:18.177944+0000","last_became_peered":"2023-07-09T02:11:18.177944+0000","last_unstale":"2023-07-09T02:11:19.170337+0000","last_undegraded":"2023-07-09T02:11:19.170337+0000","last_fullsized":"2023-07-09T02:11:19.170337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170201+0000","last_change":"2023-07-09T02:11:18.177229+0000","last_active":"2023-07-09T02:11:19.170201+0000","last_peered":"2023-07-09T02:11:19.170201+0000","last_clean":"2023-07-09T02:11:19.170201+0000","last_became_active":"2023-07-09T02:11:18.174701+0000","last_became_peered":"2023-07-09T02:11:18.174701+0000","last_unstale":"2023-07-09T02:11:19.170201+0000","last_undegraded":"2023-07-09T02:11:19.170201+0000","last_fullsized":"2023-07-09T02:11:19.170201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:24.258695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172888+0000","last_change":"2023-07-09T02:11:18.184736+0000","last_active":"2023-07-09T02:11:19.172888+0000","last_peered":"2023-07-09T02:11:19.172888+0000","last_clean":"2023-07-09T02:11:19.172888+0000","last_became_active":"2023-07-09T02:11:18.183702+0000","last_became_peered":"2023-07-09T02:11:18.183702+0000","last_unstale":"2023-07-09T02:11:19.172888+0000","last_undegraded":"2023-07-09T02:11:19.172888+0000","last_fullsized":"2023-07-09T02:11:19.172888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170226+0000","last_change":"2023-07-09T02:11:18.179358+0000","last_active":"2023-07-09T02:11:19.170226+0000","last_peered":"2023-07-09T02:11:19.170226+0000","last_clean":"2023-07-09T02:11:19.170226+0000","last_became_active":"2023-07-09T02:11:18.179041+0000","last_became_peered":"2023-07-09T02:11:18.179041+0000","last_unstale":"2023-07-09T02:11:19.170226+0000","last_undegraded":"2023-07-09T02:11:19.170226+0000","last_fullsized":"2023-07-09T02:11:19.170226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561417+0000","last_change":"2023-07-09T02:11:18.188613+0000","last_active":"2023-07-09T02:11:19.561417+0000","last_peered":"2023-07-09T02:11:19.561417+0000","last_clean":"2023-07-09T02:11:19.561417+0000","last_became_active":"2023-07-09T02:11:18.188077+0000","last_became_peered":"2023-07-09T02:11:18.188077+0000","last_unstale":"2023-07-09T02:11:19.561417+0000","last_undegraded":"2023-07-09T02:11:19.561417+0000","last_fullsized":"2023-07-09T02:11:19.561417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563907+0000","last_change":"2023-07-09T02:11:18.184235+0000","last_active":"2023-07-09T02:11:19.563907+0000","last_peered":"2023-07-09T02:11:19.563907+0000","last_clean":"2023-07-09T02:11:19.563907+0000","last_became_active":"2023-07-09T02:11:18.183126+0000","last_became_peered":"2023-07-09T02:11:18.183126+0000","last_unstale":"2023-07-09T02:11:19.563907+0000","last_undegraded":"2023-07-09T02:11:19.563907+0000","last_fullsized":"2023-07-09T02:11:19.563907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561806+0000","last_change":"2023-07-09T02:11:18.183267+0000","last_active":"2023-07-09T02:11:19.561806+0000","last_peered":"2023-07-09T02:11:19.561806+0000","last_clean":"2023-07-09T02:11:19.561806+0000","last_became_active":"2023-07-09T02:11:18.182978+0000","last_became_peered":"2023-07-09T02:11:18.182978+0000","last_unstale":"2023-07-09T02:11:19.561806+0000","last_undegraded":"2023-07-09T02:11:19.561806+0000","last_fullsized":"2023-07-09T02:11:19.561806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563259+0000","last_change":"2023-07-09T02:11:18.178491+0000","last_active":"2023-07-09T02:11:19.563259+0000","last_peered":"2023-07-09T02:11:19.563259+0000","last_clean":"2023-07-09T02:11:19.563259+0000","last_became_active":"2023-07-09T02:11:18.178285+0000","last_became_peered":"2023-07-09T02:11:18.178285+0000","last_unstale":"2023-07-09T02:11:19.563259+0000","last_undegraded":"2023-07-09T02:11:19.563259+0000","last_fullsized":"2023-07-09T02:11:19.563259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:38:30.347354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561750+0000","last_change":"2023-07-09T02:11:18.177165+0000","last_active":"2023-07-09T02:11:19.561750+0000","last_peered":"2023-07-09T02:11:19.561750+0000","last_clean":"2023-07-09T02:11:19.561750+0000","last_became_active":"2023-07-09T02:11:18.176521+0000","last_became_peered":"2023-07-09T02:11:18.176521+0000","last_unstale":"2023-07-09T02:11:19.561750+0000","last_undegraded":"2023-07-09T02:11:19.561750+0000","last_fullsized":"2023-07-09T02:11:19.561750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563364+0000","last_change":"2023-07-09T02:11:17.152607+0000","last_active":"2023-07-09T02:11:19.563364+0000","last_peered":"2023-07-09T02:11:19.563364+0000","last_clean":"2023-07-09T02:11:19.563364+0000","last_became_active":"2023-07-09T02:11:17.152046+0000","last_became_peered":"2023-07-09T02:11:17.152046+0000","last_unstale":"2023-07-09T02:11:19.563364+0000","last_undegraded":"2023-07-09T02:11:19.563364+0000","last_fullsized":"2023-07-09T02:11:19.563364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:37.921896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172894+0000","last_change":"2023-07-09T02:11:18.182781+0000","last_active":"2023-07-09T02:11:19.172894+0000","last_peered":"2023-07-09T02:11:19.172894+0000","last_clean":"2023-07-09T02:11:19.172894+0000","last_became_active":"2023-07-09T02:11:18.182536+0000","last_became_peered":"2023-07-09T02:11:18.182536+0000","last_unstale":"2023-07-09T02:11:19.172894+0000","last_undegraded":"2023-07-09T02:11:19.172894+0000","last_fullsized":"2023-07-09T02:11:19.172894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:43.483055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171507+0000","last_change":"2023-07-09T02:11:17.146484+0000","last_active":"2023-07-09T02:11:19.171507+0000","last_peered":"2023-07-09T02:11:19.171507+0000","last_clean":"2023-07-09T02:11:19.171507+0000","last_became_active":"2023-07-09T02:11:17.146040+0000","last_became_peered":"2023-07-09T02:11:17.146040+0000","last_unstale":"2023-07-09T02:11:19.171507+0000","last_undegraded":"2023-07-09T02:11:19.171507+0000","last_fullsized":"2023-07-09T02:11:19.171507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:52.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171017+0000","last_change":"2023-07-09T02:11:18.177946+0000","last_active":"2023-07-09T02:11:19.171017+0000","last_peered":"2023-07-09T02:11:19.171017+0000","last_clean":"2023-07-09T02:11:19.171017+0000","last_became_active":"2023-07-09T02:11:18.177582+0000","last_became_peered":"2023-07-09T02:11:18.177582+0000","last_unstale":"2023-07-09T02:11:19.171017+0000","last_undegraded":"2023-07-09T02:11:19.171017+0000","last_fullsized":"2023-07-09T02:11:19.171017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563900+0000","last_change":"2023-07-09T02:11:17.154743+0000","last_active":"2023-07-09T02:11:19.563900+0000","last_peered":"2023-07-09T02:11:19.563900+0000","last_clean":"2023-07-09T02:11:19.563900+0000","last_became_active":"2023-07-09T02:11:17.154330+0000","last_became_peered":"2023-07-09T02:11:17.154330+0000","last_unstale":"2023-07-09T02:11:19.563900+0000","last_undegraded":"2023-07-09T02:11:19.563900+0000","last_fullsized":"2023-07-09T02:11:19.563900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:04.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561666+0000","last_change":"2023-07-09T02:11:18.184685+0000","last_active":"2023-07-09T02:11:19.561666+0000","last_peered":"2023-07-09T02:11:19.561666+0000","last_clean":"2023-07-09T02:11:19.561666+0000","last_became_active":"2023-07-09T02:11:18.184454+0000","last_became_peered":"2023-07-09T02:11:18.184454+0000","last_unstale":"2023-07-09T02:11:19.561666+0000","last_undegraded":"2023-07-09T02:11:19.561666+0000","last_fullsized":"2023-07-09T02:11:19.561666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563353+0000","last_change":"2023-07-09T02:11:17.152301+0000","last_active":"2023-07-09T02:11:19.563353+0000","last_peered":"2023-07-09T02:11:19.563353+0000","last_clean":"2023-07-09T02:11:19.563353+0000","last_became_active":"2023-07-09T02:11:17.151929+0000","last_became_peered":"2023-07-09T02:11:17.151929+0000","last_unstale":"2023-07-09T02:11:19.563353+0000","last_undegraded":"2023-07-09T02:11:19.563353+0000","last_fullsized":"2023-07-09T02:11:19.563353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:47:02.917368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563397+0000","last_change":"2023-07-09T02:11:17.153010+0000","last_active":"2023-07-09T02:11:19.563397+0000","last_peered":"2023-07-09T02:11:19.563397+0000","last_clean":"2023-07-09T02:11:19.563397+0000","last_became_active":"2023-07-09T02:11:17.152770+0000","last_became_peered":"2023-07-09T02:11:17.152770+0000","last_unstale":"2023-07-09T02:11:19.563397+0000","last_undegraded":"2023-07-09T02:11:19.563397+0000","last_fullsized":"2023-07-09T02:11:19.563397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172585+0000","last_change":"2023-07-09T02:11:18.180346+0000","last_active":"2023-07-09T02:11:19.172585+0000","last_peered":"2023-07-09T02:11:19.172585+0000","last_clean":"2023-07-09T02:11:19.172585+0000","last_became_active":"2023-07-09T02:11:18.180096+0000","last_became_peered":"2023-07-09T02:11:18.180096+0000","last_unstale":"2023-07-09T02:11:19.172585+0000","last_undegraded":"2023-07-09T02:11:19.172585+0000","last_fullsized":"2023-07-09T02:11:19.172585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563535+0000","last_change":"2023-07-09T02:11:17.152833+0000","last_active":"2023-07-09T02:11:19.563535+0000","last_peered":"2023-07-09T02:11:19.563535+0000","last_clean":"2023-07-09T02:11:19.563535+0000","last_became_active":"2023-07-09T02:11:17.152343+0000","last_became_peered":"2023-07-09T02:11:17.152343+0000","last_unstale":"2023-07-09T02:11:19.563535+0000","last_undegraded":"2023-07-09T02:11:19.563535+0000","last_fullsized":"2023-07-09T02:11:19.563535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564321+0000","last_change":"2023-07-09T02:11:18.177770+0000","last_active":"2023-07-09T02:11:19.564321+0000","last_peered":"2023-07-09T02:11:19.564321+0000","last_clean":"2023-07-09T02:11:19.564321+0000","last_became_active":"2023-07-09T02:11:18.177539+0000","last_became_peered":"2023-07-09T02:11:18.177539+0000","last_unstale":"2023-07-09T02:11:19.564321+0000","last_undegraded":"2023-07-09T02:11:19.564321+0000","last_fullsized":"2023-07-09T02:11:19.564321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564222+0000","last_change":"2023-07-09T02:11:17.150481+0000","last_active":"2023-07-09T02:11:19.564222+0000","last_peered":"2023-07-09T02:11:19.564222+0000","last_clean":"2023-07-09T02:11:19.564222+0000","last_became_active":"2023-07-09T02:11:17.149939+0000","last_became_peered":"2023-07-09T02:11:17.149939+0000","last_unstale":"2023-07-09T02:11:19.564222+0000","last_undegraded":"2023-07-09T02:11:19.564222+0000","last_fullsized":"2023-07-09T02:11:19.564222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:04:29.662449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563686+0000","last_change":"2023-07-09T02:11:18.184631+0000","last_active":"2023-07-09T02:11:19.563686+0000","last_peered":"2023-07-09T02:11:19.563686+0000","last_clean":"2023-07-09T02:11:19.563686+0000","last_became_active":"2023-07-09T02:11:18.184406+0000","last_became_peered":"2023-07-09T02:11:18.184406+0000","last_unstale":"2023-07-09T02:11:19.563686+0000","last_undegraded":"2023-07-09T02:11:19.563686+0000","last_fullsized":"2023-07-09T02:11:19.563686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:25:42.077683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173070+0000","last_change":"2023-07-09T02:11:17.149528+0000","last_active":"2023-07-09T02:11:19.173070+0000","last_peered":"2023-07-09T02:11:19.173070+0000","last_clean":"2023-07-09T02:11:19.173070+0000","last_became_active":"2023-07-09T02:11:17.148572+0000","last_became_peered":"2023-07-09T02:11:17.148572+0000","last_unstale":"2023-07-09T02:11:19.173070+0000","last_undegraded":"2023-07-09T02:11:19.173070+0000","last_fullsized":"2023-07-09T02:11:19.173070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:17.269625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171284+0000","last_change":"2023-07-09T02:11:18.175352+0000","last_active":"2023-07-09T02:11:19.171284+0000","last_peered":"2023-07-09T02:11:19.171284+0000","last_clean":"2023-07-09T02:11:19.171284+0000","last_became_active":"2023-07-09T02:11:18.175065+0000","last_became_peered":"2023-07-09T02:11:18.175065+0000","last_unstale":"2023-07-09T02:11:19.171284+0000","last_undegraded":"2023-07-09T02:11:19.171284+0000","last_fullsized":"2023-07-09T02:11:19.171284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561829+0000","last_change":"2023-07-09T02:11:17.151647+0000","last_active":"2023-07-09T02:11:19.561829+0000","last_peered":"2023-07-09T02:11:19.561829+0000","last_clean":"2023-07-09T02:11:19.561829+0000","last_became_active":"2023-07-09T02:11:17.151192+0000","last_became_peered":"2023-07-09T02:11:17.151192+0000","last_unstale":"2023-07-09T02:11:19.561829+0000","last_undegraded":"2023-07-09T02:11:19.561829+0000","last_fullsized":"2023-07-09T02:11:19.561829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564445+0000","last_change":"2023-07-09T02:11:18.175384+0000","last_active":"2023-07-09T02:11:19.564445+0000","last_peered":"2023-07-09T02:11:19.564445+0000","last_clean":"2023-07-09T02:11:19.564445+0000","last_became_active":"2023-07-09T02:11:18.174891+0000","last_became_peered":"2023-07-09T02:11:18.174891+0000","last_unstale":"2023-07-09T02:11:19.564445+0000","last_undegraded":"2023-07-09T02:11:19.564445+0000","last_fullsized":"2023-07-09T02:11:19.564445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:37.833784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564021+0000","last_change":"2023-07-09T02:11:17.153219+0000","last_active":"2023-07-09T02:11:19.564021+0000","last_peered":"2023-07-09T02:11:19.564021+0000","last_clean":"2023-07-09T02:11:19.564021+0000","last_became_active":"2023-07-09T02:11:17.152973+0000","last_became_peered":"2023-07-09T02:11:17.152973+0000","last_unstale":"2023-07-09T02:11:19.564021+0000","last_undegraded":"2023-07-09T02:11:19.564021+0000","last_fullsized":"2023-07-09T02:11:19.564021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:19.400799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564465+0000","last_change":"2023-07-09T02:11:18.175022+0000","last_active":"2023-07-09T02:11:19.564465+0000","last_peered":"2023-07-09T02:11:19.564465+0000","last_clean":"2023-07-09T02:11:19.564465+0000","last_became_active":"2023-07-09T02:11:18.174763+0000","last_became_peered":"2023-07-09T02:11:18.174763+0000","last_unstale":"2023-07-09T02:11:19.564465+0000","last_undegraded":"2023-07-09T02:11:19.564465+0000","last_fullsized":"2023-07-09T02:11:19.564465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564742+0000","last_change":"2023-07-09T02:11:17.151279+0000","last_active":"2023-07-09T02:11:19.564742+0000","last_peered":"2023-07-09T02:11:19.564742+0000","last_clean":"2023-07-09T02:11:19.564742+0000","last_became_active":"2023-07-09T02:11:17.149257+0000","last_became_peered":"2023-07-09T02:11:17.149257+0000","last_unstale":"2023-07-09T02:11:19.564742+0000","last_undegraded":"2023-07-09T02:11:19.564742+0000","last_fullsized":"2023-07-09T02:11:19.564742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:17.269625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564603+0000","last_change":"2023-07-09T02:11:18.183346+0000","last_active":"2023-07-09T02:11:19.564603+0000","last_peered":"2023-07-09T02:11:19.564603+0000","last_clean":"2023-07-09T02:11:19.564603+0000","last_became_active":"2023-07-09T02:11:18.179089+0000","last_became_peered":"2023-07-09T02:11:18.179089+0000","last_unstale":"2023-07-09T02:11:19.564603+0000","last_undegraded":"2023-07-09T02:11:19.564603+0000","last_fullsized":"2023-07-09T02:11:19.564603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:42.158617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561948+0000","last_change":"2023-07-09T02:11:17.140858+0000","last_active":"2023-07-09T02:11:19.561948+0000","last_peered":"2023-07-09T02:11:19.561948+0000","last_clean":"2023-07-09T02:11:19.561948+0000","last_became_active":"2023-07-09T02:11:17.140653+0000","last_became_peered":"2023-07-09T02:11:17.140653+0000","last_unstale":"2023-07-09T02:11:19.561948+0000","last_undegraded":"2023-07-09T02:11:19.561948+0000","last_fullsized":"2023-07-09T02:11:19.561948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170012+0000","last_change":"2023-07-09T02:11:18.182085+0000","last_active":"2023-07-09T02:11:19.170012+0000","last_peered":"2023-07-09T02:11:19.170012+0000","last_clean":"2023-07-09T02:11:19.170012+0000","last_became_active":"2023-07-09T02:11:18.181736+0000","last_became_peered":"2023-07-09T02:11:18.181736+0000","last_unstale":"2023-07-09T02:11:19.170012+0000","last_undegraded":"2023-07-09T02:11:19.170012+0000","last_fullsized":"2023-07-09T02:11:19.170012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:59.561437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563740+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:11:19.563740+0000","last_peered":"2023-07-09T02:11:19.563740+0000","last_clean":"2023-07-09T02:11:19.563740+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:11:19.563740+0000","last_undegraded":"2023-07-09T02:11:19.563740+0000","last_fullsized":"2023-07-09T02:11:19.563740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:34.571303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173020+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:11:19.173020+0000","last_peered":"2023-07-09T02:11:19.173020+0000","last_clean":"2023-07-09T02:11:19.173020+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:11:19.173020+0000","last_undegraded":"2023-07-09T02:11:19.173020+0000","last_fullsized":"2023-07-09T02:11:19.173020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:44.044640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562136+0000","last_change":"2023-07-09T02:11:17.149270+0000","last_active":"2023-07-09T02:11:19.562136+0000","last_peered":"2023-07-09T02:11:19.562136+0000","last_clean":"2023-07-09T02:11:19.562136+0000","last_became_active":"2023-07-09T02:11:17.148945+0000","last_became_peered":"2023-07-09T02:11:17.148945+0000","last_unstale":"2023-07-09T02:11:19.562136+0000","last_undegraded":"2023-07-09T02:11:19.562136+0000","last_fullsized":"2023-07-09T02:11:19.562136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563819+0000","last_change":"2023-07-09T02:11:18.179414+0000","last_active":"2023-07-09T02:11:19.563819+0000","last_peered":"2023-07-09T02:11:19.563819+0000","last_clean":"2023-07-09T02:11:19.563819+0000","last_became_active":"2023-07-09T02:11:18.179066+0000","last_became_peered":"2023-07-09T02:11:18.179066+0000","last_unstale":"2023-07-09T02:11:19.563819+0000","last_undegraded":"2023-07-09T02:11:19.563819+0000","last_fullsized":"2023-07-09T02:11:19.563819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:54:07.291526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563613+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:11:19.563613+0000","last_peered":"2023-07-09T02:11:19.563613+0000","last_clean":"2023-07-09T02:11:19.563613+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:11:19.563613+0000","last_undegraded":"2023-07-09T02:11:19.563613+0000","last_fullsized":"2023-07-09T02:11:19.563613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:12.245950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171634+0000","last_change":"2023-07-09T02:11:17.147946+0000","last_active":"2023-07-09T02:11:19.171634+0000","last_peered":"2023-07-09T02:11:19.171634+0000","last_clean":"2023-07-09T02:11:19.171634+0000","last_became_active":"2023-07-09T02:11:17.146310+0000","last_became_peered":"2023-07-09T02:11:17.146310+0000","last_unstale":"2023-07-09T02:11:19.171634+0000","last_undegraded":"2023-07-09T02:11:19.171634+0000","last_fullsized":"2023-07-09T02:11:19.171634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171398+0000","last_change":"2023-07-09T02:11:18.179015+0000","last_active":"2023-07-09T02:11:19.171398+0000","last_peered":"2023-07-09T02:11:19.171398+0000","last_clean":"2023-07-09T02:11:19.171398+0000","last_became_active":"2023-07-09T02:11:18.178737+0000","last_became_peered":"2023-07-09T02:11:18.178737+0000","last_unstale":"2023-07-09T02:11:19.171398+0000","last_undegraded":"2023-07-09T02:11:19.171398+0000","last_fullsized":"2023-07-09T02:11:19.171398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561247+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:11:19.561247+0000","last_peered":"2023-07-09T02:11:19.561247+0000","last_clean":"2023-07-09T02:11:19.561247+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:11:19.561247+0000","last_undegraded":"2023-07-09T02:11:19.561247+0000","last_fullsized":"2023-07-09T02:11:19.561247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:48:47.217353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171016+0000","last_change":"2023-07-09T02:11:17.149678+0000","last_active":"2023-07-09T02:11:19.171016+0000","last_peered":"2023-07-09T02:11:19.171016+0000","last_clean":"2023-07-09T02:11:19.171016+0000","last_became_active":"2023-07-09T02:11:17.149224+0000","last_became_peered":"2023-07-09T02:11:17.149224+0000","last_unstale":"2023-07-09T02:11:19.171016+0000","last_undegraded":"2023-07-09T02:11:19.171016+0000","last_fullsized":"2023-07-09T02:11:19.171016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:42.480154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170514+0000","last_change":"2023-07-09T02:11:18.173705+0000","last_active":"2023-07-09T02:11:19.170514+0000","last_peered":"2023-07-09T02:11:19.170514+0000","last_clean":"2023-07-09T02:11:19.170514+0000","last_became_active":"2023-07-09T02:11:18.173058+0000","last_became_peered":"2023-07-09T02:11:18.173058+0000","last_unstale":"2023-07-09T02:11:19.170514+0000","last_undegraded":"2023-07-09T02:11:19.170514+0000","last_fullsized":"2023-07-09T02:11:19.170514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:53.324252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.173114+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:11:19.173114+0000","last_peered":"2023-07-09T02:11:19.173114+0000","last_clean":"2023-07-09T02:11:19.173114+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:11:19.173114+0000","last_undegraded":"2023-07-09T02:11:19.173114+0000","last_fullsized":"2023-07-09T02:11:19.173114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:38.598275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564792+0000","last_change":"2023-07-09T02:11:17.152808+0000","last_active":"2023-07-09T02:11:19.564792+0000","last_peered":"2023-07-09T02:11:19.564792+0000","last_clean":"2023-07-09T02:11:19.564792+0000","last_became_active":"2023-07-09T02:11:17.152237+0000","last_became_peered":"2023-07-09T02:11:17.152237+0000","last_unstale":"2023-07-09T02:11:19.564792+0000","last_undegraded":"2023-07-09T02:11:19.564792+0000","last_fullsized":"2023-07-09T02:11:19.564792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:04.858386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170528+0000","last_change":"2023-07-09T02:11:18.177324+0000","last_active":"2023-07-09T02:11:19.170528+0000","last_peered":"2023-07-09T02:11:19.170528+0000","last_clean":"2023-07-09T02:11:19.170528+0000","last_became_active":"2023-07-09T02:11:18.177090+0000","last_became_peered":"2023-07-09T02:11:18.177090+0000","last_unstale":"2023-07-09T02:11:19.170528+0000","last_undegraded":"2023-07-09T02:11:19.170528+0000","last_fullsized":"2023-07-09T02:11:19.170528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172710+0000","last_change":"2023-07-09T02:11:17.145585+0000","last_active":"2023-07-09T02:11:19.172710+0000","last_peered":"2023-07-09T02:11:19.172710+0000","last_clean":"2023-07-09T02:11:19.172710+0000","last_became_active":"2023-07-09T02:11:17.145273+0000","last_became_peered":"2023-07-09T02:11:17.145273+0000","last_unstale":"2023-07-09T02:11:19.172710+0000","last_undegraded":"2023-07-09T02:11:19.172710+0000","last_fullsized":"2023-07-09T02:11:19.172710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:52.321351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170719+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:11:19.170719+0000","last_peered":"2023-07-09T02:11:19.170719+0000","last_clean":"2023-07-09T02:11:19.170719+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:11:19.170719+0000","last_undegraded":"2023-07-09T02:11:19.170719+0000","last_fullsized":"2023-07-09T02:11:19.170719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:53.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170901+0000","last_change":"2023-07-09T02:11:18.173842+0000","last_active":"2023-07-09T02:11:19.170901+0000","last_peered":"2023-07-09T02:11:19.170901+0000","last_clean":"2023-07-09T02:11:19.170901+0000","last_became_active":"2023-07-09T02:11:18.173468+0000","last_became_peered":"2023-07-09T02:11:18.173468+0000","last_unstale":"2023-07-09T02:11:19.170901+0000","last_undegraded":"2023-07-09T02:11:19.170901+0000","last_fullsized":"2023-07-09T02:11:19.170901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170652+0000","last_change":"2023-07-09T02:11:17.150542+0000","last_active":"2023-07-09T02:11:19.170652+0000","last_peered":"2023-07-09T02:11:19.170652+0000","last_clean":"2023-07-09T02:11:19.170652+0000","last_became_active":"2023-07-09T02:11:17.149674+0000","last_became_peered":"2023-07-09T02:11:17.149674+0000","last_unstale":"2023-07-09T02:11:19.170652+0000","last_undegraded":"2023-07-09T02:11:19.170652+0000","last_fullsized":"2023-07-09T02:11:19.170652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563487+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:11:19.563487+0000","last_peered":"2023-07-09T02:11:19.563487+0000","last_clean":"2023-07-09T02:11:19.563487+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:11:19.563487+0000","last_undegraded":"2023-07-09T02:11:19.563487+0000","last_fullsized":"2023-07-09T02:11:19.563487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:36.132042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171354+0000","last_change":"2023-07-09T02:11:18.172690+0000","last_active":"2023-07-09T02:11:19.171354+0000","last_peered":"2023-07-09T02:11:19.171354+0000","last_clean":"2023-07-09T02:11:19.171354+0000","last_became_active":"2023-07-09T02:11:18.172472+0000","last_became_peered":"2023-07-09T02:11:18.172472+0000","last_unstale":"2023-07-09T02:11:19.171354+0000","last_undegraded":"2023-07-09T02:11:19.171354+0000","last_fullsized":"2023-07-09T02:11:19.171354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562080+0000","last_change":"2023-07-09T02:11:17.147493+0000","last_active":"2023-07-09T02:11:19.562080+0000","last_peered":"2023-07-09T02:11:19.562080+0000","last_clean":"2023-07-09T02:11:19.562080+0000","last_became_active":"2023-07-09T02:11:17.147154+0000","last_became_peered":"2023-07-09T02:11:17.147154+0000","last_unstale":"2023-07-09T02:11:19.562080+0000","last_undegraded":"2023-07-09T02:11:19.562080+0000","last_fullsized":"2023-07-09T02:11:19.562080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:41.155716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170433+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:11:19.170433+0000","last_peered":"2023-07-09T02:11:19.170433+0000","last_clean":"2023-07-09T02:11:19.170433+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:11:19.170433+0000","last_undegraded":"2023-07-09T02:11:19.170433+0000","last_fullsized":"2023-07-09T02:11:19.170433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:24.260899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561296+0000","last_change":"2023-07-09T02:11:18.188753+0000","last_active":"2023-07-09T02:11:19.561296+0000","last_peered":"2023-07-09T02:11:19.561296+0000","last_clean":"2023-07-09T02:11:19.561296+0000","last_became_active":"2023-07-09T02:11:18.188357+0000","last_became_peered":"2023-07-09T02:11:18.188357+0000","last_unstale":"2023-07-09T02:11:19.561296+0000","last_undegraded":"2023-07-09T02:11:19.561296+0000","last_fullsized":"2023-07-09T02:11:19.561296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:46:28.772416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:20.535098+0000","last_change":"2023-07-09T02:11:17.148129+0000","last_active":"2023-07-09T02:11:20.535098+0000","last_peered":"2023-07-09T02:11:20.535098+0000","last_clean":"2023-07-09T02:11:20.535098+0000","last_became_active":"2023-07-09T02:11:17.147351+0000","last_became_peered":"2023-07-09T02:11:17.147351+0000","last_unstale":"2023-07-09T02:11:20.535098+0000","last_undegraded":"2023-07-09T02:11:20.535098+0000","last_fullsized":"2023-07-09T02:11:20.535098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:27:23.255794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563351+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:11:19.563351+0000","last_peered":"2023-07-09T02:11:19.563351+0000","last_clean":"2023-07-09T02:11:19.563351+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:11:19.563351+0000","last_undegraded":"2023-07-09T02:11:19.563351+0000","last_fullsized":"2023-07-09T02:11:19.563351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:34:59.152910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564671+0000","last_change":"2023-07-09T02:11:18.186426+0000","last_active":"2023-07-09T02:11:19.564671+0000","last_peered":"2023-07-09T02:11:19.564671+0000","last_clean":"2023-07-09T02:11:19.564671+0000","last_became_active":"2023-07-09T02:11:18.185002+0000","last_became_peered":"2023-07-09T02:11:18.185002+0000","last_unstale":"2023-07-09T02:11:19.564671+0000","last_undegraded":"2023-07-09T02:11:19.564671+0000","last_fullsized":"2023-07-09T02:11:19.564671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:16:50.071215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564465+0000","last_change":"2023-07-09T02:11:18.183661+0000","last_active":"2023-07-09T02:11:19.564465+0000","last_peered":"2023-07-09T02:11:19.564465+0000","last_clean":"2023-07-09T02:11:19.564465+0000","last_became_active":"2023-07-09T02:11:18.179450+0000","last_became_peered":"2023-07-09T02:11:18.179450+0000","last_unstale":"2023-07-09T02:11:19.564465+0000","last_undegraded":"2023-07-09T02:11:19.564465+0000","last_fullsized":"2023-07-09T02:11:19.564465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:59.682786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564201+0000","last_change":"2023-07-09T02:11:17.148909+0000","last_active":"2023-07-09T02:11:19.564201+0000","last_peered":"2023-07-09T02:11:19.564201+0000","last_clean":"2023-07-09T02:11:19.564201+0000","last_became_active":"2023-07-09T02:11:17.148562+0000","last_became_peered":"2023-07-09T02:11:17.148562+0000","last_unstale":"2023-07-09T02:11:19.564201+0000","last_undegraded":"2023-07-09T02:11:19.564201+0000","last_fullsized":"2023-07-09T02:11:19.564201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:40.581950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170351+0000","last_change":"2023-07-09T02:11:18.178124+0000","last_active":"2023-07-09T02:11:19.170351+0000","last_peered":"2023-07-09T02:11:19.170351+0000","last_clean":"2023-07-09T02:11:19.170351+0000","last_became_active":"2023-07-09T02:11:18.177847+0000","last_became_peered":"2023-07-09T02:11:18.177847+0000","last_unstale":"2023-07-09T02:11:19.170351+0000","last_undegraded":"2023-07-09T02:11:19.170351+0000","last_fullsized":"2023-07-09T02:11:19.170351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:32.156562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563246+0000","last_change":"2023-07-09T02:11:17.151493+0000","last_active":"2023-07-09T02:11:19.563246+0000","last_peered":"2023-07-09T02:11:19.563246+0000","last_clean":"2023-07-09T02:11:19.563246+0000","last_became_active":"2023-07-09T02:11:17.151257+0000","last_became_peered":"2023-07-09T02:11:17.151257+0000","last_unstale":"2023-07-09T02:11:19.563246+0000","last_undegraded":"2023-07-09T02:11:19.563246+0000","last_fullsized":"2023-07-09T02:11:19.563246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:36.830883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172989+0000","last_change":"2023-07-09T02:11:17.149719+0000","last_active":"2023-07-09T02:11:19.172989+0000","last_peered":"2023-07-09T02:11:19.172989+0000","last_clean":"2023-07-09T02:11:19.172989+0000","last_became_active":"2023-07-09T02:11:17.149186+0000","last_became_peered":"2023-07-09T02:11:17.149186+0000","last_unstale":"2023-07-09T02:11:19.172989+0000","last_undegraded":"2023-07-09T02:11:19.172989+0000","last_fullsized":"2023-07-09T02:11:19.172989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:01.671668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561896+0000","last_change":"2023-07-09T02:11:18.186079+0000","last_active":"2023-07-09T02:11:19.561896+0000","last_peered":"2023-07-09T02:11:19.561896+0000","last_clean":"2023-07-09T02:11:19.561896+0000","last_became_active":"2023-07-09T02:11:18.185856+0000","last_became_peered":"2023-07-09T02:11:18.185856+0000","last_unstale":"2023-07-09T02:11:19.561896+0000","last_undegraded":"2023-07-09T02:11:19.561896+0000","last_fullsized":"2023-07-09T02:11:19.561896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:38.924797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171447+0000","last_change":"2023-07-09T02:11:17.146351+0000","last_active":"2023-07-09T02:11:19.171447+0000","last_peered":"2023-07-09T02:11:19.171447+0000","last_clean":"2023-07-09T02:11:19.171447+0000","last_became_active":"2023-07-09T02:11:17.145568+0000","last_became_peered":"2023-07-09T02:11:17.145568+0000","last_unstale":"2023-07-09T02:11:19.171447+0000","last_undegraded":"2023-07-09T02:11:19.171447+0000","last_fullsized":"2023-07-09T02:11:19.171447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:29.284573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561696+0000","last_change":"2023-07-09T02:11:18.183284+0000","last_active":"2023-07-09T02:11:19.561696+0000","last_peered":"2023-07-09T02:11:19.561696+0000","last_clean":"2023-07-09T02:11:19.561696+0000","last_became_active":"2023-07-09T02:11:18.183050+0000","last_became_peered":"2023-07-09T02:11:18.183050+0000","last_unstale":"2023-07-09T02:11:19.561696+0000","last_undegraded":"2023-07-09T02:11:19.561696+0000","last_fullsized":"2023-07-09T02:11:19.561696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:30.287474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.563207+0000","last_change":"2023-07-09T02:11:18.183153+0000","last_active":"2023-07-09T02:11:19.563207+0000","last_peered":"2023-07-09T02:11:19.563207+0000","last_clean":"2023-07-09T02:11:19.563207+0000","last_became_active":"2023-07-09T02:11:18.182933+0000","last_became_peered":"2023-07-09T02:11:18.182933+0000","last_unstale":"2023-07-09T02:11:19.563207+0000","last_undegraded":"2023-07-09T02:11:19.563207+0000","last_fullsized":"2023-07-09T02:11:19.563207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:14:03.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561657+0000","last_change":"2023-07-09T02:11:17.146135+0000","last_active":"2023-07-09T02:11:19.561657+0000","last_peered":"2023-07-09T02:11:19.561657+0000","last_clean":"2023-07-09T02:11:19.561657+0000","last_became_active":"2023-07-09T02:11:17.145915+0000","last_became_peered":"2023-07-09T02:11:17.145915+0000","last_unstale":"2023-07-09T02:11:19.561657+0000","last_undegraded":"2023-07-09T02:11:19.561657+0000","last_fullsized":"2023-07-09T02:11:19.561657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:23.165834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170884+0000","last_change":"2023-07-09T02:11:18.180129+0000","last_active":"2023-07-09T02:11:19.170884+0000","last_peered":"2023-07-09T02:11:19.170884+0000","last_clean":"2023-07-09T02:11:19.170884+0000","last_became_active":"2023-07-09T02:11:18.179900+0000","last_became_peered":"2023-07-09T02:11:18.179900+0000","last_unstale":"2023-07-09T02:11:19.170884+0000","last_undegraded":"2023-07-09T02:11:19.170884+0000","last_fullsized":"2023-07-09T02:11:19.170884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:39:27.300272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.170132+0000","last_change":"2023-07-09T02:11:17.149525+0000","last_active":"2023-07-09T02:11:19.170132+0000","last_peered":"2023-07-09T02:11:19.170132+0000","last_clean":"2023-07-09T02:11:19.170132+0000","last_became_active":"2023-07-09T02:11:17.148867+0000","last_became_peered":"2023-07-09T02:11:17.148867+0000","last_unstale":"2023-07-09T02:11:19.170132+0000","last_undegraded":"2023-07-09T02:11:19.170132+0000","last_fullsized":"2023-07-09T02:11:19.170132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:10.806976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561518+0000","last_change":"2023-07-09T02:11:18.175561+0000","last_active":"2023-07-09T02:11:19.561518+0000","last_peered":"2023-07-09T02:11:19.561518+0000","last_clean":"2023-07-09T02:11:19.561518+0000","last_became_active":"2023-07-09T02:11:18.175290+0000","last_became_peered":"2023-07-09T02:11:18.175290+0000","last_unstale":"2023-07-09T02:11:19.561518+0000","last_undegraded":"2023-07-09T02:11:19.561518+0000","last_fullsized":"2023-07-09T02:11:19.561518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:11.809877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564748+0000","last_change":"2023-07-09T02:11:17.147564+0000","last_active":"2023-07-09T02:11:19.564748+0000","last_peered":"2023-07-09T02:11:19.564748+0000","last_clean":"2023-07-09T02:11:19.564748+0000","last_became_active":"2023-07-09T02:11:17.147326+0000","last_became_peered":"2023-07-09T02:11:17.147326+0000","last_unstale":"2023-07-09T02:11:19.564748+0000","last_undegraded":"2023-07-09T02:11:19.564748+0000","last_fullsized":"2023-07-09T02:11:19.564748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:43.621949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.562107+0000","last_change":"2023-07-09T02:11:18.171391+0000","last_active":"2023-07-09T02:11:19.562107+0000","last_peered":"2023-07-09T02:11:19.562107+0000","last_clean":"2023-07-09T02:11:19.562107+0000","last_became_active":"2023-07-09T02:11:18.171141+0000","last_became_peered":"2023-07-09T02:11:18.171141+0000","last_unstale":"2023-07-09T02:11:19.562107+0000","last_undegraded":"2023-07-09T02:11:19.562107+0000","last_fullsized":"2023-07-09T02:11:19.562107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:38:47.066683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171145+0000","last_change":"2023-07-09T02:11:17.140030+0000","last_active":"2023-07-09T02:11:19.171145+0000","last_peered":"2023-07-09T02:11:19.171145+0000","last_clean":"2023-07-09T02:11:19.171145+0000","last_became_active":"2023-07-09T02:11:17.139783+0000","last_became_peered":"2023-07-09T02:11:17.139783+0000","last_unstale":"2023-07-09T02:11:19.171145+0000","last_undegraded":"2023-07-09T02:11:19.171145+0000","last_fullsized":"2023-07-09T02:11:19.171145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:10.806976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564215+0000","last_change":"2023-07-09T02:11:18.175178+0000","last_active":"2023-07-09T02:11:19.564215+0000","last_peered":"2023-07-09T02:11:19.564215+0000","last_clean":"2023-07-09T02:11:19.564215+0000","last_became_active":"2023-07-09T02:11:18.174561+0000","last_became_peered":"2023-07-09T02:11:18.174561+0000","last_unstale":"2023-07-09T02:11:19.564215+0000","last_undegraded":"2023-07-09T02:11:19.564215+0000","last_fullsized":"2023-07-09T02:11:19.564215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:24.168735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172908+0000","last_change":"2023-07-09T02:11:17.144465+0000","last_active":"2023-07-09T02:11:19.172908+0000","last_peered":"2023-07-09T02:11:19.172908+0000","last_clean":"2023-07-09T02:11:19.172908+0000","last_became_active":"2023-07-09T02:11:17.144209+0000","last_became_peered":"2023-07-09T02:11:17.144209+0000","last_unstale":"2023-07-09T02:11:19.172908+0000","last_undegraded":"2023-07-09T02:11:19.172908+0000","last_fullsized":"2023-07-09T02:11:19.172908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:41.155716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564419+0000","last_change":"2023-07-09T02:11:18.186664+0000","last_active":"2023-07-09T02:11:19.564419+0000","last_peered":"2023-07-09T02:11:19.564419+0000","last_clean":"2023-07-09T02:11:19.564419+0000","last_became_active":"2023-07-09T02:11:18.185338+0000","last_became_peered":"2023-07-09T02:11:18.185338+0000","last_unstale":"2023-07-09T02:11:19.564419+0000","last_undegraded":"2023-07-09T02:11:19.564419+0000","last_fullsized":"2023-07-09T02:11:19.564419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:36.052639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.172826+0000","last_change":"2023-07-09T02:11:17.150027+0000","last_active":"2023-07-09T02:11:19.172826+0000","last_peered":"2023-07-09T02:11:19.172826+0000","last_clean":"2023-07-09T02:11:19.172826+0000","last_became_active":"2023-07-09T02:11:17.145284+0000","last_became_peered":"2023-07-09T02:11:17.145284+0000","last_unstale":"2023-07-09T02:11:19.172826+0000","last_undegraded":"2023-07-09T02:11:19.172826+0000","last_fullsized":"2023-07-09T02:11:19.172826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561623+0000","last_change":"2023-07-09T02:11:18.177328+0000","last_active":"2023-07-09T02:11:19.561623+0000","last_peered":"2023-07-09T02:11:19.561623+0000","last_clean":"2023-07-09T02:11:19.561623+0000","last_became_active":"2023-07-09T02:11:18.176878+0000","last_became_peered":"2023-07-09T02:11:18.176878+0000","last_unstale":"2023-07-09T02:11:19.561623+0000","last_undegraded":"2023-07-09T02:11:19.561623+0000","last_fullsized":"2023-07-09T02:11:19.561623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:41.584851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.561894+0000","last_change":"2023-07-09T02:11:17.147704+0000","last_active":"2023-07-09T02:11:19.561894+0000","last_peered":"2023-07-09T02:11:19.561894+0000","last_clean":"2023-07-09T02:11:19.561894+0000","last_became_active":"2023-07-09T02:11:17.147468+0000","last_became_peered":"2023-07-09T02:11:17.147468+0000","last_unstale":"2023-07-09T02:11:19.561894+0000","last_undegraded":"2023-07-09T02:11:19.561894+0000","last_fullsized":"2023-07-09T02:11:19.561894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:58.679885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.564070+0000","last_change":"2023-07-09T02:11:18.184106+0000","last_active":"2023-07-09T02:11:19.564070+0000","last_peered":"2023-07-09T02:11:19.564070+0000","last_clean":"2023-07-09T02:11:19.564070+0000","last_became_active":"2023-07-09T02:11:18.182276+0000","last_became_peered":"2023-07-09T02:11:18.182276+0000","last_unstale":"2023-07-09T02:11:19.564070+0000","last_undegraded":"2023-07-09T02:11:19.564070+0000","last_fullsized":"2023-07-09T02:11:19.564070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:17.130040+0000","last_clean_scrub_stamp":"2023-07-09T02:11:17.130040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:11.809877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-09T02:11:19.171522+0000","last_change":"2023-07-09T02:11:17.147610+0000","last_active":"2023-07-09T02:11:19.171522+0000","last_peered":"2023-07-09T02:11:19.171522+0000","last_clean":"2023-07-09T02:11:19.171522+0000","last_became_active":"2023-07-09T02:11:17.144411+0000","last_became_peered":"2023-07-09T02:11:17.144411+0000","last_unstale":"2023-07-09T02:11:19.171522+0000","last_undegraded":"2023-07-09T02:11:19.171522+0000","last_fullsized":"2023-07-09T02:11:19.171522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:16.127139+0000","last_clean_scrub_stamp":"2023-07-09T02:11:16.127139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:35.049738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":670,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194642,"statfs":{"total":200000000,"available":199313742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":92,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195219,"statfs":{"total":200000000,"available":199905238,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":93,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195219,"statfs":{"total":200000000,"available":199904270,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905800,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":91,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195220,"statfs":{"total":200000000,"available":199905890,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194643,"statfs":{"total":200000000,"available":199314940,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]}],"pool_statfs":[]}} 2023-07-09T02:11:27.382 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-09T02:11:27.383 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-09T02:11:27.383 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-09T02:11:27.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-09T02:11:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb328b2c640 1 Processor -- start 2023-07-09T02:11:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb328b2c640 1 -- start start 2023-07-09T02:11:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb328b2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b4c40 0x7fb3240b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb328b2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240cd1a0 con 0x7fb3240b1f20 2023-07-09T02:11:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb328b2c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240b22f0 con 0x7fb3240d2560 2023-07-09T02:11:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb328b2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb324160a70 con 0x7fb3240b4c40 2023-07-09T02:11:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb32259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb3240b1f20 0x7fb3240b4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48956/0 (socket says 172.21.15.45:48956) 2023-07-09T02:11:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb32259c640 1 -- 172.21.15.45:0/3288182831 learned_addr learned my addr 172.21.15.45:0/3288182831 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb31bfff640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b4c40 0x7fb3240b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937208931 0 0) 0x7fb3240cd1a0 con 0x7fb3240b1f20 2023-07-09T02:11:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.564+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb310003530 con 0x7fb3240b1f20 2023-07-09T02:11:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937630768 0 0) 0x7fb3240b22f0 con 0x7fb3240d2560 2023-07-09T02:11:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3240cd1a0 con 0x7fb3240d2560 2023-07-09T02:11:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3820990095 0 0) 0x7fb310003530 con 0x7fb3240b1f20 2023-07-09T02:11:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b4c40 msgr2=0x7fb3240b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b4c40 0x7fb3240b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 >> v1:172.21.15.155:6789/0 conn(0x7fb3240d2560 legacy=0x7fb3240d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240cd440 con 0x7fb3240b1f20 2023-07-09T02:11:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fb314001680 con 0x7fb3240b1f20 2023-07-09T02:11:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 >> v1:172.21.15.45:6789/0 conn(0x7fb3240b1f20 legacy=0x7fb3240b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb310003b40 0x7fb310003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3100047d0 0x7fb310004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b4c40 0x7fb310005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324160a70 con 0x7fb310003b40 2023-07-09T02:11:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31000ba40 con 0x7fb3100047d0 2023-07-09T02:11:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31000bbb0 con 0x7fb3240b4c40 2023-07-09T02:11:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb32259c640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb310003b40 0x7fb310003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb31bfff640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3100047d0 0x7fb310004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb322d9d640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b4c40 0x7fb310005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb32259c640 1 -- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b4c40 msgr2=0x7fb310005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb32259c640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240b4c40 0x7fb310005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb32259c640 1 -- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3100047d0 msgr2=0x7fb310004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb32259c640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3100047d0 0x7fb310004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb32259c640 1 -- 172.21.15.45:0/3288182831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310003530 con 0x7fb310003b40 2023-07-09T02:11:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb32259c640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb310003b40 0x7fb310003f30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c160 tx=0x7fb31401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1500fb1b9302778 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.568+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140058e0 con 0x7fb310003b40 2023-07-09T02:11:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314005a40 con 0x7fb310003b40 2023-07-09T02:11:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb321d9b640 1 -- 172.21.15.45:0/3288182831 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314005df0 con 0x7fb310003b40 2023-07-09T02:11:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- 172.21.15.45:0/3288182831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb310003b40 msgr2=0x7fb310003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 --2- 172.21.15.45:0/3288182831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb310003b40 0x7fb310003f30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c160 tx=0x7fb31401cbc0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb322d9d640 1 -- 172.21.15.45:0/3288182831 reap_dead start 2023-07-09T02:11:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- 172.21.15.45:0/3288182831 shutdown_connections 2023-07-09T02:11:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- 172.21.15.45:0/3288182831 >> 172.21.15.45:0/3288182831 conn(0x7fb32406a510 msgr2=0x7fb3240cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- 172.21.15.45:0/3288182831 shutdown_connections 2023-07-09T02:11:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- 172.21.15.45:0/3288182831 wait complete. 2023-07-09T02:11:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 Processor -- start 2023-07-09T02:11:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- start start 2023-07-09T02:11:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb310003b40 0x7fb32415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240cbc50 0x7fb324158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32415e210 0x7fb3240b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415d170 con 0x7fb32415e210 2023-07-09T02:11:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415d450 con 0x7fb310003b40 2023-07-09T02:11:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb328b2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415d730 con 0x7fb3240cbc50 2023-07-09T02:11:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb322d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32415e210 0x7fb3240b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb322d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32415e210 0x7fb3240b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46608/0 (socket says 172.21.15.45:46608) 2023-07-09T02:11:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb322d9d640 1 -- 172.21.15.45:0/1396558716 learned_addr learned my addr 172.21.15.45:0/1396558716 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb31bfff640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240cbc50 0x7fb324158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.572+0000 7fb32259c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb310003b40 0x7fb32415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb322d9d640 1 -- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240cbc50 msgr2=0x7fb324158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb322d9d640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240cbc50 0x7fb324158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb322d9d640 1 -- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb310003b40 msgr2=0x7fb32415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb322d9d640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb310003b40 0x7fb32415c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb322d9d640 1 -- 172.21.15.45:0/1396558716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32415da10 con 0x7fb32415e210 2023-07-09T02:11:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb322d9d640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32415e210 0x7fb3240b3690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0059b0 tx=0x7fb31c012800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb31affd640 1 -- 172.21.15.45:0/1396558716 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0153e0 con 0x7fb32415e210 2023-07-09T02:11:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb31affd640 1 -- 172.21.15.45:0/1396558716 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c015540 con 0x7fb32415e210 2023-07-09T02:11:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb31affd640 1 -- 172.21.15.45:0/1396558716 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0158b0 con 0x7fb32415e210 2023-07-09T02:11:27.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32415dcf0 con 0x7fb32415e210 2023-07-09T02:11:27.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb324158660 con 0x7fb32415e210 2023-07-09T02:11:27.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32415dee0 con 0x7fb32415e210 2023-07-09T02:11:27.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb31affd640 1 -- 172.21.15.45:0/1396558716 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb31c015a10 con 0x7fb32415e210 2023-07-09T02:11:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb31affd640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3040662b0 0x7fb304068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.576+0000 7fb31affd640 1 -- 172.21.15.45:0/1396558716 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb31c0860a0 con 0x7fb32415e210 2023-07-09T02:11:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.580+0000 7fb32259c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3040662b0 0x7fb304068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.580+0000 7fb32259c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3040662b0 0x7fb304068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3140aa000 tx=0x7fb314001a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.580+0000 7fb31affd640 1 -- 172.21.15.45:0/1396558716 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb31c053530 con 0x7fb32415e210 2023-07-09T02:11:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb3240d03d0 con 0x7fb32415e210 2023-07-09T02:11:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb31affd640 1 -- 172.21.15.45:0/1396558716 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb31c01c080 con 0x7fb32415e210 2023-07-09T02:11:27.775 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:27.775 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-09T02:11:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3040662b0 msgr2=0x7fb304068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3040662b0 0x7fb304068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3140aa000 tx=0x7fb314001a00 comp rx=0 tx=0).stop 2023-07-09T02:11:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32415e210 msgr2=0x7fb3240b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32415e210 0x7fb3240b3690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0059b0 tx=0x7fb31c012800 comp rx=0 tx=0).stop 2023-07-09T02:11:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 shutdown_connections 2023-07-09T02:11:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32415e210 0x7fb3240b3690 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3040662b0 0x7fb304068760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3240cbc50 0x7fb324158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 --2- 172.21.15.45:0/1396558716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb310003b40 0x7fb32415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 >> 172.21.15.45:0/1396558716 conn(0x7fb32406a510 msgr2=0x7fb32415ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 shutdown_connections 2023-07-09T02:11:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.772+0000 7fb328b2c640 1 -- 172.21.15.45:0/1396558716 wait complete. 2023-07-09T02:11:27.795 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-09T02:11:27.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:27.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.936+0000 7fd69b07b640 1 Processor -- start 2023-07-09T02:11:27.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.936+0000 7fd69b07b640 1 -- start start 2023-07-09T02:11:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd69b07b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd69415c1c0 0x7fd6941607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd69b07b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940d1090 0x7fd6940d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd69b07b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6940cefe0 con 0x7fd6940b58d0 2023-07-09T02:11:27.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd69b07b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940d2850 con 0x7fd69415c1c0 2023-07-09T02:11:27.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd69b07b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940cd0d0 con 0x7fd6940d1090 2023-07-09T02:11:27.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd698e17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd69415c1c0 0x7fd6941607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd698e17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd69415c1c0 0x7fd6941607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46610/0 (socket says 172.21.15.45:46610) 2023-07-09T02:11:27.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd698e17640 1 -- 172.21.15.45:0/1839174678 learned_addr learned my addr 172.21.15.45:0/1839174678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:27.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd699618640 1 --2- 172.21.15.45:0/1839174678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940d1090 0x7fd6940d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd698e17640 1 -- 172.21.15.45:0/1839174678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940d1090 msgr2=0x7fd6940d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:27.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd698e17640 1 --2- 172.21.15.45:0/1839174678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940d1090 0x7fd6940d2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd698e17640 1 -- 172.21.15.45:0/1839174678 >> v1:172.21.15.155:6789/0 conn(0x7fd6940b58d0 legacy=0x7fd6940d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd698e17640 1 -- 172.21.15.45:0/1839174678 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940cecd0 con 0x7fd69415c1c0 2023-07-09T02:11:27.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd699618640 1 --2- 172.21.15.45:0/1839174678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940d1090 0x7fd6940d2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:27.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.940+0000 7fd698e17640 1 --2- 172.21.15.45:0/1839174678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6941607e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd688009870 tx=0x7fd68801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40030b178f8f838d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd6937fe640 1 -- 172.21.15.45:0/1839174678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880ab600 con 0x7fd69415c1c0 2023-07-09T02:11:27.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd6937fe640 1 -- 172.21.15.45:0/1839174678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6880ab760 con 0x7fd69415c1c0 2023-07-09T02:11:27.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd6937fe640 1 -- 172.21.15.45:0/1839174678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880abaf0 con 0x7fd69415c1c0 2023-07-09T02:11:27.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- 172.21.15.45:0/1839174678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 msgr2=0x7fd6941607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 --2- 172.21.15.45:0/1839174678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6941607e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd688009870 tx=0x7fd68801c400 comp rx=0 tx=0).stop 2023-07-09T02:11:27.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- 172.21.15.45:0/1839174678 shutdown_connections 2023-07-09T02:11:27.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 --2- 172.21.15.45:0/1839174678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940d1090 0x7fd6940d2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 --2- 172.21.15.45:0/1839174678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6941607e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- 172.21.15.45:0/1839174678 >> 172.21.15.45:0/1839174678 conn(0x7fd694069980 msgr2=0x7fd694069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:27.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- 172.21.15.45:0/1839174678 shutdown_connections 2023-07-09T02:11:27.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- 172.21.15.45:0/1839174678 wait complete. 2023-07-09T02:11:27.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 Processor -- start 2023-07-09T02:11:27.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- start start 2023-07-09T02:11:27.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940b58d0 0x7fd6940c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6940d1090 0x7fd69415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6940c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694153ea0 con 0x7fd69415c1c0 2023-07-09T02:11:27.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940c9590 con 0x7fd6940d1090 2023-07-09T02:11:27.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.944+0000 7fd69b07b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940c6590 con 0x7fd6940b58d0 2023-07-09T02:11:27.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6940c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6940c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46624/0 (socket says 172.21.15.45:46624) 2023-07-09T02:11:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 -- 172.21.15.45:0/4270923020 learned_addr learned my addr 172.21.15.45:0/4270923020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd693fff640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6940d1090 0x7fd69415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 -- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940b58d0 msgr2=0x7fd6940c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd698e17640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940b58d0 0x7fd6940c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940b58d0 0x7fd6940c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 -- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6940d1090 msgr2=0x7fd69415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6940d1090 0x7fd69415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 -- 172.21.15.45:0/4270923020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880094d0 con 0x7fd69415c1c0 2023-07-09T02:11:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd693fff640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6940d1090 0x7fd69415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd698e17640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940b58d0 0x7fd6940c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd699618640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6940c72c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd68c007e60 tx=0x7fd68c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd6917fa640 1 -- 172.21.15.45:0/4270923020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c015600 con 0x7fd69415c1c0 2023-07-09T02:11:27.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd6917fa640 1 -- 172.21.15.45:0/4270923020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00f040 con 0x7fd69415c1c0 2023-07-09T02:11:27.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd6917fa640 1 -- 172.21.15.45:0/4270923020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0159a0 con 0x7fd69415c1c0 2023-07-09T02:11:27.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6940c6e30 con 0x7fd69415c1c0 2023-07-09T02:11:27.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6940c67e0 con 0x7fd69415c1c0 2023-07-09T02:11:27.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6940c6fc0 con 0x7fd69415c1c0 2023-07-09T02:11:27.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd6917fa640 1 -- 172.21.15.45:0/4270923020 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd68c01e3b0 con 0x7fd69415c1c0 2023-07-09T02:11:27.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.948+0000 7fd6917fa640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6780662b0 0x7fd678068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:27.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.952+0000 7fd6917fa640 1 -- 172.21.15.45:0/4270923020 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd68c084070 con 0x7fd69415c1c0 2023-07-09T02:11:27.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.952+0000 7fd698e17640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6780662b0 0x7fd678068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:27.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.952+0000 7fd698e17640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6780662b0 0x7fd678068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd6880af000 tx=0x7fd688008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:27.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:27.952+0000 7fd6917fa640 1 -- 172.21.15.45:0/4270923020 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd68c0b4700 con 0x7fd69415c1c0 2023-07-09T02:11:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd69404d7d0 con 0x7fd69415c1c0 2023-07-09T02:11:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd6917fa640 1 -- 172.21.15.45:0/4270923020 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fd68c01a090 con 0x7fd69415c1c0 2023-07-09T02:11:28.115 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:28.115 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6780662b0 msgr2=0x7fd678068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6780662b0 0x7fd678068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd6880af000 tx=0x7fd688008040 comp rx=0 tx=0).stop 2023-07-09T02:11:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 msgr2=0x7fd6940c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6940c72c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd68c007e60 tx=0x7fd68c00d4a0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 shutdown_connections 2023-07-09T02:11:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd69415c1c0 0x7fd6940c72c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6940d1090 0x7fd69415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6780662b0 0x7fd678068760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 --2- 172.21.15.45:0/4270923020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6940b58d0 0x7fd6940c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 >> 172.21.15.45:0/4270923020 conn(0x7fd694069980 msgr2=0x7fd694069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.112+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 shutdown_connections 2023-07-09T02:11:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.116+0000 7fd69b07b640 1 -- 172.21.15.45:0/4270923020 wait complete. 2023-07-09T02:11:28.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:28.138 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef6683a640 1 Processor -- start 2023-07-09T02:11:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef6683a640 1 -- start start 2023-07-09T02:11:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef6683a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef60069f80 0x7fef600b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef6683a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef600d2400 0x7fef600b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef6683a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef600ceff0 con 0x7fef600b1bc0 2023-07-09T02:11:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef6683a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef600cea70 con 0x7fef60069f80 2023-07-09T02:11:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef6683a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef600b1f90 con 0x7fef600d2400 2023-07-09T02:11:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef65037640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef60069f80 0x7fef600b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef65037640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef60069f80 0x7fef600b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46640/0 (socket says 172.21.15.45:46640) 2023-07-09T02:11:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef65037640 1 -- 172.21.15.45:0/2935684414 learned_addr learned my addr 172.21.15.45:0/2935684414 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:28.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef66039640 1 --2- 172.21.15.45:0/2935684414 >> v2:172.21.15.155:3300/0 conn(0x7fef600d2400 0x7fef600b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef65037640 1 -- 172.21.15.45:0/2935684414 >> v2:172.21.15.155:3300/0 conn(0x7fef600d2400 msgr2=0x7fef600b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:28.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef65037640 1 --2- 172.21.15.45:0/2935684414 >> v2:172.21.15.155:3300/0 conn(0x7fef600d2400 0x7fef600b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef65037640 1 -- 172.21.15.45:0/2935684414 >> v1:172.21.15.155:6789/0 conn(0x7fef600b1bc0 legacy=0x7fef60069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:28.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef65037640 1 -- 172.21.15.45:0/2935684414 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef600d1500 con 0x7fef60069f80 2023-07-09T02:11:28.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.288+0000 7fef66039640 1 --2- 172.21.15.45:0/2935684414 >> v2:172.21.15.155:3300/0 conn(0x7fef600d2400 0x7fef600b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:28.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef65037640 1 --2- 172.21.15.45:0/2935684414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef60069f80 0x7fef600b58a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fef6006a5d0 tx=0x7fef5001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f83eb023d7dca3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef64836640 1 -- 172.21.15.45:0/2935684414 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500aa5f0 con 0x7fef60069f80 2023-07-09T02:11:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef64836640 1 -- 172.21.15.45:0/2935684414 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef500aa750 con 0x7fef60069f80 2023-07-09T02:11:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef64836640 1 -- 172.21.15.45:0/2935684414 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500aaae0 con 0x7fef60069f80 2023-07-09T02:11:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef6683a640 1 -- 172.21.15.45:0/2935684414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef60069f80 msgr2=0x7fef600b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef6683a640 1 --2- 172.21.15.45:0/2935684414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef60069f80 0x7fef600b58a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fef6006a5d0 tx=0x7fef5001c490 comp rx=0 tx=0).stop 2023-07-09T02:11:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef6683a640 1 -- 172.21.15.45:0/2935684414 shutdown_connections 2023-07-09T02:11:28.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef6683a640 1 --2- 172.21.15.45:0/2935684414 >> v2:172.21.15.155:3300/0 conn(0x7fef600d2400 0x7fef600b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef6683a640 1 --2- 172.21.15.45:0/2935684414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef60069f80 0x7fef600b58a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef6683a640 1 -- 172.21.15.45:0/2935684414 >> 172.21.15.45:0/2935684414 conn(0x7fef600d35b0 msgr2=0x7fef600cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:28.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef6683a640 1 -- 172.21.15.45:0/2935684414 shutdown_connections 2023-07-09T02:11:28.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.292+0000 7fef6683a640 1 -- 172.21.15.45:0/2935684414 wait complete. 2023-07-09T02:11:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 Processor -- start 2023-07-09T02:11:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 -- start start 2023-07-09T02:11:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef60069f80 0x7fef6015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef600b1bc0 0x7fef60154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef600d2400 0x7fef6015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6015f560 con 0x7fef600b1bc0 2023-07-09T02:11:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef60159ff0 con 0x7fef600d2400 2023-07-09T02:11:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6015c9b0 con 0x7fef60069f80 2023-07-09T02:11:28.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef600b1bc0 0x7fef60154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef600b1bc0 0x7fef60154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46656/0 (socket says 172.21.15.45:46656) 2023-07-09T02:11:28.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 -- 172.21.15.45:0/1986278079 learned_addr learned my addr 172.21.15.45:0/1986278079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:28.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef66039640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef600d2400 0x7fef6015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65838640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef60069f80 0x7fef6015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 -- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef60069f80 msgr2=0x7fef6015f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef60069f80 0x7fef6015f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 -- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef600d2400 msgr2=0x7fef6015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef600d2400 0x7fef6015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 -- 172.21.15.45:0/1986278079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef500094d0 con 0x7fef600b1bc0 2023-07-09T02:11:28.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef65037640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef600b1bc0 0x7fef60154080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fef500ac040 tx=0x7fef5001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef567fc640 1 -- 172.21.15.45:0/1986278079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500b3800 con 0x7fef600b1bc0 2023-07-09T02:11:28.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef567fc640 1 -- 172.21.15.45:0/1986278079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef500b3980 con 0x7fef600b1bc0 2023-07-09T02:11:28.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef567fc640 1 -- 172.21.15.45:0/1986278079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500b3d30 con 0x7fef600b1bc0 2023-07-09T02:11:28.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6015dd00 con 0x7fef600b1bc0 2023-07-09T02:11:28.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6015e2c0 con 0x7fef600b1bc0 2023-07-09T02:11:28.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.296+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6004e020 con 0x7fef600b1bc0 2023-07-09T02:11:28.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.300+0000 7fef567fc640 1 -- 172.21.15.45:0/1986278079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef500b2380 con 0x7fef600b1bc0 2023-07-09T02:11:28.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.300+0000 7fef567fc640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef44066280 0x7fef44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.300+0000 7fef567fc640 1 -- 172.21.15.45:0/1986278079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef500a7070 con 0x7fef600b1bc0 2023-07-09T02:11:28.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.300+0000 7fef65838640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef44066280 0x7fef44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.300+0000 7fef65838640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef44066280 0x7fef44068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fef5c007fd0 tx=0x7fef5c007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.304+0000 7fef567fc640 1 -- 172.21.15.45:0/1986278079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef500eba70 con 0x7fef600b1bc0 2023-07-09T02:11:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.456+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef6015da30 con 0x7fef600b1bc0 2023-07-09T02:11:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.456+0000 7fef567fc640 1 -- 172.21.15.45:0/1986278079 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef500ef090 con 0x7fef600b1bc0 2023-07-09T02:11:28.461 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:28.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef44066280 msgr2=0x7fef44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef44066280 0x7fef44068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fef5c007fd0 tx=0x7fef5c007e40 comp rx=0 tx=0).stop 2023-07-09T02:11:28.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef600b1bc0 msgr2=0x7fef60154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef600b1bc0 0x7fef60154080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fef500ac040 tx=0x7fef5001acd0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 shutdown_connections 2023-07-09T02:11:28.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef600d2400 0x7fef6015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef600b1bc0 0x7fef60154080 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef44066280 0x7fef44068730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 --2- 172.21.15.45:0/1986278079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef60069f80 0x7fef6015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 >> 172.21.15.45:0/1986278079 conn(0x7fef600d35b0 msgr2=0x7fef60070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:28.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 shutdown_connections 2023-07-09T02:11:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.460+0000 7fef6683a640 1 -- 172.21.15.45:0/1986278079 wait complete. 2023-07-09T02:11:28.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:28.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9676bac640 1 Processor -- start 2023-07-09T02:11:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9676bac640 1 -- start start 2023-07-09T02:11:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9676bac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f967015c060 0x7f96700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9676bac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9670160a50 con 0x7f96700cd120 2023-07-09T02:11:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9676bac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967015c430 con 0x7f96700d2620 2023-07-09T02:11:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9676bac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967015fb60 con 0x7f967015c060 2023-07-09T02:11:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9667fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f96700cd120 0x7f96700d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48970/0 (socket says 172.21.15.45:48970) 2023-07-09T02:11:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9667fff640 1 -- 172.21.15.45:0/1368140350 learned_addr learned my addr 172.21.15.45:0/1368140350 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f9674948640 1 --2- 172.21.15.45:0/1368140350 >> v2:172.21.15.155:3300/0 conn(0x7f967015c060 0x7f96700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484230444 0 0) 0x7f9670160a50 con 0x7f96700cd120 2023-07-09T02:11:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9658003530 con 0x7f96700cd120 2023-07-09T02:11:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753874935 0 0) 0x7f967015c430 con 0x7f96700d2620 2023-07-09T02:11:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9670160a50 con 0x7f96700d2620 2023-07-09T02:11:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 716230072 0 0) 0x7f9658003530 con 0x7f96700cd120 2023-07-09T02:11:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 >> v2:172.21.15.155:3300/0 conn(0x7f967015c060 msgr2=0x7f96700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 --2- 172.21.15.45:0/1368140350 >> v2:172.21.15.155:3300/0 conn(0x7f967015c060 0x7f96700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 >> v1:172.21.15.155:6789/0 conn(0x7f96700d2620 legacy=0x7f96700cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967015fe40 con 0x7f96700cd120 2023-07-09T02:11:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.628+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f9660001680 con 0x7f96700cd120 2023-07-09T02:11:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 >> v1:172.21.15.45:6789/0 conn(0x7f96700cd120 legacy=0x7f96700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f9658003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580047d0 0x7f9658004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9658005180 0x7f965800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967015fb60 con 0x7f9658003b10 2023-07-09T02:11:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965800bfe0 con 0x7f96580047d0 2023-07-09T02:11:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965800c1a0 con 0x7f9658005180 2023-07-09T02:11:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9674948640 1 --2- 172.21.15.45:0/1368140350 >> v2:172.21.15.155:3300/0 conn(0x7f967015c060 0x7f96700b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9674948640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f9658003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9667fff640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580047d0 0x7f9658004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9675149640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9658005180 0x7f965800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9674948640 1 -- 172.21.15.45:0/1368140350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9658005180 msgr2=0x7f965800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9674948640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9658005180 0x7f965800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9674948640 1 -- 172.21.15.45:0/1368140350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580047d0 msgr2=0x7f9658004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9674948640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96580047d0 0x7f9658004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9674948640 1 -- 172.21.15.45:0/1368140350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9658003530 con 0x7f9658003b10 2023-07-09T02:11:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9675149640 1 -- 172.21.15.45:0/1368140350 reap_dead start 2023-07-09T02:11:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f9674948640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f9658003f00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f966c009c90 tx=0x7f966c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530ef5cc2a1bccc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c004020 con 0x7f9658003b10 2023-07-09T02:11:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c004180 con 0x7f9658003b10 2023-07-09T02:11:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.632+0000 7f96677fe640 1 -- 172.21.15.45:0/1368140350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c0a5660 con 0x7f9658003b10 2023-07-09T02:11:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- 172.21.15.45:0/1368140350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 msgr2=0x7f9658003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f9658003f00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f966c009c90 tx=0x7f966c01cbc0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- 172.21.15.45:0/1368140350 shutdown_connections 2023-07-09T02:11:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 --2- 172.21.15.45:0/1368140350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f9658003f00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- 172.21.15.45:0/1368140350 >> 172.21.15.45:0/1368140350 conn(0x7f96700698e0 msgr2=0x7f9670069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- 172.21.15.45:0/1368140350 shutdown_connections 2023-07-09T02:11:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- 172.21.15.45:0/1368140350 wait complete. 2023-07-09T02:11:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 Processor -- start 2023-07-09T02:11:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- start start 2023-07-09T02:11:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f96701e8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9670157cf0 0x7f96700cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96700cc1c0 0x7f967015d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96701eb250 con 0x7f9658003b10 2023-07-09T02:11:28.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700cb930 con 0x7f9670157cf0 2023-07-09T02:11:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9676bac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96701ea2b0 con 0x7f96700cc1c0 2023-07-09T02:11:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.636+0000 7f9674948640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f96701e8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9674948640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f96701e8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46664/0 (socket says 172.21.15.45:46664) 2023-07-09T02:11:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9674948640 1 -- 172.21.15.45:0/1509594177 learned_addr learned my addr 172.21.15.45:0/1509594177 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9675149640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96700cc1c0 0x7f967015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9667fff640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9670157cf0 0x7f96700cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9674948640 1 -- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96700cc1c0 msgr2=0x7f967015d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9674948640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96700cc1c0 0x7f967015d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9674948640 1 -- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9670157cf0 msgr2=0x7f96700cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9674948640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9670157cf0 0x7f96700cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9674948640 1 -- 172.21.15.45:0/1509594177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96701ea490 con 0x7f9658003b10 2023-07-09T02:11:28.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9675149640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96700cc1c0 0x7f967015d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:28.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9667fff640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9670157cf0 0x7f96700cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:28.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9674948640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f96701e8010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f966c01c9f0 tx=0x7f9658005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f96657fa640 1 -- 172.21.15.45:0/1509594177 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c0044f0 con 0x7f9658003b10 2023-07-09T02:11:28.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f96657fa640 1 -- 172.21.15.45:0/1509594177 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c0a5660 con 0x7f9658003b10 2023-07-09T02:11:28.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f96657fa640 1 -- 172.21.15.45:0/1509594177 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c0a59d0 con 0x7f9658003b10 2023-07-09T02:11:28.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96701ea770 con 0x7f9658003b10 2023-07-09T02:11:28.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96701ead30 con 0x7f9658003b10 2023-07-09T02:11:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96700cc5c0 con 0x7f9658003b10 2023-07-09T02:11:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f96657fa640 1 -- 172.21.15.45:0/1509594177 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f966c0a5b30 con 0x7f9658003b10 2023-07-09T02:11:28.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f96657fa640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f965c0662b0 0x7f965c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.640+0000 7f96657fa640 1 -- 172.21.15.45:0/1509594177 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f966c11e690 con 0x7f9658003b10 2023-07-09T02:11:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.644+0000 7f9667fff640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f965c0662b0 0x7f965c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.644+0000 7f9667fff640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f965c0662b0 0x7f965c068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96700b6320 tx=0x7f9660009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.644+0000 7f96657fa640 1 -- 172.21.15.45:0/1509594177 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f966c0ebb90 con 0x7f9658003b10 2023-07-09T02:11:28.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f967004d7d0 con 0x7f9658003b10 2023-07-09T02:11:28.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f96657fa640 1 -- 172.21.15.45:0/1509594177 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f966c0ef1b0 con 0x7f9658003b10 2023-07-09T02:11:28.802 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f965c0662b0 msgr2=0x7f965c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f965c0662b0 0x7f965c068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96700b6320 tx=0x7f9660009040 comp rx=0 tx=0).stop 2023-07-09T02:11:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 msgr2=0x7f96701e8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f96701e8010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f966c01c9f0 tx=0x7f9658005800 comp rx=0 tx=0).stop 2023-07-09T02:11:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 shutdown_connections 2023-07-09T02:11:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f965c0662b0 0x7f965c068760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96700cc1c0 0x7f967015d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9670157cf0 0x7f96700cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 --2- 172.21.15.45:0/1509594177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9658003b10 0x7f96701e8010 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 >> 172.21.15.45:0/1509594177 conn(0x7f96700698e0 msgr2=0x7f96700b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 shutdown_connections 2023-07-09T02:11:28.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.800+0000 7f9676bac640 1 -- 172.21.15.45:0/1509594177 wait complete. 2023-07-09T02:11:28.823 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f287545c640 1 Processor -- start 2023-07-09T02:11:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f287545c640 1 -- start start 2023-07-09T02:11:28.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f287545c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f287545c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f28700cd120 0x7f28700cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f287545c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2870160a50 con 0x7f287015c060 2023-07-09T02:11:28.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f287545c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287015c430 con 0x7f28700cd120 2023-07-09T02:11:28.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f287545c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287015fb60 con 0x7f28700d2620 2023-07-09T02:11:28.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286effd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f287015c060 0x7f28700d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:57992/0 (socket says 172.21.15.45:57992) 2023-07-09T02:11:28.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286effd640 1 -- 172.21.15.45:0/2373847264 learned_addr learned my addr 172.21.15.45:0/2373847264 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:28.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286f7fe640 1 --2- 172.21.15.45:0/2373847264 >> v2:172.21.15.155:3300/0 conn(0x7f28700cd120 0x7f28700cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286e7fc640 1 --2- 172.21.15.45:0/2373847264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286dffb640 1 -- 172.21.15.45:0/2373847264 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675428063 0 0) 0x7f2870160a50 con 0x7f287015c060 2023-07-09T02:11:28.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286dffb640 1 -- 172.21.15.45:0/2373847264 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2858003530 con 0x7f287015c060 2023-07-09T02:11:28.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286f7fe640 1 -- 172.21.15.45:0/2373847264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 msgr2=0x7f28700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:28.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286f7fe640 1 --2- 172.21.15.45:0/2373847264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286f7fe640 1 -- 172.21.15.45:0/2373847264 >> v1:172.21.15.155:6789/0 conn(0x7f287015c060 legacy=0x7f28700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.968+0000 7f286f7fe640 1 -- 172.21.15.45:0/2373847264 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287015fe40 con 0x7f28700cd120 2023-07-09T02:11:28.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f286f7fe640 1 --2- 172.21.15.45:0/2373847264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28700cd120 0x7f28700cee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2868009d90 tx=0x7f286801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3615065964545d25 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f286dffb640 1 -- 172.21.15.45:0/2373847264 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680a59e0 con 0x7f28700cd120 2023-07-09T02:11:28.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f286dffb640 1 -- 172.21.15.45:0/2373847264 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28680a5b40 con 0x7f28700cd120 2023-07-09T02:11:28.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f286dffb640 1 -- 172.21.15.45:0/2373847264 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680ad440 con 0x7f28700cd120 2023-07-09T02:11:28.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f287545c640 1 -- 172.21.15.45:0/2373847264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28700cd120 msgr2=0x7f28700cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f287545c640 1 --2- 172.21.15.45:0/2373847264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28700cd120 0x7f28700cee30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2868009d90 tx=0x7f286801c920 comp rx=0 tx=0).stop 2023-07-09T02:11:28.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f287545c640 1 -- 172.21.15.45:0/2373847264 shutdown_connections 2023-07-09T02:11:28.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f287545c640 1 --2- 172.21.15.45:0/2373847264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28700cd120 0x7f28700cee30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f287545c640 1 --2- 172.21.15.45:0/2373847264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28700b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f287545c640 1 -- 172.21.15.45:0/2373847264 >> 172.21.15.45:0/2373847264 conn(0x7f28700698e0 msgr2=0x7f2870069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f287545c640 1 -- 172.21.15.45:0/2373847264 shutdown_connections 2023-07-09T02:11:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.972+0000 7f287545c640 1 -- 172.21.15.45:0/2373847264 wait complete. 2023-07-09T02:11:28.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 Processor -- start 2023-07-09T02:11:28.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 -- start start 2023-07-09T02:11:28.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28700cd120 0x7f2870151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28701573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f287015c060 0x7f2870158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701530e0 con 0x7f28700cd120 2023-07-09T02:11:28.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701568f0 con 0x7f287015c060 2023-07-09T02:11:28.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2870152db0 con 0x7f28700d2620 2023-07-09T02:11:28.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28700cd120 0x7f2870151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28700cd120 0x7f2870151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46668/0 (socket says 172.21.15.45:46668) 2023-07-09T02:11:28.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 -- 172.21.15.45:0/1003477979 learned_addr learned my addr 172.21.15.45:0/1003477979 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:28.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286f7fe640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f287015c060 0x7f2870158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286e7fc640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28701573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 -- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 msgr2=0x7f28701573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28701573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 -- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f287015c060 msgr2=0x7f2870158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:28.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f287015c060 0x7f2870158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:28.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 -- 172.21.15.45:0/1003477979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009a70 con 0x7f28700cd120 2023-07-09T02:11:28.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286f7fe640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f287015c060 0x7f2870158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:28.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286e7fc640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28701573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:28.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f286effd640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28700cd120 0x7f2870151c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f286000c420 tx=0x7f286000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f28577fe640 1 -- 172.21.15.45:0/1003477979 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860005cf0 con 0x7f28700cd120 2023-07-09T02:11:28.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f28577fe640 1 -- 172.21.15.45:0/1003477979 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860005e50 con 0x7f28700cd120 2023-07-09T02:11:28.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f28577fe640 1 -- 172.21.15.45:0/1003477979 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600072d0 con 0x7f28700cd120 2023-07-09T02:11:28.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28700b59f0 con 0x7f28700cd120 2023-07-09T02:11:28.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.976+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2870156e70 con 0x7f28700cd120 2023-07-09T02:11:28.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.980+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287004d7d0 con 0x7f28700cd120 2023-07-09T02:11:28.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.980+0000 7f28577fe640 1 -- 172.21.15.45:0/1003477979 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2860007430 con 0x7f28700cd120 2023-07-09T02:11:28.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.980+0000 7f28577fe640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f285c0662b0 0x7f285c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:28.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.980+0000 7f28577fe640 1 -- 172.21.15.45:0/1003477979 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28600831e0 con 0x7f28700cd120 2023-07-09T02:11:28.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.980+0000 7f286e7fc640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f285c0662b0 0x7f285c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:28.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.980+0000 7f286e7fc640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f285c0662b0 0x7f285c068760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2870154630 tx=0x7f2864008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:28.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:28.984+0000 7f28577fe640 1 -- 172.21.15.45:0/1003477979 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2860050700 con 0x7f28700cd120 2023-07-09T02:11:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.140+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f287006baa0 con 0x7f28700cd120 2023-07-09T02:11:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.140+0000 7f28577fe640 1 -- 172.21.15.45:0/1003477979 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2860053d20 con 0x7f28700cd120 2023-07-09T02:11:29.144 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:29.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f285c0662b0 msgr2=0x7f285c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f285c0662b0 0x7f285c068760 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2870154630 tx=0x7f2864008040 comp rx=0 tx=0).stop 2023-07-09T02:11:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28700cd120 msgr2=0x7f2870151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28700cd120 0x7f2870151c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f286000c420 tx=0x7f286000c8e0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 shutdown_connections 2023-07-09T02:11:29.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f287015c060 0x7f2870158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f285c0662b0 0x7f285c068760 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28700d2620 0x7f28701573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 --2- 172.21.15.45:0/1003477979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28700cd120 0x7f2870151c00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 >> 172.21.15.45:0/1003477979 conn(0x7f28700698e0 msgr2=0x7f2870154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:29.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 shutdown_connections 2023-07-09T02:11:29.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.144+0000 7f287545c640 1 -- 172.21.15.45:0/1003477979 wait complete. 2023-07-09T02:11:29.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:29.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6fad8640 1 Processor -- start 2023-07-09T02:11:29.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6fad8640 1 -- start start 2023-07-09T02:11:29.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6fad8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a680d2620 0x7f6a680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6fad8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a68160a50 con 0x7f6a6815c060 2023-07-09T02:11:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6fad8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6815c430 con 0x7f6a680cd120 2023-07-09T02:11:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6fad8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6815fb60 con 0x7f6a680d2620 2023-07-09T02:11:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6d874640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6a6815c060 0x7f6a680d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48972/0 (socket says 172.21.15.45:48972) 2023-07-09T02:11:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6d874640 1 -- 172.21.15.45:0/1206251112 learned_addr learned my addr 172.21.15.45:0/1206251112 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692278867 0 0) 0x7f6a68160a50 con 0x7f6a6815c060 2023-07-09T02:11:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a54003530 con 0x7f6a6815c060 2023-07-09T02:11:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6d073640 1 --2- 172.21.15.45:0/1206251112 >> v2:172.21.15.155:3300/0 conn(0x7f6a680d2620 0x7f6a680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3124613930 0 0) 0x7f6a54003530 con 0x7f6a6815c060 2023-07-09T02:11:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 >> v2:172.21.15.155:3300/0 conn(0x7f6a680d2620 msgr2=0x7f6a680b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 --2- 172.21.15.45:0/1206251112 >> v2:172.21.15.155:3300/0 conn(0x7f6a680d2620 0x7f6a680b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 >> v1:172.21.15.155:6789/0 conn(0x7f6a680cd120 legacy=0x7f6a680cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6815fe40 con 0x7f6a6815c060 2023-07-09T02:11:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f6a64001680 con 0x7f6a6815c060 2023-07-09T02:11:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 >> v1:172.21.15.45:6789/0 conn(0x7f6a6815c060 legacy=0x7f6a680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54003980 0x7f6a54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a540047d0 0x7f6a54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a54005180 0x7f6a5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6815fb60 con 0x7f6a54005180 2023-07-09T02:11:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5400c000 con 0x7f6a54003980 2023-07-09T02:11:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.308+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5400c1c0 con 0x7f6a540047d0 2023-07-09T02:11:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6e075640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a54005180 0x7f6a5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6d874640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54003980 0x7f6a54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6d073640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a540047d0 0x7f6a54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6e075640 1 -- 172.21.15.45:0/1206251112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a540047d0 msgr2=0x7f6a54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6e075640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a540047d0 0x7f6a54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6e075640 1 -- 172.21.15.45:0/1206251112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54003980 msgr2=0x7f6a54003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:29.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6e075640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54003980 0x7f6a54003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6e075640 1 -- 172.21.15.45:0/1206251112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54003530 con 0x7f6a54005180 2023-07-09T02:11:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6e075640 1 -- 172.21.15.45:0/1206251112 reap_dead start 2023-07-09T02:11:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6e075640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a54005180 0x7f6a5400b990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6a60001e70 tx=0x7f6a6001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9087aece35ae5157 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60003b80 con 0x7f6a54005180 2023-07-09T02:11:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60003d20 con 0x7f6a54005180 2023-07-09T02:11:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6c872640 1 -- 172.21.15.45:0/1206251112 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60005260 con 0x7f6a54005180 2023-07-09T02:11:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1206251112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a54005180 msgr2=0x7f6a5400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.312+0000 7f6a6fad8640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a54005180 0x7f6a5400b990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6a60001e70 tx=0x7f6a6001c760 comp rx=0 tx=0).stop 2023-07-09T02:11:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1206251112 shutdown_connections 2023-07-09T02:11:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 --2- 172.21.15.45:0/1206251112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a54005180 0x7f6a5400b990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1206251112 >> 172.21.15.45:0/1206251112 conn(0x7f6a680698e0 msgr2=0x7f6a68069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1206251112 shutdown_connections 2023-07-09T02:11:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1206251112 wait complete. 2023-07-09T02:11:29.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 Processor -- start 2023-07-09T02:11:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 -- start start 2023-07-09T02:11:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54005180 0x7f6a68158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a681f1a70 0x7f6a681f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a680b4600 0x7f6a680b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a681f2ad0 con 0x7f6a681f1a70 2023-07-09T02:11:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680b4fe0 con 0x7f6a54005180 2023-07-09T02:11:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6fad8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a681f2510 con 0x7f6a680b4600 2023-07-09T02:11:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a681f1a70 0x7f6a681f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a681f1a70 0x7f6a681f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46686/0 (socket says 172.21.15.45:46686) 2023-07-09T02:11:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 -- 172.21.15.45:0/1330723618 learned_addr learned my addr 172.21.15.45:0/1330723618 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d874640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54005180 0x7f6a68158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6e075640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a680b4600 0x7f6a680b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 -- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a680b4600 msgr2=0x7f6a680b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a680b4600 0x7f6a680b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 -- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54005180 msgr2=0x7f6a68158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54005180 0x7f6a68158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 -- 172.21.15.45:0/1330723618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a681f27f0 con 0x7f6a681f1a70 2023-07-09T02:11:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.316+0000 7f6a6d073640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a681f1a70 0x7f6a681f1ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6a58011960 tx=0x7f6a58011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a5e7fc640 1 -- 172.21.15.45:0/1330723618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58004240 con 0x7f6a681f1a70 2023-07-09T02:11:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a5e7fc640 1 -- 172.21.15.45:0/1330723618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a580043a0 con 0x7f6a681f1a70 2023-07-09T02:11:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a5e7fc640 1 -- 172.21.15.45:0/1330723618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800fb00 con 0x7f6a681f1a70 2023-07-09T02:11:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a680c9cb0 con 0x7f6a681f1a70 2023-07-09T02:11:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a68159340 con 0x7f6a681f1a70 2023-07-09T02:11:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a680c9af0 con 0x7f6a681f1a70 2023-07-09T02:11:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a5e7fc640 1 -- 172.21.15.45:0/1330723618 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a5800fc60 con 0x7f6a681f1a70 2023-07-09T02:11:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a5e7fc640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a4c0662d0 0x7f6a4c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a5e7fc640 1 -- 172.21.15.45:0/1330723618 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a580843d0 con 0x7f6a681f1a70 2023-07-09T02:11:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.320+0000 7f6a6d874640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a4c0662d0 0x7f6a4c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.324+0000 7f6a6d874640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a4c0662d0 0x7f6a4c068780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a680b4420 tx=0x7f6a64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:29.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.324+0000 7f6a5e7fc640 1 -- 172.21.15.45:0/1330723618 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a58051830 con 0x7f6a681f1a70 2023-07-09T02:11:29.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.476+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a6806baa0 con 0x7f6a681f1a70 2023-07-09T02:11:29.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.476+0000 7f6a5e7fc640 1 -- 172.21.15.45:0/1330723618 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a58054e50 con 0x7f6a681f1a70 2023-07-09T02:11:29.481 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:29.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a4c0662d0 msgr2=0x7f6a4c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a4c0662d0 0x7f6a4c068780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a680b4420 tx=0x7f6a64009040 comp rx=0 tx=0).stop 2023-07-09T02:11:29.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a681f1a70 msgr2=0x7f6a681f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a681f1a70 0x7f6a681f1ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6a58011960 tx=0x7f6a58011e20 comp rx=0 tx=0).stop 2023-07-09T02:11:29.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 shutdown_connections 2023-07-09T02:11:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a4c0662d0 0x7f6a4c068780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a680b4600 0x7f6a680b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a681f1a70 0x7f6a681f1ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 --2- 172.21.15.45:0/1330723618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a54005180 0x7f6a68158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 >> 172.21.15.45:0/1330723618 conn(0x7f6a680698e0 msgr2=0x7f6a680d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 shutdown_connections 2023-07-09T02:11:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.480+0000 7f6a6fad8640 1 -- 172.21.15.45:0/1330723618 wait complete. 2023-07-09T02:11:29.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:11:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f835ca8a640 1 Processor -- start 2023-07-09T02:11:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f835ca8a640 1 -- start start 2023-07-09T02:11:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f835ca8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f835ca8a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f835806b950 0x7f83580d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f835ca8a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580b2090 con 0x7f83580b1b50 2023-07-09T02:11:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f835ca8a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8358160520 con 0x7f835806b950 2023-07-09T02:11:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f835ca8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8358160800 con 0x7f835815c870 2023-07-09T02:11:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f8357fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f835806b950 0x7f83580d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f8357fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f835806b950 0x7f83580d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46698/0 (socket says 172.21.15.45:46698) 2023-07-09T02:11:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f8357fff640 1 -- 172.21.15.45:0/2665246798 learned_addr learned my addr 172.21.15.45:0/2665246798 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f83577fe640 1 --2- 172.21.15.45:0/2665246798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f8357fff640 1 -- 172.21.15.45:0/2665246798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 msgr2=0x7f83580b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f8357fff640 1 --2- 172.21.15.45:0/2665246798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f8357fff640 1 -- 172.21.15.45:0/2665246798 >> v1:172.21.15.155:6789/0 conn(0x7f83580b1b50 legacy=0x7f835806b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.644+0000 7f8357fff640 1 -- 172.21.15.45:0/2665246798 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8358160ae0 con 0x7f835806b950 2023-07-09T02:11:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f8357fff640 1 --2- 172.21.15.45:0/2665246798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83580d0d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8350009e50 tx=0x7f835001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0036a9b808d14c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f83567fc640 1 -- 172.21.15.45:0/2665246798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500a5850 con 0x7f835806b950 2023-07-09T02:11:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f83567fc640 1 -- 172.21.15.45:0/2665246798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500a59b0 con 0x7f835806b950 2023-07-09T02:11:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f83567fc640 1 -- 172.21.15.45:0/2665246798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500a5d40 con 0x7f835806b950 2023-07-09T02:11:29.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 -- 172.21.15.45:0/2665246798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 msgr2=0x7f83580d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 --2- 172.21.15.45:0/2665246798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83580d0d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8350009e50 tx=0x7f835001c9e0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 -- 172.21.15.45:0/2665246798 shutdown_connections 2023-07-09T02:11:29.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 --2- 172.21.15.45:0/2665246798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83580d0d70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 --2- 172.21.15.45:0/2665246798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 -- 172.21.15.45:0/2665246798 >> 172.21.15.45:0/2665246798 conn(0x7f8358070be0 msgr2=0x7f8358070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:29.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 -- 172.21.15.45:0/2665246798 shutdown_connections 2023-07-09T02:11:29.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 -- 172.21.15.45:0/2665246798 wait complete. 2023-07-09T02:11:29.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 Processor -- start 2023-07-09T02:11:29.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.648+0000 7f835ca8a640 1 -- start start 2023-07-09T02:11:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83581fc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83580b1b50 0x7f8358150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83581511f0 con 0x7f835806b950 2023-07-09T02:11:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83581fd6f0 con 0x7f83580b1b50 2023-07-09T02:11:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83581fce50 con 0x7f835815c870 2023-07-09T02:11:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83581fc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83581fc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46708/0 (socket says 172.21.15.45:46708) 2023-07-09T02:11:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 -- 172.21.15.45:0/473331381 learned_addr learned my addr 172.21.15.45:0/473331381 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f8356ffd640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83580b1b50 0x7f8358150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f8357fff640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 -- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 msgr2=0x7f83580b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 -- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83580b1b50 msgr2=0x7f8358150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83580b1b50 0x7f8358150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 -- 172.21.15.45:0/473331381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350009b30 con 0x7f835806b950 2023-07-09T02:11:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f8357fff640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f83577fe640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83581fc870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f834800e870 tx=0x7f834800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f833ffff640 1 -- 172.21.15.45:0/473331381 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348009510 con 0x7f835806b950 2023-07-09T02:11:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f833ffff640 1 -- 172.21.15.45:0/473331381 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834800eec0 con 0x7f835806b950 2023-07-09T02:11:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83581fd130 con 0x7f835806b950 2023-07-09T02:11:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f833ffff640 1 -- 172.21.15.45:0/473331381 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834800cb40 con 0x7f835806b950 2023-07-09T02:11:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8358151a40 con 0x7f835806b950 2023-07-09T02:11:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.652+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835804e020 con 0x7f835806b950 2023-07-09T02:11:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.656+0000 7f833ffff640 1 -- 172.21.15.45:0/473331381 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f834800cca0 con 0x7f835806b950 2023-07-09T02:11:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.656+0000 7f833ffff640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83440662b0 0x7f8344068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.656+0000 7f833ffff640 1 -- 172.21.15.45:0/473331381 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8348083df0 con 0x7f835806b950 2023-07-09T02:11:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.656+0000 7f8356ffd640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83440662b0 0x7f8344068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.656+0000 7f8356ffd640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83440662b0 0x7f8344068760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83580c9410 tx=0x7f834c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.660+0000 7f833ffff640 1 -- 172.21.15.45:0/473331381 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8348051280 con 0x7f835806b950 2023-07-09T02:11:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.848+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83580709c0 con 0x7f835806b950 2023-07-09T02:11:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.848+0000 7f833ffff640 1 -- 172.21.15.45:0/473331381 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f8348017090 con 0x7f835806b950 2023-07-09T02:11:29.852 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:29.853 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:11:17.535245+0000","modified":"2023-07-09T02:11:21.190690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T02:11:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-07-09T02:11:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83440662b0 msgr2=0x7f8344068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83440662b0 0x7f8344068760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83580c9410 tx=0x7f834c009040 comp rx=0 tx=0).stop 2023-07-09T02:11:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 msgr2=0x7f83581fc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83581fc870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f834800e870 tx=0x7f834800ec70 comp rx=0 tx=0).stop 2023-07-09T02:11:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 shutdown_connections 2023-07-09T02:11:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83440662b0 0x7f8344068760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f835815c870 0x7f83580b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83580b1b50 0x7f8358150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 --2- 172.21.15.45:0/473331381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f835806b950 0x7f83581fc870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 >> 172.21.15.45:0/473331381 conn(0x7f8358070be0 msgr2=0x7f83580b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 shutdown_connections 2023-07-09T02:11:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:29.852+0000 7f835ca8a640 1 -- 172.21.15.45:0/473331381 wait complete. 2023-07-09T02:11:29.875 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:30.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71f112640 1 Processor -- start 2023-07-09T02:11:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71f112640 1 -- start start 2023-07-09T02:11:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71f112640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd718159f40 0x7fd71815da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71f112640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71815b320 con 0x7fd7180d0020 2023-07-09T02:11:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71f112640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180d0500 con 0x7fd718099f40 2023-07-09T02:11:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71f112640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7180d11c0 con 0x7fd718159f40 2023-07-09T02:11:30.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e911640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd7180d0020 0x7fd71815c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48984/0 (socket says 172.21.15.45:48984) 2023-07-09T02:11:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e911640 1 -- 172.21.15.45:0/485570123 learned_addr learned my addr 172.21.15.45:0/485570123 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e110640 1 --2- 172.21.15.45:0/485570123 >> v2:172.21.15.155:3300/0 conn(0x7fd718159f40 0x7fd71815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344784855 0 0) 0x7fd71815b320 con 0x7fd7180d0020 2023-07-09T02:11:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd704003530 con 0x7fd7180d0020 2023-07-09T02:11:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452459704 0 0) 0x7fd7180d0500 con 0x7fd718099f40 2023-07-09T02:11:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd71815b320 con 0x7fd718099f40 2023-07-09T02:11:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3380922658 0 0) 0x7fd704003530 con 0x7fd7180d0020 2023-07-09T02:11:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 >> v2:172.21.15.155:3300/0 conn(0x7fd718159f40 msgr2=0x7fd71815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 --2- 172.21.15.45:0/485570123 >> v2:172.21.15.155:3300/0 conn(0x7fd718159f40 0x7fd71815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 >> v1:172.21.15.155:6789/0 conn(0x7fd718099f40 legacy=0x7fd71815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180d14a0 con 0x7fd7180d0020 2023-07-09T02:11:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fd710001a00 con 0x7fd7180d0020 2023-07-09T02:11:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 >> v1:172.21.15.45:6789/0 conn(0x7fd7180d0020 legacy=0x7fd71815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd704003b10 0x7fd704003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd70400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180d11c0 con 0x7fd704005180 2023-07-09T02:11:30.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400bfe0 con 0x7fd7040047d0 2023-07-09T02:11:30.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400c1a0 con 0x7fd704003b10 2023-07-09T02:11:30.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e110640 1 --2- 172.21.15.45:0/485570123 >> v2:172.21.15.155:3300/0 conn(0x7fd718159f40 0x7fd71815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:30.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e911640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd70400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d90f640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e110640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd704003b10 0x7fd704003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e911640 1 -- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd704003b10 msgr2=0x7fd704003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:30.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e911640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd704003b10 0x7fd704003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e911640 1 -- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7040047d0 msgr2=0x7fd704004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:30.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e911640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e911640 1 -- 172.21.15.45:0/485570123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704003530 con 0x7fd704005180 2023-07-09T02:11:30.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71e110640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd704003b10 0x7fd704003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:30.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.016+0000 7fd71d90f640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:30.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71e911640 1 -- 172.21.15.45:0/485570123 reap_dead start 2023-07-09T02:11:30.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71e911640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd70400b990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7180671d0 tx=0x7fd71001f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b79c87043015e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7100ac650 con 0x7fd704005180 2023-07-09T02:11:30.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7100ac7d0 con 0x7fd704005180 2023-07-09T02:11:30.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71d10e640 1 -- 172.21.15.45:0/485570123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7100acb80 con 0x7fd704005180 2023-07-09T02:11:30.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71f112640 1 -- 172.21.15.45:0/485570123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 msgr2=0x7fd70400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71f112640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd70400b990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7180671d0 tx=0x7fd71001f9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71f112640 1 -- 172.21.15.45:0/485570123 shutdown_connections 2023-07-09T02:11:30.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71f112640 1 --2- 172.21.15.45:0/485570123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd70400b990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71f112640 1 -- 172.21.15.45:0/485570123 >> 172.21.15.45:0/485570123 conn(0x7fd7180999f0 msgr2=0x7fd7180d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:30.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71f112640 1 -- 172.21.15.45:0/485570123 shutdown_connections 2023-07-09T02:11:30.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.020+0000 7fd71f112640 1 -- 172.21.15.45:0/485570123 wait complete. 2023-07-09T02:11:30.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 Processor -- start 2023-07-09T02:11:30.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 -- start start 2023-07-09T02:11:30.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd718156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7180b2ac0 0x7fd7180c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd71806b610 0x7fd71806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71806bfc0 con 0x7fd704005180 2023-07-09T02:11:30.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180b35a0 con 0x7fd71806b610 2023-07-09T02:11:30.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180b1f60 con 0x7fd7180b2ac0 2023-07-09T02:11:30.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd718156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd718156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46728/0 (socket says 172.21.15.45:46728) 2023-07-09T02:11:30.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 -- 172.21.15.45:0/4155515592 learned_addr learned my addr 172.21.15.45:0/4155515592 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:30.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71d90f640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7180b2ac0 0x7fd7180c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e911640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd71806b610 0x7fd71806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 -- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7180b2ac0 msgr2=0x7fd7180c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7180b2ac0 0x7fd7180c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 -- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd71806b610 msgr2=0x7fd71806ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd71806b610 0x7fd71806ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 -- 172.21.15.45:0/4155515592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180b2230 con 0x7fd704005180 2023-07-09T02:11:30.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e911640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd71806b610 0x7fd71806ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:30.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71e110640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd718156bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd714010a00 tx=0x7fd714010ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd70effd640 1 -- 172.21.15.45:0/4155515592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71400ec80 con 0x7fd704005180 2023-07-09T02:11:30.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd70effd640 1 -- 172.21.15.45:0/4155515592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71400ee00 con 0x7fd704005180 2023-07-09T02:11:30.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd70effd640 1 -- 172.21.15.45:0/4155515592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71401c640 con 0x7fd704005180 2023-07-09T02:11:30.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7180b2510 con 0x7fd704005180 2023-07-09T02:11:30.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.024+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7180b3ad0 con 0x7fd704005180 2023-07-09T02:11:30.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.028+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7180ce190 con 0x7fd704005180 2023-07-09T02:11:30.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.028+0000 7fd70effd640 1 -- 172.21.15.45:0/4155515592 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd71401c7a0 con 0x7fd704005180 2023-07-09T02:11:30.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.028+0000 7fd70effd640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6fc0662b0 0x7fd6fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.028+0000 7fd70effd640 1 -- 172.21.15.45:0/4155515592 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7140843e0 con 0x7fd704005180 2023-07-09T02:11:30.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.028+0000 7fd71d90f640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6fc0662b0 0x7fd6fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.028+0000 7fd71d90f640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6fc0662b0 0x7fd6fc068760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd7180cc390 tx=0x7fd708009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.032+0000 7fd70effd640 1 -- 172.21.15.45:0/4155515592 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd714051850 con 0x7fd704005180 2023-07-09T02:11:30.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.188+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7180ce5f0 con 0x7fd704005180 2023-07-09T02:11:30.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.188+0000 7fd70effd640 1 -- 172.21.15.45:0/4155515592 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fd714054e70 con 0x7fd704005180 2023-07-09T02:11:30.192 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:30.193 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6fc0662b0 msgr2=0x7fd6fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6fc0662b0 0x7fd6fc068760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd7180cc390 tx=0x7fd708009040 comp rx=0 tx=0).stop 2023-07-09T02:11:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 msgr2=0x7fd718156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd718156bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd714010a00 tx=0x7fd714010ec0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 shutdown_connections 2023-07-09T02:11:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd71806b610 0x7fd71806ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6fc0662b0 0x7fd6fc068760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7180b2ac0 0x7fd7180c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 --2- 172.21.15.45:0/4155515592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd704005180 0x7fd718156bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 >> 172.21.15.45:0/4155515592 conn(0x7fd7180999f0 msgr2=0x7fd718158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:30.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 shutdown_connections 2023-07-09T02:11:30.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.192+0000 7fd71f112640 1 -- 172.21.15.45:0/4155515592 wait complete. 2023-07-09T02:11:30.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:30.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8baa9e640 1 Processor -- start 2023-07-09T02:11:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8baa9e640 1 -- start start 2023-07-09T02:11:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8baa9e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8b415c060 0x7fe8b40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8baa9e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe8b40d2620 0x7fe8b40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8baa9e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b4160a50 con 0x7fe8b40cd120 2023-07-09T02:11:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8baa9e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b415c430 con 0x7fe8b415c060 2023-07-09T02:11:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8baa9e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b415fb60 con 0x7fe8b40d2620 2023-07-09T02:11:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8b883a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8b415c060 0x7fe8b40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8b883a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8b415c060 0x7fe8b40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46730/0 (socket says 172.21.15.45:46730) 2023-07-09T02:11:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.356+0000 7fe8b883a640 1 -- 172.21.15.45:0/1726074268 learned_addr learned my addr 172.21.15.45:0/1726074268 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b903b640 1 --2- 172.21.15.45:0/1726074268 >> v2:172.21.15.155:3300/0 conn(0x7fe8b40d2620 0x7fe8b40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b883a640 1 -- 172.21.15.45:0/1726074268 >> v2:172.21.15.155:3300/0 conn(0x7fe8b40d2620 msgr2=0x7fe8b40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b883a640 1 --2- 172.21.15.45:0/1726074268 >> v2:172.21.15.155:3300/0 conn(0x7fe8b40d2620 0x7fe8b40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b883a640 1 -- 172.21.15.45:0/1726074268 >> v1:172.21.15.155:6789/0 conn(0x7fe8b40cd120 legacy=0x7fe8b40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b883a640 1 -- 172.21.15.45:0/1726074268 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b415fe40 con 0x7fe8b415c060 2023-07-09T02:11:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b883a640 1 --2- 172.21.15.45:0/1726074268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b415c060 0x7fe8b40b4ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe8b408bca0 tx=0x7fe8a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48529942ac4ea581 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b37fe640 1 -- 172.21.15.45:0/1726074268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80aa430 con 0x7fe8b415c060 2023-07-09T02:11:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b37fe640 1 -- 172.21.15.45:0/1726074268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a80aa590 con 0x7fe8b415c060 2023-07-09T02:11:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8b37fe640 1 -- 172.21.15.45:0/1726074268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80aa920 con 0x7fe8b415c060 2023-07-09T02:11:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1726074268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b415c060 msgr2=0x7fe8b40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.360+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1726074268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b415c060 0x7fe8b40b4ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe8b408bca0 tx=0x7fe8a801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1726074268 shutdown_connections 2023-07-09T02:11:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1726074268 >> v2:172.21.15.155:3300/0 conn(0x7fe8b40d2620 0x7fe8b40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1726074268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b415c060 0x7fe8b40b4ed0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1726074268 >> 172.21.15.45:0/1726074268 conn(0x7fe8b40698e0 msgr2=0x7fe8b4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1726074268 shutdown_connections 2023-07-09T02:11:30.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1726074268 wait complete. 2023-07-09T02:11:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 Processor -- start 2023-07-09T02:11:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 -- start start 2023-07-09T02:11:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b40cd120 0x7fe8b415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8b40d2620 0x7fe8b415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b415c060 0x7fe8b41572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b41617a0 con 0x7fe8b40cd120 2023-07-09T02:11:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b415d560 con 0x7fe8b415c060 2023-07-09T02:11:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8baa9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b415d840 con 0x7fe8b40d2620 2023-07-09T02:11:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b883a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b40cd120 0x7fe8b415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b883a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b40cd120 0x7fe8b415cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46734/0 (socket says 172.21.15.45:46734) 2023-07-09T02:11:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b883a640 1 -- 172.21.15.45:0/1918745481 learned_addr learned my addr 172.21.15.45:0/1918745481 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b903b640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b415c060 0x7fe8b41572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b3fff640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8b40d2620 0x7fe8b415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b883a640 1 -- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8b40d2620 msgr2=0x7fe8b415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b883a640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8b40d2620 0x7fe8b415ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b883a640 1 -- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b415c060 msgr2=0x7fe8b41572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b883a640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b415c060 0x7fe8b41572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b883a640 1 -- 172.21.15.45:0/1918745481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a80094d0 con 0x7fe8b40cd120 2023-07-09T02:11:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.364+0000 7fe8b3fff640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8b40d2620 0x7fe8b415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8b883a640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b40cd120 0x7fe8b415cf50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80190e0 tx=0x7fe8a801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8b17fa640 1 -- 172.21.15.45:0/1918745481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80aa430 con 0x7fe8b40cd120 2023-07-09T02:11:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8b17fa640 1 -- 172.21.15.45:0/1918745481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a80b3820 con 0x7fe8b40cd120 2023-07-09T02:11:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8b17fa640 1 -- 172.21.15.45:0/1918745481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80b3bd0 con 0x7fe8b40cd120 2023-07-09T02:11:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b40b59f0 con 0x7fe8b40cd120 2023-07-09T02:11:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b415de00 con 0x7fe8b40cd120 2023-07-09T02:11:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b4161600 con 0x7fe8b40cd120 2023-07-09T02:11:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8b17fa640 1 -- 172.21.15.45:0/1918745481 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8a80b3d30 con 0x7fe8b40cd120 2023-07-09T02:11:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8b17fa640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe898066280 0x7fe898068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8b17fa640 1 -- 172.21.15.45:0/1918745481 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8a811e1d0 con 0x7fe8b40cd120 2023-07-09T02:11:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.368+0000 7fe8b3fff640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe898066280 0x7fe898068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.372+0000 7fe8b3fff640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe898066280 0x7fe898068730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8b415d490 tx=0x7fe8a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.372+0000 7fe8b17fa640 1 -- 172.21.15.45:0/1918745481 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8b4161600 con 0x7fe8b40cd120 2023-07-09T02:11:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.528+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8b4161970 con 0x7fe8b40cd120 2023-07-09T02:11:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.528+0000 7fe8b17fa640 1 -- 172.21.15.45:0/1918745481 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8b4161970 con 0x7fe8b40cd120 2023-07-09T02:11:30.532 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe898066280 msgr2=0x7fe898068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe898066280 0x7fe898068730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8b415d490 tx=0x7fe8a0009040 comp rx=0 tx=0).stop 2023-07-09T02:11:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b40cd120 msgr2=0x7fe8b415cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b40cd120 0x7fe8b415cf50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80190e0 tx=0x7fe8a801ad10 comp rx=0 tx=0).stop 2023-07-09T02:11:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 shutdown_connections 2023-07-09T02:11:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8b415c060 0x7fe8b41572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe898066280 0x7fe898068730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8b40d2620 0x7fe8b415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 --2- 172.21.15.45:0/1918745481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8b40cd120 0x7fe8b415cf50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 >> 172.21.15.45:0/1918745481 conn(0x7fe8b40698e0 msgr2=0x7fe8b4069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 shutdown_connections 2023-07-09T02:11:30.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.532+0000 7fe8baa9e640 1 -- 172.21.15.45:0/1918745481 wait complete. 2023-07-09T02:11:30.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:30.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0ee7b640 1 Processor -- start 2023-07-09T02:11:30.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0ee7b640 1 -- start start 2023-07-09T02:11:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0ee7b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf0815c060 0x7fcf080b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0ee7b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf08160a50 con 0x7fcf080d2620 2023-07-09T02:11:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0ee7b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0815c430 con 0x7fcf080cd120 2023-07-09T02:11:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0ee7b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0815fb60 con 0x7fcf0815c060 2023-07-09T02:11:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0cc17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf0815c060 0x7fcf080b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0cc17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf0815c060 0x7fcf080b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46746/0 (socket says 172.21.15.45:46746) 2023-07-09T02:11:30.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0cc17640 1 -- 172.21.15.45:0/749034532 learned_addr learned my addr 172.21.15.45:0/749034532 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0cc17640 1 -- 172.21.15.45:0/749034532 >> v1:172.21.15.155:6789/0 conn(0x7fcf080cd120 legacy=0x7fcf080d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0cc17640 1 -- 172.21.15.45:0/749034532 >> v1:172.21.15.45:6789/0 conn(0x7fcf080d2620 legacy=0x7fcf080cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.696+0000 7fcf0cc17640 1 -- 172.21.15.45:0/749034532 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0815fe40 con 0x7fcf0815c060 2023-07-09T02:11:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf0cc17640 1 --2- 172.21.15.45:0/749034532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4ed0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009870 tx=0x7fcefc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d307fd521704858 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf077fe640 1 -- 172.21.15.45:0/749034532 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0aa670 con 0x7fcf0815c060 2023-07-09T02:11:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf077fe640 1 -- 172.21.15.45:0/749034532 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc0aa7d0 con 0x7fcf0815c060 2023-07-09T02:11:30.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf077fe640 1 -- 172.21.15.45:0/749034532 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0aab60 con 0x7fcf0815c060 2023-07-09T02:11:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/749034532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 msgr2=0x7fcf080b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf0ee7b640 1 --2- 172.21.15.45:0/749034532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4ed0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009870 tx=0x7fcefc01c510 comp rx=0 tx=0).stop 2023-07-09T02:11:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/749034532 shutdown_connections 2023-07-09T02:11:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf0ee7b640 1 --2- 172.21.15.45:0/749034532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4ed0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/749034532 >> 172.21.15.45:0/749034532 conn(0x7fcf080698e0 msgr2=0x7fcf08069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/749034532 shutdown_connections 2023-07-09T02:11:30.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.700+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/749034532 wait complete. 2023-07-09T02:11:30.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0ee7b640 1 Processor -- start 2023-07-09T02:11:30.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0ee7b640 1 -- start start 2023-07-09T02:11:30.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0ee7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf080cd120 0x7fcf08158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0ee7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf080d2620 0x7fcf080c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0ee7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0ee7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08158480 con 0x7fcf0815c060 2023-07-09T02:11:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0ee7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08157800 con 0x7fcf080cd120 2023-07-09T02:11:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0ee7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08157ae0 con 0x7fcf080d2620 2023-07-09T02:11:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46752/0 (socket says 172.21.15.45:46752) 2023-07-09T02:11:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 -- 172.21.15.45:0/3335012250 learned_addr learned my addr 172.21.15.45:0/3335012250 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:30.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0cc17640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf080cd120 0x7fcf08158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf07fff640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf080d2620 0x7fcf080c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 -- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf080d2620 msgr2=0x7fcf080c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf080d2620 0x7fcf080c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 -- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf080cd120 msgr2=0x7fcf08158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf080cd120 0x7fcf08158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 -- 172.21.15.45:0/3335012250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc0094d0 con 0x7fcf0815c060 2023-07-09T02:11:30.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf0d418640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4030 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c700 tx=0x7fcf0000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf057fa640 1 -- 172.21.15.45:0/3335012250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00003b80 con 0x7fcf0815c060 2023-07-09T02:11:30.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.704+0000 7fcf057fa640 1 -- 172.21.15.45:0/3335012250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf00003ce0 con 0x7fcf0815c060 2023-07-09T02:11:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.708+0000 7fcf057fa640 1 -- 172.21.15.45:0/3335012250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000aa90 con 0x7fcf0815c060 2023-07-09T02:11:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.708+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf080b59f0 con 0x7fcf0815c060 2023-07-09T02:11:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.708+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf081580a0 con 0x7fcf0815c060 2023-07-09T02:11:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.708+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0804d7d0 con 0x7fcf0815c060 2023-07-09T02:11:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.708+0000 7fcf057fa640 1 -- 172.21.15.45:0/3335012250 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf0000abf0 con 0x7fcf0815c060 2023-07-09T02:11:30.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.708+0000 7fcf057fa640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fceec066280 0x7fceec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.708+0000 7fcf057fa640 1 -- 172.21.15.45:0/3335012250 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf00083980 con 0x7fcf0815c060 2023-07-09T02:11:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.708+0000 7fcf0cc17640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fceec066280 0x7fceec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:30.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.712+0000 7fcf0cc17640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fceec066280 0x7fceec068730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0ae000 tx=0x7fcefc0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:30.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.712+0000 7fcf057fa640 1 -- 172.21.15.45:0/3335012250 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf00050ec0 con 0x7fcf0815c060 2023-07-09T02:11:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.868+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcf0806baa0 con 0x7fcf0815c060 2023-07-09T02:11:30.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.868+0000 7fcf057fa640 1 -- 172.21.15.45:0/3335012250 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf00083030 con 0x7fcf0815c060 2023-07-09T02:11:30.873 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:30.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fceec066280 msgr2=0x7fceec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fceec066280 0x7fceec068730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0ae000 tx=0x7fcefc0b5040 comp rx=0 tx=0).stop 2023-07-09T02:11:30.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 msgr2=0x7fcf080b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:30.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4030 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c700 tx=0x7fcf0000cbc0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 shutdown_connections 2023-07-09T02:11:30.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf0815c060 0x7fcf080b4030 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fceec066280 0x7fceec068730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf080d2620 0x7fcf080c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 --2- 172.21.15.45:0/3335012250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf080cd120 0x7fcf08158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:30.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 >> 172.21.15.45:0/3335012250 conn(0x7fcf080698e0 msgr2=0x7fcf080b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:30.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 shutdown_connections 2023-07-09T02:11:30.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:30.872+0000 7fcf0ee7b640 1 -- 172.21.15.45:0/3335012250 wait complete. 2023-07-09T02:11:30.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:31.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94fd3d2640 1 Processor -- start 2023-07-09T02:11:31.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94fd3d2640 1 -- start start 2023-07-09T02:11:31.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94fd3d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94f815c060 0x7f94f80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94fd3d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94f80cd120 0x7f94f80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94fd3d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94fd3d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f80d28f0 con 0x7f94f80cd120 2023-07-09T02:11:31.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94fd3d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f8160a50 con 0x7f94f815c060 2023-07-09T02:11:31.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94fd3d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f815c430 con 0x7f94f80d2450 2023-07-09T02:11:31.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94effff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94f80cd120 0x7f94f80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94effff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94f80cd120 0x7f94f80d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46760/0 (socket says 172.21.15.45:46760) 2023-07-09T02:11:31.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94effff640 1 -- 172.21.15.45:0/87075104 learned_addr learned my addr 172.21.15.45:0/87075104 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:31.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94f6ffd640 1 --2- 172.21.15.45:0/87075104 >> v2:172.21.15.155:3300/0 conn(0x7f94f815c060 0x7f94f80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94f77fe640 1 --2- 172.21.15.45:0/87075104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94effff640 1 -- 172.21.15.45:0/87075104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 msgr2=0x7f94f80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:31.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94effff640 1 --2- 172.21.15.45:0/87075104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94effff640 1 -- 172.21.15.45:0/87075104 >> v2:172.21.15.155:3300/0 conn(0x7f94f815c060 msgr2=0x7f94f80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:31.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94effff640 1 --2- 172.21.15.45:0/87075104 >> v2:172.21.15.155:3300/0 conn(0x7f94f815c060 0x7f94f80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94effff640 1 -- 172.21.15.45:0/87075104 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f815fb60 con 0x7f94f80cd120 2023-07-09T02:11:31.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.040+0000 7f94f77fe640 1 --2- 172.21.15.45:0/87075104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:31.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94effff640 1 --2- 172.21.15.45:0/87075104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cd120 0x7f94f80d1f10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94f80d3ad0 tx=0x7f94e001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec57ae692fb33ff server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94f67fc640 1 -- 172.21.15.45:0/87075104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00ab600 con 0x7f94f80cd120 2023-07-09T02:11:31.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94f67fc640 1 -- 172.21.15.45:0/87075104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e00a7050 con 0x7f94f80cd120 2023-07-09T02:11:31.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94f67fc640 1 -- 172.21.15.45:0/87075104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00ab980 con 0x7f94f80cd120 2023-07-09T02:11:31.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 -- 172.21.15.45:0/87075104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cd120 msgr2=0x7f94f80d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/87075104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cd120 0x7f94f80d1f10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94f80d3ad0 tx=0x7f94e001c210 comp rx=0 tx=0).stop 2023-07-09T02:11:31.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 -- 172.21.15.45:0/87075104 shutdown_connections 2023-07-09T02:11:31.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/87075104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/87075104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cd120 0x7f94f80d1f10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/87075104 >> v2:172.21.15.155:3300/0 conn(0x7f94f815c060 0x7f94f80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 -- 172.21.15.45:0/87075104 >> 172.21.15.45:0/87075104 conn(0x7f94f80698e0 msgr2=0x7f94f8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:31.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 -- 172.21.15.45:0/87075104 shutdown_connections 2023-07-09T02:11:31.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 -- 172.21.15.45:0/87075104 wait complete. 2023-07-09T02:11:31.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 Processor -- start 2023-07-09T02:11:31.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.044+0000 7f94fd3d2640 1 -- start start 2023-07-09T02:11:31.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f80cd120 0x7f94f8151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f815c060 0x7f94f81536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f815f070 con 0x7f94f815c060 2023-07-09T02:11:31.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f815e460 con 0x7f94f80cd120 2023-07-09T02:11:31.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f815e740 con 0x7f94f80d2450 2023-07-09T02:11:31.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f815c060 0x7f94f81536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f815c060 0x7f94f81536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46776/0 (socket says 172.21.15.45:46776) 2023-07-09T02:11:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 -- 172.21.15.45:0/2555971208 learned_addr learned my addr 172.21.15.45:0/2555971208 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94effff640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f6ffd640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f80cd120 0x7f94f8151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 -- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 msgr2=0x7f94f80c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 -- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f80cd120 msgr2=0x7f94f8151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f80cd120 0x7f94f8151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 -- 172.21.15.45:0/2555971208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00094d0 con 0x7f94f815c060 2023-07-09T02:11:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94f77fe640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f815c060 0x7f94f81536d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94f000cef0 tx=0x7f94f000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94ef7fe640 1 -- 172.21.15.45:0/2555971208 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f000d840 con 0x7f94f815c060 2023-07-09T02:11:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94ef7fe640 1 -- 172.21.15.45:0/2555971208 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f000d9a0 con 0x7f94f815c060 2023-07-09T02:11:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94ef7fe640 1 -- 172.21.15.45:0/2555971208 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f000dd50 con 0x7f94f815c060 2023-07-09T02:11:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f815ea20 con 0x7f94f815c060 2023-07-09T02:11:31.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f80c8d60 con 0x7f94f815c060 2023-07-09T02:11:31.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.048+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f815f1e0 con 0x7f94f815c060 2023-07-09T02:11:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.052+0000 7f94ef7fe640 1 -- 172.21.15.45:0/2555971208 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94f001e3b0 con 0x7f94f815c060 2023-07-09T02:11:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.052+0000 7f94ef7fe640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f94d8066280 0x7f94d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.052+0000 7f94ef7fe640 1 -- 172.21.15.45:0/2555971208 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94f00846c0 con 0x7f94f815c060 2023-07-09T02:11:31.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.052+0000 7f94f6ffd640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f94d8066280 0x7f94d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.052+0000 7f94f6ffd640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f94d8066280 0x7f94d8068730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94f80ccd40 tx=0x7f94e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.056+0000 7f94ef7fe640 1 -- 172.21.15.45:0/2555971208 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94f0051bd0 con 0x7f94f815c060 2023-07-09T02:11:31.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.208+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94f804d7d0 con 0x7f94f815c060 2023-07-09T02:11:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.208+0000 7f94ef7fe640 1 -- 172.21.15.45:0/2555971208 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94f00551f0 con 0x7f94f815c060 2023-07-09T02:11:31.212 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f94d8066280 msgr2=0x7f94d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f94d8066280 0x7f94d8068730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94f80ccd40 tx=0x7f94e8008040 comp rx=0 tx=0).stop 2023-07-09T02:11:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f815c060 msgr2=0x7f94f81536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f815c060 0x7f94f81536d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94f000cef0 tx=0x7f94f000a710 comp rx=0 tx=0).stop 2023-07-09T02:11:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 shutdown_connections 2023-07-09T02:11:31.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f815c060 0x7f94f81536d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f94d8066280 0x7f94d8068730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94f80d2450 0x7f94f80c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 --2- 172.21.15.45:0/2555971208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94f80cd120 0x7f94f8151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 >> 172.21.15.45:0/2555971208 conn(0x7f94f80698e0 msgr2=0x7f94f80b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 shutdown_connections 2023-07-09T02:11:31.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.212+0000 7f94fd3d2640 1 -- 172.21.15.45:0/2555971208 wait complete. 2023-07-09T02:11:31.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:31.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f392d8640 1 Processor -- start 2023-07-09T02:11:31.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f392d8640 1 -- start start 2023-07-09T02:11:31.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f392d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0f3415c060 0x7f0f340b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f392d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f340cd120 0x7f0f340d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f392d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f34160a50 con 0x7f0f340d2450 2023-07-09T02:11:31.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f392d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340d28d0 con 0x7f0f340cd120 2023-07-09T02:11:31.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f392d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340cfe40 con 0x7f0f3415c060 2023-07-09T02:11:31.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f327fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f340cd120 0x7f0f340d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f327fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f340cd120 0x7f0f340d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46782/0 (socket says 172.21.15.45:46782) 2023-07-09T02:11:31.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f327fc640 1 -- 172.21.15.45:0/1038626364 learned_addr learned my addr 172.21.15.45:0/1038626364 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:31.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f337fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0f340d2450 0x7f0f340d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48994/0 (socket says 172.21.15.45:48994) 2023-07-09T02:11:31.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f32ffd640 1 --2- 172.21.15.45:0/1038626364 >> v2:172.21.15.155:3300/0 conn(0x7f0f3415c060 0x7f0f340b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f327fc640 1 -- 172.21.15.45:0/1038626364 >> v2:172.21.15.155:3300/0 conn(0x7f0f3415c060 msgr2=0x7f0f340b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:31.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f327fc640 1 --2- 172.21.15.45:0/1038626364 >> v2:172.21.15.155:3300/0 conn(0x7f0f3415c060 0x7f0f340b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f327fc640 1 -- 172.21.15.45:0/1038626364 >> v1:172.21.15.45:6789/0 conn(0x7f0f340d2450 legacy=0x7f0f340d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f327fc640 1 -- 172.21.15.45:0/1038626364 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3415c430 con 0x7f0f340cd120 2023-07-09T02:11:31.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.376+0000 7f0f31ffb640 1 -- 172.21.15.45:0/1038626364 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000218012 0 0) 0x7f0f34160a50 con 0x7f0f340d2450 2023-07-09T02:11:31.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f327fc640 1 --2- 172.21.15.45:0/1038626364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340cd120 0x7f0f340d1f10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0f340d3ad0 tx=0x7f0f2801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bb3050bfd9e81 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f31ffb640 1 -- 172.21.15.45:0/1038626364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280ab5f0 con 0x7f0f340cd120 2023-07-09T02:11:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f31ffb640 1 -- 172.21.15.45:0/1038626364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f280ab750 con 0x7f0f340cd120 2023-07-09T02:11:31.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f31ffb640 1 -- 172.21.15.45:0/1038626364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280abae0 con 0x7f0f340cd120 2023-07-09T02:11:31.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f392d8640 1 -- 172.21.15.45:0/1038626364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340cd120 msgr2=0x7f0f340d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f392d8640 1 --2- 172.21.15.45:0/1038626364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340cd120 0x7f0f340d1f10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0f340d3ad0 tx=0x7f0f2801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f392d8640 1 -- 172.21.15.45:0/1038626364 shutdown_connections 2023-07-09T02:11:31.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f392d8640 1 --2- 172.21.15.45:0/1038626364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340cd120 0x7f0f340d1f10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f392d8640 1 --2- 172.21.15.45:0/1038626364 >> v2:172.21.15.155:3300/0 conn(0x7f0f3415c060 0x7f0f340b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f392d8640 1 -- 172.21.15.45:0/1038626364 >> 172.21.15.45:0/1038626364 conn(0x7f0f340698e0 msgr2=0x7f0f34069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:31.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f392d8640 1 -- 172.21.15.45:0/1038626364 shutdown_connections 2023-07-09T02:11:31.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.380+0000 7f0f392d8640 1 -- 172.21.15.45:0/1038626364 wait complete. 2023-07-09T02:11:31.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 Processor -- start 2023-07-09T02:11:31.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 -- start start 2023-07-09T02:11:31.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f340cd120 0x7f0f3415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340d2450 0x7f0f34156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3415c060 0x7f0f341599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34157260 con 0x7f0f340d2450 2023-07-09T02:11:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34156790 con 0x7f0f3415c060 2023-07-09T02:11:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341569c0 con 0x7f0f340cd120 2023-07-09T02:11:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340d2450 0x7f0f34156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340d2450 0x7f0f34156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46788/0 (socket says 172.21.15.45:46788) 2023-07-09T02:11:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 -- 172.21.15.45:0/414431625 learned_addr learned my addr 172.21.15.45:0/414431625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:31.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f32ffd640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f340cd120 0x7f0f3415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f337fe640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3415c060 0x7f0f341599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 -- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f340cd120 msgr2=0x7f0f3415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f340cd120 0x7f0f3415ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 -- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3415c060 msgr2=0x7f0f341599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3415c060 0x7f0f341599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 -- 172.21.15.45:0/414431625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280094d0 con 0x7f0f340d2450 2023-07-09T02:11:31.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f337fe640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3415c060 0x7f0f341599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:31.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f327fc640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340d2450 0x7f0f34156250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f2801ab80 tx=0x7f0f2801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f1b7fe640 1 -- 172.21.15.45:0/414431625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280abcd0 con 0x7f0f340d2450 2023-07-09T02:11:31.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f1b7fe640 1 -- 172.21.15.45:0/414431625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f280b8070 con 0x7f0f340d2450 2023-07-09T02:11:31.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f1b7fe640 1 -- 172.21.15.45:0/414431625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28004220 con 0x7f0f340d2450 2023-07-09T02:11:31.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f34156ca0 con 0x7f0f340d2450 2023-07-09T02:11:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.384+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f340c9cb0 con 0x7f0f340d2450 2023-07-09T02:11:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.388+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f340c9ef0 con 0x7f0f340d2450 2023-07-09T02:11:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.388+0000 7f0f1b7fe640 1 -- 172.21.15.45:0/414431625 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f28004380 con 0x7f0f340d2450 2023-07-09T02:11:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.388+0000 7f0f1b7fe640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f20066280 0x7f0f20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.388+0000 7f0f1b7fe640 1 -- 172.21.15.45:0/414431625 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f280a8050 con 0x7f0f340d2450 2023-07-09T02:11:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.388+0000 7f0f32ffd640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f20066280 0x7f0f20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.388+0000 7f0f32ffd640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f20066280 0x7f0f20068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f240079c0 tx=0x7f0f24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.392+0000 7f0f1b7fe640 1 -- 172.21.15.45:0/414431625 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f340c9ef0 con 0x7f0f340d2450 2023-07-09T02:11:31.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f340c9ef0 con 0x7f0f340d2450 2023-07-09T02:11:31.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f1b7fe640 1 -- 172.21.15.45:0/414431625 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f340c9ef0 con 0x7f0f340d2450 2023-07-09T02:11:31.550 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:31.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f20066280 msgr2=0x7f0f20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f20066280 0x7f0f20068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f240079c0 tx=0x7f0f24008040 comp rx=0 tx=0).stop 2023-07-09T02:11:31.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340d2450 msgr2=0x7f0f34156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340d2450 0x7f0f34156250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f2801ab80 tx=0x7f0f2801ad10 comp rx=0 tx=0).stop 2023-07-09T02:11:31.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 shutdown_connections 2023-07-09T02:11:31.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3415c060 0x7f0f341599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f340d2450 0x7f0f34156250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0f20066280 0x7f0f20068730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 --2- 172.21.15.45:0/414431625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f340cd120 0x7f0f3415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 >> 172.21.15.45:0/414431625 conn(0x7f0f340698e0 msgr2=0x7f0f340b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 shutdown_connections 2023-07-09T02:11:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.548+0000 7f0f392d8640 1 -- 172.21.15.45:0/414431625 wait complete. 2023-07-09T02:11:31.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:11:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.712+0000 7eff3487b640 1 Processor -- start 2023-07-09T02:11:31.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.712+0000 7eff3487b640 1 -- start start 2023-07-09T02:11:31.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff3487b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3006c110 0x7eff3006c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff3487b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff300caec0 0x7eff300cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff3487b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3006caa0 con 0x7eff30158e30 2023-07-09T02:11:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff3487b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff300ccf80 con 0x7eff300caec0 2023-07-09T02:11:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff3487b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff300cd540 con 0x7eff3006c110 2023-07-09T02:11:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff30158e30 0x7eff3006f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48974/0 (socket says 172.21.15.45:48974) 2023-07-09T02:11:31.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2e59c640 1 -- 172.21.15.45:0/735676901 learned_addr learned my addr 172.21.15.45:0/735676901 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff27fff640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3006c110 0x7eff3006c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2ed9d640 1 --2- 172.21.15.45:0/735676901 >> v2:172.21.15.155:3300/0 conn(0x7eff300caec0 0x7eff300cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306587700 0 0) 0x7eff20001120 con 0x7eff30158e30 2023-07-09T02:11:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff1c003530 con 0x7eff30158e30 2023-07-09T02:11:31.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1824296420 0 0) 0x7eff1c003530 con 0x7eff30158e30 2023-07-09T02:11:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3006c110 msgr2=0x7eff3006c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3006c110 0x7eff3006c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 >> v2:172.21.15.155:3300/0 conn(0x7eff300caec0 msgr2=0x7eff300cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 --2- 172.21.15.45:0/735676901 >> v2:172.21.15.155:3300/0 conn(0x7eff300caec0 0x7eff300cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300cb880 con 0x7eff30158e30 2023-07-09T02:11:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7eff20001810 con 0x7eff30158e30 2023-07-09T02:11:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 >> v1:172.21.15.45:6789/0 conn(0x7eff30158e30 legacy=0x7eff3006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3006c110 0x7eff1c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff1c003f00 0x7eff1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff300ccf80 con 0x7eff1c004d10 2023-07-09T02:11:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff300cd540 con 0x7eff1c003f00 2023-07-09T02:11:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c00dbd0 con 0x7eff3006c110 2023-07-09T02:11:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2ed9d640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2e59c640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3006c110 0x7eff1c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff27fff640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff1c003f00 0x7eff1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2ed9d640 1 -- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3006c110 msgr2=0x7eff1c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:31.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2ed9d640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff3006c110 0x7eff1c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2ed9d640 1 -- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff1c003f00 msgr2=0x7eff1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2ed9d640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff1c003f00 0x7eff1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.716+0000 7eff2ed9d640 1 -- 172.21.15.45:0/735676901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c003530 con 0x7eff1c004d10 2023-07-09T02:11:31.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff2ed9d640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff1c005180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff28009fc0 tx=0x7eff2801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8063b98ea4c9ddee server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280a5ba0 con 0x7eff1c004d10 2023-07-09T02:11:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2800f040 con 0x7eff1c004d10 2023-07-09T02:11:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff2dd9b640 1 -- 172.21.15.45:0/735676901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280ad440 con 0x7eff1c004d10 2023-07-09T02:11:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff3487b640 1 -- 172.21.15.45:0/735676901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 msgr2=0x7eff1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff3487b640 1 --2- 172.21.15.45:0/735676901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff1c005180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff28009fc0 tx=0x7eff2801cc40 comp rx=0 tx=0).stop 2023-07-09T02:11:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff2ed9d640 1 -- 172.21.15.45:0/735676901 reap_dead start 2023-07-09T02:11:31.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff3487b640 1 -- 172.21.15.45:0/735676901 shutdown_connections 2023-07-09T02:11:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff3487b640 1 -- 172.21.15.45:0/735676901 >> 172.21.15.45:0/735676901 conn(0x7eff300694b0 msgr2=0x7eff300698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff3487b640 1 -- 172.21.15.45:0/735676901 shutdown_connections 2023-07-09T02:11:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.720+0000 7eff3487b640 1 -- 172.21.15.45:0/735676901 wait complete. 2023-07-09T02:11:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 Processor -- start 2023-07-09T02:11:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 -- start start 2023-07-09T02:11:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff30156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff301510d0 0x7eff3014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff300c6c60 0x7eff30070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff301f18a0 con 0x7eff1c004d10 2023-07-09T02:11:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff30156d40 con 0x7eff300c6c60 2023-07-09T02:11:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff30157020 con 0x7eff301510d0 2023-07-09T02:11:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff30156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff30156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34672/0 (socket says 172.21.15.45:34672) 2023-07-09T02:11:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 -- 172.21.15.45:0/1535396246 learned_addr learned my addr 172.21.15.45:0/1535396246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2ed9d640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff300c6c60 0x7eff30070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff27fff640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff301510d0 0x7eff3014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 -- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff301510d0 msgr2=0x7eff3014c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff301510d0 0x7eff3014c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 -- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff300c6c60 msgr2=0x7eff30070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff300c6c60 0x7eff30070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 -- 172.21.15.45:0/1535396246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff30157300 con 0x7eff1c004d10 2023-07-09T02:11:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff2e59c640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff30156760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff20012510 tx=0x7eff20012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff26ffd640 1 -- 172.21.15.45:0/1535396246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20014750 con 0x7eff1c004d10 2023-07-09T02:11:31.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff26ffd640 1 -- 172.21.15.45:0/1535396246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff200148b0 con 0x7eff1c004d10 2023-07-09T02:11:31.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff301575e0 con 0x7eff1c004d10 2023-07-09T02:11:31.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff26ffd640 1 -- 172.21.15.45:0/1535396246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20014c60 con 0x7eff1c004d10 2023-07-09T02:11:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff300c70d0 con 0x7eff1c004d10 2023-07-09T02:11:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.724+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3004d7d0 con 0x7eff1c004d10 2023-07-09T02:11:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.728+0000 7eff26ffd640 1 -- 172.21.15.45:0/1535396246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff200153e0 con 0x7eff1c004d10 2023-07-09T02:11:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.728+0000 7eff26ffd640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff100662b0 0x7eff10068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:31.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.728+0000 7eff26ffd640 1 -- 172.21.15.45:0/1535396246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff200861d0 con 0x7eff1c004d10 2023-07-09T02:11:31.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.728+0000 7eff27fff640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff100662b0 0x7eff10068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:31.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.728+0000 7eff27fff640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff100662b0 0x7eff10068760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff300c8790 tx=0x7eff18009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:31.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.732+0000 7eff26ffd640 1 -- 172.21.15.45:0/1535396246 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff200536f0 con 0x7eff1c004d10 2023-07-09T02:11:31.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.916+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff3006caa0 con 0x7eff1c004d10 2023-07-09T02:11:31.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.916+0000 7eff26ffd640 1 -- 172.21.15.45:0/1535396246 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7eff3006caa0 con 0x7eff1c004d10 2023-07-09T02:11:31.922 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:31.922 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:11:17.535245+0000","modified":"2023-07-09T02:11:21.190690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T02:11:31.923 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-07-09T02:11:31.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff100662b0 msgr2=0x7eff10068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff100662b0 0x7eff10068760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff300c8790 tx=0x7eff18009190 comp rx=0 tx=0).stop 2023-07-09T02:11:31.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 msgr2=0x7eff30156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:31.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff30156760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff20012510 tx=0x7eff20012910 comp rx=0 tx=0).stop 2023-07-09T02:11:31.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 shutdown_connections 2023-07-09T02:11:31.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff300c6c60 0x7eff30070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff100662b0 0x7eff10068760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff301510d0 0x7eff3014c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 --2- 172.21.15.45:0/1535396246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff1c004d10 0x7eff30156760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:31.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 >> 172.21.15.45:0/1535396246 conn(0x7eff300694b0 msgr2=0x7eff30153600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:31.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 shutdown_connections 2023-07-09T02:11:31.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:31.920+0000 7eff3487b640 1 -- 172.21.15.45:0/1535396246 wait complete. 2023-07-09T02:11:31.941 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:32.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74d49e8640 1 Processor -- start 2023-07-09T02:11:32.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74d49e8640 1 -- start start 2023-07-09T02:11:32.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74d49e8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74d0159f40 0x7f74d015da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74d49e8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74d0099f40 0x7f74d015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74d49e8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d00d0500 con 0x7f74d00d0020 2023-07-09T02:11:32.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74d49e8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00d11c0 con 0x7f74d0099f40 2023-07-09T02:11:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74d49e8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00d14a0 con 0x7f74d0159f40 2023-07-09T02:11:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74c7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74d0099f40 0x7f74d015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74c7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74d0099f40 0x7f74d015df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34688/0 (socket says 172.21.15.45:34688) 2023-07-09T02:11:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74cf59e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f74d00d0020 0x7f74d015a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48982/0 (socket says 172.21.15.45:48982) 2023-07-09T02:11:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74c7fff640 1 -- 172.21.15.45:0/3149749609 learned_addr learned my addr 172.21.15.45:0/3149749609 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74ced9d640 1 --2- 172.21.15.45:0/3149749609 >> v2:172.21.15.155:3300/0 conn(0x7f74d0159f40 0x7f74d015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74c7fff640 1 -- 172.21.15.45:0/3149749609 >> v2:172.21.15.155:3300/0 conn(0x7f74d0159f40 msgr2=0x7f74d015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74c7fff640 1 --2- 172.21.15.45:0/3149749609 >> v2:172.21.15.155:3300/0 conn(0x7f74d0159f40 0x7f74d015da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74c7fff640 1 -- 172.21.15.45:0/3149749609 >> v1:172.21.15.45:6789/0 conn(0x7f74d00d0020 legacy=0x7f74d015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74c7fff640 1 -- 172.21.15.45:0/3149749609 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d00ce340 con 0x7f74d0099f40 2023-07-09T02:11:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.084+0000 7f74ced9d640 1 --2- 172.21.15.45:0/3149749609 >> v2:172.21.15.155:3300/0 conn(0x7f74d0159f40 0x7f74d015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:32.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74c7fff640 1 --2- 172.21.15.45:0/3149749609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d0099f40 0x7f74d015df50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74d006cc60 tx=0x7f74b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6136acc714742c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74ce59c640 1 -- 172.21.15.45:0/3149749609 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80aa430 con 0x7f74d0099f40 2023-07-09T02:11:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74ce59c640 1 -- 172.21.15.45:0/3149749609 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80aa590 con 0x7f74d0099f40 2023-07-09T02:11:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74ce59c640 1 -- 172.21.15.45:0/3149749609 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80aa920 con 0x7f74d0099f40 2023-07-09T02:11:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74d49e8640 1 -- 172.21.15.45:0/3149749609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d0099f40 msgr2=0x7f74d015df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74d49e8640 1 --2- 172.21.15.45:0/3149749609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d0099f40 0x7f74d015df50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f74d006cc60 tx=0x7f74b801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74d49e8640 1 -- 172.21.15.45:0/3149749609 shutdown_connections 2023-07-09T02:11:32.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74d49e8640 1 --2- 172.21.15.45:0/3149749609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d0099f40 0x7f74d015df50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74d49e8640 1 --2- 172.21.15.45:0/3149749609 >> v2:172.21.15.155:3300/0 conn(0x7f74d0159f40 0x7f74d015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74d49e8640 1 -- 172.21.15.45:0/3149749609 >> 172.21.15.45:0/3149749609 conn(0x7f74d00999f0 msgr2=0x7f74d00d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74d49e8640 1 -- 172.21.15.45:0/3149749609 shutdown_connections 2023-07-09T02:11:32.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.088+0000 7f74d49e8640 1 -- 172.21.15.45:0/3149749609 wait complete. 2023-07-09T02:11:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 Processor -- start 2023-07-09T02:11:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 -- start start 2023-07-09T02:11:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d0099f40 0x7f74d0158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d00d0020 0x7f74d0151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d0159f40 0x7f74d014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d0151ea0 con 0x7f74d00d0020 2023-07-09T02:11:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d0152170 con 0x7f74d0159f40 2023-07-09T02:11:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d0152450 con 0x7f74d0099f40 2023-07-09T02:11:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d00d0020 0x7f74d0151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d00d0020 0x7f74d0151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34692/0 (socket says 172.21.15.45:34692) 2023-07-09T02:11:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 -- 172.21.15.45:0/1210430062 learned_addr learned my addr 172.21.15.45:0/1210430062 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74cf59e640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d0159f40 0x7f74d014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74ced9d640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d0099f40 0x7f74d0158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 -- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d0099f40 msgr2=0x7f74d0158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d0099f40 0x7f74d0158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 -- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d0159f40 msgr2=0x7f74d014cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d0159f40 0x7f74d014cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 -- 172.21.15.45:0/1210430062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80094d0 con 0x7f74d00d0020 2023-07-09T02:11:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c7fff640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d00d0020 0x7f74d0151960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74b80190e0 tx=0x7f74b801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c77fe640 1 -- 172.21.15.45:0/1210430062 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80b3800 con 0x7f74d00d0020 2023-07-09T02:11:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c77fe640 1 -- 172.21.15.45:0/1210430062 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80b3960 con 0x7f74d00d0020 2023-07-09T02:11:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74c77fe640 1 -- 172.21.15.45:0/1210430062 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80b3d10 con 0x7f74d00d0020 2023-07-09T02:11:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d0152730 con 0x7f74d00d0020 2023-07-09T02:11:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d0152cf0 con 0x7f74d00d0020 2023-07-09T02:11:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.092+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d00ce190 con 0x7f74d00d0020 2023-07-09T02:11:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.096+0000 7f74c77fe640 1 -- 172.21.15.45:0/1210430062 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74b80b2380 con 0x7f74d00d0020 2023-07-09T02:11:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.096+0000 7f74c77fe640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74b0066280 0x7f74b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.096+0000 7f74c77fe640 1 -- 172.21.15.45:0/1210430062 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74b811e3e0 con 0x7f74d00d0020 2023-07-09T02:11:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.096+0000 7f74ced9d640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74b0066280 0x7f74b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.096+0000 7f74ced9d640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74b0066280 0x7f74b0068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f74d00c7480 tx=0x7f74c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.100+0000 7f74c77fe640 1 -- 172.21.15.45:0/1210430062 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74b80eb900 con 0x7f74d00d0020 2023-07-09T02:11:32.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.256+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74d0073bf0 con 0x7f74d00d0020 2023-07-09T02:11:32.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.256+0000 7f74c77fe640 1 -- 172.21.15.45:0/1210430062 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f74b80eef20 con 0x7f74d00d0020 2023-07-09T02:11:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:32.261 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74b0066280 msgr2=0x7f74b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74b0066280 0x7f74b0068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f74d00c7480 tx=0x7f74c0008040 comp rx=0 tx=0).stop 2023-07-09T02:11:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d00d0020 msgr2=0x7f74d0151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d00d0020 0x7f74d0151960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f74b80190e0 tx=0x7f74b801ad10 comp rx=0 tx=0).stop 2023-07-09T02:11:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 shutdown_connections 2023-07-09T02:11:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d0159f40 0x7f74d014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d00d0020 0x7f74d0151960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74b0066280 0x7f74b0068730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 --2- 172.21.15.45:0/1210430062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d0099f40 0x7f74d0158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 >> 172.21.15.45:0/1210430062 conn(0x7f74d00999f0 msgr2=0x7f74d015bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:32.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 shutdown_connections 2023-07-09T02:11:32.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.260+0000 7f74d49e8640 1 -- 172.21.15.45:0/1210430062 wait complete. 2023-07-09T02:11:32.282 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:11:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd55707b640 1 Processor -- start 2023-07-09T02:11:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd55707b640 1 -- start start 2023-07-09T02:11:32.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd55707b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd55015c060 0x7fd5500b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd55707b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5500d2620 0x7fd5500cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd55707b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd550160a50 con 0x7fd5500cd120 2023-07-09T02:11:32.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd55707b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55015c430 con 0x7fd55015c060 2023-07-09T02:11:32.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd55707b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55015fb60 con 0x7fd5500d2620 2023-07-09T02:11:32.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd554e17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd55015c060 0x7fd5500b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd554e17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd55015c060 0x7fd5500b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34696/0 (socket says 172.21.15.45:34696) 2023-07-09T02:11:32.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd54ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd5500cd120 0x7fd5500d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48996/0 (socket says 172.21.15.45:48996) 2023-07-09T02:11:32.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd554e17640 1 -- 172.21.15.45:0/3028778137 learned_addr learned my addr 172.21.15.45:0/3028778137 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd554e17640 1 -- 172.21.15.45:0/3028778137 >> v2:172.21.15.155:3300/0 conn(0x7fd5500d2620 msgr2=0x7fd5500cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd554e17640 1 --2- 172.21.15.45:0/3028778137 >> v2:172.21.15.155:3300/0 conn(0x7fd5500d2620 0x7fd5500cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd554e17640 1 -- 172.21.15.45:0/3028778137 >> v1:172.21.15.45:6789/0 conn(0x7fd5500cd120 legacy=0x7fd5500d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.424+0000 7fd554e17640 1 -- 172.21.15.45:0/3028778137 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55015fe40 con 0x7fd55015c060 2023-07-09T02:11:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd554e17640 1 --2- 172.21.15.45:0/3028778137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b4ed0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd55008bca0 tx=0x7fd54401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd3887271fafb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd54f7fe640 1 -- 172.21.15.45:0/3028778137 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440aa650 con 0x7fd55015c060 2023-07-09T02:11:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd54f7fe640 1 -- 172.21.15.45:0/3028778137 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5440aa7b0 con 0x7fd55015c060 2023-07-09T02:11:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd54f7fe640 1 -- 172.21.15.45:0/3028778137 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440aab40 con 0x7fd55015c060 2023-07-09T02:11:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd55707b640 1 -- 172.21.15.45:0/3028778137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 msgr2=0x7fd5500b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd55707b640 1 --2- 172.21.15.45:0/3028778137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b4ed0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd55008bca0 tx=0x7fd54401c4f0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd55707b640 1 -- 172.21.15.45:0/3028778137 shutdown_connections 2023-07-09T02:11:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd55707b640 1 --2- 172.21.15.45:0/3028778137 >> v2:172.21.15.155:3300/0 conn(0x7fd5500d2620 0x7fd5500cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd55707b640 1 --2- 172.21.15.45:0/3028778137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b4ed0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd55707b640 1 -- 172.21.15.45:0/3028778137 >> 172.21.15.45:0/3028778137 conn(0x7fd5500698e0 msgr2=0x7fd550069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd55707b640 1 -- 172.21.15.45:0/3028778137 shutdown_connections 2023-07-09T02:11:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.428+0000 7fd55707b640 1 -- 172.21.15.45:0/3028778137 wait complete. 2023-07-09T02:11:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 Processor -- start 2023-07-09T02:11:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 -- start start 2023-07-09T02:11:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5500cd120 0x7fd55015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5500d2620 0x7fd550151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550153760 con 0x7fd55015c060 2023-07-09T02:11:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55015a8f0 con 0x7fd5500cd120 2023-07-09T02:11:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55015abd0 con 0x7fd5500d2620 2023-07-09T02:11:32.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd555618640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd554e17640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5500cd120 0x7fd55015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd555618640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34706/0 (socket says 172.21.15.45:34706) 2023-07-09T02:11:32.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd555618640 1 -- 172.21.15.45:0/3813759671 learned_addr learned my addr 172.21.15.45:0/3813759671 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:32.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd54ffff640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5500d2620 0x7fd550151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd554e17640 1 -- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5500d2620 msgr2=0x7fd550151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd554e17640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5500d2620 0x7fd550151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd554e17640 1 -- 172.21.15.45:0/3813759671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 msgr2=0x7fd5500b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd554e17640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd554e17640 1 -- 172.21.15.45:0/3813759671 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440094d0 con 0x7fd5500cd120 2023-07-09T02:11:32.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd555618640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd554e17640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5500cd120 0x7fd55015b440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5440ab000 tx=0x7fd54401ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd54d7fa640 1 -- 172.21.15.45:0/3813759671 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440b3800 con 0x7fd5500cd120 2023-07-09T02:11:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd54d7fa640 1 -- 172.21.15.45:0/3813759671 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5440b3960 con 0x7fd5500cd120 2023-07-09T02:11:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd54d7fa640 1 -- 172.21.15.45:0/3813759671 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440b3d10 con 0x7fd5500cd120 2023-07-09T02:11:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5500b59f0 con 0x7fd5500cd120 2023-07-09T02:11:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.432+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5501533f0 con 0x7fd5500cd120 2023-07-09T02:11:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.436+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55004d7d0 con 0x7fd5500cd120 2023-07-09T02:11:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.436+0000 7fd54d7fa640 1 -- 172.21.15.45:0/3813759671 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5440059a0 con 0x7fd5500cd120 2023-07-09T02:11:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.436+0000 7fd54d7fa640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd534066280 0x7fd534068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.436+0000 7fd54d7fa640 1 -- 172.21.15.45:0/3813759671 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd54411e4c0 con 0x7fd5500cd120 2023-07-09T02:11:32.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.436+0000 7fd54ffff640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd534066280 0x7fd534068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:32.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.436+0000 7fd54ffff640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd534066280 0x7fd534068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5500c9320 tx=0x7fd53c007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:32.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.440+0000 7fd54d7fa640 1 -- 172.21.15.45:0/3813759671 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5440eb9d0 con 0x7fd5500cd120 2023-07-09T02:11:32.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.628+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd55006baa0 con 0x7fd5500cd120 2023-07-09T02:11:32.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.628+0000 7fd54d7fa640 1 -- 172.21.15.45:0/3813759671 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fd5440eeff0 con 0x7fd5500cd120 2023-07-09T02:11:32.632 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:32.632 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:11:17.535245+0000","modified":"2023-07-09T02:11:21.190690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T02:11:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-07-09T02:11:32.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd534066280 msgr2=0x7fd534068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd534066280 0x7fd534068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5500c9320 tx=0x7fd53c007e50 comp rx=0 tx=0).stop 2023-07-09T02:11:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5500cd120 msgr2=0x7fd55015b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5500cd120 0x7fd55015b440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5440ab000 tx=0x7fd54401ad30 comp rx=0 tx=0).stop 2023-07-09T02:11:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 shutdown_connections 2023-07-09T02:11:32.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015c060 0x7fd5500b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd534066280 0x7fd534068730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5500d2620 0x7fd550151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 --2- 172.21.15.45:0/3813759671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5500cd120 0x7fd55015b440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:32.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 >> 172.21.15.45:0/3813759671 conn(0x7fd5500698e0 msgr2=0x7fd5500b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 shutdown_connections 2023-07-09T02:11:32.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:32.632+0000 7fd55707b640 1 -- 172.21.15.45:0/3813759671 wait complete. 2023-07-09T02:11:33.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:11:17.535245+0000', 'modified': '2023-07-09T02:11:21.190690+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6834/2565645293', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 2565645293}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 2565645293}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:11:33.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:11:33.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-09T02:11:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.200+0000 7fca93e56640 1 Processor -- start 2023-07-09T02:11:33.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.200+0000 7fca93e56640 1 -- start start 2023-07-09T02:11:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca93e56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca8c15c060 0x7fca8c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca93e56640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c160a50 con 0x7fca8c0d2620 2023-07-09T02:11:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca93e56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c15c430 con 0x7fca8c0cd120 2023-07-09T02:11:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca93e56640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c15fb60 con 0x7fca8c15c060 2023-07-09T02:11:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca91bf2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca8c15c060 0x7fca8c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca923f3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fca8c0d2620 0x7fca8c0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48998/0 (socket says 172.21.15.45:48998) 2023-07-09T02:11:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca923f3640 1 -- 172.21.15.45:0/2187434146 learned_addr learned my addr 172.21.15.45:0/2187434146 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca91bf2640 1 -- 172.21.15.45:0/2187434146 >> v1:172.21.15.155:6789/0 conn(0x7fca8c0cd120 legacy=0x7fca8c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca91bf2640 1 -- 172.21.15.45:0/2187434146 >> v1:172.21.15.45:6789/0 conn(0x7fca8c0d2620 legacy=0x7fca8c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca91bf2640 1 -- 172.21.15.45:0/2187434146 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c15fe40 con 0x7fca8c15c060 2023-07-09T02:11:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.204+0000 7fca90bf0640 1 -- 172.21.15.45:0/2187434146 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907753476 0 0) 0x7fca8c160a50 con 0x7fca8c0d2620 2023-07-09T02:11:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca91bf2640 1 --2- 172.21.15.45:0/2187434146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b4ed0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fca880097c0 tx=0x7fca8801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1828015b77b6c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca90bf0640 1 -- 172.21.15.45:0/2187434146 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880ab610 con 0x7fca8c15c060 2023-07-09T02:11:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca90bf0640 1 -- 172.21.15.45:0/2187434146 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880ab770 con 0x7fca8c15c060 2023-07-09T02:11:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca90bf0640 1 -- 172.21.15.45:0/2187434146 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880abb00 con 0x7fca8c15c060 2023-07-09T02:11:33.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- 172.21.15.45:0/2187434146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 msgr2=0x7fca8c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 --2- 172.21.15.45:0/2187434146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b4ed0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fca880097c0 tx=0x7fca8801c410 comp rx=0 tx=0).stop 2023-07-09T02:11:33.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- 172.21.15.45:0/2187434146 shutdown_connections 2023-07-09T02:11:33.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 --2- 172.21.15.45:0/2187434146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b4ed0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- 172.21.15.45:0/2187434146 >> 172.21.15.45:0/2187434146 conn(0x7fca8c0698e0 msgr2=0x7fca8c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:33.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- 172.21.15.45:0/2187434146 shutdown_connections 2023-07-09T02:11:33.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- 172.21.15.45:0/2187434146 wait complete. 2023-07-09T02:11:33.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 Processor -- start 2023-07-09T02:11:33.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- start start 2023-07-09T02:11:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0cd120 0x7fca8c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca8c0d2620 0x7fca8c0b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c154e90 con 0x7fca8c15c060 2023-07-09T02:11:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c14c5c0 con 0x7fca8c0cd120 2023-07-09T02:11:33.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.208+0000 7fca93e56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c154bb0 con 0x7fca8c0d2620 2023-07-09T02:11:33.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34722/0 (socket says 172.21.15.45:34722) 2023-07-09T02:11:33.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 -- 172.21.15.45:0/907496636 learned_addr learned my addr 172.21.15.45:0/907496636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:33.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca91bf2640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0cd120 0x7fca8c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca913f1640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca8c0d2620 0x7fca8c0b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 -- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca8c0d2620 msgr2=0x7fca8c0b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca8c0d2620 0x7fca8c0b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 -- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0cd120 msgr2=0x7fca8c14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0cd120 0x7fca8c14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 -- 172.21.15.45:0/907496636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009420 con 0x7fca8c15c060 2023-07-09T02:11:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca923f3640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b8450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca84002240 tx=0x7fca8400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca827fc640 1 -- 172.21.15.45:0/907496636 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8400cea0 con 0x7fca8c15c060 2023-07-09T02:11:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca827fc640 1 -- 172.21.15.45:0/907496636 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8400a640 con 0x7fca8c15c060 2023-07-09T02:11:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca827fc640 1 -- 172.21.15.45:0/907496636 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8400a9f0 con 0x7fca8c15c060 2023-07-09T02:11:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca93e56640 1 -- 172.21.15.45:0/907496636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c0b59f0 con 0x7fca8c15c060 2023-07-09T02:11:33.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.212+0000 7fca93e56640 1 -- 172.21.15.45:0/907496636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c15caa0 con 0x7fca8c15c060 2023-07-09T02:11:33.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca827fc640 1 -- 172.21.15.45:0/907496636 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca8400ab50 con 0x7fca8c15c060 2023-07-09T02:11:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca827fc640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca70066280 0x7fca70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca827fc640 1 -- 172.21.15.45:0/907496636 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca840831f0 con 0x7fca8c15c060 2023-07-09T02:11:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca971c5000 1 Processor -- start 2023-07-09T02:11:33.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca971c5000 1 -- start start 2023-07-09T02:11:33.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca70066280 0x7fca70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca971c5000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a05f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca971c5000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05aca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca971c5000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05acf90 0x5651a05ad360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca971c5000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a0473f80 con 0x5651a05f6800 2023-07-09T02:11:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca971c5000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a03adc60 con 0x5651a05f7110 2023-07-09T02:11:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca971c5000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651a0401700 con 0x5651a05acf90 2023-07-09T02:11:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a05f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a05f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34734/0 (socket says 172.21.15.45:34734) 2023-07-09T02:11:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 -- 172.21.15.45:0/1874108017 learned_addr learned my addr 172.21.15.45:0/1874108017 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca70066280 0x7fca70068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca880af000 tx=0x7fca880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca923f3640 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05acf90 0x5651a05ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca913f1640 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 -- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05acf90 msgr2=0x5651a05ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05acf90 0x5651a05ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 -- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 msgr2=0x5651a05aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 -- 172.21.15.45:0/1874108017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651a00f6890 con 0x5651a05f6800 2023-07-09T02:11:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca923f3640 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05acf90 0x5651a05ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca91bf2640 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a05f6bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fca880ab5e0 tx=0x7fca88009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36fe69ec15f1e46 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca6f7fe640 1 -- 172.21.15.45:0/1874108017 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880b6890 con 0x5651a05f6800 2023-07-09T02:11:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca6f7fe640 1 -- 172.21.15.45:0/1874108017 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880c6070 con 0x5651a05f6800 2023-07-09T02:11:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.216+0000 7fca6f7fe640 1 -- 172.21.15.45:0/1874108017 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880b6bf0 con 0x5651a05f6800 2023-07-09T02:11:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- 172.21.15.45:0/1874108017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 msgr2=0x5651a05f6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a05f6bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fca880ab5e0 tx=0x7fca88009190 comp rx=0 tx=0).stop 2023-07-09T02:11:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- 172.21.15.45:0/1874108017 shutdown_connections 2023-07-09T02:11:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05acf90 0x5651a05ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 --2- 172.21.15.45:0/1874108017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a05f6bd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- 172.21.15.45:0/1874108017 >> 172.21.15.45:0/1874108017 conn(0x5651a046fa70 msgr2=0x5651a05ab330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- 172.21.15.45:0/1874108017 shutdown_connections 2023-07-09T02:11:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- 172.21.15.45:0/1874108017 wait complete. 2023-07-09T02:11:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- start start 2023-07-09T02:11:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 Processor -- start 2023-07-09T02:11:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a05b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f6800 0x5651a05b8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 0x5651a05b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a03fa7a0 con 0x5651a05acf90 2023-07-09T02:11:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a03b6f00 con 0x5651a05f6800 2023-07-09T02:11:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651a03b6ba0 con 0x5651a05f7110 2023-07-09T02:11:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 10 client.0 _ll_register_callbacks cb 0x5651a0598930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:11:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a05b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a05b7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34740/0 (socket says 172.21.15.45:34740) 2023-07-09T02:11:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 -- 172.21.15.45:0/3226313220 learned_addr learned my addr 172.21.15.45:0/3226313220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 -- 172.21.15.45:0/3226313220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 msgr2=0x5651a05b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 0x5651a05b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 -- 172.21.15.45:0/3226313220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f6800 msgr2=0x5651a05b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f6800 0x5651a05b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 -- 172.21.15.45:0/3226313220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca880bc070 con 0x5651a05acf90 2023-07-09T02:11:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca91bf2640 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a05b7fd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca8801c8f0 tx=0x7fca8801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a10fa2138e8d52b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:11:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca6cff9640 1 -- 172.21.15.45:0/3226313220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880b6c70 con 0x5651a05acf90 2023-07-09T02:11:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca6cff9640 1 -- 172.21.15.45:0/3226313220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca880b6dd0 con 0x5651a05acf90 2023-07-09T02:11:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- 172.21.15.45:0/3226313220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651a03f90f0 con 0x5651a05acf90 2023-07-09T02:11:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca6cff9640 1 -- 172.21.15.45:0/3226313220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca880cb430 con 0x5651a05acf90 2023-07-09T02:11:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 10 client.4680 fetch_fsmap learned FSMap version 8 2023-07-09T02:11:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.220+0000 7fca971c5000 1 -- 172.21.15.45:0/3226313220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5651a03bf130 con 0x5651a05acf90 2023-07-09T02:11:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca6cff9640 1 -- 172.21.15.45:0/3226313220 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651a03f90f0 con 0x5651a05acf90 2023-07-09T02:11:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca6cff9640 1 -- 172.21.15.45:0/3226313220 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fca880d2070 con 0x5651a05acf90 2023-07-09T02:11:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 10 client.4680 fetch_fsmap finished waiting for FSMap version 8 2023-07-09T02:11:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 10 client.4680 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T02:11:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 20 client.4680 populate_metadata read hostname 'smithi045' 2023-07-09T02:11:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] conn(0x5651a05b9320 0x5651a0607d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 4 client.4680 mds_command: new command op to 4275 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:11:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 -- 172.21.15.45:0/3226313220 --> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651a03c1e40 con 0x5651a05b9320 2023-07-09T02:11:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca913f1640 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] conn(0x5651a05b9320 0x5651a0607d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca913f1640 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] conn(0x5651a05b9320 0x5651a0607d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aaa4657d739c7a1 server_cookie=2490dc15b27f4785 in_seq=0 out_seq=0 2023-07-09T02:11:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca6cff9640 10 client.4680 ms_handle_connect on v2:172.21.15.45:6832/2565645293 2023-07-09T02:11:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca6cff9640 1 -- 172.21.15.45:0/3226313220 <== mds.0 v2:172.21.15.45:6832/2565645293 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5651a03c1e40 con 0x5651a05b9320 2023-07-09T02:11:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca6cff9640 10 client.4680 handle_command_reply: tid=0 2023-07-09T02:11:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 client.4680 shutdown 2023-07-09T02:11:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 -- 172.21.15.45:0/3226313220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 msgr2=0x5651a05b7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a05b7fd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca8801c8f0 tx=0x7fca8801ac50 comp rx=0 tx=0).stop 2023-07-09T02:11:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 -- 172.21.15.45:0/3226313220 shutdown_connections 2023-07-09T02:11:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] conn(0x5651a05b9320 0x5651a0607d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 0x5651a05b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f6800 0x5651a05b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 --2- 172.21.15.45:0/3226313220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a05b7fd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca6cff9640 0 client.4680 ms_handle_reset on v2:172.21.15.45:6832/2565645293 2023-07-09T02:11:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 -- 172.21.15.45:0/3226313220 >> 172.21.15.45:0/3226313220 conn(0x5651a046fa70 msgr2=0x5651a05aba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 -- 172.21.15.45:0/3226313220 shutdown_connections 2023-07-09T02:11:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 1 -- 172.21.15.45:0/3226313220 wait complete. 2023-07-09T02:11:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.224+0000 7fca971c5000 20 client.4680 trim_cache size 0 max 16384 2023-07-09T02:11:33.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca971c5000 1 Processor -- start 2023-07-09T02:11:33.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca971c5000 1 -- start start 2023-07-09T02:11:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca971c5000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a0609470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca971c5000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f6800 0x5651a06099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca971c5000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca971c5000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a00b7940 con 0x5651a05acf90 2023-07-09T02:11:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca971c5000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a05acab0 con 0x5651a05f7110 2023-07-09T02:11:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca971c5000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651a03f7fb0 con 0x5651a05f6800 2023-07-09T02:11:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a0609470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a0609470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34748/0 (socket says 172.21.15.45:34748) 2023-07-09T02:11:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 -- 172.21.15.45:0/118868688 learned_addr learned my addr 172.21.15.45:0/118868688 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca913f1640 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f6800 0x5651a06099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca923f3640 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 -- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f6800 msgr2=0x5651a06099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f6800 0x5651a06099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 -- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 msgr2=0x5651a05f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 -- 172.21.15.45:0/118868688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651a03a53c0 con 0x5651a05acf90 2023-07-09T02:11:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca923f3640 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca91bf2640 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a0609470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca88019020 tx=0x7fca880cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d3302c36b526fa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca6ffff640 1 -- 172.21.15.45:0/118868688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880cbb60 con 0x5651a05acf90 2023-07-09T02:11:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca6ffff640 1 -- 172.21.15.45:0/118868688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880c6070 con 0x5651a05acf90 2023-07-09T02:11:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.240+0000 7fca6ffff640 1 -- 172.21.15.45:0/118868688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880cb570 con 0x5651a05acf90 2023-07-09T02:11:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- 172.21.15.45:0/118868688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 msgr2=0x5651a0609470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a0609470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca88019020 tx=0x7fca880cd040 comp rx=0 tx=0).stop 2023-07-09T02:11:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- 172.21.15.45:0/118868688 shutdown_connections 2023-07-09T02:11:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05f7110 0x5651a05f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f6800 0x5651a06099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 --2- 172.21.15.45:0/118868688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05acf90 0x5651a0609470 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- 172.21.15.45:0/118868688 >> 172.21.15.45:0/118868688 conn(0x5651a046fa70 msgr2=0x5651a0607d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- 172.21.15.45:0/118868688 shutdown_connections 2023-07-09T02:11:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- 172.21.15.45:0/118868688 wait complete. 2023-07-09T02:11:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- start start 2023-07-09T02:11:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 Processor -- start 2023-07-09T02:11:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05acf90 0x5651a0653de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a0654320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 0x5651a05f4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a05b1490 con 0x5651a05f6800 2023-07-09T02:11:33.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651a03fd300 con 0x5651a05acf90 2023-07-09T02:11:33.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651a03f6110 con 0x5651a05f7110 2023-07-09T02:11:33.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 10 client.0 _ll_register_callbacks cb 0x5651a05794d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:11:33.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a0654320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a0654320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34758/0 (socket says 172.21.15.45:34758) 2023-07-09T02:11:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 -- 172.21.15.45:0/3734662309 learned_addr learned my addr 172.21.15.45:0/3734662309 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca923f3640 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 0x5651a05f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca91bf2640 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05acf90 0x5651a0653de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 -- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 msgr2=0x5651a05f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 0x5651a05f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 -- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05acf90 msgr2=0x5651a0653de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05acf90 0x5651a0653de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 -- 172.21.15.45:0/3734662309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651a03bf130 con 0x5651a05f6800 2023-07-09T02:11:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca91bf2640 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05acf90 0x5651a0653de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca913f1640 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a0654320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0c9180 tx=0x7fca7c0175f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef36a3281b6f8af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:11:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca6cff9640 1 -- 172.21.15.45:0/3734662309 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0051d0 con 0x5651a05f6800 2023-07-09T02:11:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca971c5000 1 -- 172.21.15.45:0/3734662309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651a05b0920 con 0x5651a05f6800 2023-07-09T02:11:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.244+0000 7fca6cff9640 1 -- 172.21.15.45:0/3734662309 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca7c005330 con 0x5651a05f6800 2023-07-09T02:11:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca6cff9640 1 -- 172.21.15.45:0/3734662309 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca7c0054f0 con 0x5651a05f6800 2023-07-09T02:11:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 10 client.4686 fetch_fsmap learned FSMap version 8 2023-07-09T02:11:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 -- 172.21.15.45:0/3734662309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5651a00f6cc0 con 0x5651a05f6800 2023-07-09T02:11:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca6cff9640 1 -- 172.21.15.45:0/3734662309 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651a05b0920 con 0x5651a05f6800 2023-07-09T02:11:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca6cff9640 1 -- 172.21.15.45:0/3734662309 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fca7c007020 con 0x5651a05f6800 2023-07-09T02:11:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 10 client.4686 fetch_fsmap finished waiting for FSMap version 8 2023-07-09T02:11:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 10 client.4686 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T02:11:33.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 20 client.4686 populate_metadata read hostname 'smithi045' 2023-07-09T02:11:33.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] conn(0x5651a065ac40 0x5651a065d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 4 client.4686 mds_command: new command op to 4275 tid=0[{"prefix": "status"}] 2023-07-09T02:11:33.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 -- 172.21.15.45:0/3734662309 --> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651a03b36f0 con 0x5651a065ac40 2023-07-09T02:11:33.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca91bf2640 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] conn(0x5651a065ac40 0x5651a065d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca91bf2640 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] conn(0x5651a065ac40 0x5651a065d020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3f0152b3e5f2b2 server_cookie=b2604a995604e108 in_seq=0 out_seq=0 2023-07-09T02:11:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca6cff9640 10 client.4686 ms_handle_connect on v2:172.21.15.45:6832/2565645293 2023-07-09T02:11:33.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca6cff9640 1 -- 172.21.15.45:0/3734662309 <== mds.0 v2:172.21.15.45:6832/2565645293 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5651a03b36f0 con 0x5651a065ac40 2023-07-09T02:11:33.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca6cff9640 10 client.4686 handle_command_reply: tid=0 2023-07-09T02:11:33.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 client.4686 shutdown 2023-07-09T02:11:33.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 -- 172.21.15.45:0/3734662309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 msgr2=0x5651a0654320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a0654320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0c9180 tx=0x7fca7c0175f0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 -- 172.21.15.45:0/3734662309 shutdown_connections 2023-07-09T02:11:33.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.45:6832/2565645293,v1:172.21.15.45:6834/2565645293] conn(0x5651a065ac40 0x5651a065d020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5651a05f7110 0x5651a05f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651a05f6800 0x5651a0654320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 --2- 172.21.15.45:0/3734662309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5651a05acf90 0x5651a0653de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca6cff9640 0 client.4686 ms_handle_reset on v2:172.21.15.45:6832/2565645293 2023-07-09T02:11:33.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 -- 172.21.15.45:0/3734662309 >> 172.21.15.45:0/3734662309 conn(0x5651a046fa70 msgr2=0x5651a06085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:33.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 -- 172.21.15.45:0/3734662309 shutdown_connections 2023-07-09T02:11:33.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 1 -- 172.21.15.45:0/3734662309 wait complete. 2023-07-09T02:11:33.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca971c5000 20 client.4686 trim_cache size 0 max 16384 2023-07-09T02:11:33.260 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:11:33.260 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:11:33.260 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:11:33.261 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4275, 2023-07-09T02:11:33.261 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:11:33.261 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:11:33.261 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:11:33.261 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 15.070390689, 2023-07-09T02:11:33.261 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 8, 2023-07-09T02:11:33.261 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 24, 2023-07-09T02:11:33.261 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 24, 2023-07-09T02:11:33.262 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 21.000005997999999 2023-07-09T02:11:33.262 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:11:33.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 -- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca70066280 msgr2=0x7fca70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca70066280 0x7fca70068730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca880af000 tx=0x7fca880a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 -- 172.21.15.45:0/907496636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 msgr2=0x7fca8c0b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b8450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca84002240 tx=0x7fca8400cc50 comp rx=0 tx=0).stop 2023-07-09T02:11:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 -- 172.21.15.45:0/907496636 shutdown_connections 2023-07-09T02:11:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca8c15c060 0x7fca8c0b8450 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca70066280 0x7fca70068730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca8c0d2620 0x7fca8c0b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 --2- 172.21.15.45:0/907496636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca8c0cd120 0x7fca8c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 -- 172.21.15.45:0/907496636 >> 172.21.15.45:0/907496636 conn(0x7fca8c0698e0 msgr2=0x7fca8c0b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 -- 172.21.15.45:0/907496636 shutdown_connections 2023-07-09T02:11:33.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.248+0000 7fca93e56640 1 -- 172.21.15.45:0/907496636 wait complete. 2023-07-09T02:11:33.270 INFO:teuthology.run_tasks:Running task kclient... 2023-07-09T02:11:33.297 INFO:tasks.kclient:Mounting kernel clients... 2023-07-09T02:11:33.297 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-09T02:11:33.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:33.298 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:11:33.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:33.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-07-09T02:11:33.376 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-07-09T02:11:33.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:11:33.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:33.380 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:11:33.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:33.434 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-07-09T02:11:33.501 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-07-09T02:11:33.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:11:33.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:33.503 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:11:33.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:33.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-07-09T02:11:33.583 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2023-07-09T02:11:33.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:11:33.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:33.586 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:11:33.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:33.644 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-07-09T02:11:33.710 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2023-07-09T02:11:33.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:11:33.713 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-07-09T02:11:33.713 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T02:11:33.714 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:11:33.714 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:11:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75394d8640 1 Processor -- start 2023-07-09T02:11:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75394d8640 1 -- start start 2023-07-09T02:11:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75394d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753406b120 0x7f753406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75394d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75340d23e0 0x7f75340cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75394d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7534069980 0x7f7534069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75394d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7534071850 con 0x7f7534069980 2023-07-09T02:11:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75394d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340cd300 con 0x7f75340d23e0 2023-07-09T02:11:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75394d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753406ba30 con 0x7f753406b120 2023-07-09T02:11:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7534069980 0x7f7534069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7534069980 0x7f7534069dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34770/0 (socket says 172.21.15.45:34770) 2023-07-09T02:11:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75337fe640 1 -- 172.21.15.45:0/76656677 learned_addr learned my addr 172.21.15.45:0/76656677 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:33.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75327fc640 1 --2- 172.21.15.45:0/76656677 >> v2:172.21.15.155:3300/0 conn(0x7f75340d23e0 0x7f75340cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f7532ffd640 1 --2- 172.21.15.45:0/76656677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753406b120 0x7f753406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75337fe640 1 -- 172.21.15.45:0/76656677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753406b120 msgr2=0x7f753406b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75337fe640 1 --2- 172.21.15.45:0/76656677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753406b120 0x7f753406b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75337fe640 1 -- 172.21.15.45:0/76656677 >> v2:172.21.15.155:3300/0 conn(0x7f75340d23e0 msgr2=0x7f75340cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75337fe640 1 --2- 172.21.15.45:0/76656677 >> v2:172.21.15.155:3300/0 conn(0x7f75340d23e0 0x7f75340cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.856+0000 7f75337fe640 1 -- 172.21.15.45:0/76656677 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340d0e80 con 0x7f7534069980 2023-07-09T02:11:33.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75337fe640 1 --2- 172.21.15.45:0/76656677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7534069980 0x7f7534069dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f75340b54b0 tx=0x7f752c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8d35293707127e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f7531ffb640 1 -- 172.21.15.45:0/76656677 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c0a5820 con 0x7f7534069980 2023-07-09T02:11:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f7531ffb640 1 -- 172.21.15.45:0/76656677 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c0a5980 con 0x7f7534069980 2023-07-09T02:11:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f7531ffb640 1 -- 172.21.15.45:0/76656677 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c0a5d10 con 0x7f7534069980 2023-07-09T02:11:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 -- 172.21.15.45:0/76656677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7534069980 msgr2=0x7f7534069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 --2- 172.21.15.45:0/76656677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7534069980 0x7f7534069dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f75340b54b0 tx=0x7f752c01c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 -- 172.21.15.45:0/76656677 shutdown_connections 2023-07-09T02:11:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 --2- 172.21.15.45:0/76656677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7534069980 0x7f7534069dd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 --2- 172.21.15.45:0/76656677 >> v2:172.21.15.155:3300/0 conn(0x7f75340d23e0 0x7f75340cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 --2- 172.21.15.45:0/76656677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753406b120 0x7f753406b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 -- 172.21.15.45:0/76656677 >> 172.21.15.45:0/76656677 conn(0x7f75340cf3b0 msgr2=0x7f75340cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 -- 172.21.15.45:0/76656677 shutdown_connections 2023-07-09T02:11:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 -- 172.21.15.45:0/76656677 wait complete. 2023-07-09T02:11:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.860+0000 7f75394d8640 1 Processor -- start 2023-07-09T02:11:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 -- start start 2023-07-09T02:11:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7534069980 0x7f753415ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753406b120 0x7f7534155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75340d23e0 0x7f7534156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340cb2e0 con 0x7f753406b120 2023-07-09T02:11:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75340ca760 con 0x7f7534069980 2023-07-09T02:11:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340caa40 con 0x7f75340d23e0 2023-07-09T02:11:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753406b120 0x7f7534155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753406b120 0x7f7534155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34782/0 (socket says 172.21.15.45:34782) 2023-07-09T02:11:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 -- 172.21.15.45:0/3461260359 learned_addr learned my addr 172.21.15.45:0/3461260359 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f7532ffd640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7534069980 0x7f753415ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75337fe640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75340d23e0 0x7f7534156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 -- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75340d23e0 msgr2=0x7f7534156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75340d23e0 0x7f7534156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 -- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7534069980 msgr2=0x7f753415ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7534069980 0x7f753415ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 -- 172.21.15.45:0/3461260359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c009b30 con 0x7f753406b120 2023-07-09T02:11:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75327fc640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753406b120 0x7f7534155c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f752800d800 tx=0x7f752800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f751b7fe640 1 -- 172.21.15.45:0/3461260359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800b6c0 con 0x7f753406b120 2023-07-09T02:11:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f751b7fe640 1 -- 172.21.15.45:0/3461260359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800b820 con 0x7f753406b120 2023-07-09T02:11:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f751b7fe640 1 -- 172.21.15.45:0/3461260359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752800bb90 con 0x7f753406b120 2023-07-09T02:11:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75340cad20 con 0x7f753406b120 2023-07-09T02:11:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75340ca380 con 0x7f753406b120 2023-07-09T02:11:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.864+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753404e020 con 0x7f753406b120 2023-07-09T02:11:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.868+0000 7f751b7fe640 1 -- 172.21.15.45:0/3461260359 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f752800bcf0 con 0x7f753406b120 2023-07-09T02:11:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.868+0000 7f751b7fe640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7520066280 0x7f7520068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.868+0000 7f751b7fe640 1 -- 172.21.15.45:0/3461260359 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7528084160 con 0x7f753406b120 2023-07-09T02:11:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.868+0000 7f7532ffd640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7520066280 0x7f7520068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:33.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.868+0000 7f7532ffd640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7520066280 0x7f7520068730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f75240045f0 tx=0x7f7524008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:33.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:33.872+0000 7f751b7fe640 1 -- 172.21.15.45:0/3461260359 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7528055110 con 0x7f753406b120 2023-07-09T02:11:34.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.056+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f753406a0d0 con 0x7f753406b120 2023-07-09T02:11:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.056+0000 7f751b7fe640 1 -- 172.21.15.45:0/3461260359 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7528054ca0 con 0x7f753406b120 2023-07-09T02:11:34.061 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:11:34.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7520066280 msgr2=0x7f7520068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7520066280 0x7f7520068730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f75240045f0 tx=0x7f7524008040 comp rx=0 tx=0).stop 2023-07-09T02:11:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753406b120 msgr2=0x7f7534155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753406b120 0x7f7534155c00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f752800d800 tx=0x7f752800dcc0 comp rx=0 tx=0).stop 2023-07-09T02:11:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 shutdown_connections 2023-07-09T02:11:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7520066280 0x7f7520068730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75340d23e0 0x7f7534156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f753406b120 0x7f7534155c00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 --2- 172.21.15.45:0/3461260359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7534069980 0x7f753415ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 >> 172.21.15.45:0/3461260359 conn(0x7f75340cf3b0 msgr2=0x7f75340b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 shutdown_connections 2023-07-09T02:11:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:34.060+0000 7f75394d8640 1 -- 172.21.15.45:0/3461260359 wait complete. 2023-07-09T02:11:34.081 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T02:11:34.082 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:11:34.082 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:11:34.082 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:11:34.082 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:11:34.083 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T02:11:34.083 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T02:11:34.083 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:11:34.083 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:11:34.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.084 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:11:34.093 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:11:34.093 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:11:34.093 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:11:34.094 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:34.094 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:11:34.094 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:34.094 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:34.094 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:34.094 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:11:34.094 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:11:34.095 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:34.095 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:11:34.095 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:11:34.095 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42433sec preferred_lft 42433sec 2023-07-09T02:11:34.095 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:11:34.095 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:34.095 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:34.096 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:34.096 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:11:34.096 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:34.096 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:34.096 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:11:34.096 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:11:34.096 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:34.096 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:11:34.097 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:34.097 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-09T02:11:34.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.098 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:34.099 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:34.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-07-09T02:11:34.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-07-09T02:11:34.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-07-09T02:11:34.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-09T02:11:34.100 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:34.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.223 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:11:34.242 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:11:34.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.245 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:11:34.319 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:11:34.319 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:11:34.319 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:11:34.319 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:11:34.319 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:11:34.319 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:11:34.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.321 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:34.322 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:34.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:11:34.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:11:34.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:11:34.323 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:34.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.413 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:11:34.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.424 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-07-09T02:11:34.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.474 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:34.474 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:34.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:11:34.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-09T02:11:34.475 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:34.559 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-09T02:11:34.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.560 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:34.560 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:34.560 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-09T02:11:34.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-09T02:11:34.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-09T02:11:34.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-09T02:11:34.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-09T02:11:34.561 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:34.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.720 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:34.720 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:34.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:11:34.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-07-09T02:11:34.721 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:34.763 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:11:34.764 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:11:34.813 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:11:34.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:11:34.814 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:11:34.869 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:11:34.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:34.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:34.979 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:34.980 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:11:35.089 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:35.090 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:11:35.090 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:11:35.090 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:11:35.090 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:11:35.093 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:11:35.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:11:35.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.116 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:35.187 INFO:teuthology.orchestra.run.smithi045.stdout:client4695 2023-07-09T02:11:35.187 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:11:35.187 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:35.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.237 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:35.299 INFO:teuthology.orchestra.run.smithi045.stdout:client4695 2023-07-09T02:11:35.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.300 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:35.359 INFO:teuthology.orchestra.run.smithi045.stdout:client4695 2023-07-09T02:11:35.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.360 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client4695/status') 2023-07-09T02:11:35.428 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4695 (3)192.168.0.1:0/1303923753 2023-07-09T02:11:35.428 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-07-09T02:11:35.428 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-07-09T02:11:35.428 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-07-09T02:11:35.429 INFO:teuthology.orchestra.run.smithi045.stderr:69 bytes copied, 5.1956e-05 s, 1.3 MB/s 2023-07-09T02:11:35.430 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-07-09T02:11:35.430 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T02:11:35.430 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-09T02:11:35.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:11:35.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.612+0000 7f554160b640 1 Processor -- start 2023-07-09T02:11:35.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.612+0000 7f554160b640 1 -- start start 2023-07-09T02:11:35.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f554160b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c15c060 0x7f553c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:35.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f554160b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f553c0d2620 0x7f553c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:35.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f554160b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c160a50 con 0x7f553c0cd120 2023-07-09T02:11:35.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f554160b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c15c430 con 0x7f553c0d2620 2023-07-09T02:11:35.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f554160b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c15fb60 con 0x7f553c15c060 2023-07-09T02:11:35.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f553c0d2620 0x7f553c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:35.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f553c0d2620 0x7f553c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34798/0 (socket says 172.21.15.45:34798) 2023-07-09T02:11:35.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553b7fe640 1 -- 172.21.15.45:0/434389356 learned_addr learned my addr 172.21.15.45:0/434389356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:35.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553affd640 1 --2- 172.21.15.45:0/434389356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c15c060 0x7f553c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:35.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553b7fe640 1 -- 172.21.15.45:0/434389356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c15c060 msgr2=0x7f553c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:35.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553b7fe640 1 --2- 172.21.15.45:0/434389356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c15c060 0x7f553c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553b7fe640 1 -- 172.21.15.45:0/434389356 >> v1:172.21.15.155:6789/0 conn(0x7f553c0cd120 legacy=0x7f553c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:35.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553b7fe640 1 -- 172.21.15.45:0/434389356 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c15fe40 con 0x7f553c0d2620 2023-07-09T02:11:35.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553a7fc640 1 -- 172.21.15.45:0/434389356 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579961118 0 0) 0x7f553c160a50 con 0x7f553c0cd120 2023-07-09T02:11:35.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.616+0000 7f553b7fe640 1 --2- 172.21.15.45:0/434389356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c0d2620 0x7f553c0cee30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5534009e80 tx=0x7f553401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb0ba3bba62e86d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:35.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f553a7fc640 1 -- 172.21.15.45:0/434389356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340a5880 con 0x7f553c0d2620 2023-07-09T02:11:35.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f553a7fc640 1 -- 172.21.15.45:0/434389356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55340a59e0 con 0x7f553c0d2620 2023-07-09T02:11:35.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f553a7fc640 1 -- 172.21.15.45:0/434389356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340a5d70 con 0x7f553c0d2620 2023-07-09T02:11:35.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- 172.21.15.45:0/434389356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c0d2620 msgr2=0x7f553c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:35.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 --2- 172.21.15.45:0/434389356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c0d2620 0x7f553c0cee30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5534009e80 tx=0x7f553401c9c0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- 172.21.15.45:0/434389356 shutdown_connections 2023-07-09T02:11:35.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 --2- 172.21.15.45:0/434389356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c0d2620 0x7f553c0cee30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 --2- 172.21.15.45:0/434389356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c15c060 0x7f553c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- 172.21.15.45:0/434389356 >> 172.21.15.45:0/434389356 conn(0x7f553c0698e0 msgr2=0x7f553c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:35.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- 172.21.15.45:0/434389356 shutdown_connections 2023-07-09T02:11:35.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- 172.21.15.45:0/434389356 wait complete. 2023-07-09T02:11:35.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 Processor -- start 2023-07-09T02:11:35.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- start start 2023-07-09T02:11:35.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c0cd120 0x7f553c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:35.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c0d2620 0x7f553c1f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:35.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c15c060 0x7f553c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:35.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0b2460 con 0x7f553c15c060 2023-07-09T02:11:35.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1f8380 con 0x7f553c0cd120 2023-07-09T02:11:35.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f554160b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1f8660 con 0x7f553c0d2620 2023-07-09T02:11:35.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c15c060 0x7f553c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:35.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c15c060 0x7f553c0b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34804/0 (socket says 172.21.15.45:34804) 2023-07-09T02:11:35.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.620+0000 7f553b7fe640 1 -- 172.21.15.45:0/1642483667 learned_addr learned my addr 172.21.15.45:0/1642483667 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:35.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f553affd640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c0cd120 0x7f553c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:35.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f5533fff640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c0d2620 0x7f553c1f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:35.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f553b7fe640 1 -- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c0d2620 msgr2=0x7f553c1f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:35.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f553b7fe640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c0d2620 0x7f553c1f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f553b7fe640 1 -- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c0cd120 msgr2=0x7f553c1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:35.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f553b7fe640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c0cd120 0x7f553c1573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f553b7fe640 1 -- 172.21.15.45:0/1642483667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534009b30 con 0x7f553c15c060 2023-07-09T02:11:35.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f5533fff640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c0d2620 0x7f553c1f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:35.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f553b7fe640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c15c060 0x7f553c0b2eb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f55340af040 tx=0x7f5534019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:35.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f55337fe640 1 -- 172.21.15.45:0/1642483667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340b8670 con 0x7f553c15c060 2023-07-09T02:11:35.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f55337fe640 1 -- 172.21.15.45:0/1642483667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55340b87d0 con 0x7f553c15c060 2023-07-09T02:11:35.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f55337fe640 1 -- 172.21.15.45:0/1642483667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340b8b80 con 0x7f553c15c060 2023-07-09T02:11:35.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c0b59f0 con 0x7f553c15c060 2023-07-09T02:11:35.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c0b2990 con 0x7f553c15c060 2023-07-09T02:11:35.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c04d7d0 con 0x7f553c15c060 2023-07-09T02:11:35.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f55337fe640 1 -- 172.21.15.45:0/1642483667 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55340b8ce0 con 0x7f553c15c060 2023-07-09T02:11:35.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.624+0000 7f55337fe640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f551c066280 0x7f551c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:35.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.628+0000 7f55337fe640 1 -- 172.21.15.45:0/1642483667 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f553411f340 con 0x7f553c15c060 2023-07-09T02:11:35.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.628+0000 7f553affd640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f551c066280 0x7f551c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:35.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.628+0000 7f553affd640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f551c066280 0x7f551c068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f553c148f10 tx=0x7f552c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:35.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.632+0000 7f55337fe640 1 -- 172.21.15.45:0/1642483667 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55340ec7b0 con 0x7f553c15c060 2023-07-09T02:11:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.820+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f553c06baa0 con 0x7f553c15c060 2023-07-09T02:11:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.820+0000 7f55337fe640 1 -- 172.21.15.45:0/1642483667 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f55340efdd0 con 0x7f553c15c060 2023-07-09T02:11:35.824 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:11:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f551c066280 msgr2=0x7f551c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f551c066280 0x7f551c068730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f553c148f10 tx=0x7f552c008040 comp rx=0 tx=0).stop 2023-07-09T02:11:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c15c060 msgr2=0x7f553c0b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c15c060 0x7f553c0b2eb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f55340af040 tx=0x7f5534019760 comp rx=0 tx=0).stop 2023-07-09T02:11:35.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 shutdown_connections 2023-07-09T02:11:35.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553c15c060 0x7f553c0b2eb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f551c066280 0x7f551c068730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f553c0d2620 0x7f553c1f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 --2- 172.21.15.45:0/1642483667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553c0cd120 0x7f553c1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:35.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 >> 172.21.15.45:0/1642483667 conn(0x7f553c0698e0 msgr2=0x7f553c154dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:35.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 shutdown_connections 2023-07-09T02:11:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:35.824+0000 7f554160b640 1 -- 172.21.15.45:0/1642483667 wait complete. 2023-07-09T02:11:35.846 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T02:11:35.847 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:11:35.847 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:11:35.847 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-09T02:11:35.847 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-09T02:11:35.847 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T02:11:35.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T02:11:35.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:11:35.848 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-09T02:11:35.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.850 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:11:35.861 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:11:35.861 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:11:35.861 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:11:35.861 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:35.861 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:11:35.862 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:35.862 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:35.862 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:35.862 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:11:35.862 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:11:35.862 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:35.862 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:11:35.862 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:11:35.863 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42431sec preferred_lft 42431sec 2023-07-09T02:11:35.863 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:11:35.863 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:35.864 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:35.864 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:35.864 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:11:35.864 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:35.864 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:35.864 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:11:35.865 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:11:35.865 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:35.865 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:11:35.865 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:35.865 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:11:35.865 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:35.865 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:11:35.866 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:35.866 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-09T02:11:35.866 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:35.866 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:11:35.866 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:11:35.866 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-09T02:11:35.866 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:35.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.867 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:11:35.928 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:11:35.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.933 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:11:35.991 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:11:35.991 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:11:35.992 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:11:35.992 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:11:35.992 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:11:35.992 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:11:35.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:35.993 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:35.994 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:35.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:11:35.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:11:35.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:11:35.996 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:36.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.087 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:11:36.098 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:11:36.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.099 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-07-09T02:11:36.149 INFO:teuthology.orchestra.run.smithi045.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-09T02:11:36.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.150 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:36.151 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:36.151 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:11:36.151 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-09T02:11:36.151 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:36.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-09T02:11:36.306 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:11:36.306 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:11:36.306 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:11:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:11:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:36.307 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:11:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 1e:e4:c5:25:b5:e6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T02:11:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T02:11:36.307 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:36.308 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::1ce4:c5ff:fe25:b5e6/64 scope link 2023-07-09T02:11:36.308 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:36.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.309 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-09T02:11:36.378 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:11:36.378 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:11:36.378 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:11:36.379 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:36.379 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:11:36.379 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:36.380 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:11:36.380 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 1e:e4:c5:25:b5:e6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T02:11:36.380 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T02:11:36.380 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:36.380 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::1ce4:c5ff:fe25:b5e6/64 scope link 2023-07-09T02:11:36.381 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:36.382 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-09T02:11:36.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.382 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:36.383 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:36.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-09T02:11:36.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-09T02:11:36.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-09T02:11:36.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-09T02:11:36.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-09T02:11:36.384 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:36.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.533 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:11:36.533 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:11:36.533 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.1 up 2023-07-09T02:11:36.533 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.1 master ceph-brx 2023-07-09T02:11:36.534 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:11:36.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:11:36.577 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-09T02:11:36.634 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-09T02:11:36.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:11:36.635 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-09T02:11:36.685 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-07-09T02:11:36.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.686 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:36.787 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:36.787 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:11:36.797 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:36.798 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:11:36.798 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:11:36.798 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 2@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:11:36.798 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:11:36.801 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:11:36.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-09T02:11:36.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.824 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:36.880 INFO:teuthology.orchestra.run.smithi045.stdout:client4657 2023-07-09T02:11:36.880 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:11:36.880 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:36.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.929 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:36.983 INFO:teuthology.orchestra.run.smithi045.stdout:client4657 2023-07-09T02:11:36.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:36.984 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:37.036 INFO:teuthology.orchestra.run.smithi045.stdout:client4657 2023-07-09T02:11:37.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.037 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client4657/status') 2023-07-09T02:11:37.101 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4657 (3)172.21.15.45:0/2518506728 2023-07-09T02:11:37.102 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-07-09T02:11:37.102 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-07-09T02:11:37.102 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-07-09T02:11:37.103 INFO:teuthology.orchestra.run.smithi045.stderr:70 bytes copied, 5.1898e-05 s, 1.3 MB/s 2023-07-09T02:11:37.104 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-07-09T02:11:37.104 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T02:11:37.105 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:11:37.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:11:37.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f30511b7640 1 Processor -- start 2023-07-09T02:11:37.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f30511b7640 1 -- start start 2023-07-09T02:11:37.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f30511b7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f304c159f40 0x7f304c15da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:37.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f30511b7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f304c099f40 0x7f304c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:37.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f30511b7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0d0500 con 0x7f304c0d0020 2023-07-09T02:11:37.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f30511b7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0d11c0 con 0x7f304c159f40 2023-07-09T02:11:37.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f30511b7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0d14a0 con 0x7f304c099f40 2023-07-09T02:11:37.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f304bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f304c159f40 0x7f304c15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:37.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f304bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f304c159f40 0x7f304c15da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34806/0 (socket says 172.21.15.45:34806) 2023-07-09T02:11:37.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f304bfff640 1 -- 172.21.15.45:0/420289496 learned_addr learned my addr 172.21.15.45:0/420289496 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:37.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.288+0000 7f304b7fe640 1 --2- 172.21.15.45:0/420289496 >> v2:172.21.15.155:3300/0 conn(0x7f304c099f40 0x7f304c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:37.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304bfff640 1 -- 172.21.15.45:0/420289496 >> v2:172.21.15.155:3300/0 conn(0x7f304c099f40 msgr2=0x7f304c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:37.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304bfff640 1 --2- 172.21.15.45:0/420289496 >> v2:172.21.15.155:3300/0 conn(0x7f304c099f40 0x7f304c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304bfff640 1 -- 172.21.15.45:0/420289496 >> v1:172.21.15.155:6789/0 conn(0x7f304c0d0020 legacy=0x7f304c15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:37.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304bfff640 1 -- 172.21.15.45:0/420289496 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0ce340 con 0x7f304c159f40 2023-07-09T02:11:37.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304b7fe640 1 --2- 172.21.15.45:0/420289496 >> v2:172.21.15.155:3300/0 conn(0x7f304c099f40 0x7f304c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:37.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304bfff640 1 --2- 172.21.15.45:0/420289496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c159f40 0x7f304c15da10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f304c070530 tx=0x7f303c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dfe5f47965f6e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304affd640 1 -- 172.21.15.45:0/420289496 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0aa430 con 0x7f304c159f40 2023-07-09T02:11:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304affd640 1 -- 172.21.15.45:0/420289496 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c0aa590 con 0x7f304c159f40 2023-07-09T02:11:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.292+0000 7f304affd640 1 -- 172.21.15.45:0/420289496 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0aa920 con 0x7f304c159f40 2023-07-09T02:11:37.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- 172.21.15.45:0/420289496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c159f40 msgr2=0x7f304c15da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 --2- 172.21.15.45:0/420289496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c159f40 0x7f304c15da10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f304c070530 tx=0x7f303c01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- 172.21.15.45:0/420289496 shutdown_connections 2023-07-09T02:11:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 --2- 172.21.15.45:0/420289496 >> v2:172.21.15.155:3300/0 conn(0x7f304c099f40 0x7f304c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 --2- 172.21.15.45:0/420289496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c159f40 0x7f304c15da10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- 172.21.15.45:0/420289496 >> 172.21.15.45:0/420289496 conn(0x7f304c0999f0 msgr2=0x7f304c0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- 172.21.15.45:0/420289496 shutdown_connections 2023-07-09T02:11:37.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- 172.21.15.45:0/420289496 wait complete. 2023-07-09T02:11:37.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 Processor -- start 2023-07-09T02:11:37.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- start start 2023-07-09T02:11:37.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c099f40 0x7f304c0b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304c0d0020 0x7f304c0b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304c159f40 0x7f304c163b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c4cd0 con 0x7f304c099f40 2023-07-09T02:11:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c4f40 con 0x7f304c0d0020 2023-07-09T02:11:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30511b7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0c5220 con 0x7f304c159f40 2023-07-09T02:11:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f304bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c099f40 0x7f304c0b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f304bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c099f40 0x7f304c0b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34822/0 (socket says 172.21.15.45:34822) 2023-07-09T02:11:37.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f304bfff640 1 -- 172.21.15.45:0/1656351702 learned_addr learned my addr 172.21.15.45:0/1656351702 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:37.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f304b7fe640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304c0d0020 0x7f304c0b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:37.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.296+0000 7f30509b6640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304c159f40 0x7f304c163b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:37.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f304bfff640 1 -- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304c159f40 msgr2=0x7f304c163b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:37.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f304bfff640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304c159f40 0x7f304c163b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f304bfff640 1 -- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304c0d0020 msgr2=0x7f304c0b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f304bfff640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304c0d0020 0x7f304c0b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f304bfff640 1 -- 172.21.15.45:0/1656351702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0094d0 con 0x7f304c099f40 2023-07-09T02:11:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f304bfff640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c099f40 0x7f304c0b25b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f303c0190e0 tx=0x7f303c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f3048ff9640 1 -- 172.21.15.45:0/1656351702 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0b3800 con 0x7f304c099f40 2023-07-09T02:11:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f3048ff9640 1 -- 172.21.15.45:0/1656351702 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c0b3980 con 0x7f304c099f40 2023-07-09T02:11:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f3048ff9640 1 -- 172.21.15.45:0/1656351702 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c0b3d30 con 0x7f304c099f40 2023-07-09T02:11:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c0c5500 con 0x7f304c099f40 2023-07-09T02:11:37.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c164060 con 0x7f304c099f40 2023-07-09T02:11:37.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c0c5360 con 0x7f304c099f40 2023-07-09T02:11:37.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f3048ff9640 1 -- 172.21.15.45:0/1656351702 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f303c0b2380 con 0x7f304c099f40 2023-07-09T02:11:37.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f3048ff9640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3038066280 0x7f3038068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:37.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.300+0000 7f3048ff9640 1 -- 172.21.15.45:0/1656351702 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f303c11e330 con 0x7f304c099f40 2023-07-09T02:11:37.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.304+0000 7f304b7fe640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3038066280 0x7f3038068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:37.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.304+0000 7f304b7fe640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3038066280 0x7f3038068730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f304c0b5f40 tx=0x7f3040008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:37.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.304+0000 7f3048ff9640 1 -- 172.21.15.45:0/1656351702 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f304c0c5360 con 0x7f304c099f40 2023-07-09T02:11:37.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.492+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f304c0c5740 con 0x7f304c099f40 2023-07-09T02:11:37.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.492+0000 7f3048ff9640 1 -- 172.21.15.45:0/1656351702 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f304c0c5740 con 0x7f304c099f40 2023-07-09T02:11:37.497 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:11:37.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3038066280 msgr2=0x7f3038068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:37.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3038066280 0x7f3038068730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f304c0b5f40 tx=0x7f3040008040 comp rx=0 tx=0).stop 2023-07-09T02:11:37.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c099f40 msgr2=0x7f304c0b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:37.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c099f40 0x7f304c0b25b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f303c0190e0 tx=0x7f303c01ad10 comp rx=0 tx=0).stop 2023-07-09T02:11:37.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 shutdown_connections 2023-07-09T02:11:37.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3038066280 0x7f3038068730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f304c159f40 0x7f304c163b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f304c0d0020 0x7f304c0b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 --2- 172.21.15.45:0/1656351702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c099f40 0x7f304c0b25b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:37.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 >> 172.21.15.45:0/1656351702 conn(0x7f304c0999f0 msgr2=0x7f304c158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:37.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 shutdown_connections 2023-07-09T02:11:37.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:37.496+0000 7f30511b7640 1 -- 172.21.15.45:0/1656351702 wait complete. 2023-07-09T02:11:37.518 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T02:11:37.518 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:11:37.518 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:11:37.518 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:11:37.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:11:37.519 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T02:11:37.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T02:11:37.519 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:11:37.519 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:11:37.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.520 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:11:37.532 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:11:37.533 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:11:37.533 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:11:37.533 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:37.533 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:11:37.533 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:37.533 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:37.534 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:37.534 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:11:37.534 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:37.534 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:37.534 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:11:37.534 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:37.534 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:37.535 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:11:37.535 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:37.535 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:11:37.535 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42436sec preferred_lft 42436sec 2023-07-09T02:11:37.535 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:11:37.535 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:37.535 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:11:37.535 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:37.536 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:11:37.536 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:37.536 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-09T02:11:37.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.537 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:37.537 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:37.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2023-07-09T02:11:37.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2023-07-09T02:11:37.538 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2023-07-09T02:11:37.538 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-09T02:11:37.538 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:37.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.651 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:11:37.671 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:11:37.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.673 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:11:37.742 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:11:37.742 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:11:37.743 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:11:37.743 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:11:37.743 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:11:37.743 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:11:37.743 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:11:37.745 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:11:37.745 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:11:37.746 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:11:37.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.746 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:37.747 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:37.747 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:11:37.747 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:11:37.747 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:11:37.748 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:37.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.838 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:11:37.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.848 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2023-07-09T02:11:37.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.904 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:37.904 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:37.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:11:37.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-09T02:11:37.905 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:37.987 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-09T02:11:37.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:37.987 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:37.988 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:37.988 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-09T02:11:37.988 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-09T02:11:37.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-09T02:11:37.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-09T02:11:37.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-09T02:11:37.989 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:38.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:38.155 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:38.155 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:38.155 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:11:38.156 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2023-07-09T02:11:38.156 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:38.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:11:38.198 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:11:38.252 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:11:38.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:11:38.253 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:11:38.302 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:11:38.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:38.303 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:38.406 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:38.406 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:11:38.517 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:38.517 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:11:38.517 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:11:38.517 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:11:38.517 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:11:38.522 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:11:38.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:38.524 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:11:38.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:38.545 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:38.612 INFO:teuthology.orchestra.run.smithi155.stdout:client4710 2023-07-09T02:11:38.613 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:38.613 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:38.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:38.667 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:38.721 INFO:teuthology.orchestra.run.smithi155.stdout:client4710 2023-07-09T02:11:38.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:38.722 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:38.774 INFO:teuthology.orchestra.run.smithi155.stdout:client4710 2023-07-09T02:11:38.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:38.775 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client4710/status') 2023-07-09T02:11:38.834 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.4710 (3)172.21.15.155:0/1206825345 2023-07-09T02:11:38.835 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2023-07-09T02:11:38.835 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2023-07-09T02:11:38.835 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2023-07-09T02:11:38.835 INFO:teuthology.orchestra.run.smithi155.stderr:71 bytes copied, 4.9088e-05 s, 1.4 MB/s 2023-07-09T02:11:38.836 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-07-09T02:11:38.837 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T02:11:38.837 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-09T02:11:38.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:11:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee2910d640 1 Processor -- start 2023-07-09T02:11:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee2910d640 1 -- start start 2023-07-09T02:11:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee2910d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee2415c060 0x7fee240b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee2910d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fee240d2620 0x7fee240cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee2910d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee24160a50 con 0x7fee240cd120 2023-07-09T02:11:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee2910d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2415c430 con 0x7fee2415c060 2023-07-09T02:11:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee2910d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2415fb60 con 0x7fee240d2620 2023-07-09T02:11:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee22d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee2415c060 0x7fee240b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee22d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee2415c060 0x7fee240b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34830/0 (socket says 172.21.15.45:34830) 2023-07-09T02:11:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee22d9d640 1 -- 172.21.15.45:0/1510401865 learned_addr learned my addr 172.21.15.45:0/1510401865 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee2359e640 1 --2- 172.21.15.45:0/1510401865 >> v2:172.21.15.155:3300/0 conn(0x7fee240d2620 0x7fee240cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee22d9d640 1 -- 172.21.15.45:0/1510401865 >> v2:172.21.15.155:3300/0 conn(0x7fee240d2620 msgr2=0x7fee240cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee22d9d640 1 --2- 172.21.15.45:0/1510401865 >> v2:172.21.15.155:3300/0 conn(0x7fee240d2620 0x7fee240cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee22d9d640 1 -- 172.21.15.45:0/1510401865 >> v1:172.21.15.155:6789/0 conn(0x7fee240cd120 legacy=0x7fee240d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.988+0000 7fee22d9d640 1 -- 172.21.15.45:0/1510401865 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2415fe40 con 0x7fee2415c060 2023-07-09T02:11:38.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee22d9d640 1 --2- 172.21.15.45:0/1510401865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee240b4ed0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee2408bca0 tx=0x7fee1401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c220f1ecfc7398 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee21d9b640 1 -- 172.21.15.45:0/1510401865 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140aa430 con 0x7fee2415c060 2023-07-09T02:11:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee21d9b640 1 -- 172.21.15.45:0/1510401865 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee140aa590 con 0x7fee2415c060 2023-07-09T02:11:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee21d9b640 1 -- 172.21.15.45:0/1510401865 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee140aa920 con 0x7fee2415c060 2023-07-09T02:11:38.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee2910d640 1 -- 172.21.15.45:0/1510401865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 msgr2=0x7fee240b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:38.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee2910d640 1 --2- 172.21.15.45:0/1510401865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee240b4ed0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee2408bca0 tx=0x7fee1401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:38.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee2910d640 1 -- 172.21.15.45:0/1510401865 shutdown_connections 2023-07-09T02:11:38.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee2910d640 1 --2- 172.21.15.45:0/1510401865 >> v2:172.21.15.155:3300/0 conn(0x7fee240d2620 0x7fee240cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:38.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee2910d640 1 --2- 172.21.15.45:0/1510401865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee240b4ed0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:38.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee2910d640 1 -- 172.21.15.45:0/1510401865 >> 172.21.15.45:0/1510401865 conn(0x7fee240698e0 msgr2=0x7fee24069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:38.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee2910d640 1 -- 172.21.15.45:0/1510401865 shutdown_connections 2023-07-09T02:11:38.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.992+0000 7fee2910d640 1 -- 172.21.15.45:0/1510401865 wait complete. 2023-07-09T02:11:38.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 Processor -- start 2023-07-09T02:11:38.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 -- start start 2023-07-09T02:11:38.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee240cd120 0x7fee241666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:38.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee240d2620 0x7fee240ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:38.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee2415ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:38.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2415c980 con 0x7fee2415c060 2023-07-09T02:11:39.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240cb4c0 con 0x7fee240d2620 2023-07-09T02:11:39.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee240caf00 con 0x7fee240cd120 2023-07-09T02:11:39.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee2415ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:39.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee2415ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34838/0 (socket says 172.21.15.45:34838) 2023-07-09T02:11:39.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 -- 172.21.15.45:0/3587512728 learned_addr learned my addr 172.21.15.45:0/3587512728 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:39.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2259c640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee240d2620 0x7fee240ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee22d9d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee240cd120 0x7fee241666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 -- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee240cd120 msgr2=0x7fee241666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee240cd120 0x7fee241666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 -- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee240d2620 msgr2=0x7fee240ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee240d2620 0x7fee240ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 -- 172.21.15.45:0/3587512728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140094d0 con 0x7fee2415c060 2023-07-09T02:11:39.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2259c640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee240d2620 0x7fee240ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:39.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2359e640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee2415ea50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00ef90 tx=0x7fee1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:39.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee0b7fe640 1 -- 172.21.15.45:0/3587512728 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c009ca0 con 0x7fee2415c060 2023-07-09T02:11:39.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee0b7fe640 1 -- 172.21.15.45:0/3587512728 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c00f040 con 0x7fee2415c060 2023-07-09T02:11:39.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee0b7fe640 1 -- 172.21.15.45:0/3587512728 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0146c0 con 0x7fee2415c060 2023-07-09T02:11:39.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee240b59f0 con 0x7fee2415c060 2023-07-09T02:11:39.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:38.996+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2415c610 con 0x7fee2415c060 2023-07-09T02:11:39.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.000+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2415cb30 con 0x7fee2415c060 2023-07-09T02:11:39.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.000+0000 7fee0b7fe640 1 -- 172.21.15.45:0/3587512728 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee1c014820 con 0x7fee2415c060 2023-07-09T02:11:39.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.000+0000 7fee0b7fe640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee10066280 0x7fee10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:39.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.000+0000 7fee0b7fe640 1 -- 172.21.15.45:0/3587512728 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee1c084c50 con 0x7fee2415c060 2023-07-09T02:11:39.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.000+0000 7fee22d9d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee10066280 0x7fee10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:39.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.000+0000 7fee22d9d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee10066280 0x7fee10068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee140ae000 tx=0x7fee140b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:39.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.004+0000 7fee0b7fe640 1 -- 172.21.15.45:0/3587512728 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee2415cb30 con 0x7fee2415c060 2023-07-09T02:11:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fee2404d7d0 con 0x7fee2415c060 2023-07-09T02:11:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee0b7fe640 1 -- 172.21.15.45:0/3587512728 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fee1c018070 con 0x7fee2415c060 2023-07-09T02:11:39.196 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:11:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee10066280 msgr2=0x7fee10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee10066280 0x7fee10068730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fee140ae000 tx=0x7fee140b5040 comp rx=0 tx=0).stop 2023-07-09T02:11:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 msgr2=0x7fee2415ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee2415ea50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00ef90 tx=0x7fee1c00c490 comp rx=0 tx=0).stop 2023-07-09T02:11:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 shutdown_connections 2023-07-09T02:11:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee2415c060 0x7fee2415ea50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee240d2620 0x7fee240ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fee10066280 0x7fee10068730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 --2- 172.21.15.45:0/3587512728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee240cd120 0x7fee241666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:39.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 >> 172.21.15.45:0/3587512728 conn(0x7fee240698e0 msgr2=0x7fee24069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:39.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 shutdown_connections 2023-07-09T02:11:39.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:39.192+0000 7fee2910d640 1 -- 172.21.15.45:0/3587512728 wait complete. 2023-07-09T02:11:39.216 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T02:11:39.216 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:11:39.217 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:11:39.217 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-09T02:11:39.217 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-09T02:11:39.217 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T02:11:39.217 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T02:11:39.217 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:11:39.218 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-09T02:11:39.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.218 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:11:39.230 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:11:39.230 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:11:39.231 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:11:39.231 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.231 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:11:39.231 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.232 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:39.232 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:39.232 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:11:39.232 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:39.233 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:39.233 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:11:39.233 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:11:39.233 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:39.234 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:11:39.234 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:39.234 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:11:39.235 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42434sec preferred_lft 42434sec 2023-07-09T02:11:39.235 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:11:39.235 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.235 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:11:39.236 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:39.236 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:11:39.236 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.236 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:11:39.237 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:11:39.237 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:11:39.237 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.237 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-09T02:11:39.237 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.238 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:11:39.238 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:11:39.238 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-09T02:11:39.238 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.239 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:11:39.293 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:11:39.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.295 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:11:39.353 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:11:39.353 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:11:39.353 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:11:39.353 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:11:39.353 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:11:39.354 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:11:39.354 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:11:39.354 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:11:39.354 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:11:39.354 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:11:39.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.355 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:39.355 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:39.355 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:11:39.355 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:11:39.356 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:11:39.356 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:39.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.447 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:11:39.456 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:11:39.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.458 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2023-07-09T02:11:39.507 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-09T02:11:39.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.508 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:39.508 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:39.508 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:11:39.509 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-09T02:11:39.509 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:39.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.592 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-09T02:11:39.656 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:11:39.657 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:11:39.657 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:11:39.657 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.657 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:11:39.658 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.658 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:11:39.658 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether a6:4c:cb:61:03:9a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T02:11:39.659 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T02:11:39.659 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.659 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::a44c:cbff:fe61:39a/64 scope link tentative 2023-07-09T02:11:39.659 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.661 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-09T02:11:39.722 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:11:39.723 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:11:39.723 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:11:39.723 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.723 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:11:39.723 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.723 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:11:39.724 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether a6:4c:cb:61:03:9a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T02:11:39.724 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T02:11:39.724 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.724 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::a44c:cbff:fe61:39a/64 scope link tentative 2023-07-09T02:11:39.724 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:11:39.725 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-09T02:11:39.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.726 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:39.726 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:39.726 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-09T02:11:39.726 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-09T02:11:39.727 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-09T02:11:39.727 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-09T02:11:39.727 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-09T02:11:39.727 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:39.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:39.872 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:11:39.873 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:11:39.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.1 up 2023-07-09T02:11:39.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.1 master ceph-brx 2023-07-09T02:11:39.873 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:11:39.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:11:39.914 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-09T02:11:39.962 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-09T02:11:39.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:11:39.963 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-09T02:11:40.018 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-07-09T02:11:40.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:40.018 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:40.112 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:40.112 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:11:40.125 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:11:40.125 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:11:40.126 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:11:40.126 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 3@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:11:40.126 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:11:40.128 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:11:40.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:40.129 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-09T02:11:40.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:40.149 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:40.201 INFO:teuthology.orchestra.run.smithi155.stdout:client4719 2023-07-09T02:11:40.202 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:40.202 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:40.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:40.253 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:40.305 INFO:teuthology.orchestra.run.smithi155.stdout:client4719 2023-07-09T02:11:40.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:40.306 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:11:40.358 INFO:teuthology.orchestra.run.smithi155.stdout:client4719 2023-07-09T02:11:40.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:40.359 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client4719/status') 2023-07-09T02:11:40.423 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.4719 (3)172.21.15.155:0/952587661 2023-07-09T02:11:40.423 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2023-07-09T02:11:40.423 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2023-07-09T02:11:40.423 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2023-07-09T02:11:40.424 INFO:teuthology.orchestra.run.smithi155.stderr:70 bytes copied, 4.9274e-05 s, 1.4 MB/s 2023-07-09T02:11:40.425 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-09T02:11:40.444 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:40.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff598dfa640 1 Processor -- start 2023-07-09T02:11:40.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff598dfa640 1 -- start start 2023-07-09T02:11:40.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff598dfa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff59415c060 0x7ff5940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff598dfa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff594160a50 con 0x7ff5940d2620 2023-07-09T02:11:40.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff598dfa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59415c430 con 0x7ff5940cd120 2023-07-09T02:11:40.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff598dfa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59415fb60 con 0x7ff59415c060 2023-07-09T02:11:40.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff59259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff59415c060 0x7ff5940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff592d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff5940d2620 0x7ff5940cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49000/0 (socket says 172.21.15.45:49000) 2023-07-09T02:11:40.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff592d9d640 1 -- 172.21.15.45:0/1954429385 learned_addr learned my addr 172.21.15.45:0/1954429385 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:40.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.596+0000 7ff59259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff59415c060 0x7ff5940b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34848/0 (socket says 172.21.15.45:34848) 2023-07-09T02:11:40.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff59259c640 1 -- 172.21.15.45:0/1954429385 >> v1:172.21.15.155:6789/0 conn(0x7ff5940cd120 legacy=0x7ff5940d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff59259c640 1 -- 172.21.15.45:0/1954429385 >> v1:172.21.15.45:6789/0 conn(0x7ff5940d2620 legacy=0x7ff5940cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff59259c640 1 -- 172.21.15.45:0/1954429385 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59415fe40 con 0x7ff59415c060 2023-07-09T02:11:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff59259c640 1 --2- 172.21.15.45:0/1954429385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59415c060 0x7ff5940b4ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff5840097c0 tx=0x7ff58401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6aa5bbb5a47fb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff591d9b640 1 -- 172.21.15.45:0/1954429385 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5840ab650 con 0x7ff59415c060 2023-07-09T02:11:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff591d9b640 1 -- 172.21.15.45:0/1954429385 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5840ab7b0 con 0x7ff59415c060 2023-07-09T02:11:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff591d9b640 1 -- 172.21.15.45:0/1954429385 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5840abb40 con 0x7ff59415c060 2023-07-09T02:11:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff598dfa640 1 -- 172.21.15.45:0/1954429385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59415c060 msgr2=0x7ff5940b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.600+0000 7ff598dfa640 1 --2- 172.21.15.45:0/1954429385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59415c060 0x7ff5940b4ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff5840097c0 tx=0x7ff58401c450 comp rx=0 tx=0).stop 2023-07-09T02:11:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 -- 172.21.15.45:0/1954429385 shutdown_connections 2023-07-09T02:11:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 --2- 172.21.15.45:0/1954429385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59415c060 0x7ff5940b4ed0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 -- 172.21.15.45:0/1954429385 >> 172.21.15.45:0/1954429385 conn(0x7ff5940698e0 msgr2=0x7ff594069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 -- 172.21.15.45:0/1954429385 shutdown_connections 2023-07-09T02:11:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 -- 172.21.15.45:0/1954429385 wait complete. 2023-07-09T02:11:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 Processor -- start 2023-07-09T02:11:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 -- start start 2023-07-09T02:11:40.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5940cd120 0x7ff594157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5940d2620 0x7ff5941549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff59415c060 0x7ff59415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff594154f20 con 0x7ff5940d2620 2023-07-09T02:11:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff594156360 con 0x7ff5940cd120 2023-07-09T02:11:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff598dfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff594156640 con 0x7ff59415c060 2023-07-09T02:11:40.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff58bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5940d2620 0x7ff5941549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff592d9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff59415c060 0x7ff59415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff59259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5940cd120 0x7ff594157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff58bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5940d2620 0x7ff5941549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34850/0 (socket says 172.21.15.45:34850) 2023-07-09T02:11:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff59259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5940cd120 0x7ff594157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:54458/0 (socket says 172.21.15.45:54458) 2023-07-09T02:11:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff58bfff640 1 -- 172.21.15.45:0/3541533392 learned_addr learned my addr 172.21.15.45:0/3541533392 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff592d9d640 1 -- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5940cd120 msgr2=0x7ff594157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff592d9d640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5940cd120 0x7ff594157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff592d9d640 1 -- 172.21.15.45:0/3541533392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5940d2620 msgr2=0x7ff5941549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff592d9d640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5940d2620 0x7ff5941549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff592d9d640 1 -- 172.21.15.45:0/3541533392 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009420 con 0x7ff59415c060 2023-07-09T02:11:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.604+0000 7ff58bfff640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5940d2620 0x7ff5941549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff592d9d640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff59415c060 0x7ff59415c880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5940d2a10 tx=0x7ff58c00cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff58affd640 1 -- 172.21.15.45:0/3541533392 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00abd0 con 0x7ff59415c060 2023-07-09T02:11:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff58affd640 1 -- 172.21.15.45:0/3541533392 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c00ad30 con 0x7ff59415c060 2023-07-09T02:11:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5940b59f0 con 0x7ff59415c060 2023-07-09T02:11:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff58affd640 1 -- 172.21.15.45:0/3541533392 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00aea0 con 0x7ff59415c060 2023-07-09T02:11:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff594156c00 con 0x7ff59415c060 2023-07-09T02:11:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59404d7d0 con 0x7ff59415c060 2023-07-09T02:11:40.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff58affd640 1 -- 172.21.15.45:0/3541533392 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff58c012600 con 0x7ff59415c060 2023-07-09T02:11:40.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff58affd640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff574066280 0x7ff574068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff58affd640 1 -- 172.21.15.45:0/3541533392 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff58c083ab0 con 0x7ff59415c060 2023-07-09T02:11:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.608+0000 7ff59259c640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff574066280 0x7ff574068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.612+0000 7ff59259c640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff574066280 0x7ff574068730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff5840af000 tx=0x7ff5840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:40.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.616+0000 7ff58affd640 1 -- 172.21.15.45:0/3541533392 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff58c050fd0 con 0x7ff59415c060 2023-07-09T02:11:40.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.768+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff594156780 con 0x7ff59415c060 2023-07-09T02:11:40.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff58affd640 1 -- 172.21.15.45:0/3541533392 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7ff594156780 con 0x7ff59415c060 2023-07-09T02:11:40.773 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:40.774 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:40.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff574066280 msgr2=0x7ff574068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff574066280 0x7ff574068730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff5840af000 tx=0x7ff5840a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:40.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff59415c060 msgr2=0x7ff59415c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff59415c060 0x7ff59415c880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5940d2a10 tx=0x7ff58c00cf00 comp rx=0 tx=0).stop 2023-07-09T02:11:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 shutdown_connections 2023-07-09T02:11:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff574066280 0x7ff574068730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff59415c060 0x7ff59415c880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5940d2620 0x7ff5941549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 --2- 172.21.15.45:0/3541533392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5940cd120 0x7ff594157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 >> 172.21.15.45:0/3541533392 conn(0x7ff5940698e0 msgr2=0x7ff5940b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:40.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 shutdown_connections 2023-07-09T02:11:40.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.772+0000 7ff598dfa640 1 -- 172.21.15.45:0/3541533392 wait complete. 2023-07-09T02:11:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:40.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:40.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.936+0000 7f558c07b640 1 Processor -- start 2023-07-09T02:11:40.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.936+0000 7f558c07b640 1 -- start start 2023-07-09T02:11:40.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f558c07b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f558415c060 0x7f55840b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f558c07b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 0x7f55840cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f558c07b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5584160a50 con 0x7f55840cd120 2023-07-09T02:11:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f558c07b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558415c430 con 0x7f558415c060 2023-07-09T02:11:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f558c07b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558415fb60 con 0x7f55840d2620 2023-07-09T02:11:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f5589e17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f558415c060 0x7f55840b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f5589e17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f558415c060 0x7f55840b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34852/0 (socket says 172.21.15.45:34852) 2023-07-09T02:11:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f5589e17640 1 -- 172.21.15.45:0/1530500221 learned_addr learned my addr 172.21.15.45:0/1530500221 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f5589e17640 1 -- 172.21.15.45:0/1530500221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 msgr2=0x7f55840cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:40.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f5589e17640 1 --2- 172.21.15.45:0/1530500221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 0x7f55840cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f5589e17640 1 -- 172.21.15.45:0/1530500221 >> v1:172.21.15.155:6789/0 conn(0x7f55840cd120 legacy=0x7f55840d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:40.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.940+0000 7f5589e17640 1 -- 172.21.15.45:0/1530500221 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558415fe40 con 0x7f558415c060 2023-07-09T02:11:40.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f5589e17640 1 --2- 172.21.15.45:0/1530500221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558415c060 0x7f55840b4ed0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5580009870 tx=0x7f558001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a439c6140912336d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f5588e15640 1 -- 172.21.15.45:0/1530500221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800aa610 con 0x7f558415c060 2023-07-09T02:11:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f5588e15640 1 -- 172.21.15.45:0/1530500221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55800a6040 con 0x7f558415c060 2023-07-09T02:11:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f5588e15640 1 -- 172.21.15.45:0/1530500221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800aa990 con 0x7f558415c060 2023-07-09T02:11:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 -- 172.21.15.45:0/1530500221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558415c060 msgr2=0x7f55840b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 --2- 172.21.15.45:0/1530500221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558415c060 0x7f55840b4ed0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5580009870 tx=0x7f558001c4f0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 -- 172.21.15.45:0/1530500221 shutdown_connections 2023-07-09T02:11:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 --2- 172.21.15.45:0/1530500221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 0x7f55840cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 --2- 172.21.15.45:0/1530500221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558415c060 0x7f55840b4ed0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 -- 172.21.15.45:0/1530500221 >> 172.21.15.45:0/1530500221 conn(0x7f55840698e0 msgr2=0x7f5584069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 -- 172.21.15.45:0/1530500221 shutdown_connections 2023-07-09T02:11:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 -- 172.21.15.45:0/1530500221 wait complete. 2023-07-09T02:11:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 Processor -- start 2023-07-09T02:11:40.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.944+0000 7f558c07b640 1 -- start start 2023-07-09T02:11:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55840cd120 0x7f55840c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 0x7f55840c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f558415c060 0x7f55840ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5584159200 con 0x7f55840cd120 2023-07-09T02:11:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840cc7f0 con 0x7f558415c060 2023-07-09T02:11:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840ccad0 con 0x7f55840d2620 2023-07-09T02:11:40.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55840cd120 0x7f55840c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55840cd120 0x7f55840c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34868/0 (socket says 172.21.15.45:34868) 2023-07-09T02:11:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 -- 172.21.15.45:0/588828704 learned_addr learned my addr 172.21.15.45:0/588828704 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589616640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 0x7f55840c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558a618640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f558415c060 0x7f55840ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 -- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 msgr2=0x7f55840c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 0x7f55840c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 -- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f558415c060 msgr2=0x7f55840ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f558415c060 0x7f55840ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 -- 172.21.15.45:0/588828704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800094d0 con 0x7f55840cd120 2023-07-09T02:11:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f5589e17640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55840cd120 0x7f55840c8350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f55800ac040 tx=0x7f558001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f557a7fc640 1 -- 172.21.15.45:0/588828704 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800bd5f0 con 0x7f55840cd120 2023-07-09T02:11:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f557a7fc640 1 -- 172.21.15.45:0/588828704 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55800bd770 con 0x7f55840cd120 2023-07-09T02:11:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f557a7fc640 1 -- 172.21.15.45:0/588828704 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800bdb20 con 0x7f55840cd120 2023-07-09T02:11:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55840b59f0 con 0x7f55840cd120 2023-07-09T02:11:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5584159450 con 0x7f55840cd120 2023-07-09T02:11:40.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558404d7d0 con 0x7f55840cd120 2023-07-09T02:11:40.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.948+0000 7f557a7fc640 1 -- 172.21.15.45:0/588828704 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55800b3600 con 0x7f55840cd120 2023-07-09T02:11:40.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.952+0000 7f557a7fc640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5568066280 0x7f5568068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:40.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.952+0000 7f557a7fc640 1 -- 172.21.15.45:0/588828704 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f558011ecc0 con 0x7f55840cd120 2023-07-09T02:11:40.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.952+0000 7f5589616640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5568066280 0x7f5568068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:40.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.952+0000 7f5589616640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5568066280 0x7f5568068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5584155990 tx=0x7f5574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:40.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:40.956+0000 7f557a7fc640 1 -- 172.21.15.45:0/588828704 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5580125080 con 0x7f55840cd120 2023-07-09T02:11:41.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f558415b890 con 0x7f55840cd120 2023-07-09T02:11:41.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f557a7fc640 1 -- 172.21.15.45:0/588828704 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55800c30a0 con 0x7f55840cd120 2023-07-09T02:11:41.116 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:41.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5568066280 msgr2=0x7f5568068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5568066280 0x7f5568068730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5584155990 tx=0x7f5574009040 comp rx=0 tx=0).stop 2023-07-09T02:11:41.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55840cd120 msgr2=0x7f55840c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55840cd120 0x7f55840c8350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f55800ac040 tx=0x7f558001ad30 comp rx=0 tx=0).stop 2023-07-09T02:11:41.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 shutdown_connections 2023-07-09T02:11:41.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f558415c060 0x7f55840ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5568066280 0x7f5568068730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55840d2620 0x7f55840c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 --2- 172.21.15.45:0/588828704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55840cd120 0x7f55840c8350 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 >> 172.21.15.45:0/588828704 conn(0x7f55840698e0 msgr2=0x7f55840d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:41.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 shutdown_connections 2023-07-09T02:11:41.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.112+0000 7f558c07b640 1 -- 172.21.15.45:0/588828704 wait complete. 2023-07-09T02:11:41.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:41.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28fb74640 1 Processor -- start 2023-07-09T02:11:41.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28fb74640 1 -- start start 2023-07-09T02:11:41.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28fb74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd28815c060 0x7fd2880b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28fb74640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd288160a50 con 0x7fd2880cd120 2023-07-09T02:11:41.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28fb74640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28815c430 con 0x7fd2880d2620 2023-07-09T02:11:41.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28fb74640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28815fb60 con 0x7fd28815c060 2023-07-09T02:11:41.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28d10f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2880cd120 0x7fd2880d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49012/0 (socket says 172.21.15.45:49012) 2023-07-09T02:11:41.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28d10f640 1 -- 172.21.15.45:0/1599675993 learned_addr learned my addr 172.21.15.45:0/1599675993 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:41.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28d910640 1 --2- 172.21.15.45:0/1599675993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd28815c060 0x7fd2880b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28c90e640 1 -- 172.21.15.45:0/1599675993 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320928384 0 0) 0x7fd288160a50 con 0x7fd2880cd120 2023-07-09T02:11:41.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28c90e640 1 -- 172.21.15.45:0/1599675993 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd274003530 con 0x7fd2880cd120 2023-07-09T02:11:41.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28c90e640 1 -- 172.21.15.45:0/1599675993 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894358835 0 0) 0x7fd28815c430 con 0x7fd2880d2620 2023-07-09T02:11:41.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28c90e640 1 -- 172.21.15.45:0/1599675993 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd288160a50 con 0x7fd2880d2620 2023-07-09T02:11:41.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28d910640 1 -- 172.21.15.45:0/1599675993 >> v1:172.21.15.155:6789/0 conn(0x7fd2880d2620 legacy=0x7fd2880cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28d910640 1 -- 172.21.15.45:0/1599675993 >> v1:172.21.15.45:6789/0 conn(0x7fd2880cd120 legacy=0x7fd2880d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.280+0000 7fd28d910640 1 -- 172.21.15.45:0/1599675993 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28815fe40 con 0x7fd28815c060 2023-07-09T02:11:41.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28d910640 1 --2- 172.21.15.45:0/1599675993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd28815c060 0x7fd2880b4ed0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd284009820 tx=0x7fd28401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e2b0b6b3f5c689 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28c90e640 1 -- 172.21.15.45:0/1599675993 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840ab670 con 0x7fd28815c060 2023-07-09T02:11:41.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28c90e640 1 -- 172.21.15.45:0/1599675993 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2840ab7d0 con 0x7fd28815c060 2023-07-09T02:11:41.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28c90e640 1 -- 172.21.15.45:0/1599675993 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840abb60 con 0x7fd28815c060 2023-07-09T02:11:41.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28fb74640 1 -- 172.21.15.45:0/1599675993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd28815c060 msgr2=0x7fd2880b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28fb74640 1 --2- 172.21.15.45:0/1599675993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd28815c060 0x7fd2880b4ed0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd284009820 tx=0x7fd28401c470 comp rx=0 tx=0).stop 2023-07-09T02:11:41.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28fb74640 1 -- 172.21.15.45:0/1599675993 shutdown_connections 2023-07-09T02:11:41.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28fb74640 1 --2- 172.21.15.45:0/1599675993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd28815c060 0x7fd2880b4ed0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28fb74640 1 -- 172.21.15.45:0/1599675993 >> 172.21.15.45:0/1599675993 conn(0x7fd2880698e0 msgr2=0x7fd288069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:41.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28fb74640 1 -- 172.21.15.45:0/1599675993 shutdown_connections 2023-07-09T02:11:41.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.284+0000 7fd28fb74640 1 -- 172.21.15.45:0/1599675993 wait complete. 2023-07-09T02:11:41.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 Processor -- start 2023-07-09T02:11:41.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 -- start start 2023-07-09T02:11:41.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2880cd120 0x7fd28814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2880d2620 0x7fd288153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd28815c060 0x7fd288158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288152ab0 con 0x7fd28815c060 2023-07-09T02:11:41.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28814f680 con 0x7fd2880cd120 2023-07-09T02:11:41.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28815b170 con 0x7fd2880d2620 2023-07-09T02:11:41.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd28815c060 0x7fd288158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd28815c060 0x7fd288158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34876/0 (socket says 172.21.15.45:34876) 2023-07-09T02:11:41.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 -- 172.21.15.45:0/3837051152 learned_addr learned my addr 172.21.15.45:0/3837051152 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:41.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28d10f640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2880d2620 0x7fd288153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28d910640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2880cd120 0x7fd28814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 -- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2880d2620 msgr2=0x7fd288153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2880d2620 0x7fd288153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 -- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2880cd120 msgr2=0x7fd28814f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2880cd120 0x7fd28814f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 -- 172.21.15.45:0/3837051152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009420 con 0x7fd28815c060 2023-07-09T02:11:41.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28e111640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd28815c060 0x7fd288158a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c730 tx=0x7fd28000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd27e7fc640 1 -- 172.21.15.45:0/3837051152 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280003b80 con 0x7fd28815c060 2023-07-09T02:11:41.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd27e7fc640 1 -- 172.21.15.45:0/3837051152 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280003ce0 con 0x7fd28815c060 2023-07-09T02:11:41.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd27e7fc640 1 -- 172.21.15.45:0/3837051152 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000aa90 con 0x7fd28815c060 2023-07-09T02:11:41.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2880b59f0 con 0x7fd28815c060 2023-07-09T02:11:41.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.288+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28815b730 con 0x7fd28815c060 2023-07-09T02:11:41.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.292+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28804d7d0 con 0x7fd28815c060 2023-07-09T02:11:41.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.292+0000 7fd27e7fc640 1 -- 172.21.15.45:0/3837051152 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd28000abf0 con 0x7fd28815c060 2023-07-09T02:11:41.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.292+0000 7fd27e7fc640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd26c066280 0x7fd26c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.292+0000 7fd27e7fc640 1 -- 172.21.15.45:0/3837051152 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd280083ca0 con 0x7fd28815c060 2023-07-09T02:11:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.292+0000 7fd28d910640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd26c066280 0x7fd26c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.292+0000 7fd28d910640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd26c066280 0x7fd26c068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd2840af000 tx=0x7fd2840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.296+0000 7fd27e7fc640 1 -- 172.21.15.45:0/3837051152 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd280051080 con 0x7fd28815c060 2023-07-09T02:11:41.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.452+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd28806baa0 con 0x7fd28815c060 2023-07-09T02:11:41.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.452+0000 7fd27e7fc640 1 -- 172.21.15.45:0/3837051152 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2800546a0 con 0x7fd28815c060 2023-07-09T02:11:41.456 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:41.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.452+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd26c066280 msgr2=0x7fd26c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.452+0000 7fd28fb74640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd26c066280 0x7fd26c068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd2840af000 tx=0x7fd2840a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:41.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd28815c060 msgr2=0x7fd288158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd28815c060 0x7fd288158a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c730 tx=0x7fd28000cbf0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 shutdown_connections 2023-07-09T02:11:41.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd28815c060 0x7fd288158a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd26c066280 0x7fd26c068730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2880d2620 0x7fd288153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 --2- 172.21.15.45:0/3837051152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2880cd120 0x7fd28814f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 >> 172.21.15.45:0/3837051152 conn(0x7fd2880698e0 msgr2=0x7fd2880b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:41.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 shutdown_connections 2023-07-09T02:11:41.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.456+0000 7fd28fb74640 1 -- 172.21.15.45:0/3837051152 wait complete. 2023-07-09T02:11:41.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765e76640 1 Processor -- start 2023-07-09T02:11:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765e76640 1 -- start start 2023-07-09T02:11:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765e76640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27600b1bc0 0x7f2760069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765e76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f2760069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765e76640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f27600ccf10 0x7f2760070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765e76640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27600cea70 con 0x7f27600b1bc0 2023-07-09T02:11:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765e76640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27600b1f90 con 0x7f27600ccf10 2023-07-09T02:11:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765e76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600ceff0 con 0x7f27600d2400 2023-07-09T02:11:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2764e74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27600b1bc0 0x7f2760069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2764e74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27600b1bc0 0x7f2760069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60588/0 (socket says 172.21.15.45:60588) 2023-07-09T02:11:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2764e74640 1 -- 172.21.15.45:0/3730738244 learned_addr learned my addr 172.21.15.45:0/3730738244 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f275ffff640 1 --2- 172.21.15.45:0/3730738244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f2760069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765675640 1 --2- 172.21.15.45:0/3730738244 >> v2:172.21.15.155:3300/0 conn(0x7f27600ccf10 0x7f2760070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2764e74640 1 -- 172.21.15.45:0/3730738244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 msgr2=0x7f2760069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2764e74640 1 --2- 172.21.15.45:0/3730738244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f2760069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2764e74640 1 -- 172.21.15.45:0/3730738244 >> v2:172.21.15.155:3300/0 conn(0x7f27600ccf10 msgr2=0x7f2760070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2764e74640 1 --2- 172.21.15.45:0/3730738244 >> v2:172.21.15.155:3300/0 conn(0x7f27600ccf10 0x7f2760070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2764e74640 1 -- 172.21.15.45:0/3730738244 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600d1500 con 0x7f27600b1bc0 2023-07-09T02:11:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f2765675640 1 --2- 172.21.15.45:0/3730738244 >> v2:172.21.15.155:3300/0 conn(0x7f27600ccf10 0x7f2760070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.624+0000 7f275ffff640 1 --2- 172.21.15.45:0/3730738244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f2760069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2764e74640 1 --2- 172.21.15.45:0/3730738244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600b1bc0 0x7f2760069870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27600c9920 tx=0x7f275401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef790b02a9a33dff server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f275f7fe640 1 -- 172.21.15.45:0/3730738244 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540ab600 con 0x7f27600b1bc0 2023-07-09T02:11:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f275f7fe640 1 -- 172.21.15.45:0/3730738244 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27540a7050 con 0x7f27600b1bc0 2023-07-09T02:11:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f275f7fe640 1 -- 172.21.15.45:0/3730738244 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540ab980 con 0x7f27600b1bc0 2023-07-09T02:11:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 -- 172.21.15.45:0/3730738244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600b1bc0 msgr2=0x7f2760069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 --2- 172.21.15.45:0/3730738244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600b1bc0 0x7f2760069870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27600c9920 tx=0x7f275401c210 comp rx=0 tx=0).stop 2023-07-09T02:11:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 -- 172.21.15.45:0/3730738244 shutdown_connections 2023-07-09T02:11:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 --2- 172.21.15.45:0/3730738244 >> v2:172.21.15.155:3300/0 conn(0x7f27600ccf10 0x7f2760070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 --2- 172.21.15.45:0/3730738244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f2760069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 --2- 172.21.15.45:0/3730738244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600b1bc0 0x7f2760069870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 -- 172.21.15.45:0/3730738244 >> 172.21.15.45:0/3730738244 conn(0x7f27600d35b0 msgr2=0x7f27600cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 -- 172.21.15.45:0/3730738244 shutdown_connections 2023-07-09T02:11:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.628+0000 7f2765e76640 1 -- 172.21.15.45:0/3730738244 wait complete. 2023-07-09T02:11:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 Processor -- start 2023-07-09T02:11:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 -- start start 2023-07-09T02:11:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27600b1bc0 0x7f27600c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600ccf10 0x7f27600cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f276014d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c8060 con 0x7f27600ccf10 2023-07-09T02:11:41.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c9a40 con 0x7f27600b1bc0 2023-07-09T02:11:41.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276014e5c0 con 0x7f27600d2400 2023-07-09T02:11:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600ccf10 0x7f27600cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600ccf10 0x7f27600cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60602/0 (socket says 172.21.15.45:60602) 2023-07-09T02:11:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 -- 172.21.15.45:0/2801345137 learned_addr learned my addr 172.21.15.45:0/2801345137 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2764e74640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27600b1bc0 0x7f27600c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765675640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f276014d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 -- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 msgr2=0x7f276014d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f276014d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 -- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27600b1bc0 msgr2=0x7f27600c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27600b1bc0 0x7f27600c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 -- 172.21.15.45:0/2801345137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27540094d0 con 0x7f27600ccf10 2023-07-09T02:11:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275ffff640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600ccf10 0x7f27600cc2d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f274c00c7f0 tx=0x7f274c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275d7fa640 1 -- 172.21.15.45:0/2801345137 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c007820 con 0x7f27600ccf10 2023-07-09T02:11:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275d7fa640 1 -- 172.21.15.45:0/2801345137 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c007980 con 0x7f27600ccf10 2023-07-09T02:11:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f275d7fa640 1 -- 172.21.15.45:0/2801345137 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c007d30 con 0x7f27600ccf10 2023-07-09T02:11:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276014ee20 con 0x7f27600ccf10 2023-07-09T02:11:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.632+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276014eb40 con 0x7f27600ccf10 2023-07-09T02:11:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.636+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27600c81a0 con 0x7f27600ccf10 2023-07-09T02:11:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.636+0000 7f275d7fa640 1 -- 172.21.15.45:0/2801345137 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f274c0113f0 con 0x7f27600ccf10 2023-07-09T02:11:41.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.636+0000 7f275d7fa640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.636+0000 7f275d7fa640 1 -- 172.21.15.45:0/2801345137 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f274c083fe0 con 0x7f27600ccf10 2023-07-09T02:11:41.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.636+0000 7f2764e74640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.636+0000 7f2764e74640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f27540ad000 tx=0x7f2754008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.640+0000 7f275d7fa640 1 -- 172.21.15.45:0/2801345137 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27600c81a0 con 0x7f27600ccf10 2023-07-09T02:11:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27600c81a0 con 0x7f27600ccf10 2023-07-09T02:11:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f275d7fa640 1 -- 172.21.15.45:0/2801345137 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27600c81a0 con 0x7f27600ccf10 2023-07-09T02:11:41.799 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 msgr2=0x7f2744068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f27540ad000 tx=0x7f2754008040 comp rx=0 tx=0).stop 2023-07-09T02:11:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600ccf10 msgr2=0x7f27600cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600ccf10 0x7f27600cc2d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f274c00c7f0 tx=0x7f274c00ccb0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 shutdown_connections 2023-07-09T02:11:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27600d2400 0x7f276014d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27600ccf10 0x7f27600cc2d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 --2- 172.21.15.45:0/2801345137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27600b1bc0 0x7f27600c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 >> 172.21.15.45:0/2801345137 conn(0x7f27600d35b0 msgr2=0x7f27600d16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 shutdown_connections 2023-07-09T02:11:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.796+0000 7f2765e76640 1 -- 172.21.15.45:0/2801345137 wait complete. 2023-07-09T02:11:41.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:41.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.964+0000 7f877fde9640 1 Processor -- start 2023-07-09T02:11:41.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.964+0000 7f877fde9640 1 -- start start 2023-07-09T02:11:41.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877fde9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87780cb5d0 0x7f877806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877fde9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877806caa0 con 0x7f877806c110 2023-07-09T02:11:41.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877fde9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87780ccf80 con 0x7f8778158e30 2023-07-09T02:11:41.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877fde9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780cd540 con 0x7f87780cb5d0 2023-07-09T02:11:41.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877e386640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87780cb5d0 0x7f877806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877d384640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f877806c110 0x7f87780caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45172/0 (socket says 172.21.15.45:45172) 2023-07-09T02:11:41.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877d384640 1 -- 172.21.15.45:0/1915758366 learned_addr learned my addr 172.21.15.45:0/1915758366 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:41.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877e386640 1 -- 172.21.15.45:0/1915758366 >> v1:172.21.15.155:6789/0 conn(0x7f8778158e30 legacy=0x7f877806f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877e386640 1 -- 172.21.15.45:0/1915758366 >> v1:172.21.15.45:6789/0 conn(0x7f877806c110 legacy=0x7f87780caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.968+0000 7f877e386640 1 -- 172.21.15.45:0/1915758366 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780c8fb0 con 0x7f87780cb5d0 2023-07-09T02:11:41.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877e386640 1 --2- 172.21.15.45:0/1915758366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780cb5d0 0x7f877806c560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8770009d90 tx=0x7f877001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3eec7b713702a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877cb83640 1 -- 172.21.15.45:0/1915758366 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700a5760 con 0x7f87780cb5d0 2023-07-09T02:11:41.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877cb83640 1 -- 172.21.15.45:0/1915758366 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87700a58c0 con 0x7f87780cb5d0 2023-07-09T02:11:41.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877cb83640 1 -- 172.21.15.45:0/1915758366 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700a5c50 con 0x7f87780cb5d0 2023-07-09T02:11:41.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 -- 172.21.15.45:0/1915758366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780cb5d0 msgr2=0x7f877806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 --2- 172.21.15.45:0/1915758366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780cb5d0 0x7f877806c560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8770009d90 tx=0x7f877001c720 comp rx=0 tx=0).stop 2023-07-09T02:11:41.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 -- 172.21.15.45:0/1915758366 shutdown_connections 2023-07-09T02:11:41.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 --2- 172.21.15.45:0/1915758366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780cb5d0 0x7f877806c560 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 -- 172.21.15.45:0/1915758366 >> 172.21.15.45:0/1915758366 conn(0x7f87780694b0 msgr2=0x7f87780698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 -- 172.21.15.45:0/1915758366 shutdown_connections 2023-07-09T02:11:41.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 -- 172.21.15.45:0/1915758366 wait complete. 2023-07-09T02:11:41.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 Processor -- start 2023-07-09T02:11:41.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.972+0000 7f877fde9640 1 -- start start 2023-07-09T02:11:41.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877806c110 0x7f877814bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87780cb5d0 0x7f8778142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8778158e30 0x7f877814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780c75f0 con 0x7f877806c110 2023-07-09T02:11:41.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780c78d0 con 0x7f87780cb5d0 2023-07-09T02:11:41.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780c7bb0 con 0x7f8778158e30 2023-07-09T02:11:41.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877806c110 0x7f877814bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877806c110 0x7f877814bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60630/0 (socket says 172.21.15.45:60630) 2023-07-09T02:11:41.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 -- 172.21.15.45:0/214798052 learned_addr learned my addr 172.21.15.45:0/214798052 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:41.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877d384640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87780cb5d0 0x7f8778142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877e386640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8778158e30 0x7f877814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 -- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8778158e30 msgr2=0x7f877814a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8778158e30 0x7f877814a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 -- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87780cb5d0 msgr2=0x7f8778142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:41.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87780cb5d0 0x7f8778142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:41.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 -- 172.21.15.45:0/214798052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770009a70 con 0x7f877806c110 2023-07-09T02:11:41.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877e386640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8778158e30 0x7f877814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:41.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877d384640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87780cb5d0 0x7f8778142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:41.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877db85640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877806c110 0x7f877814bbd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f877400c3c0 tx=0x7f877400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f876e7fc640 1 -- 172.21.15.45:0/214798052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740052d0 con 0x7f877806c110 2023-07-09T02:11:41.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f876e7fc640 1 -- 172.21.15.45:0/214798052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774005430 con 0x7f877806c110 2023-07-09T02:11:41.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877814a120 con 0x7f877806c110 2023-07-09T02:11:41.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f876e7fc640 1 -- 172.21.15.45:0/214798052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774003840 con 0x7f877806c110 2023-07-09T02:11:41.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877814c110 con 0x7f877806c110 2023-07-09T02:11:41.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877804d7d0 con 0x7f877806c110 2023-07-09T02:11:41.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.976+0000 7f876e7fc640 1 -- 172.21.15.45:0/214798052 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87740039a0 con 0x7f877806c110 2023-07-09T02:11:41.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.980+0000 7f876e7fc640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f875c066280 0x7f875c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:41.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.980+0000 7f876e7fc640 1 -- 172.21.15.45:0/214798052 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8774083310 con 0x7f877806c110 2023-07-09T02:11:41.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.980+0000 7f877d384640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f875c066280 0x7f875c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:41.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.980+0000 7f877d384640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f875c066280 0x7f875c068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f87780cf330 tx=0x7f8768009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:41.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:41.980+0000 7f876e7fc640 1 -- 172.21.15.45:0/214798052 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87740506f0 con 0x7f877806c110 2023-07-09T02:11:42.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.136+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f877814a5d0 con 0x7f877806c110 2023-07-09T02:11:42.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f876e7fc640 1 -- 172.21.15.45:0/214798052 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8774053d10 con 0x7f877806c110 2023-07-09T02:11:42.141 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:42.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f875c066280 msgr2=0x7f875c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f875c066280 0x7f875c068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f87780cf330 tx=0x7f8768009040 comp rx=0 tx=0).stop 2023-07-09T02:11:42.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877806c110 msgr2=0x7f877814bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877806c110 0x7f877814bbd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f877400c3c0 tx=0x7f877400c880 comp rx=0 tx=0).stop 2023-07-09T02:11:42.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 shutdown_connections 2023-07-09T02:11:42.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f875c066280 0x7f875c068730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8778158e30 0x7f877814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87780cb5d0 0x7f8778142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 --2- 172.21.15.45:0/214798052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f877806c110 0x7f877814bbd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 >> 172.21.15.45:0/214798052 conn(0x7f87780694b0 msgr2=0x7f877814ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:42.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 shutdown_connections 2023-07-09T02:11:42.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.140+0000 7f877fde9640 1 -- 172.21.15.45:0/214798052 wait complete. 2023-07-09T02:11:42.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:42.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.304+0000 7fc338159640 1 Processor -- start 2023-07-09T02:11:42.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.304+0000 7fc338159640 1 -- start start 2023-07-09T02:11:42.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc338159640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc33015c060 0x7fc3300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc338159640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3300d2620 0x7fc3300cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc338159640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc330160a50 con 0x7fc3300cd120 2023-07-09T02:11:42.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc338159640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33015c430 con 0x7fc3300d2620 2023-07-09T02:11:42.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc338159640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33015fb60 con 0x7fc33015c060 2023-07-09T02:11:42.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc3366f6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3300d2620 0x7fc3300cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc335ef5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc33015c060 0x7fc3300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc3366f6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3300d2620 0x7fc3300cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60634/0 (socket says 172.21.15.45:60634) 2023-07-09T02:11:42.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc3366f6640 1 -- 172.21.15.45:0/2901300046 learned_addr learned my addr 172.21.15.45:0/2901300046 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:42.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc3356f4640 1 --1- 172.21.15.45:0/2901300046 >> v1:172.21.15.155:6789/0 conn(0x7fc3300cd120 0x7fc3300d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:46860/0 (socket says 172.21.15.45:46860) 2023-07-09T02:11:42.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc335ef5640 1 -- 172.21.15.45:0/2901300046 >> v2:172.21.15.45:3300/0 conn(0x7fc3300d2620 msgr2=0x7fc3300cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:42.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc335ef5640 1 --2- 172.21.15.45:0/2901300046 >> v2:172.21.15.45:3300/0 conn(0x7fc3300d2620 0x7fc3300cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc335ef5640 1 -- 172.21.15.45:0/2901300046 >> v1:172.21.15.155:6789/0 conn(0x7fc3300cd120 legacy=0x7fc3300d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc335ef5640 1 -- 172.21.15.45:0/2901300046 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33015fe40 con 0x7fc33015c060 2023-07-09T02:11:42.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.308+0000 7fc3366f6640 1 --2- 172.21.15.45:0/2901300046 >> v2:172.21.15.45:3300/0 conn(0x7fc3300d2620 0x7fc3300cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:42.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc335ef5640 1 --2- 172.21.15.45:0/2901300046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33015c060 0x7fc3300b4ed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc3300d3ad0 tx=0x7fc32c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de856d9319a79be1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:42.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc334ef3640 1 -- 172.21.15.45:0/2901300046 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0a7070 con 0x7fc33015c060 2023-07-09T02:11:42.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc334ef3640 1 -- 172.21.15.45:0/2901300046 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0ab430 con 0x7fc33015c060 2023-07-09T02:11:42.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc334ef3640 1 -- 172.21.15.45:0/2901300046 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0ab7c0 con 0x7fc33015c060 2023-07-09T02:11:42.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 -- 172.21.15.45:0/2901300046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33015c060 msgr2=0x7fc3300b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 --2- 172.21.15.45:0/2901300046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33015c060 0x7fc3300b4ed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc3300d3ad0 tx=0x7fc32c01c430 comp rx=0 tx=0).stop 2023-07-09T02:11:42.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 -- 172.21.15.45:0/2901300046 shutdown_connections 2023-07-09T02:11:42.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 --2- 172.21.15.45:0/2901300046 >> v2:172.21.15.45:3300/0 conn(0x7fc3300d2620 0x7fc3300cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 --2- 172.21.15.45:0/2901300046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33015c060 0x7fc3300b4ed0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 -- 172.21.15.45:0/2901300046 >> 172.21.15.45:0/2901300046 conn(0x7fc3300698e0 msgr2=0x7fc330069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:42.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 -- 172.21.15.45:0/2901300046 shutdown_connections 2023-07-09T02:11:42.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 -- 172.21.15.45:0/2901300046 wait complete. 2023-07-09T02:11:42.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 Processor -- start 2023-07-09T02:11:42.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.312+0000 7fc338159640 1 -- start start 2023-07-09T02:11:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3300cd120 0x7fc33015c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3300d2620 0x7fc330156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc33015c060 0x7fc3300b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33015d7d0 con 0x7fc3300cd120 2023-07-09T02:11:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33015cb50 con 0x7fc3300d2620 2023-07-09T02:11:42.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33015ce30 con 0x7fc33015c060 2023-07-09T02:11:42.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3300cd120 0x7fc33015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3300cd120 0x7fc33015c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60640/0 (socket says 172.21.15.45:60640) 2023-07-09T02:11:42.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 -- 172.21.15.45:0/3239828672 learned_addr learned my addr 172.21.15.45:0/3239828672 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:42.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc3366f6640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc33015c060 0x7fc3300b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc3356f4640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3300d2620 0x7fc330156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 -- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc33015c060 msgr2=0x7fc3300b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc33015c060 0x7fc3300b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 -- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3300d2620 msgr2=0x7fc330156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3300d2620 0x7fc330156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 -- 172.21.15.45:0/3239828672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009b30 con 0x7fc3300cd120 2023-07-09T02:11:42.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc335ef5640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3300cd120 0x7fc33015c570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0ad040 tx=0x7fc32c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:42.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc3267fc640 1 -- 172.21.15.45:0/3239828672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0bf610 con 0x7fc3300cd120 2023-07-09T02:11:42.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc3267fc640 1 -- 172.21.15.45:0/3239828672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0bf790 con 0x7fc3300cd120 2023-07-09T02:11:42.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc3267fc640 1 -- 172.21.15.45:0/3239828672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0bfb40 con 0x7fc3300cd120 2023-07-09T02:11:42.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c009420 con 0x7fc3300cd120 2023-07-09T02:11:42.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3300b59f0 con 0x7fc3300cd120 2023-07-09T02:11:42.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33004d7d0 con 0x7fc3300cd120 2023-07-09T02:11:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc3267fc640 1 -- 172.21.15.45:0/3239828672 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc32c0b5400 con 0x7fc3300cd120 2023-07-09T02:11:42.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.316+0000 7fc3267fc640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc314066280 0x7fc314068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.320+0000 7fc3267fc640 1 -- 172.21.15.45:0/3239828672 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc32c11e4a0 con 0x7fc3300cd120 2023-07-09T02:11:42.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.320+0000 7fc3356f4640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc314066280 0x7fc314068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.320+0000 7fc3356f4640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc314066280 0x7fc314068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3300b7da0 tx=0x7fc320007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:42.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.320+0000 7fc3267fc640 1 -- 172.21.15.45:0/3239828672 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc32c0eb9c0 con 0x7fc3300cd120 2023-07-09T02:11:42.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.476+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc33006baa0 con 0x7fc3300cd120 2023-07-09T02:11:42.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.476+0000 7fc3267fc640 1 -- 172.21.15.45:0/3239828672 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fc32c0eefe0 con 0x7fc3300cd120 2023-07-09T02:11:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:42.481 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:42.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc314066280 msgr2=0x7fc314068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc314066280 0x7fc314068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3300b7da0 tx=0x7fc320007cd0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3300cd120 msgr2=0x7fc33015c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3300cd120 0x7fc33015c570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0ad040 tx=0x7fc32c01ac70 comp rx=0 tx=0).stop 2023-07-09T02:11:42.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 shutdown_connections 2023-07-09T02:11:42.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc314066280 0x7fc314068730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc33015c060 0x7fc3300b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3300d2620 0x7fc330156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 --2- 172.21.15.45:0/3239828672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3300cd120 0x7fc33015c570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 >> 172.21.15.45:0/3239828672 conn(0x7fc3300698e0 msgr2=0x7fc3300b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:42.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 shutdown_connections 2023-07-09T02:11:42.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.480+0000 7fc338159640 1 -- 172.21.15.45:0/3239828672 wait complete. 2023-07-09T02:11:42.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:42.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:42.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f996acd8640 1 Processor -- start 2023-07-09T02:11:42.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f996acd8640 1 -- start start 2023-07-09T02:11:42.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f996acd8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f996415c060 0x7f99640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f996acd8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99640cd120 0x7f99640d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f996acd8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9964160a50 con 0x7f99640d2450 2023-07-09T02:11:42.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f996acd8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99640d28f0 con 0x7f996415c060 2023-07-09T02:11:42.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f996acd8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99640cfe40 con 0x7f99640cd120 2023-07-09T02:11:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f9963fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99640cd120 0x7f99640d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f9968a74640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f996415c060 0x7f99640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f9969275640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f99640d2450 0x7f99640d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:46864/0 (socket says 172.21.15.45:46864) 2023-07-09T02:11:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f9969275640 1 -- 172.21.15.45:0/2961888739 learned_addr learned my addr 172.21.15.45:0/2961888739 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f9968a74640 1 -- 172.21.15.45:0/2961888739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99640cd120 msgr2=0x7f99640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f9968a74640 1 --2- 172.21.15.45:0/2961888739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99640cd120 0x7f99640d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f9968a74640 1 -- 172.21.15.45:0/2961888739 >> v1:172.21.15.155:6789/0 conn(0x7f99640d2450 legacy=0x7f99640d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f9968a74640 1 -- 172.21.15.45:0/2961888739 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996415c430 con 0x7f996415c060 2023-07-09T02:11:42.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.648+0000 7f99637fe640 1 -- 172.21.15.45:0/2961888739 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125380353 0 0) 0x7f9964160a50 con 0x7f99640d2450 2023-07-09T02:11:42.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.652+0000 7f9968a74640 1 --2- 172.21.15.45:0/2961888739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996415c060 0x7f99640b4ed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f99580097c0 tx=0x7f995801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb44e7bc64833f45 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.652+0000 7f99637fe640 1 -- 172.21.15.45:0/2961888739 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580ab600 con 0x7f996415c060 2023-07-09T02:11:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.652+0000 7f99637fe640 1 -- 172.21.15.45:0/2961888739 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99580a7050 con 0x7f996415c060 2023-07-09T02:11:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.652+0000 7f99637fe640 1 -- 172.21.15.45:0/2961888739 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580ab980 con 0x7f996415c060 2023-07-09T02:11:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.652+0000 7f996acd8640 1 -- 172.21.15.45:0/2961888739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996415c060 msgr2=0x7f99640b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.652+0000 7f996acd8640 1 --2- 172.21.15.45:0/2961888739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996415c060 0x7f99640b4ed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f99580097c0 tx=0x7f995801c450 comp rx=0 tx=0).stop 2023-07-09T02:11:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 -- 172.21.15.45:0/2961888739 shutdown_connections 2023-07-09T02:11:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 --2- 172.21.15.45:0/2961888739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99640cd120 0x7f99640d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 --2- 172.21.15.45:0/2961888739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996415c060 0x7f99640b4ed0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 -- 172.21.15.45:0/2961888739 >> 172.21.15.45:0/2961888739 conn(0x7f99640698e0 msgr2=0x7f9964069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 -- 172.21.15.45:0/2961888739 shutdown_connections 2023-07-09T02:11:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 -- 172.21.15.45:0/2961888739 wait complete. 2023-07-09T02:11:42.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 Processor -- start 2023-07-09T02:11:42.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 -- start start 2023-07-09T02:11:42.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640cd120 0x7f996415e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99640d2450 0x7f99640b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996415c060 0x7f99640b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99640b2eb0 con 0x7f99640cd120 2023-07-09T02:11:42.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99640b3190 con 0x7f99640d2450 2023-07-09T02:11:42.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f996acd8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996415dd60 con 0x7f996415c060 2023-07-09T02:11:42.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9968a74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640cd120 0x7f996415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9968a74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640cd120 0x7f996415e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60652/0 (socket says 172.21.15.45:60652) 2023-07-09T02:11:42.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9968a74640 1 -- 172.21.15.45:0/3588702254 learned_addr learned my addr 172.21.15.45:0/3588702254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:42.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9963fff640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99640d2450 0x7f99640b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9969275640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996415c060 0x7f99640b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9968a74640 1 -- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996415c060 msgr2=0x7f99640b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9968a74640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996415c060 0x7f99640b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9968a74640 1 -- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99640d2450 msgr2=0x7f99640b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9968a74640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99640d2450 0x7f99640b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.656+0000 7f9968a74640 1 -- 172.21.15.45:0/3588702254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009420 con 0x7f99640cd120 2023-07-09T02:11:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f9968a74640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640cd120 0x7f996415e840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99580ae040 tx=0x7f995801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f99617fa640 1 -- 172.21.15.45:0/3588702254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580b7450 con 0x7f99640cd120 2023-07-09T02:11:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f99617fa640 1 -- 172.21.15.45:0/3588702254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99580b75b0 con 0x7f99640cd120 2023-07-09T02:11:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996415e040 con 0x7f99640cd120 2023-07-09T02:11:42.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f99617fa640 1 -- 172.21.15.45:0/3588702254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580b7960 con 0x7f99640cd120 2023-07-09T02:11:42.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9964153d70 con 0x7f99640cd120 2023-07-09T02:11:42.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996404d7d0 con 0x7f99640cd120 2023-07-09T02:11:42.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f99617fa640 1 -- 172.21.15.45:0/3588702254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99580b7ac0 con 0x7f99640cd120 2023-07-09T02:11:42.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f99617fa640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99480662b0 0x7f9948068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f99617fa640 1 -- 172.21.15.45:0/3588702254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f995811e4b0 con 0x7f99640cd120 2023-07-09T02:11:42.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.660+0000 7f9963fff640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99480662b0 0x7f9948068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.664+0000 7f9963fff640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99480662b0 0x7f9948068760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f996415f770 tx=0x7f9950009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:42.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.664+0000 7f99617fa640 1 -- 172.21.15.45:0/3588702254 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99580eb890 con 0x7f99640cd120 2023-07-09T02:11:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.816+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f996406baa0 con 0x7f99640cd120 2023-07-09T02:11:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.816+0000 7f99617fa640 1 -- 172.21.15.45:0/3588702254 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99580eeeb0 con 0x7f99640cd120 2023-07-09T02:11:42.821 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99480662b0 msgr2=0x7f9948068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99480662b0 0x7f9948068760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f996415f770 tx=0x7f9950009190 comp rx=0 tx=0).stop 2023-07-09T02:11:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640cd120 msgr2=0x7f996415e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640cd120 0x7f996415e840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99580ae040 tx=0x7f995801ac90 comp rx=0 tx=0).stop 2023-07-09T02:11:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 shutdown_connections 2023-07-09T02:11:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99480662b0 0x7f9948068760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996415c060 0x7f99640b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99640d2450 0x7f99640b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 --2- 172.21.15.45:0/3588702254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99640cd120 0x7f996415e840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 >> 172.21.15.45:0/3588702254 conn(0x7f99640698e0 msgr2=0x7f99640b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:42.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 shutdown_connections 2023-07-09T02:11:42.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.820+0000 7f996acd8640 1 -- 172.21.15.45:0/3588702254 wait complete. 2023-07-09T02:11:42.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:42.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f979507b640 1 Processor -- start 2023-07-09T02:11:42.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f979507b640 1 -- start start 2023-07-09T02:11:42.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f979507b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f97900d2620 0x7f97900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f979507b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97900cd120 0x7f97900cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f979507b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9790160a50 con 0x7f979015c060 2023-07-09T02:11:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f979507b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979015c430 con 0x7f97900cd120 2023-07-09T02:11:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f979507b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979015fb60 con 0x7f97900d2620 2023-07-09T02:11:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f978f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97900cd120 0x7f97900cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f978f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97900cd120 0x7f97900cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60668/0 (socket says 172.21.15.45:60668) 2023-07-09T02:11:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f978f59e640 1 -- 172.21.15.45:0/2483842701 learned_addr learned my addr 172.21.15.45:0/2483842701 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f9787fff640 1 --2- 172.21.15.45:0/2483842701 >> v2:172.21.15.155:3300/0 conn(0x7f97900d2620 0x7f97900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f978f59e640 1 -- 172.21.15.45:0/2483842701 >> v2:172.21.15.155:3300/0 conn(0x7f97900d2620 msgr2=0x7f97900b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:42.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f978f59e640 1 --2- 172.21.15.45:0/2483842701 >> v2:172.21.15.155:3300/0 conn(0x7f97900d2620 0x7f97900b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f978f59e640 1 -- 172.21.15.45:0/2483842701 >> v1:172.21.15.155:6789/0 conn(0x7f979015c060 legacy=0x7f97900d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:42.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.984+0000 7f978f59e640 1 -- 172.21.15.45:0/2483842701 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979015fe40 con 0x7f97900cd120 2023-07-09T02:11:42.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f978f59e640 1 --2- 172.21.15.45:0/2483842701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f97900cee30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f979015fac0 tx=0x7f978801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e40f46abbdb31ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:42.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f978e59c640 1 -- 172.21.15.45:0/2483842701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880a5820 con 0x7f97900cd120 2023-07-09T02:11:42.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f978e59c640 1 -- 172.21.15.45:0/2483842701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97880a5980 con 0x7f97900cd120 2023-07-09T02:11:42.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f978e59c640 1 -- 172.21.15.45:0/2483842701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880a5d10 con 0x7f97900cd120 2023-07-09T02:11:42.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f979507b640 1 -- 172.21.15.45:0/2483842701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 msgr2=0x7f97900cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f979507b640 1 --2- 172.21.15.45:0/2483842701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f97900cee30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f979015fac0 tx=0x7f978801c960 comp rx=0 tx=0).stop 2023-07-09T02:11:42.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f979507b640 1 -- 172.21.15.45:0/2483842701 shutdown_connections 2023-07-09T02:11:42.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f979507b640 1 --2- 172.21.15.45:0/2483842701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f97900cee30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f979507b640 1 --2- 172.21.15.45:0/2483842701 >> v2:172.21.15.155:3300/0 conn(0x7f97900d2620 0x7f97900b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f979507b640 1 -- 172.21.15.45:0/2483842701 >> 172.21.15.45:0/2483842701 conn(0x7f97900698e0 msgr2=0x7f9790069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:42.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f979507b640 1 -- 172.21.15.45:0/2483842701 shutdown_connections 2023-07-09T02:11:42.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.988+0000 7f979507b640 1 -- 172.21.15.45:0/2483842701 wait complete. 2023-07-09T02:11:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 Processor -- start 2023-07-09T02:11:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 -- start start 2023-07-09T02:11:42.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f9790158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97900d2620 0x7f979015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f979015c060 0x7f979015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:42.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979015d8e0 con 0x7f97900cd120 2023-07-09T02:11:42.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97901589b0 con 0x7f979015c060 2023-07-09T02:11:42.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9790154a10 con 0x7f97900d2620 2023-07-09T02:11:42.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f9790158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f9790158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60682/0 (socket says 172.21.15.45:60682) 2023-07-09T02:11:42.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 -- 172.21.15.45:0/3897324965 learned_addr learned my addr 172.21.15.45:0/3897324965 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:42.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f9787fff640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97900d2620 0x7f979015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978f59e640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f979015c060 0x7f979015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:42.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 -- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97900d2620 msgr2=0x7f979015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97900d2620 0x7f979015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 -- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f979015c060 msgr2=0x7f979015ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f979015c060 0x7f979015ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 -- 172.21.15.45:0/3897324965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788009b30 con 0x7f97900cd120 2023-07-09T02:11:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f9787fff640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97900d2620 0x7f979015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f978ed9d640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f9790158470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f978000b440 tx=0x7f978000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f97877fe640 1 -- 172.21.15.45:0/3897324965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780011830 con 0x7f97900cd120 2023-07-09T02:11:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f97877fe640 1 -- 172.21.15.45:0/3897324965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780011990 con 0x7f97900cd120 2023-07-09T02:11:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f97877fe640 1 -- 172.21.15.45:0/3897324965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780011d40 con 0x7f97900cd120 2023-07-09T02:11:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97900b59f0 con 0x7f97900cd120 2023-07-09T02:11:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.992+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979015d500 con 0x7f97900cd120 2023-07-09T02:11:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.996+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979004d7d0 con 0x7f97900cd120 2023-07-09T02:11:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.996+0000 7f97877fe640 1 -- 172.21.15.45:0/3897324965 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f978001a400 con 0x7f97900cd120 2023-07-09T02:11:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.996+0000 7f97877fe640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9770066280 0x7f9770068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.996+0000 7f97877fe640 1 -- 172.21.15.45:0/3897324965 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9780083b40 con 0x7f97900cd120 2023-07-09T02:11:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:42.996+0000 7f9787fff640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9770066280 0x7f9770068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.000+0000 7f9787fff640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9770066280 0x7f9770068730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f97900d2a10 tx=0x7f9778008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:43.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.000+0000 7f97877fe640 1 -- 172.21.15.45:0/3897324965 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9780050fb0 con 0x7f97900cd120 2023-07-09T02:11:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f979006baa0 con 0x7f97900cd120 2023-07-09T02:11:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f97877fe640 1 -- 172.21.15.45:0/3897324965 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97800545d0 con 0x7f97900cd120 2023-07-09T02:11:43.159 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:43.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9770066280 msgr2=0x7f9770068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9770066280 0x7f9770068730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f97900d2a10 tx=0x7f9778008040 comp rx=0 tx=0).stop 2023-07-09T02:11:43.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 msgr2=0x7f9790158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f9790158470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f978000b440 tx=0x7f978000b900 comp rx=0 tx=0).stop 2023-07-09T02:11:43.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 shutdown_connections 2023-07-09T02:11:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f979015c060 0x7f979015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9770066280 0x7f9770068730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97900d2620 0x7f979015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 --2- 172.21.15.45:0/3897324965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97900cd120 0x7f9790158470 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 >> 172.21.15.45:0/3897324965 conn(0x7f97900698e0 msgr2=0x7f97900b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 shutdown_connections 2023-07-09T02:11:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.156+0000 7f979507b640 1 -- 172.21.15.45:0/3897324965 wait complete. 2023-07-09T02:11:43.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0edd182640 1 Processor -- start 2023-07-09T02:11:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0edd182640 1 -- start start 2023-07-09T02:11:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0edd182640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ed815c060 0x7f0ed80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0edd182640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ed80d2620 0x7f0ed80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0edd182640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed8160a50 con 0x7f0ed80cd120 2023-07-09T02:11:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0edd182640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed815c430 con 0x7f0ed815c060 2023-07-09T02:11:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0edd182640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed815fb60 con 0x7f0ed80d2620 2023-07-09T02:11:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ecffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0ed80cd120 0x7f0ed80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45186/0 (socket says 172.21.15.45:45186) 2023-07-09T02:11:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ed6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ed815c060 0x7f0ed80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ecffff640 1 -- 172.21.15.45:0/3999806470 learned_addr learned my addr 172.21.15.45:0/3999806470 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ed759e640 1 --2- 172.21.15.45:0/3999806470 >> v2:172.21.15.155:3300/0 conn(0x7f0ed80d2620 0x7f0ed80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ed659c640 1 -- 172.21.15.45:0/3999806470 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341151741 0 0) 0x7f0ed8160a50 con 0x7f0ed80cd120 2023-07-09T02:11:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ed659c640 1 -- 172.21.15.45:0/3999806470 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4003530 con 0x7f0ed80cd120 2023-07-09T02:11:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/3999806470 >> v2:172.21.15.155:3300/0 conn(0x7f0ed80d2620 msgr2=0x7f0ed80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/3999806470 >> v2:172.21.15.155:3300/0 conn(0x7f0ed80d2620 0x7f0ed80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/3999806470 >> v1:172.21.15.45:6789/0 conn(0x7f0ed80cd120 legacy=0x7f0ed80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.324+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/3999806470 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed815fe40 con 0x7f0ed815c060 2023-07-09T02:11:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/3999806470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed815c060 0x7f0ed80b4ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ed808bca0 tx=0x7f0ec801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c33aa311708f294 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0ed659c640 1 -- 172.21.15.45:0/3999806470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80a7070 con 0x7f0ed815c060 2023-07-09T02:11:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0ed659c640 1 -- 172.21.15.45:0/3999806470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec80ab430 con 0x7f0ed815c060 2023-07-09T02:11:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0ed659c640 1 -- 172.21.15.45:0/3999806470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80ab7c0 con 0x7f0ed815c060 2023-07-09T02:11:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 -- 172.21.15.45:0/3999806470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed815c060 msgr2=0x7f0ed80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 --2- 172.21.15.45:0/3999806470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed815c060 0x7f0ed80b4ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ed808bca0 tx=0x7f0ec801c430 comp rx=0 tx=0).stop 2023-07-09T02:11:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 -- 172.21.15.45:0/3999806470 shutdown_connections 2023-07-09T02:11:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 --2- 172.21.15.45:0/3999806470 >> v2:172.21.15.155:3300/0 conn(0x7f0ed80d2620 0x7f0ed80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 --2- 172.21.15.45:0/3999806470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed815c060 0x7f0ed80b4ed0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 -- 172.21.15.45:0/3999806470 >> 172.21.15.45:0/3999806470 conn(0x7f0ed80698e0 msgr2=0x7f0ed8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 -- 172.21.15.45:0/3999806470 shutdown_connections 2023-07-09T02:11:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 -- 172.21.15.45:0/3999806470 wait complete. 2023-07-09T02:11:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.328+0000 7f0edd182640 1 Processor -- start 2023-07-09T02:11:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 -- start start 2023-07-09T02:11:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80cd120 0x7f0ed815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed80d2620 0x7f0ed8155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed815c060 0x7f0ed8156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed815e460 con 0x7f0ed80cd120 2023-07-09T02:11:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed815d7e0 con 0x7f0ed80d2620 2023-07-09T02:11:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed815dac0 con 0x7f0ed815c060 2023-07-09T02:11:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80cd120 0x7f0ed815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80cd120 0x7f0ed815ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60708/0 (socket says 172.21.15.45:60708) 2023-07-09T02:11:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/842765680 learned_addr learned my addr 172.21.15.45:0/842765680 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed759e640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed815c060 0x7f0ed8156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ecffff640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed80d2620 0x7f0ed8155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed815c060 msgr2=0x7f0ed8156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed815c060 0x7f0ed8156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed80d2620 msgr2=0x7f0ed8155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed80d2620 0x7f0ed8155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/842765680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec8009420 con 0x7f0ed80cd120 2023-07-09T02:11:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ecffff640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed80d2620 0x7f0ed8155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80cd120 0x7f0ed815ee90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80ad040 tx=0x7f0ec801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ecf7fe640 1 -- 172.21.15.45:0/842765680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80bf610 con 0x7f0ed80cd120 2023-07-09T02:11:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ecf7fe640 1 -- 172.21.15.45:0/842765680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec80bf790 con 0x7f0ed80cd120 2023-07-09T02:11:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0ecf7fe640 1 -- 172.21.15.45:0/842765680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80bfb40 con 0x7f0ed80cd120 2023-07-09T02:11:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed80b59f0 con 0x7f0ed80cd120 2023-07-09T02:11:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed815e080 con 0x7f0ed80cd120 2023-07-09T02:11:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.332+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed804d7d0 con 0x7f0ed80cd120 2023-07-09T02:11:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.336+0000 7f0ecf7fe640 1 -- 172.21.15.45:0/842765680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ec80b5400 con 0x7f0ed80cd120 2023-07-09T02:11:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.336+0000 7f0ecf7fe640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.336+0000 7f0ecf7fe640 1 -- 172.21.15.45:0/842765680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ec811ebe0 con 0x7f0ed80cd120 2023-07-09T02:11:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.336+0000 7f0ecffff640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.336+0000 7f0ecffff640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80ccc80 tx=0x7f0ec0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.340+0000 7f0ecf7fe640 1 -- 172.21.15.45:0/842765680 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ec80ec220 con 0x7f0ed80cd120 2023-07-09T02:11:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.492+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ed806baa0 con 0x7f0ed80cd120 2023-07-09T02:11:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.492+0000 7f0ecf7fe640 1 -- 172.21.15.45:0/842765680 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ec80ef840 con 0x7f0ed80cd120 2023-07-09T02:11:43.496 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 msgr2=0x7f0eb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80ccc80 tx=0x7f0ec0009040 comp rx=0 tx=0).stop 2023-07-09T02:11:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80cd120 msgr2=0x7f0ed815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80cd120 0x7f0ed815ee90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80ad040 tx=0x7f0ec801ac70 comp rx=0 tx=0).stop 2023-07-09T02:11:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 shutdown_connections 2023-07-09T02:11:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed815c060 0x7f0ed8156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed80d2620 0x7f0ed8155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 --2- 172.21.15.45:0/842765680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80cd120 0x7f0ed815ee90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 >> 172.21.15.45:0/842765680 conn(0x7f0ed80698e0 msgr2=0x7f0ed80b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 shutdown_connections 2023-07-09T02:11:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.496+0000 7f0edd182640 1 -- 172.21.15.45:0/842765680 wait complete. 2023-07-09T02:11:43.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:43.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.660+0000 7f49aa99f640 1 Processor -- start 2023-07-09T02:11:43.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.660+0000 7f49aa99f640 1 -- start start 2023-07-09T02:11:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.660+0000 7f49aa99f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49a40cd120 0x7f49a40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.660+0000 7f49aa99f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a4160a50 con 0x7f49a40d2620 2023-07-09T02:11:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.660+0000 7f49aa99f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a415c430 con 0x7f49a415c060 2023-07-09T02:11:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.660+0000 7f49aa99f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a415fb60 con 0x7f49a40cd120 2023-07-09T02:11:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.660+0000 7f49a37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f49a40d2620 0x7f49a40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45194/0 (socket says 172.21.15.45:45194) 2023-07-09T02:11:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.660+0000 7f49a37fe640 1 -- 172.21.15.45:0/1158626384 learned_addr learned my addr 172.21.15.45:0/1158626384 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a8f3c640 1 --2- 172.21.15.45:0/1158626384 >> v2:172.21.15.155:3300/0 conn(0x7f49a40cd120 0x7f49a40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687241656 0 0) 0x7f49a4160a50 con 0x7f49a40d2620 2023-07-09T02:11:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f498c003530 con 0x7f49a40d2620 2023-07-09T02:11:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 625884952 0 0) 0x7f498c003530 con 0x7f49a40d2620 2023-07-09T02:11:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 >> v2:172.21.15.155:3300/0 conn(0x7f49a40cd120 msgr2=0x7f49a40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 --2- 172.21.15.45:0/1158626384 >> v2:172.21.15.155:3300/0 conn(0x7f49a40cd120 0x7f49a40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 >> v1:172.21.15.155:6789/0 conn(0x7f49a415c060 legacy=0x7f49a40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a415fe40 con 0x7f49a40d2620 2023-07-09T02:11:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f4998001680 con 0x7f49a40d2620 2023-07-09T02:11:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 >> v1:172.21.15.45:6789/0 conn(0x7f49a40d2620 legacy=0x7f49a40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c003980 0x7f498c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f498c0047d0 0x7f498c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f498c005180 0x7f498c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a415fb60 con 0x7f498c005180 2023-07-09T02:11:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c00c000 con 0x7f498c003980 2023-07-09T02:11:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c00c1c0 con 0x7f498c0047d0 2023-07-09T02:11:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a8f3c640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f498c005180 0x7f498c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a3fff640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c003980 0x7f498c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a37fe640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f498c0047d0 0x7f498c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a8f3c640 1 -- 172.21.15.45:0/1158626384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f498c0047d0 msgr2=0x7f498c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a8f3c640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f498c0047d0 0x7f498c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a8f3c640 1 -- 172.21.15.45:0/1158626384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c003980 msgr2=0x7f498c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a8f3c640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c003980 0x7f498c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a8f3c640 1 -- 172.21.15.45:0/1158626384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c003530 con 0x7f498c005180 2023-07-09T02:11:43.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.664+0000 7f49a8f3c640 1 -- 172.21.15.45:0/1158626384 reap_dead start 2023-07-09T02:11:43.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49a8f3c640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f498c005180 0x7f498c00b990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f499c009fc0 tx=0x7f499c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7087065f9f4c71c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:43.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0a5cb0 con 0x7f498c005180 2023-07-09T02:11:43.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c00f040 con 0x7f498c005180 2023-07-09T02:11:43.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49a2ffd640 1 -- 172.21.15.45:0/1158626384 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c003be0 con 0x7f498c005180 2023-07-09T02:11:43.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- 172.21.15.45:0/1158626384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f498c005180 msgr2=0x7f498c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f498c005180 0x7f498c00b990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f499c009fc0 tx=0x7f499c01cca0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- 172.21.15.45:0/1158626384 shutdown_connections 2023-07-09T02:11:43.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 --2- 172.21.15.45:0/1158626384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f498c005180 0x7f498c00b990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- 172.21.15.45:0/1158626384 >> 172.21.15.45:0/1158626384 conn(0x7f49a40698e0 msgr2=0x7f49a4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- 172.21.15.45:0/1158626384 shutdown_connections 2023-07-09T02:11:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- 172.21.15.45:0/1158626384 wait complete. 2023-07-09T02:11:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 Processor -- start 2023-07-09T02:11:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- start start 2023-07-09T02:11:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c005180 0x7f49a41f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a40b4430 0x7f49a40b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49a415d830 0x7f49a415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40b4de0 con 0x7f49a415d830 2023-07-09T02:11:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a41f15d0 con 0x7f498c005180 2023-07-09T02:11:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.668+0000 7f49aa99f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a415e5a0 con 0x7f49a40b4430 2023-07-09T02:11:43.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49a415d830 0x7f49a415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49a415d830 0x7f49a415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60720/0 (socket says 172.21.15.45:60720) 2023-07-09T02:11:43.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 -- 172.21.15.45:0/4121386891 learned_addr learned my addr 172.21.15.45:0/4121386891 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a3fff640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c005180 0x7f49a41f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a37fe640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a40b4430 0x7f49a40b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 -- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a40b4430 msgr2=0x7f49a40b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a40b4430 0x7f49a40b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 -- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c005180 msgr2=0x7f49a41f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c005180 0x7f49a41f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 -- 172.21.15.45:0/4121386891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40c9fe0 con 0x7f49a415d830 2023-07-09T02:11:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a8f3c640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49a415d830 0x7f49a415dca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f499c0987d0 tx=0x7f499c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a0ff9640 1 -- 172.21.15.45:0/4121386891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c003db0 con 0x7f49a415d830 2023-07-09T02:11:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a0ff9640 1 -- 172.21.15.45:0/4121386891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c004030 con 0x7f49a415d830 2023-07-09T02:11:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a40ca2c0 con 0x7f49a415d830 2023-07-09T02:11:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a0ff9640 1 -- 172.21.15.45:0/4121386891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0043e0 con 0x7f49a415d830 2023-07-09T02:11:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a40ca880 con 0x7f49a415d830 2023-07-09T02:11:43.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a404d7d0 con 0x7f49a415d830 2023-07-09T02:11:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.672+0000 7f49a0ff9640 1 -- 172.21.15.45:0/4121386891 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f499c004540 con 0x7f49a415d830 2023-07-09T02:11:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.676+0000 7f49a0ff9640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49900662b0 0x7f4990068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.676+0000 7f49a0ff9640 1 -- 172.21.15.45:0/4121386891 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f499c0a6e40 con 0x7f49a415d830 2023-07-09T02:11:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.676+0000 7f49a3fff640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49900662b0 0x7f4990068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.676+0000 7f49a3fff640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49900662b0 0x7f4990068760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4994000c10 tx=0x7f4994009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.676+0000 7f49a0ff9640 1 -- 172.21.15.45:0/4121386891 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f499c0ebf20 con 0x7f49a415d830 2023-07-09T02:11:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.832+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49a40c9dc0 con 0x7f49a415d830 2023-07-09T02:11:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.832+0000 7f49a0ff9640 1 -- 172.21.15.45:0/4121386891 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f499c0bc020 con 0x7f49a415d830 2023-07-09T02:11:43.837 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49900662b0 msgr2=0x7f4990068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49900662b0 0x7f4990068760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4994000c10 tx=0x7f4994009040 comp rx=0 tx=0).stop 2023-07-09T02:11:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49a415d830 msgr2=0x7f49a415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49a415d830 0x7f49a415dca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f499c0987d0 tx=0x7f499c009750 comp rx=0 tx=0).stop 2023-07-09T02:11:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 shutdown_connections 2023-07-09T02:11:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49a415d830 0x7f49a415dca0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49900662b0 0x7f4990068760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49a40b4430 0x7f49a40b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 --2- 172.21.15.45:0/4121386891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f498c005180 0x7f49a41f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 >> 172.21.15.45:0/4121386891 conn(0x7f49a40698e0 msgr2=0x7f49a40b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 shutdown_connections 2023-07-09T02:11:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:43.836+0000 7f49aa99f640 1 -- 172.21.15.45:0/4121386891 wait complete. 2023-07-09T02:11:43.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:44.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.000+0000 7f0586c0b640 1 Processor -- start 2023-07-09T02:11:44.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.000+0000 7f0586c0b640 1 -- start start 2023-07-09T02:11:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.000+0000 7f0586c0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05800d2620 0x7f05800b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.000+0000 7f0586c0b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0580160a50 con 0x7f058015c060 2023-07-09T02:11:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.000+0000 7f0586c0b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058015c430 con 0x7f05800cd120 2023-07-09T02:11:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.000+0000 7f0586c0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058015fb60 con 0x7f05800d2620 2023-07-09T02:11:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.000+0000 7f05849a7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f058015c060 0x7f05800d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45200/0 (socket says 172.21.15.45:45200) 2023-07-09T02:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.000+0000 7f05849a7640 1 -- 172.21.15.45:0/1070161382 learned_addr learned my addr 172.21.15.45:0/1070161382 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057ffff640 1 --2- 172.21.15.45:0/1070161382 >> v2:172.21.15.155:3300/0 conn(0x7f05800d2620 0x7f05800b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662013799 0 0) 0x7f0580160a50 con 0x7f058015c060 2023-07-09T02:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0570003530 con 0x7f058015c060 2023-07-09T02:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032291588 0 0) 0x7f058015c430 con 0x7f05800cd120 2023-07-09T02:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0580160a50 con 0x7f05800cd120 2023-07-09T02:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589833839 0 0) 0x7f0570003530 con 0x7f058015c060 2023-07-09T02:11:44.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 >> v2:172.21.15.155:3300/0 conn(0x7f05800d2620 msgr2=0x7f05800b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:44.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 --2- 172.21.15.45:0/1070161382 >> v2:172.21.15.155:3300/0 conn(0x7f05800d2620 0x7f05800b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 >> v1:172.21.15.155:6789/0 conn(0x7f05800cd120 legacy=0x7f05800cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058015fe40 con 0x7f058015c060 2023-07-09T02:11:44.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f0574001680 con 0x7f058015c060 2023-07-09T02:11:44.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057ffff640 1 --2- 172.21.15.45:0/1070161382 >> v2:172.21.15.155:3300/0 conn(0x7f05800d2620 0x7f05800b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:44.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 >> v1:172.21.15.45:6789/0 conn(0x7f058015c060 legacy=0x7f05800d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0570003b10 0x7f0570003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0570004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0570005180 0x7f057000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058015fb60 con 0x7f05700047d0 2023-07-09T02:11:44.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057000bfe0 con 0x7f0570003b10 2023-07-09T02:11:44.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057000c1a0 con 0x7f0570005180 2023-07-09T02:11:44.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057ffff640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0570004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f05849a7640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0570003b10 0x7f0570003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f05851a8640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0570005180 0x7f057000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057ffff640 1 -- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0570005180 msgr2=0x7f057000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:44.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057ffff640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0570005180 0x7f057000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057ffff640 1 -- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0570003b10 msgr2=0x7f0570003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:44.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057ffff640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0570003b10 0x7f0570003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f057ffff640 1 -- 172.21.15.45:0/1070161382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570003530 con 0x7f05700047d0 2023-07-09T02:11:44.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f05849a7640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0570003b10 0x7f0570003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:44.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.004+0000 7f05851a8640 1 -- 172.21.15.45:0/1070161382 reap_dead start 2023-07-09T02:11:44.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f057ffff640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0570004c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f056c009c80 tx=0x7f056c01cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216fdd9a68bc821c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0a5790 con 0x7f05700047d0 2023-07-09T02:11:44.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c0a58f0 con 0x7f05700047d0 2023-07-09T02:11:44.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f057f7fe640 1 -- 172.21.15.45:0/1070161382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0a5ce0 con 0x7f05700047d0 2023-07-09T02:11:44.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 -- 172.21.15.45:0/1070161382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 msgr2=0x7f0570004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0570004c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f056c009c80 tx=0x7f056c01cbb0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 -- 172.21.15.45:0/1070161382 shutdown_connections 2023-07-09T02:11:44.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 --2- 172.21.15.45:0/1070161382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0570004c40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 -- 172.21.15.45:0/1070161382 >> 172.21.15.45:0/1070161382 conn(0x7f05800698e0 msgr2=0x7f0580069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:44.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 -- 172.21.15.45:0/1070161382 shutdown_connections 2023-07-09T02:11:44.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 -- 172.21.15.45:0/1070161382 wait complete. 2023-07-09T02:11:44.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 Processor -- start 2023-07-09T02:11:44.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.008+0000 7f0586c0b640 1 -- start start 2023-07-09T02:11:44.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0580156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05801f5d60 0x7f0580159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058015a190 0x7f05800c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058015a600 con 0x7f05700047d0 2023-07-09T02:11:44.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058015f4c0 con 0x7f05801f5d60 2023-07-09T02:11:44.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05801573c0 con 0x7f058015a190 2023-07-09T02:11:44.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0580156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0580156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60730/0 (socket says 172.21.15.45:60730) 2023-07-09T02:11:44.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 -- 172.21.15.45:0/3248524725 learned_addr learned my addr 172.21.15.45:0/3248524725 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:44.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f057ffff640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05801f5d60 0x7f0580159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05851a8640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058015a190 0x7f05800c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 -- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058015a190 msgr2=0x7f05800c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058015a190 0x7f05800c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 -- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05801f5d60 msgr2=0x7f0580159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05801f5d60 0x7f0580159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 -- 172.21.15.45:0/3248524725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05800ca6f0 con 0x7f05700047d0 2023-07-09T02:11:44.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05851a8640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058015a190 0x7f05800c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:44.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f05849a7640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0580156e80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f057400e850 tx=0x7f057400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f057d7fa640 1 -- 172.21.15.45:0/3248524725 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400c8d0 con 0x7f05700047d0 2023-07-09T02:11:44.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f057d7fa640 1 -- 172.21.15.45:0/3248524725 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057400ca30 con 0x7f05700047d0 2023-07-09T02:11:44.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f057d7fa640 1 -- 172.21.15.45:0/3248524725 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400cdc0 con 0x7f05700047d0 2023-07-09T02:11:44.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05801f5280 con 0x7f05700047d0 2023-07-09T02:11:44.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05801f5840 con 0x7f05700047d0 2023-07-09T02:11:44.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058004d7d0 con 0x7f05700047d0 2023-07-09T02:11:44.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.012+0000 7f057d7fa640 1 -- 172.21.15.45:0/3248524725 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0574013420 con 0x7f05700047d0 2023-07-09T02:11:44.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.016+0000 7f057d7fa640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05640662b0 0x7f0564068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.016+0000 7f057d7fa640 1 -- 172.21.15.45:0/3248524725 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0574083a10 con 0x7f05700047d0 2023-07-09T02:11:44.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.016+0000 7f057ffff640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05640662b0 0x7f0564068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.016+0000 7f057ffff640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05640662b0 0x7f0564068760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f056c0af000 tx=0x7f056c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.020+0000 7f057d7fa640 1 -- 172.21.15.45:0/3248524725 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0574050e80 con 0x7f05700047d0 2023-07-09T02:11:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.176+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f058006baa0 con 0x7f05700047d0 2023-07-09T02:11:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.176+0000 7f057d7fa640 1 -- 172.21.15.45:0/3248524725 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f05740544a0 con 0x7f05700047d0 2023-07-09T02:11:44.181 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:44.181 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05640662b0 msgr2=0x7f0564068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05640662b0 0x7f0564068760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f056c0af000 tx=0x7f056c0046d0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 msgr2=0x7f0580156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0580156e80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f057400e850 tx=0x7f057400ed10 comp rx=0 tx=0).stop 2023-07-09T02:11:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 shutdown_connections 2023-07-09T02:11:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05640662b0 0x7f0564068760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f058015a190 0x7f05800c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05801f5d60 0x7f0580159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 --2- 172.21.15.45:0/3248524725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05700047d0 0x7f0580156e80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 >> 172.21.15.45:0/3248524725 conn(0x7f05800698e0 msgr2=0x7f05800b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 shutdown_connections 2023-07-09T02:11:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.180+0000 7f0586c0b640 1 -- 172.21.15.45:0/3248524725 wait complete. 2023-07-09T02:11:44.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:44.204 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc3939db640 1 Processor -- start 2023-07-09T02:11:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc3939db640 1 -- start start 2023-07-09T02:11:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc3939db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc38c15c060 0x7fc38c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc3939db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc38c0d2620 0x7fc38c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc3939db640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc38c160a50 con 0x7fc38c0cd120 2023-07-09T02:11:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc3939db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c15c430 con 0x7fc38c15c060 2023-07-09T02:11:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc3939db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c15fb60 con 0x7fc38c0d2620 2023-07-09T02:11:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc391777640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc38c15c060 0x7fc38c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc391777640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc38c15c060 0x7fc38c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60738/0 (socket says 172.21.15.45:60738) 2023-07-09T02:11:44.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.348+0000 7fc391777640 1 -- 172.21.15.45:0/3378186663 learned_addr learned my addr 172.21.15.45:0/3378186663 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:44.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc391f78640 1 --2- 172.21.15.45:0/3378186663 >> v2:172.21.15.155:3300/0 conn(0x7fc38c0d2620 0x7fc38c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc391777640 1 -- 172.21.15.45:0/3378186663 >> v2:172.21.15.155:3300/0 conn(0x7fc38c0d2620 msgr2=0x7fc38c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:44.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc391777640 1 --2- 172.21.15.45:0/3378186663 >> v2:172.21.15.155:3300/0 conn(0x7fc38c0d2620 0x7fc38c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc391777640 1 -- 172.21.15.45:0/3378186663 >> v1:172.21.15.45:6789/0 conn(0x7fc38c0cd120 legacy=0x7fc38c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc391777640 1 -- 172.21.15.45:0/3378186663 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c15fe40 con 0x7fc38c15c060 2023-07-09T02:11:44.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc383fff640 1 -- 172.21.15.45:0/3378186663 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897731893 0 0) 0x7fc38c160a50 con 0x7fc38c0cd120 2023-07-09T02:11:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc391777640 1 --2- 172.21.15.45:0/3378186663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b4ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc38c08bca0 tx=0x7fc38801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133dbd18279c4653 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc383fff640 1 -- 172.21.15.45:0/3378186663 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3880aa430 con 0x7fc38c15c060 2023-07-09T02:11:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc383fff640 1 -- 172.21.15.45:0/3378186663 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3880aa590 con 0x7fc38c15c060 2023-07-09T02:11:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.352+0000 7fc383fff640 1 -- 172.21.15.45:0/3378186663 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3880aa920 con 0x7fc38c15c060 2023-07-09T02:11:44.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- 172.21.15.45:0/3378186663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 msgr2=0x7fc38c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 --2- 172.21.15.45:0/3378186663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b4ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc38c08bca0 tx=0x7fc38801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- 172.21.15.45:0/3378186663 shutdown_connections 2023-07-09T02:11:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 --2- 172.21.15.45:0/3378186663 >> v2:172.21.15.155:3300/0 conn(0x7fc38c0d2620 0x7fc38c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 --2- 172.21.15.45:0/3378186663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b4ed0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- 172.21.15.45:0/3378186663 >> 172.21.15.45:0/3378186663 conn(0x7fc38c0698e0 msgr2=0x7fc38c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:44.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- 172.21.15.45:0/3378186663 shutdown_connections 2023-07-09T02:11:44.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- 172.21.15.45:0/3378186663 wait complete. 2023-07-09T02:11:44.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 Processor -- start 2023-07-09T02:11:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- start start 2023-07-09T02:11:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc38c0cd120 0x7fc38c0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc38c0d2620 0x7fc38c15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0c8d00 con 0x7fc38c15c060 2023-07-09T02:11:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c15ddf0 con 0x7fc38c0cd120 2023-07-09T02:11:44.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc3939db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c15e0d0 con 0x7fc38c0d2620 2023-07-09T02:11:44.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60740/0 (socket says 172.21.15.45:60740) 2023-07-09T02:11:44.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 -- 172.21.15.45:0/901660722 learned_addr learned my addr 172.21.15.45:0/901660722 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:44.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391777640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc38c0cd120 0x7fc38c0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc390f76640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc38c0d2620 0x7fc38c15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 -- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc38c0d2620 msgr2=0x7fc38c15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc38c0d2620 0x7fc38c15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 -- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc38c0cd120 msgr2=0x7fc38c0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc38c0cd120 0x7fc38c0c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 -- 172.21.15.45:0/901660722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880094d0 con 0x7fc38c15c060 2023-07-09T02:11:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391777640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc38c0cd120 0x7fc38c0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.356+0000 7fc391f78640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b34b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc384007de0 tx=0x7fc38400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc381ffb640 1 -- 172.21.15.45:0/901660722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384014620 con 0x7fc38c15c060 2023-07-09T02:11:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc381ffb640 1 -- 172.21.15.45:0/901660722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38400ee90 con 0x7fc38c15c060 2023-07-09T02:11:44.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c0b59f0 con 0x7fc38c15c060 2023-07-09T02:11:44.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc381ffb640 1 -- 172.21.15.45:0/901660722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3840149e0 con 0x7fc38c15c060 2023-07-09T02:11:44.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c15e690 con 0x7fc38c15c060 2023-07-09T02:11:44.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c04d7d0 con 0x7fc38c15c060 2023-07-09T02:11:44.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc381ffb640 1 -- 172.21.15.45:0/901660722 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc384014b40 con 0x7fc38c15c060 2023-07-09T02:11:44.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc381ffb640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc370066280 0x7fc370068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc381ffb640 1 -- 172.21.15.45:0/901660722 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc384084890 con 0x7fc38c15c060 2023-07-09T02:11:44.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.360+0000 7fc391777640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc370066280 0x7fc370068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.364+0000 7fc391777640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc370066280 0x7fc370068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3880ae000 tx=0x7fc3880a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.364+0000 7fc381ffb640 1 -- 172.21.15.45:0/901660722 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc384055670 con 0x7fc38c15c060 2023-07-09T02:11:44.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.520+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc38c06baa0 con 0x7fc38c15c060 2023-07-09T02:11:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc381ffb640 1 -- 172.21.15.45:0/901660722 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc384055200 con 0x7fc38c15c060 2023-07-09T02:11:44.526 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc370066280 msgr2=0x7fc370068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc370066280 0x7fc370068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3880ae000 tx=0x7fc3880a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 msgr2=0x7fc38c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b34b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc384007de0 tx=0x7fc38400e4b0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 shutdown_connections 2023-07-09T02:11:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc38c15c060 0x7fc38c0b34b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc370066280 0x7fc370068730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc38c0d2620 0x7fc38c15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 --2- 172.21.15.45:0/901660722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc38c0cd120 0x7fc38c0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 >> 172.21.15.45:0/901660722 conn(0x7fc38c0698e0 msgr2=0x7fc38c0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 shutdown_connections 2023-07-09T02:11:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.524+0000 7fc3939db640 1 -- 172.21.15.45:0/901660722 wait complete. 2023-07-09T02:11:44.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:44.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.688+0000 7f2a00511640 1 Processor -- start 2023-07-09T02:11:44.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f2a00511640 1 -- start start 2023-07-09T02:11:44.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f2a00511640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f29f806c110 0x7f29f806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f2a00511640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29f80caec0 0x7f29f80cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f2a00511640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f806caa0 con 0x7f29f8158e30 2023-07-09T02:11:44.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f2a00511640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80ccf80 con 0x7f29f80caec0 2023-07-09T02:11:44.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f2a00511640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80cd540 con 0x7f29f806c110 2023-07-09T02:11:44.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f29feaae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29f80caec0 0x7f29f80cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f29feaae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29f80caec0 0x7f29f80cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60754/0 (socket says 172.21.15.45:60754) 2023-07-09T02:11:44.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f29feaae640 1 -- 172.21.15.45:0/155795856 learned_addr learned my addr 172.21.15.45:0/155795856 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:44.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f29fdaac640 1 --2- 172.21.15.45:0/155795856 >> v2:172.21.15.155:3300/0 conn(0x7f29f806c110 0x7f29f806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f29feaae640 1 -- 172.21.15.45:0/155795856 >> v2:172.21.15.155:3300/0 conn(0x7f29f806c110 msgr2=0x7f29f806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:44.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f29feaae640 1 --2- 172.21.15.45:0/155795856 >> v2:172.21.15.155:3300/0 conn(0x7f29f806c110 0x7f29f806c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f29feaae640 1 -- 172.21.15.45:0/155795856 >> v1:172.21.15.155:6789/0 conn(0x7f29f8158e30 legacy=0x7f29f806f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.692+0000 7f29feaae640 1 -- 172.21.15.45:0/155795856 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80cb840 con 0x7f29f80caec0 2023-07-09T02:11:44.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f29feaae640 1 --2- 172.21.15.45:0/155795856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f80caec0 0x7f29f80cb300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f29f806f260 tx=0x7f29f001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9936d8945ab10121 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f29fd2ab640 1 -- 172.21.15.45:0/155795856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f000b2d0 con 0x7f29f80caec0 2023-07-09T02:11:44.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f29fd2ab640 1 -- 172.21.15.45:0/155795856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f000b430 con 0x7f29f80caec0 2023-07-09T02:11:44.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f29fd2ab640 1 -- 172.21.15.45:0/155795856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00a7c00 con 0x7f29f80caec0 2023-07-09T02:11:44.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 -- 172.21.15.45:0/155795856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f80caec0 msgr2=0x7f29f80cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 --2- 172.21.15.45:0/155795856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f80caec0 0x7f29f80cb300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f29f806f260 tx=0x7f29f001eb10 comp rx=0 tx=0).stop 2023-07-09T02:11:44.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 -- 172.21.15.45:0/155795856 shutdown_connections 2023-07-09T02:11:44.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 --2- 172.21.15.45:0/155795856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f80caec0 0x7f29f80cb300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 --2- 172.21.15.45:0/155795856 >> v2:172.21.15.155:3300/0 conn(0x7f29f806c110 0x7f29f806c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 -- 172.21.15.45:0/155795856 >> 172.21.15.45:0/155795856 conn(0x7f29f80694b0 msgr2=0x7f29f80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:44.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 -- 172.21.15.45:0/155795856 shutdown_connections 2023-07-09T02:11:44.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 -- 172.21.15.45:0/155795856 wait complete. 2023-07-09T02:11:44.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.696+0000 7f2a00511640 1 Processor -- start 2023-07-09T02:11:44.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 -- start start 2023-07-09T02:11:44.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f806c110 0x7f29f8141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f80caec0 0x7f29f81f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f8158e30 0x7f29f8157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f81f8d70 con 0x7f29f806c110 2023-07-09T02:11:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f81f8a70 con 0x7f29f8158e30 2023-07-09T02:11:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f814c9f0 con 0x7f29f80caec0 2023-07-09T02:11:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f806c110 0x7f29f8141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f806c110 0x7f29f8141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60758/0 (socket says 172.21.15.45:60758) 2023-07-09T02:11:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 -- 172.21.15.45:0/2987271075 learned_addr learned my addr 172.21.15.45:0/2987271075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fdaac640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f80caec0 0x7f29f81f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29feaae640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f8158e30 0x7f29f8157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 -- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f80caec0 msgr2=0x7f29f81f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f80caec0 0x7f29f81f9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 -- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f8158e30 msgr2=0x7f29f8157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f8158e30 0x7f29f8157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 -- 172.21.15.45:0/2987271075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f000bd40 con 0x7f29f806c110 2023-07-09T02:11:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29feaae640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f8158e30 0x7f29f8157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29fe2ad640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f806c110 0x7f29f8141770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c3f0 tx=0x7f29f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29eeffd640 1 -- 172.21.15.45:0/2987271075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f40052d0 con 0x7f29f806c110 2023-07-09T02:11:44.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29eeffd640 1 -- 172.21.15.45:0/2987271075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4005430 con 0x7f29f806c110 2023-07-09T02:11:44.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f29eeffd640 1 -- 172.21.15.45:0/2987271075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4003840 con 0x7f29f806c110 2023-07-09T02:11:44.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f814ccd0 con 0x7f29f806c110 2023-07-09T02:11:44.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f8141cb0 con 0x7f29f806c110 2023-07-09T02:11:44.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.700+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f804d7d0 con 0x7f29f806c110 2023-07-09T02:11:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.704+0000 7f29eeffd640 1 -- 172.21.15.45:0/2987271075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29f40039a0 con 0x7f29f806c110 2023-07-09T02:11:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.704+0000 7f29eeffd640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f29dc0662b0 0x7f29dc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.704+0000 7f29eeffd640 1 -- 172.21.15.45:0/2987271075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29f40831a0 con 0x7f29f806c110 2023-07-09T02:11:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.704+0000 7f29fdaac640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f29dc0662b0 0x7f29dc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.704+0000 7f29fdaac640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f29dc0662b0 0x7f29dc068760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f29f815c490 tx=0x7f29e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.708+0000 7f29eeffd640 1 -- 172.21.15.45:0/2987271075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29f4050580 con 0x7f29f806c110 2023-07-09T02:11:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.860+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f29f806caa0 con 0x7f29f806c110 2023-07-09T02:11:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f29eeffd640 1 -- 172.21.15.45:0/2987271075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f29f806caa0 con 0x7f29f806c110 2023-07-09T02:11:44.865 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f29dc0662b0 msgr2=0x7f29dc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f29dc0662b0 0x7f29dc068760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f29f815c490 tx=0x7f29e8008040 comp rx=0 tx=0).stop 2023-07-09T02:11:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f806c110 msgr2=0x7f29f8141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f806c110 0x7f29f8141770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f29f400c3f0 tx=0x7f29f400c8b0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 shutdown_connections 2023-07-09T02:11:44.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29f8158e30 0x7f29f8157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f29dc0662b0 0x7f29dc068760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29f80caec0 0x7f29f81f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 --2- 172.21.15.45:0/2987271075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f806c110 0x7f29f8141770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:44.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 >> 172.21.15.45:0/2987271075 conn(0x7f29f80694b0 msgr2=0x7f29f8151030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:44.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 shutdown_connections 2023-07-09T02:11:44.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:44.864+0000 7f2a00511640 1 -- 172.21.15.45:0/2987271075 wait complete. 2023-07-09T02:11:44.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.028+0000 7fbbefddb640 1 Processor -- start 2023-07-09T02:11:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.028+0000 7fbbefddb640 1 -- start start 2023-07-09T02:11:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbefddb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbe815c060 0x7fbbe80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbefddb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbefddb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe8160a50 con 0x7fbbe80d2450 2023-07-09T02:11:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbefddb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe80d28f0 con 0x7fbbe815c060 2023-07-09T02:11:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbefddb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80cfe40 con 0x7fbbe80cd120 2023-07-09T02:11:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbedb77640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbe815c060 0x7fbbe80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbedb77640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbe815c060 0x7fbbe80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60774/0 (socket says 172.21.15.45:60774) 2023-07-09T02:11:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbedb77640 1 -- 172.21.15.45:0/2483653822 learned_addr learned my addr 172.21.15.45:0/2483653822 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbed376640 1 --2- 172.21.15.45:0/2483653822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbedb77640 1 -- 172.21.15.45:0/2483653822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 msgr2=0x7fbbe80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:45.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbedb77640 1 --2- 172.21.15.45:0/2483653822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbedb77640 1 -- 172.21.15.45:0/2483653822 >> v1:172.21.15.155:6789/0 conn(0x7fbbe80d2450 legacy=0x7fbbe80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:45.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.032+0000 7fbbedb77640 1 -- 172.21.15.45:0/2483653822 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe815c430 con 0x7fbbe815c060 2023-07-09T02:11:45.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbedb77640 1 --2- 172.21.15.45:0/2483653822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe815c060 0x7fbbe80b4ed0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009870 tx=0x7fbbe401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20561669e65b1b76 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbecb75640 1 -- 172.21.15.45:0/2483653822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40ac410 con 0x7fbbe815c060 2023-07-09T02:11:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbecb75640 1 -- 172.21.15.45:0/2483653822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe40ac570 con 0x7fbbe815c060 2023-07-09T02:11:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbecb75640 1 -- 172.21.15.45:0/2483653822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40ac900 con 0x7fbbe815c060 2023-07-09T02:11:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 -- 172.21.15.45:0/2483653822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe815c060 msgr2=0x7fbbe80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 --2- 172.21.15.45:0/2483653822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe815c060 0x7fbbe80b4ed0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009870 tx=0x7fbbe401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 -- 172.21.15.45:0/2483653822 shutdown_connections 2023-07-09T02:11:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 --2- 172.21.15.45:0/2483653822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 --2- 172.21.15.45:0/2483653822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe815c060 0x7fbbe80b4ed0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 -- 172.21.15.45:0/2483653822 >> 172.21.15.45:0/2483653822 conn(0x7fbbe80698e0 msgr2=0x7fbbe8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 -- 172.21.15.45:0/2483653822 shutdown_connections 2023-07-09T02:11:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 -- 172.21.15.45:0/2483653822 wait complete. 2023-07-09T02:11:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 Processor -- start 2023-07-09T02:11:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 -- start start 2023-07-09T02:11:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.036+0000 7fbbefddb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbefddb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe80d2450 0x7fbbe8151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbefddb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe815c060 0x7fbbe80cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbefddb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe8153e60 con 0x7fbbe80d2450 2023-07-09T02:11:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbefddb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80b5e60 con 0x7fbbe815c060 2023-07-09T02:11:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbefddb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80b3550 con 0x7fbbe80cd120 2023-07-09T02:11:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe80d2450 0x7fbbe8151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe80d2450 0x7fbbe8151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60784/0 (socket says 172.21.15.45:60784) 2023-07-09T02:11:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 -- 172.21.15.45:0/1797835701 learned_addr learned my addr 172.21.15.45:0/1797835701 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbee378640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe815c060 0x7fbbe80cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbedb77640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 -- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 msgr2=0x7fbbe80b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 -- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe815c060 msgr2=0x7fbbe80cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe815c060 0x7fbbe80cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 -- 172.21.15.45:0/1797835701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40094d0 con 0x7fbbe80d2450 2023-07-09T02:11:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbedb77640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbed376640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe80d2450 0x7fbbe8151c90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800d7d0 tx=0x7fbbd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbde7fc640 1 -- 172.21.15.45:0/1797835701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8018070 con 0x7fbbe80d2450 2023-07-09T02:11:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbde7fc640 1 -- 172.21.15.45:0/1797835701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd8004020 con 0x7fbbe80d2450 2023-07-09T02:11:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe80b3830 con 0x7fbbe80d2450 2023-07-09T02:11:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbde7fc640 1 -- 172.21.15.45:0/1797835701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80041d0 con 0x7fbbe80d2450 2023-07-09T02:11:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe80b4570 con 0x7fbbe80d2450 2023-07-09T02:11:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe804d7d0 con 0x7fbbe80d2450 2023-07-09T02:11:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.040+0000 7fbbde7fc640 1 -- 172.21.15.45:0/1797835701 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbd8004330 con 0x7fbbe80d2450 2023-07-09T02:11:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.044+0000 7fbbde7fc640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbcc066280 0x7fbbcc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.044+0000 7fbbde7fc640 1 -- 172.21.15.45:0/1797835701 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbd8083c10 con 0x7fbbe80d2450 2023-07-09T02:11:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.044+0000 7fbbedb77640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbcc066280 0x7fbbcc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.044+0000 7fbbedb77640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbcc066280 0x7fbbcc068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40ae000 tx=0x7fbbe4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.048+0000 7fbbde7fc640 1 -- 172.21.15.45:0/1797835701 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbd8054a80 con 0x7fbbe80d2450 2023-07-09T02:11:45.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbe806baa0 con 0x7fbbe80d2450 2023-07-09T02:11:45.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbde7fc640 1 -- 172.21.15.45:0/1797835701 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbd8054610 con 0x7fbbe80d2450 2023-07-09T02:11:45.211 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbcc066280 msgr2=0x7fbbcc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbcc066280 0x7fbbcc068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40ae000 tx=0x7fbbe4008040 comp rx=0 tx=0).stop 2023-07-09T02:11:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe80d2450 msgr2=0x7fbbe8151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe80d2450 0x7fbbe8151c90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800d7d0 tx=0x7fbbd800dc90 comp rx=0 tx=0).stop 2023-07-09T02:11:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 shutdown_connections 2023-07-09T02:11:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe815c060 0x7fbbe80cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe80d2450 0x7fbbe8151c90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbcc066280 0x7fbbcc068730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 --2- 172.21.15.45:0/1797835701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe80cd120 0x7fbbe80b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.208+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 >> 172.21.15.45:0/1797835701 conn(0x7fbbe80698e0 msgr2=0x7fbbe80b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.212+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 shutdown_connections 2023-07-09T02:11:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.212+0000 7fbbefddb640 1 -- 172.21.15.45:0/1797835701 wait complete. 2023-07-09T02:11:45.232 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:45.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0f0bd640 1 Processor -- start 2023-07-09T02:11:45.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0f0bd640 1 -- start start 2023-07-09T02:11:45.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0f0bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c0815c060 0x7f9c080b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0f0bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c080d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0f0bd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c08160a50 con 0x7f9c080d2450 2023-07-09T02:11:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0f0bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c080d28f0 con 0x7f9c0815c060 2023-07-09T02:11:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0f0bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080cfe40 con 0x7f9c080cd120 2023-07-09T02:11:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0ce59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c0815c060 0x7f9c080b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0ce59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c0815c060 0x7f9c080b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60788/0 (socket says 172.21.15.45:60788) 2023-07-09T02:11:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0ce59640 1 -- 172.21.15.45:0/3257229515 learned_addr learned my addr 172.21.15.45:0/3257229515 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:45.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c07fff640 1 --2- 172.21.15.45:0/3257229515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c080d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0ce59640 1 -- 172.21.15.45:0/3257229515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 msgr2=0x7f9c080d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0ce59640 1 --2- 172.21.15.45:0/3257229515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c080d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0ce59640 1 -- 172.21.15.45:0/3257229515 >> v1:172.21.15.155:6789/0 conn(0x7f9c080d2450 legacy=0x7f9c080d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:45.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.376+0000 7f9c0ce59640 1 -- 172.21.15.45:0/3257229515 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0815c430 con 0x7f9c0815c060 2023-07-09T02:11:45.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0ce59640 1 --2- 172.21.15.45:0/3257229515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c080b4ed0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009870 tx=0x7f9bfc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8834f7fe7ae69d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c077fe640 1 -- 172.21.15.45:0/3257229515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0a7070 con 0x7f9c0815c060 2023-07-09T02:11:45.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c077fe640 1 -- 172.21.15.45:0/3257229515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc0ab430 con 0x7f9c0815c060 2023-07-09T02:11:45.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c077fe640 1 -- 172.21.15.45:0/3257229515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0ab7c0 con 0x7f9c0815c060 2023-07-09T02:11:45.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/3257229515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 msgr2=0x7f9c080b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/3257229515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c080b4ed0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009870 tx=0x7f9bfc01c510 comp rx=0 tx=0).stop 2023-07-09T02:11:45.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/3257229515 shutdown_connections 2023-07-09T02:11:45.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/3257229515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c080d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/3257229515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c080b4ed0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/3257229515 >> 172.21.15.45:0/3257229515 conn(0x7f9c080698e0 msgr2=0x7f9c08069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:45.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/3257229515 shutdown_connections 2023-07-09T02:11:45.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.380+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/3257229515 wait complete. 2023-07-09T02:11:45.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 Processor -- start 2023-07-09T02:11:45.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 -- start start 2023-07-09T02:11:45.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c08158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c080d2450 0x7f9c080cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c08153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c081594e0 con 0x7f9c0815c060 2023-07-09T02:11:45.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c081597c0 con 0x7f9c080d2450 2023-07-09T02:11:45.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08159aa0 con 0x7f9c080cd120 2023-07-09T02:11:45.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c08153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0ce59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c08158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c07fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c080d2450 0x7f9c080cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c08153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60790/0 (socket says 172.21.15.45:60790) 2023-07-09T02:11:45.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0ce59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c08158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:42288/0 (socket says 172.21.15.45:42288) 2023-07-09T02:11:45.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 -- 172.21.15.45:0/1789043451 learned_addr learned my addr 172.21.15.45:0/1789043451 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:45.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 -- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 msgr2=0x7f9c08158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c08158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 -- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c080d2450 msgr2=0x7f9c080cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c080d2450 0x7f9c080cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 -- 172.21.15.45:0/1789043451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0094d0 con 0x7f9c0815c060 2023-07-09T02:11:45.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0d65a640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c08153f50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c770 tx=0x7f9c0000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c057fa640 1 -- 172.21.15.45:0/1789043451 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00003b80 con 0x7f9c0815c060 2023-07-09T02:11:45.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c057fa640 1 -- 172.21.15.45:0/1789043451 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00003ce0 con 0x7f9c0815c060 2023-07-09T02:11:45.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08159d80 con 0x7f9c0815c060 2023-07-09T02:11:45.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c057fa640 1 -- 172.21.15.45:0/1789043451 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000aa90 con 0x7f9c0815c060 2023-07-09T02:11:45.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.384+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c080cc3f0 con 0x7f9c0815c060 2023-07-09T02:11:45.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.388+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0804d7d0 con 0x7f9c0815c060 2023-07-09T02:11:45.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.388+0000 7f9c057fa640 1 -- 172.21.15.45:0/1789043451 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c0000abf0 con 0x7f9c0815c060 2023-07-09T02:11:45.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.388+0000 7f9c057fa640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bec0662b0 0x7f9bec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.388+0000 7f9c057fa640 1 -- 172.21.15.45:0/1789043451 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c00083a50 con 0x7f9c0815c060 2023-07-09T02:11:45.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.388+0000 7f9c0ce59640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bec0662b0 0x7f9bec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.388+0000 7f9c0ce59640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bec0662b0 0x7f9bec068760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0af000 tx=0x7f9bfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.392+0000 7f9c057fa640 1 -- 172.21.15.45:0/1789043451 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c00050ef0 con 0x7f9c0815c060 2023-07-09T02:11:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c0806baa0 con 0x7f9c0815c060 2023-07-09T02:11:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c057fa640 1 -- 172.21.15.45:0/1789043451 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c00054510 con 0x7f9c0815c060 2023-07-09T02:11:45.551 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bec0662b0 msgr2=0x7f9bec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bec0662b0 0x7f9bec068760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0af000 tx=0x7f9bfc008040 comp rx=0 tx=0).stop 2023-07-09T02:11:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 msgr2=0x7f9c08153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c08153f50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c770 tx=0x7f9c0000cc30 comp rx=0 tx=0).stop 2023-07-09T02:11:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 shutdown_connections 2023-07-09T02:11:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c0815c060 0x7f9c08153f50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c080d2450 0x7f9c080cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bec0662b0 0x7f9bec068760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 --2- 172.21.15.45:0/1789043451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c080cd120 0x7f9c08158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 >> 172.21.15.45:0/1789043451 conn(0x7f9c080698e0 msgr2=0x7f9c080b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 shutdown_connections 2023-07-09T02:11:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.548+0000 7f9c0f0bd640 1 -- 172.21.15.45:0/1789043451 wait complete. 2023-07-09T02:11:45.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:45.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3de33a640 1 Processor -- start 2023-07-09T02:11:45.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3de33a640 1 -- start start 2023-07-09T02:11:45.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3de33a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb3d80d2620 0x7fb3d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3de33a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3d80cd120 0x7fb3d80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3de33a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d8160a50 con 0x7fb3d815c060 2023-07-09T02:11:45.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3de33a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d815c430 con 0x7fb3d80d2620 2023-07-09T02:11:45.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3de33a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d815fb60 con 0x7fb3d80cd120 2023-07-09T02:11:45.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3d77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb3d80d2620 0x7fb3d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3d77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb3d80d2620 0x7fb3d80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60806/0 (socket says 172.21.15.45:60806) 2023-07-09T02:11:45.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3d77fe640 1 -- 172.21.15.45:0/2665763231 learned_addr learned my addr 172.21.15.45:0/2665763231 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:45.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3dc8d7640 1 --2- 172.21.15.45:0/2665763231 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80cd120 0x7fb3d80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3d77fe640 1 -- 172.21.15.45:0/2665763231 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80cd120 msgr2=0x7fb3d80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:45.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3d77fe640 1 --2- 172.21.15.45:0/2665763231 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80cd120 0x7fb3d80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3d77fe640 1 -- 172.21.15.45:0/2665763231 >> v1:172.21.15.155:6789/0 conn(0x7fb3d815c060 legacy=0x7fb3d80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:45.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.716+0000 7fb3d77fe640 1 -- 172.21.15.45:0/2665763231 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d815fe40 con 0x7fb3d80d2620 2023-07-09T02:11:45.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3d77fe640 1 --2- 172.21.15.45:0/2665763231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80d2620 0x7fb3d80b4ed0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb3d806b120 tx=0x7fb3cc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b946c278c3faed37 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2665763231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc0aa5f0 con 0x7fb3d80d2620 2023-07-09T02:11:45.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2665763231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0aa750 con 0x7fb3d80d2620 2023-07-09T02:11:45.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3d6ffd640 1 -- 172.21.15.45:0/2665763231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc0aaae0 con 0x7fb3d80d2620 2023-07-09T02:11:45.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3de33a640 1 -- 172.21.15.45:0/2665763231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80d2620 msgr2=0x7fb3d80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3de33a640 1 --2- 172.21.15.45:0/2665763231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80d2620 0x7fb3d80b4ed0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb3d806b120 tx=0x7fb3cc01c490 comp rx=0 tx=0).stop 2023-07-09T02:11:45.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3de33a640 1 -- 172.21.15.45:0/2665763231 shutdown_connections 2023-07-09T02:11:45.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3de33a640 1 --2- 172.21.15.45:0/2665763231 >> v2:172.21.15.155:3300/0 conn(0x7fb3d80cd120 0x7fb3d80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3de33a640 1 --2- 172.21.15.45:0/2665763231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80d2620 0x7fb3d80b4ed0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3de33a640 1 -- 172.21.15.45:0/2665763231 >> 172.21.15.45:0/2665763231 conn(0x7fb3d80698e0 msgr2=0x7fb3d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:45.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3de33a640 1 -- 172.21.15.45:0/2665763231 shutdown_connections 2023-07-09T02:11:45.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.720+0000 7fb3de33a640 1 -- 172.21.15.45:0/2665763231 wait complete. 2023-07-09T02:11:45.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 Processor -- start 2023-07-09T02:11:45.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 -- start start 2023-07-09T02:11:45.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80cd120 0x7fb3d815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3d80d2620 0x7fb3d80b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d815c060 0x7fb3d8153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80c9930 con 0x7fb3d80cd120 2023-07-09T02:11:45.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d81531c0 con 0x7fb3d80d2620 2023-07-09T02:11:45.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d815b140 con 0x7fb3d815c060 2023-07-09T02:11:45.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80cd120 0x7fb3d815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80cd120 0x7fb3d815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60820/0 (socket says 172.21.15.45:60820) 2023-07-09T02:11:45.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 -- 172.21.15.45:0/675101623 learned_addr learned my addr 172.21.15.45:0/675101623 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:45.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d77fe640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3d80d2620 0x7fb3d80b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3dc8d7640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d815c060 0x7fb3d8153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 -- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d815c060 msgr2=0x7fb3d8153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d815c060 0x7fb3d8153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 -- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3d80d2620 msgr2=0x7fb3d80b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3d80d2620 0x7fb3d80b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 -- 172.21.15.45:0/675101623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0094d0 con 0x7fb3d80cd120 2023-07-09T02:11:45.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d77fe640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3d80d2620 0x7fb3d80b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:45.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d7fff640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80cd120 0x7fb3d815aa60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800b410 tx=0x7fb3c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d4ff9640 1 -- 172.21.15.45:0/675101623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8004020 con 0x7fb3d80cd120 2023-07-09T02:11:45.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d4ff9640 1 -- 172.21.15.45:0/675101623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c8004180 con 0x7fb3d80cd120 2023-07-09T02:11:45.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3d4ff9640 1 -- 172.21.15.45:0/675101623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8011630 con 0x7fb3d80cd120 2023-07-09T02:11:45.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d80b59f0 con 0x7fb3d80cd120 2023-07-09T02:11:45.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d8152b70 con 0x7fb3d80cd120 2023-07-09T02:11:45.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.724+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d804d7d0 con 0x7fb3d80cd120 2023-07-09T02:11:45.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.728+0000 7fb3d4ff9640 1 -- 172.21.15.45:0/675101623 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb3c8011790 con 0x7fb3d80cd120 2023-07-09T02:11:45.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.728+0000 7fb3d4ff9640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3c40662b0 0x7fb3c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:45.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.728+0000 7fb3d4ff9640 1 -- 172.21.15.45:0/675101623 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3c8083b20 con 0x7fb3d80cd120 2023-07-09T02:11:45.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.728+0000 7fb3d77fe640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3c40662b0 0x7fb3c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:45.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.728+0000 7fb3d77fe640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3c40662b0 0x7fb3c4068760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0ae000 tx=0x7fb3cc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:45.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.732+0000 7fb3d4ff9640 1 -- 172.21.15.45:0/675101623 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3c8050f00 con 0x7fb3d80cd120 2023-07-09T02:11:45.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.888+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3d80b8750 con 0x7fb3d80cd120 2023-07-09T02:11:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.888+0000 7fb3d4ff9640 1 -- 172.21.15.45:0/675101623 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fb3c8015090 con 0x7fb3d80cd120 2023-07-09T02:11:45.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:45.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.888+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3c40662b0 msgr2=0x7fb3c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.888+0000 7fb3de33a640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3c40662b0 0x7fb3c4068760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0ae000 tx=0x7fb3cc0a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:45.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.888+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80cd120 msgr2=0x7fb3d815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:45.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.888+0000 7fb3de33a640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80cd120 0x7fb3d815aa60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800b410 tx=0x7fb3c800b8d0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.892+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 shutdown_connections 2023-07-09T02:11:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.892+0000 7fb3de33a640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb3c40662b0 0x7fb3c4068760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.892+0000 7fb3de33a640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3d815c060 0x7fb3d8153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.892+0000 7fb3de33a640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3d80d2620 0x7fb3d80b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.892+0000 7fb3de33a640 1 --2- 172.21.15.45:0/675101623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3d80cd120 0x7fb3d815aa60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.892+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 >> 172.21.15.45:0/675101623 conn(0x7fb3d80698e0 msgr2=0x7fb3d80b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.892+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 shutdown_connections 2023-07-09T02:11:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:45.892+0000 7fb3de33a640 1 -- 172.21.15.45:0/675101623 wait complete. 2023-07-09T02:11:45.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:45.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184c67b640 1 Processor -- start 2023-07-09T02:11:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184c67b640 1 -- start start 2023-07-09T02:11:46.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184c67b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f184415c060 0x7f18440b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184c67b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18440cd120 0x7f18440d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184c67b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18440d2450 0x7f18440d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184c67b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18440d28f0 con 0x7f184415c060 2023-07-09T02:11:46.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184c67b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1844160a50 con 0x7f18440d2450 2023-07-09T02:11:46.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184c67b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184415c430 con 0x7f18440cd120 2023-07-09T02:11:46.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184a417640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f184415c060 0x7f18440b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184a417640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f184415c060 0x7f18440b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60830/0 (socket says 172.21.15.45:60830) 2023-07-09T02:11:46.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.056+0000 7f184a417640 1 -- 172.21.15.45:0/3225177619 learned_addr learned my addr 172.21.15.45:0/3225177619 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:46.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f184ac18640 1 --2- 172.21.15.45:0/3225177619 >> v2:172.21.15.155:3300/0 conn(0x7f18440d2450 0x7f18440d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f1849c16640 1 --2- 172.21.15.45:0/3225177619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18440cd120 0x7f18440d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f184a417640 1 -- 172.21.15.45:0/3225177619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18440cd120 msgr2=0x7f18440d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f184a417640 1 --2- 172.21.15.45:0/3225177619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18440cd120 0x7f18440d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f184a417640 1 -- 172.21.15.45:0/3225177619 >> v2:172.21.15.155:3300/0 conn(0x7f18440d2450 msgr2=0x7f18440d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f184a417640 1 --2- 172.21.15.45:0/3225177619 >> v2:172.21.15.155:3300/0 conn(0x7f18440d2450 0x7f18440d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f184a417640 1 -- 172.21.15.45:0/3225177619 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184415fb60 con 0x7f184415c060 2023-07-09T02:11:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f184a417640 1 --2- 172.21.15.45:0/3225177619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f184415c060 0x7f18440b4ed0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f184406b120 tx=0x7f184001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddfc19182bdc5a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f1849415640 1 -- 172.21.15.45:0/3225177619 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18400ab600 con 0x7f184415c060 2023-07-09T02:11:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f1849415640 1 -- 172.21.15.45:0/3225177619 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18400a7050 con 0x7f184415c060 2023-07-09T02:11:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.060+0000 7f1849415640 1 -- 172.21.15.45:0/3225177619 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18400ab980 con 0x7f184415c060 2023-07-09T02:11:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- 172.21.15.45:0/3225177619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f184415c060 msgr2=0x7f18440b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 --2- 172.21.15.45:0/3225177619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f184415c060 0x7f18440b4ed0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f184406b120 tx=0x7f184001c210 comp rx=0 tx=0).stop 2023-07-09T02:11:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- 172.21.15.45:0/3225177619 shutdown_connections 2023-07-09T02:11:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 --2- 172.21.15.45:0/3225177619 >> v2:172.21.15.155:3300/0 conn(0x7f18440d2450 0x7f18440d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 --2- 172.21.15.45:0/3225177619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18440cd120 0x7f18440d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 --2- 172.21.15.45:0/3225177619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f184415c060 0x7f18440b4ed0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- 172.21.15.45:0/3225177619 >> 172.21.15.45:0/3225177619 conn(0x7f18440698e0 msgr2=0x7f1844069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:46.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- 172.21.15.45:0/3225177619 shutdown_connections 2023-07-09T02:11:46.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- 172.21.15.45:0/3225177619 wait complete. 2023-07-09T02:11:46.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 Processor -- start 2023-07-09T02:11:46.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- start start 2023-07-09T02:11:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18440cd120 0x7f1844154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18440d2450 0x7f1844154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f184415c060 0x7f184415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1844154b60 con 0x7f18440d2450 2023-07-09T02:11:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1844154880 con 0x7f18440cd120 2023-07-09T02:11:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184c67b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440b35e0 con 0x7f184415c060 2023-07-09T02:11:46.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f1849c16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18440d2450 0x7f1844154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f1849c16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18440d2450 0x7f1844154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60836/0 (socket says 172.21.15.45:60836) 2023-07-09T02:11:46.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f1849c16640 1 -- 172.21.15.45:0/2925367954 learned_addr learned my addr 172.21.15.45:0/2925367954 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:46.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184a417640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18440cd120 0x7f1844154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f184ac18640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f184415c060 0x7f184415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f1849c16640 1 -- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f184415c060 msgr2=0x7f184415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f1849c16640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f184415c060 0x7f184415d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f1849c16640 1 -- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18440cd120 msgr2=0x7f1844154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f1849c16640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18440cd120 0x7f1844154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.064+0000 7f1849c16640 1 -- 172.21.15.45:0/2925367954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18400094d0 con 0x7f18440d2450 2023-07-09T02:11:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f1849c16640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18440d2450 0x7f1844154210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f183400d7d0 tx=0x7f183400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f183affd640 1 -- 172.21.15.45:0/2925367954 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834004020 con 0x7f18440d2450 2023-07-09T02:11:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f183affd640 1 -- 172.21.15.45:0/2925367954 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1834004180 con 0x7f18440d2450 2023-07-09T02:11:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f183affd640 1 -- 172.21.15.45:0/2925367954 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834004330 con 0x7f18440d2450 2023-07-09T02:11:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18440b38c0 con 0x7f18440d2450 2023-07-09T02:11:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18440cce70 con 0x7f18440d2450 2023-07-09T02:11:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184404d7d0 con 0x7f18440d2450 2023-07-09T02:11:46.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f183affd640 1 -- 172.21.15.45:0/2925367954 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18340096a0 con 0x7f18440d2450 2023-07-09T02:11:46.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f183affd640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1828066280 0x7f1828068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f183affd640 1 -- 172.21.15.45:0/2925367954 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1834083f10 con 0x7f18440d2450 2023-07-09T02:11:46.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.068+0000 7f184a417640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1828066280 0x7f1828068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.072+0000 7f184a417640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1828066280 0x7f1828068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18400ad000 tx=0x7f18400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.072+0000 7f183affd640 1 -- 172.21.15.45:0/2925367954 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1834051430 con 0x7f18440d2450 2023-07-09T02:11:46.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.228+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18441603d0 con 0x7f18440d2450 2023-07-09T02:11:46.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.228+0000 7f183affd640 1 -- 172.21.15.45:0/2925367954 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1834054a50 con 0x7f18440d2450 2023-07-09T02:11:46.233 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:46.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1828066280 msgr2=0x7f1828068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1828066280 0x7f1828068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18400ad000 tx=0x7f18400a6000 comp rx=0 tx=0).stop 2023-07-09T02:11:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18440d2450 msgr2=0x7f1844154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18440d2450 0x7f1844154210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f183400d7d0 tx=0x7f183400dc90 comp rx=0 tx=0).stop 2023-07-09T02:11:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 shutdown_connections 2023-07-09T02:11:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1828066280 0x7f1828068730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f184415c060 0x7f184415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18440d2450 0x7f1844154210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 --2- 172.21.15.45:0/2925367954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18440cd120 0x7f1844154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 >> 172.21.15.45:0/2925367954 conn(0x7f18440698e0 msgr2=0x7f184415b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 shutdown_connections 2023-07-09T02:11:46.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.232+0000 7f184c67b640 1 -- 172.21.15.45:0/2925367954 wait complete. 2023-07-09T02:11:46.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:46.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb9be9640 1 Processor -- start 2023-07-09T02:11:46.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb9be9640 1 -- start start 2023-07-09T02:11:46.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb9be9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eb415c060 0x7f2eb40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb9be9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2eb40cd120 0x7f2eb40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb9be9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb40d2450 0x7f2eb40d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb9be9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb40d28f0 con 0x7f2eb415c060 2023-07-09T02:11:46.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb9be9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb4160a50 con 0x7f2eb40cd120 2023-07-09T02:11:46.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb9be9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb415c430 con 0x7f2eb40d2450 2023-07-09T02:11:46.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eb415c060 0x7f2eb40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eb415c060 0x7f2eb40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60848/0 (socket says 172.21.15.45:60848) 2023-07-09T02:11:46.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb37fe640 1 -- 172.21.15.45:0/1798366352 learned_addr learned my addr 172.21.15.45:0/1798366352 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:46.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb2ffd640 1 --2- 172.21.15.45:0/1798366352 >> v2:172.21.15.155:3300/0 conn(0x7f2eb40cd120 0x7f2eb40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb3fff640 1 --2- 172.21.15.45:0/1798366352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb40d2450 0x7f2eb40d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb37fe640 1 -- 172.21.15.45:0/1798366352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb40d2450 msgr2=0x7f2eb40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:46.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb37fe640 1 --2- 172.21.15.45:0/1798366352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb40d2450 0x7f2eb40d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb37fe640 1 -- 172.21.15.45:0/1798366352 >> v2:172.21.15.155:3300/0 conn(0x7f2eb40cd120 msgr2=0x7f2eb40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:46.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb37fe640 1 --2- 172.21.15.45:0/1798366352 >> v2:172.21.15.155:3300/0 conn(0x7f2eb40cd120 0x7f2eb40d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb37fe640 1 -- 172.21.15.45:0/1798366352 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb415fb60 con 0x7f2eb415c060 2023-07-09T02:11:46.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.396+0000 7f2eb2ffd640 1 --2- 172.21.15.45:0/1798366352 >> v2:172.21.15.155:3300/0 conn(0x7f2eb40cd120 0x7f2eb40d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:46.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb37fe640 1 --2- 172.21.15.45:0/1798366352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb415c060 0x7f2eb40b4ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2eb415fac0 tx=0x7f2ea401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103a089b632e61bf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb27fc640 1 -- 172.21.15.45:0/1798366352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40ab600 con 0x7f2eb415c060 2023-07-09T02:11:46.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb27fc640 1 -- 172.21.15.45:0/1798366352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40a7050 con 0x7f2eb415c060 2023-07-09T02:11:46.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb27fc640 1 -- 172.21.15.45:0/1798366352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40ab980 con 0x7f2eb415c060 2023-07-09T02:11:46.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 -- 172.21.15.45:0/1798366352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb415c060 msgr2=0x7f2eb40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/1798366352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb415c060 0x7f2eb40b4ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2eb415fac0 tx=0x7f2ea401c210 comp rx=0 tx=0).stop 2023-07-09T02:11:46.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 -- 172.21.15.45:0/1798366352 shutdown_connections 2023-07-09T02:11:46.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/1798366352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb40d2450 0x7f2eb40d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/1798366352 >> v2:172.21.15.155:3300/0 conn(0x7f2eb40cd120 0x7f2eb40d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/1798366352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb415c060 0x7f2eb40b4ed0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 -- 172.21.15.45:0/1798366352 >> 172.21.15.45:0/1798366352 conn(0x7f2eb40698e0 msgr2=0x7f2eb4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:46.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 -- 172.21.15.45:0/1798366352 shutdown_connections 2023-07-09T02:11:46.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.400+0000 7f2eb9be9640 1 -- 172.21.15.45:0/1798366352 wait complete. 2023-07-09T02:11:46.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 Processor -- start 2023-07-09T02:11:46.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 -- start start 2023-07-09T02:11:46.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb40cd120 0x7f2eb4159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40d2450 0x7f2eb40b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb415c060 0x7f2eb415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40b7250 con 0x7f2eb40cd120 2023-07-09T02:11:46.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb415a6a0 con 0x7f2eb40d2450 2023-07-09T02:11:46.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb415a3c0 con 0x7f2eb415c060 2023-07-09T02:11:46.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb40cd120 0x7f2eb4159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb40cd120 0x7f2eb4159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60862/0 (socket says 172.21.15.45:60862) 2023-07-09T02:11:46.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 -- 172.21.15.45:0/583285164 learned_addr learned my addr 172.21.15.45:0/583285164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:46.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb2ffd640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40d2450 0x7f2eb40b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb3fff640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb415c060 0x7f2eb415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 -- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb415c060 msgr2=0x7f2eb415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb415c060 0x7f2eb415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 -- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40d2450 msgr2=0x7f2eb40b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40d2450 0x7f2eb40b7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 -- 172.21.15.45:0/583285164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea40094d0 con 0x7f2eb40cd120 2023-07-09T02:11:46.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb3fff640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb415c060 0x7f2eb415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:46.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb37fe640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb40cd120 0x7f2eb4159d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40ae040 tx=0x7f2ea401aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2e9bfff640 1 -- 172.21.15.45:0/583285164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40b6620 con 0x7f2eb40cd120 2023-07-09T02:11:46.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2e9bfff640 1 -- 172.21.15.45:0/583285164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40abe90 con 0x7f2eb40cd120 2023-07-09T02:11:46.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2e9bfff640 1 -- 172.21.15.45:0/583285164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40b69e0 con 0x7f2eb40cd120 2023-07-09T02:11:46.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb40b6b90 con 0x7f2eb40cd120 2023-07-09T02:11:46.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.404+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb4159650 con 0x7f2eb40cd120 2023-07-09T02:11:46.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.408+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb40b69f0 con 0x7f2eb40cd120 2023-07-09T02:11:46.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.408+0000 7f2e9bfff640 1 -- 172.21.15.45:0/583285164 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ea40b2040 con 0x7f2eb40cd120 2023-07-09T02:11:46.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.408+0000 7f2e9bfff640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ea00662b0 0x7f2ea0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.408+0000 7f2e9bfff640 1 -- 172.21.15.45:0/583285164 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ea411de20 con 0x7f2eb40cd120 2023-07-09T02:11:46.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.408+0000 7f2eb2ffd640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ea00662b0 0x7f2ea0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.408+0000 7f2eb2ffd640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ea00662b0 0x7f2ea0068760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40b8a10 tx=0x7f2ea8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.412+0000 7f2e9bfff640 1 -- 172.21.15.45:0/583285164 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2eb40b69f0 con 0x7f2eb40cd120 2023-07-09T02:11:46.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2eb40b69f0 con 0x7f2eb40cd120 2023-07-09T02:11:46.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2e9bfff640 1 -- 172.21.15.45:0/583285164 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2eb40b69f0 con 0x7f2eb40cd120 2023-07-09T02:11:46.570 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:46.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ea00662b0 msgr2=0x7f2ea0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ea00662b0 0x7f2ea0068760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40b8a10 tx=0x7f2ea8008040 comp rx=0 tx=0).stop 2023-07-09T02:11:46.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb40cd120 msgr2=0x7f2eb4159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb40cd120 0x7f2eb4159d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40ae040 tx=0x7f2ea401aa50 comp rx=0 tx=0).stop 2023-07-09T02:11:46.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 shutdown_connections 2023-07-09T02:11:46.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ea00662b0 0x7f2ea0068760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb415c060 0x7f2eb415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40d2450 0x7f2eb40b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 --2- 172.21.15.45:0/583285164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eb40cd120 0x7f2eb4159d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 >> 172.21.15.45:0/583285164 conn(0x7f2eb40698e0 msgr2=0x7f2eb4151670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 shutdown_connections 2023-07-09T02:11:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.568+0000 7f2eb9be9640 1 -- 172.21.15.45:0/583285164 wait complete. 2023-07-09T02:11:46.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:46.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15ebc7b640 1 Processor -- start 2023-07-09T02:11:46.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15ebc7b640 1 -- start start 2023-07-09T02:11:46.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15ebc7b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15e40d2620 0x7f15e40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15ebc7b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e4160a50 con 0x7f15e40cd120 2023-07-09T02:11:46.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15ebc7b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e415c430 con 0x7f15e415c060 2023-07-09T02:11:46.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15ebc7b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e415fb60 con 0x7f15e40d2620 2023-07-09T02:11:46.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15e9216640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15e40d2620 0x7f15e40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15ea218640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f15e40cd120 0x7f15e40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45228/0 (socket says 172.21.15.45:45228) 2023-07-09T02:11:46.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15ea218640 1 -- 172.21.15.45:0/4962960 learned_addr learned my addr 172.21.15.45:0/4962960 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:46.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15e9216640 1 -- 172.21.15.45:0/4962960 >> v1:172.21.15.155:6789/0 conn(0x7f15e415c060 legacy=0x7f15e40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:46.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15e9216640 1 -- 172.21.15.45:0/4962960 >> v1:172.21.15.45:6789/0 conn(0x7f15e40cd120 legacy=0x7f15e40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15e9216640 1 -- 172.21.15.45:0/4962960 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e415fe40 con 0x7f15e40d2620 2023-07-09T02:11:46.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.736+0000 7f15e8a15640 1 -- 172.21.15.45:0/4962960 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101640465 0 0) 0x7f15e4160a50 con 0x7f15e40cd120 2023-07-09T02:11:46.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15e9216640 1 --2- 172.21.15.45:0/4962960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40d2620 0x7f15e40b4ed0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f15d40097c0 tx=0x7f15d401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55376d65ff022f7e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15e8a15640 1 -- 172.21.15.45:0/4962960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40ab650 con 0x7f15e40d2620 2023-07-09T02:11:46.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15e8a15640 1 -- 172.21.15.45:0/4962960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d40ab7b0 con 0x7f15e40d2620 2023-07-09T02:11:46.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15e8a15640 1 -- 172.21.15.45:0/4962960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40abb40 con 0x7f15e40d2620 2023-07-09T02:11:46.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 -- 172.21.15.45:0/4962960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40d2620 msgr2=0x7f15e40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 --2- 172.21.15.45:0/4962960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40d2620 0x7f15e40b4ed0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f15d40097c0 tx=0x7f15d401c450 comp rx=0 tx=0).stop 2023-07-09T02:11:46.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 -- 172.21.15.45:0/4962960 shutdown_connections 2023-07-09T02:11:46.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 --2- 172.21.15.45:0/4962960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40d2620 0x7f15e40b4ed0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 -- 172.21.15.45:0/4962960 >> 172.21.15.45:0/4962960 conn(0x7f15e40698e0 msgr2=0x7f15e4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:46.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 -- 172.21.15.45:0/4962960 shutdown_connections 2023-07-09T02:11:46.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 -- 172.21.15.45:0/4962960 wait complete. 2023-07-09T02:11:46.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 Processor -- start 2023-07-09T02:11:46.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.740+0000 7f15ebc7b640 1 -- start start 2023-07-09T02:11:46.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40cd120 0x7f15e414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15e40d2620 0x7f15e4154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15e415c060 0x7f15e4158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e414f7f0 con 0x7f15e40cd120 2023-07-09T02:11:46.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e415f600 con 0x7f15e40d2620 2023-07-09T02:11:46.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e415ee40 con 0x7f15e415c060 2023-07-09T02:11:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40cd120 0x7f15e414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40cd120 0x7f15e414f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60872/0 (socket says 172.21.15.45:60872) 2023-07-09T02:11:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 -- 172.21.15.45:0/503017424 learned_addr learned my addr 172.21.15.45:0/503017424 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 -- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15e415c060 msgr2=0x7f15e4158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15e415c060 0x7f15e4158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 -- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15e40d2620 msgr2=0x7f15e4154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15e40d2620 0x7f15e4154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 -- 172.21.15.45:0/503017424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4009420 con 0x7f15e40cd120 2023-07-09T02:11:46.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15e9a17640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40cd120 0x7f15e414f2b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f15e000c3c0 tx=0x7f15e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15da7fc640 1 -- 172.21.15.45:0/503017424 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00052d0 con 0x7f15e40cd120 2023-07-09T02:11:46.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15da7fc640 1 -- 172.21.15.45:0/503017424 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e0005430 con 0x7f15e40cd120 2023-07-09T02:11:46.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e40b59f0 con 0x7f15e40cd120 2023-07-09T02:11:46.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15da7fc640 1 -- 172.21.15.45:0/503017424 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0003840 con 0x7f15e40cd120 2023-07-09T02:11:46.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e415ca30 con 0x7f15e40cd120 2023-07-09T02:11:46.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.744+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e404d7d0 con 0x7f15e40cd120 2023-07-09T02:11:46.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.748+0000 7f15da7fc640 1 -- 172.21.15.45:0/503017424 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15e00039a0 con 0x7f15e40cd120 2023-07-09T02:11:46.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.748+0000 7f15da7fc640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15c8066280 0x7f15c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:46.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.748+0000 7f15da7fc640 1 -- 172.21.15.45:0/503017424 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15e0083200 con 0x7f15e40cd120 2023-07-09T02:11:46.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.748+0000 7f15e9216640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15c8066280 0x7f15c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:46.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.748+0000 7f15e9216640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15c8066280 0x7f15c8068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f15d40af000 tx=0x7f15d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:46.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.752+0000 7f15da7fc640 1 -- 172.21.15.45:0/503017424 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15e00506f0 con 0x7f15e40cd120 2023-07-09T02:11:46.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15e406baa0 con 0x7f15e40cd120 2023-07-09T02:11:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15da7fc640 1 -- 172.21.15.45:0/503017424 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15e0053d10 con 0x7f15e40cd120 2023-07-09T02:11:46.907 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15c8066280 msgr2=0x7f15c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15c8066280 0x7f15c8068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f15d40af000 tx=0x7f15d4008040 comp rx=0 tx=0).stop 2023-07-09T02:11:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40cd120 msgr2=0x7f15e414f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40cd120 0x7f15e414f2b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f15e000c3c0 tx=0x7f15e000c880 comp rx=0 tx=0).stop 2023-07-09T02:11:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 shutdown_connections 2023-07-09T02:11:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15c8066280 0x7f15c8068730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15e415c060 0x7f15e4158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15e40d2620 0x7f15e4154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 --2- 172.21.15.45:0/503017424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15e40cd120 0x7f15e414f2b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 >> 172.21.15.45:0/503017424 conn(0x7f15e40698e0 msgr2=0x7f15e40b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 shutdown_connections 2023-07-09T02:11:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:46.904+0000 7f15ebc7b640 1 -- 172.21.15.45:0/503017424 wait complete. 2023-07-09T02:11:46.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.068+0000 7f4a225fa640 1 Processor -- start 2023-07-09T02:11:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.068+0000 7f4a225fa640 1 -- start start 2023-07-09T02:11:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a225fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a1c15c060 0x7f4a1c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a225fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c0cd120 0x7f4a1c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a225fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c160a50 con 0x7f4a1c0d2450 2023-07-09T02:11:47.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a225fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0d28f0 con 0x7f4a1c15c060 2023-07-09T02:11:47.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a225fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0cfe40 con 0x7f4a1c0cd120 2023-07-09T02:11:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a1c15c060 0x7f4a1c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a1c15c060 0x7f4a1c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60884/0 (socket says 172.21.15.45:60884) 2023-07-09T02:11:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1bfff640 1 -- 172.21.15.45:0/3869107790 learned_addr learned my addr 172.21.15.45:0/3869107790 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a20b97640 1 --1- 172.21.15.45:0/3869107790 >> v1:172.21.15.45:6789/0 conn(0x7f4a1c0d2450 0x7f4a1c0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45238/0 (socket says 172.21.15.45:45238) 2023-07-09T02:11:47.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1b7fe640 1 --2- 172.21.15.45:0/3869107790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c0cd120 0x7f4a1c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1bfff640 1 -- 172.21.15.45:0/3869107790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c0cd120 msgr2=0x7f4a1c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:47.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1bfff640 1 --2- 172.21.15.45:0/3869107790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c0cd120 0x7f4a1c0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1bfff640 1 -- 172.21.15.45:0/3869107790 >> v1:172.21.15.45:6789/0 conn(0x7f4a1c0d2450 legacy=0x7f4a1c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1bfff640 1 -- 172.21.15.45:0/3869107790 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c15c430 con 0x7f4a1c15c060 2023-07-09T02:11:47.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.072+0000 7f4a1b7fe640 1 --2- 172.21.15.45:0/3869107790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c0cd120 0x7f4a1c0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:47.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a1bfff640 1 --2- 172.21.15.45:0/3869107790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c15c060 0x7f4a1c0b4ed0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009870 tx=0x7f4a0c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aa65541d1daf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:47.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a1affd640 1 -- 172.21.15.45:0/3869107790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0a7070 con 0x7f4a1c15c060 2023-07-09T02:11:47.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a1affd640 1 -- 172.21.15.45:0/3869107790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0ab430 con 0x7f4a1c15c060 2023-07-09T02:11:47.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a1affd640 1 -- 172.21.15.45:0/3869107790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0ab7c0 con 0x7f4a1c15c060 2023-07-09T02:11:47.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 -- 172.21.15.45:0/3869107790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c15c060 msgr2=0x7f4a1c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 --2- 172.21.15.45:0/3869107790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c15c060 0x7f4a1c0b4ed0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009870 tx=0x7f4a0c01c510 comp rx=0 tx=0).stop 2023-07-09T02:11:47.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 -- 172.21.15.45:0/3869107790 shutdown_connections 2023-07-09T02:11:47.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 --2- 172.21.15.45:0/3869107790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c0cd120 0x7f4a1c0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 --2- 172.21.15.45:0/3869107790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c15c060 0x7f4a1c0b4ed0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 -- 172.21.15.45:0/3869107790 >> 172.21.15.45:0/3869107790 conn(0x7f4a1c0698e0 msgr2=0x7f4a1c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:47.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 -- 172.21.15.45:0/3869107790 shutdown_connections 2023-07-09T02:11:47.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 -- 172.21.15.45:0/3869107790 wait complete. 2023-07-09T02:11:47.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 Processor -- start 2023-07-09T02:11:47.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.076+0000 7f4a225fa640 1 -- start start 2023-07-09T02:11:47.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cd120 0x7f4a1c0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a1c0d2450 0x7f4a1c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c15c060 0x7f4a1c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0cabd0 con 0x7f4a1c0cd120 2023-07-09T02:11:47.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c1545b0 con 0x7f4a1c0d2450 2023-07-09T02:11:47.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0cc1e0 con 0x7f4a1c15c060 2023-07-09T02:11:47.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cd120 0x7f4a1c0ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cd120 0x7f4a1c0ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60894/0 (socket says 172.21.15.45:60894) 2023-07-09T02:11:47.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 -- 172.21.15.45:0/2583420888 learned_addr learned my addr 172.21.15.45:0/2583420888 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:47.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a20b97640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c15c060 0x7f4a1c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1b7fe640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a1c0d2450 0x7f4a1c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 -- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c15c060 msgr2=0x7f4a1c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c15c060 0x7f4a1c159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 -- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a1c0d2450 msgr2=0x7f4a1c154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a1c0d2450 0x7f4a1c154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 -- 172.21.15.45:0/2583420888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c0094d0 con 0x7f4a1c0cd120 2023-07-09T02:11:47.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a20b97640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c15c060 0x7f4a1c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:47.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a1bfff640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cd120 0x7f4a1c0ca690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0ad040 tx=0x7f4a0c0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:47.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a18ff9640 1 -- 172.21.15.45:0/2583420888 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0bc070 con 0x7f4a1c0cd120 2023-07-09T02:11:47.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a18ff9640 1 -- 172.21.15.45:0/2583420888 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0b4630 con 0x7f4a1c0cd120 2023-07-09T02:11:47.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a18ff9640 1 -- 172.21.15.45:0/2583420888 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0b4a00 con 0x7f4a1c0cd120 2023-07-09T02:11:47.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c0cc4c0 con 0x7f4a1c0cd120 2023-07-09T02:11:47.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c0c9e90 con 0x7f4a1c0cd120 2023-07-09T02:11:47.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c04d7d0 con 0x7f4a1c0cd120 2023-07-09T02:11:47.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.080+0000 7f4a18ff9640 1 -- 172.21.15.45:0/2583420888 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a0c0b4b60 con 0x7f4a1c0cd120 2023-07-09T02:11:47.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.084+0000 7f4a18ff9640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a080662b0 0x7f4a08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.084+0000 7f4a18ff9640 1 -- 172.21.15.45:0/2583420888 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a0c11d890 con 0x7f4a1c0cd120 2023-07-09T02:11:47.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.084+0000 7f4a1b7fe640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a080662b0 0x7f4a08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.084+0000 7f4a1b7fe640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a080662b0 0x7f4a08068760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0b1c80 tx=0x7f4a10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:47.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.088+0000 7f4a18ff9640 1 -- 172.21.15.45:0/2583420888 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a0c0ead00 con 0x7f4a1c0cd120 2023-07-09T02:11:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a1c06baa0 con 0x7f4a1c0cd120 2023-07-09T02:11:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a18ff9640 1 -- 172.21.15.45:0/2583420888 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a0c0ee320 con 0x7f4a1c0cd120 2023-07-09T02:11:47.243 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:47.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a080662b0 msgr2=0x7f4a08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a080662b0 0x7f4a08068760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0b1c80 tx=0x7f4a10008040 comp rx=0 tx=0).stop 2023-07-09T02:11:47.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cd120 msgr2=0x7f4a1c0ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cd120 0x7f4a1c0ca690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0ad040 tx=0x7f4a0c0192b0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 shutdown_connections 2023-07-09T02:11:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a080662b0 0x7f4a08068760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a1c15c060 0x7f4a1c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a1c0d2450 0x7f4a1c154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 --2- 172.21.15.45:0/2583420888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a1c0cd120 0x7f4a1c0ca690 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 >> 172.21.15.45:0/2583420888 conn(0x7f4a1c0698e0 msgr2=0x7f4a1c0b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 shutdown_connections 2023-07-09T02:11:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.240+0000 7f4a225fa640 1 -- 172.21.15.45:0/2583420888 wait complete. 2023-07-09T02:11:47.283 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-07-09T02:11:47.284 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-07-09T02:11:47.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30fb456640 1 Processor -- start 2023-07-09T02:11:47.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30fb456640 1 -- start start 2023-07-09T02:11:47.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30fb456640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f30f41604a0 0x7f30f4164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30fb456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40c8dc0 0x7f30f40cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30fb456640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f406ef30 con 0x7f30f40cde40 2023-07-09T02:11:47.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30fb456640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f406be90 con 0x7f30f41604a0 2023-07-09T02:11:47.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30fb456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f406b000 con 0x7f30f40c8dc0 2023-07-09T02:11:47.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30f99f3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f30f40cde40 0x7f30f40cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45244/0 (socket says 172.21.15.45:45244) 2023-07-09T02:11:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30f99f3640 1 -- 172.21.15.45:0/887026550 learned_addr learned my addr 172.21.15.45:0/887026550 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30f89f1640 1 --2- 172.21.15.45:0/887026550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40c8dc0 0x7f30f40cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30f91f2640 1 --2- 172.21.15.45:0/887026550 >> v2:172.21.15.155:3300/0 conn(0x7f30f41604a0 0x7f30f4164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30ebfff640 1 -- 172.21.15.45:0/887026550 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327174425 0 0) 0x7f30f406ef30 con 0x7f30f40cde40 2023-07-09T02:11:47.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.424+0000 7f30ebfff640 1 -- 172.21.15.45:0/887026550 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e0003530 con 0x7f30f40cde40 2023-07-09T02:11:47.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30f89f1640 1 -- 172.21.15.45:0/887026550 >> v2:172.21.15.155:3300/0 conn(0x7f30f41604a0 msgr2=0x7f30f4164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:47.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30f89f1640 1 --2- 172.21.15.45:0/887026550 >> v2:172.21.15.155:3300/0 conn(0x7f30f41604a0 0x7f30f4164b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30ebfff640 1 -- 172.21.15.45:0/887026550 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2927971225 0 0) 0x7f30e0003530 con 0x7f30f40cde40 2023-07-09T02:11:47.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30f89f1640 1 -- 172.21.15.45:0/887026550 >> v1:172.21.15.45:6789/0 conn(0x7f30f40cde40 legacy=0x7f30f40cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30f89f1640 1 -- 172.21.15.45:0/887026550 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4165040 con 0x7f30f40c8dc0 2023-07-09T02:11:47.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30f89f1640 1 --2- 172.21.15.45:0/887026550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40c8dc0 0x7f30f40cd900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f30e40097c0 tx=0x7f30e401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68245930b45b19a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:47.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30ebfff640 1 -- 172.21.15.45:0/887026550 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec001a00 con 0x7f30f40c8dc0 2023-07-09T02:11:47.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30ebfff640 1 -- 172.21.15.45:0/887026550 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e40a7050 con 0x7f30f40c8dc0 2023-07-09T02:11:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.428+0000 7f30ebfff640 1 -- 172.21.15.45:0/887026550 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40ab620 con 0x7f30f40c8dc0 2023-07-09T02:11:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- 172.21.15.45:0/887026550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40c8dc0 msgr2=0x7f30f40cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 --2- 172.21.15.45:0/887026550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40c8dc0 0x7f30f40cd900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f30e40097c0 tx=0x7f30e401c3a0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- 172.21.15.45:0/887026550 shutdown_connections 2023-07-09T02:11:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 --2- 172.21.15.45:0/887026550 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40c8dc0 0x7f30f40cd900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 --2- 172.21.15.45:0/887026550 >> v2:172.21.15.155:3300/0 conn(0x7f30f41604a0 0x7f30f4164b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- 172.21.15.45:0/887026550 >> 172.21.15.45:0/887026550 conn(0x7f30f40694b0 msgr2=0x7f30f40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- 172.21.15.45:0/887026550 shutdown_connections 2023-07-09T02:11:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- 172.21.15.45:0/887026550 wait complete. 2023-07-09T02:11:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 Processor -- start 2023-07-09T02:11:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- start start 2023-07-09T02:11:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f40c8dc0 0x7f30f4153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40cde40 0x7f30f413f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30f41604a0 0x7f30f4142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4154320 con 0x7f30f41604a0 2023-07-09T02:11:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f413fd10 con 0x7f30f40c8dc0 2023-07-09T02:11:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30fb456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40ae460 con 0x7f30f40cde40 2023-07-09T02:11:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30f41604a0 0x7f30f4142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30f41604a0 0x7f30f4142340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60898/0 (socket says 172.21.15.45:60898) 2023-07-09T02:11:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 -- 172.21.15.45:0/2760438967 learned_addr learned my addr 172.21.15.45:0/2760438967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f91f2640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f40c8dc0 0x7f30f4153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f89f1640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40cde40 0x7f30f413f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 -- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40cde40 msgr2=0x7f30f413f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40cde40 0x7f30f413f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 -- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f40c8dc0 msgr2=0x7f30f4153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f40c8dc0 0x7f30f4153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 -- 172.21.15.45:0/2760438967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4009420 con 0x7f30f41604a0 2023-07-09T02:11:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f89f1640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40cde40 0x7f30f413f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.432+0000 7f30f99f3640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30f41604a0 0x7f30f4142340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f30ec001f80 tx=0x7f30ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30e9ffb640 1 -- 172.21.15.45:0/2760438967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec012400 con 0x7f30f41604a0 2023-07-09T02:11:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30e9ffb640 1 -- 172.21.15.45:0/2760438967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec012560 con 0x7f30f41604a0 2023-07-09T02:11:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f40ae740 con 0x7f30f41604a0 2023-07-09T02:11:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30e9ffb640 1 -- 172.21.15.45:0/2760438967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0128d0 con 0x7f30f41604a0 2023-07-09T02:11:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f41535e0 con 0x7f30f41604a0 2023-07-09T02:11:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f404d7d0 con 0x7f30f41604a0 2023-07-09T02:11:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30e9ffb640 1 -- 172.21.15.45:0/2760438967 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30ec012a30 con 0x7f30f41604a0 2023-07-09T02:11:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30e9ffb640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f30d8066280 0x7f30d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30e9ffb640 1 -- 172.21.15.45:0/2760438967 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30ec084480 con 0x7f30f41604a0 2023-07-09T02:11:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.436+0000 7f30f91f2640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f30d8066280 0x7f30d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.440+0000 7f30f91f2640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f30d8066280 0x7f30d8068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009ac0 tx=0x7f30f0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:47.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.440+0000 7f30e9ffb640 1 -- 172.21.15.45:0/2760438967 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30ec0518f0 con 0x7f30f41604a0 2023-07-09T02:11:47.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:47.652+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f30f406c740 con 0x7f30f41604a0 2023-07-09T02:11:47.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:11:47.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:11:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.612+0000 7f30e9ffb640 1 -- 172.21.15.45:0/2760438967 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v49) v1 ==== 133+0+0 (secure 0 0 0) 0x7f30ec054f10 con 0x7f30f41604a0 2023-07-09T02:11:48.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f30d8066280 msgr2=0x7f30d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:48.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f30d8066280 0x7f30d8068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009ac0 tx=0x7f30f0009190 comp rx=0 tx=0).stop 2023-07-09T02:11:48.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30f41604a0 msgr2=0x7f30f4142340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:48.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30f41604a0 0x7f30f4142340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f30ec001f80 tx=0x7f30ec00a430 comp rx=0 tx=0).stop 2023-07-09T02:11:48.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 shutdown_connections 2023-07-09T02:11:48.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30f41604a0 0x7f30f4142340 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f30d8066280 0x7f30d8068730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30f40cde40 0x7f30f413f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 --2- 172.21.15.45:0/2760438967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f40c8dc0 0x7f30f4153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 >> 172.21.15.45:0/2760438967 conn(0x7f30f40694b0 msgr2=0x7f30f40c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:48.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 shutdown_connections 2023-07-09T02:11:48.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.616+0000 7f30fb456640 1 -- 172.21.15.45:0/2760438967 wait complete. 2023-07-09T02:11:48.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-07-09T02:11:48.808 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_objectstore":"memstore"} 2023-07-09T02:11:48.809 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-07-09T02:11:48.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:11:48.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3d01456640 1 Processor -- start 2023-07-09T02:11:48.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3d01456640 1 -- start start 2023-07-09T02:11:48.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3d01456640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3cfc15c060 0x7f3cfc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:48.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3d01456640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cfc0d2620 0x7f3cfc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:48.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3d01456640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc160a50 con 0x7f3cfc0cd120 2023-07-09T02:11:48.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3d01456640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cfc15c430 con 0x7f3cfc0d2620 2023-07-09T02:11:48.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3d01456640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cfc15fb60 con 0x7f3cfc15c060 2023-07-09T02:11:48.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3cfb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cfc0d2620 0x7f3cfc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:48.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3cfb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cfc0d2620 0x7f3cfc0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60912/0 (socket says 172.21.15.45:60912) 2023-07-09T02:11:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.952+0000 7f3cfb7fe640 1 -- 172.21.15.45:0/631161224 learned_addr learned my addr 172.21.15.45:0/631161224 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfaffd640 1 --2- 172.21.15.45:0/631161224 >> v2:172.21.15.155:3300/0 conn(0x7f3cfc15c060 0x7f3cfc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfb7fe640 1 -- 172.21.15.45:0/631161224 >> v2:172.21.15.155:3300/0 conn(0x7f3cfc15c060 msgr2=0x7f3cfc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfb7fe640 1 --2- 172.21.15.45:0/631161224 >> v2:172.21.15.155:3300/0 conn(0x7f3cfc15c060 0x7f3cfc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfb7fe640 1 -- 172.21.15.45:0/631161224 >> v1:172.21.15.155:6789/0 conn(0x7f3cfc0cd120 legacy=0x7f3cfc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:48.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfb7fe640 1 -- 172.21.15.45:0/631161224 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc15fe40 con 0x7f3cfc0d2620 2023-07-09T02:11:48.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfaffd640 1 --2- 172.21.15.45:0/631161224 >> v2:172.21.15.155:3300/0 conn(0x7f3cfc15c060 0x7f3cfc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfb7fe640 1 --2- 172.21.15.45:0/631161224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0d2620 0x7f3cfc0cee30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0d3ad0 tx=0x7f3cf401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a2da3c42c2d071 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfa7fc640 1 -- 172.21.15.45:0/631161224 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40a5860 con 0x7f3cfc0d2620 2023-07-09T02:11:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfa7fc640 1 -- 172.21.15.45:0/631161224 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf40a59c0 con 0x7f3cfc0d2620 2023-07-09T02:11:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.956+0000 7f3cfa7fc640 1 -- 172.21.15.45:0/631161224 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40a5d50 con 0x7f3cfc0d2620 2023-07-09T02:11:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- 172.21.15.45:0/631161224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0d2620 msgr2=0x7f3cfc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 --2- 172.21.15.45:0/631161224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0d2620 0x7f3cfc0cee30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0d3ad0 tx=0x7f3cf401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- 172.21.15.45:0/631161224 shutdown_connections 2023-07-09T02:11:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 --2- 172.21.15.45:0/631161224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0d2620 0x7f3cfc0cee30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 --2- 172.21.15.45:0/631161224 >> v2:172.21.15.155:3300/0 conn(0x7f3cfc15c060 0x7f3cfc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- 172.21.15.45:0/631161224 >> 172.21.15.45:0/631161224 conn(0x7f3cfc0698e0 msgr2=0x7f3cfc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- 172.21.15.45:0/631161224 shutdown_connections 2023-07-09T02:11:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- 172.21.15.45:0/631161224 wait complete. 2023-07-09T02:11:48.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 Processor -- start 2023-07-09T02:11:48.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- start start 2023-07-09T02:11:48.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0cd120 0x7f3cfc0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:48.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cfc0d2620 0x7f3cfc1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:48.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc15c060 0x7f3cfc15d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:48.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc15ab80 con 0x7f3cfc0cd120 2023-07-09T02:11:48.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc159ae0 con 0x7f3cfc15c060 2023-07-09T02:11:48.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3d01456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc159dc0 con 0x7f3cfc0d2620 2023-07-09T02:11:48.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0cd120 0x7f3cfc0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:48.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0cd120 0x7f3cfc0c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60916/0 (socket says 172.21.15.45:60916) 2023-07-09T02:11:48.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 -- 172.21.15.45:0/991017144 learned_addr learned my addr 172.21.15.45:0/991017144 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfb7fe640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc15c060 0x7f3cfc15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 -- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cfc0d2620 msgr2=0x7f3cfc1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cfc0d2620 0x7f3cfc1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 -- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc15c060 msgr2=0x7f3cfc15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc15c060 0x7f3cfc15d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 -- 172.21.15.45:0/991017144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf4009b30 con 0x7f3cfc0cd120 2023-07-09T02:11:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfb7fe640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc15c060 0x7f3cfc15d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.960+0000 7f3cfaffd640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0cd120 0x7f3cfc0c86f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00d800 tx=0x7f3cec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3cf37fe640 1 -- 172.21.15.45:0/991017144 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0096c0 con 0x7f3cfc0cd120 2023-07-09T02:11:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3cf37fe640 1 -- 172.21.15.45:0/991017144 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec009820 con 0x7f3cfc0cd120 2023-07-09T02:11:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3cf37fe640 1 -- 172.21.15.45:0/991017144 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec009bd0 con 0x7f3cfc0cd120 2023-07-09T02:11:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc0b59f0 con 0x7f3cfc0cd120 2023-07-09T02:11:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc15a380 con 0x7f3cfc0cd120 2023-07-09T02:11:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc04d7d0 con 0x7f3cfc0cd120 2023-07-09T02:11:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3cf37fe640 1 -- 172.21.15.45:0/991017144 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3cec009d30 con 0x7f3cfc0cd120 2023-07-09T02:11:48.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3cf37fe640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cdc066280 0x7f3cdc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:48.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3cf37fe640 1 -- 172.21.15.45:0/991017144 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cec084470 con 0x7f3cfc0cd120 2023-07-09T02:11:48.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.964+0000 7f3cf3fff640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cdc066280 0x7f3cdc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:48.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.968+0000 7f3cf3fff640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cdc066280 0x7f3cdc068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000f70 tx=0x7f3ce40079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:48.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:48.968+0000 7f3cf37fe640 1 -- 172.21.15.45:0/991017144 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cec0518e0 con 0x7f3cfc0cd120 2023-07-09T02:11:49.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.124+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3cfc06baa0 con 0x7f3cfc0cd120 2023-07-09T02:11:49.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3cf37fe640 1 -- 172.21.15.45:0/991017144 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3cec054f00 con 0x7f3cfc0cd120 2023-07-09T02:11:49.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cdc066280 msgr2=0x7f3cdc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cdc066280 0x7f3cdc068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000f70 tx=0x7f3ce40079c0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0cd120 msgr2=0x7f3cfc0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0cd120 0x7f3cfc0c86f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00d800 tx=0x7f3cec00dcc0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 shutdown_connections 2023-07-09T02:11:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cfc15c060 0x7f3cfc15d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cdc066280 0x7f3cdc068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cfc0d2620 0x7f3cfc1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 --2- 172.21.15.45:0/991017144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cfc0cd120 0x7f3cfc0c86f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 >> 172.21.15.45:0/991017144 conn(0x7f3cfc0698e0 msgr2=0x7f3cfc15b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 shutdown_connections 2023-07-09T02:11:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.128+0000 7f3d01456640 1 -- 172.21.15.45:0/991017144 wait complete. 2023-07-09T02:11:49.153 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:11:49.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:11:49.224 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:11:49.290 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:11:49.291 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:11:49.291 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:49.300 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:11:49.301 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:49.358 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:11:49.358 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:49.409 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:49.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd5045db640 1 Processor -- start 2023-07-09T02:11:49.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd5045db640 1 -- start start 2023-07-09T02:11:49.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd5045db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4fc0d2620 0x7fd4fc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd5045db640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc160a50 con 0x7fd4fc0cd120 2023-07-09T02:11:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd5045db640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc15c430 con 0x7fd4fc15c060 2023-07-09T02:11:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd5045db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc15fb60 con 0x7fd4fc0d2620 2023-07-09T02:11:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd501b76640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4fc0d2620 0x7fd4fc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd502b78640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd4fc0cd120 0x7fd4fc0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45246/0 (socket says 172.21.15.45:45246) 2023-07-09T02:11:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd502b78640 1 -- 172.21.15.45:0/1070840292 learned_addr learned my addr 172.21.15.45:0/1070840292 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.592+0000 7fd501b76640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4fc0d2620 0x7fd4fc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60920/0 (socket says 172.21.15.45:60920) 2023-07-09T02:11:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd501b76640 1 -- 172.21.15.45:0/1070840292 >> v1:172.21.15.155:6789/0 conn(0x7fd4fc15c060 legacy=0x7fd4fc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:49.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd501b76640 1 -- 172.21.15.45:0/1070840292 >> v1:172.21.15.45:6789/0 conn(0x7fd4fc0cd120 legacy=0x7fd4fc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd501b76640 1 -- 172.21.15.45:0/1070840292 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc15fe40 con 0x7fd4fc0d2620 2023-07-09T02:11:49.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd501375640 1 -- 172.21.15.45:0/1070840292 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250239118 0 0) 0x7fd4fc160a50 con 0x7fd4fc0cd120 2023-07-09T02:11:49.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd501b76640 1 --2- 172.21.15.45:0/1070840292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc0d2620 0x7fd4fc0b4ed0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0097c0 tx=0x7fd4ec01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85f4a0bce72f9e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:49.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd501375640 1 -- 172.21.15.45:0/1070840292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0ab610 con 0x7fd4fc0d2620 2023-07-09T02:11:49.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd501375640 1 -- 172.21.15.45:0/1070840292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0ab770 con 0x7fd4fc0d2620 2023-07-09T02:11:49.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd501375640 1 -- 172.21.15.45:0/1070840292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0abb00 con 0x7fd4fc0d2620 2023-07-09T02:11:49.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd5045db640 1 -- 172.21.15.45:0/1070840292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc0d2620 msgr2=0x7fd4fc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd5045db640 1 --2- 172.21.15.45:0/1070840292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc0d2620 0x7fd4fc0b4ed0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0097c0 tx=0x7fd4ec01c410 comp rx=0 tx=0).stop 2023-07-09T02:11:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd5045db640 1 -- 172.21.15.45:0/1070840292 shutdown_connections 2023-07-09T02:11:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.596+0000 7fd5045db640 1 --2- 172.21.15.45:0/1070840292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc0d2620 0x7fd4fc0b4ed0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 -- 172.21.15.45:0/1070840292 >> 172.21.15.45:0/1070840292 conn(0x7fd4fc0698e0 msgr2=0x7fd4fc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 -- 172.21.15.45:0/1070840292 shutdown_connections 2023-07-09T02:11:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 -- 172.21.15.45:0/1070840292 wait complete. 2023-07-09T02:11:49.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 Processor -- start 2023-07-09T02:11:49.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 -- start start 2023-07-09T02:11:49.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4fc0cd120 0x7fd4fc15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4fc0d2620 0x7fd4fc166d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc15c060 0x7fd4fc15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc167290 con 0x7fd4fc15c060 2023-07-09T02:11:49.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc15f0e0 con 0x7fd4fc0d2620 2023-07-09T02:11:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd5045db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc15e840 con 0x7fd4fc0cd120 2023-07-09T02:11:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd502b78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc15c060 0x7fd4fc15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd501b76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4fc0d2620 0x7fd4fc166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd502377640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4fc0cd120 0x7fd4fc15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd501b76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4fc0d2620 0x7fd4fc166d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:58852/0 (socket says 172.21.15.45:58852) 2023-07-09T02:11:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd501b76640 1 -- 172.21.15.45:0/644310043 learned_addr learned my addr 172.21.15.45:0/644310043 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd502b78640 1 -- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4fc0cd120 msgr2=0x7fd4fc15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd502b78640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4fc0cd120 0x7fd4fc15e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd502b78640 1 -- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4fc0d2620 msgr2=0x7fd4fc166d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd502b78640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4fc0d2620 0x7fd4fc166d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.600+0000 7fd502b78640 1 -- 172.21.15.45:0/644310043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec009420 con 0x7fd4fc15c060 2023-07-09T02:11:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd502b78640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc15c060 0x7fd4fc15ab00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4002240 tx=0x7fd4f400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd4f2ffd640 1 -- 172.21.15.45:0/644310043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400ce30 con 0x7fd4fc15c060 2023-07-09T02:11:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd4f2ffd640 1 -- 172.21.15.45:0/644310043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400a640 con 0x7fd4fc15c060 2023-07-09T02:11:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd4f2ffd640 1 -- 172.21.15.45:0/644310043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400a9f0 con 0x7fd4fc15c060 2023-07-09T02:11:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0b59f0 con 0x7fd4fc15c060 2023-07-09T02:11:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc15ee00 con 0x7fd4fc15c060 2023-07-09T02:11:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc04d7d0 con 0x7fd4fc15c060 2023-07-09T02:11:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd4f2ffd640 1 -- 172.21.15.45:0/644310043 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4f400ab50 con 0x7fd4fc15c060 2023-07-09T02:11:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd4f2ffd640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4e0066280 0x7fd4e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd4f2ffd640 1 -- 172.21.15.45:0/644310043 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4f40831d0 con 0x7fd4fc15c060 2023-07-09T02:11:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.604+0000 7fd502377640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4e0066280 0x7fd4e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.608+0000 7fd502377640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4e0066280 0x7fd4e0068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0b1f20 tx=0x7fd4f8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:49.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.608+0000 7fd4f2ffd640 1 -- 172.21.15.45:0/644310043 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4f40506f0 con 0x7fd4fc15c060 2023-07-09T02:11:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4fc0b89c0 con 0x7fd4fc15c060 2023-07-09T02:11:49.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd4f2ffd640 1 -- 172.21.15.45:0/644310043 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fd4f4053d10 con 0x7fd4fc15c060 2023-07-09T02:11:49.771 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:49.771 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4e0066280 msgr2=0x7fd4e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4e0066280 0x7fd4e0068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0b1f20 tx=0x7fd4f8009060 comp rx=0 tx=0).stop 2023-07-09T02:11:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc15c060 msgr2=0x7fd4fc15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc15c060 0x7fd4fc15ab00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4002240 tx=0x7fd4f400cbe0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 shutdown_connections 2023-07-09T02:11:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4fc15c060 0x7fd4fc15ab00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4fc0d2620 0x7fd4fc166d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4e0066280 0x7fd4e0068730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 --2- 172.21.15.45:0/644310043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4fc0cd120 0x7fd4fc15e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.768+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 >> 172.21.15.45:0/644310043 conn(0x7fd4fc0698e0 msgr2=0x7fd4fc0cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:49.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.772+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 shutdown_connections 2023-07-09T02:11:49.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.772+0000 7fd5045db640 1 -- 172.21.15.45:0/644310043 wait complete. 2023-07-09T02:11:49.793 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:49.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f571069c640 1 Processor -- start 2023-07-09T02:11:49.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f571069c640 1 -- start start 2023-07-09T02:11:49.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f571069c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f570815c060 0x7f57080b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f571069c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57080cd120 0x7f57080d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f571069c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5708160a50 con 0x7f57080d2450 2023-07-09T02:11:49.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f571069c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57080d28f0 con 0x7f57080cd120 2023-07-09T02:11:49.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f571069c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57080cfe40 con 0x7f570815c060 2023-07-09T02:11:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570dc37640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57080cd120 0x7f57080d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570ec39640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f57080d2450 0x7f57080d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45252/0 (socket says 172.21.15.45:45252) 2023-07-09T02:11:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570ec39640 1 -- 172.21.15.45:0/1748798482 learned_addr learned my addr 172.21.15.45:0/1748798482 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570dc37640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57080cd120 0x7f57080d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60946/0 (socket says 172.21.15.45:60946) 2023-07-09T02:11:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570e438640 1 --2- 172.21.15.45:0/1748798482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f570815c060 0x7f57080b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570dc37640 1 -- 172.21.15.45:0/1748798482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f570815c060 msgr2=0x7f57080b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570dc37640 1 --2- 172.21.15.45:0/1748798482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f570815c060 0x7f57080b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570dc37640 1 -- 172.21.15.45:0/1748798482 >> v1:172.21.15.45:6789/0 conn(0x7f57080d2450 legacy=0x7f57080d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.940+0000 7f570dc37640 1 -- 172.21.15.45:0/1748798482 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570815c430 con 0x7f57080cd120 2023-07-09T02:11:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f570dc37640 1 --2- 172.21.15.45:0/1748798482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57080cd120 0x7f57080d1f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f56f80097c0 tx=0x7f56f801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843d9d45414c1822 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f570d436640 1 -- 172.21.15.45:0/1748798482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80ab600 con 0x7f57080cd120 2023-07-09T02:11:49.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f570d436640 1 -- 172.21.15.45:0/1748798482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80a7050 con 0x7f57080cd120 2023-07-09T02:11:49.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f570d436640 1 -- 172.21.15.45:0/1748798482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80ab980 con 0x7f57080cd120 2023-07-09T02:11:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f571069c640 1 -- 172.21.15.45:0/1748798482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57080cd120 msgr2=0x7f57080d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f571069c640 1 --2- 172.21.15.45:0/1748798482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57080cd120 0x7f57080d1f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f56f80097c0 tx=0x7f56f801c450 comp rx=0 tx=0).stop 2023-07-09T02:11:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f571069c640 1 -- 172.21.15.45:0/1748798482 shutdown_connections 2023-07-09T02:11:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f571069c640 1 --2- 172.21.15.45:0/1748798482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57080cd120 0x7f57080d1f10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f571069c640 1 --2- 172.21.15.45:0/1748798482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f570815c060 0x7f57080b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f571069c640 1 -- 172.21.15.45:0/1748798482 >> 172.21.15.45:0/1748798482 conn(0x7f57080698e0 msgr2=0x7f5708069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f571069c640 1 -- 172.21.15.45:0/1748798482 shutdown_connections 2023-07-09T02:11:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.944+0000 7f571069c640 1 -- 172.21.15.45:0/1748798482 wait complete. 2023-07-09T02:11:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 Processor -- start 2023-07-09T02:11:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 -- start start 2023-07-09T02:11:49.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57080cd120 0x7f5708154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57080d2450 0x7f570815d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f570815c060 0x7f570815de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570815f2b0 con 0x7f570815c060 2023-07-09T02:11:49.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570815e6a0 con 0x7f57080d2450 2023-07-09T02:11:49.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570815e980 con 0x7f57080cd120 2023-07-09T02:11:49.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f570815c060 0x7f570815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f570815c060 0x7f570815de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60948/0 (socket says 172.21.15.45:60948) 2023-07-09T02:11:49.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 -- 172.21.15.45:0/679387560 learned_addr learned my addr 172.21.15.45:0/679387560 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:49.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570e438640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57080cd120 0x7f5708154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570dc37640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57080d2450 0x7f570815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 -- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57080cd120 msgr2=0x7f5708154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57080cd120 0x7f5708154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 -- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57080d2450 msgr2=0x7f570815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:49.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57080d2450 0x7f570815d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:49.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 -- 172.21.15.45:0/679387560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f8009420 con 0x7f570815c060 2023-07-09T02:11:49.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f570ec39640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f570815c060 0x7f570815de80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f570000cbc0 tx=0x7f570000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:49.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f56feffd640 1 -- 172.21.15.45:0/679387560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570000ad40 con 0x7f570815c060 2023-07-09T02:11:49.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f56feffd640 1 -- 172.21.15.45:0/679387560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5700012400 con 0x7f570815c060 2023-07-09T02:11:49.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570815ec60 con 0x7f570815c060 2023-07-09T02:11:49.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f56feffd640 1 -- 172.21.15.45:0/679387560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570000aea0 con 0x7f570815c060 2023-07-09T02:11:49.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570815e3c0 con 0x7f570815c060 2023-07-09T02:11:49.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.948+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570815f420 con 0x7f570815c060 2023-07-09T02:11:49.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.952+0000 7f56feffd640 1 -- 172.21.15.45:0/679387560 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5700007070 con 0x7f570815c060 2023-07-09T02:11:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.952+0000 7f56feffd640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f56ec066280 0x7f56ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.952+0000 7f56feffd640 1 -- 172.21.15.45:0/679387560 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5700083bc0 con 0x7f570815c060 2023-07-09T02:11:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.952+0000 7f570e438640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f56ec066280 0x7f56ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:49.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.952+0000 7f570e438640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f56ec066280 0x7f56ec068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57080b8af0 tx=0x7f5704008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:49.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:49.956+0000 7f56feffd640 1 -- 172.21.15.45:0/679387560 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57000510f0 con 0x7f570815c060 2023-07-09T02:11:50.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.108+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f570804d7d0 con 0x7f570815c060 2023-07-09T02:11:50.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f56feffd640 1 -- 172.21.15.45:0/679387560 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57000170a0 con 0x7f570815c060 2023-07-09T02:11:50.114 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f56ec066280 msgr2=0x7f56ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f56ec066280 0x7f56ec068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57080b8af0 tx=0x7f5704008040 comp rx=0 tx=0).stop 2023-07-09T02:11:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f570815c060 msgr2=0x7f570815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f570815c060 0x7f570815de80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f570000cbc0 tx=0x7f570000a430 comp rx=0 tx=0).stop 2023-07-09T02:11:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 shutdown_connections 2023-07-09T02:11:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f570815c060 0x7f570815de80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57080d2450 0x7f570815d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f56ec066280 0x7f56ec068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 --2- 172.21.15.45:0/679387560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57080cd120 0x7f5708154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 >> 172.21.15.45:0/679387560 conn(0x7f57080698e0 msgr2=0x7f5708157520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:50.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 shutdown_connections 2023-07-09T02:11:50.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.112+0000 7f571069c640 1 -- 172.21.15.45:0/679387560 wait complete. 2023-07-09T02:11:50.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:50.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.280+0000 7fc9a03e9640 1 Processor -- start 2023-07-09T02:11:50.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.280+0000 7fc9a03e9640 1 -- start start 2023-07-09T02:11:50.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc9a03e9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc99815c060 0x7fc9980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc9a03e9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc9980d2620 0x7fc9980cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc9a03e9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc998160a50 con 0x7fc9980cd120 2023-07-09T02:11:50.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc9a03e9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99815c430 con 0x7fc99815c060 2023-07-09T02:11:50.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc9a03e9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99815fb60 con 0x7fc9980d2620 2023-07-09T02:11:50.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99e185640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc99815c060 0x7fc9980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99d984640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc9980cd120 0x7fc9980d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45254/0 (socket says 172.21.15.45:45254) 2023-07-09T02:11:50.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99d984640 1 -- 172.21.15.45:0/1572111582 learned_addr learned my addr 172.21.15.45:0/1572111582 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99e986640 1 --2- 172.21.15.45:0/1572111582 >> v2:172.21.15.155:3300/0 conn(0x7fc9980d2620 0x7fc9980cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99e185640 1 -- 172.21.15.45:0/1572111582 >> v2:172.21.15.155:3300/0 conn(0x7fc9980d2620 msgr2=0x7fc9980cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99e185640 1 --2- 172.21.15.45:0/1572111582 >> v2:172.21.15.155:3300/0 conn(0x7fc9980d2620 0x7fc9980cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99e185640 1 -- 172.21.15.45:0/1572111582 >> v1:172.21.15.45:6789/0 conn(0x7fc9980cd120 legacy=0x7fc9980d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99e185640 1 -- 172.21.15.45:0/1572111582 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99815fe40 con 0x7fc99815c060 2023-07-09T02:11:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99e986640 1 --2- 172.21.15.45:0/1572111582 >> v2:172.21.15.155:3300/0 conn(0x7fc9980d2620 0x7fc9980cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99d183640 1 -- 172.21.15.45:0/1572111582 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147450334 0 0) 0x7fc998160a50 con 0x7fc9980cd120 2023-07-09T02:11:50.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99e185640 1 --2- 172.21.15.45:0/1572111582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc9980b4ed0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc99808bca0 tx=0x7fc99401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26a6ea94968e6d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99d183640 1 -- 172.21.15.45:0/1572111582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940a7070 con 0x7fc99815c060 2023-07-09T02:11:50.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.284+0000 7fc99d183640 1 -- 172.21.15.45:0/1572111582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9940ab430 con 0x7fc99815c060 2023-07-09T02:11:50.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc99d183640 1 -- 172.21.15.45:0/1572111582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940ab7c0 con 0x7fc99815c060 2023-07-09T02:11:50.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1572111582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 msgr2=0x7fc9980b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1572111582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc9980b4ed0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc99808bca0 tx=0x7fc99401c430 comp rx=0 tx=0).stop 2023-07-09T02:11:50.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1572111582 shutdown_connections 2023-07-09T02:11:50.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1572111582 >> v2:172.21.15.155:3300/0 conn(0x7fc9980d2620 0x7fc9980cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1572111582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc9980b4ed0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1572111582 >> 172.21.15.45:0/1572111582 conn(0x7fc9980698e0 msgr2=0x7fc998069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:50.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1572111582 shutdown_connections 2023-07-09T02:11:50.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1572111582 wait complete. 2023-07-09T02:11:50.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 Processor -- start 2023-07-09T02:11:50.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- start start 2023-07-09T02:11:50.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9980cd120 0x7fc998150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9980d2620 0x7fc99814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc998151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998150d30 con 0x7fc99815c060 2023-07-09T02:11:50.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998151010 con 0x7fc9980d2620 2023-07-09T02:11:50.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc9a03e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9981512f0 con 0x7fc9980cd120 2023-07-09T02:11:50.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc99e986640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc998151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc99e986640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc998151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60962/0 (socket says 172.21.15.45:60962) 2023-07-09T02:11:50.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc99e986640 1 -- 172.21.15.45:0/1954256223 learned_addr learned my addr 172.21.15.45:0/1954256223 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:50.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc99d984640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9980d2620 0x7fc99814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.288+0000 7fc99e185640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9980cd120 0x7fc998150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc99e986640 1 -- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9980cd120 msgr2=0x7fc998150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc99e986640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9980cd120 0x7fc998150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc99e986640 1 -- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9980d2620 msgr2=0x7fc99814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc99e986640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9980d2620 0x7fc99814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc99e986640 1 -- 172.21.15.45:0/1954256223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994009420 con 0x7fc99815c060 2023-07-09T02:11:50.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc99e986640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc998151ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc99000ce70 tx=0x7fc99000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc98effd640 1 -- 172.21.15.45:0/1954256223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990003ba0 con 0x7fc99815c060 2023-07-09T02:11:50.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc98effd640 1 -- 172.21.15.45:0/1954256223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990003d20 con 0x7fc99815c060 2023-07-09T02:11:50.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc98effd640 1 -- 172.21.15.45:0/1954256223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99000d880 con 0x7fc99815c060 2023-07-09T02:11:50.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9980b59f0 con 0x7fc99815c060 2023-07-09T02:11:50.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9981518b0 con 0x7fc99815c060 2023-07-09T02:11:50.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99804d7d0 con 0x7fc99815c060 2023-07-09T02:11:50.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.292+0000 7fc98effd640 1 -- 172.21.15.45:0/1954256223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc99000d9e0 con 0x7fc99815c060 2023-07-09T02:11:50.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.296+0000 7fc98effd640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc97c066280 0x7fc97c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.296+0000 7fc98effd640 1 -- 172.21.15.45:0/1954256223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9900845a0 con 0x7fc99815c060 2023-07-09T02:11:50.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.296+0000 7fc99e185640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc97c066280 0x7fc97c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.296+0000 7fc99e185640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc97c066280 0x7fc97c068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9940af000 tx=0x7fc9940a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.300+0000 7fc98effd640 1 -- 172.21.15.45:0/1954256223 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc990051ac0 con 0x7fc99815c060 2023-07-09T02:11:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.452+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc99806baa0 con 0x7fc99815c060 2023-07-09T02:11:50.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc98effd640 1 -- 172.21.15.45:0/1954256223 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9900550e0 con 0x7fc99815c060 2023-07-09T02:11:50.457 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc97c066280 msgr2=0x7fc97c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc97c066280 0x7fc97c068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9940af000 tx=0x7fc9940a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 msgr2=0x7fc998151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc998151ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc99000ce70 tx=0x7fc99000a710 comp rx=0 tx=0).stop 2023-07-09T02:11:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 shutdown_connections 2023-07-09T02:11:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc99815c060 0x7fc998151ef0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9980d2620 0x7fc99814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc97c066280 0x7fc97c068730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 --2- 172.21.15.45:0/1954256223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9980cd120 0x7fc998150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 >> 172.21.15.45:0/1954256223 conn(0x7fc9980698e0 msgr2=0x7fc9980b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 shutdown_connections 2023-07-09T02:11:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.456+0000 7fc9a03e9640 1 -- 172.21.15.45:0/1954256223 wait complete. 2023-07-09T02:11:50.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.620+0000 7f357c759640 1 Processor -- start 2023-07-09T02:11:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357c759640 1 -- start start 2023-07-09T02:11:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357c759640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f357415c060 0x7f35740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357c759640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35740d2620 0x7f35740cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357c759640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3574160a50 con 0x7f35740cd120 2023-07-09T02:11:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357c759640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357415c430 con 0x7f35740d2620 2023-07-09T02:11:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357c759640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357415fb60 con 0x7f357415c060 2023-07-09T02:11:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357acf6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35740d2620 0x7f35740cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357acf6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35740d2620 0x7f35740cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60966/0 (socket says 172.21.15.45:60966) 2023-07-09T02:11:50.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357acf6640 1 -- 172.21.15.45:0/4208112461 learned_addr learned my addr 172.21.15.45:0/4208112461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357a4f5640 1 --2- 172.21.15.45:0/4208112461 >> v2:172.21.15.155:3300/0 conn(0x7f357415c060 0x7f35740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357acf6640 1 -- 172.21.15.45:0/4208112461 >> v2:172.21.15.155:3300/0 conn(0x7f357415c060 msgr2=0x7f35740b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357acf6640 1 --2- 172.21.15.45:0/4208112461 >> v2:172.21.15.155:3300/0 conn(0x7f357415c060 0x7f35740b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357acf6640 1 -- 172.21.15.45:0/4208112461 >> v1:172.21.15.155:6789/0 conn(0x7f35740cd120 legacy=0x7f35740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.624+0000 7f357acf6640 1 -- 172.21.15.45:0/4208112461 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357415fe40 con 0x7f35740d2620 2023-07-09T02:11:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357acf6640 1 --2- 172.21.15.45:0/4208112461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35740d2620 0x7f35740cee30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f35740d3ad0 tx=0x7f356c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6c74af771464f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f35794f3640 1 -- 172.21.15.45:0/4208112461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0a5860 con 0x7f35740d2620 2023-07-09T02:11:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f35794f3640 1 -- 172.21.15.45:0/4208112461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0a59c0 con 0x7f35740d2620 2023-07-09T02:11:50.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f35794f3640 1 -- 172.21.15.45:0/4208112461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0a5d50 con 0x7f35740d2620 2023-07-09T02:11:50.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 -- 172.21.15.45:0/4208112461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35740d2620 msgr2=0x7f35740cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 --2- 172.21.15.45:0/4208112461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35740d2620 0x7f35740cee30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f35740d3ad0 tx=0x7f356c01c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 -- 172.21.15.45:0/4208112461 shutdown_connections 2023-07-09T02:11:50.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 --2- 172.21.15.45:0/4208112461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35740d2620 0x7f35740cee30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 --2- 172.21.15.45:0/4208112461 >> v2:172.21.15.155:3300/0 conn(0x7f357415c060 0x7f35740b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 -- 172.21.15.45:0/4208112461 >> 172.21.15.45:0/4208112461 conn(0x7f35740698e0 msgr2=0x7f3574069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 -- 172.21.15.45:0/4208112461 shutdown_connections 2023-07-09T02:11:50.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 -- 172.21.15.45:0/4208112461 wait complete. 2023-07-09T02:11:50.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 Processor -- start 2023-07-09T02:11:50.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.628+0000 7f357c759640 1 -- start start 2023-07-09T02:11:50.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35740cd120 0x7f35740c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35740d2620 0x7f35741590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f357415c060 0x7f357415d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357415ab80 con 0x7f357415c060 2023-07-09T02:11:50.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3574159ae0 con 0x7f35740d2620 2023-07-09T02:11:50.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3574159dc0 con 0x7f35740cd120 2023-07-09T02:11:50.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f357415c060 0x7f357415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f357415c060 0x7f357415d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60974/0 (socket says 172.21.15.45:60974) 2023-07-09T02:11:50.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 -- 172.21.15.45:0/1845923974 learned_addr learned my addr 172.21.15.45:0/1845923974 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:50.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 -- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35740cd120 msgr2=0x7f35740c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35740cd120 0x7f35740c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 -- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35740d2620 msgr2=0x7f35741590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35740d2620 0x7f35741590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 -- 172.21.15.45:0/1845923974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c009b30 con 0x7f357415c060 2023-07-09T02:11:50.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357acf6640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f357415c060 0x7f357415d260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f356c0af040 tx=0x7f356c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f356affd640 1 -- 172.21.15.45:0/1845923974 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0b8670 con 0x7f357415c060 2023-07-09T02:11:50.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f356affd640 1 -- 172.21.15.45:0/1845923974 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0b87d0 con 0x7f357415c060 2023-07-09T02:11:50.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35740b59f0 con 0x7f357415c060 2023-07-09T02:11:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f356affd640 1 -- 172.21.15.45:0/1845923974 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0b8b60 con 0x7f357415c060 2023-07-09T02:11:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357415a380 con 0x7f357415c060 2023-07-09T02:11:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357404d7d0 con 0x7f357415c060 2023-07-09T02:11:50.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.632+0000 7f356affd640 1 -- 172.21.15.45:0/1845923974 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f356c0b8cc0 con 0x7f357415c060 2023-07-09T02:11:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.636+0000 7f356affd640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3558066280 0x7f3558068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.636+0000 7f356affd640 1 -- 172.21.15.45:0/1845923974 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f356c11f3a0 con 0x7f357415c060 2023-07-09T02:11:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.636+0000 7f357a4f5640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3558066280 0x7f3558068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.636+0000 7f357a4f5640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3558066280 0x7f3558068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3570006aa0 tx=0x7f3570006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.640+0000 7f356affd640 1 -- 172.21.15.45:0/1845923974 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f356c0ec8d0 con 0x7f357415c060 2023-07-09T02:11:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f357406baa0 con 0x7f357415c060 2023-07-09T02:11:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f356affd640 1 -- 172.21.15.45:0/1845923974 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f356c0efef0 con 0x7f357415c060 2023-07-09T02:11:50.795 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3558066280 msgr2=0x7f3558068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3558066280 0x7f3558068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3570006aa0 tx=0x7f3570006a30 comp rx=0 tx=0).stop 2023-07-09T02:11:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f357415c060 msgr2=0x7f357415d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f357415c060 0x7f357415d260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f356c0af040 tx=0x7f356c019740 comp rx=0 tx=0).stop 2023-07-09T02:11:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 shutdown_connections 2023-07-09T02:11:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f357415c060 0x7f357415d260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35740d2620 0x7f35741590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3558066280 0x7f3558068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 --2- 172.21.15.45:0/1845923974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35740cd120 0x7f35740c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 >> 172.21.15.45:0/1845923974 conn(0x7f35740698e0 msgr2=0x7f357415b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.792+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 shutdown_connections 2023-07-09T02:11:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.796+0000 7f357c759640 1 -- 172.21.15.45:0/1845923974 wait complete. 2023-07-09T02:11:50.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bf85c640 1 Processor -- start 2023-07-09T02:11:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bf85c640 1 -- start start 2023-07-09T02:11:50.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bf85c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b815c060 0x7f01b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bf85c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f01b80cd120 0x7f01b80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bf85c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b8160a50 con 0x7f01b80d2450 2023-07-09T02:11:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bf85c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b80d28f0 con 0x7f01b80cd120 2023-07-09T02:11:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bf85c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80cfe40 con 0x7f01b815c060 2023-07-09T02:11:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bddf9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f01b80d2450 0x7f01b80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45262/0 (socket says 172.21.15.45:45262) 2023-07-09T02:11:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bddf9640 1 -- 172.21.15.45:0/1024682655 learned_addr learned my addr 172.21.15.45:0/1024682655 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bd5f8640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b815c060 0x7f01b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526789923 0 0) 0x7f01b8160a50 con 0x7f01b80d2450 2023-07-09T02:11:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01bcdf7640 1 --2- 172.21.15.45:0/1024682655 >> v2:172.21.15.155:3300/0 conn(0x7f01b80cd120 0x7f01b80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.960+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a4003530 con 0x7f01b80d2450 2023-07-09T02:11:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1944673824 0 0) 0x7f01a4003530 con 0x7f01b80d2450 2023-07-09T02:11:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b815c060 msgr2=0x7f01b80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b815c060 0x7f01b80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 >> v2:172.21.15.155:3300/0 conn(0x7f01b80cd120 msgr2=0x7f01b80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 --2- 172.21.15.45:0/1024682655 >> v2:172.21.15.155:3300/0 conn(0x7f01b80cd120 0x7f01b80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b815c430 con 0x7f01b80d2450 2023-07-09T02:11:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f01b0001a00 con 0x7f01b80d2450 2023-07-09T02:11:50.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 >> v1:172.21.15.45:6789/0 conn(0x7f01b80d2450 legacy=0x7f01b80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a40043b0 0x7f01a4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b815c060 0x7f01a4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80cfe40 con 0x7f01a4003980 2023-07-09T02:11:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4005680 con 0x7f01a40043b0 2023-07-09T02:11:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a400ba10 con 0x7f01b815c060 2023-07-09T02:11:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bd5f8640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bcdf7640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a40043b0 0x7f01a4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bddf9640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b815c060 0x7f01a4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bd5f8640 1 -- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b815c060 msgr2=0x7f01a4004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bd5f8640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b815c060 0x7f01a4004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bd5f8640 1 -- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a40043b0 msgr2=0x7f01a4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bd5f8640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a40043b0 0x7f01a4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bd5f8640 1 -- 172.21.15.45:0/1024682655 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a4003530 con 0x7f01a4003980 2023-07-09T02:11:50.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.964+0000 7f01bd5f8640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01a4003d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009ae0 tx=0x7f01b401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94b2251824b71e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b40a5610 con 0x7f01a4003980 2023-07-09T02:11:50.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b40a5770 con 0x7f01a4003980 2023-07-09T02:11:50.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01affff640 1 -- 172.21.15.45:0/1024682655 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b40a5b20 con 0x7f01a4003980 2023-07-09T02:11:50.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- 172.21.15.45:0/1024682655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 msgr2=0x7f01a4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 --2- 172.21.15.45:0/1024682655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01a4003d90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009ae0 tx=0x7f01b401ca20 comp rx=0 tx=0).stop 2023-07-09T02:11:50.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bddf9640 1 -- 172.21.15.45:0/1024682655 reap_dead start 2023-07-09T02:11:50.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- 172.21.15.45:0/1024682655 shutdown_connections 2023-07-09T02:11:50.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- 172.21.15.45:0/1024682655 >> 172.21.15.45:0/1024682655 conn(0x7f01b80698e0 msgr2=0x7f01b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:50.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- 172.21.15.45:0/1024682655 shutdown_connections 2023-07-09T02:11:50.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- 172.21.15.45:0/1024682655 wait complete. 2023-07-09T02:11:50.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 Processor -- start 2023-07-09T02:11:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- start start 2023-07-09T02:11:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01b815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b814f2f0 0x7f01b814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b80a9fc0 0x7f01b80aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b81f44f0 con 0x7f01a4003980 2023-07-09T02:11:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8150930 con 0x7f01b80a9fc0 2023-07-09T02:11:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bf85c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80aa980 con 0x7f01b814f2f0 2023-07-09T02:11:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bd5f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01b815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bd5f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01b815a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60990/0 (socket says 172.21.15.45:60990) 2023-07-09T02:11:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.968+0000 7f01bd5f8640 1 -- 172.21.15.45:0/3856343013 learned_addr learned my addr 172.21.15.45:0/3856343013 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bddf9640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b80a9fc0 0x7f01b80aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bcdf7640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b814f2f0 0x7f01b814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bd5f8640 1 -- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b814f2f0 msgr2=0x7f01b814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bd5f8640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b814f2f0 0x7f01b814f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bd5f8640 1 -- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b80a9fc0 msgr2=0x7f01b80aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bd5f8640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b80a9fc0 0x7f01b80aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bd5f8640 1 -- 172.21.15.45:0/3856343013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b81f7830 con 0x7f01a4003980 2023-07-09T02:11:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bd5f8640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01b815a1c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f01b401cf00 tx=0x7f01a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01adffb640 1 -- 172.21.15.45:0/3856343013 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4004020 con 0x7f01a4003980 2023-07-09T02:11:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01adffb640 1 -- 172.21.15.45:0/3856343013 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b40041a0 con 0x7f01a4003980 2023-07-09T02:11:50.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b814fdb0 con 0x7f01a4003980 2023-07-09T02:11:50.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01adffb640 1 -- 172.21.15.45:0/3856343013 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4003620 con 0x7f01a4003980 2023-07-09T02:11:50.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b8150370 con 0x7f01a4003980 2023-07-09T02:11:50.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b80d2280 con 0x7f01a4003980 2023-07-09T02:11:50.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01adffb640 1 -- 172.21.15.45:0/3856343013 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01b40b4040 con 0x7f01a4003980 2023-07-09T02:11:50.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.972+0000 7f01adffb640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f019c066280 0x7f019c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:50.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.976+0000 7f01adffb640 1 -- 172.21.15.45:0/3856343013 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01b411e240 con 0x7f01a4003980 2023-07-09T02:11:50.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.976+0000 7f01bcdf7640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f019c066280 0x7f019c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:50.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.976+0000 7f01bcdf7640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f019c066280 0x7f019c068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f01b80cd570 tx=0x7f01a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:50.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:50.976+0000 7f01adffb640 1 -- 172.21.15.45:0/3856343013 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01b40eb7f0 con 0x7f01a4003980 2023-07-09T02:11:51.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.132+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01b81603d0 con 0x7f01a4003980 2023-07-09T02:11:51.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.132+0000 7f01adffb640 1 -- 172.21.15.45:0/3856343013 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01b40eee10 con 0x7f01a4003980 2023-07-09T02:11:51.136 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:51.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f019c066280 msgr2=0x7f019c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f019c066280 0x7f019c068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f01b80cd570 tx=0x7f01a8008040 comp rx=0 tx=0).stop 2023-07-09T02:11:51.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 msgr2=0x7f01b815a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01b815a1c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f01b401cf00 tx=0x7f01a4005800 comp rx=0 tx=0).stop 2023-07-09T02:11:51.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 shutdown_connections 2023-07-09T02:11:51.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b80a9fc0 0x7f01b80aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f019c066280 0x7f019c068730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b814f2f0 0x7f01b814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 --2- 172.21.15.45:0/3856343013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01a4003980 0x7f01b815a1c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 >> 172.21.15.45:0/3856343013 conn(0x7f01b80698e0 msgr2=0x7f01b80b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:51.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 shutdown_connections 2023-07-09T02:11:51.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.136+0000 7f01bf85c640 1 -- 172.21.15.45:0/3856343013 wait complete. 2023-07-09T02:11:51.157 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:11:51.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f461429c640 1 Processor -- start 2023-07-09T02:11:51.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f461429c640 1 -- start start 2023-07-09T02:11:51.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f461429c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f460c15c060 0x7f460c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f461429c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f460c0cd120 0x7f460c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f461429c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0d2450 0x7f460c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f461429c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c0d28f0 con 0x7f460c15c060 2023-07-09T02:11:51.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f461429c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c160a50 con 0x7f460c0cd120 2023-07-09T02:11:51.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f461429c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c15c430 con 0x7f460c0d2450 2023-07-09T02:11:51.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612038640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f460c15c060 0x7f460c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612038640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f460c15c060 0x7f460c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60994/0 (socket says 172.21.15.45:60994) 2023-07-09T02:11:51.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612038640 1 -- 172.21.15.45:0/2980385941 learned_addr learned my addr 172.21.15.45:0/2980385941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:51.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612839640 1 --2- 172.21.15.45:0/2980385941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0d2450 0x7f460c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4611837640 1 --2- 172.21.15.45:0/2980385941 >> v2:172.21.15.155:3300/0 conn(0x7f460c0cd120 0x7f460c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612038640 1 -- 172.21.15.45:0/2980385941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0d2450 msgr2=0x7f460c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:51.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612038640 1 --2- 172.21.15.45:0/2980385941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0d2450 0x7f460c0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612038640 1 -- 172.21.15.45:0/2980385941 >> v2:172.21.15.155:3300/0 conn(0x7f460c0cd120 msgr2=0x7f460c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:51.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612038640 1 --2- 172.21.15.45:0/2980385941 >> v2:172.21.15.155:3300/0 conn(0x7f460c0cd120 0x7f460c0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.300+0000 7f4612038640 1 -- 172.21.15.45:0/2980385941 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c15fb60 con 0x7f460c15c060 2023-07-09T02:11:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f4612038640 1 --2- 172.21.15.45:0/2980385941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c0b4ed0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f460c15fac0 tx=0x7f460801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439cbcc83fea35c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f4611036640 1 -- 172.21.15.45:0/2980385941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080ab600 con 0x7f460c15c060 2023-07-09T02:11:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f4611036640 1 -- 172.21.15.45:0/2980385941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46080a7050 con 0x7f460c15c060 2023-07-09T02:11:51.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f4611036640 1 -- 172.21.15.45:0/2980385941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080ab980 con 0x7f460c15c060 2023-07-09T02:11:51.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 -- 172.21.15.45:0/2980385941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 msgr2=0x7f460c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 --2- 172.21.15.45:0/2980385941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c0b4ed0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f460c15fac0 tx=0x7f460801c210 comp rx=0 tx=0).stop 2023-07-09T02:11:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 -- 172.21.15.45:0/2980385941 shutdown_connections 2023-07-09T02:11:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 --2- 172.21.15.45:0/2980385941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0d2450 0x7f460c0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 --2- 172.21.15.45:0/2980385941 >> v2:172.21.15.155:3300/0 conn(0x7f460c0cd120 0x7f460c0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 --2- 172.21.15.45:0/2980385941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c0b4ed0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 -- 172.21.15.45:0/2980385941 >> 172.21.15.45:0/2980385941 conn(0x7f460c0698e0 msgr2=0x7f460c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 -- 172.21.15.45:0/2980385941 shutdown_connections 2023-07-09T02:11:51.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.304+0000 7f461429c640 1 -- 172.21.15.45:0/2980385941 wait complete. 2023-07-09T02:11:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 Processor -- start 2023-07-09T02:11:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 -- start start 2023-07-09T02:11:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0cd120 0x7f460c0cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f460c0d2450 0x7f460c15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c15b180 con 0x7f460c15c060 2023-07-09T02:11:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c15a7b0 con 0x7f460c0d2450 2023-07-09T02:11:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c1598d0 con 0x7f460c0cd120 2023-07-09T02:11:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60996/0 (socket says 172.21.15.45:60996) 2023-07-09T02:11:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 -- 172.21.15.45:0/2512576733 learned_addr learned my addr 172.21.15.45:0/2512576733 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:51.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612038640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0cd120 0x7f460c0cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4611837640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f460c0d2450 0x7f460c15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 -- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0cd120 msgr2=0x7f460c0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0cd120 0x7f460c0cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 -- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f460c0d2450 msgr2=0x7f460c15ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f460c0d2450 0x7f460c15ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 -- 172.21.15.45:0/2512576733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080094d0 con 0x7f460c15c060 2023-07-09T02:11:51.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4612839640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c159390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4604007e40 tx=0x7f460400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:51.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4602ffd640 1 -- 172.21.15.45:0/2512576733 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604014620 con 0x7f460c15c060 2023-07-09T02:11:51.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4602ffd640 1 -- 172.21.15.45:0/2512576733 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460400ee90 con 0x7f460c15c060 2023-07-09T02:11:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f4602ffd640 1 -- 172.21.15.45:0/2512576733 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46040149e0 con 0x7f460c15c060 2023-07-09T02:11:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c159ba0 con 0x7f460c15c060 2023-07-09T02:11:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.308+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c15a160 con 0x7f460c15c060 2023-07-09T02:11:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.312+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c15a960 con 0x7f460c15c060 2023-07-09T02:11:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.312+0000 7f4602ffd640 1 -- 172.21.15.45:0/2512576733 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4604014b40 con 0x7f460c15c060 2023-07-09T02:11:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.312+0000 7f4602ffd640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45f00662b0 0x7f45f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.312+0000 7f4602ffd640 1 -- 172.21.15.45:0/2512576733 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46040846a0 con 0x7f460c15c060 2023-07-09T02:11:51.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.312+0000 7f4612038640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45f00662b0 0x7f45f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.312+0000 7f4612038640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45f00662b0 0x7f45f0068760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46080ad000 tx=0x7f46080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:51.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.316+0000 7f4602ffd640 1 -- 172.21.15.45:0/2512576733 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f460c15a960 con 0x7f460c15c060 2023-07-09T02:11:51.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.480+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f460c15a920 con 0x7f460c15c060 2023-07-09T02:11:51.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.480+0000 7f4602ffd640 1 -- 172.21.15.45:0/2512576733 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4604055530 con 0x7f460c15c060 2023-07-09T02:11:51.484 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:11:51.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45f00662b0 msgr2=0x7f45f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45f00662b0 0x7f45f0068760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46080ad000 tx=0x7f46080a6000 comp rx=0 tx=0).stop 2023-07-09T02:11:51.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 msgr2=0x7f460c159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c159390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4604007e40 tx=0x7f460400e4b0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 shutdown_connections 2023-07-09T02:11:51.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f460c15c060 0x7f460c159390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f460c0d2450 0x7f460c15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45f00662b0 0x7f45f0068760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 --2- 172.21.15.45:0/2512576733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f460c0cd120 0x7f460c0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 >> 172.21.15.45:0/2512576733 conn(0x7f460c0698e0 msgr2=0x7f460c0b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 shutdown_connections 2023-07-09T02:11:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.484+0000 7f461429c640 1 -- 172.21.15.45:0/2512576733 wait complete. 2023-07-09T02:11:51.505 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:11:51.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:51.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-09T02:11:51.569 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:11:51.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:51.571 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:11:51.592 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:51.592 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:51.604 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:51.604 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:51.656 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:51.656 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:51.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.848+0000 7f9014559640 1 Processor -- start 2023-07-09T02:11:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.848+0000 7f9014559640 1 -- start start 2023-07-09T02:11:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.848+0000 7f9014559640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f900c0ca0f0 0x7f900c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.848+0000 7f9014559640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f900c0cbbb0 0x7f900c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.848+0000 7f9014559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 0x7f900c15db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.848+0000 7f9014559640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c06bf30 con 0x7f900c0ca0f0 2023-07-09T02:11:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.848+0000 7f9014559640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c06bc50 con 0x7f900c0cbbb0 2023-07-09T02:11:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.848+0000 7f9014559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0cab90 con 0x7f900c0c9250 2023-07-09T02:11:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f900c0ca0f0 0x7f900c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f900c0ca0f0 0x7f900c0cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36358/0 (socket says 172.21.15.45:36358) 2023-07-09T02:11:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 -- 172.21.15.45:0/1166747145 learned_addr learned my addr 172.21.15.45:0/1166747145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f9012af6640 1 --2- 172.21.15.45:0/1166747145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 0x7f900c15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f9011af4640 1 --2- 172.21.15.45:0/1166747145 >> v2:172.21.15.155:3300/0 conn(0x7f900c0cbbb0 0x7f900c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 -- 172.21.15.45:0/1166747145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 msgr2=0x7f900c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 --2- 172.21.15.45:0/1166747145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 0x7f900c15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 -- 172.21.15.45:0/1166747145 >> v2:172.21.15.155:3300/0 conn(0x7f900c0cbbb0 msgr2=0x7f900c0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 --2- 172.21.15.45:0/1166747145 >> v2:172.21.15.155:3300/0 conn(0x7f900c0cbbb0 0x7f900c0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 -- 172.21.15.45:0/1166747145 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c0cae70 con 0x7f900c0ca0f0 2023-07-09T02:11:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90122f5640 1 --2- 172.21.15.45:0/1166747145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c0cb670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f900c06ebb0 tx=0x7f900801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecba7fcc5d525b93 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90112f3640 1 -- 172.21.15.45:0/1166747145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080ab600 con 0x7f900c0ca0f0 2023-07-09T02:11:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90112f3640 1 -- 172.21.15.45:0/1166747145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080a7050 con 0x7f900c0ca0f0 2023-07-09T02:11:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.852+0000 7f90112f3640 1 -- 172.21.15.45:0/1166747145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080ab980 con 0x7f900c0ca0f0 2023-07-09T02:11:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- 172.21.15.45:0/1166747145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 msgr2=0x7f900c0cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 --2- 172.21.15.45:0/1166747145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c0cb670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f900c06ebb0 tx=0x7f900801c470 comp rx=0 tx=0).stop 2023-07-09T02:11:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- 172.21.15.45:0/1166747145 shutdown_connections 2023-07-09T02:11:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 --2- 172.21.15.45:0/1166747145 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 0x7f900c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 --2- 172.21.15.45:0/1166747145 >> v2:172.21.15.155:3300/0 conn(0x7f900c0cbbb0 0x7f900c0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 --2- 172.21.15.45:0/1166747145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c0cb670 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- 172.21.15.45:0/1166747145 >> 172.21.15.45:0/1166747145 conn(0x7f900c0694b0 msgr2=0x7f900c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- 172.21.15.45:0/1166747145 shutdown_connections 2023-07-09T02:11:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- 172.21.15.45:0/1166747145 wait complete. 2023-07-09T02:11:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 Processor -- start 2023-07-09T02:11:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- start start 2023-07-09T02:11:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 0x7f900c149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f900c0cbbb0 0x7f900c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c14a760 con 0x7f900c0ca0f0 2023-07-09T02:11:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c14aa40 con 0x7f900c0cbbb0 2023-07-09T02:11:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9014559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c14ad20 con 0x7f900c0c9250 2023-07-09T02:11:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9011af4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9011af4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36374/0 (socket says 172.21.15.45:36374) 2023-07-09T02:11:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9011af4640 1 -- 172.21.15.45:0/4046349292 learned_addr learned my addr 172.21.15.45:0/4046349292 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f90122f5640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 0x7f900c149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9012af6640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f900c0cbbb0 0x7f900c14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9011af4640 1 -- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 msgr2=0x7f900c149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9011af4640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 0x7f900c149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9011af4640 1 -- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f900c0cbbb0 msgr2=0x7f900c14eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9011af4640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f900c0cbbb0 0x7f900c14eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9011af4640 1 -- 172.21.15.45:0/4046349292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90080094d0 con 0x7f900c0ca0f0 2023-07-09T02:11:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.856+0000 7f9012af6640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f900c0cbbb0 0x7f900c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9011af4640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c149f10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00d5f0 tx=0x7f8ffc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9002ffd640 1 -- 172.21.15.45:0/4046349292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0125f0 con 0x7f900c0ca0f0 2023-07-09T02:11:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9002ffd640 1 -- 172.21.15.45:0/4046349292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc012750 con 0x7f900c0ca0f0 2023-07-09T02:11:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9002ffd640 1 -- 172.21.15.45:0/4046349292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc012ae0 con 0x7f900c0ca0f0 2023-07-09T02:11:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c14b000 con 0x7f900c0ca0f0 2023-07-09T02:11:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c14a450 con 0x7f900c0ca0f0 2023-07-09T02:11:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c04d7d0 con 0x7f900c0ca0f0 2023-07-09T02:11:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9002ffd640 1 -- 172.21.15.45:0/4046349292 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ffc012c40 con 0x7f900c0ca0f0 2023-07-09T02:11:51.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9002ffd640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ff0066280 0x7f8ff0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:51.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f9002ffd640 1 -- 172.21.15.45:0/4046349292 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ffc0841c0 con 0x7f900c0ca0f0 2023-07-09T02:11:51.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.860+0000 7f90122f5640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ff0066280 0x7f8ff0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:51.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.864+0000 7f90122f5640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ff0066280 0x7f8ff0068730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f900c06c0c0 tx=0x7f90080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:51.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:51.864+0000 7f9002ffd640 1 -- 172.21.15.45:0/4046349292 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ffc0515a0 con 0x7f900c0ca0f0 2023-07-09T02:11:52.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.020+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f900c0b10f0 con 0x7f900c0ca0f0 2023-07-09T02:11:52.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.020+0000 7f9002ffd640 1 -- 172.21.15.45:0/4046349292 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f8ffc007380 con 0x7f900c0ca0f0 2023-07-09T02:11:52.024 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:52.024 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:52.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ff0066280 msgr2=0x7f8ff0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ff0066280 0x7f8ff0068730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f900c06c0c0 tx=0x7f90080a6000 comp rx=0 tx=0).stop 2023-07-09T02:11:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 msgr2=0x7f900c149f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c149f10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00d5f0 tx=0x7f8ffc00dab0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 shutdown_connections 2023-07-09T02:11:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f900c0cbbb0 0x7f900c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f900c0ca0f0 0x7f900c149f10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ff0066280 0x7f8ff0068730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 --2- 172.21.15.45:0/4046349292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f900c0c9250 0x7f900c149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 >> 172.21.15.45:0/4046349292 conn(0x7f900c0694b0 msgr2=0x7f900c15a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:52.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 shutdown_connections 2023-07-09T02:11:52.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.024+0000 7f9014559640 1 -- 172.21.15.45:0/4046349292 wait complete. 2023-07-09T02:11:52.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:52.046 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:52.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.188+0000 7fdfdda47640 1 Processor -- start 2023-07-09T02:11:52.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.188+0000 7fdfdda47640 1 -- start start 2023-07-09T02:11:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdda47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80b1bc0 0x7fdfd8069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdda47640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdfd80d2400 0x7fdfd8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdda47640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdfd80ccf10 0x7fdfd8070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdda47640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd80cea70 con 0x7fdfd80ccf10 2023-07-09T02:11:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdda47640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd80b1f90 con 0x7fdfd80d2400 2023-07-09T02:11:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdda47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80ceff0 con 0x7fdfd80b1bc0 2023-07-09T02:11:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdd246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdfd80ccf10 0x7fdfd8070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdd246640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdfd80ccf10 0x7fdfd8070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36382/0 (socket says 172.21.15.45:36382) 2023-07-09T02:11:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdd246640 1 -- 172.21.15.45:0/4177890417 learned_addr learned my addr 172.21.15.45:0/4177890417 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfd7fff640 1 --2- 172.21.15.45:0/4177890417 >> v2:172.21.15.155:3300/0 conn(0x7fdfd80d2400 0x7fdfd8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdca45640 1 --2- 172.21.15.45:0/4177890417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80b1bc0 0x7fdfd8069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdd246640 1 -- 172.21.15.45:0/4177890417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80b1bc0 msgr2=0x7fdfd8069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:52.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdd246640 1 --2- 172.21.15.45:0/4177890417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80b1bc0 0x7fdfd8069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdd246640 1 -- 172.21.15.45:0/4177890417 >> v2:172.21.15.155:3300/0 conn(0x7fdfd80d2400 msgr2=0x7fdfd8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:52.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdd246640 1 --2- 172.21.15.45:0/4177890417 >> v2:172.21.15.155:3300/0 conn(0x7fdfd80d2400 0x7fdfd8069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.192+0000 7fdfdd246640 1 -- 172.21.15.45:0/4177890417 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80d1500 con 0x7fdfd80ccf10 2023-07-09T02:11:52.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdd246640 1 --2- 172.21.15.45:0/4177890417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80ccf10 0x7fdfd8070be0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdfd806c5f0 tx=0x7fdfd001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc491dcef766ecdf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfd77fe640 1 -- 172.21.15.45:0/4177890417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00a5560 con 0x7fdfd80ccf10 2023-07-09T02:11:52.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfd77fe640 1 -- 172.21.15.45:0/4177890417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd00a56c0 con 0x7fdfd80ccf10 2023-07-09T02:11:52.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfd77fe640 1 -- 172.21.15.45:0/4177890417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00a5a50 con 0x7fdfd80ccf10 2023-07-09T02:11:52.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 -- 172.21.15.45:0/4177890417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80ccf10 msgr2=0x7fdfd8070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 --2- 172.21.15.45:0/4177890417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80ccf10 0x7fdfd8070be0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdfd806c5f0 tx=0x7fdfd001c6e0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 -- 172.21.15.45:0/4177890417 shutdown_connections 2023-07-09T02:11:52.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 --2- 172.21.15.45:0/4177890417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80ccf10 0x7fdfd8070be0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 --2- 172.21.15.45:0/4177890417 >> v2:172.21.15.155:3300/0 conn(0x7fdfd80d2400 0x7fdfd8069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 --2- 172.21.15.45:0/4177890417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80b1bc0 0x7fdfd8069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 -- 172.21.15.45:0/4177890417 >> 172.21.15.45:0/4177890417 conn(0x7fdfd80d35b0 msgr2=0x7fdfd80cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 -- 172.21.15.45:0/4177890417 shutdown_connections 2023-07-09T02:11:52.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 -- 172.21.15.45:0/4177890417 wait complete. 2023-07-09T02:11:52.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 Processor -- start 2023-07-09T02:11:52.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 -- start start 2023-07-09T02:11:52.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfd80b1bc0 0x7fdfd814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80ccf10 0x7fdfd81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80d2400 0x7fdfd80b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.196+0000 7fdfdda47640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd814d3c0 con 0x7fdfd80d2400 2023-07-09T02:11:52.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdda47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8152150 con 0x7fdfd80b1bc0 2023-07-09T02:11:52.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdda47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8151540 con 0x7fdfd80ccf10 2023-07-09T02:11:52.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80d2400 0x7fdfd80b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80d2400 0x7fdfd80b6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36390/0 (socket says 172.21.15.45:36390) 2023-07-09T02:11:52.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 -- 172.21.15.45:0/786002127 learned_addr learned my addr 172.21.15.45:0/786002127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:52.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfd7fff640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80ccf10 0x7fdfd81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdca45640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfd80b1bc0 0x7fdfd814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 -- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80ccf10 msgr2=0x7fdfd81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80ccf10 0x7fdfd81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 -- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfd80b1bc0 msgr2=0x7fdfd814ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfd80b1bc0 0x7fdfd814ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 -- 172.21.15.45:0/786002127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0009b30 con 0x7fdfd80d2400 2023-07-09T02:11:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdd246640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80d2400 0x7fdfd80b6540 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00af040 tx=0x7fdfd0019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfd57fa640 1 -- 172.21.15.45:0/786002127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00a5560 con 0x7fdfd80d2400 2023-07-09T02:11:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfd57fa640 1 -- 172.21.15.45:0/786002127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd00b8670 con 0x7fdfd80d2400 2023-07-09T02:11:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd8151820 con 0x7fdfd80d2400 2023-07-09T02:11:52.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfd57fa640 1 -- 172.21.15.45:0/786002127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00b8a20 con 0x7fdfd80d2400 2023-07-09T02:11:52.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd8151de0 con 0x7fdfd80d2400 2023-07-09T02:11:52.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd81522c0 con 0x7fdfd80d2400 2023-07-09T02:11:52.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.200+0000 7fdfd57fa640 1 -- 172.21.15.45:0/786002127 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdfd00b8b80 con 0x7fdfd80d2400 2023-07-09T02:11:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.204+0000 7fdfd57fa640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfbc066280 0x7fdfbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.204+0000 7fdfd57fa640 1 -- 172.21.15.45:0/786002127 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfd011f0e0 con 0x7fdfd80d2400 2023-07-09T02:11:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.204+0000 7fdfdca45640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfbc066280 0x7fdfbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.204+0000 7fdfdca45640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfbc066280 0x7fdfbc068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009a70 tx=0x7fdfcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.208+0000 7fdfd57fa640 1 -- 172.21.15.45:0/786002127 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfd00ec6a0 con 0x7fdfd80d2400 2023-07-09T02:11:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.360+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfd80cec50 con 0x7fdfd80d2400 2023-07-09T02:11:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.360+0000 7fdfd57fa640 1 -- 172.21.15.45:0/786002127 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfd0009510 con 0x7fdfd80d2400 2023-07-09T02:11:52.365 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfbc066280 msgr2=0x7fdfbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfbc066280 0x7fdfbc068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009a70 tx=0x7fdfcc008040 comp rx=0 tx=0).stop 2023-07-09T02:11:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80d2400 msgr2=0x7fdfd80b6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80d2400 0x7fdfd80b6540 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00af040 tx=0x7fdfd0019480 comp rx=0 tx=0).stop 2023-07-09T02:11:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 shutdown_connections 2023-07-09T02:11:52.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfd80d2400 0x7fdfd80b6540 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfbc066280 0x7fdfbc068730 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfd80ccf10 0x7fdfd81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 --2- 172.21.15.45:0/786002127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfd80b1bc0 0x7fdfd814ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 >> 172.21.15.45:0/786002127 conn(0x7fdfd80d35b0 msgr2=0x7fdfd80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:52.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 shutdown_connections 2023-07-09T02:11:52.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.364+0000 7fdfdda47640 1 -- 172.21.15.45:0/786002127 wait complete. 2023-07-09T02:11:52.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:52.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.528+0000 7f06c9559640 1 Processor -- start 2023-07-09T02:11:52.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.528+0000 7f06c9559640 1 -- start start 2023-07-09T02:11:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c9559640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06c415c060 0x7f06c40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c9559640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06c40cd120 0x7f06c40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c9559640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c4160a50 con 0x7f06c40d2450 2023-07-09T02:11:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c9559640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40d28d0 con 0x7f06c415c060 2023-07-09T02:11:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c9559640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40cfe40 con 0x7f06c40cd120 2023-07-09T02:11:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06c415c060 0x7f06c40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06c415c060 0x7f06c40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36398/0 (socket says 172.21.15.45:36398) 2023-07-09T02:11:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c2ffd640 1 -- 172.21.15.45:0/3209345036 learned_addr learned my addr 172.21.15.45:0/3209345036 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06bbfff640 1 --2- 172.21.15.45:0/3209345036 >> v2:172.21.15.155:3300/0 conn(0x7f06c40cd120 0x7f06c40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c2ffd640 1 -- 172.21.15.45:0/3209345036 >> v2:172.21.15.155:3300/0 conn(0x7f06c40cd120 msgr2=0x7f06c40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:52.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c2ffd640 1 --2- 172.21.15.45:0/3209345036 >> v2:172.21.15.155:3300/0 conn(0x7f06c40cd120 0x7f06c40d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c2ffd640 1 -- 172.21.15.45:0/3209345036 >> v1:172.21.15.155:6789/0 conn(0x7f06c40d2450 legacy=0x7f06c40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.532+0000 7f06c2ffd640 1 -- 172.21.15.45:0/3209345036 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c415c430 con 0x7f06c415c060 2023-07-09T02:11:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c2ffd640 1 --2- 172.21.15.45:0/3209345036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c415c060 0x7f06c40b4ed0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06c415fac0 tx=0x7f06b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accfda7550e204eb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c27fc640 1 -- 172.21.15.45:0/3209345036 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40ab5f0 con 0x7f06c415c060 2023-07-09T02:11:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c27fc640 1 -- 172.21.15.45:0/3209345036 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b40ab750 con 0x7f06c415c060 2023-07-09T02:11:52.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c27fc640 1 -- 172.21.15.45:0/3209345036 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40abae0 con 0x7f06c415c060 2023-07-09T02:11:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 -- 172.21.15.45:0/3209345036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c415c060 msgr2=0x7f06c40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 --2- 172.21.15.45:0/3209345036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c415c060 0x7f06c40b4ed0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06c415fac0 tx=0x7f06b401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 -- 172.21.15.45:0/3209345036 shutdown_connections 2023-07-09T02:11:52.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 --2- 172.21.15.45:0/3209345036 >> v2:172.21.15.155:3300/0 conn(0x7f06c40cd120 0x7f06c40d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 --2- 172.21.15.45:0/3209345036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c415c060 0x7f06c40b4ed0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 -- 172.21.15.45:0/3209345036 >> 172.21.15.45:0/3209345036 conn(0x7f06c40698e0 msgr2=0x7f06c4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:52.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 -- 172.21.15.45:0/3209345036 shutdown_connections 2023-07-09T02:11:52.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 -- 172.21.15.45:0/3209345036 wait complete. 2023-07-09T02:11:52.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 Processor -- start 2023-07-09T02:11:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.536+0000 7f06c9559640 1 -- start start 2023-07-09T02:11:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cd120 0x7f06c415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06c40d2450 0x7f06c40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06c415c060 0x7f06c40cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40b4210 con 0x7f06c40cd120 2023-07-09T02:11:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40cca30 con 0x7f06c415c060 2023-07-09T02:11:52.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40b2f10 con 0x7f06c40d2450 2023-07-09T02:11:52.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cd120 0x7f06c415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cd120 0x7f06c415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36400/0 (socket says 172.21.15.45:36400) 2023-07-09T02:11:52.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 -- 172.21.15.45:0/3639973078 learned_addr learned my addr 172.21.15.45:0/3639973078 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:52.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c37fe640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06c415c060 0x7f06c40cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06bbfff640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06c40d2450 0x7f06c40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 -- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06c40d2450 msgr2=0x7f06c40b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06c40d2450 0x7f06c40b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 -- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06c415c060 msgr2=0x7f06c40cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06c415c060 0x7f06c40cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 -- 172.21.15.45:0/3639973078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40094d0 con 0x7f06c40cd120 2023-07-09T02:11:52.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c37fe640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06c415c060 0x7f06c40cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:52.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c2ffd640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cd120 0x7f06c415a770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f06b40190e0 tx=0x7f06b401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06bb7fe640 1 -- 172.21.15.45:0/3639973078 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40be5f0 con 0x7f06c40cd120 2023-07-09T02:11:52.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06bb7fe640 1 -- 172.21.15.45:0/3639973078 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b40be770 con 0x7f06c40cd120 2023-07-09T02:11:52.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06bb7fe640 1 -- 172.21.15.45:0/3639973078 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40beb20 con 0x7f06c40cd120 2023-07-09T02:11:52.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c40b31f0 con 0x7f06c40cd120 2023-07-09T02:11:52.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c40b37b0 con 0x7f06c40cd120 2023-07-09T02:11:52.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c40b39a0 con 0x7f06c40cd120 2023-07-09T02:11:52.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.540+0000 7f06bb7fe640 1 -- 172.21.15.45:0/3639973078 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06b40b43f0 con 0x7f06c40cd120 2023-07-09T02:11:52.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.544+0000 7f06bb7fe640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06a4066280 0x7f06a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.544+0000 7f06bb7fe640 1 -- 172.21.15.45:0/3639973078 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06b40a8050 con 0x7f06c40cd120 2023-07-09T02:11:52.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.544+0000 7f06bbfff640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06a4066280 0x7f06a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.544+0000 7f06bbfff640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06a4066280 0x7f06a4068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f06c40b6890 tx=0x7f06ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.548+0000 7f06bb7fe640 1 -- 172.21.15.45:0/3639973078 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06b40ebc70 con 0x7f06c40cd120 2023-07-09T02:11:52.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.700+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06c404d7d0 con 0x7f06c40cd120 2023-07-09T02:11:52.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06bb7fe640 1 -- 172.21.15.45:0/3639973078 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06b40ef290 con 0x7f06c40cd120 2023-07-09T02:11:52.705 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:52.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06a4066280 msgr2=0x7f06a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06a4066280 0x7f06a4068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f06c40b6890 tx=0x7f06ac008040 comp rx=0 tx=0).stop 2023-07-09T02:11:52.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cd120 msgr2=0x7f06c415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cd120 0x7f06c415a770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f06b40190e0 tx=0x7f06b401ad10 comp rx=0 tx=0).stop 2023-07-09T02:11:52.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 shutdown_connections 2023-07-09T02:11:52.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06c415c060 0x7f06c40cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06a4066280 0x7f06a4068730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06c40d2450 0x7f06c40b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 --2- 172.21.15.45:0/3639973078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06c40cd120 0x7f06c415a770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 >> 172.21.15.45:0/3639973078 conn(0x7f06c40698e0 msgr2=0x7f06c40b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:52.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 shutdown_connections 2023-07-09T02:11:52.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.704+0000 7f06c9559640 1 -- 172.21.15.45:0/3639973078 wait complete. 2023-07-09T02:11:52.726 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:52.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.868+0000 7f9b2a034640 1 Processor -- start 2023-07-09T02:11:52.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.868+0000 7f9b2a034640 1 -- start start 2023-07-09T02:11:52.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b2a034640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b2415c060 0x7f9b240b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b2a034640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b240cd120 0x7f9b240d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b2a034640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b240d2450 0x7f9b240d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b2a034640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b240d28f0 con 0x7f9b240d2450 2023-07-09T02:11:52.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b2a034640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b24160a50 con 0x7f9b2415c060 2023-07-09T02:11:52.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b2a034640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2415c430 con 0x7f9b240cd120 2023-07-09T02:11:52.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b23fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b240d2450 0x7f9b240d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b23fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b240d2450 0x7f9b240d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36404/0 (socket says 172.21.15.45:36404) 2023-07-09T02:11:52.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b23fff640 1 -- 172.21.15.45:0/2543614797 learned_addr learned my addr 172.21.15.45:0/2543614797 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:52.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b22ffd640 1 --2- 172.21.15.45:0/2543614797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b240cd120 0x7f9b240d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b237fe640 1 --2- 172.21.15.45:0/2543614797 >> v2:172.21.15.155:3300/0 conn(0x7f9b2415c060 0x7f9b240b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b23fff640 1 -- 172.21.15.45:0/2543614797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b240cd120 msgr2=0x7f9b240d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:52.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b23fff640 1 --2- 172.21.15.45:0/2543614797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b240cd120 0x7f9b240d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b23fff640 1 -- 172.21.15.45:0/2543614797 >> v2:172.21.15.155:3300/0 conn(0x7f9b2415c060 msgr2=0x7f9b240b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:52.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b23fff640 1 --2- 172.21.15.45:0/2543614797 >> v2:172.21.15.155:3300/0 conn(0x7f9b2415c060 0x7f9b240b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.872+0000 7f9b23fff640 1 -- 172.21.15.45:0/2543614797 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2415fb60 con 0x7f9b240d2450 2023-07-09T02:11:52.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b23fff640 1 --2- 172.21.15.45:0/2543614797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240d2450 0x7f9b240d0610 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9b240d3ad0 tx=0x7f9b1c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df51332f9aadd16f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b227fc640 1 -- 172.21.15.45:0/2543614797 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0a5560 con 0x7f9b240d2450 2023-07-09T02:11:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b227fc640 1 -- 172.21.15.45:0/2543614797 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0a56c0 con 0x7f9b240d2450 2023-07-09T02:11:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b227fc640 1 -- 172.21.15.45:0/2543614797 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0a5a50 con 0x7f9b240d2450 2023-07-09T02:11:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 -- 172.21.15.45:0/2543614797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240d2450 msgr2=0x7f9b240d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 --2- 172.21.15.45:0/2543614797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240d2450 0x7f9b240d0610 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9b240d3ad0 tx=0x7f9b1c01c6e0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 -- 172.21.15.45:0/2543614797 shutdown_connections 2023-07-09T02:11:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 --2- 172.21.15.45:0/2543614797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240d2450 0x7f9b240d0610 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 --2- 172.21.15.45:0/2543614797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b240cd120 0x7f9b240d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 --2- 172.21.15.45:0/2543614797 >> v2:172.21.15.155:3300/0 conn(0x7f9b2415c060 0x7f9b240b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 -- 172.21.15.45:0/2543614797 >> 172.21.15.45:0/2543614797 conn(0x7f9b240698e0 msgr2=0x7f9b24069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 -- 172.21.15.45:0/2543614797 shutdown_connections 2023-07-09T02:11:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 -- 172.21.15.45:0/2543614797 wait complete. 2023-07-09T02:11:52.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 Processor -- start 2023-07-09T02:11:52.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.876+0000 7f9b2a034640 1 -- start start 2023-07-09T02:11:52.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240cd120 0x7f9b240b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b240d2450 0x7f9b240cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b2415c060 0x7f9b24157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240cc870 con 0x7f9b240cd120 2023-07-09T02:11:52.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240b8630 con 0x7f9b240d2450 2023-07-09T02:11:52.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240b7660 con 0x7f9b2415c060 2023-07-09T02:11:52.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240cd120 0x7f9b240b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240cd120 0x7f9b240b80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36416/0 (socket says 172.21.15.45:36416) 2023-07-09T02:11:52.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 -- 172.21.15.45:0/3540694860 learned_addr learned my addr 172.21.15.45:0/3540694860 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:52.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b23fff640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b2415c060 0x7f9b24157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b22ffd640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b240d2450 0x7f9b240cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 -- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b2415c060 msgr2=0x7f9b24157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b2415c060 0x7f9b24157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 -- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b240d2450 msgr2=0x7f9b240cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:52.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b240d2450 0x7f9b240cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:52.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 -- 172.21.15.45:0/3540694860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c009b30 con 0x7f9b240cd120 2023-07-09T02:11:52.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b237fe640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240cd120 0x7f9b240b80f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400e870 tx=0x7f9b1400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b0bfff640 1 -- 172.21.15.45:0/3540694860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14009510 con 0x7f9b240cd120 2023-07-09T02:11:52.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b0bfff640 1 -- 172.21.15.45:0/3540694860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400eec0 con 0x7f9b240cd120 2023-07-09T02:11:52.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b240ca5c0 con 0x7f9b240cd120 2023-07-09T02:11:52.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b0bfff640 1 -- 172.21.15.45:0/3540694860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400cb40 con 0x7f9b240cd120 2023-07-09T02:11:52.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b240cab80 con 0x7f9b240cd120 2023-07-09T02:11:52.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2404d7d0 con 0x7f9b240cd120 2023-07-09T02:11:52.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.880+0000 7f9b0bfff640 1 -- 172.21.15.45:0/3540694860 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b1400cca0 con 0x7f9b240cd120 2023-07-09T02:11:52.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.884+0000 7f9b0bfff640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b10066280 0x7f9b10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:52.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.884+0000 7f9b0bfff640 1 -- 172.21.15.45:0/3540694860 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b14083e60 con 0x7f9b240cd120 2023-07-09T02:11:52.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.884+0000 7f9b22ffd640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b10066280 0x7f9b10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:52.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.884+0000 7f9b22ffd640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b10066280 0x7f9b10068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b24166ec0 tx=0x7f9b18009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:52.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:52.888+0000 7f9b0bfff640 1 -- 172.21.15.45:0/3540694860 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b14051260 con 0x7f9b240cd120 2023-07-09T02:11:53.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.040+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b240b87d0 con 0x7f9b240cd120 2023-07-09T02:11:53.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.040+0000 7f9b0bfff640 1 -- 172.21.15.45:0/3540694860 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b14021020 con 0x7f9b240cd120 2023-07-09T02:11:53.043 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:53.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.040+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b10066280 msgr2=0x7f9b10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.040+0000 7f9b2a034640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b10066280 0x7f9b10068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b24166ec0 tx=0x7f9b18009190 comp rx=0 tx=0).stop 2023-07-09T02:11:53.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.040+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240cd120 msgr2=0x7f9b240b80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.040+0000 7f9b2a034640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240cd120 0x7f9b240b80f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400e870 tx=0x7f9b1400ec70 comp rx=0 tx=0).stop 2023-07-09T02:11:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.044+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 shutdown_connections 2023-07-09T02:11:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.044+0000 7f9b2a034640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b10066280 0x7f9b10068730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.044+0000 7f9b2a034640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b2415c060 0x7f9b24157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.044+0000 7f9b2a034640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b240d2450 0x7f9b240cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.044+0000 7f9b2a034640 1 --2- 172.21.15.45:0/3540694860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b240cd120 0x7f9b240b80f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.044+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 >> 172.21.15.45:0/3540694860 conn(0x7f9b240698e0 msgr2=0x7f9b240b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.044+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 shutdown_connections 2023-07-09T02:11:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.044+0000 7f9b2a034640 1 -- 172.21.15.45:0/3540694860 wait complete. 2023-07-09T02:11:53.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:53.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f5111d59640 1 Processor -- start 2023-07-09T02:11:53.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f5111d59640 1 -- start start 2023-07-09T02:11:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f5111d59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c158e30 0x7f510c06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f5111d59640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f510c06fd10 0x7f510c06c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f5111d59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f510c06c650 0x7f510c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f5111d59640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c06cad0 con 0x7f510c06c650 2023-07-09T02:11:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f5111d59640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c0ccf80 con 0x7f510c06fd10 2023-07-09T02:11:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f5111d59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0cd540 con 0x7f510c158e30 2023-07-09T02:11:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f510bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f510c06c650 0x7f510c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f510bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f510c06c650 0x7f510c0caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36424/0 (socket says 172.21.15.45:36424) 2023-07-09T02:11:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.208+0000 7f510bfff640 1 -- 172.21.15.45:0/4003383493 learned_addr learned my addr 172.21.15.45:0/4003383493 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510affd640 1 --2- 172.21.15.45:0/4003383493 >> v2:172.21.15.155:3300/0 conn(0x7f510c06fd10 0x7f510c06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510b7fe640 1 --2- 172.21.15.45:0/4003383493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c158e30 0x7f510c06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510bfff640 1 -- 172.21.15.45:0/4003383493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c158e30 msgr2=0x7f510c06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510bfff640 1 --2- 172.21.15.45:0/4003383493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c158e30 0x7f510c06f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510bfff640 1 -- 172.21.15.45:0/4003383493 >> v2:172.21.15.155:3300/0 conn(0x7f510c06fd10 msgr2=0x7f510c06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510bfff640 1 --2- 172.21.15.45:0/4003383493 >> v2:172.21.15.155:3300/0 conn(0x7f510c06fd10 0x7f510c06c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510bfff640 1 -- 172.21.15.45:0/4003383493 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0c8fb0 con 0x7f510c06c650 2023-07-09T02:11:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510affd640 1 --2- 172.21.15.45:0/4003383493 >> v2:172.21.15.155:3300/0 conn(0x7f510c06fd10 0x7f510c06c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:53.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510b7fe640 1 --2- 172.21.15.45:0/4003383493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c158e30 0x7f510c06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510bfff640 1 --2- 172.21.15.45:0/4003383493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c0caec0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f510c0cc150 tx=0x7f510401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a612085f3b9ae19 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510a7fc640 1 -- 172.21.15.45:0/4003383493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400b2d0 con 0x7f510c06c650 2023-07-09T02:11:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510a7fc640 1 -- 172.21.15.45:0/4003383493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510400b430 con 0x7f510c06c650 2023-07-09T02:11:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f510a7fc640 1 -- 172.21.15.45:0/4003383493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040a7be0 con 0x7f510c06c650 2023-07-09T02:11:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f5111d59640 1 -- 172.21.15.45:0/4003383493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 msgr2=0x7f510c0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.212+0000 7f5111d59640 1 --2- 172.21.15.45:0/4003383493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c0caec0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f510c0cc150 tx=0x7f510401eb10 comp rx=0 tx=0).stop 2023-07-09T02:11:53.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 -- 172.21.15.45:0/4003383493 shutdown_connections 2023-07-09T02:11:53.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 --2- 172.21.15.45:0/4003383493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c0caec0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 --2- 172.21.15.45:0/4003383493 >> v2:172.21.15.155:3300/0 conn(0x7f510c06fd10 0x7f510c06c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 --2- 172.21.15.45:0/4003383493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c158e30 0x7f510c06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 -- 172.21.15.45:0/4003383493 >> 172.21.15.45:0/4003383493 conn(0x7f510c0694b0 msgr2=0x7f510c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:53.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 -- 172.21.15.45:0/4003383493 shutdown_connections 2023-07-09T02:11:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 -- 172.21.15.45:0/4003383493 wait complete. 2023-07-09T02:11:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 Processor -- start 2023-07-09T02:11:53.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 -- start start 2023-07-09T02:11:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c06fd10 0x7f510c149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f510c158e30 0x7f510c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c149ba0 con 0x7f510c06c650 2023-07-09T02:11:53.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c153610 con 0x7f510c158e30 2023-07-09T02:11:53.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f5111d59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c1538f0 con 0x7f510c06fd10 2023-07-09T02:11:53.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c14f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36440/0 (socket says 172.21.15.45:36440) 2023-07-09T02:11:53.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510b7fe640 1 -- 172.21.15.45:0/577219096 learned_addr learned my addr 172.21.15.45:0/577219096 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:53.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510affd640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c06fd10 0x7f510c149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510bfff640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f510c158e30 0x7f510c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510b7fe640 1 -- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c06fd10 msgr2=0x7f510c149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510b7fe640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c06fd10 0x7f510c149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510b7fe640 1 -- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f510c158e30 msgr2=0x7f510c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510b7fe640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f510c158e30 0x7f510c1546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.216+0000 7f510b7fe640 1 -- 172.21.15.45:0/577219096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510400bd40 con 0x7f510c06c650 2023-07-09T02:11:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f510b7fe640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c14f680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00c7f0 tx=0x7f50fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:53.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f50f3fff640 1 -- 172.21.15.45:0/577219096 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc007820 con 0x7f510c06c650 2023-07-09T02:11:53.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f50f3fff640 1 -- 172.21.15.45:0/577219096 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc007980 con 0x7f510c06c650 2023-07-09T02:11:53.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f50f3fff640 1 -- 172.21.15.45:0/577219096 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc007d30 con 0x7f510c06c650 2023-07-09T02:11:53.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c153bd0 con 0x7f510c06c650 2023-07-09T02:11:53.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c154190 con 0x7f510c06c650 2023-07-09T02:11:53.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c04d7d0 con 0x7f510c06c650 2023-07-09T02:11:53.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f50f3fff640 1 -- 172.21.15.45:0/577219096 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50fc0113f0 con 0x7f510c06c650 2023-07-09T02:11:53.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f50f3fff640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50f8066280 0x7f50f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f50f3fff640 1 -- 172.21.15.45:0/577219096 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50fc0840c0 con 0x7f510c06c650 2023-07-09T02:11:53.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.220+0000 7f510affd640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50f8066280 0x7f50f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.224+0000 7f510affd640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50f8066280 0x7f50f8068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5100006b20 tx=0x7f5100008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.224+0000 7f50f3fff640 1 -- 172.21.15.45:0/577219096 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50fc051550 con 0x7f510c06c650 2023-07-09T02:11:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.376+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f510c0ccb30 con 0x7f510c06c650 2023-07-09T02:11:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.376+0000 7f50f3fff640 1 -- 172.21.15.45:0/577219096 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50fc054b70 con 0x7f510c06c650 2023-07-09T02:11:53.382 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:53.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50f8066280 msgr2=0x7f50f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50f8066280 0x7f50f8068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5100006b20 tx=0x7f5100008040 comp rx=0 tx=0).stop 2023-07-09T02:11:53.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 msgr2=0x7f510c14f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c14f680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00c7f0 tx=0x7f50fc00ccb0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 shutdown_connections 2023-07-09T02:11:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f510c158e30 0x7f510c1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50f8066280 0x7f50f8068730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f510c06fd10 0x7f510c149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 --2- 172.21.15.45:0/577219096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c06c650 0x7f510c14f680 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 >> 172.21.15.45:0/577219096 conn(0x7f510c0694b0 msgr2=0x7f510c0c9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 shutdown_connections 2023-07-09T02:11:53.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.380+0000 7f5111d59640 1 -- 172.21.15.45:0/577219096 wait complete. 2023-07-09T02:11:53.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:11:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f861ad40640 1 Processor -- start 2023-07-09T02:11:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f861ad40640 1 -- start start 2023-07-09T02:11:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f861ad40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140d2620 0x7f86140b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f861ad40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8614160a50 con 0x7f861415c060 2023-07-09T02:11:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f861ad40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861415c430 con 0x7f86140cd120 2023-07-09T02:11:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f861ad40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861415fb60 con 0x7f86140d2620 2023-07-09T02:11:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f8618adc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f861415c060 0x7f86140d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50154/0 (socket says 172.21.15.45:50154) 2023-07-09T02:11:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f8618adc640 1 -- 172.21.15.45:0/3372378169 learned_addr learned my addr 172.21.15.45:0/3372378169 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.544+0000 7f8613fff640 1 --2- 172.21.15.45:0/3372378169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140d2620 0x7f86140b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f86137fe640 1 -- 172.21.15.45:0/3372378169 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016353424 0 0) 0x7f8614160a50 con 0x7f861415c060 2023-07-09T02:11:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f86137fe640 1 -- 172.21.15.45:0/3372378169 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8604003530 con 0x7f861415c060 2023-07-09T02:11:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f86137fe640 1 -- 172.21.15.45:0/3372378169 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716022291 0 0) 0x7f861415c430 con 0x7f86140cd120 2023-07-09T02:11:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f86137fe640 1 -- 172.21.15.45:0/3372378169 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8614160a50 con 0x7f86140cd120 2023-07-09T02:11:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f8613fff640 1 -- 172.21.15.45:0/3372378169 >> v1:172.21.15.155:6789/0 conn(0x7f86140cd120 legacy=0x7f86140cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f8613fff640 1 -- 172.21.15.45:0/3372378169 >> v1:172.21.15.45:6789/0 conn(0x7f861415c060 legacy=0x7f86140d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f8613fff640 1 -- 172.21.15.45:0/3372378169 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861415fe40 con 0x7f86140d2620 2023-07-09T02:11:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f8613fff640 1 --2- 172.21.15.45:0/3372378169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140d2620 0x7f86140b4ed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86000097f0 tx=0x7f860001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94a0e26cca619e82 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f86137fe640 1 -- 172.21.15.45:0/3372378169 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000aa5f0 con 0x7f86140d2620 2023-07-09T02:11:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f86137fe640 1 -- 172.21.15.45:0/3372378169 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000aa750 con 0x7f86140d2620 2023-07-09T02:11:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.548+0000 7f86137fe640 1 -- 172.21.15.45:0/3372378169 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000aaae0 con 0x7f86140d2620 2023-07-09T02:11:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- 172.21.15.45:0/3372378169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140d2620 msgr2=0x7f86140b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 --2- 172.21.15.45:0/3372378169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140d2620 0x7f86140b4ed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86000097f0 tx=0x7f860001c490 comp rx=0 tx=0).stop 2023-07-09T02:11:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- 172.21.15.45:0/3372378169 shutdown_connections 2023-07-09T02:11:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 --2- 172.21.15.45:0/3372378169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140d2620 0x7f86140b4ed0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- 172.21.15.45:0/3372378169 >> 172.21.15.45:0/3372378169 conn(0x7f86140698e0 msgr2=0x7f8614069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- 172.21.15.45:0/3372378169 shutdown_connections 2023-07-09T02:11:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- 172.21.15.45:0/3372378169 wait complete. 2023-07-09T02:11:53.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 Processor -- start 2023-07-09T02:11:53.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- start start 2023-07-09T02:11:53.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140cd120 0x7f8614151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86140d2620 0x7f8614151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861415c060 0x7f861415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8614151cc0 con 0x7f861415c060 2023-07-09T02:11:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86140cc280 con 0x7f86140d2620 2023-07-09T02:11:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f861ad40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8614151f10 con 0x7f86140cd120 2023-07-09T02:11:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f86192dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861415c060 0x7f861415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f8618adc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140cd120 0x7f8614151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f86192dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861415c060 0x7f861415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36450/0 (socket says 172.21.15.45:36450) 2023-07-09T02:11:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f86192dd640 1 -- 172.21.15.45:0/1993551868 learned_addr learned my addr 172.21.15.45:0/1993551868 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:53.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.552+0000 7f8613fff640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86140d2620 0x7f8614151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f8618adc640 1 -- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86140d2620 msgr2=0x7f8614151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f8618adc640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86140d2620 0x7f8614151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f8618adc640 1 -- 172.21.15.45:0/1993551868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861415c060 msgr2=0x7f861415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f8618adc640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861415c060 0x7f861415c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f8618adc640 1 -- 172.21.15.45:0/1993551868 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600009420 con 0x7f86140cd120 2023-07-09T02:11:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f86192dd640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861415c060 0x7f861415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f8618adc640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140cd120 0x7f8614151130 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8608001ec0 tx=0x7f860800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f86117fa640 1 -- 172.21.15.45:0/1993551868 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608005cf0 con 0x7f86140cd120 2023-07-09T02:11:53.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f86117fa640 1 -- 172.21.15.45:0/1993551868 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8608005e50 con 0x7f86140cd120 2023-07-09T02:11:53.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f86117fa640 1 -- 172.21.15.45:0/1993551868 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080072d0 con 0x7f86140cd120 2023-07-09T02:11:53.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86140b59f0 con 0x7f86140cd120 2023-07-09T02:11:53.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86141524d0 con 0x7f86140cd120 2023-07-09T02:11:53.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86141526c0 con 0x7f86140cd120 2023-07-09T02:11:53.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.556+0000 7f86117fa640 1 -- 172.21.15.45:0/1993551868 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8608007430 con 0x7f86140cd120 2023-07-09T02:11:53.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.560+0000 7f86117fa640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85f8066280 0x7f85f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:53.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.560+0000 7f86117fa640 1 -- 172.21.15.45:0/1993551868 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8608083370 con 0x7f86140cd120 2023-07-09T02:11:53.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.560+0000 7f8613fff640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85f8066280 0x7f85f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:53.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.560+0000 7f8613fff640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85f8066280 0x7f85f8068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86000ae000 tx=0x7f86000a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:53.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.564+0000 7f86117fa640 1 -- 172.21.15.45:0/1993551868 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86080509d0 con 0x7f86140cd120 2023-07-09T02:11:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.728+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f861404d7d0 con 0x7f86140cd120 2023-07-09T02:11:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.728+0000 7f86117fa640 1 -- 172.21.15.45:0/1993551868 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8608053ff0 con 0x7f86140cd120 2023-07-09T02:11:53.733 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:11:53.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85f8066280 msgr2=0x7f85f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85f8066280 0x7f85f8068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86000ae000 tx=0x7f86000a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140cd120 msgr2=0x7f8614151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140cd120 0x7f8614151130 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8608001ec0 tx=0x7f860800c820 comp rx=0 tx=0).stop 2023-07-09T02:11:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 shutdown_connections 2023-07-09T02:11:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861415c060 0x7f861415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86140d2620 0x7f8614151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85f8066280 0x7f85f8068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 --2- 172.21.15.45:0/1993551868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86140cd120 0x7f8614151130 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:53.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 >> 172.21.15.45:0/1993551868 conn(0x7f86140698e0 msgr2=0x7f86140b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:53.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 shutdown_connections 2023-07-09T02:11:53.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:53.732+0000 7f861ad40640 1 -- 172.21.15.45:0/1993551868 wait complete. 2023-07-09T02:11:53.754 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:11:53.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:53.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-09T02:11:53.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:11:53.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:53.821 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:11:53.835 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:11:53.836 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:53.846 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:11:53.846 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:53.897 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:11:53.897 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:53.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.132+0000 7f33d96cb640 1 Processor -- start 2023-07-09T02:11:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.132+0000 7f33d96cb640 1 -- start start 2023-07-09T02:11:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d96cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d415c060 0x7f33d40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d96cb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33d40d2620 0x7f33d40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d96cb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d4160a50 con 0x7f33d40cd120 2023-07-09T02:11:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d96cb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d415c430 con 0x7f33d40d2620 2023-07-09T02:11:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d96cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d415fb60 con 0x7f33d415c060 2023-07-09T02:11:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33cbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f33d40cd120 0x7f33d40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50158/0 (socket says 172.21.15.45:50158) 2023-07-09T02:11:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33cbfff640 1 -- 172.21.15.45:0/3586998113 learned_addr learned my addr 172.21.15.45:0/3586998113 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d2ffd640 1 --2- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d415c060 0x7f33d40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d37fe640 1 --2- 172.21.15.45:0/3586998113 >> v2:172.21.15.155:3300/0 conn(0x7f33d40d2620 0x7f33d40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d27fc640 1 -- 172.21.15.45:0/3586998113 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139425865 0 0) 0x7f33d4160a50 con 0x7f33d40cd120 2023-07-09T02:11:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d27fc640 1 -- 172.21.15.45:0/3586998113 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c0003530 con 0x7f33d40cd120 2023-07-09T02:11:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d27fc640 1 -- 172.21.15.45:0/3586998113 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112214805 0 0) 0x7f33c0003530 con 0x7f33d40cd120 2023-07-09T02:11:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d37fe640 1 -- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d415c060 msgr2=0x7f33d40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d37fe640 1 --2- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d415c060 0x7f33d40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d37fe640 1 -- 172.21.15.45:0/3586998113 >> v1:172.21.15.45:6789/0 conn(0x7f33d40cd120 legacy=0x7f33d40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d37fe640 1 -- 172.21.15.45:0/3586998113 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d415fe40 con 0x7f33d40d2620 2023-07-09T02:11:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.136+0000 7f33d2ffd640 1 --2- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d415c060 0x7f33d40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d37fe640 1 --2- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d40d2620 0x7f33d40cee30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009dc0 tx=0x7f33cc01c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=176b828dc8e2c0b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d27fc640 1 -- 172.21.15.45:0/3586998113 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc001680 con 0x7f33d40d2620 2023-07-09T02:11:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d27fc640 1 -- 172.21.15.45:0/3586998113 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc0a5660 con 0x7f33d40d2620 2023-07-09T02:11:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d27fc640 1 -- 172.21.15.45:0/3586998113 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0a59f0 con 0x7f33d40d2620 2023-07-09T02:11:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 -- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d40d2620 msgr2=0x7f33d40cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 --2- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d40d2620 0x7f33d40cee30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009dc0 tx=0x7f33cc01c820 comp rx=0 tx=0).stop 2023-07-09T02:11:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 -- 172.21.15.45:0/3586998113 shutdown_connections 2023-07-09T02:11:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 --2- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d40d2620 0x7f33d40cee30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 --2- 172.21.15.45:0/3586998113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d415c060 0x7f33d40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 -- 172.21.15.45:0/3586998113 >> 172.21.15.45:0/3586998113 conn(0x7f33d40698e0 msgr2=0x7f33d4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 -- 172.21.15.45:0/3586998113 shutdown_connections 2023-07-09T02:11:54.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 -- 172.21.15.45:0/3586998113 wait complete. 2023-07-09T02:11:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 Processor -- start 2023-07-09T02:11:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.140+0000 7f33d96cb640 1 -- start start 2023-07-09T02:11:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d40cd120 0x7f33d40d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d40d2620 0x7f33d40b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d415c060 0x7f33d4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4152890 con 0x7f33d40d2620 2023-07-09T02:11:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d41540a0 con 0x7f33d415c060 2023-07-09T02:11:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40cc580 con 0x7f33d40cd120 2023-07-09T02:11:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d40d2620 0x7f33d40b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d40d2620 0x7f33d40b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36458/0 (socket says 172.21.15.45:36458) 2023-07-09T02:11:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 -- 172.21.15.45:0/4002737545 learned_addr learned my addr 172.21.15.45:0/4002737545 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d2ffd640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d40cd120 0x7f33d40d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d37fe640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d415c060 0x7f33d4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 -- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d40cd120 msgr2=0x7f33d40d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d40cd120 0x7f33d40d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 -- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d415c060 msgr2=0x7f33d4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d415c060 0x7f33d4158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 -- 172.21.15.45:0/4002737545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009420 con 0x7f33d40d2620 2023-07-09T02:11:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cbfff640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d40d2620 0x7f33d40b4240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00c750 tx=0x7f33bc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cb7fe640 1 -- 172.21.15.45:0/4002737545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc005af0 con 0x7f33d40d2620 2023-07-09T02:11:54.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cb7fe640 1 -- 172.21.15.45:0/4002737545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc005c50 con 0x7f33d40d2620 2023-07-09T02:11:54.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cb7fe640 1 -- 172.21.15.45:0/4002737545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc007070 con 0x7f33d40d2620 2023-07-09T02:11:54.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc009a70 con 0x7f33d40d2620 2023-07-09T02:11:54.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d40b59f0 con 0x7f33d40d2620 2023-07-09T02:11:54.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d41529d0 con 0x7f33d40d2620 2023-07-09T02:11:54.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.144+0000 7f33cb7fe640 1 -- 172.21.15.45:0/4002737545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33bc0071d0 con 0x7f33d40d2620 2023-07-09T02:11:54.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.148+0000 7f33cb7fe640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f33b40662b0 0x7f33b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.148+0000 7f33cb7fe640 1 -- 172.21.15.45:0/4002737545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33bc083a40 con 0x7f33d40d2620 2023-07-09T02:11:54.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.148+0000 7f33d2ffd640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f33b40662b0 0x7f33b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.148+0000 7f33d2ffd640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f33b40662b0 0x7f33b4068760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009be0 tx=0x7f33c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.152+0000 7f33cb7fe640 1 -- 172.21.15.45:0/4002737545 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33d41529d0 con 0x7f33d40d2620 2023-07-09T02:11:54.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.304+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33d41529d0 con 0x7f33d40d2620 2023-07-09T02:11:54.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33cb7fe640 1 -- 172.21.15.45:0/4002737545 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f33d41529d0 con 0x7f33d40d2620 2023-07-09T02:11:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:54.309 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:54.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f33b40662b0 msgr2=0x7f33b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f33b40662b0 0x7f33b4068760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009be0 tx=0x7f33c4008040 comp rx=0 tx=0).stop 2023-07-09T02:11:54.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d40d2620 msgr2=0x7f33d40b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d40d2620 0x7f33d40b4240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00c750 tx=0x7f33bc00cc10 comp rx=0 tx=0).stop 2023-07-09T02:11:54.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 shutdown_connections 2023-07-09T02:11:54.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33d415c060 0x7f33d4158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33d40d2620 0x7f33d40b4240 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f33b40662b0 0x7f33b4068760 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 --2- 172.21.15.45:0/4002737545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33d40cd120 0x7f33d40d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 >> 172.21.15.45:0/4002737545 conn(0x7f33d40698e0 msgr2=0x7f33d40b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:54.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 shutdown_connections 2023-07-09T02:11:54.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.308+0000 7f33d96cb640 1 -- 172.21.15.45:0/4002737545 wait complete. 2023-07-09T02:11:54.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:54.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e23c56640 1 Processor -- start 2023-07-09T02:11:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e23c56640 1 -- start start 2023-07-09T02:11:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e23c56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7e1c15c060 0x7f7e1c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e23c56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e1c0d2620 0x7f7e1c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e23c56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c160a50 con 0x7f7e1c0cd120 2023-07-09T02:11:54.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e23c56640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c15c430 con 0x7f7e1c0d2620 2023-07-09T02:11:54.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e23c56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c15fb60 con 0x7f7e1c15c060 2023-07-09T02:11:54.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e221f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e1c0d2620 0x7f7e1c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e221f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e1c0d2620 0x7f7e1c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36470/0 (socket says 172.21.15.45:36470) 2023-07-09T02:11:54.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e221f3640 1 -- 172.21.15.45:0/1134182031 learned_addr learned my addr 172.21.15.45:0/1134182031 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:54.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e219f2640 1 --2- 172.21.15.45:0/1134182031 >> v2:172.21.15.155:3300/0 conn(0x7f7e1c15c060 0x7f7e1c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e221f3640 1 -- 172.21.15.45:0/1134182031 >> v2:172.21.15.155:3300/0 conn(0x7f7e1c15c060 msgr2=0x7f7e1c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:54.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e221f3640 1 --2- 172.21.15.45:0/1134182031 >> v2:172.21.15.155:3300/0 conn(0x7f7e1c15c060 0x7f7e1c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e221f3640 1 -- 172.21.15.45:0/1134182031 >> v1:172.21.15.155:6789/0 conn(0x7f7e1c0cd120 legacy=0x7f7e1c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e221f3640 1 -- 172.21.15.45:0/1134182031 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c15fe40 con 0x7f7e1c0d2620 2023-07-09T02:11:54.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.476+0000 7f7e219f2640 1 --2- 172.21.15.45:0/1134182031 >> v2:172.21.15.155:3300/0 conn(0x7f7e1c15c060 0x7f7e1c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:54.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e221f3640 1 --2- 172.21.15.45:0/1134182031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0d2620 0x7f7e1c0cee30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0d3ad0 tx=0x7f7e1401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe30a5efdefd9e3f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e209f0640 1 -- 172.21.15.45:0/1134182031 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140a5860 con 0x7f7e1c0d2620 2023-07-09T02:11:54.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e209f0640 1 -- 172.21.15.45:0/1134182031 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e140a59c0 con 0x7f7e1c0d2620 2023-07-09T02:11:54.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e209f0640 1 -- 172.21.15.45:0/1134182031 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140a5d50 con 0x7f7e1c0d2620 2023-07-09T02:11:54.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e23c56640 1 -- 172.21.15.45:0/1134182031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0d2620 msgr2=0x7f7e1c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e23c56640 1 --2- 172.21.15.45:0/1134182031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0d2620 0x7f7e1c0cee30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0d3ad0 tx=0x7f7e1401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e23c56640 1 -- 172.21.15.45:0/1134182031 shutdown_connections 2023-07-09T02:11:54.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e23c56640 1 --2- 172.21.15.45:0/1134182031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0d2620 0x7f7e1c0cee30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e23c56640 1 --2- 172.21.15.45:0/1134182031 >> v2:172.21.15.155:3300/0 conn(0x7f7e1c15c060 0x7f7e1c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e23c56640 1 -- 172.21.15.45:0/1134182031 >> 172.21.15.45:0/1134182031 conn(0x7f7e1c0698e0 msgr2=0x7f7e1c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e23c56640 1 -- 172.21.15.45:0/1134182031 shutdown_connections 2023-07-09T02:11:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.480+0000 7f7e23c56640 1 -- 172.21.15.45:0/1134182031 wait complete. 2023-07-09T02:11:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 Processor -- start 2023-07-09T02:11:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 -- start start 2023-07-09T02:11:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0cd120 0x7f7e1c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e1c0d2620 0x7f7e1c1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e1c15c060 0x7f7e1c15d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c15ab80 con 0x7f7e1c0cd120 2023-07-09T02:11:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c159ae0 con 0x7f7e1c0d2620 2023-07-09T02:11:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c159dc0 con 0x7f7e1c15c060 2023-07-09T02:11:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0cd120 0x7f7e1c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0cd120 0x7f7e1c0c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36474/0 (socket says 172.21.15.45:36474) 2023-07-09T02:11:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 -- 172.21.15.45:0/967144000 learned_addr learned my addr 172.21.15.45:0/967144000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e211f1640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e1c0d2620 0x7f7e1c1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e221f3640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e1c15c060 0x7f7e1c15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 -- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e1c15c060 msgr2=0x7f7e1c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e1c15c060 0x7f7e1c15d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 -- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e1c0d2620 msgr2=0x7f7e1c1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e1c0d2620 0x7f7e1c1590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 -- 172.21.15.45:0/967144000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14009b30 con 0x7f7e1c0cd120 2023-07-09T02:11:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e211f1640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e1c0d2620 0x7f7e1c1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e219f2640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0cd120 0x7f7e1c0c86f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800d800 tx=0x7f7e1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e127fc640 1 -- 172.21.15.45:0/967144000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180096c0 con 0x7f7e1c0cd120 2023-07-09T02:11:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e127fc640 1 -- 172.21.15.45:0/967144000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18009820 con 0x7f7e1c0cd120 2023-07-09T02:11:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e127fc640 1 -- 172.21.15.45:0/967144000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18009bd0 con 0x7f7e1c0cd120 2023-07-09T02:11:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c0b59f0 con 0x7f7e1c0cd120 2023-07-09T02:11:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c15a380 con 0x7f7e1c0cd120 2023-07-09T02:11:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.484+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c04d7d0 con 0x7f7e1c0cd120 2023-07-09T02:11:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.488+0000 7f7e127fc640 1 -- 172.21.15.45:0/967144000 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e18009d30 con 0x7f7e1c0cd120 2023-07-09T02:11:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.488+0000 7f7e127fc640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e00066280 0x7f7e00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.488+0000 7f7e127fc640 1 -- 172.21.15.45:0/967144000 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e180843b0 con 0x7f7e1c0cd120 2023-07-09T02:11:54.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.488+0000 7f7e211f1640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e00066280 0x7f7e00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.488+0000 7f7e211f1640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e00066280 0x7f7e00068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0b4e60 tx=0x7f7e0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.492+0000 7f7e127fc640 1 -- 172.21.15.45:0/967144000 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e18051820 con 0x7f7e1c0cd120 2023-07-09T02:11:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.648+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e1c06baa0 con 0x7f7e1c0cd120 2023-07-09T02:11:54.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e127fc640 1 -- 172.21.15.45:0/967144000 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e18054e40 con 0x7f7e1c0cd120 2023-07-09T02:11:54.653 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:54.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e00066280 msgr2=0x7f7e00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e00066280 0x7f7e00068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0b4e60 tx=0x7f7e0c009040 comp rx=0 tx=0).stop 2023-07-09T02:11:54.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0cd120 msgr2=0x7f7e1c0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0cd120 0x7f7e1c0c86f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800d800 tx=0x7f7e1800dcc0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 shutdown_connections 2023-07-09T02:11:54.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7e00066280 0x7f7e00068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e1c15c060 0x7f7e1c15d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e1c0d2620 0x7f7e1c1590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 --2- 172.21.15.45:0/967144000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e1c0cd120 0x7f7e1c0c86f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 >> 172.21.15.45:0/967144000 conn(0x7f7e1c0698e0 msgr2=0x7f7e1c15b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:54.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 shutdown_connections 2023-07-09T02:11:54.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.652+0000 7f7e23c56640 1 -- 172.21.15.45:0/967144000 wait complete. 2023-07-09T02:11:54.674 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:54.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.816+0000 7fd282e48640 1 Processor -- start 2023-07-09T02:11:54.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.816+0000 7fd282e48640 1 -- start start 2023-07-09T02:11:54.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd282e48640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd27c0d2620 0x7fd27c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd282e48640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd27c0cd120 0x7fd27c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd282e48640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c160a50 con 0x7fd27c15c060 2023-07-09T02:11:54.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd282e48640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c15c430 con 0x7fd27c0cd120 2023-07-09T02:11:54.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd282e48640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c15fb60 con 0x7fd27c0d2620 2023-07-09T02:11:54.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd2813e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd27c0cd120 0x7fd27c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd2813e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd27c0cd120 0x7fd27c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36486/0 (socket says 172.21.15.45:36486) 2023-07-09T02:11:54.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd2813e5640 1 -- 172.21.15.45:0/2921089169 learned_addr learned my addr 172.21.15.45:0/2921089169 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:54.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd27bfff640 1 --2- 172.21.15.45:0/2921089169 >> v2:172.21.15.155:3300/0 conn(0x7fd27c0d2620 0x7fd27c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd2813e5640 1 -- 172.21.15.45:0/2921089169 >> v2:172.21.15.155:3300/0 conn(0x7fd27c0d2620 msgr2=0x7fd27c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:54.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd2813e5640 1 --2- 172.21.15.45:0/2921089169 >> v2:172.21.15.155:3300/0 conn(0x7fd27c0d2620 0x7fd27c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd2813e5640 1 -- 172.21.15.45:0/2921089169 >> v1:172.21.15.155:6789/0 conn(0x7fd27c15c060 legacy=0x7fd27c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.820+0000 7fd2813e5640 1 -- 172.21.15.45:0/2921089169 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c15fe40 con 0x7fd27c0cd120 2023-07-09T02:11:54.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd2813e5640 1 --2- 172.21.15.45:0/2921089169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0cd120 0x7fd27c0cee30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd27c15fac0 tx=0x7fd27401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910f0d90a24d3d9b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd27b7fe640 1 -- 172.21.15.45:0/2921089169 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740a5860 con 0x7fd27c0cd120 2023-07-09T02:11:54.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd27b7fe640 1 -- 172.21.15.45:0/2921089169 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2740a59c0 con 0x7fd27c0cd120 2023-07-09T02:11:54.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd27b7fe640 1 -- 172.21.15.45:0/2921089169 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740a5d50 con 0x7fd27c0cd120 2023-07-09T02:11:54.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 -- 172.21.15.45:0/2921089169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0cd120 msgr2=0x7fd27c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 --2- 172.21.15.45:0/2921089169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0cd120 0x7fd27c0cee30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd27c15fac0 tx=0x7fd27401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 -- 172.21.15.45:0/2921089169 shutdown_connections 2023-07-09T02:11:54.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 --2- 172.21.15.45:0/2921089169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0cd120 0x7fd27c0cee30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 --2- 172.21.15.45:0/2921089169 >> v2:172.21.15.155:3300/0 conn(0x7fd27c0d2620 0x7fd27c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 -- 172.21.15.45:0/2921089169 >> 172.21.15.45:0/2921089169 conn(0x7fd27c0698e0 msgr2=0x7fd27c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:54.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 -- 172.21.15.45:0/2921089169 shutdown_connections 2023-07-09T02:11:54.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 -- 172.21.15.45:0/2921089169 wait complete. 2023-07-09T02:11:54.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 Processor -- start 2023-07-09T02:11:54.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.824+0000 7fd282e48640 1 -- start start 2023-07-09T02:11:54.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27c0cd120 0x7fd27c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0d2620 0x7fd27c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27c15c060 0x7fd27c1536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0cce70 con 0x7fd27c0d2620 2023-07-09T02:11:54.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c152370 con 0x7fd27c15c060 2023-07-09T02:11:54.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c156380 con 0x7fd27c0cd120 2023-07-09T02:11:54.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0d2620 0x7fd27c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0d2620 0x7fd27c151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36494/0 (socket says 172.21.15.45:36494) 2023-07-09T02:11:54.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 -- 172.21.15.45:0/2558632758 learned_addr learned my addr 172.21.15.45:0/2558632758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:54.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd2813e5640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27c15c060 0x7fd27c1536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd280be4640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27c0cd120 0x7fd27c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 -- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27c0cd120 msgr2=0x7fd27c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27c0cd120 0x7fd27c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 -- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27c15c060 msgr2=0x7fd27c1536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27c15c060 0x7fd27c1536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 -- 172.21.15.45:0/2558632758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009b30 con 0x7fd27c0d2620 2023-07-09T02:11:54.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd27bfff640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0d2620 0x7fd27c151e30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd26800e930 tx=0x7fd26800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd2797fa640 1 -- 172.21.15.45:0/2558632758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268009690 con 0x7fd27c0d2620 2023-07-09T02:11:54.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd2797fa640 1 -- 172.21.15.45:0/2558632758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26800c9a0 con 0x7fd27c0d2620 2023-07-09T02:11:54.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd2797fa640 1 -- 172.21.15.45:0/2558632758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800cd50 con 0x7fd27c0d2620 2023-07-09T02:11:54.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c0b59f0 con 0x7fd27c0d2620 2023-07-09T02:11:54.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c156940 con 0x7fd27c0d2620 2023-07-09T02:11:54.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c04d7d0 con 0x7fd27c0d2620 2023-07-09T02:11:54.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.828+0000 7fd2797fa640 1 -- 172.21.15.45:0/2558632758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd268013470 con 0x7fd27c0d2620 2023-07-09T02:11:54.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.832+0000 7fd2797fa640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd260066280 0x7fd260068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:54.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.832+0000 7fd2797fa640 1 -- 172.21.15.45:0/2558632758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd268084340 con 0x7fd27c0d2620 2023-07-09T02:11:54.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.832+0000 7fd280be4640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd260066280 0x7fd260068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:54.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.832+0000 7fd280be4640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd260066280 0x7fd260068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd270007fd0 tx=0x7fd270009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:54.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.836+0000 7fd2797fa640 1 -- 172.21.15.45:0/2558632758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd268051810 con 0x7fd27c0d2620 2023-07-09T02:11:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd27c0b18d0 con 0x7fd27c0d2620 2023-07-09T02:11:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd2797fa640 1 -- 172.21.15.45:0/2558632758 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd268054e30 con 0x7fd27c0d2620 2023-07-09T02:11:54.995 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd260066280 msgr2=0x7fd260068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd260066280 0x7fd260068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd270007fd0 tx=0x7fd270009040 comp rx=0 tx=0).stop 2023-07-09T02:11:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0d2620 msgr2=0x7fd27c151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0d2620 0x7fd27c151e30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd26800e930 tx=0x7fd26800edf0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 shutdown_connections 2023-07-09T02:11:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd27c15c060 0x7fd27c1536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd27c0d2620 0x7fd27c151e30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.992+0000 7fd282e48640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd260066280 0x7fd260068730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.996+0000 7fd282e48640 1 --2- 172.21.15.45:0/2558632758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd27c0cd120 0x7fd27c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.996+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 >> 172.21.15.45:0/2558632758 conn(0x7fd27c0698e0 msgr2=0x7fd27c154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.996+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 shutdown_connections 2023-07-09T02:11:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:54.996+0000 7fd282e48640 1 -- 172.21.15.45:0/2558632758 wait complete. 2023-07-09T02:11:55.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.156+0000 7f1f51b59640 1 Processor -- start 2023-07-09T02:11:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f51b59640 1 -- start start 2023-07-09T02:11:55.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f51b59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c06c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f51b59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0acde0 con 0x7f1f4c06b800 2023-07-09T02:11:55.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f51b59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c0ad0c0 con 0x7f1f4c0694b0 2023-07-09T02:11:55.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f51b59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0ad3a0 con 0x7f1f4c0ac870 2023-07-09T02:11:55.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1f4c06b800 0x7f1f4c06bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50162/0 (socket says 172.21.15.45:50162) 2023-07-09T02:11:55.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4b7fe640 1 -- 172.21.15.45:0/3285663471 learned_addr learned my addr 172.21.15.45:0/3285663471 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:55.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4affd640 1 --2- 172.21.15.45:0/3285663471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4a7fc640 1 -- 172.21.15.45:0/3285663471 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596837366 0 0) 0x7f1f4c0acde0 con 0x7f1f4c06b800 2023-07-09T02:11:55.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4a7fc640 1 -- 172.21.15.45:0/3285663471 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f34003530 con 0x7f1f4c06b800 2023-07-09T02:11:55.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4a7fc640 1 -- 172.21.15.45:0/3285663471 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460584432 0 0) 0x7f1f4c0ad0c0 con 0x7f1f4c0694b0 2023-07-09T02:11:55.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4affd640 1 -- 172.21.15.45:0/3285663471 >> v1:172.21.15.155:6789/0 conn(0x7f1f4c0694b0 legacy=0x7f1f4c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4affd640 1 -- 172.21.15.45:0/3285663471 >> v1:172.21.15.45:6789/0 conn(0x7f1f4c06b800 legacy=0x7f1f4c06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.160+0000 7f1f4affd640 1 -- 172.21.15.45:0/3285663471 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0cda70 con 0x7f1f4c0ac870 2023-07-09T02:11:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f4affd640 1 --2- 172.21.15.45:0/3285663471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c06c620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f400097f0 tx=0x7f1f4001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9047b4486631e65 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f4a7fc640 1 -- 172.21.15.45:0/3285663471 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400aa610 con 0x7f1f4c0ac870 2023-07-09T02:11:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f4a7fc640 1 -- 172.21.15.45:0/3285663471 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f400a6040 con 0x7f1f4c0ac870 2023-07-09T02:11:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f4a7fc640 1 -- 172.21.15.45:0/3285663471 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400aa990 con 0x7f1f4c0ac870 2023-07-09T02:11:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f51b59640 1 -- 172.21.15.45:0/3285663471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 msgr2=0x7f1f4c06c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f51b59640 1 --2- 172.21.15.45:0/3285663471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c06c620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1f400097f0 tx=0x7f1f4001c490 comp rx=0 tx=0).stop 2023-07-09T02:11:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f51b59640 1 -- 172.21.15.45:0/3285663471 shutdown_connections 2023-07-09T02:11:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f51b59640 1 --2- 172.21.15.45:0/3285663471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c06c620 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f51b59640 1 -- 172.21.15.45:0/3285663471 >> 172.21.15.45:0/3285663471 conn(0x7f1f4c0cfb50 msgr2=0x7f1f4c0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f51b59640 1 -- 172.21.15.45:0/3285663471 shutdown_connections 2023-07-09T02:11:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f51b59640 1 -- 172.21.15.45:0/3285663471 wait complete. 2023-07-09T02:11:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.164+0000 7f1f51b59640 1 Processor -- start 2023-07-09T02:11:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 -- start start 2023-07-09T02:11:55.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f4c0694b0 0x7f1f4c0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f4c06b800 0x7f1f4c0c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c1f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c15d7b0 con 0x7f1f4c0694b0 2023-07-09T02:11:55.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c15dd70 con 0x7f1f4c06b800 2023-07-09T02:11:55.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0c7790 con 0x7f1f4c0ac870 2023-07-09T02:11:55.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f4c0694b0 0x7f1f4c0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f4c0694b0 0x7f1f4c0c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36506/0 (socket says 172.21.15.45:36506) 2023-07-09T02:11:55.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 -- 172.21.15.45:0/3402824509 learned_addr learned my addr 172.21.15.45:0/3402824509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4affd640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f4c06b800 0x7f1f4c0c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4bfff640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c1f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 -- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 msgr2=0x7f1f4c1f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c1f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 -- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f4c06b800 msgr2=0x7f1f4c0c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f4c06b800 0x7f1f4c0c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 -- 172.21.15.45:0/3402824509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40009420 con 0x7f1f4c0694b0 2023-07-09T02:11:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4bfff640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c1f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f4b7fe640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f4c0694b0 0x7f1f4c0c6e90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c480 tx=0x7f1f3c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f33fff640 1 -- 172.21.15.45:0/3402824509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c005cf0 con 0x7f1f4c0694b0 2023-07-09T02:11:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f33fff640 1 -- 172.21.15.45:0/3402824509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c005e50 con 0x7f1f4c0694b0 2023-07-09T02:11:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f33fff640 1 -- 172.21.15.45:0/3402824509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c007290 con 0x7f1f4c0694b0 2023-07-09T02:11:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c0c7a70 con 0x7f1f4c0694b0 2023-07-09T02:11:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c0c73d0 con 0x7f1f4c0694b0 2023-07-09T02:11:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.168+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c04d7d0 con 0x7f1f4c0694b0 2023-07-09T02:11:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.172+0000 7f1f33fff640 1 -- 172.21.15.45:0/3402824509 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f3c0073f0 con 0x7f1f4c0694b0 2023-07-09T02:11:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.172+0000 7f1f33fff640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f38066280 0x7f1f38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.172+0000 7f1f33fff640 1 -- 172.21.15.45:0/3402824509 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f3c0833d0 con 0x7f1f4c0694b0 2023-07-09T02:11:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.172+0000 7f1f4affd640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f38066280 0x7f1f38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.172+0000 7f1f4affd640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f38066280 0x7f1f38068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f400ae000 tx=0x7f1f400b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.176+0000 7f1f33fff640 1 -- 172.21.15.45:0/3402824509 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f3c050840 con 0x7f1f4c0694b0 2023-07-09T02:11:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.328+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f4c0c7c00 con 0x7f1f4c0694b0 2023-07-09T02:11:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.328+0000 7f1f33fff640 1 -- 172.21.15.45:0/3402824509 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f3c053e60 con 0x7f1f4c0694b0 2023-07-09T02:11:55.332 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:55.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f38066280 msgr2=0x7f1f38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f38066280 0x7f1f38068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f400ae000 tx=0x7f1f400b5040 comp rx=0 tx=0).stop 2023-07-09T02:11:55.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f4c0694b0 msgr2=0x7f1f4c0c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f4c0694b0 0x7f1f4c0c6e90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c480 tx=0x7f1f3c00c940 comp rx=0 tx=0).stop 2023-07-09T02:11:55.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 shutdown_connections 2023-07-09T02:11:55.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f38066280 0x7f1f38068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f4c0ac870 0x7f1f4c1f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f4c06b800 0x7f1f4c0c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 --2- 172.21.15.45:0/3402824509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f4c0694b0 0x7f1f4c0c6e90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 >> 172.21.15.45:0/3402824509 conn(0x7f1f4c0cfb50 msgr2=0x7f1f4c0b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 shutdown_connections 2023-07-09T02:11:55.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.332+0000 7f1f51b59640 1 -- 172.21.15.45:0/3402824509 wait complete. 2023-07-09T02:11:55.353 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:55.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f7707856640 1 Processor -- start 2023-07-09T02:11:55.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f7707856640 1 -- start start 2023-07-09T02:11:55.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f7707856640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77000d2620 0x7f77000b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f7707856640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7700160a50 con 0x7f770015c060 2023-07-09T02:11:55.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f7707856640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770015c430 con 0x7f77000cd120 2023-07-09T02:11:55.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f7707856640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770015fb60 con 0x7f77000d2620 2023-07-09T02:11:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f77055f2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f770015c060 0x7f77000d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50172/0 (socket says 172.21.15.45:50172) 2023-07-09T02:11:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f77055f2640 1 -- 172.21.15.45:0/3855664292 learned_addr learned my addr 172.21.15.45:0/3855664292 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f7704df1640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77000d2620 0x7f77000b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503160699 0 0) 0x7f7700160a50 con 0x7f770015c060 2023-07-09T02:11:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ec003530 con 0x7f770015c060 2023-07-09T02:11:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443752540 0 0) 0x7f770015c430 con 0x7f77000cd120 2023-07-09T02:11:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7700160a50 con 0x7f77000cd120 2023-07-09T02:11:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2176644180 0 0) 0x7f76ec003530 con 0x7f770015c060 2023-07-09T02:11:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77000d2620 msgr2=0x7f77000b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77000d2620 0x7f77000b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 >> v1:172.21.15.155:6789/0 conn(0x7f77000cd120 legacy=0x7f77000cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770015fe40 con 0x7f770015c060 2023-07-09T02:11:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f76fc001680 con 0x7f770015c060 2023-07-09T02:11:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 >> v1:172.21.15.45:6789/0 conn(0x7f770015c060 legacy=0x7f77000d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec003b40 0x7f76ec003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.496+0000 7f76f7fff640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec0047d0 0x7f76ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f76f7fff640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77000d2620 0x7f76ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770015fb60 con 0x7f76ec0047d0 2023-07-09T02:11:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec00ba40 con 0x7f76ec003b40 2023-07-09T02:11:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec00bbb0 con 0x7f77000d2620 2023-07-09T02:11:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f7704df1640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec0047d0 0x7f76ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f77055f2640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec003b40 0x7f76ec003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f7705df3640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77000d2620 0x7f76ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f7704df1640 1 -- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77000d2620 msgr2=0x7f76ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f7704df1640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77000d2620 0x7f76ec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f7704df1640 1 -- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec003b40 msgr2=0x7f76ec003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f7704df1640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec003b40 0x7f76ec003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f7704df1640 1 -- 172.21.15.45:0/3855664292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec003530 con 0x7f76ec0047d0 2023-07-09T02:11:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f7704df1640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec0047d0 0x7f76ec004c40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009ab0 tx=0x7f76f001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efdfcca6dc920aa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00a5620 con 0x7f76ec0047d0 2023-07-09T02:11:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00a5780 con 0x7f76ec0047d0 2023-07-09T02:11:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.500+0000 7f76f7fff640 1 -- 172.21.15.45:0/3855664292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00a5b30 con 0x7f76ec0047d0 2023-07-09T02:11:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- 172.21.15.45:0/3855664292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec0047d0 msgr2=0x7f76ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 --2- 172.21.15.45:0/3855664292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76ec0047d0 0x7f76ec004c40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009ab0 tx=0x7f76f001ca30 comp rx=0 tx=0).stop 2023-07-09T02:11:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7705df3640 1 -- 172.21.15.45:0/3855664292 reap_dead start 2023-07-09T02:11:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- 172.21.15.45:0/3855664292 shutdown_connections 2023-07-09T02:11:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- 172.21.15.45:0/3855664292 >> 172.21.15.45:0/3855664292 conn(0x7f77000698e0 msgr2=0x7f7700069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- 172.21.15.45:0/3855664292 shutdown_connections 2023-07-09T02:11:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- 172.21.15.45:0/3855664292 wait complete. 2023-07-09T02:11:55.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 Processor -- start 2023-07-09T02:11:55.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- start start 2023-07-09T02:11:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec0047d0 0x7f770015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015e850 0x7f77001f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77001f2310 0x7f77001f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001f36e0 con 0x7f77001f2310 2023-07-09T02:11:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001f2ca0 con 0x7f76ec0047d0 2023-07-09T02:11:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7707856640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770015efd0 con 0x7f770015e850 2023-07-09T02:11:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7705df3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77001f2310 0x7f77001f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7705df3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77001f2310 0x7f77001f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36536/0 (socket says 172.21.15.45:36536) 2023-07-09T02:11:55.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7705df3640 1 -- 172.21.15.45:0/1262080654 learned_addr learned my addr 172.21.15.45:0/1262080654 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:55.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f77055f2640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec0047d0 0x7f770015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.504+0000 7f7704df1640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015e850 0x7f77001f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7705df3640 1 -- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015e850 msgr2=0x7f77001f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7705df3640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015e850 0x7f77001f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7705df3640 1 -- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec0047d0 msgr2=0x7f770015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7705df3640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec0047d0 0x7f770015e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7705df3640 1 -- 172.21.15.45:0/1262080654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770015f2b0 con 0x7f77001f2310 2023-07-09T02:11:55.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7705df3640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77001f2310 0x7f77001f2760 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f770006ba70 tx=0x7f76f8011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f76f5ffb640 1 -- 172.21.15.45:0/1262080654 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f80136e0 con 0x7f77001f2310 2023-07-09T02:11:55.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f76f5ffb640 1 -- 172.21.15.45:0/1262080654 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f8013840 con 0x7f77001f2310 2023-07-09T02:11:55.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77001f3090 con 0x7f77001f2310 2023-07-09T02:11:55.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f76f5ffb640 1 -- 172.21.15.45:0/1262080654 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8013bf0 con 0x7f77001f2310 2023-07-09T02:11:55.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770015ecc0 con 0x7f77001f2310 2023-07-09T02:11:55.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77001f3850 con 0x7f77001f2310 2023-07-09T02:11:55.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f76f5ffb640 1 -- 172.21.15.45:0/1262080654 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76f8013d50 con 0x7f77001f2310 2023-07-09T02:11:55.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f76f5ffb640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76e4066280 0x7f76e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.508+0000 7f76f5ffb640 1 -- 172.21.15.45:0/1262080654 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76f80864d0 con 0x7f77001f2310 2023-07-09T02:11:55.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.512+0000 7f77055f2640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76e4066280 0x7f76e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.512+0000 7f77055f2640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76e4066280 0x7f76e4068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f76fc000c10 tx=0x7f76fc001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.512+0000 7f76f5ffb640 1 -- 172.21.15.45:0/1262080654 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76f8053960 con 0x7f77001f2310 2023-07-09T02:11:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.668+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f770004d7d0 con 0x7f77001f2310 2023-07-09T02:11:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.668+0000 7f76f5ffb640 1 -- 172.21.15.45:0/1262080654 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76f8056f80 con 0x7f77001f2310 2023-07-09T02:11:55.673 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:55.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76e4066280 msgr2=0x7f76e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76e4066280 0x7f76e4068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f76fc000c10 tx=0x7f76fc001e30 comp rx=0 tx=0).stop 2023-07-09T02:11:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77001f2310 msgr2=0x7f77001f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77001f2310 0x7f77001f2760 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f770006ba70 tx=0x7f76f8011bc0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 shutdown_connections 2023-07-09T02:11:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77001f2310 0x7f77001f2760 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76e4066280 0x7f76e4068730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f770015e850 0x7f77001f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 --2- 172.21.15.45:0/1262080654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76ec0047d0 0x7f770015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 >> 172.21.15.45:0/1262080654 conn(0x7f77000698e0 msgr2=0x7f77000b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 shutdown_connections 2023-07-09T02:11:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.672+0000 7f7707856640 1 -- 172.21.15.45:0/1262080654 wait complete. 2023-07-09T02:11:55.694 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:11:55.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a95f8f640 1 Processor -- start 2023-07-09T02:11:55.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a95f8f640 1 -- start start 2023-07-09T02:11:55.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a95f8f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4a900c8f70 0x7f4a9006b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a95f8f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9006b690 con 0x7f4a90156340 2023-07-09T02:11:55.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a95f8f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9006b970 con 0x7f4a900c9340 2023-07-09T02:11:55.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a95f8f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9006bc50 con 0x7f4a900c8f70 2023-07-09T02:11:55.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4a90156340 0x7f4a900cc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50182/0 (socket says 172.21.15.45:50182) 2023-07-09T02:11:55.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8ffff640 1 -- 172.21.15.45:0/3912310319 learned_addr learned my addr 172.21.15.45:0/3912310319 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:55.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8f7fe640 1 --2- 172.21.15.45:0/3912310319 >> v2:172.21.15.155:3300/0 conn(0x7f4a900c8f70 0x7f4a9006b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585941496 0 0) 0x7f4a9006b690 con 0x7f4a90156340 2023-07-09T02:11:55.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a78003530 con 0x7f4a90156340 2023-07-09T02:11:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907394364 0 0) 0x7f4a9006b970 con 0x7f4a900c9340 2023-07-09T02:11:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a9006b690 con 0x7f4a900c9340 2023-07-09T02:11:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649064192 0 0) 0x7f4a78003530 con 0x7f4a90156340 2023-07-09T02:11:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 >> v2:172.21.15.155:3300/0 conn(0x7f4a900c8f70 msgr2=0x7f4a9006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:55.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 --2- 172.21.15.45:0/3912310319 >> v2:172.21.15.155:3300/0 conn(0x7f4a900c8f70 0x7f4a9006b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 >> v1:172.21.15.155:6789/0 conn(0x7f4a900c9340 legacy=0x7f4a90155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9006bf30 con 0x7f4a90156340 2023-07-09T02:11:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f4a88001a00 con 0x7f4a90156340 2023-07-09T02:11:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 >> v1:172.21.15.45:6789/0 conn(0x7f4a90156340 legacy=0x7f4a900cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78003b10 0x7f4a78003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780047d0 0x7f4a78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a78005180 0x7f4a7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9006bc50 con 0x7f4a780047d0 2023-07-09T02:11:55.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7800bf80 con 0x7f4a78003b10 2023-07-09T02:11:55.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7800e320 con 0x7f4a78005180 2023-07-09T02:11:55.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8f7fe640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78003b10 0x7f4a78003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8effd640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780047d0 0x7f4a78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.836+0000 7f4a8ffff640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a78005180 0x7f4a7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8f7fe640 1 -- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a78005180 msgr2=0x7f4a7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8f7fe640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a78005180 0x7f4a7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8f7fe640 1 -- 172.21.15.45:0/3912310319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780047d0 msgr2=0x7f4a78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8f7fe640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780047d0 0x7f4a78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8f7fe640 1 -- 172.21.15.45:0/3912310319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a78003530 con 0x7f4a78003b10 2023-07-09T02:11:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8effd640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780047d0 0x7f4a78004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8ffff640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a78005180 0x7f4a7800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:11:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8ffff640 1 -- 172.21.15.45:0/3912310319 reap_dead start 2023-07-09T02:11:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8f7fe640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78003b10 0x7f4a78003f00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009ae0 tx=0x7f4a8001ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a356ce12228d7bf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a800a5640 con 0x7f4a78003b10 2023-07-09T02:11:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a800a57a0 con 0x7f4a78003b10 2023-07-09T02:11:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.840+0000 7f4a8e7fc640 1 -- 172.21.15.45:0/3912310319 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a800a5b50 con 0x7f4a78003b10 2023-07-09T02:11:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78003b10 msgr2=0x7f4a78003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78003b10 0x7f4a78003f00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009ae0 tx=0x7f4a8001ca50 comp rx=0 tx=0).stop 2023-07-09T02:11:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3912310319 shutdown_connections 2023-07-09T02:11:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 --2- 172.21.15.45:0/3912310319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78003b10 0x7f4a78003f00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3912310319 >> 172.21.15.45:0/3912310319 conn(0x7f4a900694b0 msgr2=0x7f4a900698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3912310319 shutdown_connections 2023-07-09T02:11:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3912310319 wait complete. 2023-07-09T02:11:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 Processor -- start 2023-07-09T02:11:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- start start 2023-07-09T02:11:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a78003b10 0x7f4a900af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a901e1ee0 0x7f4a901edb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a901ee040 0x7f4a900c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900c3d80 con 0x7f4a78003b10 2023-07-09T02:11:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900c6b60 con 0x7f4a901ee040 2023-07-09T02:11:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a95f8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900c6880 con 0x7f4a901e1ee0 2023-07-09T02:11:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a78003b10 0x7f4a900af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a8f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a78003b10 0x7f4a900af160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36556/0 (socket says 172.21.15.45:36556) 2023-07-09T02:11:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a8f7fe640 1 -- 172.21.15.45:0/3968833819 learned_addr learned my addr 172.21.15.45:0/3968833819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a8effd640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a901e1ee0 0x7f4a901edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.844+0000 7f4a8ffff640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a901ee040 0x7f4a900c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a8f7fe640 1 -- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a901e1ee0 msgr2=0x7f4a901edb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a8f7fe640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a901e1ee0 0x7f4a901edb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a8f7fe640 1 -- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a901ee040 msgr2=0x7f4a900c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a8f7fe640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a901ee040 0x7f4a900c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a8f7fe640 1 -- 172.21.15.45:0/3968833819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a900c36c0 con 0x7f4a78003b10 2023-07-09T02:11:55.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a8f7fe640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a78003b10 0x7f4a900af160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4a8001c880 tx=0x7f4a800197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a77fff640 1 -- 172.21.15.45:0/3968833819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a80004020 con 0x7f4a78003b10 2023-07-09T02:11:55.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a77fff640 1 -- 172.21.15.45:0/3968833819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a800041c0 con 0x7f4a78003b10 2023-07-09T02:11:55.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a77fff640 1 -- 172.21.15.45:0/3968833819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a800b8660 con 0x7f4a78003b10 2023-07-09T02:11:55.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a900c39a0 con 0x7f4a78003b10 2023-07-09T02:11:55.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a901e2350 con 0x7f4a78003b10 2023-07-09T02:11:55.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a901e2540 con 0x7f4a78003b10 2023-07-09T02:11:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a77fff640 1 -- 172.21.15.45:0/3968833819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a800b4070 con 0x7f4a78003b10 2023-07-09T02:11:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a77fff640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a7c066280 0x7f4a7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a77fff640 1 -- 172.21.15.45:0/3968833819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a8011e370 con 0x7f4a78003b10 2023-07-09T02:11:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.848+0000 7f4a8effd640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a7c066280 0x7f4a7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.852+0000 7f4a8effd640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a7c066280 0x7f4a7c068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a84000c10 tx=0x7f4a84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:55.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:55.852+0000 7f4a77fff640 1 -- 172.21.15.45:0/3968833819 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a800eb7e0 con 0x7f4a78003b10 2023-07-09T02:11:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a9004d7d0 con 0x7f4a78003b10 2023-07-09T02:11:56.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a77fff640 1 -- 172.21.15.45:0/3968833819 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4a800eee00 con 0x7f4a78003b10 2023-07-09T02:11:56.022 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:11:56.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a7c066280 msgr2=0x7f4a7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a7c066280 0x7f4a7c068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a84000c10 tx=0x7f4a84009040 comp rx=0 tx=0).stop 2023-07-09T02:11:56.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a78003b10 msgr2=0x7f4a900af160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a78003b10 0x7f4a900af160 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4a8001c880 tx=0x7f4a800197f0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 shutdown_connections 2023-07-09T02:11:56.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a901ee040 0x7f4a900c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a7c066280 0x7f4a7c068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a901e1ee0 0x7f4a901edb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 --2- 172.21.15.45:0/3968833819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a78003b10 0x7f4a900af160 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 >> 172.21.15.45:0/3968833819 conn(0x7f4a900694b0 msgr2=0x7f4a90154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:56.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 shutdown_connections 2023-07-09T02:11:56.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.020+0000 7f4a95f8f640 1 -- 172.21.15.45:0/3968833819 wait complete. 2023-07-09T02:11:56.043 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-09T02:11:56.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:56.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-09T02:11:56.108 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:11:56.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:56.109 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T02:11:56.121 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:56.121 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:56.132 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:56.133 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:56.188 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:11:56.189 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:11:56.239 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:56.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555c39f640 1 Processor -- start 2023-07-09T02:11:56.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555c39f640 1 -- start start 2023-07-09T02:11:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555c39f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555415c060 0x7f55540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555c39f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55540d2620 0x7f55540cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555c39f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5554160a50 con 0x7f55540cd120 2023-07-09T02:11:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555c39f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555415c430 con 0x7f55540d2620 2023-07-09T02:11:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555c39f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555415fb60 con 0x7f555415c060 2023-07-09T02:11:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555993a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f55540cd120 0x7f55540d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50190/0 (socket says 172.21.15.45:50190) 2023-07-09T02:11:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555a93c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55540d2620 0x7f55540cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555993a640 1 -- 172.21.15.45:0/3883727302 learned_addr learned my addr 172.21.15.45:0/3883727302 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555a13b640 1 --2- 172.21.15.45:0/3883727302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555415c060 0x7f55540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555a93c640 1 -- 172.21.15.45:0/3883727302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555415c060 msgr2=0x7f55540b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555a93c640 1 --2- 172.21.15.45:0/3883727302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555415c060 0x7f55540b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555a93c640 1 -- 172.21.15.45:0/3883727302 >> v1:172.21.15.45:6789/0 conn(0x7f55540cd120 legacy=0x7f55540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f555a93c640 1 -- 172.21.15.45:0/3883727302 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555415fe40 con 0x7f55540d2620 2023-07-09T02:11:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.380+0000 7f5559139640 1 -- 172.21.15.45:0/3883727302 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293556448 0 0) 0x7f5554160a50 con 0x7f55540cd120 2023-07-09T02:11:56.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555a93c640 1 --2- 172.21.15.45:0/3883727302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f55540cee30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f554c009dc0 tx=0x7f554c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad825e91de54570 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:56.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f5559139640 1 -- 172.21.15.45:0/3883727302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0a59c0 con 0x7f55540d2620 2023-07-09T02:11:56.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f5559139640 1 -- 172.21.15.45:0/3883727302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c0a5b20 con 0x7f55540d2620 2023-07-09T02:11:56.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f5559139640 1 -- 172.21.15.45:0/3883727302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0ad440 con 0x7f55540d2620 2023-07-09T02:11:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555c39f640 1 -- 172.21.15.45:0/3883727302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 msgr2=0x7f55540cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555c39f640 1 --2- 172.21.15.45:0/3883727302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f55540cee30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f554c009dc0 tx=0x7f554c01c900 comp rx=0 tx=0).stop 2023-07-09T02:11:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555c39f640 1 -- 172.21.15.45:0/3883727302 shutdown_connections 2023-07-09T02:11:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555c39f640 1 --2- 172.21.15.45:0/3883727302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f55540cee30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555c39f640 1 --2- 172.21.15.45:0/3883727302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555415c060 0x7f55540b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555c39f640 1 -- 172.21.15.45:0/3883727302 >> 172.21.15.45:0/3883727302 conn(0x7f55540698e0 msgr2=0x7f5554069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555c39f640 1 -- 172.21.15.45:0/3883727302 shutdown_connections 2023-07-09T02:11:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.384+0000 7f555c39f640 1 -- 172.21.15.45:0/3883727302 wait complete. 2023-07-09T02:11:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 Processor -- start 2023-07-09T02:11:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 -- start start 2023-07-09T02:11:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55540cd120 0x7f555415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f555414a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555415c060 0x7f5554153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555415a1e0 con 0x7f55540d2620 2023-07-09T02:11:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540b3150 con 0x7f555415c060 2023-07-09T02:11:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555415a480 con 0x7f55540cd120 2023-07-09T02:11:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f555414a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f555414a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36566/0 (socket says 172.21.15.45:36566) 2023-07-09T02:11:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 -- 172.21.15.45:0/597200714 learned_addr learned my addr 172.21.15.45:0/597200714 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555a13b640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55540cd120 0x7f555415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555a93c640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555415c060 0x7f5554153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 -- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55540cd120 msgr2=0x7f555415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55540cd120 0x7f555415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 -- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555415c060 msgr2=0x7f5554153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555415c060 0x7f5554153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 -- 172.21.15.45:0/597200714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c009a70 con 0x7f55540d2620 2023-07-09T02:11:56.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555993a640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f555414a520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f554400c4b0 tx=0x7f554400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f554affd640 1 -- 172.21.15.45:0/597200714 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440074e0 con 0x7f55540d2620 2023-07-09T02:11:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f554affd640 1 -- 172.21.15.45:0/597200714 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544007660 con 0x7f55540d2620 2023-07-09T02:11:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55540b59f0 con 0x7f55540d2620 2023-07-09T02:11:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f554affd640 1 -- 172.21.15.45:0/597200714 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544004a30 con 0x7f55540d2620 2023-07-09T02:11:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555415aa40 con 0x7f55540d2620 2023-07-09T02:11:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.388+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555415b4a0 con 0x7f55540d2620 2023-07-09T02:11:56.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.392+0000 7f554affd640 1 -- 172.21.15.45:0/597200714 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5544004b90 con 0x7f55540d2620 2023-07-09T02:11:56.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.392+0000 7f554affd640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5538066280 0x7f5538068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.392+0000 7f554affd640 1 -- 172.21.15.45:0/597200714 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5544083150 con 0x7f55540d2620 2023-07-09T02:11:56.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.392+0000 7f555a13b640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5538066280 0x7f5538068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.392+0000 7f555a13b640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5538066280 0x7f5538068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f55540b4340 tx=0x7f5550008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:56.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.396+0000 7f554affd640 1 -- 172.21.15.45:0/597200714 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5544050730 con 0x7f55540d2620 2023-07-09T02:11:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.552+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f555415ac60 con 0x7f55540d2620 2023-07-09T02:11:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.552+0000 7f554affd640 1 -- 172.21.15.45:0/597200714 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f5544053d50 con 0x7f55540d2620 2023-07-09T02:11:56.557 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5538066280 msgr2=0x7f5538068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5538066280 0x7f5538068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f55540b4340 tx=0x7f5550008040 comp rx=0 tx=0).stop 2023-07-09T02:11:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 msgr2=0x7f555414a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f555414a520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f554400c4b0 tx=0x7f554400c970 comp rx=0 tx=0).stop 2023-07-09T02:11:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 shutdown_connections 2023-07-09T02:11:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555415c060 0x7f5554153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55540d2620 0x7f555414a520 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5538066280 0x7f5538068730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 --2- 172.21.15.45:0/597200714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55540cd120 0x7f555415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 >> 172.21.15.45:0/597200714 conn(0x7f55540698e0 msgr2=0x7f55541582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 shutdown_connections 2023-07-09T02:11:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.556+0000 7f555c39f640 1 -- 172.21.15.45:0/597200714 wait complete. 2023-07-09T02:11:56.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:56.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9bfc5640 1 Processor -- start 2023-07-09T02:11:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9bfc5640 1 -- start start 2023-07-09T02:11:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9bfc5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdd940d2620 0x7fdd940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9bfc5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd940cd120 0x7fdd940cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9bfc5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd94160a50 con 0x7fdd9415c060 2023-07-09T02:11:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9bfc5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9415c430 con 0x7fdd940d2620 2023-07-09T02:11:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9bfc5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9415fb60 con 0x7fdd940cd120 2023-07-09T02:11:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd99d61640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdd9415c060 0x7fdd940d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50194/0 (socket says 172.21.15.45:50194) 2023-07-09T02:11:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd99d61640 1 -- 172.21.15.45:0/3567933407 learned_addr learned my addr 172.21.15.45:0/3567933407 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd99560640 1 --2- 172.21.15.45:0/3567933407 >> v2:172.21.15.45:3300/0 conn(0x7fdd940d2620 0x7fdd940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9a562640 1 --2- 172.21.15.45:0/3567933407 >> v2:172.21.15.155:3300/0 conn(0x7fdd940cd120 0x7fdd940cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd99560640 1 -- 172.21.15.45:0/3567933407 >> v2:172.21.15.155:3300/0 conn(0x7fdd940cd120 msgr2=0x7fdd940cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd99560640 1 --2- 172.21.15.45:0/3567933407 >> v2:172.21.15.155:3300/0 conn(0x7fdd940cd120 0x7fdd940cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd99560640 1 -- 172.21.15.45:0/3567933407 >> v1:172.21.15.45:6789/0 conn(0x7fdd9415c060 legacy=0x7fdd940d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd99560640 1 -- 172.21.15.45:0/3567933407 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9415fe40 con 0x7fdd940d2620 2023-07-09T02:11:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd9a562640 1 --2- 172.21.15.45:0/3567933407 >> v2:172.21.15.155:3300/0 conn(0x7fdd940cd120 0x7fdd940cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.724+0000 7fdd98d5f640 1 -- 172.21.15.45:0/3567933407 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616642204 0 0) 0x7fdd94160a50 con 0x7fdd9415c060 2023-07-09T02:11:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd99560640 1 --2- 172.21.15.45:0/3567933407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940d2620 0x7fdd940b4ed0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdd9406b120 tx=0x7fdd8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41910c352d2df02c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd98d5f640 1 -- 172.21.15.45:0/3567933407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840a7070 con 0x7fdd940d2620 2023-07-09T02:11:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd98d5f640 1 -- 172.21.15.45:0/3567933407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd840ab430 con 0x7fdd940d2620 2023-07-09T02:11:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd98d5f640 1 -- 172.21.15.45:0/3567933407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840ab7c0 con 0x7fdd940d2620 2023-07-09T02:11:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/3567933407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940d2620 msgr2=0x7fdd940b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/3567933407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940d2620 0x7fdd940b4ed0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdd9406b120 tx=0x7fdd8401c430 comp rx=0 tx=0).stop 2023-07-09T02:11:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/3567933407 shutdown_connections 2023-07-09T02:11:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/3567933407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940d2620 0x7fdd940b4ed0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/3567933407 >> v2:172.21.15.155:3300/0 conn(0x7fdd940cd120 0x7fdd940cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/3567933407 >> 172.21.15.45:0/3567933407 conn(0x7fdd940698e0 msgr2=0x7fdd94069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/3567933407 shutdown_connections 2023-07-09T02:11:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.728+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/3567933407 wait complete. 2023-07-09T02:11:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 Processor -- start 2023-07-09T02:11:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 -- start start 2023-07-09T02:11:56.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940cd120 0x7fdd941665e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd940d2620 0x7fdd9415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9415c060 0x7fdd9415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94157860 con 0x7fdd940cd120 2023-07-09T02:11:56.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94166b20 con 0x7fdd940d2620 2023-07-09T02:11:56.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940cc740 con 0x7fdd9415c060 2023-07-09T02:11:56.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940cd120 0x7fdd941665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940cd120 0x7fdd941665e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36588/0 (socket says 172.21.15.45:36588) 2023-07-09T02:11:56.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 -- 172.21.15.45:0/2695090004 learned_addr learned my addr 172.21.15.45:0/2695090004 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:56.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9a562640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9415c060 0x7fdd9415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99560640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd940d2620 0x7fdd9415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 -- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9415c060 msgr2=0x7fdd9415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9415c060 0x7fdd9415b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 -- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd940d2620 msgr2=0x7fdd9415abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd940d2620 0x7fdd9415abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 -- 172.21.15.45:0/2695090004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009420 con 0x7fdd940cd120 2023-07-09T02:11:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd99d61640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940cd120 0x7fdd941665e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c480 tx=0x7fdd9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd8a7fc640 1 -- 172.21.15.45:0/2695090004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900074e0 con 0x7fdd940cd120 2023-07-09T02:11:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd8a7fc640 1 -- 172.21.15.45:0/2695090004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd90007660 con 0x7fdd940cd120 2023-07-09T02:11:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd940b59f0 con 0x7fdd940cd120 2023-07-09T02:11:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd8a7fc640 1 -- 172.21.15.45:0/2695090004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90004a30 con 0x7fdd940cd120 2023-07-09T02:11:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.732+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd940cbe10 con 0x7fdd940cd120 2023-07-09T02:11:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.736+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9404d7d0 con 0x7fdd940cd120 2023-07-09T02:11:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.736+0000 7fdd8a7fc640 1 -- 172.21.15.45:0/2695090004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd90004b90 con 0x7fdd940cd120 2023-07-09T02:11:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.736+0000 7fdd8a7fc640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdd780662b0 0x7fdd78068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.736+0000 7fdd8a7fc640 1 -- 172.21.15.45:0/2695090004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd90082d20 con 0x7fdd940cd120 2023-07-09T02:11:56.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.736+0000 7fdd99560640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdd780662b0 0x7fdd78068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:56.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.736+0000 7fdd99560640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdd780662b0 0x7fdd78068760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdd840af000 tx=0x7fdd840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:56.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.740+0000 7fdd8a7fc640 1 -- 172.21.15.45:0/2695090004 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd900502e0 con 0x7fdd940cd120 2023-07-09T02:11:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd9406baa0 con 0x7fdd940cd120 2023-07-09T02:11:56.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd8a7fc640 1 -- 172.21.15.45:0/2695090004 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd90018020 con 0x7fdd940cd120 2023-07-09T02:11:56.898 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdd780662b0 msgr2=0x7fdd78068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdd780662b0 0x7fdd78068760 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdd840af000 tx=0x7fdd840a7000 comp rx=0 tx=0).stop 2023-07-09T02:11:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940cd120 msgr2=0x7fdd941665e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940cd120 0x7fdd941665e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c480 tx=0x7fdd9000c940 comp rx=0 tx=0).stop 2023-07-09T02:11:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 shutdown_connections 2023-07-09T02:11:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdd780662b0 0x7fdd78068760 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9415c060 0x7fdd9415b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd940d2620 0x7fdd9415abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 --2- 172.21.15.45:0/2695090004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd940cd120 0x7fdd941665e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 >> 172.21.15.45:0/2695090004 conn(0x7fdd940698e0 msgr2=0x7fdd940b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 shutdown_connections 2023-07-09T02:11:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:56.896+0000 7fdd9bfc5640 1 -- 172.21.15.45:0/2695090004 wait complete. 2023-07-09T02:11:56.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:57.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.060+0000 7f04a1f98640 1 Processor -- start 2023-07-09T02:11:57.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.060+0000 7f04a1f98640 1 -- start start 2023-07-09T02:11:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a1f98640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f049c0b1bc0 0x7f049c069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a1f98640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f049c0b68b0 0x7f049c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a1f98640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c0ceff0 con 0x7f049c0d2400 2023-07-09T02:11:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a1f98640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0cea70 con 0x7f049c0b1bc0 2023-07-09T02:11:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a1f98640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0b1f90 con 0x7f049c0b68b0 2023-07-09T02:11:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a0f96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f049c0b1bc0 0x7f049c069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a0f96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f049c0b1bc0 0x7f049c069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36590/0 (socket says 172.21.15.45:36590) 2023-07-09T02:11:57.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a0f96640 1 -- 172.21.15.45:0/3562394792 learned_addr learned my addr 172.21.15.45:0/3562394792 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a1797640 1 --2- 172.21.15.45:0/3562394792 >> v2:172.21.15.155:3300/0 conn(0x7f049c0b68b0 0x7f049c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a0f96640 1 -- 172.21.15.45:0/3562394792 >> v2:172.21.15.155:3300/0 conn(0x7f049c0b68b0 msgr2=0x7f049c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a0f96640 1 --2- 172.21.15.45:0/3562394792 >> v2:172.21.15.155:3300/0 conn(0x7f049c0b68b0 0x7f049c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a0f96640 1 -- 172.21.15.45:0/3562394792 >> v1:172.21.15.155:6789/0 conn(0x7f049c0d2400 legacy=0x7f049c070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.064+0000 7f04a0f96640 1 -- 172.21.15.45:0/3562394792 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0d1500 con 0x7f049c0b1bc0 2023-07-09T02:11:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a0f96640 1 --2- 172.21.15.45:0/3562394792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c069870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f049c066170 tx=0x7f049001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4051214b9b7e8ae5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f049b7fe640 1 -- 172.21.15.45:0/3562394792 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900aa5f0 con 0x7f049c0b1bc0 2023-07-09T02:11:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f049b7fe640 1 -- 172.21.15.45:0/3562394792 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04900aa750 con 0x7f049c0b1bc0 2023-07-09T02:11:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f049b7fe640 1 -- 172.21.15.45:0/3562394792 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900aaae0 con 0x7f049c0b1bc0 2023-07-09T02:11:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 -- 172.21.15.45:0/3562394792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 msgr2=0x7f049c069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 --2- 172.21.15.45:0/3562394792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c069870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f049c066170 tx=0x7f049001c490 comp rx=0 tx=0).stop 2023-07-09T02:11:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 -- 172.21.15.45:0/3562394792 shutdown_connections 2023-07-09T02:11:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 --2- 172.21.15.45:0/3562394792 >> v2:172.21.15.155:3300/0 conn(0x7f049c0b68b0 0x7f049c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 --2- 172.21.15.45:0/3562394792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c069870 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 -- 172.21.15.45:0/3562394792 >> 172.21.15.45:0/3562394792 conn(0x7f049c0d35b0 msgr2=0x7f049c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 -- 172.21.15.45:0/3562394792 shutdown_connections 2023-07-09T02:11:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 -- 172.21.15.45:0/3562394792 wait complete. 2023-07-09T02:11:57.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 Processor -- start 2023-07-09T02:11:57.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 -- start start 2023-07-09T02:11:57.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.068+0000 7f04a1f98640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0b68b0 0x7f049c0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1f98640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0d2400 0x7f049c15d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1f98640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c15cd90 con 0x7f049c0b1bc0 2023-07-09T02:11:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1f98640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c9f50 con 0x7f049c0d2400 2023-07-09T02:11:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1f98640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c9990 con 0x7f049c0b68b0 2023-07-09T02:11:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c0caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36594/0 (socket says 172.21.15.45:36594) 2023-07-09T02:11:57.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 -- 172.21.15.45:0/560468645 learned_addr learned my addr 172.21.15.45:0/560468645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:57.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f049bfff640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0b68b0 0x7f049c0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1797640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0d2400 0x7f049c15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 -- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0b68b0 msgr2=0x7f049c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0b68b0 0x7f049c0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 -- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0d2400 msgr2=0x7f049c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0d2400 0x7f049c15d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 -- 172.21.15.45:0/560468645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900094d0 con 0x7f049c0b1bc0 2023-07-09T02:11:57.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1797640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0d2400 0x7f049c15d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:57.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a0f96640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c0caf20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f04900ac040 tx=0x7f049001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04997fa640 1 -- 172.21.15.45:0/560468645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900b3800 con 0x7f049c0b1bc0 2023-07-09T02:11:57.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04997fa640 1 -- 172.21.15.45:0/560468645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04900b3980 con 0x7f049c0b1bc0 2023-07-09T02:11:57.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04997fa640 1 -- 172.21.15.45:0/560468645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900b3d30 con 0x7f049c0b1bc0 2023-07-09T02:11:57.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0c9c70 con 0x7f049c0b1bc0 2023-07-09T02:11:57.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c15ca20 con 0x7f049c0b1bc0 2023-07-09T02:11:57.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c04e020 con 0x7f049c0b1bc0 2023-07-09T02:11:57.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.072+0000 7f04997fa640 1 -- 172.21.15.45:0/560468645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04900b2380 con 0x7f049c0b1bc0 2023-07-09T02:11:57.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.076+0000 7f04997fa640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f04800662b0 0x7f0480068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.076+0000 7f04997fa640 1 -- 172.21.15.45:0/560468645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04900a7070 con 0x7f049c0b1bc0 2023-07-09T02:11:57.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.076+0000 7f049bfff640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f04800662b0 0x7f0480068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.076+0000 7f049bfff640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f04800662b0 0x7f0480068760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f049c159ac0 tx=0x7f0488009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.080+0000 7f04997fa640 1 -- 172.21.15.45:0/560468645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04900eb7e0 con 0x7f049c0b1bc0 2023-07-09T02:11:57.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f049c0cdd80 con 0x7f049c0b1bc0 2023-07-09T02:11:57.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04997fa640 1 -- 172.21.15.45:0/560468645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f04900eee00 con 0x7f049c0b1bc0 2023-07-09T02:11:57.238 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:57.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f04800662b0 msgr2=0x7f0480068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f04800662b0 0x7f0480068760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f049c159ac0 tx=0x7f0488009060 comp rx=0 tx=0).stop 2023-07-09T02:11:57.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 msgr2=0x7f049c0caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c0caf20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f04900ac040 tx=0x7f049001acd0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 shutdown_connections 2023-07-09T02:11:57.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0d2400 0x7f049c15d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f04800662b0 0x7f0480068760 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0b68b0 0x7f049c0cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 --2- 172.21.15.45:0/560468645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f049c0b1bc0 0x7f049c0caf20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 >> 172.21.15.45:0/560468645 conn(0x7f049c0d35b0 msgr2=0x7f049c0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 shutdown_connections 2023-07-09T02:11:57.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.236+0000 7f04a1f98640 1 -- 172.21.15.45:0/560468645 wait complete. 2023-07-09T02:11:57.259 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:57.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16cde19640 1 Processor -- start 2023-07-09T02:11:57.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16cde19640 1 -- start start 2023-07-09T02:11:57.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16cde19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80d2620 0x7f16c80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16cde19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c8160a50 con 0x7f16c815c060 2023-07-09T02:11:57.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16cde19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c815c430 con 0x7f16c80cd120 2023-07-09T02:11:57.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16cde19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c815fb60 con 0x7f16c80d2620 2023-07-09T02:11:57.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f16c815c060 0x7f16c80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50198/0 (socket says 172.21.15.45:50198) 2023-07-09T02:11:57.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c77fe640 1 -- 172.21.15.45:0/2014946104 learned_addr learned my addr 172.21.15.45:0/2014946104 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:57.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c6ffd640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80d2620 0x7f16c80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547928222 0 0) 0x7f16c8160a50 con 0x7f16c815c060 2023-07-09T02:11:57.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b0003530 con 0x7f16c815c060 2023-07-09T02:11:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263970146 0 0) 0x7f16c815c430 con 0x7f16c80cd120 2023-07-09T02:11:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c8160a50 con 0x7f16c80cd120 2023-07-09T02:11:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334780824 0 0) 0x7f16b0003530 con 0x7f16c815c060 2023-07-09T02:11:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80d2620 msgr2=0x7f16c80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80d2620 0x7f16c80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 >> v1:172.21.15.155:6789/0 conn(0x7f16c80cd120 legacy=0x7f16c80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c815fe40 con 0x7f16c815c060 2023-07-09T02:11:57.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f16b8001680 con 0x7f16c815c060 2023-07-09T02:11:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 >> v1:172.21.15.45:6789/0 conn(0x7f16c815c060 legacy=0x7f16c80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80d2620 0x7f16b0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16b00040a0 0x7f16b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c815fb60 con 0x7f16b0004d10 2023-07-09T02:11:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b000ba40 con 0x7f16b00040a0 2023-07-09T02:11:57.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b000bc00 con 0x7f16c80d2620 2023-07-09T02:11:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c7fff640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c77fe640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80d2620 0x7f16b0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c6ffd640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16b00040a0 0x7f16b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c7fff640 1 -- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80d2620 msgr2=0x7f16b0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c7fff640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80d2620 0x7f16b0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c7fff640 1 -- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16b00040a0 msgr2=0x7f16b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c7fff640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16b00040a0 0x7f16b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.404+0000 7f16c7fff640 1 -- 172.21.15.45:0/2014946104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b0003530 con 0x7f16b0004d10 2023-07-09T02:11:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16c7fff640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16b0005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16c0007fd0 tx=0x7f16c001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c6366ca7289717 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8007ea0 con 0x7f16b0004d10 2023-07-09T02:11:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c0003ba0 con 0x7f16b0004d10 2023-07-09T02:11:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16c67fc640 1 -- 172.21.15.45:0/2014946104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c00050d0 con 0x7f16b0004d10 2023-07-09T02:11:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16cde19640 1 -- 172.21.15.45:0/2014946104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 msgr2=0x7f16b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16cde19640 1 --2- 172.21.15.45:0/2014946104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16b0005180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16c0007fd0 tx=0x7f16c001c8c0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16c7fff640 1 -- 172.21.15.45:0/2014946104 reap_dead start 2023-07-09T02:11:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16cde19640 1 -- 172.21.15.45:0/2014946104 shutdown_connections 2023-07-09T02:11:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16cde19640 1 -- 172.21.15.45:0/2014946104 >> 172.21.15.45:0/2014946104 conn(0x7f16c80698e0 msgr2=0x7f16c8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16cde19640 1 -- 172.21.15.45:0/2014946104 shutdown_connections 2023-07-09T02:11:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.408+0000 7f16cde19640 1 -- 172.21.15.45:0/2014946104 wait complete. 2023-07-09T02:11:57.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 Processor -- start 2023-07-09T02:11:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 -- start start 2023-07-09T02:11:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16c8156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80b6e40 0x7f16c80b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c80cc550 0x7f16c80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80b77d0 con 0x7f16b0004d10 2023-07-09T02:11:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80ccf00 con 0x7f16c80cc550 2023-07-09T02:11:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80ca050 con 0x7f16c80b6e40 2023-07-09T02:11:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16c8156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16c8156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36614/0 (socket says 172.21.15.45:36614) 2023-07-09T02:11:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 -- 172.21.15.45:0/1256095403 learned_addr learned my addr 172.21.15.45:0/1256095403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c6ffd640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80b6e40 0x7f16c80b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c7fff640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c80cc550 0x7f16c80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 -- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80b6e40 msgr2=0x7f16c80b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80b6e40 0x7f16c80b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 -- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c80cc550 msgr2=0x7f16c80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c80cc550 0x7f16c80cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 -- 172.21.15.45:0/1256095403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80ca330 con 0x7f16b0004d10 2023-07-09T02:11:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16c77fe640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16c8156f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f16b8012540 tx=0x7f16b8012940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16affff640 1 -- 172.21.15.45:0/1256095403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8005780 con 0x7f16b0004d10 2023-07-09T02:11:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16affff640 1 -- 172.21.15.45:0/1256095403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8014750 con 0x7f16b0004d10 2023-07-09T02:11:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c80ca610 con 0x7f16b0004d10 2023-07-09T02:11:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16affff640 1 -- 172.21.15.45:0/1256095403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8014b00 con 0x7f16b0004d10 2023-07-09T02:11:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.412+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c80cabd0 con 0x7f16b0004d10 2023-07-09T02:11:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.416+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c804d7d0 con 0x7f16b0004d10 2023-07-09T02:11:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.416+0000 7f16affff640 1 -- 172.21.15.45:0/1256095403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16b8014c60 con 0x7f16b0004d10 2023-07-09T02:11:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.416+0000 7f16affff640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16b40662b0 0x7f16b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.416+0000 7f16affff640 1 -- 172.21.15.45:0/1256095403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16b8086700 con 0x7f16b0004d10 2023-07-09T02:11:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.416+0000 7f16c6ffd640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16b40662b0 0x7f16b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.416+0000 7f16c6ffd640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16b40662b0 0x7f16b4068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f16c80b83a0 tx=0x7f16bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.420+0000 7f16affff640 1 -- 172.21.15.45:0/1256095403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16b8053c20 con 0x7f16b0004d10 2023-07-09T02:11:57.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16c806baa0 con 0x7f16b0004d10 2023-07-09T02:11:57.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16affff640 1 -- 172.21.15.45:0/1256095403 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16b8057240 con 0x7f16b0004d10 2023-07-09T02:11:57.578 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:11:57.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16b40662b0 msgr2=0x7f16b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16b40662b0 0x7f16b4068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f16c80b83a0 tx=0x7f16bc009190 comp rx=0 tx=0).stop 2023-07-09T02:11:57.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 msgr2=0x7f16c8156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16c8156f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f16b8012540 tx=0x7f16b8012940 comp rx=0 tx=0).stop 2023-07-09T02:11:57.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 shutdown_connections 2023-07-09T02:11:57.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16c80cc550 0x7f16c80cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f16b40662b0 0x7f16b4068760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16c80b6e40 0x7f16c80b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 --2- 172.21.15.45:0/1256095403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b0004d10 0x7f16c8156f10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 >> 172.21.15.45:0/1256095403 conn(0x7f16c80698e0 msgr2=0x7f16c80b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:57.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 shutdown_connections 2023-07-09T02:11:57.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.576+0000 7f16cde19640 1 -- 172.21.15.45:0/1256095403 wait complete. 2023-07-09T02:11:57.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:11:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.740+0000 7f207359f640 1 Processor -- start 2023-07-09T02:11:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.740+0000 7f207359f640 1 -- start start 2023-07-09T02:11:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f207359f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f206c0d2620 0x7f206c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f207359f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 0x7f206c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f207359f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c160a50 con 0x7f206c15c060 2023-07-09T02:11:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f207359f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c15c430 con 0x7f206c0d2620 2023-07-09T02:11:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f207359f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15fb60 con 0x7f206c0cd120 2023-07-09T02:11:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f207133b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f206c15c060 0x7f206c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50206/0 (socket says 172.21.15.45:50206) 2023-07-09T02:11:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f207133b640 1 -- 172.21.15.45:0/2535206867 learned_addr learned my addr 172.21.15.45:0/2535206867 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387964727 0 0) 0x7f206c160a50 con 0x7f206c15c060 2023-07-09T02:11:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2070b3a640 1 --2- 172.21.15.45:0/2535206867 >> v2:172.21.15.155:3300/0 conn(0x7f206c0d2620 0x7f206c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2058003530 con 0x7f206c15c060 2023-07-09T02:11:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2071b3c640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 0x7f206c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2237375768 0 0) 0x7f2058003530 con 0x7f206c15c060 2023-07-09T02:11:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 msgr2=0x7f206c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 0x7f206c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 >> v2:172.21.15.155:3300/0 conn(0x7f206c0d2620 msgr2=0x7f206c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 --2- 172.21.15.45:0/2535206867 >> v2:172.21.15.155:3300/0 conn(0x7f206c0d2620 0x7f206c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c15fe40 con 0x7f206c15c060 2023-07-09T02:11:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f2068001680 con 0x7f206c15c060 2023-07-09T02:11:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2071b3c640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 0x7f206c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 >> v1:172.21.15.45:6789/0 conn(0x7f206c15c060 legacy=0x7f206c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2058003980 0x7f2058003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20580043b0 0x7f2058004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 0x7f2058004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15c430 con 0x7f20580043b0 2023-07-09T02:11:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15fb60 con 0x7f2058003980 2023-07-09T02:11:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205800b990 con 0x7f206c0cd120 2023-07-09T02:11:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2070b3a640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20580043b0 0x7f2058004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f207133b640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2058003980 0x7f2058003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2071b3c640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 0x7f2058004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2070b3a640 1 -- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 msgr2=0x7f2058004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2070b3a640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 0x7f2058004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2070b3a640 1 -- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2058003980 msgr2=0x7f2058003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2070b3a640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2058003980 0x7f2058003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2070b3a640 1 -- 172.21.15.45:0/2535206867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058003530 con 0x7f20580043b0 2023-07-09T02:11:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.744+0000 7f2071b3c640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c0cd120 0x7f2058004fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f2070b3a640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20580043b0 0x7f2058004870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f205c009ab0 tx=0x7f205c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973ade36d6bf99c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c0a5660 con 0x7f20580043b0 2023-07-09T02:11:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c0a57c0 con 0x7f20580043b0 2023-07-09T02:11:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f2063fff640 1 -- 172.21.15.45:0/2535206867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c0a5b70 con 0x7f20580043b0 2023-07-09T02:11:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f207359f640 1 -- 172.21.15.45:0/2535206867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20580043b0 msgr2=0x7f2058004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f207359f640 1 --2- 172.21.15.45:0/2535206867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20580043b0 0x7f2058004870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f205c009ab0 tx=0x7f205c01ca70 comp rx=0 tx=0).stop 2023-07-09T02:11:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f2071b3c640 1 -- 172.21.15.45:0/2535206867 reap_dead start 2023-07-09T02:11:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f207359f640 1 -- 172.21.15.45:0/2535206867 shutdown_connections 2023-07-09T02:11:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f207359f640 1 -- 172.21.15.45:0/2535206867 >> 172.21.15.45:0/2535206867 conn(0x7f206c0698e0 msgr2=0x7f206c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f207359f640 1 -- 172.21.15.45:0/2535206867 shutdown_connections 2023-07-09T02:11:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.748+0000 7f207359f640 1 -- 172.21.15.45:0/2535206867 wait complete. 2023-07-09T02:11:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 Processor -- start 2023-07-09T02:11:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 -- start start 2023-07-09T02:11:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20580043b0 0x7f206c0b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f206c0c8d80 0x7f206c1e8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c147bf0 0x7f206c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0b6990 con 0x7f206c0c8d80 2023-07-09T02:11:57.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c1e89c0 con 0x7f20580043b0 2023-07-09T02:11:57.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0c91f0 con 0x7f206c147bf0 2023-07-09T02:11:57.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f206c0c8d80 0x7f206c1e8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f206c0c8d80 0x7f206c1e8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36630/0 (socket says 172.21.15.45:36630) 2023-07-09T02:11:57.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 -- 172.21.15.45:0/1736116317 learned_addr learned my addr 172.21.15.45:0/1736116317 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207133b640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20580043b0 0x7f206c0b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2071b3c640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c147bf0 0x7f206c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 -- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c147bf0 msgr2=0x7f206c148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c147bf0 0x7f206c148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 -- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20580043b0 msgr2=0x7f206c0b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20580043b0 0x7f206c0b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 -- 172.21.15.45:0/1736116317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c15f3f0 con 0x7f206c0c8d80 2023-07-09T02:11:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2070b3a640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f206c0c8d80 0x7f206c1e8480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f205c0b0040 tx=0x7f2058005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2061ffb640 1 -- 172.21.15.45:0/1736116317 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c004220 con 0x7f206c0c8d80 2023-07-09T02:11:57.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2061ffb640 1 -- 172.21.15.45:0/1736116317 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c0043c0 con 0x7f206c0c8d80 2023-07-09T02:11:57.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f2061ffb640 1 -- 172.21.15.45:0/1736116317 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c003860 con 0x7f206c0c8d80 2023-07-09T02:11:57.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c0b6b80 con 0x7f206c0c8d80 2023-07-09T02:11:57.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c0b7140 con 0x7f206c0c8d80 2023-07-09T02:11:57.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.752+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c0d15c0 con 0x7f206c0c8d80 2023-07-09T02:11:57.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.756+0000 7f2061ffb640 1 -- 172.21.15.45:0/1736116317 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f205c0b4040 con 0x7f206c0c8d80 2023-07-09T02:11:57.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.756+0000 7f2061ffb640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f20500662b0 0x7f2050068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:57.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.756+0000 7f2061ffb640 1 -- 172.21.15.45:0/1736116317 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f205c11e0b0 con 0x7f206c0c8d80 2023-07-09T02:11:57.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.756+0000 7f207133b640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f20500662b0 0x7f2050068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:57.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.756+0000 7f207133b640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f20500662b0 0x7f2050068760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f206c0b53f0 tx=0x7f2068007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:57.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.760+0000 7f2061ffb640 1 -- 172.21.15.45:0/1736116317 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f205c0eb5d0 con 0x7f206c0c8d80 2023-07-09T02:11:57.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.912+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f206c04d7d0 con 0x7f206c0c8d80 2023-07-09T02:11:57.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.912+0000 7f2061ffb640 1 -- 172.21.15.45:0/1736116317 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f205c0eebf0 con 0x7f206c0c8d80 2023-07-09T02:11:57.917 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:11:57.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f20500662b0 msgr2=0x7f2050068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f20500662b0 0x7f2050068760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f206c0b53f0 tx=0x7f2068007900 comp rx=0 tx=0).stop 2023-07-09T02:11:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f206c0c8d80 msgr2=0x7f206c1e8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f206c0c8d80 0x7f206c1e8480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f205c0b0040 tx=0x7f2058005800 comp rx=0 tx=0).stop 2023-07-09T02:11:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 shutdown_connections 2023-07-09T02:11:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f20500662b0 0x7f2050068760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f206c147bf0 0x7f206c148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f206c0c8d80 0x7f206c1e8480 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 --2- 172.21.15.45:0/1736116317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20580043b0 0x7f206c0b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:57.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 >> 172.21.15.45:0/1736116317 conn(0x7f206c0698e0 msgr2=0x7f206c0b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:57.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 shutdown_connections 2023-07-09T02:11:57.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:57.916+0000 7f207359f640 1 -- 172.21.15.45:0/1736116317 wait complete. 2023-07-09T02:11:57.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:11:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f872e1ad640 1 Processor -- start 2023-07-09T02:11:58.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f872e1ad640 1 -- start start 2023-07-09T02:11:58.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f872e1ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8728158e30 0x7f872806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f872e1ad640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f872806fd10 0x7f872806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f872e1ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87280ccf80 con 0x7f872806c650 2023-07-09T02:11:58.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f872e1ad640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87280cd540 con 0x7f8728158e30 2023-07-09T02:11:58.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f872e1ad640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872806ca90 con 0x7f872806fd10 2023-07-09T02:11:58.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f87277fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8728158e30 0x7f872806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f87277fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8728158e30 0x7f872806f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36646/0 (socket says 172.21.15.45:36646) 2023-07-09T02:11:58.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f87277fe640 1 -- 172.21.15.45:0/1856937412 learned_addr learned my addr 172.21.15.45:0/1856937412 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:58.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f8727fff640 1 --1- 172.21.15.45:0/1856937412 >> v1:172.21.15.45:6789/0 conn(0x7f872806c650 0x7f87280caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50212/0 (socket says 172.21.15.45:50212) 2023-07-09T02:11:58.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f87277fe640 1 -- 172.21.15.45:0/1856937412 >> v2:172.21.15.155:3300/0 conn(0x7f872806fd10 msgr2=0x7f872806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:58.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f8726ffd640 1 --2- 172.21.15.45:0/1856937412 >> v2:172.21.15.155:3300/0 conn(0x7f872806fd10 0x7f872806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f87277fe640 1 --2- 172.21.15.45:0/1856937412 >> v2:172.21.15.155:3300/0 conn(0x7f872806fd10 0x7f872806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f87277fe640 1 -- 172.21.15.45:0/1856937412 >> v1:172.21.15.45:6789/0 conn(0x7f872806c650 legacy=0x7f87280caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f87277fe640 1 -- 172.21.15.45:0/1856937412 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280c8fb0 con 0x7f8728158e30 2023-07-09T02:11:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f87267fc640 1 -- 172.21.15.45:0/1856937412 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644967742 0 0) 0x7f87280ccf80 con 0x7f872806c650 2023-07-09T02:11:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.080+0000 7f8726ffd640 1 --2- 172.21.15.45:0/1856937412 >> v2:172.21.15.155:3300/0 conn(0x7f872806fd10 0x7f872806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:58.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f87277fe640 1 --2- 172.21.15.45:0/1856937412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8728158e30 0x7f872806f7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f872806f260 tx=0x7f871801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d8880aa6370b79 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f87267fc640 1 -- 172.21.15.45:0/1856937412 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180ab640 con 0x7f8728158e30 2023-07-09T02:11:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f87267fc640 1 -- 172.21.15.45:0/1856937412 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87180a7070 con 0x7f8728158e30 2023-07-09T02:11:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f87267fc640 1 -- 172.21.15.45:0/1856937412 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180ab9c0 con 0x7f8728158e30 2023-07-09T02:11:58.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f872e1ad640 1 -- 172.21.15.45:0/1856937412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8728158e30 msgr2=0x7f872806f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f872e1ad640 1 --2- 172.21.15.45:0/1856937412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8728158e30 0x7f872806f7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f872806f260 tx=0x7f871801c440 comp rx=0 tx=0).stop 2023-07-09T02:11:58.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f872e1ad640 1 -- 172.21.15.45:0/1856937412 shutdown_connections 2023-07-09T02:11:58.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f872e1ad640 1 --2- 172.21.15.45:0/1856937412 >> v2:172.21.15.155:3300/0 conn(0x7f872806fd10 0x7f872806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f872e1ad640 1 --2- 172.21.15.45:0/1856937412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8728158e30 0x7f872806f7d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f872e1ad640 1 -- 172.21.15.45:0/1856937412 >> 172.21.15.45:0/1856937412 conn(0x7f87280694b0 msgr2=0x7f87280698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:58.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f872e1ad640 1 -- 172.21.15.45:0/1856937412 shutdown_connections 2023-07-09T02:11:58.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.084+0000 7f872e1ad640 1 -- 172.21.15.45:0/1856937412 wait complete. 2023-07-09T02:11:58.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 Processor -- start 2023-07-09T02:11:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 -- start start 2023-07-09T02:11:58.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f872806c650 0x7f8728145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f872806fd10 0x7f87280c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8728158e30 0x7f8728070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8728148090 con 0x7f872806c650 2023-07-09T02:11:58.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8728145bb0 con 0x7f8728158e30 2023-07-09T02:11:58.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280c8650 con 0x7f872806fd10 2023-07-09T02:11:58.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f872806c650 0x7f8728145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f872806c650 0x7f8728145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36650/0 (socket says 172.21.15.45:36650) 2023-07-09T02:11:58.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 -- 172.21.15.45:0/101005891 learned_addr learned my addr 172.21.15.45:0/101005891 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:58.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f8726ffd640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f872806fd10 0x7f87280c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f8727fff640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8728158e30 0x7f8728070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 -- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f872806fd10 msgr2=0x7f87280c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f872806fd10 0x7f87280c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 -- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8728158e30 msgr2=0x7f8728070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8728158e30 0x7f8728070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 -- 172.21.15.45:0/101005891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180094d0 con 0x7f872806c650 2023-07-09T02:11:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f8726ffd640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f872806fd10 0x7f87280c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f8727fff640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8728158e30 0x7f8728070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f87277fe640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f872806c650 0x7f8728145520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f871801c920 tx=0x7f871801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f870ffff640 1 -- 172.21.15.45:0/101005891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718004220 con 0x7f872806c650 2023-07-09T02:11:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f870ffff640 1 -- 172.21.15.45:0/101005891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87180b8070 con 0x7f872806c650 2023-07-09T02:11:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8728149eb0 con 0x7f872806c650 2023-07-09T02:11:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f870ffff640 1 -- 172.21.15.45:0/101005891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180ab860 con 0x7f872806c650 2023-07-09T02:11:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87281482e0 con 0x7f872806c650 2023-07-09T02:11:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.088+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872804d7d0 con 0x7f872806c650 2023-07-09T02:11:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.092+0000 7f870ffff640 1 -- 172.21.15.45:0/101005891 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87180ab9c0 con 0x7f872806c650 2023-07-09T02:11:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.092+0000 7f870ffff640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066280 0x7f8714068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.092+0000 7f870ffff640 1 -- 172.21.15.45:0/101005891 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f871811de90 con 0x7f872806c650 2023-07-09T02:11:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.092+0000 7f8726ffd640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066280 0x7f8714068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.092+0000 7f8726ffd640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066280 0x7f8714068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f871c006fd0 tx=0x7f871c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.096+0000 7f870ffff640 1 -- 172.21.15.45:0/101005891 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87180eb300 con 0x7f872806c650 2023-07-09T02:11:58.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f87280ccb30 con 0x7f872806c650 2023-07-09T02:11:58.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f870ffff640 1 -- 172.21.15.45:0/101005891 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f87180ba020 con 0x7f872806c650 2023-07-09T02:11:58.267 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:11:58.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066280 msgr2=0x7f8714068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066280 0x7f8714068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f871c006fd0 tx=0x7f871c008040 comp rx=0 tx=0).stop 2023-07-09T02:11:58.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f872806c650 msgr2=0x7f8728145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f872806c650 0x7f8728145520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f871801c920 tx=0x7f871801ac80 comp rx=0 tx=0).stop 2023-07-09T02:11:58.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 shutdown_connections 2023-07-09T02:11:58.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8728158e30 0x7f8728070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8714066280 0x7f8714068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f872806fd10 0x7f87280c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 --2- 172.21.15.45:0/101005891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f872806c650 0x7f8728145520 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.264+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 >> 172.21.15.45:0/101005891 conn(0x7f87280694b0 msgr2=0x7f87281559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:58.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.268+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 shutdown_connections 2023-07-09T02:11:58.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.268+0000 7f872e1ad640 1 -- 172.21.15.45:0/101005891 wait complete. 2023-07-09T02:11:58.288 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-09T02:11:58.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:58.289 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-09T02:11:58.337 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:11:58.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:11:58.338 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T02:11:58.391 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:11:58.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:11:58.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.532+0000 7fd75abd2640 1 Processor -- start 2023-07-09T02:11:58.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.532+0000 7fd75abd2640 1 -- start start 2023-07-09T02:11:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.532+0000 7fd75abd2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7540b4ae0 0x7fd7540ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.532+0000 7fd75abd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd754160670 0x7fd7540d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.532+0000 7fd75abd2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7540cd5d0 con 0x7fd7540c8d40 2023-07-09T02:11:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.532+0000 7fd75abd2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7540d2050 con 0x7fd7540b4ae0 2023-07-09T02:11:58.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.532+0000 7fd75abd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540d27a0 con 0x7fd754160670 2023-07-09T02:11:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd7593cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7540b4ae0 0x7fd7540ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd7593cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7540b4ae0 0x7fd7540ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36666/0 (socket says 172.21.15.45:36666) 2023-07-09T02:11:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd7593cf640 1 -- 172.21.15.45:0/2820177574 learned_addr learned my addr 172.21.15.45:0/2820177574 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:58.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd75a3d1640 1 --2- 172.21.15.45:0/2820177574 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd754160670 0x7fd7540d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd7593cf640 1 -- 172.21.15.45:0/2820177574 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd754160670 msgr2=0x7fd7540d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd7593cf640 1 --2- 172.21.15.45:0/2820177574 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd754160670 0x7fd7540d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd7593cf640 1 -- 172.21.15.45:0/2820177574 >> v1:172.21.15.155:6789/0 conn(0x7fd7540c8d40 legacy=0x7fd7540b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd7593cf640 1 -- 172.21.15.45:0/2820177574 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754160ad0 con 0x7fd7540b4ae0 2023-07-09T02:11:58.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd7593cf640 1 --2- 172.21.15.45:0/2820177574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7540ccf10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd744009870 tx=0x7fd74401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92f1fe9a4f7c961 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd758bce640 1 -- 172.21.15.45:0/2820177574 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440a8a30 con 0x7fd7540b4ae0 2023-07-09T02:11:58.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd758bce640 1 -- 172.21.15.45:0/2820177574 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7440a8b90 con 0x7fd7540b4ae0 2023-07-09T02:11:58.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.536+0000 7fd758bce640 1 -- 172.21.15.45:0/2820177574 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440b0440 con 0x7fd7540b4ae0 2023-07-09T02:11:58.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- 172.21.15.45:0/2820177574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 msgr2=0x7fd7540ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2820177574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7540ccf10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd744009870 tx=0x7fd74401ed30 comp rx=0 tx=0).stop 2023-07-09T02:11:58.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- 172.21.15.45:0/2820177574 shutdown_connections 2023-07-09T02:11:58.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2820177574 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd754160670 0x7fd7540d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2820177574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7540ccf10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- 172.21.15.45:0/2820177574 >> 172.21.15.45:0/2820177574 conn(0x7fd7540d2950 msgr2=0x7fd7540d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- 172.21.15.45:0/2820177574 shutdown_connections 2023-07-09T02:11:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- 172.21.15.45:0/2820177574 wait complete. 2023-07-09T02:11:58.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 Processor -- start 2023-07-09T02:11:58.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- start start 2023-07-09T02:11:58.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7541f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7540c8d40 0x7fd754149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754160670 0x7fd7540c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541485f0 con 0x7fd7540b4ae0 2023-07-09T02:11:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541f18a0 con 0x7fd754160670 2023-07-09T02:11:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75abd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75414a0a0 con 0x7fd7540c8d40 2023-07-09T02:11:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd759bd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7541f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd759bd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7541f1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36680/0 (socket says 172.21.15.45:36680) 2023-07-09T02:11:58.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd759bd0640 1 -- 172.21.15.45:0/2539745590 learned_addr learned my addr 172.21.15.45:0/2539745590 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.540+0000 7fd75a3d1640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754160670 0x7fd7540c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd7593cf640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7540c8d40 0x7fd754149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd759bd0640 1 -- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7540c8d40 msgr2=0x7fd754149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd759bd0640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7540c8d40 0x7fd754149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd759bd0640 1 -- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754160670 msgr2=0x7fd7540c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd759bd0640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754160670 0x7fd7540c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd759bd0640 1 -- 172.21.15.45:0/2539745590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7440094d0 con 0x7fd7540b4ae0 2023-07-09T02:11:58.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd759bd0640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7541f1360 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c530 tx=0x7fd75000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd74a7fc640 1 -- 172.21.15.45:0/2539745590 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750005220 con 0x7fd7540b4ae0 2023-07-09T02:11:58.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd74a7fc640 1 -- 172.21.15.45:0/2539745590 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd750005380 con 0x7fd7540b4ae0 2023-07-09T02:11:58.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd74a7fc640 1 -- 172.21.15.45:0/2539745590 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750007270 con 0x7fd7540b4ae0 2023-07-09T02:11:58.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7540cc8e0 con 0x7fd7540b4ae0 2023-07-09T02:11:58.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7540cc040 con 0x7fd7540b4ae0 2023-07-09T02:11:58.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd754148790 con 0x7fd7540b4ae0 2023-07-09T02:11:58.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd74a7fc640 1 -- 172.21.15.45:0/2539745590 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7500073d0 con 0x7fd7540b4ae0 2023-07-09T02:11:58.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd74a7fc640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7380662b0 0x7fd738068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.544+0000 7fd74a7fc640 1 -- 172.21.15.45:0/2539745590 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7500835a0 con 0x7fd7540b4ae0 2023-07-09T02:11:58.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.548+0000 7fd7593cf640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7380662b0 0x7fd738068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.548+0000 7fd7593cf640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7380662b0 0x7fd738068760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7440b2000 tx=0x7fd744008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.548+0000 7fd74a7fc640 1 -- 172.21.15.45:0/2539745590 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd750050a10 con 0x7fd7540b4ae0 2023-07-09T02:11:58.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.736+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd75404e020 con 0x7fd7540b4ae0 2023-07-09T02:11:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd74a7fc640 1 -- 172.21.15.45:0/2539745590 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fd750054030 con 0x7fd7540b4ae0 2023-07-09T02:11:58.742 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:58.742 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:11:17.535245+0000","modified":"2023-07-09T02:11:21.190690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T02:11:58.742 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-07-09T02:11:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7380662b0 msgr2=0x7fd738068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7380662b0 0x7fd738068760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd7440b2000 tx=0x7fd744008040 comp rx=0 tx=0).stop 2023-07-09T02:11:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 msgr2=0x7fd7541f1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7541f1360 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c530 tx=0x7fd75000c9f0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 shutdown_connections 2023-07-09T02:11:58.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754160670 0x7fd7540c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7380662b0 0x7fd738068760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7540c8d40 0x7fd754149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 --2- 172.21.15.45:0/2539745590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7540b4ae0 0x7fd7541f1360 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 >> 172.21.15.45:0/2539745590 conn(0x7fd7540d2950 msgr2=0x7fd75415f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:58.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 shutdown_connections 2023-07-09T02:11:58.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.740+0000 7fd75abd2640 1 -- 172.21.15.45:0/2539745590 wait complete. 2023-07-09T02:11:58.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:11:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e07d8f640 1 Processor -- start 2023-07-09T02:11:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e07d8f640 1 -- start start 2023-07-09T02:11:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e07d8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e0015c060 0x7f6e000b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e07d8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e000cd120 0x7f6e000d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e07d8f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e000d2450 0x7f6e000d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e07d8f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e000d28f0 con 0x7f6e000cd120 2023-07-09T02:11:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e07d8f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e00160a50 con 0x7f6e000d2450 2023-07-09T02:11:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e07d8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0015c430 con 0x7f6e0015c060 2023-07-09T02:11:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0532a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e000cd120 0x7f6e000d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0532a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e000cd120 0x7f6e000d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36696/0 (socket says 172.21.15.45:36696) 2023-07-09T02:11:58.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0532a640 1 -- 172.21.15.45:0/748980521 learned_addr learned my addr 172.21.15.45:0/748980521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:58.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e05b2b640 1 --2- 172.21.15.45:0/748980521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e0015c060 0x7f6e000b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0632c640 1 --2- 172.21.15.45:0/748980521 >> v2:172.21.15.155:3300/0 conn(0x7f6e000d2450 0x7f6e000d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0532a640 1 -- 172.21.15.45:0/748980521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e0015c060 msgr2=0x7f6e000b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0532a640 1 --2- 172.21.15.45:0/748980521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e0015c060 0x7f6e000b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0532a640 1 -- 172.21.15.45:0/748980521 >> v2:172.21.15.155:3300/0 conn(0x7f6e000d2450 msgr2=0x7f6e000d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:58.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0532a640 1 --2- 172.21.15.45:0/748980521 >> v2:172.21.15.155:3300/0 conn(0x7f6e000d2450 0x7f6e000d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0532a640 1 -- 172.21.15.45:0/748980521 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0015fb60 con 0x7f6e000cd120 2023-07-09T02:11:58.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.904+0000 7f6e0632c640 1 --2- 172.21.15.45:0/748980521 >> v2:172.21.15.155:3300/0 conn(0x7f6e000d2450 0x7f6e000d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:58.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e0532a640 1 --2- 172.21.15.45:0/748980521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e000cd120 0x7f6e000d1f10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e0006b120 tx=0x7f6df001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dcc8b86089cf8e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e04b29640 1 -- 172.21.15.45:0/748980521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df00ab600 con 0x7f6e000cd120 2023-07-09T02:11:58.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e04b29640 1 -- 172.21.15.45:0/748980521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df00a7050 con 0x7f6e000cd120 2023-07-09T02:11:58.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e04b29640 1 -- 172.21.15.45:0/748980521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df00ab980 con 0x7f6e000cd120 2023-07-09T02:11:58.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 -- 172.21.15.45:0/748980521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e000cd120 msgr2=0x7f6e000d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/748980521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e000cd120 0x7f6e000d1f10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e0006b120 tx=0x7f6df001c210 comp rx=0 tx=0).stop 2023-07-09T02:11:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 -- 172.21.15.45:0/748980521 shutdown_connections 2023-07-09T02:11:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/748980521 >> v2:172.21.15.155:3300/0 conn(0x7f6e000d2450 0x7f6e000d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/748980521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e000cd120 0x7f6e000d1f10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/748980521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e0015c060 0x7f6e000b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 -- 172.21.15.45:0/748980521 >> 172.21.15.45:0/748980521 conn(0x7f6e000698e0 msgr2=0x7f6e00069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:58.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 -- 172.21.15.45:0/748980521 shutdown_connections 2023-07-09T02:11:58.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 -- 172.21.15.45:0/748980521 wait complete. 2023-07-09T02:11:58.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 Processor -- start 2023-07-09T02:11:58.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.908+0000 7f6e07d8f640 1 -- start start 2023-07-09T02:11:58.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e000cd120 0x7f6e00151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e000d2450 0x7f6e000cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e0015c060 0x7f6e001519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e001572e0 con 0x7f6e0015c060 2023-07-09T02:11:58.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000ca6c0 con 0x7f6e000d2450 2023-07-09T02:11:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000ca9a0 con 0x7f6e000cd120 2023-07-09T02:11:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e0015c060 0x7f6e001519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e0015c060 0x7f6e001519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36698/0 (socket says 172.21.15.45:36698) 2023-07-09T02:11:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 -- 172.21.15.45:0/2908502287 learned_addr learned my addr 172.21.15.45:0/2908502287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e05b2b640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e000cd120 0x7f6e00151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0532a640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e000d2450 0x7f6e000cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 -- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e000cd120 msgr2=0x7f6e00151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e000cd120 0x7f6e00151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 -- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e000d2450 msgr2=0x7f6e000cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e000d2450 0x7f6e000cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 -- 172.21.15.45:0/2908502287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df00094d0 con 0x7f6e0015c060 2023-07-09T02:11:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e0632c640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e0015c060 0x7f6e001519e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6df8007e10 tx=0x7f6df800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6df67fc640 1 -- 172.21.15.45:0/2908502287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df8003ba0 con 0x7f6e0015c060 2023-07-09T02:11:58.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6df67fc640 1 -- 172.21.15.45:0/2908502287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df800f040 con 0x7f6e0015c060 2023-07-09T02:11:58.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6df67fc640 1 -- 172.21.15.45:0/2908502287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df800de80 con 0x7f6e0015c060 2023-07-09T02:11:58.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e00156f70 con 0x7f6e0015c060 2023-07-09T02:11:58.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e00153120 con 0x7f6e0015c060 2023-07-09T02:11:58.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.912+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e00157100 con 0x7f6e0015c060 2023-07-09T02:11:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.916+0000 7f6df67fc640 1 -- 172.21.15.45:0/2908502287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6df8004030 con 0x7f6e0015c060 2023-07-09T02:11:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.916+0000 7f6df67fc640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6de4066280 0x7f6de4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.916+0000 7f6df67fc640 1 -- 172.21.15.45:0/2908502287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6df8084090 con 0x7f6e0015c060 2023-07-09T02:11:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.916+0000 7f6e05b2b640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6de4066280 0x7f6de4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.916+0000 7f6e05b2b640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6de4066280 0x7f6de4068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009ac0 tx=0x7f6dfc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:58.920+0000 7f6df67fc640 1 -- 172.21.15.45:0/2908502287 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6df8051520 con 0x7f6e0015c060 2023-07-09T02:11:59.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.096+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e0004d7d0 con 0x7f6e0015c060 2023-07-09T02:11:59.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.096+0000 7f6df67fc640 1 -- 172.21.15.45:0/2908502287 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f6df8054b40 con 0x7f6e0015c060 2023-07-09T02:11:59.101 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:11:59.101 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:11:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6de4066280 msgr2=0x7f6de4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6de4066280 0x7f6de4068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009ac0 tx=0x7f6dfc009190 comp rx=0 tx=0).stop 2023-07-09T02:11:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e0015c060 msgr2=0x7f6e001519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e0015c060 0x7f6e001519e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6df8007e10 tx=0x7f6df800d4a0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 shutdown_connections 2023-07-09T02:11:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e0015c060 0x7f6e001519e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e000d2450 0x7f6e000cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6de4066280 0x7f6de4068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 --2- 172.21.15.45:0/2908502287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e000cd120 0x7f6e00151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 >> 172.21.15.45:0/2908502287 conn(0x7f6e000698e0 msgr2=0x7f6e000b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:59.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 shutdown_connections 2023-07-09T02:11:59.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.100+0000 7f6e07d8f640 1 -- 172.21.15.45:0/2908502287 wait complete. 2023-07-09T02:11:59.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:11:15.317034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:11:16.533370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:11:59.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:11:59.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.264+0000 7fe3841e2640 1 Processor -- start 2023-07-09T02:11:59.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.264+0000 7fe3841e2640 1 -- start start 2023-07-09T02:11:59.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe3841e2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe37c0d1090 0x7fe37c1607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe3841e2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe37c0b58d0 0x7fe37c0d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe3841e2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c0cefe0 con 0x7fe37c15c1c0 2023-07-09T02:11:59.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe3841e2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c0d2850 con 0x7fe37c0b58d0 2023-07-09T02:11:59.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe3841e2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c0cd0d0 con 0x7fe37c0d1090 2023-07-09T02:11:59.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe381f7e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe37c15c1c0 0x7fe37c0d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50226/0 (socket says 172.21.15.45:50226) 2023-07-09T02:11:59.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe381f7e640 1 -- 172.21.15.45:0/4166549148 learned_addr learned my addr 172.21.15.45:0/4166549148 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:11:59.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe38277f640 1 --2- 172.21.15.45:0/4166549148 >> v2:172.21.15.45:3300/0 conn(0x7fe37c0b58d0 0x7fe37c0d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe38177d640 1 --2- 172.21.15.45:0/4166549148 >> v2:172.21.15.155:3300/0 conn(0x7fe37c0d1090 0x7fe37c1607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe380f7c640 1 -- 172.21.15.45:0/4166549148 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472426866 0 0) 0x7fe37c0cefe0 con 0x7fe37c15c1c0 2023-07-09T02:11:59.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe380f7c640 1 -- 172.21.15.45:0/4166549148 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe368003530 con 0x7fe37c15c1c0 2023-07-09T02:11:59.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe38277f640 1 -- 172.21.15.45:0/4166549148 >> v2:172.21.15.155:3300/0 conn(0x7fe37c0d1090 msgr2=0x7fe37c1607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:59.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe38277f640 1 --2- 172.21.15.45:0/4166549148 >> v2:172.21.15.155:3300/0 conn(0x7fe37c0d1090 0x7fe37c1607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe38277f640 1 -- 172.21.15.45:0/4166549148 >> v1:172.21.15.45:6789/0 conn(0x7fe37c15c1c0 legacy=0x7fe37c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.268+0000 7fe38277f640 1 -- 172.21.15.45:0/4166549148 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c0cecd0 con 0x7fe37c0b58d0 2023-07-09T02:11:59.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe38277f640 1 --2- 172.21.15.45:0/4166549148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0b58d0 0x7fe37c0d2310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0718e0 tx=0x7fe37401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78f57f509752902 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe380f7c640 1 -- 172.21.15.45:0/4166549148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740a5880 con 0x7fe37c0b58d0 2023-07-09T02:11:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe380f7c640 1 -- 172.21.15.45:0/4166549148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3740a59e0 con 0x7fe37c0b58d0 2023-07-09T02:11:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe380f7c640 1 -- 172.21.15.45:0/4166549148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740a5d70 con 0x7fe37c0b58d0 2023-07-09T02:11:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 -- 172.21.15.45:0/4166549148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0b58d0 msgr2=0x7fe37c0d2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 --2- 172.21.15.45:0/4166549148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0b58d0 0x7fe37c0d2310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0718e0 tx=0x7fe37401c7c0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 -- 172.21.15.45:0/4166549148 shutdown_connections 2023-07-09T02:11:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 --2- 172.21.15.45:0/4166549148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0b58d0 0x7fe37c0d2310 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 --2- 172.21.15.45:0/4166549148 >> v2:172.21.15.155:3300/0 conn(0x7fe37c0d1090 0x7fe37c1607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 -- 172.21.15.45:0/4166549148 >> 172.21.15.45:0/4166549148 conn(0x7fe37c069980 msgr2=0x7fe37c069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:59.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 -- 172.21.15.45:0/4166549148 shutdown_connections 2023-07-09T02:11:59.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 -- 172.21.15.45:0/4166549148 wait complete. 2023-07-09T02:11:59.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 Processor -- start 2023-07-09T02:11:59.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.272+0000 7fe3841e2640 1 -- start start 2023-07-09T02:11:59.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37c0b58d0 0x7fe37c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0d1090 0x7fe37c156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe37c15c1c0 0x7fe37c156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c1516e0 con 0x7fe37c0d1090 2023-07-09T02:11:59.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c158ae0 con 0x7fe37c15c1c0 2023-07-09T02:11:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c158d30 con 0x7fe37c0b58d0 2023-07-09T02:11:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0d1090 0x7fe37c156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0d1090 0x7fe37c156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36720/0 (socket says 172.21.15.45:36720) 2023-07-09T02:11:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 -- 172.21.15.45:0/2419664165 learned_addr learned my addr 172.21.15.45:0/2419664165 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:59.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38277f640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe37c15c1c0 0x7fe37c156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe381f7e640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37c0b58d0 0x7fe37c1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 -- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37c0b58d0 msgr2=0x7fe37c1511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37c0b58d0 0x7fe37c1511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 -- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe37c15c1c0 msgr2=0x7fe37c156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe37c15c1c0 0x7fe37c156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 -- 172.21.15.45:0/2419664165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374009a70 con 0x7fe37c0d1090 2023-07-09T02:11:59.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe38177d640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0d1090 0x7fe37c156100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e900 tx=0x7fe36c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3727fc640 1 -- 172.21.15.45:0/2419664165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c009690 con 0x7fe37c0d1090 2023-07-09T02:11:59.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3727fc640 1 -- 172.21.15.45:0/2419664165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c00ca00 con 0x7fe37c0d1090 2023-07-09T02:11:59.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3727fc640 1 -- 172.21.15.45:0/2419664165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c00cdb0 con 0x7fe37c0d1090 2023-07-09T02:11:59.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c159010 con 0x7fe37c0d1090 2023-07-09T02:11:59.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c1595d0 con 0x7fe37c0d1090 2023-07-09T02:11:59.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c04d7d0 con 0x7fe37c0d1090 2023-07-09T02:11:59.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.276+0000 7fe3727fc640 1 -- 172.21.15.45:0/2419664165 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe36c013470 con 0x7fe37c0d1090 2023-07-09T02:11:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.280+0000 7fe3727fc640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe360066280 0x7fe360068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.280+0000 7fe3727fc640 1 -- 172.21.15.45:0/2419664165 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe36c083f20 con 0x7fe37c0d1090 2023-07-09T02:11:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.280+0000 7fe381f7e640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe360066280 0x7fe360068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.280+0000 7fe381f7e640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe360066280 0x7fe360068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe3780011f0 tx=0x7fe378009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.284+0000 7fe3727fc640 1 -- 172.21.15.45:0/2419664165 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe36c051390 con 0x7fe37c0d1090 2023-07-09T02:11:59.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe37c166f40 con 0x7fe37c0d1090 2023-07-09T02:11:59.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3727fc640 1 -- 172.21.15.45:0/2419664165 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe36c0170a0 con 0x7fe37c0d1090 2023-07-09T02:11:59.443 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:11:59.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe360066280 msgr2=0x7fe360068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe360066280 0x7fe360068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe3780011f0 tx=0x7fe378009040 comp rx=0 tx=0).stop 2023-07-09T02:11:59.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0d1090 msgr2=0x7fe37c156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0d1090 0x7fe37c156100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00e900 tx=0x7fe36c00edc0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 shutdown_connections 2023-07-09T02:11:59.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe37c15c1c0 0x7fe37c156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe37c0d1090 0x7fe37c156100 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe360066280 0x7fe360068730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 --2- 172.21.15.45:0/2419664165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe37c0b58d0 0x7fe37c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 >> 172.21.15.45:0/2419664165 conn(0x7fe37c069980 msgr2=0x7fe37c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 shutdown_connections 2023-07-09T02:11:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.440+0000 7fe3841e2640 1 -- 172.21.15.45:0/2419664165 wait complete. 2023-07-09T02:11:59.464 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:11:59.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf7a2ec640 1 Processor -- start 2023-07-09T02:11:59.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf7a2ec640 1 -- start start 2023-07-09T02:11:59.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf7a2ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf7415c060 0x7fbf740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf7a2ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf740cd120 0x7fbf740d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf7a2ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf740d2450 0x7fbf740d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf7a2ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf740d28f0 con 0x7fbf7415c060 2023-07-09T02:11:59.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf7a2ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf74160a50 con 0x7fbf740cd120 2023-07-09T02:11:59.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf7a2ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7415c430 con 0x7fbf740d2450 2023-07-09T02:11:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf73fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf7415c060 0x7fbf740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf73fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf7415c060 0x7fbf740b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36722/0 (socket says 172.21.15.45:36722) 2023-07-09T02:11:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf73fff640 1 -- 172.21.15.45:0/3863267411 learned_addr learned my addr 172.21.15.45:0/3863267411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf737fe640 1 --2- 172.21.15.45:0/3863267411 >> v2:172.21.15.155:3300/0 conn(0x7fbf740cd120 0x7fbf740d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf73fff640 1 -- 172.21.15.45:0/3863267411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf740d2450 msgr2=0x7fbf740d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf78889640 1 --2- 172.21.15.45:0/3863267411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf740d2450 0x7fbf740d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf73fff640 1 --2- 172.21.15.45:0/3863267411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf740d2450 0x7fbf740d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf73fff640 1 -- 172.21.15.45:0/3863267411 >> v2:172.21.15.155:3300/0 conn(0x7fbf740cd120 msgr2=0x7fbf740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:11:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf73fff640 1 --2- 172.21.15.45:0/3863267411 >> v2:172.21.15.155:3300/0 conn(0x7fbf740cd120 0x7fbf740d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf73fff640 1 -- 172.21.15.45:0/3863267411 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7415fb60 con 0x7fbf7415c060 2023-07-09T02:11:59.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf737fe640 1 --2- 172.21.15.45:0/3863267411 >> v2:172.21.15.155:3300/0 conn(0x7fbf740cd120 0x7fbf740d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:59.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.608+0000 7fbf78889640 1 --2- 172.21.15.45:0/3863267411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf740d2450 0x7fbf740d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:11:59.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf73fff640 1 --2- 172.21.15.45:0/3863267411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7415c060 0x7fbf740b4ed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbf7415fac0 tx=0x7fbf6401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68aef5a84a49ae2f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf72ffd640 1 -- 172.21.15.45:0/3863267411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640ab600 con 0x7fbf7415c060 2023-07-09T02:11:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf72ffd640 1 -- 172.21.15.45:0/3863267411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf640a7050 con 0x7fbf7415c060 2023-07-09T02:11:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf72ffd640 1 -- 172.21.15.45:0/3863267411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640ab980 con 0x7fbf7415c060 2023-07-09T02:11:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3863267411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7415c060 msgr2=0x7fbf740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3863267411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7415c060 0x7fbf740b4ed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbf7415fac0 tx=0x7fbf6401c210 comp rx=0 tx=0).stop 2023-07-09T02:11:59.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3863267411 shutdown_connections 2023-07-09T02:11:59.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3863267411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf740d2450 0x7fbf740d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3863267411 >> v2:172.21.15.155:3300/0 conn(0x7fbf740cd120 0x7fbf740d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3863267411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7415c060 0x7fbf740b4ed0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3863267411 >> 172.21.15.45:0/3863267411 conn(0x7fbf740698e0 msgr2=0x7fbf74069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:59.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3863267411 shutdown_connections 2023-07-09T02:11:59.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.612+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3863267411 wait complete. 2023-07-09T02:11:59.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 Processor -- start 2023-07-09T02:11:59.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 -- start start 2023-07-09T02:11:59.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf740cd120 0x7fbf740b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf740d2450 0x7fbf74151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf7415c060 0x7fbf740b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf740b6f40 con 0x7fbf740cd120 2023-07-09T02:11:59.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf740b7290 con 0x7fbf740d2450 2023-07-09T02:11:59.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf74152490 con 0x7fbf7415c060 2023-07-09T02:11:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf740cd120 0x7fbf740b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf740cd120 0x7fbf740b6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36736/0 (socket says 172.21.15.45:36736) 2023-07-09T02:11:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 -- 172.21.15.45:0/3226740885 learned_addr learned my addr 172.21.15.45:0/3226740885 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf737fe640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf740d2450 0x7fbf74151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf78889640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf7415c060 0x7fbf740b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 -- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf7415c060 msgr2=0x7fbf740b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf7415c060 0x7fbf740b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 -- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf740d2450 msgr2=0x7fbf74151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf740d2450 0x7fbf74151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 -- 172.21.15.45:0/3226740885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640094d0 con 0x7fbf740cd120 2023-07-09T02:11:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf73fff640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf740cd120 0x7fbf740b6a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbf6401cab0 tx=0x7fbf6401aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf70ff9640 1 -- 172.21.15.45:0/3226740885 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640b6620 con 0x7fbf740cd120 2023-07-09T02:11:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf70ff9640 1 -- 172.21.15.45:0/3226740885 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf640b67a0 con 0x7fbf740cd120 2023-07-09T02:11:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf741f7d80 con 0x7fbf740cd120 2023-07-09T02:11:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf70ff9640 1 -- 172.21.15.45:0/3226740885 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640b6b50 con 0x7fbf740cd120 2023-07-09T02:11:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.616+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf741f8340 con 0x7fbf740cd120 2023-07-09T02:11:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.620+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf740cae70 con 0x7fbf740cd120 2023-07-09T02:11:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.620+0000 7fbf70ff9640 1 -- 172.21.15.45:0/3226740885 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf640b2040 con 0x7fbf740cd120 2023-07-09T02:11:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.620+0000 7fbf70ff9640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf60066280 0x7fbf60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.620+0000 7fbf70ff9640 1 -- 172.21.15.45:0/3226740885 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf6411ddd0 con 0x7fbf740cd120 2023-07-09T02:11:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.620+0000 7fbf737fe640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf60066280 0x7fbf60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.620+0000 7fbf737fe640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf60066280 0x7fbf60068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbf741f5790 tx=0x7fbf68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.624+0000 7fbf70ff9640 1 -- 172.21.15.45:0/3226740885 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf640eb300 con 0x7fbf740cd120 2023-07-09T02:11:59.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.780+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbf7404d7d0 con 0x7fbf740cd120 2023-07-09T02:11:59.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.780+0000 7fbf70ff9640 1 -- 172.21.15.45:0/3226740885 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf640ee920 con 0x7fbf740cd120 2023-07-09T02:11:59.785 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:11:59.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf60066280 msgr2=0x7fbf60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf60066280 0x7fbf60068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbf741f5790 tx=0x7fbf68008040 comp rx=0 tx=0).stop 2023-07-09T02:11:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf740cd120 msgr2=0x7fbf740b6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf740cd120 0x7fbf740b6a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbf6401cab0 tx=0x7fbf6401aa50 comp rx=0 tx=0).stop 2023-07-09T02:11:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 shutdown_connections 2023-07-09T02:11:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf60066280 0x7fbf60068730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf7415c060 0x7fbf740b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf740d2450 0x7fbf74151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 --2- 172.21.15.45:0/3226740885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf740cd120 0x7fbf740b6a00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 >> 172.21.15.45:0/3226740885 conn(0x7fbf740698e0 msgr2=0x7fbf741576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 shutdown_connections 2023-07-09T02:11:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.784+0000 7fbf7a2ec640 1 -- 172.21.15.45:0/3226740885 wait complete. 2023-07-09T02:11:59.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:11:59.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.948+0000 7f25d2b40640 1 Processor -- start 2023-07-09T02:11:59.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.948+0000 7f25d2b40640 1 -- start start 2023-07-09T02:11:59.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d2b40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25cc15c060 0x7f25cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d2b40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc160a50 con 0x7f25cc0d2620 2023-07-09T02:11:59.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d2b40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc15c430 con 0x7f25cc0cd120 2023-07-09T02:11:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d2b40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc15fb60 con 0x7f25cc15c060 2023-07-09T02:11:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d08dc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25cc15c060 0x7f25cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d08dc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25cc15c060 0x7f25cc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36748/0 (socket says 172.21.15.45:36748) 2023-07-09T02:11:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d08dc640 1 -- 172.21.15.45:0/3712887715 learned_addr learned my addr 172.21.15.45:0/3712887715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:59.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d08dc640 1 -- 172.21.15.45:0/3712887715 >> v1:172.21.15.155:6789/0 conn(0x7f25cc0cd120 legacy=0x7f25cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d08dc640 1 -- 172.21.15.45:0/3712887715 >> v1:172.21.15.45:6789/0 conn(0x7f25cc0d2620 legacy=0x7f25cc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25d08dc640 1 -- 172.21.15.45:0/3712887715 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc15fe40 con 0x7f25cc15c060 2023-07-09T02:11:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.952+0000 7f25cb7fe640 1 -- 172.21.15.45:0/3712887715 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32959971 0 0) 0x7f25cc160a50 con 0x7f25cc0d2620 2023-07-09T02:11:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d08dc640 1 --2- 172.21.15.45:0/3712887715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc15c060 0x7f25cc0b4ed0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009870 tx=0x7f25c001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2200330aee2dc6b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25cb7fe640 1 -- 172.21.15.45:0/3712887715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00aa670 con 0x7f25cc15c060 2023-07-09T02:11:59.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25cb7fe640 1 -- 172.21.15.45:0/3712887715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c00aa7d0 con 0x7f25cc15c060 2023-07-09T02:11:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25cb7fe640 1 -- 172.21.15.45:0/3712887715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00aab60 con 0x7f25cc15c060 2023-07-09T02:11:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 -- 172.21.15.45:0/3712887715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc15c060 msgr2=0x7f25cc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 --2- 172.21.15.45:0/3712887715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc15c060 0x7f25cc0b4ed0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009870 tx=0x7f25c001c510 comp rx=0 tx=0).stop 2023-07-09T02:11:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 -- 172.21.15.45:0/3712887715 shutdown_connections 2023-07-09T02:11:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 --2- 172.21.15.45:0/3712887715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc15c060 0x7f25cc0b4ed0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 -- 172.21.15.45:0/3712887715 >> 172.21.15.45:0/3712887715 conn(0x7f25cc0698e0 msgr2=0x7f25cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:11:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 -- 172.21.15.45:0/3712887715 shutdown_connections 2023-07-09T02:11:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 -- 172.21.15.45:0/3712887715 wait complete. 2023-07-09T02:11:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 Processor -- start 2023-07-09T02:11:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.956+0000 7f25d2b40640 1 -- start start 2023-07-09T02:11:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25cc0cd120 0x7f25cc15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc0d2620 0x7f25cc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc15c060 0x7f25cc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc153860 con 0x7f25cc0d2620 2023-07-09T02:11:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc152c50 con 0x7f25cc15c060 2023-07-09T02:11:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc152f30 con 0x7f25cc0cd120 2023-07-09T02:11:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc0d2620 0x7f25cc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc0d2620 0x7f25cc15b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36762/0 (socket says 172.21.15.45:36762) 2023-07-09T02:11:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 -- 172.21.15.45:0/3935211967 learned_addr learned my addr 172.21.15.45:0/3935211967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:11:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d08dc640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25cc0cd120 0x7f25cc15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d10dd640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc15c060 0x7f25cc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 -- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25cc0cd120 msgr2=0x7f25cc15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25cc0cd120 0x7f25cc15ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 -- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc15c060 msgr2=0x7f25cc1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:11:59.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc15c060 0x7f25cc1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:11:59.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 -- 172.21.15.45:0/3935211967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00094d0 con 0x7f25cc0d2620 2023-07-09T02:11:59.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d10dd640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc15c060 0x7f25cc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:11:59.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25cbfff640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc0d2620 0x7f25cc15b280 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c4d0 tx=0x7f25b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25c97fa640 1 -- 172.21.15.45:0/3935211967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80052d0 con 0x7f25cc0d2620 2023-07-09T02:11:59.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25c97fa640 1 -- 172.21.15.45:0/3935211967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8005430 con 0x7f25cc0d2620 2023-07-09T02:11:59.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25c97fa640 1 -- 172.21.15.45:0/3935211967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8012830 con 0x7f25cc0d2620 2023-07-09T02:11:59.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc0b59f0 con 0x7f25cc0d2620 2023-07-09T02:11:59.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1534f0 con 0x7f25cc0d2620 2023-07-09T02:11:59.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc04d7d0 con 0x7f25cc0d2620 2023-07-09T02:11:59.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.960+0000 7f25c97fa640 1 -- 172.21.15.45:0/3935211967 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25b8012990 con 0x7f25cc0d2620 2023-07-09T02:11:59.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.964+0000 7f25c97fa640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f25b0066280 0x7f25b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:11:59.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.964+0000 7f25c97fa640 1 -- 172.21.15.45:0/3935211967 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25b8083850 con 0x7f25cc0d2620 2023-07-09T02:11:59.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.964+0000 7f25d08dc640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f25b0066280 0x7f25b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:11:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.964+0000 7f25d08dc640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f25b0066280 0x7f25b0068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25c00ae000 tx=0x7f25c00b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:11:59.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:11:59.968+0000 7f25c97fa640 1 -- 172.21.15.45:0/3935211967 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25b8050c30 con 0x7f25cc0d2620 2023-07-09T02:12:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.120+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25cc06baa0 con 0x7f25cc0d2620 2023-07-09T02:12:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.120+0000 7f25c97fa640 1 -- 172.21.15.45:0/3935211967 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25b8054250 con 0x7f25cc0d2620 2023-07-09T02:12:00.124 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:12:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f25b0066280 msgr2=0x7f25b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f25b0066280 0x7f25b0068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25c00ae000 tx=0x7f25c00b5040 comp rx=0 tx=0).stop 2023-07-09T02:12:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc0d2620 msgr2=0x7f25cc15b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc0d2620 0x7f25cc15b280 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c4d0 tx=0x7f25b800c990 comp rx=0 tx=0).stop 2023-07-09T02:12:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 shutdown_connections 2023-07-09T02:12:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc15c060 0x7f25cc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25cc0d2620 0x7f25cc15b280 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f25b0066280 0x7f25b0068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 --2- 172.21.15.45:0/3935211967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25cc0cd120 0x7f25cc15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 >> 172.21.15.45:0/3935211967 conn(0x7f25cc0698e0 msgr2=0x7f25cc0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 shutdown_connections 2023-07-09T02:12:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.124+0000 7f25d2b40640 1 -- 172.21.15.45:0/3935211967 wait complete. 2023-07-09T02:12:00.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:12:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bc5ade640 1 Processor -- start 2023-07-09T02:12:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bc5ade640 1 -- start start 2023-07-09T02:12:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bc5ade640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 0x7f7bc0069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bc5ade640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7bc00d2400 0x7f7bc0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bc5ade640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00ceff0 con 0x7f7bc00ccf10 2023-07-09T02:12:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bc5ade640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00cea70 con 0x7f7bc00d2400 2023-07-09T02:12:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bc5ade640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00b1f90 con 0x7f7bc00b1bc0 2023-07-09T02:12:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bbffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7bc00d2400 0x7f7bc0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bbffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7bc00d2400 0x7f7bc0069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36770/0 (socket says 172.21.15.45:36770) 2023-07-09T02:12:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bbffff640 1 -- 172.21.15.45:0/1725479261 learned_addr learned my addr 172.21.15.45:0/1725479261 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bc4adc640 1 --2- 172.21.15.45:0/1725479261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 0x7f7bc0069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bbffff640 1 -- 172.21.15.45:0/1725479261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 msgr2=0x7f7bc0069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bbffff640 1 --2- 172.21.15.45:0/1725479261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 0x7f7bc0069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bbffff640 1 -- 172.21.15.45:0/1725479261 >> v1:172.21.15.155:6789/0 conn(0x7f7bc00ccf10 legacy=0x7f7bc0070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.288+0000 7f7bbffff640 1 -- 172.21.15.45:0/1725479261 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00d1500 con 0x7f7bc00d2400 2023-07-09T02:12:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bbffff640 1 --2- 172.21.15.45:0/1725479261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00d2400 0x7f7bc0069db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00cebb0 tx=0x7f7bac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872ab6e46df221be server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bbf7fe640 1 -- 172.21.15.45:0/1725479261 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0aa650 con 0x7f7bc00d2400 2023-07-09T02:12:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bbf7fe640 1 -- 172.21.15.45:0/1725479261 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac0aa7b0 con 0x7f7bc00d2400 2023-07-09T02:12:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bbf7fe640 1 -- 172.21.15.45:0/1725479261 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0aab40 con 0x7f7bc00d2400 2023-07-09T02:12:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1725479261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00d2400 msgr2=0x7f7bc0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1725479261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00d2400 0x7f7bc0069db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00cebb0 tx=0x7f7bac01c4f0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1725479261 shutdown_connections 2023-07-09T02:12:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1725479261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00d2400 0x7f7bc0069db0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1725479261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 0x7f7bc0069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1725479261 >> 172.21.15.45:0/1725479261 conn(0x7f7bc00d35b0 msgr2=0x7f7bc00cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1725479261 shutdown_connections 2023-07-09T02:12:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.292+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1725479261 wait complete. 2023-07-09T02:12:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 Processor -- start 2023-07-09T02:12:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 -- start start 2023-07-09T02:12:00.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 0x7f7bc00b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00ccf10 0x7f7bc014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc00d2400 0x7f7bc00c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00ca0b0 con 0x7f7bc00ccf10 2023-07-09T02:12:00.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00ca8c0 con 0x7f7bc00d2400 2023-07-09T02:12:00.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00ca300 con 0x7f7bc00b1bc0 2023-07-09T02:12:00.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00ccf10 0x7f7bc014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00ccf10 0x7f7bc014cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36786/0 (socket says 172.21.15.45:36786) 2023-07-09T02:12:00.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 -- 172.21.15.45:0/1647740421 learned_addr learned my addr 172.21.15.45:0/1647740421 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:00.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc4adc640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 0x7f7bc00b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc52dd640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc00d2400 0x7f7bc00c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 -- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 msgr2=0x7f7bc00b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 0x7f7bc00b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 -- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc00d2400 msgr2=0x7f7bc00c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc00d2400 0x7f7bc00c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 -- 172.21.15.45:0/1647740421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac0094d0 con 0x7f7bc00ccf10 2023-07-09T02:12:00.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbffff640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00ccf10 0x7f7bc014cad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0ac040 tx=0x7f7bac01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:00.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbd7fa640 1 -- 172.21.15.45:0/1647740421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0b3800 con 0x7f7bc00ccf10 2023-07-09T02:12:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbd7fa640 1 -- 172.21.15.45:0/1647740421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac0b3960 con 0x7f7bc00ccf10 2023-07-09T02:12:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bbd7fa640 1 -- 172.21.15.45:0/1647740421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0b3d10 con 0x7f7bc00ccf10 2023-07-09T02:12:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc00ca5e0 con 0x7f7bc00ccf10 2023-07-09T02:12:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.296+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc00b2a50 con 0x7f7bc00ccf10 2023-07-09T02:12:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.300+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc00c63b0 con 0x7f7bc00ccf10 2023-07-09T02:12:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.300+0000 7f7bbd7fa640 1 -- 172.21.15.45:0/1647740421 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7bac0c73a0 con 0x7f7bc00ccf10 2023-07-09T02:12:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.300+0000 7f7bbd7fa640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7ba4066280 0x7f7ba4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.300+0000 7f7bbd7fa640 1 -- 172.21.15.45:0/1647740421 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bac11e880 con 0x7f7bc00ccf10 2023-07-09T02:12:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.300+0000 7f7bc4adc640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7ba4066280 0x7f7ba4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.304+0000 7f7bc4adc640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7ba4066280 0x7f7ba4068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00b7310 tx=0x7f7bb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.304+0000 7f7bbd7fa640 1 -- 172.21.15.45:0/1647740421 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7bac0ebd10 con 0x7f7bc00ccf10 2023-07-09T02:12:00.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.460+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7bc00b2c40 con 0x7f7bc00ccf10 2023-07-09T02:12:00.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.460+0000 7f7bbd7fa640 1 -- 172.21.15.45:0/1647740421 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7bac0ef330 con 0x7f7bc00ccf10 2023-07-09T02:12:00.464 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:12:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7ba4066280 msgr2=0x7f7ba4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7ba4066280 0x7f7ba4068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00b7310 tx=0x7f7bb4008040 comp rx=0 tx=0).stop 2023-07-09T02:12:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00ccf10 msgr2=0x7f7bc014cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00ccf10 0x7f7bc014cad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0ac040 tx=0x7f7bac01ad30 comp rx=0 tx=0).stop 2023-07-09T02:12:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 shutdown_connections 2023-07-09T02:12:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bc00d2400 0x7f7bc00c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7bc00ccf10 0x7f7bc014cad0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7ba4066280 0x7f7ba4068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 --2- 172.21.15.45:0/1647740421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7bc00b1bc0 0x7f7bc00b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 >> 172.21.15.45:0/1647740421 conn(0x7f7bc00d35b0 msgr2=0x7f7bc0159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 shutdown_connections 2023-07-09T02:12:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.464+0000 7f7bc5ade640 1 -- 172.21.15.45:0/1647740421 wait complete. 2023-07-09T02:12:00.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:00.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a9d359640 1 Processor -- start 2023-07-09T02:12:00.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a9d359640 1 -- start start 2023-07-09T02:12:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a9d359640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7a980d2620 0x7f7a980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a9d359640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7a980cd120 0x7f7a980cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a9d359640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a98160a50 con 0x7f7a9815c060 2023-07-09T02:12:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a9d359640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9815c430 con 0x7f7a980d2620 2023-07-09T02:12:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a9d359640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9815fb60 con 0x7f7a980cd120 2023-07-09T02:12:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a8ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7a980d2620 0x7f7a980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a96ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7a9815c060 0x7f7a980d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50230/0 (socket says 172.21.15.45:50230) 2023-07-09T02:12:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a96ffd640 1 -- 172.21.15.45:0/3906095400 learned_addr learned my addr 172.21.15.45:0/3906095400 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a977fe640 1 --2- 172.21.15.45:0/3906095400 >> v2:172.21.15.155:3300/0 conn(0x7f7a980cd120 0x7f7a980cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a967fc640 1 -- 172.21.15.45:0/3906095400 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064703506 0 0) 0x7f7a98160a50 con 0x7f7a9815c060 2023-07-09T02:12:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a8ffff640 1 -- 172.21.15.45:0/3906095400 >> v2:172.21.15.155:3300/0 conn(0x7f7a980cd120 msgr2=0x7f7a980cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a8ffff640 1 --2- 172.21.15.45:0/3906095400 >> v2:172.21.15.155:3300/0 conn(0x7f7a980cd120 0x7f7a980cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a8ffff640 1 -- 172.21.15.45:0/3906095400 >> v1:172.21.15.45:6789/0 conn(0x7f7a9815c060 legacy=0x7f7a980d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.628+0000 7f7a8ffff640 1 -- 172.21.15.45:0/3906095400 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9815fe40 con 0x7f7a980d2620 2023-07-09T02:12:00.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a8ffff640 1 --2- 172.21.15.45:0/3906095400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980d2620 0x7f7a980b4ed0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a9806b120 tx=0x7f7a8001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230c4ffe6e7ec0ab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:00.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a967fc640 1 -- 172.21.15.45:0/3906095400 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800a7070 con 0x7f7a980d2620 2023-07-09T02:12:00.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a967fc640 1 -- 172.21.15.45:0/3906095400 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a800ab430 con 0x7f7a980d2620 2023-07-09T02:12:00.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a967fc640 1 -- 172.21.15.45:0/3906095400 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800ab7c0 con 0x7f7a980d2620 2023-07-09T02:12:00.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a9d359640 1 -- 172.21.15.45:0/3906095400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980d2620 msgr2=0x7f7a980b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a9d359640 1 --2- 172.21.15.45:0/3906095400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980d2620 0x7f7a980b4ed0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a9806b120 tx=0x7f7a8001c430 comp rx=0 tx=0).stop 2023-07-09T02:12:00.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a9d359640 1 -- 172.21.15.45:0/3906095400 shutdown_connections 2023-07-09T02:12:00.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a9d359640 1 --2- 172.21.15.45:0/3906095400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980d2620 0x7f7a980b4ed0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a9d359640 1 --2- 172.21.15.45:0/3906095400 >> v2:172.21.15.155:3300/0 conn(0x7f7a980cd120 0x7f7a980cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a9d359640 1 -- 172.21.15.45:0/3906095400 >> 172.21.15.45:0/3906095400 conn(0x7f7a980698e0 msgr2=0x7f7a98069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:00.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a9d359640 1 -- 172.21.15.45:0/3906095400 shutdown_connections 2023-07-09T02:12:00.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.632+0000 7f7a9d359640 1 -- 172.21.15.45:0/3906095400 wait complete. 2023-07-09T02:12:00.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 Processor -- start 2023-07-09T02:12:00.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 -- start start 2023-07-09T02:12:00.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980cd120 0x7f7a98154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a980d2620 0x7f7a98156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a9815c060 0x7f7a98156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a981550e0 con 0x7f7a980cd120 2023-07-09T02:12:00.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980cb1e0 con 0x7f7a980d2620 2023-07-09T02:12:00.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980cb4c0 con 0x7f7a9815c060 2023-07-09T02:12:00.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980cd120 0x7f7a98154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980cd120 0x7f7a98154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36794/0 (socket says 172.21.15.45:36794) 2023-07-09T02:12:00.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 -- 172.21.15.45:0/4192532203 learned_addr learned my addr 172.21.15.45:0/4192532203 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 -- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a9815c060 msgr2=0x7f7a98156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a9815c060 0x7f7a98156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 -- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a980d2620 msgr2=0x7f7a98156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a980d2620 0x7f7a98156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 -- 172.21.15.45:0/4192532203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80009420 con 0x7f7a980cd120 2023-07-09T02:12:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a96ffd640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980cd120 0x7f7a98154ba0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c480 tx=0x7f7a8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a8f7fe640 1 -- 172.21.15.45:0/4192532203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a880074e0 con 0x7f7a980cd120 2023-07-09T02:12:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a8f7fe640 1 -- 172.21.15.45:0/4192532203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88007660 con 0x7f7a980cd120 2023-07-09T02:12:00.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a8f7fe640 1 -- 172.21.15.45:0/4192532203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88004a30 con 0x7f7a980cd120 2023-07-09T02:12:00.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a980b59f0 con 0x7f7a980cd120 2023-07-09T02:12:00.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.636+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a980cba80 con 0x7f7a980cd120 2023-07-09T02:12:00.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.640+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9804d7d0 con 0x7f7a980cd120 2023-07-09T02:12:00.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.640+0000 7f7a8f7fe640 1 -- 172.21.15.45:0/4192532203 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a88004b90 con 0x7f7a980cd120 2023-07-09T02:12:00.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.640+0000 7f7a8f7fe640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a78066280 0x7f7a78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:00.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.640+0000 7f7a8f7fe640 1 -- 172.21.15.45:0/4192532203 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a88083bc0 con 0x7f7a980cd120 2023-07-09T02:12:00.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.640+0000 7f7a8ffff640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a78066280 0x7f7a78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:00.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.640+0000 7f7a8ffff640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a78066280 0x7f7a78068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a800af000 tx=0x7f7a80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:00.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.644+0000 7f7a8f7fe640 1 -- 172.21.15.45:0/4192532203 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a88054a30 con 0x7f7a980cd120 2023-07-09T02:12:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a9806baa0 con 0x7f7a980cd120 2023-07-09T02:12:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a8f7fe640 1 -- 172.21.15.45:0/4192532203 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f7a880545c0 con 0x7f7a980cd120 2023-07-09T02:12:00.836 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:00.836 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:11:17.535245+0000","modified":"2023-07-09T02:11:21.190690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T02:12:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-07-09T02:12:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a78066280 msgr2=0x7f7a78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a78066280 0x7f7a78068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a800af000 tx=0x7f7a80008040 comp rx=0 tx=0).stop 2023-07-09T02:12:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980cd120 msgr2=0x7f7a98154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980cd120 0x7f7a98154ba0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c480 tx=0x7f7a8800c940 comp rx=0 tx=0).stop 2023-07-09T02:12:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 shutdown_connections 2023-07-09T02:12:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a78066280 0x7f7a78068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a9815c060 0x7f7a98156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a980d2620 0x7f7a98156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 --2- 172.21.15.45:0/4192532203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a980cd120 0x7f7a98154ba0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 >> 172.21.15.45:0/4192532203 conn(0x7f7a980698e0 msgr2=0x7f7a980b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 shutdown_connections 2023-07-09T02:12:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.832+0000 7f7a9d359640 1 -- 172.21.15.45:0/4192532203 wait complete. 2023-07-09T02:12:00.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:00.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbd1311640 1 Processor -- start 2023-07-09T02:12:00.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbd1311640 1 -- start start 2023-07-09T02:12:01.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbd1311640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdbcc0cd120 0x7fdbcc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbd1311640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc160a50 con 0x7fdbcc15c060 2023-07-09T02:12:01.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbd1311640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc15c430 con 0x7fdbcc0d2620 2023-07-09T02:12:01.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbd1311640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc15fb60 con 0x7fdbcc0cd120 2023-07-09T02:12:01.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbcaffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdbcc15c060 0x7fdbcc0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50242/0 (socket says 172.21.15.45:50242) 2023-07-09T02:12:01.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbcaffd640 1 -- 172.21.15.45:0/443093216 learned_addr learned my addr 172.21.15.45:0/443093216 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:01.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbcb7fe640 1 --2- 172.21.15.45:0/443093216 >> v2:172.21.15.155:3300/0 conn(0x7fdbcc0cd120 0x7fdbcc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbca7fc640 1 -- 172.21.15.45:0/443093216 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168342970 0 0) 0x7fdbcc160a50 con 0x7fdbcc15c060 2023-07-09T02:12:01.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbca7fc640 1 -- 172.21.15.45:0/443093216 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb8003530 con 0x7fdbcc15c060 2023-07-09T02:12:01.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbcb7fe640 1 -- 172.21.15.45:0/443093216 >> v1:172.21.15.155:6789/0 conn(0x7fdbcc0d2620 legacy=0x7fdbcc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbca7fc640 1 -- 172.21.15.45:0/443093216 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284610355 0 0) 0x7fdbb8003530 con 0x7fdbcc15c060 2023-07-09T02:12:01.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbcb7fe640 1 -- 172.21.15.45:0/443093216 >> v1:172.21.15.45:6789/0 conn(0x7fdbcc15c060 legacy=0x7fdbcc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:00.996+0000 7fdbcb7fe640 1 -- 172.21.15.45:0/443093216 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc15fe40 con 0x7fdbcc0cd120 2023-07-09T02:12:01.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbcb7fe640 1 --2- 172.21.15.45:0/443093216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 0x7fdbcc0b4ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009d90 tx=0x7fdbc401c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a72d956ca6b6977 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbca7fc640 1 -- 172.21.15.45:0/443093216 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc001680 con 0x7fdbcc0cd120 2023-07-09T02:12:01.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbca7fc640 1 -- 172.21.15.45:0/443093216 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc40a6500 con 0x7fdbcc0cd120 2023-07-09T02:12:01.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbca7fc640 1 -- 172.21.15.45:0/443093216 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40a6890 con 0x7fdbcc0cd120 2023-07-09T02:12:01.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbd1311640 1 -- 172.21.15.45:0/443093216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 msgr2=0x7fdbcc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbd1311640 1 --2- 172.21.15.45:0/443093216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 0x7fdbcc0b4ed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009d90 tx=0x7fdbc401c6f0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbd1311640 1 -- 172.21.15.45:0/443093216 shutdown_connections 2023-07-09T02:12:01.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbd1311640 1 --2- 172.21.15.45:0/443093216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 0x7fdbcc0b4ed0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbd1311640 1 -- 172.21.15.45:0/443093216 >> 172.21.15.45:0/443093216 conn(0x7fdbcc0698e0 msgr2=0x7fdbcc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:01.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbd1311640 1 -- 172.21.15.45:0/443093216 shutdown_connections 2023-07-09T02:12:01.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.000+0000 7fdbd1311640 1 -- 172.21.15.45:0/443093216 wait complete. 2023-07-09T02:12:01.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 Processor -- start 2023-07-09T02:12:01.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 -- start start 2023-07-09T02:12:01.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0cd120 0x7fdbcc0c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c060 0x7fdbcc14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc153230 con 0x7fdbcc0d2620 2023-07-09T02:12:01.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc153d00 con 0x7fdbcc15c060 2023-07-09T02:12:01.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc153460 con 0x7fdbcc0cd120 2023-07-09T02:12:01.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36802/0 (socket says 172.21.15.45:36802) 2023-07-09T02:12:01.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 -- 172.21.15.45:0/3039213919 learned_addr learned my addr 172.21.15.45:0/3039213919 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:01.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbcaffd640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0cd120 0x7fdbcc0c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbcb7fe640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c060 0x7fdbcc14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 -- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0cd120 msgr2=0x7fdbcc0c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0cd120 0x7fdbcc0c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 -- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c060 msgr2=0x7fdbcc14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c060 0x7fdbcc14e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 -- 172.21.15.45:0/3039213919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4009a70 con 0x7fdbcc0d2620 2023-07-09T02:12:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbcb7fe640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c060 0x7fdbcc14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc3fff640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc152cf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c750 tx=0x7fdbb400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc37fe640 1 -- 172.21.15.45:0/3039213919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4005270 con 0x7fdbcc0d2620 2023-07-09T02:12:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc37fe640 1 -- 172.21.15.45:0/3039213919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40053f0 con 0x7fdbcc0d2620 2023-07-09T02:12:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbc37fe640 1 -- 172.21.15.45:0/3039213919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400a880 con 0x7fdbcc0d2620 2023-07-09T02:12:01.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc0b59f0 con 0x7fdbcc0d2620 2023-07-09T02:12:01.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.004+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc153a20 con 0x7fdbcc0d2620 2023-07-09T02:12:01.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.008+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc04d7d0 con 0x7fdbcc0d2620 2023-07-09T02:12:01.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.008+0000 7fdbc37fe640 1 -- 172.21.15.45:0/3039213919 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdbb400a9e0 con 0x7fdbcc0d2620 2023-07-09T02:12:01.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.008+0000 7fdbc37fe640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac0662b0 0x7fdbac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.008+0000 7fdbc37fe640 1 -- 172.21.15.45:0/3039213919 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbb4083370 con 0x7fdbcc0d2620 2023-07-09T02:12:01.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.008+0000 7fdbcaffd640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac0662b0 0x7fdbac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.012+0000 7fdbcaffd640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac0662b0 0x7fdbac068760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc001ec0 tx=0x7fdbbc000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.012+0000 7fdbc37fe640 1 -- 172.21.15.45:0/3039213919 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbb4050950 con 0x7fdbcc0d2620 2023-07-09T02:12:01.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbcc06baa0 con 0x7fdbcc0d2620 2023-07-09T02:12:01.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbc37fe640 1 -- 172.21.15.45:0/3039213919 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fdbb4053f70 con 0x7fdbcc0d2620 2023-07-09T02:12:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:01.175 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:01.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac0662b0 msgr2=0x7fdbac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac0662b0 0x7fdbac068760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc001ec0 tx=0x7fdbbc000ee0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 msgr2=0x7fdbcc152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc152cf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c750 tx=0x7fdbb400cc10 comp rx=0 tx=0).stop 2023-07-09T02:12:01.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 shutdown_connections 2023-07-09T02:12:01.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c060 0x7fdbcc14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc152cf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac0662b0 0x7fdbac068760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 --2- 172.21.15.45:0/3039213919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0cd120 0x7fdbcc0c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 >> 172.21.15.45:0/3039213919 conn(0x7fdbcc0698e0 msgr2=0x7fdbcc0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:01.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 shutdown_connections 2023-07-09T02:12:01.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.172+0000 7fdbd1311640 1 -- 172.21.15.45:0/3039213919 wait complete. 2023-07-09T02:12:01.196 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:12:01.196 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:01.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd2287b640 1 Processor -- start 2023-07-09T02:12:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd2287b640 1 -- start start 2023-07-09T02:12:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd2287b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd2287b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd1c160630 0x7fbd1c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd2287b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c069e30 con 0x7fbd1c0699f0 2023-07-09T02:12:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd2287b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0cd6d0 con 0x7fbd1c160630 2023-07-09T02:12:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd2287b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0d0630 con 0x7fbd1c142500 2023-07-09T02:12:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd20e18640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd1c0699f0 0x7fbd1c06c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50248/0 (socket says 172.21.15.45:50248) 2023-07-09T02:12:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd20e18640 1 -- 172.21.15.45:0/1554016065 learned_addr learned my addr 172.21.15.45:0/1554016065 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd1bfff640 1 --2- 172.21.15.45:0/1554016065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.336+0000 7fbd1b7fe640 1 --2- 172.21.15.45:0/1554016065 >> v2:172.21.15.155:3300/0 conn(0x7fbd1c160630 0x7fbd1c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1affd640 1 -- 172.21.15.45:0/1554016065 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123711354 0 0) 0x7fbd1c069e30 con 0x7fbd1c0699f0 2023-07-09T02:12:01.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1bfff640 1 -- 172.21.15.45:0/1554016065 >> v2:172.21.15.155:3300/0 conn(0x7fbd1c160630 msgr2=0x7fbd1c0694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1bfff640 1 --2- 172.21.15.45:0/1554016065 >> v2:172.21.15.155:3300/0 conn(0x7fbd1c160630 0x7fbd1c0694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1bfff640 1 -- 172.21.15.45:0/1554016065 >> v1:172.21.15.45:6789/0 conn(0x7fbd1c0699f0 legacy=0x7fbd1c06c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1bfff640 1 -- 172.21.15.45:0/1554016065 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0cf320 con 0x7fbd1c142500 2023-07-09T02:12:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1bfff640 1 --2- 172.21.15.45:0/1554016065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c0cecf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0097c0 tx=0x7fbd0c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3167e79e738fc54b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1affd640 1 -- 172.21.15.45:0/1554016065 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0ab600 con 0x7fbd1c142500 2023-07-09T02:12:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1affd640 1 -- 172.21.15.45:0/1554016065 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c0a7050 con 0x7fbd1c142500 2023-07-09T02:12:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.340+0000 7fbd1affd640 1 -- 172.21.15.45:0/1554016065 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0ab980 con 0x7fbd1c142500 2023-07-09T02:12:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- 172.21.15.45:0/1554016065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 msgr2=0x7fbd1c0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 --2- 172.21.15.45:0/1554016065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c0cecf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0097c0 tx=0x7fbd0c01c450 comp rx=0 tx=0).stop 2023-07-09T02:12:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- 172.21.15.45:0/1554016065 shutdown_connections 2023-07-09T02:12:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 --2- 172.21.15.45:0/1554016065 >> v2:172.21.15.155:3300/0 conn(0x7fbd1c160630 0x7fbd1c0694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 --2- 172.21.15.45:0/1554016065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c0cecf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- 172.21.15.45:0/1554016065 >> 172.21.15.45:0/1554016065 conn(0x7fbd1c0650b0 msgr2=0x7fbd1c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:01.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- 172.21.15.45:0/1554016065 shutdown_connections 2023-07-09T02:12:01.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- 172.21.15.45:0/1554016065 wait complete. 2023-07-09T02:12:01.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 Processor -- start 2023-07-09T02:12:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- start start 2023-07-09T02:12:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1c0699f0 0x7fbd1c0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c1391e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd1c160630 0x7fbd1c1417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1f83d0 con 0x7fbd1c0699f0 2023-07-09T02:12:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c139720 con 0x7fbd1c160630 2023-07-09T02:12:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd2287b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1f77c0 con 0x7fbd1c142500 2023-07-09T02:12:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1c0699f0 0x7fbd1c0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1c0699f0 0x7fbd1c0c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36816/0 (socket says 172.21.15.45:36816) 2023-07-09T02:12:01.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1bfff640 1 -- 172.21.15.45:0/4154370427 learned_addr learned my addr 172.21.15.45:0/4154370427 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:01.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1b7fe640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c1391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd20e18640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd1c160630 0x7fbd1c1417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1bfff640 1 -- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 msgr2=0x7fbd1c1391e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1bfff640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c1391e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1bfff640 1 -- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd1c160630 msgr2=0x7fbd1c1417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1bfff640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd1c160630 0x7fbd1c1417a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.344+0000 7fbd1bfff640 1 -- 172.21.15.45:0/4154370427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c009420 con 0x7fbd1c0699f0 2023-07-09T02:12:01.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd1bfff640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1c0699f0 0x7fbd1c0c9ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0ae040 tx=0x7fbd0c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd18ff9640 1 -- 172.21.15.45:0/4154370427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0b7450 con 0x7fbd1c0699f0 2023-07-09T02:12:01.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd18ff9640 1 -- 172.21.15.45:0/4154370427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c0b75b0 con 0x7fbd1c0699f0 2023-07-09T02:12:01.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd18ff9640 1 -- 172.21.15.45:0/4154370427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0b7960 con 0x7fbd1c0699f0 2023-07-09T02:12:01.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c1f7aa0 con 0x7fbd1c0699f0 2023-07-09T02:12:01.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c1f8060 con 0x7fbd1c0699f0 2023-07-09T02:12:01.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c04d7d0 con 0x7fbd1c0699f0 2023-07-09T02:12:01.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd18ff9640 1 -- 172.21.15.45:0/4154370427 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd0c0b7ac0 con 0x7fbd1c0699f0 2023-07-09T02:12:01.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd18ff9640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd08066280 0x7fbd08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd18ff9640 1 -- 172.21.15.45:0/4154370427 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd0c11e4f0 con 0x7fbd1c0699f0 2023-07-09T02:12:01.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.348+0000 7fbd1b7fe640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd08066280 0x7fbd08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.352+0000 7fbd1b7fe640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd08066280 0x7fbd08068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c13f2d0 tx=0x7fbd10009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.352+0000 7fbd18ff9640 1 -- 172.21.15.45:0/4154370427 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd0c0eb980 con 0x7fbd1c0699f0 2023-07-09T02:12:01.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd1c0d0150 con 0x7fbd1c0699f0 2023-07-09T02:12:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd18ff9640 1 -- 172.21.15.45:0/4154370427 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fbd0c0eefa0 con 0x7fbd1c0699f0 2023-07-09T02:12:01.543 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:01.543 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:11:17.535245+0000","modified":"2023-07-09T02:11:21.190690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T02:12:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-07-09T02:12:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd08066280 msgr2=0x7fbd08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd08066280 0x7fbd08068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c13f2d0 tx=0x7fbd10009190 comp rx=0 tx=0).stop 2023-07-09T02:12:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1c0699f0 msgr2=0x7fbd1c0c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1c0699f0 0x7fbd1c0c9ad0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0ae040 tx=0x7fbd0c01ac90 comp rx=0 tx=0).stop 2023-07-09T02:12:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 shutdown_connections 2023-07-09T02:12:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd1c160630 0x7fbd1c1417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd08066280 0x7fbd08068730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd1c142500 0x7fbd1c1391e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.540+0000 7fbd2287b640 1 --2- 172.21.15.45:0/4154370427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd1c0699f0 0x7fbd1c0c9ad0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.544+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 >> 172.21.15.45:0/4154370427 conn(0x7fbd1c0650b0 msgr2=0x7fbd1c0cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.544+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 shutdown_connections 2023-07-09T02:12:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.544+0000 7fbd2287b640 1 -- 172.21.15.45:0/4154370427 wait complete. 2023-07-09T02:12:01.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.704+0000 7f6f264aa640 1 Processor -- start 2023-07-09T02:12:01.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.704+0000 7f6f264aa640 1 -- start start 2023-07-09T02:12:01.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f264aa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200cd120 0x7f6f200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f264aa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f20160a50 con 0x7f6f2015c060 2023-07-09T02:12:01.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f264aa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2015c430 con 0x7f6f200d2620 2023-07-09T02:12:01.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f264aa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2015fb60 con 0x7f6f200cd120 2023-07-09T02:12:01.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f1ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f2015c060 0x7f6f200d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39280/0 (socket says 172.21.15.45:39280) 2023-07-09T02:12:01.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f1ffff640 1 -- 172.21.15.45:0/252387926 learned_addr learned my addr 172.21.15.45:0/252387926 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:01.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f24a47640 1 --2- 172.21.15.45:0/252387926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200cd120 0x7f6f200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f1effd640 1 -- 172.21.15.45:0/252387926 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291608547 0 0) 0x7f6f20160a50 con 0x7f6f2015c060 2023-07-09T02:12:01.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f1effd640 1 -- 172.21.15.45:0/252387926 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f08003530 con 0x7f6f2015c060 2023-07-09T02:12:01.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f1effd640 1 -- 172.21.15.45:0/252387926 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341454025 0 0) 0x7f6f2015c430 con 0x7f6f200d2620 2023-07-09T02:12:01.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f1effd640 1 -- 172.21.15.45:0/252387926 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f20160a50 con 0x7f6f200d2620 2023-07-09T02:12:01.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f24a47640 1 -- 172.21.15.45:0/252387926 >> v1:172.21.15.155:6789/0 conn(0x7f6f200d2620 legacy=0x7f6f200cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f24a47640 1 -- 172.21.15.45:0/252387926 >> v1:172.21.15.45:6789/0 conn(0x7f6f2015c060 legacy=0x7f6f200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.708+0000 7f6f24a47640 1 -- 172.21.15.45:0/252387926 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2015fe40 con 0x7f6f200cd120 2023-07-09T02:12:01.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f24a47640 1 --2- 172.21.15.45:0/252387926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200cd120 0x7f6f200b4ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009dc0 tx=0x7f6f1801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88af3181a8fbebae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f1effd640 1 -- 172.21.15.45:0/252387926 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180a5a00 con 0x7f6f200cd120 2023-07-09T02:12:01.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f1effd640 1 -- 172.21.15.45:0/252387926 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f180a5b60 con 0x7f6f200cd120 2023-07-09T02:12:01.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f1effd640 1 -- 172.21.15.45:0/252387926 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180ad440 con 0x7f6f200cd120 2023-07-09T02:12:01.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 -- 172.21.15.45:0/252387926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200cd120 msgr2=0x7f6f200b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 --2- 172.21.15.45:0/252387926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200cd120 0x7f6f200b4ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009dc0 tx=0x7f6f1801c940 comp rx=0 tx=0).stop 2023-07-09T02:12:01.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 -- 172.21.15.45:0/252387926 shutdown_connections 2023-07-09T02:12:01.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 --2- 172.21.15.45:0/252387926 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200cd120 0x7f6f200b4ed0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 -- 172.21.15.45:0/252387926 >> 172.21.15.45:0/252387926 conn(0x7f6f200698e0 msgr2=0x7f6f20069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:01.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 -- 172.21.15.45:0/252387926 shutdown_connections 2023-07-09T02:12:01.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 -- 172.21.15.45:0/252387926 wait complete. 2023-07-09T02:12:01.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 Processor -- start 2023-07-09T02:12:01.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.712+0000 7f6f264aa640 1 -- start start 2023-07-09T02:12:01.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f200cd120 0x7f6f20151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200d2620 0x7f6f201544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2015c060 0x7f6f200b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2015ded0 con 0x7f6f2015c060 2023-07-09T02:12:01.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20152e20 con 0x7f6f200cd120 2023-07-09T02:12:01.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20153100 con 0x7f6f200d2620 2023-07-09T02:12:01.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2015c060 0x7f6f200b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2015c060 0x7f6f200b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60460/0 (socket says 172.21.15.45:60460) 2023-07-09T02:12:01.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 -- 172.21.15.45:0/2883895104 learned_addr learned my addr 172.21.15.45:0/2883895104 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:01.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f1ffff640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f200cd120 0x7f6f20151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f1f7fe640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200d2620 0x7f6f201544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 -- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200d2620 msgr2=0x7f6f201544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200d2620 0x7f6f201544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 -- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f200cd120 msgr2=0x7f6f20151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f200cd120 0x7f6f20151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 -- 172.21.15.45:0/2883895104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009a70 con 0x7f6f2015c060 2023-07-09T02:12:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f1f7fe640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200d2620 0x7f6f201544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f24a47640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2015c060 0x7f6f200b5c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6f1801a570 tx=0x7f6f180196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f1cff9640 1 -- 172.21.15.45:0/2883895104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180aec30 con 0x7f6f2015c060 2023-07-09T02:12:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f1cff9640 1 -- 172.21.15.45:0/2883895104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f180aedb0 con 0x7f6f2015c060 2023-07-09T02:12:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f1cff9640 1 -- 172.21.15.45:0/2883895104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180b7650 con 0x7f6f2015c060 2023-07-09T02:12:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f200b59f0 con 0x7f6f2015c060 2023-07-09T02:12:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f201536c0 con 0x7f6f2015c060 2023-07-09T02:12:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2015e060 con 0x7f6f2015c060 2023-07-09T02:12:01.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.716+0000 7f6f1cff9640 1 -- 172.21.15.45:0/2883895104 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f180b4050 con 0x7f6f2015c060 2023-07-09T02:12:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.720+0000 7f6f1cff9640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f0c066280 0x7f6f0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.720+0000 7f6f1cff9640 1 -- 172.21.15.45:0/2883895104 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f1811ec70 con 0x7f6f2015c060 2023-07-09T02:12:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.720+0000 7f6f1ffff640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f0c066280 0x7f6f0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.720+0000 7f6f1ffff640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f0c066280 0x7f6f0c068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f10007fd0 tx=0x7f6f10007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:01.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.724+0000 7f6f1cff9640 1 -- 172.21.15.45:0/2883895104 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f2015e060 con 0x7f6f2015c060 2023-07-09T02:12:01.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f2015e060 con 0x7f6f2015c060 2023-07-09T02:12:01.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f1cff9640 1 -- 172.21.15.45:0/2883895104 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f6f2015e060 con 0x7f6f2015c060 2023-07-09T02:12:01.911 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:01.911 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/115926235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":115926235},{"type":"v1","addr":"172.21.15.155:6837","nonce":115926235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2239467495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2239467495},{"type":"v1","addr":"172.21.15.45:6835","nonce":2239467495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/920307469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":920307469},{"type":"v1","addr":"172.21.15.155:6836","nonce":920307469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:11:17.535245+0000","modified":"2023-07-09T02:11:21.190690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6834/2565645293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2565645293},{"type":"v1","addr":"172.21.15.45:6834","nonce":2565645293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T02:12:01.911 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-07-09T02:12:01.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f0c066280 msgr2=0x7f6f0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f0c066280 0x7f6f0c068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6f10007fd0 tx=0x7f6f10007d80 comp rx=0 tx=0).stop 2023-07-09T02:12:01.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2015c060 msgr2=0x7f6f200b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:01.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2015c060 0x7f6f200b5c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6f1801a570 tx=0x7f6f180196e0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 shutdown_connections 2023-07-09T02:12:01.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f2015c060 0x7f6f200b5c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f0c066280 0x7f6f0c068730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f200d2620 0x7f6f201544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 --2- 172.21.15.45:0/2883895104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f200cd120 0x7f6f20151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:01.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 >> 172.21.15.45:0/2883895104 conn(0x7f6f200698e0 msgr2=0x7f6f200b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:01.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 shutdown_connections 2023-07-09T02:12:01.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:01.908+0000 7f6f264aa640 1 -- 172.21.15.45:0/2883895104 wait complete. 2023-07-09T02:12:01.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:02.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.072+0000 7f0799848640 1 Processor -- start 2023-07-09T02:12:02.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f0799848640 1 -- start start 2023-07-09T02:12:02.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f0799848640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f079415c060 0x7f07940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f0799848640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f07940cd120 0x7f07940d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f0799848640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0794160a50 con 0x7f07940d2450 2023-07-09T02:12:02.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f0799848640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07940d28d0 con 0x7f07940cd120 2023-07-09T02:12:02.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f0799848640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07940cfe40 con 0x7f079415c060 2023-07-09T02:12:02.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f078bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f07940cd120 0x7f07940d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f078bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f07940cd120 0x7f07940d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60462/0 (socket says 172.21.15.45:60462) 2023-07-09T02:12:02.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f078bfff640 1 -- 172.21.15.45:0/2708428617 learned_addr learned my addr 172.21.15.45:0/2708428617 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:02.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f0792ffd640 1 --2- 172.21.15.45:0/2708428617 >> v2:172.21.15.155:3300/0 conn(0x7f079415c060 0x7f07940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f078bfff640 1 -- 172.21.15.45:0/2708428617 >> v2:172.21.15.155:3300/0 conn(0x7f079415c060 msgr2=0x7f07940b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:02.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f078bfff640 1 --2- 172.21.15.45:0/2708428617 >> v2:172.21.15.155:3300/0 conn(0x7f079415c060 0x7f07940b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f078bfff640 1 -- 172.21.15.45:0/2708428617 >> v1:172.21.15.155:6789/0 conn(0x7f07940d2450 legacy=0x7f07940d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:02.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.076+0000 7f078bfff640 1 -- 172.21.15.45:0/2708428617 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079415c430 con 0x7f07940cd120 2023-07-09T02:12:02.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f078bfff640 1 --2- 172.21.15.45:0/2708428617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940d1f10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f07940d3ad0 tx=0x7f077c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a647e507dafdc26b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f07927fc640 1 -- 172.21.15.45:0/2708428617 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0ac410 con 0x7f07940cd120 2023-07-09T02:12:02.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f07927fc640 1 -- 172.21.15.45:0/2708428617 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c0ac570 con 0x7f07940cd120 2023-07-09T02:12:02.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f07927fc640 1 -- 172.21.15.45:0/2708428617 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0ac900 con 0x7f07940cd120 2023-07-09T02:12:02.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 -- 172.21.15.45:0/2708428617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 msgr2=0x7f07940d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 --2- 172.21.15.45:0/2708428617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940d1f10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f07940d3ad0 tx=0x7f077c01c490 comp rx=0 tx=0).stop 2023-07-09T02:12:02.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 -- 172.21.15.45:0/2708428617 shutdown_connections 2023-07-09T02:12:02.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 --2- 172.21.15.45:0/2708428617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940d1f10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 --2- 172.21.15.45:0/2708428617 >> v2:172.21.15.155:3300/0 conn(0x7f079415c060 0x7f07940b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 -- 172.21.15.45:0/2708428617 >> 172.21.15.45:0/2708428617 conn(0x7f07940698e0 msgr2=0x7f0794069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:02.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 -- 172.21.15.45:0/2708428617 shutdown_connections 2023-07-09T02:12:02.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 -- 172.21.15.45:0/2708428617 wait complete. 2023-07-09T02:12:02.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 Processor -- start 2023-07-09T02:12:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.080+0000 7f0799848640 1 -- start start 2023-07-09T02:12:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07940d2450 0x7f07940b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f079415c060 0x7f0794153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940b3850 con 0x7f07940cd120 2023-07-09T02:12:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940b29a0 con 0x7f079415c060 2023-07-09T02:12:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07940b2bd0 con 0x7f07940d2450 2023-07-09T02:12:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60474/0 (socket says 172.21.15.45:60474) 2023-07-09T02:12:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 -- 172.21.15.45:0/599840725 learned_addr learned my addr 172.21.15.45:0/599840725 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f07937fe640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f079415c060 0x7f0794153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 -- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07940d2450 msgr2=0x7f07940b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07940d2450 0x7f07940b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 -- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f079415c060 msgr2=0x7f0794153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f079415c060 0x7f0794153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 -- 172.21.15.45:0/599840725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0094d0 con 0x7f07940cd120 2023-07-09T02:12:02.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f07937fe640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f079415c060 0x7f0794153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:02.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0792ffd640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940cbfc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f078400d5f0 tx=0x7f078400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0790ff9640 1 -- 172.21.15.45:0/599840725 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07840125f0 con 0x7f07940cd120 2023-07-09T02:12:02.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0790ff9640 1 -- 172.21.15.45:0/599840725 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0784012750 con 0x7f07940cd120 2023-07-09T02:12:02.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07940b2eb0 con 0x7f07940cd120 2023-07-09T02:12:02.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0790ff9640 1 -- 172.21.15.45:0/599840725 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784012ae0 con 0x7f07940cd120 2023-07-09T02:12:02.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07940b3470 con 0x7f07940cd120 2023-07-09T02:12:02.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079404d7d0 con 0x7f07940cd120 2023-07-09T02:12:02.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.084+0000 7f0790ff9640 1 -- 172.21.15.45:0/599840725 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0784012c40 con 0x7f07940cd120 2023-07-09T02:12:02.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.088+0000 7f0790ff9640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0774066280 0x7f0774068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.088+0000 7f0790ff9640 1 -- 172.21.15.45:0/599840725 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07840841e0 con 0x7f07940cd120 2023-07-09T02:12:02.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.088+0000 7f078bfff640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0774066280 0x7f0774068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.088+0000 7f078bfff640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0774066280 0x7f0774068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ae000 tx=0x7f077c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.092+0000 7f0790ff9640 1 -- 172.21.15.45:0/599840725 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07840516d0 con 0x7f07940cd120 2023-07-09T02:12:02.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07940ccf00 con 0x7f07940cd120 2023-07-09T02:12:02.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0790ff9640 1 -- 172.21.15.45:0/599840725 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18279 (secure 0 0 0) 0x7f0784007380 con 0x7f07940cd120 2023-07-09T02:12:02.251 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:02.251 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:11:19.162632+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:11:15.317034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T02:11:16.533370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:02.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0774066280 msgr2=0x7f0774068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0774066280 0x7f0774068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f077c0ae000 tx=0x7f077c004740 comp rx=0 tx=0).stop 2023-07-09T02:12:02.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 msgr2=0x7f07940cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940cbfc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f078400d5f0 tx=0x7f078400dab0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 shutdown_connections 2023-07-09T02:12:02.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f079415c060 0x7f0794153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0774066280 0x7f0774068730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07940d2450 0x7f07940b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 --2- 172.21.15.45:0/599840725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07940cd120 0x7f07940cbfc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 >> 172.21.15.45:0/599840725 conn(0x7f07940698e0 msgr2=0x7f07940b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:02.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 shutdown_connections 2023-07-09T02:12:02.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.248+0000 7f0799848640 1 -- 172.21.15.45:0/599840725 wait complete. 2023-07-09T02:12:02.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:12:02.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.412+0000 7f87912c4640 1 Processor -- start 2023-07-09T02:12:02.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.412+0000 7f87912c4640 1 -- start start 2023-07-09T02:12:02.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f87912c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878c0cd120 0x7f878c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f87912c4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c160a50 con 0x7f878c15c060 2023-07-09T02:12:02.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f87912c4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c15c430 con 0x7f878c0d2620 2023-07-09T02:12:02.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f87912c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c15fb60 con 0x7f878c0cd120 2023-07-09T02:12:02.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f878c15c060 0x7f878c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39286/0 (socket says 172.21.15.45:39286) 2023-07-09T02:12:02.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878affd640 1 -- 172.21.15.45:0/783633946 learned_addr learned my addr 172.21.15.45:0/783633946 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:02.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878b7fe640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878c0cd120 0x7f878c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764514032 0 0) 0x7f878c160a50 con 0x7f878c15c060 2023-07-09T02:12:02.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8778003530 con 0x7f878c15c060 2023-07-09T02:12:02.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279245013 0 0) 0x7f878c15c430 con 0x7f878c0d2620 2023-07-09T02:12:02.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f878c160a50 con 0x7f878c0d2620 2023-07-09T02:12:02.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1712262034 0 0) 0x7f8778003530 con 0x7f878c15c060 2023-07-09T02:12:02.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878c0cd120 msgr2=0x7f878c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:02.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878c0cd120 0x7f878c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 >> v1:172.21.15.155:6789/0 conn(0x7f878c0d2620 legacy=0x7f878c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c15fe40 con 0x7f878c15c060 2023-07-09T02:12:02.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f877c001680 con 0x7f878c15c060 2023-07-09T02:12:02.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 >> v1:172.21.15.45:6789/0 conn(0x7f878c15c060 legacy=0x7f878c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8778003b40 0x7f8778003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780047d0 0x7f8778004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878c0cd120 0x7f8778005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c15fb60 con 0x7f87780047d0 2023-07-09T02:12:02.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877800ba40 con 0x7f8778003b40 2023-07-09T02:12:02.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877800bbb0 con 0x7f878c0cd120 2023-07-09T02:12:02.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f8783fff640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780047d0 0x7f8778004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878affd640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8778003b40 0x7f8778003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f878b7fe640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878c0cd120 0x7f8778005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f8783fff640 1 -- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878c0cd120 msgr2=0x7f8778005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:02.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f8783fff640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878c0cd120 0x7f8778005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f8783fff640 1 -- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8778003b40 msgr2=0x7f8778003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:02.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f8783fff640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8778003b40 0x7f8778003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.416+0000 7f8783fff640 1 -- 172.21.15.45:0/783633946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778003530 con 0x7f87780047d0 2023-07-09T02:12:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f8783fff640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780047d0 0x7f8778004c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f878c0d2a10 tx=0x7f877401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d6fba2bceb9ccc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740052d0 con 0x7f87780047d0 2023-07-09T02:12:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774005450 con 0x7f87780047d0 2023-07-09T02:12:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f878a7fc640 1 -- 172.21.15.45:0/783633946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740a8910 con 0x7f87780047d0 2023-07-09T02:12:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f87912c4640 1 -- 172.21.15.45:0/783633946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780047d0 msgr2=0x7f8778004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f87912c4640 1 --2- 172.21.15.45:0/783633946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87780047d0 0x7f8778004c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f878c0d2a10 tx=0x7f877401ecb0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f878b7fe640 1 -- 172.21.15.45:0/783633946 reap_dead start 2023-07-09T02:12:02.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f87912c4640 1 -- 172.21.15.45:0/783633946 shutdown_connections 2023-07-09T02:12:02.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f87912c4640 1 -- 172.21.15.45:0/783633946 >> 172.21.15.45:0/783633946 conn(0x7f878c0698e0 msgr2=0x7f878c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:02.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f87912c4640 1 -- 172.21.15.45:0/783633946 shutdown_connections 2023-07-09T02:12:02.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.420+0000 7f87912c4640 1 -- 172.21.15.45:0/783633946 wait complete. 2023-07-09T02:12:02.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 Processor -- start 2023-07-09T02:12:02.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 -- start start 2023-07-09T02:12:02.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87780047d0 0x7f878c1f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878c15f270 0x7f878c150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f878c0b7090 0x7f878c0b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b7a50 con 0x7f878c15f270 2023-07-09T02:12:02.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0c9b10 con 0x7f878c0b7090 2023-07-09T02:12:02.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0ca970 con 0x7f87780047d0 2023-07-09T02:12:02.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878c15f270 0x7f878c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878c15f270 0x7f878c150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60490/0 (socket says 172.21.15.45:60490) 2023-07-09T02:12:02.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 -- 172.21.15.45:0/3161672876 learned_addr learned my addr 172.21.15.45:0/3161672876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:02.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f878affd640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87780047d0 0x7f878c1f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f878b7fe640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f878c0b7090 0x7f878c0b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 -- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87780047d0 msgr2=0x7f878c1f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87780047d0 0x7f878c1f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 -- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f878c0b7090 msgr2=0x7f878c0b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f878c0b7090 0x7f878c0b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 -- 172.21.15.45:0/3161672876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c1f6150 con 0x7f878c15f270 2023-07-09T02:12:02.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f8783fff640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878c15f270 0x7f878c150150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f877409b3f0 tx=0x7f8778005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87837fe640 1 -- 172.21.15.45:0/3161672876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740a8d30 con 0x7f878c15f270 2023-07-09T02:12:02.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87837fe640 1 -- 172.21.15.45:0/3161672876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87740a8e90 con 0x7f878c15f270 2023-07-09T02:12:02.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87837fe640 1 -- 172.21.15.45:0/3161672876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740052f0 con 0x7f878c15f270 2023-07-09T02:12:02.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c0c9d60 con 0x7f878c15f270 2023-07-09T02:12:02.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c0ca320 con 0x7f878c15f270 2023-07-09T02:12:02.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.424+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c0caab0 con 0x7f878c15f270 2023-07-09T02:12:02.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.428+0000 7f87837fe640 1 -- 172.21.15.45:0/3161672876 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87740067e0 con 0x7f878c15f270 2023-07-09T02:12:02.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.428+0000 7f87837fe640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c0662b0 0x7f876c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.428+0000 7f87837fe640 1 -- 172.21.15.45:0/3161672876 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8774120dd0 con 0x7f878c15f270 2023-07-09T02:12:02.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.428+0000 7f878affd640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c0662b0 0x7f876c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.428+0000 7f878affd640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c0662b0 0x7f876c068760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f877c001060 tx=0x7f877c001e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.432+0000 7f87837fe640 1 -- 172.21.15.45:0/3161672876 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f878c0caab0 con 0x7f878c15f270 2023-07-09T02:12:02.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.616+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f878c0caab0 con 0x7f878c15f270 2023-07-09T02:12:02.620 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:12:02.616+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:12:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87837fe640 1 -- 172.21.15.45:0/3161672876 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f878c0caab0 con 0x7f878c15f270 2023-07-09T02:12:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:12:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c0662b0 msgr2=0x7f876c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c0662b0 0x7f876c068760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f877c001060 tx=0x7f877c001e10 comp rx=0 tx=0).stop 2023-07-09T02:12:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878c15f270 msgr2=0x7f878c150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878c15f270 0x7f878c150150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f877409b3f0 tx=0x7f8778005800 comp rx=0 tx=0).stop 2023-07-09T02:12:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 shutdown_connections 2023-07-09T02:12:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f878c0b7090 0x7f878c0b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878c15f270 0x7f878c150150 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c0662b0 0x7f876c068760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 --2- 172.21.15.45:0/3161672876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87780047d0 0x7f878c1f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 >> 172.21.15.45:0/3161672876 conn(0x7f878c0698e0 msgr2=0x7f878c0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 shutdown_connections 2023-07-09T02:12:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.624+0000 7f87912c4640 1 -- 172.21.15.45:0/3161672876 wait complete. 2023-07-09T02:12:02.638 INFO:tasks.ceph.mds.a.smithi045.stderr: -6805> 2023-07-09T02:11:22.264+0000 7fef95fda640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:12:02.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:12:02.698 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:12:02.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f423c8d8640 1 Processor -- start 2023-07-09T02:12:02.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f423c8d8640 1 -- start start 2023-07-09T02:12:02.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f423c8d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42380b1bc0 0x7f4238069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f423c8d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42380b68b0 0x7f4238069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f423c8d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42380ceff0 con 0x7f42380d2400 2023-07-09T02:12:02.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f423c8d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42380cea70 con 0x7f42380b68b0 2023-07-09T02:12:02.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f423c8d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42380b1f90 con 0x7f42380b1bc0 2023-07-09T02:12:02.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f4237fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42380b68b0 0x7f4238069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f4237fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42380b68b0 0x7f4238069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60510/0 (socket says 172.21.15.45:60510) 2023-07-09T02:12:02.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.804+0000 7f4237fff640 1 -- 172.21.15.45:0/3252555011 learned_addr learned my addr 172.21.15.45:0/3252555011 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:02.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f42377fe640 1 --2- 172.21.15.45:0/3252555011 >> v2:172.21.15.155:3300/0 conn(0x7f42380b1bc0 0x7f4238069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f4237fff640 1 -- 172.21.15.45:0/3252555011 >> v2:172.21.15.155:3300/0 conn(0x7f42380b1bc0 msgr2=0x7f4238069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:02.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f4237fff640 1 --2- 172.21.15.45:0/3252555011 >> v2:172.21.15.155:3300/0 conn(0x7f42380b1bc0 0x7f4238069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f4237fff640 1 -- 172.21.15.45:0/3252555011 >> v1:172.21.15.155:6789/0 conn(0x7f42380d2400 legacy=0x7f4238070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f4237fff640 1 -- 172.21.15.45:0/3252555011 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42380d1500 con 0x7f42380b68b0 2023-07-09T02:12:02.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f4237fff640 1 --2- 172.21.15.45:0/3252555011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b68b0 0x7f4238069db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f42380d28b0 tx=0x7f423001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c5dc2e4cdedcdb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f42367fc640 1 -- 172.21.15.45:0/3252555011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300a5860 con 0x7f42380b68b0 2023-07-09T02:12:02.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f42367fc640 1 -- 172.21.15.45:0/3252555011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42300a59c0 con 0x7f42380b68b0 2023-07-09T02:12:02.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f42367fc640 1 -- 172.21.15.45:0/3252555011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300a5d50 con 0x7f42380b68b0 2023-07-09T02:12:02.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f423c8d8640 1 -- 172.21.15.45:0/3252555011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b68b0 msgr2=0x7f4238069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3252555011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b68b0 0x7f4238069db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f42380d28b0 tx=0x7f423001c9a0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f423c8d8640 1 -- 172.21.15.45:0/3252555011 shutdown_connections 2023-07-09T02:12:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3252555011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b68b0 0x7f4238069db0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3252555011 >> v2:172.21.15.155:3300/0 conn(0x7f42380b1bc0 0x7f4238069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.808+0000 7f423c8d8640 1 -- 172.21.15.45:0/3252555011 >> 172.21.15.45:0/3252555011 conn(0x7f42380d35b0 msgr2=0x7f42380cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 -- 172.21.15.45:0/3252555011 shutdown_connections 2023-07-09T02:12:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 -- 172.21.15.45:0/3252555011 wait complete. 2023-07-09T02:12:02.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 Processor -- start 2023-07-09T02:12:02.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 -- start start 2023-07-09T02:12:02.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b1bc0 0x7f423815e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42380b68b0 0x7f4238152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42380d2400 0x7f42380ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380ca2a0 con 0x7f42380b1bc0 2023-07-09T02:12:02.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380cc870 con 0x7f42380d2400 2023-07-09T02:12:02.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f423c8d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4238153440 con 0x7f42380b68b0 2023-07-09T02:12:02.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b1bc0 0x7f423815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b1bc0 0x7f423815e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60514/0 (socket says 172.21.15.45:60514) 2023-07-09T02:12:02.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 -- 172.21.15.45:0/3291049190 learned_addr learned my addr 172.21.15.45:0/3291049190 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:02.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f4237fff640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42380d2400 0x7f42380ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f4236ffd640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42380b68b0 0x7f4238152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 -- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42380b68b0 msgr2=0x7f4238152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42380b68b0 0x7f4238152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 -- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42380d2400 msgr2=0x7f42380ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42380d2400 0x7f42380ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 -- 172.21.15.45:0/3291049190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230009b30 con 0x7f42380b1bc0 2023-07-09T02:12:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f4236ffd640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42380b68b0 0x7f4238152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.812+0000 7f42377fe640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b1bc0 0x7f423815e930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f422800e960 tx=0x7f422800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f421ffff640 1 -- 172.21.15.45:0/3291049190 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228009690 con 0x7f42380b1bc0 2023-07-09T02:12:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f421ffff640 1 -- 172.21.15.45:0/3291049190 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422800ca00 con 0x7f42380b1bc0 2023-07-09T02:12:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f421ffff640 1 -- 172.21.15.45:0/3291049190 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800cd70 con 0x7f42380b1bc0 2023-07-09T02:12:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42380c9990 con 0x7f42380b1bc0 2023-07-09T02:12:02.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4238153670 con 0x7f42380b1bc0 2023-07-09T02:12:02.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4238071f70 con 0x7f42380b1bc0 2023-07-09T02:12:02.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f421ffff640 1 -- 172.21.15.45:0/3291049190 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4228013470 con 0x7f42380b1bc0 2023-07-09T02:12:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f421ffff640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4224066280 0x7f4224068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f421ffff640 1 -- 172.21.15.45:0/3291049190 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4228083f30 con 0x7f42380b1bc0 2023-07-09T02:12:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.816+0000 7f4236ffd640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4224066280 0x7f4224068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.820+0000 7f4236ffd640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4224066280 0x7f4224068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4238158b20 tx=0x7f422c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:02.820+0000 7f421ffff640 1 -- 172.21.15.45:0/3291049190 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42280513e0 con 0x7f42380b1bc0 2023-07-09T02:12:03.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.008+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f42380ca510 con 0x7f42380b1bc0 2023-07-09T02:12:03.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.676+0000 7f421ffff640 1 -- 172.21.15.45:0/3291049190 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4228054a00 con 0x7f42380b1bc0 2023-07-09T02:12:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4224066280 msgr2=0x7f4224068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4224066280 0x7f4224068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4238158b20 tx=0x7f422c009040 comp rx=0 tx=0).stop 2023-07-09T02:12:03.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b1bc0 msgr2=0x7f423815e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:03.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b1bc0 0x7f423815e930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f422800e960 tx=0x7f422800ee20 comp rx=0 tx=0).stop 2023-07-09T02:12:03.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 shutdown_connections 2023-07-09T02:12:03.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42380d2400 0x7f42380ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4224066280 0x7f4224068730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42380b68b0 0x7f4238152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 --2- 172.21.15.45:0/3291049190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42380b1bc0 0x7f423815e930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 >> 172.21.15.45:0/3291049190 conn(0x7f42380d35b0 msgr2=0x7f42380b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 shutdown_connections 2023-07-09T02:12:03.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.680+0000 7f423c8d8640 1 -- 172.21.15.45:0/3291049190 wait complete. 2023-07-09T02:12:03.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:12:03.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.896+0000 7f1198634640 1 Processor -- start 2023-07-09T02:12:03.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.896+0000 7f1198634640 1 -- start start 2023-07-09T02:12:03.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.896+0000 7f1198634640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1190158f50 0x7f119015d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:03.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.896+0000 7f1198634640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f119015d690 0x7f11900694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:03.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.896+0000 7f1198634640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1190159320 con 0x7f11900c52a0 2023-07-09T02:12:03.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.896+0000 7f1198634640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11900b16f0 con 0x7f119015d690 2023-07-09T02:12:03.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.896+0000 7f1198634640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119015ca20 con 0x7f1190158f50 2023-07-09T02:12:03.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1195bcf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f119015d690 0x7f11900694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:03.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1195bcf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f119015d690 0x7f11900694b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60520/0 (socket says 172.21.15.45:60520) 2023-07-09T02:12:03.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1195bcf640 1 -- 172.21.15.45:0/376721541 learned_addr learned my addr 172.21.15.45:0/376721541 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:03.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1196bd1640 1 --1- 172.21.15.45:0/376721541 >> v1:172.21.15.45:6789/0 conn(0x7f11900c52a0 0x7f11900ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39292/0 (socket says 172.21.15.45:39292) 2023-07-09T02:12:03.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f11963d0640 1 --2- 172.21.15.45:0/376721541 >> v2:172.21.15.155:3300/0 conn(0x7f1190158f50 0x7f119015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:03.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1195bcf640 1 -- 172.21.15.45:0/376721541 >> v2:172.21.15.155:3300/0 conn(0x7f1190158f50 msgr2=0x7f119015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1195bcf640 1 --2- 172.21.15.45:0/376721541 >> v2:172.21.15.155:3300/0 conn(0x7f1190158f50 0x7f119015d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1195bcf640 1 -- 172.21.15.45:0/376721541 >> v1:172.21.15.45:6789/0 conn(0x7f11900c52a0 legacy=0x7f11900ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1195bcf640 1 -- 172.21.15.45:0/376721541 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900c8fd0 con 0x7f119015d690 2023-07-09T02:12:03.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f1195bcf640 1 --2- 172.21.15.45:0/376721541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119015d690 0x7f11900694b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f119006a380 tx=0x7f118001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aa04813176a667 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:03.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f11953ce640 1 -- 172.21.15.45:0/376721541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800ac630 con 0x7f119015d690 2023-07-09T02:12:03.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f11953ce640 1 -- 172.21.15.45:0/376721541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11800ac790 con 0x7f119015d690 2023-07-09T02:12:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.900+0000 7f11953ce640 1 -- 172.21.15.45:0/376721541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800acb20 con 0x7f119015d690 2023-07-09T02:12:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- 172.21.15.45:0/376721541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119015d690 msgr2=0x7f11900694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 --2- 172.21.15.45:0/376721541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119015d690 0x7f11900694b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f119006a380 tx=0x7f118001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- 172.21.15.45:0/376721541 shutdown_connections 2023-07-09T02:12:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 --2- 172.21.15.45:0/376721541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f119015d690 0x7f11900694b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 --2- 172.21.15.45:0/376721541 >> v2:172.21.15.155:3300/0 conn(0x7f1190158f50 0x7f119015d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- 172.21.15.45:0/376721541 >> 172.21.15.45:0/376721541 conn(0x7f119006ae60 msgr2=0x7f119006b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- 172.21.15.45:0/376721541 shutdown_connections 2023-07-09T02:12:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- 172.21.15.45:0/376721541 wait complete. 2023-07-09T02:12:03.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 Processor -- start 2023-07-09T02:12:03.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- start start 2023-07-09T02:12:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11900c52a0 0x7f119014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1190158f50 0x7f119015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f119015d690 0x7f11900b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:03.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119015a350 con 0x7f1190158f50 2023-07-09T02:12:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119015a630 con 0x7f119015d690 2023-07-09T02:12:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1198634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119015a910 con 0x7f11900c52a0 2023-07-09T02:12:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1195bcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1190158f50 0x7f119015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1195bcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1190158f50 0x7f119015b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60536/0 (socket says 172.21.15.45:60536) 2023-07-09T02:12:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1195bcf640 1 -- 172.21.15.45:0/3933078701 learned_addr learned my addr 172.21.15.45:0/3933078701 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f11963d0640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11900c52a0 0x7f119014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:03.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1196bd1640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f119015d690 0x7f11900b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:03.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1195bcf640 1 -- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11900c52a0 msgr2=0x7f119014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1195bcf640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11900c52a0 0x7f119014a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1195bcf640 1 -- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f119015d690 msgr2=0x7f11900b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1195bcf640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f119015d690 0x7f11900b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1195bcf640 1 -- 172.21.15.45:0/3933078701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800094d0 con 0x7f1190158f50 2023-07-09T02:12:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.904+0000 7f1196bd1640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f119015d690 0x7f11900b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1195bcf640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1190158f50 0x7f119015b3f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11800af040 tx=0x7f1180019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1186ffd640 1 -- 172.21.15.45:0/3933078701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800b7620 con 0x7f1190158f50 2023-07-09T02:12:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1186ffd640 1 -- 172.21.15.45:0/3933078701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11800b7780 con 0x7f1190158f50 2023-07-09T02:12:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119015abf0 con 0x7f1190158f50 2023-07-09T02:12:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1186ffd640 1 -- 172.21.15.45:0/3933078701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800b7b10 con 0x7f1190158f50 2023-07-09T02:12:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119014af20 con 0x7f1190158f50 2023-07-09T02:12:03.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900cad90 con 0x7f1190158f50 2023-07-09T02:12:03.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1186ffd640 1 -- 172.21.15.45:0/3933078701 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11800b3040 con 0x7f1190158f50 2023-07-09T02:12:03.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1186ffd640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1174066280 0x7f1174068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:03.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f1186ffd640 1 -- 172.21.15.45:0/3933078701 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f118011e290 con 0x7f1190158f50 2023-07-09T02:12:03.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.908+0000 7f11963d0640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1174066280 0x7f1174068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:03.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.912+0000 7f11963d0640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1174066280 0x7f1174068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f11900b3310 tx=0x7f118c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:03.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:03.912+0000 7f1186ffd640 1 -- 172.21.15.45:0/3933078701 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11800eb750 con 0x7f1190158f50 2023-07-09T02:12:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.068+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f119015cc10 con 0x7f1190158f50 2023-07-09T02:12:04.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.684+0000 7f1186ffd640 1 -- 172.21.15.45:0/3933078701 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f119015cc10 con 0x7f1190158f50 2023-07-09T02:12:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:12:04.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1174066280 msgr2=0x7f1174068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:04.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1174066280 0x7f1174068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f11900b3310 tx=0x7f118c008040 comp rx=0 tx=0).stop 2023-07-09T02:12:04.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1190158f50 msgr2=0x7f119015b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:04.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1190158f50 0x7f119015b3f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11800af040 tx=0x7f1180019270 comp rx=0 tx=0).stop 2023-07-09T02:12:04.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 shutdown_connections 2023-07-09T02:12:04.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f119015d690 0x7f11900b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:04.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1190158f50 0x7f119015b3f0 secure :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11800af040 tx=0x7f1180019270 comp rx=0 tx=0).stop 2023-07-09T02:12:04.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1174066280 0x7f1174068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:04.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 --2- 172.21.15.45:0/3933078701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11900c52a0 0x7f119014a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:04.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 >> 172.21.15.45:0/3933078701 conn(0x7f119006ae60 msgr2=0x7f11900ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:04.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 shutdown_connections 2023-07-09T02:12:04.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.688+0000 7f1198634640 1 -- 172.21.15.45:0/3933078701 wait complete. 2023-07-09T02:12:04.715 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:12:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.860+0000 7f343927b640 1 Processor -- start 2023-07-09T02:12:04.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.860+0000 7f343927b640 1 -- start start 2023-07-09T02:12:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.860+0000 7f343927b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34340cd060 0x7f34340cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.860+0000 7f343927b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34340d19c0 con 0x7f34340b4490 2023-07-09T02:12:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.860+0000 7f343927b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34340cf210 con 0x7f343415c480 2023-07-09T02:12:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.860+0000 7f343927b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343415c850 con 0x7f34340cd060 2023-07-09T02:12:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.860+0000 7f342bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34340cd060 0x7f34340cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f342bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34340cd060 0x7f34340cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60542/0 (socket says 172.21.15.45:60542) 2023-07-09T02:12:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f342bfff640 1 -- 172.21.15.45:0/1885765628 learned_addr learned my addr 172.21.15.45:0/1885765628 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f34337fe640 1 --1- 172.21.15.45:0/1885765628 >> v1:172.21.15.45:6789/0 conn(0x7f34340b4490 0x7f34340b5860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39298/0 (socket says 172.21.15.45:39298) 2023-07-09T02:12:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f342bfff640 1 -- 172.21.15.45:0/1885765628 >> v1:172.21.15.155:6789/0 conn(0x7f343415c480 legacy=0x7f34340d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f342bfff640 1 -- 172.21.15.45:0/1885765628 >> v1:172.21.15.45:6789/0 conn(0x7f34340b4490 legacy=0x7f34340b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f342bfff640 1 -- 172.21.15.45:0/1885765628 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34340cd4d0 con 0x7f34340cd060 2023-07-09T02:12:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f34327fc640 1 -- 172.21.15.45:0/1885765628 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386229365 0 0) 0x7f34340d19c0 con 0x7f34340b4490 2023-07-09T02:12:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f342bfff640 1 --2- 172.21.15.45:0/1885765628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34340cd060 0x7f34340cecd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f341c009870 tx=0x7f341c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d30a73775d7c52 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f34327fc640 1 -- 172.21.15.45:0/1885765628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0ab600 con 0x7f34340cd060 2023-07-09T02:12:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f34327fc640 1 -- 172.21.15.45:0/1885765628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c0a7050 con 0x7f34340cd060 2023-07-09T02:12:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.864+0000 7f34327fc640 1 -- 172.21.15.45:0/1885765628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0ab980 con 0x7f34340cd060 2023-07-09T02:12:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- 172.21.15.45:0/1885765628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34340cd060 msgr2=0x7f34340cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 --2- 172.21.15.45:0/1885765628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34340cd060 0x7f34340cecd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f341c009870 tx=0x7f341c01c540 comp rx=0 tx=0).stop 2023-07-09T02:12:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- 172.21.15.45:0/1885765628 shutdown_connections 2023-07-09T02:12:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 --2- 172.21.15.45:0/1885765628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34340cd060 0x7f34340cecd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- 172.21.15.45:0/1885765628 >> 172.21.15.45:0/1885765628 conn(0x7f34340cf490 msgr2=0x7f34340cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- 172.21.15.45:0/1885765628 shutdown_connections 2023-07-09T02:12:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- 172.21.15.45:0/1885765628 wait complete. 2023-07-09T02:12:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 Processor -- start 2023-07-09T02:12:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- start start 2023-07-09T02:12:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b4490 0x7f343414e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340cd060 0x7f34340c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f343415c480 0x7f34340cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34340c7ff0 con 0x7f343415c480 2023-07-09T02:12:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34340c7230 con 0x7f34340b4490 2023-07-09T02:12:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f343927b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34340c7510 con 0x7f34340cd060 2023-07-09T02:12:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f343415c480 0x7f34340cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f343415c480 0x7f34340cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60552/0 (socket says 172.21.15.45:60552) 2023-07-09T02:12:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 -- 172.21.15.45:0/3950899530 learned_addr learned my addr 172.21.15.45:0/3950899530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f3432ffd640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b4490 0x7f343414e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f342bfff640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340cd060 0x7f34340c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 -- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340cd060 msgr2=0x7f34340c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340cd060 0x7f34340c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 -- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b4490 msgr2=0x7f343414e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b4490 0x7f343414e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 -- 172.21.15.45:0/3950899530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0094d0 con 0x7f343415c480 2023-07-09T02:12:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f3432ffd640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b4490 0x7f343414e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.868+0000 7f34337fe640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f343415c480 0x7f34340cb5a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f342c00cbc0 tx=0x7f342c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f342b7fe640 1 -- 172.21.15.45:0/3950899530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00a890 con 0x7f343415c480 2023-07-09T02:12:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f342b7fe640 1 -- 172.21.15.45:0/3950899530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c00aa10 con 0x7f343415c480 2023-07-09T02:12:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f342b7fe640 1 -- 172.21.15.45:0/3950899530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00adc0 con 0x7f343415c480 2023-07-09T02:12:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34340c77f0 con 0x7f343415c480 2023-07-09T02:12:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34340c6f00 con 0x7f343415c480 2023-07-09T02:12:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343404d7d0 con 0x7f343415c480 2023-07-09T02:12:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f342b7fe640 1 -- 172.21.15.45:0/3950899530 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f342c0070d0 con 0x7f343415c480 2023-07-09T02:12:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f342b7fe640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3414066280 0x7f3414068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f342b7fe640 1 -- 172.21.15.45:0/3950899530 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f342c083520 con 0x7f343415c480 2023-07-09T02:12:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.872+0000 7f3432ffd640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3414066280 0x7f3414068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.876+0000 7f3432ffd640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3414066280 0x7f3414068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f34340cae10 tx=0x7f3424009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:04.876+0000 7f342b7fe640 1 -- 172.21.15.45:0/3950899530 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f342c050ac0 con 0x7f343415c480 2023-07-09T02:12:05.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.032+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f34340c7ca0 con 0x7f343415c480 2023-07-09T02:12:05.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.696+0000 7f342b7fe640 1 -- 172.21.15.45:0/3950899530 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f342c0540e0 con 0x7f343415c480 2023-07-09T02:12:05.698 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:12:05.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.696+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3414066280 msgr2=0x7f3414068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.696+0000 7f343927b640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3414066280 0x7f3414068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f34340cae10 tx=0x7f3424009040 comp rx=0 tx=0).stop 2023-07-09T02:12:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.696+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f343415c480 msgr2=0x7f34340cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.696+0000 7f343927b640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f343415c480 0x7f34340cb5a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f342c00cbc0 tx=0x7f342c00a060 comp rx=0 tx=0).stop 2023-07-09T02:12:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.700+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 shutdown_connections 2023-07-09T02:12:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.700+0000 7f343927b640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f343415c480 0x7f34340cb5a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.700+0000 7f343927b640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3414066280 0x7f3414068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.700+0000 7f343927b640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340cd060 0x7f34340c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.700+0000 7f343927b640 1 --2- 172.21.15.45:0/3950899530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b4490 0x7f343414e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.700+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 >> 172.21.15.45:0/3950899530 conn(0x7f34340cf490 msgr2=0x7f343415b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.700+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 shutdown_connections 2023-07-09T02:12:05.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.700+0000 7f343927b640 1 -- 172.21.15.45:0/3950899530 wait complete. 2023-07-09T02:12:05.723 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:12:05.724 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:12:05.724 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:12:05.724 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:12:05.724 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:12:05.725 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:12:05.725 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:12:05.725 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:12:05.725 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:12:05.725 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:12:05.726 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:12:05.726 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:12:05.726 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:12:05.726 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:12:05.727 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:12:05.727 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:12:05.737 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:12:05.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:12:05.739 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:12:05.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:12:05.740 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:12:05.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:12:05.741 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:12:05.741 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:12:05.783 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:12:05.784 DEBUG:teuthology.parallel:result is None 2023-07-09T02:12:05.785 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:12:05.786 DEBUG:teuthology.parallel:result is None 2023-07-09T02:12:05.787 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:12:05.788 DEBUG:teuthology.parallel:result is None 2023-07-09T02:12:05.789 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:12:05.790 DEBUG:teuthology.parallel:result is None 2023-07-09T02:12:05.790 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:12:05.874 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:12:05.876 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:12:05.881 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:12:05.882 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:12:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95ca87b640 1 Processor -- start 2023-07-09T02:12:05.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95ca87b640 1 -- start start 2023-07-09T02:12:05.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95ca87b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:05.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95ca87b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c4160a50 con 0x7f95c40cd120 2023-07-09T02:12:05.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95ca87b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c415c430 con 0x7f95c415c060 2023-07-09T02:12:05.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95ca87b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c415fb60 con 0x7f95c40d2620 2023-07-09T02:12:05.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95c8e18640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95c40cd120 0x7f95c40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39326/0 (socket says 172.21.15.45:39326) 2023-07-09T02:12:05.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95c8e18640 1 -- 172.21.15.45:0/2184278250 learned_addr learned my addr 172.21.15.45:0/2184278250 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95c37fe640 1 --2- 172.21.15.45:0/2184278250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95c37fe640 1 -- 172.21.15.45:0/2184278250 >> v1:172.21.15.155:6789/0 conn(0x7f95c415c060 legacy=0x7f95c40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95c37fe640 1 -- 172.21.15.45:0/2184278250 >> v1:172.21.15.45:6789/0 conn(0x7f95c40cd120 legacy=0x7f95c40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95c2ffd640 1 -- 172.21.15.45:0/2184278250 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674235406 0 0) 0x7f95c415c430 con 0x7f95c415c060 2023-07-09T02:12:05.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.940+0000 7f95c37fe640 1 -- 172.21.15.45:0/2184278250 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c415fe40 con 0x7f95c40d2620 2023-07-09T02:12:05.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95c37fe640 1 --2- 172.21.15.45:0/2184278250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c40b4ed0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95b80097f0 tx=0x7f95b801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4606231ee1c010bd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95c2ffd640 1 -- 172.21.15.45:0/2184278250 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80ab600 con 0x7f95c40d2620 2023-07-09T02:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95c2ffd640 1 -- 172.21.15.45:0/2184278250 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b80a7050 con 0x7f95c40d2620 2023-07-09T02:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95c2ffd640 1 -- 172.21.15.45:0/2184278250 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80ab980 con 0x7f95c40d2620 2023-07-09T02:12:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95ca87b640 1 -- 172.21.15.45:0/2184278250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 msgr2=0x7f95c40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:05.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95ca87b640 1 --2- 172.21.15.45:0/2184278250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c40b4ed0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95b80097f0 tx=0x7f95b801c350 comp rx=0 tx=0).stop 2023-07-09T02:12:05.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95ca87b640 1 -- 172.21.15.45:0/2184278250 shutdown_connections 2023-07-09T02:12:05.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95ca87b640 1 --2- 172.21.15.45:0/2184278250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c40b4ed0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:05.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95ca87b640 1 -- 172.21.15.45:0/2184278250 >> 172.21.15.45:0/2184278250 conn(0x7f95c40698e0 msgr2=0x7f95c4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:05.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95ca87b640 1 -- 172.21.15.45:0/2184278250 shutdown_connections 2023-07-09T02:12:05.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.944+0000 7f95ca87b640 1 -- 172.21.15.45:0/2184278250 wait complete. 2023-07-09T02:12:05.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 Processor -- start 2023-07-09T02:12:05.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 -- start start 2023-07-09T02:12:05.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c40cd120 0x7f95c40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:05.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c41592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:05.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c415c060 0x7f95c41f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:05.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40c9eb0 con 0x7f95c415c060 2023-07-09T02:12:05.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4159820 con 0x7f95c40cd120 2023-07-09T02:12:05.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40c9b10 con 0x7f95c40d2620 2023-07-09T02:12:05.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c415c060 0x7f95c41f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:05.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c415c060 0x7f95c41f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60578/0 (socket says 172.21.15.45:60578) 2023-07-09T02:12:05.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 -- 172.21.15.45:0/641668361 learned_addr learned my addr 172.21.15.45:0/641668361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:05.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c37fe640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c41592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:05.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c3fff640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c40cd120 0x7f95c40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:05.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 -- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 msgr2=0x7f95c41592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:05.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c41592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:05.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 -- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c40cd120 msgr2=0x7f95c40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:05.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c40cd120 0x7f95c40cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:05.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 -- 172.21.15.45:0/641668361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009420 con 0x7f95c415c060 2023-07-09T02:12:05.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c8e18640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c415c060 0x7f95c41f5f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00e780 tx=0x7f95bc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:05.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c0ff9640 1 -- 172.21.15.45:0/641668361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00f930 con 0x7f95c415c060 2023-07-09T02:12:05.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c0ff9640 1 -- 172.21.15.45:0/641668361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00fa90 con 0x7f95c415c060 2023-07-09T02:12:05.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95c0ff9640 1 -- 172.21.15.45:0/641668361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00fe60 con 0x7f95c415c060 2023-07-09T02:12:05.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c41f67c0 con 0x7f95c415c060 2023-07-09T02:12:05.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.948+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c41f6d80 con 0x7f95c415c060 2023-07-09T02:12:05.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.952+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c41603e0 con 0x7f95c415c060 2023-07-09T02:12:05.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.952+0000 7f95c0ff9640 1 -- 172.21.15.45:0/641668361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95bc015070 con 0x7f95c415c060 2023-07-09T02:12:05.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.952+0000 7f95c0ff9640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95b0066280 0x7f95b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:05.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.952+0000 7f95c0ff9640 1 -- 172.21.15.45:0/641668361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f95bc086320 con 0x7f95c415c060 2023-07-09T02:12:05.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.952+0000 7f95c3fff640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95b0066280 0x7f95b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:05.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.952+0000 7f95c3fff640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95b0066280 0x7f95b0068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95c415b1e0 tx=0x7f95b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:05.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:05.956+0000 7f95c0ff9640 1 -- 172.21.15.45:0/641668361 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95c41603e0 con 0x7f95c415c060 2023-07-09T02:12:06.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.120+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f95c40c9ff0 con 0x7f95c415c060 2023-07-09T02:12:06.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.708+0000 7f95c0ff9640 1 -- 172.21.15.45:0/641668361 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f95c40c9ff0 con 0x7f95c415c060 2023-07-09T02:12:06.711 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:12:06.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95b0066280 msgr2=0x7f95b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:06.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95b0066280 0x7f95b0068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f95c415b1e0 tx=0x7f95b4009040 comp rx=0 tx=0).stop 2023-07-09T02:12:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c415c060 msgr2=0x7f95c41f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c415c060 0x7f95c41f5f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00e780 tx=0x7f95bc00ec40 comp rx=0 tx=0).stop 2023-07-09T02:12:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 shutdown_connections 2023-07-09T02:12:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c415c060 0x7f95c41f5f00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95b0066280 0x7f95b0068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:06.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40d2620 0x7f95c41592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 --2- 172.21.15.45:0/641668361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c40cd120 0x7f95c40cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 >> 172.21.15.45:0/641668361 conn(0x7f95c40698e0 msgr2=0x7f95c40b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 shutdown_connections 2023-07-09T02:12:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.712+0000 7f95ca87b640 1 -- 172.21.15.45:0/641668361 wait complete. 2023-07-09T02:12:06.736 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:12:06.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.876+0000 7f263547b640 1 Processor -- start 2023-07-09T02:12:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.876+0000 7f263547b640 1 -- start start 2023-07-09T02:12:06.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f263547b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26300d2620 0x7f26300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:06.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f263547b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2630160a50 con 0x7f26300cd120 2023-07-09T02:12:06.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f263547b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263015c430 con 0x7f263015c060 2023-07-09T02:12:06.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f263547b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263015fb60 con 0x7f26300d2620 2023-07-09T02:12:06.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f262f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f26300cd120 0x7f26300cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39340/0 (socket says 172.21.15.45:39340) 2023-07-09T02:12:06.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f262f7fe640 1 -- 172.21.15.45:0/1137659371 learned_addr learned my addr 172.21.15.45:0/1137659371 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f2627fff640 1 --2- 172.21.15.45:0/1137659371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26300d2620 0x7f26300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f262e7fc640 1 -- 172.21.15.45:0/1137659371 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276040215 0 0) 0x7f2630160a50 con 0x7f26300cd120 2023-07-09T02:12:06.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f262e7fc640 1 -- 172.21.15.45:0/1137659371 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f261c003530 con 0x7f26300cd120 2023-07-09T02:12:06.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f2627fff640 1 -- 172.21.15.45:0/1137659371 >> v1:172.21.15.155:6789/0 conn(0x7f263015c060 legacy=0x7f26300d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:06.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f262e7fc640 1 -- 172.21.15.45:0/1137659371 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650266803 0 0) 0x7f263015c430 con 0x7f263015c060 2023-07-09T02:12:06.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f2627fff640 1 -- 172.21.15.45:0/1137659371 >> v1:172.21.15.45:6789/0 conn(0x7f26300cd120 legacy=0x7f26300cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:06.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.880+0000 7f2627fff640 1 -- 172.21.15.45:0/1137659371 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263015fe40 con 0x7f26300d2620 2023-07-09T02:12:06.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f2627fff640 1 --2- 172.21.15.45:0/1137659371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26300d2620 0x7f26300b4ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f26180097f0 tx=0x7f261801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25e82dd8c493b443 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:06.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f262e7fc640 1 -- 172.21.15.45:0/1137659371 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180aa5f0 con 0x7f26300d2620 2023-07-09T02:12:06.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f262e7fc640 1 -- 172.21.15.45:0/1137659371 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26180aa750 con 0x7f26300d2620 2023-07-09T02:12:06.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f262e7fc640 1 -- 172.21.15.45:0/1137659371 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180aaae0 con 0x7f26300d2620 2023-07-09T02:12:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 -- 172.21.15.45:0/1137659371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26300d2620 msgr2=0x7f26300b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 --2- 172.21.15.45:0/1137659371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26300d2620 0x7f26300b4ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f26180097f0 tx=0x7f261801c490 comp rx=0 tx=0).stop 2023-07-09T02:12:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 -- 172.21.15.45:0/1137659371 shutdown_connections 2023-07-09T02:12:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 --2- 172.21.15.45:0/1137659371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26300d2620 0x7f26300b4ed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 -- 172.21.15.45:0/1137659371 >> 172.21.15.45:0/1137659371 conn(0x7f26300698e0 msgr2=0x7f2630069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:06.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 -- 172.21.15.45:0/1137659371 shutdown_connections 2023-07-09T02:12:06.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 -- 172.21.15.45:0/1137659371 wait complete. 2023-07-09T02:12:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 Processor -- start 2023-07-09T02:12:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.884+0000 7f263547b640 1 -- start start 2023-07-09T02:12:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26300cd120 0x7f2630151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26300d2620 0x7f263015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f263015c060 0x7f26301594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263015e800 con 0x7f26300cd120 2023-07-09T02:12:06.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630153830 con 0x7f26300d2620 2023-07-09T02:12:06.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26301552f0 con 0x7f263015c060 2023-07-09T02:12:06.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26300cd120 0x7f2630151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:06.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26300cd120 0x7f2630151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60584/0 (socket says 172.21.15.45:60584) 2023-07-09T02:12:06.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 -- 172.21.15.45:0/83798918 learned_addr learned my addr 172.21.15.45:0/83798918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:06.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262f7fe640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f263015c060 0x7f26301594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:06.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f2627fff640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26300d2620 0x7f263015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:06.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 -- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f263015c060 msgr2=0x7f26301594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:06.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f263015c060 0x7f26301594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:06.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 -- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26300d2620 msgr2=0x7f263015ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:06.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26300d2620 0x7f263015ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:06.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 -- 172.21.15.45:0/83798918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618009420 con 0x7f26300cd120 2023-07-09T02:12:06.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262f7fe640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f263015c060 0x7f26301594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:06.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f262effd640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26300cd120 0x7f2630151300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2620001ec0 tx=0x7f262000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:06.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f26277fe640 1 -- 172.21.15.45:0/83798918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200054e0 con 0x7f26300cd120 2023-07-09T02:12:06.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f26277fe640 1 -- 172.21.15.45:0/83798918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620003600 con 0x7f26300cd120 2023-07-09T02:12:06.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f26277fe640 1 -- 172.21.15.45:0/83798918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200039b0 con 0x7f26300cd120 2023-07-09T02:12:06.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26300b59f0 con 0x7f26300cd120 2023-07-09T02:12:06.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2630151840 con 0x7f26300cd120 2023-07-09T02:12:06.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263004d7d0 con 0x7f26300cd120 2023-07-09T02:12:06.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.888+0000 7f26277fe640 1 -- 172.21.15.45:0/83798918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2620003b10 con 0x7f26300cd120 2023-07-09T02:12:06.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.892+0000 7f26277fe640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2610066280 0x7f2610068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:06.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.892+0000 7f26277fe640 1 -- 172.21.15.45:0/83798918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2620082f50 con 0x7f26300cd120 2023-07-09T02:12:06.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.892+0000 7f2627fff640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2610066280 0x7f2610068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:06.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.892+0000 7f2627fff640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2610066280 0x7f2610068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26180ae000 tx=0x7f26180a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:06.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:06.912+0000 7f26277fe640 1 -- 172.21.15.45:0/83798918 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26200507c0 con 0x7f26300cd120 2023-07-09T02:12:07.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.116+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f26300d2230 con 0x7f26300cd120 2023-07-09T02:12:07.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.116+0000 7f26277fe640 1 -- 172.21.15.45:0/83798918 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2620017020 con 0x7f26300cd120 2023-07-09T02:12:07.120 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:07.120 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:12:07.121 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:12:07.121 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.121 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:12:07.121 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:12:07.121 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.121 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:07.121 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:07.122 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:07.122 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.122 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.122 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.122 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.123 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:12:07.123 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:12:07.123 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.123 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:07.123 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:07.123 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:07.123 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.123 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.124 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.124 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.124 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:12:07.124 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:12:07.124 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.124 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:07.125 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:07.125 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:07.125 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.125 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.125 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.125 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.125 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:12:07.125 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:12:07.126 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.126 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:07.126 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:07.126 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:07.126 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.126 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.126 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.126 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.127 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:12:07.127 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:12:07.127 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.128 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:07.128 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:07.128 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.128 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.129 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.129 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.129 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:12:07.129 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:12:07.129 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.129 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:07.130 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:07.130 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.130 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.130 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.130 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:12:07.130 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:12:07.130 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.131 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:07.131 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:07.131 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.131 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.131 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.131 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.131 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:12:07.131 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:12:07.132 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.132 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:07.132 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:07.132 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.132 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.133 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.133 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.133 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:12:07.133 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:12:07.133 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.133 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:07.134 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:07.134 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.134 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.134 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.134 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.134 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:12:07.135 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:12:07.135 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.135 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:07.135 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:07.135 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.135 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.135 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.135 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.136 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:12:07.136 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:12:07.136 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.136 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:07.136 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:07.136 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.136 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.137 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.137 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.137 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:12:07.137 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:12:07.137 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.138 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:07.138 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:07.138 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.138 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.138 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.139 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.139 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:12:07.139 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:12:07.139 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.139 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:07.139 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:12:07.139 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:12:07.140 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:12:07.140 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.140 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.140 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:12:07.140 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:12:07.140 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.141 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:07.141 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:12:07.141 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:12:07.141 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:12:07.141 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.141 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.141 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.141 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:12:07.142 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:12:07.142 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.142 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:07.142 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:12:07.142 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:12:07.142 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:12:07.142 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.142 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.143 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.143 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:12:07.143 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:12:07.143 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.143 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:07.143 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:12:07.144 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:12:07.144 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:12:07.144 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.144 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.144 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.144 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:12:07.144 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:12:07.145 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.145 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:12:07.145 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:07.145 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:07.145 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.145 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.145 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.145 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.146 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2023-07-09T02:12:07.146 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzF6pkNNXdHRAANBBi1JKu98ZKszVtilMqRQ==", 2023-07-09T02:12:07.146 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.146 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2023-07-09T02:12:07.146 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.146 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.146 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.146 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2023-07-09T02:12:07.147 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzF6pkwd7dHRAA89oiVj3pIt6fdadP4AMwmg==", 2023-07-09T02:12:07.147 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.147 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-09T02:12:07.147 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.147 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.147 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.148 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2023-07-09T02:12:07.148 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzF6pkfOjdHRAA9SJSxpbVtNvmBSL+kN/LeQ==", 2023-07-09T02:12:07.148 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.148 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2023-07-09T02:12:07.148 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.149 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.149 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.149 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2023-07-09T02:12:07.149 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzF6pkNvHdHRAAOroQ1iEBXVzridZv6r4fLg==", 2023-07-09T02:12:07.149 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.150 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-09T02:12:07.150 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.150 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.150 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.150 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-09T02:12:07.150 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzF6pkx/vdHRAAL6cwZ557BNLTopuSukrpAg==", 2023-07-09T02:12:07.150 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.150 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-09T02:12:07.151 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.151 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.151 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.151 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2023-07-09T02:12:07.151 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAzF6pkXwreHRAAnnHDM24Vhj9Clakio6Fw1Q==", 2023-07-09T02:12:07.151 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.151 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-09T02:12:07.152 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.152 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.152 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.152 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:12:07.152 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:12:07.152 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.152 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:12:07.153 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:12:07.153 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.153 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.153 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:07.153 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:07.153 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:12:07.153 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:12:07.154 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:07.154 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:12:07.154 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:12:07.154 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:07.154 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.154 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:07.154 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:12:07.155 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:12:07.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2610066280 msgr2=0x7f2610068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2610066280 0x7f2610068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f26180ae000 tx=0x7f26180a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:07.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26300cd120 msgr2=0x7f2630151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26300cd120 0x7f2630151300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2620001ec0 tx=0x7f262000c8e0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 shutdown_connections 2023-07-09T02:12:07.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2610066280 0x7f2610068730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f263015c060 0x7f26301594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26300d2620 0x7f263015ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 --2- 172.21.15.45:0/83798918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26300cd120 0x7f2630151300 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 >> 172.21.15.45:0/83798918 conn(0x7f26300698e0 msgr2=0x7f26300d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 shutdown_connections 2023-07-09T02:12:07.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.120+0000 7f263547b640 1 -- 172.21.15.45:0/83798918 wait complete. 2023-07-09T02:12:07.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-09T02:12:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441eeca640 1 Processor -- start 2023-07-09T02:12:07.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441eeca640 1 -- start start 2023-07-09T02:12:07.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441eeca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180d0200 0x7f441815fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441eeca640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441806bfe0 con 0x7f44180ce340 2023-07-09T02:12:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441eeca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441806d5d0 con 0x7f4418099df0 2023-07-09T02:12:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441eeca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441806da60 con 0x7f44180d0200 2023-07-09T02:12:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441e6c9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f44180ce340 0x7f44180ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39344/0 (socket says 172.21.15.45:39344) 2023-07-09T02:12:07.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441e6c9640 1 -- 172.21.15.45:0/1995020715 learned_addr learned my addr 172.21.15.45:0/1995020715 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441dec8640 1 --2- 172.21.15.45:0/1995020715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180d0200 0x7f441815fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441cec6640 1 -- 172.21.15.45:0/1995020715 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269378940 0 0) 0x7f441806bfe0 con 0x7f44180ce340 2023-07-09T02:12:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441cec6640 1 -- 172.21.15.45:0/1995020715 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4404003530 con 0x7f44180ce340 2023-07-09T02:12:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441cec6640 1 -- 172.21.15.45:0/1995020715 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886970210 0 0) 0x7f441806d5d0 con 0x7f4418099df0 2023-07-09T02:12:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441dec8640 1 -- 172.21.15.45:0/1995020715 >> v1:172.21.15.155:6789/0 conn(0x7f4418099df0 legacy=0x7f4418160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441dec8640 1 -- 172.21.15.45:0/1995020715 >> v1:172.21.15.45:6789/0 conn(0x7f44180ce340 legacy=0x7f44180ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.300+0000 7f441dec8640 1 -- 172.21.15.45:0/1995020715 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441806c230 con 0x7f44180d0200 2023-07-09T02:12:07.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441dec8640 1 --2- 172.21.15.45:0/1995020715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180d0200 0x7f441815fac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44140097f0 tx=0x7f441401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec092e7f6d76739b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:07.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441cec6640 1 -- 172.21.15.45:0/1995020715 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140ab600 con 0x7f44180d0200 2023-07-09T02:12:07.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441cec6640 1 -- 172.21.15.45:0/1995020715 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44140a7050 con 0x7f44180d0200 2023-07-09T02:12:07.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441cec6640 1 -- 172.21.15.45:0/1995020715 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140ab980 con 0x7f44180d0200 2023-07-09T02:12:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441eeca640 1 -- 172.21.15.45:0/1995020715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180d0200 msgr2=0x7f441815fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441eeca640 1 --2- 172.21.15.45:0/1995020715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180d0200 0x7f441815fac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44140097f0 tx=0x7f441401c370 comp rx=0 tx=0).stop 2023-07-09T02:12:07.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441eeca640 1 -- 172.21.15.45:0/1995020715 shutdown_connections 2023-07-09T02:12:07.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441eeca640 1 --2- 172.21.15.45:0/1995020715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180d0200 0x7f441815fac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441eeca640 1 -- 172.21.15.45:0/1995020715 >> 172.21.15.45:0/1995020715 conn(0x7f44180999f0 msgr2=0x7f44180d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:07.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441eeca640 1 -- 172.21.15.45:0/1995020715 shutdown_connections 2023-07-09T02:12:07.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.304+0000 7f441eeca640 1 -- 172.21.15.45:0/1995020715 wait complete. 2023-07-09T02:12:07.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 Processor -- start 2023-07-09T02:12:07.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 -- start start 2023-07-09T02:12:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4418099df0 0x7f44180c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180ce340 0x7f4418150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44180d0200 0x7f44180c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441815cdb0 con 0x7f44180d0200 2023-07-09T02:12:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180cde80 con 0x7f4418099df0 2023-07-09T02:12:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4418154910 con 0x7f44180ce340 2023-07-09T02:12:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44180d0200 0x7f44180c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44180d0200 0x7f44180c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60586/0 (socket says 172.21.15.45:60586) 2023-07-09T02:12:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 -- 172.21.15.45:0/3360524250 learned_addr learned my addr 172.21.15.45:0/3360524250 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441dec8640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4418099df0 0x7f44180c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441d6c7640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180ce340 0x7f4418150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 -- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180ce340 msgr2=0x7f4418150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180ce340 0x7f4418150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 -- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4418099df0 msgr2=0x7f44180c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4418099df0 0x7f44180c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 -- 172.21.15.45:0/3360524250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414009420 con 0x7f44180d0200 2023-07-09T02:12:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441e6c9640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44180d0200 0x7f44180c5e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f441000cb70 tx=0x7f441000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f440e7fc640 1 -- 172.21.15.45:0/3360524250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441000ad40 con 0x7f44180d0200 2023-07-09T02:12:07.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f440e7fc640 1 -- 172.21.15.45:0/3360524250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4410012400 con 0x7f44180d0200 2023-07-09T02:12:07.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f440e7fc640 1 -- 172.21.15.45:0/3360524250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441000aea0 con 0x7f44180d0200 2023-07-09T02:12:07.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44180c70c0 con 0x7f44180d0200 2023-07-09T02:12:07.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.308+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44180cdba0 con 0x7f44180d0200 2023-07-09T02:12:07.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.312+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441815cef0 con 0x7f44180d0200 2023-07-09T02:12:07.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.312+0000 7f440e7fc640 1 -- 172.21.15.45:0/3360524250 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4410007070 con 0x7f44180d0200 2023-07-09T02:12:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.312+0000 7f440e7fc640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f43fc066280 0x7f43fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.312+0000 7f440e7fc640 1 -- 172.21.15.45:0/3360524250 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4410083990 con 0x7f44180d0200 2023-07-09T02:12:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.312+0000 7f441dec8640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f43fc066280 0x7f43fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.312+0000 7f441dec8640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f43fc066280 0x7f43fc068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f44140ad000 tx=0x7f44140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:07.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.316+0000 7f440e7fc640 1 -- 172.21.15.45:0/3360524250 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f441815cef0 con 0x7f44180d0200 2023-07-09T02:12:07.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.520+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f441815cef0 con 0x7f44180d0200 2023-07-09T02:12:07.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f440e7fc640 1 -- 172.21.15.45:0/3360524250 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f441815cef0 con 0x7f44180d0200 2023-07-09T02:12:07.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f43fc066280 msgr2=0x7f43fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f43fc066280 0x7f43fc068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f44140ad000 tx=0x7f44140a6000 comp rx=0 tx=0).stop 2023-07-09T02:12:07.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44180d0200 msgr2=0x7f44180c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44180d0200 0x7f44180c5e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f441000cb70 tx=0x7f441000a430 comp rx=0 tx=0).stop 2023-07-09T02:12:07.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 shutdown_connections 2023-07-09T02:12:07.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44180d0200 0x7f44180c5e10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f43fc066280 0x7f43fc068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44180ce340 0x7f4418150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 --2- 172.21.15.45:0/3360524250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4418099df0 0x7f44180c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 >> 172.21.15.45:0/3360524250 conn(0x7f44180999f0 msgr2=0x7f44180b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:07.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 shutdown_connections 2023-07-09T02:12:07.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.528+0000 7f441eeca640 1 -- 172.21.15.45:0/3360524250 wait complete. 2023-07-09T02:12:07.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-09T02:12:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.692+0000 7f5ff8434640 1 Processor -- start 2023-07-09T02:12:07.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.692+0000 7f5ff8434640 1 -- start start 2023-07-09T02:12:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.692+0000 7f5ff8434640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 0x7f5ff00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.692+0000 7f5ff8434640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ff00cd120 0x7f5ff00d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.692+0000 7f5ff8434640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff0160a50 con 0x7f5ff00d2450 2023-07-09T02:12:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.692+0000 7f5ff8434640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff00d28f0 con 0x7f5ff00cd120 2023-07-09T02:12:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.692+0000 7f5ff8434640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00cfe40 con 0x7f5ff015c060 2023-07-09T02:12:07.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff59cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ff00cd120 0x7f5ff00d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff69d1640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5ff00d2450 0x7f5ff00d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39356/0 (socket says 172.21.15.45:39356) 2023-07-09T02:12:07.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff59cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ff00cd120 0x7f5ff00d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60598/0 (socket says 172.21.15.45:60598) 2023-07-09T02:12:07.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff69d1640 1 -- 172.21.15.45:0/1381542152 learned_addr learned my addr 172.21.15.45:0/1381542152 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:07.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff61d0640 1 --2- 172.21.15.45:0/1381542152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 0x7f5ff00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff59cf640 1 -- 172.21.15.45:0/1381542152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 msgr2=0x7f5ff00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff59cf640 1 --2- 172.21.15.45:0/1381542152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 0x7f5ff00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff59cf640 1 -- 172.21.15.45:0/1381542152 >> v1:172.21.15.45:6789/0 conn(0x7f5ff00d2450 legacy=0x7f5ff00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff51ce640 1 -- 172.21.15.45:0/1381542152 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288151710 0 0) 0x7f5ff0160a50 con 0x7f5ff00d2450 2023-07-09T02:12:07.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff59cf640 1 -- 172.21.15.45:0/1381542152 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff015c430 con 0x7f5ff00cd120 2023-07-09T02:12:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff59cf640 1 --2- 172.21.15.45:0/1381542152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00cd120 0x7f5ff00d1f10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097c0 tx=0x7f5fe001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aaa970da0a32e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff51ce640 1 -- 172.21.15.45:0/1381542152 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab600 con 0x7f5ff00cd120 2023-07-09T02:12:07.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff51ce640 1 -- 172.21.15.45:0/1381542152 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00a7050 con 0x7f5ff00cd120 2023-07-09T02:12:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.696+0000 7f5ff51ce640 1 -- 172.21.15.45:0/1381542152 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab980 con 0x7f5ff00cd120 2023-07-09T02:12:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- 172.21.15.45:0/1381542152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00cd120 msgr2=0x7f5ff00d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 --2- 172.21.15.45:0/1381542152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00cd120 0x7f5ff00d1f10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097c0 tx=0x7f5fe001c450 comp rx=0 tx=0).stop 2023-07-09T02:12:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- 172.21.15.45:0/1381542152 shutdown_connections 2023-07-09T02:12:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 --2- 172.21.15.45:0/1381542152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00cd120 0x7f5ff00d1f10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 --2- 172.21.15.45:0/1381542152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 0x7f5ff00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- 172.21.15.45:0/1381542152 >> 172.21.15.45:0/1381542152 conn(0x7f5ff00698e0 msgr2=0x7f5ff0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- 172.21.15.45:0/1381542152 shutdown_connections 2023-07-09T02:12:07.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- 172.21.15.45:0/1381542152 wait complete. 2023-07-09T02:12:07.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 Processor -- start 2023-07-09T02:12:07.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- start start 2023-07-09T02:12:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff00cd120 0x7f5ff00b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00d2450 0x7f5ff0153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 0x7f5ff0152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00cc990 con 0x7f5ff00d2450 2023-07-09T02:12:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff015c9e0 con 0x7f5ff00cd120 2023-07-09T02:12:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff8434640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff015ccc0 con 0x7f5ff015c060 2023-07-09T02:12:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff59cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00d2450 0x7f5ff0153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff59cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00d2450 0x7f5ff0153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60616/0 (socket says 172.21.15.45:60616) 2023-07-09T02:12:07.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff59cf640 1 -- 172.21.15.45:0/4068618318 learned_addr learned my addr 172.21.15.45:0/4068618318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff69d1640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 0x7f5ff0152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff61d0640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff00cd120 0x7f5ff00b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff59cf640 1 -- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 msgr2=0x7f5ff0152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff59cf640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 0x7f5ff0152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff59cf640 1 -- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff00cd120 msgr2=0x7f5ff00b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff59cf640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff00cd120 0x7f5ff00b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.700+0000 7f5ff59cf640 1 -- 172.21.15.45:0/4068618318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009420 con 0x7f5ff00d2450 2023-07-09T02:12:07.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.704+0000 7f5ff59cf640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00d2450 0x7f5ff0153e70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ae040 tx=0x7f5fe001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:07.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.704+0000 7f5fe6ffd640 1 -- 172.21.15.45:0/4068618318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00b7450 con 0x7f5ff00d2450 2023-07-09T02:12:07.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.704+0000 7f5fe6ffd640 1 -- 172.21.15.45:0/4068618318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00b75b0 con 0x7f5ff00d2450 2023-07-09T02:12:07.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.704+0000 7f5fe6ffd640 1 -- 172.21.15.45:0/4068618318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00b7960 con 0x7f5ff00d2450 2023-07-09T02:12:07.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.704+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff015cfa0 con 0x7f5ff00d2450 2023-07-09T02:12:07.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.704+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff015d560 con 0x7f5ff00d2450 2023-07-09T02:12:07.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.704+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff015d750 con 0x7f5ff00d2450 2023-07-09T02:12:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.704+0000 7f5fe6ffd640 1 -- 172.21.15.45:0/4068618318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fe00b7ac0 con 0x7f5ff00d2450 2023-07-09T02:12:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.708+0000 7f5fe6ffd640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5fd4066280 0x7f5fd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:07.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.708+0000 7f5ff61d0640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5fd4066280 0x7f5fd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.708+0000 7f5fe6ffd640 1 -- 172.21.15.45:0/4068618318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5fe00f3550 con 0x7f5ff00d2450 2023-07-09T02:12:07.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.708+0000 7f5ff61d0640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5fd4066280 0x7f5fd4068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009aa0 tx=0x7f5fec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:07.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.712+0000 7f5fe6ffd640 1 -- 172.21.15.45:0/4068618318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5fe00eb980 con 0x7f5ff00d2450 2023-07-09T02:12:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.924+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f5ff004d7d0 con 0x7f5ff00d2450 2023-07-09T02:12:07.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5fe6ffd640 1 -- 172.21.15.45:0/4068618318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5fe00eefa0 con 0x7f5ff00d2450 2023-07-09T02:12:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5fd4066280 msgr2=0x7f5fd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5fd4066280 0x7f5fd4068730 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009aa0 tx=0x7f5fec009190 comp rx=0 tx=0).stop 2023-07-09T02:12:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00d2450 msgr2=0x7f5ff0153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00d2450 0x7f5ff0153e70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ae040 tx=0x7f5fe001ac90 comp rx=0 tx=0).stop 2023-07-09T02:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 shutdown_connections 2023-07-09T02:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5fd4066280 0x7f5fd4068730 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ff015c060 0x7f5ff0152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ff00d2450 0x7f5ff0153e70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 --2- 172.21.15.45:0/4068618318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ff00cd120 0x7f5ff00b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 >> 172.21.15.45:0/4068618318 conn(0x7f5ff00698e0 msgr2=0x7f5ff01573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 shutdown_connections 2023-07-09T02:12:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:07.932+0000 7f5ff8434640 1 -- 172.21.15.45:0/4068618318 wait complete. 2023-07-09T02:12:07.954 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-09T02:12:08.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5fa893640 1 Processor -- start 2023-07-09T02:12:08.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5fa893640 1 -- start start 2023-07-09T02:12:08.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5fa893640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40d2620 0x7fa5f40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5fa893640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f4160a50 con 0x7fa5f415c060 2023-07-09T02:12:08.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5fa893640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f415c430 con 0x7fa5f40cd120 2023-07-09T02:12:08.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5fa893640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f415fb60 con 0x7fa5f40d2620 2023-07-09T02:12:08.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa5f415c060 0x7fa5f40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39368/0 (socket says 172.21.15.45:39368) 2023-07-09T02:12:08.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f3fff640 1 -- 172.21.15.45:0/2010949287 learned_addr learned my addr 172.21.15.45:0/2010949287 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:08.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f37fe640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40d2620 0x7fa5f40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849621960 0 0) 0x7fa5f4160a50 con 0x7fa5f415c060 2023-07-09T02:12:08.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc003530 con 0x7fa5f415c060 2023-07-09T02:12:08.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 254295352 0 0) 0x7fa5dc003530 con 0x7fa5f415c060 2023-07-09T02:12:08.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40d2620 msgr2=0x7fa5f40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:08.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40d2620 0x7fa5f40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 >> v1:172.21.15.155:6789/0 conn(0x7fa5f40cd120 legacy=0x7fa5f40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f415fe40 con 0x7fa5f415c060 2023-07-09T02:12:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fa5e4001680 con 0x7fa5f415c060 2023-07-09T02:12:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 >> v1:172.21.15.45:6789/0 conn(0x7fa5f415c060 legacy=0x7fa5f40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5dc0039b0 0x7fa5dc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004300 0x7fa5dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5dc004fd0 0x7fa5dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f415fb60 con 0x7fa5dc004fd0 2023-07-09T02:12:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc00bed0 con 0x7fa5dc004300 2023-07-09T02:12:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.096+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc00c090 con 0x7fa5dc0039b0 2023-07-09T02:12:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f8e30640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5dc004fd0 0x7fa5dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f3fff640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5dc0039b0 0x7fa5dc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f37fe640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004300 0x7fa5dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f8e30640 1 -- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5dc0039b0 msgr2=0x7fa5dc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f8e30640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5dc0039b0 0x7fa5dc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f8e30640 1 -- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004300 msgr2=0x7fa5dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f8e30640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004300 0x7fa5dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f8e30640 1 -- 172.21.15.45:0/2010949287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc003530 con 0x7fa5dc004fd0 2023-07-09T02:12:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f37fe640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004300 0x7fa5dc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:08.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f8e30640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5dc004fd0 0x7fa5dc00b990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec001f60 tx=0x7fa5ec01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9297a53ff967e669 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4007ea0 con 0x7fa5dc004fd0 2023-07-09T02:12:08.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0a5750 con 0x7fa5dc004fd0 2023-07-09T02:12:08.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.100+0000 7fa5f2ffd640 1 -- 172.21.15.45:0/2010949287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0a5b40 con 0x7fa5dc004fd0 2023-07-09T02:12:08.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- 172.21.15.45:0/2010949287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5dc004fd0 msgr2=0x7fa5dc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 --2- 172.21.15.45:0/2010949287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5dc004fd0 0x7fa5dc00b990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec001f60 tx=0x7fa5ec01c860 comp rx=0 tx=0).stop 2023-07-09T02:12:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 -- 172.21.15.45:0/2010949287 reap_dead start 2023-07-09T02:12:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- 172.21.15.45:0/2010949287 shutdown_connections 2023-07-09T02:12:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- 172.21.15.45:0/2010949287 >> 172.21.15.45:0/2010949287 conn(0x7fa5f40698e0 msgr2=0x7fa5f4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- 172.21.15.45:0/2010949287 shutdown_connections 2023-07-09T02:12:08.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- 172.21.15.45:0/2010949287 wait complete. 2023-07-09T02:12:08.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 Processor -- start 2023-07-09T02:12:08.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- start start 2023-07-09T02:12:08.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004fd0 0x7fa5f4070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40c9b10 0x7fa5f4156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5f4156b70 0x7fa5f40b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41573c0 con 0x7fa5f4156b70 2023-07-09T02:12:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40ca520 con 0x7fa5dc004fd0 2023-07-09T02:12:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5fa893640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40ca770 con 0x7fa5f40c9b10 2023-07-09T02:12:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5f4156b70 0x7fa5f40b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5f4156b70 0x7fa5f40b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60632/0 (socket says 172.21.15.45:60632) 2023-07-09T02:12:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 -- 172.21.15.45:0/3553422679 learned_addr learned my addr 172.21.15.45:0/3553422679 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f37fe640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40c9b10 0x7fa5f4156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f3fff640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004fd0 0x7fa5f4070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 -- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40c9b10 msgr2=0x7fa5f4156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40c9b10 0x7fa5f4156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 -- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004fd0 msgr2=0x7fa5f4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004fd0 0x7fa5f4070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.104+0000 7fa5f8e30640 1 -- 172.21.15.45:0/3553422679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40caa50 con 0x7fa5f4156b70 2023-07-09T02:12:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f3fff640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004fd0 0x7fa5f4070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f8e30640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5f4156b70 0x7fa5f40b6c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec001f60 tx=0x7fa5dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f0ff9640 1 -- 172.21.15.45:0/3553422679 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec003d90 con 0x7fa5f4156b70 2023-07-09T02:12:08.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f0ff9640 1 -- 172.21.15.45:0/3553422679 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0a58c0 con 0x7fa5f4156b70 2023-07-09T02:12:08.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f415d760 con 0x7fa5f4156b70 2023-07-09T02:12:08.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f0ff9640 1 -- 172.21.15.45:0/3553422679 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0a5c30 con 0x7fa5f4156b70 2023-07-09T02:12:08.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f40b71c0 con 0x7fa5f4156b70 2023-07-09T02:12:08.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f404d7d0 con 0x7fa5f4156b70 2023-07-09T02:12:08.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f0ff9640 1 -- 172.21.15.45:0/3553422679 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5ec0b4040 con 0x7fa5f4156b70 2023-07-09T02:12:08.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f0ff9640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa5e0066280 0x7fa5e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f0ff9640 1 -- 172.21.15.45:0/3553422679 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa5ec11ccc0 con 0x7fa5f4156b70 2023-07-09T02:12:08.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.108+0000 7fa5f3fff640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa5e0066280 0x7fa5e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.112+0000 7fa5f3fff640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa5e0066280 0x7fa5e0068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4000c10 tx=0x7fa5e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.112+0000 7fa5f0ff9640 1 -- 172.21.15.45:0/3553422679 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5ec123080 con 0x7fa5f4156b70 2023-07-09T02:12:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.320+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa5f406baa0 con 0x7fa5f4156b70 2023-07-09T02:12:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.324+0000 7fa5f0ff9640 1 -- 172.21.15.45:0/3553422679 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa5ec0ea4a0 con 0x7fa5f4156b70 2023-07-09T02:12:08.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa5e0066280 msgr2=0x7fa5e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa5e0066280 0x7fa5e0068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4000c10 tx=0x7fa5e4009040 comp rx=0 tx=0).stop 2023-07-09T02:12:08.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5f4156b70 msgr2=0x7fa5f40b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5f4156b70 0x7fa5f40b6c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec001f60 tx=0x7fa5dc005800 comp rx=0 tx=0).stop 2023-07-09T02:12:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 shutdown_connections 2023-07-09T02:12:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5f4156b70 0x7fa5f40b6c80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa5e0066280 0x7fa5e0068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5f40c9b10 0x7fa5f4156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 --2- 172.21.15.45:0/3553422679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5dc004fd0 0x7fa5f4070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 >> 172.21.15.45:0/3553422679 conn(0x7fa5f40698e0 msgr2=0x7fa5f40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 shutdown_connections 2023-07-09T02:12:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.328+0000 7fa5fa893640 1 -- 172.21.15.45:0/3553422679 wait complete. 2023-07-09T02:12:08.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-09T02:12:08.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae69b82640 1 Processor -- start 2023-07-09T02:12:08.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae69b82640 1 -- start start 2023-07-09T02:12:08.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae69b82640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae6415c060 0x7fae640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae69b82640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fae640cd120 0x7fae640d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae69b82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640d2450 0x7fae640d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae69b82640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae640d28f0 con 0x7fae6415c060 2023-07-09T02:12:08.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae69b82640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae64160a50 con 0x7fae640cd120 2023-07-09T02:12:08.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae69b82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6415c430 con 0x7fae640d2450 2023-07-09T02:12:08.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.488+0000 7fae637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae6415c060 0x7fae640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae6415c060 0x7fae640b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60638/0 (socket says 172.21.15.45:60638) 2023-07-09T02:12:08.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae637fe640 1 -- 172.21.15.45:0/3374358307 learned_addr learned my addr 172.21.15.45:0/3374358307 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:08.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae62ffd640 1 --2- 172.21.15.45:0/3374358307 >> v2:172.21.15.155:3300/0 conn(0x7fae640cd120 0x7fae640d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae63fff640 1 --2- 172.21.15.45:0/3374358307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640d2450 0x7fae640d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae637fe640 1 -- 172.21.15.45:0/3374358307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640d2450 msgr2=0x7fae640d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:08.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae637fe640 1 --2- 172.21.15.45:0/3374358307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640d2450 0x7fae640d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae637fe640 1 -- 172.21.15.45:0/3374358307 >> v2:172.21.15.155:3300/0 conn(0x7fae640cd120 msgr2=0x7fae640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:08.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae637fe640 1 --2- 172.21.15.45:0/3374358307 >> v2:172.21.15.155:3300/0 conn(0x7fae640cd120 0x7fae640d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae637fe640 1 -- 172.21.15.45:0/3374358307 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6415fb60 con 0x7fae6415c060 2023-07-09T02:12:08.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae62ffd640 1 --2- 172.21.15.45:0/3374358307 >> v2:172.21.15.155:3300/0 conn(0x7fae640cd120 0x7fae640d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:08.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae637fe640 1 --2- 172.21.15.45:0/3374358307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae640b4ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae6415fac0 tx=0x7fae5401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9b008060135a72 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae627fc640 1 -- 172.21.15.45:0/3374358307 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540ab600 con 0x7fae6415c060 2023-07-09T02:12:08.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae627fc640 1 -- 172.21.15.45:0/3374358307 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae540a7050 con 0x7fae6415c060 2023-07-09T02:12:08.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.492+0000 7fae627fc640 1 -- 172.21.15.45:0/3374358307 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540ab980 con 0x7fae6415c060 2023-07-09T02:12:08.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- 172.21.15.45:0/3374358307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 msgr2=0x7fae640b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 --2- 172.21.15.45:0/3374358307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae640b4ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae6415fac0 tx=0x7fae5401c210 comp rx=0 tx=0).stop 2023-07-09T02:12:08.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- 172.21.15.45:0/3374358307 shutdown_connections 2023-07-09T02:12:08.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 --2- 172.21.15.45:0/3374358307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640d2450 0x7fae640d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 --2- 172.21.15.45:0/3374358307 >> v2:172.21.15.155:3300/0 conn(0x7fae640cd120 0x7fae640d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 --2- 172.21.15.45:0/3374358307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae640b4ed0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- 172.21.15.45:0/3374358307 >> 172.21.15.45:0/3374358307 conn(0x7fae640698e0 msgr2=0x7fae64069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- 172.21.15.45:0/3374358307 shutdown_connections 2023-07-09T02:12:08.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- 172.21.15.45:0/3374358307 wait complete. 2023-07-09T02:12:08.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 Processor -- start 2023-07-09T02:12:08.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- start start 2023-07-09T02:12:08.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640cd120 0x7fae640b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640d2450 0x7fae641551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae64151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae640b6e00 con 0x7fae6415c060 2023-07-09T02:12:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae640b61f0 con 0x7fae640d2450 2023-07-09T02:12:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae69b82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae640b64d0 con 0x7fae640cd120 2023-07-09T02:12:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae63fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae64151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae63fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae64151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60650/0 (socket says 172.21.15.45:60650) 2023-07-09T02:12:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae63fff640 1 -- 172.21.15.45:0/415881516 learned_addr learned my addr 172.21.15.45:0/415881516 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae637fe640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640cd120 0x7fae640b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae62ffd640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640d2450 0x7fae641551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae63fff640 1 -- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640cd120 msgr2=0x7fae640b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae63fff640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640cd120 0x7fae640b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae63fff640 1 -- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640d2450 msgr2=0x7fae641551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae63fff640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640d2450 0x7fae641551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae63fff640 1 -- 172.21.15.45:0/415881516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae540094d0 con 0x7fae6415c060 2023-07-09T02:12:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.496+0000 7fae62ffd640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640d2450 0x7fae641551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae63fff640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae64151880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fae5c007e40 tx=0x7fae5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae4bfff640 1 -- 172.21.15.45:0/415881516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c014620 con 0x7fae6415c060 2023-07-09T02:12:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae4bfff640 1 -- 172.21.15.45:0/415881516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c00ee90 con 0x7fae6415c060 2023-07-09T02:12:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae4bfff640 1 -- 172.21.15.45:0/415881516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0149e0 con 0x7fae6415c060 2023-07-09T02:12:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae640b67b0 con 0x7fae6415c060 2023-07-09T02:12:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae640b88b0 con 0x7fae6415c060 2023-07-09T02:12:08.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6415d850 con 0x7fae6415c060 2023-07-09T02:12:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae4bfff640 1 -- 172.21.15.45:0/415881516 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae5c014b40 con 0x7fae6415c060 2023-07-09T02:12:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae4bfff640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fae50066280 0x7fae50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae4bfff640 1 -- 172.21.15.45:0/415881516 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fae5c084300 con 0x7fae6415c060 2023-07-09T02:12:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.500+0000 7fae637fe640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fae50066280 0x7fae50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.504+0000 7fae637fe640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fae50066280 0x7fae50068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fae540ad000 tx=0x7fae54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.504+0000 7fae4bfff640 1 -- 172.21.15.45:0/415881516 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae5c051a30 con 0x7fae6415c060 2023-07-09T02:12:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.712+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fae6404d7d0 con 0x7fae6415c060 2023-07-09T02:12:08.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae4bfff640 1 -- 172.21.15.45:0/415881516 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fae5c055050 con 0x7fae6415c060 2023-07-09T02:12:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fae50066280 msgr2=0x7fae50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fae50066280 0x7fae50068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fae540ad000 tx=0x7fae54008040 comp rx=0 tx=0).stop 2023-07-09T02:12:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 msgr2=0x7fae64151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae64151880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fae5c007e40 tx=0x7fae5c00e4b0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 shutdown_connections 2023-07-09T02:12:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae6415c060 0x7fae64151880 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae640d2450 0x7fae641551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fae50066280 0x7fae50068730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 --2- 172.21.15.45:0/415881516 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae640cd120 0x7fae640b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.720+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 >> 172.21.15.45:0/415881516 conn(0x7fae640698e0 msgr2=0x7fae640b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.724+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 shutdown_connections 2023-07-09T02:12:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.724+0000 7fae69b82640 1 -- 172.21.15.45:0/415881516 wait complete. 2023-07-09T02:12:08.744 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-09T02:12:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.884+0000 7f1345256640 1 Processor -- start 2023-07-09T02:12:08.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.884+0000 7f1345256640 1 -- start start 2023-07-09T02:12:08.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f1345256640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13400d2620 0x7f13400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f1345256640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1340160a50 con 0x7f134015c060 2023-07-09T02:12:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f1345256640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134015c430 con 0x7f13400cd120 2023-07-09T02:12:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f1345256640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134015fb60 con 0x7f13400d2620 2023-07-09T02:12:08.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133ed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f134015c060 0x7f13400d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39374/0 (socket says 172.21.15.45:39374) 2023-07-09T02:12:08.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133ed9d640 1 -- 172.21.15.45:0/689364766 learned_addr learned my addr 172.21.15.45:0/689364766 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:08.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f1337fff640 1 --2- 172.21.15.45:0/689364766 >> v2:172.21.15.155:3300/0 conn(0x7f13400d2620 0x7f13400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5241982 0 0) 0x7f1340160a50 con 0x7f134015c060 2023-07-09T02:12:08.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f132c003530 con 0x7f134015c060 2023-07-09T02:12:08.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977069266 0 0) 0x7f134015c430 con 0x7f13400cd120 2023-07-09T02:12:08.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1340160a50 con 0x7f13400cd120 2023-07-09T02:12:08.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3046473750 0 0) 0x7f132c003530 con 0x7f134015c060 2023-07-09T02:12:08.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 >> v2:172.21.15.155:3300/0 conn(0x7f13400d2620 msgr2=0x7f13400b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 --2- 172.21.15.45:0/689364766 >> v2:172.21.15.155:3300/0 conn(0x7f13400d2620 0x7f13400b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 >> v1:172.21.15.155:6789/0 conn(0x7f13400cd120 legacy=0x7f13400cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134015fe40 con 0x7f134015c060 2023-07-09T02:12:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f1330001680 con 0x7f134015c060 2023-07-09T02:12:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 >> v1:172.21.15.45:6789/0 conn(0x7f134015c060 legacy=0x7f13400d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f132c003b10 0x7f132c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c0047d0 0x7f132c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132c005180 0x7f132c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134015fb60 con 0x7f132c005180 2023-07-09T02:12:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c00bfe0 con 0x7f132c003b10 2023-07-09T02:12:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c00c1a0 con 0x7f132c0047d0 2023-07-09T02:12:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133ed9d640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f132c003b10 0x7f132c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133f59e640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132c005180 0x7f132c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f1337fff640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c0047d0 0x7f132c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133f59e640 1 -- 172.21.15.45:0/689364766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c0047d0 msgr2=0x7f132c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133f59e640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c0047d0 0x7f132c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133f59e640 1 -- 172.21.15.45:0/689364766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f132c003b10 msgr2=0x7f132c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133f59e640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f132c003b10 0x7f132c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.888+0000 7f133f59e640 1 -- 172.21.15.45:0/689364766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c003530 con 0x7f132c005180 2023-07-09T02:12:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f133f59e640 1 -- 172.21.15.45:0/689364766 reap_dead start 2023-07-09T02:12:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f133f59e640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132c005180 0x7f132c00b990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1338001fd0 tx=0x7f133801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a647ba48c5354f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330007ea0 con 0x7f132c005180 2023-07-09T02:12:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1338003ba0 con 0x7f132c005180 2023-07-09T02:12:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f133e59c640 1 -- 172.21.15.45:0/689364766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380050d0 con 0x7f132c005180 2023-07-09T02:12:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f1345256640 1 -- 172.21.15.45:0/689364766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132c005180 msgr2=0x7f132c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f1345256640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132c005180 0x7f132c00b990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1338001fd0 tx=0x7f133801c8e0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f1345256640 1 -- 172.21.15.45:0/689364766 shutdown_connections 2023-07-09T02:12:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f1345256640 1 --2- 172.21.15.45:0/689364766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132c005180 0x7f132c00b990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f1345256640 1 -- 172.21.15.45:0/689364766 >> 172.21.15.45:0/689364766 conn(0x7f13400698e0 msgr2=0x7f1340069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f1345256640 1 -- 172.21.15.45:0/689364766 shutdown_connections 2023-07-09T02:12:08.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.892+0000 7f1345256640 1 -- 172.21.15.45:0/689364766 wait complete. 2023-07-09T02:12:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 Processor -- start 2023-07-09T02:12:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 -- start start 2023-07-09T02:12:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c005180 0x7f13400b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13400cbcf0 0x7f13400cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13401f0ca0 0x7f13401f1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13401f5c80 con 0x7f13400cbcf0 2023-07-09T02:12:08.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400cc6a0 con 0x7f13401f0ca0 2023-07-09T02:12:08.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13401f1650 con 0x7f132c005180 2023-07-09T02:12:08.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13400cbcf0 0x7f13400cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13400cbcf0 0x7f13400cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60670/0 (socket says 172.21.15.45:60670) 2023-07-09T02:12:08.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 -- 172.21.15.45:0/2937174313 learned_addr learned my addr 172.21.15.45:0/2937174313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:08.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f133f59e640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13401f0ca0 0x7f13401f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f133ed9d640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c005180 0x7f13400b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 -- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c005180 msgr2=0x7f13400b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c005180 0x7f13400b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 -- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13401f0ca0 msgr2=0x7f13401f1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:08.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13401f0ca0 0x7f13401f1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:08.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 -- 172.21.15.45:0/2937174313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13401f4d90 con 0x7f13400cbcf0 2023-07-09T02:12:08.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f133ed9d640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c005180 0x7f13400b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:08.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1337fff640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13400cbcf0 0x7f13400cc160 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1328011990 tx=0x7f1328011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f13377fe640 1 -- 172.21.15.45:0/2937174313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328004240 con 0x7f13400cbcf0 2023-07-09T02:12:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f13377fe640 1 -- 172.21.15.45:0/2937174313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13280043a0 con 0x7f13400cbcf0 2023-07-09T02:12:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f13377fe640 1 -- 172.21.15.45:0/2937174313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132800fa80 con 0x7f13400cbcf0 2023-07-09T02:12:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13401f5070 con 0x7f13400cbcf0 2023-07-09T02:12:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.896+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13401f5630 con 0x7f13400cbcf0 2023-07-09T02:12:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.900+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13400c9af0 con 0x7f13400cbcf0 2023-07-09T02:12:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.900+0000 7f13377fe640 1 -- 172.21.15.45:0/2937174313 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f132800fbe0 con 0x7f13400cbcf0 2023-07-09T02:12:08.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.900+0000 7f13377fe640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1320066280 0x7f1320068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.900+0000 7f13377fe640 1 -- 172.21.15.45:0/2937174313 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1328084090 con 0x7f13400cbcf0 2023-07-09T02:12:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.900+0000 7f133ed9d640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1320066280 0x7f1320068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.900+0000 7f133ed9d640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1320066280 0x7f1320068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1330001060 tx=0x7f1330009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:08.904+0000 7f13377fe640 1 -- 172.21.15.45:0/2937174313 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1328051870 con 0x7f13400cbcf0 2023-07-09T02:12:09.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.116+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f134004d7d0 con 0x7f13400cbcf0 2023-07-09T02:12:09.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f13377fe640 1 -- 172.21.15.45:0/2937174313 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1328054e90 con 0x7f13400cbcf0 2023-07-09T02:12:09.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1320066280 msgr2=0x7f1320068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1320066280 0x7f1320068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1330001060 tx=0x7f1330009040 comp rx=0 tx=0).stop 2023-07-09T02:12:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13400cbcf0 msgr2=0x7f13400cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13400cbcf0 0x7f13400cc160 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1328011990 tx=0x7f1328011e50 comp rx=0 tx=0).stop 2023-07-09T02:12:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 shutdown_connections 2023-07-09T02:12:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13401f0ca0 0x7f13401f1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13400cbcf0 0x7f13400cc160 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1320066280 0x7f1320068730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 --2- 172.21.15.45:0/2937174313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f132c005180 0x7f13400b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 >> 172.21.15.45:0/2937174313 conn(0x7f13400698e0 msgr2=0x7f1340069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 shutdown_connections 2023-07-09T02:12:09.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.120+0000 7f1345256640 1 -- 172.21.15.45:0/2937174313 wait complete. 2023-07-09T02:12:09.144 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-09T02:12:09.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.284+0000 7febee9ad640 1 Processor -- start 2023-07-09T02:12:09.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.284+0000 7febee9ad640 1 -- start start 2023-07-09T02:12:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febee9ad640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7febe80cd120 0x7febe80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febee9ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe8160a50 con 0x7febe815c060 2023-07-09T02:12:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febee9ad640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe815c430 con 0x7febe80d2620 2023-07-09T02:12:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febee9ad640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe815fb60 con 0x7febe80cd120 2023-07-09T02:12:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febe7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7febe815c060 0x7febe80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39390/0 (socket says 172.21.15.45:39390) 2023-07-09T02:12:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febe7fff640 1 -- 172.21.15.45:0/1783310568 learned_addr learned my addr 172.21.15.45:0/1783310568 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febecf4a640 1 --2- 172.21.15.45:0/1783310568 >> v2:172.21.15.155:3300/0 conn(0x7febe80cd120 0x7febe80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febecf4a640 1 -- 172.21.15.45:0/1783310568 >> v1:172.21.15.155:6789/0 conn(0x7febe80d2620 legacy=0x7febe80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febecf4a640 1 -- 172.21.15.45:0/1783310568 >> v1:172.21.15.45:6789/0 conn(0x7febe815c060 legacy=0x7febe80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.288+0000 7febecf4a640 1 -- 172.21.15.45:0/1783310568 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe815fe40 con 0x7febe80cd120 2023-07-09T02:12:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febecf4a640 1 --2- 172.21.15.45:0/1783310568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe80cd120 0x7febe80b4ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febe0009d90 tx=0x7febe001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810d517b1e8dce79 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febe6ffd640 1 -- 172.21.15.45:0/1783310568 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00a59e0 con 0x7febe80cd120 2023-07-09T02:12:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febe6ffd640 1 -- 172.21.15.45:0/1783310568 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe00a5b40 con 0x7febe80cd120 2023-07-09T02:12:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febe6ffd640 1 -- 172.21.15.45:0/1783310568 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00ad440 con 0x7febe80cd120 2023-07-09T02:12:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 -- 172.21.15.45:0/1783310568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe80cd120 msgr2=0x7febe80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 --2- 172.21.15.45:0/1783310568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe80cd120 0x7febe80b4ed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febe0009d90 tx=0x7febe001c920 comp rx=0 tx=0).stop 2023-07-09T02:12:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 -- 172.21.15.45:0/1783310568 shutdown_connections 2023-07-09T02:12:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 --2- 172.21.15.45:0/1783310568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe80cd120 0x7febe80b4ed0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 -- 172.21.15.45:0/1783310568 >> 172.21.15.45:0/1783310568 conn(0x7febe80698e0 msgr2=0x7febe8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 -- 172.21.15.45:0/1783310568 shutdown_connections 2023-07-09T02:12:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 -- 172.21.15.45:0/1783310568 wait complete. 2023-07-09T02:12:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 Processor -- start 2023-07-09T02:12:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.292+0000 7febee9ad640 1 -- start start 2023-07-09T02:12:09.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80cd120 0x7febe815e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febe80d2620 0x7febe8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe815c060 0x7febe80b7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe815ed30 con 0x7febe80cd120 2023-07-09T02:12:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe815f010 con 0x7febe815c060 2023-07-09T02:12:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe815f2f0 con 0x7febe80d2620 2023-07-09T02:12:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80cd120 0x7febe815e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80cd120 0x7febe815e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60678/0 (socket says 172.21.15.45:60678) 2023-07-09T02:12:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 -- 172.21.15.45:0/1709906090 learned_addr learned my addr 172.21.15.45:0/1709906090 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febecf4a640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe815c060 0x7febe80b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe77fe640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febe80d2620 0x7febe8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 -- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febe80d2620 msgr2=0x7febe8151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febe80d2620 0x7febe8151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 -- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe815c060 msgr2=0x7febe80b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe815c060 0x7febe80b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 -- 172.21.15.45:0/1709906090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0009a70 con 0x7febe80cd120 2023-07-09T02:12:09.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe77fe640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febe80d2620 0x7febe8151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:09.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe7fff640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80cd120 0x7febe815e6c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7febd800c400 tx=0x7febd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:09.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe4ff9640 1 -- 172.21.15.45:0/1709906090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8005cf0 con 0x7febe80cd120 2023-07-09T02:12:09.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe4ff9640 1 -- 172.21.15.45:0/1709906090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8005e50 con 0x7febe80cd120 2023-07-09T02:12:09.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe4ff9640 1 -- 172.21.15.45:0/1709906090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80072d0 con 0x7febe80cd120 2023-07-09T02:12:09.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80b59f0 con 0x7febe80cd120 2023-07-09T02:12:09.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe815f5d0 con 0x7febe80cd120 2023-07-09T02:12:09.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe804d7d0 con 0x7febe80cd120 2023-07-09T02:12:09.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.296+0000 7febe4ff9640 1 -- 172.21.15.45:0/1709906090 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febd8007430 con 0x7febe80cd120 2023-07-09T02:12:09.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.300+0000 7febe4ff9640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7febd4066280 0x7febd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.300+0000 7febe4ff9640 1 -- 172.21.15.45:0/1709906090 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7febd8082e60 con 0x7febe80cd120 2023-07-09T02:12:09.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.300+0000 7febe77fe640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7febd4066280 0x7febd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.300+0000 7febe77fe640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7febd4066280 0x7febd4068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7febe80ceea0 tx=0x7febdc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:09.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.304+0000 7febe4ff9640 1 -- 172.21.15.45:0/1709906090 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febd80506d0 con 0x7febe80cd120 2023-07-09T02:12:09.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.512+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7febe806baa0 con 0x7febe80cd120 2023-07-09T02:12:09.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.516+0000 7febe4ff9640 1 -- 172.21.15.45:0/1709906090 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7febd8053cf0 con 0x7febe80cd120 2023-07-09T02:12:09.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7febd4066280 msgr2=0x7febd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7febd4066280 0x7febd4068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7febe80ceea0 tx=0x7febdc009040 comp rx=0 tx=0).stop 2023-07-09T02:12:09.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80cd120 msgr2=0x7febe815e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80cd120 0x7febe815e6c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7febd800c400 tx=0x7febd800c8c0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 shutdown_connections 2023-07-09T02:12:09.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febe815c060 0x7febe80b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7febd4066280 0x7febd4068730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febe80d2620 0x7febe8151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 --2- 172.21.15.45:0/1709906090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80cd120 0x7febe815e6c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 >> 172.21.15.45:0/1709906090 conn(0x7febe80698e0 msgr2=0x7febe80d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:09.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 shutdown_connections 2023-07-09T02:12:09.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.520+0000 7febee9ad640 1 -- 172.21.15.45:0/1709906090 wait complete. 2023-07-09T02:12:09.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.680+0000 7f05d5656640 1 Processor -- start 2023-07-09T02:12:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05d5656640 1 -- start start 2023-07-09T02:12:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05d5656640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d015c060 0x7f05d00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05d5656640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05d00d2620 0x7f05d00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05d5656640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d0160a50 con 0x7f05d00cd120 2023-07-09T02:12:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05d5656640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d015c430 con 0x7f05d00d2620 2023-07-09T02:12:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05d5656640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d015fb60 con 0x7f05d015c060 2023-07-09T02:12:09.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05cf7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05d00d2620 0x7f05d00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05cf7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05d00d2620 0x7f05d00cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60684/0 (socket says 172.21.15.45:60684) 2023-07-09T02:12:09.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05cf7fe640 1 -- 172.21.15.45:0/4090575021 learned_addr learned my addr 172.21.15.45:0/4090575021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05ceffd640 1 --2- 172.21.15.45:0/4090575021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d015c060 0x7f05d00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05cf7fe640 1 -- 172.21.15.45:0/4090575021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d015c060 msgr2=0x7f05d00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05cf7fe640 1 --2- 172.21.15.45:0/4090575021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d015c060 0x7f05d00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05cf7fe640 1 -- 172.21.15.45:0/4090575021 >> v1:172.21.15.155:6789/0 conn(0x7f05d00cd120 legacy=0x7f05d00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.684+0000 7f05cf7fe640 1 -- 172.21.15.45:0/4090575021 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d015fe40 con 0x7f05d00d2620 2023-07-09T02:12:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05cf7fe640 1 --2- 172.21.15.45:0/4090575021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d00cee30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009e80 tx=0x7f05c801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60209a3ef85c3c69 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05ce7fc640 1 -- 172.21.15.45:0/4090575021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80a5880 con 0x7f05d00d2620 2023-07-09T02:12:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05ce7fc640 1 -- 172.21.15.45:0/4090575021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c80a59e0 con 0x7f05d00d2620 2023-07-09T02:12:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05ce7fc640 1 -- 172.21.15.45:0/4090575021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80a5d70 con 0x7f05d00d2620 2023-07-09T02:12:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 -- 172.21.15.45:0/4090575021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 msgr2=0x7f05d00cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 --2- 172.21.15.45:0/4090575021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d00cee30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009e80 tx=0x7f05c801c9c0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 -- 172.21.15.45:0/4090575021 shutdown_connections 2023-07-09T02:12:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 --2- 172.21.15.45:0/4090575021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d00cee30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 --2- 172.21.15.45:0/4090575021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d015c060 0x7f05d00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 -- 172.21.15.45:0/4090575021 >> 172.21.15.45:0/4090575021 conn(0x7f05d00698e0 msgr2=0x7f05d0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 -- 172.21.15.45:0/4090575021 shutdown_connections 2023-07-09T02:12:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 -- 172.21.15.45:0/4090575021 wait complete. 2023-07-09T02:12:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 Processor -- start 2023-07-09T02:12:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.688+0000 7f05d5656640 1 -- start start 2023-07-09T02:12:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d00cd120 0x7f05d015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d015c060 0x7f05d0151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0152990 con 0x7f05d00d2620 2023-07-09T02:12:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0152c70 con 0x7f05d015c060 2023-07-09T02:12:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0152f50 con 0x7f05d00cd120 2023-07-09T02:12:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05ceffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d00cd120 0x7f05d015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d015a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60690/0 (socket says 172.21.15.45:60690) 2023-07-09T02:12:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 -- 172.21.15.45:0/3041744278 learned_addr learned my addr 172.21.15.45:0/3041744278 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05cf7fe640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d015c060 0x7f05d0151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 -- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d00cd120 msgr2=0x7f05d015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d00cd120 0x7f05d015b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 -- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d015c060 msgr2=0x7f05d0151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d015c060 0x7f05d0151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 -- 172.21.15.45:0/3041744278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c8009b30 con 0x7f05d00d2620 2023-07-09T02:12:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c7fff640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d015a6e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c4d0 tx=0x7f05b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c77fe640 1 -- 172.21.15.45:0/3041744278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80052d0 con 0x7f05d00d2620 2023-07-09T02:12:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c77fe640 1 -- 172.21.15.45:0/3041744278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8005430 con 0x7f05d00d2620 2023-07-09T02:12:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05c77fe640 1 -- 172.21.15.45:0/3041744278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8012830 con 0x7f05d00d2620 2023-07-09T02:12:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00b59f0 con 0x7f05d00d2620 2023-07-09T02:12:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d015b7c0 con 0x7f05d00d2620 2023-07-09T02:12:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.692+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d0153750 con 0x7f05d00d2620 2023-07-09T02:12:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.696+0000 7f05c77fe640 1 -- 172.21.15.45:0/3041744278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05b8012990 con 0x7f05d00d2620 2023-07-09T02:12:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.696+0000 7f05c77fe640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b00662b0 0x7f05b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.696+0000 7f05c77fe640 1 -- 172.21.15.45:0/3041744278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f05b80833e0 con 0x7f05d00d2620 2023-07-09T02:12:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.696+0000 7f05ceffd640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b00662b0 0x7f05b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.696+0000 7f05ceffd640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b00662b0 0x7f05b0068760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009ac0 tx=0x7f05c0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.700+0000 7f05c77fe640 1 -- 172.21.15.45:0/3041744278 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05d0153750 con 0x7f05d00d2620 2023-07-09T02:12:09.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05d0153750 con 0x7f05d00d2620 2023-07-09T02:12:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05c77fe640 1 -- 172.21.15.45:0/3041744278 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f05d0153750 con 0x7f05d00d2620 2023-07-09T02:12:09.858 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:09.859 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":31,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:06.717321+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b00662b0 msgr2=0x7f05b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b00662b0 0x7f05b0068760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009ac0 tx=0x7f05c0009190 comp rx=0 tx=0).stop 2023-07-09T02:12:09.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 msgr2=0x7f05d015a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d015a6e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c4d0 tx=0x7f05b800c990 comp rx=0 tx=0).stop 2023-07-09T02:12:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 shutdown_connections 2023-07-09T02:12:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d015c060 0x7f05d0151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d00d2620 0x7f05d015a6e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b00662b0 0x7f05b0068760 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 --2- 172.21.15.45:0/3041744278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05d00cd120 0x7f05d015b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 >> 172.21.15.45:0/3041744278 conn(0x7f05d00698e0 msgr2=0x7f05d00b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 shutdown_connections 2023-07-09T02:12:09.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:09.856+0000 7f05d5656640 1 -- 172.21.15.45:0/3041744278 wait complete. 2023-07-09T02:12:09.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:12:09.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:12:10.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a27b40640 1 Processor -- start 2023-07-09T02:12:10.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a27b40640 1 -- start start 2023-07-09T02:12:10.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a27b40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a200cecf0 0x7f6a200694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a27b40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a200699f0 0x7f6a200cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a27b40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a200cf320 con 0x7f6a20142500 2023-07-09T02:12:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a27b40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a200cd6d0 con 0x7f6a200699f0 2023-07-09T02:12:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a27b40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a20069dc0 con 0x7f6a200cecf0 2023-07-09T02:12:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a258dc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6a20142500 0x7f6a20160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39398/0 (socket says 172.21.15.45:39398) 2023-07-09T02:12:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a258dc640 1 -- 172.21.15.45:0/3339335058 learned_addr learned my addr 172.21.15.45:0/3339335058 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:10.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a260dd640 1 --2- 172.21.15.45:0/3339335058 >> v2:172.21.15.45:3300/0 conn(0x7f6a200699f0 0x7f6a200cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.024+0000 7f6a250db640 1 --2- 172.21.15.45:0/3339335058 >> v2:172.21.15.155:3300/0 conn(0x7f6a200cecf0 0x7f6a200694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a248da640 1 -- 172.21.15.45:0/3339335058 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571731884 0 0) 0x7f6a200cf320 con 0x7f6a20142500 2023-07-09T02:12:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a248da640 1 -- 172.21.15.45:0/3339335058 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a0c003530 con 0x7f6a20142500 2023-07-09T02:12:10.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a260dd640 1 -- 172.21.15.45:0/3339335058 >> v2:172.21.15.155:3300/0 conn(0x7f6a200cecf0 msgr2=0x7f6a200694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a260dd640 1 --2- 172.21.15.45:0/3339335058 >> v2:172.21.15.155:3300/0 conn(0x7f6a200cecf0 0x7f6a200694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a260dd640 1 -- 172.21.15.45:0/3339335058 >> v1:172.21.15.45:6789/0 conn(0x7f6a20142500 legacy=0x7f6a20160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a260dd640 1 -- 172.21.15.45:0/3339335058 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2015d590 con 0x7f6a200699f0 2023-07-09T02:12:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a250db640 1 --2- 172.21.15.45:0/3339335058 >> v2:172.21.15.155:3300/0 conn(0x7f6a200cecf0 0x7f6a200694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:10.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a260dd640 1 --2- 172.21.15.45:0/3339335058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200699f0 0x7f6a200cf620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6a2006e080 tx=0x7f6a1801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afa29648f802af0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a248da640 1 -- 172.21.15.45:0/3339335058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a180a58c0 con 0x7f6a200699f0 2023-07-09T02:12:10.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a248da640 1 -- 172.21.15.45:0/3339335058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a180a5a20 con 0x7f6a200699f0 2023-07-09T02:12:10.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a248da640 1 -- 172.21.15.45:0/3339335058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a180a5db0 con 0x7f6a200699f0 2023-07-09T02:12:10.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a27b40640 1 -- 172.21.15.45:0/3339335058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200699f0 msgr2=0x7f6a200cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a27b40640 1 --2- 172.21.15.45:0/3339335058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200699f0 0x7f6a200cf620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6a2006e080 tx=0x7f6a1801c910 comp rx=0 tx=0).stop 2023-07-09T02:12:10.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a27b40640 1 -- 172.21.15.45:0/3339335058 shutdown_connections 2023-07-09T02:12:10.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a27b40640 1 --2- 172.21.15.45:0/3339335058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200699f0 0x7f6a200cf620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a27b40640 1 --2- 172.21.15.45:0/3339335058 >> v2:172.21.15.155:3300/0 conn(0x7f6a200cecf0 0x7f6a200694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.028+0000 7f6a27b40640 1 -- 172.21.15.45:0/3339335058 >> 172.21.15.45:0/3339335058 conn(0x7f6a200650b0 msgr2=0x7f6a200654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 -- 172.21.15.45:0/3339335058 shutdown_connections 2023-07-09T02:12:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 -- 172.21.15.45:0/3339335058 wait complete. 2023-07-09T02:12:10.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 Processor -- start 2023-07-09T02:12:10.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 -- start start 2023-07-09T02:12:10.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a200699f0 0x7f6a200c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200cecf0 0x7f6a201599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a20142500 0x7f6a200cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c8650 con 0x7f6a200cecf0 2023-07-09T02:12:10.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c77c0 con 0x7f6a200699f0 2023-07-09T02:12:10.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c7cb0 con 0x7f6a20142500 2023-07-09T02:12:10.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200cecf0 0x7f6a201599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200cecf0 0x7f6a201599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60704/0 (socket says 172.21.15.45:60704) 2023-07-09T02:12:10.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 -- 172.21.15.45:0/2422410337 learned_addr learned my addr 172.21.15.45:0/2422410337 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a258dc640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a200699f0 0x7f6a200c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a260dd640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a20142500 0x7f6a200cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 -- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a20142500 msgr2=0x7f6a200cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a20142500 0x7f6a200cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 -- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a200699f0 msgr2=0x7f6a200c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a200699f0 0x7f6a200c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 -- 172.21.15.45:0/2422410337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18009a70 con 0x7f6a200cecf0 2023-07-09T02:12:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a258dc640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a200699f0 0x7f6a200c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a250db640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200cecf0 0x7f6a201599f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000e810 tx=0x7f6a1000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a167fc640 1 -- 172.21.15.45:0/2422410337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000c8d0 con 0x7f6a200cecf0 2023-07-09T02:12:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a167fc640 1 -- 172.21.15.45:0/2422410337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000ca30 con 0x7f6a200cecf0 2023-07-09T02:12:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a167fc640 1 -- 172.21.15.45:0/2422410337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000cdc0 con 0x7f6a200cecf0 2023-07-09T02:12:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.032+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a200c7f90 con 0x7f6a200cecf0 2023-07-09T02:12:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.036+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a200c8fb0 con 0x7f6a200cecf0 2023-07-09T02:12:10.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.036+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2004d7d0 con 0x7f6a200cecf0 2023-07-09T02:12:10.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.036+0000 7f6a167fc640 1 -- 172.21.15.45:0/2422410337 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a10013410 con 0x7f6a200cecf0 2023-07-09T02:12:10.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.036+0000 7f6a167fc640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a04066280 0x7f6a04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.036+0000 7f6a167fc640 1 -- 172.21.15.45:0/2422410337 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6a10083780 con 0x7f6a200cecf0 2023-07-09T02:12:10.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.036+0000 7f6a258dc640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a04066280 0x7f6a04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.036+0000 7f6a258dc640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a04066280 0x7f6a04068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0011f0 tx=0x7f6a1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.040+0000 7f6a167fc640 1 -- 172.21.15.45:0/2422410337 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a10050f40 con 0x7f6a200cecf0 2023-07-09T02:12:10.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.196+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a200695e0 con 0x7f6a200cecf0 2023-07-09T02:12:10.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.196+0000 7f6a167fc640 1 -- 172.21.15.45:0/2422410337 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a10009480 con 0x7f6a200cecf0 2023-07-09T02:12:10.199 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:12:10.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a04066280 msgr2=0x7f6a04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a04066280 0x7f6a04068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0011f0 tx=0x7f6a1c009040 comp rx=0 tx=0).stop 2023-07-09T02:12:10.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200cecf0 msgr2=0x7f6a201599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200cecf0 0x7f6a201599f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000e810 tx=0x7f6a1000ecd0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 shutdown_connections 2023-07-09T02:12:10.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a04066280 0x7f6a04068730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a20142500 0x7f6a200cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a200cecf0 0x7f6a201599f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 --2- 172.21.15.45:0/2422410337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a200699f0 0x7f6a200c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 >> 172.21.15.45:0/2422410337 conn(0x7f6a200650b0 msgr2=0x7f6a20070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:10.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 shutdown_connections 2023-07-09T02:12:10.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.200+0000 7f6a27b40640 1 -- 172.21.15.45:0/2422410337 wait complete. 2023-07-09T02:12:10.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:12:10.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cdb819640 1 Processor -- start 2023-07-09T02:12:10.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cdb819640 1 -- start start 2023-07-09T02:12:10.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cdb819640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8cd415c060 0x7f8cd40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cdb819640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cd40cd120 0x7f8cd40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cdb819640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd4160a50 con 0x7f8cd40d2450 2023-07-09T02:12:10.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cdb819640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40d28d0 con 0x7f8cd40cd120 2023-07-09T02:12:10.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cdb819640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40cfe40 con 0x7f8cd415c060 2023-07-09T02:12:10.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd8db4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cd40cd120 0x7f8cd40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd8db4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cd40cd120 0x7f8cd40d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60712/0 (socket says 172.21.15.45:60712) 2023-07-09T02:12:10.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd8db4640 1 -- 172.21.15.45:0/2198940243 learned_addr learned my addr 172.21.15.45:0/2198940243 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:10.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd8db4640 1 -- 172.21.15.45:0/2198940243 >> v2:172.21.15.155:3300/0 conn(0x7f8cd415c060 msgr2=0x7f8cd40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:10.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd95b5640 1 --2- 172.21.15.45:0/2198940243 >> v2:172.21.15.155:3300/0 conn(0x7f8cd415c060 0x7f8cd40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd8db4640 1 --2- 172.21.15.45:0/2198940243 >> v2:172.21.15.155:3300/0 conn(0x7f8cd415c060 0x7f8cd40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd8db4640 1 -- 172.21.15.45:0/2198940243 >> v1:172.21.15.155:6789/0 conn(0x7f8cd40d2450 legacy=0x7f8cd40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:10.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd8db4640 1 -- 172.21.15.45:0/2198940243 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd415c430 con 0x7f8cd40cd120 2023-07-09T02:12:10.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.364+0000 7f8cd95b5640 1 --2- 172.21.15.45:0/2198940243 >> v2:172.21.15.155:3300/0 conn(0x7f8cd415c060 0x7f8cd40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:10.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cd8db4640 1 --2- 172.21.15.45:0/2198940243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd40d1f10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40d3ad0 tx=0x7f8cc401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbedf42f96c0fa6e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8ccbfff640 1 -- 172.21.15.45:0/2198940243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40ac410 con 0x7f8cd40cd120 2023-07-09T02:12:10.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8ccbfff640 1 -- 172.21.15.45:0/2198940243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40ac570 con 0x7f8cd40cd120 2023-07-09T02:12:10.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8ccbfff640 1 -- 172.21.15.45:0/2198940243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40ac900 con 0x7f8cd40cd120 2023-07-09T02:12:10.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cdb819640 1 -- 172.21.15.45:0/2198940243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 msgr2=0x7f8cd40d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cdb819640 1 --2- 172.21.15.45:0/2198940243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd40d1f10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40d3ad0 tx=0x7f8cc401c490 comp rx=0 tx=0).stop 2023-07-09T02:12:10.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cdb819640 1 -- 172.21.15.45:0/2198940243 shutdown_connections 2023-07-09T02:12:10.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cdb819640 1 --2- 172.21.15.45:0/2198940243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd40d1f10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cdb819640 1 --2- 172.21.15.45:0/2198940243 >> v2:172.21.15.155:3300/0 conn(0x7f8cd415c060 0x7f8cd40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cdb819640 1 -- 172.21.15.45:0/2198940243 >> 172.21.15.45:0/2198940243 conn(0x7f8cd40698e0 msgr2=0x7f8cd4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:10.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cdb819640 1 -- 172.21.15.45:0/2198940243 shutdown_connections 2023-07-09T02:12:10.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.368+0000 7f8cdb819640 1 -- 172.21.15.45:0/2198940243 wait complete. 2023-07-09T02:12:10.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 Processor -- start 2023-07-09T02:12:10.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 -- start start 2023-07-09T02:12:10.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cd40d2450 0x7f8cd4157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cd415c060 0x7f8cd4157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd415eba0 con 0x7f8cd40cd120 2023-07-09T02:12:10.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd415df90 con 0x7f8cd415c060 2023-07-09T02:12:10.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd415e270 con 0x7f8cd40d2450 2023-07-09T02:12:10.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd415d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60714/0 (socket says 172.21.15.45:60714) 2023-07-09T02:12:10.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 -- 172.21.15.45:0/523097901 learned_addr learned my addr 172.21.15.45:0/523097901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:10.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd8db4640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cd40d2450 0x7f8cd4157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd9db6640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cd415c060 0x7f8cd4157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 -- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cd40d2450 msgr2=0x7f8cd4157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cd40d2450 0x7f8cd4157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 -- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cd415c060 msgr2=0x7f8cd4157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cd415c060 0x7f8cd4157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 -- 172.21.15.45:0/523097901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40094d0 con 0x7f8cd40cd120 2023-07-09T02:12:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cd95b5640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd415d6a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c7f0 tx=0x7f8cd000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cc9ffb640 1 -- 172.21.15.45:0/523097901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0007820 con 0x7f8cd40cd120 2023-07-09T02:12:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cc9ffb640 1 -- 172.21.15.45:0/523097901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0007980 con 0x7f8cd40cd120 2023-07-09T02:12:10.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cc9ffb640 1 -- 172.21.15.45:0/523097901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0007d30 con 0x7f8cd40cd120 2023-07-09T02:12:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd415e550 con 0x7f8cd40cd120 2023-07-09T02:12:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.372+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd415dbe0 con 0x7f8cd40cd120 2023-07-09T02:12:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.376+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd404d7d0 con 0x7f8cd40cd120 2023-07-09T02:12:10.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.376+0000 7f8cc9ffb640 1 -- 172.21.15.45:0/523097901 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8cd00113f0 con 0x7f8cd40cd120 2023-07-09T02:12:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.376+0000 7f8cc9ffb640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb8066280 0x7f8cb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.376+0000 7f8cc9ffb640 1 -- 172.21.15.45:0/523097901 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8cd0083d10 con 0x7f8cd40cd120 2023-07-09T02:12:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.376+0000 7f8cd8db4640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb8066280 0x7f8cb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.376+0000 7f8cd8db4640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb8066280 0x7f8cb8068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40ae000 tx=0x7f8cc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.380+0000 7f8cc9ffb640 1 -- 172.21.15.45:0/523097901 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8cd0089020 con 0x7f8cd40cd120 2023-07-09T02:12:10.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8cd406baa0 con 0x7f8cd40cd120 2023-07-09T02:12:10.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cc9ffb640 1 -- 172.21.15.45:0/523097901 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8cd001f0a0 con 0x7f8cd40cd120 2023-07-09T02:12:10.539 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:12:10.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb8066280 msgr2=0x7f8cb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb8066280 0x7f8cb8068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40ae000 tx=0x7f8cc4009040 comp rx=0 tx=0).stop 2023-07-09T02:12:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 msgr2=0x7f8cd415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd415d6a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c7f0 tx=0x7f8cd000ccb0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 shutdown_connections 2023-07-09T02:12:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cd415c060 0x7f8cd4157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb8066280 0x7f8cb8068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cd40d2450 0x7f8cd4157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.536+0000 7f8cdb819640 1 --2- 172.21.15.45:0/523097901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cd40cd120 0x7f8cd415d6a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.540+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 >> 172.21.15.45:0/523097901 conn(0x7f8cd40698e0 msgr2=0x7f8cd40b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:10.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.540+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 shutdown_connections 2023-07-09T02:12:10.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.540+0000 7f8cdb819640 1 -- 172.21.15.45:0/523097901 wait complete. 2023-07-09T02:12:10.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:12:10.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.700+0000 7f41f7a93640 1 Processor -- start 2023-07-09T02:12:10.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.700+0000 7f41f7a93640 1 -- start start 2023-07-09T02:12:10.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.700+0000 7f41f7a93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41f00c8d10 0x7f41f00c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.700+0000 7f41f7a93640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41f015db00 0x7f41f015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.700+0000 7f41f7a93640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f006bf30 con 0x7f41f00ca0f0 2023-07-09T02:12:10.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.700+0000 7f41f7a93640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f015e4c0 con 0x7f41f015db00 2023-07-09T02:12:10.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.700+0000 7f41f7a93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f006bc50 con 0x7f41f00c8d10 2023-07-09T02:12:10.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f582f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f41f00ca0f0 0x7f41f00cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39408/0 (socket says 172.21.15.45:39408) 2023-07-09T02:12:10.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f582f640 1 -- 172.21.15.45:0/4180391562 learned_addr learned my addr 172.21.15.45:0/4180391562 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:10.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f6030640 1 --2- 172.21.15.45:0/4180391562 >> v2:172.21.15.155:3300/0 conn(0x7f41f015db00 0x7f41f015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f502e640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41f00c8d10 0x7f41f00c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946415889 0 0) 0x7f41f006bf30 con 0x7f41f00ca0f0 2023-07-09T02:12:10.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41dc003530 con 0x7f41f00ca0f0 2023-07-09T02:12:10.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935128930 0 0) 0x7f41dc003530 con 0x7f41f00ca0f0 2023-07-09T02:12:10.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41f00c8d10 msgr2=0x7f41f00c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:10.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41f00c8d10 0x7f41f00c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 >> v2:172.21.15.155:3300/0 conn(0x7f41f015db00 msgr2=0x7f41f015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 --2- 172.21.15.45:0/4180391562 >> v2:172.21.15.155:3300/0 conn(0x7f41f015db00 0x7f41f015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00cab90 con 0x7f41f00ca0f0 2023-07-09T02:12:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f41ec001680 con 0x7f41f00ca0f0 2023-07-09T02:12:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 >> v1:172.21.15.45:6789/0 conn(0x7f41f00ca0f0 legacy=0x7f41f00cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41dc003980 0x7f41dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41f00c8d10 0x7f41dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc004d10 0x7f41dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f015e4c0 con 0x7f41dc003980 2023-07-09T02:12:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f006bc50 con 0x7f41dc004d10 2023-07-09T02:12:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc00b990 con 0x7f41f00c8d10 2023-07-09T02:12:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f582f640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41dc003980 0x7f41dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f6030640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc004d10 0x7f41dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f502e640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41f00c8d10 0x7f41dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f582f640 1 -- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41f00c8d10 msgr2=0x7f41dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f582f640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41f00c8d10 0x7f41dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f582f640 1 -- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc004d10 msgr2=0x7f41dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:10.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f582f640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41dc004d10 0x7f41dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.704+0000 7f41f582f640 1 -- 172.21.15.45:0/4180391562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc003530 con 0x7f41dc003980 2023-07-09T02:12:10.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f582f640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41dc003980 0x7f41dc003d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00c240 tx=0x7f41ec01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbecadbfaf90e02 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec0a5940 con 0x7f41dc003980 2023-07-09T02:12:10.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec0a5aa0 con 0x7f41dc003980 2023-07-09T02:12:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f482d640 1 -- 172.21.15.45:0/4180391562 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec0a5e70 con 0x7f41dc003980 2023-07-09T02:12:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f7a93640 1 -- 172.21.15.45:0/4180391562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41dc003980 msgr2=0x7f41dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f7a93640 1 --2- 172.21.15.45:0/4180391562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41dc003980 0x7f41dc003d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00c240 tx=0x7f41ec01cc60 comp rx=0 tx=0).stop 2023-07-09T02:12:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f6030640 1 -- 172.21.15.45:0/4180391562 reap_dead start 2023-07-09T02:12:10.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f7a93640 1 -- 172.21.15.45:0/4180391562 shutdown_connections 2023-07-09T02:12:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f7a93640 1 -- 172.21.15.45:0/4180391562 >> 172.21.15.45:0/4180391562 conn(0x7f41f00694b0 msgr2=0x7f41f00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f7a93640 1 -- 172.21.15.45:0/4180391562 shutdown_connections 2023-07-09T02:12:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f7a93640 1 -- 172.21.15.45:0/4180391562 wait complete. 2023-07-09T02:12:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f7a93640 1 Processor -- start 2023-07-09T02:12:10.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.708+0000 7f41f7a93640 1 -- start start 2023-07-09T02:12:10.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc003980 0x7f41f00b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41f00b2b70 0x7f41f014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c6da0 0x7f41f015caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0148cf0 con 0x7f41f00b2b70 2023-07-09T02:12:10.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00c7210 con 0x7f41f00c6da0 2023-07-09T02:12:10.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00b3b50 con 0x7f41dc003980 2023-07-09T02:12:10.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41f00b2b70 0x7f41f014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41f00b2b70 0x7f41f014f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60736/0 (socket says 172.21.15.45:60736) 2023-07-09T02:12:10.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 -- 172.21.15.45:0/180360565 learned_addr learned my addr 172.21.15.45:0/180360565 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:10.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f582f640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc003980 0x7f41f00b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f6030640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c6da0 0x7f41f015caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 -- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc003980 msgr2=0x7f41f00b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc003980 0x7f41f00b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 -- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c6da0 msgr2=0x7f41f015caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c6da0 0x7f41f015caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 -- 172.21.15.45:0/180360565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00b3e30 con 0x7f41f00b2b70 2023-07-09T02:12:10.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f502e640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41f00b2b70 0x7f41f014f960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f41e0011560 tx=0x7f41e0011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41e67fc640 1 -- 172.21.15.45:0/180360565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0015930 con 0x7f41f00b2b70 2023-07-09T02:12:10.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41e67fc640 1 -- 172.21.15.45:0/180360565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0015a90 con 0x7f41f00b2b70 2023-07-09T02:12:10.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41e67fc640 1 -- 172.21.15.45:0/180360565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0015e20 con 0x7f41f00b2b70 2023-07-09T02:12:10.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f00b4110 con 0x7f41f00b2b70 2023-07-09T02:12:10.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f00b15d0 con 0x7f41f00b2b70 2023-07-09T02:12:10.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f004d7d0 con 0x7f41f00b2b70 2023-07-09T02:12:10.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.712+0000 7f41e67fc640 1 -- 172.21.15.45:0/180360565 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f41e000f460 con 0x7f41f00b2b70 2023-07-09T02:12:10.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.716+0000 7f41e67fc640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f41d4066280 0x7f41d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:10.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.716+0000 7f41e67fc640 1 -- 172.21.15.45:0/180360565 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f41e00840c0 con 0x7f41f00b2b70 2023-07-09T02:12:10.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.716+0000 7f41f582f640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f41d4066280 0x7f41d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:10.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.716+0000 7f41f582f640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f41d4066280 0x7f41d4068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0aa000 tx=0x7f41ec001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:10.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.720+0000 7f41e67fc640 1 -- 172.21.15.45:0/180360565 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41e00553b0 con 0x7f41f00b2b70 2023-07-09T02:12:10.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f41f006c540 con 0x7f41f00b2b70 2023-07-09T02:12:10.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41e67fc640 1 -- 172.21.15.45:0/180360565 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+126 (secure 0 0 0) 0x7f41e0054f40 con 0x7f41f00b2b70 2023-07-09T02:12:10.878 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:10.879 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:12:10.879 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:10.879 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:12:10.879 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:12:10.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:10.879 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:10.880 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:12:10.880 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:12:10.880 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:10.880 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:12:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f41d4066280 msgr2=0x7f41d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f41d4066280 0x7f41d4068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0aa000 tx=0x7f41ec001a80 comp rx=0 tx=0).stop 2023-07-09T02:12:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41f00b2b70 msgr2=0x7f41f014f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:10.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41f00b2b70 0x7f41f014f960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f41e0011560 tx=0x7f41e0011a20 comp rx=0 tx=0).stop 2023-07-09T02:12:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 shutdown_connections 2023-07-09T02:12:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c6da0 0x7f41f015caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41f00b2b70 0x7f41f014f960 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f41d4066280 0x7f41d4068730 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 --2- 172.21.15.45:0/180360565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41dc003980 0x7f41f00b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 >> 172.21.15.45:0/180360565 conn(0x7f41f00694b0 msgr2=0x7f41f00c3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 shutdown_connections 2023-07-09T02:12:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:10.876+0000 7f41f7a93640 1 -- 172.21.15.45:0/180360565 wait complete. 2023-07-09T02:12:10.899 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:12:10.900 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:12:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f72a14bd640 1 Processor -- start 2023-07-09T02:12:11.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f72a14bd640 1 -- start start 2023-07-09T02:12:11.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f72a14bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f72a14bd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f729c0b4490 0x7f729c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f72a14bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c0d19c0 con 0x7f729c15c480 2023-07-09T02:12:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f72a14bd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c15c850 con 0x7f729c0b4490 2023-07-09T02:12:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f72a14bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0b4e50 con 0x7f729c0cd060 2023-07-09T02:12:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f729c15c480 0x7f729c0d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39424/0 (socket says 172.21.15.45:39424) 2023-07-09T02:12:11.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729affd640 1 -- 172.21.15.45:0/2319547961 learned_addr learned my addr 172.21.15.45:0/2319547961 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:11.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729b7fe640 1 --2- 172.21.15.45:0/2319547961 >> v2:172.21.15.155:3300/0 conn(0x7f729c0b4490 0x7f729c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f7293fff640 1 --2- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729a7fc640 1 -- 172.21.15.45:0/2319547961 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523044681 0 0) 0x7f729c0d19c0 con 0x7f729c15c480 2023-07-09T02:12:11.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729a7fc640 1 -- 172.21.15.45:0/2319547961 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7288003530 con 0x7f729c15c480 2023-07-09T02:12:11.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729b7fe640 1 -- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 msgr2=0x7f729c0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:11.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729b7fe640 1 --2- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c0cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729b7fe640 1 -- 172.21.15.45:0/2319547961 >> v1:172.21.15.45:6789/0 conn(0x7f729c15c480 legacy=0x7f729c0d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729a7fc640 1 -- 172.21.15.45:0/2319547961 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 801683995 0 0) 0x7f7288003530 con 0x7f729c15c480 2023-07-09T02:12:11.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f729b7fe640 1 -- 172.21.15.45:0/2319547961 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0cf210 con 0x7f729c0b4490 2023-07-09T02:12:11.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.044+0000 7f7293fff640 1 --2- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c0cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:11.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f729b7fe640 1 --2- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0b4490 0x7f729c0b4910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729401c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e333f18cc1a2734d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f729a7fc640 1 -- 172.21.15.45:0/2319547961 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c001680 con 0x7f729c0b4490 2023-07-09T02:12:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f729a7fc640 1 -- 172.21.15.45:0/2319547961 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72940a5560 con 0x7f729c0b4490 2023-07-09T02:12:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f729a7fc640 1 -- 172.21.15.45:0/2319547961 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72940a58f0 con 0x7f729c0b4490 2023-07-09T02:12:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f72a14bd640 1 -- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0b4490 msgr2=0x7f729c0b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f72a14bd640 1 --2- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0b4490 0x7f729c0b4910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729401c870 comp rx=0 tx=0).stop 2023-07-09T02:12:11.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f72a14bd640 1 -- 172.21.15.45:0/2319547961 shutdown_connections 2023-07-09T02:12:11.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f72a14bd640 1 --2- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c0cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f72a14bd640 1 --2- 172.21.15.45:0/2319547961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0b4490 0x7f729c0b4910 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f72a14bd640 1 -- 172.21.15.45:0/2319547961 >> 172.21.15.45:0/2319547961 conn(0x7f729c0cf490 msgr2=0x7f729c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:11.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f72a14bd640 1 -- 172.21.15.45:0/2319547961 shutdown_connections 2023-07-09T02:12:11.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.048+0000 7f72a14bd640 1 -- 172.21.15.45:0/2319547961 wait complete. 2023-07-09T02:12:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 Processor -- start 2023-07-09T02:12:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 -- start start 2023-07-09T02:12:11.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b4490 0x7f729c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c15c480 0x7f729c154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0c4e70 con 0x7f729c0b4490 2023-07-09T02:12:11.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1508d0 con 0x7f729c15c480 2023-07-09T02:12:11.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0c5060 con 0x7f729c0cd060 2023-07-09T02:12:11.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b4490 0x7f729c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b4490 0x7f729c154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60746/0 (socket says 172.21.15.45:60746) 2023-07-09T02:12:11.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 -- 172.21.15.45:0/277025643 learned_addr learned my addr 172.21.15.45:0/277025643 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:11.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729b7fe640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c15c480 0x7f729c154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f7293fff640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 -- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 msgr2=0x7f729c154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 -- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c15c480 msgr2=0x7f729c154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c15c480 0x7f729c154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 -- 172.21.15.45:0/277025643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7284009420 con 0x7f729c0b4490 2023-07-09T02:12:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f729affd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b4490 0x7f729c154050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f728c00c780 tx=0x7f728c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72937fe640 1 -- 172.21.15.45:0/277025643 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c005ae0 con 0x7f729c0b4490 2023-07-09T02:12:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72937fe640 1 -- 172.21.15.45:0/277025643 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c005c40 con 0x7f729c0b4490 2023-07-09T02:12:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72937fe640 1 -- 172.21.15.45:0/277025643 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c007070 con 0x7f729c0b4490 2023-07-09T02:12:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7294009a70 con 0x7f729c0b4490 2023-07-09T02:12:11.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.052+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c0c52d0 con 0x7f729c0b4490 2023-07-09T02:12:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.056+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c04d7d0 con 0x7f729c0b4490 2023-07-09T02:12:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.056+0000 7f72937fe640 1 -- 172.21.15.45:0/277025643 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f728c0071f0 con 0x7f729c0b4490 2023-07-09T02:12:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.056+0000 7f72937fe640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f727c066280 0x7f727c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.056+0000 7f72937fe640 1 -- 172.21.15.45:0/277025643 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f728c083600 con 0x7f729c0b4490 2023-07-09T02:12:11.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.056+0000 7f7293fff640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f727c066280 0x7f727c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.056+0000 7f7293fff640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f727c066280 0x7f727c068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f729c14ea60 tx=0x7f7284009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:11.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.060+0000 7f72937fe640 1 -- 172.21.15.45:0/277025643 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f728c050de0 con 0x7f729c0b4490 2023-07-09T02:12:11.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.216+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f729c1567d0 con 0x7f729c0b4490 2023-07-09T02:12:11.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.736+0000 7f72937fe640 1 -- 172.21.15.45:0/277025643 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f728c054400 con 0x7f729c0b4490 2023-07-09T02:12:11.739 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:12:11.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f727c066280 msgr2=0x7f727c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f727c066280 0x7f727c068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f729c14ea60 tx=0x7f7284009190 comp rx=0 tx=0).stop 2023-07-09T02:12:11.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b4490 msgr2=0x7f729c154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b4490 0x7f729c154050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f728c00c780 tx=0x7f728c00cc40 comp rx=0 tx=0).stop 2023-07-09T02:12:11.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 shutdown_connections 2023-07-09T02:12:11.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c15c480 0x7f729c154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f727c066280 0x7f727c068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0cd060 0x7f729c154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 --2- 172.21.15.45:0/277025643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b4490 0x7f729c154050 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 >> 172.21.15.45:0/277025643 conn(0x7f729c0cf490 msgr2=0x7f729c0b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 shutdown_connections 2023-07-09T02:12:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.740+0000 7f72a14bd640 1 -- 172.21.15.45:0/277025643 wait complete. 2023-07-09T02:12:11.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:12:11.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.912+0000 7f69e4419640 1 Processor -- start 2023-07-09T02:12:11.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.912+0000 7f69e4419640 1 -- start start 2023-07-09T02:12:11.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.912+0000 7f69e4419640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69dc0b59b0 0x7f69dc0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.912+0000 7f69e4419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e4419640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc0ced10 con 0x7f69dc15c410 2023-07-09T02:12:11.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e4419640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69dc15c7e0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e4419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0cd1b0 con 0x7f69dc0d2340 2023-07-09T02:12:11.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e19b4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69dc0b59b0 0x7f69dc0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e19b4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69dc0b59b0 0x7f69dc0b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59198/0 (socket says 172.21.15.45:59198) 2023-07-09T02:12:11.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e19b4640 1 -- 172.21.15.45:0/2579532474 learned_addr learned my addr 172.21.15.45:0/2579532474 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:11.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e29b6640 1 --2- 172.21.15.45:0/2579532474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e19b4640 1 -- 172.21.15.45:0/2579532474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 msgr2=0x7f69dc0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e19b4640 1 --2- 172.21.15.45:0/2579532474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e19b4640 1 -- 172.21.15.45:0/2579532474 >> v1:172.21.15.155:6789/0 conn(0x7f69dc15c410 legacy=0x7f69dc1608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e19b4640 1 -- 172.21.15.45:0/2579532474 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0cef40 con 0x7f69dc0b59b0 2023-07-09T02:12:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e19b4640 1 --2- 172.21.15.45:0/2579532474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc0b45e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0098a0 tx=0x7f69cc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be46fe8f54effcd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.916+0000 7f69e11b3640 1 -- 172.21.15.45:0/2579532474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0aa650 con 0x7f69dc0b59b0 2023-07-09T02:12:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e11b3640 1 -- 172.21.15.45:0/2579532474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc0aa7b0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e11b3640 1 -- 172.21.15.45:0/2579532474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0aab40 con 0x7f69dc0b59b0 2023-07-09T02:12:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- 172.21.15.45:0/2579532474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 msgr2=0x7f69dc0b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 --2- 172.21.15.45:0/2579532474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc0b45e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0098a0 tx=0x7f69cc01c4f0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- 172.21.15.45:0/2579532474 shutdown_connections 2023-07-09T02:12:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 --2- 172.21.15.45:0/2579532474 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 --2- 172.21.15.45:0/2579532474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc0b45e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- 172.21.15.45:0/2579532474 >> 172.21.15.45:0/2579532474 conn(0x7f69dc06a590 msgr2=0x7f69dc0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- 172.21.15.45:0/2579532474 shutdown_connections 2023-07-09T02:12:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- 172.21.15.45:0/2579532474 wait complete. 2023-07-09T02:12:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 Processor -- start 2023-07-09T02:12:11.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- start start 2023-07-09T02:12:11.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69dc15c410 0x7f69dc1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0c94d0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0c8c30 con 0x7f69dc15c410 2023-07-09T02:12:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e4419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0c8f10 con 0x7f69dc0d2340 2023-07-09T02:12:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e21b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e21b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc1583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59206/0 (socket says 172.21.15.45:59206) 2023-07-09T02:12:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e21b5640 1 -- 172.21.15.45:0/3378567197 learned_addr learned my addr 172.21.15.45:0/3378567197 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.920+0000 7f69e29b6640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69dc15c410 0x7f69dc1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e19b4640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e21b5640 1 -- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 msgr2=0x7f69dc0c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e21b5640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e21b5640 1 -- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69dc15c410 msgr2=0x7f69dc1512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e21b5640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69dc15c410 0x7f69dc1512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e21b5640 1 -- 172.21.15.45:0/3378567197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc0094d0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e19b4640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e21b5640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc1583b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c3c0 tx=0x7f69d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69d2ffd640 1 -- 172.21.15.45:0/3378567197 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80052d0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69d2ffd640 1 -- 172.21.15.45:0/3378567197 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d8005430 con 0x7f69dc0b59b0 2023-07-09T02:12:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69d2ffd640 1 -- 172.21.15.45:0/3378567197 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8003840 con 0x7f69dc0b59b0 2023-07-09T02:12:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc0c91f0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc0c88f0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc04d7d0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.924+0000 7f69d2ffd640 1 -- 172.21.15.45:0/3378567197 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69d80039a0 con 0x7f69dc0b59b0 2023-07-09T02:12:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.928+0000 7f69d2ffd640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f69c0066280 0x7f69c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.928+0000 7f69d2ffd640 1 -- 172.21.15.45:0/3378567197 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f69d8083200 con 0x7f69dc0b59b0 2023-07-09T02:12:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.928+0000 7f69e19b4640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f69c0066280 0x7f69c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:11.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.928+0000 7f69e19b4640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f69c0066280 0x7f69c0068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0ae000 tx=0x7f69cc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:11.932+0000 7f69d2ffd640 1 -- 172.21.15.45:0/3378567197 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69d8050980 con 0x7f69dc0b59b0 2023-07-09T02:12:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.084+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f69dc0cfea0 con 0x7f69dc0b59b0 2023-07-09T02:12:12.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.744+0000 7f69d2ffd640 1 -- 172.21.15.45:0/3378567197 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f69d8053fa0 con 0x7f69dc0b59b0 2023-07-09T02:12:12.752 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:12:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.752+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f69c0066280 msgr2=0x7f69c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.752+0000 7f69e4419640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f69c0066280 0x7f69c0068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0ae000 tx=0x7f69cc0a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.752+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 msgr2=0x7f69dc1583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.752+0000 7f69e4419640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc1583b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c3c0 tx=0x7f69d800c880 comp rx=0 tx=0).stop 2023-07-09T02:12:12.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.756+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 shutdown_connections 2023-07-09T02:12:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.756+0000 7f69e4419640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69dc15c410 0x7f69dc1512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.756+0000 7f69e4419640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f69c0066280 0x7f69c0068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.756+0000 7f69e4419640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69dc0d2340 0x7f69dc0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.756+0000 7f69e4419640 1 --2- 172.21.15.45:0/3378567197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69dc0b59b0 0x7f69dc1583b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.756+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 >> 172.21.15.45:0/3378567197 conn(0x7f69dc06a590 msgr2=0x7f69dc159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.756+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 shutdown_connections 2023-07-09T02:12:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.760+0000 7f69e4419640 1 -- 172.21.15.45:0/3378567197 wait complete. 2023-07-09T02:12:12.782 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:12:12.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50c6540640 1 Processor -- start 2023-07-09T02:12:12.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50c6540640 1 -- start start 2023-07-09T02:12:12.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50c6540640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50c015c060 0x7f50c00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:12.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50c6540640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50c00d2620 0x7f50c00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:12.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50c6540640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c0160a50 con 0x7f50c00cd120 2023-07-09T02:12:12.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50c6540640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c015c430 con 0x7f50c015c060 2023-07-09T02:12:12.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50c6540640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c015fb60 con 0x7f50c00d2620 2023-07-09T02:12:12.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50bffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50c015c060 0x7f50c00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:12.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50bffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50c015c060 0x7f50c00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59214/0 (socket says 172.21.15.45:59214) 2023-07-09T02:12:12.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50bffff640 1 -- 172.21.15.45:0/3936687167 learned_addr learned my addr 172.21.15.45:0/3936687167 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:12.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50bf7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f50c00cd120 0x7f50c00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47156/0 (socket says 172.21.15.45:47156) 2023-07-09T02:12:12.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50c4add640 1 --2- 172.21.15.45:0/3936687167 >> v2:172.21.15.155:3300/0 conn(0x7f50c00d2620 0x7f50c00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:12.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50bffff640 1 -- 172.21.15.45:0/3936687167 >> v2:172.21.15.155:3300/0 conn(0x7f50c00d2620 msgr2=0x7f50c00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:12.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50bffff640 1 --2- 172.21.15.45:0/3936687167 >> v2:172.21.15.155:3300/0 conn(0x7f50c00d2620 0x7f50c00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50bffff640 1 -- 172.21.15.45:0/3936687167 >> v1:172.21.15.45:6789/0 conn(0x7f50c00cd120 legacy=0x7f50c00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50bffff640 1 -- 172.21.15.45:0/3936687167 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c015fe40 con 0x7f50c015c060 2023-07-09T02:12:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.928+0000 7f50beffd640 1 -- 172.21.15.45:0/3936687167 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192553621 0 0) 0x7f50c0160a50 con 0x7f50c00cd120 2023-07-09T02:12:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50bffff640 1 --2- 172.21.15.45:0/3936687167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c015c060 0x7f50c00b4ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f50c008bca0 tx=0x7f50b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a938a0dce5cade server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50beffd640 1 -- 172.21.15.45:0/3936687167 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00aa430 con 0x7f50c015c060 2023-07-09T02:12:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50beffd640 1 -- 172.21.15.45:0/3936687167 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00aa590 con 0x7f50c015c060 2023-07-09T02:12:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50beffd640 1 -- 172.21.15.45:0/3936687167 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00aa920 con 0x7f50c015c060 2023-07-09T02:12:12.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50c6540640 1 -- 172.21.15.45:0/3936687167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c015c060 msgr2=0x7f50c00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:12.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50c6540640 1 --2- 172.21.15.45:0/3936687167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c015c060 0x7f50c00b4ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f50c008bca0 tx=0x7f50b001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50c6540640 1 -- 172.21.15.45:0/3936687167 shutdown_connections 2023-07-09T02:12:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50c6540640 1 --2- 172.21.15.45:0/3936687167 >> v2:172.21.15.155:3300/0 conn(0x7f50c00d2620 0x7f50c00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50c6540640 1 --2- 172.21.15.45:0/3936687167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c015c060 0x7f50c00b4ed0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50c6540640 1 -- 172.21.15.45:0/3936687167 >> 172.21.15.45:0/3936687167 conn(0x7f50c00698e0 msgr2=0x7f50c0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50c6540640 1 -- 172.21.15.45:0/3936687167 shutdown_connections 2023-07-09T02:12:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.932+0000 7f50c6540640 1 -- 172.21.15.45:0/3936687167 wait complete. 2023-07-09T02:12:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 Processor -- start 2023-07-09T02:12:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 -- start start 2023-07-09T02:12:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00cd120 0x7f50c00cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c00d2620 0x7f50c00b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c015c060 0x7f50c0153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c015a020 con 0x7f50c00d2620 2023-07-09T02:12:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0159d40 con 0x7f50c00cd120 2023-07-09T02:12:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0152690 con 0x7f50c015c060 2023-07-09T02:12:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c00d2620 0x7f50c00b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c00d2620 0x7f50c00b7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59226/0 (socket says 172.21.15.45:59226) 2023-07-09T02:12:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 -- 172.21.15.45:0/337681079 learned_addr learned my addr 172.21.15.45:0/337681079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bffff640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00cd120 0x7f50c00cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c4add640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c015c060 0x7f50c0153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 -- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c015c060 msgr2=0x7f50c0153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c015c060 0x7f50c0153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 -- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00cd120 msgr2=0x7f50c00cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00cd120 0x7f50c00cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 -- 172.21.15.45:0/337681079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00094d0 con 0x7f50c00d2620 2023-07-09T02:12:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bffff640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00cd120 0x7f50c00cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bf7fe640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c00d2620 0x7f50c00b7ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f50b400c4b0 tx=0x7f50b400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bcff9640 1 -- 172.21.15.45:0/337681079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40074e0 con 0x7f50c00d2620 2023-07-09T02:12:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bcff9640 1 -- 172.21.15.45:0/337681079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4007660 con 0x7f50c00d2620 2023-07-09T02:12:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c00b59f0 con 0x7f50c00d2620 2023-07-09T02:12:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50bcff9640 1 -- 172.21.15.45:0/337681079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4004a30 con 0x7f50c00d2620 2023-07-09T02:12:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.936+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c0152c50 con 0x7f50c00d2620 2023-07-09T02:12:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.940+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c004d7d0 con 0x7f50c00d2620 2023-07-09T02:12:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.940+0000 7f50bcff9640 1 -- 172.21.15.45:0/337681079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50b4004b90 con 0x7f50c00d2620 2023-07-09T02:12:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.940+0000 7f50bcff9640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50ac066280 0x7f50ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.940+0000 7f50bcff9640 1 -- 172.21.15.45:0/337681079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f50b4083210 con 0x7f50c00d2620 2023-07-09T02:12:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.940+0000 7f50bffff640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50ac066280 0x7f50ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.940+0000 7f50bffff640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50ac066280 0x7f50ac068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50b00ae000 tx=0x7f50b00b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:12.944+0000 7f50bcff9640 1 -- 172.21.15.45:0/337681079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50b40507a0 con 0x7f50c00d2620 2023-07-09T02:12:13.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.132+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f50c00b4d10 con 0x7f50c00d2620 2023-07-09T02:12:13.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.756+0000 7f50bcff9640 1 -- 172.21.15.45:0/337681079 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f50b4053dc0 con 0x7f50c00d2620 2023-07-09T02:12:13.761 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 5 and data pool 6 2023-07-09T02:12:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.768+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50ac066280 msgr2=0x7f50ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.768+0000 7f50c6540640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50ac066280 0x7f50ac068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50b00ae000 tx=0x7f50b00b5040 comp rx=0 tx=0).stop 2023-07-09T02:12:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.768+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c00d2620 msgr2=0x7f50c00b7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:13.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c00d2620 0x7f50c00b7ea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f50b400c4b0 tx=0x7f50b400c970 comp rx=0 tx=0).stop 2023-07-09T02:12:13.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 shutdown_connections 2023-07-09T02:12:13.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50ac066280 0x7f50ac068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:13.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50c015c060 0x7f50c0153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:13.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50c00d2620 0x7f50c00b7ea0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:13.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 --2- 172.21.15.45:0/337681079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c00cd120 0x7f50c00cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:13.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 >> 172.21.15.45:0/337681079 conn(0x7f50c00698e0 msgr2=0x7f50c00b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:13.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 shutdown_connections 2023-07-09T02:12:13.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.772+0000 7f50c6540640 1 -- 172.21.15.45:0/337681079 wait complete. 2023-07-09T02:12:13.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:13.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f54e0b640 1 Processor -- start 2023-07-09T02:12:13.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f54e0b640 1 -- start start 2023-07-09T02:12:13.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f54e0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f5015c060 0x7f1f500b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f54e0b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f50160a50 con 0x7f1f500cd120 2023-07-09T02:12:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f54e0b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5015c430 con 0x7f1f500d2620 2023-07-09T02:12:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f54e0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5015fb60 con 0x7f1f5015c060 2023-07-09T02:12:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f4e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f5015c060 0x7f1f500b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f47fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1f500cd120 0x7f1f500d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47166/0 (socket says 172.21.15.45:47166) 2023-07-09T02:12:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f47fff640 1 -- 172.21.15.45:0/1426940084 learned_addr learned my addr 172.21.15.45:0/1426940084 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:13.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f4dd9b640 1 -- 172.21.15.45:0/1426940084 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944756128 0 0) 0x7f1f50160a50 con 0x7f1f500cd120 2023-07-09T02:12:13.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f4dd9b640 1 -- 172.21.15.45:0/1426940084 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c003530 con 0x7f1f500cd120 2023-07-09T02:12:13.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f4e59c640 1 -- 172.21.15.45:0/1426940084 >> v1:172.21.15.155:6789/0 conn(0x7f1f500d2620 legacy=0x7f1f500cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:13.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f4e59c640 1 -- 172.21.15.45:0/1426940084 >> v1:172.21.15.45:6789/0 conn(0x7f1f500cd120 legacy=0x7f1f500d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:13.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.940+0000 7f1f4e59c640 1 -- 172.21.15.45:0/1426940084 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5015fe40 con 0x7f1f5015c060 2023-07-09T02:12:13.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f4e59c640 1 --2- 172.21.15.45:0/1426940084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5015c060 0x7f1f500b4ed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1f400097c0 tx=0x7f1f4001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22afa378676c4f90 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:13.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f4dd9b640 1 -- 172.21.15.45:0/1426940084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400ab650 con 0x7f1f5015c060 2023-07-09T02:12:13.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f4dd9b640 1 -- 172.21.15.45:0/1426940084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f400ab7b0 con 0x7f1f5015c060 2023-07-09T02:12:13.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f4dd9b640 1 -- 172.21.15.45:0/1426940084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400abb40 con 0x7f1f5015c060 2023-07-09T02:12:13.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f54e0b640 1 -- 172.21.15.45:0/1426940084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5015c060 msgr2=0x7f1f500b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:13.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f54e0b640 1 --2- 172.21.15.45:0/1426940084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5015c060 0x7f1f500b4ed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1f400097c0 tx=0x7f1f4001c450 comp rx=0 tx=0).stop 2023-07-09T02:12:13.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f54e0b640 1 -- 172.21.15.45:0/1426940084 shutdown_connections 2023-07-09T02:12:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f54e0b640 1 --2- 172.21.15.45:0/1426940084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f5015c060 0x7f1f500b4ed0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f54e0b640 1 -- 172.21.15.45:0/1426940084 >> 172.21.15.45:0/1426940084 conn(0x7f1f500698e0 msgr2=0x7f1f50069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f54e0b640 1 -- 172.21.15.45:0/1426940084 shutdown_connections 2023-07-09T02:12:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.944+0000 7f1f54e0b640 1 -- 172.21.15.45:0/1426940084 wait complete. 2023-07-09T02:12:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 Processor -- start 2023-07-09T02:12:13.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 -- start start 2023-07-09T02:12:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f500cd120 0x7f1f5015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500d2620 0x7f1f50153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f5015c060 0x7f1f500b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5015b870 con 0x7f1f500cd120 2023-07-09T02:12:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5015b2b0 con 0x7f1f500d2620 2023-07-09T02:12:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5015b590 con 0x7f1f5015c060 2023-07-09T02:12:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f500cd120 0x7f1f5015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f500cd120 0x7f1f5015ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59256/0 (socket says 172.21.15.45:59256) 2023-07-09T02:12:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 -- 172.21.15.45:0/2508738622 learned_addr learned my addr 172.21.15.45:0/2508738622 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f47fff640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500d2620 0x7f1f50153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4ed9d640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f5015c060 0x7f1f500b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 -- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f5015c060 msgr2=0x7f1f500b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f5015c060 0x7f1f500b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 -- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500d2620 msgr2=0x7f1f50153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500d2620 0x7f1f50153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 -- 172.21.15.45:0/2508738622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40009420 con 0x7f1f500cd120 2023-07-09T02:12:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f4e59c640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f500cd120 0x7f1f5015ac40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1f400ad040 tx=0x7f1f4001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f46ffd640 1 -- 172.21.15.45:0/2508738622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400bf610 con 0x7f1f500cd120 2023-07-09T02:12:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f46ffd640 1 -- 172.21.15.45:0/2508738622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f400bf790 con 0x7f1f500cd120 2023-07-09T02:12:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f500b59f0 con 0x7f1f500cd120 2023-07-09T02:12:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f46ffd640 1 -- 172.21.15.45:0/2508738622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400bfb40 con 0x7f1f500cd120 2023-07-09T02:12:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.948+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f50152de0 con 0x7f1f500cd120 2023-07-09T02:12:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.952+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f50152fd0 con 0x7f1f500cd120 2023-07-09T02:12:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.952+0000 7f1f46ffd640 1 -- 172.21.15.45:0/2508738622 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f400bfca0 con 0x7f1f500cd120 2023-07-09T02:12:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.952+0000 7f1f46ffd640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f30066280 0x7f1f30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:13.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.952+0000 7f1f46ffd640 1 -- 172.21.15.45:0/2508738622 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f4011ec90 con 0x7f1f500cd120 2023-07-09T02:12:13.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.952+0000 7f1f47fff640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f30066280 0x7f1f30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:13.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.956+0000 7f1f47fff640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f30066280 0x7f1f30068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f50069f10 tx=0x7f1f38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:13.956+0000 7f1f46ffd640 1 -- 172.21.15.45:0/2508738622 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f400ec100 con 0x7f1f500cd120 2023-07-09T02:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.116+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f5004d7d0 con 0x7f1f500cd120 2023-07-09T02:12:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.116+0000 7f1f46ffd640 1 -- 172.21.15.45:0/2508738622 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f1f400ef720 con 0x7f1f500cd120 2023-07-09T02:12:14.120 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:14.120 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:13.135430+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f30066280 msgr2=0x7f1f30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f30066280 0x7f1f30068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f50069f10 tx=0x7f1f38009040 comp rx=0 tx=0).stop 2023-07-09T02:12:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f500cd120 msgr2=0x7f1f5015ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f500cd120 0x7f1f5015ac40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1f400ad040 tx=0x7f1f4001ac90 comp rx=0 tx=0).stop 2023-07-09T02:12:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 shutdown_connections 2023-07-09T02:12:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f30066280 0x7f1f30068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f5015c060 0x7f1f500b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500d2620 0x7f1f50153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 --2- 172.21.15.45:0/2508738622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f500cd120 0x7f1f5015ac40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 >> 172.21.15.45:0/2508738622 conn(0x7f1f500698e0 msgr2=0x7f1f500d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 shutdown_connections 2023-07-09T02:12:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.120+0000 7f1f54e0b640 1 -- 172.21.15.45:0/2508738622 wait complete. 2023-07-09T02:12:14.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:14.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.280+0000 7f2f05fe9640 1 Processor -- start 2023-07-09T02:12:14.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.280+0000 7f2f05fe9640 1 -- start start 2023-07-09T02:12:14.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2f05fe9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f0015c060 0x7f2f000b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2f05fe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 0x7f2f000cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2f05fe9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f00160a50 con 0x7f2f000cd120 2023-07-09T02:12:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2f05fe9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0015c430 con 0x7f2f0015c060 2023-07-09T02:12:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2f05fe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0015fb60 con 0x7f2f000d2620 2023-07-09T02:12:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2eff7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f0015c060 0x7f2f000b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2eff7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f0015c060 0x7f2f000b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59268/0 (socket says 172.21.15.45:59268) 2023-07-09T02:12:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2eff7fe640 1 -- 172.21.15.45:0/2641777303 learned_addr learned my addr 172.21.15.45:0/2641777303 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2efffff640 1 --2- 172.21.15.45:0/2641777303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 0x7f2f000cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2eff7fe640 1 -- 172.21.15.45:0/2641777303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 msgr2=0x7f2f000cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:14.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2eff7fe640 1 --2- 172.21.15.45:0/2641777303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 0x7f2f000cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2eff7fe640 1 -- 172.21.15.45:0/2641777303 >> v1:172.21.15.155:6789/0 conn(0x7f2f000cd120 legacy=0x7f2f000d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.284+0000 7f2eff7fe640 1 -- 172.21.15.45:0/2641777303 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0015fe40 con 0x7f2f0015c060 2023-07-09T02:12:14.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2eff7fe640 1 --2- 172.21.15.45:0/2641777303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b4ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009870 tx=0x7f2ef001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1922c3d68e43baf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:14.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2efe7fc640 1 -- 172.21.15.45:0/2641777303 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00aa670 con 0x7f2f0015c060 2023-07-09T02:12:14.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2efe7fc640 1 -- 172.21.15.45:0/2641777303 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef00aa7d0 con 0x7f2f0015c060 2023-07-09T02:12:14.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2efe7fc640 1 -- 172.21.15.45:0/2641777303 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00aab60 con 0x7f2f0015c060 2023-07-09T02:12:14.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2f05fe9640 1 -- 172.21.15.45:0/2641777303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 msgr2=0x7f2f000b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/2641777303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b4ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009870 tx=0x7f2ef001c510 comp rx=0 tx=0).stop 2023-07-09T02:12:14.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2f05fe9640 1 -- 172.21.15.45:0/2641777303 shutdown_connections 2023-07-09T02:12:14.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/2641777303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 0x7f2f000cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/2641777303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b4ed0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2f05fe9640 1 -- 172.21.15.45:0/2641777303 >> 172.21.15.45:0/2641777303 conn(0x7f2f000698e0 msgr2=0x7f2f00069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:14.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2f05fe9640 1 -- 172.21.15.45:0/2641777303 shutdown_connections 2023-07-09T02:12:14.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.288+0000 7f2f05fe9640 1 -- 172.21.15.45:0/2641777303 wait complete. 2023-07-09T02:12:14.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 Processor -- start 2023-07-09T02:12:14.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 -- start start 2023-07-09T02:12:14.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f000cd120 0x7f2f00153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 0x7f2f000ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000c9930 con 0x7f2f0015c060 2023-07-09T02:12:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000c9650 con 0x7f2f000cd120 2023-07-09T02:12:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0015c6a0 con 0x7f2f000d2620 2023-07-09T02:12:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59282/0 (socket says 172.21.15.45:59282) 2023-07-09T02:12:14.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 -- 172.21.15.45:0/254991740 learned_addr learned my addr 172.21.15.45:0/254991740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:14.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2eff7fe640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f000cd120 0x7f2f00153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efeffd640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 0x7f2f000ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 -- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 msgr2=0x7f2f000ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 0x7f2f000ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 -- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f000cd120 msgr2=0x7f2f00153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f000cd120 0x7f2f00153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 -- 172.21.15.45:0/254991740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00094d0 con 0x7f2f0015c060 2023-07-09T02:12:14.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2eff7fe640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f000cd120 0x7f2f00153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2efffff640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b44b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800efc0 tx=0x7f2ef800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2ee7fff640 1 -- 172.21.15.45:0/254991740 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8014480 con 0x7f2f0015c060 2023-07-09T02:12:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2ee7fff640 1 -- 172.21.15.45:0/254991740 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef800f040 con 0x7f2f0015c060 2023-07-09T02:12:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2ee7fff640 1 -- 172.21.15.45:0/254991740 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8014820 con 0x7f2f0015c060 2023-07-09T02:12:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.292+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f000b59f0 con 0x7f2f0015c060 2023-07-09T02:12:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.296+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0015cc60 con 0x7f2f0015c060 2023-07-09T02:12:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.296+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0015ce80 con 0x7f2f0015c060 2023-07-09T02:12:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.296+0000 7f2ee7fff640 1 -- 172.21.15.45:0/254991740 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ef8014980 con 0x7f2f0015c060 2023-07-09T02:12:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.296+0000 7f2ee7fff640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2eec066280 0x7f2eec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.296+0000 7f2ee7fff640 1 -- 172.21.15.45:0/254991740 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ef8084ba0 con 0x7f2f0015c060 2023-07-09T02:12:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.296+0000 7f2eff7fe640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2eec066280 0x7f2eec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.300+0000 7f2eff7fe640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2eec066280 0x7f2eec068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00ae000 tx=0x7f2ef00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:14.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.300+0000 7f2ee7fff640 1 -- 172.21.15.45:0/254991740 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ef80520b0 con 0x7f2f0015c060 2023-07-09T02:12:14.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.456+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f0004d7d0 con 0x7f2f0015c060 2023-07-09T02:12:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.456+0000 7f2ee7fff640 1 -- 172.21.15.45:0/254991740 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f2ef8018090 con 0x7f2f0015c060 2023-07-09T02:12:14.461 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:14.461 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:13.135430+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2eec066280 msgr2=0x7f2eec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2eec066280 0x7f2eec068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00ae000 tx=0x7f2ef00a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 msgr2=0x7f2f000b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b44b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800efc0 tx=0x7f2ef800c490 comp rx=0 tx=0).stop 2023-07-09T02:12:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 shutdown_connections 2023-07-09T02:12:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0015c060 0x7f2f000b44b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2eec066280 0x7f2eec068730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f000d2620 0x7f2f000ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 --2- 172.21.15.45:0/254991740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f000cd120 0x7f2f00153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 >> 172.21.15.45:0/254991740 conn(0x7f2f000698e0 msgr2=0x7f2f0015b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 shutdown_connections 2023-07-09T02:12:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.460+0000 7f2f05fe9640 1 -- 172.21.15.45:0/254991740 wait complete. 2023-07-09T02:12:14.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:12:14.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.624+0000 7f94bf5fa640 1 Processor -- start 2023-07-09T02:12:14.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bf5fa640 1 -- start start 2023-07-09T02:12:14.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bf5fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94b815c060 0x7f94b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bf5fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80d2620 0x7f94b80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bf5fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b8160a50 con 0x7f94b80cd120 2023-07-09T02:12:14.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bf5fa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b815c430 con 0x7f94b815c060 2023-07-09T02:12:14.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bf5fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b815fb60 con 0x7f94b80d2620 2023-07-09T02:12:14.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bdb97640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80d2620 0x7f94b80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bd396640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94b815c060 0x7f94b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bcb95640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f94b80cd120 0x7f94b80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:41264/0 (socket says 172.21.15.45:41264) 2023-07-09T02:12:14.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bcb95640 1 -- 172.21.15.45:0/3727990195 learned_addr learned my addr 172.21.15.45:0/3727990195 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:14.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bd396640 1 -- 172.21.15.45:0/3727990195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80d2620 msgr2=0x7f94b80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:14.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bd396640 1 --2- 172.21.15.45:0/3727990195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80d2620 0x7f94b80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bd396640 1 -- 172.21.15.45:0/3727990195 >> v1:172.21.15.155:6789/0 conn(0x7f94b80cd120 legacy=0x7f94b80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94affff640 1 -- 172.21.15.45:0/3727990195 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987741923 0 0) 0x7f94b8160a50 con 0x7f94b80cd120 2023-07-09T02:12:14.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.628+0000 7f94bd396640 1 -- 172.21.15.45:0/3727990195 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b815fe40 con 0x7f94b815c060 2023-07-09T02:12:14.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bd396640 1 --2- 172.21.15.45:0/3727990195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 0x7f94b80b4ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097c0 tx=0x7f94b401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cdef1cb6e2f73c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94affff640 1 -- 172.21.15.45:0/3727990195 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40ab650 con 0x7f94b815c060 2023-07-09T02:12:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94affff640 1 -- 172.21.15.45:0/3727990195 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40ab7b0 con 0x7f94b815c060 2023-07-09T02:12:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94affff640 1 -- 172.21.15.45:0/3727990195 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40abb40 con 0x7f94b815c060 2023-07-09T02:12:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bf5fa640 1 -- 172.21.15.45:0/3727990195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 msgr2=0x7f94b80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/3727990195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 0x7f94b80b4ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097c0 tx=0x7f94b401c450 comp rx=0 tx=0).stop 2023-07-09T02:12:14.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bf5fa640 1 -- 172.21.15.45:0/3727990195 shutdown_connections 2023-07-09T02:12:14.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/3727990195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80d2620 0x7f94b80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/3727990195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 0x7f94b80b4ed0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bf5fa640 1 -- 172.21.15.45:0/3727990195 >> 172.21.15.45:0/3727990195 conn(0x7f94b80698e0 msgr2=0x7f94b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bf5fa640 1 -- 172.21.15.45:0/3727990195 shutdown_connections 2023-07-09T02:12:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.632+0000 7f94bf5fa640 1 -- 172.21.15.45:0/3727990195 wait complete. 2023-07-09T02:12:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 Processor -- start 2023-07-09T02:12:14.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 -- start start 2023-07-09T02:12:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80cd120 0x7f94b81581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94b80d2620 0x7f94b815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 0x7f94b80b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b81586f0 con 0x7f94b80d2620 2023-07-09T02:12:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b815e270 con 0x7f94b815c060 2023-07-09T02:12:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8158e50 con 0x7f94b80cd120 2023-07-09T02:12:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94b80d2620 0x7f94b815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bd396640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80cd120 0x7f94b81581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94b80d2620 0x7f94b815cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59298/0 (socket says 172.21.15.45:59298) 2023-07-09T02:12:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 -- 172.21.15.45:0/833346434 learned_addr learned my addr 172.21.15.45:0/833346434 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bdb97640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 0x7f94b80b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 -- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80cd120 msgr2=0x7f94b81581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80cd120 0x7f94b81581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 -- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 msgr2=0x7f94b80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 0x7f94b80b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 -- 172.21.15.45:0/833346434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009420 con 0x7f94b80d2620 2023-07-09T02:12:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bdb97640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 0x7f94b80b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bcb95640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94b80d2620 0x7f94b815cf80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f94a800c4b0 tx=0x7f94a800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94adffb640 1 -- 172.21.15.45:0/833346434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80074e0 con 0x7f94b80d2620 2023-07-09T02:12:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94adffb640 1 -- 172.21.15.45:0/833346434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a8007660 con 0x7f94b80d2620 2023-07-09T02:12:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94adffb640 1 -- 172.21.15.45:0/833346434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8004a30 con 0x7f94b80d2620 2023-07-09T02:12:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b80b59f0 con 0x7f94b80d2620 2023-07-09T02:12:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b8159130 con 0x7f94b80d2620 2023-07-09T02:12:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.636+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b804d7d0 con 0x7f94b80d2620 2023-07-09T02:12:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.640+0000 7f94adffb640 1 -- 172.21.15.45:0/833346434 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94a8004b90 con 0x7f94b80d2620 2023-07-09T02:12:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.640+0000 7f94adffb640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f949c066280 0x7f949c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.640+0000 7f94adffb640 1 -- 172.21.15.45:0/833346434 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94a8082e10 con 0x7f94b80d2620 2023-07-09T02:12:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.640+0000 7f94bd396640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f949c066280 0x7f949c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.640+0000 7f94bd396640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f949c066280 0x7f949c068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f94b40af000 tx=0x7f94b40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.644+0000 7f94adffb640 1 -- 172.21.15.45:0/833346434 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94a8086030 con 0x7f94b80d2620 2023-07-09T02:12:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:14.832+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f94b806baa0 con 0x7f94b80d2620 2023-07-09T02:12:15.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.780+0000 7f94adffb640 1 -- 172.21.15.45:0/833346434 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f94a8018020 con 0x7f94b80d2620 2023-07-09T02:12:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f949c066280 msgr2=0x7f949c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f949c066280 0x7f949c068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f94b40af000 tx=0x7f94b40a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94b80d2620 msgr2=0x7f94b815cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94b80d2620 0x7f94b815cf80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f94a800c4b0 tx=0x7f94a800c970 comp rx=0 tx=0).stop 2023-07-09T02:12:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 shutdown_connections 2023-07-09T02:12:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b815c060 0x7f94b80b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94b80d2620 0x7f94b815cf80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f949c066280 0x7f949c068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 --2- 172.21.15.45:0/833346434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94b80cd120 0x7f94b81581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 >> 172.21.15.45:0/833346434 conn(0x7f94b80698e0 msgr2=0x7f94b80b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 shutdown_connections 2023-07-09T02:12:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.784+0000 7f94bf5fa640 1 -- 172.21.15.45:0/833346434 wait complete. 2023-07-09T02:12:15.809 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:12:15.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:12:15.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.956+0000 7f5d50abd640 1 Processor -- start 2023-07-09T02:12:15.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.956+0000 7f5d50abd640 1 -- start start 2023-07-09T02:12:15.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d50abd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:15.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d50abd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5d4c0b68b0 0x7f5d4c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:15.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d50abd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c0ceff0 con 0x7f5d4c0d2400 2023-07-09T02:12:15.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d50abd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c0cea70 con 0x7f5d4c0b68b0 2023-07-09T02:12:15.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d50abd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b1f90 con 0x7f5d4c0b1bc0 2023-07-09T02:12:15.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d4c0d2400 0x7f5d4c070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47170/0 (socket says 172.21.15.45:47170) 2023-07-09T02:12:15.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4affd640 1 -- 172.21.15.45:0/2402267130 learned_addr learned my addr 172.21.15.45:0/2402267130 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:15.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4b7fe640 1 --2- 172.21.15.45:0/2402267130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:15.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4bfff640 1 --2- 172.21.15.45:0/2402267130 >> v2:172.21.15.155:3300/0 conn(0x7f5d4c0b68b0 0x7f5d4c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:15.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4a7fc640 1 -- 172.21.15.45:0/2402267130 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275675951 0 0) 0x7f5d4c0ceff0 con 0x7f5d4c0d2400 2023-07-09T02:12:15.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4a7fc640 1 -- 172.21.15.45:0/2402267130 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d34003530 con 0x7f5d4c0d2400 2023-07-09T02:12:15.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4b7fe640 1 -- 172.21.15.45:0/2402267130 >> v2:172.21.15.155:3300/0 conn(0x7f5d4c0b68b0 msgr2=0x7f5d4c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:15.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4b7fe640 1 --2- 172.21.15.45:0/2402267130 >> v2:172.21.15.155:3300/0 conn(0x7f5d4c0b68b0 0x7f5d4c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4b7fe640 1 -- 172.21.15.45:0/2402267130 >> v1:172.21.15.45:6789/0 conn(0x7f5d4c0d2400 legacy=0x7f5d4c070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:15.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.960+0000 7f5d4b7fe640 1 -- 172.21.15.45:0/2402267130 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0d1500 con 0x7f5d4c0b1bc0 2023-07-09T02:12:15.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d4b7fe640 1 --2- 172.21.15.45:0/2402267130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c069870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0cebb0 tx=0x7f5d3c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26fbcc591e5b4803 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:15.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d4a7fc640 1 -- 172.21.15.45:0/2402267130 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0ab650 con 0x7f5d4c0b1bc0 2023-07-09T02:12:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d4a7fc640 1 -- 172.21.15.45:0/2402267130 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0ab7b0 con 0x7f5d4c0b1bc0 2023-07-09T02:12:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d4a7fc640 1 -- 172.21.15.45:0/2402267130 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0abb40 con 0x7f5d4c0b1bc0 2023-07-09T02:12:15.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 -- 172.21.15.45:0/2402267130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 msgr2=0x7f5d4c069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2402267130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c069870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0cebb0 tx=0x7f5d3c01c450 comp rx=0 tx=0).stop 2023-07-09T02:12:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 -- 172.21.15.45:0/2402267130 shutdown_connections 2023-07-09T02:12:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2402267130 >> v2:172.21.15.155:3300/0 conn(0x7f5d4c0b68b0 0x7f5d4c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2402267130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c069870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 -- 172.21.15.45:0/2402267130 >> 172.21.15.45:0/2402267130 conn(0x7f5d4c0d35b0 msgr2=0x7f5d4c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:15.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 -- 172.21.15.45:0/2402267130 shutdown_connections 2023-07-09T02:12:15.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 -- 172.21.15.45:0/2402267130 wait complete. 2023-07-09T02:12:15.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 Processor -- start 2023-07-09T02:12:15.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.964+0000 7f5d50abd640 1 -- start start 2023-07-09T02:12:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4c0b68b0 0x7f5d4c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:15.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4c0d2400 0x7f5d4c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c15c290 con 0x7f5d4c0d2400 2023-07-09T02:12:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c15a160 con 0x7f5d4c0b68b0 2023-07-09T02:12:15.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c159e80 con 0x7f5d4c0b1bc0 2023-07-09T02:12:15.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4c0d2400 0x7f5d4c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:15.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4c0d2400 0x7f5d4c15bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59300/0 (socket says 172.21.15.45:59300) 2023-07-09T02:12:15.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 -- 172.21.15.45:0/2686452933 learned_addr learned my addr 172.21.15.45:0/2686452933 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:15.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4b7fe640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:15.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4affd640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4c0b68b0 0x7f5d4c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:15.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 -- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 msgr2=0x7f5d4c154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 -- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4c0b68b0 msgr2=0x7f5d4c152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:15.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4c0b68b0 0x7f5d4c152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 -- 172.21.15.45:0/2686452933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c009420 con 0x7f5d4c0d2400 2023-07-09T02:12:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d4bfff640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4c0d2400 0x7f5d4c15bd50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400efc0 tx=0x7f5d4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d33fff640 1 -- 172.21.15.45:0/2686452933 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44014480 con 0x7f5d4c0d2400 2023-07-09T02:12:15.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d33fff640 1 -- 172.21.15.45:0/2686452933 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400f040 con 0x7f5d4c0d2400 2023-07-09T02:12:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c15a640 con 0x7f5d4c0d2400 2023-07-09T02:12:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d33fff640 1 -- 172.21.15.45:0/2686452933 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44014820 con 0x7f5d4c0d2400 2023-07-09T02:12:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c15ac00 con 0x7f5d4c0d2400 2023-07-09T02:12:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.968+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c15ae20 con 0x7f5d4c0d2400 2023-07-09T02:12:15.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.972+0000 7f5d33fff640 1 -- 172.21.15.45:0/2686452933 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d44014980 con 0x7f5d4c0d2400 2023-07-09T02:12:15.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.972+0000 7f5d33fff640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d380662b0 0x7f5d38068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:15.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.972+0000 7f5d33fff640 1 -- 172.21.15.45:0/2686452933 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d44084ab0 con 0x7f5d4c0d2400 2023-07-09T02:12:15.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.972+0000 7f5d4b7fe640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d380662b0 0x7f5d38068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:15.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.972+0000 7f5d4b7fe640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d380662b0 0x7f5d38068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0af000 tx=0x7f5d3c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:15.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:15.976+0000 7f5d33fff640 1 -- 172.21.15.45:0/2686452933 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d44051f40 con 0x7f5d4c0d2400 2023-07-09T02:12:16.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.164+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d4c04e020 con 0x7f5d4c0d2400 2023-07-09T02:12:16.706 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-07-09T02:12:16.704+0000 7fc533aff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:12:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.788+0000 7f5d33fff640 1 -- 172.21.15.45:0/2686452933 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d44055560 con 0x7f5d4c0d2400 2023-07-09T02:12:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d380662b0 msgr2=0x7f5d38068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d380662b0 0x7f5d38068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0af000 tx=0x7f5d3c0a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4c0d2400 msgr2=0x7f5d4c15bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4c0d2400 0x7f5d4c15bd50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400efc0 tx=0x7f5d4400c490 comp rx=0 tx=0).stop 2023-07-09T02:12:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 shutdown_connections 2023-07-09T02:12:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4c0d2400 0x7f5d4c15bd50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4c0b68b0 0x7f5d4c152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d380662b0 0x7f5d38068760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 --2- 172.21.15.45:0/2686452933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4c0b1bc0 0x7f5d4c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 >> 172.21.15.45:0/2686452933 conn(0x7f5d4c0d35b0 msgr2=0x7f5d4c0b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 shutdown_connections 2023-07-09T02:12:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.792+0000 7f5d50abd640 1 -- 172.21.15.45:0/2686452933 wait complete. 2023-07-09T02:12:16.816 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:12:16.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:16.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b31634640 1 Processor -- start 2023-07-09T02:12:16.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b31634640 1 -- start start 2023-07-09T02:12:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b31634640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3b2c15c060 0x7f3b2c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b31634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0cd120 0x7f3b2c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b31634640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b2c0d2450 0x7f3b2c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b31634640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c0d28f0 con 0x7f3b2c0d2450 2023-07-09T02:12:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b31634640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c160a50 con 0x7f3b2c15c060 2023-07-09T02:12:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b31634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c15c430 con 0x7f3b2c0cd120 2023-07-09T02:12:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b2c0d2450 0x7f3b2c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b2c0d2450 0x7f3b2c0d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59314/0 (socket says 172.21.15.45:59314) 2023-07-09T02:12:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2b7fe640 1 -- 172.21.15.45:0/852182171 learned_addr learned my addr 172.21.15.45:0/852182171 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b23fff640 1 --2- 172.21.15.45:0/852182171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0cd120 0x7f3b2c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2affd640 1 --2- 172.21.15.45:0/852182171 >> v2:172.21.15.155:3300/0 conn(0x7f3b2c15c060 0x7f3b2c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:16.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2b7fe640 1 -- 172.21.15.45:0/852182171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0cd120 msgr2=0x7f3b2c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:16.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2b7fe640 1 --2- 172.21.15.45:0/852182171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0cd120 0x7f3b2c0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2b7fe640 1 -- 172.21.15.45:0/852182171 >> v2:172.21.15.155:3300/0 conn(0x7f3b2c15c060 msgr2=0x7f3b2c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:16.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2b7fe640 1 --2- 172.21.15.45:0/852182171 >> v2:172.21.15.155:3300/0 conn(0x7f3b2c15c060 0x7f3b2c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.964+0000 7f3b2b7fe640 1 -- 172.21.15.45:0/852182171 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c15fb60 con 0x7f3b2c0d2450 2023-07-09T02:12:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b2b7fe640 1 --2- 172.21.15.45:0/852182171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0d2450 0x7f3b2c0d0610 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0d3ad0 tx=0x7f3b2401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1218aeafdcbbf86 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b2a7fc640 1 -- 172.21.15.45:0/852182171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240a5560 con 0x7f3b2c0d2450 2023-07-09T02:12:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b2a7fc640 1 -- 172.21.15.45:0/852182171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b240a56c0 con 0x7f3b2c0d2450 2023-07-09T02:12:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b2a7fc640 1 -- 172.21.15.45:0/852182171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240a5a50 con 0x7f3b2c0d2450 2023-07-09T02:12:16.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 -- 172.21.15.45:0/852182171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0d2450 msgr2=0x7f3b2c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:16.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 --2- 172.21.15.45:0/852182171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0d2450 0x7f3b2c0d0610 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0d3ad0 tx=0x7f3b2401c6e0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 -- 172.21.15.45:0/852182171 shutdown_connections 2023-07-09T02:12:16.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 --2- 172.21.15.45:0/852182171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0d2450 0x7f3b2c0d0610 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 --2- 172.21.15.45:0/852182171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0cd120 0x7f3b2c0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 --2- 172.21.15.45:0/852182171 >> v2:172.21.15.155:3300/0 conn(0x7f3b2c15c060 0x7f3b2c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 -- 172.21.15.45:0/852182171 >> 172.21.15.45:0/852182171 conn(0x7f3b2c0698e0 msgr2=0x7f3b2c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:16.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 -- 172.21.15.45:0/852182171 shutdown_connections 2023-07-09T02:12:16.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.968+0000 7f3b31634640 1 -- 172.21.15.45:0/852182171 wait complete. 2023-07-09T02:12:16.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 Processor -- start 2023-07-09T02:12:16.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 -- start start 2023-07-09T02:12:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0cd120 0x7f3b2c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0d2450 0x7f3b2c0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:16.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b2c15c060 0x7f3b2c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:16.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0ca200 con 0x7f3b2c0cd120 2023-07-09T02:12:16.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0c92a0 con 0x7f3b2c15c060 2023-07-09T02:12:16.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c153d10 con 0x7f3b2c0d2450 2023-07-09T02:12:16.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0cd120 0x7f3b2c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:16.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0cd120 0x7f3b2c151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59318/0 (socket says 172.21.15.45:59318) 2023-07-09T02:12:16.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 -- 172.21.15.45:0/2810719784 learned_addr learned my addr 172.21.15.45:0/2810719784 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:16.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b23fff640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0d2450 0x7f3b2c0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:16.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2b7fe640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b2c15c060 0x7f3b2c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:16.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 -- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0d2450 msgr2=0x7f3b2c0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:16.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0d2450 0x7f3b2c0b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 -- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b2c15c060 msgr2=0x7f3b2c0b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:16.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b2c15c060 0x7f3b2c0b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:16.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 -- 172.21.15.45:0/2810719784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009b30 con 0x7f3b2c0cd120 2023-07-09T02:12:16.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b2affd640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0cd120 0x7f3b2c151e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e870 tx=0x7f3b1c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:16.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b237fe640 1 -- 172.21.15.45:0/2810719784 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c009510 con 0x7f3b2c0cd120 2023-07-09T02:12:16.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b237fe640 1 -- 172.21.15.45:0/2810719784 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c00eec0 con 0x7f3b2c0cd120 2023-07-09T02:12:16.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c158be0 con 0x7f3b2c0cd120 2023-07-09T02:12:16.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b237fe640 1 -- 172.21.15.45:0/2810719784 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00cb40 con 0x7f3b2c0cd120 2023-07-09T02:12:16.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c0c9f20 con 0x7f3b2c0cd120 2023-07-09T02:12:16.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.972+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c04d7d0 con 0x7f3b2c0cd120 2023-07-09T02:12:16.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.976+0000 7f3b237fe640 1 -- 172.21.15.45:0/2810719784 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b1c00cca0 con 0x7f3b2c0cd120 2023-07-09T02:12:16.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.976+0000 7f3b237fe640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b0c066280 0x7f3b0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:16.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.976+0000 7f3b237fe640 1 -- 172.21.15.45:0/2810719784 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b1c0841b0 con 0x7f3b2c0cd120 2023-07-09T02:12:16.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.976+0000 7f3b23fff640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b0c066280 0x7f3b0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:16.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.976+0000 7f3b23fff640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b0c066280 0x7f3b0c068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c15f7f0 tx=0x7f3b14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:16.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:16.980+0000 7f3b237fe640 1 -- 172.21.15.45:0/2810719784 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b1c051620 con 0x7f3b2c0cd120 2023-07-09T02:12:17.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.168+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b2c06baa0 con 0x7f3b2c0cd120 2023-07-09T02:12:17.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.168+0000 7f3b237fe640 1 -- 172.21.15.45:0/2810719784 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f3b1c054c40 con 0x7f3b2c0cd120 2023-07-09T02:12:17.172 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:17.172 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:13.135771+0000","modified":"2023-07-09T02:12:16.783642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3290020828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3290020828},{"type":"v1","addr":"172.21.15.45:6835","nonce":3290020828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T02:12:17.172 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-07-09T02:12:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b0c066280 msgr2=0x7f3b0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b0c066280 0x7f3b0c068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c15f7f0 tx=0x7f3b14008040 comp rx=0 tx=0).stop 2023-07-09T02:12:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0cd120 msgr2=0x7f3b2c151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0cd120 0x7f3b2c151e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e870 tx=0x7f3b1c00ec70 comp rx=0 tx=0).stop 2023-07-09T02:12:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 shutdown_connections 2023-07-09T02:12:17.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b2c15c060 0x7f3b2c0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b0c066280 0x7f3b0c068730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b2c0d2450 0x7f3b2c0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 --2- 172.21.15.45:0/2810719784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b2c0cd120 0x7f3b2c151e10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 >> 172.21.15.45:0/2810719784 conn(0x7f3b2c0698e0 msgr2=0x7f3b2c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:17.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 shutdown_connections 2023-07-09T02:12:17.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.172+0000 7f3b31634640 1 -- 172.21.15.45:0/2810719784 wait complete. 2023-07-09T02:12:17.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.332+0000 7f5180c19640 1 Processor -- start 2023-07-09T02:12:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.332+0000 7f5180c19640 1 -- start start 2023-07-09T02:12:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5180c19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c0d2620 0x7f517c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5180c19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c160a50 con 0x7f517c15c060 2023-07-09T02:12:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5180c19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c15c430 con 0x7f517c0cd120 2023-07-09T02:12:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5180c19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c15fb60 con 0x7f517c0d2620 2023-07-09T02:12:17.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f517a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f517c15c060 0x7f517c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47174/0 (socket says 172.21.15.45:47174) 2023-07-09T02:12:17.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f517a59c640 1 -- 172.21.15.45:0/792535358 learned_addr learned my addr 172.21.15.45:0/792535358 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:17.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5173fff640 1 --2- 172.21.15.45:0/792535358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c0d2620 0x7f517c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5179d9b640 1 -- 172.21.15.45:0/792535358 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521193998 0 0) 0x7f517c160a50 con 0x7f517c15c060 2023-07-09T02:12:17.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5179d9b640 1 -- 172.21.15.45:0/792535358 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5168003530 con 0x7f517c15c060 2023-07-09T02:12:17.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5179d9b640 1 -- 172.21.15.45:0/792535358 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364639486 0 0) 0x7f517c15c430 con 0x7f517c0cd120 2023-07-09T02:12:17.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5179d9b640 1 -- 172.21.15.45:0/792535358 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f517c160a50 con 0x7f517c0cd120 2023-07-09T02:12:17.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5173fff640 1 -- 172.21.15.45:0/792535358 >> v1:172.21.15.155:6789/0 conn(0x7f517c0cd120 legacy=0x7f517c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5173fff640 1 -- 172.21.15.45:0/792535358 >> v1:172.21.15.45:6789/0 conn(0x7f517c15c060 legacy=0x7f517c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.336+0000 7f5173fff640 1 -- 172.21.15.45:0/792535358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c15fe40 con 0x7f517c0d2620 2023-07-09T02:12:17.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5173fff640 1 --2- 172.21.15.45:0/792535358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c0d2620 0x7f517c0b4ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51640097f0 tx=0x7f516401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c3c7e9c5e48b82 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:17.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5179d9b640 1 -- 172.21.15.45:0/792535358 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640aa5f0 con 0x7f517c0d2620 2023-07-09T02:12:17.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5179d9b640 1 -- 172.21.15.45:0/792535358 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51640aa750 con 0x7f517c0d2620 2023-07-09T02:12:17.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5179d9b640 1 -- 172.21.15.45:0/792535358 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640aaae0 con 0x7f517c0d2620 2023-07-09T02:12:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 -- 172.21.15.45:0/792535358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c0d2620 msgr2=0x7f517c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 --2- 172.21.15.45:0/792535358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c0d2620 0x7f517c0b4ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51640097f0 tx=0x7f516401c490 comp rx=0 tx=0).stop 2023-07-09T02:12:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 -- 172.21.15.45:0/792535358 shutdown_connections 2023-07-09T02:12:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 --2- 172.21.15.45:0/792535358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c0d2620 0x7f517c0b4ed0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 -- 172.21.15.45:0/792535358 >> 172.21.15.45:0/792535358 conn(0x7f517c0698e0 msgr2=0x7f517c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 -- 172.21.15.45:0/792535358 shutdown_connections 2023-07-09T02:12:17.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 -- 172.21.15.45:0/792535358 wait complete. 2023-07-09T02:12:17.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 Processor -- start 2023-07-09T02:12:17.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.340+0000 7f5180c19640 1 -- start start 2023-07-09T02:12:17.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f517c0cd120 0x7f517c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f517c0d2620 0x7f517c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c15c060 0x7f517c15e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c152790 con 0x7f517c0cd120 2023-07-09T02:12:17.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c15f640 con 0x7f517c0d2620 2023-07-09T02:12:17.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1598b0 con 0x7f517c15c060 2023-07-09T02:12:17.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f517c0cd120 0x7f517c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f517c0cd120 0x7f517c152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59326/0 (socket says 172.21.15.45:59326) 2023-07-09T02:12:17.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 -- 172.21.15.45:0/1668467424 learned_addr learned my addr 172.21.15.45:0/1668467424 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:17.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5173fff640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f517c0d2620 0x7f517c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517ad9d640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c15c060 0x7f517c15e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 -- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c15c060 msgr2=0x7f517c15e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c15c060 0x7f517c15e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 -- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f517c0d2620 msgr2=0x7f517c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f517c0d2620 0x7f517c15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 -- 172.21.15.45:0/1668467424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5164009420 con 0x7f517c0cd120 2023-07-09T02:12:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f517a59c640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f517c0cd120 0x7f517c152250 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c420 tx=0x7f516c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:17.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5172ffd640 1 -- 172.21.15.45:0/1668467424 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c005cf0 con 0x7f517c0cd120 2023-07-09T02:12:17.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5172ffd640 1 -- 172.21.15.45:0/1668467424 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c005e50 con 0x7f517c0cd120 2023-07-09T02:12:17.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5172ffd640 1 -- 172.21.15.45:0/1668467424 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c007310 con 0x7f517c0cd120 2023-07-09T02:12:17.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c0b59f0 con 0x7f517c0cd120 2023-07-09T02:12:17.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c159ca0 con 0x7f517c0cd120 2023-07-09T02:12:17.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c04d7d0 con 0x7f517c0cd120 2023-07-09T02:12:17.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.344+0000 7f5172ffd640 1 -- 172.21.15.45:0/1668467424 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f516c007470 con 0x7f517c0cd120 2023-07-09T02:12:17.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.348+0000 7f5172ffd640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f515c066280 0x7f515c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.348+0000 7f5172ffd640 1 -- 172.21.15.45:0/1668467424 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f516c0832c0 con 0x7f517c0cd120 2023-07-09T02:12:17.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.348+0000 7f5173fff640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f515c066280 0x7f515c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.348+0000 7f5173fff640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f515c066280 0x7f515c068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f51640ae000 tx=0x7f51640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.352+0000 7f5172ffd640 1 -- 172.21.15.45:0/1668467424 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f516c0507e0 con 0x7f517c0cd120 2023-07-09T02:12:17.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.504+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f517c06baa0 con 0x7f517c0cd120 2023-07-09T02:12:17.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.504+0000 7f5172ffd640 1 -- 172.21.15.45:0/1668467424 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f516c053e00 con 0x7f517c0cd120 2023-07-09T02:12:17.508 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:17.509 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:14.751751+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f515c066280 msgr2=0x7f515c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f515c066280 0x7f515c068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f51640ae000 tx=0x7f51640a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f517c0cd120 msgr2=0x7f517c152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f517c0cd120 0x7f517c152250 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c420 tx=0x7f516c00c8e0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 shutdown_connections 2023-07-09T02:12:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f515c066280 0x7f515c068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517c15c060 0x7f517c15e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f517c0d2620 0x7f517c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 --2- 172.21.15.45:0/1668467424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f517c0cd120 0x7f517c152250 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 >> 172.21.15.45:0/1668467424 conn(0x7f517c0698e0 msgr2=0x7f517c0b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 shutdown_connections 2023-07-09T02:12:17.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.508+0000 7f5180c19640 1 -- 172.21.15.45:0/1668467424 wait complete. 2023-07-09T02:12:17.529 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:12:17.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:12:17.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39c159f640 1 Processor -- start 2023-07-09T02:12:17.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39c159f640 1 -- start start 2023-07-09T02:12:17.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39c159f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39bc0d2620 0x7f39bc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39c159f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39bc0cd120 0x7f39bc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39c159f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc160a50 con 0x7f39bc15c060 2023-07-09T02:12:17.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39c159f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc15c430 con 0x7f39bc0cd120 2023-07-09T02:12:17.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39c159f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc15fb60 con 0x7f39bc0d2620 2023-07-09T02:12:17.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39bb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39bc0cd120 0x7f39bc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39bb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39bc0cd120 0x7f39bc0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59338/0 (socket says 172.21.15.45:59338) 2023-07-09T02:12:17.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39bb7fe640 1 -- 172.21.15.45:0/401199639 learned_addr learned my addr 172.21.15.45:0/401199639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:17.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39baffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f39bc15c060 0x7f39bc0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47178/0 (socket says 172.21.15.45:47178) 2023-07-09T02:12:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39b3fff640 1 --2- 172.21.15.45:0/401199639 >> v2:172.21.15.155:3300/0 conn(0x7f39bc0d2620 0x7f39bc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39bb7fe640 1 -- 172.21.15.45:0/401199639 >> v2:172.21.15.155:3300/0 conn(0x7f39bc0d2620 msgr2=0x7f39bc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39bb7fe640 1 --2- 172.21.15.45:0/401199639 >> v2:172.21.15.155:3300/0 conn(0x7f39bc0d2620 0x7f39bc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39bb7fe640 1 -- 172.21.15.45:0/401199639 >> v1:172.21.15.45:6789/0 conn(0x7f39bc15c060 legacy=0x7f39bc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39bb7fe640 1 -- 172.21.15.45:0/401199639 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc15fe40 con 0x7f39bc0cd120 2023-07-09T02:12:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39ba7fc640 1 -- 172.21.15.45:0/401199639 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118641786 0 0) 0x7f39bc160a50 con 0x7f39bc15c060 2023-07-09T02:12:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.672+0000 7f39b3fff640 1 --2- 172.21.15.45:0/401199639 >> v2:172.21.15.155:3300/0 conn(0x7f39bc0d2620 0x7f39bc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:17.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39bb7fe640 1 --2- 172.21.15.45:0/401199639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc0cee30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f39bc15fac0 tx=0x7f39b401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22d959574bee79 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:17.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39ba7fc640 1 -- 172.21.15.45:0/401199639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b40a5860 con 0x7f39bc0cd120 2023-07-09T02:12:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39ba7fc640 1 -- 172.21.15.45:0/401199639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b40a59c0 con 0x7f39bc0cd120 2023-07-09T02:12:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39ba7fc640 1 -- 172.21.15.45:0/401199639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b40a5d50 con 0x7f39bc0cd120 2023-07-09T02:12:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39c159f640 1 -- 172.21.15.45:0/401199639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 msgr2=0x7f39bc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39c159f640 1 --2- 172.21.15.45:0/401199639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc0cee30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f39bc15fac0 tx=0x7f39b401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39c159f640 1 -- 172.21.15.45:0/401199639 shutdown_connections 2023-07-09T02:12:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39c159f640 1 --2- 172.21.15.45:0/401199639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc0cee30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39c159f640 1 --2- 172.21.15.45:0/401199639 >> v2:172.21.15.155:3300/0 conn(0x7f39bc0d2620 0x7f39bc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39c159f640 1 -- 172.21.15.45:0/401199639 >> 172.21.15.45:0/401199639 conn(0x7f39bc0698e0 msgr2=0x7f39bc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39c159f640 1 -- 172.21.15.45:0/401199639 shutdown_connections 2023-07-09T02:12:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.676+0000 7f39c159f640 1 -- 172.21.15.45:0/401199639 wait complete. 2023-07-09T02:12:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 Processor -- start 2023-07-09T02:12:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 -- start start 2023-07-09T02:12:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc0d2620 0x7f39bc15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c060 0x7f39bc154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc15f3f0 con 0x7f39bc0cd120 2023-07-09T02:12:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc15afe0 con 0x7f39bc0d2620 2023-07-09T02:12:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc159150 con 0x7f39bc15c060 2023-07-09T02:12:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59340/0 (socket says 172.21.15.45:59340) 2023-07-09T02:12:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 -- 172.21.15.45:0/2056202893 learned_addr learned my addr 172.21.15.45:0/2056202893 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:17.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39b3fff640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc0d2620 0x7f39bc15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39bb7fe640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c060 0x7f39bc154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 -- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c060 msgr2=0x7f39bc154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c060 0x7f39bc154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 -- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc0d2620 msgr2=0x7f39bc15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc0d2620 0x7f39bc15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 -- 172.21.15.45:0/2056202893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4009b30 con 0x7f39bc0cd120 2023-07-09T02:12:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39bb7fe640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c060 0x7f39bc154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39b3fff640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc0d2620 0x7f39bc15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39baffd640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc158b30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c480 tx=0x7f39ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39b37fe640 1 -- 172.21.15.45:0/2056202893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0074e0 con 0x7f39bc0cd120 2023-07-09T02:12:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39b37fe640 1 -- 172.21.15.45:0/2056202893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac007660 con 0x7f39bc0cd120 2023-07-09T02:12:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39b37fe640 1 -- 172.21.15.45:0/2056202893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac004a30 con 0x7f39bc0cd120 2023-07-09T02:12:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc0b59f0 con 0x7f39bc0cd120 2023-07-09T02:12:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc159710 con 0x7f39bc0cd120 2023-07-09T02:12:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.680+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc04d7d0 con 0x7f39bc0cd120 2023-07-09T02:12:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.684+0000 7f39b37fe640 1 -- 172.21.15.45:0/2056202893 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39ac004b90 con 0x7f39bc0cd120 2023-07-09T02:12:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.684+0000 7f39b37fe640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f399c066280 0x7f399c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.684+0000 7f39b37fe640 1 -- 172.21.15.45:0/2056202893 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39ac082f10 con 0x7f39bc0cd120 2023-07-09T02:12:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.684+0000 7f39b3fff640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f399c066280 0x7f399c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.684+0000 7f39b3fff640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f399c066280 0x7f399c068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f39bc166ec0 tx=0x7f39a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:17.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.688+0000 7f39b37fe640 1 -- 172.21.15.45:0/2056202893 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39ac053e10 con 0x7f39bc0cd120 2023-07-09T02:12:17.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:12:17.811 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:12:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.844+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39bc0b5870 con 0x7f399c066280 2023-07-09T02:12:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.852+0000 7f39b37fe640 1 -- 172.21.15.45:0/2056202893 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305679 (secure 0 0 0) 0x7f39a4009120 con 0x7f399c066280 2023-07-09T02:12:17.860 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:17.861 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:12:17.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f399c066280 msgr2=0x7f399c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f399c066280 0x7f399c068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f39bc166ec0 tx=0x7f39a4008040 comp rx=0 tx=0).stop 2023-07-09T02:12:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 msgr2=0x7f39bc158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc158b30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c480 tx=0x7f39ac00c940 comp rx=0 tx=0).stop 2023-07-09T02:12:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 shutdown_connections 2023-07-09T02:12:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f399c066280 0x7f399c068730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39bc15c060 0x7f39bc154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39bc0d2620 0x7f39bc15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 --2- 172.21.15.45:0/2056202893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39bc0cd120 0x7f39bc158b30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 >> 172.21.15.45:0/2056202893 conn(0x7f39bc0698e0 msgr2=0x7f39bc0b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 shutdown_connections 2023-07-09T02:12:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:17.856+0000 7f39c159f640 1 -- 172.21.15.45:0/2056202893 wait complete. 2023-07-09T02:12:17.879 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-07-09T02:12:16.539725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2405,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560094,"statfs":{"total":1600000000,"available":1597536974,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.800402"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767695+0000","last_change":"2023-07-09T02:12:13.765142+0000","last_active":"2023-07-09T02:12:14.767695+0000","last_peered":"2023-07-09T02:12:14.767695+0000","last_clean":"2023-07-09T02:12:14.767695+0000","last_became_active":"2023-07-09T02:12:13.764925+0000","last_became_peered":"2023-07-09T02:12:13.764925+0000","last_unstale":"2023-07-09T02:12:14.767695+0000","last_undegraded":"2023-07-09T02:12:14.767695+0000","last_fullsized":"2023-07-09T02:12:14.767695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:11.562783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767860+0000","last_change":"2023-07-09T02:12:13.767785+0000","last_active":"2023-07-09T02:12:14.767860+0000","last_peered":"2023-07-09T02:12:14.767860+0000","last_clean":"2023-07-09T02:12:14.767860+0000","last_became_active":"2023-07-09T02:12:13.766700+0000","last_became_peered":"2023-07-09T02:12:13.766700+0000","last_unstale":"2023-07-09T02:12:14.767860+0000","last_undegraded":"2023-07-09T02:12:14.767860+0000","last_fullsized":"2023-07-09T02:12:14.767860+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:05:29.077399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756750+0000","last_change":"2023-07-09T02:12:13.769999+0000","last_active":"2023-07-09T02:12:14.756750+0000","last_peered":"2023-07-09T02:12:14.756750+0000","last_clean":"2023-07-09T02:12:14.756750+0000","last_became_active":"2023-07-09T02:12:13.769657+0000","last_became_peered":"2023-07-09T02:12:13.769657+0000","last_unstale":"2023-07-09T02:12:14.756750+0000","last_undegraded":"2023-07-09T02:12:14.756750+0000","last_fullsized":"2023-07-09T02:12:14.756750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:42:28.671465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178683+0000","last_change":"2023-07-09T02:12:13.760787+0000","last_active":"2023-07-09T02:12:15.178683+0000","last_peered":"2023-07-09T02:12:15.178683+0000","last_clean":"2023-07-09T02:12:15.178683+0000","last_became_active":"2023-07-09T02:12:13.760407+0000","last_became_peered":"2023-07-09T02:12:13.760407+0000","last_unstale":"2023-07-09T02:12:15.178683+0000","last_undegraded":"2023-07-09T02:12:15.178683+0000","last_fullsized":"2023-07-09T02:12:15.178683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:15:45.505964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179087+0000","last_change":"2023-07-09T02:12:13.762010+0000","last_active":"2023-07-09T02:12:15.179087+0000","last_peered":"2023-07-09T02:12:15.179087+0000","last_clean":"2023-07-09T02:12:15.179087+0000","last_became_active":"2023-07-09T02:12:13.761747+0000","last_became_peered":"2023-07-09T02:12:13.761747+0000","last_unstale":"2023-07-09T02:12:15.179087+0000","last_undegraded":"2023-07-09T02:12:15.179087+0000","last_fullsized":"2023-07-09T02:12:15.179087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:52:28.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768279+0000","last_change":"2023-07-09T02:12:13.770547+0000","last_active":"2023-07-09T02:12:14.768279+0000","last_peered":"2023-07-09T02:12:14.768279+0000","last_clean":"2023-07-09T02:12:14.768279+0000","last_became_active":"2023-07-09T02:12:13.770321+0000","last_became_peered":"2023-07-09T02:12:13.770321+0000","last_unstale":"2023-07-09T02:12:14.768279+0000","last_undegraded":"2023-07-09T02:12:14.768279+0000","last_fullsized":"2023-07-09T02:12:14.768279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:36.396620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756410+0000","last_change":"2023-07-09T02:12:13.771138+0000","last_active":"2023-07-09T02:12:14.756410+0000","last_peered":"2023-07-09T02:12:14.756410+0000","last_clean":"2023-07-09T02:12:14.756410+0000","last_became_active":"2023-07-09T02:12:13.770753+0000","last_became_peered":"2023-07-09T02:12:13.770753+0000","last_unstale":"2023-07-09T02:12:14.756410+0000","last_undegraded":"2023-07-09T02:12:14.756410+0000","last_fullsized":"2023-07-09T02:12:14.756410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:49:08.021243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767508+0000","last_change":"2023-07-09T02:12:13.772744+0000","last_active":"2023-07-09T02:12:14.767508+0000","last_peered":"2023-07-09T02:12:14.767508+0000","last_clean":"2023-07-09T02:12:14.767508+0000","last_became_active":"2023-07-09T02:12:13.772415+0000","last_became_peered":"2023-07-09T02:12:13.772415+0000","last_unstale":"2023-07-09T02:12:14.767508+0000","last_undegraded":"2023-07-09T02:12:14.767508+0000","last_fullsized":"2023-07-09T02:12:14.767508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:32:25.411969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756753+0000","last_change":"2023-07-09T02:12:13.769760+0000","last_active":"2023-07-09T02:12:14.756753+0000","last_peered":"2023-07-09T02:12:14.756753+0000","last_clean":"2023-07-09T02:12:14.756753+0000","last_became_active":"2023-07-09T02:12:13.769527+0000","last_became_peered":"2023-07-09T02:12:13.769527+0000","last_unstale":"2023-07-09T02:12:14.756753+0000","last_undegraded":"2023-07-09T02:12:14.756753+0000","last_fullsized":"2023-07-09T02:12:14.756753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:55.208492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756934+0000","last_change":"2023-07-09T02:12:13.768657+0000","last_active":"2023-07-09T02:12:14.756934+0000","last_peered":"2023-07-09T02:12:14.756934+0000","last_clean":"2023-07-09T02:12:14.756934+0000","last_became_active":"2023-07-09T02:12:13.768079+0000","last_became_peered":"2023-07-09T02:12:13.768079+0000","last_unstale":"2023-07-09T02:12:14.756934+0000","last_undegraded":"2023-07-09T02:12:14.756934+0000","last_fullsized":"2023-07-09T02:12:14.756934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:25:09.019551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756772+0000","last_change":"2023-07-09T02:12:13.770873+0000","last_active":"2023-07-09T02:12:14.756772+0000","last_peered":"2023-07-09T02:12:14.756772+0000","last_clean":"2023-07-09T02:12:14.756772+0000","last_became_active":"2023-07-09T02:12:13.770218+0000","last_became_peered":"2023-07-09T02:12:13.770218+0000","last_unstale":"2023-07-09T02:12:14.756772+0000","last_undegraded":"2023-07-09T02:12:14.756772+0000","last_fullsized":"2023-07-09T02:12:14.756772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:10:56.669830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756897+0000","last_change":"2023-07-09T02:12:13.764360+0000","last_active":"2023-07-09T02:12:14.756897+0000","last_peered":"2023-07-09T02:12:14.756897+0000","last_clean":"2023-07-09T02:12:14.756897+0000","last_became_active":"2023-07-09T02:12:13.763620+0000","last_became_peered":"2023-07-09T02:12:13.763620+0000","last_unstale":"2023-07-09T02:12:14.756897+0000","last_undegraded":"2023-07-09T02:12:14.756897+0000","last_fullsized":"2023-07-09T02:12:14.756897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:06.955088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756707+0000","last_change":"2023-07-09T02:12:13.773952+0000","last_active":"2023-07-09T02:12:14.756707+0000","last_peered":"2023-07-09T02:12:14.756707+0000","last_clean":"2023-07-09T02:12:14.756707+0000","last_became_active":"2023-07-09T02:12:13.769974+0000","last_became_peered":"2023-07-09T02:12:13.769974+0000","last_unstale":"2023-07-09T02:12:14.756707+0000","last_undegraded":"2023-07-09T02:12:14.756707+0000","last_fullsized":"2023-07-09T02:12:14.756707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:21:50.490939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.754956+0000","last_change":"2023-07-09T02:12:13.765958+0000","last_active":"2023-07-09T02:12:14.754956+0000","last_peered":"2023-07-09T02:12:14.754956+0000","last_clean":"2023-07-09T02:12:14.754956+0000","last_became_active":"2023-07-09T02:12:13.765440+0000","last_became_peered":"2023-07-09T02:12:13.765440+0000","last_unstale":"2023-07-09T02:12:14.754956+0000","last_undegraded":"2023-07-09T02:12:14.754956+0000","last_fullsized":"2023-07-09T02:12:14.754956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:37:51.314786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757120+0000","last_change":"2023-07-09T02:12:13.768441+0000","last_active":"2023-07-09T02:12:14.757120+0000","last_peered":"2023-07-09T02:12:14.757120+0000","last_clean":"2023-07-09T02:12:14.757120+0000","last_became_active":"2023-07-09T02:12:13.767771+0000","last_became_peered":"2023-07-09T02:12:13.767771+0000","last_unstale":"2023-07-09T02:12:14.757120+0000","last_undegraded":"2023-07-09T02:12:14.757120+0000","last_fullsized":"2023-07-09T02:12:14.757120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:23:56.300340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768338+0000","last_change":"2023-07-09T02:12:13.772748+0000","last_active":"2023-07-09T02:12:14.768338+0000","last_peered":"2023-07-09T02:12:14.768338+0000","last_clean":"2023-07-09T02:12:14.768338+0000","last_became_active":"2023-07-09T02:12:13.772284+0000","last_became_peered":"2023-07-09T02:12:13.772284+0000","last_unstale":"2023-07-09T02:12:14.768338+0000","last_undegraded":"2023-07-09T02:12:14.768338+0000","last_fullsized":"2023-07-09T02:12:14.768338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:50:28.281570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767890+0000","last_change":"2023-07-09T02:12:13.767767+0000","last_active":"2023-07-09T02:12:14.767890+0000","last_peered":"2023-07-09T02:12:14.767890+0000","last_clean":"2023-07-09T02:12:14.767890+0000","last_became_active":"2023-07-09T02:12:13.767552+0000","last_became_peered":"2023-07-09T02:12:13.767552+0000","last_unstale":"2023-07-09T02:12:14.767890+0000","last_undegraded":"2023-07-09T02:12:14.767890+0000","last_fullsized":"2023-07-09T02:12:14.767890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:26.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767795+0000","last_change":"2023-07-09T02:12:13.765767+0000","last_active":"2023-07-09T02:12:14.767795+0000","last_peered":"2023-07-09T02:12:14.767795+0000","last_clean":"2023-07-09T02:12:14.767795+0000","last_became_active":"2023-07-09T02:12:13.765352+0000","last_became_peered":"2023-07-09T02:12:13.765352+0000","last_unstale":"2023-07-09T02:12:14.767795+0000","last_undegraded":"2023-07-09T02:12:14.767795+0000","last_fullsized":"2023-07-09T02:12:14.767795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:09:22.923286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178821+0000","last_change":"2023-07-09T02:12:13.761281+0000","last_active":"2023-07-09T02:12:15.178821+0000","last_peered":"2023-07-09T02:12:15.178821+0000","last_clean":"2023-07-09T02:12:15.178821+0000","last_became_active":"2023-07-09T02:12:13.761012+0000","last_became_peered":"2023-07-09T02:12:13.761012+0000","last_unstale":"2023-07-09T02:12:15.178821+0000","last_undegraded":"2023-07-09T02:12:15.178821+0000","last_fullsized":"2023-07-09T02:12:15.178821+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:09:22.923286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768335+0000","last_change":"2023-07-09T02:12:13.765473+0000","last_active":"2023-07-09T02:12:14.768335+0000","last_peered":"2023-07-09T02:12:14.768335+0000","last_clean":"2023-07-09T02:12:14.768335+0000","last_became_active":"2023-07-09T02:12:13.764004+0000","last_became_peered":"2023-07-09T02:12:13.764004+0000","last_unstale":"2023-07-09T02:12:14.768335+0000","last_undegraded":"2023-07-09T02:12:14.768335+0000","last_fullsized":"2023-07-09T02:12:14.768335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:05:00.216032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756987+0000","last_change":"2023-07-09T02:12:13.770669+0000","last_active":"2023-07-09T02:12:14.756987+0000","last_peered":"2023-07-09T02:12:14.756987+0000","last_clean":"2023-07-09T02:12:14.756987+0000","last_became_active":"2023-07-09T02:12:13.769928+0000","last_became_peered":"2023-07-09T02:12:13.769928+0000","last_unstale":"2023-07-09T02:12:14.756987+0000","last_undegraded":"2023-07-09T02:12:14.756987+0000","last_fullsized":"2023-07-09T02:12:14.756987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:38:38.195388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.754886+0000","last_change":"2023-07-09T02:12:13.760941+0000","last_active":"2023-07-09T02:12:14.754886+0000","last_peered":"2023-07-09T02:12:14.754886+0000","last_clean":"2023-07-09T02:12:14.754886+0000","last_became_active":"2023-07-09T02:12:13.760728+0000","last_became_peered":"2023-07-09T02:12:13.760728+0000","last_unstale":"2023-07-09T02:12:14.754886+0000","last_undegraded":"2023-07-09T02:12:14.754886+0000","last_fullsized":"2023-07-09T02:12:14.754886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:49.514023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768227+0000","last_change":"2023-07-09T02:12:13.757747+0000","last_active":"2023-07-09T02:12:14.768227+0000","last_peered":"2023-07-09T02:12:14.768227+0000","last_clean":"2023-07-09T02:12:14.768227+0000","last_became_active":"2023-07-09T02:12:13.757476+0000","last_became_peered":"2023-07-09T02:12:13.757476+0000","last_unstale":"2023-07-09T02:12:14.768227+0000","last_undegraded":"2023-07-09T02:12:14.768227+0000","last_fullsized":"2023-07-09T02:12:14.768227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:10:53.555026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178970+0000","last_change":"2023-07-09T02:12:13.756948+0000","last_active":"2023-07-09T02:12:15.178970+0000","last_peered":"2023-07-09T02:12:15.178970+0000","last_clean":"2023-07-09T02:12:15.178970+0000","last_became_active":"2023-07-09T02:12:13.756713+0000","last_became_peered":"2023-07-09T02:12:13.756713+0000","last_unstale":"2023-07-09T02:12:15.178970+0000","last_undegraded":"2023-07-09T02:12:15.178970+0000","last_fullsized":"2023-07-09T02:12:15.178970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:24:21.692189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768099+0000","last_change":"2023-07-09T02:12:13.763764+0000","last_active":"2023-07-09T02:12:14.768099+0000","last_peered":"2023-07-09T02:12:14.768099+0000","last_clean":"2023-07-09T02:12:14.768099+0000","last_became_active":"2023-07-09T02:12:13.763429+0000","last_became_peered":"2023-07-09T02:12:13.763429+0000","last_unstale":"2023-07-09T02:12:14.768099+0000","last_undegraded":"2023-07-09T02:12:14.768099+0000","last_fullsized":"2023-07-09T02:12:14.768099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:52:28.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768382+0000","last_change":"2023-07-09T02:12:13.772100+0000","last_active":"2023-07-09T02:12:14.768382+0000","last_peered":"2023-07-09T02:12:14.768382+0000","last_clean":"2023-07-09T02:12:14.768382+0000","last_became_active":"2023-07-09T02:12:13.771644+0000","last_became_peered":"2023-07-09T02:12:13.771644+0000","last_unstale":"2023-07-09T02:12:14.768382+0000","last_undegraded":"2023-07-09T02:12:14.768382+0000","last_fullsized":"2023-07-09T02:12:14.768382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:49.514023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767794+0000","last_change":"2023-07-09T02:12:13.762109+0000","last_active":"2023-07-09T02:12:14.767794+0000","last_peered":"2023-07-09T02:12:14.767794+0000","last_clean":"2023-07-09T02:12:14.767794+0000","last_became_active":"2023-07-09T02:12:13.761781+0000","last_became_peered":"2023-07-09T02:12:13.761781+0000","last_unstale":"2023-07-09T02:12:14.767794+0000","last_undegraded":"2023-07-09T02:12:14.767794+0000","last_fullsized":"2023-07-09T02:12:14.767794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:13:23.551914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756898+0000","last_change":"2023-07-09T02:12:13.774212+0000","last_active":"2023-07-09T02:12:14.756898+0000","last_peered":"2023-07-09T02:12:14.756898+0000","last_clean":"2023-07-09T02:12:14.756898+0000","last_became_active":"2023-07-09T02:12:13.771049+0000","last_became_peered":"2023-07-09T02:12:13.771049+0000","last_unstale":"2023-07-09T02:12:14.756898+0000","last_undegraded":"2023-07-09T02:12:14.756898+0000","last_fullsized":"2023-07-09T02:12:14.756898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:13:57.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767835+0000","last_change":"2023-07-09T02:12:13.766356+0000","last_active":"2023-07-09T02:12:14.767835+0000","last_peered":"2023-07-09T02:12:14.767835+0000","last_clean":"2023-07-09T02:12:14.767835+0000","last_became_active":"2023-07-09T02:12:13.764086+0000","last_became_peered":"2023-07-09T02:12:13.764086+0000","last_unstale":"2023-07-09T02:12:14.767835+0000","last_undegraded":"2023-07-09T02:12:14.767835+0000","last_fullsized":"2023-07-09T02:12:14.767835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:52:30.365029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768223+0000","last_change":"2023-07-09T02:12:13.766930+0000","last_active":"2023-07-09T02:12:14.768223+0000","last_peered":"2023-07-09T02:12:14.768223+0000","last_clean":"2023-07-09T02:12:14.768223+0000","last_became_active":"2023-07-09T02:12:13.766667+0000","last_became_peered":"2023-07-09T02:12:13.766667+0000","last_unstale":"2023-07-09T02:12:14.768223+0000","last_undegraded":"2023-07-09T02:12:14.768223+0000","last_fullsized":"2023-07-09T02:12:14.768223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:49:40.062889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768446+0000","last_change":"2023-07-09T02:12:13.756874+0000","last_active":"2023-07-09T02:12:14.768446+0000","last_peered":"2023-07-09T02:12:14.768446+0000","last_clean":"2023-07-09T02:12:14.768446+0000","last_became_active":"2023-07-09T02:12:13.756582+0000","last_became_peered":"2023-07-09T02:12:13.756582+0000","last_unstale":"2023-07-09T02:12:14.768446+0000","last_undegraded":"2023-07-09T02:12:14.768446+0000","last_fullsized":"2023-07-09T02:12:14.768446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:13:57.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768243+0000","last_change":"2023-07-09T02:12:13.767665+0000","last_active":"2023-07-09T02:12:14.768243+0000","last_peered":"2023-07-09T02:12:14.768243+0000","last_clean":"2023-07-09T02:12:14.768243+0000","last_became_active":"2023-07-09T02:12:13.767404+0000","last_became_peered":"2023-07-09T02:12:13.767404+0000","last_unstale":"2023-07-09T02:12:14.768243+0000","last_undegraded":"2023-07-09T02:12:14.768243+0000","last_fullsized":"2023-07-09T02:12:14.768243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:55:03.157131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768512+0000","last_change":"2023-07-09T02:12:13.772520+0000","last_active":"2023-07-09T02:12:14.768512+0000","last_peered":"2023-07-09T02:12:14.768512+0000","last_clean":"2023-07-09T02:12:14.768512+0000","last_became_active":"2023-07-09T02:12:13.771866+0000","last_became_peered":"2023-07-09T02:12:13.771866+0000","last_unstale":"2023-07-09T02:12:14.768512+0000","last_undegraded":"2023-07-09T02:12:14.768512+0000","last_fullsized":"2023-07-09T02:12:14.768512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:25:09.019551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767943+0000","last_change":"2023-07-09T02:12:12.764858+0000","last_active":"2023-07-09T02:12:14.767943+0000","last_peered":"2023-07-09T02:12:14.767943+0000","last_clean":"2023-07-09T02:12:14.767943+0000","last_became_active":"2023-07-09T02:12:12.764617+0000","last_became_peered":"2023-07-09T02:12:12.764617+0000","last_unstale":"2023-07-09T02:12:14.767943+0000","last_undegraded":"2023-07-09T02:12:14.767943+0000","last_fullsized":"2023-07-09T02:12:14.767943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:24:20.683817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768498+0000","last_change":"2023-07-09T02:12:13.770864+0000","last_active":"2023-07-09T02:12:14.768498+0000","last_peered":"2023-07-09T02:12:14.768498+0000","last_clean":"2023-07-09T02:12:14.768498+0000","last_became_active":"2023-07-09T02:12:13.770507+0000","last_became_peered":"2023-07-09T02:12:13.770507+0000","last_unstale":"2023-07-09T02:12:14.768498+0000","last_undegraded":"2023-07-09T02:12:14.768498+0000","last_fullsized":"2023-07-09T02:12:14.768498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:33:18.971043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757195+0000","last_change":"2023-07-09T02:12:12.762398+0000","last_active":"2023-07-09T02:12:14.757195+0000","last_peered":"2023-07-09T02:12:14.757195+0000","last_clean":"2023-07-09T02:12:14.757195+0000","last_became_active":"2023-07-09T02:12:12.762153+0000","last_became_peered":"2023-07-09T02:12:12.762153+0000","last_unstale":"2023-07-09T02:12:14.757195+0000","last_undegraded":"2023-07-09T02:12:14.757195+0000","last_fullsized":"2023-07-09T02:12:14.757195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:00:56.340096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755157+0000","last_change":"2023-07-09T02:12:13.765651+0000","last_active":"2023-07-09T02:12:14.755157+0000","last_peered":"2023-07-09T02:12:14.755157+0000","last_clean":"2023-07-09T02:12:14.755157+0000","last_became_active":"2023-07-09T02:12:13.765145+0000","last_became_peered":"2023-07-09T02:12:13.765145+0000","last_unstale":"2023-07-09T02:12:14.755157+0000","last_undegraded":"2023-07-09T02:12:14.755157+0000","last_fullsized":"2023-07-09T02:12:14.755157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:26.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768713+0000","last_change":"2023-07-09T02:12:12.761662+0000","last_active":"2023-07-09T02:12:14.768713+0000","last_peered":"2023-07-09T02:12:14.768713+0000","last_clean":"2023-07-09T02:12:14.768713+0000","last_became_active":"2023-07-09T02:12:12.761324+0000","last_became_peered":"2023-07-09T02:12:12.761324+0000","last_unstale":"2023-07-09T02:12:14.768713+0000","last_undegraded":"2023-07-09T02:12:14.768713+0000","last_fullsized":"2023-07-09T02:12:14.768713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:25.950279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767634+0000","last_change":"2023-07-09T02:12:13.765900+0000","last_active":"2023-07-09T02:12:14.767634+0000","last_peered":"2023-07-09T02:12:14.767634+0000","last_clean":"2023-07-09T02:12:14.767634+0000","last_became_active":"2023-07-09T02:12:13.765240+0000","last_became_peered":"2023-07-09T02:12:13.765240+0000","last_unstale":"2023-07-09T02:12:14.767634+0000","last_undegraded":"2023-07-09T02:12:14.767634+0000","last_fullsized":"2023-07-09T02:12:14.767634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:11:44.376004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755142+0000","last_change":"2023-07-09T02:12:12.754206+0000","last_active":"2023-07-09T02:12:14.755142+0000","last_peered":"2023-07-09T02:12:14.755142+0000","last_clean":"2023-07-09T02:12:14.755142+0000","last_became_active":"2023-07-09T02:12:12.753989+0000","last_became_peered":"2023-07-09T02:12:12.753989+0000","last_unstale":"2023-07-09T02:12:14.755142+0000","last_undegraded":"2023-07-09T02:12:14.755142+0000","last_fullsized":"2023-07-09T02:12:14.755142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:40:09.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756926+0000","last_change":"2023-07-09T02:12:13.762604+0000","last_active":"2023-07-09T02:12:14.756926+0000","last_peered":"2023-07-09T02:12:14.756926+0000","last_clean":"2023-07-09T02:12:14.756926+0000","last_became_active":"2023-07-09T02:12:13.762384+0000","last_became_peered":"2023-07-09T02:12:13.762384+0000","last_unstale":"2023-07-09T02:12:14.756926+0000","last_undegraded":"2023-07-09T02:12:14.756926+0000","last_fullsized":"2023-07-09T02:12:14.756926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:26:25.088518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756786+0000","last_change":"2023-07-09T02:12:12.758044+0000","last_active":"2023-07-09T02:12:14.756786+0000","last_peered":"2023-07-09T02:12:14.756786+0000","last_clean":"2023-07-09T02:12:14.756786+0000","last_became_active":"2023-07-09T02:12:12.757673+0000","last_became_peered":"2023-07-09T02:12:12.757673+0000","last_unstale":"2023-07-09T02:12:14.756786+0000","last_undegraded":"2023-07-09T02:12:14.756786+0000","last_fullsized":"2023-07-09T02:12:14.756786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:50:27.273198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756279+0000","last_change":"2023-07-09T02:12:13.769345+0000","last_active":"2023-07-09T02:12:14.756279+0000","last_peered":"2023-07-09T02:12:14.756279+0000","last_clean":"2023-07-09T02:12:14.756279+0000","last_became_active":"2023-07-09T02:12:13.768768+0000","last_became_peered":"2023-07-09T02:12:13.768768+0000","last_unstale":"2023-07-09T02:12:14.756279+0000","last_undegraded":"2023-07-09T02:12:14.756279+0000","last_fullsized":"2023-07-09T02:12:14.756279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:40:37.622379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768077+0000","last_change":"2023-07-09T02:12:12.765547+0000","last_active":"2023-07-09T02:12:14.768077+0000","last_peered":"2023-07-09T02:12:14.768077+0000","last_clean":"2023-07-09T02:12:14.768077+0000","last_became_active":"2023-07-09T02:12:12.764975+0000","last_became_peered":"2023-07-09T02:12:12.764975+0000","last_unstale":"2023-07-09T02:12:14.768077+0000","last_undegraded":"2023-07-09T02:12:14.768077+0000","last_fullsized":"2023-07-09T02:12:14.768077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:49:07.012871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755256+0000","last_change":"2023-07-09T02:12:13.770659+0000","last_active":"2023-07-09T02:12:14.755256+0000","last_peered":"2023-07-09T02:12:14.755256+0000","last_clean":"2023-07-09T02:12:14.755256+0000","last_became_active":"2023-07-09T02:12:13.770443+0000","last_became_peered":"2023-07-09T02:12:13.770443+0000","last_unstale":"2023-07-09T02:12:14.755256+0000","last_undegraded":"2023-07-09T02:12:14.755256+0000","last_fullsized":"2023-07-09T02:12:14.755256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:40:37.622379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768165+0000","last_change":"2023-07-09T02:12:12.757723+0000","last_active":"2023-07-09T02:12:14.768165+0000","last_peered":"2023-07-09T02:12:14.768165+0000","last_clean":"2023-07-09T02:12:14.768165+0000","last_became_active":"2023-07-09T02:12:12.757133+0000","last_became_peered":"2023-07-09T02:12:12.757133+0000","last_unstale":"2023-07-09T02:12:14.768165+0000","last_undegraded":"2023-07-09T02:12:14.768165+0000","last_fullsized":"2023-07-09T02:12:14.768165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:01.432463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767987+0000","last_change":"2023-07-09T02:12:13.768159+0000","last_active":"2023-07-09T02:12:14.767987+0000","last_peered":"2023-07-09T02:12:14.767987+0000","last_clean":"2023-07-09T02:12:14.767987+0000","last_became_active":"2023-07-09T02:12:13.767272+0000","last_became_peered":"2023-07-09T02:12:13.767272+0000","last_unstale":"2023-07-09T02:12:14.767987+0000","last_undegraded":"2023-07-09T02:12:14.767987+0000","last_fullsized":"2023-07-09T02:12:14.767987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:36.396620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755236+0000","last_change":"2023-07-09T02:12:12.763857+0000","last_active":"2023-07-09T02:12:14.755236+0000","last_peered":"2023-07-09T02:12:14.755236+0000","last_clean":"2023-07-09T02:12:14.755236+0000","last_became_active":"2023-07-09T02:12:12.763595+0000","last_became_peered":"2023-07-09T02:12:12.763595+0000","last_unstale":"2023-07-09T02:12:14.755236+0000","last_undegraded":"2023-07-09T02:12:14.755236+0000","last_fullsized":"2023-07-09T02:12:14.755236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:17.577055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179111+0000","last_change":"2023-07-09T02:12:13.760647+0000","last_active":"2023-07-09T02:12:15.179111+0000","last_peered":"2023-07-09T02:12:15.179111+0000","last_clean":"2023-07-09T02:12:15.179111+0000","last_became_active":"2023-07-09T02:12:13.760073+0000","last_became_peered":"2023-07-09T02:12:13.760073+0000","last_unstale":"2023-07-09T02:12:15.179111+0000","last_undegraded":"2023-07-09T02:12:15.179111+0000","last_fullsized":"2023-07-09T02:12:15.179111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:40.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768196+0000","last_change":"2023-07-09T02:12:12.758147+0000","last_active":"2023-07-09T02:12:14.768196+0000","last_peered":"2023-07-09T02:12:14.768196+0000","last_clean":"2023-07-09T02:12:14.768196+0000","last_became_active":"2023-07-09T02:12:12.757028+0000","last_became_peered":"2023-07-09T02:12:12.757028+0000","last_unstale":"2023-07-09T02:12:14.768196+0000","last_undegraded":"2023-07-09T02:12:14.768196+0000","last_fullsized":"2023-07-09T02:12:14.768196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:22.181528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767939+0000","last_change":"2023-07-09T02:12:13.763037+0000","last_active":"2023-07-09T02:12:14.767939+0000","last_peered":"2023-07-09T02:12:14.767939+0000","last_clean":"2023-07-09T02:12:14.767939+0000","last_became_active":"2023-07-09T02:12:13.762816+0000","last_became_peered":"2023-07-09T02:12:13.762816+0000","last_unstale":"2023-07-09T02:12:14.767939+0000","last_undegraded":"2023-07-09T02:12:14.767939+0000","last_fullsized":"2023-07-09T02:12:14.767939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:18.585427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756941+0000","last_change":"2023-07-09T02:12:12.757905+0000","last_active":"2023-07-09T02:12:14.756941+0000","last_peered":"2023-07-09T02:12:14.756941+0000","last_clean":"2023-07-09T02:12:14.756941+0000","last_became_active":"2023-07-09T02:12:12.757182+0000","last_became_peered":"2023-07-09T02:12:12.757182+0000","last_unstale":"2023-07-09T02:12:14.756941+0000","last_undegraded":"2023-07-09T02:12:14.756941+0000","last_fullsized":"2023-07-09T02:12:14.756941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:35:10.682297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757027+0000","last_change":"2023-07-09T02:12:13.764233+0000","last_active":"2023-07-09T02:12:14.757027+0000","last_peered":"2023-07-09T02:12:14.757027+0000","last_clean":"2023-07-09T02:12:14.757027+0000","last_became_active":"2023-07-09T02:12:13.763335+0000","last_became_peered":"2023-07-09T02:12:13.763335+0000","last_unstale":"2023-07-09T02:12:14.757027+0000","last_undegraded":"2023-07-09T02:12:14.757027+0000","last_fullsized":"2023-07-09T02:12:14.757027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:36:53.102274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757114+0000","last_change":"2023-07-09T02:12:12.753960+0000","last_active":"2023-07-09T02:12:14.757114+0000","last_peered":"2023-07-09T02:12:14.757114+0000","last_clean":"2023-07-09T02:12:14.757114+0000","last_became_active":"2023-07-09T02:12:12.753684+0000","last_became_peered":"2023-07-09T02:12:12.753684+0000","last_unstale":"2023-07-09T02:12:14.757114+0000","last_undegraded":"2023-07-09T02:12:14.757114+0000","last_fullsized":"2023-07-09T02:12:14.757114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:36:30.545369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.754815+0000","last_change":"2023-07-09T02:12:13.766617+0000","last_active":"2023-07-09T02:12:14.754815+0000","last_peered":"2023-07-09T02:12:14.754815+0000","last_clean":"2023-07-09T02:12:14.754815+0000","last_became_active":"2023-07-09T02:12:13.765912+0000","last_became_peered":"2023-07-09T02:12:13.765912+0000","last_unstale":"2023-07-09T02:12:14.754815+0000","last_undegraded":"2023-07-09T02:12:14.754815+0000","last_fullsized":"2023-07-09T02:12:14.754815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:36.396620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767553+0000","last_change":"2023-07-09T02:12:12.762343+0000","last_active":"2023-07-09T02:12:14.767553+0000","last_peered":"2023-07-09T02:12:14.767553+0000","last_clean":"2023-07-09T02:12:14.767553+0000","last_became_active":"2023-07-09T02:12:12.762133+0000","last_became_peered":"2023-07-09T02:12:12.762133+0000","last_unstale":"2023-07-09T02:12:14.767553+0000","last_undegraded":"2023-07-09T02:12:14.767553+0000","last_fullsized":"2023-07-09T02:12:14.767553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:35:43.218007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756882+0000","last_change":"2023-07-09T02:12:13.769867+0000","last_active":"2023-07-09T02:12:14.756882+0000","last_peered":"2023-07-09T02:12:14.756882+0000","last_clean":"2023-07-09T02:12:14.756882+0000","last_became_active":"2023-07-09T02:12:13.769344+0000","last_became_peered":"2023-07-09T02:12:13.769344+0000","last_unstale":"2023-07-09T02:12:14.756882+0000","last_undegraded":"2023-07-09T02:12:14.756882+0000","last_fullsized":"2023-07-09T02:12:14.756882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:12:15.853601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768070+0000","last_change":"2023-07-09T02:12:12.757643+0000","last_active":"2023-07-09T02:12:14.768070+0000","last_peered":"2023-07-09T02:12:14.768070+0000","last_clean":"2023-07-09T02:12:14.768070+0000","last_became_active":"2023-07-09T02:12:12.757440+0000","last_became_peered":"2023-07-09T02:12:12.757440+0000","last_unstale":"2023-07-09T02:12:14.768070+0000","last_undegraded":"2023-07-09T02:12:14.768070+0000","last_fullsized":"2023-07-09T02:12:14.768070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:48.505651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768107+0000","last_change":"2023-07-09T02:12:13.768353+0000","last_active":"2023-07-09T02:12:14.768107+0000","last_peered":"2023-07-09T02:12:14.768107+0000","last_clean":"2023-07-09T02:12:14.768107+0000","last_became_active":"2023-07-09T02:12:13.767563+0000","last_became_peered":"2023-07-09T02:12:13.767563+0000","last_unstale":"2023-07-09T02:12:14.768107+0000","last_undegraded":"2023-07-09T02:12:14.768107+0000","last_fullsized":"2023-07-09T02:12:14.768107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:37:51.314786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768468+0000","last_change":"2023-07-09T02:12:12.756208+0000","last_active":"2023-07-09T02:12:14.768468+0000","last_peered":"2023-07-09T02:12:14.768468+0000","last_clean":"2023-07-09T02:12:14.768468+0000","last_became_active":"2023-07-09T02:12:12.755956+0000","last_became_peered":"2023-07-09T02:12:12.755956+0000","last_unstale":"2023-07-09T02:12:14.768468+0000","last_undegraded":"2023-07-09T02:12:14.768468+0000","last_fullsized":"2023-07-09T02:12:14.768468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:22.181528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768570+0000","last_change":"2023-07-09T02:12:13.759428+0000","last_active":"2023-07-09T02:12:14.768570+0000","last_peered":"2023-07-09T02:12:14.768570+0000","last_clean":"2023-07-09T02:12:14.768570+0000","last_became_active":"2023-07-09T02:12:13.758423+0000","last_became_peered":"2023-07-09T02:12:13.758423+0000","last_unstale":"2023-07-09T02:12:14.768570+0000","last_undegraded":"2023-07-09T02:12:14.768570+0000","last_fullsized":"2023-07-09T02:12:14.768570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:35:11.690669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767928+0000","last_change":"2023-07-09T02:12:12.764074+0000","last_active":"2023-07-09T02:12:14.767928+0000","last_peered":"2023-07-09T02:12:14.767928+0000","last_clean":"2023-07-09T02:12:14.767928+0000","last_became_active":"2023-07-09T02:12:12.763847+0000","last_became_peered":"2023-07-09T02:12:12.763847+0000","last_unstale":"2023-07-09T02:12:14.767928+0000","last_undegraded":"2023-07-09T02:12:14.767928+0000","last_fullsized":"2023-07-09T02:12:14.767928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:07:44.040140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767943+0000","last_change":"2023-07-09T02:12:13.764300+0000","last_active":"2023-07-09T02:12:14.767943+0000","last_peered":"2023-07-09T02:12:14.767943+0000","last_clean":"2023-07-09T02:12:14.767943+0000","last_became_active":"2023-07-09T02:12:13.764080+0000","last_became_peered":"2023-07-09T02:12:13.764080+0000","last_unstale":"2023-07-09T02:12:14.767943+0000","last_undegraded":"2023-07-09T02:12:14.767943+0000","last_fullsized":"2023-07-09T02:12:14.767943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:55:03.157131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768365+0000","last_change":"2023-07-09T02:12:12.765870+0000","last_active":"2023-07-09T02:12:14.768365+0000","last_peered":"2023-07-09T02:12:14.768365+0000","last_clean":"2023-07-09T02:12:14.768365+0000","last_became_active":"2023-07-09T02:12:12.765300+0000","last_became_peered":"2023-07-09T02:12:12.765300+0000","last_unstale":"2023-07-09T02:12:14.768365+0000","last_undegraded":"2023-07-09T02:12:14.768365+0000","last_fullsized":"2023-07-09T02:12:14.768365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:10:55.661458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768224+0000","last_change":"2023-07-09T02:12:13.768029+0000","last_active":"2023-07-09T02:12:14.768224+0000","last_peered":"2023-07-09T02:12:14.768224+0000","last_clean":"2023-07-09T02:12:14.768224+0000","last_became_active":"2023-07-09T02:12:13.766989+0000","last_became_peered":"2023-07-09T02:12:13.766989+0000","last_unstale":"2023-07-09T02:12:14.768224+0000","last_undegraded":"2023-07-09T02:12:14.768224+0000","last_fullsized":"2023-07-09T02:12:14.768224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:33:18.971043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756808+0000","last_change":"2023-07-09T02:12:12.762003+0000","last_active":"2023-07-09T02:12:14.756808+0000","last_peered":"2023-07-09T02:12:14.756808+0000","last_clean":"2023-07-09T02:12:14.756808+0000","last_became_active":"2023-07-09T02:12:12.761785+0000","last_became_peered":"2023-07-09T02:12:12.761785+0000","last_unstale":"2023-07-09T02:12:14.756808+0000","last_undegraded":"2023-07-09T02:12:14.756808+0000","last_fullsized":"2023-07-09T02:12:14.756808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:43.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757128+0000","last_change":"2023-07-09T02:12:13.770453+0000","last_active":"2023-07-09T02:12:14.757128+0000","last_peered":"2023-07-09T02:12:14.757128+0000","last_clean":"2023-07-09T02:12:14.757128+0000","last_became_active":"2023-07-09T02:12:13.769640+0000","last_became_peered":"2023-07-09T02:12:13.769640+0000","last_unstale":"2023-07-09T02:12:14.757128+0000","last_undegraded":"2023-07-09T02:12:14.757128+0000","last_fullsized":"2023-07-09T02:12:14.757128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:58:50.868540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755454+0000","last_change":"2023-07-09T02:12:12.759239+0000","last_active":"2023-07-09T02:12:14.755454+0000","last_peered":"2023-07-09T02:12:14.755454+0000","last_clean":"2023-07-09T02:12:14.755454+0000","last_became_active":"2023-07-09T02:12:12.759019+0000","last_became_peered":"2023-07-09T02:12:12.759019+0000","last_unstale":"2023-07-09T02:12:14.755454+0000","last_undegraded":"2023-07-09T02:12:14.755454+0000","last_fullsized":"2023-07-09T02:12:14.755454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:38:26.868516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.754972+0000","last_change":"2023-07-09T02:12:13.767609+0000","last_active":"2023-07-09T02:12:14.754972+0000","last_peered":"2023-07-09T02:12:14.754972+0000","last_clean":"2023-07-09T02:12:14.754972+0000","last_became_active":"2023-07-09T02:12:13.767372+0000","last_became_peered":"2023-07-09T02:12:13.767372+0000","last_unstale":"2023-07-09T02:12:14.754972+0000","last_undegraded":"2023-07-09T02:12:14.754972+0000","last_fullsized":"2023-07-09T02:12:14.754972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:23.189900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179013+0000","last_change":"2023-07-09T02:12:12.764058+0000","last_active":"2023-07-09T02:12:15.179013+0000","last_peered":"2023-07-09T02:12:15.179013+0000","last_clean":"2023-07-09T02:12:15.179013+0000","last_became_active":"2023-07-09T02:12:12.763818+0000","last_became_peered":"2023-07-09T02:12:12.763818+0000","last_unstale":"2023-07-09T02:12:15.179013+0000","last_undegraded":"2023-07-09T02:12:15.179013+0000","last_fullsized":"2023-07-09T02:12:15.179013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:22:58.757961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179215+0000","last_change":"2023-07-09T02:12:13.763990+0000","last_active":"2023-07-09T02:12:15.179215+0000","last_peered":"2023-07-09T02:12:15.179215+0000","last_clean":"2023-07-09T02:12:15.179215+0000","last_became_active":"2023-07-09T02:12:13.763765+0000","last_became_peered":"2023-07-09T02:12:13.763765+0000","last_unstale":"2023-07-09T02:12:15.179215+0000","last_undegraded":"2023-07-09T02:12:15.179215+0000","last_fullsized":"2023-07-09T02:12:15.179215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:05:00.216032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768427+0000","last_change":"2023-07-09T02:12:12.752011+0000","last_active":"2023-07-09T02:12:14.768427+0000","last_peered":"2023-07-09T02:12:14.768427+0000","last_clean":"2023-07-09T02:12:14.768427+0000","last_became_active":"2023-07-09T02:12:12.751796+0000","last_became_peered":"2023-07-09T02:12:12.751796+0000","last_unstale":"2023-07-09T02:12:14.768427+0000","last_undegraded":"2023-07-09T02:12:14.768427+0000","last_fullsized":"2023-07-09T02:12:14.768427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:37:50.306414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768637+0000","last_change":"2023-07-09T02:12:13.760345+0000","last_active":"2023-07-09T02:12:14.768637+0000","last_peered":"2023-07-09T02:12:14.768637+0000","last_clean":"2023-07-09T02:12:14.768637+0000","last_became_active":"2023-07-09T02:12:13.759881+0000","last_became_peered":"2023-07-09T02:12:13.759881+0000","last_unstale":"2023-07-09T02:12:14.768637+0000","last_undegraded":"2023-07-09T02:12:14.768637+0000","last_fullsized":"2023-07-09T02:12:14.768637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:38:38.195388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178774+0000","last_change":"2023-07-09T02:12:12.757627+0000","last_active":"2023-07-09T02:12:15.178774+0000","last_peered":"2023-07-09T02:12:15.178774+0000","last_clean":"2023-07-09T02:12:15.178774+0000","last_became_active":"2023-07-09T02:12:12.757415+0000","last_became_peered":"2023-07-09T02:12:12.757415+0000","last_unstale":"2023-07-09T02:12:15.178774+0000","last_undegraded":"2023-07-09T02:12:15.178774+0000","last_fullsized":"2023-07-09T02:12:15.178774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:13:22.543542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757043+0000","last_change":"2023-07-09T02:12:13.758581+0000","last_active":"2023-07-09T02:12:14.757043+0000","last_peered":"2023-07-09T02:12:14.757043+0000","last_clean":"2023-07-09T02:12:14.757043+0000","last_became_active":"2023-07-09T02:12:13.758344+0000","last_became_peered":"2023-07-09T02:12:13.758344+0000","last_unstale":"2023-07-09T02:12:14.757043+0000","last_undegraded":"2023-07-09T02:12:14.757043+0000","last_fullsized":"2023-07-09T02:12:14.757043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:23:35.273007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179320+0000","last_change":"2023-07-09T02:12:12.752713+0000","last_active":"2023-07-09T02:12:15.179320+0000","last_peered":"2023-07-09T02:12:15.179320+0000","last_clean":"2023-07-09T02:12:15.179320+0000","last_became_active":"2023-07-09T02:12:12.752503+0000","last_became_peered":"2023-07-09T02:12:12.752503+0000","last_unstale":"2023-07-09T02:12:15.179320+0000","last_undegraded":"2023-07-09T02:12:15.179320+0000","last_fullsized":"2023-07-09T02:12:15.179320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:02:02.608497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756448+0000","last_change":"2023-07-09T02:12:13.769608+0000","last_active":"2023-07-09T02:12:14.756448+0000","last_peered":"2023-07-09T02:12:14.756448+0000","last_clean":"2023-07-09T02:12:14.756448+0000","last_became_active":"2023-07-09T02:12:13.769094+0000","last_became_peered":"2023-07-09T02:12:13.769094+0000","last_unstale":"2023-07-09T02:12:14.756448+0000","last_undegraded":"2023-07-09T02:12:14.756448+0000","last_fullsized":"2023-07-09T02:12:14.756448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:38:27.876888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768279+0000","last_change":"2023-07-09T02:12:12.764772+0000","last_active":"2023-07-09T02:12:14.768279+0000","last_peered":"2023-07-09T02:12:14.768279+0000","last_clean":"2023-07-09T02:12:14.768279+0000","last_became_active":"2023-07-09T02:12:12.764534+0000","last_became_peered":"2023-07-09T02:12:12.764534+0000","last_unstale":"2023-07-09T02:12:14.768279+0000","last_undegraded":"2023-07-09T02:12:14.768279+0000","last_fullsized":"2023-07-09T02:12:14.768279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:21:49.482567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767754+0000","last_change":"2023-07-09T02:12:13.766387+0000","last_active":"2023-07-09T02:12:14.767754+0000","last_peered":"2023-07-09T02:12:14.767754+0000","last_clean":"2023-07-09T02:12:14.767754+0000","last_became_active":"2023-07-09T02:12:13.765541+0000","last_became_peered":"2023-07-09T02:12:13.765541+0000","last_unstale":"2023-07-09T02:12:14.767754+0000","last_undegraded":"2023-07-09T02:12:14.767754+0000","last_fullsized":"2023-07-09T02:12:14.767754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:49:11.700076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179202+0000","last_change":"2023-07-09T02:12:12.758326+0000","last_active":"2023-07-09T02:12:15.179202+0000","last_peered":"2023-07-09T02:12:15.179202+0000","last_clean":"2023-07-09T02:12:15.179202+0000","last_became_active":"2023-07-09T02:12:12.758111+0000","last_became_peered":"2023-07-09T02:12:12.758111+0000","last_unstale":"2023-07-09T02:12:15.179202+0000","last_undegraded":"2023-07-09T02:12:15.179202+0000","last_fullsized":"2023-07-09T02:12:15.179202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:49:39.054517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756604+0000","last_change":"2023-07-09T02:12:13.770987+0000","last_active":"2023-07-09T02:12:14.756604+0000","last_peered":"2023-07-09T02:12:14.756604+0000","last_clean":"2023-07-09T02:12:14.756604+0000","last_became_active":"2023-07-09T02:12:13.770443+0000","last_became_peered":"2023-07-09T02:12:13.770443+0000","last_unstale":"2023-07-09T02:12:14.756604+0000","last_undegraded":"2023-07-09T02:12:14.756604+0000","last_fullsized":"2023-07-09T02:12:14.756604+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:10:53.555026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768366+0000","last_change":"2023-07-09T02:12:12.760812+0000","last_active":"2023-07-09T02:12:14.768366+0000","last_peered":"2023-07-09T02:12:14.768366+0000","last_clean":"2023-07-09T02:12:14.768366+0000","last_became_active":"2023-07-09T02:12:12.760586+0000","last_became_peered":"2023-07-09T02:12:12.760586+0000","last_unstale":"2023-07-09T02:12:14.768366+0000","last_undegraded":"2023-07-09T02:12:14.768366+0000","last_fullsized":"2023-07-09T02:12:14.768366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:43.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768160+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:12:14.768160+0000","last_peered":"2023-07-09T02:12:14.768160+0000","last_clean":"2023-07-09T02:12:14.768160+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:12:14.768160+0000","last_undegraded":"2023-07-09T02:12:14.768160+0000","last_fullsized":"2023-07-09T02:12:14.768160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:37:22.214584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757197+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:12:14.757197+0000","last_peered":"2023-07-09T02:12:14.757197+0000","last_clean":"2023-07-09T02:12:14.757197+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:12:14.757197+0000","last_undegraded":"2023-07-09T02:12:14.757197+0000","last_fullsized":"2023-07-09T02:12:14.757197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:22:26.302215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768606+0000","last_change":"2023-07-09T02:12:13.770732+0000","last_active":"2023-07-09T02:12:14.768606+0000","last_peered":"2023-07-09T02:12:14.768606+0000","last_clean":"2023-07-09T02:12:14.768606+0000","last_became_active":"2023-07-09T02:12:13.770158+0000","last_became_peered":"2023-07-09T02:12:13.770158+0000","last_unstale":"2023-07-09T02:12:14.768606+0000","last_undegraded":"2023-07-09T02:12:14.768606+0000","last_fullsized":"2023-07-09T02:12:14.768606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:40:10.689297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757184+0000","last_change":"2023-07-09T02:12:12.753949+0000","last_active":"2023-07-09T02:12:14.757184+0000","last_peered":"2023-07-09T02:12:14.757184+0000","last_clean":"2023-07-09T02:12:14.757184+0000","last_became_active":"2023-07-09T02:12:12.753703+0000","last_became_peered":"2023-07-09T02:12:12.753703+0000","last_unstale":"2023-07-09T02:12:14.757184+0000","last_undegraded":"2023-07-09T02:12:14.757184+0000","last_fullsized":"2023-07-09T02:12:14.757184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:00:02.032951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767953+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:12:14.767953+0000","last_peered":"2023-07-09T02:12:14.767953+0000","last_clean":"2023-07-09T02:12:14.767953+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:12:14.767953+0000","last_undegraded":"2023-07-09T02:12:14.767953+0000","last_fullsized":"2023-07-09T02:12:14.767953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:39:35.987046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767554+0000","last_change":"2023-07-09T02:12:13.762735+0000","last_active":"2023-07-09T02:12:14.767554+0000","last_peered":"2023-07-09T02:12:14.767554+0000","last_clean":"2023-07-09T02:12:14.767554+0000","last_became_active":"2023-07-09T02:12:13.762511+0000","last_became_peered":"2023-07-09T02:12:13.762511+0000","last_unstale":"2023-07-09T02:12:14.767554+0000","last_undegraded":"2023-07-09T02:12:14.767554+0000","last_fullsized":"2023-07-09T02:12:14.767554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:33:18.971043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178869+0000","last_change":"2023-07-09T02:12:12.757200+0000","last_active":"2023-07-09T02:12:15.178869+0000","last_peered":"2023-07-09T02:12:15.178869+0000","last_clean":"2023-07-09T02:12:15.178869+0000","last_became_active":"2023-07-09T02:12:12.756967+0000","last_became_peered":"2023-07-09T02:12:12.756967+0000","last_unstale":"2023-07-09T02:12:15.178869+0000","last_undegraded":"2023-07-09T02:12:15.178869+0000","last_fullsized":"2023-07-09T02:12:15.178869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:52:29.356657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178922+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:12:15.178922+0000","last_peered":"2023-07-09T02:12:15.178922+0000","last_clean":"2023-07-09T02:12:15.178922+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:12:15.178922+0000","last_undegraded":"2023-07-09T02:12:15.178922+0000","last_fullsized":"2023-07-09T02:12:15.178922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:06:43.413179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767866+0000","last_change":"2023-07-09T02:12:13.765766+0000","last_active":"2023-07-09T02:12:14.767866+0000","last_peered":"2023-07-09T02:12:14.767866+0000","last_clean":"2023-07-09T02:12:14.767866+0000","last_became_active":"2023-07-09T02:12:13.764971+0000","last_became_peered":"2023-07-09T02:12:13.764971+0000","last_unstale":"2023-07-09T02:12:14.767866+0000","last_undegraded":"2023-07-09T02:12:14.767866+0000","last_fullsized":"2023-07-09T02:12:14.767866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:02.440835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757013+0000","last_change":"2023-07-09T02:12:12.759433+0000","last_active":"2023-07-09T02:12:14.757013+0000","last_peered":"2023-07-09T02:12:14.757013+0000","last_clean":"2023-07-09T02:12:14.757013+0000","last_became_active":"2023-07-09T02:12:12.759206+0000","last_became_peered":"2023-07-09T02:12:12.759206+0000","last_unstale":"2023-07-09T02:12:14.757013+0000","last_undegraded":"2023-07-09T02:12:14.757013+0000","last_fullsized":"2023-07-09T02:12:14.757013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:38.713863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757242+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:12:14.757242+0000","last_peered":"2023-07-09T02:12:14.757242+0000","last_clean":"2023-07-09T02:12:14.757242+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:12:14.757242+0000","last_undegraded":"2023-07-09T02:12:14.757242+0000","last_fullsized":"2023-07-09T02:12:14.757242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:58:18.094575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756898+0000","last_change":"2023-07-09T02:12:13.765612+0000","last_active":"2023-07-09T02:12:14.756898+0000","last_peered":"2023-07-09T02:12:14.756898+0000","last_clean":"2023-07-09T02:12:14.756898+0000","last_became_active":"2023-07-09T02:12:13.765350+0000","last_became_peered":"2023-07-09T02:12:13.765350+0000","last_unstale":"2023-07-09T02:12:14.756898+0000","last_undegraded":"2023-07-09T02:12:14.756898+0000","last_fullsized":"2023-07-09T02:12:14.756898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:35:42.289157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756844+0000","last_change":"2023-07-09T02:12:12.761436+0000","last_active":"2023-07-09T02:12:14.756844+0000","last_peered":"2023-07-09T02:12:14.756844+0000","last_clean":"2023-07-09T02:12:14.756844+0000","last_became_active":"2023-07-09T02:12:12.761206+0000","last_became_peered":"2023-07-09T02:12:12.761206+0000","last_unstale":"2023-07-09T02:12:14.756844+0000","last_undegraded":"2023-07-09T02:12:14.756844+0000","last_fullsized":"2023-07-09T02:12:14.756844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:24:12.135107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768780+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:12:14.768780+0000","last_peered":"2023-07-09T02:12:14.768780+0000","last_clean":"2023-07-09T02:12:14.768780+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:12:14.768780+0000","last_undegraded":"2023-07-09T02:12:14.768780+0000","last_fullsized":"2023-07-09T02:12:14.768780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:56:16.950095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767917+0000","last_change":"2023-07-09T02:12:13.768154+0000","last_active":"2023-07-09T02:12:14.767917+0000","last_peered":"2023-07-09T02:12:14.767917+0000","last_clean":"2023-07-09T02:12:14.767917+0000","last_became_active":"2023-07-09T02:12:13.767926+0000","last_became_peered":"2023-07-09T02:12:13.767926+0000","last_unstale":"2023-07-09T02:12:14.767917+0000","last_undegraded":"2023-07-09T02:12:14.767917+0000","last_fullsized":"2023-07-09T02:12:14.767917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:49:11.700076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768057+0000","last_change":"2023-07-09T02:12:12.762066+0000","last_active":"2023-07-09T02:12:14.768057+0000","last_peered":"2023-07-09T02:12:14.768057+0000","last_clean":"2023-07-09T02:12:14.768057+0000","last_became_active":"2023-07-09T02:12:12.761806+0000","last_became_peered":"2023-07-09T02:12:12.761806+0000","last_unstale":"2023-07-09T02:12:14.768057+0000","last_undegraded":"2023-07-09T02:12:14.768057+0000","last_fullsized":"2023-07-09T02:12:14.768057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:22:58.757961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767824+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:12:14.767824+0000","last_peered":"2023-07-09T02:12:14.767824+0000","last_clean":"2023-07-09T02:12:14.767824+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:12:14.767824+0000","last_undegraded":"2023-07-09T02:12:14.767824+0000","last_fullsized":"2023-07-09T02:12:14.767824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:39:09.053965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755039+0000","last_change":"2023-07-09T02:12:13.767178+0000","last_active":"2023-07-09T02:12:14.755039+0000","last_peered":"2023-07-09T02:12:14.755039+0000","last_clean":"2023-07-09T02:12:14.755039+0000","last_became_active":"2023-07-09T02:12:13.766957+0000","last_became_peered":"2023-07-09T02:12:13.766957+0000","last_unstale":"2023-07-09T02:12:14.755039+0000","last_undegraded":"2023-07-09T02:12:14.755039+0000","last_fullsized":"2023-07-09T02:12:14.755039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:33:18.971043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755393+0000","last_change":"2023-07-09T02:12:12.755744+0000","last_active":"2023-07-09T02:12:14.755393+0000","last_peered":"2023-07-09T02:12:14.755393+0000","last_clean":"2023-07-09T02:12:14.755393+0000","last_became_active":"2023-07-09T02:12:12.755530+0000","last_became_peered":"2023-07-09T02:12:12.755530+0000","last_unstale":"2023-07-09T02:12:14.755393+0000","last_undegraded":"2023-07-09T02:12:14.755393+0000","last_fullsized":"2023-07-09T02:12:14.755393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:49:07.012871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768054+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:12:14.768054+0000","last_peered":"2023-07-09T02:12:14.768054+0000","last_clean":"2023-07-09T02:12:14.768054+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:12:14.768054+0000","last_undegraded":"2023-07-09T02:12:14.768054+0000","last_fullsized":"2023-07-09T02:12:14.768054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:04:27.442067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768709+0000","last_change":"2023-07-09T02:12:13.763639+0000","last_active":"2023-07-09T02:12:14.768709+0000","last_peered":"2023-07-09T02:12:14.768709+0000","last_clean":"2023-07-09T02:12:14.768709+0000","last_became_active":"2023-07-09T02:12:13.763402+0000","last_became_peered":"2023-07-09T02:12:13.763402+0000","last_unstale":"2023-07-09T02:12:14.768709+0000","last_undegraded":"2023-07-09T02:12:14.768709+0000","last_fullsized":"2023-07-09T02:12:14.768709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:36:31.553741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767669+0000","last_change":"2023-07-09T02:12:12.757901+0000","last_active":"2023-07-09T02:12:14.767669+0000","last_peered":"2023-07-09T02:12:14.767669+0000","last_clean":"2023-07-09T02:12:14.767669+0000","last_became_active":"2023-07-09T02:12:12.757628+0000","last_became_peered":"2023-07-09T02:12:12.757628+0000","last_unstale":"2023-07-09T02:12:14.767669+0000","last_undegraded":"2023-07-09T02:12:14.767669+0000","last_fullsized":"2023-07-09T02:12:14.767669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:12:40.591812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768139+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:12:14.768139+0000","last_peered":"2023-07-09T02:12:14.768139+0000","last_clean":"2023-07-09T02:12:14.768139+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:12:14.768139+0000","last_undegraded":"2023-07-09T02:12:14.768139+0000","last_fullsized":"2023-07-09T02:12:14.768139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:19:38.439868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194576,"statfs":{"total":200000000,"available":199246639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.86699999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.0369999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.075}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.88900000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.745},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.96399999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":1.087},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.0569999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838059,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.94399999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.76600000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.79800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":157,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.65900000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.62}]},{"osd":3,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68400000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838037,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.70099999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.71599999999999997}]},{"osd":5,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.504},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":159,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195153,"statfs":{"total":200000000,"available":199837043,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":1.1200000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":1},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.88}]},{"osd":6,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.5569999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.165}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":151,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195161,"statfs":{"total":200000000,"available":199845224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58899999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65400000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.79000000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.80700000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.874},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.91700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":151,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195161,"statfs":{"total":200000000,"available":199845204,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.435}]},{"osd":2,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.377}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.36099999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194578,"statfs":{"total":200000000,"available":199248239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.371},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.443}]},{"osd":4,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.82999999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.77500000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.69499999999999995}]}]}],"pool_statfs":[]}} 2023-07-09T02:12:17.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:12:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.060+0000 7f549285c640 1 Processor -- start 2023-07-09T02:12:18.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.060+0000 7f549285c640 1 -- start start 2023-07-09T02:12:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f549285c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c15c060 0x7f548c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f549285c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f548c0cd120 0x7f548c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f549285c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c160a50 con 0x7f548c0d2450 2023-07-09T02:12:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f549285c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c0d28f0 con 0x7f548c0cd120 2023-07-09T02:12:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f549285c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0cfe40 con 0x7f548c15c060 2023-07-09T02:12:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f548b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f548c0cd120 0x7f548c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f5490df9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f548c0d2450 0x7f548c0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47188/0 (socket says 172.21.15.45:47188) 2023-07-09T02:12:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f5490df9640 1 -- 172.21.15.45:0/264759165 learned_addr learned my addr 172.21.15.45:0/264759165 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f548bfff640 1 --2- 172.21.15.45:0/264759165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c15c060 0x7f548c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f548b7fe640 1 -- 172.21.15.45:0/264759165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c15c060 msgr2=0x7f548c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f548b7fe640 1 --2- 172.21.15.45:0/264759165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c15c060 0x7f548c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f548b7fe640 1 -- 172.21.15.45:0/264759165 >> v1:172.21.15.45:6789/0 conn(0x7f548c0d2450 legacy=0x7f548c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.064+0000 7f548b7fe640 1 -- 172.21.15.45:0/264759165 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c15c430 con 0x7f548c0cd120 2023-07-09T02:12:18.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f548b7fe640 1 --2- 172.21.15.45:0/264759165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c0d1f10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f54800097c0 tx=0x7f548001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9434cb5cdb55c373 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f548affd640 1 -- 172.21.15.45:0/264759165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800ab600 con 0x7f548c0cd120 2023-07-09T02:12:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f548affd640 1 -- 172.21.15.45:0/264759165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54800a7050 con 0x7f548c0cd120 2023-07-09T02:12:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f548affd640 1 -- 172.21.15.45:0/264759165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800ab980 con 0x7f548c0cd120 2023-07-09T02:12:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- 172.21.15.45:0/264759165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 msgr2=0x7f548c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 --2- 172.21.15.45:0/264759165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c0d1f10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f54800097c0 tx=0x7f548001c450 comp rx=0 tx=0).stop 2023-07-09T02:12:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- 172.21.15.45:0/264759165 shutdown_connections 2023-07-09T02:12:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 --2- 172.21.15.45:0/264759165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c0d1f10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 --2- 172.21.15.45:0/264759165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c15c060 0x7f548c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- 172.21.15.45:0/264759165 >> 172.21.15.45:0/264759165 conn(0x7f548c0698e0 msgr2=0x7f548c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:18.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- 172.21.15.45:0/264759165 shutdown_connections 2023-07-09T02:12:18.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- 172.21.15.45:0/264759165 wait complete. 2023-07-09T02:12:18.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 Processor -- start 2023-07-09T02:12:18.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- start start 2023-07-09T02:12:18.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c0d2450 0x7f548c15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f548c15c060 0x7f548c0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c153940 con 0x7f548c0cd120 2023-07-09T02:12:18.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c154940 con 0x7f548c15c060 2023-07-09T02:12:18.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.068+0000 7f549285c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c154c20 con 0x7f548c0d2450 2023-07-09T02:12:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59358/0 (socket says 172.21.15.45:59358) 2023-07-09T02:12:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 -- 172.21.15.45:0/898308835 learned_addr learned my addr 172.21.15.45:0/898308835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 -- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c0d2450 msgr2=0x7f548c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c0d2450 0x7f548c15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 -- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f548c15c060 msgr2=0x7f548c0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f548c15c060 0x7f548c0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 -- 172.21.15.45:0/898308835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480009420 con 0x7f548c0cd120 2023-07-09T02:12:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f548bfff640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c153400 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f547c00d5f0 tx=0x7f547c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f5488ff9640 1 -- 172.21.15.45:0/898308835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0125f0 con 0x7f548c0cd120 2023-07-09T02:12:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f5488ff9640 1 -- 172.21.15.45:0/898308835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c012750 con 0x7f548c0cd120 2023-07-09T02:12:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f5488ff9640 1 -- 172.21.15.45:0/898308835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c012ae0 con 0x7f548c0cd120 2023-07-09T02:12:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c154f00 con 0x7f548c0cd120 2023-07-09T02:12:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c1554c0 con 0x7f548c0cd120 2023-07-09T02:12:18.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c155680 con 0x7f548c0cd120 2023-07-09T02:12:18.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.072+0000 7f5488ff9640 1 -- 172.21.15.45:0/898308835 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f547c012c40 con 0x7f548c0cd120 2023-07-09T02:12:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.076+0000 7f5488ff9640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5478066280 0x7f5478068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.076+0000 7f5488ff9640 1 -- 172.21.15.45:0/898308835 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f547c084260 con 0x7f548c0cd120 2023-07-09T02:12:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.076+0000 7f548b7fe640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5478066280 0x7f5478068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.076+0000 7f548b7fe640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5478066280 0x7f5478068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f54800ad000 tx=0x7f5480008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.076+0000 7f5488ff9640 1 -- 172.21.15.45:0/898308835 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f547c0516d0 con 0x7f548c0cd120 2023-07-09T02:12:18.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.232+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f548c160400 con 0x7f5478066280 2023-07-09T02:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f5488ff9640 1 -- 172.21.15.45:0/898308835 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305679 (secure 0 0 0) 0x7f54800ab660 con 0x7f5478066280 2023-07-09T02:12:18.246 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:12:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5478066280 msgr2=0x7f5478068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5478066280 0x7f5478068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f54800ad000 tx=0x7f5480008040 comp rx=0 tx=0).stop 2023-07-09T02:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 msgr2=0x7f548c153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c153400 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f547c00d5f0 tx=0x7f547c00dab0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 shutdown_connections 2023-07-09T02:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f548c15c060 0x7f548c0b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5478066280 0x7f5478068730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f548c0d2450 0x7f548c15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 --2- 172.21.15.45:0/898308835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f548c0cd120 0x7f548c153400 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 >> 172.21.15.45:0/898308835 conn(0x7f548c0698e0 msgr2=0x7f548c0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 shutdown_connections 2023-07-09T02:12:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.244+0000 7f549285c640 1 -- 172.21.15.45:0/898308835 wait complete. 2023-07-09T02:12:18.268 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-07-09T02:12:16.539725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2405,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560094,"statfs":{"total":1600000000,"available":1597536974,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.800402"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767695+0000","last_change":"2023-07-09T02:12:13.765142+0000","last_active":"2023-07-09T02:12:14.767695+0000","last_peered":"2023-07-09T02:12:14.767695+0000","last_clean":"2023-07-09T02:12:14.767695+0000","last_became_active":"2023-07-09T02:12:13.764925+0000","last_became_peered":"2023-07-09T02:12:13.764925+0000","last_unstale":"2023-07-09T02:12:14.767695+0000","last_undegraded":"2023-07-09T02:12:14.767695+0000","last_fullsized":"2023-07-09T02:12:14.767695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:11.562783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767860+0000","last_change":"2023-07-09T02:12:13.767785+0000","last_active":"2023-07-09T02:12:14.767860+0000","last_peered":"2023-07-09T02:12:14.767860+0000","last_clean":"2023-07-09T02:12:14.767860+0000","last_became_active":"2023-07-09T02:12:13.766700+0000","last_became_peered":"2023-07-09T02:12:13.766700+0000","last_unstale":"2023-07-09T02:12:14.767860+0000","last_undegraded":"2023-07-09T02:12:14.767860+0000","last_fullsized":"2023-07-09T02:12:14.767860+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:05:29.077399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756750+0000","last_change":"2023-07-09T02:12:13.769999+0000","last_active":"2023-07-09T02:12:14.756750+0000","last_peered":"2023-07-09T02:12:14.756750+0000","last_clean":"2023-07-09T02:12:14.756750+0000","last_became_active":"2023-07-09T02:12:13.769657+0000","last_became_peered":"2023-07-09T02:12:13.769657+0000","last_unstale":"2023-07-09T02:12:14.756750+0000","last_undegraded":"2023-07-09T02:12:14.756750+0000","last_fullsized":"2023-07-09T02:12:14.756750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:42:28.671465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178683+0000","last_change":"2023-07-09T02:12:13.760787+0000","last_active":"2023-07-09T02:12:15.178683+0000","last_peered":"2023-07-09T02:12:15.178683+0000","last_clean":"2023-07-09T02:12:15.178683+0000","last_became_active":"2023-07-09T02:12:13.760407+0000","last_became_peered":"2023-07-09T02:12:13.760407+0000","last_unstale":"2023-07-09T02:12:15.178683+0000","last_undegraded":"2023-07-09T02:12:15.178683+0000","last_fullsized":"2023-07-09T02:12:15.178683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:15:45.505964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179087+0000","last_change":"2023-07-09T02:12:13.762010+0000","last_active":"2023-07-09T02:12:15.179087+0000","last_peered":"2023-07-09T02:12:15.179087+0000","last_clean":"2023-07-09T02:12:15.179087+0000","last_became_active":"2023-07-09T02:12:13.761747+0000","last_became_peered":"2023-07-09T02:12:13.761747+0000","last_unstale":"2023-07-09T02:12:15.179087+0000","last_undegraded":"2023-07-09T02:12:15.179087+0000","last_fullsized":"2023-07-09T02:12:15.179087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:52:28.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768279+0000","last_change":"2023-07-09T02:12:13.770547+0000","last_active":"2023-07-09T02:12:14.768279+0000","last_peered":"2023-07-09T02:12:14.768279+0000","last_clean":"2023-07-09T02:12:14.768279+0000","last_became_active":"2023-07-09T02:12:13.770321+0000","last_became_peered":"2023-07-09T02:12:13.770321+0000","last_unstale":"2023-07-09T02:12:14.768279+0000","last_undegraded":"2023-07-09T02:12:14.768279+0000","last_fullsized":"2023-07-09T02:12:14.768279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:36.396620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756410+0000","last_change":"2023-07-09T02:12:13.771138+0000","last_active":"2023-07-09T02:12:14.756410+0000","last_peered":"2023-07-09T02:12:14.756410+0000","last_clean":"2023-07-09T02:12:14.756410+0000","last_became_active":"2023-07-09T02:12:13.770753+0000","last_became_peered":"2023-07-09T02:12:13.770753+0000","last_unstale":"2023-07-09T02:12:14.756410+0000","last_undegraded":"2023-07-09T02:12:14.756410+0000","last_fullsized":"2023-07-09T02:12:14.756410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:49:08.021243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767508+0000","last_change":"2023-07-09T02:12:13.772744+0000","last_active":"2023-07-09T02:12:14.767508+0000","last_peered":"2023-07-09T02:12:14.767508+0000","last_clean":"2023-07-09T02:12:14.767508+0000","last_became_active":"2023-07-09T02:12:13.772415+0000","last_became_peered":"2023-07-09T02:12:13.772415+0000","last_unstale":"2023-07-09T02:12:14.767508+0000","last_undegraded":"2023-07-09T02:12:14.767508+0000","last_fullsized":"2023-07-09T02:12:14.767508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:32:25.411969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756753+0000","last_change":"2023-07-09T02:12:13.769760+0000","last_active":"2023-07-09T02:12:14.756753+0000","last_peered":"2023-07-09T02:12:14.756753+0000","last_clean":"2023-07-09T02:12:14.756753+0000","last_became_active":"2023-07-09T02:12:13.769527+0000","last_became_peered":"2023-07-09T02:12:13.769527+0000","last_unstale":"2023-07-09T02:12:14.756753+0000","last_undegraded":"2023-07-09T02:12:14.756753+0000","last_fullsized":"2023-07-09T02:12:14.756753+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:55.208492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756934+0000","last_change":"2023-07-09T02:12:13.768657+0000","last_active":"2023-07-09T02:12:14.756934+0000","last_peered":"2023-07-09T02:12:14.756934+0000","last_clean":"2023-07-09T02:12:14.756934+0000","last_became_active":"2023-07-09T02:12:13.768079+0000","last_became_peered":"2023-07-09T02:12:13.768079+0000","last_unstale":"2023-07-09T02:12:14.756934+0000","last_undegraded":"2023-07-09T02:12:14.756934+0000","last_fullsized":"2023-07-09T02:12:14.756934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:25:09.019551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756772+0000","last_change":"2023-07-09T02:12:13.770873+0000","last_active":"2023-07-09T02:12:14.756772+0000","last_peered":"2023-07-09T02:12:14.756772+0000","last_clean":"2023-07-09T02:12:14.756772+0000","last_became_active":"2023-07-09T02:12:13.770218+0000","last_became_peered":"2023-07-09T02:12:13.770218+0000","last_unstale":"2023-07-09T02:12:14.756772+0000","last_undegraded":"2023-07-09T02:12:14.756772+0000","last_fullsized":"2023-07-09T02:12:14.756772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:10:56.669830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756897+0000","last_change":"2023-07-09T02:12:13.764360+0000","last_active":"2023-07-09T02:12:14.756897+0000","last_peered":"2023-07-09T02:12:14.756897+0000","last_clean":"2023-07-09T02:12:14.756897+0000","last_became_active":"2023-07-09T02:12:13.763620+0000","last_became_peered":"2023-07-09T02:12:13.763620+0000","last_unstale":"2023-07-09T02:12:14.756897+0000","last_undegraded":"2023-07-09T02:12:14.756897+0000","last_fullsized":"2023-07-09T02:12:14.756897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:06.955088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756707+0000","last_change":"2023-07-09T02:12:13.773952+0000","last_active":"2023-07-09T02:12:14.756707+0000","last_peered":"2023-07-09T02:12:14.756707+0000","last_clean":"2023-07-09T02:12:14.756707+0000","last_became_active":"2023-07-09T02:12:13.769974+0000","last_became_peered":"2023-07-09T02:12:13.769974+0000","last_unstale":"2023-07-09T02:12:14.756707+0000","last_undegraded":"2023-07-09T02:12:14.756707+0000","last_fullsized":"2023-07-09T02:12:14.756707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:21:50.490939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.754956+0000","last_change":"2023-07-09T02:12:13.765958+0000","last_active":"2023-07-09T02:12:14.754956+0000","last_peered":"2023-07-09T02:12:14.754956+0000","last_clean":"2023-07-09T02:12:14.754956+0000","last_became_active":"2023-07-09T02:12:13.765440+0000","last_became_peered":"2023-07-09T02:12:13.765440+0000","last_unstale":"2023-07-09T02:12:14.754956+0000","last_undegraded":"2023-07-09T02:12:14.754956+0000","last_fullsized":"2023-07-09T02:12:14.754956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:37:51.314786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757120+0000","last_change":"2023-07-09T02:12:13.768441+0000","last_active":"2023-07-09T02:12:14.757120+0000","last_peered":"2023-07-09T02:12:14.757120+0000","last_clean":"2023-07-09T02:12:14.757120+0000","last_became_active":"2023-07-09T02:12:13.767771+0000","last_became_peered":"2023-07-09T02:12:13.767771+0000","last_unstale":"2023-07-09T02:12:14.757120+0000","last_undegraded":"2023-07-09T02:12:14.757120+0000","last_fullsized":"2023-07-09T02:12:14.757120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:23:56.300340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768338+0000","last_change":"2023-07-09T02:12:13.772748+0000","last_active":"2023-07-09T02:12:14.768338+0000","last_peered":"2023-07-09T02:12:14.768338+0000","last_clean":"2023-07-09T02:12:14.768338+0000","last_became_active":"2023-07-09T02:12:13.772284+0000","last_became_peered":"2023-07-09T02:12:13.772284+0000","last_unstale":"2023-07-09T02:12:14.768338+0000","last_undegraded":"2023-07-09T02:12:14.768338+0000","last_fullsized":"2023-07-09T02:12:14.768338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:50:28.281570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767890+0000","last_change":"2023-07-09T02:12:13.767767+0000","last_active":"2023-07-09T02:12:14.767890+0000","last_peered":"2023-07-09T02:12:14.767890+0000","last_clean":"2023-07-09T02:12:14.767890+0000","last_became_active":"2023-07-09T02:12:13.767552+0000","last_became_peered":"2023-07-09T02:12:13.767552+0000","last_unstale":"2023-07-09T02:12:14.767890+0000","last_undegraded":"2023-07-09T02:12:14.767890+0000","last_fullsized":"2023-07-09T02:12:14.767890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:26.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767795+0000","last_change":"2023-07-09T02:12:13.765767+0000","last_active":"2023-07-09T02:12:14.767795+0000","last_peered":"2023-07-09T02:12:14.767795+0000","last_clean":"2023-07-09T02:12:14.767795+0000","last_became_active":"2023-07-09T02:12:13.765352+0000","last_became_peered":"2023-07-09T02:12:13.765352+0000","last_unstale":"2023-07-09T02:12:14.767795+0000","last_undegraded":"2023-07-09T02:12:14.767795+0000","last_fullsized":"2023-07-09T02:12:14.767795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:09:22.923286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178821+0000","last_change":"2023-07-09T02:12:13.761281+0000","last_active":"2023-07-09T02:12:15.178821+0000","last_peered":"2023-07-09T02:12:15.178821+0000","last_clean":"2023-07-09T02:12:15.178821+0000","last_became_active":"2023-07-09T02:12:13.761012+0000","last_became_peered":"2023-07-09T02:12:13.761012+0000","last_unstale":"2023-07-09T02:12:15.178821+0000","last_undegraded":"2023-07-09T02:12:15.178821+0000","last_fullsized":"2023-07-09T02:12:15.178821+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:09:22.923286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768335+0000","last_change":"2023-07-09T02:12:13.765473+0000","last_active":"2023-07-09T02:12:14.768335+0000","last_peered":"2023-07-09T02:12:14.768335+0000","last_clean":"2023-07-09T02:12:14.768335+0000","last_became_active":"2023-07-09T02:12:13.764004+0000","last_became_peered":"2023-07-09T02:12:13.764004+0000","last_unstale":"2023-07-09T02:12:14.768335+0000","last_undegraded":"2023-07-09T02:12:14.768335+0000","last_fullsized":"2023-07-09T02:12:14.768335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:05:00.216032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756987+0000","last_change":"2023-07-09T02:12:13.770669+0000","last_active":"2023-07-09T02:12:14.756987+0000","last_peered":"2023-07-09T02:12:14.756987+0000","last_clean":"2023-07-09T02:12:14.756987+0000","last_became_active":"2023-07-09T02:12:13.769928+0000","last_became_peered":"2023-07-09T02:12:13.769928+0000","last_unstale":"2023-07-09T02:12:14.756987+0000","last_undegraded":"2023-07-09T02:12:14.756987+0000","last_fullsized":"2023-07-09T02:12:14.756987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:38:38.195388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.754886+0000","last_change":"2023-07-09T02:12:13.760941+0000","last_active":"2023-07-09T02:12:14.754886+0000","last_peered":"2023-07-09T02:12:14.754886+0000","last_clean":"2023-07-09T02:12:14.754886+0000","last_became_active":"2023-07-09T02:12:13.760728+0000","last_became_peered":"2023-07-09T02:12:13.760728+0000","last_unstale":"2023-07-09T02:12:14.754886+0000","last_undegraded":"2023-07-09T02:12:14.754886+0000","last_fullsized":"2023-07-09T02:12:14.754886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:49.514023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768227+0000","last_change":"2023-07-09T02:12:13.757747+0000","last_active":"2023-07-09T02:12:14.768227+0000","last_peered":"2023-07-09T02:12:14.768227+0000","last_clean":"2023-07-09T02:12:14.768227+0000","last_became_active":"2023-07-09T02:12:13.757476+0000","last_became_peered":"2023-07-09T02:12:13.757476+0000","last_unstale":"2023-07-09T02:12:14.768227+0000","last_undegraded":"2023-07-09T02:12:14.768227+0000","last_fullsized":"2023-07-09T02:12:14.768227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:10:53.555026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178970+0000","last_change":"2023-07-09T02:12:13.756948+0000","last_active":"2023-07-09T02:12:15.178970+0000","last_peered":"2023-07-09T02:12:15.178970+0000","last_clean":"2023-07-09T02:12:15.178970+0000","last_became_active":"2023-07-09T02:12:13.756713+0000","last_became_peered":"2023-07-09T02:12:13.756713+0000","last_unstale":"2023-07-09T02:12:15.178970+0000","last_undegraded":"2023-07-09T02:12:15.178970+0000","last_fullsized":"2023-07-09T02:12:15.178970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:24:21.692189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768099+0000","last_change":"2023-07-09T02:12:13.763764+0000","last_active":"2023-07-09T02:12:14.768099+0000","last_peered":"2023-07-09T02:12:14.768099+0000","last_clean":"2023-07-09T02:12:14.768099+0000","last_became_active":"2023-07-09T02:12:13.763429+0000","last_became_peered":"2023-07-09T02:12:13.763429+0000","last_unstale":"2023-07-09T02:12:14.768099+0000","last_undegraded":"2023-07-09T02:12:14.768099+0000","last_fullsized":"2023-07-09T02:12:14.768099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:52:28.927032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768382+0000","last_change":"2023-07-09T02:12:13.772100+0000","last_active":"2023-07-09T02:12:14.768382+0000","last_peered":"2023-07-09T02:12:14.768382+0000","last_clean":"2023-07-09T02:12:14.768382+0000","last_became_active":"2023-07-09T02:12:13.771644+0000","last_became_peered":"2023-07-09T02:12:13.771644+0000","last_unstale":"2023-07-09T02:12:14.768382+0000","last_undegraded":"2023-07-09T02:12:14.768382+0000","last_fullsized":"2023-07-09T02:12:14.768382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:49.514023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767794+0000","last_change":"2023-07-09T02:12:13.762109+0000","last_active":"2023-07-09T02:12:14.767794+0000","last_peered":"2023-07-09T02:12:14.767794+0000","last_clean":"2023-07-09T02:12:14.767794+0000","last_became_active":"2023-07-09T02:12:13.761781+0000","last_became_peered":"2023-07-09T02:12:13.761781+0000","last_unstale":"2023-07-09T02:12:14.767794+0000","last_undegraded":"2023-07-09T02:12:14.767794+0000","last_fullsized":"2023-07-09T02:12:14.767794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:13:23.551914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756898+0000","last_change":"2023-07-09T02:12:13.774212+0000","last_active":"2023-07-09T02:12:14.756898+0000","last_peered":"2023-07-09T02:12:14.756898+0000","last_clean":"2023-07-09T02:12:14.756898+0000","last_became_active":"2023-07-09T02:12:13.771049+0000","last_became_peered":"2023-07-09T02:12:13.771049+0000","last_unstale":"2023-07-09T02:12:14.756898+0000","last_undegraded":"2023-07-09T02:12:14.756898+0000","last_fullsized":"2023-07-09T02:12:14.756898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:13:57.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767835+0000","last_change":"2023-07-09T02:12:13.766356+0000","last_active":"2023-07-09T02:12:14.767835+0000","last_peered":"2023-07-09T02:12:14.767835+0000","last_clean":"2023-07-09T02:12:14.767835+0000","last_became_active":"2023-07-09T02:12:13.764086+0000","last_became_peered":"2023-07-09T02:12:13.764086+0000","last_unstale":"2023-07-09T02:12:14.767835+0000","last_undegraded":"2023-07-09T02:12:14.767835+0000","last_fullsized":"2023-07-09T02:12:14.767835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:52:30.365029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768223+0000","last_change":"2023-07-09T02:12:13.766930+0000","last_active":"2023-07-09T02:12:14.768223+0000","last_peered":"2023-07-09T02:12:14.768223+0000","last_clean":"2023-07-09T02:12:14.768223+0000","last_became_active":"2023-07-09T02:12:13.766667+0000","last_became_peered":"2023-07-09T02:12:13.766667+0000","last_unstale":"2023-07-09T02:12:14.768223+0000","last_undegraded":"2023-07-09T02:12:14.768223+0000","last_fullsized":"2023-07-09T02:12:14.768223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:49:40.062889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768446+0000","last_change":"2023-07-09T02:12:13.756874+0000","last_active":"2023-07-09T02:12:14.768446+0000","last_peered":"2023-07-09T02:12:14.768446+0000","last_clean":"2023-07-09T02:12:14.768446+0000","last_became_active":"2023-07-09T02:12:13.756582+0000","last_became_peered":"2023-07-09T02:12:13.756582+0000","last_unstale":"2023-07-09T02:12:14.768446+0000","last_undegraded":"2023-07-09T02:12:14.768446+0000","last_fullsized":"2023-07-09T02:12:14.768446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:13:57.831910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768243+0000","last_change":"2023-07-09T02:12:13.767665+0000","last_active":"2023-07-09T02:12:14.768243+0000","last_peered":"2023-07-09T02:12:14.768243+0000","last_clean":"2023-07-09T02:12:14.768243+0000","last_became_active":"2023-07-09T02:12:13.767404+0000","last_became_peered":"2023-07-09T02:12:13.767404+0000","last_unstale":"2023-07-09T02:12:14.768243+0000","last_undegraded":"2023-07-09T02:12:14.768243+0000","last_fullsized":"2023-07-09T02:12:14.768243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:55:03.157131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768512+0000","last_change":"2023-07-09T02:12:13.772520+0000","last_active":"2023-07-09T02:12:14.768512+0000","last_peered":"2023-07-09T02:12:14.768512+0000","last_clean":"2023-07-09T02:12:14.768512+0000","last_became_active":"2023-07-09T02:12:13.771866+0000","last_became_peered":"2023-07-09T02:12:13.771866+0000","last_unstale":"2023-07-09T02:12:14.768512+0000","last_undegraded":"2023-07-09T02:12:14.768512+0000","last_fullsized":"2023-07-09T02:12:14.768512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:25:09.019551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767943+0000","last_change":"2023-07-09T02:12:12.764858+0000","last_active":"2023-07-09T02:12:14.767943+0000","last_peered":"2023-07-09T02:12:14.767943+0000","last_clean":"2023-07-09T02:12:14.767943+0000","last_became_active":"2023-07-09T02:12:12.764617+0000","last_became_peered":"2023-07-09T02:12:12.764617+0000","last_unstale":"2023-07-09T02:12:14.767943+0000","last_undegraded":"2023-07-09T02:12:14.767943+0000","last_fullsized":"2023-07-09T02:12:14.767943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:24:20.683817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768498+0000","last_change":"2023-07-09T02:12:13.770864+0000","last_active":"2023-07-09T02:12:14.768498+0000","last_peered":"2023-07-09T02:12:14.768498+0000","last_clean":"2023-07-09T02:12:14.768498+0000","last_became_active":"2023-07-09T02:12:13.770507+0000","last_became_peered":"2023-07-09T02:12:13.770507+0000","last_unstale":"2023-07-09T02:12:14.768498+0000","last_undegraded":"2023-07-09T02:12:14.768498+0000","last_fullsized":"2023-07-09T02:12:14.768498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:33:18.971043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757195+0000","last_change":"2023-07-09T02:12:12.762398+0000","last_active":"2023-07-09T02:12:14.757195+0000","last_peered":"2023-07-09T02:12:14.757195+0000","last_clean":"2023-07-09T02:12:14.757195+0000","last_became_active":"2023-07-09T02:12:12.762153+0000","last_became_peered":"2023-07-09T02:12:12.762153+0000","last_unstale":"2023-07-09T02:12:14.757195+0000","last_undegraded":"2023-07-09T02:12:14.757195+0000","last_fullsized":"2023-07-09T02:12:14.757195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:00:56.340096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755157+0000","last_change":"2023-07-09T02:12:13.765651+0000","last_active":"2023-07-09T02:12:14.755157+0000","last_peered":"2023-07-09T02:12:14.755157+0000","last_clean":"2023-07-09T02:12:14.755157+0000","last_became_active":"2023-07-09T02:12:13.765145+0000","last_became_peered":"2023-07-09T02:12:13.765145+0000","last_unstale":"2023-07-09T02:12:14.755157+0000","last_undegraded":"2023-07-09T02:12:14.755157+0000","last_fullsized":"2023-07-09T02:12:14.755157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:26.958651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768713+0000","last_change":"2023-07-09T02:12:12.761662+0000","last_active":"2023-07-09T02:12:14.768713+0000","last_peered":"2023-07-09T02:12:14.768713+0000","last_clean":"2023-07-09T02:12:14.768713+0000","last_became_active":"2023-07-09T02:12:12.761324+0000","last_became_peered":"2023-07-09T02:12:12.761324+0000","last_unstale":"2023-07-09T02:12:14.768713+0000","last_undegraded":"2023-07-09T02:12:14.768713+0000","last_fullsized":"2023-07-09T02:12:14.768713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:15:25.950279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767634+0000","last_change":"2023-07-09T02:12:13.765900+0000","last_active":"2023-07-09T02:12:14.767634+0000","last_peered":"2023-07-09T02:12:14.767634+0000","last_clean":"2023-07-09T02:12:14.767634+0000","last_became_active":"2023-07-09T02:12:13.765240+0000","last_became_peered":"2023-07-09T02:12:13.765240+0000","last_unstale":"2023-07-09T02:12:14.767634+0000","last_undegraded":"2023-07-09T02:12:14.767634+0000","last_fullsized":"2023-07-09T02:12:14.767634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:11:44.376004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755142+0000","last_change":"2023-07-09T02:12:12.754206+0000","last_active":"2023-07-09T02:12:14.755142+0000","last_peered":"2023-07-09T02:12:14.755142+0000","last_clean":"2023-07-09T02:12:14.755142+0000","last_became_active":"2023-07-09T02:12:12.753989+0000","last_became_peered":"2023-07-09T02:12:12.753989+0000","last_unstale":"2023-07-09T02:12:14.755142+0000","last_undegraded":"2023-07-09T02:12:14.755142+0000","last_fullsized":"2023-07-09T02:12:14.755142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:40:09.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756926+0000","last_change":"2023-07-09T02:12:13.762604+0000","last_active":"2023-07-09T02:12:14.756926+0000","last_peered":"2023-07-09T02:12:14.756926+0000","last_clean":"2023-07-09T02:12:14.756926+0000","last_became_active":"2023-07-09T02:12:13.762384+0000","last_became_peered":"2023-07-09T02:12:13.762384+0000","last_unstale":"2023-07-09T02:12:14.756926+0000","last_undegraded":"2023-07-09T02:12:14.756926+0000","last_fullsized":"2023-07-09T02:12:14.756926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:26:25.088518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756786+0000","last_change":"2023-07-09T02:12:12.758044+0000","last_active":"2023-07-09T02:12:14.756786+0000","last_peered":"2023-07-09T02:12:14.756786+0000","last_clean":"2023-07-09T02:12:14.756786+0000","last_became_active":"2023-07-09T02:12:12.757673+0000","last_became_peered":"2023-07-09T02:12:12.757673+0000","last_unstale":"2023-07-09T02:12:14.756786+0000","last_undegraded":"2023-07-09T02:12:14.756786+0000","last_fullsized":"2023-07-09T02:12:14.756786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:50:27.273198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756279+0000","last_change":"2023-07-09T02:12:13.769345+0000","last_active":"2023-07-09T02:12:14.756279+0000","last_peered":"2023-07-09T02:12:14.756279+0000","last_clean":"2023-07-09T02:12:14.756279+0000","last_became_active":"2023-07-09T02:12:13.768768+0000","last_became_peered":"2023-07-09T02:12:13.768768+0000","last_unstale":"2023-07-09T02:12:14.756279+0000","last_undegraded":"2023-07-09T02:12:14.756279+0000","last_fullsized":"2023-07-09T02:12:14.756279+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:40:37.622379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768077+0000","last_change":"2023-07-09T02:12:12.765547+0000","last_active":"2023-07-09T02:12:14.768077+0000","last_peered":"2023-07-09T02:12:14.768077+0000","last_clean":"2023-07-09T02:12:14.768077+0000","last_became_active":"2023-07-09T02:12:12.764975+0000","last_became_peered":"2023-07-09T02:12:12.764975+0000","last_unstale":"2023-07-09T02:12:14.768077+0000","last_undegraded":"2023-07-09T02:12:14.768077+0000","last_fullsized":"2023-07-09T02:12:14.768077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:49:07.012871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755256+0000","last_change":"2023-07-09T02:12:13.770659+0000","last_active":"2023-07-09T02:12:14.755256+0000","last_peered":"2023-07-09T02:12:14.755256+0000","last_clean":"2023-07-09T02:12:14.755256+0000","last_became_active":"2023-07-09T02:12:13.770443+0000","last_became_peered":"2023-07-09T02:12:13.770443+0000","last_unstale":"2023-07-09T02:12:14.755256+0000","last_undegraded":"2023-07-09T02:12:14.755256+0000","last_fullsized":"2023-07-09T02:12:14.755256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:40:37.622379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768165+0000","last_change":"2023-07-09T02:12:12.757723+0000","last_active":"2023-07-09T02:12:14.768165+0000","last_peered":"2023-07-09T02:12:14.768165+0000","last_clean":"2023-07-09T02:12:14.768165+0000","last_became_active":"2023-07-09T02:12:12.757133+0000","last_became_peered":"2023-07-09T02:12:12.757133+0000","last_unstale":"2023-07-09T02:12:14.768165+0000","last_undegraded":"2023-07-09T02:12:14.768165+0000","last_fullsized":"2023-07-09T02:12:14.768165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:01.432463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767987+0000","last_change":"2023-07-09T02:12:13.768159+0000","last_active":"2023-07-09T02:12:14.767987+0000","last_peered":"2023-07-09T02:12:14.767987+0000","last_clean":"2023-07-09T02:12:14.767987+0000","last_became_active":"2023-07-09T02:12:13.767272+0000","last_became_peered":"2023-07-09T02:12:13.767272+0000","last_unstale":"2023-07-09T02:12:14.767987+0000","last_undegraded":"2023-07-09T02:12:14.767987+0000","last_fullsized":"2023-07-09T02:12:14.767987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:36.396620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755236+0000","last_change":"2023-07-09T02:12:12.763857+0000","last_active":"2023-07-09T02:12:14.755236+0000","last_peered":"2023-07-09T02:12:14.755236+0000","last_clean":"2023-07-09T02:12:14.755236+0000","last_became_active":"2023-07-09T02:12:12.763595+0000","last_became_peered":"2023-07-09T02:12:12.763595+0000","last_unstale":"2023-07-09T02:12:14.755236+0000","last_undegraded":"2023-07-09T02:12:14.755236+0000","last_fullsized":"2023-07-09T02:12:14.755236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:17.577055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179111+0000","last_change":"2023-07-09T02:12:13.760647+0000","last_active":"2023-07-09T02:12:15.179111+0000","last_peered":"2023-07-09T02:12:15.179111+0000","last_clean":"2023-07-09T02:12:15.179111+0000","last_became_active":"2023-07-09T02:12:13.760073+0000","last_became_peered":"2023-07-09T02:12:13.760073+0000","last_unstale":"2023-07-09T02:12:15.179111+0000","last_undegraded":"2023-07-09T02:12:15.179111+0000","last_fullsized":"2023-07-09T02:12:15.179111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:40.075201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768196+0000","last_change":"2023-07-09T02:12:12.758147+0000","last_active":"2023-07-09T02:12:14.768196+0000","last_peered":"2023-07-09T02:12:14.768196+0000","last_clean":"2023-07-09T02:12:14.768196+0000","last_became_active":"2023-07-09T02:12:12.757028+0000","last_became_peered":"2023-07-09T02:12:12.757028+0000","last_unstale":"2023-07-09T02:12:14.768196+0000","last_undegraded":"2023-07-09T02:12:14.768196+0000","last_fullsized":"2023-07-09T02:12:14.768196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:22.181528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767939+0000","last_change":"2023-07-09T02:12:13.763037+0000","last_active":"2023-07-09T02:12:14.767939+0000","last_peered":"2023-07-09T02:12:14.767939+0000","last_clean":"2023-07-09T02:12:14.767939+0000","last_became_active":"2023-07-09T02:12:13.762816+0000","last_became_peered":"2023-07-09T02:12:13.762816+0000","last_unstale":"2023-07-09T02:12:14.767939+0000","last_undegraded":"2023-07-09T02:12:14.767939+0000","last_fullsized":"2023-07-09T02:12:14.767939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:18.585427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756941+0000","last_change":"2023-07-09T02:12:12.757905+0000","last_active":"2023-07-09T02:12:14.756941+0000","last_peered":"2023-07-09T02:12:14.756941+0000","last_clean":"2023-07-09T02:12:14.756941+0000","last_became_active":"2023-07-09T02:12:12.757182+0000","last_became_peered":"2023-07-09T02:12:12.757182+0000","last_unstale":"2023-07-09T02:12:14.756941+0000","last_undegraded":"2023-07-09T02:12:14.756941+0000","last_fullsized":"2023-07-09T02:12:14.756941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:35:10.682297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757027+0000","last_change":"2023-07-09T02:12:13.764233+0000","last_active":"2023-07-09T02:12:14.757027+0000","last_peered":"2023-07-09T02:12:14.757027+0000","last_clean":"2023-07-09T02:12:14.757027+0000","last_became_active":"2023-07-09T02:12:13.763335+0000","last_became_peered":"2023-07-09T02:12:13.763335+0000","last_unstale":"2023-07-09T02:12:14.757027+0000","last_undegraded":"2023-07-09T02:12:14.757027+0000","last_fullsized":"2023-07-09T02:12:14.757027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:36:53.102274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757114+0000","last_change":"2023-07-09T02:12:12.753960+0000","last_active":"2023-07-09T02:12:14.757114+0000","last_peered":"2023-07-09T02:12:14.757114+0000","last_clean":"2023-07-09T02:12:14.757114+0000","last_became_active":"2023-07-09T02:12:12.753684+0000","last_became_peered":"2023-07-09T02:12:12.753684+0000","last_unstale":"2023-07-09T02:12:14.757114+0000","last_undegraded":"2023-07-09T02:12:14.757114+0000","last_fullsized":"2023-07-09T02:12:14.757114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:36:30.545369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.754815+0000","last_change":"2023-07-09T02:12:13.766617+0000","last_active":"2023-07-09T02:12:14.754815+0000","last_peered":"2023-07-09T02:12:14.754815+0000","last_clean":"2023-07-09T02:12:14.754815+0000","last_became_active":"2023-07-09T02:12:13.765912+0000","last_became_peered":"2023-07-09T02:12:13.765912+0000","last_unstale":"2023-07-09T02:12:14.754815+0000","last_undegraded":"2023-07-09T02:12:14.754815+0000","last_fullsized":"2023-07-09T02:12:14.754815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:36.396620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767553+0000","last_change":"2023-07-09T02:12:12.762343+0000","last_active":"2023-07-09T02:12:14.767553+0000","last_peered":"2023-07-09T02:12:14.767553+0000","last_clean":"2023-07-09T02:12:14.767553+0000","last_became_active":"2023-07-09T02:12:12.762133+0000","last_became_peered":"2023-07-09T02:12:12.762133+0000","last_unstale":"2023-07-09T02:12:14.767553+0000","last_undegraded":"2023-07-09T02:12:14.767553+0000","last_fullsized":"2023-07-09T02:12:14.767553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:35:43.218007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756882+0000","last_change":"2023-07-09T02:12:13.769867+0000","last_active":"2023-07-09T02:12:14.756882+0000","last_peered":"2023-07-09T02:12:14.756882+0000","last_clean":"2023-07-09T02:12:14.756882+0000","last_became_active":"2023-07-09T02:12:13.769344+0000","last_became_peered":"2023-07-09T02:12:13.769344+0000","last_unstale":"2023-07-09T02:12:14.756882+0000","last_undegraded":"2023-07-09T02:12:14.756882+0000","last_fullsized":"2023-07-09T02:12:14.756882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:12:15.853601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768070+0000","last_change":"2023-07-09T02:12:12.757643+0000","last_active":"2023-07-09T02:12:14.768070+0000","last_peered":"2023-07-09T02:12:14.768070+0000","last_clean":"2023-07-09T02:12:14.768070+0000","last_became_active":"2023-07-09T02:12:12.757440+0000","last_became_peered":"2023-07-09T02:12:12.757440+0000","last_unstale":"2023-07-09T02:12:14.768070+0000","last_undegraded":"2023-07-09T02:12:14.768070+0000","last_fullsized":"2023-07-09T02:12:14.768070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:48.505651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768107+0000","last_change":"2023-07-09T02:12:13.768353+0000","last_active":"2023-07-09T02:12:14.768107+0000","last_peered":"2023-07-09T02:12:14.768107+0000","last_clean":"2023-07-09T02:12:14.768107+0000","last_became_active":"2023-07-09T02:12:13.767563+0000","last_became_peered":"2023-07-09T02:12:13.767563+0000","last_unstale":"2023-07-09T02:12:14.768107+0000","last_undegraded":"2023-07-09T02:12:14.768107+0000","last_fullsized":"2023-07-09T02:12:14.768107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:37:51.314786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768468+0000","last_change":"2023-07-09T02:12:12.756208+0000","last_active":"2023-07-09T02:12:14.768468+0000","last_peered":"2023-07-09T02:12:14.768468+0000","last_clean":"2023-07-09T02:12:14.768468+0000","last_became_active":"2023-07-09T02:12:12.755956+0000","last_became_peered":"2023-07-09T02:12:12.755956+0000","last_unstale":"2023-07-09T02:12:14.768468+0000","last_undegraded":"2023-07-09T02:12:14.768468+0000","last_fullsized":"2023-07-09T02:12:14.768468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:22.181528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768570+0000","last_change":"2023-07-09T02:12:13.759428+0000","last_active":"2023-07-09T02:12:14.768570+0000","last_peered":"2023-07-09T02:12:14.768570+0000","last_clean":"2023-07-09T02:12:14.768570+0000","last_became_active":"2023-07-09T02:12:13.758423+0000","last_became_peered":"2023-07-09T02:12:13.758423+0000","last_unstale":"2023-07-09T02:12:14.768570+0000","last_undegraded":"2023-07-09T02:12:14.768570+0000","last_fullsized":"2023-07-09T02:12:14.768570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:35:11.690669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767928+0000","last_change":"2023-07-09T02:12:12.764074+0000","last_active":"2023-07-09T02:12:14.767928+0000","last_peered":"2023-07-09T02:12:14.767928+0000","last_clean":"2023-07-09T02:12:14.767928+0000","last_became_active":"2023-07-09T02:12:12.763847+0000","last_became_peered":"2023-07-09T02:12:12.763847+0000","last_unstale":"2023-07-09T02:12:14.767928+0000","last_undegraded":"2023-07-09T02:12:14.767928+0000","last_fullsized":"2023-07-09T02:12:14.767928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:07:44.040140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767943+0000","last_change":"2023-07-09T02:12:13.764300+0000","last_active":"2023-07-09T02:12:14.767943+0000","last_peered":"2023-07-09T02:12:14.767943+0000","last_clean":"2023-07-09T02:12:14.767943+0000","last_became_active":"2023-07-09T02:12:13.764080+0000","last_became_peered":"2023-07-09T02:12:13.764080+0000","last_unstale":"2023-07-09T02:12:14.767943+0000","last_undegraded":"2023-07-09T02:12:14.767943+0000","last_fullsized":"2023-07-09T02:12:14.767943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:55:03.157131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768365+0000","last_change":"2023-07-09T02:12:12.765870+0000","last_active":"2023-07-09T02:12:14.768365+0000","last_peered":"2023-07-09T02:12:14.768365+0000","last_clean":"2023-07-09T02:12:14.768365+0000","last_became_active":"2023-07-09T02:12:12.765300+0000","last_became_peered":"2023-07-09T02:12:12.765300+0000","last_unstale":"2023-07-09T02:12:14.768365+0000","last_undegraded":"2023-07-09T02:12:14.768365+0000","last_fullsized":"2023-07-09T02:12:14.768365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:10:55.661458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768224+0000","last_change":"2023-07-09T02:12:13.768029+0000","last_active":"2023-07-09T02:12:14.768224+0000","last_peered":"2023-07-09T02:12:14.768224+0000","last_clean":"2023-07-09T02:12:14.768224+0000","last_became_active":"2023-07-09T02:12:13.766989+0000","last_became_peered":"2023-07-09T02:12:13.766989+0000","last_unstale":"2023-07-09T02:12:14.768224+0000","last_undegraded":"2023-07-09T02:12:14.768224+0000","last_fullsized":"2023-07-09T02:12:14.768224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:33:18.971043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756808+0000","last_change":"2023-07-09T02:12:12.762003+0000","last_active":"2023-07-09T02:12:14.756808+0000","last_peered":"2023-07-09T02:12:14.756808+0000","last_clean":"2023-07-09T02:12:14.756808+0000","last_became_active":"2023-07-09T02:12:12.761785+0000","last_became_peered":"2023-07-09T02:12:12.761785+0000","last_unstale":"2023-07-09T02:12:14.756808+0000","last_undegraded":"2023-07-09T02:12:14.756808+0000","last_fullsized":"2023-07-09T02:12:14.756808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:43.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757128+0000","last_change":"2023-07-09T02:12:13.770453+0000","last_active":"2023-07-09T02:12:14.757128+0000","last_peered":"2023-07-09T02:12:14.757128+0000","last_clean":"2023-07-09T02:12:14.757128+0000","last_became_active":"2023-07-09T02:12:13.769640+0000","last_became_peered":"2023-07-09T02:12:13.769640+0000","last_unstale":"2023-07-09T02:12:14.757128+0000","last_undegraded":"2023-07-09T02:12:14.757128+0000","last_fullsized":"2023-07-09T02:12:14.757128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:58:50.868540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755454+0000","last_change":"2023-07-09T02:12:12.759239+0000","last_active":"2023-07-09T02:12:14.755454+0000","last_peered":"2023-07-09T02:12:14.755454+0000","last_clean":"2023-07-09T02:12:14.755454+0000","last_became_active":"2023-07-09T02:12:12.759019+0000","last_became_peered":"2023-07-09T02:12:12.759019+0000","last_unstale":"2023-07-09T02:12:14.755454+0000","last_undegraded":"2023-07-09T02:12:14.755454+0000","last_fullsized":"2023-07-09T02:12:14.755454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:38:26.868516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.754972+0000","last_change":"2023-07-09T02:12:13.767609+0000","last_active":"2023-07-09T02:12:14.754972+0000","last_peered":"2023-07-09T02:12:14.754972+0000","last_clean":"2023-07-09T02:12:14.754972+0000","last_became_active":"2023-07-09T02:12:13.767372+0000","last_became_peered":"2023-07-09T02:12:13.767372+0000","last_unstale":"2023-07-09T02:12:14.754972+0000","last_undegraded":"2023-07-09T02:12:14.754972+0000","last_fullsized":"2023-07-09T02:12:14.754972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:23.189900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179013+0000","last_change":"2023-07-09T02:12:12.764058+0000","last_active":"2023-07-09T02:12:15.179013+0000","last_peered":"2023-07-09T02:12:15.179013+0000","last_clean":"2023-07-09T02:12:15.179013+0000","last_became_active":"2023-07-09T02:12:12.763818+0000","last_became_peered":"2023-07-09T02:12:12.763818+0000","last_unstale":"2023-07-09T02:12:15.179013+0000","last_undegraded":"2023-07-09T02:12:15.179013+0000","last_fullsized":"2023-07-09T02:12:15.179013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:22:58.757961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179215+0000","last_change":"2023-07-09T02:12:13.763990+0000","last_active":"2023-07-09T02:12:15.179215+0000","last_peered":"2023-07-09T02:12:15.179215+0000","last_clean":"2023-07-09T02:12:15.179215+0000","last_became_active":"2023-07-09T02:12:13.763765+0000","last_became_peered":"2023-07-09T02:12:13.763765+0000","last_unstale":"2023-07-09T02:12:15.179215+0000","last_undegraded":"2023-07-09T02:12:15.179215+0000","last_fullsized":"2023-07-09T02:12:15.179215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:05:00.216032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768427+0000","last_change":"2023-07-09T02:12:12.752011+0000","last_active":"2023-07-09T02:12:14.768427+0000","last_peered":"2023-07-09T02:12:14.768427+0000","last_clean":"2023-07-09T02:12:14.768427+0000","last_became_active":"2023-07-09T02:12:12.751796+0000","last_became_peered":"2023-07-09T02:12:12.751796+0000","last_unstale":"2023-07-09T02:12:14.768427+0000","last_undegraded":"2023-07-09T02:12:14.768427+0000","last_fullsized":"2023-07-09T02:12:14.768427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:37:50.306414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768637+0000","last_change":"2023-07-09T02:12:13.760345+0000","last_active":"2023-07-09T02:12:14.768637+0000","last_peered":"2023-07-09T02:12:14.768637+0000","last_clean":"2023-07-09T02:12:14.768637+0000","last_became_active":"2023-07-09T02:12:13.759881+0000","last_became_peered":"2023-07-09T02:12:13.759881+0000","last_unstale":"2023-07-09T02:12:14.768637+0000","last_undegraded":"2023-07-09T02:12:14.768637+0000","last_fullsized":"2023-07-09T02:12:14.768637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:38:38.195388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178774+0000","last_change":"2023-07-09T02:12:12.757627+0000","last_active":"2023-07-09T02:12:15.178774+0000","last_peered":"2023-07-09T02:12:15.178774+0000","last_clean":"2023-07-09T02:12:15.178774+0000","last_became_active":"2023-07-09T02:12:12.757415+0000","last_became_peered":"2023-07-09T02:12:12.757415+0000","last_unstale":"2023-07-09T02:12:15.178774+0000","last_undegraded":"2023-07-09T02:12:15.178774+0000","last_fullsized":"2023-07-09T02:12:15.178774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:13:22.543542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757043+0000","last_change":"2023-07-09T02:12:13.758581+0000","last_active":"2023-07-09T02:12:14.757043+0000","last_peered":"2023-07-09T02:12:14.757043+0000","last_clean":"2023-07-09T02:12:14.757043+0000","last_became_active":"2023-07-09T02:12:13.758344+0000","last_became_peered":"2023-07-09T02:12:13.758344+0000","last_unstale":"2023-07-09T02:12:14.757043+0000","last_undegraded":"2023-07-09T02:12:14.757043+0000","last_fullsized":"2023-07-09T02:12:14.757043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:23:35.273007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179320+0000","last_change":"2023-07-09T02:12:12.752713+0000","last_active":"2023-07-09T02:12:15.179320+0000","last_peered":"2023-07-09T02:12:15.179320+0000","last_clean":"2023-07-09T02:12:15.179320+0000","last_became_active":"2023-07-09T02:12:12.752503+0000","last_became_peered":"2023-07-09T02:12:12.752503+0000","last_unstale":"2023-07-09T02:12:15.179320+0000","last_undegraded":"2023-07-09T02:12:15.179320+0000","last_fullsized":"2023-07-09T02:12:15.179320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:02:02.608497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756448+0000","last_change":"2023-07-09T02:12:13.769608+0000","last_active":"2023-07-09T02:12:14.756448+0000","last_peered":"2023-07-09T02:12:14.756448+0000","last_clean":"2023-07-09T02:12:14.756448+0000","last_became_active":"2023-07-09T02:12:13.769094+0000","last_became_peered":"2023-07-09T02:12:13.769094+0000","last_unstale":"2023-07-09T02:12:14.756448+0000","last_undegraded":"2023-07-09T02:12:14.756448+0000","last_fullsized":"2023-07-09T02:12:14.756448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:38:27.876888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768279+0000","last_change":"2023-07-09T02:12:12.764772+0000","last_active":"2023-07-09T02:12:14.768279+0000","last_peered":"2023-07-09T02:12:14.768279+0000","last_clean":"2023-07-09T02:12:14.768279+0000","last_became_active":"2023-07-09T02:12:12.764534+0000","last_became_peered":"2023-07-09T02:12:12.764534+0000","last_unstale":"2023-07-09T02:12:14.768279+0000","last_undegraded":"2023-07-09T02:12:14.768279+0000","last_fullsized":"2023-07-09T02:12:14.768279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:21:49.482567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767754+0000","last_change":"2023-07-09T02:12:13.766387+0000","last_active":"2023-07-09T02:12:14.767754+0000","last_peered":"2023-07-09T02:12:14.767754+0000","last_clean":"2023-07-09T02:12:14.767754+0000","last_became_active":"2023-07-09T02:12:13.765541+0000","last_became_peered":"2023-07-09T02:12:13.765541+0000","last_unstale":"2023-07-09T02:12:14.767754+0000","last_undegraded":"2023-07-09T02:12:14.767754+0000","last_fullsized":"2023-07-09T02:12:14.767754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:49:11.700076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.179202+0000","last_change":"2023-07-09T02:12:12.758326+0000","last_active":"2023-07-09T02:12:15.179202+0000","last_peered":"2023-07-09T02:12:15.179202+0000","last_clean":"2023-07-09T02:12:15.179202+0000","last_became_active":"2023-07-09T02:12:12.758111+0000","last_became_peered":"2023-07-09T02:12:12.758111+0000","last_unstale":"2023-07-09T02:12:15.179202+0000","last_undegraded":"2023-07-09T02:12:15.179202+0000","last_fullsized":"2023-07-09T02:12:15.179202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:49:39.054517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756604+0000","last_change":"2023-07-09T02:12:13.770987+0000","last_active":"2023-07-09T02:12:14.756604+0000","last_peered":"2023-07-09T02:12:14.756604+0000","last_clean":"2023-07-09T02:12:14.756604+0000","last_became_active":"2023-07-09T02:12:13.770443+0000","last_became_peered":"2023-07-09T02:12:13.770443+0000","last_unstale":"2023-07-09T02:12:14.756604+0000","last_undegraded":"2023-07-09T02:12:14.756604+0000","last_fullsized":"2023-07-09T02:12:14.756604+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:10:53.555026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768366+0000","last_change":"2023-07-09T02:12:12.760812+0000","last_active":"2023-07-09T02:12:14.768366+0000","last_peered":"2023-07-09T02:12:14.768366+0000","last_clean":"2023-07-09T02:12:14.768366+0000","last_became_active":"2023-07-09T02:12:12.760586+0000","last_became_peered":"2023-07-09T02:12:12.760586+0000","last_unstale":"2023-07-09T02:12:14.768366+0000","last_undegraded":"2023-07-09T02:12:14.768366+0000","last_fullsized":"2023-07-09T02:12:14.768366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:43.698858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768160+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:12:14.768160+0000","last_peered":"2023-07-09T02:12:14.768160+0000","last_clean":"2023-07-09T02:12:14.768160+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:12:14.768160+0000","last_undegraded":"2023-07-09T02:12:14.768160+0000","last_fullsized":"2023-07-09T02:12:14.768160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:37:22.214584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757197+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:12:14.757197+0000","last_peered":"2023-07-09T02:12:14.757197+0000","last_clean":"2023-07-09T02:12:14.757197+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:12:14.757197+0000","last_undegraded":"2023-07-09T02:12:14.757197+0000","last_fullsized":"2023-07-09T02:12:14.757197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:22:26.302215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768606+0000","last_change":"2023-07-09T02:12:13.770732+0000","last_active":"2023-07-09T02:12:14.768606+0000","last_peered":"2023-07-09T02:12:14.768606+0000","last_clean":"2023-07-09T02:12:14.768606+0000","last_became_active":"2023-07-09T02:12:13.770158+0000","last_became_peered":"2023-07-09T02:12:13.770158+0000","last_unstale":"2023-07-09T02:12:14.768606+0000","last_undegraded":"2023-07-09T02:12:14.768606+0000","last_fullsized":"2023-07-09T02:12:14.768606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:40:10.689297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757184+0000","last_change":"2023-07-09T02:12:12.753949+0000","last_active":"2023-07-09T02:12:14.757184+0000","last_peered":"2023-07-09T02:12:14.757184+0000","last_clean":"2023-07-09T02:12:14.757184+0000","last_became_active":"2023-07-09T02:12:12.753703+0000","last_became_peered":"2023-07-09T02:12:12.753703+0000","last_unstale":"2023-07-09T02:12:14.757184+0000","last_undegraded":"2023-07-09T02:12:14.757184+0000","last_fullsized":"2023-07-09T02:12:14.757184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:00:02.032951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767953+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:12:14.767953+0000","last_peered":"2023-07-09T02:12:14.767953+0000","last_clean":"2023-07-09T02:12:14.767953+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:12:14.767953+0000","last_undegraded":"2023-07-09T02:12:14.767953+0000","last_fullsized":"2023-07-09T02:12:14.767953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:39:35.987046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767554+0000","last_change":"2023-07-09T02:12:13.762735+0000","last_active":"2023-07-09T02:12:14.767554+0000","last_peered":"2023-07-09T02:12:14.767554+0000","last_clean":"2023-07-09T02:12:14.767554+0000","last_became_active":"2023-07-09T02:12:13.762511+0000","last_became_peered":"2023-07-09T02:12:13.762511+0000","last_unstale":"2023-07-09T02:12:14.767554+0000","last_undegraded":"2023-07-09T02:12:14.767554+0000","last_fullsized":"2023-07-09T02:12:14.767554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:33:18.971043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178869+0000","last_change":"2023-07-09T02:12:12.757200+0000","last_active":"2023-07-09T02:12:15.178869+0000","last_peered":"2023-07-09T02:12:15.178869+0000","last_clean":"2023-07-09T02:12:15.178869+0000","last_became_active":"2023-07-09T02:12:12.756967+0000","last_became_peered":"2023-07-09T02:12:12.756967+0000","last_unstale":"2023-07-09T02:12:15.178869+0000","last_undegraded":"2023-07-09T02:12:15.178869+0000","last_fullsized":"2023-07-09T02:12:15.178869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:52:29.356657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:15.178922+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:12:15.178922+0000","last_peered":"2023-07-09T02:12:15.178922+0000","last_clean":"2023-07-09T02:12:15.178922+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:12:15.178922+0000","last_undegraded":"2023-07-09T02:12:15.178922+0000","last_fullsized":"2023-07-09T02:12:15.178922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:06:43.413179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767866+0000","last_change":"2023-07-09T02:12:13.765766+0000","last_active":"2023-07-09T02:12:14.767866+0000","last_peered":"2023-07-09T02:12:14.767866+0000","last_clean":"2023-07-09T02:12:14.767866+0000","last_became_active":"2023-07-09T02:12:13.764971+0000","last_became_peered":"2023-07-09T02:12:13.764971+0000","last_unstale":"2023-07-09T02:12:14.767866+0000","last_undegraded":"2023-07-09T02:12:14.767866+0000","last_fullsized":"2023-07-09T02:12:14.767866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:02.440835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757013+0000","last_change":"2023-07-09T02:12:12.759433+0000","last_active":"2023-07-09T02:12:14.757013+0000","last_peered":"2023-07-09T02:12:14.757013+0000","last_clean":"2023-07-09T02:12:14.757013+0000","last_became_active":"2023-07-09T02:12:12.759206+0000","last_became_peered":"2023-07-09T02:12:12.759206+0000","last_unstale":"2023-07-09T02:12:14.757013+0000","last_undegraded":"2023-07-09T02:12:14.757013+0000","last_fullsized":"2023-07-09T02:12:14.757013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:38.713863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.757242+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:12:14.757242+0000","last_peered":"2023-07-09T02:12:14.757242+0000","last_clean":"2023-07-09T02:12:14.757242+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:12:14.757242+0000","last_undegraded":"2023-07-09T02:12:14.757242+0000","last_fullsized":"2023-07-09T02:12:14.757242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:58:18.094575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756898+0000","last_change":"2023-07-09T02:12:13.765612+0000","last_active":"2023-07-09T02:12:14.756898+0000","last_peered":"2023-07-09T02:12:14.756898+0000","last_clean":"2023-07-09T02:12:14.756898+0000","last_became_active":"2023-07-09T02:12:13.765350+0000","last_became_peered":"2023-07-09T02:12:13.765350+0000","last_unstale":"2023-07-09T02:12:14.756898+0000","last_undegraded":"2023-07-09T02:12:14.756898+0000","last_fullsized":"2023-07-09T02:12:14.756898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:35:42.289157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.756844+0000","last_change":"2023-07-09T02:12:12.761436+0000","last_active":"2023-07-09T02:12:14.756844+0000","last_peered":"2023-07-09T02:12:14.756844+0000","last_clean":"2023-07-09T02:12:14.756844+0000","last_became_active":"2023-07-09T02:12:12.761206+0000","last_became_peered":"2023-07-09T02:12:12.761206+0000","last_unstale":"2023-07-09T02:12:14.756844+0000","last_undegraded":"2023-07-09T02:12:14.756844+0000","last_fullsized":"2023-07-09T02:12:14.756844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:24:12.135107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768780+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:12:14.768780+0000","last_peered":"2023-07-09T02:12:14.768780+0000","last_clean":"2023-07-09T02:12:14.768780+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:12:14.768780+0000","last_undegraded":"2023-07-09T02:12:14.768780+0000","last_fullsized":"2023-07-09T02:12:14.768780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:56:16.950095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767917+0000","last_change":"2023-07-09T02:12:13.768154+0000","last_active":"2023-07-09T02:12:14.767917+0000","last_peered":"2023-07-09T02:12:14.767917+0000","last_clean":"2023-07-09T02:12:14.767917+0000","last_became_active":"2023-07-09T02:12:13.767926+0000","last_became_peered":"2023-07-09T02:12:13.767926+0000","last_unstale":"2023-07-09T02:12:14.767917+0000","last_undegraded":"2023-07-09T02:12:14.767917+0000","last_fullsized":"2023-07-09T02:12:14.767917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:49:11.700076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768057+0000","last_change":"2023-07-09T02:12:12.762066+0000","last_active":"2023-07-09T02:12:14.768057+0000","last_peered":"2023-07-09T02:12:14.768057+0000","last_clean":"2023-07-09T02:12:14.768057+0000","last_became_active":"2023-07-09T02:12:12.761806+0000","last_became_peered":"2023-07-09T02:12:12.761806+0000","last_unstale":"2023-07-09T02:12:14.768057+0000","last_undegraded":"2023-07-09T02:12:14.768057+0000","last_fullsized":"2023-07-09T02:12:14.768057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:22:58.757961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767824+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:12:14.767824+0000","last_peered":"2023-07-09T02:12:14.767824+0000","last_clean":"2023-07-09T02:12:14.767824+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:12:14.767824+0000","last_undegraded":"2023-07-09T02:12:14.767824+0000","last_fullsized":"2023-07-09T02:12:14.767824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:39:09.053965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755039+0000","last_change":"2023-07-09T02:12:13.767178+0000","last_active":"2023-07-09T02:12:14.755039+0000","last_peered":"2023-07-09T02:12:14.755039+0000","last_clean":"2023-07-09T02:12:14.755039+0000","last_became_active":"2023-07-09T02:12:13.766957+0000","last_became_peered":"2023-07-09T02:12:13.766957+0000","last_unstale":"2023-07-09T02:12:14.755039+0000","last_undegraded":"2023-07-09T02:12:14.755039+0000","last_fullsized":"2023-07-09T02:12:14.755039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:33:18.971043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.755393+0000","last_change":"2023-07-09T02:12:12.755744+0000","last_active":"2023-07-09T02:12:14.755393+0000","last_peered":"2023-07-09T02:12:14.755393+0000","last_clean":"2023-07-09T02:12:14.755393+0000","last_became_active":"2023-07-09T02:12:12.755530+0000","last_became_peered":"2023-07-09T02:12:12.755530+0000","last_unstale":"2023-07-09T02:12:14.755393+0000","last_undegraded":"2023-07-09T02:12:14.755393+0000","last_fullsized":"2023-07-09T02:12:14.755393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:49:07.012871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768054+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:12:14.768054+0000","last_peered":"2023-07-09T02:12:14.768054+0000","last_clean":"2023-07-09T02:12:14.768054+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:12:14.768054+0000","last_undegraded":"2023-07-09T02:12:14.768054+0000","last_fullsized":"2023-07-09T02:12:14.768054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:04:27.442067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768709+0000","last_change":"2023-07-09T02:12:13.763639+0000","last_active":"2023-07-09T02:12:14.768709+0000","last_peered":"2023-07-09T02:12:14.768709+0000","last_clean":"2023-07-09T02:12:14.768709+0000","last_became_active":"2023-07-09T02:12:13.763402+0000","last_became_peered":"2023-07-09T02:12:13.763402+0000","last_unstale":"2023-07-09T02:12:14.768709+0000","last_undegraded":"2023-07-09T02:12:14.768709+0000","last_fullsized":"2023-07-09T02:12:14.768709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:12.738797+0000","last_clean_scrub_stamp":"2023-07-09T02:12:12.738797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:36:31.553741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.767669+0000","last_change":"2023-07-09T02:12:12.757901+0000","last_active":"2023-07-09T02:12:14.767669+0000","last_peered":"2023-07-09T02:12:14.767669+0000","last_clean":"2023-07-09T02:12:14.767669+0000","last_became_active":"2023-07-09T02:12:12.757628+0000","last_became_peered":"2023-07-09T02:12:12.757628+0000","last_unstale":"2023-07-09T02:12:14.767669+0000","last_undegraded":"2023-07-09T02:12:14.767669+0000","last_fullsized":"2023-07-09T02:12:14.767669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:11.730425+0000","last_clean_scrub_stamp":"2023-07-09T02:12:11.730425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:12:40.591812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T02:12:14.768139+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:12:14.768139+0000","last_peered":"2023-07-09T02:12:14.768139+0000","last_clean":"2023-07-09T02:12:14.768139+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:12:14.768139+0000","last_undegraded":"2023-07-09T02:12:14.768139+0000","last_fullsized":"2023-07-09T02:12:14.768139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:19:38.439868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194576,"statfs":{"total":200000000,"available":199246639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.86699999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.0369999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":1.075}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.88900000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.745},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.96399999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":1.087},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.0569999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838059,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.94399999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.76600000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.79800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":157,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.65900000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.62}]},{"osd":3,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68400000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":158,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195154,"statfs":{"total":200000000,"available":199838037,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.70099999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.71599999999999997}]},{"osd":5,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.504},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.76300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":159,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195153,"statfs":{"total":200000000,"available":199837043,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":1.1200000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":1},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.88}]},{"osd":6,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.5569999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.165}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":151,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195161,"statfs":{"total":200000000,"available":199845224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58899999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65400000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.79000000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.80700000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.874},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.91700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":151,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195161,"statfs":{"total":200000000,"available":199845204,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.435}]},{"osd":2,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.377}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.36099999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194578,"statfs":{"total":200000000,"available":199248239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.371},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.443}]},{"osd":4,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.82999999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.77500000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.69499999999999995}]}]}],"pool_statfs":[]}} 2023-07-09T02:12:18.275 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:12:18.275 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:12:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.460+0000 7fe7dfffa640 1 Processor -- start 2023-07-09T02:12:18.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7dfffa640 1 -- start start 2023-07-09T02:12:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7dfffa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7d80af990 0x7fe7d806a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7dfffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d80b23b0 0x7fe7d806ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7dfffa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d806c1c0 con 0x7fe7d806b040 2023-07-09T02:12:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7dfffa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d80ccdd0 con 0x7fe7d80af990 2023-07-09T02:12:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7dfffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80cd120 con 0x7fe7d80b23b0 2023-07-09T02:12:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7ddd96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7d80af990 0x7fe7d806a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7ddd96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7d80af990 0x7fe7d806a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59368/0 (socket says 172.21.15.45:59368) 2023-07-09T02:12:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7ddd96640 1 -- 172.21.15.45:0/3207949810 learned_addr learned my addr 172.21.15.45:0/3207949810 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7dd595640 1 --2- 172.21.15.45:0/3207949810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d80b23b0 0x7fe7d806ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7ddd96640 1 -- 172.21.15.45:0/3207949810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d80b23b0 msgr2=0x7fe7d806ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:18.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7ddd96640 1 --2- 172.21.15.45:0/3207949810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d80b23b0 0x7fe7d806ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7ddd96640 1 -- 172.21.15.45:0/3207949810 >> v1:172.21.15.155:6789/0 conn(0x7fe7d806b040 legacy=0x7fe7d80caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.464+0000 7fe7ddd96640 1 -- 172.21.15.45:0/3207949810 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d80cc150 con 0x7fe7d80af990 2023-07-09T02:12:18.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7ddd96640 1 --2- 172.21.15.45:0/3207949810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80af990 0x7fe7d806a5c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4006fd0 tx=0x7fe7d401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0f417640ea042b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dcd94640 1 -- 172.21.15.45:0/3207949810 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40aa650 con 0x7fe7d80af990 2023-07-09T02:12:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dcd94640 1 -- 172.21.15.45:0/3207949810 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d40aa7b0 con 0x7fe7d80af990 2023-07-09T02:12:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dcd94640 1 -- 172.21.15.45:0/3207949810 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40aab40 con 0x7fe7d80af990 2023-07-09T02:12:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3207949810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80af990 msgr2=0x7fe7d806a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3207949810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80af990 0x7fe7d806a5c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4006fd0 tx=0x7fe7d401c4f0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3207949810 shutdown_connections 2023-07-09T02:12:18.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3207949810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d80b23b0 0x7fe7d806ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3207949810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80af990 0x7fe7d806a5c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3207949810 >> 172.21.15.45:0/3207949810 conn(0x7fe7d80999f0 msgr2=0x7fe7d80d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3207949810 shutdown_connections 2023-07-09T02:12:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3207949810 wait complete. 2023-07-09T02:12:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 Processor -- start 2023-07-09T02:12:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.468+0000 7fe7dfffa640 1 -- start start 2023-07-09T02:12:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d806b040 0x7fe7d8153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7d80af990 0x7fe7d815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80b23b0 0x7fe7d80add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8153740 con 0x7fe7d80b23b0 2023-07-09T02:12:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d815d0b0 con 0x7fe7d80af990 2023-07-09T02:12:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d815d390 con 0x7fe7d806b040 2023-07-09T02:12:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80b23b0 0x7fe7d80add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80b23b0 0x7fe7d80add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59374/0 (socket says 172.21.15.45:59374) 2023-07-09T02:12:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 -- 172.21.15.45:0/3181085509 learned_addr learned my addr 172.21.15.45:0/3181085509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7ddd96640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d806b040 0x7fe7d8153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dd595640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7d80af990 0x7fe7d815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 -- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d806b040 msgr2=0x7fe7d8153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d806b040 0x7fe7d8153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 -- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7d80af990 msgr2=0x7fe7d815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7d80af990 0x7fe7d815b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 -- 172.21.15.45:0/3181085509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4009480 con 0x7fe7d80b23b0 2023-07-09T02:12:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7de597640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80b23b0 0x7fe7d80add20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000c7a0 tx=0x7fe7d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7ce7fc640 1 -- 172.21.15.45:0/3181085509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0003b80 con 0x7fe7d80b23b0 2023-07-09T02:12:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7ce7fc640 1 -- 172.21.15.45:0/3181085509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d0003ce0 con 0x7fe7d80b23b0 2023-07-09T02:12:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7ce7fc640 1 -- 172.21.15.45:0/3181085509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d000aa30 con 0x7fe7d80b23b0 2023-07-09T02:12:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d815d670 con 0x7fe7d80b23b0 2023-07-09T02:12:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d815dc30 con 0x7fe7d80b23b0 2023-07-09T02:12:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d804d7d0 con 0x7fe7d80b23b0 2023-07-09T02:12:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.472+0000 7fe7ce7fc640 1 -- 172.21.15.45:0/3181085509 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7d000ab90 con 0x7fe7d80b23b0 2023-07-09T02:12:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.476+0000 7fe7ce7fc640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe7bc0662b0 0x7fe7bc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.476+0000 7fe7ce7fc640 1 -- 172.21.15.45:0/3181085509 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7d0083a70 con 0x7fe7d80b23b0 2023-07-09T02:12:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.476+0000 7fe7ddd96640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe7bc0662b0 0x7fe7bc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.476+0000 7fe7ddd96640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe7bc0662b0 0x7fe7bc068760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40ae000 tx=0x7fe7d40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.480+0000 7fe7ce7fc640 1 -- 172.21.15.45:0/3181085509 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7d0050f00 con 0x7fe7d80b23b0 2023-07-09T02:12:18.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.688+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe7d80d1490 con 0x7fe7d80b23b0 2023-07-09T02:12:18.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7ce7fc640 1 -- 172.21.15.45:0/3181085509 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe7d0054520 con 0x7fe7d80b23b0 2023-07-09T02:12:18.695 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:12:18.695 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:12:18.695 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:12:18.695 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:12:18.695 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:12:18.696 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:12:18.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe7bc0662b0 msgr2=0x7fe7bc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe7bc0662b0 0x7fe7bc068760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40ae000 tx=0x7fe7d40a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:18.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80b23b0 msgr2=0x7fe7d80add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80b23b0 0x7fe7d80add20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000c7a0 tx=0x7fe7d000cc60 comp rx=0 tx=0).stop 2023-07-09T02:12:18.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 shutdown_connections 2023-07-09T02:12:18.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d80b23b0 0x7fe7d80add20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7d80af990 0x7fe7d815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe7bc0662b0 0x7fe7bc068760 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 --2- 172.21.15.45:0/3181085509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7d806b040 0x7fe7d8153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.692+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 >> 172.21.15.45:0/3181085509 conn(0x7fe7d80999f0 msgr2=0x7fe7d8159770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:18.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.696+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 shutdown_connections 2023-07-09T02:12:18.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.696+0000 7fe7dfffa640 1 -- 172.21.15.45:0/3181085509 wait complete. 2023-07-09T02:12:18.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:18.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.856+0000 7f899ff40640 1 Processor -- start 2023-07-09T02:12:18.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.856+0000 7f899ff40640 1 -- start start 2023-07-09T02:12:18.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899ff40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899815c060 0x7f89980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899ff40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89980d2620 0x7f89980cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899ff40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8998160a50 con 0x7f89980cd120 2023-07-09T02:12:18.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899ff40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899815c430 con 0x7f89980d2620 2023-07-09T02:12:18.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899ff40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899815fb60 con 0x7f899815c060 2023-07-09T02:12:18.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899e4dd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89980d2620 0x7f89980cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899e4dd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89980d2620 0x7f89980cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59380/0 (socket says 172.21.15.45:59380) 2023-07-09T02:12:18.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899e4dd640 1 -- 172.21.15.45:0/214779306 learned_addr learned my addr 172.21.15.45:0/214779306 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:18.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899dcdc640 1 --2- 172.21.15.45:0/214779306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899815c060 0x7f89980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899e4dd640 1 -- 172.21.15.45:0/214779306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899815c060 msgr2=0x7f89980b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:18.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899e4dd640 1 --2- 172.21.15.45:0/214779306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899815c060 0x7f89980b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899e4dd640 1 -- 172.21.15.45:0/214779306 >> v1:172.21.15.155:6789/0 conn(0x7f89980cd120 legacy=0x7f89980d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.860+0000 7f899e4dd640 1 -- 172.21.15.45:0/214779306 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899815fe40 con 0x7f89980d2620 2023-07-09T02:12:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899e4dd640 1 --2- 172.21.15.45:0/214779306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cee30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8990009e80 tx=0x7f899001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb04618fed473e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ccda640 1 -- 172.21.15.45:0/214779306 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900a5880 con 0x7f89980d2620 2023-07-09T02:12:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ccda640 1 -- 172.21.15.45:0/214779306 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89900a59e0 con 0x7f89980d2620 2023-07-09T02:12:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ccda640 1 -- 172.21.15.45:0/214779306 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900a5d70 con 0x7f89980d2620 2023-07-09T02:12:18.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- 172.21.15.45:0/214779306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 msgr2=0x7f89980cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 --2- 172.21.15.45:0/214779306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cee30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8990009e80 tx=0x7f899001c9c0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- 172.21.15.45:0/214779306 shutdown_connections 2023-07-09T02:12:18.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 --2- 172.21.15.45:0/214779306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cee30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 --2- 172.21.15.45:0/214779306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f899815c060 0x7f89980b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- 172.21.15.45:0/214779306 >> 172.21.15.45:0/214779306 conn(0x7f89980698e0 msgr2=0x7f8998069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:18.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- 172.21.15.45:0/214779306 shutdown_connections 2023-07-09T02:12:18.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- 172.21.15.45:0/214779306 wait complete. 2023-07-09T02:12:18.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 Processor -- start 2023-07-09T02:12:18.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- start start 2023-07-09T02:12:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89980cd120 0x7f8998151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899815c060 0x7f89980b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8998153d50 con 0x7f89980d2620 2023-07-09T02:12:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89981528e0 con 0x7f899815c060 2023-07-09T02:12:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.864+0000 7f899ff40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8998152bc0 con 0x7f89980cd120 2023-07-09T02:12:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899dcdc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89980cd120 0x7f8998151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59382/0 (socket says 172.21.15.45:59382) 2023-07-09T02:12:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 -- 172.21.15.45:0/4054634772 learned_addr learned my addr 172.21.15.45:0/4054634772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899dcdc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89980cd120 0x7f8998151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:44248/0 (socket says 172.21.15.45:44248) 2023-07-09T02:12:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899e4dd640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899815c060 0x7f89980b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 -- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89980cd120 msgr2=0x7f8998151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89980cd120 0x7f8998151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 -- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899815c060 msgr2=0x7f89980b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899815c060 0x7f89980b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 -- 172.21.15.45:0/4054634772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8990009b30 con 0x7f89980d2620 2023-07-09T02:12:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899d4db640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cc8e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f898800c4d0 tx=0x7f898800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f898e7fc640 1 -- 172.21.15.45:0/4054634772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880052d0 con 0x7f89980d2620 2023-07-09T02:12:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f898e7fc640 1 -- 172.21.15.45:0/4054634772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8988005430 con 0x7f89980d2620 2023-07-09T02:12:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f898e7fc640 1 -- 172.21.15.45:0/4054634772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988012830 con 0x7f89980d2620 2023-07-09T02:12:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89980b59f0 con 0x7f89980d2620 2023-07-09T02:12:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8998153180 con 0x7f89980d2620 2023-07-09T02:12:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89980cf170 con 0x7f89980d2620 2023-07-09T02:12:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.868+0000 7f898e7fc640 1 -- 172.21.15.45:0/4054634772 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8988012990 con 0x7f89980d2620 2023-07-09T02:12:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.872+0000 7f898e7fc640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f897c066280 0x7f897c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.872+0000 7f898e7fc640 1 -- 172.21.15.45:0/4054634772 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8988083700 con 0x7f89980d2620 2023-07-09T02:12:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.872+0000 7f899dcdc640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f897c066280 0x7f897c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.872+0000 7f899dcdc640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f897c066280 0x7f897c068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8994009ac0 tx=0x7f8994009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:18.872+0000 7f898e7fc640 1 -- 172.21.15.45:0/4054634772 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8988050c30 con 0x7f89980d2620 2023-07-09T02:12:19.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.064+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f899804d7d0 con 0x7f89980d2620 2023-07-09T02:12:19.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f898e7fc640 1 -- 172.21.15.45:0/4054634772 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f8988054250 con 0x7f89980d2620 2023-07-09T02:12:19.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:19.069 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:13.135771+0000","modified":"2023-07-09T02:12:16.783642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3290020828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3290020828},{"type":"v1","addr":"172.21.15.45:6835","nonce":3290020828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T02:12:19.070 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-07-09T02:12:19.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f897c066280 msgr2=0x7f897c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f897c066280 0x7f897c068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8994009ac0 tx=0x7f8994009190 comp rx=0 tx=0).stop 2023-07-09T02:12:19.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 msgr2=0x7f89980cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cc8e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f898800c4d0 tx=0x7f898800c990 comp rx=0 tx=0).stop 2023-07-09T02:12:19.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 shutdown_connections 2023-07-09T02:12:19.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899815c060 0x7f89980b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89980d2620 0x7f89980cc8e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f897c066280 0x7f897c068730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 --2- 172.21.15.45:0/4054634772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89980cd120 0x7f8998151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 >> 172.21.15.45:0/4054634772 conn(0x7f89980698e0 msgr2=0x7f89980b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:19.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 shutdown_connections 2023-07-09T02:12:19.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.068+0000 7f899ff40640 1 -- 172.21.15.45:0/4054634772 wait complete. 2023-07-09T02:12:19.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:12:13.135771+0000', 'modified': '2023-07-09T02:12:16.783642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5151}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5151': {'gid': 5151, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/3290020828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 3290020828}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 3290020828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:12:19.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:12:19.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-09T02:12:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.640+0000 7f7602b58640 1 Processor -- start 2023-07-09T02:12:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.640+0000 7f7602b58640 1 -- start start 2023-07-09T02:12:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.640+0000 7f7602b58640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75fc159fd0 0x7f75fc15e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.640+0000 7f7602b58640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0cf020 0x7f75fc0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602b58640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc0cf9c0 con 0x7f75fc0b2e00 2023-07-09T02:12:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602b58640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc0cd620 con 0x7f75fc159fd0 2023-07-09T02:12:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602b58640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0cdaf0 con 0x7f75fc0cf020 2023-07-09T02:12:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602357640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0cf020 0x7f75fc0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602357640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0cf020 0x7f75fc0cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:44252/0 (socket says 172.21.15.45:44252) 2023-07-09T02:12:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602357640 1 -- 172.21.15.45:0/858298613 learned_addr learned my addr 172.21.15.45:0/858298613 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7601b56640 1 --2- 172.21.15.45:0/858298613 >> v2:172.21.15.155:3300/0 conn(0x7f75fc159fd0 0x7f75fc15e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7600b54640 1 -- 172.21.15.45:0/858298613 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526243636 0 0) 0x7f75fc0cf9c0 con 0x7f75fc0b2e00 2023-07-09T02:12:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7600b54640 1 -- 172.21.15.45:0/858298613 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e8003530 con 0x7f75fc0b2e00 2023-07-09T02:12:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602357640 1 -- 172.21.15.45:0/858298613 >> v2:172.21.15.155:3300/0 conn(0x7f75fc159fd0 msgr2=0x7f75fc15e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602357640 1 --2- 172.21.15.45:0/858298613 >> v2:172.21.15.155:3300/0 conn(0x7f75fc159fd0 0x7f75fc15e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602357640 1 -- 172.21.15.45:0/858298613 >> v1:172.21.15.155:6789/0 conn(0x7f75fc0b2e00 legacy=0x7f75fc0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602357640 1 -- 172.21.15.45:0/858298613 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0cd810 con 0x7f75fc0cf020 2023-07-09T02:12:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.644+0000 7f7602357640 1 --2- 172.21.15.45:0/858298613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0cf020 0x7f75fc0cf480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009e50 tx=0x7f75f401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=161249bebd066681 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7600b54640 1 -- 172.21.15.45:0/858298613 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40a5810 con 0x7f75fc0cf020 2023-07-09T02:12:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7600b54640 1 -- 172.21.15.45:0/858298613 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f40a5970 con 0x7f75fc0cf020 2023-07-09T02:12:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7600b54640 1 -- 172.21.15.45:0/858298613 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40a5d00 con 0x7f75fc0cf020 2023-07-09T02:12:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- 172.21.15.45:0/858298613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0cf020 msgr2=0x7f75fc0cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 --2- 172.21.15.45:0/858298613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0cf020 0x7f75fc0cf480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009e50 tx=0x7f75f401c950 comp rx=0 tx=0).stop 2023-07-09T02:12:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- 172.21.15.45:0/858298613 shutdown_connections 2023-07-09T02:12:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 --2- 172.21.15.45:0/858298613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0cf020 0x7f75fc0cf480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 --2- 172.21.15.45:0/858298613 >> v2:172.21.15.155:3300/0 conn(0x7f75fc159fd0 0x7f75fc15e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- 172.21.15.45:0/858298613 >> 172.21.15.45:0/858298613 conn(0x7f75fc0650b0 msgr2=0x7f75fc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- 172.21.15.45:0/858298613 shutdown_connections 2023-07-09T02:12:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- 172.21.15.45:0/858298613 wait complete. 2023-07-09T02:12:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 Processor -- start 2023-07-09T02:12:19.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- start start 2023-07-09T02:12:19.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0b2e00 0x7f75fc1462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0cf020 0x7f75fc14e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc159fd0 0x7f75fc0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0c51e0 con 0x7f75fc159fd0 2023-07-09T02:12:19.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0c7970 con 0x7f75fc0cf020 2023-07-09T02:12:19.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.648+0000 7f7602b58640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc1467e0 con 0x7f75fc0b2e00 2023-07-09T02:12:19.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc159fd0 0x7f75fc0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc159fd0 0x7f75fc0c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59398/0 (socket says 172.21.15.45:59398) 2023-07-09T02:12:19.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 -- 172.21.15.45:0/705491285 learned_addr learned my addr 172.21.15.45:0/705491285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:19.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7601b56640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0b2e00 0x7f75fc1462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7601355640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0cf020 0x7f75fc14e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 -- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0b2e00 msgr2=0x7f75fc1462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0b2e00 0x7f75fc1462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 -- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0cf020 msgr2=0x7f75fc14e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0cf020 0x7f75fc14e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 -- 172.21.15.45:0/705491285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4009b30 con 0x7f75fc159fd0 2023-07-09T02:12:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602357640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc159fd0 0x7f75fc0c5600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f75f40af040 tx=0x7f75f40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f75f27fc640 1 -- 172.21.15.45:0/705491285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40b8670 con 0x7f75fc159fd0 2023-07-09T02:12:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f75f27fc640 1 -- 172.21.15.45:0/705491285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f40b87d0 con 0x7f75fc159fd0 2023-07-09T02:12:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f75f27fc640 1 -- 172.21.15.45:0/705491285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40b8b60 con 0x7f75fc159fd0 2023-07-09T02:12:19.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602b58640 1 -- 172.21.15.45:0/705491285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc0c4560 con 0x7f75fc159fd0 2023-07-09T02:12:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f7602b58640 1 -- 172.21.15.45:0/705491285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc0c4b20 con 0x7f75fc159fd0 2023-07-09T02:12:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.652+0000 7f75f27fc640 1 -- 172.21.15.45:0/705491285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75f40b8cc0 con 0x7f75fc159fd0 2023-07-09T02:12:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f75f27fc640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75e0066280 0x7f75e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f75f27fc640 1 -- 172.21.15.45:0/705491285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75f411f2e0 con 0x7f75fc159fd0 2023-07-09T02:12:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75e0066280 0x7f75e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f760712e000 1 Processor -- start 2023-07-09T02:12:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f760712e000 1 -- start start 2023-07-09T02:12:19.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75e0066280 0x7f75e0068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009a50 tx=0x7f75f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f760712e000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f760712e000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 0x55e4831a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f760712e000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 0x55e4831a6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f760712e000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e48306cf80 con 0x55e4831ef800 2023-07-09T02:12:19.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f760712e000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482fa6c60 con 0x55e4831a5f90 2023-07-09T02:12:19.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f760712e000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e482ffa700 con 0x55e4831f0110 2023-07-09T02:12:19.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831efbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59400/0 (socket says 172.21.15.45:59400) 2023-07-09T02:12:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 -- 172.21.15.45:0/2077361621 learned_addr learned my addr 172.21.15.45:0/2077361621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601355640 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 0x55e4831a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7602357640 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 0x55e4831a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 -- 172.21.15.45:0/2077361621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 msgr2=0x55e4831a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 0x55e4831a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 -- 172.21.15.45:0/2077361621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 msgr2=0x55e4831a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 0x55e4831a6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 -- 172.21.15.45:0/2077361621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e482cef890 con 0x55e4831ef800 2023-07-09T02:12:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f7601b56640 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831efbd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f75f8011ce0 tx=0x7f75f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d7b5963248e640 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f75df7fe640 1 -- 172.21.15.45:0/2077361621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8011d10 con 0x55e4831ef800 2023-07-09T02:12:19.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f75df7fe640 1 -- 172.21.15.45:0/2077361621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8011e70 con 0x55e4831ef800 2023-07-09T02:12:19.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.656+0000 7f75df7fe640 1 -- 172.21.15.45:0/2077361621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8021640 con 0x55e4831ef800 2023-07-09T02:12:19.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- 172.21.15.45:0/2077361621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 msgr2=0x55e4831efbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831efbd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f75f8011ce0 tx=0x7f75f8014000 comp rx=0 tx=0).stop 2023-07-09T02:12:19.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- 172.21.15.45:0/2077361621 shutdown_connections 2023-07-09T02:12:19.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 0x55e4831a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 0x55e4831a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 --2- 172.21.15.45:0/2077361621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831efbd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- 172.21.15.45:0/2077361621 >> 172.21.15.45:0/2077361621 conn(0x55e483068a70 msgr2=0x55e4831a4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- 172.21.15.45:0/2077361621 shutdown_connections 2023-07-09T02:12:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- 172.21.15.45:0/2077361621 wait complete. 2023-07-09T02:12:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- start start 2023-07-09T02:12:19.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 Processor -- start 2023-07-09T02:12:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 0x55e4831b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831ef800 0x55e4831b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831f0110 0x55e4831b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482ff37a0 con 0x55e4831f0110 2023-07-09T02:12:19.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482faff00 con 0x55e4831ef800 2023-07-09T02:12:19.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e482fafba0 con 0x55e4831a5f90 2023-07-09T02:12:19.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 10 client.0 _ll_register_callbacks cb 0x55e483191930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:12:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831f0110 0x55e4831b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831f0110 0x55e4831b1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59404/0 (socket says 172.21.15.45:59404) 2023-07-09T02:12:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 -- 172.21.15.45:0/3521106444 learned_addr learned my addr 172.21.15.45:0/3521106444 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:19.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7601355640 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831ef800 0x55e4831b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7601b56640 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 0x55e4831b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 -- 172.21.15.45:0/3521106444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 msgr2=0x55e4831b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 0x55e4831b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 -- 172.21.15.45:0/3521106444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831ef800 msgr2=0x55e4831b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831ef800 0x55e4831b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 -- 172.21.15.45:0/3521106444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f80119c0 con 0x55e4831f0110 2023-07-09T02:12:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f7602357640 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831f0110 0x55e4831b1a50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f75f401c990 tx=0x7f75f40f4410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc9453390985eaf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f75dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:12:19.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f75dcff9640 1 -- 172.21.15.45:0/3521106444 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40f60b0 con 0x55e4831f0110 2023-07-09T02:12:19.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f75dcff9640 1 -- 172.21.15.45:0/3521106444 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75f40ef870 con 0x55e4831f0110 2023-07-09T02:12:19.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- 172.21.15.45:0/3521106444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e482ff20f0 con 0x55e4831f0110 2023-07-09T02:12:19.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f75dcff9640 1 -- 172.21.15.45:0/3521106444 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75f40f6210 con 0x55e4831f0110 2023-07-09T02:12:19.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 10 client.5328 fetch_fsmap learned FSMap version 16 2023-07-09T02:12:19.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f760712e000 1 -- 172.21.15.45:0/3521106444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e482fb8130 con 0x55e4831f0110 2023-07-09T02:12:19.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.660+0000 7f75dcff9640 1 -- 172.21.15.45:0/3521106444 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e482ff20f0 con 0x55e4831f0110 2023-07-09T02:12:19.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f75dcff9640 1 -- 172.21.15.45:0/3521106444 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f75f40c8020 con 0x55e4831f0110 2023-07-09T02:12:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 10 client.5328 fetch_fsmap finished waiting for FSMap version 16 2023-07-09T02:12:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 10 client.5328 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T02:12:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 20 client.5328 populate_metadata read hostname 'smithi045' 2023-07-09T02:12:19.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] conn(0x55e4831b2320 0x55e483200d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 4 client.5328 mds_command: new command op to 5151 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:12:19.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 -- 172.21.15.45:0/3521106444 --> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e482fbae40 con 0x55e4831b2320 2023-07-09T02:12:19.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f7601b56640 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] conn(0x55e4831b2320 0x55e483200d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f7601b56640 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] conn(0x55e4831b2320 0x55e483200d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b963a42193d9f25 server_cookie=f86dee13909e9d19 in_seq=0 out_seq=0 2023-07-09T02:12:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f75dcff9640 10 client.5328 ms_handle_connect on v2:172.21.15.45:6832/3290020828 2023-07-09T02:12:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f75dcff9640 1 -- 172.21.15.45:0/3521106444 <== mds.0 v2:172.21.15.45:6832/3290020828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e482fbae40 con 0x55e4831b2320 2023-07-09T02:12:19.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f75dcff9640 10 client.5328 handle_command_reply: tid=0 2023-07-09T02:12:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 client.5328 shutdown 2023-07-09T02:12:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 -- 172.21.15.45:0/3521106444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831f0110 msgr2=0x55e4831b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831f0110 0x55e4831b1a50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f75f401c990 tx=0x7f75f40f4410 comp rx=0 tx=0).stop 2023-07-09T02:12:19.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 -- 172.21.15.45:0/3521106444 shutdown_connections 2023-07-09T02:12:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] conn(0x55e4831b2320 0x55e483200d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831f0110 0x55e4831b1a50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831ef800 0x55e4831b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 --2- 172.21.15.45:0/3521106444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 0x55e4831b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 -- 172.21.15.45:0/3521106444 >> 172.21.15.45:0/3521106444 conn(0x55e483068a70 msgr2=0x55e4831a4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f75dcff9640 0 client.5328 ms_handle_reset on v2:172.21.15.45:6832/3290020828 2023-07-09T02:12:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 -- 172.21.15.45:0/3521106444 shutdown_connections 2023-07-09T02:12:19.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 1 -- 172.21.15.45:0/3521106444 wait complete. 2023-07-09T02:12:19.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.664+0000 7f760712e000 20 client.5328 trim_cache size 0 max 16384 2023-07-09T02:12:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f760712e000 1 Processor -- start 2023-07-09T02:12:19.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f760712e000 1 -- start start 2023-07-09T02:12:19.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f760712e000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 0x55e4831edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f760712e000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831ee520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f760712e000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 0x55e48320a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f760712e000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482cb0940 con 0x55e4831ef800 2023-07-09T02:12:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f760712e000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4831b18d0 con 0x55e4831a5f90 2023-07-09T02:12:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f760712e000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4831aa520 con 0x55e4831f0110 2023-07-09T02:12:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831ee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831ee520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59410/0 (socket says 172.21.15.45:59410) 2023-07-09T02:12:19.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 -- 172.21.15.45:0/3940228246 learned_addr learned my addr 172.21.15.45:0/3940228246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:19.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7602357640 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 0x55e48320a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601b56640 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 0x55e4831edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 -- 172.21.15.45:0/3940228246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 msgr2=0x55e48320a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 0x55e48320a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 -- 172.21.15.45:0/3940228246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 msgr2=0x55e4831edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 0x55e4831edfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 -- 172.21.15.45:0/3940228246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e482f9e3c0 con 0x55e4831ef800 2023-07-09T02:12:19.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f7601355640 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831ee520 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0016f0 tx=0x7f75ec001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea01338c41f2e53 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f75dffff640 1 -- 172.21.15.45:0/3940228246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0052e0 con 0x55e4831ef800 2023-07-09T02:12:19.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f75dffff640 1 -- 172.21.15.45:0/3940228246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec005440 con 0x55e4831ef800 2023-07-09T02:12:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.680+0000 7f75dffff640 1 -- 172.21.15.45:0/3940228246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec014ac0 con 0x55e4831ef800 2023-07-09T02:12:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- 172.21.15.45:0/3940228246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 msgr2=0x55e4831ee520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831ee520 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0016f0 tx=0x7f75ec001bb0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- 172.21.15.45:0/3940228246 shutdown_connections 2023-07-09T02:12:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831f0110 0x55e48320a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e4831ee520 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 --2- 172.21.15.45:0/3940228246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831a5f90 0x55e4831edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- 172.21.15.45:0/3940228246 >> 172.21.15.45:0/3940228246 conn(0x55e483068a70 msgr2=0x55e4831ec8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:19.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- 172.21.15.45:0/3940228246 shutdown_connections 2023-07-09T02:12:19.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- 172.21.15.45:0/3940228246 wait complete. 2023-07-09T02:12:19.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- start start 2023-07-09T02:12:19.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 Processor -- start 2023-07-09T02:12:19.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 0x55e483251720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e483251c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831f0110 0x55e48320c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e48319d7a0 con 0x55e4831ef800 2023-07-09T02:12:19.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4831a5ab0 con 0x55e4831f0110 2023-07-09T02:12:19.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e482f90ea0 con 0x55e4831a5f90 2023-07-09T02:12:19.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 10 client.0 _ll_register_callbacks cb 0x55e4831724d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:12:19.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e483251c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e483251c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59424/0 (socket says 172.21.15.45:59424) 2023-07-09T02:12:19.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 -- 172.21.15.45:0/635565119 learned_addr learned my addr 172.21.15.45:0/635565119 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:19.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7602357640 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831f0110 0x55e48320c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601b56640 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 0x55e483251720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 -- 172.21.15.45:0/635565119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 msgr2=0x55e483251720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 0x55e483251720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 -- 172.21.15.45:0/635565119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831f0110 msgr2=0x55e48320c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831f0110 0x55e48320c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 -- 172.21.15.45:0/635565119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec00f040 con 0x55e4831ef800 2023-07-09T02:12:19.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f7601355640 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e483251c60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55e483177060 tx=0x7f75ec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a4c4a7da44852c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f75dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:12:19.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f75dcff9640 1 -- 172.21.15.45:0/635565119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0052e0 con 0x55e4831ef800 2023-07-09T02:12:19.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- 172.21.15.45:0/635565119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4831a9920 con 0x55e4831ef800 2023-07-09T02:12:19.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f75dcff9640 1 -- 172.21.15.45:0/635565119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75ec0013c0 con 0x55e4831ef800 2023-07-09T02:12:19.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f75dcff9640 1 -- 172.21.15.45:0/635565119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75ec003810 con 0x55e4831ef800 2023-07-09T02:12:19.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 10 client.5334 fetch_fsmap learned FSMap version 16 2023-07-09T02:12:19.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.684+0000 7f760712e000 1 -- 172.21.15.45:0/635565119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e482cefcc0 con 0x55e4831ef800 2023-07-09T02:12:19.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f75dcff9640 1 -- 172.21.15.45:0/635565119 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4831a9920 con 0x55e4831ef800 2023-07-09T02:12:19.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f75dcff9640 1 -- 172.21.15.45:0/635565119 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f75ec003970 con 0x55e4831ef800 2023-07-09T02:12:19.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 10 client.5334 fetch_fsmap finished waiting for FSMap version 16 2023-07-09T02:12:19.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 10 client.5334 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T02:12:19.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 20 client.5334 populate_metadata read hostname 'smithi045' 2023-07-09T02:12:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] conn(0x55e4832585f0 0x55e48325a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 4 client.5334 mds_command: new command op to 5151 tid=0[{"prefix": "status"}] 2023-07-09T02:12:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 -- 172.21.15.45:0/635565119 --> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e482fac6f0 con 0x55e4832585f0 2023-07-09T02:12:19.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7601b56640 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] conn(0x55e4832585f0 0x55e48325a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7601b56640 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] conn(0x55e4832585f0 0x55e48325a9d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=879c0d5a0df340a9 server_cookie=bd8e6836aaa479 in_seq=0 out_seq=0 2023-07-09T02:12:19.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f75dcff9640 10 client.5334 ms_handle_connect on v2:172.21.15.45:6832/3290020828 2023-07-09T02:12:19.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f75dcff9640 1 -- 172.21.15.45:0/635565119 <== mds.0 v2:172.21.15.45:6832/3290020828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e482fac6f0 con 0x55e4832585f0 2023-07-09T02:12:19.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f75dcff9640 10 client.5334 handle_command_reply: tid=0 2023-07-09T02:12:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 client.5334 shutdown 2023-07-09T02:12:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 -- 172.21.15.45:0/635565119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 msgr2=0x55e483251c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e483251c60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55e483177060 tx=0x7f75ec000ee0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 -- 172.21.15.45:0/635565119 shutdown_connections 2023-07-09T02:12:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.45:6832/3290020828,v1:172.21.15.45:6835/3290020828] conn(0x55e4832585f0 0x55e48325a9d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e4831f0110 0x55e48320c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4831ef800 0x55e483251c60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f75dcff9640 0 client.5334 ms_handle_reset on v2:172.21.15.45:6832/3290020828 2023-07-09T02:12:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 --2- 172.21.15.45:0/635565119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55e4831a5f90 0x55e483251720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 -- 172.21.15.45:0/635565119 >> 172.21.15.45:0/635565119 conn(0x55e483068a70 msgr2=0x55e4831eea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:19.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 -- 172.21.15.45:0/635565119 shutdown_connections 2023-07-09T02:12:19.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 1 -- 172.21.15.45:0/635565119 wait complete. 2023-07-09T02:12:19.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f760712e000 20 client.5334 trim_cache size 0 max 16384 2023-07-09T02:12:19.726 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:12:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:12:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:12:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5151, 2023-07-09T02:12:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:12:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:12:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:12:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9392653190000004, 2023-07-09T02:12:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 16, 2023-07-09T02:12:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 35, 2023-07-09T02:12:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 35, 2023-07-09T02:12:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 13.811075689999999 2023-07-09T02:12:19.728 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:12:19.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 -- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75e0066280 msgr2=0x7f75e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75e0066280 0x7f75e0068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009a50 tx=0x7f75f8008040 comp rx=0 tx=0).stop 2023-07-09T02:12:19.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 -- 172.21.15.45:0/705491285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc159fd0 msgr2=0x7f75fc0c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc159fd0 0x7f75fc0c5600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f75f40af040 tx=0x7f75f40196f0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 -- 172.21.15.45:0/705491285 shutdown_connections 2023-07-09T02:12:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc159fd0 0x7f75fc0c5600 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0cf020 0x7f75fc14e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75e0066280 0x7f75e0068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 --2- 172.21.15.45:0/705491285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0b2e00 0x7f75fc1462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 -- 172.21.15.45:0/705491285 >> 172.21.15.45:0/705491285 conn(0x7f75fc0650b0 msgr2=0x7f75fc0b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 -- 172.21.15.45:0/705491285 shutdown_connections 2023-07-09T02:12:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.688+0000 7f7602b58640 1 -- 172.21.15.45:0/705491285 wait complete. 2023-07-09T02:12:19.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:12:19.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.872+0000 7f587e65c640 1 Processor -- start 2023-07-09T02:12:19.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.872+0000 7f587e65c640 1 -- start start 2023-07-09T02:12:19.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f587e65c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f587806a5c0 0x7f587815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f587e65c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f587806aa40 0x7f5878160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f587e65c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5878071140 con 0x7f58780cd290 2023-07-09T02:12:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f587e65c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587806b010 con 0x7f587806a5c0 2023-07-09T02:12:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f587e65c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587815c970 con 0x7f587806aa40 2023-07-09T02:12:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f58777fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f587806a5c0 0x7f587815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f58777fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f587806a5c0 0x7f587815fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59430/0 (socket says 172.21.15.45:59430) 2023-07-09T02:12:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f5877fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f58780cd290 0x7f58780cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47204/0 (socket says 172.21.15.45:47204) 2023-07-09T02:12:19.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f58777fe640 1 -- 172.21.15.45:0/2855367829 learned_addr learned my addr 172.21.15.45:0/2855367829 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:19.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f587cbf9640 1 --2- 172.21.15.45:0/2855367829 >> v2:172.21.15.155:3300/0 conn(0x7f587806aa40 0x7f5878160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f58777fe640 1 -- 172.21.15.45:0/2855367829 >> v2:172.21.15.155:3300/0 conn(0x7f587806aa40 msgr2=0x7f5878160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f58777fe640 1 --2- 172.21.15.45:0/2855367829 >> v2:172.21.15.155:3300/0 conn(0x7f587806aa40 0x7f5878160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f58777fe640 1 -- 172.21.15.45:0/2855367829 >> v1:172.21.15.45:6789/0 conn(0x7f58780cd290 legacy=0x7f58780cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f58777fe640 1 -- 172.21.15.45:0/2855367829 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587815cc50 con 0x7f587806a5c0 2023-07-09T02:12:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.876+0000 7f5876ffd640 1 -- 172.21.15.45:0/2855367829 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932005095 0 0) 0x7f5878071140 con 0x7f58780cd290 2023-07-09T02:12:19.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f58777fe640 1 --2- 172.21.15.45:0/2855367829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587815fdd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f587815fd10 tx=0x7f586c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b575c2bdb6be8e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f5876ffd640 1 -- 172.21.15.45:0/2855367829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0ab600 con 0x7f587806a5c0 2023-07-09T02:12:19.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f5876ffd640 1 -- 172.21.15.45:0/2855367829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c0a7050 con 0x7f587806a5c0 2023-07-09T02:12:19.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f5876ffd640 1 -- 172.21.15.45:0/2855367829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0ab980 con 0x7f587806a5c0 2023-07-09T02:12:19.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- 172.21.15.45:0/2855367829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 msgr2=0x7f587815fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 --2- 172.21.15.45:0/2855367829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587815fdd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f587815fd10 tx=0x7f586c01c500 comp rx=0 tx=0).stop 2023-07-09T02:12:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- 172.21.15.45:0/2855367829 shutdown_connections 2023-07-09T02:12:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 --2- 172.21.15.45:0/2855367829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587815fdd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 --2- 172.21.15.45:0/2855367829 >> v2:172.21.15.155:3300/0 conn(0x7f587806aa40 0x7f5878160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- 172.21.15.45:0/2855367829 >> 172.21.15.45:0/2855367829 conn(0x7f587806d140 msgr2=0x7f587806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- 172.21.15.45:0/2855367829 shutdown_connections 2023-07-09T02:12:19.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- 172.21.15.45:0/2855367829 wait complete. 2023-07-09T02:12:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 Processor -- start 2023-07-09T02:12:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- start start 2023-07-09T02:12:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f587806aa40 0x7f5878151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58780cd290 0x7f587815e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587815f1b0 con 0x7f587806a5c0 2023-07-09T02:12:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587815f730 con 0x7f587806aa40 2023-07-09T02:12:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.880+0000 7f587e65c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587815f450 con 0x7f58780cd290 2023-07-09T02:12:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587814db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59442/0 (socket says 172.21.15.45:59442) 2023-07-09T02:12:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 -- 172.21.15.45:0/2946422657 learned_addr learned my addr 172.21.15.45:0/2946422657 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:19.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 -- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58780cd290 msgr2=0x7f587815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f58777fe640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f587806aa40 0x7f5878151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58780cd290 0x7f587815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 -- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f587806aa40 msgr2=0x7f5878151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:19.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f587806aa40 0x7f5878151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:19.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 -- 172.21.15.45:0/2946422657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c0094d0 con 0x7f587806a5c0 2023-07-09T02:12:19.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f58777fe640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f587806aa40 0x7f5878151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:19.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5877fff640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587814db90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f586800c480 tx=0x7f586800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5874ff9640 1 -- 172.21.15.45:0/2946422657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680074e0 con 0x7f587806a5c0 2023-07-09T02:12:19.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5874ff9640 1 -- 172.21.15.45:0/2946422657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868007660 con 0x7f587806a5c0 2023-07-09T02:12:19.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5874ff9640 1 -- 172.21.15.45:0/2946422657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868004a30 con 0x7f587806a5c0 2023-07-09T02:12:19.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587815d950 con 0x7f587806a5c0 2023-07-09T02:12:19.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587814e0d0 con 0x7f587806a5c0 2023-07-09T02:12:19.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587804d7d0 con 0x7f587806a5c0 2023-07-09T02:12:19.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.884+0000 7f5874ff9640 1 -- 172.21.15.45:0/2946422657 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5868004b90 con 0x7f587806a5c0 2023-07-09T02:12:19.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.888+0000 7f5874ff9640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5864066280 0x7f5864068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:19.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.888+0000 7f5874ff9640 1 -- 172.21.15.45:0/2946422657 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5868082f30 con 0x7f587806a5c0 2023-07-09T02:12:19.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.888+0000 7f58777fe640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5864066280 0x7f5864068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:19.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.888+0000 7f58777fe640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5864066280 0x7f5864068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f586c0ad000 tx=0x7f586c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:19.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:19.892+0000 7f5874ff9640 1 -- 172.21.15.45:0/2946422657 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5868053e30 con 0x7f587806a5c0 2023-07-09T02:12:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.080+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f587815d730 con 0x7f587806a5c0 2023-07-09T02:12:20.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.080+0000 7f5874ff9640 1 -- 172.21.15.45:0/2946422657 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5868018020 con 0x7f587806a5c0 2023-07-09T02:12:20.083 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:12:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.080+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5864066280 msgr2=0x7f5864068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.080+0000 7f587e65c640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5864066280 0x7f5864068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f586c0ad000 tx=0x7f586c008040 comp rx=0 tx=0).stop 2023-07-09T02:12:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.080+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 msgr2=0x7f587814db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.080+0000 7f587e65c640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587814db90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f586800c480 tx=0x7f586800c940 comp rx=0 tx=0).stop 2023-07-09T02:12:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.084+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 shutdown_connections 2023-07-09T02:12:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.084+0000 7f587e65c640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5864066280 0x7f5864068730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.084+0000 7f587e65c640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58780cd290 0x7f587815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.084+0000 7f587e65c640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f587806aa40 0x7f5878151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.084+0000 7f587e65c640 1 --2- 172.21.15.45:0/2946422657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f587806a5c0 0x7f587814db90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.084+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 >> 172.21.15.45:0/2946422657 conn(0x7f587806d140 msgr2=0x7f58780cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.084+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 shutdown_connections 2023-07-09T02:12:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.084+0000 7f587e65c640 1 -- 172.21.15.45:0/2946422657 wait complete. 2023-07-09T02:12:20.104 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:12:20.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:12:20.104 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:12:20.105 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:12:20.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:20.105 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:12:20.106 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:12:20.106 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:12:20.106 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:12:20.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.107 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:12:20.117 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:12:20.117 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:12:20.117 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:12:20.117 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:20.117 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:12:20.117 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:20.118 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:20.118 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:20.118 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:12:20.118 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:12:20.118 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:20.118 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:12:20.118 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:12:20.118 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42387sec preferred_lft 42387sec 2023-07-09T02:12:20.119 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:12:20.119 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:20.119 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:20.119 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:20.119 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:12:20.119 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:20.119 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:20.119 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:12:20.120 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:12:20.120 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:20.120 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:12:20.120 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:20.120 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:12:20.120 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:20.120 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:12:20.121 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:20.121 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:12:20.121 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:20.121 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:12:20.121 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:12:20.121 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:12:20.121 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:20.121 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:12:20.122 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:12:20.122 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:12:20.122 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:20.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.123 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:12:20.187 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:12:20.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.190 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:12:20.242 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:12:20.242 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:12:20.242 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:12:20.242 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:12:20.242 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:12:20.242 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:12:20.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.243 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:12:20.244 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:12:20.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:12:20.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:12:20.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:12:20.245 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:12:20.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.338 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:12:20.348 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:12:20.348 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:12:20.349 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:12:20.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:12:20.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:12:20.417 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:20.465 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:12:20.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:12:20.466 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:20.516 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:12:20.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:20.612 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:20.612 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:12:20.624 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:20.624 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:12:20.624 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:12:20.625 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:12:20.625 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:12:20.628 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:12:20.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:20.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:20.651 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:12:20.708 INFO:teuthology.orchestra.run.smithi045.stdout:client5227 2023-07-09T02:12:20.709 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:20.709 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:20.765 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:12:20.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc9e9c640 1 Processor -- start 2023-07-09T02:12:20.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc9e9c640 1 -- start start 2023-07-09T02:12:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc9e9c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1dc415c060 0x7f1dc40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc9e9c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc4160a50 con 0x7f1dc40d2620 2023-07-09T02:12:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc9e9c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc415c430 con 0x7f1dc40cd120 2023-07-09T02:12:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc9e9c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc415fb60 con 0x7f1dc415c060 2023-07-09T02:12:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1dc415c060 0x7f1dc40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1dc40d2620 0x7f1dc40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47212/0 (socket says 172.21.15.45:47212) 2023-07-09T02:12:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.952+0000 7f1dc3fff640 1 -- 172.21.15.45:0/3188472589 learned_addr learned my addr 172.21.15.45:0/3188472589 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.956+0000 7f1dc37fe640 1 -- 172.21.15.45:0/3188472589 >> v1:172.21.15.155:6789/0 conn(0x7f1dc40cd120 legacy=0x7f1dc40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.956+0000 7f1dc37fe640 1 -- 172.21.15.45:0/3188472589 >> v1:172.21.15.45:6789/0 conn(0x7f1dc40d2620 legacy=0x7f1dc40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.956+0000 7f1dc37fe640 1 -- 172.21.15.45:0/3188472589 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc415fe40 con 0x7f1dc415c060 2023-07-09T02:12:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.956+0000 7f1dc27fc640 1 -- 172.21.15.45:0/3188472589 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392471443 0 0) 0x7f1dc4160a50 con 0x7f1dc40d2620 2023-07-09T02:12:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.956+0000 7f1dc37fe640 1 --2- 172.21.15.45:0/3188472589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc40b4ed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1db40097c0 tx=0x7f1db401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38575d607e0a1c7c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.956+0000 7f1dc27fc640 1 -- 172.21.15.45:0/3188472589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db40ab610 con 0x7f1dc415c060 2023-07-09T02:12:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.956+0000 7f1dc27fc640 1 -- 172.21.15.45:0/3188472589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db40ab770 con 0x7f1dc415c060 2023-07-09T02:12:20.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.956+0000 7f1dc27fc640 1 -- 172.21.15.45:0/3188472589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db40abb00 con 0x7f1dc415c060 2023-07-09T02:12:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3188472589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 msgr2=0x7f1dc40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 --2- 172.21.15.45:0/3188472589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc40b4ed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1db40097c0 tx=0x7f1db401c410 comp rx=0 tx=0).stop 2023-07-09T02:12:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3188472589 shutdown_connections 2023-07-09T02:12:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 --2- 172.21.15.45:0/3188472589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc40b4ed0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:20.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3188472589 >> 172.21.15.45:0/3188472589 conn(0x7f1dc40698e0 msgr2=0x7f1dc4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:20.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3188472589 shutdown_connections 2023-07-09T02:12:20.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3188472589 wait complete. 2023-07-09T02:12:20.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 Processor -- start 2023-07-09T02:12:20.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- start start 2023-07-09T02:12:20.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dc40cd120 0x7f1dc414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:20.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dc40d2620 0x7f1dc415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:20.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc414e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:20.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4154ed0 con 0x7f1dc415c060 2023-07-09T02:12:20.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc415f630 con 0x7f1dc40cd120 2023-07-09T02:12:20.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc9e9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4152d70 con 0x7f1dc40d2620 2023-07-09T02:12:20.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc414e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:20.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dc40cd120 0x7f1dc414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:20.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc414e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59466/0 (socket says 172.21.15.45:59466) 2023-07-09T02:12:20.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc3fff640 1 -- 172.21.15.45:0/3981677128 learned_addr learned my addr 172.21.15.45:0/3981677128 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:20.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc2ffd640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dc40d2620 0x7f1dc415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:20.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc3fff640 1 -- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dc40d2620 msgr2=0x7f1dc415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:20.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc3fff640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dc40d2620 0x7f1dc415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:20.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc3fff640 1 -- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dc40cd120 msgr2=0x7f1dc414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:20.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc3fff640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dc40cd120 0x7f1dc414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:20.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.960+0000 7f1dc3fff640 1 -- 172.21.15.45:0/3981677128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4009420 con 0x7f1dc415c060 2023-07-09T02:12:20.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dc3fff640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc414e8d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc002240 tx=0x7f1dbc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:20.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dabfff640 1 -- 172.21.15.45:0/3981677128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00cea0 con 0x7f1dc415c060 2023-07-09T02:12:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dabfff640 1 -- 172.21.15.45:0/3981677128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc00a640 con 0x7f1dc415c060 2023-07-09T02:12:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dabfff640 1 -- 172.21.15.45:0/3981677128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc00a9f0 con 0x7f1dc415c060 2023-07-09T02:12:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc40b59f0 con 0x7f1dc415c060 2023-07-09T02:12:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc415c7c0 con 0x7f1dc415c060 2023-07-09T02:12:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc415c620 con 0x7f1dc415c060 2023-07-09T02:12:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dabfff640 1 -- 172.21.15.45:0/3981677128 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1dbc00ab50 con 0x7f1dc415c060 2023-07-09T02:12:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.964+0000 7f1dabfff640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1db0066280 0x7f1db0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:20.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.968+0000 7f1dabfff640 1 -- 172.21.15.45:0/3981677128 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1dbc083230 con 0x7f1dc415c060 2023-07-09T02:12:20.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.968+0000 7f1dc37fe640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1db0066280 0x7f1db0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:20.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.968+0000 7f1dc37fe640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1db0066280 0x7f1db0068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1db40af000 tx=0x7f1db40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:20.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:20.968+0000 7f1dabfff640 1 -- 172.21.15.45:0/3981677128 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1dc415c620 con 0x7f1dc415c060 2023-07-09T02:12:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.156+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1dc415c620 con 0x7f1dc415c060 2023-07-09T02:12:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.156+0000 7f1dabfff640 1 -- 172.21.15.45:0/3981677128 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1dc415c620 con 0x7f1dc415c060 2023-07-09T02:12:21.161 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:12:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1db0066280 msgr2=0x7f1db0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1db0066280 0x7f1db0068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1db40af000 tx=0x7f1db40a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 msgr2=0x7f1dc414e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc414e8d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc002240 tx=0x7f1dbc00cc50 comp rx=0 tx=0).stop 2023-07-09T02:12:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 shutdown_connections 2023-07-09T02:12:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc415c060 0x7f1dc414e8d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1db0066280 0x7f1db0068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1dc40d2620 0x7f1dc415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 --2- 172.21.15.45:0/3981677128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dc40cd120 0x7f1dc414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 >> 172.21.15.45:0/3981677128 conn(0x7f1dc40698e0 msgr2=0x7f1dc40b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 shutdown_connections 2023-07-09T02:12:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.160+0000 7f1dc9e9c640 1 -- 172.21.15.45:0/3981677128 wait complete. 2023-07-09T02:12:21.182 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:12:21.182 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:12:21.183 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:12:21.183 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:12:21.183 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:21.184 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:12:21.184 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:12:21.184 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:12:21.184 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:12:21.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.185 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:12:21.196 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:12:21.196 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:12:21.196 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:12:21.197 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:21.197 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:12:21.197 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:21.197 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:12:21.198 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:12:21.198 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:21.198 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:21.199 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:12:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:12:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-07-09T02:12:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:12:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:21.199 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:12:21.199 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:12:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:21.200 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:12:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:12:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:21.200 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:12:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:21.201 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:12:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:12:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:12:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:21.201 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:12:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:12:21.201 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:12:21.202 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:21.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.203 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:12:21.265 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:12:21.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.267 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:12:21.323 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:12:21.323 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:12:21.323 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:12:21.323 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:12:21.323 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:12:21.325 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:12:21.325 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:12:21.325 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:12:21.325 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:12:21.325 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:12:21.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.326 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:12:21.326 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:12:21.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:12:21.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:12:21.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:12:21.328 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:12:21.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.419 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:12:21.428 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:12:21.428 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:12:21.429 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:12:21.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:12:21.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:12:21.493 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:21.544 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:12:21.545 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:12:21.545 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:21.595 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:12:21.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.596 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:21.686 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:21.687 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:12:21.700 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:21.700 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:12:21.700 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:12:21.700 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:12:21.701 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:12:21.703 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:12:21.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.704 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:21.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:21.725 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:12:21.783 INFO:teuthology.orchestra.run.smithi155.stdout:client4952 2023-07-09T02:12:21.783 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:12:21.784 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:21.832 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:21.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9c6619640 1 Processor -- start 2023-07-09T02:12:21.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9c6619640 1 -- start start 2023-07-09T02:12:21.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9c6619640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9c00ccc50 0x7fe9c00c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:21.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9c6619640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c00c98c0 con 0x7fe9c00cb0d0 2023-07-09T02:12:21.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9c6619640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c00cd1d0 con 0x7fe9c015c110 2023-07-09T02:12:21.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9c6619640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c00cd4b0 con 0x7fe9c00ccc50 2023-07-09T02:12:21.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9c4bb6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe9c00cb0d0 0x7fe9c006b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59476/0 (socket says 172.21.15.45:59476) 2023-07-09T02:12:21.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9c4bb6640 1 -- 172.21.15.45:0/1904997550 learned_addr learned my addr 172.21.15.45:0/1904997550 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:21.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.980+0000 7fe9bf7fe640 1 --2- 172.21.15.45:0/1904997550 >> v2:172.21.15.155:3300/0 conn(0x7fe9c00ccc50 0x7fe9c00c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:21.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9bf7fe640 1 -- 172.21.15.45:0/1904997550 >> v1:172.21.15.155:6789/0 conn(0x7fe9c015c110 legacy=0x7fe9c01607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:21.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9beffd640 1 -- 172.21.15.45:0/1904997550 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187110445 0 0) 0x7fe9c00c98c0 con 0x7fe9c00cb0d0 2023-07-09T02:12:21.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9bf7fe640 1 -- 172.21.15.45:0/1904997550 >> v1:172.21.15.45:6789/0 conn(0x7fe9c00cb0d0 legacy=0x7fe9c006b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:21.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9bf7fe640 1 -- 172.21.15.45:0/1904997550 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00c9270 con 0x7fe9c00ccc50 2023-07-09T02:12:21.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9bf7fe640 1 --2- 172.21.15.45:0/1904997550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00ccc50 0x7fe9c00c9d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40097c0 tx=0x7fe9b401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f98053e8ca133af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9beffd640 1 -- 172.21.15.45:0/1904997550 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40ad660 con 0x7fe9c00ccc50 2023-07-09T02:12:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9beffd640 1 -- 172.21.15.45:0/1904997550 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b40ad7c0 con 0x7fe9c00ccc50 2023-07-09T02:12:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9beffd640 1 -- 172.21.15.45:0/1904997550 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40adb50 con 0x7fe9c00ccc50 2023-07-09T02:12:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9c6619640 1 -- 172.21.15.45:0/1904997550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00ccc50 msgr2=0x7fe9c00c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9c6619640 1 --2- 172.21.15.45:0/1904997550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00ccc50 0x7fe9c00c9d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40097c0 tx=0x7fe9b401c450 comp rx=0 tx=0).stop 2023-07-09T02:12:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9c6619640 1 -- 172.21.15.45:0/1904997550 shutdown_connections 2023-07-09T02:12:21.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9c6619640 1 --2- 172.21.15.45:0/1904997550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00ccc50 0x7fe9c00c9d50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:21.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.984+0000 7fe9c6619640 1 -- 172.21.15.45:0/1904997550 >> 172.21.15.45:0/1904997550 conn(0x7fe9c00694b0 msgr2=0x7fe9c00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:21.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 -- 172.21.15.45:0/1904997550 shutdown_connections 2023-07-09T02:12:21.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 -- 172.21.15.45:0/1904997550 wait complete. 2023-07-09T02:12:21.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 Processor -- start 2023-07-09T02:12:21.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 -- start start 2023-07-09T02:12:21.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00cb0d0 0x7fe9c00b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:21.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c00ccc50 0x7fe9c00b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:21.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c015c110 0x7fe9c01f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:21.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00b24c0 con 0x7fe9c015c110 2023-07-09T02:12:21.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c015f610 con 0x7fe9c00cb0d0 2023-07-09T02:12:21.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c6619640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00b45c0 con 0x7fe9c00ccc50 2023-07-09T02:12:21.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c015c110 0x7fe9c01f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:21.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c015c110 0x7fe9c01f8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52612/0 (socket says 172.21.15.45:52612) 2023-07-09T02:12:21.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 -- 172.21.15.45:0/2752393197 learned_addr learned my addr 172.21.15.45:0/2752393197 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9bffff640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00cb0d0 0x7fe9c00b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:21.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9bf7fe640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c00ccc50 0x7fe9c00b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 -- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c00ccc50 msgr2=0x7fe9c00b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c00ccc50 0x7fe9c00b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 -- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00cb0d0 msgr2=0x7fe9c00b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:21.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00cb0d0 0x7fe9c00b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:21.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 -- 172.21.15.45:0/2752393197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b4009420 con 0x7fe9c015c110 2023-07-09T02:12:21.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9bf7fe640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c00ccc50 0x7fe9c00b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:21.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9bffff640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00cb0d0 0x7fe9c00b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:21.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.988+0000 7fe9c4bb6640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c015c110 0x7fe9c01f8ab0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c810 tx=0x7fe9b800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:21.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9bcff9640 1 -- 172.21.15.45:0/2752393197 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800a640 con 0x7fe9c015c110 2023-07-09T02:12:21.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9bcff9640 1 -- 172.21.15.45:0/2752393197 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b800a7c0 con 0x7fe9c015c110 2023-07-09T02:12:21.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9bcff9640 1 -- 172.21.15.45:0/2752393197 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800ab70 con 0x7fe9c015c110 2023-07-09T02:12:21.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c01f8ff0 con 0x7fe9c015c110 2023-07-09T02:12:21.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c015f050 con 0x7fe9c015c110 2023-07-09T02:12:21.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c00c6600 con 0x7fe9c015c110 2023-07-09T02:12:21.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9bcff9640 1 -- 172.21.15.45:0/2752393197 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9b800acd0 con 0x7fe9c015c110 2023-07-09T02:12:21.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9bcff9640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066280 0x7fe9ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:21.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9bcff9640 1 -- 172.21.15.45:0/2752393197 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe9b8083250 con 0x7fe9c015c110 2023-07-09T02:12:21.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.992+0000 7fe9bffff640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066280 0x7fe9ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.996+0000 7fe9bffff640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066280 0x7fe9ac068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00ac830 tx=0x7fe9b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:22.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:21.996+0000 7fe9bcff9640 1 -- 172.21.15.45:0/2752393197 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9c00c6600 con 0x7fe9c015c110 2023-07-09T02:12:22.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.188+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9c00c6600 con 0x7fe9c015c110 2023-07-09T02:12:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.188+0000 7fe9bcff9640 1 -- 172.21.15.45:0/2752393197 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fe9c00c6600 con 0x7fe9c015c110 2023-07-09T02:12:22.192 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:22.192 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:13.135771+0000","modified":"2023-07-09T02:12:16.783642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3290020828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3290020828},{"type":"v1","addr":"172.21.15.45:6835","nonce":3290020828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T02:12:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-07-09T02:12:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066280 msgr2=0x7fe9ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066280 0x7fe9ac068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00ac830 tx=0x7fe9b0009040 comp rx=0 tx=0).stop 2023-07-09T02:12:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c015c110 msgr2=0x7fe9c01f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c015c110 0x7fe9c01f8ab0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c810 tx=0x7fe9b800ccd0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 shutdown_connections 2023-07-09T02:12:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9c015c110 0x7fe9c01f8ab0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9ac066280 0x7fe9ac068730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c00ccc50 0x7fe9c00b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 --2- 172.21.15.45:0/2752393197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c00cb0d0 0x7fe9c00b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 >> 172.21.15.45:0/2752393197 conn(0x7fe9c00694b0 msgr2=0x7fe9c00c4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 shutdown_connections 2023-07-09T02:12:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.192+0000 7fe9c6619640 1 -- 172.21.15.45:0/2752393197 wait complete. 2023-07-09T02:12:22.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-07-09T02:12:22.377 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":5151,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.6114628839999998,"mdsmap_epoch":16,"osdmap_epoch":35,"osdmap_epoch_barrier":35,"uptime":16.483276434} 2023-07-09T02:12:22.378 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 5151, "mdsmap_epoch": 16, "osdmap_epoch": 35, "osdmap_epoch_barrier": 35, "rank_uptime": 8.611462884, "state": "up:active", "uptime": 16.483276434, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:12:22.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-07-09T02:12:22.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbf3fa640 1 Processor -- start 2023-07-09T02:12:22.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbf3fa640 1 -- start start 2023-07-09T02:12:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbf3fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cb80b1f20 0x7f2cb80b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbf3fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80d2560 0x7f2cb80cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbf3fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80cd1a0 con 0x7f2cb80b4530 2023-07-09T02:12:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbf3fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80b22f0 con 0x7f2cb80b1f20 2023-07-09T02:12:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbf3fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb8160a70 con 0x7f2cb80d2560 2023-07-09T02:12:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbd196640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cb80b1f20 0x7f2cb80b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbd196640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cb80b1f20 0x7f2cb80b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52620/0 (socket says 172.21.15.45:52620) 2023-07-09T02:12:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbd196640 1 -- 172.21.15.45:0/2296358530 learned_addr learned my addr 172.21.15.45:0/2296358530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbc995640 1 --2- 172.21.15.45:0/2296358530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80d2560 0x7f2cb80cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbd196640 1 -- 172.21.15.45:0/2296358530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80d2560 msgr2=0x7f2cb80cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbd196640 1 --2- 172.21.15.45:0/2296358530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80d2560 0x7f2cb80cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbd196640 1 -- 172.21.15.45:0/2296358530 >> v1:172.21.15.155:6789/0 conn(0x7f2cb80b4530 legacy=0x7f2cb80d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbd196640 1 -- 172.21.15.45:0/2296358530 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80cd440 con 0x7f2cb80b1f20 2023-07-09T02:12:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.520+0000 7f2cbc995640 1 --2- 172.21.15.45:0/2296358530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80d2560 0x7f2cb80cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbd196640 1 --2- 172.21.15.45:0/2296358530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b1f20 0x7f2cb80b5900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009870 tx=0x7f2cb401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc0f4df4b188cb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2caffff640 1 -- 172.21.15.45:0/2296358530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40a89b0 con 0x7f2cb80b1f20 2023-07-09T02:12:22.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2caffff640 1 -- 172.21.15.45:0/2296358530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb40a8b10 con 0x7f2cb80b1f20 2023-07-09T02:12:22.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2caffff640 1 -- 172.21.15.45:0/2296358530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40a8ea0 con 0x7f2cb80b1f20 2023-07-09T02:12:22.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/2296358530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b1f20 msgr2=0x7f2cb80b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/2296358530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b1f20 0x7f2cb80b5900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009870 tx=0x7f2cb401ecf0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/2296358530 shutdown_connections 2023-07-09T02:12:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/2296358530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80d2560 0x7f2cb80cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/2296358530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b1f20 0x7f2cb80b5900 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/2296358530 >> 172.21.15.45:0/2296358530 conn(0x7f2cb806a510 msgr2=0x7f2cb80cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/2296358530 shutdown_connections 2023-07-09T02:12:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.524+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/2296358530 wait complete. 2023-07-09T02:12:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 Processor -- start 2023-07-09T02:12:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 -- start start 2023-07-09T02:12:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80b1f20 0x7f2cb815db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b4530 0x7f2cb81f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb80d2560 0x7f2cb81f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81f5d10 con 0x7f2cb80b4530 2023-07-09T02:12:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb815e0d0 con 0x7f2cb80d2560 2023-07-09T02:12:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81f5750 con 0x7f2cb80b1f20 2023-07-09T02:12:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b4530 0x7f2cb81f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b4530 0x7f2cb81f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52632/0 (socket says 172.21.15.45:52632) 2023-07-09T02:12:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 -- 172.21.15.45:0/1388832698 learned_addr learned my addr 172.21.15.45:0/1388832698 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbd196640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80b1f20 0x7f2cb815db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbd997640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb80d2560 0x7f2cb81f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 -- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80b1f20 msgr2=0x7f2cb815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80b1f20 0x7f2cb815db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 -- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb80d2560 msgr2=0x7f2cb81f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb80d2560 0x7f2cb81f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 -- 172.21.15.45:0/1388832698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40094d0 con 0x7f2cb80b4530 2023-07-09T02:12:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbd997640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb80d2560 0x7f2cb81f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbc995640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b4530 0x7f2cb81f4e20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c7f0 tx=0x7f2ca800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cadffb640 1 -- 172.21.15.45:0/1388832698 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8007820 con 0x7f2cb80b4530 2023-07-09T02:12:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cadffb640 1 -- 172.21.15.45:0/1388832698 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8007980 con 0x7f2cb80b4530 2023-07-09T02:12:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cadffb640 1 -- 172.21.15.45:0/1388832698 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8007d30 con 0x7f2cb80b4530 2023-07-09T02:12:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb81f5a30 con 0x7f2cb80b4530 2023-07-09T02:12:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.528+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb80c9f90 con 0x7f2cb80b4530 2023-07-09T02:12:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.532+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb804d7d0 con 0x7f2cb80b4530 2023-07-09T02:12:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.532+0000 7f2cadffb640 1 -- 172.21.15.45:0/1388832698 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ca80113f0 con 0x7f2cb80b4530 2023-07-09T02:12:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.532+0000 7f2cadffb640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c9c066280 0x7f2c9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.532+0000 7f2cadffb640 1 -- 172.21.15.45:0/1388832698 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ca8083f00 con 0x7f2cb80b4530 2023-07-09T02:12:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.532+0000 7f2cbd196640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c9c066280 0x7f2c9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.532+0000 7f2cbd196640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c9c066280 0x7f2c9c068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40b2000 tx=0x7f2cb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:22.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.536+0000 7f2cadffb640 1 -- 172.21.15.45:0/1388832698 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ca80514c0 con 0x7f2cb80b4530 2023-07-09T02:12:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.744+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f2cb80cfd80 con 0x7f2cb80b4530 2023-07-09T02:12:22.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.744+0000 7f2cadffb640 1 -- 172.21.15.45:0/1388832698 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1920 (secure 0 0 0) 0x7f2ca801f090 con 0x7f2cb80b4530 2023-07-09T02:12:22.749 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:22.749 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:12:22.749 INFO:teuthology.orchestra.run.smithi045.stdout: "stats": { 2023-07-09T02:12:22.749 INFO:teuthology.orchestra.run.smithi045.stdout: "total_bytes": 1600000000, 2023-07-09T02:12:22.749 INFO:teuthology.orchestra.run.smithi045.stdout: "total_avail_bytes": 1597523668, 2023-07-09T02:12:22.750 INFO:teuthology.orchestra.run.smithi045.stdout: "total_used_bytes": 2476332, 2023-07-09T02:12:22.750 INFO:teuthology.orchestra.run.smithi045.stdout: "total_used_raw_bytes": 2476332, 2023-07-09T02:12:22.750 INFO:teuthology.orchestra.run.smithi045.stdout: "total_used_raw_ratio": 0.0015477074775844812, 2023-07-09T02:12:22.751 INFO:teuthology.orchestra.run.smithi045.stdout: "num_osds": 8, 2023-07-09T02:12:22.751 INFO:teuthology.orchestra.run.smithi045.stdout: "num_per_pool_osds": 0, 2023-07-09T02:12:22.751 INFO:teuthology.orchestra.run.smithi045.stdout: "num_per_pool_omap_osds": 0 2023-07-09T02:12:22.751 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:22.751 INFO:teuthology.orchestra.run.smithi045.stdout: "stats_by_class": { 2023-07-09T02:12:22.751 INFO:teuthology.orchestra.run.smithi045.stdout: "hdd": { 2023-07-09T02:12:22.752 INFO:teuthology.orchestra.run.smithi045.stdout: "total_bytes": 1600000000, 2023-07-09T02:12:22.752 INFO:teuthology.orchestra.run.smithi045.stdout: "total_avail_bytes": 1597523668, 2023-07-09T02:12:22.752 INFO:teuthology.orchestra.run.smithi045.stdout: "total_used_bytes": 2476332, 2023-07-09T02:12:22.752 INFO:teuthology.orchestra.run.smithi045.stdout: "total_used_raw_bytes": 2476332, 2023-07-09T02:12:22.752 INFO:teuthology.orchestra.run.smithi045.stdout: "total_used_raw_ratio": 0.0015477074775844812 2023-07-09T02:12:22.752 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:12:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: "name": ".mgr", 2023-07-09T02:12:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1, 2023-07-09T02:12:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: "stats": { 2023-07-09T02:12:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: "stored": 590368, 2023-07-09T02:12:22.753 INFO:teuthology.orchestra.run.smithi045.stdout: "objects": 2, 2023-07-09T02:12:22.754 INFO:teuthology.orchestra.run.smithi045.stdout: "kb_used": 577, 2023-07-09T02:12:22.754 INFO:teuthology.orchestra.run.smithi045.stdout: "bytes_used": 590368, 2023-07-09T02:12:22.754 INFO:teuthology.orchestra.run.smithi045.stdout: "percent_used": 0.000529687968082726, 2023-07-09T02:12:22.755 INFO:teuthology.orchestra.run.smithi045.stdout: "max_avail": 556983872 2023-07-09T02:12:22.755 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:22.755 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:22.755 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:22.756 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd", 2023-07-09T02:12:22.756 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2, 2023-07-09T02:12:22.757 INFO:teuthology.orchestra.run.smithi045.stdout: "stats": { 2023-07-09T02:12:22.757 INFO:teuthology.orchestra.run.smithi045.stdout: "stored": 0, 2023-07-09T02:12:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: "objects": 0, 2023-07-09T02:12:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: "kb_used": 0, 2023-07-09T02:12:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: "bytes_used": 0, 2023-07-09T02:12:22.759 INFO:teuthology.orchestra.run.smithi045.stdout: "percent_used": 0, 2023-07-09T02:12:22.760 INFO:teuthology.orchestra.run.smithi045.stdout: "max_avail": 556983872 2023-07-09T02:12:22.760 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:22.761 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:22.762 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:22.762 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephfs_metadata", 2023-07-09T02:12:22.762 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5, 2023-07-09T02:12:22.762 INFO:teuthology.orchestra.run.smithi045.stdout: "stats": { 2023-07-09T02:12:22.762 INFO:teuthology.orchestra.run.smithi045.stdout: "stored": 2362, 2023-07-09T02:12:22.763 INFO:teuthology.orchestra.run.smithi045.stdout: "objects": 22, 2023-07-09T02:12:22.763 INFO:teuthology.orchestra.run.smithi045.stdout: "kb_used": 3, 2023-07-09T02:12:22.763 INFO:teuthology.orchestra.run.smithi045.stdout: "bytes_used": 2362, 2023-07-09T02:12:22.763 INFO:teuthology.orchestra.run.smithi045.stdout: "percent_used": 2.1203443338890793e-06, 2023-07-09T02:12:22.764 INFO:teuthology.orchestra.run.smithi045.stdout: "max_avail": 556983872 2023-07-09T02:12:22.764 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:22.764 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:22.765 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:22.765 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephfs_data", 2023-07-09T02:12:22.765 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6, 2023-07-09T02:12:22.765 INFO:teuthology.orchestra.run.smithi045.stdout: "stats": { 2023-07-09T02:12:22.765 INFO:teuthology.orchestra.run.smithi045.stdout: "stored": 0, 2023-07-09T02:12:22.765 INFO:teuthology.orchestra.run.smithi045.stdout: "objects": 0, 2023-07-09T02:12:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: "kb_used": 0, 2023-07-09T02:12:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: "bytes_used": 0, 2023-07-09T02:12:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: "percent_used": 0, 2023-07-09T02:12:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: "max_avail": 556983872 2023-07-09T02:12:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:22.766 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:12:22.766 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:12:22.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c9c066280 msgr2=0x7f2c9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:22.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c9c066280 0x7f2c9c068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40b2000 tx=0x7f2cb4008040 comp rx=0 tx=0).stop 2023-07-09T02:12:22.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b4530 msgr2=0x7f2cb81f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:22.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b4530 0x7f2cb81f4e20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c7f0 tx=0x7f2ca800ccb0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 shutdown_connections 2023-07-09T02:12:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb80d2560 0x7f2cb81f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb80b4530 0x7f2cb81f4e20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c9c066280 0x7f2c9c068730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 --2- 172.21.15.45:0/1388832698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb80b1f20 0x7f2cb815db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 >> 172.21.15.45:0/1388832698 conn(0x7f2cb806a510 msgr2=0x7f2cb815ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 shutdown_connections 2023-07-09T02:12:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:22.748+0000 7f2cbf3fa640 1 -- 172.21.15.45:0/1388832698 wait complete. 2023-07-09T02:12:22.772 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:12:22.773 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:12:22.773 DEBUG:teuthology.orchestra.run.smithi045:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-07-09T02:12:22.773 DEBUG:teuthology.orchestra.run.smithi045:> os.fchmod(fd, 0O666) 2023-07-09T02:12:22.773 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(fd) 2023-07-09T02:12:22.774 DEBUG:teuthology.orchestra.run.smithi045:> os.close(fd) 2023-07-09T02:12:22.774 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:12:23.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:23.029 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:12:23.085 INFO:teuthology.orchestra.run.smithi045.stdout:client5227 2023-07-09T02:12:23.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:23.086 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client5227/osdmap') 2023-07-09T02:12:23.149 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 35 barrier 35 flags 0x588000 2023-07-09T02:12:23.150 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:23.150 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:23.151 INFO:teuthology.orchestra.run.smithi045.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:23.151 INFO:teuthology.orchestra.run.smithi045.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:23.151 INFO:teuthology.orchestra.run.smithi045.stdout:osd0 (2)172.21.15.45:6808 100% (exists, up) 100% -1 2023-07-09T02:12:23.151 INFO:teuthology.orchestra.run.smithi045.stdout:osd1 (2)172.21.15.45:6800 100% (exists, up) 100% -1 2023-07-09T02:12:23.152 INFO:teuthology.orchestra.run.smithi045.stdout:osd2 (2)172.21.15.45:6821 100% (exists, up) 100% -1 2023-07-09T02:12:23.152 INFO:teuthology.orchestra.run.smithi045.stdout:osd3 (2)172.21.15.45:6814 100% (exists, up) 100% -1 2023-07-09T02:12:23.152 INFO:teuthology.orchestra.run.smithi045.stdout:osd4 (2)172.21.15.155:6808 100% (exists, up) 100% -1 2023-07-09T02:12:23.152 INFO:teuthology.orchestra.run.smithi045.stdout:osd5 (2)172.21.15.155:6819 100% (exists, up) 100% -1 2023-07-09T02:12:23.153 INFO:teuthology.orchestra.run.smithi045.stdout:osd6 (2)172.21.15.155:6800 100% (exists, up) 100% -1 2023-07-09T02:12:23.153 INFO:teuthology.orchestra.run.smithi045.stdout:osd7 (2)172.21.15.155:6816 100% (exists, up) 100% -1 2023-07-09T02:12:23.154 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records in 2023-07-09T02:12:23.154 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records out 2023-07-09T02:12:23.155 INFO:teuthology.orchestra.run.smithi045.stderr:900 bytes copied, 0.000105344 s, 8.5 MB/s 2023-07-09T02:12:23.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-07-09T02:12:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.336+0000 7fa2d438f640 1 Processor -- start 2023-07-09T02:12:23.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.336+0000 7fa2d438f640 1 -- start start 2023-07-09T02:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d438f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2cc15c060 0x7fa2cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d438f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa2cc0d2620 0x7fa2cc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d438f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2cc160a50 con 0x7fa2cc0cd120 2023-07-09T02:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d438f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc15c430 con 0x7fa2cc15c060 2023-07-09T02:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d438f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc15fb60 con 0x7fa2cc0d2620 2023-07-09T02:12:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d212b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2cc15c060 0x7fa2cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d212b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2cc15c060 0x7fa2cc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52638/0 (socket says 172.21.15.45:52638) 2023-07-09T02:12:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d212b640 1 -- 172.21.15.45:0/3105144746 learned_addr learned my addr 172.21.15.45:0/3105144746 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d212b640 1 -- 172.21.15.45:0/3105144746 >> v2:172.21.15.155:3300/0 conn(0x7fa2cc0d2620 msgr2=0x7fa2cc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d292c640 1 --2- 172.21.15.45:0/3105144746 >> v2:172.21.15.155:3300/0 conn(0x7fa2cc0d2620 0x7fa2cc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d212b640 1 --2- 172.21.15.45:0/3105144746 >> v2:172.21.15.155:3300/0 conn(0x7fa2cc0d2620 0x7fa2cc0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d212b640 1 -- 172.21.15.45:0/3105144746 >> v1:172.21.15.45:6789/0 conn(0x7fa2cc0cd120 legacy=0x7fa2cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d1129640 1 -- 172.21.15.45:0/3105144746 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433395176 0 0) 0x7fa2cc160a50 con 0x7fa2cc0cd120 2023-07-09T02:12:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d212b640 1 -- 172.21.15.45:0/3105144746 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc15fe40 con 0x7fa2cc15c060 2023-07-09T02:12:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d292c640 1 --2- 172.21.15.45:0/3105144746 >> v2:172.21.15.155:3300/0 conn(0x7fa2cc0d2620 0x7fa2cc0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:23.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d212b640 1 --2- 172.21.15.45:0/3105144746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc15c060 0x7fa2cc0b4ed0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc08bca0 tx=0x7fa2c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22040af5e6ff9ab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:23.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d1129640 1 -- 172.21.15.45:0/3105144746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80aa430 con 0x7fa2cc15c060 2023-07-09T02:12:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d1129640 1 -- 172.21.15.45:0/3105144746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c80aa590 con 0x7fa2cc15c060 2023-07-09T02:12:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.340+0000 7fa2d1129640 1 -- 172.21.15.45:0/3105144746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80aa920 con 0x7fa2cc15c060 2023-07-09T02:12:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- 172.21.15.45:0/3105144746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc15c060 msgr2=0x7fa2cc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 --2- 172.21.15.45:0/3105144746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc15c060 0x7fa2cc0b4ed0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc08bca0 tx=0x7fa2c801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- 172.21.15.45:0/3105144746 shutdown_connections 2023-07-09T02:12:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 --2- 172.21.15.45:0/3105144746 >> v2:172.21.15.155:3300/0 conn(0x7fa2cc0d2620 0x7fa2cc0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 --2- 172.21.15.45:0/3105144746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc15c060 0x7fa2cc0b4ed0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- 172.21.15.45:0/3105144746 >> 172.21.15.45:0/3105144746 conn(0x7fa2cc0698e0 msgr2=0x7fa2cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- 172.21.15.45:0/3105144746 shutdown_connections 2023-07-09T02:12:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- 172.21.15.45:0/3105144746 wait complete. 2023-07-09T02:12:23.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 Processor -- start 2023-07-09T02:12:23.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- start start 2023-07-09T02:12:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc0cd120 0x7fa2cc1418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2cc0d2620 0x7fa2cc0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2cc15c060 0x7fa2cc0b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc15d100 con 0x7fa2cc0cd120 2023-07-09T02:12:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc15c780 con 0x7fa2cc0d2620 2023-07-09T02:12:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d438f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc15ca40 con 0x7fa2cc15c060 2023-07-09T02:12:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d212b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc0cd120 0x7fa2cc1418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d212b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc0cd120 0x7fa2cc1418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52644/0 (socket says 172.21.15.45:52644) 2023-07-09T02:12:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.344+0000 7fa2d212b640 1 -- 172.21.15.45:0/4068898403 learned_addr learned my addr 172.21.15.45:0/4068898403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:23.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d192a640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2cc0d2620 0x7fa2cc0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d292c640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2cc15c060 0x7fa2cc0b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d212b640 1 -- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2cc15c060 msgr2=0x7fa2cc0b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:23.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d212b640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2cc15c060 0x7fa2cc0b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d212b640 1 -- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2cc0d2620 msgr2=0x7fa2cc0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:23.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d212b640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2cc0d2620 0x7fa2cc0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d212b640 1 -- 172.21.15.45:0/4068898403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c80094d0 con 0x7fa2cc0cd120 2023-07-09T02:12:23.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d212b640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc0cd120 0x7fa2cc1418a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80ac040 tx=0x7fa2c801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2c2ffd640 1 -- 172.21.15.45:0/4068898403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8004020 con 0x7fa2cc0cd120 2023-07-09T02:12:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2c2ffd640 1 -- 172.21.15.45:0/4068898403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c80b7070 con 0x7fa2cc0cd120 2023-07-09T02:12:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2c2ffd640 1 -- 172.21.15.45:0/4068898403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8004380 con 0x7fa2cc0cd120 2023-07-09T02:12:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc0b59f0 con 0x7fa2cc0cd120 2023-07-09T02:12:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc0c8a40 con 0x7fa2cc0cd120 2023-07-09T02:12:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc15f670 con 0x7fa2cc0cd120 2023-07-09T02:12:23.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2c2ffd640 1 -- 172.21.15.45:0/4068898403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2c8003620 con 0x7fa2cc0cd120 2023-07-09T02:12:23.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2c2ffd640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.348+0000 7fa2c2ffd640 1 -- 172.21.15.45:0/4068898403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2c811de80 con 0x7fa2cc0cd120 2023-07-09T02:12:23.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.352+0000 7fa2d192a640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.352+0000 7fa2d192a640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa2b0066280 0x7fa2b0068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc15a0c0 tx=0x7fa2bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:23.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.352+0000 7fa2c2ffd640 1 -- 172.21.15.45:0/4068898403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2c80eb310 con 0x7fa2cc0cd120 2023-07-09T02:12:23.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.516+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7fa2cc04d7d0 con 0x7fa2cc0cd120 2023-07-09T02:12:23.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2c2ffd640 1 -- 172.21.15.45:0/4068898403 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v36) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa2c80b9030 con 0x7fa2cc0cd120 2023-07-09T02:12:23.823 INFO:teuthology.orchestra.run.smithi045.stderr:pauserd,pausewr is set 2023-07-09T02:12:23.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa2b0066280 msgr2=0x7fa2b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:23.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa2b0066280 0x7fa2b0068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc15a0c0 tx=0x7fa2bc009040 comp rx=0 tx=0).stop 2023-07-09T02:12:23.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc0cd120 msgr2=0x7fa2cc1418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:23.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc0cd120 0x7fa2cc1418a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80ac040 tx=0x7fa2c801ad10 comp rx=0 tx=0).stop 2023-07-09T02:12:23.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 shutdown_connections 2023-07-09T02:12:23.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2cc15c060 0x7fa2cc0b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2cc0d2620 0x7fa2cc0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 --2- 172.21.15.45:0/4068898403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2cc0cd120 0x7fa2cc1418a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 >> 172.21.15.45:0/4068898403 conn(0x7fa2cc0698e0 msgr2=0x7fa2cc0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:23.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.820+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 shutdown_connections 2023-07-09T02:12:23.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.824+0000 7fa2d438f640 1 -- 172.21.15.45:0/4068898403 wait complete. 2023-07-09T02:12:23.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-07-09T02:12:23.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.984+0000 7f8bde559640 1 Processor -- start 2023-07-09T02:12:23.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.984+0000 7f8bde559640 1 -- start start 2023-07-09T02:12:23.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bde559640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bd815c060 0x7f8bd80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bde559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80d2620 0x7f8bd80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bde559640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd8160a50 con 0x7f8bd80cd120 2023-07-09T02:12:23.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bde559640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd815c430 con 0x7f8bd815c060 2023-07-09T02:12:23.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bde559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd815fb60 con 0x7f8bd80d2620 2023-07-09T02:12:23.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bd815c060 0x7f8bd80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bd815c060 0x7f8bd80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52646/0 (socket says 172.21.15.45:52646) 2023-07-09T02:12:23.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd7fff640 1 -- 172.21.15.45:0/3357070036 learned_addr learned my addr 172.21.15.45:0/3357070036 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:23.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd77fe640 1 --1- 172.21.15.45:0/3357070036 >> v1:172.21.15.45:6789/0 conn(0x7f8bd80cd120 0x7f8bd80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59492/0 (socket says 172.21.15.45:59492) 2023-07-09T02:12:23.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bdcaf6640 1 --2- 172.21.15.45:0/3357070036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80d2620 0x7f8bd80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd7fff640 1 -- 172.21.15.45:0/3357070036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80d2620 msgr2=0x7f8bd80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:23.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd7fff640 1 --2- 172.21.15.45:0/3357070036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80d2620 0x7f8bd80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd7fff640 1 -- 172.21.15.45:0/3357070036 >> v1:172.21.15.45:6789/0 conn(0x7f8bd80cd120 legacy=0x7f8bd80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:23.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd7fff640 1 -- 172.21.15.45:0/3357070036 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd815fe40 con 0x7f8bd815c060 2023-07-09T02:12:23.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.988+0000 7f8bd6ffd640 1 -- 172.21.15.45:0/3357070036 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589116043 0 0) 0x7f8bd8160a50 con 0x7f8bd80cd120 2023-07-09T02:12:23.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bd7fff640 1 --2- 172.21.15.45:0/3357070036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd815c060 0x7f8bd80b4ed0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009870 tx=0x7f8bc801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5359e51e183bf0c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:23.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bd6ffd640 1 -- 172.21.15.45:0/3357070036 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80aa670 con 0x7f8bd815c060 2023-07-09T02:12:23.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bd6ffd640 1 -- 172.21.15.45:0/3357070036 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc80aa7d0 con 0x7f8bd815c060 2023-07-09T02:12:23.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bd6ffd640 1 -- 172.21.15.45:0/3357070036 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80aab60 con 0x7f8bd815c060 2023-07-09T02:12:23.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- 172.21.15.45:0/3357070036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd815c060 msgr2=0x7f8bd80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:23.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 --2- 172.21.15.45:0/3357070036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd815c060 0x7f8bd80b4ed0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009870 tx=0x7f8bc801c510 comp rx=0 tx=0).stop 2023-07-09T02:12:23.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- 172.21.15.45:0/3357070036 shutdown_connections 2023-07-09T02:12:23.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 --2- 172.21.15.45:0/3357070036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80d2620 0x7f8bd80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 --2- 172.21.15.45:0/3357070036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd815c060 0x7f8bd80b4ed0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:23.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- 172.21.15.45:0/3357070036 >> 172.21.15.45:0/3357070036 conn(0x7f8bd80698e0 msgr2=0x7f8bd8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:23.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- 172.21.15.45:0/3357070036 shutdown_connections 2023-07-09T02:12:23.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- 172.21.15.45:0/3357070036 wait complete. 2023-07-09T02:12:23.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 Processor -- start 2023-07-09T02:12:23.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- start start 2023-07-09T02:12:23.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80cd120 0x7f8bd80b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd80d2620 0x7f8bd815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd815c060 0x7f8bd8152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:23.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd815d4f0 con 0x7f8bd80d2620 2023-07-09T02:12:23.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd815c600 con 0x7f8bd815c060 2023-07-09T02:12:23.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.992+0000 7f8bde559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd815c8e0 con 0x7f8bd80cd120 2023-07-09T02:12:23.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd80d2620 0x7f8bd815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:23.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd80d2620 0x7f8bd815d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52660/0 (socket says 172.21.15.45:52660) 2023-07-09T02:12:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 -- 172.21.15.45:0/4053123952 learned_addr learned my addr 172.21.15.45:0/4053123952 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd7fff640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80cd120 0x7f8bd80b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bdcaf6640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd815c060 0x7f8bd8152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 -- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80cd120 msgr2=0x7f8bd80b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80cd120 0x7f8bd80b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 -- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd815c060 msgr2=0x7f8bd8152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd815c060 0x7f8bd8152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 -- 172.21.15.45:0/4053123952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc80094d0 con 0x7f8bd80d2620 2023-07-09T02:12:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bdcaf6640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd815c060 0x7f8bd8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd77fe640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd80d2620 0x7f8bd815d980 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00c4b0 tx=0x7f8bcc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0074e0 con 0x7f8bd80d2620 2023-07-09T02:12:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc007660 con 0x7f8bd80d2620 2023-07-09T02:12:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc004a30 con 0x7f8bd80d2620 2023-07-09T02:12:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd80b59f0 con 0x7f8bd80d2620 2023-07-09T02:12:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd815cea0 con 0x7f8bd80d2620 2023-07-09T02:12:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd804d7d0 con 0x7f8bd80d2620 2023-07-09T02:12:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:23.996+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8bcc004b90 con 0x7f8bd80d2620 2023-07-09T02:12:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.000+0000 7f8bd4ff9640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8bc40662b0 0x7f8bc4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.000+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bcc082e00 con 0x7f8bd80d2620 2023-07-09T02:12:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.000+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=37+}) v3 -- 0x7f8bc406e3f0 con 0x7f8bd80d2620 2023-07-09T02:12:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.000+0000 7f8bd7fff640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8bc40662b0 0x7f8bc4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.000+0000 7f8bd7fff640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8bc40662b0 0x7f8bc4068760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80ae000 tx=0x7f8bc80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.004+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8bcc018020 con 0x7f8bd80d2620 2023-07-09T02:12:24.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.168+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f8bd806baa0 con 0x7f8bd80d2620 2023-07-09T02:12:24.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.820+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(37..37 src has 1..37) v4 ==== 288+0+0 (secure 0 0 0) 0x7f8bcc004e40 con 0x7f8bd80d2620 2023-07-09T02:12:24.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.820+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f8bc406ec30 con 0x7f8bd80d2620 2023-07-09T02:12:24.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.824+0000 7f8bd4ff9640 1 -- 172.21.15.45:0/4053123952 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8bcc050480 con 0x7f8bd80d2620 2023-07-09T02:12:24.826 INFO:teuthology.orchestra.run.smithi045.stderr:pauserd,pausewr is unset 2023-07-09T02:12:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8bc40662b0 msgr2=0x7f8bc4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8bc40662b0 0x7f8bc4068760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80ae000 tx=0x7f8bc80b5040 comp rx=0 tx=0).stop 2023-07-09T02:12:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd80d2620 msgr2=0x7f8bd815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd80d2620 0x7f8bd815d980 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00c4b0 tx=0x7f8bcc00c970 comp rx=0 tx=0).stop 2023-07-09T02:12:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 shutdown_connections 2023-07-09T02:12:24.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd815c060 0x7f8bd8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:24.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd80d2620 0x7f8bd815d980 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:24.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8bc40662b0 0x7f8bc4068760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:24.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 --2- 172.21.15.45:0/4053123952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd80cd120 0x7f8bd80b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:24.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 >> 172.21.15.45:0/4053123952 conn(0x7f8bd80698e0 msgr2=0x7f8bd80b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:24.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 shutdown_connections 2023-07-09T02:12:24.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.828+0000 7f8bde559640 1 -- 172.21.15.45:0/4053123952 wait complete. 2023-07-09T02:12:24.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c5920b640 1 Processor -- start 2023-07-09T02:12:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c5920b640 1 -- start start 2023-07-09T02:12:25.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c5920b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0c5415c060 0x7f0c540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c5920b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c540d2620 0x7f0c540cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c5920b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c54160a50 con 0x7f0c540cd120 2023-07-09T02:12:25.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c5920b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5415c430 con 0x7f0c540d2620 2023-07-09T02:12:25.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c5920b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5415fb60 con 0x7f0c5415c060 2023-07-09T02:12:25.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c5359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c540d2620 0x7f0c540cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c4bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c540cd120 0x7f0c540d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59506/0 (socket says 172.21.15.45:59506) 2023-07-09T02:12:25.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c4bfff640 1 -- 172.21.15.45:0/490552632 learned_addr learned my addr 172.21.15.45:0/490552632 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:25.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:24.996+0000 7f0c52d9d640 1 --2- 172.21.15.45:0/490552632 >> v2:172.21.15.155:3300/0 conn(0x7f0c5415c060 0x7f0c540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5359e640 1 -- 172.21.15.45:0/490552632 >> v2:172.21.15.155:3300/0 conn(0x7f0c5415c060 msgr2=0x7f0c540b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:25.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5359e640 1 --2- 172.21.15.45:0/490552632 >> v2:172.21.15.155:3300/0 conn(0x7f0c5415c060 0x7f0c540b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5359e640 1 -- 172.21.15.45:0/490552632 >> v1:172.21.15.45:6789/0 conn(0x7f0c540cd120 legacy=0x7f0c540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5359e640 1 -- 172.21.15.45:0/490552632 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5415fe40 con 0x7f0c540d2620 2023-07-09T02:12:25.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5259c640 1 -- 172.21.15.45:0/490552632 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061851520 0 0) 0x7f0c54160a50 con 0x7f0c540cd120 2023-07-09T02:12:25.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c52d9d640 1 --2- 172.21.15.45:0/490552632 >> v2:172.21.15.155:3300/0 conn(0x7f0c5415c060 0x7f0c540b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:25.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5359e640 1 --2- 172.21.15.45:0/490552632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540d2620 0x7f0c540cee30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c540d3ad0 tx=0x7f0c4c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7576002b59dfa8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:25.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5259c640 1 -- 172.21.15.45:0/490552632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0a59a0 con 0x7f0c540d2620 2023-07-09T02:12:25.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5259c640 1 -- 172.21.15.45:0/490552632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c0a5b00 con 0x7f0c540d2620 2023-07-09T02:12:25.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5259c640 1 -- 172.21.15.45:0/490552632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0a5e90 con 0x7f0c540d2620 2023-07-09T02:12:25.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5920b640 1 -- 172.21.15.45:0/490552632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540d2620 msgr2=0x7f0c540cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.000+0000 7f0c5920b640 1 --2- 172.21.15.45:0/490552632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540d2620 0x7f0c540cee30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c540d3ad0 tx=0x7f0c4c01c8e0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 -- 172.21.15.45:0/490552632 shutdown_connections 2023-07-09T02:12:25.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 --2- 172.21.15.45:0/490552632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540d2620 0x7f0c540cee30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 --2- 172.21.15.45:0/490552632 >> v2:172.21.15.155:3300/0 conn(0x7f0c5415c060 0x7f0c540b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 -- 172.21.15.45:0/490552632 >> 172.21.15.45:0/490552632 conn(0x7f0c540698e0 msgr2=0x7f0c54069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:25.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 -- 172.21.15.45:0/490552632 shutdown_connections 2023-07-09T02:12:25.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 -- 172.21.15.45:0/490552632 wait complete. 2023-07-09T02:12:25.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 Processor -- start 2023-07-09T02:12:25.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 -- start start 2023-07-09T02:12:25.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540cd120 0x7f0c540b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c540d2620 0x7f0c540b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c5415c060 0x7f0c5414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5414de00 con 0x7f0c540cd120 2023-07-09T02:12:25.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415a450 con 0x7f0c540d2620 2023-07-09T02:12:25.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5920b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415a170 con 0x7f0c5415c060 2023-07-09T02:12:25.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c52d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540cd120 0x7f0c540b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c52d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540cd120 0x7f0c540b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52684/0 (socket says 172.21.15.45:52684) 2023-07-09T02:12:25.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c52d9d640 1 -- 172.21.15.45:0/4041659789 learned_addr learned my addr 172.21.15.45:0/4041659789 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:25.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c4bfff640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c540d2620 0x7f0c540b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c5359e640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c5415c060 0x7f0c5414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c52d9d640 1 -- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c5415c060 msgr2=0x7f0c5414e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c52d9d640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c5415c060 0x7f0c5414e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c52d9d640 1 -- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c540d2620 msgr2=0x7f0c540b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c52d9d640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c540d2620 0x7f0c540b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.004+0000 7f0c52d9d640 1 -- 172.21.15.45:0/4041659789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c009a70 con 0x7f0c540cd120 2023-07-09T02:12:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c52d9d640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540cd120 0x7f0c540b6c30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400d830 tx=0x7f0c4400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c4b7fe640 1 -- 172.21.15.45:0/4041659789 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c440096c0 con 0x7f0c540cd120 2023-07-09T02:12:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c4b7fe640 1 -- 172.21.15.45:0/4041659789 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44009820 con 0x7f0c540cd120 2023-07-09T02:12:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c540b59f0 con 0x7f0c540cd120 2023-07-09T02:12:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c4b7fe640 1 -- 172.21.15.45:0/4041659789 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44009bd0 con 0x7f0c540cd120 2023-07-09T02:12:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5414da90 con 0x7f0c540cd120 2023-07-09T02:12:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5414d610 con 0x7f0c540cd120 2023-07-09T02:12:25.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c4b7fe640 1 -- 172.21.15.45:0/4041659789 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c44014410 con 0x7f0c540cd120 2023-07-09T02:12:25.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c4b7fe640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c4b7fe640 1 -- 172.21.15.45:0/4041659789 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c44084720 con 0x7f0c540cd120 2023-07-09T02:12:25.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.008+0000 7f0c4bfff640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.012+0000 7f0c4bfff640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c34066280 0x7f0c34068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c54151a70 tx=0x7f0c3c007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:25.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.012+0000 7f0c4b7fe640 1 -- 172.21.15.45:0/4041659789 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c5414d610 con 0x7f0c540cd120 2023-07-09T02:12:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c5414d610 con 0x7f0c540cd120 2023-07-09T02:12:25.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c4b7fe640 1 -- 172.21.15.45:0/4041659789 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f0c5414d610 con 0x7f0c540cd120 2023-07-09T02:12:25.174 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:25.175 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:24.822024+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c34066280 msgr2=0x7f0c34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c34066280 0x7f0c34068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c54151a70 tx=0x7f0c3c007b60 comp rx=0 tx=0).stop 2023-07-09T02:12:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540cd120 msgr2=0x7f0c540b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540cd120 0x7f0c540b6c30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400d830 tx=0x7f0c4400dcf0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 shutdown_connections 2023-07-09T02:12:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c5415c060 0x7f0c5414e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c540d2620 0x7f0c540b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 --2- 172.21.15.45:0/4041659789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c540cd120 0x7f0c540b6c30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 >> 172.21.15.45:0/4041659789 conn(0x7f0c540698e0 msgr2=0x7f0c540b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 shutdown_connections 2023-07-09T02:12:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.172+0000 7f0c5920b640 1 -- 172.21.15.45:0/4041659789 wait complete. 2023-07-09T02:12:25.196 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:12:25.197 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:12:25.197 DEBUG:teuthology.orchestra.run.smithi045:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-07-09T02:12:25.197 DEBUG:teuthology.orchestra.run.smithi045:> os.fchmod(fd, 0O666) 2023-07-09T02:12:25.197 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(fd) 2023-07-09T02:12:25.198 DEBUG:teuthology.orchestra.run.smithi045:> os.close(fd) 2023-07-09T02:12:25.198 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:12:25.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:25.454 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:12:25.508 INFO:teuthology.orchestra.run.smithi045.stdout:client5227 2023-07-09T02:12:25.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:25.509 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client5227/osdmap') 2023-07-09T02:12:25.574 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 35 barrier 35 flags 0x588000 2023-07-09T02:12:25.574 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:25.574 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:25.575 INFO:teuthology.orchestra.run.smithi045.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:25.575 INFO:teuthology.orchestra.run.smithi045.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:25.575 INFO:teuthology.orchestra.run.smithi045.stdout:osd0 (2)172.21.15.45:6808 100% (exists, up) 100% -1 2023-07-09T02:12:25.575 INFO:teuthology.orchestra.run.smithi045.stdout:osd1 (2)172.21.15.45:6800 100% (exists, up) 100% -1 2023-07-09T02:12:25.575 INFO:teuthology.orchestra.run.smithi045.stdout:osd2 (2)172.21.15.45:6821 100% (exists, up) 100% -1 2023-07-09T02:12:25.575 INFO:teuthology.orchestra.run.smithi045.stdout:osd3 (2)172.21.15.45:6814 100% (exists, up) 100% -1 2023-07-09T02:12:25.575 INFO:teuthology.orchestra.run.smithi045.stdout:osd4 (2)172.21.15.155:6808 100% (exists, up) 100% -1 2023-07-09T02:12:25.575 INFO:teuthology.orchestra.run.smithi045.stdout:osd5 (2)172.21.15.155:6819 100% (exists, up) 100% -1 2023-07-09T02:12:25.576 INFO:teuthology.orchestra.run.smithi045.stdout:osd6 (2)172.21.15.155:6800 100% (exists, up) 100% -1 2023-07-09T02:12:25.576 INFO:teuthology.orchestra.run.smithi045.stdout:osd7 (2)172.21.15.155:6816 100% (exists, up) 100% -1 2023-07-09T02:12:25.577 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records in 2023-07-09T02:12:25.577 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records out 2023-07-09T02:12:25.577 INFO:teuthology.orchestra.run.smithi045.stderr:900 bytes copied, 7.3352e-05 s, 12.3 MB/s 2023-07-09T02:12:25.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:25.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fda93a640 1 Processor -- start 2023-07-09T02:12:25.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fda93a640 1 -- start start 2023-07-09T02:12:25.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fda93a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fd40d2620 0x7f4fd40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fda93a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40cd120 0x7f4fd40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fda93a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd4160a50 con 0x7f4fd415c060 2023-07-09T02:12:25.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fda93a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd415c430 con 0x7f4fd40d2620 2023-07-09T02:12:25.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fda93a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd415fb60 con 0x7f4fd40cd120 2023-07-09T02:12:25.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4fd415c060 0x7f4fd40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59508/0 (socket says 172.21.15.45:59508) 2023-07-09T02:12:25.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd3fff640 1 -- 172.21.15.45:0/3884768630 learned_addr learned my addr 172.21.15.45:0/3884768630 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:25.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd37fe640 1 --2- 172.21.15.45:0/3884768630 >> v2:172.21.15.45:3300/0 conn(0x7f4fd40d2620 0x7f4fd40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd8ed7640 1 --2- 172.21.15.45:0/3884768630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40cd120 0x7f4fd40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd37fe640 1 -- 172.21.15.45:0/3884768630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40cd120 msgr2=0x7f4fd40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:25.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd37fe640 1 --2- 172.21.15.45:0/3884768630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40cd120 0x7f4fd40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd37fe640 1 -- 172.21.15.45:0/3884768630 >> v1:172.21.15.45:6789/0 conn(0x7f4fd415c060 legacy=0x7f4fd40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd37fe640 1 -- 172.21.15.45:0/3884768630 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd415fe40 con 0x7f4fd40d2620 2023-07-09T02:12:25.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.760+0000 7f4fd2ffd640 1 -- 172.21.15.45:0/3884768630 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662519453 0 0) 0x7f4fd4160a50 con 0x7f4fd415c060 2023-07-09T02:12:25.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fd37fe640 1 --2- 172.21.15.45:0/3884768630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd40d2620 0x7f4fd40b4ed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097c0 tx=0x7f4fc801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec87d6f4624704ef server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:25.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fd2ffd640 1 -- 172.21.15.45:0/3884768630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80ab650 con 0x7f4fd40d2620 2023-07-09T02:12:25.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fd2ffd640 1 -- 172.21.15.45:0/3884768630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc80ab7b0 con 0x7f4fd40d2620 2023-07-09T02:12:25.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fd2ffd640 1 -- 172.21.15.45:0/3884768630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80abb40 con 0x7f4fd40d2620 2023-07-09T02:12:25.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fda93a640 1 -- 172.21.15.45:0/3884768630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd40d2620 msgr2=0x7f4fd40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fda93a640 1 --2- 172.21.15.45:0/3884768630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd40d2620 0x7f4fd40b4ed0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80097c0 tx=0x7f4fc801c450 comp rx=0 tx=0).stop 2023-07-09T02:12:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fda93a640 1 -- 172.21.15.45:0/3884768630 shutdown_connections 2023-07-09T02:12:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fda93a640 1 --2- 172.21.15.45:0/3884768630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40cd120 0x7f4fd40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fda93a640 1 --2- 172.21.15.45:0/3884768630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd40d2620 0x7f4fd40b4ed0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fda93a640 1 -- 172.21.15.45:0/3884768630 >> 172.21.15.45:0/3884768630 conn(0x7f4fd40698e0 msgr2=0x7f4fd4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fda93a640 1 -- 172.21.15.45:0/3884768630 shutdown_connections 2023-07-09T02:12:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.764+0000 7f4fda93a640 1 -- 172.21.15.45:0/3884768630 wait complete. 2023-07-09T02:12:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 Processor -- start 2023-07-09T02:12:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 -- start start 2023-07-09T02:12:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fd40cd120 0x7f4fd415c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40d2620 0x7f4fd4156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd415c060 0x7f4fd415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd415a420 con 0x7f4fd415c060 2023-07-09T02:12:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4157190 con 0x7f4fd40cd120 2023-07-09T02:12:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4159810 con 0x7f4fd40d2620 2023-07-09T02:12:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd415c060 0x7f4fd415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd415c060 0x7f4fd415a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52710/0 (socket says 172.21.15.45:52710) 2023-07-09T02:12:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 -- 172.21.15.45:0/2270946471 learned_addr learned my addr 172.21.15.45:0/2270946471 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 -- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40d2620 msgr2=0x7f4fd4156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40d2620 0x7f4fd4156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 -- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fd40cd120 msgr2=0x7f4fd415c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fd40cd120 0x7f4fd415c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 -- 172.21.15.45:0/2270946471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8009420 con 0x7f4fd415c060 2023-07-09T02:12:25.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd8ed7640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd415c060 0x7f4fd415a8b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007e90 tx=0x7f4fcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:25.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd0ff9640 1 -- 172.21.15.45:0/2270946471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc014420 con 0x7f4fd415c060 2023-07-09T02:12:25.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd0ff9640 1 -- 172.21.15.45:0/2270946471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc014580 con 0x7f4fd415c060 2023-07-09T02:12:25.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fd0ff9640 1 -- 172.21.15.45:0/2270946471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc014930 con 0x7f4fd415c060 2023-07-09T02:12:25.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd40b59f0 con 0x7f4fd415c060 2023-07-09T02:12:25.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.768+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd4159dd0 con 0x7f4fd415c060 2023-07-09T02:12:25.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.772+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd404d7d0 con 0x7f4fd415c060 2023-07-09T02:12:25.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.772+0000 7f4fd0ff9640 1 -- 172.21.15.45:0/2270946471 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fcc014a90 con 0x7f4fd415c060 2023-07-09T02:12:25.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.772+0000 7f4fd0ff9640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fc0066280 0x7f4fc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:25.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.772+0000 7f4fd0ff9640 1 -- 172.21.15.45:0/2270946471 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fcc084640 con 0x7f4fd415c060 2023-07-09T02:12:25.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.772+0000 7f4fd3fff640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fc0066280 0x7f4fc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:25.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.772+0000 7f4fd3fff640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fc0066280 0x7f4fc0068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40011f0 tx=0x7f4fc4007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:25.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.776+0000 7f4fd0ff9640 1 -- 172.21.15.45:0/2270946471 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fcc055540 con 0x7f4fd415c060 2023-07-09T02:12:25.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fd415a5d0 con 0x7f4fd415c060 2023-07-09T02:12:25.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fd0ff9640 1 -- 172.21.15.45:0/2270946471 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f4fd415a5d0 con 0x7f4fd415c060 2023-07-09T02:12:25.966 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:25.966 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:13.135771+0000","modified":"2023-07-09T02:12:16.783642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3290020828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3290020828},{"type":"v1","addr":"172.21.15.45:6835","nonce":3290020828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T02:12:25.966 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-07-09T02:12:25.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fc0066280 msgr2=0x7f4fc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fc0066280 0x7f4fc0068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40011f0 tx=0x7f4fc4007930 comp rx=0 tx=0).stop 2023-07-09T02:12:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd415c060 msgr2=0x7f4fd415a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd415c060 0x7f4fd415a8b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007e90 tx=0x7f4fcc00e4b0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 shutdown_connections 2023-07-09T02:12:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd415c060 0x7f4fd415a8b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fc0066280 0x7f4fc0068730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fd40d2620 0x7f4fd4156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 --2- 172.21.15.45:0/2270946471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fd40cd120 0x7f4fd415c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:25.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 >> 172.21.15.45:0/2270946471 conn(0x7f4fd40698e0 msgr2=0x7f4fd415b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:25.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 shutdown_connections 2023-07-09T02:12:25.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:25.964+0000 7f4fda93a640 1 -- 172.21.15.45:0/2270946471 wait complete. 2023-07-09T02:12:25.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 37 2023-07-09T02:12:26.148 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-07-09T02:12:26.149 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:12:26.150 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:12:26.150 DEBUG:teuthology.orchestra.run.smithi045:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-07-09T02:12:26.150 DEBUG:teuthology.orchestra.run.smithi045:> os.fchmod(fd, 0O666) 2023-07-09T02:12:26.151 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(fd) 2023-07-09T02:12:26.151 DEBUG:teuthology.orchestra.run.smithi045:> os.close(fd) 2023-07-09T02:12:26.151 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:12:26.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:26.406 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:12:26.462 INFO:teuthology.orchestra.run.smithi045.stdout:client5227 2023-07-09T02:12:26.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:26.463 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client5227/osdmap') 2023-07-09T02:12:26.527 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 37 barrier 37 flags 0x588000 2023-07-09T02:12:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd0 (2)172.21.15.45:6808 100% (exists, up) 100% -1 2023-07-09T02:12:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd1 (2)172.21.15.45:6800 100% (exists, up) 100% -1 2023-07-09T02:12:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd2 (2)172.21.15.45:6821 100% (exists, up) 100% -1 2023-07-09T02:12:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd3 (2)172.21.15.45:6814 100% (exists, up) 100% -1 2023-07-09T02:12:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd4 (2)172.21.15.155:6808 100% (exists, up) 100% -1 2023-07-09T02:12:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd5 (2)172.21.15.155:6819 100% (exists, up) 100% -1 2023-07-09T02:12:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd6 (2)172.21.15.155:6800 100% (exists, up) 100% -1 2023-07-09T02:12:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:osd7 (2)172.21.15.155:6816 100% (exists, up) 100% -1 2023-07-09T02:12:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records in 2023-07-09T02:12:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records out 2023-07-09T02:12:26.531 INFO:teuthology.orchestra.run.smithi045.stderr:900 bytes copied, 6.9236e-05 s, 13.0 MB/s 2023-07-09T02:12:26.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:26.531 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:12:26.588 INFO:teuthology.orchestra.run.smithi045.stdout:client5227 2023-07-09T02:12:26.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:26.589 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client5227/osdmap') 2023-07-09T02:12:26.654 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 37 barrier 37 flags 0x588000 2023-07-09T02:12:26.654 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:26.655 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:26.655 INFO:teuthology.orchestra.run.smithi045.stdout:pool 5 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:26.655 INFO:teuthology.orchestra.run.smithi045.stdout:pool 6 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:12:26.655 INFO:teuthology.orchestra.run.smithi045.stdout:osd0 (2)172.21.15.45:6808 100% (exists, up) 100% -1 2023-07-09T02:12:26.655 INFO:teuthology.orchestra.run.smithi045.stdout:osd1 (2)172.21.15.45:6800 100% (exists, up) 100% -1 2023-07-09T02:12:26.655 INFO:teuthology.orchestra.run.smithi045.stdout:osd2 (2)172.21.15.45:6821 100% (exists, up) 100% -1 2023-07-09T02:12:26.656 INFO:teuthology.orchestra.run.smithi045.stdout:osd3 (2)172.21.15.45:6814 100% (exists, up) 100% -1 2023-07-09T02:12:26.656 INFO:teuthology.orchestra.run.smithi045.stdout:osd4 (2)172.21.15.155:6808 100% (exists, up) 100% -1 2023-07-09T02:12:26.656 INFO:teuthology.orchestra.run.smithi045.stdout:osd5 (2)172.21.15.155:6819 100% (exists, up) 100% -1 2023-07-09T02:12:26.656 INFO:teuthology.orchestra.run.smithi045.stdout:osd6 (2)172.21.15.155:6800 100% (exists, up) 100% -1 2023-07-09T02:12:26.656 INFO:teuthology.orchestra.run.smithi045.stdout:osd7 (2)172.21.15.155:6816 100% (exists, up) 100% -1 2023-07-09T02:12:26.657 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records in 2023-07-09T02:12:26.657 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records out 2023-07-09T02:12:26.658 INFO:teuthology.orchestra.run.smithi045.stderr:900 bytes copied, 6.8373e-05 s, 13.2 MB/s 2023-07-09T02:12:26.658 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:12:26.658 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:12:26.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:12:26.771 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:12:26.828 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:12:26.828 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:26.829 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:26.839 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:26.839 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:26.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:27.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.076+0000 7fc973acb640 1 Processor -- start 2023-07-09T02:12:27.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.076+0000 7fc973acb640 1 -- start start 2023-07-09T02:12:27.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc973acb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0cd120 0x7fc96c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc973acb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c160a50 con 0x7fc96c15c060 2023-07-09T02:12:27.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc973acb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c15c430 con 0x7fc96c0d2620 2023-07-09T02:12:27.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc973acb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c15fb60 con 0x7fc96c0cd120 2023-07-09T02:12:27.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc971867640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc96c15c060 0x7fc96c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59518/0 (socket says 172.21.15.45:59518) 2023-07-09T02:12:27.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc971867640 1 -- 172.21.15.45:0/2514898751 learned_addr learned my addr 172.21.15.45:0/2514898751 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:27.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc972068640 1 --2- 172.21.15.45:0/2514898751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0cd120 0x7fc96c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc970865640 1 -- 172.21.15.45:0/2514898751 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628173876 0 0) 0x7fc96c160a50 con 0x7fc96c15c060 2023-07-09T02:12:27.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc970865640 1 -- 172.21.15.45:0/2514898751 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc958003530 con 0x7fc96c15c060 2023-07-09T02:12:27.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc970865640 1 -- 172.21.15.45:0/2514898751 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463086532 0 0) 0x7fc96c15c430 con 0x7fc96c0d2620 2023-07-09T02:12:27.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc970865640 1 -- 172.21.15.45:0/2514898751 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc96c160a50 con 0x7fc96c0d2620 2023-07-09T02:12:27.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc972068640 1 -- 172.21.15.45:0/2514898751 >> v1:172.21.15.155:6789/0 conn(0x7fc96c0d2620 legacy=0x7fc96c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc972068640 1 -- 172.21.15.45:0/2514898751 >> v1:172.21.15.45:6789/0 conn(0x7fc96c15c060 legacy=0x7fc96c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc970865640 1 -- 172.21.15.45:0/2514898751 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1785936350 0 0) 0x7fc958003530 con 0x7fc96c15c060 2023-07-09T02:12:27.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.080+0000 7fc972068640 1 -- 172.21.15.45:0/2514898751 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c15fe40 con 0x7fc96c0cd120 2023-07-09T02:12:27.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc972068640 1 --2- 172.21.15.45:0/2514898751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0cd120 0x7fc96c0b4ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc964009dc0 tx=0x7fc96401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2b083079a160edc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc970865640 1 -- 172.21.15.45:0/2514898751 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968001680 con 0x7fc96c0cd120 2023-07-09T02:12:27.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc970865640 1 -- 172.21.15.45:0/2514898751 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9640a56a0 con 0x7fc96c0cd120 2023-07-09T02:12:27.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc970865640 1 -- 172.21.15.45:0/2514898751 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640a5a30 con 0x7fc96c0cd120 2023-07-09T02:12:27.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc973acb640 1 -- 172.21.15.45:0/2514898751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0cd120 msgr2=0x7fc96c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc973acb640 1 --2- 172.21.15.45:0/2514898751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0cd120 0x7fc96c0b4ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc964009dc0 tx=0x7fc96401c860 comp rx=0 tx=0).stop 2023-07-09T02:12:27.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc973acb640 1 -- 172.21.15.45:0/2514898751 shutdown_connections 2023-07-09T02:12:27.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc973acb640 1 --2- 172.21.15.45:0/2514898751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0cd120 0x7fc96c0b4ed0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc973acb640 1 -- 172.21.15.45:0/2514898751 >> 172.21.15.45:0/2514898751 conn(0x7fc96c0698e0 msgr2=0x7fc96c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:27.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc973acb640 1 -- 172.21.15.45:0/2514898751 shutdown_connections 2023-07-09T02:12:27.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc973acb640 1 -- 172.21.15.45:0/2514898751 wait complete. 2023-07-09T02:12:27.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.084+0000 7fc973acb640 1 Processor -- start 2023-07-09T02:12:27.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 -- start start 2023-07-09T02:12:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0cd120 0x7fc96c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0d2620 0x7fc96c1f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96c15c060 0x7fc96c1f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c151d80 con 0x7fc96c15c060 2023-07-09T02:12:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c156820 con 0x7fc96c0cd120 2023-07-09T02:12:27.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0cc790 con 0x7fc96c0d2620 2023-07-09T02:12:27.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96c15c060 0x7fc96c1f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96c15c060 0x7fc96c1f84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52718/0 (socket says 172.21.15.45:52718) 2023-07-09T02:12:27.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 -- 172.21.15.45:0/3180827916 learned_addr learned my addr 172.21.15.45:0/3180827916 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:27.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc971066640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0d2620 0x7fc96c1f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc971867640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0cd120 0x7fc96c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 -- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0d2620 msgr2=0x7fc96c1f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0d2620 0x7fc96c1f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 -- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0cd120 msgr2=0x7fc96c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0cd120 0x7fc96c151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 -- 172.21.15.45:0/3180827916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009a70 con 0x7fc96c15c060 2023-07-09T02:12:27.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc971867640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0cd120 0x7fc96c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:27.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc972068640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96c15c060 0x7fc96c1f84e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc96401cd40 tx=0x7fc964019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc9627fc640 1 -- 172.21.15.45:0/3180827916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964003ba0 con 0x7fc96c15c060 2023-07-09T02:12:27.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc9627fc640 1 -- 172.21.15.45:0/3180827916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc964003d20 con 0x7fc96c15c060 2023-07-09T02:12:27.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc9627fc640 1 -- 172.21.15.45:0/3180827916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640ad890 con 0x7fc96c15c060 2023-07-09T02:12:27.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c0b59f0 con 0x7fc96c15c060 2023-07-09T02:12:27.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c155a60 con 0x7fc96c15c060 2023-07-09T02:12:27.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.088+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c04d7d0 con 0x7fc96c15c060 2023-07-09T02:12:27.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.092+0000 7fc9627fc640 1 -- 172.21.15.45:0/3180827916 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9640b4050 con 0x7fc96c15c060 2023-07-09T02:12:27.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.092+0000 7fc9627fc640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc9500662b0 0x7fc950068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.092+0000 7fc9627fc640 1 -- 172.21.15.45:0/3180827916 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc96411e860 con 0x7fc96c15c060 2023-07-09T02:12:27.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.092+0000 7fc971867640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc9500662b0 0x7fc950068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.092+0000 7fc971867640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc9500662b0 0x7fc950068760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc968000f70 tx=0x7fc968009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.096+0000 7fc9627fc640 1 -- 172.21.15.45:0/3180827916 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9640ebd80 con 0x7fc96c15c060 2023-07-09T02:12:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc96c0b5df0 con 0x7fc96c15c060 2023-07-09T02:12:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc9627fc640 1 -- 172.21.15.45:0/3180827916 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fc964009450 con 0x7fc96c15c060 2023-07-09T02:12:27.255 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:27.255 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:24.822024+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:27.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc9500662b0 msgr2=0x7fc950068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc9500662b0 0x7fc950068760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc968000f70 tx=0x7fc968009040 comp rx=0 tx=0).stop 2023-07-09T02:12:27.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96c15c060 msgr2=0x7fc96c1f84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96c15c060 0x7fc96c1f84e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc96401cd40 tx=0x7fc964019600 comp rx=0 tx=0).stop 2023-07-09T02:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 shutdown_connections 2023-07-09T02:12:27.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96c15c060 0x7fc96c1f84e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc9500662b0 0x7fc950068760 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc96c0d2620 0x7fc96c1f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 --2- 172.21.15.45:0/3180827916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc96c0cd120 0x7fc96c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 >> 172.21.15.45:0/3180827916 conn(0x7fc96c0698e0 msgr2=0x7fc96c0d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 shutdown_connections 2023-07-09T02:12:27.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.252+0000 7fc973acb640 1 -- 172.21.15.45:0/3180827916 wait complete. 2023-07-09T02:12:27.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:12:11.263177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:12:12.133396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:12:27.278 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:12:27.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68ce40b640 1 Processor -- start 2023-07-09T02:12:27.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68ce40b640 1 -- start start 2023-07-09T02:12:27.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68ce40b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68ce40b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68c80cd120 0x7f68c80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68ce40b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c8160a50 con 0x7f68c815c060 2023-07-09T02:12:27.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68ce40b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c815c430 con 0x7f68c80cd120 2023-07-09T02:12:27.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68ce40b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c815fb60 con 0x7f68c80d2620 2023-07-09T02:12:27.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68cc9a8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68c80cd120 0x7f68c80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68cc9a8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68c80cd120 0x7f68c80cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52734/0 (socket says 172.21.15.45:52734) 2023-07-09T02:12:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68cc9a8640 1 -- 172.21.15.45:0/812067503 learned_addr learned my addr 172.21.15.45:0/812067503 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68c77fe640 1 --2- 172.21.15.45:0/812067503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68cc9a8640 1 -- 172.21.15.45:0/812067503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 msgr2=0x7f68c80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68cc9a8640 1 --2- 172.21.15.45:0/812067503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68cc9a8640 1 -- 172.21.15.45:0/812067503 >> v1:172.21.15.155:6789/0 conn(0x7f68c815c060 legacy=0x7f68c80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68cc9a8640 1 -- 172.21.15.45:0/812067503 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c815fe40 con 0x7f68c80cd120 2023-07-09T02:12:27.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.424+0000 7f68c77fe640 1 --2- 172.21.15.45:0/812067503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68cc9a8640 1 --2- 172.21.15.45:0/812067503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c80cd120 0x7f68c80cee30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009e50 tx=0x7f68c001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195122e4564f5f2c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68c6ffd640 1 -- 172.21.15.45:0/812067503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00a58a0 con 0x7f68c80cd120 2023-07-09T02:12:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68c6ffd640 1 -- 172.21.15.45:0/812067503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00a5a00 con 0x7f68c80cd120 2023-07-09T02:12:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68c6ffd640 1 -- 172.21.15.45:0/812067503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00a5d90 con 0x7f68c80cd120 2023-07-09T02:12:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 -- 172.21.15.45:0/812067503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c80cd120 msgr2=0x7f68c80cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 --2- 172.21.15.45:0/812067503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c80cd120 0x7f68c80cee30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009e50 tx=0x7f68c001c9e0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 -- 172.21.15.45:0/812067503 shutdown_connections 2023-07-09T02:12:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 --2- 172.21.15.45:0/812067503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c80cd120 0x7f68c80cee30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 --2- 172.21.15.45:0/812067503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 -- 172.21.15.45:0/812067503 >> 172.21.15.45:0/812067503 conn(0x7f68c80698e0 msgr2=0x7f68c8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 -- 172.21.15.45:0/812067503 shutdown_connections 2023-07-09T02:12:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 -- 172.21.15.45:0/812067503 wait complete. 2023-07-09T02:12:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 Processor -- start 2023-07-09T02:12:27.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.428+0000 7f68ce40b640 1 -- start start 2023-07-09T02:12:27.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c80cd120 0x7f68c815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c81f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c815c060 0x7f68c8158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c81f49f0 con 0x7f68c815c060 2023-07-09T02:12:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c81f4cd0 con 0x7f68c80cd120 2023-07-09T02:12:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c81f4fb0 con 0x7f68c80d2620 2023-07-09T02:12:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c815c060 0x7f68c8158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c815c060 0x7f68c8158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52750/0 (socket says 172.21.15.45:52750) 2023-07-09T02:12:27.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 -- 172.21.15.45:0/214692462 learned_addr learned my addr 172.21.15.45:0/214692462 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:27.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68c7fff640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c80cd120 0x7f68c815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68c77fe640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c81f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 -- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 msgr2=0x7f68c81f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c81f43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 -- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c80cd120 msgr2=0x7f68c815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c80cd120 0x7f68c815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 -- 172.21.15.45:0/214692462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c0009b30 con 0x7f68c815c060 2023-07-09T02:12:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68c7fff640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c80cd120 0x7f68c815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68cc9a8640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c815c060 0x7f68c8158d10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f68c001a610 tx=0x7f68c0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68c4ff9640 1 -- 172.21.15.45:0/214692462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00b8670 con 0x7f68c815c060 2023-07-09T02:12:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68c4ff9640 1 -- 172.21.15.45:0/214692462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00b87f0 con 0x7f68c815c060 2023-07-09T02:12:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68c4ff9640 1 -- 172.21.15.45:0/214692462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00b8ba0 con 0x7f68c815c060 2023-07-09T02:12:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c80b59f0 con 0x7f68c815c060 2023-07-09T02:12:27.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c81f5290 con 0x7f68c815c060 2023-07-09T02:12:27.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.432+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c815d8e0 con 0x7f68c815c060 2023-07-09T02:12:27.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.436+0000 7f68c4ff9640 1 -- 172.21.15.45:0/214692462 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68c00b8d00 con 0x7f68c815c060 2023-07-09T02:12:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.436+0000 7f68c4ff9640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68b4066280 0x7f68b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.436+0000 7f68c4ff9640 1 -- 172.21.15.45:0/214692462 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68c011f610 con 0x7f68c815c060 2023-07-09T02:12:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.436+0000 7f68c7fff640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68b4066280 0x7f68b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.436+0000 7f68c7fff640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68b4066280 0x7f68b4068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f68c80c9ac0 tx=0x7f68b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.440+0000 7f68c4ff9640 1 -- 172.21.15.45:0/214692462 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68c815d8e0 con 0x7f68c815c060 2023-07-09T02:12:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.592+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f68c815d8e0 con 0x7f68c815c060 2023-07-09T02:12:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.592+0000 7f68c4ff9640 1 -- 172.21.15.45:0/214692462 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f68c815d8e0 con 0x7f68c815c060 2023-07-09T02:12:27.596 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:12:27.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68b4066280 msgr2=0x7f68b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68b4066280 0x7f68b4068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f68c80c9ac0 tx=0x7f68b8009040 comp rx=0 tx=0).stop 2023-07-09T02:12:27.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c815c060 msgr2=0x7f68c8158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c815c060 0x7f68c8158d10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f68c001a610 tx=0x7f68c0019780 comp rx=0 tx=0).stop 2023-07-09T02:12:27.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 shutdown_connections 2023-07-09T02:12:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c815c060 0x7f68c8158d10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68b4066280 0x7f68b4068730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c80d2620 0x7f68c81f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 --2- 172.21.15.45:0/214692462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c80cd120 0x7f68c815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 >> 172.21.15.45:0/214692462 conn(0x7f68c80698e0 msgr2=0x7f68c8069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 shutdown_connections 2023-07-09T02:12:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.596+0000 7f68ce40b640 1 -- 172.21.15.45:0/214692462 wait complete. 2023-07-09T02:12:27.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:12:27.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2ce7b640 1 Processor -- start 2023-07-09T02:12:27.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2ce7b640 1 -- start start 2023-07-09T02:12:27.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2ce7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac2815c060 0x7fac280b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2ce7b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac280d2620 0x7fac280cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2ce7b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac28160a50 con 0x7fac280cd120 2023-07-09T02:12:27.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2ce7b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2815c430 con 0x7fac280d2620 2023-07-09T02:12:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2ce7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2815fb60 con 0x7fac2815c060 2023-07-09T02:12:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac1ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fac280cd120 0x7fac280d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59528/0 (socket says 172.21.15.45:59528) 2023-07-09T02:12:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac1ffff640 1 -- 172.21.15.45:0/3770937350 learned_addr learned my addr 172.21.15.45:0/3770937350 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac26d9d640 1 --2- 172.21.15.45:0/3770937350 >> v2:172.21.15.45:3300/0 conn(0x7fac280d2620 0x7fac280cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2659c640 1 --2- 172.21.15.45:0/3770937350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac2815c060 0x7fac280b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac26d9d640 1 -- 172.21.15.45:0/3770937350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac2815c060 msgr2=0x7fac280b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac26d9d640 1 --2- 172.21.15.45:0/3770937350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac2815c060 0x7fac280b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac26d9d640 1 -- 172.21.15.45:0/3770937350 >> v1:172.21.15.45:6789/0 conn(0x7fac280cd120 legacy=0x7fac280d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac25d9b640 1 -- 172.21.15.45:0/3770937350 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062245064 0 0) 0x7fac28160a50 con 0x7fac280cd120 2023-07-09T02:12:27.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac26d9d640 1 -- 172.21.15.45:0/3770937350 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2815fe40 con 0x7fac280d2620 2023-07-09T02:12:27.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.764+0000 7fac2659c640 1 --2- 172.21.15.45:0/3770937350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac2815c060 0x7fac280b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:27.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac26d9d640 1 --2- 172.21.15.45:0/3770937350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280d2620 0x7fac280cee30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fac20009dc0 tx=0x7fac2001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac2236bb4420283 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac25d9b640 1 -- 172.21.15.45:0/3770937350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200a59c0 con 0x7fac280d2620 2023-07-09T02:12:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac25d9b640 1 -- 172.21.15.45:0/3770937350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac200a5b20 con 0x7fac280d2620 2023-07-09T02:12:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac25d9b640 1 -- 172.21.15.45:0/3770937350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200ad440 con 0x7fac280d2620 2023-07-09T02:12:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3770937350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280d2620 msgr2=0x7fac280cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3770937350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280d2620 0x7fac280cee30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fac20009dc0 tx=0x7fac2001c900 comp rx=0 tx=0).stop 2023-07-09T02:12:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3770937350 shutdown_connections 2023-07-09T02:12:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3770937350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280d2620 0x7fac280cee30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3770937350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac2815c060 0x7fac280b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3770937350 >> 172.21.15.45:0/3770937350 conn(0x7fac280698e0 msgr2=0x7fac28069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3770937350 shutdown_connections 2023-07-09T02:12:27.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3770937350 wait complete. 2023-07-09T02:12:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.768+0000 7fac2ce7b640 1 Processor -- start 2023-07-09T02:12:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 -- start start 2023-07-09T02:12:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280cd120 0x7fac280b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac280d2620 0x7fac28158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac2815c060 0x7fac28151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28159480 con 0x7fac280cd120 2023-07-09T02:12:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28159700 con 0x7fac2815c060 2023-07-09T02:12:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac281599e0 con 0x7fac280d2620 2023-07-09T02:12:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280cd120 0x7fac280b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280cd120 0x7fac280b7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52768/0 (socket says 172.21.15.45:52768) 2023-07-09T02:12:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 -- 172.21.15.45:0/3898895188 learned_addr learned my addr 172.21.15.45:0/3898895188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac26d9d640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac2815c060 0x7fac28151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac1ffff640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac280d2620 0x7fac28158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 -- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac280d2620 msgr2=0x7fac28158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac280d2620 0x7fac28158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 -- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac2815c060 msgr2=0x7fac28151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac2815c060 0x7fac28151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 -- 172.21.15.45:0/3898895188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20009a70 con 0x7fac280cd120 2023-07-09T02:12:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2659c640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280cd120 0x7fac280b7fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fac1800c7f0 tx=0x7fac1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac1effd640 1 -- 172.21.15.45:0/3898895188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18007820 con 0x7fac280cd120 2023-07-09T02:12:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac1effd640 1 -- 172.21.15.45:0/3898895188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac18007980 con 0x7fac280cd120 2023-07-09T02:12:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac280b59f0 con 0x7fac280cd120 2023-07-09T02:12:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac1effd640 1 -- 172.21.15.45:0/3898895188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18007d30 con 0x7fac280cd120 2023-07-09T02:12:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac28159fa0 con 0x7fac280cd120 2023-07-09T02:12:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.772+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2815a190 con 0x7fac280cd120 2023-07-09T02:12:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.776+0000 7fac1effd640 1 -- 172.21.15.45:0/3898895188 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac180113f0 con 0x7fac280cd120 2023-07-09T02:12:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.776+0000 7fac1effd640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac08066280 0x7fac08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.776+0000 7fac1effd640 1 -- 172.21.15.45:0/3898895188 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac18084090 con 0x7fac280cd120 2023-07-09T02:12:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.776+0000 7fac1ffff640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac08066280 0x7fac08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.776+0000 7fac1ffff640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac08066280 0x7fac08068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac2815b380 tx=0x7fac10007b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.780+0000 7fac1effd640 1 -- 172.21.15.45:0/3898895188 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac18051520 con 0x7fac280cd120 2023-07-09T02:12:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac2804d7d0 con 0x7fac280cd120 2023-07-09T02:12:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac1effd640 1 -- 172.21.15.45:0/3898895188 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac18054b40 con 0x7fac280cd120 2023-07-09T02:12:27.939 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:12:27.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac08066280 msgr2=0x7fac08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac08066280 0x7fac08068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fac2815b380 tx=0x7fac10007b80 comp rx=0 tx=0).stop 2023-07-09T02:12:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280cd120 msgr2=0x7fac280b7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280cd120 0x7fac280b7fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fac1800c7f0 tx=0x7fac1800ccb0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 shutdown_connections 2023-07-09T02:12:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac2815c060 0x7fac28151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac08066280 0x7fac08068730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac280d2620 0x7fac28158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 --2- 172.21.15.45:0/3898895188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac280cd120 0x7fac280b7fe0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.936+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 >> 172.21.15.45:0/3898895188 conn(0x7fac280698e0 msgr2=0x7fac280d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.940+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 shutdown_connections 2023-07-09T02:12:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:27.940+0000 7fac2ce7b640 1 -- 172.21.15.45:0/3898895188 wait complete. 2023-07-09T02:12:27.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f74263e9640 1 Processor -- start 2023-07-09T02:12:28.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f74263e9640 1 -- start start 2023-07-09T02:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f74263e9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7420158e30 0x7f742006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f74263e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f74200caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f74263e9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200ccf80 con 0x7f742006fd10 2023-07-09T02:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f74263e9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74200cd540 con 0x7f7420158e30 2023-07-09T02:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f74263e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74200c8fb0 con 0x7f742006c820 2023-07-09T02:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f741ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7420158e30 0x7f742006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f741ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7420158e30 0x7f742006f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52780/0 (socket says 172.21.15.45:52780) 2023-07-09T02:12:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f741ffff640 1 -- 172.21.15.45:0/1878444766 learned_addr learned my addr 172.21.15.45:0/1878444766 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f7424986640 1 --2- 172.21.15.45:0/1878444766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f74200caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f741ffff640 1 -- 172.21.15.45:0/1878444766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 msgr2=0x7f74200caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f741ffff640 1 --2- 172.21.15.45:0/1878444766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f74200caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f741ffff640 1 -- 172.21.15.45:0/1878444766 >> v1:172.21.15.155:6789/0 conn(0x7f742006fd10 legacy=0x7f742006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f741ffff640 1 -- 172.21.15.45:0/1878444766 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200cbad0 con 0x7f7420158e30 2023-07-09T02:12:28.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.104+0000 7f7424986640 1 --2- 172.21.15.45:0/1878444766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f74200caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:28.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f741ffff640 1 --2- 172.21.15.45:0/1878444766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7420158e30 0x7f742006f7d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f741001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca35334dacc56f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f741effd640 1 -- 172.21.15.45:0/1878444766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100a6040 con 0x7f7420158e30 2023-07-09T02:12:28.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f741effd640 1 -- 172.21.15.45:0/1878444766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74100aa600 con 0x7f7420158e30 2023-07-09T02:12:28.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f741effd640 1 -- 172.21.15.45:0/1878444766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100aa990 con 0x7f7420158e30 2023-07-09T02:12:28.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f74263e9640 1 -- 172.21.15.45:0/1878444766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7420158e30 msgr2=0x7f742006f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f74263e9640 1 --2- 172.21.15.45:0/1878444766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7420158e30 0x7f742006f7d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f741001c480 comp rx=0 tx=0).stop 2023-07-09T02:12:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f74263e9640 1 -- 172.21.15.45:0/1878444766 shutdown_connections 2023-07-09T02:12:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f74263e9640 1 --2- 172.21.15.45:0/1878444766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f74200caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f74263e9640 1 --2- 172.21.15.45:0/1878444766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7420158e30 0x7f742006f7d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f74263e9640 1 -- 172.21.15.45:0/1878444766 >> 172.21.15.45:0/1878444766 conn(0x7f74200694b0 msgr2=0x7f74200698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f74263e9640 1 -- 172.21.15.45:0/1878444766 shutdown_connections 2023-07-09T02:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.108+0000 7f74263e9640 1 -- 172.21.15.45:0/1878444766 wait complete. 2023-07-09T02:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 Processor -- start 2023-07-09T02:12:28.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 -- start start 2023-07-09T02:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f742014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f742006fd10 0x7f7420155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7420158e30 0x7f7420145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7420151a60 con 0x7f742006fd10 2023-07-09T02:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7420151190 con 0x7f7420158e30 2023-07-09T02:12:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742014db80 con 0x7f742006c820 2023-07-09T02:12:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f742006fd10 0x7f7420155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f742006fd10 0x7f7420155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52782/0 (socket says 172.21.15.45:52782) 2023-07-09T02:12:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 -- 172.21.15.45:0/2373768015 learned_addr learned my addr 172.21.15.45:0/2373768015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f7424986640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7420158e30 0x7f7420145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741ffff640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f742014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 -- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 msgr2=0x7f742014d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f742014d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 -- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7420158e30 msgr2=0x7f7420145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7420158e30 0x7f7420145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 -- 172.21.15.45:0/2373768015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100094d0 con 0x7f742006fd10 2023-07-09T02:12:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741f7fe640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f742006fd10 0x7f7420155730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f741400c500 tx=0x7f741400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741cff9640 1 -- 172.21.15.45:0/2373768015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414005220 con 0x7f742006fd10 2023-07-09T02:12:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741cff9640 1 -- 172.21.15.45:0/2373768015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414005380 con 0x7f742006fd10 2023-07-09T02:12:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f741cff9640 1 -- 172.21.15.45:0/2373768015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414007270 con 0x7f742006fd10 2023-07-09T02:12:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7420151410 con 0x7f742006fd10 2023-07-09T02:12:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.112+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7420155c70 con 0x7f742006fd10 2023-07-09T02:12:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.116+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7420151c10 con 0x7f742006fd10 2023-07-09T02:12:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.116+0000 7f741cff9640 1 -- 172.21.15.45:0/2373768015 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74140073d0 con 0x7f742006fd10 2023-07-09T02:12:28.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.116+0000 7f741cff9640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f740c066280 0x7f740c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.116+0000 7f741cff9640 1 -- 172.21.15.45:0/2373768015 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7414083510 con 0x7f742006fd10 2023-07-09T02:12:28.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.116+0000 7f741ffff640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f740c066280 0x7f740c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.116+0000 7f741ffff640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f740c066280 0x7f740c068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f74100ae000 tx=0x7f74100b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.120+0000 7f741cff9640 1 -- 172.21.15.45:0/2373768015 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7420151c10 con 0x7f742006fd10 2023-07-09T02:12:28.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.272+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7420151c10 con 0x7f742006fd10 2023-07-09T02:12:28.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.272+0000 7f741cff9640 1 -- 172.21.15.45:0/2373768015 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7420151c10 con 0x7f742006fd10 2023-07-09T02:12:28.276 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:12:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f740c066280 msgr2=0x7f740c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f740c066280 0x7f740c068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f74100ae000 tx=0x7f74100b5040 comp rx=0 tx=0).stop 2023-07-09T02:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f742006fd10 msgr2=0x7f7420155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f742006fd10 0x7f7420155730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f741400c500 tx=0x7f741400c9c0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 shutdown_connections 2023-07-09T02:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7420158e30 0x7f7420145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f742006fd10 0x7f7420155730 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f740c066280 0x7f740c068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 --2- 172.21.15.45:0/2373768015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742006c820 0x7f742014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 >> 172.21.15.45:0/2373768015 conn(0x7f74200694b0 msgr2=0x7f742006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:28.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 shutdown_connections 2023-07-09T02:12:28.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.276+0000 7f74263e9640 1 -- 172.21.15.45:0/2373768015 wait complete. 2023-07-09T02:12:28.296 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:12:28.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82d5782640 1 Processor -- start 2023-07-09T02:12:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82d5782640 1 -- start start 2023-07-09T02:12:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82d5782640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82d00d2620 0x7f82d00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82d5782640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d00cd120 0x7f82d00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82d5782640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d0160a50 con 0x7f82d015c060 2023-07-09T02:12:28.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82d5782640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d015c430 con 0x7f82d00d2620 2023-07-09T02:12:28.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82d5782640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d015fb60 con 0x7f82d00cd120 2023-07-09T02:12:28.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82c7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82d00d2620 0x7f82d00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82cf7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d00cd120 0x7f82d00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82cf7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d00cd120 0x7f82d00cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:55520/0 (socket says 172.21.15.45:55520) 2023-07-09T02:12:28.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82c7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82d00d2620 0x7f82d00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:56322/0 (socket says 172.21.15.45:56322) 2023-07-09T02:12:28.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82cf7fe640 1 -- 172.21.15.45:0/2452381879 learned_addr learned my addr 172.21.15.45:0/2452381879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:28.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82cf7fe640 1 -- 172.21.15.45:0/2452381879 >> v2:172.21.15.155:3300/0 conn(0x7f82d00d2620 msgr2=0x7f82d00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:28.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82cf7fe640 1 --2- 172.21.15.45:0/2452381879 >> v2:172.21.15.155:3300/0 conn(0x7f82d00d2620 0x7f82d00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82cf7fe640 1 -- 172.21.15.45:0/2452381879 >> v1:172.21.15.155:6789/0 conn(0x7f82d015c060 legacy=0x7f82d00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82cf7fe640 1 -- 172.21.15.45:0/2452381879 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d015fe40 con 0x7f82d00cd120 2023-07-09T02:12:28.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.440+0000 7f82c7fff640 1 --2- 172.21.15.45:0/2452381879 >> v2:172.21.15.155:3300/0 conn(0x7f82d00d2620 0x7f82d00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:28.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82cf7fe640 1 --2- 172.21.15.45:0/2452381879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d00cd120 0x7f82d00cee30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009e50 tx=0x7f82c801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35515d660c50eb79 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82ce7fc640 1 -- 172.21.15.45:0/2452381879 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80a58a0 con 0x7f82d00cd120 2023-07-09T02:12:28.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82ce7fc640 1 -- 172.21.15.45:0/2452381879 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c80a5a00 con 0x7f82d00cd120 2023-07-09T02:12:28.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82ce7fc640 1 -- 172.21.15.45:0/2452381879 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80a5d90 con 0x7f82d00cd120 2023-07-09T02:12:28.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82d5782640 1 -- 172.21.15.45:0/2452381879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d00cd120 msgr2=0x7f82d00cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82d5782640 1 --2- 172.21.15.45:0/2452381879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d00cd120 0x7f82d00cee30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009e50 tx=0x7f82c801c9e0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82d5782640 1 -- 172.21.15.45:0/2452381879 shutdown_connections 2023-07-09T02:12:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82d5782640 1 --2- 172.21.15.45:0/2452381879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d00cd120 0x7f82d00cee30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82d5782640 1 --2- 172.21.15.45:0/2452381879 >> v2:172.21.15.155:3300/0 conn(0x7f82d00d2620 0x7f82d00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82d5782640 1 -- 172.21.15.45:0/2452381879 >> 172.21.15.45:0/2452381879 conn(0x7f82d00698e0 msgr2=0x7f82d0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:28.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82d5782640 1 -- 172.21.15.45:0/2452381879 shutdown_connections 2023-07-09T02:12:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.444+0000 7f82d5782640 1 -- 172.21.15.45:0/2452381879 wait complete. 2023-07-09T02:12:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 Processor -- start 2023-07-09T02:12:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 -- start start 2023-07-09T02:12:28.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d00cd120 0x7f82d0151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d00d2620 0x7f82d0152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d015c060 0x7f82d00b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d015a1e0 con 0x7f82d00d2620 2023-07-09T02:12:28.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0159c20 con 0x7f82d00cd120 2023-07-09T02:12:28.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0159f00 con 0x7f82d015c060 2023-07-09T02:12:28.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d00d2620 0x7f82d0152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82ceffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d00cd120 0x7f82d0151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d00d2620 0x7f82d0152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52790/0 (socket says 172.21.15.45:52790) 2023-07-09T02:12:28.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82c7fff640 1 -- 172.21.15.45:0/3350589952 learned_addr learned my addr 172.21.15.45:0/3350589952 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:28.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82cf7fe640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d015c060 0x7f82d00b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82ceffd640 1 -- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d015c060 msgr2=0x7f82d00b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82ceffd640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d015c060 0x7f82d00b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82ceffd640 1 -- 172.21.15.45:0/3350589952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d00d2620 msgr2=0x7f82d0152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82ceffd640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d00d2620 0x7f82d0152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82ceffd640 1 -- 172.21.15.45:0/3350589952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8009420 con 0x7f82d00cd120 2023-07-09T02:12:28.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82c7fff640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d00d2620 0x7f82d0152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:28.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82ceffd640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d00cd120 0x7f82d0151c90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f82c0000f70 tx=0x7f82c000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82c77fe640 1 -- 172.21.15.45:0/3350589952 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00052d0 con 0x7f82d00cd120 2023-07-09T02:12:28.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82c77fe640 1 -- 172.21.15.45:0/3350589952 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0005430 con 0x7f82d00cd120 2023-07-09T02:12:28.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82c77fe640 1 -- 172.21.15.45:0/3350589952 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0003840 con 0x7f82d00cd120 2023-07-09T02:12:28.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c8009b30 con 0x7f82d00cd120 2023-07-09T02:12:28.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.448+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d00b59f0 con 0x7f82d00cd120 2023-07-09T02:12:28.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.452+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d015dbe0 con 0x7f82d00cd120 2023-07-09T02:12:28.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.452+0000 7f82c77fe640 1 -- 172.21.15.45:0/3350589952 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82c00039a0 con 0x7f82d00cd120 2023-07-09T02:12:28.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.452+0000 7f82c77fe640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82b00662d0 0x7f82b0068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.452+0000 7f82c77fe640 1 -- 172.21.15.45:0/3350589952 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82c0083210 con 0x7f82d00cd120 2023-07-09T02:12:28.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.452+0000 7f82c7fff640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82b00662d0 0x7f82b0068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.452+0000 7f82c7fff640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82b00662d0 0x7f82b0068780 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f82d00c9940 tx=0x7f82b8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.456+0000 7f82c77fe640 1 -- 172.21.15.45:0/3350589952 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82c00507b0 con 0x7f82d00cd120 2023-07-09T02:12:28.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.608+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82d015dbe0 con 0x7f82d00cd120 2023-07-09T02:12:28.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82c77fe640 1 -- 172.21.15.45:0/3350589952 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82d015dbe0 con 0x7f82d00cd120 2023-07-09T02:12:28.614 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:12:28.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82b00662d0 msgr2=0x7f82b0068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82b00662d0 0x7f82b0068780 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f82d00c9940 tx=0x7f82b8009190 comp rx=0 tx=0).stop 2023-07-09T02:12:28.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d00cd120 msgr2=0x7f82d0151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d00cd120 0x7f82d0151c90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f82c0000f70 tx=0x7f82c000c820 comp rx=0 tx=0).stop 2023-07-09T02:12:28.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 shutdown_connections 2023-07-09T02:12:28.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82b00662d0 0x7f82b0068780 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82d015c060 0x7f82d00b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d00d2620 0x7f82d0152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 --2- 172.21.15.45:0/3350589952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d00cd120 0x7f82d0151c90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 >> 172.21.15.45:0/3350589952 conn(0x7f82d00698e0 msgr2=0x7f82d00b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 shutdown_connections 2023-07-09T02:12:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.612+0000 7f82d5782640 1 -- 172.21.15.45:0/3350589952 wait complete. 2023-07-09T02:12:28.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:12:28.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6ae0159640 1 Processor -- start 2023-07-09T02:12:28.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6ae0159640 1 -- start start 2023-07-09T02:12:28.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6ae0159640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80cd290 0x7f6ad80cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6ae0159640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ad806a5c0 0x7f6ad806aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6ae0159640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad8071140 con 0x7f6ad80b2340 2023-07-09T02:12:28.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6ae0159640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad806b010 con 0x7f6ad806a5c0 2023-07-09T02:12:28.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6ae0159640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80cdba0 con 0x7f6ad80cd290 2023-07-09T02:12:28.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6add6f4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ad806a5c0 0x7f6ad806aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6addef5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80cd290 0x7f6ad80cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6add6f4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ad806a5c0 0x7f6ad806aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:56336/0 (socket says 172.21.15.45:56336) 2023-07-09T02:12:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6add6f4640 1 -- 172.21.15.45:0/660770596 learned_addr learned my addr 172.21.15.45:0/660770596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6ade6f6640 1 --1- 172.21.15.45:0/660770596 >> v1:172.21.15.155:6789/0 conn(0x7f6ad80b2340 0x7f6ad80b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:33280/0 (socket says 172.21.15.45:33280) 2023-07-09T02:12:28.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6add6f4640 1 -- 172.21.15.45:0/660770596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80cd290 msgr2=0x7f6ad80cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6add6f4640 1 --2- 172.21.15.45:0/660770596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80cd290 0x7f6ad80cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6add6f4640 1 -- 172.21.15.45:0/660770596 >> v1:172.21.15.155:6789/0 conn(0x7f6ad80b2340 legacy=0x7f6ad80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6add6f4640 1 -- 172.21.15.45:0/660770596 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad815c970 con 0x7f6ad806a5c0 2023-07-09T02:12:28.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.780+0000 7f6addef5640 1 --2- 172.21.15.45:0/660770596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80cd290 0x7f6ad80cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6add6f4640 1 --2- 172.21.15.45:0/660770596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 0x7f6ad806aa10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009870 tx=0x7f6ac801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=462cacf1a56ae0e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6adcef3640 1 -- 172.21.15.45:0/660770596 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80a7070 con 0x7f6ad806a5c0 2023-07-09T02:12:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6adcef3640 1 -- 172.21.15.45:0/660770596 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80ab430 con 0x7f6ad806a5c0 2023-07-09T02:12:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6adcef3640 1 -- 172.21.15.45:0/660770596 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80ab7c0 con 0x7f6ad806a5c0 2023-07-09T02:12:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6ae0159640 1 -- 172.21.15.45:0/660770596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 msgr2=0x7f6ad806aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6ae0159640 1 --2- 172.21.15.45:0/660770596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 0x7f6ad806aa10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009870 tx=0x7f6ac801c540 comp rx=0 tx=0).stop 2023-07-09T02:12:28.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6ae0159640 1 -- 172.21.15.45:0/660770596 shutdown_connections 2023-07-09T02:12:28.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6ae0159640 1 --2- 172.21.15.45:0/660770596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 0x7f6ad806aa10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6ae0159640 1 --2- 172.21.15.45:0/660770596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80cd290 0x7f6ad80cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6ae0159640 1 -- 172.21.15.45:0/660770596 >> 172.21.15.45:0/660770596 conn(0x7f6ad806d140 msgr2=0x7f6ad806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:28.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6ae0159640 1 -- 172.21.15.45:0/660770596 shutdown_connections 2023-07-09T02:12:28.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.784+0000 7f6ae0159640 1 -- 172.21.15.45:0/660770596 wait complete. 2023-07-09T02:12:28.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 Processor -- start 2023-07-09T02:12:28.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 -- start start 2023-07-09T02:12:28.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 0x7f6ad81557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80b2340 0x7f6ad8155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad80cd290 0x7f6ad80b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad815e3f0 con 0x7f6ad80cd290 2023-07-09T02:12:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80b6440 con 0x7f6ad806a5c0 2023-07-09T02:12:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad8156440 con 0x7f6ad80b2340 2023-07-09T02:12:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad80cd290 0x7f6ad80b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad80cd290 0x7f6ad80b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52794/0 (socket says 172.21.15.45:52794) 2023-07-09T02:12:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 -- 172.21.15.45:0/1867317935 learned_addr learned my addr 172.21.15.45:0/1867317935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:28.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6addef5640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 0x7f6ad81557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6add6f4640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80b2340 0x7f6ad8155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 -- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80b2340 msgr2=0x7f6ad8155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80b2340 0x7f6ad8155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 -- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 msgr2=0x7f6ad81557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 0x7f6ad81557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 -- 172.21.15.45:0/1867317935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4009420 con 0x7f6ad80cd290 2023-07-09T02:12:28.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6add6f4640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80b2340 0x7f6ad8155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:28.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ade6f6640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad80cd290 0x7f6ad80b3900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c800 tx=0x7f6ad000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ace7fc640 1 -- 172.21.15.45:0/1867317935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000a640 con 0x7f6ad80cd290 2023-07-09T02:12:28.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ace7fc640 1 -- 172.21.15.45:0/1867317935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad000a7a0 con 0x7f6ad80cd290 2023-07-09T02:12:28.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac80094d0 con 0x7f6ad80cd290 2023-07-09T02:12:28.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ace7fc640 1 -- 172.21.15.45:0/1867317935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000ab10 con 0x7f6ad80cd290 2023-07-09T02:12:28.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.788+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad815dd30 con 0x7f6ad80cd290 2023-07-09T02:12:28.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.792+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad815e530 con 0x7f6ad80cd290 2023-07-09T02:12:28.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.792+0000 7f6ace7fc640 1 -- 172.21.15.45:0/1867317935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ad000ac70 con 0x7f6ad80cd290 2023-07-09T02:12:28.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.792+0000 7f6ace7fc640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6abc066280 0x7f6abc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:28.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.792+0000 7f6ace7fc640 1 -- 172.21.15.45:0/1867317935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ad0083500 con 0x7f6ad80cd290 2023-07-09T02:12:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.792+0000 7f6addef5640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6abc066280 0x7f6abc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.792+0000 7f6addef5640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6abc066280 0x7f6abc068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009c50 tx=0x7f6ad4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:28.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.796+0000 7f6ace7fc640 1 -- 172.21.15.45:0/1867317935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ad815e530 con 0x7f6ad80cd290 2023-07-09T02:12:28.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.964+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ad815e530 con 0x7f6ad80cd290 2023-07-09T02:12:28.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.964+0000 7f6ace7fc640 1 -- 172.21.15.45:0/1867317935 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6ad815e530 con 0x7f6ad80cd290 2023-07-09T02:12:28.968 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:12:28.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6abc066280 msgr2=0x7f6abc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6abc066280 0x7f6abc068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009c50 tx=0x7f6ad4009190 comp rx=0 tx=0).stop 2023-07-09T02:12:28.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad80cd290 msgr2=0x7f6ad80b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:28.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad80cd290 0x7f6ad80b3900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c800 tx=0x7f6ad000ccc0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 shutdown_connections 2023-07-09T02:12:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad80cd290 0x7f6ad80b3900 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6abc066280 0x7f6abc068730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ad80b2340 0x7f6ad8155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 --2- 172.21.15.45:0/1867317935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ad806a5c0 0x7f6ad81557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 >> 172.21.15.45:0/1867317935 conn(0x7f6ad806d140 msgr2=0x7f6ad80b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 shutdown_connections 2023-07-09T02:12:28.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:28.968+0000 7f6ae0159640 1 -- 172.21.15.45:0/1867317935 wait complete. 2023-07-09T02:12:28.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:12:28.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:28.989 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:29.093 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:12:29.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:29.094 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:12:29.104 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:12:29.105 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:29.115 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:12:29.116 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:29.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:29.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0ec00b640 1 Processor -- start 2023-07-09T02:12:29.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0ec00b640 1 -- start start 2023-07-09T02:12:29.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0ec00b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0e415c060 0x7fa0e40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0ec00b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e40cd120 0x7fa0e40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0ec00b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e4160a50 con 0x7fa0e40d2450 2023-07-09T02:12:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0ec00b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e40d28f0 con 0x7fa0e415c060 2023-07-09T02:12:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0ec00b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40cfe40 con 0x7fa0e40cd120 2023-07-09T02:12:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e9da7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0e415c060 0x7fa0e40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e9da7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0e415c060 0x7fa0e40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52800/0 (socket says 172.21.15.45:52800) 2023-07-09T02:12:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e9da7640 1 -- 172.21.15.45:0/2069633828 learned_addr learned my addr 172.21.15.45:0/2069633828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0ea5a8640 1 --1- 172.21.15.45:0/2069633828 >> v1:172.21.15.45:6789/0 conn(0x7fa0e40d2450 0x7fa0e40d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59542/0 (socket says 172.21.15.45:59542) 2023-07-09T02:12:29.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e95a6640 1 --2- 172.21.15.45:0/2069633828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e40cd120 0x7fa0e40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e9da7640 1 -- 172.21.15.45:0/2069633828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e40cd120 msgr2=0x7fa0e40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:29.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e9da7640 1 --2- 172.21.15.45:0/2069633828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e40cd120 0x7fa0e40d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e9da7640 1 -- 172.21.15.45:0/2069633828 >> v1:172.21.15.45:6789/0 conn(0x7fa0e40d2450 legacy=0x7fa0e40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e9da7640 1 -- 172.21.15.45:0/2069633828 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e415c430 con 0x7fa0e415c060 2023-07-09T02:12:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.308+0000 7fa0e8da5640 1 -- 172.21.15.45:0/2069633828 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843494310 0 0) 0x7fa0e4160a50 con 0x7fa0e40d2450 2023-07-09T02:12:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0e9da7640 1 --2- 172.21.15.45:0/2069633828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e415c060 0x7fa0e40b4ed0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009870 tx=0x7fa0e001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f193f3aa8c11c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:29.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0e8da5640 1 -- 172.21.15.45:0/2069633828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00a7070 con 0x7fa0e415c060 2023-07-09T02:12:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0e8da5640 1 -- 172.21.15.45:0/2069633828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e00ab430 con 0x7fa0e415c060 2023-07-09T02:12:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0e8da5640 1 -- 172.21.15.45:0/2069633828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00ab7c0 con 0x7fa0e415c060 2023-07-09T02:12:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0ec00b640 1 -- 172.21.15.45:0/2069633828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e415c060 msgr2=0x7fa0e40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/2069633828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e415c060 0x7fa0e40b4ed0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009870 tx=0x7fa0e001c510 comp rx=0 tx=0).stop 2023-07-09T02:12:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0ec00b640 1 -- 172.21.15.45:0/2069633828 shutdown_connections 2023-07-09T02:12:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/2069633828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e40cd120 0x7fa0e40d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/2069633828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e415c060 0x7fa0e40b4ed0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0ec00b640 1 -- 172.21.15.45:0/2069633828 >> 172.21.15.45:0/2069633828 conn(0x7fa0e40698e0 msgr2=0x7fa0e4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0ec00b640 1 -- 172.21.15.45:0/2069633828 shutdown_connections 2023-07-09T02:12:29.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.312+0000 7fa0ec00b640 1 -- 172.21.15.45:0/2069633828 wait complete. 2023-07-09T02:12:29.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 Processor -- start 2023-07-09T02:12:29.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 -- start start 2023-07-09T02:12:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e40cd120 0x7fa0e41528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e40d2450 0x7fa0e4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e415c060 0x7fa0e4152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e40cc700 con 0x7fa0e40cd120 2023-07-09T02:12:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4154680 con 0x7fa0e40d2450 2023-07-09T02:12:29.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4154c40 con 0x7fa0e415c060 2023-07-09T02:12:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e40cd120 0x7fa0e41528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e40cd120 0x7fa0e41528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52810/0 (socket says 172.21.15.45:52810) 2023-07-09T02:12:29.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 -- 172.21.15.45:0/14654521 learned_addr learned my addr 172.21.15.45:0/14654521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:29.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 -- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e415c060 msgr2=0x7fa0e4152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e415c060 0x7fa0e4152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 -- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e40d2450 msgr2=0x7fa0e4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e40d2450 0x7fa0e4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 -- 172.21.15.45:0/14654521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00094d0 con 0x7fa0e40cd120 2023-07-09T02:12:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0e9da7640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e40cd120 0x7fa0e41528e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00ad040 tx=0x7fa0e001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0da7fc640 1 -- 172.21.15.45:0/14654521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0004220 con 0x7fa0e40cd120 2023-07-09T02:12:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0da7fc640 1 -- 172.21.15.45:0/14654521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e0004380 con 0x7fa0e40cd120 2023-07-09T02:12:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0da7fc640 1 -- 172.21.15.45:0/14654521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0003840 con 0x7fa0e40cd120 2023-07-09T02:12:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e40cc950 con 0x7fa0e40cd120 2023-07-09T02:12:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e41548d0 con 0x7fa0e40cd120 2023-07-09T02:12:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.316+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e404d7d0 con 0x7fa0e40cd120 2023-07-09T02:12:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.320+0000 7fa0da7fc640 1 -- 172.21.15.45:0/14654521 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa0e00039a0 con 0x7fa0e40cd120 2023-07-09T02:12:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.320+0000 7fa0da7fc640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0c80662b0 0x7fa0c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.320+0000 7fa0da7fc640 1 -- 172.21.15.45:0/14654521 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0e011dac0 con 0x7fa0e40cd120 2023-07-09T02:12:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.320+0000 7fa0e95a6640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0c80662b0 0x7fa0c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.320+0000 7fa0e95a6640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0c80662b0 0x7fa0c8068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40c9790 tx=0x7fa0d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:29.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.324+0000 7fa0da7fc640 1 -- 172.21.15.45:0/14654521 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0e00eaea0 con 0x7fa0e40cd120 2023-07-09T02:12:29.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.476+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0e4154a90 con 0x7fa0e40cd120 2023-07-09T02:12:29.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0da7fc640 1 -- 172.21.15.45:0/14654521 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fa0e00044f0 con 0x7fa0e40cd120 2023-07-09T02:12:29.481 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:29.481 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:24.822024+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0c80662b0 msgr2=0x7fa0c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0c80662b0 0x7fa0c8068760 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa0e40c9790 tx=0x7fa0d4008040 comp rx=0 tx=0).stop 2023-07-09T02:12:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e40cd120 msgr2=0x7fa0e41528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e40cd120 0x7fa0e41528e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00ad040 tx=0x7fa0e001ad50 comp rx=0 tx=0).stop 2023-07-09T02:12:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 shutdown_connections 2023-07-09T02:12:29.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0c80662b0 0x7fa0c8068760 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0e415c060 0x7fa0e4152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e40d2450 0x7fa0e4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 --2- 172.21.15.45:0/14654521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e40cd120 0x7fa0e41528e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 >> 172.21.15.45:0/14654521 conn(0x7fa0e40698e0 msgr2=0x7fa0e40b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:29.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 shutdown_connections 2023-07-09T02:12:29.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.480+0000 7fa0ec00b640 1 -- 172.21.15.45:0/14654521 wait complete. 2023-07-09T02:12:29.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:12:11.263177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:12:12.133396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:12:29.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:12:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faee5493640 1 Processor -- start 2023-07-09T02:12:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faee5493640 1 -- start start 2023-07-09T02:12:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faee5493640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee015c060 0x7faee00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faee5493640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee0160a50 con 0x7faee00cd120 2023-07-09T02:12:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faee5493640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee015c430 con 0x7faee00d2620 2023-07-09T02:12:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faee5493640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee015fb60 con 0x7faee015c060 2023-07-09T02:12:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faed7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faee00cd120 0x7faee00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59554/0 (socket says 172.21.15.45:59554) 2023-07-09T02:12:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faed7fff640 1 -- 172.21.15.45:0/2653220184 learned_addr learned my addr 172.21.15.45:0/2653220184 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faedeffd640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee015c060 0x7faee00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742094350 0 0) 0x7faee0160a50 con 0x7faee00cd120 2023-07-09T02:12:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faecc003530 con 0x7faee00cd120 2023-07-09T02:12:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115159165 0 0) 0x7faee015c430 con 0x7faee00d2620 2023-07-09T02:12:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faee0160a50 con 0x7faee00d2620 2023-07-09T02:12:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023666966 0 0) 0x7faecc003530 con 0x7faee00cd120 2023-07-09T02:12:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee015c060 msgr2=0x7faee00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee015c060 0x7faee00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 >> v1:172.21.15.155:6789/0 conn(0x7faee00d2620 legacy=0x7faee00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee015fe40 con 0x7faee00cd120 2023-07-09T02:12:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7faec8001680 con 0x7faee00cd120 2023-07-09T02:12:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 >> v1:172.21.15.45:6789/0 conn(0x7faee00cd120 legacy=0x7faee00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003b40 0x7faecc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee015c060 0x7faecc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc004d10 0x7faecc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee015fb60 con 0x7faecc003b40 2023-07-09T02:12:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00ba40 con 0x7faecc004d10 2023-07-09T02:12:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.648+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc00bc00 con 0x7faee015c060 2023-07-09T02:12:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faedeffd640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003b40 0x7faecc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faedf7fe640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc004d10 0x7faecc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faed7fff640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee015c060 0x7faecc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faedeffd640 1 -- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee015c060 msgr2=0x7faecc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faedeffd640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee015c060 0x7faecc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faedeffd640 1 -- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc004d10 msgr2=0x7faecc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faedeffd640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc004d10 0x7faecc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faedeffd640 1 -- 172.21.15.45:0/2653220184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc003530 con 0x7faecc003b40 2023-07-09T02:12:29.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faedeffd640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003b40 0x7faecc003f30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7faed0009ab0 tx=0x7faed001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c763841b8f619f76 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:29.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00a55f0 con 0x7faecc003b40 2023-07-09T02:12:29.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed00a5750 con 0x7faecc003b40 2023-07-09T02:12:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.652+0000 7faede7fc640 1 -- 172.21.15.45:0/2653220184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00a5b00 con 0x7faecc003b40 2023-07-09T02:12:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- 172.21.15.45:0/2653220184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003b40 msgr2=0x7faecc003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 --2- 172.21.15.45:0/2653220184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faecc003b40 0x7faecc003f30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7faed0009ab0 tx=0x7faed001ca00 comp rx=0 tx=0).stop 2023-07-09T02:12:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedf7fe640 1 -- 172.21.15.45:0/2653220184 reap_dead start 2023-07-09T02:12:29.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- 172.21.15.45:0/2653220184 shutdown_connections 2023-07-09T02:12:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- 172.21.15.45:0/2653220184 >> 172.21.15.45:0/2653220184 conn(0x7faee00698e0 msgr2=0x7faee0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- 172.21.15.45:0/2653220184 shutdown_connections 2023-07-09T02:12:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- 172.21.15.45:0/2653220184 wait complete. 2023-07-09T02:12:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 Processor -- start 2023-07-09T02:12:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- start start 2023-07-09T02:12:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc003b40 0x7faee015ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee0157110 0x7faee01f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee01477e0 0x7faee0147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01481c0 con 0x7faee01477e0 2023-07-09T02:12:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01575f0 con 0x7faecc003b40 2023-07-09T02:12:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faee5493640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee01578d0 con 0x7faee0157110 2023-07-09T02:12:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedeffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc003b40 0x7faee015ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee01477e0 0x7faee0147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedeffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc003b40 0x7faee015ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:56380/0 (socket says 172.21.15.45:56380) 2023-07-09T02:12:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedeffd640 1 -- 172.21.15.45:0/3021962264 learned_addr learned my addr 172.21.15.45:0/3021962264 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faed7fff640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee0157110 0x7faee01f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedeffd640 1 -- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee0157110 msgr2=0x7faee01f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedeffd640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee0157110 0x7faee01f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedeffd640 1 -- 172.21.15.45:0/3021962264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee01477e0 msgr2=0x7faee0147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedeffd640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee01477e0 0x7faee0147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedeffd640 1 -- 172.21.15.45:0/3021962264 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee0157bb0 con 0x7faecc003b40 2023-07-09T02:12:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.656+0000 7faedf7fe640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee01477e0 0x7faee0147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faedeffd640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc003b40 0x7faee015ef60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faed00b0040 tx=0x7faecc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faed77fe640 1 -- 172.21.15.45:0/3021962264 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00be070 con 0x7faecc003b40 2023-07-09T02:12:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faed77fe640 1 -- 172.21.15.45:0/3021962264 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed000f000 con 0x7faecc003b40 2023-07-09T02:12:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee0157e90 con 0x7faecc003b40 2023-07-09T02:12:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faed77fe640 1 -- 172.21.15.45:0/3021962264 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00a55f0 con 0x7faecc003b40 2023-07-09T02:12:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee015f4a0 con 0x7faecc003b40 2023-07-09T02:12:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee00cb450 con 0x7faecc003b40 2023-07-09T02:12:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faed77fe640 1 -- 172.21.15.45:0/3021962264 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faed00b4040 con 0x7faecc003b40 2023-07-09T02:12:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faed77fe640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faec00662b0 0x7faec0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.660+0000 7faed77fe640 1 -- 172.21.15.45:0/3021962264 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faed011e230 con 0x7faecc003b40 2023-07-09T02:12:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.664+0000 7faed7fff640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faec00662b0 0x7faec0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.664+0000 7faed7fff640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faec00662b0 0x7faec0068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faee0157520 tx=0x7faec8007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.664+0000 7faed77fe640 1 -- 172.21.15.45:0/3021962264 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faed00eb780 con 0x7faecc003b40 2023-07-09T02:12:29.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faee01580d0 con 0x7faecc003b40 2023-07-09T02:12:29.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faed77fe640 1 -- 172.21.15.45:0/3021962264 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7faed00eed60 con 0x7faecc003b40 2023-07-09T02:12:29.826 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:12:29.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faec00662b0 msgr2=0x7faec0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faec00662b0 0x7faec0068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faee0157520 tx=0x7faec8007040 comp rx=0 tx=0).stop 2023-07-09T02:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc003b40 msgr2=0x7faee015ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc003b40 0x7faee015ef60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faed00b0040 tx=0x7faecc005800 comp rx=0 tx=0).stop 2023-07-09T02:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 shutdown_connections 2023-07-09T02:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee01477e0 0x7faee0147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faec00662b0 0x7faec0068760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faee0157110 0x7faee01f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 --2- 172.21.15.45:0/3021962264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faecc003b40 0x7faee015ef60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 >> 172.21.15.45:0/3021962264 conn(0x7faee00698e0 msgr2=0x7faee00b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 shutdown_connections 2023-07-09T02:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.824+0000 7faee5493640 1 -- 172.21.15.45:0/3021962264 wait complete. 2023-07-09T02:12:29.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:12:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.992+0000 7f37226d8640 1 Processor -- start 2023-07-09T02:12:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.992+0000 7f37226d8640 1 -- start start 2023-07-09T02:12:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f37226d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f371c15c060 0x7f371c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f37226d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0d2620 0x7f371c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f37226d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c160a50 con 0x7f371c0cd120 2023-07-09T02:12:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f37226d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c15c430 con 0x7f371c15c060 2023-07-09T02:12:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f37226d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c15fb60 con 0x7f371c0d2620 2023-07-09T02:12:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f3720c75640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0d2620 0x7f371c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f371b7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f371c0cd120 0x7f371c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:33298/0 (socket says 172.21.15.45:33298) 2023-07-09T02:12:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f371b7fe640 1 -- 172.21.15.45:0/2954168010 learned_addr learned my addr 172.21.15.45:0/2954168010 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f371bfff640 1 --2- 172.21.15.45:0/2954168010 >> v2:172.21.15.155:3300/0 conn(0x7f371c15c060 0x7f371c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f3720c75640 1 -- 172.21.15.45:0/2954168010 >> v2:172.21.15.155:3300/0 conn(0x7f371c15c060 msgr2=0x7f371c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f3720c75640 1 --2- 172.21.15.45:0/2954168010 >> v2:172.21.15.155:3300/0 conn(0x7f371c15c060 0x7f371c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f3720c75640 1 -- 172.21.15.45:0/2954168010 >> v1:172.21.15.155:6789/0 conn(0x7f371c0cd120 legacy=0x7f371c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f371affd640 1 -- 172.21.15.45:0/2954168010 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998340036 0 0) 0x7f371c160a50 con 0x7f371c0cd120 2023-07-09T02:12:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:29.996+0000 7f3720c75640 1 -- 172.21.15.45:0/2954168010 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c15fe40 con 0x7f371c0d2620 2023-07-09T02:12:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f3720c75640 1 --2- 172.21.15.45:0/2954168010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0d2620 0x7f371c0cee30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3714009d90 tx=0x7f371401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd0d80cf2eddc70 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f371affd640 1 -- 172.21.15.45:0/2954168010 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37140a59e0 con 0x7f371c0d2620 2023-07-09T02:12:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f371affd640 1 -- 172.21.15.45:0/2954168010 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37140a5b40 con 0x7f371c0d2620 2023-07-09T02:12:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f371affd640 1 -- 172.21.15.45:0/2954168010 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37140ad440 con 0x7f371c0d2620 2023-07-09T02:12:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 -- 172.21.15.45:0/2954168010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0d2620 msgr2=0x7f371c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 --2- 172.21.15.45:0/2954168010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0d2620 0x7f371c0cee30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3714009d90 tx=0x7f371401c920 comp rx=0 tx=0).stop 2023-07-09T02:12:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 -- 172.21.15.45:0/2954168010 shutdown_connections 2023-07-09T02:12:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 --2- 172.21.15.45:0/2954168010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0d2620 0x7f371c0cee30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 --2- 172.21.15.45:0/2954168010 >> v2:172.21.15.155:3300/0 conn(0x7f371c15c060 0x7f371c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 -- 172.21.15.45:0/2954168010 >> 172.21.15.45:0/2954168010 conn(0x7f371c0698e0 msgr2=0x7f371c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 -- 172.21.15.45:0/2954168010 shutdown_connections 2023-07-09T02:12:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 -- 172.21.15.45:0/2954168010 wait complete. 2023-07-09T02:12:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.000+0000 7f37226d8640 1 Processor -- start 2023-07-09T02:12:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 -- start start 2023-07-09T02:12:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f371c0cd120 0x7f371c15d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d2620 0x7f371c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c15c060 0x7f371c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0ccd10 con 0x7f371c0cd120 2023-07-09T02:12:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c15f3e0 con 0x7f371c0d2620 2023-07-09T02:12:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c15dde0 con 0x7f371c15c060 2023-07-09T02:12:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f371c0cd120 0x7f371c15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f371c0cd120 0x7f371c15d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52852/0 (socket says 172.21.15.45:52852) 2023-07-09T02:12:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 -- 172.21.15.45:0/172580747 learned_addr learned my addr 172.21.15.45:0/172580747 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371b7fe640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d2620 0x7f371c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f3720c75640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c15c060 0x7f371c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 -- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c15c060 msgr2=0x7f371c15eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c15c060 0x7f371c15eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 -- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d2620 msgr2=0x7f371c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d2620 0x7f371c0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 -- 172.21.15.45:0/172580747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009a70 con 0x7f371c0cd120 2023-07-09T02:12:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f371bfff640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f371c0cd120 0x7f371c15d750 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f370c00e870 tx=0x7f370c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f3718ff9640 1 -- 172.21.15.45:0/172580747 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c009510 con 0x7f371c0cd120 2023-07-09T02:12:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f3718ff9640 1 -- 172.21.15.45:0/172580747 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c00eec0 con 0x7f371c0cd120 2023-07-09T02:12:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c0b59f0 con 0x7f371c0cd120 2023-07-09T02:12:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f3718ff9640 1 -- 172.21.15.45:0/172580747 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c00cb40 con 0x7f371c0cd120 2023-07-09T02:12:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c15e3c0 con 0x7f371c0cd120 2023-07-09T02:12:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.004+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c04d7d0 con 0x7f371c0cd120 2023-07-09T02:12:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.008+0000 7f3718ff9640 1 -- 172.21.15.45:0/172580747 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f370c00cca0 con 0x7f371c0cd120 2023-07-09T02:12:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.008+0000 7f3718ff9640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3708066280 0x7f3708068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.008+0000 7f3718ff9640 1 -- 172.21.15.45:0/172580747 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f370c083da0 con 0x7f371c0cd120 2023-07-09T02:12:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.008+0000 7f371b7fe640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3708066280 0x7f3708068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.008+0000 7f371b7fe640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3708066280 0x7f3708068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f371c1478d0 tx=0x7f3710007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.012+0000 7f3718ff9640 1 -- 172.21.15.45:0/172580747 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f370c0512c0 con 0x7f371c0cd120 2023-07-09T02:12:30.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f371c06baa0 con 0x7f371c0cd120 2023-07-09T02:12:30.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f3718ff9640 1 -- 172.21.15.45:0/172580747 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f370c0170a0 con 0x7f371c0cd120 2023-07-09T02:12:30.170 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:12:30.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3708066280 msgr2=0x7f3708068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3708066280 0x7f3708068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f371c1478d0 tx=0x7f3710007d60 comp rx=0 tx=0).stop 2023-07-09T02:12:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f371c0cd120 msgr2=0x7f371c15d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f371c0cd120 0x7f371c15d750 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f370c00e870 tx=0x7f370c00ec70 comp rx=0 tx=0).stop 2023-07-09T02:12:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 shutdown_connections 2023-07-09T02:12:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3708066280 0x7f3708068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c15c060 0x7f371c15eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d2620 0x7f371c0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 --2- 172.21.15.45:0/172580747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f371c0cd120 0x7f371c15d750 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 >> 172.21.15.45:0/172580747 conn(0x7f371c0698e0 msgr2=0x7f371c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:30.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 shutdown_connections 2023-07-09T02:12:30.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.168+0000 7f37226d8640 1 -- 172.21.15.45:0/172580747 wait complete. 2023-07-09T02:12:30.190 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:12:30.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.332+0000 7fc66ce19640 1 Processor -- start 2023-07-09T02:12:30.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.332+0000 7fc66ce19640 1 -- start start 2023-07-09T02:12:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc66ce19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc66ce19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6680cd120 0x7fc6680cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc66ce19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc668160a50 con 0x7fc66815c060 2023-07-09T02:12:30.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc66ce19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66815c430 con 0x7fc6680cd120 2023-07-09T02:12:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc66ce19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815fb60 con 0x7fc6680d2620 2023-07-09T02:12:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc666d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6680cd120 0x7fc6680cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc66659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc66815c060 0x7fc6680d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59558/0 (socket says 172.21.15.45:59558) 2023-07-09T02:12:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc666d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6680cd120 0x7fc6680cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52860/0 (socket says 172.21.15.45:52860) 2023-07-09T02:12:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc66659c640 1 -- 172.21.15.45:0/2505329427 learned_addr learned my addr 172.21.15.45:0/2505329427 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:30.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc665d9b640 1 --2- 172.21.15.45:0/2505329427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc666d9d640 1 -- 172.21.15.45:0/2505329427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 msgr2=0x7fc6680b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:30.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc666d9d640 1 --2- 172.21.15.45:0/2505329427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc666d9d640 1 -- 172.21.15.45:0/2505329427 >> v1:172.21.15.45:6789/0 conn(0x7fc66815c060 legacy=0x7fc6680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc666d9d640 1 -- 172.21.15.45:0/2505329427 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66815fe40 con 0x7fc6680cd120 2023-07-09T02:12:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.336+0000 7fc665d9b640 1 --2- 172.21.15.45:0/2505329427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc666d9d640 1 --2- 172.21.15.45:0/2505329427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680cd120 0x7fc6680cee30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc66001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d446c5dd95d547 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66559a640 1 -- 172.21.15.45:0/2505329427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600a59e0 con 0x7fc6680cd120 2023-07-09T02:12:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66559a640 1 -- 172.21.15.45:0/2505329427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6600a5b40 con 0x7fc6680cd120 2023-07-09T02:12:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66559a640 1 -- 172.21.15.45:0/2505329427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600ad440 con 0x7fc6680cd120 2023-07-09T02:12:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 -- 172.21.15.45:0/2505329427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680cd120 msgr2=0x7fc6680cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 --2- 172.21.15.45:0/2505329427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680cd120 0x7fc6680cee30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc66001c920 comp rx=0 tx=0).stop 2023-07-09T02:12:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 -- 172.21.15.45:0/2505329427 shutdown_connections 2023-07-09T02:12:30.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 --2- 172.21.15.45:0/2505329427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680cd120 0x7fc6680cee30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 --2- 172.21.15.45:0/2505329427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 -- 172.21.15.45:0/2505329427 >> 172.21.15.45:0/2505329427 conn(0x7fc6680698e0 msgr2=0x7fc668069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 -- 172.21.15.45:0/2505329427 shutdown_connections 2023-07-09T02:12:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 -- 172.21.15.45:0/2505329427 wait complete. 2023-07-09T02:12:30.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.340+0000 7fc66ce19640 1 Processor -- start 2023-07-09T02:12:30.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 -- start start 2023-07-09T02:12:30.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680cd120 0x7fc668153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66815c060 0x7fc6681567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668154000 con 0x7fc66815c060 2023-07-09T02:12:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b30b0 con 0x7fc6680cd120 2023-07-09T02:12:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b2680 con 0x7fc6680d2620 2023-07-09T02:12:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66815c060 0x7fc6681567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66815c060 0x7fc6681567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52866/0 (socket says 172.21.15.45:52866) 2023-07-09T02:12:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 -- 172.21.15.45:0/3907428195 learned_addr learned my addr 172.21.15.45:0/3907428195 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66659c640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680cd120 0x7fc668153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc665d9b640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 -- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 msgr2=0x7fc6680b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 -- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680cd120 msgr2=0x7fc668153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680cd120 0x7fc668153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 -- 172.21.15.45:0/3907428195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009a70 con 0x7fc66815c060 2023-07-09T02:12:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc666d9d640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66815c060 0x7fc6681567e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc6600196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc656ffd640 1 -- 172.21.15.45:0/3907428195 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600ade40 con 0x7fc66815c060 2023-07-09T02:12:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc656ffd640 1 -- 172.21.15.45:0/3907428195 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc660009450 con 0x7fc66815c060 2023-07-09T02:12:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc656ffd640 1 -- 172.21.15.45:0/3907428195 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600b9690 con 0x7fc66815c060 2023-07-09T02:12:30.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6680b59f0 con 0x7fc66815c060 2023-07-09T02:12:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66815ef60 con 0x7fc66815c060 2023-07-09T02:12:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.344+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66804d7d0 con 0x7fc66815c060 2023-07-09T02:12:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.348+0000 7fc656ffd640 1 -- 172.21.15.45:0/3907428195 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6600b97f0 con 0x7fc66815c060 2023-07-09T02:12:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.348+0000 7fc656ffd640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.348+0000 7fc656ffd640 1 -- 172.21.15.45:0/3907428195 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc66011f4c0 con 0x7fc66815c060 2023-07-09T02:12:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.348+0000 7fc66659c640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.348+0000 7fc66659c640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc658005890 tx=0x7fc658009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.352+0000 7fc656ffd640 1 -- 172.21.15.45:0/3907428195 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6600ec9e0 con 0x7fc66815c060 2023-07-09T02:12:30.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.504+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6680b31f0 con 0x7fc66815c060 2023-07-09T02:12:30.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.504+0000 7fc656ffd640 1 -- 172.21.15.45:0/3907428195 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6600f0000 con 0x7fc66815c060 2023-07-09T02:12:30.508 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:12:30.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 msgr2=0x7fc648068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc658005890 tx=0x7fc658009040 comp rx=0 tx=0).stop 2023-07-09T02:12:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66815c060 msgr2=0x7fc6681567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66815c060 0x7fc6681567e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc6600196c0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 shutdown_connections 2023-07-09T02:12:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66815c060 0x7fc6681567e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680d2620 0x7fc6680b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 --2- 172.21.15.45:0/3907428195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680cd120 0x7fc668153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 >> 172.21.15.45:0/3907428195 conn(0x7fc6680698e0 msgr2=0x7fc66815b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 shutdown_connections 2023-07-09T02:12:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.508+0000 7fc66ce19640 1 -- 172.21.15.45:0/3907428195 wait complete. 2023-07-09T02:12:30.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:12:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.672+0000 7f0c428de640 1 Processor -- start 2023-07-09T02:12:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.672+0000 7f0c428de640 1 -- start start 2023-07-09T02:12:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c428de640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c069f80 0x7f0c3c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c428de640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0c3c0d2400 0x7f0c3c0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c428de640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c0ceff0 con 0x7f0c3c0b1bc0 2023-07-09T02:12:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c428de640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c0cea70 con 0x7f0c3c0d2400 2023-07-09T02:12:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c428de640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0b1f90 con 0x7f0c3c069f80 2023-07-09T02:12:30.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c418dc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c3c0b1bc0 0x7f0c3c069870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59568/0 (socket says 172.21.15.45:59568) 2023-07-09T02:12:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c418dc640 1 -- 172.21.15.45:0/2038292618 learned_addr learned my addr 172.21.15.45:0/2038292618 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c420dd640 1 --2- 172.21.15.45:0/2038292618 >> v2:172.21.15.155:3300/0 conn(0x7f0c3c0d2400 0x7f0c3c0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c410db640 1 --2- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c069f80 0x7f0c3c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c408da640 1 -- 172.21.15.45:0/2038292618 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234762568 0 0) 0x7f0c3c0ceff0 con 0x7f0c3c0b1bc0 2023-07-09T02:12:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c408da640 1 -- 172.21.15.45:0/2038292618 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c28003530 con 0x7f0c3c0b1bc0 2023-07-09T02:12:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c420dd640 1 -- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c069f80 msgr2=0x7f0c3c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:30.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c420dd640 1 --2- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c069f80 0x7f0c3c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c420dd640 1 -- 172.21.15.45:0/2038292618 >> v1:172.21.15.45:6789/0 conn(0x7f0c3c0b1bc0 legacy=0x7f0c3c069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c420dd640 1 -- 172.21.15.45:0/2038292618 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0d1500 con 0x7f0c3c0d2400 2023-07-09T02:12:30.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.676+0000 7f0c410db640 1 --2- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c069f80 0x7f0c3c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:30.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c420dd640 1 --2- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c0b5de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009d90 tx=0x7f0c3401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21e87614419f03dc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c408da640 1 -- 172.21.15.45:0/2038292618 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340a59e0 con 0x7f0c3c0d2400 2023-07-09T02:12:30.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c408da640 1 -- 172.21.15.45:0/2038292618 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340a5b40 con 0x7f0c3c0d2400 2023-07-09T02:12:30.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c408da640 1 -- 172.21.15.45:0/2038292618 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340ad440 con 0x7f0c3c0d2400 2023-07-09T02:12:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 -- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c0d2400 msgr2=0x7f0c3c0b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 --2- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c0b5de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009d90 tx=0x7f0c3401c920 comp rx=0 tx=0).stop 2023-07-09T02:12:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 -- 172.21.15.45:0/2038292618 shutdown_connections 2023-07-09T02:12:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 --2- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c069f80 0x7f0c3c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 --2- 172.21.15.45:0/2038292618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c0b5de0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 -- 172.21.15.45:0/2038292618 >> 172.21.15.45:0/2038292618 conn(0x7f0c3c0d35b0 msgr2=0x7f0c3c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 -- 172.21.15.45:0/2038292618 shutdown_connections 2023-07-09T02:12:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 -- 172.21.15.45:0/2038292618 wait complete. 2023-07-09T02:12:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 Processor -- start 2023-07-09T02:12:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.680+0000 7f0c428de640 1 -- start start 2023-07-09T02:12:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c069f80 0x7f0c3c0c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c0b1bc0 0x7f0c3c159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ca000 con 0x7f0c3c0d2400 2023-07-09T02:12:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ca2e0 con 0x7f0c3c069f80 2023-07-09T02:12:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ca5c0 con 0x7f0c3c0b1bc0 2023-07-09T02:12:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52868/0 (socket says 172.21.15.45:52868) 2023-07-09T02:12:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 -- 172.21.15.45:0/85876246 learned_addr learned my addr 172.21.15.45:0/85876246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c418dc640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c069f80 0x7f0c3c0c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c410db640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c0b1bc0 0x7f0c3c159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 -- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c0b1bc0 msgr2=0x7f0c3c159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c0b1bc0 0x7f0c3c159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 -- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c069f80 msgr2=0x7f0c3c0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c069f80 0x7f0c3c0c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 -- 172.21.15.45:0/85876246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c009420 con 0x7f0c3c0d2400 2023-07-09T02:12:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c410db640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c0b1bc0 0x7f0c3c159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c418dc640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c069f80 0x7f0c3c0c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c420dd640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c158fb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0c340b0040 tx=0x7f0c340196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c327fc640 1 -- 172.21.15.45:0/85876246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340adce0 con 0x7f0c3c0d2400 2023-07-09T02:12:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c327fc640 1 -- 172.21.15.45:0/85876246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340ade40 con 0x7f0c3c0d2400 2023-07-09T02:12:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c327fc640 1 -- 172.21.15.45:0/85876246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340b9690 con 0x7f0c3c0d2400 2023-07-09T02:12:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c34009a70 con 0x7f0c3c0d2400 2023-07-09T02:12:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c153b90 con 0x7f0c3c0d2400 2023-07-09T02:12:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c153d80 con 0x7f0c3c0d2400 2023-07-09T02:12:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.684+0000 7f0c327fc640 1 -- 172.21.15.45:0/85876246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c340b97f0 con 0x7f0c3c0d2400 2023-07-09T02:12:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.688+0000 7f0c327fc640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c20066280 0x7f0c20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.688+0000 7f0c327fc640 1 -- 172.21.15.45:0/85876246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c3411f530 con 0x7f0c3c0d2400 2023-07-09T02:12:30.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.688+0000 7f0c418dc640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c20066280 0x7f0c20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:30.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.688+0000 7f0c418dc640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c20066280 0x7f0c20068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c380011f0 tx=0x7f0c38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:30.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.692+0000 7f0c327fc640 1 -- 172.21.15.45:0/85876246 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c340ecad0 con 0x7f0c3c0d2400 2023-07-09T02:12:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.844+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c3c04e020 con 0x7f0c3c0d2400 2023-07-09T02:12:30.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.844+0000 7f0c327fc640 1 -- 172.21.15.45:0/85876246 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c34009450 con 0x7f0c3c0d2400 2023-07-09T02:12:30.849 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:12:30.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c20066280 msgr2=0x7f0c20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c20066280 0x7f0c20068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c380011f0 tx=0x7f0c38009040 comp rx=0 tx=0).stop 2023-07-09T02:12:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c3c0d2400 msgr2=0x7f0c3c158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c158fb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0c340b0040 tx=0x7f0c340196c0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 shutdown_connections 2023-07-09T02:12:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c3c0d2400 0x7f0c3c158fb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c20066280 0x7f0c20068730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c3c0b1bc0 0x7f0c3c159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 --2- 172.21.15.45:0/85876246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c3c069f80 0x7f0c3c0c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 >> 172.21.15.45:0/85876246 conn(0x7f0c3c0d35b0 msgr2=0x7f0c3c0b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 shutdown_connections 2023-07-09T02:12:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:30.848+0000 7f0c428de640 1 -- 172.21.15.45:0/85876246 wait complete. 2023-07-09T02:12:30.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:12:31.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2647619640 1 Processor -- start 2023-07-09T02:12:31.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2647619640 1 -- start start 2023-07-09T02:12:31.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2647619640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26400c8dc0 0x7f26400cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2647619640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264006ef30 con 0x7f26400cde40 2023-07-09T02:12:31.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2647619640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264006b210 con 0x7f26401604a0 2023-07-09T02:12:31.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2647619640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264006be90 con 0x7f26400c8dc0 2023-07-09T02:12:31.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2644bb4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26400c8dc0 0x7f26400cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2645bb6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f26400cde40 0x7f26400caaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59584/0 (socket says 172.21.15.45:59584) 2023-07-09T02:12:31.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2645bb6640 1 -- 172.21.15.45:0/3856587507 learned_addr learned my addr 172.21.15.45:0/3856587507 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:31.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2644bb4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26400c8dc0 0x7f26400cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52884/0 (socket says 172.21.15.45:52884) 2023-07-09T02:12:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2644bb4640 1 -- 172.21.15.45:0/3856587507 >> v1:172.21.15.155:6789/0 conn(0x7f26401604a0 legacy=0x7f2640164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2644bb4640 1 -- 172.21.15.45:0/3856587507 >> v1:172.21.15.45:6789/0 conn(0x7f26400cde40 legacy=0x7f26400caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.012+0000 7f2644bb4640 1 -- 172.21.15.45:0/3856587507 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264006b4f0 con 0x7f26400c8dc0 2023-07-09T02:12:31.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2644bb4640 1 --2- 172.21.15.45:0/3856587507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400c8dc0 0x7f26400cd900 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f26300097c0 tx=0x7f263001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd24464f3c79d0af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2637fff640 1 -- 172.21.15.45:0/3856587507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26300ab600 con 0x7f26400c8dc0 2023-07-09T02:12:31.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2637fff640 1 -- 172.21.15.45:0/3856587507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26300a7050 con 0x7f26400c8dc0 2023-07-09T02:12:31.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2637fff640 1 -- 172.21.15.45:0/3856587507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26300ab980 con 0x7f26400c8dc0 2023-07-09T02:12:31.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2647619640 1 -- 172.21.15.45:0/3856587507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400c8dc0 msgr2=0x7f26400cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2647619640 1 --2- 172.21.15.45:0/3856587507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400c8dc0 0x7f26400cd900 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f26300097c0 tx=0x7f263001c310 comp rx=0 tx=0).stop 2023-07-09T02:12:31.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2647619640 1 -- 172.21.15.45:0/3856587507 shutdown_connections 2023-07-09T02:12:31.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2647619640 1 --2- 172.21.15.45:0/3856587507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400c8dc0 0x7f26400cd900 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2647619640 1 -- 172.21.15.45:0/3856587507 >> 172.21.15.45:0/3856587507 conn(0x7f26400694b0 msgr2=0x7f26400698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:31.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2647619640 1 -- 172.21.15.45:0/3856587507 shutdown_connections 2023-07-09T02:12:31.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.016+0000 7f2647619640 1 -- 172.21.15.45:0/3856587507 wait complete. 2023-07-09T02:12:31.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 Processor -- start 2023-07-09T02:12:31.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 -- start start 2023-07-09T02:12:31.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26400c8dc0 0x7f264015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400cde40 0x7f264015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26401604a0 0x7f26400cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400b40c0 con 0x7f26400cde40 2023-07-09T02:12:31.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400b4640 con 0x7f26400c8dc0 2023-07-09T02:12:31.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26400b4360 con 0x7f26401604a0 2023-07-09T02:12:31.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400cde40 0x7f264015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400cde40 0x7f264015aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52894/0 (socket says 172.21.15.45:52894) 2023-07-09T02:12:31.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 -- 172.21.15.45:0/3721183502 learned_addr learned my addr 172.21.15.45:0/3721183502 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:31.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2645bb6640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26401604a0 0x7f26400cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f26453b5640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26400c8dc0 0x7f264015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 -- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26401604a0 msgr2=0x7f26400cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26401604a0 0x7f26400cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 -- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26400c8dc0 msgr2=0x7f264015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26400c8dc0 0x7f264015f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 -- 172.21.15.45:0/3721183502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630009420 con 0x7f26400cde40 2023-07-09T02:12:31.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2645bb6640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26401604a0 0x7f26400cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:31.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2644bb4640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400cde40 0x7f264015aa00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f26300ae040 tx=0x7f26300190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2635ffb640 1 -- 172.21.15.45:0/3721183502 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26300aa8b0 con 0x7f26400cde40 2023-07-09T02:12:31.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2635ffb640 1 -- 172.21.15.45:0/3721183502 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26300aaa10 con 0x7f26400cde40 2023-07-09T02:12:31.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2635ffb640 1 -- 172.21.15.45:0/3721183502 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26300aadc0 con 0x7f26400cde40 2023-07-09T02:12:31.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26400b1700 con 0x7f26400cde40 2023-07-09T02:12:31.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264015ba50 con 0x7f26400cde40 2023-07-09T02:12:31.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.020+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264004d7d0 con 0x7f26400cde40 2023-07-09T02:12:31.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.024+0000 7f2635ffb640 1 -- 172.21.15.45:0/3721183502 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26300b2040 con 0x7f26400cde40 2023-07-09T02:12:31.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.024+0000 7f2635ffb640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2624066280 0x7f2624068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.024+0000 7f2635ffb640 1 -- 172.21.15.45:0/3721183502 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f263011e2f0 con 0x7f26400cde40 2023-07-09T02:12:31.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.024+0000 7f26453b5640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2624066280 0x7f2624068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.024+0000 7f26453b5640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2624066280 0x7f2624068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f263c000f70 tx=0x7f263c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.028+0000 7f2635ffb640 1 -- 172.21.15.45:0/3721183502 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26300eb760 con 0x7f26400cde40 2023-07-09T02:12:31.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.192+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f264006c740 con 0x7f26400cde40 2023-07-09T02:12:31.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.192+0000 7f2635ffb640 1 -- 172.21.15.45:0/3721183502 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f26300b0080 con 0x7f26400cde40 2023-07-09T02:12:31.195 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:12:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2624066280 msgr2=0x7f2624068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2624066280 0x7f2624068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f263c000f70 tx=0x7f263c009040 comp rx=0 tx=0).stop 2023-07-09T02:12:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400cde40 msgr2=0x7f264015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400cde40 0x7f264015aa00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f26300ae040 tx=0x7f26300190b0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 shutdown_connections 2023-07-09T02:12:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2624066280 0x7f2624068730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26401604a0 0x7f26400cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26400cde40 0x7f264015aa00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 --2- 172.21.15.45:0/3721183502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26400c8dc0 0x7f264015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 >> 172.21.15.45:0/3721183502 conn(0x7f26400694b0 msgr2=0x7f264006f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 shutdown_connections 2023-07-09T02:12:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.196+0000 7f2647619640 1 -- 172.21.15.45:0/3721183502 wait complete. 2023-07-09T02:12:31.216 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:12:31.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:31.217 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:31.288 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:12:31.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:31.289 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:12:31.300 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:31.301 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:31.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:12:31.311 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:12:31.311 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:31.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:12:31.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.496+0000 7f681b056640 1 Processor -- start 2023-07-09T02:12:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.496+0000 7f681b056640 1 -- start start 2023-07-09T02:12:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f681b056640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f681415c060 0x7f68140b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f681b056640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68140d2620 0x7f68140cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f681b056640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6814160a50 con 0x7f68140cd120 2023-07-09T02:12:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f681b056640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681415c430 con 0x7f68140d2620 2023-07-09T02:12:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f681b056640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681415fb60 con 0x7f681415c060 2023-07-09T02:12:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f68195f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68140d2620 0x7f68140cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f68195f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68140d2620 0x7f68140cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52910/0 (socket says 172.21.15.45:52910) 2023-07-09T02:12:31.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f68195f3640 1 -- 172.21.15.45:0/228973015 learned_addr learned my addr 172.21.15.45:0/228973015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f6813fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f68140cd120 0x7f68140d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59590/0 (socket says 172.21.15.45:59590) 2023-07-09T02:12:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f6818df2640 1 --2- 172.21.15.45:0/228973015 >> v2:172.21.15.155:3300/0 conn(0x7f681415c060 0x7f68140b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f68195f3640 1 -- 172.21.15.45:0/228973015 >> v2:172.21.15.155:3300/0 conn(0x7f681415c060 msgr2=0x7f68140b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f68195f3640 1 --2- 172.21.15.45:0/228973015 >> v2:172.21.15.155:3300/0 conn(0x7f681415c060 0x7f68140b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f68195f3640 1 -- 172.21.15.45:0/228973015 >> v1:172.21.15.45:6789/0 conn(0x7f68140cd120 legacy=0x7f68140d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.500+0000 7f68195f3640 1 -- 172.21.15.45:0/228973015 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681415fe40 con 0x7f68140d2620 2023-07-09T02:12:31.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f68195f3640 1 --2- 172.21.15.45:0/228973015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140d2620 0x7f68140cee30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f68140d3ad0 tx=0x7f680c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97e09bf9d6edcf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f68137fe640 1 -- 172.21.15.45:0/228973015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0a5860 con 0x7f68140d2620 2023-07-09T02:12:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f68137fe640 1 -- 172.21.15.45:0/228973015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c0a59c0 con 0x7f68140d2620 2023-07-09T02:12:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f68137fe640 1 -- 172.21.15.45:0/228973015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0a5d50 con 0x7f68140d2620 2023-07-09T02:12:31.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- 172.21.15.45:0/228973015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140d2620 msgr2=0x7f68140cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 --2- 172.21.15.45:0/228973015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140d2620 0x7f68140cee30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f68140d3ad0 tx=0x7f680c01c9a0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- 172.21.15.45:0/228973015 shutdown_connections 2023-07-09T02:12:31.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 --2- 172.21.15.45:0/228973015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140d2620 0x7f68140cee30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 --2- 172.21.15.45:0/228973015 >> v2:172.21.15.155:3300/0 conn(0x7f681415c060 0x7f68140b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- 172.21.15.45:0/228973015 >> 172.21.15.45:0/228973015 conn(0x7f68140698e0 msgr2=0x7f6814069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:31.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- 172.21.15.45:0/228973015 shutdown_connections 2023-07-09T02:12:31.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- 172.21.15.45:0/228973015 wait complete. 2023-07-09T02:12:31.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 Processor -- start 2023-07-09T02:12:31.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- start start 2023-07-09T02:12:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140cd120 0x7f68140cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68140d2620 0x7f681415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681415c060 0x7f68140cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68140c9b10 con 0x7f68140cd120 2023-07-09T02:12:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68140c9df0 con 0x7f68140d2620 2023-07-09T02:12:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.504+0000 7f681b056640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68140ca0d0 con 0x7f681415c060 2023-07-09T02:12:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140cd120 0x7f68140cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140cd120 0x7f68140cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52926/0 (socket says 172.21.15.45:52926) 2023-07-09T02:12:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 -- 172.21.15.45:0/2088632462 learned_addr learned my addr 172.21.15.45:0/2088632462 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6813fff640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68140d2620 0x7f681415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 -- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681415c060 msgr2=0x7f68140cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681415c060 0x7f68140cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 -- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68140d2620 msgr2=0x7f681415e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68140d2620 0x7f681415e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 -- 172.21.15.45:0/2088632462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c009b30 con 0x7f68140cd120 2023-07-09T02:12:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6813fff640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68140d2620 0x7f681415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f6818df2640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140cd120 0x7f68140cc2c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f680800d5f0 tx=0x7f680800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f68117fa640 1 -- 172.21.15.45:0/2088632462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080125f0 con 0x7f68140cd120 2023-07-09T02:12:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f68117fa640 1 -- 172.21.15.45:0/2088632462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808012750 con 0x7f68140cd120 2023-07-09T02:12:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68140b59f0 con 0x7f68140cd120 2023-07-09T02:12:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f68117fa640 1 -- 172.21.15.45:0/2088632462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808012ae0 con 0x7f68140cd120 2023-07-09T02:12:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68140ca970 con 0x7f68140cd120 2023-07-09T02:12:31.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681404d7d0 con 0x7f68140cd120 2023-07-09T02:12:31.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f68117fa640 1 -- 172.21.15.45:0/2088632462 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6808012c40 con 0x7f68140cd120 2023-07-09T02:12:31.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f68117fa640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f67f8066280 0x7f67f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.508+0000 7f68117fa640 1 -- 172.21.15.45:0/2088632462 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68080842d0 con 0x7f68140cd120 2023-07-09T02:12:31.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.512+0000 7f6813fff640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f67f8066280 0x7f67f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.512+0000 7f6813fff640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f67f8066280 0x7f67f8068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6814166e50 tx=0x7f6800009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.512+0000 7f68117fa640 1 -- 172.21.15.45:0/2088632462 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68080516b0 con 0x7f68140cd120 2023-07-09T02:12:31.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f681406baa0 con 0x7f68140cd120 2023-07-09T02:12:31.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f68117fa640 1 -- 172.21.15.45:0/2088632462 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f6808054cd0 con 0x7f68140cd120 2023-07-09T02:12:31.703 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:31.703 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:13.135771+0000","modified":"2023-07-09T02:12:16.783642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3290020828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3290020828},{"type":"v1","addr":"172.21.15.45:6835","nonce":3290020828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T02:12:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-07-09T02:12:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f67f8066280 msgr2=0x7f67f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f67f8066280 0x7f67f8068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6814166e50 tx=0x7f6800009040 comp rx=0 tx=0).stop 2023-07-09T02:12:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140cd120 msgr2=0x7f68140cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140cd120 0x7f68140cc2c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f680800d5f0 tx=0x7f680800dab0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 shutdown_connections 2023-07-09T02:12:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f67f8066280 0x7f67f8068730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f681415c060 0x7f68140cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68140d2620 0x7f681415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 --2- 172.21.15.45:0/2088632462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68140cd120 0x7f68140cc2c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 >> 172.21.15.45:0/2088632462 conn(0x7f68140698e0 msgr2=0x7f6814158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 shutdown_connections 2023-07-09T02:12:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.700+0000 7f681b056640 1 -- 172.21.15.45:0/2088632462 wait complete. 2023-07-09T02:12:31.730 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.872+0000 7f576aeec640 1 Processor -- start 2023-07-09T02:12:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.872+0000 7f576aeec640 1 -- start start 2023-07-09T02:12:31.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f576aeec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f576aeec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f57640cd120 0x7f57640d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f576aeec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5764160a50 con 0x7f57640d2450 2023-07-09T02:12:31.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f576aeec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640d28d0 con 0x7f576415c060 2023-07-09T02:12:31.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f576aeec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640cfe40 con 0x7f57640cd120 2023-07-09T02:12:31.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5768c88640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5768c88640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59044/0 (socket says 172.21.15.45:59044) 2023-07-09T02:12:31.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5768c88640 1 -- 172.21.15.45:0/774910246 learned_addr learned my addr 172.21.15.45:0/774910246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:31.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5763fff640 1 --2- 172.21.15.45:0/774910246 >> v2:172.21.15.155:3300/0 conn(0x7f57640cd120 0x7f57640d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5768c88640 1 -- 172.21.15.45:0/774910246 >> v2:172.21.15.155:3300/0 conn(0x7f57640cd120 msgr2=0x7f57640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5768c88640 1 --2- 172.21.15.45:0/774910246 >> v2:172.21.15.155:3300/0 conn(0x7f57640cd120 0x7f57640d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5768c88640 1 -- 172.21.15.45:0/774910246 >> v1:172.21.15.155:6789/0 conn(0x7f57640d2450 legacy=0x7f57640d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5768c88640 1 -- 172.21.15.45:0/774910246 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576415c430 con 0x7f576415c060 2023-07-09T02:12:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.876+0000 7f5768c88640 1 --2- 172.21.15.45:0/774910246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f576415c060 0x7f57640b4ed0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f576415fac0 tx=0x7f575801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9f7306d3f6a2ab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f57637fe640 1 -- 172.21.15.45:0/774910246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580ab5f0 con 0x7f576415c060 2023-07-09T02:12:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f57637fe640 1 -- 172.21.15.45:0/774910246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57580ab750 con 0x7f576415c060 2023-07-09T02:12:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f57637fe640 1 -- 172.21.15.45:0/774910246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580abae0 con 0x7f576415c060 2023-07-09T02:12:31.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- 172.21.15.45:0/774910246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f576415c060 msgr2=0x7f57640b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 --2- 172.21.15.45:0/774910246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f576415c060 0x7f57640b4ed0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f576415fac0 tx=0x7f575801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- 172.21.15.45:0/774910246 shutdown_connections 2023-07-09T02:12:31.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 --2- 172.21.15.45:0/774910246 >> v2:172.21.15.155:3300/0 conn(0x7f57640cd120 0x7f57640d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 --2- 172.21.15.45:0/774910246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- 172.21.15.45:0/774910246 >> 172.21.15.45:0/774910246 conn(0x7f57640698e0 msgr2=0x7f5764069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- 172.21.15.45:0/774910246 shutdown_connections 2023-07-09T02:12:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- 172.21.15.45:0/774910246 wait complete. 2023-07-09T02:12:31.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 Processor -- start 2023-07-09T02:12:31.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- start start 2023-07-09T02:12:31.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f5764153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640d2450 0x7f57640c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f576415c060 0x7f57640b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640ca440 con 0x7f57640cd120 2023-07-09T02:12:31.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640ca720 con 0x7f57640d2450 2023-07-09T02:12:31.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f576aeec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640caa00 con 0x7f576415c060 2023-07-09T02:12:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f5768c88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f5764153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f5768c88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f5764153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59052/0 (socket says 172.21.15.45:59052) 2023-07-09T02:12:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.880+0000 7f5768c88640 1 -- 172.21.15.45:0/3794566296 learned_addr learned my addr 172.21.15.45:0/3794566296 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5763fff640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640d2450 0x7f57640c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5769489640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f576415c060 0x7f57640b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5768c88640 1 -- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f576415c060 msgr2=0x7f57640b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5768c88640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f576415c060 0x7f57640b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5768c88640 1 -- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640d2450 msgr2=0x7f57640c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5768c88640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640d2450 0x7f57640c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5768c88640 1 -- 172.21.15.45:0/3794566296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580094d0 con 0x7f57640cd120 2023-07-09T02:12:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5768c88640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f5764153d20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f57580190e0 tx=0x7f575801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f57617fa640 1 -- 172.21.15.45:0/3794566296 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580be5f0 con 0x7f57640cd120 2023-07-09T02:12:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f57617fa640 1 -- 172.21.15.45:0/3794566296 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57580be770 con 0x7f57640cd120 2023-07-09T02:12:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f57617fa640 1 -- 172.21.15.45:0/3794566296 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580beb20 con 0x7f57640cd120 2023-07-09T02:12:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57640cace0 con 0x7f57640cd120 2023-07-09T02:12:31.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5764154260 con 0x7f57640cd120 2023-07-09T02:12:31.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576404d7d0 con 0x7f57640cd120 2023-07-09T02:12:31.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f57617fa640 1 -- 172.21.15.45:0/3794566296 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57580b43f0 con 0x7f57640cd120 2023-07-09T02:12:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f57617fa640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f57617fa640 1 -- 172.21.15.45:0/3794566296 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57580a8050 con 0x7f57640cd120 2023-07-09T02:12:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.884+0000 7f5763fff640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.888+0000 7f5763fff640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5748066280 0x7f5748068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5764159930 tx=0x7f5750009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:31.888+0000 7f57617fa640 1 -- 172.21.15.45:0/3794566296 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57580ebe10 con 0x7f57640cd120 2023-07-09T02:12:32.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.048+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57640cb190 con 0x7f57640cd120 2023-07-09T02:12:32.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.048+0000 7f57617fa640 1 -- 172.21.15.45:0/3794566296 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f57580ef430 con 0x7f57640cd120 2023-07-09T02:12:32.052 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:32.053 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:24.822024+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:32.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5748066280 msgr2=0x7f5748068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5748066280 0x7f5748068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5764159930 tx=0x7f5750009190 comp rx=0 tx=0).stop 2023-07-09T02:12:32.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 msgr2=0x7f5764153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f5764153d20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f57580190e0 tx=0x7f575801ad10 comp rx=0 tx=0).stop 2023-07-09T02:12:32.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 shutdown_connections 2023-07-09T02:12:32.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f576415c060 0x7f57640b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57640d2450 0x7f57640c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 --2- 172.21.15.45:0/3794566296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f5764153d20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 >> 172.21.15.45:0/3794566296 conn(0x7f57640698e0 msgr2=0x7f57640b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:32.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 shutdown_connections 2023-07-09T02:12:32.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.052+0000 7f576aeec640 1 -- 172.21.15.45:0/3794566296 wait complete. 2023-07-09T02:12:32.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:12:11.263177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:12:12.133396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:12:32.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:12:32.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.216+0000 7f5efa311640 1 Processor -- start 2023-07-09T02:12:32.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.216+0000 7f5efa311640 1 -- start start 2023-07-09T02:12:32.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5efa311640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ef415c060 0x7f5ef40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5efa311640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5ef40d2620 0x7f5ef40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5efa311640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef4160a50 con 0x7f5ef40cd120 2023-07-09T02:12:32.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5efa311640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef415c430 con 0x7f5ef415c060 2023-07-09T02:12:32.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5efa311640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef415fb60 con 0x7f5ef40d2620 2023-07-09T02:12:32.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ef415c060 0x7f5ef40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ef415c060 0x7f5ef40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59062/0 (socket says 172.21.15.45:59062) 2023-07-09T02:12:32.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef3fff640 1 -- 172.21.15.45:0/1805440937 learned_addr learned my addr 172.21.15.45:0/1805440937 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:32.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef3fff640 1 -- 172.21.15.45:0/1805440937 >> v2:172.21.15.155:3300/0 conn(0x7f5ef40d2620 msgr2=0x7f5ef40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:32.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef88ae640 1 --2- 172.21.15.45:0/1805440937 >> v2:172.21.15.155:3300/0 conn(0x7f5ef40d2620 0x7f5ef40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef3fff640 1 --2- 172.21.15.45:0/1805440937 >> v2:172.21.15.155:3300/0 conn(0x7f5ef40d2620 0x7f5ef40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef3fff640 1 -- 172.21.15.45:0/1805440937 >> v1:172.21.15.155:6789/0 conn(0x7f5ef40cd120 legacy=0x7f5ef40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:32.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef3fff640 1 -- 172.21.15.45:0/1805440937 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef415fe40 con 0x7f5ef415c060 2023-07-09T02:12:32.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef88ae640 1 --2- 172.21.15.45:0/1805440937 >> v2:172.21.15.155:3300/0 conn(0x7f5ef40d2620 0x7f5ef40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:32.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.220+0000 7f5ef3fff640 1 --2- 172.21.15.45:0/1805440937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c060 0x7f5ef40b4ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5ef408bca0 tx=0x7f5ee401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb81e5a80c151e45 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5ef2ffd640 1 -- 172.21.15.45:0/1805440937 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40aa430 con 0x7f5ef415c060 2023-07-09T02:12:32.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5ef2ffd640 1 -- 172.21.15.45:0/1805440937 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee40aa590 con 0x7f5ef415c060 2023-07-09T02:12:32.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5ef2ffd640 1 -- 172.21.15.45:0/1805440937 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40aa920 con 0x7f5ef415c060 2023-07-09T02:12:32.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- 172.21.15.45:0/1805440937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c060 msgr2=0x7f5ef40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 --2- 172.21.15.45:0/1805440937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c060 0x7f5ef40b4ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5ef408bca0 tx=0x7f5ee401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- 172.21.15.45:0/1805440937 shutdown_connections 2023-07-09T02:12:32.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 --2- 172.21.15.45:0/1805440937 >> v2:172.21.15.155:3300/0 conn(0x7f5ef40d2620 0x7f5ef40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 --2- 172.21.15.45:0/1805440937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c060 0x7f5ef40b4ed0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- 172.21.15.45:0/1805440937 >> 172.21.15.45:0/1805440937 conn(0x7f5ef40698e0 msgr2=0x7f5ef4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:32.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- 172.21.15.45:0/1805440937 shutdown_connections 2023-07-09T02:12:32.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- 172.21.15.45:0/1805440937 wait complete. 2023-07-09T02:12:32.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 Processor -- start 2023-07-09T02:12:32.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- start start 2023-07-09T02:12:32.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef40cd120 0x7f5ef41f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ef40d2620 0x7f5ef40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ef415c060 0x7f5ef40cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef415d290 con 0x7f5ef40cd120 2023-07-09T02:12:32.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef415c680 con 0x7f5ef415c060 2023-07-09T02:12:32.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5efa311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef415c960 con 0x7f5ef40d2620 2023-07-09T02:12:32.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5ef3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef40cd120 0x7f5ef41f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.224+0000 7f5ef3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef40cd120 0x7f5ef41f9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59064/0 (socket says 172.21.15.45:59064) 2023-07-09T02:12:32.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef37fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ef40d2620 0x7f5ef40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef3fff640 1 -- 172.21.15.45:0/1496408546 learned_addr learned my addr 172.21.15.45:0/1496408546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:32.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef88ae640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ef415c060 0x7f5ef40cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef3fff640 1 -- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ef40d2620 msgr2=0x7f5ef40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef3fff640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ef40d2620 0x7f5ef40cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef3fff640 1 -- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ef415c060 msgr2=0x7f5ef40cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef3fff640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ef415c060 0x7f5ef40cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef3fff640 1 -- 172.21.15.45:0/1496408546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee40094d0 con 0x7f5ef40cd120 2023-07-09T02:12:32.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef3fff640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef40cd120 0x7f5ef41f9c50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40190e0 tx=0x7f5ee401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef0ff9640 1 -- 172.21.15.45:0/1496408546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40b3800 con 0x7f5ef40cd120 2023-07-09T02:12:32.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef0ff9640 1 -- 172.21.15.45:0/1496408546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee40b3960 con 0x7f5ef40cd120 2023-07-09T02:12:32.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef0ff9640 1 -- 172.21.15.45:0/1496408546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40b3d10 con 0x7f5ef40cd120 2023-07-09T02:12:32.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef40b59f0 con 0x7f5ef40cd120 2023-07-09T02:12:32.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef415cf20 con 0x7f5ef40cd120 2023-07-09T02:12:32.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef404d7d0 con 0x7f5ef40cd120 2023-07-09T02:12:32.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef0ff9640 1 -- 172.21.15.45:0/1496408546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ee40b2380 con 0x7f5ef40cd120 2023-07-09T02:12:32.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef0ff9640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ee00662b0 0x7f5ee0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.228+0000 7f5ef0ff9640 1 -- 172.21.15.45:0/1496408546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ee411e320 con 0x7f5ef40cd120 2023-07-09T02:12:32.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.232+0000 7f5ef37fe640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ee00662b0 0x7f5ee0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.232+0000 7f5ef37fe640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ee00662b0 0x7f5ee0068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ef406b460 tx=0x7f5ee8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.232+0000 7f5ef0ff9640 1 -- 172.21.15.45:0/1496408546 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ee40eb840 con 0x7f5ef40cd120 2023-07-09T02:12:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.388+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ef415caa0 con 0x7f5ef40cd120 2023-07-09T02:12:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.388+0000 7f5ef0ff9640 1 -- 172.21.15.45:0/1496408546 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ef415caa0 con 0x7f5ef40cd120 2023-07-09T02:12:32.392 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:12:32.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ee00662b0 msgr2=0x7f5ee0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ee00662b0 0x7f5ee0068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ef406b460 tx=0x7f5ee8009040 comp rx=0 tx=0).stop 2023-07-09T02:12:32.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef40cd120 msgr2=0x7f5ef41f9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef40cd120 0x7f5ef41f9c50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40190e0 tx=0x7f5ee401ad10 comp rx=0 tx=0).stop 2023-07-09T02:12:32.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 shutdown_connections 2023-07-09T02:12:32.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ef415c060 0x7f5ef40cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ee00662b0 0x7f5ee0068760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ef40d2620 0x7f5ef40cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 --2- 172.21.15.45:0/1496408546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef40cd120 0x7f5ef41f9c50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 >> 172.21.15.45:0/1496408546 conn(0x7f5ef40698e0 msgr2=0x7f5ef40b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:32.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 shutdown_connections 2023-07-09T02:12:32.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.392+0000 7f5efa311640 1 -- 172.21.15.45:0/1496408546 wait complete. 2023-07-09T02:12:32.412 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:12:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe97806d640 1 Processor -- start 2023-07-09T02:12:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe97806d640 1 -- start start 2023-07-09T02:12:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe97806d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe97015c060 0x7fe9700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe97806d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9700d2620 0x7fe9700cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe97806d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe970160a50 con 0x7fe9700cd120 2023-07-09T02:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe97806d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97015c430 con 0x7fe9700d2620 2023-07-09T02:12:32.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe97806d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015fb60 con 0x7fe97015c060 2023-07-09T02:12:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe975e09640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe97015c060 0x7fe9700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe975e09640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe97015c060 0x7fe9700b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:45768/0 (socket says 172.21.15.45:45768) 2023-07-09T02:12:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe975e09640 1 -- 172.21.15.45:0/4277140206 learned_addr learned my addr 172.21.15.45:0/4277140206 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe975608640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe9700cd120 0x7fe9700d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:59470/0 (socket says 172.21.15.45:59470) 2023-07-09T02:12:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe97660a640 1 --2- 172.21.15.45:0/4277140206 >> v2:172.21.15.155:3300/0 conn(0x7fe9700d2620 0x7fe9700cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe975e09640 1 -- 172.21.15.45:0/4277140206 >> v2:172.21.15.155:3300/0 conn(0x7fe9700d2620 msgr2=0x7fe9700cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe975e09640 1 --2- 172.21.15.45:0/4277140206 >> v2:172.21.15.155:3300/0 conn(0x7fe9700d2620 0x7fe9700cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe975e09640 1 -- 172.21.15.45:0/4277140206 >> v1:172.21.15.155:6789/0 conn(0x7fe9700cd120 legacy=0x7fe9700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.556+0000 7fe975e09640 1 -- 172.21.15.45:0/4277140206 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97015fe40 con 0x7fe97015c060 2023-07-09T02:12:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe975e09640 1 --2- 172.21.15.45:0/4277140206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe97015c060 0x7fe9700b4ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0098a0 tx=0x7fe96c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=362e75c66fb359c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe974e07640 1 -- 172.21.15.45:0/4277140206 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0aa650 con 0x7fe97015c060 2023-07-09T02:12:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe974e07640 1 -- 172.21.15.45:0/4277140206 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c0aa7b0 con 0x7fe97015c060 2023-07-09T02:12:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe974e07640 1 -- 172.21.15.45:0/4277140206 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0aab40 con 0x7fe97015c060 2023-07-09T02:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe97806d640 1 -- 172.21.15.45:0/4277140206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe97015c060 msgr2=0x7fe9700b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe97806d640 1 --2- 172.21.15.45:0/4277140206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe97015c060 0x7fe9700b4ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0098a0 tx=0x7fe96c01c4f0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe97806d640 1 -- 172.21.15.45:0/4277140206 shutdown_connections 2023-07-09T02:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe97806d640 1 --2- 172.21.15.45:0/4277140206 >> v2:172.21.15.155:3300/0 conn(0x7fe9700d2620 0x7fe9700cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe97806d640 1 --2- 172.21.15.45:0/4277140206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe97015c060 0x7fe9700b4ed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe97806d640 1 -- 172.21.15.45:0/4277140206 >> 172.21.15.45:0/4277140206 conn(0x7fe9700698e0 msgr2=0x7fe970069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.560+0000 7fe97806d640 1 -- 172.21.15.45:0/4277140206 shutdown_connections 2023-07-09T02:12:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 -- 172.21.15.45:0/4277140206 wait complete. 2023-07-09T02:12:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 Processor -- start 2023-07-09T02:12:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 -- start start 2023-07-09T02:12:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9700cd120 0x7fe97015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9700d2620 0x7fe9700ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe97015c060 0x7fe970151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970153250 con 0x7fe97015c060 2023-07-09T02:12:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970152660 con 0x7fe9700cd120 2023-07-09T02:12:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe970152450 con 0x7fe9700d2620 2023-07-09T02:12:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe97015c060 0x7fe970151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe97015c060 0x7fe970151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59072/0 (socket says 172.21.15.45:59072) 2023-07-09T02:12:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 -- 172.21.15.45:0/297906530 learned_addr learned my addr 172.21.15.45:0/297906530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe975e09640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9700cd120 0x7fe97015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe975608640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9700d2620 0x7fe9700ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 -- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9700d2620 msgr2=0x7fe9700ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9700d2620 0x7fe9700ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 -- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9700cd120 msgr2=0x7fe97015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9700cd120 0x7fe97015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 -- 172.21.15.45:0/297906530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0094d0 con 0x7fe97015c060 2023-07-09T02:12:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe975608640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9700d2620 0x7fe9700ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97660a640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe97015c060 0x7fe970151f10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe96800efc0 tx=0x7fe96800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe9667fc640 1 -- 172.21.15.45:0/297906530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968009ca0 con 0x7fe97015c060 2023-07-09T02:12:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe9667fc640 1 -- 172.21.15.45:0/297906530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96800f040 con 0x7fe97015c060 2023-07-09T02:12:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe9667fc640 1 -- 172.21.15.45:0/297906530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9680146c0 con 0x7fe97015c060 2023-07-09T02:12:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.564+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9700b59f0 con 0x7fe97015c060 2023-07-09T02:12:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.568+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe970152b90 con 0x7fe97015c060 2023-07-09T02:12:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.568+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe970153390 con 0x7fe97015c060 2023-07-09T02:12:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.568+0000 7fe9667fc640 1 -- 172.21.15.45:0/297906530 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe968014820 con 0x7fe97015c060 2023-07-09T02:12:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.568+0000 7fe9667fc640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe954066280 0x7fe954068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.568+0000 7fe9667fc640 1 -- 172.21.15.45:0/297906530 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe968084bb0 con 0x7fe97015c060 2023-07-09T02:12:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.568+0000 7fe975e09640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe954066280 0x7fe954068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.572+0000 7fe975e09640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe954066280 0x7fe954068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0ae000 tx=0x7fe96c0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.572+0000 7fe9667fc640 1 -- 172.21.15.45:0/297906530 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe970153390 con 0x7fe97015c060 2023-07-09T02:12:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.728+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe970153390 con 0x7fe97015c060 2023-07-09T02:12:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.728+0000 7fe9667fc640 1 -- 172.21.15.45:0/297906530 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe970153390 con 0x7fe97015c060 2023-07-09T02:12:32.732 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:12:32.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe954066280 msgr2=0x7fe954068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe954066280 0x7fe954068730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0ae000 tx=0x7fe96c0b5040 comp rx=0 tx=0).stop 2023-07-09T02:12:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe97015c060 msgr2=0x7fe970151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe97015c060 0x7fe970151f10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe96800efc0 tx=0x7fe96800c490 comp rx=0 tx=0).stop 2023-07-09T02:12:32.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 shutdown_connections 2023-07-09T02:12:32.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe97015c060 0x7fe970151f10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe954066280 0x7fe954068730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9700d2620 0x7fe9700ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 --2- 172.21.15.45:0/297906530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9700cd120 0x7fe97015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 >> 172.21.15.45:0/297906530 conn(0x7fe9700698e0 msgr2=0x7fe9700b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:32.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 shutdown_connections 2023-07-09T02:12:32.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.732+0000 7fe97806d640 1 -- 172.21.15.45:0/297906530 wait complete. 2023-07-09T02:12:32.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:12:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.896+0000 7fcce9759640 1 Processor -- start 2023-07-09T02:12:32.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.896+0000 7fcce9759640 1 -- start start 2023-07-09T02:12:32.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fcce9759640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce406b120 0x7fcce406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fcce9759640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcce40d2400 0x7fcce40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fcce9759640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce40cd320 con 0x7fcce4069980 2023-07-09T02:12:32.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fcce9759640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce4071850 con 0x7fcce40d2400 2023-07-09T02:12:32.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fcce9759640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce406ba30 con 0x7fcce406b120 2023-07-09T02:12:32.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fccdbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcce40d2400 0x7fcce40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fccdbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcce40d2400 0x7fcce40cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59078/0 (socket says 172.21.15.45:59078) 2023-07-09T02:12:32.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fccdbfff640 1 -- 172.21.15.45:0/1541401512 learned_addr learned my addr 172.21.15.45:0/1541401512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:32.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fcce2ffd640 1 --2- 172.21.15.45:0/1541401512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce406b120 0x7fcce406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fccdbfff640 1 -- 172.21.15.45:0/1541401512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce406b120 msgr2=0x7fcce406b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fccdbfff640 1 --2- 172.21.15.45:0/1541401512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce406b120 0x7fcce406b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fccdbfff640 1 -- 172.21.15.45:0/1541401512 >> v1:172.21.15.155:6789/0 conn(0x7fcce4069980 legacy=0x7fcce4069dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.900+0000 7fccdbfff640 1 -- 172.21.15.45:0/1541401512 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce40d0ea0 con 0x7fcce40d2400 2023-07-09T02:12:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fccdbfff640 1 --2- 172.21.15.45:0/1541401512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce40cea70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009870 tx=0x7fcccc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd538c9f7b1f13ff server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce27fc640 1 -- 172.21.15.45:0/1541401512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0aa670 con 0x7fcce40d2400 2023-07-09T02:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce27fc640 1 -- 172.21.15.45:0/1541401512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc0aa7d0 con 0x7fcce40d2400 2023-07-09T02:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce27fc640 1 -- 172.21.15.45:0/1541401512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0aab60 con 0x7fcce40d2400 2023-07-09T02:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 -- 172.21.15.45:0/1541401512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 msgr2=0x7fcce40cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 --2- 172.21.15.45:0/1541401512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce40cea70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009870 tx=0x7fcccc01c510 comp rx=0 tx=0).stop 2023-07-09T02:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 -- 172.21.15.45:0/1541401512 shutdown_connections 2023-07-09T02:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 --2- 172.21.15.45:0/1541401512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce40cea70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 --2- 172.21.15.45:0/1541401512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce406b120 0x7fcce406b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 -- 172.21.15.45:0/1541401512 >> 172.21.15.45:0/1541401512 conn(0x7fcce40cf3d0 msgr2=0x7fcce40cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 -- 172.21.15.45:0/1541401512 shutdown_connections 2023-07-09T02:12:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 -- 172.21.15.45:0/1541401512 wait complete. 2023-07-09T02:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 Processor -- start 2023-07-09T02:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 -- start start 2023-07-09T02:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce4069980 0x7fcce40cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.904+0000 7fcce9759640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcce406b120 0x7fcce41512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce9759640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce4158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce9759640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4151ef0 con 0x7fcce40d2400 2023-07-09T02:12:32.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce9759640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4152f60 con 0x7fcce406b120 2023-07-09T02:12:32.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce9759640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4153400 con 0x7fcce4069980 2023-07-09T02:12:32.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce4158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce4158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59090/0 (socket says 172.21.15.45:59090) 2023-07-09T02:12:32.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 -- 172.21.15.45:0/3329927135 learned_addr learned my addr 172.21.15.45:0/3329927135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce2ffd640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce4069980 0x7fcce40cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fccdbfff640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcce406b120 0x7fcce41512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 -- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce4069980 msgr2=0x7fcce40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce4069980 0x7fcce40cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 -- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcce406b120 msgr2=0x7fcce41512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcce406b120 0x7fcce41512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 -- 172.21.15.45:0/3329927135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc0094d0 con 0x7fcce40d2400 2023-07-09T02:12:32.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce2ffd640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce4069980 0x7fcce40cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:32.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce37fe640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce4158600 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c770 tx=0x7fccdc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fccdb7fe640 1 -- 172.21.15.45:0/3329927135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc003b80 con 0x7fcce40d2400 2023-07-09T02:12:32.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fccdb7fe640 1 -- 172.21.15.45:0/3329927135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc003ce0 con 0x7fcce40d2400 2023-07-09T02:12:32.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fccdb7fe640 1 -- 172.21.15.45:0/3329927135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00aa90 con 0x7fcce40d2400 2023-07-09T02:12:32.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce41536e0 con 0x7fcce40d2400 2023-07-09T02:12:32.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4153ca0 con 0x7fcce40d2400 2023-07-09T02:12:32.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce4155fd0 con 0x7fcce40d2400 2023-07-09T02:12:32.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fccdb7fe640 1 -- 172.21.15.45:0/3329927135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fccdc00abf0 con 0x7fcce40d2400 2023-07-09T02:12:32.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.908+0000 7fccdb7fe640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fccc4066280 0x7fccc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:32.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.912+0000 7fccdb7fe640 1 -- 172.21.15.45:0/3329927135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fccdc083a50 con 0x7fcce40d2400 2023-07-09T02:12:32.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.912+0000 7fcce2ffd640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fccc4066280 0x7fccc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:32.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.912+0000 7fcce2ffd640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fccc4066280 0x7fccc4068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcce41f85c0 tx=0x7fccd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:32.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:32.912+0000 7fccdb7fe640 1 -- 172.21.15.45:0/3329927135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fccdc050f60 con 0x7fcce40d2400 2023-07-09T02:12:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcce404e020 con 0x7fcce40d2400 2023-07-09T02:12:33.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fccdb7fe640 1 -- 172.21.15.45:0/3329927135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccdc054580 con 0x7fcce40d2400 2023-07-09T02:12:33.070 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:12:33.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fccc4066280 msgr2=0x7fccc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fccc4066280 0x7fccc4068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcce41f85c0 tx=0x7fccd4008040 comp rx=0 tx=0).stop 2023-07-09T02:12:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 msgr2=0x7fcce4158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce4158600 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00c770 tx=0x7fccdc00cc30 comp rx=0 tx=0).stop 2023-07-09T02:12:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 shutdown_connections 2023-07-09T02:12:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcce40d2400 0x7fcce4158600 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcce406b120 0x7fcce41512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fccc4066280 0x7fccc4068730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 --2- 172.21.15.45:0/3329927135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcce4069980 0x7fcce40cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 >> 172.21.15.45:0/3329927135 conn(0x7fcce40cf3d0 msgr2=0x7fcce40b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:33.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 shutdown_connections 2023-07-09T02:12:33.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.068+0000 7fcce9759640 1 -- 172.21.15.45:0/3329927135 wait complete. 2023-07-09T02:12:33.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:12:33.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.232+0000 7fe07507b640 1 Processor -- start 2023-07-09T02:12:33.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.232+0000 7fe07507b640 1 -- start start 2023-07-09T02:12:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe07507b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0700cd290 0x7fe0700cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe07507b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe07006aa10 0x7fe0700b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe07507b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe070071140 con 0x7fe07006a5c0 2023-07-09T02:12:33.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe07507b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07006b010 con 0x7fe07006aa10 2023-07-09T02:12:33.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe07507b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0700cdba0 con 0x7fe0700cd290 2023-07-09T02:12:33.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe07006aa10 0x7fe0700b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe07006aa10 0x7fe0700b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59104/0 (socket says 172.21.15.45:59104) 2023-07-09T02:12:33.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06f59e640 1 -- 172.21.15.45:0/1471651767 learned_addr learned my addr 172.21.15.45:0/1471651767 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:33.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06ed9d640 1 --2- 172.21.15.45:0/1471651767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0700cd290 0x7fe0700cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06f59e640 1 -- 172.21.15.45:0/1471651767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0700cd290 msgr2=0x7fe0700cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:33.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06f59e640 1 --2- 172.21.15.45:0/1471651767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0700cd290 0x7fe0700cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06f59e640 1 -- 172.21.15.45:0/1471651767 >> v1:172.21.15.155:6789/0 conn(0x7fe07006a5c0 legacy=0x7fe0700b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:33.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06f59e640 1 -- 172.21.15.45:0/1471651767 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07015c970 con 0x7fe07006aa10 2023-07-09T02:12:33.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.236+0000 7fe06ed9d640 1 --2- 172.21.15.45:0/1471651767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0700cd290 0x7fe0700cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:33.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe06f59e640 1 --2- 172.21.15.45:0/1471651767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006aa10 0x7fe0700b2a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe068009e50 tx=0x7fe06801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4ce6b09c49b016 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe06e59c640 1 -- 172.21.15.45:0/1471651767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0680a57d0 con 0x7fe07006aa10 2023-07-09T02:12:33.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe06e59c640 1 -- 172.21.15.45:0/1471651767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0680a5930 con 0x7fe07006aa10 2023-07-09T02:12:33.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe06e59c640 1 -- 172.21.15.45:0/1471651767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0680a5cc0 con 0x7fe07006aa10 2023-07-09T02:12:33.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 -- 172.21.15.45:0/1471651767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006aa10 msgr2=0x7fe0700b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 --2- 172.21.15.45:0/1471651767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006aa10 0x7fe0700b2a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe068009e50 tx=0x7fe06801ca10 comp rx=0 tx=0).stop 2023-07-09T02:12:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 -- 172.21.15.45:0/1471651767 shutdown_connections 2023-07-09T02:12:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 --2- 172.21.15.45:0/1471651767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006aa10 0x7fe0700b2a50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 --2- 172.21.15.45:0/1471651767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0700cd290 0x7fe0700cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 -- 172.21.15.45:0/1471651767 >> 172.21.15.45:0/1471651767 conn(0x7fe07006d140 msgr2=0x7fe07006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 -- 172.21.15.45:0/1471651767 shutdown_connections 2023-07-09T02:12:33.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 -- 172.21.15.45:0/1471651767 wait complete. 2023-07-09T02:12:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 Processor -- start 2023-07-09T02:12:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.240+0000 7fe07507b640 1 -- start start 2023-07-09T02:12:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006a5c0 0x7fe070155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe07006aa10 0x7fe07014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0700cd290 0x7fe0700b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe070154a90 con 0x7fe07006a5c0 2023-07-09T02:12:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe070154d30 con 0x7fe0700cd290 2023-07-09T02:12:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe070155010 con 0x7fe07006aa10 2023-07-09T02:12:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006a5c0 0x7fe070155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006a5c0 0x7fe070155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59116/0 (socket says 172.21.15.45:59116) 2023-07-09T02:12:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 -- 172.21.15.45:0/2687074196 learned_addr learned my addr 172.21.15.45:0/2687074196 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06f59e640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0700cd290 0x7fe0700b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe067fff640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe07006aa10 0x7fe07014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 -- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe07006aa10 msgr2=0x7fe07014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe07006aa10 0x7fe07014e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 -- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0700cd290 msgr2=0x7fe0700b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0700cd290 0x7fe0700b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 -- 172.21.15.45:0/2687074196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe068009b30 con 0x7fe07006a5c0 2023-07-09T02:12:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe06ed9d640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006a5c0 0x7fe070155dd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe06000d800 tx=0x7fe06000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe0677fe640 1 -- 172.21.15.45:0/2687074196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600096c0 con 0x7fe07006a5c0 2023-07-09T02:12:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe0677fe640 1 -- 172.21.15.45:0/2687074196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe060009820 con 0x7fe07006a5c0 2023-07-09T02:12:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe0677fe640 1 -- 172.21.15.45:0/2687074196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe060009bd0 con 0x7fe07006a5c0 2023-07-09T02:12:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0701552f0 con 0x7fe07006a5c0 2023-07-09T02:12:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0701558b0 con 0x7fe07006a5c0 2023-07-09T02:12:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe070155a70 con 0x7fe07006a5c0 2023-07-09T02:12:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.244+0000 7fe0677fe640 1 -- 172.21.15.45:0/2687074196 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe060009d30 con 0x7fe07006a5c0 2023-07-09T02:12:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.248+0000 7fe0677fe640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe050066280 0x7fe050068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.248+0000 7fe0677fe640 1 -- 172.21.15.45:0/2687074196 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe060084390 con 0x7fe07006a5c0 2023-07-09T02:12:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.248+0000 7fe067fff640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe050066280 0x7fe050068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.248+0000 7fe067fff640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe050066280 0x7fe050068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe0701538f0 tx=0x7fe058009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.252+0000 7fe0677fe640 1 -- 172.21.15.45:0/2687074196 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe060051820 con 0x7fe07006a5c0 2023-07-09T02:12:33.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe07004d7d0 con 0x7fe07006a5c0 2023-07-09T02:12:33.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe0677fe640 1 -- 172.21.15.45:0/2687074196 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe060054e40 con 0x7fe07006a5c0 2023-07-09T02:12:33.413 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:12:33.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe050066280 msgr2=0x7fe050068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe050066280 0x7fe050068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe0701538f0 tx=0x7fe058009040 comp rx=0 tx=0).stop 2023-07-09T02:12:33.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006a5c0 msgr2=0x7fe070155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006a5c0 0x7fe070155dd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe06000d800 tx=0x7fe06000dcc0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 shutdown_connections 2023-07-09T02:12:33.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0700cd290 0x7fe0700b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe050066280 0x7fe050068730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe07006aa10 0x7fe07014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 --2- 172.21.15.45:0/2687074196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe07006a5c0 0x7fe070155dd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 >> 172.21.15.45:0/2687074196 conn(0x7fe07006d140 msgr2=0x7fe070159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:33.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 shutdown_connections 2023-07-09T02:12:33.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.408+0000 7fe07507b640 1 -- 172.21.15.45:0/2687074196 wait complete. 2023-07-09T02:12:33.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:33.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe853959640 1 Processor -- start 2023-07-09T02:12:33.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe853959640 1 -- start start 2023-07-09T02:12:33.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe853959640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe84c15c060 0x7fe84c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe853959640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe853959640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c160a50 con 0x7fe84c0cd120 2023-07-09T02:12:33.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe853959640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c15c430 con 0x7fe84c15c060 2023-07-09T02:12:33.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe853959640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c15fb60 con 0x7fe84c0d2620 2023-07-09T02:12:33.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe850ef4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe84c0cd120 0x7fe84c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39674/0 (socket says 172.21.15.45:39674) 2023-07-09T02:12:33.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe850ef4640 1 -- 172.21.15.45:0/1559079053 learned_addr learned my addr 172.21.15.45:0/1559079053 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:33.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe851ef6640 1 --2- 172.21.15.45:0/1559079053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe8516f5640 1 --2- 172.21.15.45:0/1559079053 >> v2:172.21.15.155:3300/0 conn(0x7fe84c15c060 0x7fe84c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe843fff640 1 -- 172.21.15.45:0/1559079053 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085562756 0 0) 0x7fe84c160a50 con 0x7fe84c0cd120 2023-07-09T02:12:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe843fff640 1 -- 172.21.15.45:0/1559079053 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe838003530 con 0x7fe84c0cd120 2023-07-09T02:12:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe843fff640 1 -- 172.21.15.45:0/1559079053 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1590144002 0 0) 0x7fe838003530 con 0x7fe84c0cd120 2023-07-09T02:12:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe851ef6640 1 -- 172.21.15.45:0/1559079053 >> v2:172.21.15.155:3300/0 conn(0x7fe84c15c060 msgr2=0x7fe84c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe851ef6640 1 --2- 172.21.15.45:0/1559079053 >> v2:172.21.15.155:3300/0 conn(0x7fe84c15c060 0x7fe84c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe851ef6640 1 -- 172.21.15.45:0/1559079053 >> v1:172.21.15.45:6789/0 conn(0x7fe84c0cd120 legacy=0x7fe84c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.572+0000 7fe851ef6640 1 -- 172.21.15.45:0/1559079053 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c15fe40 con 0x7fe84c0d2620 2023-07-09T02:12:33.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe851ef6640 1 --2- 172.21.15.45:0/1559079053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c0cee30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe844009d90 tx=0x7fe84401c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9143b27d21e9efae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe843fff640 1 -- 172.21.15.45:0/1559079053 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c001680 con 0x7fe84c0d2620 2023-07-09T02:12:33.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe843fff640 1 -- 172.21.15.45:0/1559079053 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8440a5640 con 0x7fe84c0d2620 2023-07-09T02:12:33.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe843fff640 1 -- 172.21.15.45:0/1559079053 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440a59d0 con 0x7fe84c0d2620 2023-07-09T02:12:33.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe853959640 1 -- 172.21.15.45:0/1559079053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 msgr2=0x7fe84c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe853959640 1 --2- 172.21.15.45:0/1559079053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c0cee30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe844009d90 tx=0x7fe84401c840 comp rx=0 tx=0).stop 2023-07-09T02:12:33.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe853959640 1 -- 172.21.15.45:0/1559079053 shutdown_connections 2023-07-09T02:12:33.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe853959640 1 --2- 172.21.15.45:0/1559079053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c0cee30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe853959640 1 --2- 172.21.15.45:0/1559079053 >> v2:172.21.15.155:3300/0 conn(0x7fe84c15c060 0x7fe84c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe853959640 1 -- 172.21.15.45:0/1559079053 >> 172.21.15.45:0/1559079053 conn(0x7fe84c0698e0 msgr2=0x7fe84c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:33.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe853959640 1 -- 172.21.15.45:0/1559079053 shutdown_connections 2023-07-09T02:12:33.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.576+0000 7fe853959640 1 -- 172.21.15.45:0/1559079053 wait complete. 2023-07-09T02:12:33.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 Processor -- start 2023-07-09T02:12:33.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 -- start start 2023-07-09T02:12:33.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe84c0cd120 0x7fe84c150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe84c15c060 0x7fe84c1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c14fff0 con 0x7fe84c15c060 2023-07-09T02:12:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c1502d0 con 0x7fe84c0cd120 2023-07-09T02:12:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c1505b0 con 0x7fe84c0d2620 2023-07-09T02:12:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe84c15c060 0x7fe84c1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe84c15c060 0x7fe84c1517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59132/0 (socket says 172.21.15.45:59132) 2023-07-09T02:12:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 -- 172.21.15.45:0/2391333324 learned_addr learned my addr 172.21.15.45:0/2391333324 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe850ef4640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe8516f5640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe84c0cd120 0x7fe84c150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 -- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 msgr2=0x7fe84c14f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c14f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 -- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe84c0cd120 msgr2=0x7fe84c150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe84c0cd120 0x7fe84c150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 -- 172.21.15.45:0/2391333324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe844009a70 con 0x7fe84c15c060 2023-07-09T02:12:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe8516f5640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe84c0cd120 0x7fe84c150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe851ef6640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe84c15c060 0x7fe84c1517a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe84401d0e0 tx=0x7fe8440195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe841ffb640 1 -- 172.21.15.45:0/2391333324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440b9860 con 0x7fe84c15c060 2023-07-09T02:12:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe841ffb640 1 -- 172.21.15.45:0/2391333324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8440b99c0 con 0x7fe84c15c060 2023-07-09T02:12:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c0b59f0 con 0x7fe84c15c060 2023-07-09T02:12:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe841ffb640 1 -- 172.21.15.45:0/2391333324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440b9d50 con 0x7fe84c15c060 2023-07-09T02:12:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.580+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c14fce0 con 0x7fe84c15c060 2023-07-09T02:12:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.584+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c04d7d0 con 0x7fe84c15c060 2023-07-09T02:12:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.584+0000 7fe841ffb640 1 -- 172.21.15.45:0/2391333324 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8440c4460 con 0x7fe84c15c060 2023-07-09T02:12:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.584+0000 7fe841ffb640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe830066280 0x7fe830068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.584+0000 7fe841ffb640 1 -- 172.21.15.45:0/2391333324 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe84411f250 con 0x7fe84c15c060 2023-07-09T02:12:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.584+0000 7fe8516f5640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe830066280 0x7fe830068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.584+0000 7fe8516f5640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe830066280 0x7fe830068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe84c151730 tx=0x7fe848008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.588+0000 7fe841ffb640 1 -- 172.21.15.45:0/2391333324 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8440ec750 con 0x7fe84c15c060 2023-07-09T02:12:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.772+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe84c06baa0 con 0x7fe84c15c060 2023-07-09T02:12:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe841ffb640 1 -- 172.21.15.45:0/2391333324 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fe844009450 con 0x7fe84c15c060 2023-07-09T02:12:33.777 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:33.777 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:13.135771+0000","modified":"2023-07-09T02:12:16.783642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3290020828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3290020828},{"type":"v1","addr":"172.21.15.45:6835","nonce":3290020828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T02:12:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-07-09T02:12:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe830066280 msgr2=0x7fe830068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe830066280 0x7fe830068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe84c151730 tx=0x7fe848008040 comp rx=0 tx=0).stop 2023-07-09T02:12:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe84c15c060 msgr2=0x7fe84c1517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe84c15c060 0x7fe84c1517a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe84401d0e0 tx=0x7fe8440195e0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 shutdown_connections 2023-07-09T02:12:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe84c15c060 0x7fe84c1517a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe830066280 0x7fe830068730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe84c0d2620 0x7fe84c14f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 --2- 172.21.15.45:0/2391333324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe84c0cd120 0x7fe84c150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 >> 172.21.15.45:0/2391333324 conn(0x7fe84c0698e0 msgr2=0x7fe84c069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 shutdown_connections 2023-07-09T02:12:33.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.776+0000 7fe853959640 1 -- 172.21.15.45:0/2391333324 wait complete. 2023-07-09T02:12:33.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc95d82640 1 Processor -- start 2023-07-09T02:12:33.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc95d82640 1 -- start start 2023-07-09T02:12:33.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc95d82640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc900ca0f0 0x7efc900cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc95d82640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efc9015db00 0x7efc9015df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc95d82640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9006bf30 con 0x7efc900cbbb0 2023-07-09T02:12:33.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc95d82640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9015e480 con 0x7efc900ca0f0 2023-07-09T02:12:33.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc95d82640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9006bc50 con 0x7efc9015db00 2023-07-09T02:12:33.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc8f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc900ca0f0 0x7efc900cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc900ca0f0 0x7efc900cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59138/0 (socket says 172.21.15.45:59138) 2023-07-09T02:12:33.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.940+0000 7efc8effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc900cbbb0 0x7efc900c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39688/0 (socket says 172.21.15.45:39688) 2023-07-09T02:12:33.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8f7fe640 1 -- 172.21.15.45:0/2610230459 learned_addr learned my addr 172.21.15.45:0/2610230459 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:33.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8ffff640 1 --2- 172.21.15.45:0/2610230459 >> v2:172.21.15.155:3300/0 conn(0x7efc9015db00 0x7efc9015df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8f7fe640 1 -- 172.21.15.45:0/2610230459 >> v2:172.21.15.155:3300/0 conn(0x7efc9015db00 msgr2=0x7efc9015df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:33.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8f7fe640 1 --2- 172.21.15.45:0/2610230459 >> v2:172.21.15.155:3300/0 conn(0x7efc9015db00 0x7efc9015df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8f7fe640 1 -- 172.21.15.45:0/2610230459 >> v1:172.21.15.45:6789/0 conn(0x7efc900cbbb0 legacy=0x7efc900c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8f7fe640 1 -- 172.21.15.45:0/2610230459 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900cab90 con 0x7efc900ca0f0 2023-07-09T02:12:33.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8e7fc640 1 -- 172.21.15.45:0/2610230459 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070880377 0 0) 0x7efc9006bf30 con 0x7efc900cbbb0 2023-07-09T02:12:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8f7fe640 1 --2- 172.21.15.45:0/2610230459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900ca0f0 0x7efc900cb670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc9006eec0 tx=0x7efc8001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688b4a33ff3dc283 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8e7fc640 1 -- 172.21.15.45:0/2610230459 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800ad680 con 0x7efc900ca0f0 2023-07-09T02:12:33.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8e7fc640 1 -- 172.21.15.45:0/2610230459 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc800ad7e0 con 0x7efc900ca0f0 2023-07-09T02:12:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.944+0000 7efc8e7fc640 1 -- 172.21.15.45:0/2610230459 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800adb70 con 0x7efc900ca0f0 2023-07-09T02:12:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- 172.21.15.45:0/2610230459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900ca0f0 msgr2=0x7efc900cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 --2- 172.21.15.45:0/2610230459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900ca0f0 0x7efc900cb670 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc9006eec0 tx=0x7efc8001c470 comp rx=0 tx=0).stop 2023-07-09T02:12:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- 172.21.15.45:0/2610230459 shutdown_connections 2023-07-09T02:12:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 --2- 172.21.15.45:0/2610230459 >> v2:172.21.15.155:3300/0 conn(0x7efc9015db00 0x7efc9015df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 --2- 172.21.15.45:0/2610230459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900ca0f0 0x7efc900cb670 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- 172.21.15.45:0/2610230459 >> 172.21.15.45:0/2610230459 conn(0x7efc900694b0 msgr2=0x7efc900698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:33.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- 172.21.15.45:0/2610230459 shutdown_connections 2023-07-09T02:12:33.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- 172.21.15.45:0/2610230459 wait complete. 2023-07-09T02:12:33.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 Processor -- start 2023-07-09T02:12:33.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- start start 2023-07-09T02:12:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc900ca0f0 0x7efc901523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900cbbb0 0x7efc900cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9015db00 0x7efc900c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc900ccce0 con 0x7efc900cbbb0 2023-07-09T02:12:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc900ccfc0 con 0x7efc900ca0f0 2023-07-09T02:12:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc95d82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc900cd2a0 con 0x7efc9015db00 2023-07-09T02:12:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc8effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900cbbb0 0x7efc900cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc8effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900cbbb0 0x7efc900cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59144/0 (socket says 172.21.15.45:59144) 2023-07-09T02:12:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc8effd640 1 -- 172.21.15.45:0/853646135 learned_addr learned my addr 172.21.15.45:0/853646135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc8f7fe640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc900ca0f0 0x7efc901523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.948+0000 7efc8ffff640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9015db00 0x7efc900c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc8effd640 1 -- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9015db00 msgr2=0x7efc900c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc8effd640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9015db00 0x7efc900c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc8effd640 1 -- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc900ca0f0 msgr2=0x7efc901523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc8effd640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc900ca0f0 0x7efc901523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc8effd640 1 -- 172.21.15.45:0/853646135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800094d0 con 0x7efc900cbbb0 2023-07-09T02:12:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc8effd640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900cbbb0 0x7efc900cc290 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efc840011f0 tx=0x7efc8400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc77fff640 1 -- 172.21.15.45:0/853646135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840074e0 con 0x7efc900cbbb0 2023-07-09T02:12:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc77fff640 1 -- 172.21.15.45:0/853646135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84007640 con 0x7efc900cbbb0 2023-07-09T02:12:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc77fff640 1 -- 172.21.15.45:0/853646135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84004a10 con 0x7efc900cbbb0 2023-07-09T02:12:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9013b860 con 0x7efc900cbbb0 2023-07-09T02:12:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc901541f0 con 0x7efc900cbbb0 2023-07-09T02:12:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9004d7d0 con 0x7efc900cbbb0 2023-07-09T02:12:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc77fff640 1 -- 172.21.15.45:0/853646135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc84004b70 con 0x7efc900cbbb0 2023-07-09T02:12:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc77fff640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efc7c066280 0x7efc7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc77fff640 1 -- 172.21.15.45:0/853646135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc84083130 con 0x7efc900cbbb0 2023-07-09T02:12:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.952+0000 7efc8f7fe640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efc7c066280 0x7efc7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.956+0000 7efc8f7fe640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efc7c066280 0x7efc7c068730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efc800af000 tx=0x7efc800a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:33.956+0000 7efc77fff640 1 -- 172.21.15.45:0/853646135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc84050490 con 0x7efc900cbbb0 2023-07-09T02:12:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.112+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc9006c540 con 0x7efc900cbbb0 2023-07-09T02:12:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.112+0000 7efc77fff640 1 -- 172.21.15.45:0/853646135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18351 (secure 0 0 0) 0x7efc84053ab0 con 0x7efc900cbbb0 2023-07-09T02:12:34.117 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:34.117 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:24.822024+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efc7c066280 msgr2=0x7efc7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efc7c066280 0x7efc7c068730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efc800af000 tx=0x7efc800a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900cbbb0 msgr2=0x7efc900cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900cbbb0 0x7efc900cc290 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efc840011f0 tx=0x7efc8400c9b0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 shutdown_connections 2023-07-09T02:12:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efc7c066280 0x7efc7c068730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc9015db00 0x7efc900c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc900cbbb0 0x7efc900cc290 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 --2- 172.21.15.45:0/853646135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc900ca0f0 0x7efc901523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 >> 172.21.15.45:0/853646135 conn(0x7efc900694b0 msgr2=0x7efc9015b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 shutdown_connections 2023-07-09T02:12:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.116+0000 7efc95d82640 1 -- 172.21.15.45:0/853646135 wait complete. 2023-07-09T02:12:34.138 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:12:34.139 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:34.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a491ad640 1 Processor -- start 2023-07-09T02:12:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a491ad640 1 -- start start 2023-07-09T02:12:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a491ad640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7a440d2620 0x7f7a440b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a491ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a491ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a44160a50 con 0x7f7a4415c060 2023-07-09T02:12:34.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a491ad640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4415c430 con 0x7f7a440d2620 2023-07-09T02:12:34.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a491ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415fb60 con 0x7f7a440cd120 2023-07-09T02:12:34.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a42d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7a4415c060 0x7f7a440d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39694/0 (socket says 172.21.15.45:39694) 2023-07-09T02:12:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a42d9d640 1 -- 172.21.15.45:0/3423524154 learned_addr learned my addr 172.21.15.45:0/3423524154 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a4359e640 1 --2- 172.21.15.45:0/3423524154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a3bfff640 1 --2- 172.21.15.45:0/3423524154 >> v2:172.21.15.155:3300/0 conn(0x7f7a440d2620 0x7f7a440b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a4259c640 1 -- 172.21.15.45:0/3423524154 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770814584 0 0) 0x7f7a44160a50 con 0x7f7a4415c060 2023-07-09T02:12:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a4259c640 1 -- 172.21.15.45:0/3423524154 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a30003530 con 0x7f7a4415c060 2023-07-09T02:12:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a4359e640 1 -- 172.21.15.45:0/3423524154 >> v2:172.21.15.155:3300/0 conn(0x7f7a440d2620 msgr2=0x7f7a440b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a4359e640 1 --2- 172.21.15.45:0/3423524154 >> v2:172.21.15.155:3300/0 conn(0x7f7a440d2620 0x7f7a440b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a4359e640 1 -- 172.21.15.45:0/3423524154 >> v1:172.21.15.45:6789/0 conn(0x7f7a4415c060 legacy=0x7f7a440d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a4259c640 1 -- 172.21.15.45:0/3423524154 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3630649167 0 0) 0x7f7a30003530 con 0x7f7a4415c060 2023-07-09T02:12:34.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.280+0000 7f7a4359e640 1 -- 172.21.15.45:0/3423524154 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4415fe40 con 0x7f7a440cd120 2023-07-09T02:12:34.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a4359e640 1 --2- 172.21.15.45:0/3423524154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440cee30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009d90 tx=0x7f7a3c01c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cabbef90c5eeda0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:34.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a4259c640 1 -- 172.21.15.45:0/3423524154 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34001680 con 0x7f7a440cd120 2023-07-09T02:12:34.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a4259c640 1 -- 172.21.15.45:0/3423524154 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0a5640 con 0x7f7a440cd120 2023-07-09T02:12:34.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a4259c640 1 -- 172.21.15.45:0/3423524154 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0a59d0 con 0x7f7a440cd120 2023-07-09T02:12:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a491ad640 1 -- 172.21.15.45:0/3423524154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 msgr2=0x7f7a440cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3423524154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440cee30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009d90 tx=0x7f7a3c01c840 comp rx=0 tx=0).stop 2023-07-09T02:12:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a491ad640 1 -- 172.21.15.45:0/3423524154 shutdown_connections 2023-07-09T02:12:34.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3423524154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440cee30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3423524154 >> v2:172.21.15.155:3300/0 conn(0x7f7a440d2620 0x7f7a440b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a491ad640 1 -- 172.21.15.45:0/3423524154 >> 172.21.15.45:0/3423524154 conn(0x7f7a440698e0 msgr2=0x7f7a44069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:34.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a491ad640 1 -- 172.21.15.45:0/3423524154 shutdown_connections 2023-07-09T02:12:34.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.284+0000 7f7a491ad640 1 -- 172.21.15.45:0/3423524154 wait complete. 2023-07-09T02:12:34.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 Processor -- start 2023-07-09T02:12:34.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 -- start start 2023-07-09T02:12:34.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440d2620 0x7f7a440caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a4415c060 0x7f7a440cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a441f4a60 con 0x7f7a4415c060 2023-07-09T02:12:34.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440c8e90 con 0x7f7a440d2620 2023-07-09T02:12:34.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440caa70 con 0x7f7a440cd120 2023-07-09T02:12:34.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a4415c060 0x7f7a440cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a4415c060 0x7f7a440cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59156/0 (socket says 172.21.15.45:59156) 2023-07-09T02:12:34.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 -- 172.21.15.45:0/3174573287 learned_addr learned my addr 172.21.15.45:0/3174573287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:34.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a42d9d640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a3bfff640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440d2620 0x7f7a440caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 -- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 msgr2=0x7f7a440c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 -- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440d2620 msgr2=0x7f7a440caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440d2620 0x7f7a440caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 -- 172.21.15.45:0/3174573287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009a70 con 0x7f7a4415c060 2023-07-09T02:12:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a42d9d640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a3bfff640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440d2620 0x7f7a440caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a4359e640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a4415c060 0x7f7a440cb1e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0b0040 tx=0x7f7a3c0195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a3b7fe640 1 -- 172.21.15.45:0/3174573287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0ad850 con 0x7f7a4415c060 2023-07-09T02:12:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a3b7fe640 1 -- 172.21.15.45:0/3174573287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0ad9b0 con 0x7f7a4415c060 2023-07-09T02:12:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a3b7fe640 1 -- 172.21.15.45:0/3174573287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0adda0 con 0x7f7a4415c060 2023-07-09T02:12:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a440b59f0 con 0x7f7a4415c060 2023-07-09T02:12:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.288+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a441f5920 con 0x7f7a4415c060 2023-07-09T02:12:34.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.292+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4404d7d0 con 0x7f7a4415c060 2023-07-09T02:12:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.292+0000 7f7a3b7fe640 1 -- 172.21.15.45:0/3174573287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a3c0b4050 con 0x7f7a4415c060 2023-07-09T02:12:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.292+0000 7f7a3b7fe640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a24066280 0x7f7a24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.292+0000 7f7a3b7fe640 1 -- 172.21.15.45:0/3174573287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a3c11ece0 con 0x7f7a4415c060 2023-07-09T02:12:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.292+0000 7f7a42d9d640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a24066280 0x7f7a24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.292+0000 7f7a42d9d640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a24066280 0x7f7a24068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7a34005890 tx=0x7f7a34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:34.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.296+0000 7f7a3b7fe640 1 -- 172.21.15.45:0/3174573287 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a3c0ec270 con 0x7f7a4415c060 2023-07-09T02:12:34.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.484+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a440d3880 con 0x7f7a4415c060 2023-07-09T02:12:34.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.484+0000 7f7a3b7fe640 1 -- 172.21.15.45:0/3174573287 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f7a3c0c7090 con 0x7f7a4415c060 2023-07-09T02:12:34.490 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:34.490 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:13.135771+0000","modified":"2023-07-09T02:12:16.783642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3290020828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3290020828},{"type":"v1","addr":"172.21.15.45:6835","nonce":3290020828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T02:12:34.491 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-07-09T02:12:34.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a24066280 msgr2=0x7f7a24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a24066280 0x7f7a24068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7a34005890 tx=0x7f7a34009040 comp rx=0 tx=0).stop 2023-07-09T02:12:34.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a4415c060 msgr2=0x7f7a440cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a4415c060 0x7f7a440cb1e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0b0040 tx=0x7f7a3c0195e0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 shutdown_connections 2023-07-09T02:12:34.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a4415c060 0x7f7a440cb1e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440d2620 0x7f7a440caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7a24066280 0x7f7a24068730 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 --2- 172.21.15.45:0/3174573287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440cd120 0x7f7a440c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 >> 172.21.15.45:0/3174573287 conn(0x7f7a440698e0 msgr2=0x7f7a44157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:34.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 shutdown_connections 2023-07-09T02:12:34.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.488+0000 7f7a491ad640 1 -- 172.21.15.45:0/3174573287 wait complete. 2023-07-09T02:12:34.510 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd65138f640 1 Processor -- start 2023-07-09T02:12:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd65138f640 1 -- start start 2023-07-09T02:12:34.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd65138f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd64c15c060 0x7fd64c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd65138f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd64c0cd120 0x7fd64c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd65138f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64c160a50 con 0x7fd64c0d2450 2023-07-09T02:12:34.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd65138f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c0d28d0 con 0x7fd64c0cd120 2023-07-09T02:12:34.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd65138f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c0cfe40 con 0x7fd64c15c060 2023-07-09T02:12:34.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd643fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd64c0cd120 0x7fd64c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd64b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd64c0d2450 0x7fd64c0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39696/0 (socket says 172.21.15.45:39696) 2023-07-09T02:12:34.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd64b7fe640 1 -- 172.21.15.45:0/2149255635 learned_addr learned my addr 172.21.15.45:0/2149255635 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:34.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd64affd640 1 --2- 172.21.15.45:0/2149255635 >> v2:172.21.15.155:3300/0 conn(0x7fd64c15c060 0x7fd64c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd643fff640 1 -- 172.21.15.45:0/2149255635 >> v2:172.21.15.155:3300/0 conn(0x7fd64c15c060 msgr2=0x7fd64c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:34.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd643fff640 1 --2- 172.21.15.45:0/2149255635 >> v2:172.21.15.155:3300/0 conn(0x7fd64c15c060 0x7fd64c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd643fff640 1 -- 172.21.15.45:0/2149255635 >> v1:172.21.15.45:6789/0 conn(0x7fd64c0d2450 legacy=0x7fd64c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd643fff640 1 -- 172.21.15.45:0/2149255635 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c15c430 con 0x7fd64c0cd120 2023-07-09T02:12:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd64a7fc640 1 -- 172.21.15.45:0/2149255635 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612383099 0 0) 0x7fd64c160a50 con 0x7fd64c0d2450 2023-07-09T02:12:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.652+0000 7fd64affd640 1 --2- 172.21.15.45:0/2149255635 >> v2:172.21.15.155:3300/0 conn(0x7fd64c15c060 0x7fd64c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd643fff640 1 --2- 172.21.15.45:0/2149255635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c0d1f10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0d3ad0 tx=0x7fd63401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fcae16fc20d460 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:34.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd64a7fc640 1 -- 172.21.15.45:0/2149255635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634004230 con 0x7fd64c0cd120 2023-07-09T02:12:34.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd64a7fc640 1 -- 172.21.15.45:0/2149255635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6340a7050 con 0x7fd64c0cd120 2023-07-09T02:12:34.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd64a7fc640 1 -- 172.21.15.45:0/2149255635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634003620 con 0x7fd64c0cd120 2023-07-09T02:12:34.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd65138f640 1 -- 172.21.15.45:0/2149255635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 msgr2=0x7fd64c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd65138f640 1 --2- 172.21.15.45:0/2149255635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c0d1f10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0d3ad0 tx=0x7fd63401c430 comp rx=0 tx=0).stop 2023-07-09T02:12:34.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd65138f640 1 -- 172.21.15.45:0/2149255635 shutdown_connections 2023-07-09T02:12:34.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd65138f640 1 --2- 172.21.15.45:0/2149255635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c0d1f10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd65138f640 1 --2- 172.21.15.45:0/2149255635 >> v2:172.21.15.155:3300/0 conn(0x7fd64c15c060 0x7fd64c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd65138f640 1 -- 172.21.15.45:0/2149255635 >> 172.21.15.45:0/2149255635 conn(0x7fd64c0698e0 msgr2=0x7fd64c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:34.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd65138f640 1 -- 172.21.15.45:0/2149255635 shutdown_connections 2023-07-09T02:12:34.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.656+0000 7fd65138f640 1 -- 172.21.15.45:0/2149255635 wait complete. 2023-07-09T02:12:34.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 Processor -- start 2023-07-09T02:12:34.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 -- start start 2023-07-09T02:12:34.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd64c0d2450 0x7fd64c0b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64c15c060 0x7fd64c0b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0ca6c0 con 0x7fd64c0cd120 2023-07-09T02:12:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0ca9a0 con 0x7fd64c15c060 2023-07-09T02:12:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0cac80 con 0x7fd64c0d2450 2023-07-09T02:12:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59168/0 (socket says 172.21.15.45:59168) 2023-07-09T02:12:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 -- 172.21.15.45:0/64497098 learned_addr learned my addr 172.21.15.45:0/64497098 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:34.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd643fff640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd64c0d2450 0x7fd64c0b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64b7fe640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64c15c060 0x7fd64c0b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 -- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd64c0d2450 msgr2=0x7fd64c0b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd64c0d2450 0x7fd64c0b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 -- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64c15c060 msgr2=0x7fd64c0b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64c15c060 0x7fd64c0b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 -- 172.21.15.45:0/64497098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634009420 con 0x7fd64c0cd120 2023-07-09T02:12:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64b7fe640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64c15c060 0x7fd64c0b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd64affd640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c153db0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c7f0 tx=0x7fd63c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd6437fe640 1 -- 172.21.15.45:0/64497098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c007820 con 0x7fd64c0cd120 2023-07-09T02:12:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd6437fe640 1 -- 172.21.15.45:0/64497098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c007980 con 0x7fd64c0cd120 2023-07-09T02:12:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd6437fe640 1 -- 172.21.15.45:0/64497098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c007d30 con 0x7fd64c0cd120 2023-07-09T02:12:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c0caf60 con 0x7fd64c0cd120 2023-07-09T02:12:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c0b4580 con 0x7fd64c0cd120 2023-07-09T02:12:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.660+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c1600d0 con 0x7fd64c0cd120 2023-07-09T02:12:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.664+0000 7fd6437fe640 1 -- 172.21.15.45:0/64497098 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd63c0113f0 con 0x7fd64c0cd120 2023-07-09T02:12:34.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.664+0000 7fd6437fe640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd62c066280 0x7fd62c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:34.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.664+0000 7fd6437fe640 1 -- 172.21.15.45:0/64497098 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd63c0840b0 con 0x7fd64c0cd120 2023-07-09T02:12:34.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.664+0000 7fd643fff640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd62c066280 0x7fd62c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:34.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.664+0000 7fd643fff640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd62c066280 0x7fd62c068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd6340ad000 tx=0x7fd6340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:34.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.668+0000 7fd6437fe640 1 -- 172.21.15.45:0/64497098 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd63c051520 con 0x7fd64c0cd120 2023-07-09T02:12:34.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.852+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd64c04d7d0 con 0x7fd64c0cd120 2023-07-09T02:12:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd6437fe640 1 -- 172.21.15.45:0/64497098 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fd63c054b40 con 0x7fd64c0cd120 2023-07-09T02:12:34.857 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:34.857 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:13.135771+0000","modified":"2023-07-09T02:12:16.783642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3290020828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3290020828},{"type":"v1","addr":"172.21.15.45:6835","nonce":3290020828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T02:12:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-07-09T02:12:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd62c066280 msgr2=0x7fd62c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd62c066280 0x7fd62c068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd6340ad000 tx=0x7fd6340a6000 comp rx=0 tx=0).stop 2023-07-09T02:12:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 msgr2=0x7fd64c153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c153db0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c7f0 tx=0x7fd63c00ccb0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 shutdown_connections 2023-07-09T02:12:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64c15c060 0x7fd64c0b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd62c066280 0x7fd62c068730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd64c0d2450 0x7fd64c0b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 --2- 172.21.15.45:0/64497098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cd120 0x7fd64c153db0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 >> 172.21.15.45:0/64497098 conn(0x7fd64c0698e0 msgr2=0x7fd64c0b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 shutdown_connections 2023-07-09T02:12:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:34.856+0000 7fd65138f640 1 -- 172.21.15.45:0/64497098 wait complete. 2023-07-09T02:12:34.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:35.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c91a9640 1 Processor -- start 2023-07-09T02:12:35.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c91a9640 1 -- start start 2023-07-09T02:12:35.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c91a9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa6c40c8d40 0x7fa6c40ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c91a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6c40b4ae0 0x7fa6c40d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c91a9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c40cd5d0 con 0x7fa6c4160670 2023-07-09T02:12:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c91a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c40d2050 con 0x7fa6c40b4ae0 2023-07-09T02:12:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c91a9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c40d27a0 con 0x7fa6c40c8d40 2023-07-09T02:12:35.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c89a8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6c40b4ae0 0x7fa6c40d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c89a8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6c40b4ae0 0x7fa6c40d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59178/0 (socket says 172.21.15.45:59178) 2023-07-09T02:12:35.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c89a8640 1 -- 172.21.15.45:0/1596347950 learned_addr learned my addr 172.21.15.45:0/1596347950 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:35.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c3fff640 1 --2- 172.21.15.45:0/1596347950 >> v2:172.21.15.155:3300/0 conn(0x7fa6c40c8d40 0x7fa6c40ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c89a8640 1 -- 172.21.15.45:0/1596347950 >> v2:172.21.15.155:3300/0 conn(0x7fa6c40c8d40 msgr2=0x7fa6c40ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:35.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c89a8640 1 --2- 172.21.15.45:0/1596347950 >> v2:172.21.15.155:3300/0 conn(0x7fa6c40c8d40 0x7fa6c40ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c89a8640 1 -- 172.21.15.45:0/1596347950 >> v1:172.21.15.155:6789/0 conn(0x7fa6c4160670 legacy=0x7fa6c40b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:35.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.020+0000 7fa6c89a8640 1 -- 172.21.15.45:0/1596347950 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c4160ad0 con 0x7fa6c40b4ae0 2023-07-09T02:12:35.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c89a8640 1 --2- 172.21.15.45:0/1596347950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c40b4ae0 0x7fa6c40d0490 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40b5540 tx=0x7fa6bc01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d0c4a298f9be8a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c2ffd640 1 -- 172.21.15.45:0/1596347950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0af400 con 0x7fa6c40b4ae0 2023-07-09T02:12:35.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c2ffd640 1 -- 172.21.15.45:0/1596347950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc0ab050 con 0x7fa6c40b4ae0 2023-07-09T02:12:35.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c2ffd640 1 -- 172.21.15.45:0/1596347950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0af780 con 0x7fa6c40b4ae0 2023-07-09T02:12:35.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1596347950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c40b4ae0 msgr2=0x7fa6c40d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1596347950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c40b4ae0 0x7fa6c40d0490 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40b5540 tx=0x7fa6bc01f180 comp rx=0 tx=0).stop 2023-07-09T02:12:35.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1596347950 shutdown_connections 2023-07-09T02:12:35.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1596347950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c40b4ae0 0x7fa6c40d0490 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1596347950 >> v2:172.21.15.155:3300/0 conn(0x7fa6c40c8d40 0x7fa6c40ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1596347950 >> 172.21.15.45:0/1596347950 conn(0x7fa6c40d2950 msgr2=0x7fa6c40d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:35.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1596347950 shutdown_connections 2023-07-09T02:12:35.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.024+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1596347950 wait complete. 2023-07-09T02:12:35.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 Processor -- start 2023-07-09T02:12:35.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 -- start start 2023-07-09T02:12:35.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c40b4ae0 0x7fa6c415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c40c8d40 0x7fa6c41f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c4160670 0x7fa6c41f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c41f5900 con 0x7fa6c4160670 2023-07-09T02:12:35.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c40b3f80 con 0x7fa6c40c8d40 2023-07-09T02:12:35.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c415f420 con 0x7fa6c40b4ae0 2023-07-09T02:12:35.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c4160670 0x7fa6c41f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c4160670 0x7fa6c41f53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59192/0 (socket says 172.21.15.45:59192) 2023-07-09T02:12:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 -- 172.21.15.45:0/1778792554 learned_addr learned my addr 172.21.15.45:0/1778792554 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 -- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c40b4ae0 msgr2=0x7fa6c415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c40b4ae0 0x7fa6c415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 -- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c40c8d40 msgr2=0x7fa6c41f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c40c8d40 0x7fa6c41f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 -- 172.21.15.45:0/1778792554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc009b30 con 0x7fa6c4160670 2023-07-09T02:12:35.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c89a8640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c4160670 0x7fa6c41f53c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc01cdb0 tx=0x7fa6bc01bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c0ff9640 1 -- 172.21.15.45:0/1778792554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0afe00 con 0x7fa6c4160670 2023-07-09T02:12:35.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c0ff9640 1 -- 172.21.15.45:0/1778792554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc009510 con 0x7fa6c4160670 2023-07-09T02:12:35.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c0ff9640 1 -- 172.21.15.45:0/1778792554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0ba660 con 0x7fa6c4160670 2023-07-09T02:12:35.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c40b3c50 con 0x7fa6c4160670 2023-07-09T02:12:35.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.028+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c40b5a60 con 0x7fa6c4160670 2023-07-09T02:12:35.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.032+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c404e020 con 0x7fa6c4160670 2023-07-09T02:12:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.032+0000 7fa6c0ff9640 1 -- 172.21.15.45:0/1778792554 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6bc0b6040 con 0x7fa6c4160670 2023-07-09T02:12:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.032+0000 7fa6c0ff9640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6b0066280 0x7fa6b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.032+0000 7fa6c0ff9640 1 -- 172.21.15.45:0/1778792554 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6bc122140 con 0x7fa6c4160670 2023-07-09T02:12:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.032+0000 7fa6c3fff640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6b0066280 0x7fa6b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.032+0000 7fa6c3fff640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6b0066280 0x7fa6b0068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400a8b0 tx=0x7fa6b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.036+0000 7fa6c0ff9640 1 -- 172.21.15.45:0/1778792554 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6bc0ef520 con 0x7fa6c4160670 2023-07-09T02:12:35.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6c40b40c0 con 0x7fa6c4160670 2023-07-09T02:12:35.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c0ff9640 1 -- 172.21.15.45:0/1778792554 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fa6bc0f2b40 con 0x7fa6c4160670 2023-07-09T02:12:35.194 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:35.195 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:24.822024+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:11.263177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:12.133396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6b0066280 msgr2=0x7fa6b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6b0066280 0x7fa6b0068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400a8b0 tx=0x7fa6b4008040 comp rx=0 tx=0).stop 2023-07-09T02:12:35.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c4160670 msgr2=0x7fa6c41f53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c4160670 0x7fa6c41f53c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc01cdb0 tx=0x7fa6bc01bf20 comp rx=0 tx=0).stop 2023-07-09T02:12:35.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 shutdown_connections 2023-07-09T02:12:35.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6c4160670 0x7fa6c41f53c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c40c8d40 0x7fa6c41f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6b0066280 0x7fa6b0068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 --2- 172.21.15.45:0/1778792554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c40b4ae0 0x7fa6c415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 >> 172.21.15.45:0/1778792554 conn(0x7fa6c40d2950 msgr2=0x7fa6c40d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:35.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 shutdown_connections 2023-07-09T02:12:35.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.192+0000 7fa6c91a9640 1 -- 172.21.15.45:0/1778792554 wait complete. 2023-07-09T02:12:35.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:12:35.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74f029e640 1 Processor -- start 2023-07-09T02:12:35.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74f029e640 1 -- start start 2023-07-09T02:12:35.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74f029e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74e80cd290 0x7f74e80cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74f029e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74e806aa40 0x7f74e80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74f029e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e8071140 con 0x7f74e806a5c0 2023-07-09T02:12:35.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74f029e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e806b010 con 0x7f74e806aa40 2023-07-09T02:12:35.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74f029e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e80cdba0 con 0x7f74e80cd290 2023-07-09T02:12:35.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ee83b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74e806aa40 0x7f74e80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ed839640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f74e806a5c0 0x7f74e80b2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39698/0 (socket says 172.21.15.45:39698) 2023-07-09T02:12:35.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ed839640 1 -- 172.21.15.45:0/661427270 learned_addr learned my addr 172.21.15.45:0/661427270 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:35.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ee83b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74e806aa40 0x7f74e80b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59194/0 (socket says 172.21.15.45:59194) 2023-07-09T02:12:35.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ee03a640 1 --2- 172.21.15.45:0/661427270 >> v2:172.21.15.155:3300/0 conn(0x7f74e80cd290 0x7f74e80cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ee83b640 1 -- 172.21.15.45:0/661427270 >> v2:172.21.15.155:3300/0 conn(0x7f74e80cd290 msgr2=0x7f74e80cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:35.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ed038640 1 -- 172.21.15.45:0/661427270 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692320155 0 0) 0x7f74e8071140 con 0x7f74e806a5c0 2023-07-09T02:12:35.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ee83b640 1 --2- 172.21.15.45:0/661427270 >> v2:172.21.15.155:3300/0 conn(0x7f74e80cd290 0x7f74e80cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ee83b640 1 -- 172.21.15.45:0/661427270 >> v1:172.21.15.45:6789/0 conn(0x7f74e806a5c0 legacy=0x7f74e80b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.360+0000 7f74ee83b640 1 -- 172.21.15.45:0/661427270 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e815c970 con 0x7f74e806aa40 2023-07-09T02:12:35.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74ee83b640 1 --2- 172.21.15.45:0/661427270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80b2a50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f74e8070f40 tx=0x7f74e001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fabb2d9c4290c38 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74ed038640 1 -- 172.21.15.45:0/661427270 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00a5740 con 0x7f74e806aa40 2023-07-09T02:12:35.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74ed038640 1 -- 172.21.15.45:0/661427270 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e00a58a0 con 0x7f74e806aa40 2023-07-09T02:12:35.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74ed038640 1 -- 172.21.15.45:0/661427270 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00a5c30 con 0x7f74e806aa40 2023-07-09T02:12:35.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74f029e640 1 -- 172.21.15.45:0/661427270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 msgr2=0x7f74e80b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74f029e640 1 --2- 172.21.15.45:0/661427270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80b2a50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f74e8070f40 tx=0x7f74e001c880 comp rx=0 tx=0).stop 2023-07-09T02:12:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74f029e640 1 -- 172.21.15.45:0/661427270 shutdown_connections 2023-07-09T02:12:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74f029e640 1 --2- 172.21.15.45:0/661427270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80b2a50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74f029e640 1 --2- 172.21.15.45:0/661427270 >> v2:172.21.15.155:3300/0 conn(0x7f74e80cd290 0x7f74e80cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74f029e640 1 -- 172.21.15.45:0/661427270 >> 172.21.15.45:0/661427270 conn(0x7f74e806d140 msgr2=0x7f74e806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74f029e640 1 -- 172.21.15.45:0/661427270 shutdown_connections 2023-07-09T02:12:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.364+0000 7f74f029e640 1 -- 172.21.15.45:0/661427270 wait complete. 2023-07-09T02:12:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 Processor -- start 2023-07-09T02:12:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 -- start start 2023-07-09T02:12:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e806a5c0 0x7f74e814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e80cd290 0x7f74e80b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80b0320 con 0x7f74e806aa40 2023-07-09T02:12:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80b08e0 con 0x7f74e80cd290 2023-07-09T02:12:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e814d020 con 0x7f74e806a5c0 2023-07-09T02:12:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59200/0 (socket says 172.21.15.45:59200) 2023-07-09T02:12:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 -- 172.21.15.45:0/1409787229 learned_addr learned my addr 172.21.15.45:0/1409787229 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 -- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e806a5c0 msgr2=0x7f74e814cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e806a5c0 0x7f74e814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 -- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e80cd290 msgr2=0x7f74e80b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e80cd290 0x7f74e80b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 -- 172.21.15.45:0/1409787229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0009a70 con 0x7f74e806aa40 2023-07-09T02:12:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74ed839640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80af080 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c550 tx=0x7f74d800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74deffd640 1 -- 172.21.15.45:0/1409787229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80074e0 con 0x7f74e806aa40 2023-07-09T02:12:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74deffd640 1 -- 172.21.15.45:0/1409787229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d8007640 con 0x7f74e806aa40 2023-07-09T02:12:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74deffd640 1 -- 172.21.15.45:0/1409787229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80049f0 con 0x7f74e806aa40 2023-07-09T02:12:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e814fab0 con 0x7f74e806aa40 2023-07-09T02:12:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e80aeab0 con 0x7f74e806aa40 2023-07-09T02:12:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.368+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e804d7d0 con 0x7f74e806aa40 2023-07-09T02:12:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.372+0000 7f74deffd640 1 -- 172.21.15.45:0/1409787229 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74d8004b50 con 0x7f74e806aa40 2023-07-09T02:12:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.372+0000 7f74deffd640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.372+0000 7f74deffd640 1 -- 172.21.15.45:0/1409787229 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74d8082ff0 con 0x7f74e806aa40 2023-07-09T02:12:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.372+0000 7f74ee03a640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.372+0000 7f74ee03a640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74cc066280 0x7f74cc068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f74e4006aa0 tx=0x7f74e4006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.376+0000 7f74deffd640 1 -- 172.21.15.45:0/1409787229 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74d80b3700 con 0x7f74e806aa40 2023-07-09T02:12:35.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.564+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f74e80b0a20 con 0x7f74e806aa40 2023-07-09T02:12:35.566 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:12:35.564+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:12:35.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.568+0000 7f74deffd640 1 -- 172.21.15.45:0/1409787229 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f74e80b0a20 con 0x7f74e806aa40 2023-07-09T02:12:35.572 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:12:35.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74cc066280 msgr2=0x7f74cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74cc066280 0x7f74cc068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f74e4006aa0 tx=0x7f74e4006a30 comp rx=0 tx=0).stop 2023-07-09T02:12:35.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 msgr2=0x7f74e80af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80af080 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c550 tx=0x7f74d800ca10 comp rx=0 tx=0).stop 2023-07-09T02:12:35.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 shutdown_connections 2023-07-09T02:12:35.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e80cd290 0x7f74e80b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e806aa40 0x7f74e80af080 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74cc066280 0x7f74cc068730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 --2- 172.21.15.45:0/1409787229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e806a5c0 0x7f74e814cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 >> 172.21.15.45:0/1409787229 conn(0x7f74e806d140 msgr2=0x7f74e815b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:35.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 shutdown_connections 2023-07-09T02:12:35.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.572+0000 7f74f029e640 1 -- 172.21.15.45:0/1409787229 wait complete. 2023-07-09T02:12:35.580 INFO:tasks.ceph.mds.c.smithi045.stderr: -4695> 2023-07-09T02:12:16.704+0000 7fc533aff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:12:35.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:12:35.631 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:12:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f936e5ac640 1 Processor -- start 2023-07-09T02:12:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f936e5ac640 1 -- start start 2023-07-09T02:12:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f936e5ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f936815c060 0x7f93680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f936e5ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93680d2620 0x7f93680cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f936e5ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9368160a50 con 0x7f93680cd120 2023-07-09T02:12:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f936e5ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936815c430 con 0x7f93680d2620 2023-07-09T02:12:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f936e5ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936815fb60 con 0x7f936815c060 2023-07-09T02:12:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f93677fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f93680cd120 0x7f93680d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39702/0 (socket says 172.21.15.45:39702) 2023-07-09T02:12:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f93677fe640 1 -- 172.21.15.45:0/1044618790 learned_addr learned my addr 172.21.15.45:0/1044618790 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f9367fff640 1 --2- 172.21.15.45:0/1044618790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f936815c060 0x7f93680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f936cb49640 1 --2- 172.21.15.45:0/1044618790 >> v2:172.21.15.155:3300/0 conn(0x7f93680d2620 0x7f93680cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f9366ffd640 1 -- 172.21.15.45:0/1044618790 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864596415 0 0) 0x7f9368160a50 con 0x7f93680cd120 2023-07-09T02:12:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f9366ffd640 1 -- 172.21.15.45:0/1044618790 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9350003530 con 0x7f93680cd120 2023-07-09T02:12:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f9366ffd640 1 -- 172.21.15.45:0/1044618790 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2814837550 0 0) 0x7f9350003530 con 0x7f93680cd120 2023-07-09T02:12:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f9367fff640 1 -- 172.21.15.45:0/1044618790 >> v2:172.21.15.155:3300/0 conn(0x7f93680d2620 msgr2=0x7f93680cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f9367fff640 1 --2- 172.21.15.45:0/1044618790 >> v2:172.21.15.155:3300/0 conn(0x7f93680d2620 0x7f93680cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f9367fff640 1 -- 172.21.15.45:0/1044618790 >> v1:172.21.15.45:6789/0 conn(0x7f93680cd120 legacy=0x7f93680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.740+0000 7f9367fff640 1 -- 172.21.15.45:0/1044618790 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936815fe40 con 0x7f936815c060 2023-07-09T02:12:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f9367fff640 1 --2- 172.21.15.45:0/1044618790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f936815c060 0x7f93680b4ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93580097f0 tx=0x7f935801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3479fe0898428115 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f9366ffd640 1 -- 172.21.15.45:0/1044618790 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c001680 con 0x7f936815c060 2023-07-09T02:12:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f9366ffd640 1 -- 172.21.15.45:0/1044618790 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93580a7050 con 0x7f936815c060 2023-07-09T02:12:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f9366ffd640 1 -- 172.21.15.45:0/1044618790 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580ab620 con 0x7f936815c060 2023-07-09T02:12:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f936e5ac640 1 -- 172.21.15.45:0/1044618790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f936815c060 msgr2=0x7f93680b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1044618790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f936815c060 0x7f93680b4ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93580097f0 tx=0x7f935801c370 comp rx=0 tx=0).stop 2023-07-09T02:12:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f936e5ac640 1 -- 172.21.15.45:0/1044618790 shutdown_connections 2023-07-09T02:12:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1044618790 >> v2:172.21.15.155:3300/0 conn(0x7f93680d2620 0x7f93680cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1044618790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f936815c060 0x7f93680b4ed0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f936e5ac640 1 -- 172.21.15.45:0/1044618790 >> 172.21.15.45:0/1044618790 conn(0x7f93680698e0 msgr2=0x7f9368069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f936e5ac640 1 -- 172.21.15.45:0/1044618790 shutdown_connections 2023-07-09T02:12:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.744+0000 7f936e5ac640 1 -- 172.21.15.45:0/1044618790 wait complete. 2023-07-09T02:12:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 Processor -- start 2023-07-09T02:12:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 -- start start 2023-07-09T02:12:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93680cd120 0x7f936814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93680d2620 0x7f936815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f936815c060 0x7f93680b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936815cb40 con 0x7f93680d2620 2023-07-09T02:12:35.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680c9100 con 0x7f936815c060 2023-07-09T02:12:35.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936814b430 con 0x7f93680cd120 2023-07-09T02:12:35.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93680d2620 0x7f936815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93680d2620 0x7f936815c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59232/0 (socket says 172.21.15.45:59232) 2023-07-09T02:12:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 -- 172.21.15.45:0/1836750983 learned_addr learned my addr 172.21.15.45:0/1836750983 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f9367fff640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93680cd120 0x7f936814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936cb49640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f936815c060 0x7f93680b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 -- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93680cd120 msgr2=0x7f936814a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93680cd120 0x7f936814a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 -- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f936815c060 msgr2=0x7f93680b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:35.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f936815c060 0x7f93680b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:35.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 -- 172.21.15.45:0/1836750983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9358009420 con 0x7f93680d2620 2023-07-09T02:12:35.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936cb49640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f936815c060 0x7f93680b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:35.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f93677fe640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93680d2620 0x7f936815c600 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c730 tx=0x7f935c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f9364ff9640 1 -- 172.21.15.45:0/1836750983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c005ae0 con 0x7f93680d2620 2023-07-09T02:12:35.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f9364ff9640 1 -- 172.21.15.45:0/1836750983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c005c40 con 0x7f93680d2620 2023-07-09T02:12:35.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93680b59f0 con 0x7f93680d2620 2023-07-09T02:12:35.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f9364ff9640 1 -- 172.21.15.45:0/1836750983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c007070 con 0x7f93680d2620 2023-07-09T02:12:35.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.748+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936815f480 con 0x7f93680d2620 2023-07-09T02:12:35.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.752+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936804d7d0 con 0x7f93680d2620 2023-07-09T02:12:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.752+0000 7f9364ff9640 1 -- 172.21.15.45:0/1836750983 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f935c0073e0 con 0x7f93680d2620 2023-07-09T02:12:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.752+0000 7f9364ff9640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93540662b0 0x7f9354068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.752+0000 7f9364ff9640 1 -- 172.21.15.45:0/1836750983 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f935c083cc0 con 0x7f93680d2620 2023-07-09T02:12:35.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.752+0000 7f9367fff640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93540662b0 0x7f9354068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:35.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.752+0000 7f9367fff640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93540662b0 0x7f9354068760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f93580ad000 tx=0x7f93580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:35.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.756+0000 7f9364ff9640 1 -- 172.21.15.45:0/1836750983 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f935c08a080 con 0x7f93680d2620 2023-07-09T02:12:35.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:35.940+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f93681606b0 con 0x7f93680d2620 2023-07-09T02:12:36.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f9364ff9640 1 -- 172.21.15.45:0/1836750983 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f935c0510d0 con 0x7f93680d2620 2023-07-09T02:12:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93540662b0 msgr2=0x7f9354068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93540662b0 0x7f9354068760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f93580ad000 tx=0x7f93580a6000 comp rx=0 tx=0).stop 2023-07-09T02:12:36.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93680d2620 msgr2=0x7f936815c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93680d2620 0x7f936815c600 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c730 tx=0x7f935c00cbf0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 shutdown_connections 2023-07-09T02:12:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f936815c060 0x7f93680b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93680d2620 0x7f936815c600 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93540662b0 0x7f9354068760 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 --2- 172.21.15.45:0/1836750983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93680cd120 0x7f936814a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 >> 172.21.15.45:0/1836750983 conn(0x7f93680698e0 msgr2=0x7f9368154fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 shutdown_connections 2023-07-09T02:12:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.572+0000 7f936e5ac640 1 -- 172.21.15.45:0/1836750983 wait complete. 2023-07-09T02:12:36.597 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:12:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a912c640 1 Processor -- start 2023-07-09T02:12:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a912c640 1 -- start start 2023-07-09T02:12:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a912c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a415d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a912c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a4159320 con 0x7f24a40c52a0 2023-07-09T02:12:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a912c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40c8fd0 con 0x7f24a415d690 2023-07-09T02:12:36.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a912c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40b16f0 con 0x7f24a4158f50 2023-07-09T02:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a359e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f24a40c52a0 0x7f24a40ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39712/0 (socket says 172.21.15.45:39712) 2023-07-09T02:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a359e640 1 -- 172.21.15.45:0/128216428 learned_addr learned my addr 172.21.15.45:0/128216428 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a2d9d640 1 --2- 172.21.15.45:0/128216428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a259c640 1 -- 172.21.15.45:0/128216428 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743576882 0 0) 0x7f24a4159320 con 0x7f24a40c52a0 2023-07-09T02:12:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.792+0000 7f24a259c640 1 -- 172.21.15.45:0/128216428 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2490003530 con 0x7f24a40c52a0 2023-07-09T02:12:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a259c640 1 -- 172.21.15.45:0/128216428 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399717159 0 0) 0x7f24a40c8fd0 con 0x7f24a415d690 2023-07-09T02:12:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a259c640 1 -- 172.21.15.45:0/128216428 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a4159320 con 0x7f24a415d690 2023-07-09T02:12:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a2d9d640 1 -- 172.21.15.45:0/128216428 >> v1:172.21.15.155:6789/0 conn(0x7f24a415d690 legacy=0x7f24a40694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a259c640 1 -- 172.21.15.45:0/128216428 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1058970978 0 0) 0x7f2490003530 con 0x7f24a40c52a0 2023-07-09T02:12:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a2d9d640 1 -- 172.21.15.45:0/128216428 >> v1:172.21.15.45:6789/0 conn(0x7f24a40c52a0 legacy=0x7f24a40ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a2d9d640 1 -- 172.21.15.45:0/128216428 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40c92b0 con 0x7f24a4158f50 2023-07-09T02:12:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a2d9d640 1 --2- 172.21.15.45:0/128216428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a415d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24940097f0 tx=0x7f249401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b714aa76ff36f462 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a259c640 1 -- 172.21.15.45:0/128216428 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c001a20 con 0x7f24a4158f50 2023-07-09T02:12:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a259c640 1 -- 172.21.15.45:0/128216428 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940a7050 con 0x7f24a4158f50 2023-07-09T02:12:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a259c640 1 -- 172.21.15.45:0/128216428 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940ab620 con 0x7f24a4158f50 2023-07-09T02:12:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a912c640 1 -- 172.21.15.45:0/128216428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 msgr2=0x7f24a415d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a912c640 1 --2- 172.21.15.45:0/128216428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a415d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24940097f0 tx=0x7f249401c3e0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a912c640 1 -- 172.21.15.45:0/128216428 shutdown_connections 2023-07-09T02:12:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a912c640 1 --2- 172.21.15.45:0/128216428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a415d150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.796+0000 7f24a912c640 1 -- 172.21.15.45:0/128216428 >> 172.21.15.45:0/128216428 conn(0x7f24a406ae60 msgr2=0x7f24a406b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 -- 172.21.15.45:0/128216428 shutdown_connections 2023-07-09T02:12:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 -- 172.21.15.45:0/128216428 wait complete. 2023-07-09T02:12:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 Processor -- start 2023-07-09T02:12:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 -- start start 2023-07-09T02:12:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a40c52a0 0x7f24a40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a40b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a415d690 0x7f24a4140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4152fd0 con 0x7f24a40c52a0 2023-07-09T02:12:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a41417c0 con 0x7f24a415d690 2023-07-09T02:12:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a912c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4141aa0 con 0x7f24a4158f50 2023-07-09T02:12:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a40c52a0 0x7f24a40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a40c52a0 0x7f24a40ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59242/0 (socket says 172.21.15.45:59242) 2023-07-09T02:12:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 -- 172.21.15.45:0/1838255350 learned_addr learned my addr 172.21.15.45:0/1838255350 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a359e640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a415d690 0x7f24a4140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f249bfff640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a40b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 -- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 msgr2=0x7f24a40b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a40b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 -- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a415d690 msgr2=0x7f24a4140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a415d690 0x7f24a4140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 -- 172.21.15.45:0/1838255350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009420 con 0x7f24a40c52a0 2023-07-09T02:12:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.800+0000 7f24a2d9d640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a40c52a0 0x7f24a40ae340 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f24940ae040 tx=0x7f249401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f249b7fe640 1 -- 172.21.15.45:0/1838255350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940abcd0 con 0x7f24a40c52a0 2023-07-09T02:12:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f249b7fe640 1 -- 172.21.15.45:0/1838255350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940abe50 con 0x7f24a40c52a0 2023-07-09T02:12:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f249b7fe640 1 -- 172.21.15.45:0/1838255350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494004260 con 0x7f24a40c52a0 2023-07-09T02:12:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a40afd80 con 0x7f24a40c52a0 2023-07-09T02:12:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40b0340 con 0x7f24a40c52a0 2023-07-09T02:12:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a40cad90 con 0x7f24a40c52a0 2023-07-09T02:12:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f249b7fe640 1 -- 172.21.15.45:0/1838255350 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24940043c0 con 0x7f24a40c52a0 2023-07-09T02:12:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f249b7fe640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2484066280 0x7f2484068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f249b7fe640 1 -- 172.21.15.45:0/1838255350 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f249411e210 con 0x7f24a40c52a0 2023-07-09T02:12:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.804+0000 7f249bfff640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2484066280 0x7f2484068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.808+0000 7f249bfff640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2484066280 0x7f2484068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f24a406f140 tx=0x7f248c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:36.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.808+0000 7f249b7fe640 1 -- 172.21.15.45:0/1838255350 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24940eb6d0 con 0x7f24a40c52a0 2023-07-09T02:12:36.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:36.968+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24a40afbe0 con 0x7f24a40c52a0 2023-07-09T02:12:37.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.872+0000 7f249b7fe640 1 -- 172.21.15.45:0/1838255350 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f24a40afbe0 con 0x7f24a40c52a0 2023-07-09T02:12:37.874 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:12:37.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2484066280 msgr2=0x7f2484068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:37.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2484066280 0x7f2484068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f24a406f140 tx=0x7f248c009040 comp rx=0 tx=0).stop 2023-07-09T02:12:37.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a40c52a0 msgr2=0x7f24a40ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:37.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a40c52a0 0x7f24a40ae340 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f24940ae040 tx=0x7f249401ac20 comp rx=0 tx=0).stop 2023-07-09T02:12:37.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 shutdown_connections 2023-07-09T02:12:37.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a415d690 0x7f24a4140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:37.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2484066280 0x7f2484068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:37.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a4158f50 0x7f24a40b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:37.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 --2- 172.21.15.45:0/1838255350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24a40c52a0 0x7f24a40ae340 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:37.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 >> 172.21.15.45:0/1838255350 conn(0x7f24a406ae60 msgr2=0x7f24a40b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:37.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 shutdown_connections 2023-07-09T02:12:37.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:37.876+0000 7f24a912c640 1 -- 172.21.15.45:0/1838255350 wait complete. 2023-07-09T02:12:37.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:12:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.052+0000 7f551d618640 1 Processor -- start 2023-07-09T02:12:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.052+0000 7f551d618640 1 -- start start 2023-07-09T02:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f551d618640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 0x7f55180cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f551d618640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55180cecd0 0x7f55180d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f551d618640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55180b4490 0x7f55180b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f551d618640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551815c850 con 0x7f55180b4490 2023-07-09T02:12:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f551d618640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55180b4e50 con 0x7f55180cecd0 2023-07-09T02:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f551d618640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55180d19c0 con 0x7f551815c480 2023-07-09T02:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55180b4490 0x7f55180b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55180b4490 0x7f55180b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59254/0 (socket says 172.21.15.45:59254) 2023-07-09T02:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 -- 172.21.15.45:0/3186841350 learned_addr learned my addr 172.21.15.45:0/3186841350 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f5516ffd640 1 --2- 172.21.15.45:0/3186841350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 0x7f55180cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f550ffff640 1 --2- 172.21.15.45:0/3186841350 >> v2:172.21.15.155:3300/0 conn(0x7f55180cecd0 0x7f55180d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 -- 172.21.15.45:0/3186841350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 msgr2=0x7f55180cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 --2- 172.21.15.45:0/3186841350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 0x7f55180cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 -- 172.21.15.45:0/3186841350 >> v2:172.21.15.155:3300/0 conn(0x7f55180cecd0 msgr2=0x7f55180d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 --2- 172.21.15.45:0/3186841350 >> v2:172.21.15.155:3300/0 conn(0x7f55180cecd0 0x7f55180d1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 -- 172.21.15.45:0/3186841350 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55180d1090 con 0x7f55180b4490 2023-07-09T02:12:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f550ffff640 1 --2- 172.21.15.45:0/3186841350 >> v2:172.21.15.155:3300/0 conn(0x7f55180cecd0 0x7f55180d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.056+0000 7f55177fe640 1 --2- 172.21.15.45:0/3186841350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b4910 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f55180d3a70 tx=0x7f551001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ccfbddaa23cc7f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f55167fc640 1 -- 172.21.15.45:0/3186841350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55100a5850 con 0x7f55180b4490 2023-07-09T02:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f55167fc640 1 -- 172.21.15.45:0/3186841350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55100a59b0 con 0x7f55180b4490 2023-07-09T02:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f55167fc640 1 -- 172.21.15.45:0/3186841350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55100a5d40 con 0x7f55180b4490 2023-07-09T02:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- 172.21.15.45:0/3186841350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 msgr2=0x7f55180b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 --2- 172.21.15.45:0/3186841350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b4910 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f55180d3a70 tx=0x7f551001c9d0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- 172.21.15.45:0/3186841350 shutdown_connections 2023-07-09T02:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 --2- 172.21.15.45:0/3186841350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b4910 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 --2- 172.21.15.45:0/3186841350 >> v2:172.21.15.155:3300/0 conn(0x7f55180cecd0 0x7f55180d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 --2- 172.21.15.45:0/3186841350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 0x7f55180cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- 172.21.15.45:0/3186841350 >> 172.21.15.45:0/3186841350 conn(0x7f55180cf490 msgr2=0x7f55180cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- 172.21.15.45:0/3186841350 shutdown_connections 2023-07-09T02:12:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- 172.21.15.45:0/3186841350 wait complete. 2023-07-09T02:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 Processor -- start 2023-07-09T02:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- start start 2023-07-09T02:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55180cecd0 0x7f55180b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 0x7f55180b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55181535b0 con 0x7f55180b4490 2023-07-09T02:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180b81b0 con 0x7f55180cecd0 2023-07-09T02:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f551d618640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55180b7910 con 0x7f551815c480 2023-07-09T02:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f5516ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f5516ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59266/0 (socket says 172.21.15.45:59266) 2023-07-09T02:12:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f5516ffd640 1 -- 172.21.15.45:0/1636312541 learned_addr learned my addr 172.21.15.45:0/1636312541 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f55177fe640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 0x7f55180b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.060+0000 7f550ffff640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55180cecd0 0x7f55180b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f5516ffd640 1 -- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 msgr2=0x7f55180b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f5516ffd640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 0x7f55180b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f5516ffd640 1 -- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55180cecd0 msgr2=0x7f55180b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f5516ffd640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55180cecd0 0x7f55180b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f5516ffd640 1 -- 172.21.15.45:0/1636312541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510009b30 con 0x7f55180b4490 2023-07-09T02:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f5516ffd640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b70c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f550800e870 tx=0x7f550800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f550f7fe640 1 -- 172.21.15.45:0/1636312541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508009510 con 0x7f55180b4490 2023-07-09T02:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f550f7fe640 1 -- 172.21.15.45:0/1636312541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550800eec0 con 0x7f55180b4490 2023-07-09T02:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f550f7fe640 1 -- 172.21.15.45:0/1636312541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800cb40 con 0x7f55180b4490 2023-07-09T02:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55180b7bf0 con 0x7f55180b4490 2023-07-09T02:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55180b7600 con 0x7f55180b4490 2023-07-09T02:12:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5518153820 con 0x7f55180b4490 2023-07-09T02:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.064+0000 7f550f7fe640 1 -- 172.21.15.45:0/1636312541 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f550800cca0 con 0x7f55180b4490 2023-07-09T02:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.068+0000 7f550f7fe640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54f8066280 0x7f54f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.068+0000 7f550f7fe640 1 -- 172.21.15.45:0/1636312541 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f5508083be0 con 0x7f55180b4490 2023-07-09T02:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.068+0000 7f550ffff640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54f8066280 0x7f54f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.068+0000 7f550ffff640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54f8066280 0x7f54f8068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f55180c6040 tx=0x7f5500008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.072+0000 7f550f7fe640 1 -- 172.21.15.45:0/1636312541 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5508051300 con 0x7f55180b4490 2023-07-09T02:12:38.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.224+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f551804d7d0 con 0x7f55180b4490 2023-07-09T02:12:38.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.884+0000 7f550f7fe640 1 -- 172.21.15.45:0/1636312541 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f55080170d0 con 0x7f55180b4490 2023-07-09T02:12:38.888 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:12:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54f8066280 msgr2=0x7f54f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54f8066280 0x7f54f8068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f55180c6040 tx=0x7f5500008040 comp rx=0 tx=0).stop 2023-07-09T02:12:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 msgr2=0x7f55180b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b70c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f550800e870 tx=0x7f550800ec70 comp rx=0 tx=0).stop 2023-07-09T02:12:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 shutdown_connections 2023-07-09T02:12:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54f8066280 0x7f54f8068730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f551815c480 0x7f55180b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55180cecd0 0x7f55180b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 --2- 172.21.15.45:0/1636312541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55180b4490 0x7f55180b70c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 >> 172.21.15.45:0/1636312541 conn(0x7f55180cf490 msgr2=0x7f5518159610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 shutdown_connections 2023-07-09T02:12:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:38.888+0000 7f551d618640 1 -- 172.21.15.45:0/1636312541 wait complete. 2023-07-09T02:12:38.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:12:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.060+0000 7f010dd37640 1 Processor -- start 2023-07-09T02:12:39.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.060+0000 7f010dd37640 1 -- start start 2023-07-09T02:12:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f010dd37640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f01080c8d10 0x7f01080c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f010dd37640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f010815db00 0x7f010815df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f010dd37640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010806bf30 con 0x7f01080ca0f0 2023-07-09T02:12:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f010dd37640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010815e480 con 0x7f010815db00 2023-07-09T02:12:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f010dd37640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010806bc50 con 0x7f01080c8d10 2023-07-09T02:12:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f0107fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f010815db00 0x7f010815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f0107fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f010815db00 0x7f010815df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59280/0 (socket says 172.21.15.45:59280) 2023-07-09T02:12:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f0107fff640 1 -- 172.21.15.45:0/321507128 learned_addr learned my addr 172.21.15.45:0/321507128 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f0107fff640 1 -- 172.21.15.45:0/321507128 >> v2:172.21.15.155:3300/0 conn(0x7f01080c8d10 msgr2=0x7f01080c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f0107fff640 1 --2- 172.21.15.45:0/321507128 >> v2:172.21.15.155:3300/0 conn(0x7f01080c8d10 0x7f01080c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f0107fff640 1 -- 172.21.15.45:0/321507128 >> v1:172.21.15.155:6789/0 conn(0x7f01080ca0f0 legacy=0x7f01080cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.064+0000 7f0107fff640 1 -- 172.21.15.45:0/321507128 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080cab90 con 0x7f010815db00 2023-07-09T02:12:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.068+0000 7f0107fff640 1 --2- 172.21.15.45:0/321507128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010815db00 0x7f010815df40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f010806ebb0 tx=0x7f010001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ce84ca9da75d92 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.068+0000 7f01067fc640 1 -- 172.21.15.45:0/321507128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000a57c0 con 0x7f010815db00 2023-07-09T02:12:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.068+0000 7f01067fc640 1 -- 172.21.15.45:0/321507128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01000a5920 con 0x7f010815db00 2023-07-09T02:12:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.068+0000 7f01067fc640 1 -- 172.21.15.45:0/321507128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000a5cb0 con 0x7f010815db00 2023-07-09T02:12:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.068+0000 7f010dd37640 1 -- 172.21.15.45:0/321507128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010815db00 msgr2=0x7f010815df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.068+0000 7f010dd37640 1 --2- 172.21.15.45:0/321507128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010815db00 0x7f010815df40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f010806ebb0 tx=0x7f010001c900 comp rx=0 tx=0).stop 2023-07-09T02:12:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 -- 172.21.15.45:0/321507128 shutdown_connections 2023-07-09T02:12:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 --2- 172.21.15.45:0/321507128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f010815db00 0x7f010815df40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 --2- 172.21.15.45:0/321507128 >> v2:172.21.15.155:3300/0 conn(0x7f01080c8d10 0x7f01080c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 -- 172.21.15.45:0/321507128 >> 172.21.15.45:0/321507128 conn(0x7f01080694b0 msgr2=0x7f01080698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:39.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 -- 172.21.15.45:0/321507128 shutdown_connections 2023-07-09T02:12:39.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 -- 172.21.15.45:0/321507128 wait complete. 2023-07-09T02:12:39.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 Processor -- start 2023-07-09T02:12:39.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 -- start start 2023-07-09T02:12:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01080c8d10 0x7f01080c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01080ca0f0 0x7f01081f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010815db00 0x7f010814e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c6290 con 0x7f01080c8d10 2023-07-09T02:12:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c6570 con 0x7f01080ca0f0 2023-07-09T02:12:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f010dd37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c6850 con 0x7f010815db00 2023-07-09T02:12:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.072+0000 7f01077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01080c8d10 0x7f01080c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f01077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01080c8d10 0x7f01080c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59288/0 (socket says 172.21.15.45:59288) 2023-07-09T02:12:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f01077fe640 1 -- 172.21.15.45:0/1565045814 learned_addr learned my addr 172.21.15.45:0/1565045814 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f0107fff640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010815db00 0x7f010814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f0106ffd640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01080ca0f0 0x7f01081f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f01077fe640 1 -- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010815db00 msgr2=0x7f010814e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f01077fe640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010815db00 0x7f010814e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f01077fe640 1 -- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01080ca0f0 msgr2=0x7f01081f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f01077fe640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01080ca0f0 0x7f01081f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f01077fe640 1 -- 172.21.15.45:0/1565045814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0100009b30 con 0x7f01080c8d10 2023-07-09T02:12:39.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f01077fe640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01080c8d10 0x7f01080c7e10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c490 tx=0x7f00f8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:39.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f00effff640 1 -- 172.21.15.45:0/1565045814 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8003600 con 0x7f01080c8d10 2023-07-09T02:12:39.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f00effff640 1 -- 172.21.15.45:0/1565045814 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8003780 con 0x7f01080c8d10 2023-07-09T02:12:39.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f00effff640 1 -- 172.21.15.45:0/1565045814 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8003b70 con 0x7f01080c8d10 2023-07-09T02:12:39.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01081f8040 con 0x7f01080c8d10 2023-07-09T02:12:39.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010814e860 con 0x7f01080c8d10 2023-07-09T02:12:39.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010804d7d0 con 0x7f01080c8d10 2023-07-09T02:12:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f00effff640 1 -- 172.21.15.45:0/1565045814 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00f8003cd0 con 0x7f01080c8d10 2023-07-09T02:12:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.076+0000 7f00effff640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00f4066280 0x7f00f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.080+0000 7f00effff640 1 -- 172.21.15.45:0/1565045814 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f00f8082cc0 con 0x7f01080c8d10 2023-07-09T02:12:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.080+0000 7f0106ffd640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00f4066280 0x7f00f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.080+0000 7f0106ffd640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00f4066280 0x7f00f4068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f00fc006fd0 tx=0x7f00fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:39.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.080+0000 7f00effff640 1 -- 172.21.15.45:0/1565045814 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00f8089080 con 0x7f01080c8d10 2023-07-09T02:12:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.240+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f01080b0a00 con 0x7f01080c8d10 2023-07-09T02:12:39.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f00effff640 1 -- 172.21.15.45:0/1565045814 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00f80170a0 con 0x7f01080c8d10 2023-07-09T02:12:39.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00f4066280 msgr2=0x7f00f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00f4066280 0x7f00f4068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f00fc006fd0 tx=0x7f00fc008040 comp rx=0 tx=0).stop 2023-07-09T02:12:39.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01080c8d10 msgr2=0x7f01080c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01080c8d10 0x7f01080c7e10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c490 tx=0x7f00f8001e80 comp rx=0 tx=0).stop 2023-07-09T02:12:39.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 shutdown_connections 2023-07-09T02:12:39.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00f4066280 0x7f00f4068730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010815db00 0x7f010814e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01080ca0f0 0x7f01081f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 --2- 172.21.15.45:0/1565045814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01080c8d10 0x7f01080c7e10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.244+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 >> 172.21.15.45:0/1565045814 conn(0x7f01080694b0 msgr2=0x7f01080c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:39.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.248+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 shutdown_connections 2023-07-09T02:12:39.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.248+0000 7f010dd37640 1 -- 172.21.15.45:0/1565045814 wait complete. 2023-07-09T02:12:39.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-07-09T02:12:39.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.408+0000 7fc44e737640 1 Processor -- start 2023-07-09T02:12:39.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.408+0000 7fc44e737640 1 -- start start 2023-07-09T02:12:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.408+0000 7fc44e737640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc44815c060 0x7fc4480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc44e737640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4480cd120 0x7fc4480d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc44e737640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc448160a50 con 0x7fc4480d2450 2023-07-09T02:12:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc44e737640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4480d28d0 con 0x7fc4480cd120 2023-07-09T02:12:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc44e737640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4480cfe40 con 0x7fc44815c060 2023-07-09T02:12:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc4477fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4480cd120 0x7fc4480d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc44ccd4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc4480d2450 0x7fc4480d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39724/0 (socket says 172.21.15.45:39724) 2023-07-09T02:12:39.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc44ccd4640 1 -- 172.21.15.45:0/3239793575 learned_addr learned my addr 172.21.15.45:0/3239793575 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc447fff640 1 --2- 172.21.15.45:0/3239793575 >> v2:172.21.15.155:3300/0 conn(0x7fc44815c060 0x7fc4480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc4477fe640 1 -- 172.21.15.45:0/3239793575 >> v2:172.21.15.155:3300/0 conn(0x7fc44815c060 msgr2=0x7fc4480b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc4477fe640 1 --2- 172.21.15.45:0/3239793575 >> v2:172.21.15.155:3300/0 conn(0x7fc44815c060 0x7fc4480b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc4477fe640 1 -- 172.21.15.45:0/3239793575 >> v1:172.21.15.45:6789/0 conn(0x7fc4480d2450 legacy=0x7fc4480d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc446ffd640 1 -- 172.21.15.45:0/3239793575 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021899124 0 0) 0x7fc448160a50 con 0x7fc4480d2450 2023-07-09T02:12:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc4477fe640 1 -- 172.21.15.45:0/3239793575 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44815c430 con 0x7fc4480cd120 2023-07-09T02:12:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc4477fe640 1 --2- 172.21.15.45:0/3239793575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480d1f10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc4480d3ad0 tx=0x7fc43c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b47bd8ff8d3950 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc446ffd640 1 -- 172.21.15.45:0/3239793575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c004230 con 0x7fc4480cd120 2023-07-09T02:12:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc446ffd640 1 -- 172.21.15.45:0/3239793575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c0a7050 con 0x7fc4480cd120 2023-07-09T02:12:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.412+0000 7fc446ffd640 1 -- 172.21.15.45:0/3239793575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c003620 con 0x7fc4480cd120 2023-07-09T02:12:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 -- 172.21.15.45:0/3239793575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 msgr2=0x7fc4480d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 --2- 172.21.15.45:0/3239793575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480d1f10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc4480d3ad0 tx=0x7fc43c01c430 comp rx=0 tx=0).stop 2023-07-09T02:12:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 -- 172.21.15.45:0/3239793575 shutdown_connections 2023-07-09T02:12:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 --2- 172.21.15.45:0/3239793575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480d1f10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 --2- 172.21.15.45:0/3239793575 >> v2:172.21.15.155:3300/0 conn(0x7fc44815c060 0x7fc4480b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 -- 172.21.15.45:0/3239793575 >> 172.21.15.45:0/3239793575 conn(0x7fc4480698e0 msgr2=0x7fc448069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:39.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 -- 172.21.15.45:0/3239793575 shutdown_connections 2023-07-09T02:12:39.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 -- 172.21.15.45:0/3239793575 wait complete. 2023-07-09T02:12:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 Processor -- start 2023-07-09T02:12:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.416+0000 7fc44e737640 1 -- start start 2023-07-09T02:12:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480d2450 0x7fc44815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc44815c060 0x7fc448156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480b2ea0 con 0x7fc4480cd120 2023-07-09T02:12:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480b3140 con 0x7fc44815c060 2023-07-09T02:12:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc448156ad0 con 0x7fc4480d2450 2023-07-09T02:12:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59310/0 (socket says 172.21.15.45:59310) 2023-07-09T02:12:39.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 -- 172.21.15.45:0/2278162885 learned_addr learned my addr 172.21.15.45:0/2278162885 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc4477fe640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480d2450 0x7fc44815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44ccd4640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc44815c060 0x7fc448156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 -- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480d2450 msgr2=0x7fc44815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480d2450 0x7fc44815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 -- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc44815c060 msgr2=0x7fc448156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc44815c060 0x7fc448156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 -- 172.21.15.45:0/2278162885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c009420 con 0x7fc4480cd120 2023-07-09T02:12:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc447fff640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480c8950 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc43800e870 tx=0x7fc43800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc444ff9640 1 -- 172.21.15.45:0/2278162885 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438009510 con 0x7fc4480cd120 2023-07-09T02:12:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc444ff9640 1 -- 172.21.15.45:0/2278162885 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43800eec0 con 0x7fc4480cd120 2023-07-09T02:12:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc444ff9640 1 -- 172.21.15.45:0/2278162885 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800cb40 con 0x7fc4480cd120 2023-07-09T02:12:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc448156d70 con 0x7fc4480cd120 2023-07-09T02:12:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc448157330 con 0x7fc4480cd120 2023-07-09T02:12:39.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc448157520 con 0x7fc4480cd120 2023-07-09T02:12:39.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.420+0000 7fc444ff9640 1 -- 172.21.15.45:0/2278162885 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc43800cca0 con 0x7fc4480cd120 2023-07-09T02:12:39.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.424+0000 7fc444ff9640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc434066280 0x7fc434068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:39.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.424+0000 7fc444ff9640 1 -- 172.21.15.45:0/2278162885 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc438083c00 con 0x7fc4480cd120 2023-07-09T02:12:39.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.424+0000 7fc4477fe640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc434066280 0x7fc434068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:39.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.424+0000 7fc4477fe640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc434066280 0x7fc434068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0ad000 tx=0x7fc43c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:39.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.428+0000 7fc444ff9640 1 -- 172.21.15.45:0/2278162885 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc438051300 con 0x7fc4480cd120 2023-07-09T02:12:39.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.636+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fc44804d7d0 con 0x7fc4480cd120 2023-07-09T02:12:39.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc444ff9640 1 -- 172.21.15.45:0/2278162885 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v100) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc4380170c0 con 0x7fc4480cd120 2023-07-09T02:12:39.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc434066280 msgr2=0x7fc434068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc434066280 0x7fc434068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0ad000 tx=0x7fc43c0a6000 comp rx=0 tx=0).stop 2023-07-09T02:12:39.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 msgr2=0x7fc4480c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:39.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480c8950 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc43800e870 tx=0x7fc43800ec70 comp rx=0 tx=0).stop 2023-07-09T02:12:39.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 shutdown_connections 2023-07-09T02:12:39.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc44815c060 0x7fc448156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc434066280 0x7fc434068730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4480d2450 0x7fc44815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 --2- 172.21.15.45:0/2278162885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4480cd120 0x7fc4480c8950 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:39.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 >> 172.21.15.45:0/2278162885 conn(0x7fc4480698e0 msgr2=0x7fc44815b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:39.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 shutdown_connections 2023-07-09T02:12:39.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:39.884+0000 7fc44e737640 1 -- 172.21.15.45:0/2278162885 wait complete. 2023-07-09T02:12:39.908 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-07-09T02:12:39.908 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-07-09T02:12:39.909 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-07-09T02:12:40.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.048+0000 7ff7fbe6d640 1 Processor -- start 2023-07-09T02:12:40.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7fbe6d640 1 -- start start 2023-07-09T02:12:40.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7fbe6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7f406a5c0 0x7ff7f415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:40.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7fbe6d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f4071140 con 0x7ff7f406aa40 2023-07-09T02:12:40.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7fbe6d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f406b010 con 0x7ff7f40cd290 2023-07-09T02:12:40.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7fbe6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f415c970 con 0x7ff7f406a5c0 2023-07-09T02:12:40.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7f9408640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7f406a5c0 0x7ff7f415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:40.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7fa40a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff7f406aa40 0x7ff7f4160310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39740/0 (socket says 172.21.15.45:39740) 2023-07-09T02:12:40.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7fa40a640 1 -- 172.21.15.45:0/999655146 learned_addr learned my addr 172.21.15.45:0/999655146 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:40.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7f9408640 1 -- 172.21.15.45:0/999655146 >> v1:172.21.15.155:6789/0 conn(0x7ff7f40cd290 legacy=0x7ff7f40cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:40.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7f9408640 1 -- 172.21.15.45:0/999655146 >> v1:172.21.15.45:6789/0 conn(0x7ff7f406aa40 legacy=0x7ff7f4160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:40.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7f9408640 1 -- 172.21.15.45:0/999655146 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f415cc50 con 0x7ff7f406a5c0 2023-07-09T02:12:40.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.052+0000 7ff7f8c07640 1 -- 172.21.15.45:0/999655146 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358859707 0 0) 0x7ff7f4071140 con 0x7ff7f406aa40 2023-07-09T02:12:40.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7f9408640 1 --2- 172.21.15.45:0/999655146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406a5c0 0x7ff7f415fdd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40097c0 tx=0x7ff7e401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a7c2cc332f7663 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7f8c07640 1 -- 172.21.15.45:0/999655146 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40ab600 con 0x7ff7f406a5c0 2023-07-09T02:12:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7f8c07640 1 -- 172.21.15.45:0/999655146 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40a7050 con 0x7ff7f406a5c0 2023-07-09T02:12:40.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7f8c07640 1 -- 172.21.15.45:0/999655146 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40ab980 con 0x7ff7f406a5c0 2023-07-09T02:12:40.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/999655146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406a5c0 msgr2=0x7ff7f415fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:40.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 --2- 172.21.15.45:0/999655146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406a5c0 0x7ff7f415fdd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40097c0 tx=0x7ff7e401c480 comp rx=0 tx=0).stop 2023-07-09T02:12:40.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/999655146 shutdown_connections 2023-07-09T02:12:40.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 --2- 172.21.15.45:0/999655146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406a5c0 0x7ff7f415fdd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:40.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/999655146 >> 172.21.15.45:0/999655146 conn(0x7ff7f406d140 msgr2=0x7ff7f406d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:40.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/999655146 shutdown_connections 2023-07-09T02:12:40.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/999655146 wait complete. 2023-07-09T02:12:40.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 Processor -- start 2023-07-09T02:12:40.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.056+0000 7ff7fbe6d640 1 -- start start 2023-07-09T02:12:40.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7f406a5c0 0x7ff7f415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:40.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406aa40 0x7ff7f414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:40.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f40cd290 0x7ff7f414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:40.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40b31f0 con 0x7ff7f406aa40 2023-07-09T02:12:40.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f414fd90 con 0x7ff7f40cd290 2023-07-09T02:12:40.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40b0a20 con 0x7ff7f406a5c0 2023-07-09T02:12:40.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406aa40 0x7ff7f414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:40.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406aa40 0x7ff7f414cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59324/0 (socket says 172.21.15.45:59324) 2023-07-09T02:12:40.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 -- 172.21.15.45:0/260274515 learned_addr learned my addr 172.21.15.45:0/260274515 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:40.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 -- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7f406a5c0 msgr2=0x7ff7f415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:40.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7f406a5c0 0x7ff7f415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:40.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 -- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f40cd290 msgr2=0x7ff7f414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:40.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f40cd290 0x7ff7f414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:40.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 -- 172.21.15.45:0/260274515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4009420 con 0x7ff7f406aa40 2023-07-09T02:12:40.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7f9408640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406aa40 0x7ff7f414cac0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff7e401a0b0 tx=0x7ff7e4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:40.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7ea7fc640 1 -- 172.21.15.45:0/260274515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4004220 con 0x7ff7f406aa40 2023-07-09T02:12:40.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7ea7fc640 1 -- 172.21.15.45:0/260274515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4004380 con 0x7ff7f406aa40 2023-07-09T02:12:40.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7ea7fc640 1 -- 172.21.15.45:0/260274515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4003820 con 0x7ff7f406aa40 2023-07-09T02:12:40.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f414d6a0 con 0x7ff7f406aa40 2023-07-09T02:12:40.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f414dc60 con 0x7ff7f406aa40 2023-07-09T02:12:40.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f414de50 con 0x7ff7f406aa40 2023-07-09T02:12:40.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.060+0000 7ff7ea7fc640 1 -- 172.21.15.45:0/260274515 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7e40b2040 con 0x7ff7f406aa40 2023-07-09T02:12:40.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.064+0000 7ff7ea7fc640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7d8066280 0x7ff7d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:40.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.064+0000 7ff7ea7fc640 1 -- 172.21.15.45:0/260274515 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff7e411da90 con 0x7ff7f406aa40 2023-07-09T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.064+0000 7ff7f9c09640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7d8066280 0x7ff7d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.064+0000 7ff7f9c09640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7d8066280 0x7ff7d8068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0000f70 tx=0x7ff7f00079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:40.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.068+0000 7ff7ea7fc640 1 -- 172.21.15.45:0/260274515 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7e40eb220 con 0x7ff7f406aa40 2023-07-09T02:12:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.276+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7ff7f404d7d0 con 0x7ff7f406aa40 2023-07-09T02:12:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.888+0000 7ff7ea7fc640 1 -- 172.21.15.45:0/260274515 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v101) v1 ==== 145+0+0 (secure 0 0 0) 0x7ff7e40b0020 con 0x7ff7f406aa40 2023-07-09T02:12:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7d8066280 msgr2=0x7ff7d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7d8066280 0x7ff7d8068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0000f70 tx=0x7ff7f00079c0 comp rx=0 tx=0).stop 2023-07-09T02:12:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406aa40 msgr2=0x7ff7f414cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406aa40 0x7ff7f414cac0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff7e401a0b0 tx=0x7ff7e4019220 comp rx=0 tx=0).stop 2023-07-09T02:12:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 shutdown_connections 2023-07-09T02:12:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7f40cd290 0x7ff7f414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7f406aa40 0x7ff7f414cac0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7d8066280 0x7ff7d8068730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 --2- 172.21.15.45:0/260274515 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7f406a5c0 0x7ff7f415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 >> 172.21.15.45:0/260274515 conn(0x7ff7f406d140 msgr2=0x7ff7f40cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 shutdown_connections 2023-07-09T02:12:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:40.892+0000 7ff7fbe6d640 1 -- 172.21.15.45:0/260274515 wait complete. 2023-07-09T02:12:40.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-07-09T02:12:41.081 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_objectstore":"memstore"} 2023-07-09T02:12:41.081 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-07-09T02:12:41.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:12:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.224+0000 7f8cf1d9f640 1 Processor -- start 2023-07-09T02:12:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.224+0000 7f8cf1d9f640 1 -- start start 2023-07-09T02:12:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8cf1d9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec15c060 0x7f8cec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8cf1d9f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cec0cd120 0x7f8cec0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8cf1d9f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8cec0d2450 0x7f8cec0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8cf1d9f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec0d28f0 con 0x7f8cec0cd120 2023-07-09T02:12:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8cf1d9f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec160a50 con 0x7f8cec0d2450 2023-07-09T02:12:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8cf1d9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec15c430 con 0x7f8cec15c060 2023-07-09T02:12:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cec0cd120 0x7f8cec0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cec0cd120 0x7f8cec0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59342/0 (socket says 172.21.15.45:59342) 2023-07-09T02:12:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceaffd640 1 -- 172.21.15.45:0/1490981065 learned_addr learned my addr 172.21.15.45:0/1490981065 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceb7fe640 1 --2- 172.21.15.45:0/1490981065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec15c060 0x7f8cec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8cebfff640 1 --2- 172.21.15.45:0/1490981065 >> v2:172.21.15.155:3300/0 conn(0x7f8cec0d2450 0x7f8cec0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceaffd640 1 -- 172.21.15.45:0/1490981065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec15c060 msgr2=0x7f8cec0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceaffd640 1 --2- 172.21.15.45:0/1490981065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec15c060 0x7f8cec0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceaffd640 1 -- 172.21.15.45:0/1490981065 >> v2:172.21.15.155:3300/0 conn(0x7f8cec0d2450 msgr2=0x7f8cec0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceaffd640 1 --2- 172.21.15.45:0/1490981065 >> v2:172.21.15.155:3300/0 conn(0x7f8cec0d2450 0x7f8cec0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceaffd640 1 -- 172.21.15.45:0/1490981065 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec15fb60 con 0x7f8cec0cd120 2023-07-09T02:12:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8ceb7fe640 1 --2- 172.21.15.45:0/1490981065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec15c060 0x7f8cec0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.228+0000 7f8cebfff640 1 --2- 172.21.15.45:0/1490981065 >> v2:172.21.15.155:3300/0 conn(0x7f8cec0d2450 0x7f8cec0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8ceaffd640 1 --2- 172.21.15.45:0/1490981065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec0cd120 0x7f8cec0d1f10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8cec06b120 tx=0x7f8ce001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33690a7e1cbc3a74 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cea7fc640 1 -- 172.21.15.45:0/1490981065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00ab600 con 0x7f8cec0cd120 2023-07-09T02:12:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cea7fc640 1 -- 172.21.15.45:0/1490981065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce00a7050 con 0x7f8cec0cd120 2023-07-09T02:12:41.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cea7fc640 1 -- 172.21.15.45:0/1490981065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00ab980 con 0x7f8cec0cd120 2023-07-09T02:12:41.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1490981065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec0cd120 msgr2=0x7f8cec0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1490981065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec0cd120 0x7f8cec0d1f10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8cec06b120 tx=0x7f8ce001c210 comp rx=0 tx=0).stop 2023-07-09T02:12:41.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1490981065 shutdown_connections 2023-07-09T02:12:41.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1490981065 >> v2:172.21.15.155:3300/0 conn(0x7f8cec0d2450 0x7f8cec0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1490981065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec0cd120 0x7f8cec0d1f10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1490981065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec15c060 0x7f8cec0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1490981065 >> 172.21.15.45:0/1490981065 conn(0x7f8cec0698e0 msgr2=0x7f8cec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1490981065 shutdown_connections 2023-07-09T02:12:41.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1490981065 wait complete. 2023-07-09T02:12:41.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 Processor -- start 2023-07-09T02:12:41.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.232+0000 7f8cf1d9f640 1 -- start start 2023-07-09T02:12:41.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cec0cd120 0x7f8cec1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec0d2450 0x7f8cec1572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec15c060 0x7f8cec14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec150350 con 0x7f8cec15c060 2023-07-09T02:12:41.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec1504b0 con 0x7f8cec0cd120 2023-07-09T02:12:41.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec150750 con 0x7f8cec0d2450 2023-07-09T02:12:41.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec15c060 0x7f8cec14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec15c060 0x7f8cec14fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59344/0 (socket says 172.21.15.45:59344) 2023-07-09T02:12:41.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 -- 172.21.15.45:0/1442977901 learned_addr learned my addr 172.21.15.45:0/1442977901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:41.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8ceb7fe640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cec0cd120 0x7f8cec1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8ceaffd640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec0d2450 0x7f8cec1572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 -- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec0d2450 msgr2=0x7f8cec1572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec0d2450 0x7f8cec1572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 -- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cec0cd120 msgr2=0x7f8cec1519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cec0cd120 0x7f8cec1519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 -- 172.21.15.45:0/1442977901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00094d0 con 0x7f8cec15c060 2023-07-09T02:12:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cebfff640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec15c060 0x7f8cec14fe10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4007e10 tx=0x7f8ce400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cd3fff640 1 -- 172.21.15.45:0/1442977901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4003ba0 con 0x7f8cec15c060 2023-07-09T02:12:41.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cd3fff640 1 -- 172.21.15.45:0/1442977901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce400f040 con 0x7f8cec15c060 2023-07-09T02:12:41.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cd3fff640 1 -- 172.21.15.45:0/1442977901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400de80 con 0x7f8cec15c060 2023-07-09T02:12:41.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec150a30 con 0x7f8cec15c060 2023-07-09T02:12:41.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec150ff0 con 0x7f8cec15c060 2023-07-09T02:12:41.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec151210 con 0x7f8cec15c060 2023-07-09T02:12:41.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.236+0000 7f8cd3fff640 1 -- 172.21.15.45:0/1442977901 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ce4004030 con 0x7f8cec15c060 2023-07-09T02:12:41.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.240+0000 7f8cd3fff640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cd8066280 0x7f8cd8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.240+0000 7f8cd3fff640 1 -- 172.21.15.45:0/1442977901 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8ce4083d70 con 0x7f8cec15c060 2023-07-09T02:12:41.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.240+0000 7f8ceb7fe640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cd8066280 0x7f8cd8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.240+0000 7f8ceb7fe640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cd8066280 0x7f8cd8068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0045f0 tx=0x7f8cdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:41.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.240+0000 7f8cd3fff640 1 -- 172.21.15.45:0/1442977901 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ce4051520 con 0x7f8cec15c060 2023-07-09T02:12:41.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.396+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8cec04d7d0 con 0x7f8cec15c060 2023-07-09T02:12:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.400+0000 7f8cd3fff640 1 -- 172.21.15.45:0/1442977901 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ce401a0c0 con 0x7f8cec15c060 2023-07-09T02:12:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cd8066280 msgr2=0x7f8cd8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cd8066280 0x7f8cd8068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0045f0 tx=0x7f8cdc008040 comp rx=0 tx=0).stop 2023-07-09T02:12:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec15c060 msgr2=0x7f8cec14fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec15c060 0x7f8cec14fe10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4007e10 tx=0x7f8ce400d4a0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 shutdown_connections 2023-07-09T02:12:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cec15c060 0x7f8cec14fe10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cd8066280 0x7f8cd8068730 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cec0d2450 0x7f8cec1572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 --2- 172.21.15.45:0/1442977901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cec0cd120 0x7f8cec1519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 >> 172.21.15.45:0/1442977901 conn(0x7f8cec0698e0 msgr2=0x7f8cec0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 shutdown_connections 2023-07-09T02:12:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.404+0000 7f8cf1d9f640 1 -- 172.21.15.45:0/1442977901 wait complete. 2023-07-09T02:12:41.424 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:12:41.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:12:41.479 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:12:41.539 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:12:41.540 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:41.541 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:41.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:12:41.550 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:12:41.551 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:41.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:12:41.560 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:41.560 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:41.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:12:41.601 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:12:41.602 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:41.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:12:41.610 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:12:41.611 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:41.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b7c0b640 1 Processor -- start 2023-07-09T02:12:41.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b7c0b640 1 -- start start 2023-07-09T02:12:41.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b7c0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b015c060 0x7ff7b00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b7c0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b00cd120 0x7ff7b00d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b7c0b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b0160a50 con 0x7ff7b00d2450 2023-07-09T02:12:41.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b7c0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b00d28f0 con 0x7ff7b00cd120 2023-07-09T02:12:41.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b7c0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00cfe40 con 0x7ff7b015c060 2023-07-09T02:12:41.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b59a7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b015c060 0x7ff7b00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b59a7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b015c060 0x7ff7b00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:37380/0 (socket says 172.21.15.45:37380) 2023-07-09T02:12:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b51a6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b00cd120 0x7ff7b00d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.784+0000 7ff7b59a7640 1 -- 172.21.15.45:0/1242189882 learned_addr learned my addr 172.21.15.45:0/1242189882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b59a7640 1 -- 172.21.15.45:0/1242189882 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00cd120 msgr2=0x7ff7b00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b59a7640 1 --2- 172.21.15.45:0/1242189882 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00cd120 0x7ff7b00d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b59a7640 1 -- 172.21.15.45:0/1242189882 >> v1:172.21.15.155:6789/0 conn(0x7ff7b00d2450 legacy=0x7ff7b00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b59a7640 1 -- 172.21.15.45:0/1242189882 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b015c430 con 0x7ff7b015c060 2023-07-09T02:12:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b49a5640 1 -- 172.21.15.45:0/1242189882 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216731270 0 0) 0x7ff7b0160a50 con 0x7ff7b00d2450 2023-07-09T02:12:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b51a6640 1 --2- 172.21.15.45:0/1242189882 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00cd120 0x7ff7b00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:41.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b59a7640 1 --2- 172.21.15.45:0/1242189882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b015c060 0x7ff7b00b4ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009870 tx=0x7ff7ac01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7042780176a13054 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b49a5640 1 -- 172.21.15.45:0/1242189882 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0a7070 con 0x7ff7b015c060 2023-07-09T02:12:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b49a5640 1 -- 172.21.15.45:0/1242189882 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0ab430 con 0x7ff7b015c060 2023-07-09T02:12:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b49a5640 1 -- 172.21.15.45:0/1242189882 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0ab7c0 con 0x7ff7b015c060 2023-07-09T02:12:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/1242189882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b015c060 msgr2=0x7ff7b00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/1242189882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b015c060 0x7ff7b00b4ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009870 tx=0x7ff7ac01c510 comp rx=0 tx=0).stop 2023-07-09T02:12:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/1242189882 shutdown_connections 2023-07-09T02:12:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/1242189882 >> v2:172.21.15.155:3300/0 conn(0x7ff7b00cd120 0x7ff7b00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/1242189882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b015c060 0x7ff7b00b4ed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.788+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/1242189882 >> 172.21.15.45:0/1242189882 conn(0x7ff7b00698e0 msgr2=0x7ff7b0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/1242189882 shutdown_connections 2023-07-09T02:12:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/1242189882 wait complete. 2023-07-09T02:12:41.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 Processor -- start 2023-07-09T02:12:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 -- start start 2023-07-09T02:12:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00cd120 0x7ff7b0153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b00d2450 0x7ff7b015e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b015c060 0x7ff7b015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b01542d0 con 0x7ff7b00d2450 2023-07-09T02:12:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b015d0e0 con 0x7ff7b015c060 2023-07-09T02:12:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b015d3c0 con 0x7ff7b00cd120 2023-07-09T02:12:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b00d2450 0x7ff7b015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b00d2450 0x7ff7b015e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56966/0 (socket says 172.21.15.45:56966) 2023-07-09T02:12:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 -- 172.21.15.45:0/3231554149 learned_addr learned my addr 172.21.15.45:0/3231554149 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b59a7640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00cd120 0x7ff7b0153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b61a8640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b015c060 0x7ff7b015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 -- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00cd120 msgr2=0x7ff7b0153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00cd120 0x7ff7b0153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 -- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b015c060 msgr2=0x7ff7b015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b015c060 0x7ff7b015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 -- 172.21.15.45:0/3231554149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0009420 con 0x7ff7b00d2450 2023-07-09T02:12:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b61a8640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b015c060 0x7ff7b015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b51a6640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b00d2450 0x7ff7b015e180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000ebb0 tx=0x7ff7a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7a67fc640 1 -- 172.21.15.45:0/3231554149 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000eeb0 con 0x7ff7b00d2450 2023-07-09T02:12:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7a67fc640 1 -- 172.21.15.45:0/3231554149 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a000cc30 con 0x7ff7b00d2450 2023-07-09T02:12:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7a67fc640 1 -- 172.21.15.45:0/3231554149 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0013470 con 0x7ff7b00d2450 2023-07-09T02:12:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.792+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac0094d0 con 0x7ff7b00d2450 2023-07-09T02:12:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.796+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b015d980 con 0x7ff7b00d2450 2023-07-09T02:12:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.796+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b004d7d0 con 0x7ff7b00d2450 2023-07-09T02:12:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.796+0000 7ff7a67fc640 1 -- 172.21.15.45:0/3231554149 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7a00135d0 con 0x7ff7b00d2450 2023-07-09T02:12:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.796+0000 7ff7a67fc640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff794066280 0x7ff794068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.796+0000 7ff7a67fc640 1 -- 172.21.15.45:0/3231554149 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff7a0083dd0 con 0x7ff7b00d2450 2023-07-09T02:12:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.796+0000 7ff7b59a7640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff794066280 0x7ff794068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.800+0000 7ff7b59a7640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff794066280 0x7ff794068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0af000 tx=0x7ff7ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.800+0000 7ff7a67fc640 1 -- 172.21.15.45:0/3231554149 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7a00514f0 con 0x7ff7b00d2450 2023-07-09T02:12:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7b006baa0 con 0x7ff7b00d2450 2023-07-09T02:12:41.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7a67fc640 1 -- 172.21.15.45:0/3231554149 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7ff7a0021090 con 0x7ff7b00d2450 2023-07-09T02:12:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3484379852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3484379852},{"type":"v1","addr":"172.21.15.155:6837","nonce":3484379852}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5053,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/3210332463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3210332463},{"type":"v1","addr":"172.21.15.45:6834","nonce":3210332463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4026010036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4026010036},{"type":"v1","addr":"172.21.15.155:6836","nonce":4026010036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/426702564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":426702564},{"type":"v1","addr":"172.21.15.45:6835","nonce":426702564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-07-09T02:12:41.991 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 18 2023-07-09T02:12:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff794066280 msgr2=0x7ff794068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff794066280 0x7ff794068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0af000 tx=0x7ff7ac008040 comp rx=0 tx=0).stop 2023-07-09T02:12:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b00d2450 msgr2=0x7ff7b015e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b00d2450 0x7ff7b015e180 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000ebb0 tx=0x7ff7a000c520 comp rx=0 tx=0).stop 2023-07-09T02:12:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 shutdown_connections 2023-07-09T02:12:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b015c060 0x7ff7b015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b00d2450 0x7ff7b015e180 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff794066280 0x7ff794068730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 --2- 172.21.15.45:0/3231554149 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7b00cd120 0x7ff7b0153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 >> 172.21.15.45:0/3231554149 conn(0x7ff7b00698e0 msgr2=0x7ff7b00b6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 shutdown_connections 2023-07-09T02:12:41.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:41.988+0000 7ff7b7c0b640 1 -- 172.21.15.45:0/3231554149 wait complete. 2023-07-09T02:12:42.012 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:12:42.012 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:12:42.013 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:12:42.013 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:12:42.013 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:12:42.013 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:12:42.013 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:12:42.014 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:12:42.014 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:12:42.014 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:12:42.015 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:12:42.015 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:12:42.015 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:12:42.015 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:12:42.015 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:12:42.016 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:12:42.027 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:12:42.028 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:12:42.030 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:12:42.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:12:42.032 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:12:42.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:12:42.034 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:12:42.034 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:12:42.072 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:12:42.072 DEBUG:teuthology.parallel:result is None 2023-07-09T02:12:42.073 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:12:42.074 DEBUG:teuthology.parallel:result is None 2023-07-09T02:12:42.083 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:12:42.084 DEBUG:teuthology.parallel:result is None 2023-07-09T02:12:42.085 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:12:42.086 DEBUG:teuthology.parallel:result is None 2023-07-09T02:12:42.086 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:12:42.162 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:12:42.163 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:12:42.175 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:12:42.176 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:12:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54c70ec640 1 Processor -- start 2023-07-09T02:12:42.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54c70ec640 1 -- start start 2023-07-09T02:12:42.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54c70ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54c00d2620 0x7f54c00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:42.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54c70ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f54c00cd120 0x7f54c00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:42.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54c70ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c0160a50 con 0x7f54c015c060 2023-07-09T02:12:42.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54c70ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c015c430 con 0x7f54c00d2620 2023-07-09T02:12:42.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54c70ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c015fb60 con 0x7f54c00cd120 2023-07-09T02:12:42.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54bffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54c00d2620 0x7f54c00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:42.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54bffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54c00d2620 0x7f54c00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57000/0 (socket says 172.21.15.45:57000) 2023-07-09T02:12:42.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54bffff640 1 -- 172.21.15.45:0/3040051813 learned_addr learned my addr 172.21.15.45:0/3040051813 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:42.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.232+0000 7f54c5689640 1 --2- 172.21.15.45:0/3040051813 >> v2:172.21.15.155:3300/0 conn(0x7f54c00cd120 0x7f54c00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:42.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bffff640 1 -- 172.21.15.45:0/3040051813 >> v2:172.21.15.155:3300/0 conn(0x7f54c00cd120 msgr2=0x7f54c00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:42.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bffff640 1 --2- 172.21.15.45:0/3040051813 >> v2:172.21.15.155:3300/0 conn(0x7f54c00cd120 0x7f54c00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bffff640 1 -- 172.21.15.45:0/3040051813 >> v1:172.21.15.155:6789/0 conn(0x7f54c015c060 legacy=0x7f54c00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:42.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bffff640 1 -- 172.21.15.45:0/3040051813 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c015fe40 con 0x7f54c00d2620 2023-07-09T02:12:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bf7fe640 1 -- 172.21.15.45:0/3040051813 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808531804 0 0) 0x7f54c0160a50 con 0x7f54c015c060 2023-07-09T02:12:42.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54c5689640 1 --2- 172.21.15.45:0/3040051813 >> v2:172.21.15.155:3300/0 conn(0x7f54c00cd120 0x7f54c00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:42.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bffff640 1 --2- 172.21.15.45:0/3040051813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00d2620 0x7f54c00b4ed0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f54c006b120 tx=0x7f54ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2f4cc137f5a343 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:42.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bf7fe640 1 -- 172.21.15.45:0/3040051813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0aa430 con 0x7f54c00d2620 2023-07-09T02:12:42.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bf7fe640 1 -- 172.21.15.45:0/3040051813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac0aa590 con 0x7f54c00d2620 2023-07-09T02:12:42.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.236+0000 7f54bf7fe640 1 -- 172.21.15.45:0/3040051813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0aa920 con 0x7f54c00d2620 2023-07-09T02:12:42.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- 172.21.15.45:0/3040051813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00d2620 msgr2=0x7f54c00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:42.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 --2- 172.21.15.45:0/3040051813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00d2620 0x7f54c00b4ed0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f54c006b120 tx=0x7f54ac01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- 172.21.15.45:0/3040051813 shutdown_connections 2023-07-09T02:12:42.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 --2- 172.21.15.45:0/3040051813 >> v2:172.21.15.155:3300/0 conn(0x7f54c00cd120 0x7f54c00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 --2- 172.21.15.45:0/3040051813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00d2620 0x7f54c00b4ed0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- 172.21.15.45:0/3040051813 >> 172.21.15.45:0/3040051813 conn(0x7f54c00698e0 msgr2=0x7f54c0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:42.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- 172.21.15.45:0/3040051813 shutdown_connections 2023-07-09T02:12:42.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- 172.21.15.45:0/3040051813 wait complete. 2023-07-09T02:12:42.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 Processor -- start 2023-07-09T02:12:42.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- start start 2023-07-09T02:12:42.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00cd120 0x7f54c00c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:42.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54c00d2620 0x7f54c00c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:42.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c015c060 0x7f54c015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:42.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00ca330 con 0x7f54c00cd120 2023-07-09T02:12:42.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c015d340 con 0x7f54c015c060 2023-07-09T02:12:42.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c70ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c00c8e90 con 0x7f54c00d2620 2023-07-09T02:12:42.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c4e88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00cd120 0x7f54c00c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:42.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c4e88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00cd120 0x7f54c00c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57012/0 (socket says 172.21.15.45:57012) 2023-07-09T02:12:42.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c4e88640 1 -- 172.21.15.45:0/2400517289 learned_addr learned my addr 172.21.15.45:0/2400517289 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:42.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c5689640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c015c060 0x7f54c015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:42.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54bffff640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54c00d2620 0x7f54c00c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:42.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c4e88640 1 -- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54c00d2620 msgr2=0x7f54c00c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:42.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c4e88640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54c00d2620 0x7f54c00c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c4e88640 1 -- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c015c060 msgr2=0x7f54c015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:42.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c4e88640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c015c060 0x7f54c015a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.240+0000 7f54c4e88640 1 -- 172.21.15.45:0/2400517289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b8009a70 con 0x7f54c00cd120 2023-07-09T02:12:42.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54c4e88640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00cd120 0x7f54c00c9df0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f54b4001ec0 tx=0x7f54b400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:42.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54bd7fa640 1 -- 172.21.15.45:0/2400517289 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40054e0 con 0x7f54c00cd120 2023-07-09T02:12:42.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54bd7fa640 1 -- 172.21.15.45:0/2400517289 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b4003600 con 0x7f54c00cd120 2023-07-09T02:12:42.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac0094d0 con 0x7f54c00cd120 2023-07-09T02:12:42.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54bd7fa640 1 -- 172.21.15.45:0/2400517289 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40039b0 con 0x7f54c00cd120 2023-07-09T02:12:42.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c00b59f0 con 0x7f54c00cd120 2023-07-09T02:12:42.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c004d7d0 con 0x7f54c00cd120 2023-07-09T02:12:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54bd7fa640 1 -- 172.21.15.45:0/2400517289 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54b4003b10 con 0x7f54c00cd120 2023-07-09T02:12:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54bd7fa640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54a40662b0 0x7f54a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54bd7fa640 1 -- 172.21.15.45:0/2400517289 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f54b4082ec0 con 0x7f54c00cd120 2023-07-09T02:12:42.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.244+0000 7f54bffff640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54a40662b0 0x7f54a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:42.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.248+0000 7f54bffff640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54a40662b0 0x7f54a4068760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0ae000 tx=0x7f54ac0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.248+0000 7f54bd7fa640 1 -- 172.21.15.45:0/2400517289 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54b4050700 con 0x7f54c00cd120 2023-07-09T02:12:42.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.412+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54c00ccf00 con 0x7f54c00cd120 2023-07-09T02:12:42.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.904+0000 7f54bd7fa640 1 -- 172.21.15.45:0/2400517289 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54b4017080 con 0x7f54c00cd120 2023-07-09T02:12:42.910 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:12:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54a40662b0 msgr2=0x7f54a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54a40662b0 0x7f54a4068760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0ae000 tx=0x7f54ac0b5040 comp rx=0 tx=0).stop 2023-07-09T02:12:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00cd120 msgr2=0x7f54c00c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00cd120 0x7f54c00c9df0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f54b4001ec0 tx=0x7f54b400c820 comp rx=0 tx=0).stop 2023-07-09T02:12:42.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 shutdown_connections 2023-07-09T02:12:42.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c015c060 0x7f54c015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54a40662b0 0x7f54a4068760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54c00d2620 0x7f54c00c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 --2- 172.21.15.45:0/2400517289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c00cd120 0x7f54c00c9df0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:42.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 >> 172.21.15.45:0/2400517289 conn(0x7f54c00698e0 msgr2=0x7f54c0158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:42.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 shutdown_connections 2023-07-09T02:12:42.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:42.908+0000 7f54c70ec640 1 -- 172.21.15.45:0/2400517289 wait complete. 2023-07-09T02:12:42.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:12:43.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf9411e640 1 Processor -- start 2023-07-09T02:12:43.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf9411e640 1 -- start start 2023-07-09T02:12:43.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf9411e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf8c0c8d10 0x7fcf8c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf9411e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8c06bf30 con 0x7fcf8c0ca0f0 2023-07-09T02:12:43.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf9411e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8c06bc50 con 0x7fcf8c15db00 2023-07-09T02:12:43.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf9411e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8c0cab90 con 0x7fcf8c0c8d10 2023-07-09T02:12:43.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf91eba640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcf8c0ca0f0 0x7fcf8c0cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46410/0 (socket says 172.21.15.45:46410) 2023-07-09T02:12:43.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf91eba640 1 -- 172.21.15.45:0/2365507516 learned_addr learned my addr 172.21.15.45:0/2365507516 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:43.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf916b9640 1 --2- 172.21.15.45:0/2365507516 >> v2:172.21.15.45:3300/0 conn(0x7fcf8c0c8d10 0x7fcf8c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf90eb8640 1 -- 172.21.15.45:0/2365507516 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970206034 0 0) 0x7fcf8c06bf30 con 0x7fcf8c0ca0f0 2023-07-09T02:12:43.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf90eb8640 1 -- 172.21.15.45:0/2365507516 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf78003530 con 0x7fcf8c0ca0f0 2023-07-09T02:12:43.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf916b9640 1 -- 172.21.15.45:0/2365507516 >> v1:172.21.15.155:6789/0 conn(0x7fcf8c15db00 legacy=0x7fcf8c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf90eb8640 1 -- 172.21.15.45:0/2365507516 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382058326 0 0) 0x7fcf8c06bc50 con 0x7fcf8c15db00 2023-07-09T02:12:43.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf916b9640 1 -- 172.21.15.45:0/2365507516 >> v1:172.21.15.45:6789/0 conn(0x7fcf8c0ca0f0 legacy=0x7fcf8c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.076+0000 7fcf916b9640 1 -- 172.21.15.45:0/2365507516 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c0cae70 con 0x7fcf8c0c8d10 2023-07-09T02:12:43.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf916b9640 1 --2- 172.21.15.45:0/2365507516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c0c8d10 0x7fcf8c0c9160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0097c0 tx=0x7fcf7c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c843f7812b4fec33 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf90eb8640 1 -- 172.21.15.45:0/2365507516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0ab610 con 0x7fcf8c0c8d10 2023-07-09T02:12:43.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf90eb8640 1 -- 172.21.15.45:0/2365507516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c0ab770 con 0x7fcf8c0c8d10 2023-07-09T02:12:43.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf90eb8640 1 -- 172.21.15.45:0/2365507516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0abae0 con 0x7fcf8c0c8d10 2023-07-09T02:12:43.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf9411e640 1 -- 172.21.15.45:0/2365507516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c0c8d10 msgr2=0x7fcf8c0c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf9411e640 1 --2- 172.21.15.45:0/2365507516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c0c8d10 0x7fcf8c0c9160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0097c0 tx=0x7fcf7c01c3f0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf9411e640 1 -- 172.21.15.45:0/2365507516 shutdown_connections 2023-07-09T02:12:43.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf9411e640 1 --2- 172.21.15.45:0/2365507516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c0c8d10 0x7fcf8c0c9160 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf9411e640 1 -- 172.21.15.45:0/2365507516 >> 172.21.15.45:0/2365507516 conn(0x7fcf8c0694b0 msgr2=0x7fcf8c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:43.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf9411e640 1 -- 172.21.15.45:0/2365507516 shutdown_connections 2023-07-09T02:12:43.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.080+0000 7fcf9411e640 1 -- 172.21.15.45:0/2365507516 wait complete. 2023-07-09T02:12:43.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 Processor -- start 2023-07-09T02:12:43.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 -- start start 2023-07-09T02:12:43.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf8c0c8d10 0x7fcf8c149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0ca0f0 0x7fcf8c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c15db00 0x7fcf8c149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c15c2e0 con 0x7fcf8c15db00 2023-07-09T02:12:43.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c15b6d0 con 0x7fcf8c0ca0f0 2023-07-09T02:12:43.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c15b9b0 con 0x7fcf8c0c8d10 2023-07-09T02:12:43.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c15db00 0x7fcf8c149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c15db00 0x7fcf8c149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57042/0 (socket says 172.21.15.45:57042) 2023-07-09T02:12:43.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf91eba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf8c0c8d10 0x7fcf8c149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 -- 172.21.15.45:0/2728897835 learned_addr learned my addr 172.21.15.45:0/2728897835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:43.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf916b9640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0ca0f0 0x7fcf8c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 -- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf8c0c8d10 msgr2=0x7fcf8c149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf8c0c8d10 0x7fcf8c149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 -- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0ca0f0 msgr2=0x7fcf8c14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0ca0f0 0x7fcf8c14bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 -- 172.21.15.45:0/2728897835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c009420 con 0x7fcf8c15db00 2023-07-09T02:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf926bb640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c15db00 0x7fcf8c149410 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c780 tx=0x7fcf8400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf827fc640 1 -- 172.21.15.45:0/2728897835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84003db0 con 0x7fcf8c15db00 2023-07-09T02:12:43.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf827fc640 1 -- 172.21.15.45:0/2728897835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8400ce30 con 0x7fcf8c15db00 2023-07-09T02:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c15bc90 con 0x7fcf8c15db00 2023-07-09T02:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf827fc640 1 -- 172.21.15.45:0/2728897835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840052b0 con 0x7fcf8c15db00 2023-07-09T02:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c14a430 con 0x7fcf8c15db00 2023-07-09T02:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.084+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c04d7d0 con 0x7fcf8c15db00 2023-07-09T02:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.088+0000 7fcf827fc640 1 -- 172.21.15.45:0/2728897835 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf84005410 con 0x7fcf8c15db00 2023-07-09T02:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.088+0000 7fcf827fc640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcf70066280 0x7fcf70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.088+0000 7fcf827fc640 1 -- 172.21.15.45:0/2728897835 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf840836b0 con 0x7fcf8c15db00 2023-07-09T02:12:43.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.088+0000 7fcf91eba640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcf70066280 0x7fcf70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.088+0000 7fcf91eba640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcf70066280 0x7fcf70068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf88007fd0 tx=0x7fcf88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.092+0000 7fcf827fc640 1 -- 172.21.15.45:0/2728897835 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf84050f10 con 0x7fcf8c15db00 2023-07-09T02:12:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcf8c15c420 con 0x7fcf8c15db00 2023-07-09T02:12:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf827fc640 1 -- 172.21.15.45:0/2728897835 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcf84054530 con 0x7fcf8c15db00 2023-07-09T02:12:43.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:43.303 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:12:43.304 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:12:43.304 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.304 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:12:43.305 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:12:43.305 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.305 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:43.305 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:43.306 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:43.306 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.306 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.307 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.307 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.307 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:12:43.307 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:12:43.307 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.307 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:43.308 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:43.308 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:43.308 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.308 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.308 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.308 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.309 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:12:43.309 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:12:43.309 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.309 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:43.309 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:43.309 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:43.310 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.310 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.310 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.310 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.310 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:12:43.310 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:12:43.310 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.310 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:43.311 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:43.311 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:43.311 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.311 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.311 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.311 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:12:43.312 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:12:43.312 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.312 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:43.312 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:43.312 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.312 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.313 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.313 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:12:43.313 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:12:43.313 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.313 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:43.313 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:43.313 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.314 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.314 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.314 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.314 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:12:43.314 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:12:43.314 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.315 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:43.315 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:43.316 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.316 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.316 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.316 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:12:43.317 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:12:43.317 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.317 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:43.317 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:43.317 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.317 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.318 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.318 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:12:43.318 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:12:43.318 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.318 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:43.318 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:43.318 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.319 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.319 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.319 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:12:43.319 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:12:43.319 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.319 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:43.320 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:43.320 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.320 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.320 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.320 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.321 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:12:43.321 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:12:43.321 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.321 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:43.321 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:43.322 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.322 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.322 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.322 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:12:43.322 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:12:43.323 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.323 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:12:43.323 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:12:43.323 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.323 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.324 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.324 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:12:43.324 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:12:43.324 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.324 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:43.324 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:12:43.324 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:12:43.325 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.325 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.325 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:12:43.325 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:12:43.326 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.326 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:12:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:12:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:12:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:12:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:12:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:12:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:12:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:12:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:12:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:12:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:12:43.330 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:12:43.330 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:12:43.330 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:12:43.330 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.330 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.330 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.330 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:12:43.331 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:12:43.331 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.331 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:12:43.331 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:12:43.331 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:12:43.331 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.331 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.332 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.332 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.332 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:12:43.332 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:12:43.332 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.332 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:12:43.332 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:12:43.333 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.333 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:43.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:43.333 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:12:43.333 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:12:43.333 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:12:43.334 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:12:43.334 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:12:43.334 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:12:43.334 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.334 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:43.334 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:12:43.334 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:12:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcf70066280 msgr2=0x7fcf70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcf70066280 0x7fcf70068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf88007fd0 tx=0x7fcf88009040 comp rx=0 tx=0).stop 2023-07-09T02:12:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c15db00 msgr2=0x7fcf8c149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c15db00 0x7fcf8c149410 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c780 tx=0x7fcf8400cc40 comp rx=0 tx=0).stop 2023-07-09T02:12:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 shutdown_connections 2023-07-09T02:12:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c15db00 0x7fcf8c149410 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf8c0ca0f0 0x7fcf8c14bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcf70066280 0x7fcf70068730 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 --2- 172.21.15.45:0/2728897835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf8c0c8d10 0x7fcf8c149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 >> 172.21.15.45:0/2728897835 conn(0x7fcf8c0694b0 msgr2=0x7fcf8c069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 shutdown_connections 2023-07-09T02:12:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.300+0000 7fcf9411e640 1 -- 172.21.15.45:0/2728897835 wait complete. 2023-07-09T02:12:43.339 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:43.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f7434640 1 Processor -- start 2023-07-09T02:12:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f7434640 1 -- start start 2023-07-09T02:12:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f7434640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1f00d2620 0x7fd1f00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f7434640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cd120 0x7fd1f00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f7434640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f0160a50 con 0x7fd1f015c060 2023-07-09T02:12:43.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f7434640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f015c430 con 0x7fd1f00d2620 2023-07-09T02:12:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f7434640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f015fb60 con 0x7fd1f00cd120 2023-07-09T02:12:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f49cf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1f00d2620 0x7fd1f00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f51d0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd1f015c060 0x7fd1f00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46420/0 (socket says 172.21.15.45:46420) 2023-07-09T02:12:43.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f51d0640 1 -- 172.21.15.45:0/3734933700 learned_addr learned my addr 172.21.15.45:0/3734933700 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f59d1640 1 --2- 172.21.15.45:0/3734933700 >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cd120 0x7fd1f00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f49cf640 1 -- 172.21.15.45:0/3734933700 >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cd120 msgr2=0x7fd1f00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f49cf640 1 --2- 172.21.15.45:0/3734933700 >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cd120 0x7fd1f00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f49cf640 1 -- 172.21.15.45:0/3734933700 >> v1:172.21.15.45:6789/0 conn(0x7fd1f015c060 legacy=0x7fd1f00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1f49cf640 1 -- 172.21.15.45:0/3734933700 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f015fe40 con 0x7fd1f00d2620 2023-07-09T02:12:43.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.480+0000 7fd1e7fff640 1 -- 172.21.15.45:0/3734933700 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099988799 0 0) 0x7fd1f0160a50 con 0x7fd1f015c060 2023-07-09T02:12:43.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f49cf640 1 --2- 172.21.15.45:0/3734933700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00d2620 0x7fd1f00b4ed0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd1f006b120 tx=0x7fd1e001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258be544f0c33ec2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1e7fff640 1 -- 172.21.15.45:0/3734933700 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00a7070 con 0x7fd1f00d2620 2023-07-09T02:12:43.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1e7fff640 1 -- 172.21.15.45:0/3734933700 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e00ab430 con 0x7fd1f00d2620 2023-07-09T02:12:43.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1e7fff640 1 -- 172.21.15.45:0/3734933700 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00ab7c0 con 0x7fd1f00d2620 2023-07-09T02:12:43.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f7434640 1 -- 172.21.15.45:0/3734933700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00d2620 msgr2=0x7fd1f00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f7434640 1 --2- 172.21.15.45:0/3734933700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00d2620 0x7fd1f00b4ed0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd1f006b120 tx=0x7fd1e001c430 comp rx=0 tx=0).stop 2023-07-09T02:12:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f7434640 1 -- 172.21.15.45:0/3734933700 shutdown_connections 2023-07-09T02:12:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f7434640 1 --2- 172.21.15.45:0/3734933700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00d2620 0x7fd1f00b4ed0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f7434640 1 --2- 172.21.15.45:0/3734933700 >> v2:172.21.15.155:3300/0 conn(0x7fd1f00cd120 0x7fd1f00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f7434640 1 -- 172.21.15.45:0/3734933700 >> 172.21.15.45:0/3734933700 conn(0x7fd1f00698e0 msgr2=0x7fd1f0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f7434640 1 -- 172.21.15.45:0/3734933700 shutdown_connections 2023-07-09T02:12:43.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.484+0000 7fd1f7434640 1 -- 172.21.15.45:0/3734933700 wait complete. 2023-07-09T02:12:43.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 Processor -- start 2023-07-09T02:12:43.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 -- start start 2023-07-09T02:12:43.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00cd120 0x7fd1f0154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00d2620 0x7fd1f0156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f015c060 0x7fd1f0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01550e0 con 0x7fd1f00cd120 2023-07-09T02:12:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00cb1e0 con 0x7fd1f015c060 2023-07-09T02:12:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00cb4c0 con 0x7fd1f00d2620 2023-07-09T02:12:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00cd120 0x7fd1f0154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00cd120 0x7fd1f0154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57060/0 (socket says 172.21.15.45:57060) 2023-07-09T02:12:43.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 -- 172.21.15.45:0/1451489392 learned_addr learned my addr 172.21.15.45:0/1451489392 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:43.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f49cf640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00d2620 0x7fd1f0156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 -- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00d2620 msgr2=0x7fd1f0156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00d2620 0x7fd1f0156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 -- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f015c060 msgr2=0x7fd1f0156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f015c060 0x7fd1f0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 -- 172.21.15.45:0/1451489392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0009420 con 0x7fd1f00cd120 2023-07-09T02:12:43.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f51d0640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00cd120 0x7fd1f0154ba0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00c480 tx=0x7fd1ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1e5ffb640 1 -- 172.21.15.45:0/1451489392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec0074e0 con 0x7fd1f00cd120 2023-07-09T02:12:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1e5ffb640 1 -- 172.21.15.45:0/1451489392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec007660 con 0x7fd1f00cd120 2023-07-09T02:12:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1e5ffb640 1 -- 172.21.15.45:0/1451489392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec004a30 con 0x7fd1f00cd120 2023-07-09T02:12:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f00b59f0 con 0x7fd1f00cd120 2023-07-09T02:12:43.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.488+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f00cba80 con 0x7fd1f00cd120 2023-07-09T02:12:43.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.492+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f004d7d0 con 0x7fd1f00cd120 2023-07-09T02:12:43.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.492+0000 7fd1e5ffb640 1 -- 172.21.15.45:0/1451489392 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1ec004b90 con 0x7fd1f00cd120 2023-07-09T02:12:43.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.492+0000 7fd1e5ffb640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1d4066280 0x7fd1d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.492+0000 7fd1e5ffb640 1 -- 172.21.15.45:0/1451489392 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd1ec082b60 con 0x7fd1f00cd120 2023-07-09T02:12:43.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.492+0000 7fd1f49cf640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1d4066280 0x7fd1d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.492+0000 7fd1f49cf640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1d4066280 0x7fd1d4068730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00af000 tx=0x7fd1e00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.496+0000 7fd1e5ffb640 1 -- 172.21.15.45:0/1451489392 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1ec053e60 con 0x7fd1f00cd120 2023-07-09T02:12:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.656+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1f006baa0 con 0x7fd1f00cd120 2023-07-09T02:12:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.656+0000 7fd1e5ffb640 1 -- 172.21.15.45:0/1451489392 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+14639 (secure 0 0 0) 0x7fd1ec018020 con 0x7fd1f00cd120 2023-07-09T02:12:43.659 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:43.659 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:42.914900+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.656+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1d4066280 msgr2=0x7fd1d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.656+0000 7fd1f7434640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1d4066280 0x7fd1d4068730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00af000 tx=0x7fd1e00a7000 comp rx=0 tx=0).stop 2023-07-09T02:12:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.656+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00cd120 msgr2=0x7fd1f0154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.656+0000 7fd1f7434640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00cd120 0x7fd1f0154ba0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00c480 tx=0x7fd1ec00c940 comp rx=0 tx=0).stop 2023-07-09T02:12:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.660+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 shutdown_connections 2023-07-09T02:12:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.660+0000 7fd1f7434640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1f015c060 0x7fd1f0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.660+0000 7fd1f7434640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1d4066280 0x7fd1d4068730 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.660+0000 7fd1f7434640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1f00d2620 0x7fd1f0156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.660+0000 7fd1f7434640 1 --2- 172.21.15.45:0/1451489392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1f00cd120 0x7fd1f0154ba0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.660+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 >> 172.21.15.45:0/1451489392 conn(0x7fd1f00698e0 msgr2=0x7fd1f00b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.660+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 shutdown_connections 2023-07-09T02:12:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.660+0000 7fd1f7434640 1 -- 172.21.15.45:0/1451489392 wait complete. 2023-07-09T02:12:43.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:12:43.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:12:43.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa964dd2640 1 Processor -- start 2023-07-09T02:12:43.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa964dd2640 1 -- start start 2023-07-09T02:12:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa964dd2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa96015c060 0x7fa9600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa964dd2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9600cd120 0x7fa9600d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa964dd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600d2450 0x7fa9600d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa964dd2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600d28f0 con 0x7fa96015c060 2023-07-09T02:12:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa964dd2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa960160a50 con 0x7fa9600cd120 2023-07-09T02:12:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa964dd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96015c430 con 0x7fa9600d2450 2023-07-09T02:12:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa96015c060 0x7fa9600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa96015c060 0x7fa9600b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57068/0 (socket says 172.21.15.45:57068) 2023-07-09T02:12:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95e59c640 1 -- 172.21.15.45:0/4000719915 learned_addr learned my addr 172.21.15.45:0/4000719915 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa957fff640 1 --2- 172.21.15.45:0/4000719915 >> v2:172.21.15.155:3300/0 conn(0x7fa9600cd120 0x7fa9600d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95ed9d640 1 --2- 172.21.15.45:0/4000719915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600d2450 0x7fa9600d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95e59c640 1 -- 172.21.15.45:0/4000719915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600d2450 msgr2=0x7fa9600d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95e59c640 1 --2- 172.21.15.45:0/4000719915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600d2450 0x7fa9600d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95e59c640 1 -- 172.21.15.45:0/4000719915 >> v2:172.21.15.155:3300/0 conn(0x7fa9600cd120 msgr2=0x7fa9600d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95e59c640 1 --2- 172.21.15.45:0/4000719915 >> v2:172.21.15.155:3300/0 conn(0x7fa9600cd120 0x7fa9600d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95e59c640 1 -- 172.21.15.45:0/4000719915 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96015fb60 con 0x7fa96015c060 2023-07-09T02:12:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.824+0000 7fa95ed9d640 1 --2- 172.21.15.45:0/4000719915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600d2450 0x7fa9600d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa95e59c640 1 --2- 172.21.15.45:0/4000719915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96015c060 0x7fa9600b4ed0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa96015fac0 tx=0x7fa95001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa999d5f6bf2184a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa95dd9b640 1 -- 172.21.15.45:0/4000719915 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500ab600 con 0x7fa96015c060 2023-07-09T02:12:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa95dd9b640 1 -- 172.21.15.45:0/4000719915 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9500a7050 con 0x7fa96015c060 2023-07-09T02:12:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa95dd9b640 1 -- 172.21.15.45:0/4000719915 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500ab980 con 0x7fa96015c060 2023-07-09T02:12:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 -- 172.21.15.45:0/4000719915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96015c060 msgr2=0x7fa9600b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 --2- 172.21.15.45:0/4000719915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96015c060 0x7fa9600b4ed0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa96015fac0 tx=0x7fa95001c210 comp rx=0 tx=0).stop 2023-07-09T02:12:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 -- 172.21.15.45:0/4000719915 shutdown_connections 2023-07-09T02:12:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 --2- 172.21.15.45:0/4000719915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600d2450 0x7fa9600d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 --2- 172.21.15.45:0/4000719915 >> v2:172.21.15.155:3300/0 conn(0x7fa9600cd120 0x7fa9600d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 --2- 172.21.15.45:0/4000719915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96015c060 0x7fa9600b4ed0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 -- 172.21.15.45:0/4000719915 >> 172.21.15.45:0/4000719915 conn(0x7fa9600698e0 msgr2=0x7fa960069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:43.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 -- 172.21.15.45:0/4000719915 shutdown_connections 2023-07-09T02:12:43.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.828+0000 7fa964dd2640 1 -- 172.21.15.45:0/4000719915 wait complete. 2023-07-09T02:12:43.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 Processor -- start 2023-07-09T02:12:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 -- start start 2023-07-09T02:12:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600cd120 0x7fa96014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9600d2450 0x7fa960150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa96015c060 0x7fa960159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa960159c20 con 0x7fa9600d2450 2023-07-09T02:12:43.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa960159f00 con 0x7fa96015c060 2023-07-09T02:12:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960150420 con 0x7fa9600cd120 2023-07-09T02:12:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9600d2450 0x7fa960150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9600d2450 0x7fa960150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57072/0 (socket says 172.21.15.45:57072) 2023-07-09T02:12:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 -- 172.21.15.45:0/2258253258 learned_addr learned my addr 172.21.15.45:0/2258253258 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa95ed9d640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa96015c060 0x7fa960159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa95e59c640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600cd120 0x7fa96014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 -- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600cd120 msgr2=0x7fa96014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600cd120 0x7fa96014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 -- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa96015c060 msgr2=0x7fa960159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa96015c060 0x7fa960159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:43.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 -- 172.21.15.45:0/2258253258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500094d0 con 0x7fa9600d2450 2023-07-09T02:12:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa957fff640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9600d2450 0x7fa960150f00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa948009fd0 tx=0x7fa94800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa956ffd640 1 -- 172.21.15.45:0/2258253258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800c940 con 0x7fa9600d2450 2023-07-09T02:12:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa956ffd640 1 -- 172.21.15.45:0/2258253258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94800caa0 con 0x7fa9600d2450 2023-07-09T02:12:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa956ffd640 1 -- 172.21.15.45:0/2258253258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800ce30 con 0x7fa9600d2450 2023-07-09T02:12:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.832+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa960150700 con 0x7fa9600d2450 2023-07-09T02:12:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.836+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa960151ae0 con 0x7fa9600d2450 2023-07-09T02:12:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.836+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96004d7d0 con 0x7fa9600d2450 2023-07-09T02:12:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.836+0000 7fa956ffd640 1 -- 172.21.15.45:0/2258253258 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa948013470 con 0x7fa9600d2450 2023-07-09T02:12:43.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.836+0000 7fa956ffd640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9400662b0 0x7fa940068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:43.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.836+0000 7fa956ffd640 1 -- 172.21.15.45:0/2258253258 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa9480838c0 con 0x7fa9600d2450 2023-07-09T02:12:43.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.836+0000 7fa95e59c640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9400662b0 0x7fa940068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:43.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.836+0000 7fa95e59c640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9400662b0 0x7fa940068760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa9500ad000 tx=0x7fa9500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:43.840+0000 7fa956ffd640 1 -- 172.21.15.45:0/2258253258 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa948050ff0 con 0x7fa9600d2450 2023-07-09T02:12:44.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.000+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa96006baa0 con 0x7fa9600d2450 2023-07-09T02:12:44.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.000+0000 7fa956ffd640 1 -- 172.21.15.45:0/2258253258 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa948021020 con 0x7fa9600d2450 2023-07-09T02:12:44.003 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:12:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9400662b0 msgr2=0x7fa940068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9400662b0 0x7fa940068760 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa9500ad000 tx=0x7fa9500a6000 comp rx=0 tx=0).stop 2023-07-09T02:12:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9600d2450 msgr2=0x7fa960150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9600d2450 0x7fa960150f00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa948009fd0 tx=0x7fa94800ed40 comp rx=0 tx=0).stop 2023-07-09T02:12:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 shutdown_connections 2023-07-09T02:12:44.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa96015c060 0x7fa960159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9600d2450 0x7fa960150f00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9400662b0 0x7fa940068760 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 --2- 172.21.15.45:0/2258253258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9600cd120 0x7fa96014fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 >> 172.21.15.45:0/2258253258 conn(0x7fa9600698e0 msgr2=0x7fa9600b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 shutdown_connections 2023-07-09T02:12:44.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.004+0000 7fa964dd2640 1 -- 172.21.15.45:0/2258253258 wait complete. 2023-07-09T02:12:44.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:12:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.168+0000 7fefafa7b640 1 Processor -- start 2023-07-09T02:12:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.168+0000 7fefafa7b640 1 -- start start 2023-07-09T02:12:44.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.168+0000 7fefafa7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa815c060 0x7fefa80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.168+0000 7fefafa7b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fefa80cd120 0x7fefa80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.168+0000 7fefafa7b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa8160a50 con 0x7fefa80d2450 2023-07-09T02:12:44.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.168+0000 7fefafa7b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa80d28f0 con 0x7fefa80cd120 2023-07-09T02:12:44.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefafa7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80cfe40 con 0x7fefa815c060 2023-07-09T02:12:44.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad016640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fefa80cd120 0x7fefa80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad817640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa815c060 0x7fefa80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad016640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fefa80cd120 0x7fefa80d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:51310/0 (socket says 172.21.15.45:51310) 2023-07-09T02:12:44.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad016640 1 -- 172.21.15.45:0/953790938 learned_addr learned my addr 172.21.15.45:0/953790938 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefae018640 1 --1- 172.21.15.45:0/953790938 >> v1:172.21.15.155:6789/0 conn(0x7fefa80d2450 0x7fefa80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:45454/0 (socket says 172.21.15.45:45454) 2023-07-09T02:12:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad817640 1 -- 172.21.15.45:0/953790938 >> v2:172.21.15.155:3300/0 conn(0x7fefa80cd120 msgr2=0x7fefa80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad817640 1 --2- 172.21.15.45:0/953790938 >> v2:172.21.15.155:3300/0 conn(0x7fefa80cd120 0x7fefa80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad817640 1 -- 172.21.15.45:0/953790938 >> v1:172.21.15.155:6789/0 conn(0x7fefa80d2450 legacy=0x7fefa80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad817640 1 -- 172.21.15.45:0/953790938 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa815c430 con 0x7fefa815c060 2023-07-09T02:12:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad016640 1 --2- 172.21.15.45:0/953790938 >> v2:172.21.15.155:3300/0 conn(0x7fefa80cd120 0x7fefa80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.172+0000 7fefad817640 1 --2- 172.21.15.45:0/953790938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa815c060 0x7fefa80b4ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefa40097c0 tx=0x7fefa401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5368a934ab05035 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefac815640 1 -- 172.21.15.45:0/953790938 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40ab600 con 0x7fefa815c060 2023-07-09T02:12:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefac815640 1 -- 172.21.15.45:0/953790938 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa40a7050 con 0x7fefa815c060 2023-07-09T02:12:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefac815640 1 -- 172.21.15.45:0/953790938 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40ab980 con 0x7fefa815c060 2023-07-09T02:12:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- 172.21.15.45:0/953790938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa815c060 msgr2=0x7fefa80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 --2- 172.21.15.45:0/953790938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa815c060 0x7fefa80b4ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefa40097c0 tx=0x7fefa401c450 comp rx=0 tx=0).stop 2023-07-09T02:12:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- 172.21.15.45:0/953790938 shutdown_connections 2023-07-09T02:12:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 --2- 172.21.15.45:0/953790938 >> v2:172.21.15.155:3300/0 conn(0x7fefa80cd120 0x7fefa80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 --2- 172.21.15.45:0/953790938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa815c060 0x7fefa80b4ed0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- 172.21.15.45:0/953790938 >> 172.21.15.45:0/953790938 conn(0x7fefa80698e0 msgr2=0x7fefa8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- 172.21.15.45:0/953790938 shutdown_connections 2023-07-09T02:12:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- 172.21.15.45:0/953790938 wait complete. 2023-07-09T02:12:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 Processor -- start 2023-07-09T02:12:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- start start 2023-07-09T02:12:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80cd120 0x7fefa8151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa80d2450 0x7fefa80cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa815c060 0x7fefa80cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8159ef0 con 0x7fefa80cd120 2023-07-09T02:12:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81f8a00 con 0x7fefa815c060 2023-07-09T02:12:44.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefafa7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8155fc0 con 0x7fefa80d2450 2023-07-09T02:12:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefad817640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80cd120 0x7fefa8151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefad817640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80cd120 0x7fefa8151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57082/0 (socket says 172.21.15.45:57082) 2023-07-09T02:12:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefad817640 1 -- 172.21.15.45:0/3083181908 learned_addr learned my addr 172.21.15.45:0/3083181908 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.176+0000 7fefad016640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa80d2450 0x7fefa80cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefae018640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa815c060 0x7fefa80cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefad817640 1 -- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa80d2450 msgr2=0x7fefa80cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefad817640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa80d2450 0x7fefa80cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefad817640 1 -- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa815c060 msgr2=0x7fefa80cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefad817640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa815c060 0x7fefa80cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefad817640 1 -- 172.21.15.45:0/3083181908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980094d0 con 0x7fefa80cd120 2023-07-09T02:12:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefad817640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80cd120 0x7fefa8151a70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fefa401a080 tx=0x7fefa401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fef9e7fc640 1 -- 172.21.15.45:0/3083181908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40b7450 con 0x7fefa80cd120 2023-07-09T02:12:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fef9e7fc640 1 -- 172.21.15.45:0/3083181908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa40b75b0 con 0x7fefa80cd120 2023-07-09T02:12:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fef9e7fc640 1 -- 172.21.15.45:0/3083181908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40b7960 con 0x7fefa80cd120 2023-07-09T02:12:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa4009420 con 0x7fefa80cd120 2023-07-09T02:12:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa8155970 con 0x7fefa80cd120 2023-07-09T02:12:44.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa804d7d0 con 0x7fefa80cd120 2023-07-09T02:12:44.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.180+0000 7fef9e7fc640 1 -- 172.21.15.45:0/3083181908 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fefa40b7ac0 con 0x7fefa80cd120 2023-07-09T02:12:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.184+0000 7fef9e7fc640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef8c066280 0x7fef8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.184+0000 7fef9e7fc640 1 -- 172.21.15.45:0/3083181908 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fefa411e130 con 0x7fefa80cd120 2023-07-09T02:12:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.184+0000 7fefad016640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef8c066280 0x7fef8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.184+0000 7fefad016640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef8c066280 0x7fef8c068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fefa8157710 tx=0x7fef98009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.188+0000 7fef9e7fc640 1 -- 172.21.15.45:0/3083181908 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fefa40ebab0 con 0x7fefa80cd120 2023-07-09T02:12:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.340+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fefa806baa0 con 0x7fefa80cd120 2023-07-09T02:12:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.340+0000 7fef9e7fc640 1 -- 172.21.15.45:0/3083181908 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7fefa40ef0d0 con 0x7fefa80cd120 2023-07-09T02:12:44.344 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:12:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef8c066280 msgr2=0x7fef8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef8c066280 0x7fef8c068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fefa8157710 tx=0x7fef98009240 comp rx=0 tx=0).stop 2023-07-09T02:12:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80cd120 msgr2=0x7fefa8151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80cd120 0x7fefa8151a70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fefa401a080 tx=0x7fefa401ac90 comp rx=0 tx=0).stop 2023-07-09T02:12:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 shutdown_connections 2023-07-09T02:12:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefa815c060 0x7fefa80cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fef8c066280 0x7fef8c068730 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefa80d2450 0x7fefa80cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 --2- 172.21.15.45:0/3083181908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefa80cd120 0x7fefa8151a70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 >> 172.21.15.45:0/3083181908 conn(0x7fefa80698e0 msgr2=0x7fefa80b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 shutdown_connections 2023-07-09T02:12:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.344+0000 7fefafa7b640 1 -- 172.21.15.45:0/3083181908 wait complete. 2023-07-09T02:12:44.365 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:12:44.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.504+0000 7f2768d37640 1 Processor -- start 2023-07-09T02:12:44.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.504+0000 7f2768d37640 1 -- start start 2023-07-09T02:12:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f2768d37640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f27640d2620 0x7f27640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f2768d37640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2764160a50 con 0x7f276415c060 2023-07-09T02:12:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f2768d37640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276415c430 con 0x7f27640cd120 2023-07-09T02:12:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f2768d37640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276415fb60 con 0x7f27640d2620 2023-07-09T02:12:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f276259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f276415c060 0x7f27640d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46422/0 (socket says 172.21.15.45:46422) 2023-07-09T02:12:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f276259c640 1 -- 172.21.15.45:0/1765394856 learned_addr learned my addr 172.21.15.45:0/1765394856 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:44.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f2761d9b640 1 --2- 172.21.15.45:0/1765394856 >> v2:172.21.15.155:3300/0 conn(0x7f27640d2620 0x7f27640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f276159a640 1 -- 172.21.15.45:0/1765394856 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580955628 0 0) 0x7f2764160a50 con 0x7f276415c060 2023-07-09T02:12:44.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f276159a640 1 -- 172.21.15.45:0/1765394856 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274c003530 con 0x7f276415c060 2023-07-09T02:12:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f2761d9b640 1 -- 172.21.15.45:0/1765394856 >> v1:172.21.15.155:6789/0 conn(0x7f27640cd120 legacy=0x7f27640cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f276159a640 1 -- 172.21.15.45:0/1765394856 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827694255 0 0) 0x7f276415c430 con 0x7f27640cd120 2023-07-09T02:12:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f2761d9b640 1 -- 172.21.15.45:0/1765394856 >> v1:172.21.15.45:6789/0 conn(0x7f276415c060 legacy=0x7f27640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.508+0000 7f2761d9b640 1 -- 172.21.15.45:0/1765394856 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276415fe40 con 0x7f27640d2620 2023-07-09T02:12:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2761d9b640 1 --2- 172.21.15.45:0/1765394856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27640d2620 0x7f27640b4ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f27580097c0 tx=0x7f275801c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=411f56555c3dbcf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f276159a640 1 -- 172.21.15.45:0/1765394856 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754001680 con 0x7f27640d2620 2023-07-09T02:12:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f276159a640 1 -- 172.21.15.45:0/1765394856 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27580a7050 con 0x7f27640d2620 2023-07-09T02:12:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f276159a640 1 -- 172.21.15.45:0/1765394856 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580ab620 con 0x7f27640d2620 2023-07-09T02:12:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2768d37640 1 -- 172.21.15.45:0/1765394856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27640d2620 msgr2=0x7f27640b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2768d37640 1 --2- 172.21.15.45:0/1765394856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27640d2620 0x7f27640b4ed0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f27580097c0 tx=0x7f275801c290 comp rx=0 tx=0).stop 2023-07-09T02:12:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2768d37640 1 -- 172.21.15.45:0/1765394856 shutdown_connections 2023-07-09T02:12:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2768d37640 1 --2- 172.21.15.45:0/1765394856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27640d2620 0x7f27640b4ed0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2768d37640 1 -- 172.21.15.45:0/1765394856 >> 172.21.15.45:0/1765394856 conn(0x7f27640698e0 msgr2=0x7f2764069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2768d37640 1 -- 172.21.15.45:0/1765394856 shutdown_connections 2023-07-09T02:12:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2768d37640 1 -- 172.21.15.45:0/1765394856 wait complete. 2023-07-09T02:12:44.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.512+0000 7f2768d37640 1 Processor -- start 2023-07-09T02:12:44.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 -- start start 2023-07-09T02:12:44.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27640cd120 0x7f276415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27640d2620 0x7f2764165190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f276415c060 0x7f27641656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276415d8d0 con 0x7f27640d2620 2023-07-09T02:12:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276415d000 con 0x7f276415c060 2023-07-09T02:12:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2764162040 con 0x7f27640cd120 2023-07-09T02:12:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27640d2620 0x7f2764165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27640d2620 0x7f2764165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57098/0 (socket says 172.21.15.45:57098) 2023-07-09T02:12:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 -- 172.21.15.45:0/3607980907 learned_addr learned my addr 172.21.15.45:0/3607980907 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f276259c640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27640cd120 0x7f276415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2762d9d640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f276415c060 0x7f27641656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 -- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27640cd120 msgr2=0x7f276415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27640cd120 0x7f276415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 -- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f276415c060 msgr2=0x7f27641656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f276415c060 0x7f27641656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 -- 172.21.15.45:0/3607980907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2758009420 con 0x7f27640d2620 2023-07-09T02:12:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f276259c640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27640cd120 0x7f276415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2761d9b640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27640d2620 0x7f2764165190 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f27580ae040 tx=0x7f275801aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2752ffd640 1 -- 172.21.15.45:0/3607980907 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580abd80 con 0x7f27640d2620 2023-07-09T02:12:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2752ffd640 1 -- 172.21.15.45:0/3607980907 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758004020 con 0x7f27640d2620 2023-07-09T02:12:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27640b59f0 con 0x7f27640d2620 2023-07-09T02:12:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2752ffd640 1 -- 172.21.15.45:0/3607980907 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580043d0 con 0x7f27640d2620 2023-07-09T02:12:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276415d560 con 0x7f27640d2620 2023-07-09T02:12:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.516+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276415da80 con 0x7f27640d2620 2023-07-09T02:12:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.520+0000 7f2752ffd640 1 -- 172.21.15.45:0/3607980907 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2758003620 con 0x7f27640d2620 2023-07-09T02:12:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.520+0000 7f2752ffd640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.520+0000 7f2752ffd640 1 -- 172.21.15.45:0/3607980907 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f275811dad0 con 0x7f27640d2620 2023-07-09T02:12:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.520+0000 7f276259c640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.520+0000 7f276259c640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2754000fc0 tx=0x7f2754001920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.524+0000 7f2752ffd640 1 -- 172.21.15.45:0/3607980907 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f276415da80 con 0x7f27640d2620 2023-07-09T02:12:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.680+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f276415da80 con 0x7f27640d2620 2023-07-09T02:12:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.680+0000 7f2752ffd640 1 -- 172.21.15.45:0/3607980907 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+126 (secure 0 0 0) 0x7f276415da80 con 0x7f27640d2620 2023-07-09T02:12:44.684 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:44.684 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:12:44.684 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:44.684 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:12:44.684 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:12:44.685 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:12:44.685 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:12:44.685 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:12:44.685 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:12:44.685 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:12:44.685 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:12:44.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 msgr2=0x7f2744068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2754000fc0 tx=0x7f2754001920 comp rx=0 tx=0).stop 2023-07-09T02:12:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27640d2620 msgr2=0x7f2764165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27640d2620 0x7f2764165190 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f27580ae040 tx=0x7f275801aad0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 shutdown_connections 2023-07-09T02:12:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f276415c060 0x7f27641656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27640d2620 0x7f2764165190 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27440662b0 0x7f2744068760 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 --2- 172.21.15.45:0/3607980907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27640cd120 0x7f276415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 >> 172.21.15.45:0/3607980907 conn(0x7f27640698e0 msgr2=0x7f27640b6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:44.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 shutdown_connections 2023-07-09T02:12:44.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.684+0000 7f2768d37640 1 -- 172.21.15.45:0/3607980907 wait complete. 2023-07-09T02:12:44.705 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:12:44.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:12:44.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.848+0000 7f7b33382640 1 Processor -- start 2023-07-09T02:12:44.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.848+0000 7f7b33382640 1 -- start start 2023-07-09T02:12:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b33382640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b2c15c400 0x7f7b2c0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b33382640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c15c7d0 con 0x7f7b2c15feb0 2023-07-09T02:12:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b33382640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c06a5c0 con 0x7f7b2c071ee0 2023-07-09T02:12:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b33382640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c160340 con 0x7f7b2c15c400 2023-07-09T02:12:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b3091d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7b2c15feb0 0x7f7b2c0b22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46430/0 (socket says 172.21.15.45:46430) 2023-07-09T02:12:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b3091d640 1 -- 172.21.15.45:0/387928428 learned_addr learned my addr 172.21.15.45:0/387928428 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b3111e640 1 --2- 172.21.15.45:0/387928428 >> v2:172.21.15.155:3300/0 conn(0x7f7b2c15c400 0x7f7b2c0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b23fff640 1 -- 172.21.15.45:0/387928428 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478617189 0 0) 0x7f7b2c15c7d0 con 0x7f7b2c15feb0 2023-07-09T02:12:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b23fff640 1 -- 172.21.15.45:0/387928428 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b18003530 con 0x7f7b2c15feb0 2023-07-09T02:12:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b23fff640 1 -- 172.21.15.45:0/387928428 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756791944 0 0) 0x7f7b2c06a5c0 con 0x7f7b2c071ee0 2023-07-09T02:12:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b23fff640 1 -- 172.21.15.45:0/387928428 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b2c15c7d0 con 0x7f7b2c071ee0 2023-07-09T02:12:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b3111e640 1 -- 172.21.15.45:0/387928428 >> v1:172.21.15.155:6789/0 conn(0x7f7b2c071ee0 legacy=0x7f7b2c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b3111e640 1 -- 172.21.15.45:0/387928428 >> v1:172.21.15.45:6789/0 conn(0x7f7b2c15feb0 legacy=0x7f7b2c0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b23fff640 1 -- 172.21.15.45:0/387928428 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2533207173 0 0) 0x7f7b18003530 con 0x7f7b2c15feb0 2023-07-09T02:12:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.852+0000 7f7b3111e640 1 -- 172.21.15.45:0/387928428 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c160620 con 0x7f7b2c15c400 2023-07-09T02:12:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b3111e640 1 --2- 172.21.15.45:0/387928428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c15c400 0x7f7b2c0cd0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b280097c0 tx=0x7f7b2801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df14809ef9c20046 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b23fff640 1 -- 172.21.15.45:0/387928428 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c001680 con 0x7f7b2c15c400 2023-07-09T02:12:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b23fff640 1 -- 172.21.15.45:0/387928428 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b280a7050 con 0x7f7b2c15c400 2023-07-09T02:12:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b23fff640 1 -- 172.21.15.45:0/387928428 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280ab620 con 0x7f7b2c15c400 2023-07-09T02:12:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b33382640 1 -- 172.21.15.45:0/387928428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c15c400 msgr2=0x7f7b2c0cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b33382640 1 --2- 172.21.15.45:0/387928428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c15c400 0x7f7b2c0cd0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b280097c0 tx=0x7f7b2801c370 comp rx=0 tx=0).stop 2023-07-09T02:12:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b33382640 1 -- 172.21.15.45:0/387928428 shutdown_connections 2023-07-09T02:12:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b33382640 1 --2- 172.21.15.45:0/387928428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c15c400 0x7f7b2c0cd0f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b33382640 1 -- 172.21.15.45:0/387928428 >> 172.21.15.45:0/387928428 conn(0x7f7b2c06ec20 msgr2=0x7f7b2c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b33382640 1 -- 172.21.15.45:0/387928428 shutdown_connections 2023-07-09T02:12:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.856+0000 7f7b33382640 1 -- 172.21.15.45:0/387928428 wait complete. 2023-07-09T02:12:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 Processor -- start 2023-07-09T02:12:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 -- start start 2023-07-09T02:12:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2c071ee0 0x7f7b2c0c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b2c15c400 0x7f7b2c0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c15feb0 0x7f7b2c152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c0c5a70 con 0x7f7b2c071ee0 2023-07-09T02:12:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c152660 con 0x7f7b2c15feb0 2023-07-09T02:12:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c0c4a90 con 0x7f7b2c15c400 2023-07-09T02:12:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2c071ee0 0x7f7b2c0c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2c071ee0 0x7f7b2c0c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57100/0 (socket says 172.21.15.45:57100) 2023-07-09T02:12:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 -- 172.21.15.45:0/1167163282 learned_addr learned my addr 172.21.15.45:0/1167163282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 -- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b2c15c400 msgr2=0x7f7b2c0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b2c15c400 0x7f7b2c0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 -- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c15feb0 msgr2=0x7f7b2c152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c15feb0 0x7f7b2c152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 -- 172.21.15.45:0/1167163282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b28009420 con 0x7f7b2c071ee0 2023-07-09T02:12:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b3111e640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2c071ee0 0x7f7b2c0c4f20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b28019fa0 tx=0x7f7b28019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b21ffb640 1 -- 172.21.15.45:0/1167163282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280b4400 con 0x7f7b2c071ee0 2023-07-09T02:12:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b21ffb640 1 -- 172.21.15.45:0/1167163282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b280b45a0 con 0x7f7b2c071ee0 2023-07-09T02:12:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b21ffb640 1 -- 172.21.15.45:0/1167163282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280b4950 con 0x7f7b2c071ee0 2023-07-09T02:12:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c0c5c60 con 0x7f7b2c071ee0 2023-07-09T02:12:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c0c4720 con 0x7f7b2c071ee0 2023-07-09T02:12:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.860+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c04d7d0 con 0x7f7b2c071ee0 2023-07-09T02:12:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.864+0000 7f7b21ffb640 1 -- 172.21.15.45:0/1167163282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b280b2040 con 0x7f7b2c071ee0 2023-07-09T02:12:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.864+0000 7f7b21ffb640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b10066280 0x7f7b10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.864+0000 7f7b21ffb640 1 -- 172.21.15.45:0/1167163282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7b2811d610 con 0x7f7b2c071ee0 2023-07-09T02:12:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.864+0000 7f7b3091d640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b10066280 0x7f7b10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.864+0000 7f7b3091d640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b10066280 0x7f7b10068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c001350 tx=0x7f7b1c001260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:44.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:44.868+0000 7f7b21ffb640 1 -- 172.21.15.45:0/1167163282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b280eadd0 con 0x7f7b2c071ee0 2023-07-09T02:12:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.024+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7b2c15c9b0 con 0x7f7b2c071ee0 2023-07-09T02:12:45.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.920+0000 7f7b21ffb640 1 -- 172.21.15.45:0/1167163282 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7b280ee3f0 con 0x7f7b2c071ee0 2023-07-09T02:12:45.922 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:12:45.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b10066280 msgr2=0x7f7b10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:45.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b10066280 0x7f7b10068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c001350 tx=0x7f7b1c001260 comp rx=0 tx=0).stop 2023-07-09T02:12:45.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2c071ee0 msgr2=0x7f7b2c0c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:45.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2c071ee0 0x7f7b2c0c4f20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b28019fa0 tx=0x7f7b28019110 comp rx=0 tx=0).stop 2023-07-09T02:12:45.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 shutdown_connections 2023-07-09T02:12:45.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c15feb0 0x7f7b2c152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:45.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b10066280 0x7f7b10068730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:45.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b2c15c400 0x7f7b2c0c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:45.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 --2- 172.21.15.45:0/1167163282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2c071ee0 0x7f7b2c0c4f20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:45.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 >> 172.21.15.45:0/1167163282 conn(0x7f7b2c06ec20 msgr2=0x7f7b2c0cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:45.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 shutdown_connections 2023-07-09T02:12:45.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:45.924+0000 7f7b33382640 1 -- 172.21.15.45:0/1167163282 wait complete. 2023-07-09T02:12:45.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:12:46.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bceeaa640 1 Processor -- start 2023-07-09T02:12:46.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bceeaa640 1 -- start start 2023-07-09T02:12:46.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bceeaa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bc80b59b0 0x7f4bc80b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:46.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bceeaa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc80ced10 con 0x7f4bc80d2340 2023-07-09T02:12:46.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bceeaa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc815c7e0 con 0x7f4bc815c410 2023-07-09T02:12:46.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bceeaa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc80cd1b0 con 0x7f4bc80b59b0 2023-07-09T02:12:46.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bcd447640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4bc80d2340 0x7f4bc80d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46434/0 (socket says 172.21.15.45:46434) 2023-07-09T02:12:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bcd447640 1 -- 172.21.15.45:0/561119356 learned_addr learned my addr 172.21.15.45:0/561119356 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bc7fff640 1 --2- 172.21.15.45:0/561119356 >> v2:172.21.15.45:3300/0 conn(0x7f4bc80b59b0 0x7f4bc80b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bc77fe640 1 -- 172.21.15.45:0/561119356 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142843391 0 0) 0x7f4bc80ced10 con 0x7f4bc80d2340 2023-07-09T02:12:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bc77fe640 1 -- 172.21.15.45:0/561119356 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb8003530 con 0x7f4bc80d2340 2023-07-09T02:12:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bc77fe640 1 -- 172.21.15.45:0/561119356 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779631353 0 0) 0x7f4bc815c7e0 con 0x7f4bc815c410 2023-07-09T02:12:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bc77fe640 1 -- 172.21.15.45:0/561119356 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc80ced10 con 0x7f4bc815c410 2023-07-09T02:12:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bc7fff640 1 -- 172.21.15.45:0/561119356 >> v1:172.21.15.155:6789/0 conn(0x7f4bc815c410 legacy=0x7f4bc81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:46.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bc7fff640 1 -- 172.21.15.45:0/561119356 >> v1:172.21.15.45:6789/0 conn(0x7f4bc80d2340 legacy=0x7f4bc80d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:46.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.104+0000 7f4bc7fff640 1 -- 172.21.15.45:0/561119356 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc80cef40 con 0x7f4bc80b59b0 2023-07-09T02:12:46.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bc7fff640 1 --2- 172.21.15.45:0/561119356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80b59b0 0x7f4bc80b45e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40097f0 tx=0x7f4bb401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b0e59caaa4d002 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bc77fe640 1 -- 172.21.15.45:0/561119356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40ab600 con 0x7f4bc80b59b0 2023-07-09T02:12:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bc77fe640 1 -- 172.21.15.45:0/561119356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb40a7050 con 0x7f4bc80b59b0 2023-07-09T02:12:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bc77fe640 1 -- 172.21.15.45:0/561119356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40ab980 con 0x7f4bc80b59b0 2023-07-09T02:12:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bceeaa640 1 -- 172.21.15.45:0/561119356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80b59b0 msgr2=0x7f4bc80b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bceeaa640 1 --2- 172.21.15.45:0/561119356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80b59b0 0x7f4bc80b45e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40097f0 tx=0x7f4bb401c450 comp rx=0 tx=0).stop 2023-07-09T02:12:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bceeaa640 1 -- 172.21.15.45:0/561119356 shutdown_connections 2023-07-09T02:12:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bceeaa640 1 --2- 172.21.15.45:0/561119356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80b59b0 0x7f4bc80b45e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bceeaa640 1 -- 172.21.15.45:0/561119356 >> 172.21.15.45:0/561119356 conn(0x7f4bc806a590 msgr2=0x7f4bc80cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bceeaa640 1 -- 172.21.15.45:0/561119356 shutdown_connections 2023-07-09T02:12:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.108+0000 7f4bceeaa640 1 -- 172.21.15.45:0/561119356 wait complete. 2023-07-09T02:12:46.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bceeaa640 1 Processor -- start 2023-07-09T02:12:46.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bceeaa640 1 -- start start 2023-07-09T02:12:46.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bceeaa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc80b59b0 0x7f4bc80c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:46.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bceeaa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80d2340 0x7f4bc80c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:46.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bceeaa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc815c410 0x7f4bc8154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:46.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bceeaa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80c75e0 con 0x7f4bc80d2340 2023-07-09T02:12:46.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bceeaa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80cb3a0 con 0x7f4bc80b59b0 2023-07-09T02:12:46.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bceeaa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc80c7810 con 0x7f4bc815c410 2023-07-09T02:12:46.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80d2340 0x7f4bc80c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:46.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bccc46640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc80b59b0 0x7f4bc80c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:46.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80d2340 0x7f4bc80c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57128/0 (socket says 172.21.15.45:57128) 2023-07-09T02:12:46.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 -- 172.21.15.45:0/2725240310 learned_addr learned my addr 172.21.15.45:0/2725240310 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:46.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bcd447640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc815c410 0x7f4bc8154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:46.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 -- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc815c410 msgr2=0x7f4bc8154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:46.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc815c410 0x7f4bc8154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:46.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 -- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc80b59b0 msgr2=0x7f4bc80c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:46.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc80b59b0 0x7f4bc80c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:46.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 -- 172.21.15.45:0/2725240310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4009420 con 0x7f4bc80d2340 2023-07-09T02:12:46.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bccc46640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc80b59b0 0x7f4bc80c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:46.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.112+0000 7f4bc7fff640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80d2340 0x7f4bc80c70a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40ae040 tx=0x7f4bb40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:46.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bc57fa640 1 -- 172.21.15.45:0/2725240310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40abe50 con 0x7f4bc80d2340 2023-07-09T02:12:46.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bc57fa640 1 -- 172.21.15.45:0/2725240310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4004020 con 0x7f4bc80d2340 2023-07-09T02:12:46.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bc57fa640 1 -- 172.21.15.45:0/2725240310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40043d0 con 0x7f4bc80d2340 2023-07-09T02:12:46.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc80cad50 con 0x7f4bc80d2340 2023-07-09T02:12:46.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc80c7af0 con 0x7f4bc80d2340 2023-07-09T02:12:46.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc804d7d0 con 0x7f4bc80d2340 2023-07-09T02:12:46.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bc57fa640 1 -- 172.21.15.45:0/2725240310 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bb40b2040 con 0x7f4bc80d2340 2023-07-09T02:12:46.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bc57fa640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bac0662b0 0x7f4bac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:46.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bc57fa640 1 -- 172.21.15.45:0/2725240310 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f4bb411d090 con 0x7f4bc80d2340 2023-07-09T02:12:46.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.116+0000 7f4bccc46640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bac0662b0 0x7f4bac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:46.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.120+0000 7f4bccc46640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bac0662b0 0x7f4bac068760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0011f0 tx=0x7f4bbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:46.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.120+0000 7f4bc57fa640 1 -- 172.21.15.45:0/2725240310 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bb40ea780 con 0x7f4bc80d2340 2023-07-09T02:12:46.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.276+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4bc8154160 con 0x7f4bc80d2340 2023-07-09T02:12:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:12:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.924+0000 7f4bc57fa640 1 -- 172.21.15.45:0/2725240310 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4bb40edda0 con 0x7f4bc80d2340 2023-07-09T02:12:46.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.932+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bac0662b0 msgr2=0x7f4bac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:46.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.932+0000 7f4bceeaa640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bac0662b0 0x7f4bac068760 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0011f0 tx=0x7f4bbc009040 comp rx=0 tx=0).stop 2023-07-09T02:12:46.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.932+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80d2340 msgr2=0x7f4bc80c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:46.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.932+0000 7f4bceeaa640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80d2340 0x7f4bc80c70a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40ae040 tx=0x7f4bb40191f0 comp rx=0 tx=0).stop 2023-07-09T02:12:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.936+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 shutdown_connections 2023-07-09T02:12:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.936+0000 7f4bceeaa640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bac0662b0 0x7f4bac068760 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.936+0000 7f4bceeaa640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc815c410 0x7f4bc8154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.936+0000 7f4bceeaa640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc80d2340 0x7f4bc80c70a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.936+0000 7f4bceeaa640 1 --2- 172.21.15.45:0/2725240310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc80b59b0 0x7f4bc80c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.936+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 >> 172.21.15.45:0/2725240310 conn(0x7f4bc806a590 msgr2=0x7f4bc8154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.936+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 shutdown_connections 2023-07-09T02:12:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:46.936+0000 7f4bceeaa640 1 -- 172.21.15.45:0/2725240310 wait complete. 2023-07-09T02:12:46.963 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:12:47.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.108+0000 7f6bc6b8f640 1 Processor -- start 2023-07-09T02:12:47.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.108+0000 7f6bc6b8f640 1 -- start start 2023-07-09T02:12:47.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bc6b8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00d2620 0x7f6bc00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:47.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bc6b8f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6bc00cd120 0x7f6bc00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:47.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bc6b8f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc0160a50 con 0x7f6bc015c060 2023-07-09T02:12:47.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bc6b8f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc015c430 con 0x7f6bc00cd120 2023-07-09T02:12:47.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bc6b8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc015fb60 con 0x7f6bc00d2620 2023-07-09T02:12:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bc492b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6bc015c060 0x7f6bc00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46450/0 (socket says 172.21.15.45:46450) 2023-07-09T02:12:47.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bc492b640 1 -- 172.21.15.45:0/2591567823 learned_addr learned my addr 172.21.15.45:0/2591567823 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bbffff640 1 --2- 172.21.15.45:0/2591567823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00d2620 0x7f6bc00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bc512c640 1 --2- 172.21.15.45:0/2591567823 >> v2:172.21.15.155:3300/0 conn(0x7f6bc00cd120 0x7f6bc00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bbf7fe640 1 -- 172.21.15.45:0/2591567823 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185527156 0 0) 0x7f6bc0160a50 con 0x7f6bc015c060 2023-07-09T02:12:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bbf7fe640 1 -- 172.21.15.45:0/2591567823 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb0003530 con 0x7f6bc015c060 2023-07-09T02:12:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bbf7fe640 1 -- 172.21.15.45:0/2591567823 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057656671 0 0) 0x7f6bb0003530 con 0x7f6bc015c060 2023-07-09T02:12:47.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bbffff640 1 -- 172.21.15.45:0/2591567823 >> v2:172.21.15.155:3300/0 conn(0x7f6bc00cd120 msgr2=0x7f6bc00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:47.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bbffff640 1 --2- 172.21.15.45:0/2591567823 >> v2:172.21.15.155:3300/0 conn(0x7f6bc00cd120 0x7f6bc00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bbffff640 1 -- 172.21.15.45:0/2591567823 >> v1:172.21.15.45:6789/0 conn(0x7f6bc015c060 legacy=0x7f6bc00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:47.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.112+0000 7f6bbffff640 1 -- 172.21.15.45:0/2591567823 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc015fe40 con 0x7f6bc00d2620 2023-07-09T02:12:47.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bbffff640 1 --2- 172.21.15.45:0/2591567823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00d2620 0x7f6bc00b4ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0097c0 tx=0x7f6bac01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e0483023c82329 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:47.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bbf7fe640 1 -- 172.21.15.45:0/2591567823 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4001680 con 0x7f6bc00d2620 2023-07-09T02:12:47.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bbf7fe640 1 -- 172.21.15.45:0/2591567823 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac0a7050 con 0x7f6bc00d2620 2023-07-09T02:12:47.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bbf7fe640 1 -- 172.21.15.45:0/2591567823 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0ab620 con 0x7f6bc00d2620 2023-07-09T02:12:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/2591567823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00d2620 msgr2=0x7f6bc00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 --2- 172.21.15.45:0/2591567823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00d2620 0x7f6bc00b4ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0097c0 tx=0x7f6bac01c370 comp rx=0 tx=0).stop 2023-07-09T02:12:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/2591567823 shutdown_connections 2023-07-09T02:12:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 --2- 172.21.15.45:0/2591567823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00d2620 0x7f6bc00b4ed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 --2- 172.21.15.45:0/2591567823 >> v2:172.21.15.155:3300/0 conn(0x7f6bc00cd120 0x7f6bc00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/2591567823 >> 172.21.15.45:0/2591567823 conn(0x7f6bc00698e0 msgr2=0x7f6bc0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/2591567823 shutdown_connections 2023-07-09T02:12:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/2591567823 wait complete. 2023-07-09T02:12:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 Processor -- start 2023-07-09T02:12:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.116+0000 7f6bc6b8f640 1 -- start start 2023-07-09T02:12:47.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00cd120 0x7f6bc00c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:47.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc00d2620 0x7f6bc015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:47.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc015c060 0x7f6bc015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:47.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00c8d90 con 0x7f6bc00d2620 2023-07-09T02:12:47.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0154480 con 0x7f6bc015c060 2023-07-09T02:12:47.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc015d710 con 0x7f6bc00cd120 2023-07-09T02:12:47.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc00d2620 0x7f6bc015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:47.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc00d2620 0x7f6bc015d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57136/0 (socket says 172.21.15.45:57136) 2023-07-09T02:12:47.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 -- 172.21.15.45:0/59437686 learned_addr learned my addr 172.21.15.45:0/59437686 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:47.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc512c640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc015c060 0x7f6bc015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:47.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 -- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00cd120 msgr2=0x7f6bc00c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:47.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00cd120 0x7f6bc00c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 -- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc015c060 msgr2=0x7f6bc015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:47.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc015c060 0x7f6bc015ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 -- 172.21.15.45:0/59437686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac009420 con 0x7f6bc00d2620 2023-07-09T02:12:47.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc512c640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc015c060 0x7f6bc015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:47.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbffff640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc00d2620 0x7f6bc015d1d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0097c0 tx=0x7f6bac01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:47.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbd7fa640 1 -- 172.21.15.45:0/59437686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0b7450 con 0x7f6bc00d2620 2023-07-09T02:12:47.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbd7fa640 1 -- 172.21.15.45:0/59437686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac0b75d0 con 0x7f6bc00d2620 2023-07-09T02:12:47.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbd7fa640 1 -- 172.21.15.45:0/59437686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0b7980 con 0x7f6bc00d2620 2023-07-09T02:12:47.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/59437686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc00b59f0 con 0x7f6bc00d2620 2023-07-09T02:12:47.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/59437686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc015f130 con 0x7f6bc00d2620 2023-07-09T02:12:47.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/59437686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0069cb0 con 0x7f6bc00d2620 2023-07-09T02:12:47.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.120+0000 7f6bbd7fa640 1 -- 172.21.15.45:0/59437686 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bac0b7ae0 con 0x7f6bc00d2620 2023-07-09T02:12:47.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.124+0000 7f6bbd7fa640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ba4066280 0x7f6ba4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:47.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.124+0000 7f6bbd7fa640 1 -- 172.21.15.45:0/59437686 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f6bac11e4d0 con 0x7f6bc00d2620 2023-07-09T02:12:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.124+0000 7f6bc492b640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ba4066280 0x7f6ba4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.124+0000 7f6bc492b640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ba4066280 0x7f6ba4068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4001ec0 tx=0x7f6bb4001990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.128+0000 7f6bbd7fa640 1 -- 172.21.15.45:0/59437686 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bac0eb880 con 0x7f6bc00d2620 2023-07-09T02:12:47.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.312+0000 7f6bc6b8f640 1 -- 172.21.15.45:0/59437686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6bc004d7d0 con 0x7f6bc00d2620 2023-07-09T02:12:47.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:12:47.874 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:12:47.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.932+0000 7f6bbd7fa640 1 -- 172.21.15.45:0/59437686 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6bac0b00c0 con 0x7f6bc00d2620 2023-07-09T02:12:47.936 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 7 and data pool 8 2023-07-09T02:12:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.944+0000 7f6baaffd640 1 -- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ba4066280 msgr2=0x7f6ba4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.944+0000 7f6baaffd640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ba4066280 0x7f6ba4068730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4001ec0 tx=0x7f6bb4001990 comp rx=0 tx=0).stop 2023-07-09T02:12:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.944+0000 7f6baaffd640 1 -- 172.21.15.45:0/59437686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc00d2620 msgr2=0x7f6bc015d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.944+0000 7f6baaffd640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc00d2620 0x7f6bc015d1d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0097c0 tx=0x7f6bac01abb0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.948+0000 7f6baaffd640 1 -- 172.21.15.45:0/59437686 shutdown_connections 2023-07-09T02:12:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.948+0000 7f6baaffd640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc015c060 0x7f6bc015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.948+0000 7f6baaffd640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc00d2620 0x7f6bc015d1d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.948+0000 7f6baaffd640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ba4066280 0x7f6ba4068730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.948+0000 7f6baaffd640 1 --2- 172.21.15.45:0/59437686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6bc00cd120 0x7f6bc00c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.948+0000 7f6baaffd640 1 -- 172.21.15.45:0/59437686 >> 172.21.15.45:0/59437686 conn(0x7f6bc00698e0 msgr2=0x7f6bc00b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.948+0000 7f6baaffd640 1 -- 172.21.15.45:0/59437686 shutdown_connections 2023-07-09T02:12:47.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:47.948+0000 7f6baaffd640 1 -- 172.21.15.45:0/59437686 wait complete. 2023-07-09T02:12:47.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:48.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.160+0000 7f5416ed8640 1 Processor -- start 2023-07-09T02:12:48.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.160+0000 7f5416ed8640 1 -- start start 2023-07-09T02:12:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f5416ed8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54100cd120 0x7f54100b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f5416ed8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5410160a50 con 0x7f54100d2620 2023-07-09T02:12:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f5416ed8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541015c430 con 0x7f541015c060 2023-07-09T02:12:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f5416ed8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541015fb60 con 0x7f54100cd120 2023-07-09T02:12:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f5415475640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54100cd120 0x7f54100b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f540ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f54100d2620 0x7f54100cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46452/0 (socket says 172.21.15.45:46452) 2023-07-09T02:12:48.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f540ffff640 1 -- 172.21.15.45:0/932282124 learned_addr learned my addr 172.21.15.45:0/932282124 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:48.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f5415475640 1 -- 172.21.15.45:0/932282124 >> v1:172.21.15.155:6789/0 conn(0x7f541015c060 legacy=0x7f54100d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f5415475640 1 -- 172.21.15.45:0/932282124 >> v1:172.21.15.45:6789/0 conn(0x7f54100d2620 legacy=0x7f54100cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f5415475640 1 -- 172.21.15.45:0/932282124 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541015fe40 con 0x7f54100cd120 2023-07-09T02:12:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.164+0000 7f540f7fe640 1 -- 172.21.15.45:0/932282124 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825339613 0 0) 0x7f5410160a50 con 0x7f54100d2620 2023-07-09T02:12:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5415475640 1 --2- 172.21.15.45:0/932282124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100cd120 0x7f54100b4ed0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5408009d90 tx=0x7f540801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7eedf8e477e7f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f540f7fe640 1 -- 172.21.15.45:0/932282124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080a59e0 con 0x7f54100cd120 2023-07-09T02:12:48.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f540f7fe640 1 -- 172.21.15.45:0/932282124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080a5b40 con 0x7f54100cd120 2023-07-09T02:12:48.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f540f7fe640 1 -- 172.21.15.45:0/932282124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080ad440 con 0x7f54100cd120 2023-07-09T02:12:48.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 -- 172.21.15.45:0/932282124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100cd120 msgr2=0x7f54100b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 --2- 172.21.15.45:0/932282124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100cd120 0x7f54100b4ed0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5408009d90 tx=0x7f540801c920 comp rx=0 tx=0).stop 2023-07-09T02:12:48.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 -- 172.21.15.45:0/932282124 shutdown_connections 2023-07-09T02:12:48.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 --2- 172.21.15.45:0/932282124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100cd120 0x7f54100b4ed0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 -- 172.21.15.45:0/932282124 >> 172.21.15.45:0/932282124 conn(0x7f54100698e0 msgr2=0x7f5410069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:48.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 -- 172.21.15.45:0/932282124 shutdown_connections 2023-07-09T02:12:48.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 -- 172.21.15.45:0/932282124 wait complete. 2023-07-09T02:12:48.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 Processor -- start 2023-07-09T02:12:48.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.168+0000 7f5416ed8640 1 -- start start 2023-07-09T02:12:48.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54100cd120 0x7f5410160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100d2620 0x7f5410158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f541015c060 0x7f5410163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410161340 con 0x7f54100d2620 2023-07-09T02:12:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410161620 con 0x7f541015c060 2023-07-09T02:12:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5410161900 con 0x7f54100cd120 2023-07-09T02:12:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100d2620 0x7f5410158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100d2620 0x7f5410158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57150/0 (socket says 172.21.15.45:57150) 2023-07-09T02:12:48.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 -- 172.21.15.45:0/1844303481 learned_addr learned my addr 172.21.15.45:0/1844303481 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:48.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5414c74640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54100cd120 0x7f5410160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5415475640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f541015c060 0x7f5410163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 -- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54100cd120 msgr2=0x7f5410160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54100cd120 0x7f5410160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 -- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f541015c060 msgr2=0x7f5410163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f541015c060 0x7f5410163270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 -- 172.21.15.45:0/1844303481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408009a70 con 0x7f54100d2620 2023-07-09T02:12:48.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5415475640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f541015c060 0x7f5410163270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:48.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540ffff640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100d2620 0x7f5410158240 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00c480 tx=0x7f53fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540d7fa640 1 -- 172.21.15.45:0/1844303481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0074e0 con 0x7f54100d2620 2023-07-09T02:12:48.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540d7fa640 1 -- 172.21.15.45:0/1844303481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc007640 con 0x7f54100d2620 2023-07-09T02:12:48.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f540d7fa640 1 -- 172.21.15.45:0/1844303481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc004a10 con 0x7f54100d2620 2023-07-09T02:12:48.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54100b59f0 con 0x7f54100d2620 2023-07-09T02:12:48.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5410161ec0 con 0x7f54100d2620 2023-07-09T02:12:48.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.172+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54101620b0 con 0x7f54100d2620 2023-07-09T02:12:48.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.176+0000 7f540d7fa640 1 -- 172.21.15.45:0/1844303481 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53fc004b70 con 0x7f54100d2620 2023-07-09T02:12:48.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.176+0000 7f540d7fa640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53f4066280 0x7f53f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.176+0000 7f540d7fa640 1 -- 172.21.15.45:0/1844303481 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53fc082f80 con 0x7f54100d2620 2023-07-09T02:12:48.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.176+0000 7f5414c74640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53f4066280 0x7f53f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.176+0000 7f5414c74640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53f4066280 0x7f53f4068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5404000f70 tx=0x7f5404009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.180+0000 7f540d7fa640 1 -- 172.21.15.45:0/1844303481 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53fc0504a0 con 0x7f54100d2620 2023-07-09T02:12:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.336+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f541004d7d0 con 0x7f54100d2620 2023-07-09T02:12:48.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.336+0000 7f540d7fa640 1 -- 172.21.15.45:0/1844303481 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18364 (secure 0 0 0) 0x7f53fc018070 con 0x7f54100d2620 2023-07-09T02:12:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:48.339 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:47.318904+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:45.075187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:46.325197+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:48.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53f4066280 msgr2=0x7f53f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53f4066280 0x7f53f4068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5404000f70 tx=0x7f5404009040 comp rx=0 tx=0).stop 2023-07-09T02:12:48.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100d2620 msgr2=0x7f5410158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100d2620 0x7f5410158240 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00c480 tx=0x7f53fc00c940 comp rx=0 tx=0).stop 2023-07-09T02:12:48.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 shutdown_connections 2023-07-09T02:12:48.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f541015c060 0x7f5410163270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54100d2620 0x7f5410158240 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53f4066280 0x7f53f4068730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 --2- 172.21.15.45:0/1844303481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54100cd120 0x7f5410160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 >> 172.21.15.45:0/1844303481 conn(0x7f54100698e0 msgr2=0x7f54100b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:48.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 shutdown_connections 2023-07-09T02:12:48.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.340+0000 7f5416ed8640 1 -- 172.21.15.45:0/1844303481 wait complete. 2023-07-09T02:12:48.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28ed1e640 1 Processor -- start 2023-07-09T02:12:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28ed1e640 1 -- start start 2023-07-09T02:12:48.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28ed1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe28815c060 0x7fe2880b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28ed1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2880cd120 0x7fe2880d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28ed1e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe288160a50 con 0x7fe2880d2450 2023-07-09T02:12:48.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28ed1e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2880d28f0 con 0x7fe28815c060 2023-07-09T02:12:48.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28ed1e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2880cfe40 con 0x7fe2880cd120 2023-07-09T02:12:48.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28caba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe28815c060 0x7fe2880b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28caba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe28815c060 0x7fe2880b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57152/0 (socket says 172.21.15.45:57152) 2023-07-09T02:12:48.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28caba640 1 -- 172.21.15.45:0/1022405639 learned_addr learned my addr 172.21.15.45:0/1022405639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:48.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe287fff640 1 --2- 172.21.15.45:0/1022405639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2880cd120 0x7fe2880d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28caba640 1 -- 172.21.15.45:0/1022405639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2880cd120 msgr2=0x7fe2880d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:48.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28caba640 1 --2- 172.21.15.45:0/1022405639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2880cd120 0x7fe2880d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28caba640 1 -- 172.21.15.45:0/1022405639 >> v1:172.21.15.155:6789/0 conn(0x7fe2880d2450 legacy=0x7fe2880d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.504+0000 7fe28caba640 1 -- 172.21.15.45:0/1022405639 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28815c430 con 0x7fe28815c060 2023-07-09T02:12:48.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28caba640 1 --2- 172.21.15.45:0/1022405639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe28815c060 0x7fe2880b4ed0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009870 tx=0x7fe27c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b743fcca44057b36 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe2877fe640 1 -- 172.21.15.45:0/1022405639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0a7070 con 0x7fe28815c060 2023-07-09T02:12:48.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe2877fe640 1 -- 172.21.15.45:0/1022405639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c0ab430 con 0x7fe28815c060 2023-07-09T02:12:48.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe2877fe640 1 -- 172.21.15.45:0/1022405639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0ab7c0 con 0x7fe28815c060 2023-07-09T02:12:48.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28ed1e640 1 -- 172.21.15.45:0/1022405639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe28815c060 msgr2=0x7fe2880b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/1022405639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe28815c060 0x7fe2880b4ed0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009870 tx=0x7fe27c01c510 comp rx=0 tx=0).stop 2023-07-09T02:12:48.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28ed1e640 1 -- 172.21.15.45:0/1022405639 shutdown_connections 2023-07-09T02:12:48.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/1022405639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2880cd120 0x7fe2880d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/1022405639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe28815c060 0x7fe2880b4ed0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28ed1e640 1 -- 172.21.15.45:0/1022405639 >> 172.21.15.45:0/1022405639 conn(0x7fe2880698e0 msgr2=0x7fe288069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:48.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28ed1e640 1 -- 172.21.15.45:0/1022405639 shutdown_connections 2023-07-09T02:12:48.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.508+0000 7fe28ed1e640 1 -- 172.21.15.45:0/1022405639 wait complete. 2023-07-09T02:12:48.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 Processor -- start 2023-07-09T02:12:48.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 -- start start 2023-07-09T02:12:48.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2880cd120 0x7fe28815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2880d2450 0x7fe288157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28815c060 0x7fe28815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2881575b0 con 0x7fe2880cd120 2023-07-09T02:12:48.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28815cc40 con 0x7fe2880d2450 2023-07-09T02:12:48.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28815cf20 con 0x7fe28815c060 2023-07-09T02:12:48.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2880cd120 0x7fe28815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2880cd120 0x7fe28815c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57160/0 (socket says 172.21.15.45:57160) 2023-07-09T02:12:48.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 -- 172.21.15.45:0/8155857 learned_addr learned my addr 172.21.15.45:0/8155857 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe287fff640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2880d2450 0x7fe288157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28d2bb640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28815c060 0x7fe28815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 -- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28815c060 msgr2=0x7fe28815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28815c060 0x7fe28815dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 -- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2880d2450 msgr2=0x7fe288157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2880d2450 0x7fe288157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 -- 172.21.15.45:0/8155857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c0094d0 con 0x7fe2880cd120 2023-07-09T02:12:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28caba640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2880cd120 0x7fe28815c660 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0ad040 tx=0x7fe27c0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe2857fa640 1 -- 172.21.15.45:0/8155857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0bc070 con 0x7fe2880cd120 2023-07-09T02:12:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe2857fa640 1 -- 172.21.15.45:0/8155857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c0abe10 con 0x7fe2880cd120 2023-07-09T02:12:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe2857fa640 1 -- 172.21.15.45:0/8155857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0b4890 con 0x7fe2880cd120 2023-07-09T02:12:48.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28815d200 con 0x7fe2880cd120 2023-07-09T02:12:48.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.512+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28815d7c0 con 0x7fe2880cd120 2023-07-09T02:12:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.516+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28804d7d0 con 0x7fe2880cd120 2023-07-09T02:12:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.516+0000 7fe2857fa640 1 -- 172.21.15.45:0/8155857 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe27c0b49f0 con 0x7fe2880cd120 2023-07-09T02:12:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.516+0000 7fe2857fa640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe26c066250 0x7fe26c068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.516+0000 7fe2857fa640 1 -- 172.21.15.45:0/8155857 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe27c11d800 con 0x7fe2880cd120 2023-07-09T02:12:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.516+0000 7fe287fff640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe26c066250 0x7fe26c068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.516+0000 7fe287fff640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe26c066250 0x7fe26c068700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe2881f8150 tx=0x7fe274008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.520+0000 7fe2857fa640 1 -- 172.21.15.45:0/8155857 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe27c0eac70 con 0x7fe2880cd120 2023-07-09T02:12:48.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.676+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe28806baa0 con 0x7fe2880cd120 2023-07-09T02:12:48.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.676+0000 7fe2857fa640 1 -- 172.21.15.45:0/8155857 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18364 (secure 0 0 0) 0x7fe27c0ee290 con 0x7fe2880cd120 2023-07-09T02:12:48.680 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:48.680 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:47.318904+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:45.075187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:46.325197+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:48.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe26c066250 msgr2=0x7fe26c068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe26c066250 0x7fe26c068700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe2881f8150 tx=0x7fe274008040 comp rx=0 tx=0).stop 2023-07-09T02:12:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2880cd120 msgr2=0x7fe28815c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2880cd120 0x7fe28815c660 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0ad040 tx=0x7fe27c0192b0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 shutdown_connections 2023-07-09T02:12:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe26c066250 0x7fe26c068700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe28815c060 0x7fe28815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2880d2450 0x7fe288157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 --2- 172.21.15.45:0/8155857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2880cd120 0x7fe28815c660 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 >> 172.21.15.45:0/8155857 conn(0x7fe2880698e0 msgr2=0x7fe2880b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 shutdown_connections 2023-07-09T02:12:48.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.680+0000 7fe28ed1e640 1 -- 172.21.15.45:0/8155857 wait complete. 2023-07-09T02:12:48.702 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:12:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.844+0000 7f702669c640 1 Processor -- start 2023-07-09T02:12:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.844+0000 7f702669c640 1 -- start start 2023-07-09T02:12:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f702669c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70200cd120 0x7f70200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f702669c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7020160a50 con 0x7f70200d2620 2023-07-09T02:12:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f702669c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702015c430 con 0x7f702015c060 2023-07-09T02:12:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f702669c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702015fb60 con 0x7f70200cd120 2023-07-09T02:12:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f701f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f70200d2620 0x7f70200cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46464/0 (socket says 172.21.15.45:46464) 2023-07-09T02:12:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f701f7fe640 1 -- 172.21.15.45:0/1062824083 learned_addr learned my addr 172.21.15.45:0/1062824083 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f7024c39640 1 --2- 172.21.15.45:0/1062824083 >> v2:172.21.15.45:3300/0 conn(0x7f70200cd120 0x7f70200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f701effd640 1 -- 172.21.15.45:0/1062824083 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079964363 0 0) 0x7f7020160a50 con 0x7f70200d2620 2023-07-09T02:12:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f701effd640 1 -- 172.21.15.45:0/1062824083 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7008003530 con 0x7f70200d2620 2023-07-09T02:12:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f7024c39640 1 -- 172.21.15.45:0/1062824083 >> v1:172.21.15.155:6789/0 conn(0x7f702015c060 legacy=0x7f70200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f7024c39640 1 -- 172.21.15.45:0/1062824083 >> v1:172.21.15.45:6789/0 conn(0x7f70200d2620 legacy=0x7f70200cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.848+0000 7f7024c39640 1 -- 172.21.15.45:0/1062824083 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702015fe40 con 0x7f70200cd120 2023-07-09T02:12:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f7024c39640 1 --2- 172.21.15.45:0/1062824083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f70200b4ed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7018009d90 tx=0x7f701801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43373c6231dee5df server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f701effd640 1 -- 172.21.15.45:0/1062824083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180a59e0 con 0x7f70200cd120 2023-07-09T02:12:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f701effd640 1 -- 172.21.15.45:0/1062824083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70180a5b40 con 0x7f70200cd120 2023-07-09T02:12:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f701effd640 1 -- 172.21.15.45:0/1062824083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180ad440 con 0x7f70200cd120 2023-07-09T02:12:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- 172.21.15.45:0/1062824083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 msgr2=0x7f70200b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 --2- 172.21.15.45:0/1062824083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f70200b4ed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7018009d90 tx=0x7f701801c920 comp rx=0 tx=0).stop 2023-07-09T02:12:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- 172.21.15.45:0/1062824083 shutdown_connections 2023-07-09T02:12:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 --2- 172.21.15.45:0/1062824083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f70200b4ed0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- 172.21.15.45:0/1062824083 >> 172.21.15.45:0/1062824083 conn(0x7f70200698e0 msgr2=0x7f7020069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- 172.21.15.45:0/1062824083 shutdown_connections 2023-07-09T02:12:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- 172.21.15.45:0/1062824083 wait complete. 2023-07-09T02:12:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 Processor -- start 2023-07-09T02:12:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- start start 2023-07-09T02:12:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f7020152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70200d2620 0x7f70200b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702015c060 0x7f702015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020154c20 con 0x7f70200cd120 2023-07-09T02:12:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020152e50 con 0x7f70200d2620 2023-07-09T02:12:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.852+0000 7f702669c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702015a980 con 0x7f702015c060 2023-07-09T02:12:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f7020152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f7020152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57172/0 (socket says 172.21.15.45:57172) 2023-07-09T02:12:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 -- 172.21.15.45:0/4202046395 learned_addr learned my addr 172.21.15.45:0/4202046395 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701f7fe640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70200d2620 0x7f70200b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f7024c39640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702015c060 0x7f702015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 -- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702015c060 msgr2=0x7f702015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702015c060 0x7f702015dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 -- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70200d2620 msgr2=0x7f70200b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70200d2620 0x7f70200b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 -- 172.21.15.45:0/4202046395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018009a70 con 0x7f70200cd120 2023-07-09T02:12:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701ffff640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f7020152910 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f701000c3c0 tx=0x7f701000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701cff9640 1 -- 172.21.15.45:0/4202046395 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100052d0 con 0x7f70200cd120 2023-07-09T02:12:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701cff9640 1 -- 172.21.15.45:0/4202046395 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7010005430 con 0x7f70200cd120 2023-07-09T02:12:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701cff9640 1 -- 172.21.15.45:0/4202046395 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010003840 con 0x7f70200cd120 2023-07-09T02:12:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70200b59f0 con 0x7f70200cd120 2023-07-09T02:12:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7020153900 con 0x7f70200cd120 2023-07-09T02:12:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702004d7d0 con 0x7f70200cd120 2023-07-09T02:12:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.856+0000 7f701cff9640 1 -- 172.21.15.45:0/4202046395 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70100039a0 con 0x7f70200cd120 2023-07-09T02:12:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.860+0000 7f701cff9640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f700c0662b0 0x7f700c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.860+0000 7f701cff9640 1 -- 172.21.15.45:0/4202046395 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70100831e0 con 0x7f70200cd120 2023-07-09T02:12:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.860+0000 7f701f7fe640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f700c0662b0 0x7f700c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.860+0000 7f701f7fe640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f700c0662b0 0x7f700c068760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f702015a540 tx=0x7f7014009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:48.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:48.860+0000 7f701cff9640 1 -- 172.21.15.45:0/4202046395 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7010050650 con 0x7f70200cd120 2023-07-09T02:12:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.052+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f702006baa0 con 0x7f70200cd120 2023-07-09T02:12:49.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.960+0000 7f701cff9640 1 -- 172.21.15.45:0/4202046395 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7010053c70 con 0x7f70200cd120 2023-07-09T02:12:49.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f700c0662b0 msgr2=0x7f700c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:49.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f700c0662b0 0x7f700c068760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f702015a540 tx=0x7f7014009040 comp rx=0 tx=0).stop 2023-07-09T02:12:49.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 msgr2=0x7f7020152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:49.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f7020152910 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f701000c3c0 tx=0x7f701000c880 comp rx=0 tx=0).stop 2023-07-09T02:12:49.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 shutdown_connections 2023-07-09T02:12:49.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f700c0662b0 0x7f700c068760 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f702015c060 0x7f702015dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70200d2620 0x7f70200b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 --2- 172.21.15.45:0/4202046395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70200cd120 0x7f7020152910 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 >> 172.21.15.45:0/4202046395 conn(0x7f70200698e0 msgr2=0x7f70200b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:49.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 shutdown_connections 2023-07-09T02:12:49.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:49.964+0000 7f702669c640 1 -- 172.21.15.45:0/4202046395 wait complete. 2023-07-09T02:12:49.991 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:12:49.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:12:50.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb286c48640 1 Processor -- start 2023-07-09T02:12:50.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb286c48640 1 -- start start 2023-07-09T02:12:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb286c48640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb28015c060 0x7fb2800b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb286c48640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb2800cd120 0x7fb2800d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb286c48640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb280160a50 con 0x7fb2800d2450 2023-07-09T02:12:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb286c48640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2800d28d0 con 0x7fb28015c060 2023-07-09T02:12:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb286c48640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2800cfe40 con 0x7fb2800cd120 2023-07-09T02:12:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb2849e4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb28015c060 0x7fb2800b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb2849e4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb28015c060 0x7fb2800b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57188/0 (socket says 172.21.15.45:57188) 2023-07-09T02:12:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb2849e4640 1 -- 172.21.15.45:0/3801417706 learned_addr learned my addr 172.21.15.45:0/3801417706 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb27ffff640 1 --2- 172.21.15.45:0/3801417706 >> v2:172.21.15.155:3300/0 conn(0x7fb2800cd120 0x7fb2800d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb2849e4640 1 -- 172.21.15.45:0/3801417706 >> v2:172.21.15.155:3300/0 conn(0x7fb2800cd120 msgr2=0x7fb2800d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb2849e4640 1 --2- 172.21.15.45:0/3801417706 >> v2:172.21.15.155:3300/0 conn(0x7fb2800cd120 0x7fb2800d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb2849e4640 1 -- 172.21.15.45:0/3801417706 >> v1:172.21.15.155:6789/0 conn(0x7fb2800d2450 legacy=0x7fb2800d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb2849e4640 1 -- 172.21.15.45:0/3801417706 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28015c430 con 0x7fb28015c060 2023-07-09T02:12:50.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.143+0000 7fb27ffff640 1 --2- 172.21.15.45:0/3801417706 >> v2:172.21.15.155:3300/0 conn(0x7fb2800cd120 0x7fb2800d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:50.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb2849e4640 1 --2- 172.21.15.45:0/3801417706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb28015c060 0x7fb2800b4ed0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb28015fac0 tx=0x7fb27401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4342a80c91106e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb27f7fe640 1 -- 172.21.15.45:0/3801417706 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740ab5f0 con 0x7fb28015c060 2023-07-09T02:12:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb27f7fe640 1 -- 172.21.15.45:0/3801417706 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740ab750 con 0x7fb28015c060 2023-07-09T02:12:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb27f7fe640 1 -- 172.21.15.45:0/3801417706 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740abae0 con 0x7fb28015c060 2023-07-09T02:12:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 -- 172.21.15.45:0/3801417706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb28015c060 msgr2=0x7fb2800b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 --2- 172.21.15.45:0/3801417706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb28015c060 0x7fb2800b4ed0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb28015fac0 tx=0x7fb27401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 -- 172.21.15.45:0/3801417706 shutdown_connections 2023-07-09T02:12:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 --2- 172.21.15.45:0/3801417706 >> v2:172.21.15.155:3300/0 conn(0x7fb2800cd120 0x7fb2800d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 --2- 172.21.15.45:0/3801417706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb28015c060 0x7fb2800b4ed0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 -- 172.21.15.45:0/3801417706 >> 172.21.15.45:0/3801417706 conn(0x7fb2800698e0 msgr2=0x7fb280069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:50.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 -- 172.21.15.45:0/3801417706 shutdown_connections 2023-07-09T02:12:50.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 -- 172.21.15.45:0/3801417706 wait complete. 2023-07-09T02:12:50.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 Processor -- start 2023-07-09T02:12:50.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.147+0000 7fb286c48640 1 -- start start 2023-07-09T02:12:50.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2800cd120 0x7fb28015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2800d2450 0x7fb2800b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb28015c060 0x7fb2800cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800b4210 con 0x7fb2800cd120 2023-07-09T02:12:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800cca30 con 0x7fb28015c060 2023-07-09T02:12:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800b2f10 con 0x7fb2800d2450 2023-07-09T02:12:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2800cd120 0x7fb28015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2800cd120 0x7fb28015a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57198/0 (socket says 172.21.15.45:57198) 2023-07-09T02:12:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 -- 172.21.15.45:0/490432763 learned_addr learned my addr 172.21.15.45:0/490432763 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb27ffff640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2800d2450 0x7fb2800b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2851e5640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb28015c060 0x7fb2800cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 -- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2800d2450 msgr2=0x7fb2800b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2800d2450 0x7fb2800b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 -- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb28015c060 msgr2=0x7fb2800cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb28015c060 0x7fb2800cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 -- 172.21.15.45:0/490432763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740094d0 con 0x7fb2800cd120 2023-07-09T02:12:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb27ffff640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2800d2450 0x7fb2800b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2851e5640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb28015c060 0x7fb2800cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb2849e4640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2800cd120 0x7fb28015a770 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb2740190e0 tx=0x7fb27401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb27d7fa640 1 -- 172.21.15.45:0/490432763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740be5f0 con 0x7fb2800cd120 2023-07-09T02:12:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb27d7fa640 1 -- 172.21.15.45:0/490432763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740be770 con 0x7fb2800cd120 2023-07-09T02:12:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb27d7fa640 1 -- 172.21.15.45:0/490432763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740beb20 con 0x7fb2800cd120 2023-07-09T02:12:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2800b31f0 con 0x7fb2800cd120 2023-07-09T02:12:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2800b37b0 con 0x7fb2800cd120 2023-07-09T02:12:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.151+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2800b39a0 con 0x7fb2800cd120 2023-07-09T02:12:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.155+0000 7fb27d7fa640 1 -- 172.21.15.45:0/490432763 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2740b4600 con 0x7fb2800cd120 2023-07-09T02:12:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.155+0000 7fb27d7fa640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb264066280 0x7fb264068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.155+0000 7fb27d7fa640 1 -- 172.21.15.45:0/490432763 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2740a8050 con 0x7fb2800cd120 2023-07-09T02:12:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.155+0000 7fb27ffff640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb264066280 0x7fb264068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.155+0000 7fb27ffff640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb264066280 0x7fb264068730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b6890 tx=0x7fb26c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:50.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.159+0000 7fb27d7fa640 1 -- 172.21.15.45:0/490432763 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2740eb8a0 con 0x7fb2800cd120 2023-07-09T02:12:50.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.347+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb28004d7d0 con 0x7fb2800cd120 2023-07-09T02:12:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.967+0000 7fb27d7fa640 1 -- 172.21.15.45:0/490432763 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb2740eeec0 con 0x7fb2800cd120 2023-07-09T02:12:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb264066280 msgr2=0x7fb264068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb264066280 0x7fb264068730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb2800b6890 tx=0x7fb26c008040 comp rx=0 tx=0).stop 2023-07-09T02:12:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2800cd120 msgr2=0x7fb28015a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2800cd120 0x7fb28015a770 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb2740190e0 tx=0x7fb27401ad10 comp rx=0 tx=0).stop 2023-07-09T02:12:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 shutdown_connections 2023-07-09T02:12:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb28015c060 0x7fb2800cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb264066280 0x7fb264068730 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2800d2450 0x7fb2800b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 --2- 172.21.15.45:0/490432763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2800cd120 0x7fb28015a770 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 >> 172.21.15.45:0/490432763 conn(0x7fb2800698e0 msgr2=0x7fb2800b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 shutdown_connections 2023-07-09T02:12:50.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:50.971+0000 7fb286c48640 1 -- 172.21.15.45:0/490432763 wait complete. 2023-07-09T02:12:50.996 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:12:50.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:51.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d631ac640 1 Processor -- start 2023-07-09T02:12:51.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d631ac640 1 -- start start 2023-07-09T02:12:51.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d631ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d5c0cb5d0 0x7f0d5c06c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d631ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c06caa0 con 0x7f0d5c06c110 2023-07-09T02:12:51.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d631ac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c0ccf80 con 0x7f0d5c158e30 2023-07-09T02:12:51.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d631ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c0cd540 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d61749640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d5c0cb5d0 0x7f0d5c06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d5bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0d5c06c110 0x7f0d5c0caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46476/0 (socket says 172.21.15.45:46476) 2023-07-09T02:12:51.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.139+0000 7f0d5bfff640 1 -- 172.21.15.45:0/3835605283 learned_addr learned my addr 172.21.15.45:0/3835605283 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:51.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d61749640 1 -- 172.21.15.45:0/3835605283 >> v1:172.21.15.155:6789/0 conn(0x7f0d5c158e30 legacy=0x7f0d5c06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:51.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d61749640 1 -- 172.21.15.45:0/3835605283 >> v1:172.21.15.45:6789/0 conn(0x7f0d5c06c110 legacy=0x7f0d5c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d5b7fe640 1 -- 172.21.15.45:0/3835605283 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186266269 0 0) 0x7f0d48001120 con 0x7f0d5c06c110 2023-07-09T02:12:51.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d61749640 1 -- 172.21.15.45:0/3835605283 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0c8fb0 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d61749640 1 --2- 172.21.15.45:0/3835605283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c06c560 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76067cdb6ffe95f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d5b7fe640 1 -- 172.21.15.45:0/3835605283 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540a5910 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d5b7fe640 1 -- 172.21.15.45:0/3835605283 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d540a5a70 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d5b7fe640 1 -- 172.21.15.45:0/3835605283 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d540a5e00 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d631ac640 1 -- 172.21.15.45:0/3835605283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 msgr2=0x7f0d5c06c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d631ac640 1 --2- 172.21.15.45:0/3835605283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c06c560 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009d90 tx=0x7f0d5401c850 comp rx=0 tx=0).stop 2023-07-09T02:12:51.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d631ac640 1 -- 172.21.15.45:0/3835605283 shutdown_connections 2023-07-09T02:12:51.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d631ac640 1 --2- 172.21.15.45:0/3835605283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c06c560 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d631ac640 1 -- 172.21.15.45:0/3835605283 >> 172.21.15.45:0/3835605283 conn(0x7f0d5c0694b0 msgr2=0x7f0d5c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:51.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.143+0000 7f0d631ac640 1 -- 172.21.15.45:0/3835605283 shutdown_connections 2023-07-09T02:12:51.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 -- 172.21.15.45:0/3835605283 wait complete. 2023-07-09T02:12:51.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 Processor -- start 2023-07-09T02:12:51.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 -- start start 2023-07-09T02:12:51.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d5c06c110 0x7f0d5c142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c158e30 0x7f0d5c0c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c158710 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c14e540 con 0x7f0d5c158e30 2023-07-09T02:12:51.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d631ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c14e820 con 0x7f0d5c06c110 2023-07-09T02:12:51.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c1581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57214/0 (socket says 172.21.15.45:57214) 2023-07-09T02:12:51.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 -- 172.21.15.45:0/301838868 learned_addr learned my addr 172.21.15.45:0/301838868 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:51.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d61749640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c158e30 0x7f0d5c0c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d60f48640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d5c06c110 0x7f0d5c142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 -- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d5c06c110 msgr2=0x7f0d5c142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d5c06c110 0x7f0d5c142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 -- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c158e30 msgr2=0x7f0d5c0c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c158e30 0x7f0d5c0c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 -- 172.21.15.45:0/301838868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54009a70 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d60f48640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d5c06c110 0x7f0d5c142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.147+0000 7f0d5bfff640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c1581d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c780 tx=0x7f0d4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d597fa640 1 -- 172.21.15.45:0/301838868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480072d0 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d597fa640 1 -- 172.21.15.45:0/301838868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48007450 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d597fa640 1 -- 172.21.15.45:0/301838868 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480047f0 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c14eb00 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c14f0c0 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c04d7d0 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d597fa640 1 -- 172.21.15.45:0/301838868 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d48004950 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d597fa640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d40066280 0x7f0d40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d597fa640 1 -- 172.21.15.45:0/301838868 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d48082e50 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d60f48640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d40066280 0x7f0d40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.151+0000 7f0d60f48640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d40066280 0x7f0d40068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d500098b0 tx=0x7f0d50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.155+0000 7f0d597fa640 1 -- 172.21.15.45:0/301838868 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d480502e0 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d5c06caa0 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d597fa640 1 -- 172.21.15.45:0/301838868 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f0d5c06caa0 con 0x7f0d5c0cb5d0 2023-07-09T02:12:51.346 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:51.346 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:12:51.347 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:12:51.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d40066280 msgr2=0x7f0d40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d40066280 0x7f0d40068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d500098b0 tx=0x7f0d50008040 comp rx=0 tx=0).stop 2023-07-09T02:12:51.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 msgr2=0x7f0d5c1581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c1581d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c780 tx=0x7f0d4800cc40 comp rx=0 tx=0).stop 2023-07-09T02:12:51.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 shutdown_connections 2023-07-09T02:12:51.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d5c158e30 0x7f0d5c0c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d5c0cb5d0 0x7f0d5c1581d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d40066280 0x7f0d40068730 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 --2- 172.21.15.45:0/301838868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d5c06c110 0x7f0d5c142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 >> 172.21.15.45:0/301838868 conn(0x7f0d5c0694b0 msgr2=0x7f0d5c155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:51.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 shutdown_connections 2023-07-09T02:12:51.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.343+0000 7f0d631ac640 1 -- 172.21.15.45:0/301838868 wait complete. 2023-07-09T02:12:51.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:12:51.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.507+0000 7f6794d3a640 1 Processor -- start 2023-07-09T02:12:51.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f6794d3a640 1 -- start start 2023-07-09T02:12:51.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f6794d3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900d2620 0x7f67900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f6794d3a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67900cd120 0x7f67900cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f6794d3a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6790160a50 con 0x7f679015c060 2023-07-09T02:12:51.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f6794d3a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679015c430 con 0x7f67900cd120 2023-07-09T02:12:51.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f6794d3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679015fb60 con 0x7f67900d2620 2023-07-09T02:12:51.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f678ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67900cd120 0x7f67900cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f678ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67900cd120 0x7f67900cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57224/0 (socket says 172.21.15.45:57224) 2023-07-09T02:12:51.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f678ed9d640 1 -- 172.21.15.45:0/1574831075 learned_addr learned my addr 172.21.15.45:0/1574831075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:51.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f6787fff640 1 --2- 172.21.15.45:0/1574831075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900d2620 0x7f67900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f678ed9d640 1 -- 172.21.15.45:0/1574831075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900d2620 msgr2=0x7f67900b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:51.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f678ed9d640 1 --2- 172.21.15.45:0/1574831075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900d2620 0x7f67900b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f678ed9d640 1 -- 172.21.15.45:0/1574831075 >> v1:172.21.15.155:6789/0 conn(0x7f679015c060 legacy=0x7f67900d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.511+0000 7f678ed9d640 1 -- 172.21.15.45:0/1574831075 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679015fe40 con 0x7f67900cd120 2023-07-09T02:12:51.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f678ed9d640 1 --2- 172.21.15.45:0/1574831075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67900cd120 0x7f67900cee30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6788009e50 tx=0x7f678801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e17a7594d798ce4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f678dd9b640 1 -- 172.21.15.45:0/1574831075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880a58a0 con 0x7f67900cd120 2023-07-09T02:12:51.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f678dd9b640 1 -- 172.21.15.45:0/1574831075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67880a5a00 con 0x7f67900cd120 2023-07-09T02:12:51.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f678dd9b640 1 -- 172.21.15.45:0/1574831075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880a5d90 con 0x7f67900cd120 2023-07-09T02:12:51.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 -- 172.21.15.45:0/1574831075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67900cd120 msgr2=0x7f67900cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 --2- 172.21.15.45:0/1574831075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67900cd120 0x7f67900cee30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6788009e50 tx=0x7f678801c9e0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 -- 172.21.15.45:0/1574831075 shutdown_connections 2023-07-09T02:12:51.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 --2- 172.21.15.45:0/1574831075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67900cd120 0x7f67900cee30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 --2- 172.21.15.45:0/1574831075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900d2620 0x7f67900b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 -- 172.21.15.45:0/1574831075 >> 172.21.15.45:0/1574831075 conn(0x7f67900698e0 msgr2=0x7f6790069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:51.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 -- 172.21.15.45:0/1574831075 shutdown_connections 2023-07-09T02:12:51.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 -- 172.21.15.45:0/1574831075 wait complete. 2023-07-09T02:12:51.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 Processor -- start 2023-07-09T02:12:51.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.515+0000 7f6794d3a640 1 -- start start 2023-07-09T02:12:51.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900cd120 0x7f67900cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67900d2620 0x7f6790154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015c060 0x7f67900cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900cb0f0 con 0x7f679015c060 2023-07-09T02:12:51.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900c9b10 con 0x7f67900d2620 2023-07-09T02:12:51.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900c9df0 con 0x7f67900cd120 2023-07-09T02:12:51.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015c060 0x7f67900cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015c060 0x7f67900cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57234/0 (socket says 172.21.15.45:57234) 2023-07-09T02:12:51.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 -- 172.21.15.45:0/2828053203 learned_addr learned my addr 172.21.15.45:0/2828053203 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:51.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678e59c640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900cd120 0x7f67900cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6787fff640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67900d2620 0x7f6790154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 -- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900cd120 msgr2=0x7f67900cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900cd120 0x7f67900cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 -- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67900d2620 msgr2=0x7f6790154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67900d2620 0x7f6790154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 -- 172.21.15.45:0/2828053203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009b30 con 0x7f679015c060 2023-07-09T02:12:51.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678e59c640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900cd120 0x7f67900cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:51.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f678ed9d640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015c060 0x7f67900cb700 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f678801a610 tx=0x7f6788019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6786ffd640 1 -- 172.21.15.45:0/2828053203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880b8670 con 0x7f679015c060 2023-07-09T02:12:51.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6786ffd640 1 -- 172.21.15.45:0/2828053203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67880b87d0 con 0x7f679015c060 2023-07-09T02:12:51.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6786ffd640 1 -- 172.21.15.45:0/2828053203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880b8b80 con 0x7f679015c060 2023-07-09T02:12:51.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67900b59f0 con 0x7f679015c060 2023-07-09T02:12:51.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67900ca3b0 con 0x7f679015c060 2023-07-09T02:12:51.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67900cef70 con 0x7f679015c060 2023-07-09T02:12:51.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.519+0000 7f6786ffd640 1 -- 172.21.15.45:0/2828053203 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f67880b8ce0 con 0x7f679015c060 2023-07-09T02:12:51.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.523+0000 7f6786ffd640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6770066280 0x7f6770068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.523+0000 7f6786ffd640 1 -- 172.21.15.45:0/2828053203 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f678811f320 con 0x7f679015c060 2023-07-09T02:12:51.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.523+0000 7f678e59c640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6770066280 0x7f6770068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.523+0000 7f678e59c640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6770066280 0x7f6770068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6780000f70 tx=0x7f6780009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.527+0000 7f6786ffd640 1 -- 172.21.15.45:0/2828053203 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67880ec8e0 con 0x7f679015c060 2023-07-09T02:12:51.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.679+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f679004d7d0 con 0x7f679015c060 2023-07-09T02:12:51.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6786ffd640 1 -- 172.21.15.45:0/2828053203 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f67880eff00 con 0x7f679015c060 2023-07-09T02:12:51.686 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:51.686 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":48,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:12:48.928396+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:45.075187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:46.325197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:12:51.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6770066280 msgr2=0x7f6770068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6770066280 0x7f6770068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6780000f70 tx=0x7f6780009040 comp rx=0 tx=0).stop 2023-07-09T02:12:51.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015c060 msgr2=0x7f67900cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015c060 0x7f67900cb700 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f678801a610 tx=0x7f6788019780 comp rx=0 tx=0).stop 2023-07-09T02:12:51.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 shutdown_connections 2023-07-09T02:12:51.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f679015c060 0x7f67900cb700 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67900d2620 0x7f6790154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6770066280 0x7f6770068730 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 --2- 172.21.15.45:0/2828053203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67900cd120 0x7f67900cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 >> 172.21.15.45:0/2828053203 conn(0x7f67900698e0 msgr2=0x7f67900b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:51.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 shutdown_connections 2023-07-09T02:12:51.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.683+0000 7f6794d3a640 1 -- 172.21.15.45:0/2828053203 wait complete. 2023-07-09T02:12:51.707 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:12:51.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:12:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f1425500640 1 Processor -- start 2023-07-09T02:12:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f1425500640 1 -- start start 2023-07-09T02:12:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f1425500640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f14200cd120 0x7f14200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f1425500640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1420160a50 con 0x7f14200d2620 2023-07-09T02:12:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f1425500640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142015c430 con 0x7f142015c060 2023-07-09T02:12:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f1425500640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142015fb60 con 0x7f14200cd120 2023-07-09T02:12:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f141f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f14200cd120 0x7f14200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f1417fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f14200d2620 0x7f14200cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47942/0 (socket says 172.21.15.45:47942) 2023-07-09T02:12:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.847+0000 7f1417fff640 1 -- 172.21.15.45:0/214287224 learned_addr learned my addr 172.21.15.45:0/214287224 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f141f7fe640 1 -- 172.21.15.45:0/214287224 >> v1:172.21.15.155:6789/0 conn(0x7f142015c060 legacy=0x7f14200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f141f7fe640 1 -- 172.21.15.45:0/214287224 >> v1:172.21.15.45:6789/0 conn(0x7f14200d2620 legacy=0x7f14200cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f141f7fe640 1 -- 172.21.15.45:0/214287224 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142015fe40 con 0x7f14200cd120 2023-07-09T02:12:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f141e7fc640 1 -- 172.21.15.45:0/214287224 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598851431 0 0) 0x7f1420160a50 con 0x7f14200d2620 2023-07-09T02:12:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f141f7fe640 1 --2- 172.21.15.45:0/214287224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200b4ed0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1418009d90 tx=0x7f141801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f370aba3067f1ad server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f141e7fc640 1 -- 172.21.15.45:0/214287224 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180a59e0 con 0x7f14200cd120 2023-07-09T02:12:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f141e7fc640 1 -- 172.21.15.45:0/214287224 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14180a5b40 con 0x7f14200cd120 2023-07-09T02:12:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f141e7fc640 1 -- 172.21.15.45:0/214287224 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180ad440 con 0x7f14200cd120 2023-07-09T02:12:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f1425500640 1 -- 172.21.15.45:0/214287224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 msgr2=0x7f14200b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f1425500640 1 --2- 172.21.15.45:0/214287224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200b4ed0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1418009d90 tx=0x7f141801c920 comp rx=0 tx=0).stop 2023-07-09T02:12:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f1425500640 1 -- 172.21.15.45:0/214287224 shutdown_connections 2023-07-09T02:12:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f1425500640 1 --2- 172.21.15.45:0/214287224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200b4ed0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.851+0000 7f1425500640 1 -- 172.21.15.45:0/214287224 >> 172.21.15.45:0/214287224 conn(0x7f14200698e0 msgr2=0x7f1420069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 -- 172.21.15.45:0/214287224 shutdown_connections 2023-07-09T02:12:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 -- 172.21.15.45:0/214287224 wait complete. 2023-07-09T02:12:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 Processor -- start 2023-07-09T02:12:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 -- start start 2023-07-09T02:12:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14200d2620 0x7f142015e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f142015c060 0x7f1420151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200cac20 con 0x7f14200cd120 2023-07-09T02:12:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200ca010 con 0x7f14200d2620 2023-07-09T02:12:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14200ca2f0 con 0x7f142015c060 2023-07-09T02:12:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41942/0 (socket says 172.21.15.45:41942) 2023-07-09T02:12:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 -- 172.21.15.45:0/809055951 learned_addr learned my addr 172.21.15.45:0/809055951 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1417fff640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14200d2620 0x7f142015e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141f7fe640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f142015c060 0x7f1420151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 -- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f142015c060 msgr2=0x7f1420151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f142015c060 0x7f1420151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 -- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14200d2620 msgr2=0x7f142015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14200d2620 0x7f142015e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 -- 172.21.15.45:0/809055951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418009a70 con 0x7f14200cd120 2023-07-09T02:12:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f141effd640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200cb0b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f141000c3c0 tx=0x7f141000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f14177fe640 1 -- 172.21.15.45:0/809055951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100052d0 con 0x7f14200cd120 2023-07-09T02:12:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f14177fe640 1 -- 172.21.15.45:0/809055951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410005430 con 0x7f14200cd120 2023-07-09T02:12:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.855+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14200b59f0 con 0x7f14200cd120 2023-07-09T02:12:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.859+0000 7f14177fe640 1 -- 172.21.15.45:0/809055951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410003840 con 0x7f14200cd120 2023-07-09T02:12:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.859+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14200ca8b0 con 0x7f14200cd120 2023-07-09T02:12:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.859+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142004d7d0 con 0x7f14200cd120 2023-07-09T02:12:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.859+0000 7f14177fe640 1 -- 172.21.15.45:0/809055951 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14100039a0 con 0x7f14200cd120 2023-07-09T02:12:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.859+0000 7f14177fe640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1400066280 0x7f1400068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.859+0000 7f14177fe640 1 -- 172.21.15.45:0/809055951 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1410083310 con 0x7f14200cd120 2023-07-09T02:12:51.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.859+0000 7f1417fff640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1400066280 0x7f1400068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:51.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.863+0000 7f1417fff640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1400066280 0x7f1400068730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1408007fd0 tx=0x7f1408007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:51.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:51.863+0000 7f14177fe640 1 -- 172.21.15.45:0/809055951 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14100506f0 con 0x7f14200cd120 2023-07-09T02:12:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.015+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14200b5870 con 0x7f1400066280 2023-07-09T02:12:52.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.023+0000 7f14177fe640 1 -- 172.21.15.45:0/809055951 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305647 (secure 0 0 0) 0x7f1408007170 con 0x7f1400066280 2023-07-09T02:12:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:52.034 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:12:52.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1400066280 msgr2=0x7f1400068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1400066280 0x7f1400068730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1408007fd0 tx=0x7f1408007ba0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 msgr2=0x7f14200cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200cb0b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f141000c3c0 tx=0x7f141000c880 comp rx=0 tx=0).stop 2023-07-09T02:12:52.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 shutdown_connections 2023-07-09T02:12:52.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1400066280 0x7f1400068730 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f142015c060 0x7f1420151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14200d2620 0x7f142015e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 --2- 172.21.15.45:0/809055951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14200cd120 0x7f14200cb0b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 >> 172.21.15.45:0/809055951 conn(0x7f14200698e0 msgr2=0x7f14200d1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 shutdown_connections 2023-07-09T02:12:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.027+0000 7f1425500640 1 -- 172.21.15.45:0/809055951 wait complete. 2023-07-09T02:12:52.051 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-07-09T02:12:50.547201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3033,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559466,"statfs":{"total":1600000000,"available":1596893465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.627959"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972675+0000","last_change":"2023-07-09T02:12:47.942096+0000","last_active":"2023-07-09T02:12:49.972675+0000","last_peered":"2023-07-09T02:12:49.972675+0000","last_clean":"2023-07-09T02:12:49.972675+0000","last_became_active":"2023-07-09T02:12:47.941833+0000","last_became_peered":"2023-07-09T02:12:47.941833+0000","last_unstale":"2023-07-09T02:12:49.972675+0000","last_undegraded":"2023-07-09T02:12:49.972675+0000","last_fullsized":"2023-07-09T02:12:49.972675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:28:44.185597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983262+0000","last_change":"2023-07-09T02:12:47.939153+0000","last_active":"2023-07-09T02:12:48.983262+0000","last_peered":"2023-07-09T02:12:48.983262+0000","last_clean":"2023-07-09T02:12:48.983262+0000","last_became_active":"2023-07-09T02:12:47.938905+0000","last_became_peered":"2023-07-09T02:12:47.938905+0000","last_unstale":"2023-07-09T02:12:48.983262+0000","last_undegraded":"2023-07-09T02:12:48.983262+0000","last_fullsized":"2023-07-09T02:12:48.983262+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:27:18.298549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933392+0000","last_change":"2023-07-09T02:12:47.938833+0000","last_active":"2023-07-09T02:12:48.933392+0000","last_peered":"2023-07-09T02:12:48.933392+0000","last_clean":"2023-07-09T02:12:48.933392+0000","last_became_active":"2023-07-09T02:12:47.938612+0000","last_became_peered":"2023-07-09T02:12:47.938612+0000","last_unstale":"2023-07-09T02:12:48.933392+0000","last_undegraded":"2023-07-09T02:12:48.933392+0000","last_fullsized":"2023-07-09T02:12:48.933392+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:20:14.220427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983308+0000","last_change":"2023-07-09T02:12:47.943492+0000","last_active":"2023-07-09T02:12:48.983308+0000","last_peered":"2023-07-09T02:12:48.983308+0000","last_clean":"2023-07-09T02:12:48.983308+0000","last_became_active":"2023-07-09T02:12:47.943265+0000","last_became_peered":"2023-07-09T02:12:47.943265+0000","last_unstale":"2023-07-09T02:12:48.983308+0000","last_undegraded":"2023-07-09T02:12:48.983308+0000","last_fullsized":"2023-07-09T02:12:48.983308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:34.131486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972296+0000","last_change":"2023-07-09T02:12:47.940312+0000","last_active":"2023-07-09T02:12:48.972296+0000","last_peered":"2023-07-09T02:12:48.972296+0000","last_clean":"2023-07-09T02:12:48.972296+0000","last_became_active":"2023-07-09T02:12:47.939866+0000","last_became_peered":"2023-07-09T02:12:47.939866+0000","last_unstale":"2023-07-09T02:12:48.972296+0000","last_undegraded":"2023-07-09T02:12:48.972296+0000","last_fullsized":"2023-07-09T02:12:48.972296+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:04:46.632880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972935+0000","last_change":"2023-07-09T02:12:47.942999+0000","last_active":"2023-07-09T02:12:49.972935+0000","last_peered":"2023-07-09T02:12:49.972935+0000","last_clean":"2023-07-09T02:12:49.972935+0000","last_became_active":"2023-07-09T02:12:47.942658+0000","last_became_peered":"2023-07-09T02:12:47.942658+0000","last_unstale":"2023-07-09T02:12:49.972935+0000","last_undegraded":"2023-07-09T02:12:49.972935+0000","last_fullsized":"2023-07-09T02:12:49.972935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:23:15.987610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933224+0000","last_change":"2023-07-09T02:12:47.933473+0000","last_active":"2023-07-09T02:12:48.933224+0000","last_peered":"2023-07-09T02:12:48.933224+0000","last_clean":"2023-07-09T02:12:48.933224+0000","last_became_active":"2023-07-09T02:12:47.933229+0000","last_became_peered":"2023-07-09T02:12:47.933229+0000","last_unstale":"2023-07-09T02:12:48.933224+0000","last_undegraded":"2023-07-09T02:12:48.933224+0000","last_fullsized":"2023-07-09T02:12:48.933224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:29.196936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931808+0000","last_change":"2023-07-09T02:12:47.948470+0000","last_active":"2023-07-09T02:12:48.931808+0000","last_peered":"2023-07-09T02:12:48.931808+0000","last_clean":"2023-07-09T02:12:48.931808+0000","last_became_active":"2023-07-09T02:12:47.948097+0000","last_became_peered":"2023-07-09T02:12:47.948097+0000","last_unstale":"2023-07-09T02:12:48.931808+0000","last_undegraded":"2023-07-09T02:12:48.931808+0000","last_fullsized":"2023-07-09T02:12:48.931808+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:20:35.628274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931793+0000","last_change":"2023-07-09T02:12:47.952401+0000","last_active":"2023-07-09T02:12:48.931793+0000","last_peered":"2023-07-09T02:12:48.931793+0000","last_clean":"2023-07-09T02:12:48.931793+0000","last_became_active":"2023-07-09T02:12:47.951992+0000","last_became_peered":"2023-07-09T02:12:47.951992+0000","last_unstale":"2023-07-09T02:12:48.931793+0000","last_undegraded":"2023-07-09T02:12:48.931793+0000","last_fullsized":"2023-07-09T02:12:48.931793+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:54:12.288457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972650+0000","last_change":"2023-07-09T02:12:47.943114+0000","last_active":"2023-07-09T02:12:49.972650+0000","last_peered":"2023-07-09T02:12:49.972650+0000","last_clean":"2023-07-09T02:12:49.972650+0000","last_became_active":"2023-07-09T02:12:47.942772+0000","last_became_peered":"2023-07-09T02:12:47.942772+0000","last_unstale":"2023-07-09T02:12:49.972650+0000","last_undegraded":"2023-07-09T02:12:49.972650+0000","last_fullsized":"2023-07-09T02:12:49.972650+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:07:06.725253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.984968+0000","last_change":"2023-07-09T02:12:47.933042+0000","last_active":"2023-07-09T02:12:48.984968+0000","last_peered":"2023-07-09T02:12:48.984968+0000","last_clean":"2023-07-09T02:12:48.984968+0000","last_became_active":"2023-07-09T02:12:47.932809+0000","last_became_peered":"2023-07-09T02:12:47.932809+0000","last_unstale":"2023-07-09T02:12:48.984968+0000","last_undegraded":"2023-07-09T02:12:48.984968+0000","last_fullsized":"2023-07-09T02:12:48.984968+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:31:03.185948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932099+0000","last_change":"2023-07-09T02:12:47.949586+0000","last_active":"2023-07-09T02:12:48.932099+0000","last_peered":"2023-07-09T02:12:48.932099+0000","last_clean":"2023-07-09T02:12:48.932099+0000","last_became_active":"2023-07-09T02:12:47.949124+0000","last_became_peered":"2023-07-09T02:12:47.949124+0000","last_unstale":"2023-07-09T02:12:48.932099+0000","last_undegraded":"2023-07-09T02:12:48.932099+0000","last_fullsized":"2023-07-09T02:12:48.932099+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:01:39.726596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972510+0000","last_change":"2023-07-09T02:12:47.943854+0000","last_active":"2023-07-09T02:12:49.972510+0000","last_peered":"2023-07-09T02:12:49.972510+0000","last_clean":"2023-07-09T02:12:49.972510+0000","last_became_active":"2023-07-09T02:12:47.943368+0000","last_became_peered":"2023-07-09T02:12:47.943368+0000","last_unstale":"2023-07-09T02:12:49.972510+0000","last_undegraded":"2023-07-09T02:12:49.972510+0000","last_fullsized":"2023-07-09T02:12:49.972510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:01:43.389798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933239+0000","last_change":"2023-07-09T02:12:47.937522+0000","last_active":"2023-07-09T02:12:48.933239+0000","last_peered":"2023-07-09T02:12:48.933239+0000","last_clean":"2023-07-09T02:12:48.933239+0000","last_became_active":"2023-07-09T02:12:47.936968+0000","last_became_peered":"2023-07-09T02:12:47.936968+0000","last_unstale":"2023-07-09T02:12:48.933239+0000","last_undegraded":"2023-07-09T02:12:48.933239+0000","last_fullsized":"2023-07-09T02:12:48.933239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:05.436560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983482+0000","last_change":"2023-07-09T02:12:47.938050+0000","last_active":"2023-07-09T02:12:48.983482+0000","last_peered":"2023-07-09T02:12:48.983482+0000","last_clean":"2023-07-09T02:12:48.983482+0000","last_became_active":"2023-07-09T02:12:47.937826+0000","last_became_peered":"2023-07-09T02:12:47.937826+0000","last_unstale":"2023-07-09T02:12:48.983482+0000","last_undegraded":"2023-07-09T02:12:48.983482+0000","last_fullsized":"2023-07-09T02:12:48.983482+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:49:06.270138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972819+0000","last_change":"2023-07-09T02:12:47.942863+0000","last_active":"2023-07-09T02:12:49.972819+0000","last_peered":"2023-07-09T02:12:49.972819+0000","last_clean":"2023-07-09T02:12:49.972819+0000","last_became_active":"2023-07-09T02:12:47.942329+0000","last_became_peered":"2023-07-09T02:12:47.942329+0000","last_unstale":"2023-07-09T02:12:49.972819+0000","last_undegraded":"2023-07-09T02:12:49.972819+0000","last_fullsized":"2023-07-09T02:12:49.972819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:05.370790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933406+0000","last_change":"2023-07-09T02:12:47.939689+0000","last_active":"2023-07-09T02:12:48.933406+0000","last_peered":"2023-07-09T02:12:48.933406+0000","last_clean":"2023-07-09T02:12:48.933406+0000","last_became_active":"2023-07-09T02:12:47.939383+0000","last_became_peered":"2023-07-09T02:12:47.939383+0000","last_unstale":"2023-07-09T02:12:48.933406+0000","last_undegraded":"2023-07-09T02:12:48.933406+0000","last_fullsized":"2023-07-09T02:12:48.933406+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:29:10.485005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983235+0000","last_change":"2023-07-09T02:12:47.940460+0000","last_active":"2023-07-09T02:12:48.983235+0000","last_peered":"2023-07-09T02:12:48.983235+0000","last_clean":"2023-07-09T02:12:48.983235+0000","last_became_active":"2023-07-09T02:12:47.939556+0000","last_became_peered":"2023-07-09T02:12:47.939556+0000","last_unstale":"2023-07-09T02:12:48.983235+0000","last_undegraded":"2023-07-09T02:12:48.983235+0000","last_fullsized":"2023-07-09T02:12:48.983235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:26.958581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933102+0000","last_change":"2023-07-09T02:12:47.935577+0000","last_active":"2023-07-09T02:12:48.933102+0000","last_peered":"2023-07-09T02:12:48.933102+0000","last_clean":"2023-07-09T02:12:48.933102+0000","last_became_active":"2023-07-09T02:12:47.935319+0000","last_became_peered":"2023-07-09T02:12:47.935319+0000","last_unstale":"2023-07-09T02:12:48.933102+0000","last_undegraded":"2023-07-09T02:12:48.933102+0000","last_fullsized":"2023-07-09T02:12:48.933102+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:54:12.288457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971518+0000","last_change":"2023-07-09T02:12:47.942612+0000","last_active":"2023-07-09T02:12:49.971518+0000","last_peered":"2023-07-09T02:12:49.971518+0000","last_clean":"2023-07-09T02:12:49.971518+0000","last_became_active":"2023-07-09T02:12:47.942194+0000","last_became_peered":"2023-07-09T02:12:47.942194+0000","last_unstale":"2023-07-09T02:12:49.971518+0000","last_undegraded":"2023-07-09T02:12:49.971518+0000","last_fullsized":"2023-07-09T02:12:49.971518+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:31:37.315073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971362+0000","last_change":"2023-07-09T02:12:47.943520+0000","last_active":"2023-07-09T02:12:49.971362+0000","last_peered":"2023-07-09T02:12:49.971362+0000","last_clean":"2023-07-09T02:12:49.971362+0000","last_became_active":"2023-07-09T02:12:47.943158+0000","last_became_peered":"2023-07-09T02:12:47.943158+0000","last_unstale":"2023-07-09T02:12:49.971362+0000","last_undegraded":"2023-07-09T02:12:49.971362+0000","last_fullsized":"2023-07-09T02:12:49.971362+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:40:37.083841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932233+0000","last_change":"2023-07-09T02:12:47.949417+0000","last_active":"2023-07-09T02:12:48.932233+0000","last_peered":"2023-07-09T02:12:48.932233+0000","last_clean":"2023-07-09T02:12:48.932233+0000","last_became_active":"2023-07-09T02:12:47.948801+0000","last_became_peered":"2023-07-09T02:12:47.948801+0000","last_unstale":"2023-07-09T02:12:48.932233+0000","last_undegraded":"2023-07-09T02:12:48.932233+0000","last_fullsized":"2023-07-09T02:12:48.932233+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:17:53.451294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.984967+0000","last_change":"2023-07-09T02:12:47.935715+0000","last_active":"2023-07-09T02:12:48.984967+0000","last_peered":"2023-07-09T02:12:48.984967+0000","last_clean":"2023-07-09T02:12:48.984967+0000","last_became_active":"2023-07-09T02:12:47.935488+0000","last_became_peered":"2023-07-09T02:12:47.935488+0000","last_unstale":"2023-07-09T02:12:48.984967+0000","last_undegraded":"2023-07-09T02:12:48.984967+0000","last_fullsized":"2023-07-09T02:12:48.984967+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:49:48.709481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933371+0000","last_change":"2023-07-09T02:12:47.937654+0000","last_active":"2023-07-09T02:12:48.933371+0000","last_peered":"2023-07-09T02:12:48.933371+0000","last_clean":"2023-07-09T02:12:48.933371+0000","last_became_active":"2023-07-09T02:12:47.937278+0000","last_became_peered":"2023-07-09T02:12:47.937278+0000","last_unstale":"2023-07-09T02:12:48.933371+0000","last_undegraded":"2023-07-09T02:12:48.933371+0000","last_fullsized":"2023-07-09T02:12:48.933371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:29.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933225+0000","last_change":"2023-07-09T02:12:47.945016+0000","last_active":"2023-07-09T02:12:48.933225+0000","last_peered":"2023-07-09T02:12:48.933225+0000","last_clean":"2023-07-09T02:12:48.933225+0000","last_became_active":"2023-07-09T02:12:47.944772+0000","last_became_peered":"2023-07-09T02:12:47.944772+0000","last_unstale":"2023-07-09T02:12:48.933225+0000","last_undegraded":"2023-07-09T02:12:48.933225+0000","last_fullsized":"2023-07-09T02:12:48.933225+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:48.820706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931963+0000","last_change":"2023-07-09T02:12:47.943391+0000","last_active":"2023-07-09T02:12:48.931963+0000","last_peered":"2023-07-09T02:12:48.931963+0000","last_clean":"2023-07-09T02:12:48.931963+0000","last_became_active":"2023-07-09T02:12:47.943155+0000","last_became_peered":"2023-07-09T02:12:47.943155+0000","last_unstale":"2023-07-09T02:12:48.931963+0000","last_undegraded":"2023-07-09T02:12:48.931963+0000","last_fullsized":"2023-07-09T02:12:48.931963+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:48.820706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972560+0000","last_change":"2023-07-09T02:12:47.941350+0000","last_active":"2023-07-09T02:12:49.972560+0000","last_peered":"2023-07-09T02:12:49.972560+0000","last_clean":"2023-07-09T02:12:49.972560+0000","last_became_active":"2023-07-09T02:12:47.941140+0000","last_became_peered":"2023-07-09T02:12:47.941140+0000","last_unstale":"2023-07-09T02:12:49.972560+0000","last_undegraded":"2023-07-09T02:12:49.972560+0000","last_fullsized":"2023-07-09T02:12:49.972560+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:06:32.827087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971438+0000","last_change":"2023-07-09T02:12:47.937616+0000","last_active":"2023-07-09T02:12:49.971438+0000","last_peered":"2023-07-09T02:12:49.971438+0000","last_clean":"2023-07-09T02:12:49.971438+0000","last_became_active":"2023-07-09T02:12:47.937342+0000","last_became_peered":"2023-07-09T02:12:47.937342+0000","last_unstale":"2023-07-09T02:12:49.971438+0000","last_undegraded":"2023-07-09T02:12:49.971438+0000","last_fullsized":"2023-07-09T02:12:49.971438+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:58:52.001996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933499+0000","last_change":"2023-07-09T02:12:47.939909+0000","last_active":"2023-07-09T02:12:48.933499+0000","last_peered":"2023-07-09T02:12:48.933499+0000","last_clean":"2023-07-09T02:12:48.933499+0000","last_became_active":"2023-07-09T02:12:47.939644+0000","last_became_peered":"2023-07-09T02:12:47.939644+0000","last_unstale":"2023-07-09T02:12:48.933499+0000","last_undegraded":"2023-07-09T02:12:48.933499+0000","last_fullsized":"2023-07-09T02:12:48.933499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:17:53.451294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983601+0000","last_change":"2023-07-09T02:12:47.940734+0000","last_active":"2023-07-09T02:12:48.983601+0000","last_peered":"2023-07-09T02:12:48.983601+0000","last_clean":"2023-07-09T02:12:48.983601+0000","last_became_active":"2023-07-09T02:12:47.940366+0000","last_became_peered":"2023-07-09T02:12:47.940366+0000","last_unstale":"2023-07-09T02:12:48.983601+0000","last_undegraded":"2023-07-09T02:12:48.983601+0000","last_fullsized":"2023-07-09T02:12:48.983601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:08.797313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933242+0000","last_change":"2023-07-09T02:12:47.936538+0000","last_active":"2023-07-09T02:12:48.933242+0000","last_peered":"2023-07-09T02:12:48.933242+0000","last_clean":"2023-07-09T02:12:48.933242+0000","last_became_active":"2023-07-09T02:12:47.936333+0000","last_became_peered":"2023-07-09T02:12:47.936333+0000","last_unstale":"2023-07-09T02:12:48.933242+0000","last_undegraded":"2023-07-09T02:12:48.933242+0000","last_fullsized":"2023-07-09T02:12:48.933242+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:39:39.078505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931912+0000","last_change":"2023-07-09T02:12:47.944165+0000","last_active":"2023-07-09T02:12:48.931912+0000","last_peered":"2023-07-09T02:12:48.931912+0000","last_clean":"2023-07-09T02:12:48.931912+0000","last_became_active":"2023-07-09T02:12:47.943884+0000","last_became_peered":"2023-07-09T02:12:47.943884+0000","last_unstale":"2023-07-09T02:12:48.931912+0000","last_undegraded":"2023-07-09T02:12:48.931912+0000","last_fullsized":"2023-07-09T02:12:48.931912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:12:37.600529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983485+0000","last_change":"2023-07-09T02:12:47.940315+0000","last_active":"2023-07-09T02:12:48.983485+0000","last_peered":"2023-07-09T02:12:48.983485+0000","last_clean":"2023-07-09T02:12:48.983485+0000","last_became_active":"2023-07-09T02:12:47.939242+0000","last_became_peered":"2023-07-09T02:12:47.939242+0000","last_unstale":"2023-07-09T02:12:48.983485+0000","last_undegraded":"2023-07-09T02:12:48.983485+0000","last_fullsized":"2023-07-09T02:12:48.983485+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:34:56.998195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971591+0000","last_change":"2023-07-09T02:12:46.936252+0000","last_active":"2023-07-09T02:12:49.971591+0000","last_peered":"2023-07-09T02:12:49.971591+0000","last_clean":"2023-07-09T02:12:49.971591+0000","last_became_active":"2023-07-09T02:12:46.935972+0000","last_became_peered":"2023-07-09T02:12:46.935972+0000","last_unstale":"2023-07-09T02:12:49.971591+0000","last_undegraded":"2023-07-09T02:12:49.971591+0000","last_fullsized":"2023-07-09T02:12:49.971591+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:33.827220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932057+0000","last_change":"2023-07-09T02:12:47.940927+0000","last_active":"2023-07-09T02:12:48.932057+0000","last_peered":"2023-07-09T02:12:48.932057+0000","last_clean":"2023-07-09T02:12:48.932057+0000","last_became_active":"2023-07-09T02:12:47.940563+0000","last_became_peered":"2023-07-09T02:12:47.940563+0000","last_unstale":"2023-07-09T02:12:48.932057+0000","last_undegraded":"2023-07-09T02:12:48.932057+0000","last_fullsized":"2023-07-09T02:12:48.932057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:28:01.400991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972450+0000","last_change":"2023-07-09T02:12:46.943588+0000","last_active":"2023-07-09T02:12:49.972450+0000","last_peered":"2023-07-09T02:12:49.972450+0000","last_clean":"2023-07-09T02:12:49.972450+0000","last_became_active":"2023-07-09T02:12:46.943367+0000","last_became_peered":"2023-07-09T02:12:46.943367+0000","last_unstale":"2023-07-09T02:12:49.972450+0000","last_undegraded":"2023-07-09T02:12:49.972450+0000","last_fullsized":"2023-07-09T02:12:49.972450+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:59.527240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971536+0000","last_change":"2023-07-09T02:12:47.943374+0000","last_active":"2023-07-09T02:12:49.971536+0000","last_peered":"2023-07-09T02:12:49.971536+0000","last_clean":"2023-07-09T02:12:49.971536+0000","last_became_active":"2023-07-09T02:12:47.942793+0000","last_became_peered":"2023-07-09T02:12:47.942793+0000","last_unstale":"2023-07-09T02:12:49.971536+0000","last_undegraded":"2023-07-09T02:12:49.971536+0000","last_fullsized":"2023-07-09T02:12:49.971536+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:20.771703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973015+0000","last_change":"2023-07-09T02:12:46.942709+0000","last_active":"2023-07-09T02:12:49.973015+0000","last_peered":"2023-07-09T02:12:49.973015+0000","last_clean":"2023-07-09T02:12:49.973015+0000","last_became_active":"2023-07-09T02:12:46.942421+0000","last_became_peered":"2023-07-09T02:12:46.942421+0000","last_unstale":"2023-07-09T02:12:49.973015+0000","last_undegraded":"2023-07-09T02:12:49.973015+0000","last_fullsized":"2023-07-09T02:12:49.973015+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:37:30.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932135+0000","last_change":"2023-07-09T02:12:47.940997+0000","last_active":"2023-07-09T02:12:48.932135+0000","last_peered":"2023-07-09T02:12:48.932135+0000","last_clean":"2023-07-09T02:12:48.932135+0000","last_became_active":"2023-07-09T02:12:47.940779+0000","last_became_peered":"2023-07-09T02:12:47.940779+0000","last_unstale":"2023-07-09T02:12:48.932135+0000","last_undegraded":"2023-07-09T02:12:48.932135+0000","last_fullsized":"2023-07-09T02:12:48.932135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:29.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932358+0000","last_change":"2023-07-09T02:12:46.931162+0000","last_active":"2023-07-09T02:12:48.932358+0000","last_peered":"2023-07-09T02:12:48.932358+0000","last_clean":"2023-07-09T02:12:48.932358+0000","last_became_active":"2023-07-09T02:12:46.930946+0000","last_became_peered":"2023-07-09T02:12:46.930946+0000","last_unstale":"2023-07-09T02:12:48.932358+0000","last_undegraded":"2023-07-09T02:12:48.932358+0000","last_fullsized":"2023-07-09T02:12:48.932358+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:58:31.222267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972082+0000","last_change":"2023-07-09T02:12:47.937626+0000","last_active":"2023-07-09T02:12:48.972082+0000","last_peered":"2023-07-09T02:12:48.972082+0000","last_clean":"2023-07-09T02:12:48.972082+0000","last_became_active":"2023-07-09T02:12:47.936241+0000","last_became_peered":"2023-07-09T02:12:47.936241+0000","last_unstale":"2023-07-09T02:12:48.972082+0000","last_undegraded":"2023-07-09T02:12:48.972082+0000","last_fullsized":"2023-07-09T02:12:48.972082+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:51:36.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933721+0000","last_change":"2023-07-09T02:12:46.938451+0000","last_active":"2023-07-09T02:12:48.933721+0000","last_peered":"2023-07-09T02:12:48.933721+0000","last_clean":"2023-07-09T02:12:48.933721+0000","last_became_active":"2023-07-09T02:12:46.938019+0000","last_became_peered":"2023-07-09T02:12:46.938019+0000","last_unstale":"2023-07-09T02:12:48.933721+0000","last_undegraded":"2023-07-09T02:12:48.933721+0000","last_fullsized":"2023-07-09T02:12:48.933721+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:07:05.716582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983344+0000","last_change":"2023-07-09T02:12:47.940894+0000","last_active":"2023-07-09T02:12:48.983344+0000","last_peered":"2023-07-09T02:12:48.983344+0000","last_clean":"2023-07-09T02:12:48.983344+0000","last_became_active":"2023-07-09T02:12:47.940658+0000","last_became_peered":"2023-07-09T02:12:47.940658+0000","last_unstale":"2023-07-09T02:12:48.983344+0000","last_undegraded":"2023-07-09T02:12:48.983344+0000","last_fullsized":"2023-07-09T02:12:48.983344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:59:22.259962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.971974+0000","last_change":"2023-07-09T02:12:46.937614+0000","last_active":"2023-07-09T02:12:48.971974+0000","last_peered":"2023-07-09T02:12:48.971974+0000","last_clean":"2023-07-09T02:12:48.971974+0000","last_became_active":"2023-07-09T02:12:46.937192+0000","last_became_peered":"2023-07-09T02:12:46.937192+0000","last_unstale":"2023-07-09T02:12:48.971974+0000","last_undegraded":"2023-07-09T02:12:48.971974+0000","last_fullsized":"2023-07-09T02:12:48.971974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:00:52.100191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932432+0000","last_change":"2023-07-09T02:12:47.950073+0000","last_active":"2023-07-09T02:12:48.932432+0000","last_peered":"2023-07-09T02:12:48.932432+0000","last_clean":"2023-07-09T02:12:48.932432+0000","last_became_active":"2023-07-09T02:12:47.949811+0000","last_became_peered":"2023-07-09T02:12:47.949811+0000","last_unstale":"2023-07-09T02:12:48.932432+0000","last_undegraded":"2023-07-09T02:12:48.932432+0000","last_fullsized":"2023-07-09T02:12:48.932432+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:42:52.374840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971517+0000","last_change":"2023-07-09T02:12:46.935291+0000","last_active":"2023-07-09T02:12:49.971517+0000","last_peered":"2023-07-09T02:12:49.971517+0000","last_clean":"2023-07-09T02:12:49.971517+0000","last_became_active":"2023-07-09T02:12:46.935042+0000","last_became_peered":"2023-07-09T02:12:46.935042+0000","last_unstale":"2023-07-09T02:12:49.971517+0000","last_undegraded":"2023-07-09T02:12:49.971517+0000","last_fullsized":"2023-07-09T02:12:49.971517+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:31:06.810848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983633+0000","last_change":"2023-07-09T02:12:47.933739+0000","last_active":"2023-07-09T02:12:48.983633+0000","last_peered":"2023-07-09T02:12:48.983633+0000","last_clean":"2023-07-09T02:12:48.983633+0000","last_became_active":"2023-07-09T02:12:47.933512+0000","last_became_peered":"2023-07-09T02:12:47.933512+0000","last_unstale":"2023-07-09T02:12:48.983633+0000","last_undegraded":"2023-07-09T02:12:48.983633+0000","last_fullsized":"2023-07-09T02:12:48.983633+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:25.039230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933518+0000","last_change":"2023-07-09T02:12:46.942095+0000","last_active":"2023-07-09T02:12:48.933518+0000","last_peered":"2023-07-09T02:12:48.933518+0000","last_clean":"2023-07-09T02:12:48.933518+0000","last_became_active":"2023-07-09T02:12:46.941725+0000","last_became_peered":"2023-07-09T02:12:46.941725+0000","last_unstale":"2023-07-09T02:12:48.933518+0000","last_undegraded":"2023-07-09T02:12:48.933518+0000","last_fullsized":"2023-07-09T02:12:48.933518+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:13:50.709158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972145+0000","last_change":"2023-07-09T02:12:47.943386+0000","last_active":"2023-07-09T02:12:48.972145+0000","last_peered":"2023-07-09T02:12:48.972145+0000","last_clean":"2023-07-09T02:12:48.972145+0000","last_became_active":"2023-07-09T02:12:47.941674+0000","last_became_peered":"2023-07-09T02:12:47.941674+0000","last_unstale":"2023-07-09T02:12:48.972145+0000","last_undegraded":"2023-07-09T02:12:48.972145+0000","last_fullsized":"2023-07-09T02:12:48.972145+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:24:08.104713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983701+0000","last_change":"2023-07-09T02:12:46.938916+0000","last_active":"2023-07-09T02:12:48.983701+0000","last_peered":"2023-07-09T02:12:48.983701+0000","last_clean":"2023-07-09T02:12:48.983701+0000","last_became_active":"2023-07-09T02:12:46.938691+0000","last_became_peered":"2023-07-09T02:12:46.938691+0000","last_unstale":"2023-07-09T02:12:48.983701+0000","last_undegraded":"2023-07-09T02:12:48.983701+0000","last_fullsized":"2023-07-09T02:12:48.983701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:40:52.675215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931879+0000","last_change":"2023-07-09T02:12:47.941586+0000","last_active":"2023-07-09T02:12:48.931879+0000","last_peered":"2023-07-09T02:12:48.931879+0000","last_clean":"2023-07-09T02:12:48.931879+0000","last_became_active":"2023-07-09T02:12:47.941348+0000","last_became_peered":"2023-07-09T02:12:47.941348+0000","last_unstale":"2023-07-09T02:12:48.931879+0000","last_undegraded":"2023-07-09T02:12:48.931879+0000","last_fullsized":"2023-07-09T02:12:48.931879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:03:16.682093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972192+0000","last_change":"2023-07-09T02:12:46.929785+0000","last_active":"2023-07-09T02:12:48.972192+0000","last_peered":"2023-07-09T02:12:48.972192+0000","last_clean":"2023-07-09T02:12:48.972192+0000","last_became_active":"2023-07-09T02:12:46.929527+0000","last_became_peered":"2023-07-09T02:12:46.929527+0000","last_unstale":"2023-07-09T02:12:48.972192+0000","last_undegraded":"2023-07-09T02:12:48.972192+0000","last_fullsized":"2023-07-09T02:12:48.972192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:49:27.606505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933246+0000","last_change":"2023-07-09T02:12:47.940854+0000","last_active":"2023-07-09T02:12:48.933246+0000","last_peered":"2023-07-09T02:12:48.933246+0000","last_clean":"2023-07-09T02:12:48.933246+0000","last_became_active":"2023-07-09T02:12:47.939974+0000","last_became_peered":"2023-07-09T02:12:47.939974+0000","last_unstale":"2023-07-09T02:12:48.933246+0000","last_undegraded":"2023-07-09T02:12:48.933246+0000","last_fullsized":"2023-07-09T02:12:48.933246+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:01:39.726596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983569+0000","last_change":"2023-07-09T02:12:46.937195+0000","last_active":"2023-07-09T02:12:48.983569+0000","last_peered":"2023-07-09T02:12:48.983569+0000","last_clean":"2023-07-09T02:12:48.983569+0000","last_became_active":"2023-07-09T02:12:46.936981+0000","last_became_peered":"2023-07-09T02:12:46.936981+0000","last_unstale":"2023-07-09T02:12:48.983569+0000","last_undegraded":"2023-07-09T02:12:48.983569+0000","last_fullsized":"2023-07-09T02:12:48.983569+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:18:31.222865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.971892+0000","last_change":"2023-07-09T02:12:47.939009+0000","last_active":"2023-07-09T02:12:48.971892+0000","last_peered":"2023-07-09T02:12:48.971892+0000","last_clean":"2023-07-09T02:12:48.971892+0000","last_became_active":"2023-07-09T02:12:47.938790+0000","last_became_peered":"2023-07-09T02:12:47.938790+0000","last_unstale":"2023-07-09T02:12:48.971892+0000","last_undegraded":"2023-07-09T02:12:48.971892+0000","last_fullsized":"2023-07-09T02:12:48.971892+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:36:27.371788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":19,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932295+0000","last_change":"2023-07-09T02:12:46.937603+0000","last_active":"2023-07-09T02:12:48.932295+0000","last_peered":"2023-07-09T02:12:48.932295+0000","last_clean":"2023-07-09T02:12:48.932295+0000","last_became_active":"2023-07-09T02:12:46.936672+0000","last_became_peered":"2023-07-09T02:12:46.936672+0000","last_unstale":"2023-07-09T02:12:48.932295+0000","last_undegraded":"2023-07-09T02:12:48.932295+0000","last_fullsized":"2023-07-09T02:12:48.932295+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:13:50.709158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932103+0000","last_change":"2023-07-09T02:12:47.941769+0000","last_active":"2023-07-09T02:12:48.932103+0000","last_peered":"2023-07-09T02:12:48.932103+0000","last_clean":"2023-07-09T02:12:48.932103+0000","last_became_active":"2023-07-09T02:12:47.941321+0000","last_became_peered":"2023-07-09T02:12:47.941321+0000","last_unstale":"2023-07-09T02:12:48.932103+0000","last_undegraded":"2023-07-09T02:12:48.932103+0000","last_fullsized":"2023-07-09T02:12:48.932103+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:26.958581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933645+0000","last_change":"2023-07-09T02:12:46.939195+0000","last_active":"2023-07-09T02:12:48.933645+0000","last_peered":"2023-07-09T02:12:48.933645+0000","last_clean":"2023-07-09T02:12:48.933645+0000","last_became_active":"2023-07-09T02:12:46.938489+0000","last_became_peered":"2023-07-09T02:12:46.938489+0000","last_unstale":"2023-07-09T02:12:48.933645+0000","last_undegraded":"2023-07-09T02:12:48.933645+0000","last_fullsized":"2023-07-09T02:12:48.933645+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:06:31.818415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933402+0000","last_change":"2023-07-09T02:12:47.941702+0000","last_active":"2023-07-09T02:12:48.933402+0000","last_peered":"2023-07-09T02:12:48.933402+0000","last_clean":"2023-07-09T02:12:48.933402+0000","last_became_active":"2023-07-09T02:12:47.941487+0000","last_became_peered":"2023-07-09T02:12:47.941487+0000","last_unstale":"2023-07-09T02:12:48.933402+0000","last_undegraded":"2023-07-09T02:12:48.933402+0000","last_fullsized":"2023-07-09T02:12:48.933402+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:26:59.166176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971691+0000","last_change":"2023-07-09T02:12:46.943546+0000","last_active":"2023-07-09T02:12:49.971691+0000","last_peered":"2023-07-09T02:12:49.971691+0000","last_clean":"2023-07-09T02:12:49.971691+0000","last_became_active":"2023-07-09T02:12:46.943312+0000","last_became_peered":"2023-07-09T02:12:46.943312+0000","last_unstale":"2023-07-09T02:12:49.971691+0000","last_undegraded":"2023-07-09T02:12:49.971691+0000","last_fullsized":"2023-07-09T02:12:49.971691+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:43:28.676212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931919+0000","last_change":"2023-07-09T02:12:47.948429+0000","last_active":"2023-07-09T02:12:48.931919+0000","last_peered":"2023-07-09T02:12:48.931919+0000","last_clean":"2023-07-09T02:12:48.931919+0000","last_became_active":"2023-07-09T02:12:47.946176+0000","last_became_peered":"2023-07-09T02:12:47.946176+0000","last_unstale":"2023-07-09T02:12:48.931919+0000","last_undegraded":"2023-07-09T02:12:48.931919+0000","last_fullsized":"2023-07-09T02:12:48.931919+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:29.196936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983403+0000","last_change":"2023-07-09T02:12:46.938663+0000","last_active":"2023-07-09T02:12:48.983403+0000","last_peered":"2023-07-09T02:12:48.983403+0000","last_clean":"2023-07-09T02:12:48.983403+0000","last_became_active":"2023-07-09T02:12:46.938401+0000","last_became_peered":"2023-07-09T02:12:46.938401+0000","last_unstale":"2023-07-09T02:12:48.983403+0000","last_undegraded":"2023-07-09T02:12:48.983403+0000","last_fullsized":"2023-07-09T02:12:48.983403+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:20:15.500993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933123+0000","last_change":"2023-07-09T02:12:47.945769+0000","last_active":"2023-07-09T02:12:48.933123+0000","last_peered":"2023-07-09T02:12:48.933123+0000","last_clean":"2023-07-09T02:12:48.933123+0000","last_became_active":"2023-07-09T02:12:47.945371+0000","last_became_peered":"2023-07-09T02:12:47.945371+0000","last_unstale":"2023-07-09T02:12:48.933123+0000","last_undegraded":"2023-07-09T02:12:48.933123+0000","last_fullsized":"2023-07-09T02:12:48.933123+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:20:35.628274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932014+0000","last_change":"2023-07-09T02:12:46.938041+0000","last_active":"2023-07-09T02:12:48.932014+0000","last_peered":"2023-07-09T02:12:48.932014+0000","last_clean":"2023-07-09T02:12:48.932014+0000","last_became_active":"2023-07-09T02:12:46.937818+0000","last_became_peered":"2023-07-09T02:12:46.937818+0000","last_unstale":"2023-07-09T02:12:48.932014+0000","last_undegraded":"2023-07-09T02:12:48.932014+0000","last_fullsized":"2023-07-09T02:12:48.932014+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:04.427889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932175+0000","last_change":"2023-07-09T02:12:47.948583+0000","last_active":"2023-07-09T02:12:48.932175+0000","last_peered":"2023-07-09T02:12:48.932175+0000","last_clean":"2023-07-09T02:12:48.932175+0000","last_became_active":"2023-07-09T02:12:47.948164+0000","last_became_peered":"2023-07-09T02:12:47.948164+0000","last_unstale":"2023-07-09T02:12:48.932175+0000","last_undegraded":"2023-07-09T02:12:48.932175+0000","last_fullsized":"2023-07-09T02:12:48.932175+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:26:59.166176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933637+0000","last_change":"2023-07-09T02:12:46.943336+0000","last_active":"2023-07-09T02:12:48.933637+0000","last_peered":"2023-07-09T02:12:48.933637+0000","last_clean":"2023-07-09T02:12:48.933637+0000","last_became_active":"2023-07-09T02:12:46.942838+0000","last_became_peered":"2023-07-09T02:12:46.942838+0000","last_unstale":"2023-07-09T02:12:48.933637+0000","last_undegraded":"2023-07-09T02:12:48.933637+0000","last_fullsized":"2023-07-09T02:12:48.933637+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:01:42.381126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972885+0000","last_change":"2023-07-09T02:12:47.943989+0000","last_active":"2023-07-09T02:12:49.972885+0000","last_peered":"2023-07-09T02:12:49.972885+0000","last_clean":"2023-07-09T02:12:49.972885+0000","last_became_active":"2023-07-09T02:12:47.943646+0000","last_became_peered":"2023-07-09T02:12:47.943646+0000","last_unstale":"2023-07-09T02:12:49.972885+0000","last_undegraded":"2023-07-09T02:12:49.972885+0000","last_fullsized":"2023-07-09T02:12:49.972885+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:22:04.186323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.985079+0000","last_change":"2023-07-09T02:12:46.932782+0000","last_active":"2023-07-09T02:12:48.985079+0000","last_peered":"2023-07-09T02:12:48.985079+0000","last_clean":"2023-07-09T02:12:48.985079+0000","last_became_active":"2023-07-09T02:12:46.932519+0000","last_became_peered":"2023-07-09T02:12:46.932519+0000","last_unstale":"2023-07-09T02:12:48.985079+0000","last_undegraded":"2023-07-09T02:12:48.985079+0000","last_fullsized":"2023-07-09T02:12:48.985079+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:11:27.439570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972057+0000","last_change":"2023-07-09T02:12:47.938081+0000","last_active":"2023-07-09T02:12:48.972057+0000","last_peered":"2023-07-09T02:12:48.972057+0000","last_clean":"2023-07-09T02:12:48.972057+0000","last_became_active":"2023-07-09T02:12:47.937838+0000","last_became_peered":"2023-07-09T02:12:47.937838+0000","last_unstale":"2023-07-09T02:12:48.972057+0000","last_undegraded":"2023-07-09T02:12:48.972057+0000","last_fullsized":"2023-07-09T02:12:48.972057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:39:47.715340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971827+0000","last_change":"2023-07-09T02:12:46.941339+0000","last_active":"2023-07-09T02:12:49.971827+0000","last_peered":"2023-07-09T02:12:49.971827+0000","last_clean":"2023-07-09T02:12:49.971827+0000","last_became_active":"2023-07-09T02:12:46.941142+0000","last_became_peered":"2023-07-09T02:12:46.941142+0000","last_unstale":"2023-07-09T02:12:49.971827+0000","last_undegraded":"2023-07-09T02:12:49.971827+0000","last_fullsized":"2023-07-09T02:12:49.971827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:19:15.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973031+0000","last_change":"2023-07-09T02:12:47.950453+0000","last_active":"2023-07-09T02:12:49.973031+0000","last_peered":"2023-07-09T02:12:49.973031+0000","last_clean":"2023-07-09T02:12:49.973031+0000","last_became_active":"2023-07-09T02:12:47.950171+0000","last_became_peered":"2023-07-09T02:12:47.950171+0000","last_unstale":"2023-07-09T02:12:49.973031+0000","last_undegraded":"2023-07-09T02:12:49.973031+0000","last_fullsized":"2023-07-09T02:12:49.973031+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:17:36.277552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971533+0000","last_change":"2023-07-09T02:12:46.939456+0000","last_active":"2023-07-09T02:12:49.971533+0000","last_peered":"2023-07-09T02:12:49.971533+0000","last_clean":"2023-07-09T02:12:49.971533+0000","last_became_active":"2023-07-09T02:12:46.939075+0000","last_became_peered":"2023-07-09T02:12:46.939075+0000","last_unstale":"2023-07-09T02:12:49.971533+0000","last_undegraded":"2023-07-09T02:12:49.971533+0000","last_fullsized":"2023-07-09T02:12:49.971533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:15:07.654800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932144+0000","last_change":"2023-07-09T02:12:47.939282+0000","last_active":"2023-07-09T02:12:48.932144+0000","last_peered":"2023-07-09T02:12:48.932144+0000","last_clean":"2023-07-09T02:12:48.932144+0000","last_became_active":"2023-07-09T02:12:47.939063+0000","last_became_peered":"2023-07-09T02:12:47.939063+0000","last_unstale":"2023-07-09T02:12:48.932144+0000","last_undegraded":"2023-07-09T02:12:48.932144+0000","last_fullsized":"2023-07-09T02:12:48.932144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:27:18.298549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973040+0000","last_change":"2023-07-09T02:12:46.936739+0000","last_active":"2023-07-09T02:12:49.973040+0000","last_peered":"2023-07-09T02:12:49.973040+0000","last_clean":"2023-07-09T02:12:49.973040+0000","last_became_active":"2023-07-09T02:12:46.936110+0000","last_became_peered":"2023-07-09T02:12:46.936110+0000","last_unstale":"2023-07-09T02:12:49.973040+0000","last_undegraded":"2023-07-09T02:12:49.973040+0000","last_fullsized":"2023-07-09T02:12:49.973040+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:33:35.592256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971228+0000","last_change":"2023-07-09T02:12:47.940031+0000","last_active":"2023-07-09T02:12:49.971228+0000","last_peered":"2023-07-09T02:12:49.971228+0000","last_clean":"2023-07-09T02:12:49.971228+0000","last_became_active":"2023-07-09T02:12:47.939814+0000","last_became_peered":"2023-07-09T02:12:47.939814+0000","last_unstale":"2023-07-09T02:12:49.971228+0000","last_undegraded":"2023-07-09T02:12:49.971228+0000","last_fullsized":"2023-07-09T02:12:49.971228+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:10:38.951597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932391+0000","last_change":"2023-07-09T02:12:46.937762+0000","last_active":"2023-07-09T02:12:48.932391+0000","last_peered":"2023-07-09T02:12:48.932391+0000","last_clean":"2023-07-09T02:12:48.932391+0000","last_became_active":"2023-07-09T02:12:46.937015+0000","last_became_peered":"2023-07-09T02:12:46.937015+0000","last_unstale":"2023-07-09T02:12:48.932391+0000","last_undegraded":"2023-07-09T02:12:48.932391+0000","last_fullsized":"2023-07-09T02:12:48.932391+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:26:55.033760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933519+0000","last_change":"2023-07-09T02:12:47.940986+0000","last_active":"2023-07-09T02:12:48.933519+0000","last_peered":"2023-07-09T02:12:48.933519+0000","last_clean":"2023-07-09T02:12:48.933519+0000","last_became_active":"2023-07-09T02:12:47.940280+0000","last_became_peered":"2023-07-09T02:12:47.940280+0000","last_unstale":"2023-07-09T02:12:48.933519+0000","last_undegraded":"2023-07-09T02:12:48.933519+0000","last_fullsized":"2023-07-09T02:12:48.933519+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:26:56.042432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933766+0000","last_change":"2023-07-09T02:12:46.939337+0000","last_active":"2023-07-09T02:12:48.933766+0000","last_peered":"2023-07-09T02:12:48.933766+0000","last_clean":"2023-07-09T02:12:48.933766+0000","last_became_active":"2023-07-09T02:12:46.938977+0000","last_became_peered":"2023-07-09T02:12:46.938977+0000","last_unstale":"2023-07-09T02:12:48.933766+0000","last_undegraded":"2023-07-09T02:12:48.933766+0000","last_fullsized":"2023-07-09T02:12:48.933766+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:28:43.176926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972750+0000","last_change":"2023-07-09T02:12:47.944896+0000","last_active":"2023-07-09T02:12:49.972750+0000","last_peered":"2023-07-09T02:12:49.972750+0000","last_clean":"2023-07-09T02:12:49.972750+0000","last_became_active":"2023-07-09T02:12:47.944680+0000","last_became_peered":"2023-07-09T02:12:47.944680+0000","last_unstale":"2023-07-09T02:12:49.972750+0000","last_undegraded":"2023-07-09T02:12:49.972750+0000","last_fullsized":"2023-07-09T02:12:49.972750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:31:16.274271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.985218+0000","last_change":"2023-07-09T02:12:46.941667+0000","last_active":"2023-07-09T02:12:48.985218+0000","last_peered":"2023-07-09T02:12:48.985218+0000","last_clean":"2023-07-09T02:12:48.985218+0000","last_became_active":"2023-07-09T02:12:46.941279+0000","last_became_peered":"2023-07-09T02:12:46.941279+0000","last_unstale":"2023-07-09T02:12:48.985218+0000","last_undegraded":"2023-07-09T02:12:48.985218+0000","last_fullsized":"2023-07-09T02:12:48.985218+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:59.359282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971644+0000","last_change":"2023-07-09T02:12:47.940990+0000","last_active":"2023-07-09T02:12:49.971644+0000","last_peered":"2023-07-09T02:12:49.971644+0000","last_clean":"2023-07-09T02:12:49.971644+0000","last_became_active":"2023-07-09T02:12:47.940771+0000","last_became_peered":"2023-07-09T02:12:47.940771+0000","last_unstale":"2023-07-09T02:12:49.971644+0000","last_undegraded":"2023-07-09T02:12:49.971644+0000","last_fullsized":"2023-07-09T02:12:49.971644+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:54:24.276859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933639+0000","last_change":"2023-07-09T02:12:46.940333+0000","last_active":"2023-07-09T02:12:48.933639+0000","last_peered":"2023-07-09T02:12:48.933639+0000","last_clean":"2023-07-09T02:12:48.933639+0000","last_became_active":"2023-07-09T02:12:46.940081+0000","last_became_peered":"2023-07-09T02:12:46.940081+0000","last_unstale":"2023-07-09T02:12:48.933639+0000","last_undegraded":"2023-07-09T02:12:48.933639+0000","last_fullsized":"2023-07-09T02:12:48.933639+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:59.527240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983812+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:12:48.983812+0000","last_peered":"2023-07-09T02:12:48.983812+0000","last_clean":"2023-07-09T02:12:48.983812+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:12:48.983812+0000","last_undegraded":"2023-07-09T02:12:48.983812+0000","last_fullsized":"2023-07-09T02:12:48.983812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:48:50.250571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932415+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:12:48.932415+0000","last_peered":"2023-07-09T02:12:48.932415+0000","last_clean":"2023-07-09T02:12:48.932415+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:12:48.932415+0000","last_undegraded":"2023-07-09T02:12:48.932415+0000","last_fullsized":"2023-07-09T02:12:48.932415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:47:30.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972676+0000","last_change":"2023-07-09T02:12:47.946285+0000","last_active":"2023-07-09T02:12:49.972676+0000","last_peered":"2023-07-09T02:12:49.972676+0000","last_clean":"2023-07-09T02:12:49.972676+0000","last_became_active":"2023-07-09T02:12:47.946051+0000","last_became_peered":"2023-07-09T02:12:47.946051+0000","last_unstale":"2023-07-09T02:12:49.972676+0000","last_undegraded":"2023-07-09T02:12:49.972676+0000","last_fullsized":"2023-07-09T02:12:49.972676+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:45:22.490687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983627+0000","last_change":"2023-07-09T02:12:46.936577+0000","last_active":"2023-07-09T02:12:48.983627+0000","last_peered":"2023-07-09T02:12:48.983627+0000","last_clean":"2023-07-09T02:12:48.983627+0000","last_became_active":"2023-07-09T02:12:46.936260+0000","last_became_peered":"2023-07-09T02:12:46.936260+0000","last_unstale":"2023-07-09T02:12:48.983627+0000","last_undegraded":"2023-07-09T02:12:48.983627+0000","last_fullsized":"2023-07-09T02:12:48.983627+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:16:28.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983702+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:12:48.983702+0000","last_peered":"2023-07-09T02:12:48.983702+0000","last_clean":"2023-07-09T02:12:48.983702+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:12:48.983702+0000","last_undegraded":"2023-07-09T02:12:48.983702+0000","last_fullsized":"2023-07-09T02:12:48.983702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:03:53.778055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932152+0000","last_change":"2023-07-09T02:12:47.948326+0000","last_active":"2023-07-09T02:12:48.932152+0000","last_peered":"2023-07-09T02:12:48.932152+0000","last_clean":"2023-07-09T02:12:48.932152+0000","last_became_active":"2023-07-09T02:12:47.947773+0000","last_became_peered":"2023-07-09T02:12:47.947773+0000","last_unstale":"2023-07-09T02:12:48.932152+0000","last_undegraded":"2023-07-09T02:12:48.932152+0000","last_fullsized":"2023-07-09T02:12:48.932152+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:20:14.220427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933855+0000","last_change":"2023-07-09T02:12:46.941958+0000","last_active":"2023-07-09T02:12:48.933855+0000","last_peered":"2023-07-09T02:12:48.933855+0000","last_clean":"2023-07-09T02:12:48.933855+0000","last_became_active":"2023-07-09T02:12:46.941400+0000","last_became_peered":"2023-07-09T02:12:46.941400+0000","last_unstale":"2023-07-09T02:12:48.933855+0000","last_undegraded":"2023-07-09T02:12:48.933855+0000","last_fullsized":"2023-07-09T02:12:48.933855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:45:21.482015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.985141+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:12:48.985141+0000","last_peered":"2023-07-09T02:12:48.985141+0000","last_clean":"2023-07-09T02:12:48.985141+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:12:48.985141+0000","last_undegraded":"2023-07-09T02:12:48.985141+0000","last_fullsized":"2023-07-09T02:12:48.985141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:54:08.474725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932285+0000","last_change":"2023-07-09T02:12:47.945403+0000","last_active":"2023-07-09T02:12:48.932285+0000","last_peered":"2023-07-09T02:12:48.932285+0000","last_clean":"2023-07-09T02:12:48.932285+0000","last_became_active":"2023-07-09T02:12:47.945020+0000","last_became_peered":"2023-07-09T02:12:47.945020+0000","last_unstale":"2023-07-09T02:12:48.932285+0000","last_undegraded":"2023-07-09T02:12:48.932285+0000","last_fullsized":"2023-07-09T02:12:48.932285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:59:22.259962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971694+0000","last_change":"2023-07-09T02:12:46.943543+0000","last_active":"2023-07-09T02:12:49.971694+0000","last_peered":"2023-07-09T02:12:49.971694+0000","last_clean":"2023-07-09T02:12:49.971694+0000","last_became_active":"2023-07-09T02:12:46.943338+0000","last_became_peered":"2023-07-09T02:12:46.943338+0000","last_unstale":"2023-07-09T02:12:49.971694+0000","last_undegraded":"2023-07-09T02:12:49.971694+0000","last_fullsized":"2023-07-09T02:12:49.971694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:02:19.658556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932247+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:12:48.932247+0000","last_peered":"2023-07-09T02:12:48.932247+0000","last_clean":"2023-07-09T02:12:48.932247+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:12:48.932247+0000","last_undegraded":"2023-07-09T02:12:48.932247+0000","last_fullsized":"2023-07-09T02:12:48.932247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:18:40.693608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933918+0000","last_change":"2023-07-09T02:12:47.936663+0000","last_active":"2023-07-09T02:12:48.933918+0000","last_peered":"2023-07-09T02:12:48.933918+0000","last_clean":"2023-07-09T02:12:48.933918+0000","last_became_active":"2023-07-09T02:12:47.936458+0000","last_became_peered":"2023-07-09T02:12:47.936458+0000","last_unstale":"2023-07-09T02:12:48.933918+0000","last_undegraded":"2023-07-09T02:12:48.933918+0000","last_fullsized":"2023-07-09T02:12:48.933918+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:31:16.274271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972088+0000","last_change":"2023-07-09T02:12:46.932425+0000","last_active":"2023-07-09T02:12:48.972088+0000","last_peered":"2023-07-09T02:12:48.972088+0000","last_clean":"2023-07-09T02:12:48.972088+0000","last_became_active":"2023-07-09T02:12:46.932105+0000","last_became_peered":"2023-07-09T02:12:46.932105+0000","last_unstale":"2023-07-09T02:12:48.972088+0000","last_undegraded":"2023-07-09T02:12:48.972088+0000","last_fullsized":"2023-07-09T02:12:48.972088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:36:55.459867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973071+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:12:49.973071+0000","last_peered":"2023-07-09T02:12:49.973071+0000","last_clean":"2023-07-09T02:12:49.973071+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:12:49.973071+0000","last_undegraded":"2023-07-09T02:12:49.973071+0000","last_fullsized":"2023-07-09T02:12:49.973071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:35:43.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932047+0000","last_change":"2023-07-09T02:12:47.951258+0000","last_active":"2023-07-09T02:12:48.932047+0000","last_peered":"2023-07-09T02:12:48.932047+0000","last_clean":"2023-07-09T02:12:48.932047+0000","last_became_active":"2023-07-09T02:12:47.949059+0000","last_became_peered":"2023-07-09T02:12:47.949059+0000","last_unstale":"2023-07-09T02:12:48.932047+0000","last_undegraded":"2023-07-09T02:12:48.932047+0000","last_fullsized":"2023-07-09T02:12:48.932047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:39:39.078505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932057+0000","last_change":"2023-07-09T02:12:46.934532+0000","last_active":"2023-07-09T02:12:48.932057+0000","last_peered":"2023-07-09T02:12:48.932057+0000","last_clean":"2023-07-09T02:12:48.932057+0000","last_became_active":"2023-07-09T02:12:46.934297+0000","last_became_peered":"2023-07-09T02:12:46.934297+0000","last_unstale":"2023-07-09T02:12:48.932057+0000","last_undegraded":"2023-07-09T02:12:48.932057+0000","last_fullsized":"2023-07-09T02:12:48.932057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:06:27.608470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983430+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:12:48.983430+0000","last_peered":"2023-07-09T02:12:48.983430+0000","last_clean":"2023-07-09T02:12:48.983430+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:12:48.983430+0000","last_undegraded":"2023-07-09T02:12:48.983430+0000","last_fullsized":"2023-07-09T02:12:48.983430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:56.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933530+0000","last_change":"2023-07-09T02:12:47.945237+0000","last_active":"2023-07-09T02:12:48.933530+0000","last_peered":"2023-07-09T02:12:48.933530+0000","last_clean":"2023-07-09T02:12:48.933530+0000","last_became_active":"2023-07-09T02:12:47.944964+0000","last_became_peered":"2023-07-09T02:12:47.944964+0000","last_unstale":"2023-07-09T02:12:48.933530+0000","last_undegraded":"2023-07-09T02:12:48.933530+0000","last_fullsized":"2023-07-09T02:12:48.933530+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:42:52.374840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932176+0000","last_change":"2023-07-09T02:12:46.938307+0000","last_active":"2023-07-09T02:12:48.932176+0000","last_peered":"2023-07-09T02:12:48.932176+0000","last_clean":"2023-07-09T02:12:48.932176+0000","last_became_active":"2023-07-09T02:12:46.937882+0000","last_became_peered":"2023-07-09T02:12:46.937882+0000","last_unstale":"2023-07-09T02:12:48.932176+0000","last_undegraded":"2023-07-09T02:12:48.932176+0000","last_fullsized":"2023-07-09T02:12:48.932176+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:29:09.476334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973120+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:12:49.973120+0000","last_peered":"2023-07-09T02:12:49.973120+0000","last_clean":"2023-07-09T02:12:49.973120+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:12:49.973120+0000","last_undegraded":"2023-07-09T02:12:49.973120+0000","last_fullsized":"2023-07-09T02:12:49.973120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:06.404867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932197+0000","last_change":"2023-07-09T02:12:47.941571+0000","last_active":"2023-07-09T02:12:48.932197+0000","last_peered":"2023-07-09T02:12:48.932197+0000","last_clean":"2023-07-09T02:12:48.932197+0000","last_became_active":"2023-07-09T02:12:47.941000+0000","last_became_peered":"2023-07-09T02:12:47.941000+0000","last_unstale":"2023-07-09T02:12:48.932197+0000","last_undegraded":"2023-07-09T02:12:48.932197+0000","last_fullsized":"2023-07-09T02:12:48.932197+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:34.131486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932538+0000","last_change":"2023-07-09T02:12:46.941175+0000","last_active":"2023-07-09T02:12:48.932538+0000","last_peered":"2023-07-09T02:12:48.932538+0000","last_clean":"2023-07-09T02:12:48.932538+0000","last_became_active":"2023-07-09T02:12:46.940762+0000","last_became_peered":"2023-07-09T02:12:46.940762+0000","last_unstale":"2023-07-09T02:12:48.932538+0000","last_undegraded":"2023-07-09T02:12:48.932538+0000","last_fullsized":"2023-07-09T02:12:48.932538+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:59.527240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971788+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:12:49.971788+0000","last_peered":"2023-07-09T02:12:49.971788+0000","last_clean":"2023-07-09T02:12:49.971788+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:12:49.971788+0000","last_undegraded":"2023-07-09T02:12:49.971788+0000","last_fullsized":"2023-07-09T02:12:49.971788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:43:47.635713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168542,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64300000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58599999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.495}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.621}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.94899999999999995}]},{"osd":1,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.78200000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.99299999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.80300000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.90900000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69299999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195077,"statfs":{"total":200000000,"available":199759034,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.629}]},{"osd":1,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71099999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67700000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.495},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.43099999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.625},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.52300000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.81200000000000006}]},{"osd":5,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.86199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757448,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.36499999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72999999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.628},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.85399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757470,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.255}]},{"osd":1,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.621},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.59099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":228,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195083,"statfs":{"total":200000000,"available":199765527,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.315},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.37},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.379}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.749}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.69999999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168610,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.496}]},{"osd":2,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.44800000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.75},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.65700000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.74099999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.58299999999999996}]}]}],"pool_statfs":[]}} 2023-07-09T02:12:52.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:12:52.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f80750d8640 1 Processor -- start 2023-07-09T02:12:52.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f80750d8640 1 -- start start 2023-07-09T02:12:52.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f80750d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8070158e30 0x7f807006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f80750d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f807006c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f80750d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700ccf80 con 0x7f807006c650 2023-07-09T02:12:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f80750d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807006cad0 con 0x7f8070158e30 2023-07-09T02:12:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f80750d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80700cd540 con 0x7f807006fd10 2023-07-09T02:12:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f8067fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f807006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f806ed9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8070158e30 0x7f807006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f806ed9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8070158e30 0x7f807006f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:51296/0 (socket says 172.21.15.45:51296) 2023-07-09T02:12:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f806ed9d640 1 -- 172.21.15.45:0/1958069199 learned_addr learned my addr 172.21.15.45:0/1958069199 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.235+0000 7f8067fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f807006c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:35400/0 (socket says 172.21.15.45:35400) 2023-07-09T02:12:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f8067fff640 1 -- 172.21.15.45:0/1958069199 >> v2:172.21.15.155:3300/0 conn(0x7f8070158e30 msgr2=0x7f807006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f8067fff640 1 --2- 172.21.15.45:0/1958069199 >> v2:172.21.15.155:3300/0 conn(0x7f8070158e30 0x7f807006f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f8067fff640 1 -- 172.21.15.45:0/1958069199 >> v1:172.21.15.155:6789/0 conn(0x7f807006c650 legacy=0x7f80700caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f8067fff640 1 -- 172.21.15.45:0/1958069199 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80700c8fb0 con 0x7f807006fd10 2023-07-09T02:12:52.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f806ed9d640 1 --2- 172.21.15.45:0/1958069199 >> v2:172.21.15.155:3300/0 conn(0x7f8070158e30 0x7f807006f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:52.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f8067fff640 1 --2- 172.21.15.45:0/1958069199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f807006c110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80580097c0 tx=0x7f805801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8191444c49f2f26a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:52.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f806e59c640 1 -- 172.21.15.45:0/1958069199 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580ac620 con 0x7f807006fd10 2023-07-09T02:12:52.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f806e59c640 1 -- 172.21.15.45:0/1958069199 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80580ac780 con 0x7f807006fd10 2023-07-09T02:12:52.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.239+0000 7f806e59c640 1 -- 172.21.15.45:0/1958069199 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580acb10 con 0x7f807006fd10 2023-07-09T02:12:52.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- 172.21.15.45:0/1958069199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 msgr2=0x7f807006c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 --2- 172.21.15.45:0/1958069199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f807006c110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80580097c0 tx=0x7f805801c3c0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- 172.21.15.45:0/1958069199 shutdown_connections 2023-07-09T02:12:52.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 --2- 172.21.15.45:0/1958069199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f807006c110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 --2- 172.21.15.45:0/1958069199 >> v2:172.21.15.155:3300/0 conn(0x7f8070158e30 0x7f807006f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- 172.21.15.45:0/1958069199 >> 172.21.15.45:0/1958069199 conn(0x7f80700694b0 msgr2=0x7f80700698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:52.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- 172.21.15.45:0/1958069199 shutdown_connections 2023-07-09T02:12:52.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- 172.21.15.45:0/1958069199 wait complete. 2023-07-09T02:12:52.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 Processor -- start 2023-07-09T02:12:52.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- start start 2023-07-09T02:12:52.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f807006c650 0x7f807015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f80700ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8070158e30 0x7f80700ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070153e60 con 0x7f8070158e30 2023-07-09T02:12:52.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80700c7430 con 0x7f807006c650 2023-07-09T02:12:52.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f80750d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80700c7710 con 0x7f807006fd10 2023-07-09T02:12:52.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f806f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8070158e30 0x7f80700ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f806ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f807006c650 0x7f807015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f806f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8070158e30 0x7f80700ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41948/0 (socket says 172.21.15.45:41948) 2023-07-09T02:12:52.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f806f59e640 1 -- 172.21.15.45:0/179783816 learned_addr learned my addr 172.21.15.45:0/179783816 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:52.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f8067fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f80700ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f806f59e640 1 -- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 msgr2=0x7f80700ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f806f59e640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f80700ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f806f59e640 1 -- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f807006c650 msgr2=0x7f807015bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.243+0000 7f806f59e640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f807006c650 0x7f807015bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f806f59e640 1 -- 172.21.15.45:0/179783816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80600094d0 con 0x7f8070158e30 2023-07-09T02:12:52.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f806ed9d640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f807006c650 0x7f807015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:12:52.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f806f59e640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8070158e30 0x7f80700ae9e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f806800c770 tx=0x7f806800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:52.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80677fe640 1 -- 172.21.15.45:0/179783816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068003b80 con 0x7f8070158e30 2023-07-09T02:12:52.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80677fe640 1 -- 172.21.15.45:0/179783816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8068003ce0 con 0x7f8070158e30 2023-07-09T02:12:52.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80677fe640 1 -- 172.21.15.45:0/179783816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800aa90 con 0x7f8070158e30 2023-07-09T02:12:52.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8058009420 con 0x7f8070158e30 2023-07-09T02:12:52.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80700c7cd0 con 0x7f8070158e30 2023-07-09T02:12:52.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807004d7d0 con 0x7f8070158e30 2023-07-09T02:12:52.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80677fe640 1 -- 172.21.15.45:0/179783816 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f806800abf0 con 0x7f8070158e30 2023-07-09T02:12:52.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80677fe640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8050066280 0x7f8050068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f80677fe640 1 -- 172.21.15.45:0/179783816 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8068083ad0 con 0x7f8070158e30 2023-07-09T02:12:52.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.247+0000 7f806ed9d640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8050066280 0x7f8050068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.251+0000 7f806ed9d640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8050066280 0x7f8050068730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8060006cb0 tx=0x7f8060009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:52.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.251+0000 7f80677fe640 1 -- 172.21.15.45:0/179783816 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8068050f60 con 0x7f8070158e30 2023-07-09T02:12:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.403+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8070159200 con 0x7f8050066280 2023-07-09T02:12:52.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.411+0000 7f80677fe640 1 -- 172.21.15.45:0/179783816 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305647 (secure 0 0 0) 0x7f8060014440 con 0x7f8050066280 2023-07-09T02:12:52.419 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:52.421 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:12:52.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8050066280 msgr2=0x7f8050068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8050066280 0x7f8050068730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8060006cb0 tx=0x7f8060009240 comp rx=0 tx=0).stop 2023-07-09T02:12:52.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8070158e30 msgr2=0x7f80700ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8070158e30 0x7f80700ae9e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f806800c770 tx=0x7f806800cc30 comp rx=0 tx=0).stop 2023-07-09T02:12:52.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 shutdown_connections 2023-07-09T02:12:52.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8070158e30 0x7f80700ae9e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8050066280 0x7f8050068730 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807006fd10 0x7f80700ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 --2- 172.21.15.45:0/179783816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f807006c650 0x7f807015bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 >> 172.21.15.45:0/179783816 conn(0x7f80700694b0 msgr2=0x7f80701551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:52.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 shutdown_connections 2023-07-09T02:12:52.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.415+0000 7f80750d8640 1 -- 172.21.15.45:0/179783816 wait complete. 2023-07-09T02:12:52.440 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-07-09T02:12:50.547201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3033,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559466,"statfs":{"total":1600000000,"available":1596893465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.627959"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972675+0000","last_change":"2023-07-09T02:12:47.942096+0000","last_active":"2023-07-09T02:12:49.972675+0000","last_peered":"2023-07-09T02:12:49.972675+0000","last_clean":"2023-07-09T02:12:49.972675+0000","last_became_active":"2023-07-09T02:12:47.941833+0000","last_became_peered":"2023-07-09T02:12:47.941833+0000","last_unstale":"2023-07-09T02:12:49.972675+0000","last_undegraded":"2023-07-09T02:12:49.972675+0000","last_fullsized":"2023-07-09T02:12:49.972675+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:28:44.185597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983262+0000","last_change":"2023-07-09T02:12:47.939153+0000","last_active":"2023-07-09T02:12:48.983262+0000","last_peered":"2023-07-09T02:12:48.983262+0000","last_clean":"2023-07-09T02:12:48.983262+0000","last_became_active":"2023-07-09T02:12:47.938905+0000","last_became_peered":"2023-07-09T02:12:47.938905+0000","last_unstale":"2023-07-09T02:12:48.983262+0000","last_undegraded":"2023-07-09T02:12:48.983262+0000","last_fullsized":"2023-07-09T02:12:48.983262+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:27:18.298549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933392+0000","last_change":"2023-07-09T02:12:47.938833+0000","last_active":"2023-07-09T02:12:48.933392+0000","last_peered":"2023-07-09T02:12:48.933392+0000","last_clean":"2023-07-09T02:12:48.933392+0000","last_became_active":"2023-07-09T02:12:47.938612+0000","last_became_peered":"2023-07-09T02:12:47.938612+0000","last_unstale":"2023-07-09T02:12:48.933392+0000","last_undegraded":"2023-07-09T02:12:48.933392+0000","last_fullsized":"2023-07-09T02:12:48.933392+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:20:14.220427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983308+0000","last_change":"2023-07-09T02:12:47.943492+0000","last_active":"2023-07-09T02:12:48.983308+0000","last_peered":"2023-07-09T02:12:48.983308+0000","last_clean":"2023-07-09T02:12:48.983308+0000","last_became_active":"2023-07-09T02:12:47.943265+0000","last_became_peered":"2023-07-09T02:12:47.943265+0000","last_unstale":"2023-07-09T02:12:48.983308+0000","last_undegraded":"2023-07-09T02:12:48.983308+0000","last_fullsized":"2023-07-09T02:12:48.983308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:34.131486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972296+0000","last_change":"2023-07-09T02:12:47.940312+0000","last_active":"2023-07-09T02:12:48.972296+0000","last_peered":"2023-07-09T02:12:48.972296+0000","last_clean":"2023-07-09T02:12:48.972296+0000","last_became_active":"2023-07-09T02:12:47.939866+0000","last_became_peered":"2023-07-09T02:12:47.939866+0000","last_unstale":"2023-07-09T02:12:48.972296+0000","last_undegraded":"2023-07-09T02:12:48.972296+0000","last_fullsized":"2023-07-09T02:12:48.972296+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:04:46.632880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972935+0000","last_change":"2023-07-09T02:12:47.942999+0000","last_active":"2023-07-09T02:12:49.972935+0000","last_peered":"2023-07-09T02:12:49.972935+0000","last_clean":"2023-07-09T02:12:49.972935+0000","last_became_active":"2023-07-09T02:12:47.942658+0000","last_became_peered":"2023-07-09T02:12:47.942658+0000","last_unstale":"2023-07-09T02:12:49.972935+0000","last_undegraded":"2023-07-09T02:12:49.972935+0000","last_fullsized":"2023-07-09T02:12:49.972935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:23:15.987610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933224+0000","last_change":"2023-07-09T02:12:47.933473+0000","last_active":"2023-07-09T02:12:48.933224+0000","last_peered":"2023-07-09T02:12:48.933224+0000","last_clean":"2023-07-09T02:12:48.933224+0000","last_became_active":"2023-07-09T02:12:47.933229+0000","last_became_peered":"2023-07-09T02:12:47.933229+0000","last_unstale":"2023-07-09T02:12:48.933224+0000","last_undegraded":"2023-07-09T02:12:48.933224+0000","last_fullsized":"2023-07-09T02:12:48.933224+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:29.196936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931808+0000","last_change":"2023-07-09T02:12:47.948470+0000","last_active":"2023-07-09T02:12:48.931808+0000","last_peered":"2023-07-09T02:12:48.931808+0000","last_clean":"2023-07-09T02:12:48.931808+0000","last_became_active":"2023-07-09T02:12:47.948097+0000","last_became_peered":"2023-07-09T02:12:47.948097+0000","last_unstale":"2023-07-09T02:12:48.931808+0000","last_undegraded":"2023-07-09T02:12:48.931808+0000","last_fullsized":"2023-07-09T02:12:48.931808+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:20:35.628274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931793+0000","last_change":"2023-07-09T02:12:47.952401+0000","last_active":"2023-07-09T02:12:48.931793+0000","last_peered":"2023-07-09T02:12:48.931793+0000","last_clean":"2023-07-09T02:12:48.931793+0000","last_became_active":"2023-07-09T02:12:47.951992+0000","last_became_peered":"2023-07-09T02:12:47.951992+0000","last_unstale":"2023-07-09T02:12:48.931793+0000","last_undegraded":"2023-07-09T02:12:48.931793+0000","last_fullsized":"2023-07-09T02:12:48.931793+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:54:12.288457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972650+0000","last_change":"2023-07-09T02:12:47.943114+0000","last_active":"2023-07-09T02:12:49.972650+0000","last_peered":"2023-07-09T02:12:49.972650+0000","last_clean":"2023-07-09T02:12:49.972650+0000","last_became_active":"2023-07-09T02:12:47.942772+0000","last_became_peered":"2023-07-09T02:12:47.942772+0000","last_unstale":"2023-07-09T02:12:49.972650+0000","last_undegraded":"2023-07-09T02:12:49.972650+0000","last_fullsized":"2023-07-09T02:12:49.972650+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:07:06.725253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.984968+0000","last_change":"2023-07-09T02:12:47.933042+0000","last_active":"2023-07-09T02:12:48.984968+0000","last_peered":"2023-07-09T02:12:48.984968+0000","last_clean":"2023-07-09T02:12:48.984968+0000","last_became_active":"2023-07-09T02:12:47.932809+0000","last_became_peered":"2023-07-09T02:12:47.932809+0000","last_unstale":"2023-07-09T02:12:48.984968+0000","last_undegraded":"2023-07-09T02:12:48.984968+0000","last_fullsized":"2023-07-09T02:12:48.984968+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:31:03.185948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932099+0000","last_change":"2023-07-09T02:12:47.949586+0000","last_active":"2023-07-09T02:12:48.932099+0000","last_peered":"2023-07-09T02:12:48.932099+0000","last_clean":"2023-07-09T02:12:48.932099+0000","last_became_active":"2023-07-09T02:12:47.949124+0000","last_became_peered":"2023-07-09T02:12:47.949124+0000","last_unstale":"2023-07-09T02:12:48.932099+0000","last_undegraded":"2023-07-09T02:12:48.932099+0000","last_fullsized":"2023-07-09T02:12:48.932099+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:01:39.726596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972510+0000","last_change":"2023-07-09T02:12:47.943854+0000","last_active":"2023-07-09T02:12:49.972510+0000","last_peered":"2023-07-09T02:12:49.972510+0000","last_clean":"2023-07-09T02:12:49.972510+0000","last_became_active":"2023-07-09T02:12:47.943368+0000","last_became_peered":"2023-07-09T02:12:47.943368+0000","last_unstale":"2023-07-09T02:12:49.972510+0000","last_undegraded":"2023-07-09T02:12:49.972510+0000","last_fullsized":"2023-07-09T02:12:49.972510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:01:43.389798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933239+0000","last_change":"2023-07-09T02:12:47.937522+0000","last_active":"2023-07-09T02:12:48.933239+0000","last_peered":"2023-07-09T02:12:48.933239+0000","last_clean":"2023-07-09T02:12:48.933239+0000","last_became_active":"2023-07-09T02:12:47.936968+0000","last_became_peered":"2023-07-09T02:12:47.936968+0000","last_unstale":"2023-07-09T02:12:48.933239+0000","last_undegraded":"2023-07-09T02:12:48.933239+0000","last_fullsized":"2023-07-09T02:12:48.933239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:05.436560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983482+0000","last_change":"2023-07-09T02:12:47.938050+0000","last_active":"2023-07-09T02:12:48.983482+0000","last_peered":"2023-07-09T02:12:48.983482+0000","last_clean":"2023-07-09T02:12:48.983482+0000","last_became_active":"2023-07-09T02:12:47.937826+0000","last_became_peered":"2023-07-09T02:12:47.937826+0000","last_unstale":"2023-07-09T02:12:48.983482+0000","last_undegraded":"2023-07-09T02:12:48.983482+0000","last_fullsized":"2023-07-09T02:12:48.983482+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:49:06.270138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972819+0000","last_change":"2023-07-09T02:12:47.942863+0000","last_active":"2023-07-09T02:12:49.972819+0000","last_peered":"2023-07-09T02:12:49.972819+0000","last_clean":"2023-07-09T02:12:49.972819+0000","last_became_active":"2023-07-09T02:12:47.942329+0000","last_became_peered":"2023-07-09T02:12:47.942329+0000","last_unstale":"2023-07-09T02:12:49.972819+0000","last_undegraded":"2023-07-09T02:12:49.972819+0000","last_fullsized":"2023-07-09T02:12:49.972819+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:05.370790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933406+0000","last_change":"2023-07-09T02:12:47.939689+0000","last_active":"2023-07-09T02:12:48.933406+0000","last_peered":"2023-07-09T02:12:48.933406+0000","last_clean":"2023-07-09T02:12:48.933406+0000","last_became_active":"2023-07-09T02:12:47.939383+0000","last_became_peered":"2023-07-09T02:12:47.939383+0000","last_unstale":"2023-07-09T02:12:48.933406+0000","last_undegraded":"2023-07-09T02:12:48.933406+0000","last_fullsized":"2023-07-09T02:12:48.933406+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:29:10.485005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983235+0000","last_change":"2023-07-09T02:12:47.940460+0000","last_active":"2023-07-09T02:12:48.983235+0000","last_peered":"2023-07-09T02:12:48.983235+0000","last_clean":"2023-07-09T02:12:48.983235+0000","last_became_active":"2023-07-09T02:12:47.939556+0000","last_became_peered":"2023-07-09T02:12:47.939556+0000","last_unstale":"2023-07-09T02:12:48.983235+0000","last_undegraded":"2023-07-09T02:12:48.983235+0000","last_fullsized":"2023-07-09T02:12:48.983235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:26.958581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933102+0000","last_change":"2023-07-09T02:12:47.935577+0000","last_active":"2023-07-09T02:12:48.933102+0000","last_peered":"2023-07-09T02:12:48.933102+0000","last_clean":"2023-07-09T02:12:48.933102+0000","last_became_active":"2023-07-09T02:12:47.935319+0000","last_became_peered":"2023-07-09T02:12:47.935319+0000","last_unstale":"2023-07-09T02:12:48.933102+0000","last_undegraded":"2023-07-09T02:12:48.933102+0000","last_fullsized":"2023-07-09T02:12:48.933102+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:54:12.288457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971518+0000","last_change":"2023-07-09T02:12:47.942612+0000","last_active":"2023-07-09T02:12:49.971518+0000","last_peered":"2023-07-09T02:12:49.971518+0000","last_clean":"2023-07-09T02:12:49.971518+0000","last_became_active":"2023-07-09T02:12:47.942194+0000","last_became_peered":"2023-07-09T02:12:47.942194+0000","last_unstale":"2023-07-09T02:12:49.971518+0000","last_undegraded":"2023-07-09T02:12:49.971518+0000","last_fullsized":"2023-07-09T02:12:49.971518+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:31:37.315073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971362+0000","last_change":"2023-07-09T02:12:47.943520+0000","last_active":"2023-07-09T02:12:49.971362+0000","last_peered":"2023-07-09T02:12:49.971362+0000","last_clean":"2023-07-09T02:12:49.971362+0000","last_became_active":"2023-07-09T02:12:47.943158+0000","last_became_peered":"2023-07-09T02:12:47.943158+0000","last_unstale":"2023-07-09T02:12:49.971362+0000","last_undegraded":"2023-07-09T02:12:49.971362+0000","last_fullsized":"2023-07-09T02:12:49.971362+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:40:37.083841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932233+0000","last_change":"2023-07-09T02:12:47.949417+0000","last_active":"2023-07-09T02:12:48.932233+0000","last_peered":"2023-07-09T02:12:48.932233+0000","last_clean":"2023-07-09T02:12:48.932233+0000","last_became_active":"2023-07-09T02:12:47.948801+0000","last_became_peered":"2023-07-09T02:12:47.948801+0000","last_unstale":"2023-07-09T02:12:48.932233+0000","last_undegraded":"2023-07-09T02:12:48.932233+0000","last_fullsized":"2023-07-09T02:12:48.932233+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:17:53.451294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.984967+0000","last_change":"2023-07-09T02:12:47.935715+0000","last_active":"2023-07-09T02:12:48.984967+0000","last_peered":"2023-07-09T02:12:48.984967+0000","last_clean":"2023-07-09T02:12:48.984967+0000","last_became_active":"2023-07-09T02:12:47.935488+0000","last_became_peered":"2023-07-09T02:12:47.935488+0000","last_unstale":"2023-07-09T02:12:48.984967+0000","last_undegraded":"2023-07-09T02:12:48.984967+0000","last_fullsized":"2023-07-09T02:12:48.984967+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:49:48.709481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933371+0000","last_change":"2023-07-09T02:12:47.937654+0000","last_active":"2023-07-09T02:12:48.933371+0000","last_peered":"2023-07-09T02:12:48.933371+0000","last_clean":"2023-07-09T02:12:48.933371+0000","last_became_active":"2023-07-09T02:12:47.937278+0000","last_became_peered":"2023-07-09T02:12:47.937278+0000","last_unstale":"2023-07-09T02:12:48.933371+0000","last_undegraded":"2023-07-09T02:12:48.933371+0000","last_fullsized":"2023-07-09T02:12:48.933371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:29.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933225+0000","last_change":"2023-07-09T02:12:47.945016+0000","last_active":"2023-07-09T02:12:48.933225+0000","last_peered":"2023-07-09T02:12:48.933225+0000","last_clean":"2023-07-09T02:12:48.933225+0000","last_became_active":"2023-07-09T02:12:47.944772+0000","last_became_peered":"2023-07-09T02:12:47.944772+0000","last_unstale":"2023-07-09T02:12:48.933225+0000","last_undegraded":"2023-07-09T02:12:48.933225+0000","last_fullsized":"2023-07-09T02:12:48.933225+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:48.820706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931963+0000","last_change":"2023-07-09T02:12:47.943391+0000","last_active":"2023-07-09T02:12:48.931963+0000","last_peered":"2023-07-09T02:12:48.931963+0000","last_clean":"2023-07-09T02:12:48.931963+0000","last_became_active":"2023-07-09T02:12:47.943155+0000","last_became_peered":"2023-07-09T02:12:47.943155+0000","last_unstale":"2023-07-09T02:12:48.931963+0000","last_undegraded":"2023-07-09T02:12:48.931963+0000","last_fullsized":"2023-07-09T02:12:48.931963+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:48.820706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972560+0000","last_change":"2023-07-09T02:12:47.941350+0000","last_active":"2023-07-09T02:12:49.972560+0000","last_peered":"2023-07-09T02:12:49.972560+0000","last_clean":"2023-07-09T02:12:49.972560+0000","last_became_active":"2023-07-09T02:12:47.941140+0000","last_became_peered":"2023-07-09T02:12:47.941140+0000","last_unstale":"2023-07-09T02:12:49.972560+0000","last_undegraded":"2023-07-09T02:12:49.972560+0000","last_fullsized":"2023-07-09T02:12:49.972560+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:06:32.827087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971438+0000","last_change":"2023-07-09T02:12:47.937616+0000","last_active":"2023-07-09T02:12:49.971438+0000","last_peered":"2023-07-09T02:12:49.971438+0000","last_clean":"2023-07-09T02:12:49.971438+0000","last_became_active":"2023-07-09T02:12:47.937342+0000","last_became_peered":"2023-07-09T02:12:47.937342+0000","last_unstale":"2023-07-09T02:12:49.971438+0000","last_undegraded":"2023-07-09T02:12:49.971438+0000","last_fullsized":"2023-07-09T02:12:49.971438+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:58:52.001996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933499+0000","last_change":"2023-07-09T02:12:47.939909+0000","last_active":"2023-07-09T02:12:48.933499+0000","last_peered":"2023-07-09T02:12:48.933499+0000","last_clean":"2023-07-09T02:12:48.933499+0000","last_became_active":"2023-07-09T02:12:47.939644+0000","last_became_peered":"2023-07-09T02:12:47.939644+0000","last_unstale":"2023-07-09T02:12:48.933499+0000","last_undegraded":"2023-07-09T02:12:48.933499+0000","last_fullsized":"2023-07-09T02:12:48.933499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:17:53.451294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983601+0000","last_change":"2023-07-09T02:12:47.940734+0000","last_active":"2023-07-09T02:12:48.983601+0000","last_peered":"2023-07-09T02:12:48.983601+0000","last_clean":"2023-07-09T02:12:48.983601+0000","last_became_active":"2023-07-09T02:12:47.940366+0000","last_became_peered":"2023-07-09T02:12:47.940366+0000","last_unstale":"2023-07-09T02:12:48.983601+0000","last_undegraded":"2023-07-09T02:12:48.983601+0000","last_fullsized":"2023-07-09T02:12:48.983601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:08.797313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933242+0000","last_change":"2023-07-09T02:12:47.936538+0000","last_active":"2023-07-09T02:12:48.933242+0000","last_peered":"2023-07-09T02:12:48.933242+0000","last_clean":"2023-07-09T02:12:48.933242+0000","last_became_active":"2023-07-09T02:12:47.936333+0000","last_became_peered":"2023-07-09T02:12:47.936333+0000","last_unstale":"2023-07-09T02:12:48.933242+0000","last_undegraded":"2023-07-09T02:12:48.933242+0000","last_fullsized":"2023-07-09T02:12:48.933242+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:39:39.078505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931912+0000","last_change":"2023-07-09T02:12:47.944165+0000","last_active":"2023-07-09T02:12:48.931912+0000","last_peered":"2023-07-09T02:12:48.931912+0000","last_clean":"2023-07-09T02:12:48.931912+0000","last_became_active":"2023-07-09T02:12:47.943884+0000","last_became_peered":"2023-07-09T02:12:47.943884+0000","last_unstale":"2023-07-09T02:12:48.931912+0000","last_undegraded":"2023-07-09T02:12:48.931912+0000","last_fullsized":"2023-07-09T02:12:48.931912+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:12:37.600529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983485+0000","last_change":"2023-07-09T02:12:47.940315+0000","last_active":"2023-07-09T02:12:48.983485+0000","last_peered":"2023-07-09T02:12:48.983485+0000","last_clean":"2023-07-09T02:12:48.983485+0000","last_became_active":"2023-07-09T02:12:47.939242+0000","last_became_peered":"2023-07-09T02:12:47.939242+0000","last_unstale":"2023-07-09T02:12:48.983485+0000","last_undegraded":"2023-07-09T02:12:48.983485+0000","last_fullsized":"2023-07-09T02:12:48.983485+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:34:56.998195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"47'4","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971591+0000","last_change":"2023-07-09T02:12:46.936252+0000","last_active":"2023-07-09T02:12:49.971591+0000","last_peered":"2023-07-09T02:12:49.971591+0000","last_clean":"2023-07-09T02:12:49.971591+0000","last_became_active":"2023-07-09T02:12:46.935972+0000","last_became_peered":"2023-07-09T02:12:46.935972+0000","last_unstale":"2023-07-09T02:12:49.971591+0000","last_undegraded":"2023-07-09T02:12:49.971591+0000","last_fullsized":"2023-07-09T02:12:49.971591+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:33.827220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932057+0000","last_change":"2023-07-09T02:12:47.940927+0000","last_active":"2023-07-09T02:12:48.932057+0000","last_peered":"2023-07-09T02:12:48.932057+0000","last_clean":"2023-07-09T02:12:48.932057+0000","last_became_active":"2023-07-09T02:12:47.940563+0000","last_became_peered":"2023-07-09T02:12:47.940563+0000","last_unstale":"2023-07-09T02:12:48.932057+0000","last_undegraded":"2023-07-09T02:12:48.932057+0000","last_fullsized":"2023-07-09T02:12:48.932057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:28:01.400991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972450+0000","last_change":"2023-07-09T02:12:46.943588+0000","last_active":"2023-07-09T02:12:49.972450+0000","last_peered":"2023-07-09T02:12:49.972450+0000","last_clean":"2023-07-09T02:12:49.972450+0000","last_became_active":"2023-07-09T02:12:46.943367+0000","last_became_peered":"2023-07-09T02:12:46.943367+0000","last_unstale":"2023-07-09T02:12:49.972450+0000","last_undegraded":"2023-07-09T02:12:49.972450+0000","last_fullsized":"2023-07-09T02:12:49.972450+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:59.527240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971536+0000","last_change":"2023-07-09T02:12:47.943374+0000","last_active":"2023-07-09T02:12:49.971536+0000","last_peered":"2023-07-09T02:12:49.971536+0000","last_clean":"2023-07-09T02:12:49.971536+0000","last_became_active":"2023-07-09T02:12:47.942793+0000","last_became_peered":"2023-07-09T02:12:47.942793+0000","last_unstale":"2023-07-09T02:12:49.971536+0000","last_undegraded":"2023-07-09T02:12:49.971536+0000","last_fullsized":"2023-07-09T02:12:49.971536+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:20.771703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973015+0000","last_change":"2023-07-09T02:12:46.942709+0000","last_active":"2023-07-09T02:12:49.973015+0000","last_peered":"2023-07-09T02:12:49.973015+0000","last_clean":"2023-07-09T02:12:49.973015+0000","last_became_active":"2023-07-09T02:12:46.942421+0000","last_became_peered":"2023-07-09T02:12:46.942421+0000","last_unstale":"2023-07-09T02:12:49.973015+0000","last_undegraded":"2023-07-09T02:12:49.973015+0000","last_fullsized":"2023-07-09T02:12:49.973015+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:37:30.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932135+0000","last_change":"2023-07-09T02:12:47.940997+0000","last_active":"2023-07-09T02:12:48.932135+0000","last_peered":"2023-07-09T02:12:48.932135+0000","last_clean":"2023-07-09T02:12:48.932135+0000","last_became_active":"2023-07-09T02:12:47.940779+0000","last_became_peered":"2023-07-09T02:12:47.940779+0000","last_unstale":"2023-07-09T02:12:48.932135+0000","last_undegraded":"2023-07-09T02:12:48.932135+0000","last_fullsized":"2023-07-09T02:12:48.932135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:29.278920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932358+0000","last_change":"2023-07-09T02:12:46.931162+0000","last_active":"2023-07-09T02:12:48.932358+0000","last_peered":"2023-07-09T02:12:48.932358+0000","last_clean":"2023-07-09T02:12:48.932358+0000","last_became_active":"2023-07-09T02:12:46.930946+0000","last_became_peered":"2023-07-09T02:12:46.930946+0000","last_unstale":"2023-07-09T02:12:48.932358+0000","last_undegraded":"2023-07-09T02:12:48.932358+0000","last_fullsized":"2023-07-09T02:12:48.932358+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:58:31.222267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972082+0000","last_change":"2023-07-09T02:12:47.937626+0000","last_active":"2023-07-09T02:12:48.972082+0000","last_peered":"2023-07-09T02:12:48.972082+0000","last_clean":"2023-07-09T02:12:48.972082+0000","last_became_active":"2023-07-09T02:12:47.936241+0000","last_became_peered":"2023-07-09T02:12:47.936241+0000","last_unstale":"2023-07-09T02:12:48.972082+0000","last_undegraded":"2023-07-09T02:12:48.972082+0000","last_fullsized":"2023-07-09T02:12:48.972082+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:51:36.583121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933721+0000","last_change":"2023-07-09T02:12:46.938451+0000","last_active":"2023-07-09T02:12:48.933721+0000","last_peered":"2023-07-09T02:12:48.933721+0000","last_clean":"2023-07-09T02:12:48.933721+0000","last_became_active":"2023-07-09T02:12:46.938019+0000","last_became_peered":"2023-07-09T02:12:46.938019+0000","last_unstale":"2023-07-09T02:12:48.933721+0000","last_undegraded":"2023-07-09T02:12:48.933721+0000","last_fullsized":"2023-07-09T02:12:48.933721+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:07:05.716582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983344+0000","last_change":"2023-07-09T02:12:47.940894+0000","last_active":"2023-07-09T02:12:48.983344+0000","last_peered":"2023-07-09T02:12:48.983344+0000","last_clean":"2023-07-09T02:12:48.983344+0000","last_became_active":"2023-07-09T02:12:47.940658+0000","last_became_peered":"2023-07-09T02:12:47.940658+0000","last_unstale":"2023-07-09T02:12:48.983344+0000","last_undegraded":"2023-07-09T02:12:48.983344+0000","last_fullsized":"2023-07-09T02:12:48.983344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:59:22.259962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.971974+0000","last_change":"2023-07-09T02:12:46.937614+0000","last_active":"2023-07-09T02:12:48.971974+0000","last_peered":"2023-07-09T02:12:48.971974+0000","last_clean":"2023-07-09T02:12:48.971974+0000","last_became_active":"2023-07-09T02:12:46.937192+0000","last_became_peered":"2023-07-09T02:12:46.937192+0000","last_unstale":"2023-07-09T02:12:48.971974+0000","last_undegraded":"2023-07-09T02:12:48.971974+0000","last_fullsized":"2023-07-09T02:12:48.971974+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:00:52.100191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932432+0000","last_change":"2023-07-09T02:12:47.950073+0000","last_active":"2023-07-09T02:12:48.932432+0000","last_peered":"2023-07-09T02:12:48.932432+0000","last_clean":"2023-07-09T02:12:48.932432+0000","last_became_active":"2023-07-09T02:12:47.949811+0000","last_became_peered":"2023-07-09T02:12:47.949811+0000","last_unstale":"2023-07-09T02:12:48.932432+0000","last_undegraded":"2023-07-09T02:12:48.932432+0000","last_fullsized":"2023-07-09T02:12:48.932432+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:42:52.374840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971517+0000","last_change":"2023-07-09T02:12:46.935291+0000","last_active":"2023-07-09T02:12:49.971517+0000","last_peered":"2023-07-09T02:12:49.971517+0000","last_clean":"2023-07-09T02:12:49.971517+0000","last_became_active":"2023-07-09T02:12:46.935042+0000","last_became_peered":"2023-07-09T02:12:46.935042+0000","last_unstale":"2023-07-09T02:12:49.971517+0000","last_undegraded":"2023-07-09T02:12:49.971517+0000","last_fullsized":"2023-07-09T02:12:49.971517+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:31:06.810848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983633+0000","last_change":"2023-07-09T02:12:47.933739+0000","last_active":"2023-07-09T02:12:48.983633+0000","last_peered":"2023-07-09T02:12:48.983633+0000","last_clean":"2023-07-09T02:12:48.983633+0000","last_became_active":"2023-07-09T02:12:47.933512+0000","last_became_peered":"2023-07-09T02:12:47.933512+0000","last_unstale":"2023-07-09T02:12:48.983633+0000","last_undegraded":"2023-07-09T02:12:48.983633+0000","last_fullsized":"2023-07-09T02:12:48.983633+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:25.039230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933518+0000","last_change":"2023-07-09T02:12:46.942095+0000","last_active":"2023-07-09T02:12:48.933518+0000","last_peered":"2023-07-09T02:12:48.933518+0000","last_clean":"2023-07-09T02:12:48.933518+0000","last_became_active":"2023-07-09T02:12:46.941725+0000","last_became_peered":"2023-07-09T02:12:46.941725+0000","last_unstale":"2023-07-09T02:12:48.933518+0000","last_undegraded":"2023-07-09T02:12:48.933518+0000","last_fullsized":"2023-07-09T02:12:48.933518+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:13:50.709158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972145+0000","last_change":"2023-07-09T02:12:47.943386+0000","last_active":"2023-07-09T02:12:48.972145+0000","last_peered":"2023-07-09T02:12:48.972145+0000","last_clean":"2023-07-09T02:12:48.972145+0000","last_became_active":"2023-07-09T02:12:47.941674+0000","last_became_peered":"2023-07-09T02:12:47.941674+0000","last_unstale":"2023-07-09T02:12:48.972145+0000","last_undegraded":"2023-07-09T02:12:48.972145+0000","last_fullsized":"2023-07-09T02:12:48.972145+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:24:08.104713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983701+0000","last_change":"2023-07-09T02:12:46.938916+0000","last_active":"2023-07-09T02:12:48.983701+0000","last_peered":"2023-07-09T02:12:48.983701+0000","last_clean":"2023-07-09T02:12:48.983701+0000","last_became_active":"2023-07-09T02:12:46.938691+0000","last_became_peered":"2023-07-09T02:12:46.938691+0000","last_unstale":"2023-07-09T02:12:48.983701+0000","last_undegraded":"2023-07-09T02:12:48.983701+0000","last_fullsized":"2023-07-09T02:12:48.983701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:40:52.675215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931879+0000","last_change":"2023-07-09T02:12:47.941586+0000","last_active":"2023-07-09T02:12:48.931879+0000","last_peered":"2023-07-09T02:12:48.931879+0000","last_clean":"2023-07-09T02:12:48.931879+0000","last_became_active":"2023-07-09T02:12:47.941348+0000","last_became_peered":"2023-07-09T02:12:47.941348+0000","last_unstale":"2023-07-09T02:12:48.931879+0000","last_undegraded":"2023-07-09T02:12:48.931879+0000","last_fullsized":"2023-07-09T02:12:48.931879+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:03:16.682093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972192+0000","last_change":"2023-07-09T02:12:46.929785+0000","last_active":"2023-07-09T02:12:48.972192+0000","last_peered":"2023-07-09T02:12:48.972192+0000","last_clean":"2023-07-09T02:12:48.972192+0000","last_became_active":"2023-07-09T02:12:46.929527+0000","last_became_peered":"2023-07-09T02:12:46.929527+0000","last_unstale":"2023-07-09T02:12:48.972192+0000","last_undegraded":"2023-07-09T02:12:48.972192+0000","last_fullsized":"2023-07-09T02:12:48.972192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:49:27.606505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933246+0000","last_change":"2023-07-09T02:12:47.940854+0000","last_active":"2023-07-09T02:12:48.933246+0000","last_peered":"2023-07-09T02:12:48.933246+0000","last_clean":"2023-07-09T02:12:48.933246+0000","last_became_active":"2023-07-09T02:12:47.939974+0000","last_became_peered":"2023-07-09T02:12:47.939974+0000","last_unstale":"2023-07-09T02:12:48.933246+0000","last_undegraded":"2023-07-09T02:12:48.933246+0000","last_fullsized":"2023-07-09T02:12:48.933246+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:01:39.726596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"47'3","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983569+0000","last_change":"2023-07-09T02:12:46.937195+0000","last_active":"2023-07-09T02:12:48.983569+0000","last_peered":"2023-07-09T02:12:48.983569+0000","last_clean":"2023-07-09T02:12:48.983569+0000","last_became_active":"2023-07-09T02:12:46.936981+0000","last_became_peered":"2023-07-09T02:12:46.936981+0000","last_unstale":"2023-07-09T02:12:48.983569+0000","last_undegraded":"2023-07-09T02:12:48.983569+0000","last_fullsized":"2023-07-09T02:12:48.983569+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:18:31.222865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.971892+0000","last_change":"2023-07-09T02:12:47.939009+0000","last_active":"2023-07-09T02:12:48.971892+0000","last_peered":"2023-07-09T02:12:48.971892+0000","last_clean":"2023-07-09T02:12:48.971892+0000","last_became_active":"2023-07-09T02:12:47.938790+0000","last_became_peered":"2023-07-09T02:12:47.938790+0000","last_unstale":"2023-07-09T02:12:48.971892+0000","last_undegraded":"2023-07-09T02:12:48.971892+0000","last_fullsized":"2023-07-09T02:12:48.971892+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:36:27.371788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"47'6","reported_seq":19,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932295+0000","last_change":"2023-07-09T02:12:46.937603+0000","last_active":"2023-07-09T02:12:48.932295+0000","last_peered":"2023-07-09T02:12:48.932295+0000","last_clean":"2023-07-09T02:12:48.932295+0000","last_became_active":"2023-07-09T02:12:46.936672+0000","last_became_peered":"2023-07-09T02:12:46.936672+0000","last_unstale":"2023-07-09T02:12:48.932295+0000","last_undegraded":"2023-07-09T02:12:48.932295+0000","last_fullsized":"2023-07-09T02:12:48.932295+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:13:50.709158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932103+0000","last_change":"2023-07-09T02:12:47.941769+0000","last_active":"2023-07-09T02:12:48.932103+0000","last_peered":"2023-07-09T02:12:48.932103+0000","last_clean":"2023-07-09T02:12:48.932103+0000","last_became_active":"2023-07-09T02:12:47.941321+0000","last_became_peered":"2023-07-09T02:12:47.941321+0000","last_unstale":"2023-07-09T02:12:48.932103+0000","last_undegraded":"2023-07-09T02:12:48.932103+0000","last_fullsized":"2023-07-09T02:12:48.932103+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:26.958581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933645+0000","last_change":"2023-07-09T02:12:46.939195+0000","last_active":"2023-07-09T02:12:48.933645+0000","last_peered":"2023-07-09T02:12:48.933645+0000","last_clean":"2023-07-09T02:12:48.933645+0000","last_became_active":"2023-07-09T02:12:46.938489+0000","last_became_peered":"2023-07-09T02:12:46.938489+0000","last_unstale":"2023-07-09T02:12:48.933645+0000","last_undegraded":"2023-07-09T02:12:48.933645+0000","last_fullsized":"2023-07-09T02:12:48.933645+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:06:31.818415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933402+0000","last_change":"2023-07-09T02:12:47.941702+0000","last_active":"2023-07-09T02:12:48.933402+0000","last_peered":"2023-07-09T02:12:48.933402+0000","last_clean":"2023-07-09T02:12:48.933402+0000","last_became_active":"2023-07-09T02:12:47.941487+0000","last_became_peered":"2023-07-09T02:12:47.941487+0000","last_unstale":"2023-07-09T02:12:48.933402+0000","last_undegraded":"2023-07-09T02:12:48.933402+0000","last_fullsized":"2023-07-09T02:12:48.933402+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:26:59.166176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971691+0000","last_change":"2023-07-09T02:12:46.943546+0000","last_active":"2023-07-09T02:12:49.971691+0000","last_peered":"2023-07-09T02:12:49.971691+0000","last_clean":"2023-07-09T02:12:49.971691+0000","last_became_active":"2023-07-09T02:12:46.943312+0000","last_became_peered":"2023-07-09T02:12:46.943312+0000","last_unstale":"2023-07-09T02:12:49.971691+0000","last_undegraded":"2023-07-09T02:12:49.971691+0000","last_fullsized":"2023-07-09T02:12:49.971691+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:43:28.676212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.931919+0000","last_change":"2023-07-09T02:12:47.948429+0000","last_active":"2023-07-09T02:12:48.931919+0000","last_peered":"2023-07-09T02:12:48.931919+0000","last_clean":"2023-07-09T02:12:48.931919+0000","last_became_active":"2023-07-09T02:12:47.946176+0000","last_became_peered":"2023-07-09T02:12:47.946176+0000","last_unstale":"2023-07-09T02:12:48.931919+0000","last_undegraded":"2023-07-09T02:12:48.931919+0000","last_fullsized":"2023-07-09T02:12:48.931919+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:34:29.196936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983403+0000","last_change":"2023-07-09T02:12:46.938663+0000","last_active":"2023-07-09T02:12:48.983403+0000","last_peered":"2023-07-09T02:12:48.983403+0000","last_clean":"2023-07-09T02:12:48.983403+0000","last_became_active":"2023-07-09T02:12:46.938401+0000","last_became_peered":"2023-07-09T02:12:46.938401+0000","last_unstale":"2023-07-09T02:12:48.983403+0000","last_undegraded":"2023-07-09T02:12:48.983403+0000","last_fullsized":"2023-07-09T02:12:48.983403+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:20:15.500993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933123+0000","last_change":"2023-07-09T02:12:47.945769+0000","last_active":"2023-07-09T02:12:48.933123+0000","last_peered":"2023-07-09T02:12:48.933123+0000","last_clean":"2023-07-09T02:12:48.933123+0000","last_became_active":"2023-07-09T02:12:47.945371+0000","last_became_peered":"2023-07-09T02:12:47.945371+0000","last_unstale":"2023-07-09T02:12:48.933123+0000","last_undegraded":"2023-07-09T02:12:48.933123+0000","last_fullsized":"2023-07-09T02:12:48.933123+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:20:35.628274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"47'8","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932014+0000","last_change":"2023-07-09T02:12:46.938041+0000","last_active":"2023-07-09T02:12:48.932014+0000","last_peered":"2023-07-09T02:12:48.932014+0000","last_clean":"2023-07-09T02:12:48.932014+0000","last_became_active":"2023-07-09T02:12:46.937818+0000","last_became_peered":"2023-07-09T02:12:46.937818+0000","last_unstale":"2023-07-09T02:12:48.932014+0000","last_undegraded":"2023-07-09T02:12:48.932014+0000","last_fullsized":"2023-07-09T02:12:48.932014+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:04.427889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932175+0000","last_change":"2023-07-09T02:12:47.948583+0000","last_active":"2023-07-09T02:12:48.932175+0000","last_peered":"2023-07-09T02:12:48.932175+0000","last_clean":"2023-07-09T02:12:48.932175+0000","last_became_active":"2023-07-09T02:12:47.948164+0000","last_became_peered":"2023-07-09T02:12:47.948164+0000","last_unstale":"2023-07-09T02:12:48.932175+0000","last_undegraded":"2023-07-09T02:12:48.932175+0000","last_fullsized":"2023-07-09T02:12:48.932175+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:26:59.166176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933637+0000","last_change":"2023-07-09T02:12:46.943336+0000","last_active":"2023-07-09T02:12:48.933637+0000","last_peered":"2023-07-09T02:12:48.933637+0000","last_clean":"2023-07-09T02:12:48.933637+0000","last_became_active":"2023-07-09T02:12:46.942838+0000","last_became_peered":"2023-07-09T02:12:46.942838+0000","last_unstale":"2023-07-09T02:12:48.933637+0000","last_undegraded":"2023-07-09T02:12:48.933637+0000","last_fullsized":"2023-07-09T02:12:48.933637+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:01:42.381126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972885+0000","last_change":"2023-07-09T02:12:47.943989+0000","last_active":"2023-07-09T02:12:49.972885+0000","last_peered":"2023-07-09T02:12:49.972885+0000","last_clean":"2023-07-09T02:12:49.972885+0000","last_became_active":"2023-07-09T02:12:47.943646+0000","last_became_peered":"2023-07-09T02:12:47.943646+0000","last_unstale":"2023-07-09T02:12:49.972885+0000","last_undegraded":"2023-07-09T02:12:49.972885+0000","last_fullsized":"2023-07-09T02:12:49.972885+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:22:04.186323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.985079+0000","last_change":"2023-07-09T02:12:46.932782+0000","last_active":"2023-07-09T02:12:48.985079+0000","last_peered":"2023-07-09T02:12:48.985079+0000","last_clean":"2023-07-09T02:12:48.985079+0000","last_became_active":"2023-07-09T02:12:46.932519+0000","last_became_peered":"2023-07-09T02:12:46.932519+0000","last_unstale":"2023-07-09T02:12:48.985079+0000","last_undegraded":"2023-07-09T02:12:48.985079+0000","last_fullsized":"2023-07-09T02:12:48.985079+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:11:27.439570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972057+0000","last_change":"2023-07-09T02:12:47.938081+0000","last_active":"2023-07-09T02:12:48.972057+0000","last_peered":"2023-07-09T02:12:48.972057+0000","last_clean":"2023-07-09T02:12:48.972057+0000","last_became_active":"2023-07-09T02:12:47.937838+0000","last_became_peered":"2023-07-09T02:12:47.937838+0000","last_unstale":"2023-07-09T02:12:48.972057+0000","last_undegraded":"2023-07-09T02:12:48.972057+0000","last_fullsized":"2023-07-09T02:12:48.972057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:39:47.715340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971827+0000","last_change":"2023-07-09T02:12:46.941339+0000","last_active":"2023-07-09T02:12:49.971827+0000","last_peered":"2023-07-09T02:12:49.971827+0000","last_clean":"2023-07-09T02:12:49.971827+0000","last_became_active":"2023-07-09T02:12:46.941142+0000","last_became_peered":"2023-07-09T02:12:46.941142+0000","last_unstale":"2023-07-09T02:12:49.971827+0000","last_undegraded":"2023-07-09T02:12:49.971827+0000","last_fullsized":"2023-07-09T02:12:49.971827+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:19:15.719135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973031+0000","last_change":"2023-07-09T02:12:47.950453+0000","last_active":"2023-07-09T02:12:49.973031+0000","last_peered":"2023-07-09T02:12:49.973031+0000","last_clean":"2023-07-09T02:12:49.973031+0000","last_became_active":"2023-07-09T02:12:47.950171+0000","last_became_peered":"2023-07-09T02:12:47.950171+0000","last_unstale":"2023-07-09T02:12:49.973031+0000","last_undegraded":"2023-07-09T02:12:49.973031+0000","last_fullsized":"2023-07-09T02:12:49.973031+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:17:36.277552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971533+0000","last_change":"2023-07-09T02:12:46.939456+0000","last_active":"2023-07-09T02:12:49.971533+0000","last_peered":"2023-07-09T02:12:49.971533+0000","last_clean":"2023-07-09T02:12:49.971533+0000","last_became_active":"2023-07-09T02:12:46.939075+0000","last_became_peered":"2023-07-09T02:12:46.939075+0000","last_unstale":"2023-07-09T02:12:49.971533+0000","last_undegraded":"2023-07-09T02:12:49.971533+0000","last_fullsized":"2023-07-09T02:12:49.971533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:15:07.654800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932144+0000","last_change":"2023-07-09T02:12:47.939282+0000","last_active":"2023-07-09T02:12:48.932144+0000","last_peered":"2023-07-09T02:12:48.932144+0000","last_clean":"2023-07-09T02:12:48.932144+0000","last_became_active":"2023-07-09T02:12:47.939063+0000","last_became_peered":"2023-07-09T02:12:47.939063+0000","last_unstale":"2023-07-09T02:12:48.932144+0000","last_undegraded":"2023-07-09T02:12:48.932144+0000","last_fullsized":"2023-07-09T02:12:48.932144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:27:18.298549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973040+0000","last_change":"2023-07-09T02:12:46.936739+0000","last_active":"2023-07-09T02:12:49.973040+0000","last_peered":"2023-07-09T02:12:49.973040+0000","last_clean":"2023-07-09T02:12:49.973040+0000","last_became_active":"2023-07-09T02:12:46.936110+0000","last_became_peered":"2023-07-09T02:12:46.936110+0000","last_unstale":"2023-07-09T02:12:49.973040+0000","last_undegraded":"2023-07-09T02:12:49.973040+0000","last_fullsized":"2023-07-09T02:12:49.973040+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:33:35.592256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971228+0000","last_change":"2023-07-09T02:12:47.940031+0000","last_active":"2023-07-09T02:12:49.971228+0000","last_peered":"2023-07-09T02:12:49.971228+0000","last_clean":"2023-07-09T02:12:49.971228+0000","last_became_active":"2023-07-09T02:12:47.939814+0000","last_became_peered":"2023-07-09T02:12:47.939814+0000","last_unstale":"2023-07-09T02:12:49.971228+0000","last_undegraded":"2023-07-09T02:12:49.971228+0000","last_fullsized":"2023-07-09T02:12:49.971228+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:10:38.951597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932391+0000","last_change":"2023-07-09T02:12:46.937762+0000","last_active":"2023-07-09T02:12:48.932391+0000","last_peered":"2023-07-09T02:12:48.932391+0000","last_clean":"2023-07-09T02:12:48.932391+0000","last_became_active":"2023-07-09T02:12:46.937015+0000","last_became_peered":"2023-07-09T02:12:46.937015+0000","last_unstale":"2023-07-09T02:12:48.932391+0000","last_undegraded":"2023-07-09T02:12:48.932391+0000","last_fullsized":"2023-07-09T02:12:48.932391+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:26:55.033760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933519+0000","last_change":"2023-07-09T02:12:47.940986+0000","last_active":"2023-07-09T02:12:48.933519+0000","last_peered":"2023-07-09T02:12:48.933519+0000","last_clean":"2023-07-09T02:12:48.933519+0000","last_became_active":"2023-07-09T02:12:47.940280+0000","last_became_peered":"2023-07-09T02:12:47.940280+0000","last_unstale":"2023-07-09T02:12:48.933519+0000","last_undegraded":"2023-07-09T02:12:48.933519+0000","last_fullsized":"2023-07-09T02:12:48.933519+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:26:56.042432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933766+0000","last_change":"2023-07-09T02:12:46.939337+0000","last_active":"2023-07-09T02:12:48.933766+0000","last_peered":"2023-07-09T02:12:48.933766+0000","last_clean":"2023-07-09T02:12:48.933766+0000","last_became_active":"2023-07-09T02:12:46.938977+0000","last_became_peered":"2023-07-09T02:12:46.938977+0000","last_unstale":"2023-07-09T02:12:48.933766+0000","last_undegraded":"2023-07-09T02:12:48.933766+0000","last_fullsized":"2023-07-09T02:12:48.933766+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:28:43.176926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972750+0000","last_change":"2023-07-09T02:12:47.944896+0000","last_active":"2023-07-09T02:12:49.972750+0000","last_peered":"2023-07-09T02:12:49.972750+0000","last_clean":"2023-07-09T02:12:49.972750+0000","last_became_active":"2023-07-09T02:12:47.944680+0000","last_became_peered":"2023-07-09T02:12:47.944680+0000","last_unstale":"2023-07-09T02:12:49.972750+0000","last_undegraded":"2023-07-09T02:12:49.972750+0000","last_fullsized":"2023-07-09T02:12:49.972750+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:31:16.274271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.985218+0000","last_change":"2023-07-09T02:12:46.941667+0000","last_active":"2023-07-09T02:12:48.985218+0000","last_peered":"2023-07-09T02:12:48.985218+0000","last_clean":"2023-07-09T02:12:48.985218+0000","last_became_active":"2023-07-09T02:12:46.941279+0000","last_became_peered":"2023-07-09T02:12:46.941279+0000","last_unstale":"2023-07-09T02:12:48.985218+0000","last_undegraded":"2023-07-09T02:12:48.985218+0000","last_fullsized":"2023-07-09T02:12:48.985218+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:59.359282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971644+0000","last_change":"2023-07-09T02:12:47.940990+0000","last_active":"2023-07-09T02:12:49.971644+0000","last_peered":"2023-07-09T02:12:49.971644+0000","last_clean":"2023-07-09T02:12:49.971644+0000","last_became_active":"2023-07-09T02:12:47.940771+0000","last_became_peered":"2023-07-09T02:12:47.940771+0000","last_unstale":"2023-07-09T02:12:49.971644+0000","last_undegraded":"2023-07-09T02:12:49.971644+0000","last_fullsized":"2023-07-09T02:12:49.971644+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:54:24.276859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933639+0000","last_change":"2023-07-09T02:12:46.940333+0000","last_active":"2023-07-09T02:12:48.933639+0000","last_peered":"2023-07-09T02:12:48.933639+0000","last_clean":"2023-07-09T02:12:48.933639+0000","last_became_active":"2023-07-09T02:12:46.940081+0000","last_became_peered":"2023-07-09T02:12:46.940081+0000","last_unstale":"2023-07-09T02:12:48.933639+0000","last_undegraded":"2023-07-09T02:12:48.933639+0000","last_fullsized":"2023-07-09T02:12:48.933639+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:59.527240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983812+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:12:48.983812+0000","last_peered":"2023-07-09T02:12:48.983812+0000","last_clean":"2023-07-09T02:12:48.983812+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:12:48.983812+0000","last_undegraded":"2023-07-09T02:12:48.983812+0000","last_fullsized":"2023-07-09T02:12:48.983812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:48:50.250571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932415+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:12:48.932415+0000","last_peered":"2023-07-09T02:12:48.932415+0000","last_clean":"2023-07-09T02:12:48.932415+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:12:48.932415+0000","last_undegraded":"2023-07-09T02:12:48.932415+0000","last_fullsized":"2023-07-09T02:12:48.932415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:47:30.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.972676+0000","last_change":"2023-07-09T02:12:47.946285+0000","last_active":"2023-07-09T02:12:49.972676+0000","last_peered":"2023-07-09T02:12:49.972676+0000","last_clean":"2023-07-09T02:12:49.972676+0000","last_became_active":"2023-07-09T02:12:47.946051+0000","last_became_peered":"2023-07-09T02:12:47.946051+0000","last_unstale":"2023-07-09T02:12:49.972676+0000","last_undegraded":"2023-07-09T02:12:49.972676+0000","last_fullsized":"2023-07-09T02:12:49.972676+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:45:22.490687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983627+0000","last_change":"2023-07-09T02:12:46.936577+0000","last_active":"2023-07-09T02:12:48.983627+0000","last_peered":"2023-07-09T02:12:48.983627+0000","last_clean":"2023-07-09T02:12:48.983627+0000","last_became_active":"2023-07-09T02:12:46.936260+0000","last_became_peered":"2023-07-09T02:12:46.936260+0000","last_unstale":"2023-07-09T02:12:48.983627+0000","last_undegraded":"2023-07-09T02:12:48.983627+0000","last_fullsized":"2023-07-09T02:12:48.983627+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:16:28.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983702+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:12:48.983702+0000","last_peered":"2023-07-09T02:12:48.983702+0000","last_clean":"2023-07-09T02:12:48.983702+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:12:48.983702+0000","last_undegraded":"2023-07-09T02:12:48.983702+0000","last_fullsized":"2023-07-09T02:12:48.983702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:03:53.778055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932152+0000","last_change":"2023-07-09T02:12:47.948326+0000","last_active":"2023-07-09T02:12:48.932152+0000","last_peered":"2023-07-09T02:12:48.932152+0000","last_clean":"2023-07-09T02:12:48.932152+0000","last_became_active":"2023-07-09T02:12:47.947773+0000","last_became_peered":"2023-07-09T02:12:47.947773+0000","last_unstale":"2023-07-09T02:12:48.932152+0000","last_undegraded":"2023-07-09T02:12:48.932152+0000","last_fullsized":"2023-07-09T02:12:48.932152+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:20:14.220427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933855+0000","last_change":"2023-07-09T02:12:46.941958+0000","last_active":"2023-07-09T02:12:48.933855+0000","last_peered":"2023-07-09T02:12:48.933855+0000","last_clean":"2023-07-09T02:12:48.933855+0000","last_became_active":"2023-07-09T02:12:46.941400+0000","last_became_peered":"2023-07-09T02:12:46.941400+0000","last_unstale":"2023-07-09T02:12:48.933855+0000","last_undegraded":"2023-07-09T02:12:48.933855+0000","last_fullsized":"2023-07-09T02:12:48.933855+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:45:21.482015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.985141+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:12:48.985141+0000","last_peered":"2023-07-09T02:12:48.985141+0000","last_clean":"2023-07-09T02:12:48.985141+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:12:48.985141+0000","last_undegraded":"2023-07-09T02:12:48.985141+0000","last_fullsized":"2023-07-09T02:12:48.985141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:54:08.474725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932285+0000","last_change":"2023-07-09T02:12:47.945403+0000","last_active":"2023-07-09T02:12:48.932285+0000","last_peered":"2023-07-09T02:12:48.932285+0000","last_clean":"2023-07-09T02:12:48.932285+0000","last_became_active":"2023-07-09T02:12:47.945020+0000","last_became_peered":"2023-07-09T02:12:47.945020+0000","last_unstale":"2023-07-09T02:12:48.932285+0000","last_undegraded":"2023-07-09T02:12:48.932285+0000","last_fullsized":"2023-07-09T02:12:48.932285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:59:22.259962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971694+0000","last_change":"2023-07-09T02:12:46.943543+0000","last_active":"2023-07-09T02:12:49.971694+0000","last_peered":"2023-07-09T02:12:49.971694+0000","last_clean":"2023-07-09T02:12:49.971694+0000","last_became_active":"2023-07-09T02:12:46.943338+0000","last_became_peered":"2023-07-09T02:12:46.943338+0000","last_unstale":"2023-07-09T02:12:49.971694+0000","last_undegraded":"2023-07-09T02:12:49.971694+0000","last_fullsized":"2023-07-09T02:12:49.971694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:02:19.658556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932247+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:12:48.932247+0000","last_peered":"2023-07-09T02:12:48.932247+0000","last_clean":"2023-07-09T02:12:48.932247+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:12:48.932247+0000","last_undegraded":"2023-07-09T02:12:48.932247+0000","last_fullsized":"2023-07-09T02:12:48.932247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:18:40.693608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933918+0000","last_change":"2023-07-09T02:12:47.936663+0000","last_active":"2023-07-09T02:12:48.933918+0000","last_peered":"2023-07-09T02:12:48.933918+0000","last_clean":"2023-07-09T02:12:48.933918+0000","last_became_active":"2023-07-09T02:12:47.936458+0000","last_became_peered":"2023-07-09T02:12:47.936458+0000","last_unstale":"2023-07-09T02:12:48.933918+0000","last_undegraded":"2023-07-09T02:12:48.933918+0000","last_fullsized":"2023-07-09T02:12:48.933918+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:31:16.274271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.972088+0000","last_change":"2023-07-09T02:12:46.932425+0000","last_active":"2023-07-09T02:12:48.972088+0000","last_peered":"2023-07-09T02:12:48.972088+0000","last_clean":"2023-07-09T02:12:48.972088+0000","last_became_active":"2023-07-09T02:12:46.932105+0000","last_became_peered":"2023-07-09T02:12:46.932105+0000","last_unstale":"2023-07-09T02:12:48.972088+0000","last_undegraded":"2023-07-09T02:12:48.972088+0000","last_fullsized":"2023-07-09T02:12:48.972088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:36:55.459867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973071+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:12:49.973071+0000","last_peered":"2023-07-09T02:12:49.973071+0000","last_clean":"2023-07-09T02:12:49.973071+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:12:49.973071+0000","last_undegraded":"2023-07-09T02:12:49.973071+0000","last_fullsized":"2023-07-09T02:12:49.973071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:35:43.833960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932047+0000","last_change":"2023-07-09T02:12:47.951258+0000","last_active":"2023-07-09T02:12:48.932047+0000","last_peered":"2023-07-09T02:12:48.932047+0000","last_clean":"2023-07-09T02:12:48.932047+0000","last_became_active":"2023-07-09T02:12:47.949059+0000","last_became_peered":"2023-07-09T02:12:47.949059+0000","last_unstale":"2023-07-09T02:12:48.932047+0000","last_undegraded":"2023-07-09T02:12:48.932047+0000","last_fullsized":"2023-07-09T02:12:48.932047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:39:39.078505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932057+0000","last_change":"2023-07-09T02:12:46.934532+0000","last_active":"2023-07-09T02:12:48.932057+0000","last_peered":"2023-07-09T02:12:48.932057+0000","last_clean":"2023-07-09T02:12:48.932057+0000","last_became_active":"2023-07-09T02:12:46.934297+0000","last_became_peered":"2023-07-09T02:12:46.934297+0000","last_unstale":"2023-07-09T02:12:48.932057+0000","last_undegraded":"2023-07-09T02:12:48.932057+0000","last_fullsized":"2023-07-09T02:12:48.932057+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:06:27.608470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.983430+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:12:48.983430+0000","last_peered":"2023-07-09T02:12:48.983430+0000","last_clean":"2023-07-09T02:12:48.983430+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:12:48.983430+0000","last_undegraded":"2023-07-09T02:12:48.983430+0000","last_fullsized":"2023-07-09T02:12:48.983430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:56.414883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.933530+0000","last_change":"2023-07-09T02:12:47.945237+0000","last_active":"2023-07-09T02:12:48.933530+0000","last_peered":"2023-07-09T02:12:48.933530+0000","last_clean":"2023-07-09T02:12:48.933530+0000","last_became_active":"2023-07-09T02:12:47.944964+0000","last_became_peered":"2023-07-09T02:12:47.944964+0000","last_unstale":"2023-07-09T02:12:48.933530+0000","last_undegraded":"2023-07-09T02:12:48.933530+0000","last_fullsized":"2023-07-09T02:12:48.933530+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:42:52.374840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932176+0000","last_change":"2023-07-09T02:12:46.938307+0000","last_active":"2023-07-09T02:12:48.932176+0000","last_peered":"2023-07-09T02:12:48.932176+0000","last_clean":"2023-07-09T02:12:48.932176+0000","last_became_active":"2023-07-09T02:12:46.937882+0000","last_became_peered":"2023-07-09T02:12:46.937882+0000","last_unstale":"2023-07-09T02:12:48.932176+0000","last_undegraded":"2023-07-09T02:12:48.932176+0000","last_fullsized":"2023-07-09T02:12:48.932176+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:29:09.476334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.973120+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:12:49.973120+0000","last_peered":"2023-07-09T02:12:49.973120+0000","last_clean":"2023-07-09T02:12:49.973120+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:12:49.973120+0000","last_undegraded":"2023-07-09T02:12:49.973120+0000","last_fullsized":"2023-07-09T02:12:49.973120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:53:06.404867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932197+0000","last_change":"2023-07-09T02:12:47.941571+0000","last_active":"2023-07-09T02:12:48.932197+0000","last_peered":"2023-07-09T02:12:48.932197+0000","last_clean":"2023-07-09T02:12:48.932197+0000","last_became_active":"2023-07-09T02:12:47.941000+0000","last_became_peered":"2023-07-09T02:12:47.941000+0000","last_unstale":"2023-07-09T02:12:48.932197+0000","last_undegraded":"2023-07-09T02:12:48.932197+0000","last_fullsized":"2023-07-09T02:12:48.932197+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:46.919521+0000","last_clean_scrub_stamp":"2023-07-09T02:12:46.919521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:34.131486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:48.932538+0000","last_change":"2023-07-09T02:12:46.941175+0000","last_active":"2023-07-09T02:12:48.932538+0000","last_peered":"2023-07-09T02:12:48.932538+0000","last_clean":"2023-07-09T02:12:48.932538+0000","last_became_active":"2023-07-09T02:12:46.940762+0000","last_became_peered":"2023-07-09T02:12:46.940762+0000","last_unstale":"2023-07-09T02:12:48.932538+0000","last_undegraded":"2023-07-09T02:12:48.932538+0000","last_fullsized":"2023-07-09T02:12:48.932538+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:12:45.910849+0000","last_clean_scrub_stamp":"2023-07-09T02:12:45.910849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:59.527240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-07-09T02:12:49.971788+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:12:49.971788+0000","last_peered":"2023-07-09T02:12:49.971788+0000","last_clean":"2023-07-09T02:12:49.971788+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:12:49.971788+0000","last_undegraded":"2023-07-09T02:12:49.971788+0000","last_fullsized":"2023-07-09T02:12:49.971788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:43:47.635713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168542,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64300000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58599999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.495}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.621}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.94899999999999995}]},{"osd":1,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.78200000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.99299999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.80300000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.90900000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.69299999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195077,"statfs":{"total":200000000,"available":199759034,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.629}]},{"osd":1,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.71099999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67700000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.495},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.43099999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195076,"statfs":{"total":200000000,"available":199758452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.625},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.52300000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.81200000000000006}]},{"osd":5,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.86199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757448,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.36499999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72999999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.628},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.85399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":236,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195075,"statfs":{"total":200000000,"available":199757470,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.255}]},{"osd":1,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.621},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.59099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":228,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195083,"statfs":{"total":200000000,"available":199765527,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.315},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.37},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.379}]},{"osd":3,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.749}]},{"osd":6,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.69999999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168610,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.496}]},{"osd":2,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.44800000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.75},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.65700000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.74099999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.58299999999999996}]}]}],"pool_statfs":[]}} 2023-07-09T02:12:52.448 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:12:52.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:12:52.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95ccd37640 1 Processor -- start 2023-07-09T02:12:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95ccd37640 1 -- start start 2023-07-09T02:12:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95ccd37640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f95c80ced50 0x7f95c806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95ccd37640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c8071170 con 0x7f95c81598e0 2023-07-09T02:12:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95ccd37640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c80b4340 con 0x7f95c80b3f70 2023-07-09T02:12:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95ccd37640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c815a610 con 0x7f95c80ced50 2023-07-09T02:12:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95c6d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95c81598e0 0x7f95c8159d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47956/0 (socket says 172.21.15.45:47956) 2023-07-09T02:12:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95c6d9d640 1 -- 172.21.15.45:0/1315295826 learned_addr learned my addr 172.21.15.45:0/1315295826 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95bffff640 1 --2- 172.21.15.45:0/1315295826 >> v2:172.21.15.155:3300/0 conn(0x7f95c80ced50 0x7f95c806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95c5d9b640 1 -- 172.21.15.45:0/1315295826 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381185172 0 0) 0x7f95c00014a0 con 0x7f95c81598e0 2023-07-09T02:12:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95c5d9b640 1 -- 172.21.15.45:0/1315295826 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b4003530 con 0x7f95c81598e0 2023-07-09T02:12:52.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95bffff640 1 -- 172.21.15.45:0/1315295826 >> v1:172.21.15.155:6789/0 conn(0x7f95c80b3f70 legacy=0x7f95c80ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95bffff640 1 -- 172.21.15.45:0/1315295826 >> v1:172.21.15.45:6789/0 conn(0x7f95c81598e0 legacy=0x7f95c8159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95c5d9b640 1 -- 172.21.15.45:0/1315295826 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402747051 0 0) 0x7f95b4003530 con 0x7f95c81598e0 2023-07-09T02:12:52.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.627+0000 7f95bffff640 1 -- 172.21.15.45:0/1315295826 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c815a8f0 con 0x7f95c80ced50 2023-07-09T02:12:52.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95bffff640 1 --2- 172.21.15.45:0/1315295826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c80ced50 0x7f95c806bbc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95b00097c0 tx=0x7f95b001e580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6cd60e06ff3ab18 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:52.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95c5d9b640 1 -- 172.21.15.45:0/1315295826 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0001b90 con 0x7f95c80ced50 2023-07-09T02:12:52.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95c5d9b640 1 -- 172.21.15.45:0/1315295826 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b00ac470 con 0x7f95c80ced50 2023-07-09T02:12:52.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95c5d9b640 1 -- 172.21.15.45:0/1315295826 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00ac7e0 con 0x7f95c80ced50 2023-07-09T02:12:52.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95ccd37640 1 -- 172.21.15.45:0/1315295826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c80ced50 msgr2=0x7f95c806bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95ccd37640 1 --2- 172.21.15.45:0/1315295826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c80ced50 0x7f95c806bbc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95b00097c0 tx=0x7f95b001e580 comp rx=0 tx=0).stop 2023-07-09T02:12:52.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95ccd37640 1 -- 172.21.15.45:0/1315295826 shutdown_connections 2023-07-09T02:12:52.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95ccd37640 1 --2- 172.21.15.45:0/1315295826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c80ced50 0x7f95c806bbc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95ccd37640 1 -- 172.21.15.45:0/1315295826 >> 172.21.15.45:0/1315295826 conn(0x7f95c80694b0 msgr2=0x7f95c80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:52.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95ccd37640 1 -- 172.21.15.45:0/1315295826 shutdown_connections 2023-07-09T02:12:52.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.631+0000 7f95ccd37640 1 -- 172.21.15.45:0/1315295826 wait complete. 2023-07-09T02:12:52.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 Processor -- start 2023-07-09T02:12:52.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 -- start start 2023-07-09T02:12:52.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80b3f70 0x7f95c8153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c80ced50 0x7f95c81537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c81598e0 0x7f95c80ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c8153580 con 0x7f95c80b3f70 2023-07-09T02:12:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80cdcd0 con 0x7f95c81598e0 2023-07-09T02:12:52.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80cdfb0 con 0x7f95c80ced50 2023-07-09T02:12:52.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80b3f70 0x7f95c8153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80b3f70 0x7f95c8153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41954/0 (socket says 172.21.15.45:41954) 2023-07-09T02:12:52.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 -- 172.21.15.45:0/3882731730 learned_addr learned my addr 172.21.15.45:0/3882731730 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:52.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c6d9d640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c81598e0 0x7f95c80ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95bffff640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c80ced50 0x7f95c81537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 -- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c80ced50 msgr2=0x7f95c81537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c80ced50 0x7f95c81537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 -- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c81598e0 msgr2=0x7f95c80ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c81598e0 0x7f95c80ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 -- 172.21.15.45:0/3882731730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009420 con 0x7f95c80b3f70 2023-07-09T02:12:52.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c6d9d640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c81598e0 0x7f95c80ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:52.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95c659c640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80b3f70 0x7f95c8153040 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c420 tx=0x7f95b800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:52.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95beffd640 1 -- 172.21.15.45:0/3882731730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80052d0 con 0x7f95c80b3f70 2023-07-09T02:12:52.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95beffd640 1 -- 172.21.15.45:0/3882731730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b8005430 con 0x7f95c80b3f70 2023-07-09T02:12:52.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95beffd640 1 -- 172.21.15.45:0/3882731730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8007260 con 0x7f95c80b3f70 2023-07-09T02:12:52.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c80c6a70 con 0x7f95c80b3f70 2023-07-09T02:12:52.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.635+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c80c2170 con 0x7f95c80b3f70 2023-07-09T02:12:52.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.639+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c804d7d0 con 0x7f95c80b3f70 2023-07-09T02:12:52.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.639+0000 7f95beffd640 1 -- 172.21.15.45:0/3882731730 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95b80073c0 con 0x7f95c80b3f70 2023-07-09T02:12:52.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.639+0000 7f95beffd640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95a80662b0 0x7f95a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:52.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.639+0000 7f95beffd640 1 -- 172.21.15.45:0/3882731730 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95b80831a0 con 0x7f95c80b3f70 2023-07-09T02:12:52.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.639+0000 7f95bffff640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95a80662b0 0x7f95a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:52.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.639+0000 7f95bffff640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95a80662b0 0x7f95a8068760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f95b00b0000 tx=0x7f95b00a9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:52.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.643+0000 7f95beffd640 1 -- 172.21.15.45:0/3882731730 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95b8050580 con 0x7f95c80b3f70 2023-07-09T02:12:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.855+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f95c80c8d00 con 0x7f95c80b3f70 2023-07-09T02:12:52.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95beffd640 1 -- 172.21.15.45:0/3882731730 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f95b8053ba0 con 0x7f95c80b3f70 2023-07-09T02:12:52.861 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:12:52.862 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:12:52.862 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:12:52.862 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:12:52.862 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:12:52.862 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:12:52.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95a80662b0 msgr2=0x7f95a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95a80662b0 0x7f95a8068760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f95b00b0000 tx=0x7f95b00a9000 comp rx=0 tx=0).stop 2023-07-09T02:12:52.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80b3f70 msgr2=0x7f95c8153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:52.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80b3f70 0x7f95c8153040 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c420 tx=0x7f95b800c8e0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 shutdown_connections 2023-07-09T02:12:52.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c81598e0 0x7f95c80ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95a80662b0 0x7f95a8068760 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c80ced50 0x7f95c81537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 --2- 172.21.15.45:0/3882731730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95c80b3f70 0x7f95c8153040 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:52.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 >> 172.21.15.45:0/3882731730 conn(0x7f95c80694b0 msgr2=0x7f95c8158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:52.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 shutdown_connections 2023-07-09T02:12:52.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:52.859+0000 7f95ccd37640 1 -- 172.21.15.45:0/3882731730 wait complete. 2023-07-09T02:12:52.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b92d8640 1 Processor -- start 2023-07-09T02:12:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b92d8640 1 -- start start 2023-07-09T02:12:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b92d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69b415c060 0x7f69b40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b92d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f69b40d2620 0x7f69b40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b92d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b4160a50 con 0x7f69b40cd120 2023-07-09T02:12:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b92d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b415c430 con 0x7f69b415c060 2023-07-09T02:12:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b92d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b415fb60 con 0x7f69b40d2620 2023-07-09T02:12:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69b415c060 0x7f69b40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69abfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f69b40cd120 0x7f69b40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47958/0 (socket says 172.21.15.45:47958) 2023-07-09T02:12:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69abfff640 1 -- 172.21.15.45:0/1539320227 learned_addr learned my addr 172.21.15.45:0/1539320227 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b37fe640 1 --2- 172.21.15.45:0/1539320227 >> v2:172.21.15.155:3300/0 conn(0x7f69b40d2620 0x7f69b40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b2ffd640 1 -- 172.21.15.45:0/1539320227 >> v2:172.21.15.155:3300/0 conn(0x7f69b40d2620 msgr2=0x7f69b40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b2ffd640 1 --2- 172.21.15.45:0/1539320227 >> v2:172.21.15.155:3300/0 conn(0x7f69b40d2620 0x7f69b40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b2ffd640 1 -- 172.21.15.45:0/1539320227 >> v1:172.21.15.45:6789/0 conn(0x7f69b40cd120 legacy=0x7f69b40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b27fc640 1 -- 172.21.15.45:0/1539320227 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352479089 0 0) 0x7f69b4160a50 con 0x7f69b40cd120 2023-07-09T02:12:53.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.023+0000 7f69b2ffd640 1 -- 172.21.15.45:0/1539320227 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b415fe40 con 0x7f69b415c060 2023-07-09T02:12:53.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b2ffd640 1 --2- 172.21.15.45:0/1539320227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b415c060 0x7f69b40b4ed0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f69b408bca0 tx=0x7f69a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7513da21805df285 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b27fc640 1 -- 172.21.15.45:0/1539320227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40a7070 con 0x7f69b415c060 2023-07-09T02:12:53.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b27fc640 1 -- 172.21.15.45:0/1539320227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a40ab430 con 0x7f69b415c060 2023-07-09T02:12:53.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b27fc640 1 -- 172.21.15.45:0/1539320227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40ab7c0 con 0x7f69b415c060 2023-07-09T02:12:53.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b92d8640 1 -- 172.21.15.45:0/1539320227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b415c060 msgr2=0x7f69b40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b92d8640 1 --2- 172.21.15.45:0/1539320227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b415c060 0x7f69b40b4ed0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f69b408bca0 tx=0x7f69a401c430 comp rx=0 tx=0).stop 2023-07-09T02:12:53.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b92d8640 1 -- 172.21.15.45:0/1539320227 shutdown_connections 2023-07-09T02:12:53.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b92d8640 1 --2- 172.21.15.45:0/1539320227 >> v2:172.21.15.155:3300/0 conn(0x7f69b40d2620 0x7f69b40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b92d8640 1 --2- 172.21.15.45:0/1539320227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b415c060 0x7f69b40b4ed0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b92d8640 1 -- 172.21.15.45:0/1539320227 >> 172.21.15.45:0/1539320227 conn(0x7f69b40698e0 msgr2=0x7f69b4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:53.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b92d8640 1 -- 172.21.15.45:0/1539320227 shutdown_connections 2023-07-09T02:12:53.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.027+0000 7f69b92d8640 1 -- 172.21.15.45:0/1539320227 wait complete. 2023-07-09T02:12:53.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 Processor -- start 2023-07-09T02:12:53.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 -- start start 2023-07-09T02:12:53.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b40cd120 0x7f69b40c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b40d2620 0x7f69b4153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69b415c060 0x7f69b40b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b415b240 con 0x7f69b40cd120 2023-07-09T02:12:53.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b415b6d0 con 0x7f69b40d2620 2023-07-09T02:12:53.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b415a630 con 0x7f69b415c060 2023-07-09T02:12:53.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b40cd120 0x7f69b40c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b40cd120 0x7f69b40c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41970/0 (socket says 172.21.15.45:41970) 2023-07-09T02:12:53.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 -- 172.21.15.45:0/4232740976 learned_addr learned my addr 172.21.15.45:0/4232740976 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:53.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69abfff640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b40d2620 0x7f69b4153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b37fe640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69b415c060 0x7f69b40b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 -- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69b415c060 msgr2=0x7f69b40b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69b415c060 0x7f69b40b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 -- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b40d2620 msgr2=0x7f69b4153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b40d2620 0x7f69b4153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 -- 172.21.15.45:0/4232740976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a4009420 con 0x7f69b40cd120 2023-07-09T02:12:53.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b2ffd640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b40cd120 0x7f69b40c8750 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f69a40ad040 tx=0x7f69a401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69ab7fe640 1 -- 172.21.15.45:0/4232740976 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40b5810 con 0x7f69b40cd120 2023-07-09T02:12:53.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69ab7fe640 1 -- 172.21.15.45:0/4232740976 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a40b5990 con 0x7f69b40cd120 2023-07-09T02:12:53.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69ab7fe640 1 -- 172.21.15.45:0/4232740976 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a40b5d40 con 0x7f69b40cd120 2023-07-09T02:12:53.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b40b59f0 con 0x7f69b40cd120 2023-07-09T02:12:53.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.031+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b415abf0 con 0x7f69b40cd120 2023-07-09T02:12:53.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.035+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b404d7d0 con 0x7f69b40cd120 2023-07-09T02:12:53.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.035+0000 7f69ab7fe640 1 -- 172.21.15.45:0/4232740976 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69a40b4390 con 0x7f69b40cd120 2023-07-09T02:12:53.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.035+0000 7f69ab7fe640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6994066280 0x7f6994068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.035+0000 7f69ab7fe640 1 -- 172.21.15.45:0/4232740976 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69a411e4b0 con 0x7f69b40cd120 2023-07-09T02:12:53.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.035+0000 7f69abfff640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6994066280 0x7f6994068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.035+0000 7f69abfff640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6994066280 0x7f6994068730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f69b40b8970 tx=0x7f699c007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.039+0000 7f69ab7fe640 1 -- 172.21.15.45:0/4232740976 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69a40eb940 con 0x7f69b40cd120 2023-07-09T02:12:53.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.223+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69b406baa0 con 0x7f69b40cd120 2023-07-09T02:12:53.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.223+0000 7f69ab7fe640 1 -- 172.21.15.45:0/4232740976 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f69a4006e20 con 0x7f69b40cd120 2023-07-09T02:12:53.229 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:53.229 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:12:53.230 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:12:53.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6994066280 msgr2=0x7f6994068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6994066280 0x7f6994068730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f69b40b8970 tx=0x7f699c007d60 comp rx=0 tx=0).stop 2023-07-09T02:12:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b40cd120 msgr2=0x7f69b40c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b40cd120 0x7f69b40c8750 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f69a40ad040 tx=0x7f69a401ac70 comp rx=0 tx=0).stop 2023-07-09T02:12:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 shutdown_connections 2023-07-09T02:12:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6994066280 0x7f6994068730 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69b415c060 0x7f69b40b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69b40d2620 0x7f69b4153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 --2- 172.21.15.45:0/4232740976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69b40cd120 0x7f69b40c8750 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 >> 172.21.15.45:0/4232740976 conn(0x7f69b40698e0 msgr2=0x7f69b40b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:53.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 shutdown_connections 2023-07-09T02:12:53.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.227+0000 7f69b92d8640 1 -- 172.21.15.45:0/4232740976 wait complete. 2023-07-09T02:12:53.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:12:47.319387+0000', 'modified': '2023-07-09T02:12:50.963975+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5628}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5628': {'gid': 5628, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/3039557147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 3039557147}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 3039557147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:12:53.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:12:53.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-09T02:12:53.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.795+0000 7f2e6e1e9640 1 Processor -- start 2023-07-09T02:12:53.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.795+0000 7f2e6e1e9640 1 -- start start 2023-07-09T02:12:53.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e6e1e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68158e30 0x7f2e6806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e6e1e9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e680ccf80 con 0x7f2e6806fd10 2023-07-09T02:12:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e6e1e9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e680cd540 con 0x7f2e6806c820 2023-07-09T02:12:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e6e1e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680c8fb0 con 0x7f2e68158e30 2023-07-09T02:12:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e66ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2e6806fd10 0x7f2e6806c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47962/0 (socket says 172.21.15.45:47962) 2023-07-09T02:12:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e66ffd640 1 -- 172.21.15.45:0/3783374048 learned_addr learned my addr 172.21.15.45:0/3783374048 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171433371 0 0) 0x7f2e680ccf80 con 0x7f2e6806fd10 2023-07-09T02:12:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e50005740 con 0x7f2e6806fd10 2023-07-09T02:12:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991390096 0 0) 0x7f2e680cd540 con 0x7f2e6806c820 2023-07-09T02:12:53.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e680ccf80 con 0x7f2e6806c820 2023-07-09T02:12:53.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e677fe640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68158e30 0x7f2e6806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 982895860 0 0) 0x7f2e50005740 con 0x7f2e6806fd10 2023-07-09T02:12:53.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68158e30 msgr2=0x7f2e6806f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68158e30 0x7f2e6806f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 >> v1:172.21.15.155:6789/0 conn(0x7f2e6806c820 legacy=0x7f2e680caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e680cbad0 con 0x7f2e6806fd10 2023-07-09T02:12:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f2e5c001680 con 0x7f2e6806fd10 2023-07-09T02:12:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 >> v1:172.21.15.45:6789/0 conn(0x7f2e6806fd10 legacy=0x7f2e6806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e50006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68158e30 0x7f2e500069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e50006f20 0x7f2e50007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680c8fb0 con 0x7f2e50005d50 2023-07-09T02:12:53.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5000dd60 con 0x7f2e50006f20 2023-07-09T02:12:53.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5000df20 con 0x7f2e68158e30 2023-07-09T02:12:53.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e677fe640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e50006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68158e30 0x7f2e500069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e677fe640 1 -- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68158e30 msgr2=0x7f2e500069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e677fe640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68158e30 0x7f2e500069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e677fe640 1 -- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e50006f20 msgr2=0x7f2e50007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e677fe640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e50006f20 0x7f2e50007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.799+0000 7f2e677fe640 1 -- 172.21.15.45:0/3783374048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e50005740 con 0x7f2e50005d50 2023-07-09T02:12:53.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e677fe640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e50006140 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800ba30 tx=0x7f2e5801c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a2013c317a201c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580ab640 con 0x7f2e50005d50 2023-07-09T02:12:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580ab7a0 con 0x7f2e50005d50 2023-07-09T02:12:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e667fc640 1 -- 172.21.15.45:0/3783374048 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580abb50 con 0x7f2e50005d50 2023-07-09T02:12:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/3783374048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 msgr2=0x7f2e50006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e6e1e9640 1 --2- 172.21.15.45:0/3783374048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e50006140 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800ba30 tx=0x7f2e5801c650 comp rx=0 tx=0).stop 2023-07-09T02:12:53.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e67fff640 1 -- 172.21.15.45:0/3783374048 reap_dead start 2023-07-09T02:12:53.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/3783374048 shutdown_connections 2023-07-09T02:12:53.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/3783374048 >> 172.21.15.45:0/3783374048 conn(0x7f2e680694b0 msgr2=0x7f2e680698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:53.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/3783374048 shutdown_connections 2023-07-09T02:12:53.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.803+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/3783374048 wait complete. 2023-07-09T02:12:53.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 Processor -- start 2023-07-09T02:12:53.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 -- start start 2023-07-09T02:12:53.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e680b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68159380 0x7f2e6815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e68157fd0 0x7f2e6815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680b0f60 con 0x7f2e50005d50 2023-07-09T02:12:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68159b20 con 0x7f2e68157fd0 2023-07-09T02:12:53.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68159840 con 0x7f2e68159380 2023-07-09T02:12:53.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e680b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e680b0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42002/0 (socket says 172.21.15.45:42002) 2023-07-09T02:12:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 -- 172.21.15.45:0/1075772961 learned_addr learned my addr 172.21.15.45:0/1075772961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68159380 0x7f2e6815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e67fff640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e68157fd0 0x7f2e6815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 -- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68159380 msgr2=0x7f2e6815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68159380 0x7f2e6815cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 -- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e68157fd0 msgr2=0x7f2e6815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e68157fd0 0x7f2e6815d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 -- 172.21.15.45:0/1075772961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6815bc30 con 0x7f2e50005d50 2023-07-09T02:12:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e677fe640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e680b0a20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2e580ad040 tx=0x7f2e50007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e4ffff640 1 -- 172.21.15.45:0/1075772961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58004220 con 0x7f2e50005d50 2023-07-09T02:12:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e4ffff640 1 -- 172.21.15.45:0/1075772961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580b8070 con 0x7f2e50005d50 2023-07-09T02:12:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e4ffff640 1 -- 172.21.15.45:0/1075772961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580ab910 con 0x7f2e50005d50 2023-07-09T02:12:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/1075772961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6815bf10 con 0x7f2e50005d50 2023-07-09T02:12:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.807+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/1075772961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e680adf90 con 0x7f2e50005d50 2023-07-09T02:12:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.811+0000 7f2e4ffff640 1 -- 172.21.15.45:0/1075772961 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e580aba70 con 0x7f2e50005d50 2023-07-09T02:12:53.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.811+0000 7f2e4ffff640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e540662b0 0x7f2e54068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.811+0000 7f2e4ffff640 1 -- 172.21.15.45:0/1075772961 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e5811dcf0 con 0x7f2e50005d50 2023-07-09T02:12:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.811+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e540662b0 0x7f2e54068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.811+0000 7f2e71561000 1 Processor -- start 2023-07-09T02:12:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.811+0000 7f2e71561000 1 -- start start 2023-07-09T02:12:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.811+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e540662b0 0x7f2e54068760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c001ec0 tx=0x7f2e5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e66bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e67110 0x561d82e1ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e1cf90 0x561d82e1d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d82ce3f80 con 0x561d82e1cf90 2023-07-09T02:12:53.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d82c1dc60 con 0x561d82e66800 2023-07-09T02:12:53.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d82c71700 con 0x561d82e67110 2023-07-09T02:12:53.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e1cf90 0x561d82e1d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e1cf90 0x561d82e1d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42006/0 (socket says 172.21.15.45:42006) 2023-07-09T02:12:53.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 -- 172.21.15.45:0/2809188951 learned_addr learned my addr 172.21.15.45:0/2809188951 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:53.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e67110 0x561d82e1ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e677fe640 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e66bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 -- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e67110 msgr2=0x561d82e1ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e67110 0x561d82e1ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 -- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 msgr2=0x561d82e66bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e66bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 -- 172.21.15.45:0/2809188951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d82966890 con 0x561d82e1cf90 2023-07-09T02:12:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e67110 0x561d82e1ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e677fe640 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e66bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e67fff640 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e1cf90 0x561d82e1d360 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2e6806cbf0 tx=0x7f2e60001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd701972bf7055d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e4d7fa640 1 -- 172.21.15.45:0/2809188951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60002090 con 0x561d82e1cf90 2023-07-09T02:12:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e4d7fa640 1 -- 172.21.15.45:0/2809188951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e60005d60 con 0x561d82e1cf90 2023-07-09T02:12:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e4d7fa640 1 -- 172.21.15.45:0/2809188951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60007310 con 0x561d82e1cf90 2023-07-09T02:12:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- 172.21.15.45:0/2809188951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e1cf90 msgr2=0x561d82e1d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e1cf90 0x561d82e1d360 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2e6806cbf0 tx=0x7f2e60001c60 comp rx=0 tx=0).stop 2023-07-09T02:12:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- 172.21.15.45:0/2809188951 shutdown_connections 2023-07-09T02:12:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e1cf90 0x561d82e1d360 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e67110 0x561d82e1ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 --2- 172.21.15.45:0/2809188951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e66bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- 172.21.15.45:0/2809188951 >> 172.21.15.45:0/2809188951 conn(0x561d82cdfa70 msgr2=0x561d82e1b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- 172.21.15.45:0/2809188951 shutdown_connections 2023-07-09T02:12:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- 172.21.15.45:0/2809188951 wait complete. 2023-07-09T02:12:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 -- start start 2023-07-09T02:12:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.815+0000 7f2e71561000 1 Processor -- start 2023-07-09T02:12:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 0x561d82e27fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e28510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e28a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d82c6a7a0 con 0x561d82e67110 2023-07-09T02:12:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d82c26f00 con 0x561d82e66800 2023-07-09T02:12:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d82c26ba0 con 0x561d82e1cf90 2023-07-09T02:12:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 10 client.0 _ll_register_callbacks cb 0x561d82e08930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:12:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e28a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 0x561d82e27fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e28a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42008/0 (socket says 172.21.15.45:42008) 2023-07-09T02:12:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 -- 172.21.15.45:0/344169566 learned_addr learned my addr 172.21.15.45:0/344169566 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e28510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 -- 172.21.15.45:0/344169566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 msgr2=0x561d82e27fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 0x561d82e27fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 -- 172.21.15.45:0/344169566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 msgr2=0x561d82e28510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e28510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 -- 172.21.15.45:0/344169566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6000f040 con 0x561d82e67110 2023-07-09T02:12:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e67fff640 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e28a50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x561d82c5c1d0 tx=0x7f2e60011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c2e53013a2c07 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:12:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 1 -- 172.21.15.45:0/344169566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6001d040 con 0x561d82e67110 2023-07-09T02:12:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 -- 172.21.15.45:0/344169566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d82c690f0 con 0x561d82e67110 2023-07-09T02:12:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 1 -- 172.21.15.45:0/344169566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e60005e30 con 0x561d82e67110 2023-07-09T02:12:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 1 -- 172.21.15.45:0/344169566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e600078d0 con 0x561d82e67110 2023-07-09T02:12:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 10 client.5784 fetch_fsmap learned FSMap version 25 2023-07-09T02:12:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 -- 172.21.15.45:0/344169566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x561d82c2f130 con 0x561d82e67110 2023-07-09T02:12:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 1 -- 172.21.15.45:0/344169566 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d82c690f0 con 0x561d82e67110 2023-07-09T02:12:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 1 -- 172.21.15.45:0/344169566 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2e60015440 con 0x561d82e67110 2023-07-09T02:12:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 10 client.5784 fetch_fsmap finished waiting for FSMap version 25 2023-07-09T02:12:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 10 client.5784 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T02:12:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 20 client.5784 populate_metadata read hostname 'smithi045' 2023-07-09T02:12:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] conn(0x561d82e29320 0x561d82e77d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 4 client.5784 mds_command: new command op to 5628 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:12:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 -- 172.21.15.45:0/344169566 --> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d82c31e40 con 0x561d82e29320 2023-07-09T02:12:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e677fe640 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] conn(0x561d82e29320 0x561d82e77d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e677fe640 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] conn(0x561d82e29320 0x561d82e77d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd0ddb9f3d8a4d4 server_cookie=e7054f877f3f12c6 in_seq=0 out_seq=0 2023-07-09T02:12:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 10 client.5784 ms_handle_connect on v2:172.21.15.45:6833/3039557147 2023-07-09T02:12:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 1 -- 172.21.15.45:0/344169566 <== mds.0 v2:172.21.15.45:6833/3039557147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561d82c31e40 con 0x561d82e29320 2023-07-09T02:12:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e467fc640 10 client.5784 handle_command_reply: tid=0 2023-07-09T02:12:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.819+0000 7f2e71561000 1 client.5784 shutdown 2023-07-09T02:12:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 -- 172.21.15.45:0/344169566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 msgr2=0x561d82e28a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e28a50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x561d82c5c1d0 tx=0x7f2e60011000 comp rx=0 tx=0).stop 2023-07-09T02:12:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 -- 172.21.15.45:0/344169566 shutdown_connections 2023-07-09T02:12:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] conn(0x561d82e29320 0x561d82e77d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e28a50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e28510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 --2- 172.21.15.45:0/344169566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 0x561d82e27fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e467fc640 0 client.5784 ms_handle_reset on v2:172.21.15.45:6833/3039557147 2023-07-09T02:12:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 -- 172.21.15.45:0/344169566 >> 172.21.15.45:0/344169566 conn(0x561d82cdfa70 msgr2=0x561d82e1ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:53.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 -- 172.21.15.45:0/344169566 shutdown_connections 2023-07-09T02:12:53.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 1 -- 172.21.15.45:0/344169566 wait complete. 2023-07-09T02:12:53.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.823+0000 7f2e71561000 20 client.5784 trim_cache size 0 max 16384 2023-07-09T02:12:53.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.835+0000 7f2e71561000 1 Processor -- start 2023-07-09T02:12:53.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.835+0000 7f2e71561000 1 -- start start 2023-07-09T02:12:53.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 0x561d82e79470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e799b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d82927940 con 0x561d82e67110 2023-07-09T02:12:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d82d24860 con 0x561d82e66800 2023-07-09T02:12:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d82c39740 con 0x561d82e1cf90 2023-07-09T02:12:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e618b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42010/0 (socket says 172.21.15.45:42010) 2023-07-09T02:12:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 -- 172.21.15.45:0/2783018791 learned_addr learned my addr 172.21.15.45:0/2783018791 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e677fe640 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 0x561d82e79470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 -- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 msgr2=0x561d82e79470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 0x561d82e79470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 -- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 msgr2=0x561d82e799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e799b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 -- 172.21.15.45:0/2783018791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d82c153c0 con 0x561d82e67110 2023-07-09T02:12:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e67fff640 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e618b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2e60001ca0 tx=0x7f2e60007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a643ee43d29221bf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e4dffb640 1 -- 172.21.15.45:0/2783018791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6001d050 con 0x561d82e67110 2023-07-09T02:12:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e4dffb640 1 -- 172.21.15.45:0/2783018791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e60005e20 con 0x561d82e67110 2023-07-09T02:12:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e4dffb640 1 -- 172.21.15.45:0/2783018791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60015440 con 0x561d82e67110 2023-07-09T02:12:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- 172.21.15.45:0/2783018791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 msgr2=0x561d82e618b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e618b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2e60001ca0 tx=0x7f2e60007000 comp rx=0 tx=0).stop 2023-07-09T02:12:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- 172.21.15.45:0/2783018791 shutdown_connections 2023-07-09T02:12:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e618b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e66800 0x561d82e799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 --2- 172.21.15.45:0/2783018791 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e1cf90 0x561d82e79470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- 172.21.15.45:0/2783018791 >> 172.21.15.45:0/2783018791 conn(0x561d82cdfa70 msgr2=0x561d82e77d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:53.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- 172.21.15.45:0/2783018791 shutdown_connections 2023-07-09T02:12:53.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- 172.21.15.45:0/2783018791 wait complete. 2023-07-09T02:12:53.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 -- start start 2023-07-09T02:12:53.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.839+0000 7f2e71561000 1 Processor -- start 2023-07-09T02:12:53.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e1cf90 0x561d82ec3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e66800 0x561d82ec4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e64510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d82c36760 con 0x561d82e67110 2023-07-09T02:12:53.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d82c07ea0 con 0x561d82e1cf90 2023-07-09T02:12:53.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d82c69fb0 con 0x561d82e66800 2023-07-09T02:12:53.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 10 client.0 _ll_register_callbacks cb 0x561d82de94d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:12:53.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e64510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e64510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42018/0 (socket says 172.21.15.45:42018) 2023-07-09T02:12:53.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 -- 172.21.15.45:0/3634258768 learned_addr learned my addr 172.21.15.45:0/3634258768 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:53.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e677fe640 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e1cf90 0x561d82ec3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e66ffd640 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e66800 0x561d82ec4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 -- 172.21.15.45:0/3634258768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e66800 msgr2=0x561d82ec4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e66800 0x561d82ec4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 -- 172.21.15.45:0/3634258768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e1cf90 msgr2=0x561d82ec3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:53.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e1cf90 0x561d82ec3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 -- 172.21.15.45:0/3634258768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d82c2f130 con 0x561d82e67110 2023-07-09T02:12:53.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e67fff640 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e64510 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2e60025040 tx=0x7f2e60001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0fce53ff2a0009 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:53.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:12:53.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 1 -- 172.21.15.45:0/3634258768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60033070 con 0x561d82e67110 2023-07-09T02:12:53.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 -- 172.21.15.45:0/3634258768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d82e208e0 con 0x561d82e67110 2023-07-09T02:12:53.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 1 -- 172.21.15.45:0/3634258768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e60015a70 con 0x561d82e67110 2023-07-09T02:12:53.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 1 -- 172.21.15.45:0/3634258768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e6001d040 con 0x561d82e67110 2023-07-09T02:12:53.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 10 client.5790 fetch_fsmap learned FSMap version 25 2023-07-09T02:12:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 -- 172.21.15.45:0/3634258768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x561d82966cc0 con 0x561d82e67110 2023-07-09T02:12:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 1 -- 172.21.15.45:0/3634258768 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d82e208e0 con 0x561d82e67110 2023-07-09T02:12:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 1 -- 172.21.15.45:0/3634258768 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2e60015c50 con 0x561d82e67110 2023-07-09T02:12:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 10 client.5790 fetch_fsmap finished waiting for FSMap version 25 2023-07-09T02:12:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 10 client.5790 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T02:12:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 20 client.5790 populate_metadata read hostname 'smithi045' 2023-07-09T02:12:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] conn(0x561d82e64ed0 0x561d82e652a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 4 client.5790 mds_command: new command op to 5628 tid=0[{"prefix": "status"}] 2023-07-09T02:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 -- 172.21.15.45:0/3634258768 --> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d82c236f0 con 0x561d82e64ed0 2023-07-09T02:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e677fe640 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] conn(0x561d82e64ed0 0x561d82e652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 10 client.5790 ms_handle_connect on v2:172.21.15.45:6833/3039557147 2023-07-09T02:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e677fe640 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] conn(0x561d82e64ed0 0x561d82e652a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f9c1e96a6c88f23 server_cookie=914da7b9bd490a5b in_seq=0 out_seq=0 2023-07-09T02:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 1 -- 172.21.15.45:0/3634258768 <== mds.0 v2:172.21.15.45:6833/3039557147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561d82c236f0 con 0x561d82e64ed0 2023-07-09T02:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e467fc640 10 client.5790 handle_command_reply: tid=0 2023-07-09T02:12:53.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 client.5790 shutdown 2023-07-09T02:12:53.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 -- 172.21.15.45:0/3634258768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 msgr2=0x561d82e64510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e64510 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2e60025040 tx=0x7f2e60001260 comp rx=0 tx=0).stop 2023-07-09T02:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 -- 172.21.15.45:0/3634258768 shutdown_connections 2023-07-09T02:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.843+0000 7f2e71561000 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.45:6833/3039557147,v1:172.21.15.45:6835/3039557147] conn(0x561d82e64ed0 0x561d82e652a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e71561000 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561d82e67110 0x561d82e64510 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e71561000 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561d82e66800 0x561d82ec4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e71561000 1 --2- 172.21.15.45:0/3634258768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d82e1cf90 0x561d82ec3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e467fc640 0 client.5790 ms_handle_reset on v2:172.21.15.45:6833/3039557147 2023-07-09T02:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e71561000 1 -- 172.21.15.45:0/3634258768 >> 172.21.15.45:0/3634258768 conn(0x561d82cdfa70 msgr2=0x561d82e785e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e71561000 1 -- 172.21.15.45:0/3634258768 shutdown_connections 2023-07-09T02:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e71561000 1 -- 172.21.15.45:0/3634258768 wait complete. 2023-07-09T02:12:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e71561000 20 client.5790 trim_cache size 0 max 16384 2023-07-09T02:12:53.867 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:12:53.867 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:12:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:12:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5628, 2023-07-09T02:12:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:12:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:12:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:12:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9210737480000004, 2023-07-09T02:12:53.868 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 25, 2023-07-09T02:12:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 48, 2023-07-09T02:12:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 48, 2023-07-09T02:12:53.869 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.682341922000001 2023-07-09T02:12:53.869 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:12:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e540662b0 msgr2=0x7f2e54068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e540662b0 0x7f2e54068760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c001ec0 tx=0x7f2e5c009040 comp rx=0 tx=0).stop 2023-07-09T02:12:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/1075772961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 msgr2=0x7f2e680b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e680b0a20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2e580ad040 tx=0x7f2e50007a10 comp rx=0 tx=0).stop 2023-07-09T02:12:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/1075772961 shutdown_connections 2023-07-09T02:12:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e68157fd0 0x7f2e6815d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e540662b0 0x7f2e54068760 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e68159380 0x7f2e6815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 --2- 172.21.15.45:0/1075772961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50005d50 0x7f2e680b0a20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/1075772961 >> 172.21.15.45:0/1075772961 conn(0x7f2e680694b0 msgr2=0x7f2e680ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/1075772961 shutdown_connections 2023-07-09T02:12:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:53.847+0000 7f2e6e1e9640 1 -- 172.21.15.45:0/1075772961 wait complete. 2023-07-09T02:12:53.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:12:53.912 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-07-09T02:12:53.907+0000 7f04d76df640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:12:54.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.011+0000 7f3cf19db640 1 Processor -- start 2023-07-09T02:12:54.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.011+0000 7f3cf19db640 1 -- start start 2023-07-09T02:12:54.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3cf19db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3cec15c060 0x7f3cec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3cf19db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cec0cd120 0x7f3cec0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3cf19db640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec160a50 con 0x7f3cec0d2450 2023-07-09T02:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3cf19db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec0d28d0 con 0x7f3cec0cd120 2023-07-09T02:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3cf19db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec0cfe40 con 0x7f3cec15c060 2023-07-09T02:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3ce3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cec0cd120 0x7f3cec0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:54.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3ce3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cec0cd120 0x7f3cec0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42028/0 (socket says 172.21.15.45:42028) 2023-07-09T02:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3ce3fff640 1 -- 172.21.15.45:0/4277929950 learned_addr learned my addr 172.21.15.45:0/4277929950 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3ceaffd640 1 --2- 172.21.15.45:0/4277929950 >> v2:172.21.15.155:3300/0 conn(0x7f3cec15c060 0x7f3cec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:54.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3ce3fff640 1 -- 172.21.15.45:0/4277929950 >> v2:172.21.15.155:3300/0 conn(0x7f3cec15c060 msgr2=0x7f3cec0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:54.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3ce3fff640 1 --2- 172.21.15.45:0/4277929950 >> v2:172.21.15.155:3300/0 conn(0x7f3cec15c060 0x7f3cec0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3ce3fff640 1 -- 172.21.15.45:0/4277929950 >> v1:172.21.15.155:6789/0 conn(0x7f3cec0d2450 legacy=0x7f3cec0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:54.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.015+0000 7f3ce3fff640 1 -- 172.21.15.45:0/4277929950 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec15c430 con 0x7f3cec0cd120 2023-07-09T02:12:54.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3ce3fff640 1 --2- 172.21.15.45:0/4277929950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec0d1f10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0d3ad0 tx=0x7f3cd401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a3c4b0bd00e514 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:54.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cea7fc640 1 -- 172.21.15.45:0/4277929950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40ab5f0 con 0x7f3cec0cd120 2023-07-09T02:12:54.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cea7fc640 1 -- 172.21.15.45:0/4277929950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd40ab750 con 0x7f3cec0cd120 2023-07-09T02:12:54.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cea7fc640 1 -- 172.21.15.45:0/4277929950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40abae0 con 0x7f3cec0cd120 2023-07-09T02:12:54.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 -- 172.21.15.45:0/4277929950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 msgr2=0x7f3cec0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:54.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 --2- 172.21.15.45:0/4277929950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec0d1f10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0d3ad0 tx=0x7f3cd401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 -- 172.21.15.45:0/4277929950 shutdown_connections 2023-07-09T02:12:54.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 --2- 172.21.15.45:0/4277929950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec0d1f10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 --2- 172.21.15.45:0/4277929950 >> v2:172.21.15.155:3300/0 conn(0x7f3cec15c060 0x7f3cec0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 -- 172.21.15.45:0/4277929950 >> 172.21.15.45:0/4277929950 conn(0x7f3cec0698e0 msgr2=0x7f3cec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:54.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 -- 172.21.15.45:0/4277929950 shutdown_connections 2023-07-09T02:12:54.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 -- 172.21.15.45:0/4277929950 wait complete. 2023-07-09T02:12:54.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 Processor -- start 2023-07-09T02:12:54.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.019+0000 7f3cf19db640 1 -- start start 2023-07-09T02:12:54.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:54.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cec0d2450 0x7f3cec0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cec15c060 0x7f3cec0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0b39c0 con 0x7f3cec0cd120 2023-07-09T02:12:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec151d80 con 0x7f3cec15c060 2023-07-09T02:12:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0b2db0 con 0x7f3cec0d2450 2023-07-09T02:12:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42038/0 (socket says 172.21.15.45:42038) 2023-07-09T02:12:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 -- 172.21.15.45:0/1950548945 learned_addr learned my addr 172.21.15.45:0/1950548945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ce3fff640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cec0d2450 0x7f3cec0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceb7fe640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cec15c060 0x7f3cec0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 -- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cec0d2450 msgr2=0x7f3cec0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cec0d2450 0x7f3cec0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 -- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cec15c060 msgr2=0x7f3cec0b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cec15c060 0x7f3cec0b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 -- 172.21.15.45:0/1950548945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40094d0 con 0x7f3cec0cd120 2023-07-09T02:12:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceb7fe640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cec15c060 0x7f3cec0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ceaffd640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec151840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00e8a0 tx=0x7f3cdc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ce8ff9640 1 -- 172.21.15.45:0/1950548945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc009510 con 0x7f3cec0cd120 2023-07-09T02:12:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ce8ff9640 1 -- 172.21.15.45:0/1950548945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00c940 con 0x7f3cec0cd120 2023-07-09T02:12:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ce8ff9640 1 -- 172.21.15.45:0/1950548945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00ccb0 con 0x7f3cec0cd120 2023-07-09T02:12:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec0b3090 con 0x7f3cec0cd120 2023-07-09T02:12:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec0b3650 con 0x7f3cec0cd120 2023-07-09T02:12:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec04d7d0 con 0x7f3cec0cd120 2023-07-09T02:12:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.023+0000 7f3ce8ff9640 1 -- 172.21.15.45:0/1950548945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3cdc013470 con 0x7f3cec0cd120 2023-07-09T02:12:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.027+0000 7f3ce8ff9640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ccc066280 0x7f3ccc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.027+0000 7f3ce8ff9640 1 -- 172.21.15.45:0/1950548945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cdc083e60 con 0x7f3cec0cd120 2023-07-09T02:12:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.027+0000 7f3ce3fff640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ccc066280 0x7f3ccc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:54.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.027+0000 7f3ce3fff640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ccc066280 0x7f3ccc068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40af000 tx=0x7f3cd40b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:54.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.031+0000 7f3ce8ff9640 1 -- 172.21.15.45:0/1950548945 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cdc0512f0 con 0x7f3cec0cd120 2023-07-09T02:12:54.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.219+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3cec1606b0 con 0x7f3cec0cd120 2023-07-09T02:12:54.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.219+0000 7f3ce8ff9640 1 -- 172.21.15.45:0/1950548945 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3cdc017070 con 0x7f3cec0cd120 2023-07-09T02:12:54.225 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:12:54.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ccc066280 msgr2=0x7f3ccc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ccc066280 0x7f3ccc068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40af000 tx=0x7f3cd40b6040 comp rx=0 tx=0).stop 2023-07-09T02:12:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 msgr2=0x7f3cec151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec151840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00e8a0 tx=0x7f3cdc00eca0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 shutdown_connections 2023-07-09T02:12:54.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cec15c060 0x7f3cec0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ccc066280 0x7f3ccc068730 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cec0d2450 0x7f3cec0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 --2- 172.21.15.45:0/1950548945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cec0cd120 0x7f3cec151840 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:54.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 >> 172.21.15.45:0/1950548945 conn(0x7f3cec0698e0 msgr2=0x7f3cec157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:54.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 shutdown_connections 2023-07-09T02:12:54.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:54.223+0000 7f3cf19db640 1 -- 172.21.15.45:0/1950548945 wait complete. 2023-07-09T02:12:54.245 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:12:54.246 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:12:54.246 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:12:54.247 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:12:54.247 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:54.248 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:12:54.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:12:54.248 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:12:54.249 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:12:54.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.249 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:12:54.298 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:12:54.299 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:12:54.299 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:12:54.299 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:54.299 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:12:54.299 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:54.299 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:54.300 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:54.300 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:12:54.300 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:12:54.300 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:54.300 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:12:54.300 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:12:54.300 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42352sec preferred_lft 42352sec 2023-07-09T02:12:54.301 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:12:54.301 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:54.301 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:54.301 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:54.301 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:12:54.301 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:54.301 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:54.301 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:12:54.302 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:12:54.302 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:54.302 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:12:54.302 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:54.302 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:12:54.302 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:54.302 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:12:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:12:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:54.303 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:12:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:12:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:12:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:54.303 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:12:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:12:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:12:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:54.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.305 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:12:54.360 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:12:54.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.362 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:12:54.414 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:12:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:12:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:12:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:12:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:12:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:12:54.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.416 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:12:54.417 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:12:54.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:12:54.418 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:12:54.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:12:54.419 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:12:54.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.513 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:12:54.522 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:12:54.523 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:12:54.524 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:12:54.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:12:54.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:12:54.591 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:54.641 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:12:54.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:12:54.643 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:54.693 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:12:54.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.694 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:54.790 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:54.790 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:12:54.801 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:54.801 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:12:54.802 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:12:54.802 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:12:54.802 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:12:54.805 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:12:54.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.805 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:12:54.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:54.828 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:12:54.884 INFO:teuthology.orchestra.run.smithi045.stdout:client5225 2023-07-09T02:12:54.885 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:54.885 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:54.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:12:55.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.123+0000 7f0d6c1db640 1 Processor -- start 2023-07-09T02:12:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.123+0000 7f0d6c1db640 1 -- start start 2023-07-09T02:12:55.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.123+0000 7f0d6c1db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d64158e30 0x7f0d6406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:55.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.123+0000 7f0d6c1db640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d640ccf80 con 0x7f0d6406c820 2023-07-09T02:12:55.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.123+0000 7f0d6c1db640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d640cd540 con 0x7f0d6406fd10 2023-07-09T02:12:55.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.123+0000 7f0d6c1db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d640c8fb0 con 0x7f0d64158e30 2023-07-09T02:12:55.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.123+0000 7f0d6a778640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0d6406c820 0x7f0d640caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47964/0 (socket says 172.21.15.45:47964) 2023-07-09T02:12:55.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.123+0000 7f0d6a778640 1 -- 172.21.15.45:0/1446902221 learned_addr learned my addr 172.21.15.45:0/1446902221 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:12:55.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d69f77640 1 --2- 172.21.15.45:0/1446902221 >> v2:172.21.15.155:3300/0 conn(0x7f0d64158e30 0x7f0d6406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505508356 0 0) 0x7f0d640ccf80 con 0x7f0d6406c820 2023-07-09T02:12:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d50003530 con 0x7f0d6406c820 2023-07-09T02:12:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2999990421 0 0) 0x7f0d50003530 con 0x7f0d6406c820 2023-07-09T02:12:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 >> v2:172.21.15.155:3300/0 conn(0x7f0d64158e30 msgr2=0x7f0d6406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 --2- 172.21.15.45:0/1446902221 >> v2:172.21.15.155:3300/0 conn(0x7f0d64158e30 0x7f0d6406f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 >> v1:172.21.15.155:6789/0 conn(0x7f0d6406fd10 legacy=0x7f0d6406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640cbad0 con 0x7f0d6406c820 2023-07-09T02:12:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f0d5c001a00 con 0x7f0d6406c820 2023-07-09T02:12:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 >> v1:172.21.15.45:6789/0 conn(0x7f0d6406c820 legacy=0x7f0d640caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d50003980 0x7f0d50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d500047d0 0x7f0d50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50005180 0x7f0d5000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640c8fb0 con 0x7f0d50003980 2023-07-09T02:12:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5000c090 con 0x7f0d50005180 2023-07-09T02:12:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5000c250 con 0x7f0d500047d0 2023-07-09T02:12:55.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d69f77640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d50003980 0x7f0d50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:55.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d6a778640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50005180 0x7f0d5000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:55.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d69776640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d500047d0 0x7f0d50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:55.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d69f77640 1 -- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d500047d0 msgr2=0x7f0d50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:55.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d69f77640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d500047d0 0x7f0d50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d69f77640 1 -- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50005180 msgr2=0x7f0d5000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:55.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d69f77640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50005180 0x7f0d5000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d69f77640 1 -- 172.21.15.45:0/1446902221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50003530 con 0x7f0d50003980 2023-07-09T02:12:55.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d6a778640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50005180 0x7f0d5000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:55.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.127+0000 7f0d6a778640 1 -- 172.21.15.45:0/1446902221 reap_dead start 2023-07-09T02:12:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d69f77640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d50003980 0x7f0d50003d90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009ae0 tx=0x7f0d6001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40bb8e88b053294 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600a6510 con 0x7f0d50003980 2023-07-09T02:12:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d600a6670 con 0x7f0d50003980 2023-07-09T02:12:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d68f75640 1 -- 172.21.15.45:0/1446902221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600a6a20 con 0x7f0d50003980 2023-07-09T02:12:55.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- 172.21.15.45:0/1446902221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d50003980 msgr2=0x7f0d50003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:55.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d50003980 0x7f0d50003d90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009ae0 tx=0x7f0d6001ca20 comp rx=0 tx=0).stop 2023-07-09T02:12:55.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- 172.21.15.45:0/1446902221 shutdown_connections 2023-07-09T02:12:55.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 --2- 172.21.15.45:0/1446902221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d50003980 0x7f0d50003d90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- 172.21.15.45:0/1446902221 >> 172.21.15.45:0/1446902221 conn(0x7f0d640694b0 msgr2=0x7f0d640698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:55.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- 172.21.15.45:0/1446902221 shutdown_connections 2023-07-09T02:12:55.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- 172.21.15.45:0/1446902221 wait complete. 2023-07-09T02:12:55.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 Processor -- start 2023-07-09T02:12:55.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- start start 2023-07-09T02:12:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50003980 0x7f0d641e6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6415bda0 0x7f0d640c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d640c4140 0x7f0d640c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640c45b0 con 0x7f0d640c4140 2023-07-09T02:12:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d641e6d70 con 0x7f0d50003980 2023-07-09T02:12:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6c1db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d64156b40 con 0x7f0d6415bda0 2023-07-09T02:12:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.131+0000 7f0d6a778640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d640c4140 0x7f0d640c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6a778640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d640c4140 0x7f0d640c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42062/0 (socket says 172.21.15.45:42062) 2023-07-09T02:12:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6a778640 1 -- 172.21.15.45:0/2850485936 learned_addr learned my addr 172.21.15.45:0/2850485936 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d69f77640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50003980 0x7f0d641e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d69776640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6415bda0 0x7f0d640c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6a778640 1 -- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6415bda0 msgr2=0x7f0d640c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6a778640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6415bda0 0x7f0d640c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6a778640 1 -- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50003980 msgr2=0x7f0d641e6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6a778640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50003980 0x7f0d641e6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6a778640 1 -- 172.21.15.45:0/2850485936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d64156e20 con 0x7f0d640c4140 2023-07-09T02:12:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d69f77640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50003980 0x7f0d641e6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d69776640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6415bda0 0x7f0d640c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:12:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6a778640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d640c4140 0x7f0d640c7760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c000f90 tx=0x7f0d5c007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d5a7fc640 1 -- 172.21.15.45:0/2850485936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c010510 con 0x7f0d640c4140 2023-07-09T02:12:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d5a7fc640 1 -- 172.21.15.45:0/2850485936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c010670 con 0x7f0d640c4140 2023-07-09T02:12:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d5a7fc640 1 -- 172.21.15.45:0/2850485936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c010a20 con 0x7f0d640c4140 2023-07-09T02:12:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d64157100 con 0x7f0d640c4140 2023-07-09T02:12:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d641576c0 con 0x7f0d640c4140 2023-07-09T02:12:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d641578e0 con 0x7f0d640c4140 2023-07-09T02:12:55.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d5a7fc640 1 -- 172.21.15.45:0/2850485936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d5c010b80 con 0x7f0d640c4140 2023-07-09T02:12:55.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d5a7fc640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d48066280 0x7f0d48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:55.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.135+0000 7f0d5a7fc640 1 -- 172.21.15.45:0/2850485936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d5c083700 con 0x7f0d640c4140 2023-07-09T02:12:55.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.139+0000 7f0d69f77640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d48066280 0x7f0d48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:55.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.139+0000 7f0d69f77640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d48066280 0x7f0d48068730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0d600af000 tx=0x7f0d600046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:55.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.143+0000 7f0d5a7fc640 1 -- 172.21.15.45:0/2850485936 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d5c050b70 con 0x7f0d640c4140 2023-07-09T02:12:55.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d6404d7d0 con 0x7f0d640c4140 2023-07-09T02:12:55.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d5a7fc640 1 -- 172.21.15.45:0/2850485936 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d5c054190 con 0x7f0d640c4140 2023-07-09T02:12:55.334 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:12:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d48066280 msgr2=0x7f0d48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d48066280 0x7f0d48068730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0d600af000 tx=0x7f0d600046d0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d640c4140 msgr2=0x7f0d640c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d640c4140 0x7f0d640c7760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c000f90 tx=0x7f0d5c007a20 comp rx=0 tx=0).stop 2023-07-09T02:12:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 shutdown_connections 2023-07-09T02:12:55.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d640c4140 0x7f0d640c7760 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d48066280 0x7f0d48068730 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d6415bda0 0x7f0d640c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 --2- 172.21.15.45:0/2850485936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d50003980 0x7f0d641e6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:55.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 >> 172.21.15.45:0/2850485936 conn(0x7f0d640694b0 msgr2=0x7f0d64154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:55.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 shutdown_connections 2023-07-09T02:12:55.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:55.331+0000 7f0d6c1db640 1 -- 172.21.15.45:0/2850485936 wait complete. 2023-07-09T02:12:55.354 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:12:55.354 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:12:55.355 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:12:55.355 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:12:55.355 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:55.356 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:12:55.356 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:12:55.356 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:12:55.356 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:12:55.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.357 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:12:55.367 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:12:55.367 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:12:55.368 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:12:55.368 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:55.368 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:12:55.368 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:55.368 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:55.368 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:55.369 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:12:55.369 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:55.369 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:55.369 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:12:55.369 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:12:55.369 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:55.370 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:12:55.370 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:55.370 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:12:55.370 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42358sec preferred_lft 42358sec 2023-07-09T02:12:55.370 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:12:55.370 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:55.371 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:12:55.371 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:55.371 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:12:55.371 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:55.371 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:12:55.371 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:12:55.371 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:12:55.371 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:55.372 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:12:55.372 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:55.372 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:12:55.372 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:12:55.372 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:12:55.372 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:55.372 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:12:55.373 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:12:55.373 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:12:55.373 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:12:55.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.375 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:12:55.437 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:12:55.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.439 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:12:55.491 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:12:55.491 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:12:55.491 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:12:55.491 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:12:55.492 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:12:55.492 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:12:55.492 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:12:55.492 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:12:55.492 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:12:55.492 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:12:55.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.493 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:12:55.493 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:12:55.494 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:12:55.494 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:12:55.494 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:12:55.495 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:12:55.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.589 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:12:55.599 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:12:55.599 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:12:55.599 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:12:55.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.600 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:12:55.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:12:55.662 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:55.712 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:12:55.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:12:55.713 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:55.764 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:12:55.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.765 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:55.855 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:55.855 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:12:55.867 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:12:55.868 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:12:55.868 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:12:55.868 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:12:55.868 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:12:55.872 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:12:55.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:12:55.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:55.894 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:12:55.952 INFO:teuthology.orchestra.run.smithi155.stdout:client5228 2023-07-09T02:12:55.952 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:12:55.953 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:56.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:12:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.147+0000 7fac40382640 1 Processor -- start 2023-07-09T02:12:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.147+0000 7fac40382640 1 -- start start 2023-07-09T02:12:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac40382640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 0x7fac3806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac40382640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac380c9340 0x7fac38159660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac40382640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac38155c30 0x7fac38156090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac40382640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac381565d0 con 0x7fac380c9340 2023-07-09T02:12:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac40382640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3806b690 con 0x7fac38155c30 2023-07-09T02:12:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac40382640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3806b970 con 0x7fac380c8f70 2023-07-09T02:12:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac380c9340 0x7fac38159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac380c9340 0x7fac38159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42070/0 (socket says 172.21.15.45:42070) 2023-07-09T02:12:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 -- 172.21.15.45:0/2290993081 learned_addr learned my addr 172.21.15.45:0/2290993081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3e91f640 1 --2- 172.21.15.45:0/2290993081 >> v2:172.21.15.155:3300/0 conn(0x7fac38155c30 0x7fac38156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3e11e640 1 --2- 172.21.15.45:0/2290993081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 0x7fac3806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 -- 172.21.15.45:0/2290993081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 msgr2=0x7fac3806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 --2- 172.21.15.45:0/2290993081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 0x7fac3806b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 -- 172.21.15.45:0/2290993081 >> v2:172.21.15.155:3300/0 conn(0x7fac38155c30 msgr2=0x7fac38156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:12:56.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 --2- 172.21.15.45:0/2290993081 >> v2:172.21.15.155:3300/0 conn(0x7fac38155c30 0x7fac38156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 -- 172.21.15.45:0/2290993081 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3806bc50 con 0x7fac380c9340 2023-07-09T02:12:56.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3e91f640 1 --2- 172.21.15.45:0/2290993081 >> v2:172.21.15.155:3300/0 conn(0x7fac38155c30 0x7fac38156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:12:56.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.151+0000 7fac3d91d640 1 --2- 172.21.15.45:0/2290993081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac380c9340 0x7fac38159660 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fac380ca6a0 tx=0x7fac2801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfc151d7faff840 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:56.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac3d11c640 1 -- 172.21.15.45:0/2290993081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280a89b0 con 0x7fac380c9340 2023-07-09T02:12:56.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac3d11c640 1 -- 172.21.15.45:0/2290993081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac280a8b10 con 0x7fac380c9340 2023-07-09T02:12:56.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac3d11c640 1 -- 172.21.15.45:0/2290993081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280a8ea0 con 0x7fac380c9340 2023-07-09T02:12:56.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- 172.21.15.45:0/2290993081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac380c9340 msgr2=0x7fac38159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:56.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 --2- 172.21.15.45:0/2290993081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac380c9340 0x7fac38159660 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fac380ca6a0 tx=0x7fac2801ecf0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- 172.21.15.45:0/2290993081 shutdown_connections 2023-07-09T02:12:56.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 --2- 172.21.15.45:0/2290993081 >> v2:172.21.15.155:3300/0 conn(0x7fac38155c30 0x7fac38156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 --2- 172.21.15.45:0/2290993081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac380c9340 0x7fac38159660 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 --2- 172.21.15.45:0/2290993081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 0x7fac3806b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- 172.21.15.45:0/2290993081 >> 172.21.15.45:0/2290993081 conn(0x7fac380694b0 msgr2=0x7fac380698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:56.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- 172.21.15.45:0/2290993081 shutdown_connections 2023-07-09T02:12:56.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- 172.21.15.45:0/2290993081 wait complete. 2023-07-09T02:12:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 Processor -- start 2023-07-09T02:12:56.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- start start 2023-07-09T02:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 0x7fac381535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac380c9340 0x7fac38157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac38155c30 0x7fac380c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:56.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac381543b0 con 0x7fac38155c30 2023-07-09T02:12:56.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac381576a0 con 0x7fac380c9340 2023-07-09T02:12:56.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.155+0000 7fac40382640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac38158070 con 0x7fac380c8f70 2023-07-09T02:12:56.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac38155c30 0x7fac380c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:56.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac38155c30 0x7fac380c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42082/0 (socket says 172.21.15.45:42082) 2023-07-09T02:12:56.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 -- 172.21.15.45:0/3873928035 learned_addr learned my addr 172.21.15.45:0/3873928035 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:12:56.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3d91d640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac380c9340 0x7fac38157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e11e640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 0x7fac381535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 -- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 msgr2=0x7fac381535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 0x7fac381535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 -- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac380c9340 msgr2=0x7fac38157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac380c9340 0x7fac38157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 -- 172.21.15.45:0/3873928035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280094d0 con 0x7fac38155c30 2023-07-09T02:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac3e91f640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac38155c30 0x7fac380c42d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fac30007df0 tx=0x7fac3000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac2effd640 1 -- 172.21.15.45:0/3873928035 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300039a0 con 0x7fac38155c30 2023-07-09T02:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac2effd640 1 -- 172.21.15.45:0/3873928035 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3000f040 con 0x7fac38155c30 2023-07-09T02:12:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac2effd640 1 -- 172.21.15.45:0/3873928035 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30003d40 con 0x7fac38155c30 2023-07-09T02:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac38158390 con 0x7fac38155c30 2023-07-09T02:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac38153df0 con 0x7fac38155c30 2023-07-09T02:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3804d7d0 con 0x7fac38155c30 2023-07-09T02:12:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.159+0000 7fac2effd640 1 -- 172.21.15.45:0/3873928035 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac30004030 con 0x7fac38155c30 2023-07-09T02:12:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.163+0000 7fac2effd640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac1c066280 0x7fac1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:12:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.163+0000 7fac2effd640 1 -- 172.21.15.45:0/3873928035 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac30083fc0 con 0x7fac38155c30 2023-07-09T02:12:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.163+0000 7fac3e11e640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac1c066280 0x7fac1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:12:56.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.163+0000 7fac3e11e640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac1c066280 0x7fac1c068730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac38073ec0 tx=0x7fac34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:12:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.163+0000 7fac2effd640 1 -- 172.21.15.45:0/3873928035 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac300b4700 con 0x7fac38155c30 2023-07-09T02:12:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.351+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac380c5550 con 0x7fac38155c30 2023-07-09T02:12:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.351+0000 7fac2effd640 1 -- 172.21.15.45:0/3873928035 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fac3001a090 con 0x7fac38155c30 2023-07-09T02:12:56.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:12:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:12:56.356 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:12:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac1c066280 msgr2=0x7fac1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac1c066280 0x7fac1c068730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac38073ec0 tx=0x7fac34008040 comp rx=0 tx=0).stop 2023-07-09T02:12:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac38155c30 msgr2=0x7fac380c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:12:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac38155c30 0x7fac380c42d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fac30007df0 tx=0x7fac3000d4a0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 shutdown_connections 2023-07-09T02:12:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac38155c30 0x7fac380c42d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac380c9340 0x7fac38157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fac1c066280 0x7fac1c068730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 --2- 172.21.15.45:0/3873928035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac380c8f70 0x7fac381535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:12:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 >> 172.21.15.45:0/3873928035 conn(0x7fac380694b0 msgr2=0x7fac381e2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:12:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 shutdown_connections 2023-07-09T02:12:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:12:56.355+0000 7fac40382640 1 -- 172.21.15.45:0/3873928035 wait complete. 2023-07-09T02:12:56.376 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-07-09T02:12:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":5628,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5959384459999999,"mdsmap_epoch":25,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":14.357208738000001} 2023-07-09T02:12:56.539 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 5628, "mdsmap_epoch": 25, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 8.595938446, "state": "up:active", "uptime": 14.357208738, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:12:56.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-07-09T02:12:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_mon_report_interval":"5"} 2023-07-09T02:12:56.700 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-07-09T02:12:56.701 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-07-09T02:12:56.701 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:56.701 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:56.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:56.711 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-07-09T02:12:58.574 INFO:teuthology.orchestra.run.smithi045.stderr:265+0 records in 2023-07-09T02:12:58.574 INFO:teuthology.orchestra.run.smithi045.stderr:265+0 records out 2023-07-09T02:12:58.574 INFO:teuthology.orchestra.run.smithi045.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.81072 s, 153 MB/s 2023-07-09T02:12:58.575 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:12:58.576 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:12:58.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:12:58.586 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-07-09T02:13:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:292+0 records in 2023-07-09T02:13:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:292+0 records out 2023-07-09T02:13:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.12365 s, 144 MB/s 2023-07-09T02:13:00.767 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-07-09T02:13:00.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:13:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb327b2c640 1 Processor -- start 2023-07-09T02:13:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb327b2c640 1 -- start start 2023-07-09T02:13:00.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb327b2c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb32015c060 0x7fb3200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:00.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb327b2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 0x7fb3200d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb327b2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb320160a50 con 0x7fb3200d2450 2023-07-09T02:13:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb327b2c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3200d28f0 con 0x7fb32015c060 2023-07-09T02:13:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb327b2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200cfe40 con 0x7fb3200cd120 2023-07-09T02:13:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3260c9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb3200d2450 0x7fb3200d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:47972/0 (socket says 172.21.15.45:47972) 2023-07-09T02:13:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3258c8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb32015c060 0x7fb3200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3260c9640 1 -- 172.21.15.45:0/1422839177 learned_addr learned my addr 172.21.15.45:0/1422839177 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:00.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3250c7640 1 --2- 172.21.15.45:0/1422839177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 0x7fb3200d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3258c8640 1 -- 172.21.15.45:0/1422839177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 msgr2=0x7fb3200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3258c8640 1 --2- 172.21.15.45:0/1422839177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 0x7fb3200d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3258c8640 1 -- 172.21.15.45:0/1422839177 >> v1:172.21.15.45:6789/0 conn(0x7fb3200d2450 legacy=0x7fb3200d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3258c8640 1 -- 172.21.15.45:0/1422839177 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32015c430 con 0x7fb32015c060 2023-07-09T02:13:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.907+0000 7fb3248c6640 1 -- 172.21.15.45:0/1422839177 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799100559 0 0) 0x7fb320160a50 con 0x7fb3200d2450 2023-07-09T02:13:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb3258c8640 1 --2- 172.21.15.45:0/1422839177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb3200b4ed0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0097c0 tx=0x7fb31c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbafaa8e651a20f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb3248c6640 1 -- 172.21.15.45:0/1422839177 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0ab600 con 0x7fb32015c060 2023-07-09T02:13:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb3248c6640 1 -- 172.21.15.45:0/1422839177 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0a7050 con 0x7fb32015c060 2023-07-09T02:13:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb3248c6640 1 -- 172.21.15.45:0/1422839177 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0ab980 con 0x7fb32015c060 2023-07-09T02:13:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb327b2c640 1 -- 172.21.15.45:0/1422839177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 msgr2=0x7fb3200b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb327b2c640 1 --2- 172.21.15.45:0/1422839177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb3200b4ed0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0097c0 tx=0x7fb31c01c450 comp rx=0 tx=0).stop 2023-07-09T02:13:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb327b2c640 1 -- 172.21.15.45:0/1422839177 shutdown_connections 2023-07-09T02:13:00.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb327b2c640 1 --2- 172.21.15.45:0/1422839177 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 0x7fb3200d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:00.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb327b2c640 1 --2- 172.21.15.45:0/1422839177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb3200b4ed0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:00.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb327b2c640 1 -- 172.21.15.45:0/1422839177 >> 172.21.15.45:0/1422839177 conn(0x7fb3200698e0 msgr2=0x7fb320069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:00.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb327b2c640 1 -- 172.21.15.45:0/1422839177 shutdown_connections 2023-07-09T02:13:00.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.911+0000 7fb327b2c640 1 -- 172.21.15.45:0/1422839177 wait complete. 2023-07-09T02:13:00.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 Processor -- start 2023-07-09T02:13:00.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 -- start start 2023-07-09T02:13:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 0x7fb320153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3200d2450 0x7fb320152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb320155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32015af40 con 0x7fb32015c060 2023-07-09T02:13:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320154050 con 0x7fb3200d2450 2023-07-09T02:13:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb320152590 con 0x7fb3200cd120 2023-07-09T02:13:00.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb320155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:00.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb320155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42102/0 (socket says 172.21.15.45:42102) 2023-07-09T02:13:00.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 -- 172.21.15.45:0/4178856558 learned_addr learned my addr 172.21.15.45:0/4178856558 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:00.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3258c8640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 0x7fb320153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:00.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3250c7640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3200d2450 0x7fb320152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:00.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 -- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 msgr2=0x7fb320153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:00.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 0x7fb320153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:00.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 -- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3200d2450 msgr2=0x7fb320152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:00.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3200d2450 0x7fb320152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 -- 172.21.15.45:0/4178856558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c009420 con 0x7fb32015c060 2023-07-09T02:13:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3260c9640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb320155e80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb318001570 tx=0x7fb31800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3167fc640 1 -- 172.21.15.45:0/4178856558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31800a5e0 con 0x7fb32015c060 2023-07-09T02:13:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3167fc640 1 -- 172.21.15.45:0/4178856558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31800a760 con 0x7fb32015c060 2023-07-09T02:13:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb3167fc640 1 -- 172.21.15.45:0/4178856558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31800ab10 con 0x7fb32015c060 2023-07-09T02:13:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32015a980 con 0x7fb32015c060 2023-07-09T02:13:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.915+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb320153310 con 0x7fb32015c060 2023-07-09T02:13:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.919+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb320153150 con 0x7fb32015c060 2023-07-09T02:13:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.919+0000 7fb3167fc640 1 -- 172.21.15.45:0/4178856558 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb31800ac70 con 0x7fb32015c060 2023-07-09T02:13:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.919+0000 7fb3167fc640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb304066280 0x7fb304068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.919+0000 7fb3167fc640 1 -- 172.21.15.45:0/4178856558 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb318083290 con 0x7fb32015c060 2023-07-09T02:13:00.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.919+0000 7fb3258c8640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb304066280 0x7fb304068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:00.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.919+0000 7fb3258c8640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb304066280 0x7fb304068730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0ad000 tx=0x7fb31c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:00.923+0000 7fb3167fc640 1 -- 172.21.15.45:0/4178856558 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3180507b0 con 0x7fb32015c060 2023-07-09T02:13:01.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.079+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb32015e830 con 0x7fb32015c060 2023-07-09T02:13:01.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.079+0000 7fb3167fc640 1 -- 172.21.15.45:0/4178856558 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+36998 (secure 0 0 0) 0x7fb318053dd0 con 0x7fb32015c060 2023-07-09T02:13:01.084 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:01.084 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:01.084 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 48, 2023-07-09T02:13:01.084 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:13:01.084 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:13:01.084 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:12:48.928396+0000", 2023-07-09T02:13:01.085 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:13:01.085 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:13:01.085 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:13:01.085 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:13:01.085 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:13:01.085 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:13:01.085 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:13:01.086 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:13:01.086 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:13:01.086 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:01.086 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:13:01.086 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:13:01.086 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:13:01.086 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:13:01.086 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:13:01.087 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 8, 2023-07-09T02:13:01.087 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:13:01.087 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:13:01.087 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:13:01.087 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:13:01.087 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:13:01.087 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:13:01.087 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.088 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:13:01.088 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:13:01.088 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:13:01.088 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:01.088 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:01.088 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:01.088 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:01.089 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:01.089 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:01.089 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:01.089 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:01.089 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:01.089 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:01.089 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:01.089 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:01.090 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:13:01.090 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:13:01.090 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:13:01.090 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:13:01.090 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:13:01.090 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:01.090 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:01.090 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:01.091 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:01.091 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:01.091 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:01.091 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:01.091 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.091 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "17", 2023-07-09T02:13:01.091 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:01.091 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:01.092 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:01.092 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:01.092 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:01.092 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:01.092 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:01.092 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:01.092 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:01.092 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:01.093 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:01.094 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:01.094 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:01.094 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:01.094 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:01.094 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:01.094 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:01.094 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:01.094 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:01.095 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.095 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:01.095 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:01.095 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:01.095 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:01.095 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:01.095 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:01.095 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:01.096 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:01.096 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:01.096 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:01.096 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:01.096 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:01.096 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:13:01.096 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:13:01.097 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.097 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:01.097 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:13:01.097 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.097 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:01.097 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:13:01.097 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:13:01.097 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:13:01.098 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:13:01.098 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:13:01.098 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:01.098 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:01.098 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:01.098 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.098 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.098 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.099 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:13:01.099 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:13:01.099 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:13:01.099 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:01.099 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:01.099 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:01.099 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:01.099 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:01.100 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:01.100 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:01.100 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:01.100 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:01.100 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:01.100 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:01.100 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:01.101 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:13:01.101 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:13:01.101 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:13:01.101 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:13:01.101 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:13:01.101 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:01.101 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:01.101 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:01.102 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:01.102 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:01.102 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:01.102 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:01.102 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.102 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "20", 2023-07-09T02:13:01.102 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:01.102 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:01.103 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:01.103 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:01.103 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:01.103 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:01.103 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:01.103 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:01.103 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:01.103 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:01.104 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:01.104 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:01.104 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:01.104 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:01.104 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:01.104 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:01.104 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:01.104 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:01.105 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:01.105 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:01.105 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:01.105 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:01.105 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:01.105 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:01.105 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:01.105 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:01.106 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.106 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:01.106 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:01.106 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:01.106 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:01.106 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:01.106 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:01.106 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:01.107 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:01.107 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:01.107 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:01.107 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:01.107 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:13:01.107 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:01.107 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:13:01.107 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:13:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:13:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:13:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:01.109 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:01.109 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:01.109 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.109 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.109 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.109 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 7, 2023-07-09T02:13:01.109 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:13:01.109 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:45.075187+0000", 2023-07-09T02:13:01.110 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:01.110 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:01.110 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:01.110 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:01.110 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:01.110 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:01.110 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:01.110 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:01.111 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:01.111 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:01.111 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:01.111 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:01.111 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:13:01.111 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:13:01.111 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:13:01.111 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:13:01.112 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:13:01.112 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:01.112 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:01.112 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:01.112 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:01.112 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:01.112 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:01.112 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:01.113 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.113 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "47", 2023-07-09T02:13:01.113 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:01.113 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:01.113 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:01.113 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:01.113 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:01.114 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:01.114 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:01.114 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:01.114 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:01.114 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:01.114 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:01.114 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:01.114 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:01.115 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:01.115 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:01.115 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:01.115 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:01.115 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:01.115 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:01.115 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:01.115 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:01.116 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:01.116 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:01.116 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:01.116 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:01.116 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:01.116 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.116 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:01.116 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:01.118 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:01.118 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:01.118 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:13:01.118 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:13:01.118 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:13:01.118 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.118 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:01.118 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:01.119 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:13:01.119 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.119 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.119 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:01.119 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:13:01.119 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:13:01.119 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:01.119 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:01.120 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:01.120 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:01.120 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:01.120 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:01.120 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.120 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.120 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.121 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-07-09T02:13:01.121 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:13:01.121 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:46.325197+0000", 2023-07-09T02:13:01.121 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:01.121 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:01.121 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:01.121 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:01.121 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:01.122 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:01.122 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:01.122 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:01.122 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:01.122 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:01.122 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:01.122 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:01.122 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:13:01.123 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:13:01.123 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:13:01.123 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:13:01.123 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:13:01.123 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:01.123 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:01.123 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:01.123 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "48", 2023-07-09T02:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:01.124 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:01.125 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:01.125 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:01.125 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:01.125 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:01.125 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:01.125 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:01.125 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:01.125 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:01.126 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:01.126 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:01.126 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:01.126 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:01.126 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:01.126 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:01.126 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:01.127 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:01.127 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:01.127 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:01.127 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:01.127 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:01.127 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:01.127 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:01.127 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:01.128 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.128 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:01.128 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:01.128 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:01.128 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:01.128 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:01.128 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:01.128 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:13:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:13:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:13:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.8799999952316284, 2023-07-09T02:13:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.8799999952316284, 2023-07-09T02:13:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.8799999952316284, 2023-07-09T02:13:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.8799999952316284, 2023-07-09T02:13:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.132 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.132 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:01.132 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:13:01.132 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.132 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:01.132 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:01.132 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:01.132 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:01.133 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:01.133 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:01.133 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:01.133 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:01.133 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:01.133 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:01.133 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:01.133 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:01.134 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:01.134 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.134 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.134 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.134 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:13:01.134 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:01.134 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.134 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.135 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.135 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:13:01.135 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:01.135 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.135 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.135 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.135 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:01.135 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.136 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.136 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.136 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:13:01.136 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:01.136 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.136 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.136 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.136 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:13:01.137 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:01.137 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.137 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.137 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.137 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:01.137 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.137 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.137 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.138 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:13:01.138 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:01.138 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.138 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.138 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.138 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:13:01.138 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:01.138 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.139 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.139 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.139 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:01.139 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.139 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.139 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.139 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:13:01.139 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:01.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.140 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.140 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.140 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:13:01.140 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:01.140 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.140 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.141 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:13:01.141 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:13:01.141 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:13:01.141 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:13:01.141 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:01.141 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:01.141 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:01.141 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.142 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.142 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.142 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:01.142 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:01.142 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:01.142 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:01.142 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:01.143 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:01.143 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:01.143 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:01.143 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:01.143 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:01.143 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:01.143 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:01.143 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:01.144 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.144 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.144 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.144 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:13:01.144 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:01.144 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.144 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.144 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.145 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:13:01.145 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:01.145 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.145 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.145 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.145 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:01.145 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.145 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.146 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.146 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:13:01.146 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:01.146 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.146 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.146 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.146 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:13:01.146 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:01.147 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.147 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.147 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.147 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:01.147 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.147 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.147 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.148 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:13:01.148 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:01.148 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.148 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.148 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.148 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:13:01.148 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:01.148 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.149 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.149 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.149 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:01.149 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.149 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.149 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.149 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:13:01.149 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:01.150 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.150 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.150 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.150 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:13:01.150 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:01.150 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.150 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.150 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.151 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:13:01.151 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:13:01.151 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:13:01.151 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:13:01.151 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:01.151 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:01.151 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:01.151 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.152 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.152 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.152 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:01.152 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:01.152 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:01.152 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:01.152 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:01.152 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:01.153 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:01.153 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:01.153 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:01.153 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:01.153 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:01.153 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:01.153 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:01.153 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.154 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.154 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.154 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:13:01.154 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:01.154 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.154 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.154 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:13:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.155 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:13:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:13:01.156 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.157 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:13:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:13:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.158 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:13:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:01.159 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:13:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.160 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:13:01.161 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:13:01.161 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:13:01.161 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:13:01.161 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:01.161 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:01.161 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:01.161 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.161 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.162 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.162 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:01.162 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:01.162 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:01.162 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:01.162 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:01.162 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.163 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.164 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.164 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:13:01.164 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:01.164 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.164 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.164 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.164 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:13:01.165 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:01.165 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.165 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.165 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.165 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:01.165 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.165 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.165 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:13:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:13:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:01.166 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:13:01.167 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:13:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.168 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:13:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.169 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:13:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:13:01.170 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:13:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:13:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:13:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.171 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:01.172 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.173 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.174 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.174 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:13:01.174 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:01.174 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.174 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.174 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.174 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:13:01.174 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.175 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:13:01.176 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:01.176 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.176 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.176 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.176 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:13:01.176 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:01.176 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.176 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.177 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.177 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:01.177 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.177 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.177 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.177 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:13:01.177 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:01.177 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.178 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.178 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.178 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:13:01.178 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:01.178 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.178 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.178 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.178 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:01.179 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.179 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.179 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.179 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:13:01.179 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:01.179 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.179 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.179 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.180 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:13:01.180 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:01.180 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.180 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.180 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.180 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:13:01.180 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:13:01.181 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:13:01.181 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:13:01.181 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:01.181 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:01.181 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:01.181 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.181 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.181 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.182 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:01.182 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:01.182 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:01.182 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:01.182 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:01.182 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:01.182 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:01.182 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:01.183 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:01.183 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:01.183 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:01.183 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:01.183 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:01.183 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.183 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.183 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.184 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:13:01.184 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:01.184 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.184 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.184 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.184 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:13:01.184 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:01.184 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.185 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.185 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.185 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:01.185 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.185 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.185 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.185 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:13:01.185 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:01.186 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.186 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.186 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.186 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:13:01.186 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:01.186 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.186 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.186 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.187 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:01.187 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.187 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.187 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.187 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:13:01.187 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:01.187 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.187 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.188 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.188 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:13:01.188 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:01.188 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.188 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.188 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.188 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:01.188 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.189 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.189 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.189 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:13:01.189 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:01.189 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.189 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.189 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.189 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:13:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:13:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:13:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:13:01.190 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:13:01.191 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:01.191 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:01.191 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:01.191 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.191 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.191 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.191 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:01.191 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:01.192 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:01.192 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:01.192 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:01.192 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:01.192 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:01.192 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:01.192 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:01.192 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:01.193 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:01.193 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:01.193 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:01.193 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.193 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.193 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.193 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:13:01.193 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:01.194 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.194 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.194 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.194 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:13:01.194 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:01.194 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.194 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.194 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.195 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:01.195 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.195 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.195 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.195 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:13:01.195 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:01.195 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.196 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.196 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.196 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:13:01.196 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:01.196 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.196 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.196 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.196 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:13:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.197 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:13:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.198 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:13:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:13:01.199 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:13:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:13:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:13:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:13:01.200 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:01.201 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:01.202 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:13:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:01.203 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.204 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.204 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.204 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:13:01.204 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:01.204 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.204 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.204 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.204 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:01.205 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.205 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.205 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.205 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:13:01.205 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:01.205 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.205 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.205 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.206 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:13:01.206 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:01.206 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.206 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.206 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.206 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:01.206 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.206 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.207 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.207 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:13:01.207 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:01.207 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.207 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.207 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.207 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:13:01.207 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:01.208 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.208 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.208 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:01.208 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:01.208 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.208 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:01.209 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:13:01.209 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:01.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.209 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.209 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:01.209 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:13:01.209 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:01.209 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.210 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.210 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:13:01.210 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:13:01.210 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:13:01.210 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:13:01.210 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:01.210 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:01.211 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:01.211 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:01.211 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.211 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:01.211 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:13:01.211 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.211 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:01.211 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:01.212 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:01.212 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:01.212 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:01.212 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:01.212 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:13:01.212 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:01.212 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.212 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.213 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:01.213 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:01.213 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:01.213 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:01.213 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:01.213 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:01.213 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:13:01.213 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:01.214 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:13:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:01.215 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:13:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:01.216 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:13:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:01.217 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:01.218 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:01.220 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:13:01.220 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:01.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.220 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:01.220 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:01.220 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:01.220 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:01.221 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:13:01.222 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:13:01.222 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:13:01.222 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:13:01.222 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:13:01.222 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:13:01.222 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:13:01.222 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:13:01.222 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:13:01.223 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:13:01.223 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:13:01.223 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:13:01.223 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:13:01.223 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:13:01.223 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.223 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:01.223 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:13:01.224 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:13:01.224 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:13:01.224 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:13:01.224 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:13:01.224 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:13:01.224 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:13:01.224 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:13:01.224 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:13:01.225 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:13:01.225 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:13:01.225 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:01.225 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:01.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb304066280 msgr2=0x7fb304068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:01.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb304066280 0x7fb304068730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0ad000 tx=0x7fb31c0a6000 comp rx=0 tx=0).stop 2023-07-09T02:13:01.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 msgr2=0x7fb320155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:01.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb320155e80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb318001570 tx=0x7fb31800cca0 comp rx=0 tx=0).stop 2023-07-09T02:13:01.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 shutdown_connections 2023-07-09T02:13:01.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb32015c060 0x7fb320155e80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:01.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3200d2450 0x7fb320152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:01.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb304066280 0x7fb304068730 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:01.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 --2- 172.21.15.45:0/4178856558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb3200cd120 0x7fb320153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:01.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 >> 172.21.15.45:0/4178856558 conn(0x7fb3200698e0 msgr2=0x7fb3200d2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:01.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 shutdown_connections 2023-07-09T02:13:01.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:01.083+0000 7fb327b2c640 1 -- 172.21.15.45:0/4178856558 wait complete. 2023-07-09T02:13:01.229 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:13:02.331 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:13:02.331+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-07-09T02:13:06.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:13:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd3626d8640 1 Processor -- start 2023-07-09T02:13:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd3626d8640 1 -- start start 2023-07-09T02:13:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd3626d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd35c15c060 0x7fd35c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd3626d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c160a50 con 0x7fd35c0d2620 2023-07-09T02:13:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd3626d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c15c430 con 0x7fd35c0cd120 2023-07-09T02:13:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd3626d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35c15fb60 con 0x7fd35c15c060 2023-07-09T02:13:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd35bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd35c15c060 0x7fd35c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd360c75640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd35c0d2620 0x7fd35c0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49114/0 (socket says 172.21.15.45:49114) 2023-07-09T02:13:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.383+0000 7fd360c75640 1 -- 172.21.15.45:0/2703386383 learned_addr learned my addr 172.21.15.45:0/2703386383 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:06.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.387+0000 7fd35bfff640 1 -- 172.21.15.45:0/2703386383 >> v1:172.21.15.155:6789/0 conn(0x7fd35c0cd120 legacy=0x7fd35c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:06.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.387+0000 7fd35bfff640 1 -- 172.21.15.45:0/2703386383 >> v1:172.21.15.45:6789/0 conn(0x7fd35c0d2620 legacy=0x7fd35c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:06.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.387+0000 7fd35bfff640 1 -- 172.21.15.45:0/2703386383 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c15fe40 con 0x7fd35c15c060 2023-07-09T02:13:06.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.387+0000 7fd35affd640 1 -- 172.21.15.45:0/2703386383 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256333295 0 0) 0x7fd35c160a50 con 0x7fd35c0d2620 2023-07-09T02:13:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.387+0000 7fd35bfff640 1 --2- 172.21.15.45:0/2703386383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c15c060 0x7fd35c0b4ed0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0097c0 tx=0x7fd34c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21ef1bf52a9a3c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.387+0000 7fd35affd640 1 -- 172.21.15.45:0/2703386383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0ab610 con 0x7fd35c15c060 2023-07-09T02:13:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.387+0000 7fd35affd640 1 -- 172.21.15.45:0/2703386383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0ab770 con 0x7fd35c15c060 2023-07-09T02:13:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.387+0000 7fd35affd640 1 -- 172.21.15.45:0/2703386383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0abb00 con 0x7fd35c15c060 2023-07-09T02:13:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- 172.21.15.45:0/2703386383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c15c060 msgr2=0x7fd35c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 --2- 172.21.15.45:0/2703386383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c15c060 0x7fd35c0b4ed0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0097c0 tx=0x7fd34c01c410 comp rx=0 tx=0).stop 2023-07-09T02:13:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- 172.21.15.45:0/2703386383 shutdown_connections 2023-07-09T02:13:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 --2- 172.21.15.45:0/2703386383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c15c060 0x7fd35c0b4ed0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- 172.21.15.45:0/2703386383 >> 172.21.15.45:0/2703386383 conn(0x7fd35c0698e0 msgr2=0x7fd35c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- 172.21.15.45:0/2703386383 shutdown_connections 2023-07-09T02:13:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- 172.21.15.45:0/2703386383 wait complete. 2023-07-09T02:13:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 Processor -- start 2023-07-09T02:13:06.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- start start 2023-07-09T02:13:06.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c0cd120 0x7fd35c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:06.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35c0d2620 0x7fd35c0b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:06.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd35c15c060 0x7fd35c0b8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:06.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c154e90 con 0x7fd35c0cd120 2023-07-09T02:13:06.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c14c5c0 con 0x7fd35c0d2620 2023-07-09T02:13:06.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd3626d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c154bb0 con 0x7fd35c15c060 2023-07-09T02:13:06.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c0cd120 0x7fd35c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:06.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c0cd120 0x7fd35c14c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40504/0 (socket says 172.21.15.45:40504) 2023-07-09T02:13:06.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35bfff640 1 -- 172.21.15.45:0/3554393055 learned_addr learned my addr 172.21.15.45:0/3554393055 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:06.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd360c75640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd35c15c060 0x7fd35c0b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:06.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35b7fe640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35c0d2620 0x7fd35c0b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:06.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35bfff640 1 -- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd35c15c060 msgr2=0x7fd35c0b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:06.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35bfff640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd35c15c060 0x7fd35c0b8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:06.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35bfff640 1 -- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35c0d2620 msgr2=0x7fd35c0b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:06.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35bfff640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35c0d2620 0x7fd35c0b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:06.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35bfff640 1 -- 172.21.15.45:0/3554393055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c009420 con 0x7fd35c0cd120 2023-07-09T02:13:06.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.391+0000 7fd35b7fe640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35c0d2620 0x7fd35c0b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:06.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd35bfff640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c0cd120 0x7fd35c14c080 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0ad040 tx=0x7fd34c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:06.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd358ff9640 1 -- 172.21.15.45:0/3554393055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0b5810 con 0x7fd35c0cd120 2023-07-09T02:13:06.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd358ff9640 1 -- 172.21.15.45:0/3554393055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0b59b0 con 0x7fd35c0cd120 2023-07-09T02:13:06.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd358ff9640 1 -- 172.21.15.45:0/3554393055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0b5d60 con 0x7fd35c0cd120 2023-07-09T02:13:06.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c0b59f0 con 0x7fd35c0cd120 2023-07-09T02:13:06.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c15caa0 con 0x7fd35c0cd120 2023-07-09T02:13:06.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35c15c620 con 0x7fd35c0cd120 2023-07-09T02:13:06.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd358ff9640 1 -- 172.21.15.45:0/3554393055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd34c0bf410 con 0x7fd35c0cd120 2023-07-09T02:13:06.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd358ff9640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd348066280 0x7fd348068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:06.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.395+0000 7fd358ff9640 1 -- 172.21.15.45:0/3554393055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd34c11e790 con 0x7fd35c0cd120 2023-07-09T02:13:06.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.399+0000 7fd358ff9640 1 -- 172.21.15.45:0/3554393055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7fd34806e480 con 0x7fd35c0cd120 2023-07-09T02:13:06.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.399+0000 7fd35b7fe640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd348066280 0x7fd348068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:06.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.399+0000 7fd35b7fe640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd348066280 0x7fd348068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0b1950 tx=0x7fd350009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:06.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.399+0000 7fd358ff9640 1 -- 172.21.15.45:0/3554393055 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd35c15c620 con 0x7fd35c0cd120 2023-07-09T02:13:06.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.555+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd35c15c620 con 0x7fd35c0cd120 2023-07-09T02:13:06.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.555+0000 7fd358ff9640 1 -- 172.21.15.45:0/3554393055 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+37513 (secure 0 0 0) 0x7fd35c15c620 con 0x7fd35c0cd120 2023-07-09T02:13:06.559 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:06.560 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:06.560 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 53, 2023-07-09T02:13:06.560 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:13:06.560 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:13:06.560 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:13:06.364315+0000", 2023-07-09T02:13:06.560 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:13:06.561 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:13:06.561 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:13:06.561 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:13:06.561 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:13:06.561 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:13:06.561 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:13:06.561 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:13:06.562 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:13:06.562 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:06.562 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:13:06.562 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:13:06.562 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:13:06.562 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:13:06.562 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:13:06.562 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 8, 2023-07-09T02:13:06.563 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:13:06.563 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:13:06.563 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "luminous", 2023-07-09T02:13:06.563 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:13:06.563 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:13:06.563 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:13:06.563 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.564 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:13:06.564 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:13:06.564 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:13:06.564 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:06.564 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:06.564 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:06.565 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:06.565 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:06.565 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:06.565 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:06.565 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:06.565 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:06.565 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:06.566 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:06.566 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:06.566 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:13:06.566 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:13:06.566 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:13:06.566 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:13:06.566 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:13:06.566 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:06.567 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:06.567 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:06.567 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:06.567 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:06.567 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:06.567 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:06.567 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.568 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:06.568 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:06.568 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:06.568 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:06.568 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:06.568 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:06.569 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:06.569 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:06.569 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:06.569 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:06.569 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:06.569 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:06.569 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:06.569 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:06.570 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:06.570 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:06.570 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:06.570 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:06.570 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:06.570 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:06.570 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:06.571 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:06.571 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:06.571 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:06.571 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:06.571 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:06.572 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:06.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.572 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:06.572 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:06.572 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:06.572 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:06.573 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:06.573 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:06.573 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:06.573 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:06.573 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:06.573 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:06.573 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:06.574 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:06.574 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:13:06.574 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:13:06.574 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.574 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:06.574 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:13:06.575 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.575 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:06.575 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:13:06.575 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:13:06.575 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:13:06.575 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:13:06.576 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:13:06.576 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:06.576 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:06.576 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:06.576 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.577 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.577 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.577 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:13:06.577 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:13:06.577 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:13:06.577 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:06.577 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:06.578 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:06.578 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:06.578 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:06.578 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:06.578 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:06.578 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:06.578 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:06.579 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:06.579 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:06.579 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:06.579 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:13:06.579 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:13:06.579 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:13:06.579 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:13:06.580 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:13:06.580 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:06.580 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:06.580 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:06.580 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:06.580 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:06.581 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:06.581 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:06.581 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.581 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:06.581 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:06.581 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:06.581 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:06.582 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:06.582 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:06.582 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:06.582 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:06.582 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:06.582 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:06.582 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:06.583 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:06.583 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:06.583 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:06.583 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:06.583 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:06.583 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:06.583 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:06.583 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:06.584 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:06.584 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:06.584 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:06.584 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:06.584 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:06.585 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:06.585 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:06.585 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:06.585 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.585 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:06.585 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:06.585 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:06.586 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:06.586 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:06.586 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:06.586 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:06.586 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:06.586 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:06.586 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:06.587 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:06.587 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:13:06.587 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:06.587 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:13:06.587 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.587 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:06.587 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:13:06.588 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:13:06.588 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:13:06.588 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:06.588 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:06.588 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:06.588 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:06.588 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:06.589 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.589 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.589 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.589 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 7, 2023-07-09T02:13:06.589 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:13:06.589 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:45.075187+0000", 2023-07-09T02:13:06.589 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:06.590 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:06.590 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:06.590 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:06.590 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:06.590 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:06.590 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:06.590 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:06.591 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:06.591 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:06.591 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:06.591 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:06.591 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:13:06.591 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:13:06.591 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:13:06.592 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:13:06.592 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:13:06.592 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:06.592 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:06.592 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:06.592 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:06.592 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:06.593 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:06.593 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:06.593 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.593 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:06.593 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:06.593 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:06.593 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:06.594 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:06.594 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:06.594 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:06.594 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:06.594 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:06.594 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:06.594 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:06.595 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:06.595 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:06.595 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:06.595 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:06.595 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:06.595 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:06.595 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:06.596 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:06.596 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:06.596 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:06.596 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:06.596 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:06.596 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:06.596 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:06.597 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:06.597 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:06.597 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.597 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:06.597 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:06.597 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:06.597 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:06.598 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:06.598 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:06.598 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:06.598 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:06.598 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:06.598 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:06.598 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:06.599 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:06.599 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:13:06.599 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:13:06.599 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:13:06.599 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.599 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:06.600 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:06.600 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:13:06.600 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.600 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.600 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:06.600 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:13:06.600 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:13:06.601 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:06.601 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:06.601 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:06.601 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:06.601 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:06.601 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:06.601 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.602 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.602 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.602 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-07-09T02:13:06.602 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:13:06.602 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:46.325197+0000", 2023-07-09T02:13:06.602 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:06.602 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:06.603 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:06.603 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:06.603 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:06.603 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:06.603 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:06.603 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:06.603 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:06.604 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:06.604 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:06.604 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:06.604 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:13:06.604 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:13:06.604 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:13:06.604 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:13:06.604 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:13:06.605 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:06.605 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:06.605 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:06.605 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:06.605 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:06.605 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:06.605 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:06.606 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.606 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:06.606 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:06.606 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:06.606 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:06.606 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:06.606 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:06.607 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:06.607 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:06.607 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:06.607 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:06.607 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:06.607 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:06.607 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:06.608 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:06.608 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:06.608 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:06.608 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:06.608 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:06.608 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:06.608 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:06.609 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:06.609 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:06.609 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:06.609 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:06.609 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:06.609 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:06.609 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:06.610 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.610 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:06.610 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:06.610 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:06.610 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:06.610 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:06.610 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:06.611 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:06.611 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:06.611 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:06.611 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:06.611 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:06.611 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:06.611 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:13:06.612 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:13:06.612 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.612 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:06.612 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:06.612 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:13:06.612 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.612 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.613 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:06.613 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.8799999952316284, 2023-07-09T02:13:06.613 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.8799999952316284, 2023-07-09T02:13:06.613 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:06.613 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.8799999952316284, 2023-07-09T02:13:06.613 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.8799999952316284, 2023-07-09T02:13:06.613 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:06.614 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:06.614 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:06.614 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.614 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.614 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:06.614 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:13:06.615 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.615 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:06.615 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:06.615 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:06.615 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:06.615 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:06.615 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:06.616 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:06.616 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:06.616 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:06.616 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:06.616 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:06.616 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:13:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.618 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.618 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:13:06.618 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:06.618 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.618 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.618 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.618 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:06.619 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.619 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.619 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.619 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:13:06.619 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:06.619 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.619 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.620 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.620 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:13:06.620 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:06.620 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.620 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.620 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.620 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:06.621 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.621 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.621 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.621 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:13:06.621 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:06.621 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.621 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.622 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.622 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:13:06.622 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:06.622 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.622 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.622 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.622 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:06.622 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.623 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.623 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.623 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:13:06.623 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:06.623 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.623 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.623 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.624 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:13:06.624 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:06.624 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.624 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.624 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.624 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:13:06.624 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:13:06.625 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:13:06.625 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:13:06.625 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:06.625 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:06.625 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:06.625 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:06.625 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:06.626 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:06.627 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.628 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:13:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:13:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:06.629 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.630 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:13:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:13:06.631 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.632 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:13:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:13:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:06.633 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.634 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:13:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:13:06.635 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:13:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:13:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:13:06.636 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:13:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.637 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:06.638 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.639 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:13:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.640 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:13:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.641 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:13:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.642 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:13:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.643 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:13:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:13:06.644 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.645 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:13:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:13:06.646 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:13:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:13:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:13:06.647 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:13:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.648 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 52, 2023-07-09T02:13:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.650 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:13:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.651 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:13:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.652 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:13:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:13:06.653 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.654 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:13:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:13:06.655 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.656 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:13:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:13:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:06.657 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:13:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:13:06.658 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:13:06.659 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:13:06.659 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:06.659 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:06.659 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:06.659 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:06.660 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.660 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.660 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.660 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:06.660 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:06.660 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:06.661 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:06.661 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:06.661 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:06.661 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:06.661 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:06.661 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:06.661 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:06.661 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:06.662 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:06.662 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:06.662 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.662 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.662 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.662 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:13:06.662 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:06.663 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.663 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.663 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.663 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:13:06.663 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:06.663 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.663 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.664 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:06.664 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.664 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.664 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.664 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:13:06.664 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:06.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.665 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.665 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.665 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:13:06.665 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:06.665 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.665 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.665 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.666 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:06.666 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.666 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.666 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.666 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:13:06.666 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:06.666 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.667 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.667 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.667 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:13:06.667 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:06.667 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.667 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.667 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.668 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:06.668 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.668 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.668 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.668 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:13:06.668 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:06.668 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.669 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.669 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.669 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:13:06.669 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:06.669 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.670 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.670 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:13:06.670 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:13:06.670 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:13:06.670 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:13:06.670 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:06.670 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:06.671 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:06.671 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.671 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.671 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:06.671 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:06.671 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:06.672 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:06.672 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:06.672 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:06.672 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:06.672 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:06.672 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:06.673 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:06.673 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:06.673 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:06.673 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:06.673 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.673 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.673 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.674 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:13:06.674 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:06.674 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.674 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.674 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.674 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:13:06.674 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:06.675 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.675 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.675 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.675 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:06.675 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.675 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.676 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.676 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:13:06.676 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:06.676 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.676 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.676 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.677 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:13:06.677 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:06.677 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.677 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.677 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:13:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:06.678 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:13:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.679 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:13:06.680 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:13:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.681 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:13:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:13:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:13:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:13:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:06.682 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:06.683 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:06.684 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:06.685 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:13:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.686 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:13:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.687 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:13:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.688 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:13:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:06.689 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:13:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:13:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.691 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:13:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:06.692 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:13:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.693 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:13:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:13:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:13:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:13:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:06.694 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:06.695 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:06.696 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:13:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:06.697 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:13:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.698 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:13:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.699 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:13:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.700 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.701 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:13:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:13:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:06.702 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:06.703 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:13:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:13:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:06.704 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:13:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:13:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:13:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:13:06.705 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:06.706 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:13:06.707 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.707 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:06.707 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:06.707 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:06.707 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:06.707 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:06.707 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:06.708 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:13:06.708 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:06.708 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.708 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.708 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:06.709 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:06.709 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:06.709 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:06.709 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:06.709 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:06.709 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:13:06.710 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:06.710 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.710 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.710 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:06.710 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:06.710 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:06.710 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:06.711 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:06.711 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:06.711 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:13:06.711 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:06.711 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:06.712 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:13:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:06.713 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:13:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.714 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:06.715 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:13:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:06.716 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:13:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:06.717 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:06.718 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:06.719 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:06.719 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:06.719 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:13:06.719 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:06.719 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.720 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:06.720 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:13:06.720 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [ 2023-07-09T02:13:06.720 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.720 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.2a", 2023-07-09T02:13:06.720 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:06.720 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.721 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:06.721 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:06.721 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.721 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.721 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.721 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.722 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.37", 2023-07-09T02:13:06.722 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:06.722 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:06.722 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:06.722 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:06.722 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.722 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:06.723 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.723 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:06.723 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:13:06.723 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:13:06.723 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:13:06.723 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:13:06.723 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:13:06.724 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:13:06.724 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:13:06.724 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:13:06.724 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:13:06.724 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:13:06.724 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:13:06.724 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:13:06.725 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.725 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:06.725 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:13:06.725 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:13:06.725 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:13:06.725 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:13:06.725 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:13:06.726 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:13:06.726 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:13:06.726 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:13:06.726 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:13:06.726 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:13:06.726 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:13:06.726 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:06.727 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd348066280 msgr2=0x7fd348068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd348066280 0x7fd348068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0b1950 tx=0x7fd350009040 comp rx=0 tx=0).stop 2023-07-09T02:13:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c0cd120 msgr2=0x7fd35c14c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c0cd120 0x7fd35c14c080 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0ad040 tx=0x7fd34c01ac50 comp rx=0 tx=0).stop 2023-07-09T02:13:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 shutdown_connections 2023-07-09T02:13:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd348066280 0x7fd348068730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd35c15c060 0x7fd35c0b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35c0d2620 0x7fd35c0b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:06.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 --2- 172.21.15.45:0/3554393055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd35c0cd120 0x7fd35c14c080 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:06.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 >> 172.21.15.45:0/3554393055 conn(0x7fd35c0698e0 msgr2=0x7fd35c0b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:06.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 shutdown_connections 2023-07-09T02:13:06.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:06.559+0000 7fd3626d8640 1 -- 172.21.15.45:0/3554393055 wait complete. 2023-07-09T02:13:06.731 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-07-09T02:13:06.731 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:06.732 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:06.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:06.742 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-07-09T02:13:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-07-09T02:13:07.100 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records in 2023-07-09T02:13:07.100 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records out 2023-07-09T02:13:07.100 INFO:teuthology.orchestra.run.smithi045.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.296652 s, 177 MB/s 2023-07-09T02:13:07.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:13:07.101 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:13:07.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.239+0000 7ff04f2a9640 1 Processor -- start 2023-07-09T02:13:07.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.239+0000 7ff04f2a9640 1 -- start start 2023-07-09T02:13:07.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04f2a9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff04806c110 0x7ff04806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04f2a9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04806caa0 con 0x7ff0480caec0 2023-07-09T02:13:07.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04f2a9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480ccf80 con 0x7ff048158e30 2023-07-09T02:13:07.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04f2a9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480cd540 con 0x7ff04806c110 2023-07-09T02:13:07.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04d846640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0480caec0 0x7ff0480cd9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49122/0 (socket says 172.21.15.45:49122) 2023-07-09T02:13:07.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04d846640 1 -- 172.21.15.45:0/2418107670 learned_addr learned my addr 172.21.15.45:0/2418107670 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04c844640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff04806c110 0x7ff04806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818123794 0 0) 0x7ff0400014a0 con 0x7ff0480caec0 2023-07-09T02:13:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff034005740 con 0x7ff0480caec0 2023-07-09T02:13:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 93627827 0 0) 0x7ff034005740 con 0x7ff0480caec0 2023-07-09T02:13:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff04806c110 msgr2=0x7ff04806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff04806c110 0x7ff04806c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 >> v1:172.21.15.155:6789/0 conn(0x7ff048158e30 legacy=0x7ff04806f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480c8fb0 con 0x7ff0480caec0 2023-07-09T02:13:07.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7ff040001b90 con 0x7ff0480caec0 2023-07-09T02:13:07.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 >> v1:172.21.15.45:6789/0 conn(0x7ff0480caec0 legacy=0x7ff0480cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff04806c110 0x7ff034005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0340069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff034006f20 0x7ff034007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480cd540 con 0x7ff034006140 2023-07-09T02:13:07.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03400dd30 con 0x7ff034006f20 2023-07-09T02:13:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff034003530 con 0x7ff04806c110 2023-07-09T02:13:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04c844640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0340069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04d846640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff034006f20 0x7ff034007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04d045640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff04806c110 0x7ff034005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04c844640 1 -- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff04806c110 msgr2=0x7ff034005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04c844640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff04806c110 0x7ff034005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04c844640 1 -- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff034006f20 msgr2=0x7ff034007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04c844640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff034006f20 0x7ff034007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.243+0000 7ff04c844640 1 -- 172.21.15.45:0/2418107670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034005740 con 0x7ff034006140 2023-07-09T02:13:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04c844640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0340069e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff038009ab0 tx=0x7ff03801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7f0d576a910512 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380a64e0 con 0x7ff034006140 2023-07-09T02:13:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0380a6640 con 0x7ff034006140 2023-07-09T02:13:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff03ffff640 1 -- 172.21.15.45:0/2418107670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380a69f0 con 0x7ff034006140 2023-07-09T02:13:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04f2a9640 1 -- 172.21.15.45:0/2418107670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 msgr2=0x7ff0340069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04f2a9640 1 --2- 172.21.15.45:0/2418107670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0340069e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff038009ab0 tx=0x7ff03801ca00 comp rx=0 tx=0).stop 2023-07-09T02:13:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04d846640 1 -- 172.21.15.45:0/2418107670 reap_dead start 2023-07-09T02:13:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04f2a9640 1 -- 172.21.15.45:0/2418107670 shutdown_connections 2023-07-09T02:13:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04f2a9640 1 -- 172.21.15.45:0/2418107670 >> 172.21.15.45:0/2418107670 conn(0x7ff0480694b0 msgr2=0x7ff0480698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04f2a9640 1 -- 172.21.15.45:0/2418107670 shutdown_connections 2023-07-09T02:13:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04f2a9640 1 -- 172.21.15.45:0/2418107670 wait complete. 2023-07-09T02:13:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04f2a9640 1 Processor -- start 2023-07-09T02:13:07.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.247+0000 7ff04f2a9640 1 -- start start 2023-07-09T02:13:07.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0481576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0480c7340 0x7ff0481450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0481551c0 0x7ff048155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff048155b50 con 0x7ff034006140 2023-07-09T02:13:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480c7ae0 con 0x7ff0481551c0 2023-07-09T02:13:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480c7dc0 con 0x7ff0480c7340 2023-07-09T02:13:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0481576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0481576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40518/0 (socket says 172.21.15.45:40518) 2023-07-09T02:13:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 -- 172.21.15.45:0/3776460054 learned_addr learned my addr 172.21.15.45:0/3776460054 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 -- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0480c7340 msgr2=0x7ff0481450d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T02:13:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0480c7340 0x7ff0481450d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 -- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0481551c0 msgr2=0x7ff048155610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T02:13:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0481551c0 0x7ff048155610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 -- 172.21.15.45:0/3776460054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480c80a0 con 0x7ff034006140 2023-07-09T02:13:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04d045640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0481576c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff04400e550 tx=0x7ff04400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff03dffb640 1 -- 172.21.15.45:0/3776460054 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440052e0 con 0x7ff034006140 2023-07-09T02:13:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff03dffb640 1 -- 172.21.15.45:0/3776460054 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044005440 con 0x7ff034006140 2023-07-09T02:13:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0480c8380 con 0x7ff034006140 2023-07-09T02:13:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff03dffb640 1 -- 172.21.15.45:0/3776460054 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044003820 con 0x7ff034006140 2023-07-09T02:13:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0480c77b0 con 0x7ff034006140 2023-07-09T02:13:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.251+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04804d7d0 con 0x7ff034006140 2023-07-09T02:13:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.255+0000 7ff03dffb640 1 -- 172.21.15.45:0/3776460054 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff044003980 con 0x7ff034006140 2023-07-09T02:13:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.255+0000 7ff03dffb640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff02c0662b0 0x7ff02c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.255+0000 7ff03dffb640 1 -- 172.21.15.45:0/3776460054 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff044083aa0 con 0x7ff034006140 2023-07-09T02:13:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.255+0000 7ff04c844640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff02c0662b0 0x7ff02c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.255+0000 7ff03dffb640 1 -- 172.21.15.45:0/3776460054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7ff02c06e4b0 con 0x7ff034006140 2023-07-09T02:13:07.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.255+0000 7ff04c844640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff02c0662b0 0x7ff02c068760 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0380af000 tx=0x7ff0380046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.259+0000 7ff03dffb640 1 -- 172.21.15.45:0/3776460054 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff044050f70 con 0x7ff034006140 2023-07-09T02:13:07.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.411+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff0480ccb30 con 0x7ff034006140 2023-07-09T02:13:07.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff03dffb640 1 -- 172.21.15.45:0/3776460054 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+37513 (secure 0 0 0) 0x7ff044054590 con 0x7ff034006140 2023-07-09T02:13:07.418 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:07.418 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:07.419 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 53, 2023-07-09T02:13:07.419 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:13:07.419 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:13:07.419 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:13:06.364315+0000", 2023-07-09T02:13:07.419 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:13:07.419 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:13:07.419 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:13:07.420 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:13:07.420 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:13:07.420 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:13:07.420 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:13:07.420 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:13:07.420 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:13:07.421 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:07.421 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:13:07.421 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:13:07.421 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:13:07.422 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:13:07.422 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:13:07.422 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 8, 2023-07-09T02:13:07.422 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:13:07.422 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:13:07.422 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "luminous", 2023-07-09T02:13:07.422 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:13:07.423 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:13:07.423 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:13:07.423 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.423 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:13:07.423 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:13:07.423 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:13:07.423 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:07.424 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:07.424 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:07.424 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:07.424 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:07.424 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:07.424 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:07.425 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:07.425 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:07.425 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:07.425 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:07.425 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:07.425 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:13:07.426 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:13:07.426 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:13:07.426 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:13:07.426 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:13:07.426 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:07.427 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:07.427 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:07.427 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:07.427 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:07.427 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:07.427 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:07.427 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:07.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:07.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:07.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:07.428 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:07.429 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:07.429 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:07.429 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:07.429 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:07.429 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:07.430 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:07.430 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:07.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:07.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:07.430 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:07.430 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:07.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:07.431 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:07.431 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:07.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:07.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:07.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:07.432 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:07.432 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:07.432 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:07.433 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:07.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:07.433 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.434 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:07.434 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:07.434 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:07.435 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:07.435 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:07.435 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:07.435 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:07.435 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:07.436 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:07.436 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:07.436 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:07.436 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:07.437 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:13:07.437 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:13:07.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.438 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:07.438 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:13:07.438 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.438 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:07.439 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:13:07.439 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:13:07.440 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:13:07.440 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:13:07.440 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:13:07.441 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:07.441 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:07.441 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:07.441 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.442 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:13:07.443 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:13:07.443 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:13:07.443 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:07.443 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:07.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:07.443 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:07.444 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:13:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:13:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:13:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:13:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:13:07.445 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:07.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:07.447 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:07.448 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:07.449 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:07.450 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:07.451 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:07.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.451 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:07.451 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:07.451 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:07.451 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:07.451 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:07.452 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:07.452 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:07.452 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:07.452 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:07.452 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:07.452 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:07.452 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:13:07.453 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:07.453 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:13:07.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.453 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:07.453 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:13:07.453 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:13:07.453 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:13:07.454 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:07.454 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:07.454 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:07.454 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:07.454 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:07.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.455 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.455 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 7, 2023-07-09T02:13:07.455 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:13:07.455 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:45.075187+0000", 2023-07-09T02:13:07.455 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:07.455 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:07.455 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:07.456 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:07.456 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:07.456 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:07.456 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:07.456 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:07.456 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:07.456 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:13:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:13:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:13:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:13:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:13:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:07.461 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:07.461 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:07.461 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:07.461 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:07.461 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:07.461 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:07.461 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:07.462 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:07.462 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:07.462 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:07.462 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:07.462 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:07.462 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:07.462 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:07.463 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:07.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.463 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:07.463 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:07.463 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:07.463 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:07.463 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:07.464 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:07.464 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:07.464 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:07.464 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:07.465 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:07.465 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:07.465 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:07.465 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:13:07.466 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:13:07.466 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:13:07.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.467 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:07.467 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:07.467 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:13:07.467 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.468 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:07.468 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:13:07.469 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:13:07.469 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:07.469 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:07.470 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:07.470 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:07.470 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:07.471 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:07.471 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.472 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.472 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-07-09T02:13:07.472 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:13:07.472 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:46.325197+0000", 2023-07-09T02:13:07.473 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:07.473 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:07.473 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:07.473 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:07.474 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:07.474 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:07.474 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:07.474 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:07.475 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:07.475 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:07.475 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:07.476 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:07.476 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:13:07.476 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:13:07.476 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:13:07.476 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:13:07.477 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:13:07.477 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:07.477 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:07.477 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:07.477 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:07.477 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:07.477 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:07.478 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:07.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.478 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:07.478 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:07.478 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:07.478 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:07.478 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:07.479 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:07.479 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:07.479 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:07.479 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:07.479 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:07.479 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:07.479 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:07.480 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:07.480 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:07.480 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:07.480 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:07.480 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:07.481 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:07.481 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:07.481 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:07.481 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:07.481 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:07.481 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:07.481 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:07.482 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:07.482 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:07.482 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:07.483 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.483 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:07.483 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:07.483 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:07.484 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:07.484 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:07.484 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:07.484 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:07.484 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:07.484 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:07.485 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:07.485 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:07.485 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:07.485 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:13:07.485 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:13:07.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.485 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:07.486 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:07.486 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:13:07.486 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.486 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.486 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:07.486 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.8799999952316284, 2023-07-09T02:13:07.487 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.8799999952316284, 2023-07-09T02:13:07.487 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:07.487 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.8799999952316284, 2023-07-09T02:13:07.487 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.8799999952316284, 2023-07-09T02:13:07.487 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:07.487 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:07.487 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:07.488 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.488 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.488 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:07.488 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:13:07.488 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.488 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:07.489 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:07.489 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:07.489 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:07.489 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:07.489 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:07.489 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:07.490 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:13:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.491 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:13:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:07.492 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:13:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:07.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:13:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.495 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:13:07.496 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:07.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.496 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.496 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.496 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:13:07.496 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:07.496 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.497 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.497 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:07.497 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.497 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.497 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:13:07.498 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:07.498 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.498 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.498 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.498 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:13:07.498 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:07.498 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.499 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.499 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.499 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:13:07.499 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:13:07.499 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:13:07.499 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:13:07.499 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:07.500 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:07.500 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:07.500 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:07.500 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.500 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.500 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:07.501 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:07.501 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:07.501 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:07.501 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:07.501 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:07.501 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:07.501 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:07.502 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:07.502 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:07.502 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:07.502 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:07.502 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:07.502 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.503 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.503 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:13:07.503 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:07.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.503 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.503 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.503 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:13:07.504 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:07.504 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.504 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.504 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.505 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:07.505 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.505 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.505 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.505 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:13:07.505 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:07.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.506 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.506 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:13:07.506 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:07.506 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.506 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.507 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:07.507 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.507 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.507 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.508 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:13:07.508 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:07.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.508 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.508 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.508 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:13:07.509 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:07.509 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.509 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.509 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:07.509 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.509 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.510 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.510 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:13:07.510 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:07.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.510 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.510 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.510 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:13:07.510 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:07.511 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.511 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.511 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:13:07.511 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:13:07.511 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:13:07.511 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:13:07.512 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:07.512 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:07.512 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:07.512 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.512 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.513 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:07.513 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:07.513 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:07.513 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:07.513 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:07.513 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:07.514 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:07.514 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:07.514 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:07.514 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:07.514 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:07.514 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:07.515 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:07.515 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.515 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.515 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.515 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:13:07.515 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:07.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.516 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.516 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.516 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:13:07.516 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:07.516 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.516 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.517 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:07.517 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.517 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.517 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:13:07.517 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:07.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.518 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.518 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.518 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:13:07.518 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:07.518 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.519 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.519 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:07.519 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.519 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.519 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.519 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:13:07.519 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:07.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.520 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.520 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.520 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:13:07.520 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:07.520 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.521 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.521 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:07.521 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.521 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.521 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.522 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:13:07.522 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:07.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.522 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.522 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.522 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:13:07.522 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:07.523 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.523 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.523 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.523 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:13:07.523 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:13:07.523 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:13:07.523 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:13:07.523 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:07.524 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:07.524 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:07.524 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:07.524 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.524 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.524 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.524 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:07.525 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:07.525 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:07.525 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:07.525 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:07.525 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:07.525 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:07.525 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:07.526 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:07.526 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 52, 2023-07-09T02:13:07.526 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:07.526 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:07.526 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:07.526 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.526 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.527 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.527 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:13:07.527 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:07.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.527 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.527 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.527 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:13:07.528 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:07.528 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.528 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.528 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.528 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:07.528 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.528 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.529 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.529 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:13:07.529 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:07.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.529 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.529 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.529 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:13:07.530 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:07.530 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.530 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.530 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.530 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:07.530 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.530 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.531 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.531 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:13:07.531 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:07.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.531 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.531 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.531 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:13:07.531 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:07.532 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.532 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.532 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.532 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:07.532 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.532 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.533 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.533 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:13:07.533 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:07.533 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.533 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.533 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.533 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:13:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:13:07.534 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:13:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:13:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:13:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:07.535 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:07.536 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:07.537 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.538 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:13:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:13:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:07.539 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.540 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.540 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:07.540 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.540 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.540 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:13:07.541 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:07.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.541 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.541 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.541 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:13:07.541 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:07.541 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.542 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.542 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:07.542 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.542 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.542 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:13:07.543 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:07.543 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.543 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.543 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.543 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:13:07.543 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:07.543 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.544 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.544 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:07.544 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.544 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.544 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.544 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:13:07.545 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:07.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.545 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.545 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.545 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:13:07.545 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:07.545 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.546 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.546 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:13:07.546 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:13:07.546 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:13:07.546 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:13:07.546 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:07.546 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:07.547 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:07.547 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.547 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.547 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:07.547 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:07.547 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:07.549 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:07.549 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:07.549 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:07.549 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.549 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.549 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.549 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:13:07.550 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:07.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.550 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.550 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:13:07.550 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:07.550 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.551 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.551 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:07.551 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.551 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.551 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.551 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:13:07.551 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:07.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.552 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.552 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.552 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:13:07.552 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:07.552 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.552 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.553 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.553 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:07.553 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.553 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.553 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.553 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:13:07.553 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:07.554 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.554 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.554 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.554 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:13:07.554 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:07.554 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.554 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.555 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:07.555 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.555 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.555 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.555 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:13:07.555 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:07.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.556 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.556 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.556 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:13:07.556 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:07.556 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.556 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.557 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:13:07.557 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:13:07.557 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:13:07.557 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:13:07.557 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:07.557 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:07.557 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:07.558 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:07.558 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.558 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.558 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.558 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:07.558 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:07.558 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:07.559 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:07.559 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:07.559 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:07.559 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:07.559 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:07.559 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:07.559 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:07.560 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:07.560 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:07.560 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:07.560 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.560 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.560 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.560 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:13:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:13:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:07.561 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.562 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:13:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:13:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.563 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.564 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:13:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:13:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.565 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:13:07.566 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:13:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.567 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.568 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.568 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:13:07.568 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:13:07.568 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:13:07.568 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:13:07.568 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:07.568 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:07.569 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:07.569 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.569 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.569 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.569 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:07.569 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:07.569 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:07.570 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:07.570 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:07.570 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:07.570 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:07.570 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:07.570 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:07.570 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:07.570 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:07.571 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:07.571 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:07.571 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.571 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.571 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.571 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:13:07.571 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:07.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.572 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.572 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.572 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:13:07.572 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:07.572 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.573 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.573 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.573 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:07.573 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.573 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.573 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.573 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:13:07.574 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:07.574 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.574 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.574 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.574 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:13:07.574 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:07.574 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.574 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.575 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.575 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:07.575 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.575 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.575 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.575 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:13:07.575 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:07.576 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.576 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.576 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.576 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:13:07.576 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:07.576 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.576 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.577 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.577 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:07.577 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:07.577 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.577 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:07.578 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:13:07.578 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:07.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.578 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.578 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:07.578 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:13:07.578 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:07.579 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.579 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.579 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.579 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:13:07.579 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:13:07.579 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:13:07.579 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:13:07.579 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:07.580 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:07.580 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:07.580 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:07.580 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.580 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.580 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:07.580 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:13:07.581 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.581 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:07.581 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:07.581 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:07.581 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:07.581 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:07.582 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:07.582 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:13:07.582 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:07.582 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.582 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.582 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:07.582 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:07.583 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:07.583 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:07.583 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:07.583 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:07.583 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:13:07.583 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:07.583 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.584 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.584 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:07.584 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:07.584 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:07.584 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:07.584 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:07.584 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:07.585 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:13:07.585 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:07.585 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.585 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.585 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:07.585 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:07.585 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:07.586 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:07.586 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:07.586 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:07.586 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:13:07.587 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:07.587 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.587 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.587 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:07.588 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:07.588 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:07.588 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:07.589 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:07.589 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:07.589 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:13:07.590 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:07.590 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.590 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.590 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:07.591 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:07.591 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:07.591 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:07.591 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:07.592 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:07.592 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:13:07.592 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:07.593 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.593 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.593 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:07.593 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:07.593 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:07.593 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:07.594 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:07.594 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:07.594 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:13:07.594 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:07.594 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.594 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.594 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:07.595 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:07.595 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:07.595 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:07.595 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:07.595 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:07.595 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:13:07.595 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:07.596 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.596 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:07.596 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:13:07.596 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [ 2023-07-09T02:13:07.596 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.596 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.2a", 2023-07-09T02:13:07.597 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:07.597 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.597 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:07.597 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:07.597 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.597 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.597 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.598 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.598 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.37", 2023-07-09T02:13:07.598 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:07.598 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:07.598 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:07.598 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:07.598 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.598 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:07.599 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.599 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:07.599 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:13:07.599 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:13:07.599 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:13:07.599 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:13:07.599 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:13:07.600 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:13:07.600 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:13:07.600 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:13:07.600 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:13:07.600 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:13:07.600 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:13:07.601 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:13:07.601 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.601 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:07.601 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:13:07.601 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:13:07.601 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:13:07.601 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:13:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:13:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:13:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:13:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:13:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:13:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:13:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:13:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:07.603 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:07.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff02c0662b0 msgr2=0x7ff02c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff02c0662b0 0x7ff02c068760 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0380af000 tx=0x7ff0380046d0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 msgr2=0x7ff0481576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0481576c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff04400e550 tx=0x7ff04400ea10 comp rx=0 tx=0).stop 2023-07-09T02:13:07.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 shutdown_connections 2023-07-09T02:13:07.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0481551c0 0x7ff048155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff02c0662b0 0x7ff02c068760 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0480c7340 0x7ff0481450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 --2- 172.21.15.45:0/3776460054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff034006140 0x7ff0481576c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 >> 172.21.15.45:0/3776460054 conn(0x7ff0480694b0 msgr2=0x7ff0480c3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:07.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 shutdown_connections 2023-07-09T02:13:07.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.415+0000 7ff04f2a9640 1 -- 172.21.15.45:0/3776460054 wait complete. 2023-07-09T02:13:07.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:07.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0bd634640 1 Processor -- start 2023-07-09T02:13:07.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0bd634640 1 -- start start 2023-07-09T02:13:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0bd634640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0b80d2620 0x7ff0b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0bd634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80cd120 0x7ff0b80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0bd634640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b8160a50 con 0x7ff0b815c060 2023-07-09T02:13:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0bd634640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b815c430 con 0x7ff0b80d2620 2023-07-09T02:13:07.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0bd634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b815fb60 con 0x7ff0b80cd120 2023-07-09T02:13:07.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0affff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0b80d2620 0x7ff0b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80cd120 0x7ff0b80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0affff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0b80d2620 0x7ff0b80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:54070/0 (socket says 172.21.15.45:54070) 2023-07-09T02:13:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0b6ffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff0b815c060 0x7ff0b80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:51620/0 (socket says 172.21.15.45:51620) 2023-07-09T02:13:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0affff640 1 -- 172.21.15.45:0/3003437457 learned_addr learned my addr 172.21.15.45:0/3003437457 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.747+0000 7ff0b77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80cd120 0x7ff0b80cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:58498/0 (socket says 172.21.15.45:58498) 2023-07-09T02:13:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0affff640 1 -- 172.21.15.45:0/3003437457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80cd120 msgr2=0x7ff0b80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0affff640 1 --2- 172.21.15.45:0/3003437457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80cd120 0x7ff0b80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0affff640 1 -- 172.21.15.45:0/3003437457 >> v1:172.21.15.155:6789/0 conn(0x7ff0b815c060 legacy=0x7ff0b80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0affff640 1 -- 172.21.15.45:0/3003437457 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b815fe40 con 0x7ff0b80d2620 2023-07-09T02:13:07.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0b77fe640 1 --2- 172.21.15.45:0/3003437457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80cd120 0x7ff0b80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:07.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0b67fc640 1 -- 172.21.15.45:0/3003437457 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128662742 0 0) 0x7ff0b8160a50 con 0x7ff0b815c060 2023-07-09T02:13:07.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0affff640 1 --2- 172.21.15.45:0/3003437457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b80d2620 0x7ff0b80b4ed0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009870 tx=0x7ff0a001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2382c4612e4b0ec3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:07.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0b67fc640 1 -- 172.21.15.45:0/3003437457 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00aa670 con 0x7ff0b80d2620 2023-07-09T02:13:07.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0b67fc640 1 -- 172.21.15.45:0/3003437457 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a00aa7d0 con 0x7ff0b80d2620 2023-07-09T02:13:07.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.751+0000 7ff0b67fc640 1 -- 172.21.15.45:0/3003437457 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00aab60 con 0x7ff0b80d2620 2023-07-09T02:13:07.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- 172.21.15.45:0/3003437457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b80d2620 msgr2=0x7ff0b80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 --2- 172.21.15.45:0/3003437457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b80d2620 0x7ff0b80b4ed0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009870 tx=0x7ff0a001c510 comp rx=0 tx=0).stop 2023-07-09T02:13:07.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- 172.21.15.45:0/3003437457 shutdown_connections 2023-07-09T02:13:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 --2- 172.21.15.45:0/3003437457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80cd120 0x7ff0b80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 --2- 172.21.15.45:0/3003437457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b80d2620 0x7ff0b80b4ed0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- 172.21.15.45:0/3003437457 >> 172.21.15.45:0/3003437457 conn(0x7ff0b80698e0 msgr2=0x7ff0b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- 172.21.15.45:0/3003437457 shutdown_connections 2023-07-09T02:13:07.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- 172.21.15.45:0/3003437457 wait complete. 2023-07-09T02:13:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 Processor -- start 2023-07-09T02:13:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- start start 2023-07-09T02:13:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b80cd120 0x7ff0b80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80d2620 0x7ff0b80b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b815c060 0x7ff0b80c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b815c600 con 0x7ff0b80cd120 2023-07-09T02:13:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b815c8e0 con 0x7ff0b815c060 2023-07-09T02:13:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0bd634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80cc210 con 0x7ff0b80d2620 2023-07-09T02:13:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b80cd120 0x7ff0b80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b80cd120 0x7ff0b80cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40530/0 (socket says 172.21.15.45:40530) 2023-07-09T02:13:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b6ffd640 1 -- 172.21.15.45:0/1740839901 learned_addr learned my addr 172.21.15.45:0/1740839901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0affff640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80d2620 0x7ff0b80b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b77fe640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b815c060 0x7ff0b80c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b6ffd640 1 -- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80d2620 msgr2=0x7ff0b80b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b6ffd640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80d2620 0x7ff0b80b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b6ffd640 1 -- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b815c060 msgr2=0x7ff0b80c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b6ffd640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b815c060 0x7ff0b80c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b6ffd640 1 -- 172.21.15.45:0/1740839901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0009a70 con 0x7ff0b80cd120 2023-07-09T02:13:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0affff640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80d2620 0x7ff0b80b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.755+0000 7ff0b77fe640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b815c060 0x7ff0b80c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0b6ffd640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b80cd120 0x7ff0b80cbc30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80011f0 tx=0x7ff0a800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0af7fe640 1 -- 172.21.15.45:0/1740839901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a80074e0 con 0x7ff0b80cd120 2023-07-09T02:13:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0af7fe640 1 -- 172.21.15.45:0/1740839901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a8007640 con 0x7ff0b80cd120 2023-07-09T02:13:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a00094d0 con 0x7ff0b80cd120 2023-07-09T02:13:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0af7fe640 1 -- 172.21.15.45:0/1740839901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8004a10 con 0x7ff0b80cd120 2023-07-09T02:13:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b80b59f0 con 0x7ff0b80cd120 2023-07-09T02:13:07.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b804d7d0 con 0x7ff0b80cd120 2023-07-09T02:13:07.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0af7fe640 1 -- 172.21.15.45:0/1740839901 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0a8004b70 con 0x7ff0b80cd120 2023-07-09T02:13:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0af7fe640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff098066280 0x7ff098068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0af7fe640 1 -- 172.21.15.45:0/1740839901 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff0a80832e0 con 0x7ff0b80cd120 2023-07-09T02:13:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0af7fe640 1 -- 172.21.15.45:0/1740839901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7ff09806e480 con 0x7ff0b80cd120 2023-07-09T02:13:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.759+0000 7ff0affff640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff098066280 0x7ff098068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:07.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.763+0000 7ff0affff640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff098066280 0x7ff098068730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00ae000 tx=0x7ff0a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:07.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.763+0000 7ff0af7fe640 1 -- 172.21.15.45:0/1740839901 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0a8050710 con 0x7ff0b80cd120 2023-07-09T02:13:07.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.951+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0b80b1840 con 0x7ff0b80cd120 2023-07-09T02:13:07.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0af7fe640 1 -- 172.21.15.45:0/1740839901 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7ff0a8018070 con 0x7ff0b80cd120 2023-07-09T02:13:07.958 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:07.958 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:13:07.960 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:13:07.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff098066280 msgr2=0x7ff098068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff098066280 0x7ff098068730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00ae000 tx=0x7ff0a0008040 comp rx=0 tx=0).stop 2023-07-09T02:13:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b80cd120 msgr2=0x7ff0b80cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b80cd120 0x7ff0b80cbc30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80011f0 tx=0x7ff0a800c9b0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 shutdown_connections 2023-07-09T02:13:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b815c060 0x7ff0b80c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff098066280 0x7ff098068730 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b80d2620 0x7ff0b80b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 --2- 172.21.15.45:0/1740839901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0b80cd120 0x7ff0b80cbc30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:07.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 >> 172.21.15.45:0/1740839901 conn(0x7ff0b80698e0 msgr2=0x7ff0b8069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:07.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 shutdown_connections 2023-07-09T02:13:07.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:07.955+0000 7ff0bd634640 1 -- 172.21.15.45:0/1740839901 wait complete. 2023-07-09T02:13:07.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-07-09T02:13:08.140 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":5628,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.198023514999999,"mdsmap_epoch":25,"osdmap_epoch":53,"osdmap_epoch_barrier":53,"uptime":25.959295439000002} 2023-07-09T02:13:08.141 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 5628, "mdsmap_epoch": 25, "osdmap_epoch": 53, "osdmap_epoch_barrier": 53, "rank_uptime": 20.198023515, "state": "up:active", "uptime": 25.959295439, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:13:08.141 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:13:08.142 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:08.142 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:08.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:08.153 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-07-09T02:13:08.208 INFO:teuthology.orchestra.run.smithi045.stderr:dd: failed to open 'small_file_1': Permission denied 2023-07-09T02:13:08.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:13:08.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:08.210 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-07-09T02:13:08.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:08.263 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-07-09T02:13:08.317 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:13:08.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.499+0000 7f97dff82640 1 Processor -- start 2023-07-09T02:13:08.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.499+0000 7f97dff82640 1 -- start start 2023-07-09T02:13:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.499+0000 7f97dff82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d815c060 0x7f97d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.499+0000 7f97dff82640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f97d80cd120 0x7f97d80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.499+0000 7f97dff82640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d8160a50 con 0x7f97d80d2450 2023-07-09T02:13:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.499+0000 7f97dff82640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d80d28f0 con 0x7f97d80cd120 2023-07-09T02:13:08.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.499+0000 7f97dff82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80cfe40 con 0x7f97d815c060 2023-07-09T02:13:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97de51f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f97d80d2450 0x7f97d80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49132/0 (socket says 172.21.15.45:49132) 2023-07-09T02:13:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97de51f640 1 -- 172.21.15.45:0/2158170632 learned_addr learned my addr 172.21.15.45:0/2158170632 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97ddd1e640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d815c060 0x7f97d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dd51d640 1 --2- 172.21.15.45:0/2158170632 >> v2:172.21.15.155:3300/0 conn(0x7f97d80cd120 0x7f97d80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766505932 0 0) 0x7f97d8160a50 con 0x7f97d80d2450 2023-07-09T02:13:08.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c4003530 con 0x7f97d80d2450 2023-07-09T02:13:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1774615568 0 0) 0x7f97c4003530 con 0x7f97d80d2450 2023-07-09T02:13:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d815c060 msgr2=0x7f97d80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d815c060 0x7f97d80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 >> v2:172.21.15.155:3300/0 conn(0x7f97d80cd120 msgr2=0x7f97d80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 --2- 172.21.15.45:0/2158170632 >> v2:172.21.15.155:3300/0 conn(0x7f97d80cd120 0x7f97d80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d815c430 con 0x7f97d80d2450 2023-07-09T02:13:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f97d0001a00 con 0x7f97d80d2450 2023-07-09T02:13:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 >> v1:172.21.15.45:6789/0 conn(0x7f97d80d2450 legacy=0x7f97d80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97c4003980 0x7f97c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97c40043b0 0x7f97c4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d815c060 0x7f97c4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80cfe40 con 0x7f97c40043b0 2023-07-09T02:13:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c4005680 con 0x7f97c4003980 2023-07-09T02:13:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c400ba10 con 0x7f97d815c060 2023-07-09T02:13:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dd51d640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97c40043b0 0x7f97c4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97ddd1e640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97c4003980 0x7f97c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97de51f640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d815c060 0x7f97c4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dd51d640 1 -- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d815c060 msgr2=0x7f97c4004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dd51d640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d815c060 0x7f97c4004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dd51d640 1 -- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97c4003980 msgr2=0x7f97c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:08.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dd51d640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97c4003980 0x7f97c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97dd51d640 1 -- 172.21.15.45:0/2158170632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c4003530 con 0x7f97c40043b0 2023-07-09T02:13:08.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.503+0000 7f97ddd1e640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97c4003980 0x7f97c4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dd51d640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97c40043b0 0x7f97c4004870 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009ab0 tx=0x7f97c801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb634ad5fa1b962 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80a5550 con 0x7f97c40043b0 2023-07-09T02:13:08.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c80a56b0 con 0x7f97c40043b0 2023-07-09T02:13:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dcd1c640 1 -- 172.21.15.45:0/2158170632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80a5a20 con 0x7f97c40043b0 2023-07-09T02:13:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dff82640 1 -- 172.21.15.45:0/2158170632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97c40043b0 msgr2=0x7f97c4004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dff82640 1 --2- 172.21.15.45:0/2158170632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97c40043b0 0x7f97c4004870 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009ab0 tx=0x7f97c801ca70 comp rx=0 tx=0).stop 2023-07-09T02:13:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97de51f640 1 -- 172.21.15.45:0/2158170632 reap_dead start 2023-07-09T02:13:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dff82640 1 -- 172.21.15.45:0/2158170632 shutdown_connections 2023-07-09T02:13:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dff82640 1 -- 172.21.15.45:0/2158170632 >> 172.21.15.45:0/2158170632 conn(0x7f97d80698e0 msgr2=0x7f97d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:08.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dff82640 1 -- 172.21.15.45:0/2158170632 shutdown_connections 2023-07-09T02:13:08.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dff82640 1 -- 172.21.15.45:0/2158170632 wait complete. 2023-07-09T02:13:08.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dff82640 1 Processor -- start 2023-07-09T02:13:08.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.507+0000 7f97dff82640 1 -- start start 2023-07-09T02:13:08.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97c40043b0 0x7f97d814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d80c9b10 0x7f97d80cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d80c9f80 0x7f97d80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80ca480 con 0x7f97d80c9f80 2023-07-09T02:13:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80ca760 con 0x7f97d80c9b10 2023-07-09T02:13:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d80caa40 con 0x7f97c40043b0 2023-07-09T02:13:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97de51f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d80c9f80 0x7f97d80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97ddd1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97c40043b0 0x7f97d814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dd51d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d80c9b10 0x7f97d80cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97ddd1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97c40043b0 0x7f97d814ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:58518/0 (socket says 172.21.15.45:58518) 2023-07-09T02:13:08.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97ddd1e640 1 -- 172.21.15.45:0/3124548408 learned_addr learned my addr 172.21.15.45:0/3124548408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:08.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97de51f640 1 -- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97c40043b0 msgr2=0x7f97d814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:08.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97de51f640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97c40043b0 0x7f97d814ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97de51f640 1 -- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d80c9b10 msgr2=0x7f97d80cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:08.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97de51f640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d80c9b10 0x7f97d80cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97de51f640 1 -- 172.21.15.45:0/3124548408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80cad20 con 0x7f97d80c9f80 2023-07-09T02:13:08.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97de51f640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d80c9f80 0x7f97d80cbea0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f97c400bba0 tx=0x7f97d0007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:08.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97ce7fc640 1 -- 172.21.15.45:0/3124548408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0015610 con 0x7f97d80c9f80 2023-07-09T02:13:08.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97ce7fc640 1 -- 172.21.15.45:0/3124548408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d0015790 con 0x7f97d80c9f80 2023-07-09T02:13:08.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97ce7fc640 1 -- 172.21.15.45:0/3124548408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d0015b40 con 0x7f97d80c9f80 2023-07-09T02:13:08.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d80cb000 con 0x7f97d80c9f80 2023-07-09T02:13:08.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d814b320 con 0x7f97d80c9f80 2023-07-09T02:13:08.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d80cb1f0 con 0x7f97d80c9f80 2023-07-09T02:13:08.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.511+0000 7f97ce7fc640 1 -- 172.21.15.45:0/3124548408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97d0015ca0 con 0x7f97d80c9f80 2023-07-09T02:13:08.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.515+0000 7f97ce7fc640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97bc066280 0x7f97bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:08.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.515+0000 7f97ce7fc640 1 -- 172.21.15.45:0/3124548408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f97d00869b0 con 0x7f97d80c9f80 2023-07-09T02:13:08.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.515+0000 7f97ce7fc640 1 -- 172.21.15.45:0/3124548408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7f97bc06e480 con 0x7f97d80c9f80 2023-07-09T02:13:08.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.515+0000 7f97ddd1e640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97bc066280 0x7f97bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:08.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.515+0000 7f97ddd1e640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97bc066280 0x7f97bc068730 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009ba0 tx=0x7f97d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:08.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.519+0000 7f97ce7fc640 1 -- 172.21.15.45:0/3124548408 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97d0053de0 con 0x7f97d80c9f80 2023-07-09T02:13:08.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.675+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f97d804d7d0 con 0x7f97d80c9f80 2023-07-09T02:13:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.675+0000 7f97ce7fc640 1 -- 172.21.15.45:0/3124548408 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+37513 (secure 0 0 0) 0x7f97d0057400 con 0x7f97d80c9f80 2023-07-09T02:13:08.679 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:08.679 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:08.679 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 53, 2023-07-09T02:13:08.680 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:13:08.680 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:13:08.680 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:13:06.364315+0000", 2023-07-09T02:13:08.680 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:13:08.680 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:13:08.680 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:13:08.680 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:13:08.681 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:13:08.681 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:13:08.681 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:13:08.681 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:13:08.681 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:13:08.681 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:08.681 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:13:08.682 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:13:08.682 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:13:08.682 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:13:08.682 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:13:08.682 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 8, 2023-07-09T02:13:08.682 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:13:08.682 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:13:08.682 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "luminous", 2023-07-09T02:13:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:13:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:13:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:13:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:13:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:13:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:13:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:13:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:13:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:13:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:13:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:13:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:13:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:13:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:13:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:13:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:13:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:13:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:13:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:13:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:13:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:13:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:13:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:08.696 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:08.696 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:08.696 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:08.696 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:08.696 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:08.696 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:08.696 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:08.697 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:08.697 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:08.697 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:13:08.697 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:13:08.697 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:13:08.697 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:13:08.697 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:13:08.698 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:08.698 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:08.698 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:08.698 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:08.698 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:08.698 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:08.698 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:08.698 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.699 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:08.699 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:08.699 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:08.699 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:08.699 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:08.700 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:08.700 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:08.700 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:08.700 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:08.700 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:08.700 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:08.700 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:08.702 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:08.702 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:08.702 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:08.702 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:08.702 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:08.702 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:08.702 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:08.702 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.703 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:08.703 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:08.703 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:08.703 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:08.703 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:08.703 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:08.703 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:08.704 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:08.704 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:08.704 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:08.704 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:08.704 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:13:08.705 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:08.705 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:13:08.705 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.706 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:08.706 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:13:08.706 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:13:08.706 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:13:08.706 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:08.706 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:08.706 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:08.706 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:08.707 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:08.707 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.707 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.707 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.707 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 7, 2023-07-09T02:13:08.708 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:13:08.708 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:45.075187+0000", 2023-07-09T02:13:08.708 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:08.708 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:08.708 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:08.708 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:08.709 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:08.709 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:08.709 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:08.709 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:08.709 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:08.709 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:08.709 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:08.710 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:08.710 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:13:08.710 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:13:08.710 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:13:08.710 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:13:08.710 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:13:08.710 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:08.710 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:08.711 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:08.711 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:08.711 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:08.711 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:08.711 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:08.711 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.711 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:08.711 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:08.712 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:08.712 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:08.712 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:08.712 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:08.712 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:08.712 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:08.712 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:08.713 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:08.713 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:08.713 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:08.713 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:08.713 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:08.713 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:08.713 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:08.714 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:08.714 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:08.714 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:08.714 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:08.714 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:08.714 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:08.714 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:08.715 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:08.715 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:08.715 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:08.715 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:08.715 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.715 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:08.716 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:08.716 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:08.716 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:08.716 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:08.716 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:08.716 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:08.716 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:08.717 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:08.717 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:08.717 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:08.717 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:08.717 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:13:08.717 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:13:08.717 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:13:08.717 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.718 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:08.718 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:08.718 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:13:08.718 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.718 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.718 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:08.719 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:13:08.719 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:13:08.719 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:08.720 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:08.720 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:08.720 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:08.721 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:08.721 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:08.721 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.721 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.722 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.722 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-07-09T02:13:08.722 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:13:08.723 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:46.325197+0000", 2023-07-09T02:13:08.723 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:08.723 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:08.724 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:08.724 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:08.724 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:08.725 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:08.725 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:08.725 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:08.725 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:08.726 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:08.726 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:08.726 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:08.726 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:13:08.726 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:13:08.726 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:13:08.727 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:13:08.727 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:13:08.727 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:08.727 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:08.727 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:08.727 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:08.728 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:08.728 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:08.728 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:08.728 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.728 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:08.728 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:08.729 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:08.729 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:08.729 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:08.729 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:08.729 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:08.729 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:08.729 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:08.729 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:08.731 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:08.732 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:08.733 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:13:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:13:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:08.734 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:13:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.8799999952316284, 2023-07-09T02:13:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.8799999952316284, 2023-07-09T02:13:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:08.735 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.8799999952316284, 2023-07-09T02:13:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.8799999952316284, 2023-07-09T02:13:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.736 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:13:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:08.737 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:08.738 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:08.739 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.739 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.739 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.739 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:13:08.739 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:08.739 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.739 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.739 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.740 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:13:08.740 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:08.740 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.740 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.740 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.740 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:08.741 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.741 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.741 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.741 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:13:08.741 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:08.741 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:13:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.742 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:08.743 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.743 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.743 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.743 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:13:08.743 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:08.743 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.743 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.744 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.744 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:13:08.744 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:08.744 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.744 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.744 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.744 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:08.745 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.745 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.745 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.745 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:13:08.745 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:08.745 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.746 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.746 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.746 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:13:08.746 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:08.746 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.746 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.746 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.746 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:13:08.747 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:13:08.747 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:13:08.747 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:13:08.747 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:08.747 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:08.747 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:08.747 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:08.747 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.748 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.748 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.748 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:08.748 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:08.748 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:08.748 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:08.748 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:08.749 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:08.749 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:08.749 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:08.749 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:08.749 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:08.749 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:08.749 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:08.749 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:08.750 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.750 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.750 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.750 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:13:08.750 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:08.750 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.750 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:13:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:08.751 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.752 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.752 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.752 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:13:08.752 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:08.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.752 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.752 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.753 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:13:08.753 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:08.753 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.753 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.753 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.753 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:08.753 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.753 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.754 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.754 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:13:08.754 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:08.754 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.754 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.754 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.754 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:13:08.754 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:08.755 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.755 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.755 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.755 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:08.755 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.755 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.755 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.755 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:13:08.756 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:08.756 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.756 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.756 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.756 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:13:08.756 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:08.756 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.757 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.757 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.757 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:13:08.757 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:13:08.757 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:13:08.757 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:13:08.757 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:08.757 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:08.758 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:08.758 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.758 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.758 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.758 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:08.758 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:08.759 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:08.759 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:08.759 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:08.759 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:08.759 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:08.759 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:08.759 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:08.759 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:08.760 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:08.760 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:08.760 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:08.760 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.760 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.760 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.760 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:13:08.760 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:08.761 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.761 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.761 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.761 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:13:08.761 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:08.761 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.761 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.762 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:08.762 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.762 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.762 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.762 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:13:08.762 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:08.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.763 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.763 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.763 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:13:08.763 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:08.763 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.763 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.763 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.763 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:08.764 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.764 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.764 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.764 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:13:08.764 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:08.764 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.764 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.765 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.765 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:13:08.765 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:08.765 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.765 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.765 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.765 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:08.766 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.766 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.766 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.766 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:13:08.766 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:08.766 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.766 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.766 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:13:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:13:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:13:08.767 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:13:08.768 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:13:08.768 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:08.768 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:08.768 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:08.768 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:08.768 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.769 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.769 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:08.769 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:08.769 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:08.769 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:08.769 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:08.769 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 52, 2023-07-09T02:13:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:08.770 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.771 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.771 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.771 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:13:08.771 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:08.771 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.771 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.771 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.771 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:13:08.772 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:08.772 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.772 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.772 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.772 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:08.772 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.772 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.773 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.773 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:13:08.773 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:08.773 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.773 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.773 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.773 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:13:08.773 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:08.774 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.774 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.774 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:08.774 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.774 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.774 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.774 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:13:08.775 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:08.775 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.775 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.775 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.775 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:13:08.775 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:08.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.775 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.776 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.776 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:08.776 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.776 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.776 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.776 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:13:08.776 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:13:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:13:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:13:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:13:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:13:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.780 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:08.780 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:08.780 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:08.780 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:08.781 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:08.781 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:08.781 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:08.781 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:08.782 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:08.782 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:08.782 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:08.782 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:08.783 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:08.783 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.783 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.784 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.784 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:13:08.784 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:08.784 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.785 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.785 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.785 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:13:08.785 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:08.786 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.786 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.786 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.786 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:08.786 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.786 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.786 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.787 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:13:08.787 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:08.787 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.787 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.787 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.787 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:13:08.787 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:08.787 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.788 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:13:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:13:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:13:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:13:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:13:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:13:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:13:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:13:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:08.800 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:08.800 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.800 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.800 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.801 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:13:08.801 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:08.801 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.802 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.802 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.802 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:13:08.802 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:08.802 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.802 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.802 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.803 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:08.803 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.803 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.803 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.803 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:13:08.803 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:08.803 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.804 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.804 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.804 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:13:08.804 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:08.804 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.804 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.804 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.805 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:08.805 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.805 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.805 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.805 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:13:08.805 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:08.806 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.806 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.806 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.806 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:13:08.806 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:08.807 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.807 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.807 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.807 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:08.807 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.807 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.807 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.807 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:13:08.808 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:08.808 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.808 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.808 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.808 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:13:08.808 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:08.808 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.809 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.809 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.809 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:13:08.809 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:13:08.809 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:13:08.809 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:13:08.809 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:08.809 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:08.810 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:08.810 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:08.810 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.810 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.810 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:08.810 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:08.811 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:08.811 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:08.811 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:08.811 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:08.811 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:08.811 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:08.811 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:08.811 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:08.812 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:08.812 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:08.812 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:08.812 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.812 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.812 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:13:08.813 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:08.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.813 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.813 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.813 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:13:08.813 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:08.813 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.813 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.814 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:08.814 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.814 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.815 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.815 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:13:08.815 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:08.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.816 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.816 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.816 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:13:08.816 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:08.817 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.817 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.817 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.817 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:08.817 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.818 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.818 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.818 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:13:08.818 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:08.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.818 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.818 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.818 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:13:08.819 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:08.819 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.819 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.819 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:08.819 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.819 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.820 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.820 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:13:08.820 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:08.820 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.820 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.820 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.820 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:13:08.820 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:08.821 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.821 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.821 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.821 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:13:08.821 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:13:08.821 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:13:08.821 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:13:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:08.822 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:08.823 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:08.823 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:08.823 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:08.823 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:08.823 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:08.823 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:08.823 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:08.823 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:08.824 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:08.824 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:08.824 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:08.824 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.824 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.825 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.825 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:13:08.825 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:08.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.825 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.825 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.825 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:13:08.826 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:08.826 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.826 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.826 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:08.826 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.826 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.827 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.827 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:13:08.827 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:08.827 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.827 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.827 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.827 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:13:08.827 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:13:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:13:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.830 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.830 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.830 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:08.830 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:08.830 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.830 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:08.830 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:13:08.830 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:08.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.831 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.831 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:08.831 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:13:08.831 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:08.831 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.831 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.832 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:13:08.832 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:13:08.832 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:13:08.832 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:13:08.832 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:08.832 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:08.833 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:08.833 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:08.833 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.833 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.833 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:08.833 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:13:08.833 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.833 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:08.834 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:08.834 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:08.834 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:08.834 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:08.834 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:08.834 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:13:08.834 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:08.835 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.835 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.835 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:08.835 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:08.835 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:08.835 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:08.835 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:08.835 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:08.836 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:13:08.836 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:08.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.836 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.836 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:08.836 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:08.836 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:08.837 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:08.837 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:08.837 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:08.837 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:13:08.837 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:08.837 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.837 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.837 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:08.838 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:08.838 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:08.838 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:08.838 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:08.838 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:08.838 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:13:08.838 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:08.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.839 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.839 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:08.839 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:08.839 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:08.839 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:08.839 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:08.839 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:08.839 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:13:08.840 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:08.840 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.840 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.840 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:08.840 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:08.841 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:08.841 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:08.841 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:08.841 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:08.841 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:13:08.841 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:08.841 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.841 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.842 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:08.842 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:08.842 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:08.842 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:08.842 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:08.842 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:08.842 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:13:08.842 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:08.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.843 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.843 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:08.843 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:08.843 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:08.843 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:08.843 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:08.843 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:13:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:13:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [ 2023-07-09T02:13:08.844 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.2a", 2023-07-09T02:13:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.845 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.37", 2023-07-09T02:13:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:08.846 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:13:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:13:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:13:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:13:08.847 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:13:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:13:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:13:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:13:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:13:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:13:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:13:08.848 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:13:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:13:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:13:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:13:08.849 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:13:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:13:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:13:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:13:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:13:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:13:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:13:08.850 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:13:08.851 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:08.851 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97bc066280 msgr2=0x7f97bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97bc066280 0x7f97bc068730 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009ba0 tx=0x7f97d4009190 comp rx=0 tx=0).stop 2023-07-09T02:13:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d80c9f80 msgr2=0x7f97d80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d80c9f80 0x7f97d80cbea0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f97c400bba0 tx=0x7f97d0007950 comp rx=0 tx=0).stop 2023-07-09T02:13:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 shutdown_connections 2023-07-09T02:13:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d80c9f80 0x7f97d80cbea0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d80c9b10 0x7f97d80cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97bc066280 0x7f97bc068730 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 --2- 172.21.15.45:0/3124548408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97c40043b0 0x7f97d814ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 >> 172.21.15.45:0/3124548408 conn(0x7f97d80698e0 msgr2=0x7f97d815f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 shutdown_connections 2023-07-09T02:13:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:08.679+0000 7f97dff82640 1 -- 172.21.15.45:0/3124548408 wait complete. 2023-07-09T02:13:08.855 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:13:09.301 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:13:09.299+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-07-09T02:13:11.383 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:13:11.383+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL) 2023-07-09T02:13:13.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:13:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.007+0000 7fb535c9c640 1 Processor -- start 2023-07-09T02:13:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.007+0000 7fb535c9c640 1 -- start start 2023-07-09T02:13:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb535c9c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb53015c060 0x7fb5300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb535c9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300cd120 0x7fb5300d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb535c9c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb530160a50 con 0x7fb5300d2450 2023-07-09T02:13:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb535c9c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5300d28f0 con 0x7fb53015c060 2023-07-09T02:13:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb535c9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300cfe40 con 0x7fb5300cd120 2023-07-09T02:13:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb5300d2450 0x7fb5300d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46524/0 (socket says 172.21.15.45:46524) 2023-07-09T02:13:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52ffff640 1 -- 172.21.15.45:0/1699404069 learned_addr learned my addr 172.21.15.45:0/1699404069 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:14.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52effd640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300cd120 0x7fb5300d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52f7fe640 1 --2- 172.21.15.45:0/1699404069 >> v2:172.21.15.155:3300/0 conn(0x7fb53015c060 0x7fb5300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977569940 0 0) 0x7fb530160a50 con 0x7fb5300d2450 2023-07-09T02:13:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb518003530 con 0x7fb5300d2450 2023-07-09T02:13:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186949913 0 0) 0x7fb518003530 con 0x7fb5300d2450 2023-07-09T02:13:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300cd120 msgr2=0x7fb5300d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300cd120 0x7fb5300d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 >> v2:172.21.15.155:3300/0 conn(0x7fb53015c060 msgr2=0x7fb5300b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 --2- 172.21.15.45:0/1699404069 >> v2:172.21.15.155:3300/0 conn(0x7fb53015c060 0x7fb5300b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53015c430 con 0x7fb5300d2450 2023-07-09T02:13:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fb528001a00 con 0x7fb5300d2450 2023-07-09T02:13:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 >> v1:172.21.15.45:6789/0 conn(0x7fb5300d2450 legacy=0x7fb5300d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518003980 0x7fb518003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180043b0 0x7fb518004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb518004e90 0x7fb51800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300cfe40 con 0x7fb518004e90 2023-07-09T02:13:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180056a0 con 0x7fb518003980 2023-07-09T02:13:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51800bf50 con 0x7fb5180043b0 2023-07-09T02:13:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52effd640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300cd120 0x7fb5300d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52f7fe640 1 --2- 172.21.15.45:0/1699404069 >> v2:172.21.15.155:3300/0 conn(0x7fb53015c060 0x7fb5300b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52ffff640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb518004e90 0x7fb51800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52f7fe640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518003980 0x7fb518003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52effd640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180043b0 0x7fb518004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52ffff640 1 -- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180043b0 msgr2=0x7fb518004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52ffff640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5180043b0 0x7fb518004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52ffff640 1 -- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518003980 msgr2=0x7fb518003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52ffff640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518003980 0x7fb518003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.011+0000 7fb52ffff640 1 -- 172.21.15.45:0/1699404069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518003530 con 0x7fb518004e90 2023-07-09T02:13:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb52ffff640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb518004e90 0x7fb51800b990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb52800a860 tx=0x7fb52801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc84203e5ab4c040 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280ad630 con 0x7fb518004e90 2023-07-09T02:13:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5280a8070 con 0x7fb518004e90 2023-07-09T02:13:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb52e7fc640 1 -- 172.21.15.45:0/1699404069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280ad9f0 con 0x7fb518004e90 2023-07-09T02:13:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb535c9c640 1 -- 172.21.15.45:0/1699404069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb518004e90 msgr2=0x7fb51800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb535c9c640 1 --2- 172.21.15.45:0/1699404069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb518004e90 0x7fb51800b990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb52800a860 tx=0x7fb52801d360 comp rx=0 tx=0).stop 2023-07-09T02:13:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb52ffff640 1 -- 172.21.15.45:0/1699404069 reap_dead start 2023-07-09T02:13:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb535c9c640 1 -- 172.21.15.45:0/1699404069 shutdown_connections 2023-07-09T02:13:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb535c9c640 1 -- 172.21.15.45:0/1699404069 >> 172.21.15.45:0/1699404069 conn(0x7fb5300698e0 msgr2=0x7fb530069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb535c9c640 1 -- 172.21.15.45:0/1699404069 shutdown_connections 2023-07-09T02:13:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb535c9c640 1 -- 172.21.15.45:0/1699404069 wait complete. 2023-07-09T02:13:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb535c9c640 1 Processor -- start 2023-07-09T02:13:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.015+0000 7fb535c9c640 1 -- start start 2023-07-09T02:13:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518004e90 0x7fb5300b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5300b18a0 0x7fb5301f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300a9400 0x7fb5300a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300a9db0 con 0x7fb5300b18a0 2023-07-09T02:13:14.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300b6e00 con 0x7fb518004e90 2023-07-09T02:13:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300b7040 con 0x7fb5300a9400 2023-07-09T02:13:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5300b18a0 0x7fb5301f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5300b18a0 0x7fb5301f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36214/0 (socket says 172.21.15.45:36214) 2023-07-09T02:13:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 -- 172.21.15.45:0/1351600615 learned_addr learned my addr 172.21.15.45:0/1351600615 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52ffff640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300a9400 0x7fb5300a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52f7fe640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518004e90 0x7fb5300b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 -- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300a9400 msgr2=0x7fb5300a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300a9400 0x7fb5300a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 -- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518004e90 msgr2=0x7fb5300b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518004e90 0x7fb5300b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 -- 172.21.15.45:0/1351600615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5300b7320 con 0x7fb5300b18a0 2023-07-09T02:13:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52ffff640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300a9400 0x7fb5300a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52f7fe640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518004e90 0x7fb5300b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb52effd640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5300b18a0 0x7fb5301f5410 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb524011600 tx=0x7fb5240116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb517fff640 1 -- 172.21.15.45:0/1351600615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524015870 con 0x7fb5300b18a0 2023-07-09T02:13:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb517fff640 1 -- 172.21.15.45:0/1351600615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5240159d0 con 0x7fb5300b18a0 2023-07-09T02:13:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5300b7600 con 0x7fb5300b18a0 2023-07-09T02:13:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb517fff640 1 -- 172.21.15.45:0/1351600615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524015d40 con 0x7fb5300b18a0 2023-07-09T02:13:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5300b7bc0 con 0x7fb5300b18a0 2023-07-09T02:13:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.019+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5300b7d80 con 0x7fb5300b18a0 2023-07-09T02:13:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.023+0000 7fb517fff640 1 -- 172.21.15.45:0/1351600615 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb52401e450 con 0x7fb5300b18a0 2023-07-09T02:13:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.023+0000 7fb517fff640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb51c066280 0x7fb51c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.023+0000 7fb517fff640 1 -- 172.21.15.45:0/1351600615 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb524083fb0 con 0x7fb5300b18a0 2023-07-09T02:13:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.023+0000 7fb517fff640 1 -- 172.21.15.45:0/1351600615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7fb51c06e480 con 0x7fb5300b18a0 2023-07-09T02:13:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.023+0000 7fb52f7fe640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb51c066280 0x7fb51c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:14.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.023+0000 7fb52f7fe640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb51c066280 0x7fb51c068730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb520009c30 tx=0x7fb520008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:14.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.027+0000 7fb517fff640 1 -- 172.21.15.45:0/1351600615 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb524023060 con 0x7fb5300b18a0 2023-07-09T02:13:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.183+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb53004d7d0 con 0x7fb5300b18a0 2023-07-09T02:13:14.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.183+0000 7fb517fff640 1 -- 172.21.15.45:0/1351600615 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+37465 (secure 0 0 0) 0x7fb524051350 con 0x7fb5300b18a0 2023-07-09T02:13:14.189 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:14.189 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:14.189 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 55, 2023-07-09T02:13:14.190 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:13:14.190 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:13:14.190 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:13:13.446364+0000", 2023-07-09T02:13:14.190 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:13:14.191 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:13:14.191 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:13:14.191 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:13:14.191 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:13:14.191 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:13:14.191 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:13:14.191 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:13:14.192 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:13:14.192 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:14.192 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:13:14.192 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:13:14.192 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:13:14.192 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:13:14.192 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:13:14.193 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 8, 2023-07-09T02:13:14.193 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:13:14.193 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:13:14.193 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "luminous", 2023-07-09T02:13:14.193 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:13:14.193 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:13:14.193 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:13:14.193 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.194 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:13:14.194 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:13:14.194 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:13:14.194 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:14.194 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:14.194 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:14.194 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:14.195 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:14.195 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:14.195 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:14.195 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:14.196 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:14.196 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:14.196 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:14.196 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:14.196 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:13:14.196 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:13:14.196 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:13:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:13:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:13:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:14.197 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:14.198 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:14.199 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:14.200 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:14.201 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:14.202 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:14.203 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.204 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:14.205 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:14.206 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:14.207 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:14.207 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:14.207 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:14.208 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:14.208 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:13:14.208 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:13:14.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.208 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:14.209 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:13:14.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.209 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:14.209 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:13:14.210 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:13:14.210 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:13:14.210 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:13:14.211 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:13:14.211 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:14.211 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:14.211 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:14.211 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.212 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.212 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:13:14.212 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:13:14.212 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:13:14.212 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:14.212 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:14.212 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:14.213 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:14.213 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:14.213 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:14.213 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:14.213 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:14.213 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:14.213 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:14.213 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:13:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:13:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:13:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:13:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:13:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:14.215 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:14.215 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:14.215 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:14.215 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:14.215 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:14.215 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.215 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:14.215 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:14.216 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:14.216 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:14.216 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:14.216 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:14.216 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:14.216 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:14.216 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:14.217 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:14.217 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:14.217 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:14.217 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:14.217 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:14.217 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:14.217 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:14.217 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:14.218 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:14.218 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:14.218 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:14.218 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:14.218 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:14.218 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:14.218 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:14.218 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:14.219 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:14.219 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:14.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.219 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:14.219 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:14.219 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:14.219 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:14.220 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:14.220 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:14.220 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:14.220 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:14.220 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:14.220 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:14.220 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:14.221 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:13:14.221 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:14.221 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:13:14.221 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.221 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:14.221 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:13:14.221 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:13:14.222 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:13:14.222 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:14.222 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:14.222 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:14.222 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:14.222 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:14.222 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.222 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.223 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.223 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 7, 2023-07-09T02:13:14.223 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:13:14.223 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:45.075187+0000", 2023-07-09T02:13:14.223 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:14.223 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:14.223 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:14.223 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:14.224 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:14.224 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:14.224 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:14.224 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:14.224 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:14.225 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:14.225 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:14.225 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:14.225 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:13:14.225 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:13:14.225 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:13:14.225 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:13:14.225 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:13:14.226 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:14.226 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:14.226 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:14.226 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:14.226 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:14.226 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:14.227 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:14.227 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.227 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:14.227 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:14.227 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:14.227 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:14.228 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:14.228 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:14.228 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:14.228 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:14.228 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:14.228 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:14.228 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:14.229 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:14.229 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:14.229 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:14.229 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:14.229 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:14.230 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:14.230 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:14.231 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:14.231 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:14.231 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:14.231 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:14.232 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:14.233 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:14.233 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:14.233 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:14.234 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:14.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.234 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:14.234 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:14.235 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:14.235 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:14.235 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:14.236 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:14.236 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:14.236 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:14.237 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:14.237 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:14.237 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:14.237 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:14.237 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:13:14.238 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:13:14.238 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:13:14.238 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.238 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:14.238 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:14.239 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:13:14.239 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.239 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.240 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:14.240 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:13:14.240 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:13:14.240 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:14.240 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:14.241 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:14.241 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:14.241 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:14.241 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:14.241 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.241 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.241 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.242 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-07-09T02:13:14.242 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:13:14.242 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:46.325197+0000", 2023-07-09T02:13:14.242 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:13:14.242 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:13:14.242 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:14.242 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:14.242 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:13:14.244 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:13:14.244 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:13:14.244 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:13:14.244 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:13:14.244 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:14.244 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:14.244 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:14.245 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:14.245 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:14.245 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:14.245 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:14.245 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.245 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "49", 2023-07-09T02:13:14.245 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:14.245 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:14.246 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:14.246 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:14.246 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:14.246 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:14.246 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:14.246 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:14.246 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:14.247 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:14.247 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:14.247 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:14.247 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:14.247 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:14.247 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:14.247 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:14.247 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:14.248 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:14.248 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:14.248 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:14.248 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:14.248 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:14.248 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:14.248 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:14.249 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:14.249 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:14.249 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.249 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:14.249 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:14.249 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:14.249 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:14.249 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:13:14.251 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:13:14.251 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.251 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:14.251 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:14.251 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:13:14.251 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.251 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.252 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:14.252 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.8799999952316284, 2023-07-09T02:13:14.252 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.8799999952316284, 2023-07-09T02:13:14.252 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:14.252 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.8799999952316284, 2023-07-09T02:13:14.252 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.8799999952316284, 2023-07-09T02:13:14.252 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:14.252 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:14.253 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:14.253 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.253 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.253 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:14.253 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:13:14.253 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.253 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:14.253 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.255 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:13:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:13:14.256 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.257 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:13:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:14.258 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.259 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.259 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.259 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:13:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.260 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.262 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.262 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:13:14.262 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:14.262 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.263 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.263 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.263 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:13:14.263 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:14.264 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.264 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.264 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.264 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:14.265 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.265 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.265 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.265 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:13:14.265 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:14.265 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.266 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.266 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.266 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:13:14.266 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:14.266 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.267 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.267 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.267 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:13:14.267 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:13:14.267 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:13:14.267 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:13:14.268 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:14.268 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:14.268 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:14.268 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:14.268 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.269 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.269 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.269 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:14.269 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:14.269 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:14.269 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:14.269 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:14.269 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:14.270 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:14.270 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:14.270 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:14.270 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:14.270 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:14.270 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:14.270 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:14.271 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.271 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.271 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.271 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:13:14.271 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:14.271 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.271 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.271 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.272 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:13:14.272 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:14.272 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.272 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.272 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.273 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:14.273 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.273 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.274 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.274 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:13:14.274 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:14.275 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.275 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.275 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.275 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:13:14.276 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:14.276 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.276 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.277 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:14.277 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.277 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.278 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.278 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:13:14.278 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:14.279 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.279 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.279 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.279 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:13:14.280 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:14.280 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.280 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.281 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.281 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:14.281 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.281 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.282 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:13:14.282 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:14.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.282 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.283 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.283 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:13:14.283 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:14.284 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.284 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.284 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.284 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:13:14.284 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:13:14.284 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:13:14.285 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:13:14.285 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:14.285 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:14.285 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:14.285 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.285 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.285 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:14.286 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:14.286 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:14.286 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:14.286 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:14.286 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:14.286 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:14.286 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:14.286 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.287 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:13:14.288 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:14.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.288 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.288 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.288 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:13:14.288 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:14.288 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.289 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.289 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:14.289 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.289 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.289 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.289 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:13:14.289 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:14.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.290 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.290 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.290 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:13:14.290 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:14.290 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.290 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.291 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:14.291 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.291 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.291 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.291 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:13:14.291 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:14.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.292 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.292 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.292 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:13:14.292 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:14.292 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.292 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.292 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:14.293 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.293 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.293 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.293 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:13:14.293 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:14.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.293 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.294 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.294 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:13:14.294 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:14.294 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.294 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.294 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.294 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:13:14.294 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:13:14.295 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:13:14.295 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:13:14.295 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:14.295 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:14.295 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:14.295 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:14.295 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.295 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.296 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.296 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:14.296 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:14.296 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:14.296 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:14.296 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:14.296 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:14.297 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:14.297 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:14.297 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:14.297 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 52, 2023-07-09T02:13:14.297 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:14.297 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:14.297 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:14.297 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.298 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.298 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.298 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:13:14.298 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:14.298 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.298 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.298 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:13:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:13:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:13:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.302 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:13:14.302 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:14.302 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.302 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.302 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.302 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:13:14.302 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:14.303 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.303 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.303 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:14.303 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.303 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.303 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.303 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:13:14.304 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:14.304 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.304 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.304 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.304 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:13:14.304 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:14.304 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.305 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.305 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.305 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:13:14.305 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:13:14.305 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:13:14.305 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:13:14.305 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:14.305 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:14.306 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:14.306 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.306 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.306 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.306 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:14.306 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:14.306 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:14.306 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:14.307 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:14.307 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:14.307 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:14.307 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:14.307 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:14.307 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:14.307 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:14.307 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:14.308 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:14.308 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.308 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.308 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.308 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:13:14.308 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:14.308 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.309 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.309 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.309 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:13:14.309 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:14.309 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.309 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.309 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.309 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:14.310 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.310 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.310 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.310 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:13:14.310 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:14.310 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.310 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.310 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.311 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:13:14.311 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:14.311 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.311 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.311 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:14.311 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.311 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.312 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.312 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:13:14.312 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:14.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.312 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.313 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.313 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:13:14.313 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:14.313 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.313 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.313 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.313 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:14.313 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.314 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.314 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.314 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:13:14.314 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:14.314 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.314 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.314 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.314 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:13:14.315 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:14.315 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.315 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.315 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:13:14.315 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:13:14.315 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:13:14.315 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:13:14.316 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:14.316 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:14.316 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:14.316 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.316 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.316 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:14.317 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:14.317 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:14.317 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:14.317 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:14.317 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:14.317 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:14.317 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:14.317 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:14.318 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:14.318 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:14.318 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:14.318 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:14.318 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.318 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.318 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.318 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:13:14.319 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:14.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.319 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.319 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.319 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:13:14.319 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:14.319 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.319 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.320 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.320 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:14.320 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.320 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.320 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.320 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:13:14.320 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:13:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:13:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.322 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.323 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.323 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:13:14.323 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:14.323 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.323 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.324 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.324 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:14.324 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:13:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:13:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:13:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:13:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:13:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:13:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:13:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:13:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:13:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:13:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:13:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:13:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:13:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.338 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.338 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:14.338 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.338 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.339 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.339 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:13:14.339 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:14.340 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.340 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.340 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.340 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:13:14.341 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:14.341 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.341 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.341 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.341 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:13:14.341 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:13:14.341 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:13:14.342 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:13:14.342 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:14.342 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:14.342 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:14.342 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.343 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.343 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.343 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:14.343 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:14.344 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:14.344 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:14.344 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:14.344 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:14.345 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:14.345 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:14.345 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:14.345 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:14.346 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:14.346 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:14.346 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:14.346 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.346 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:13:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:13:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:13:14.349 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:13:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:13:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:14.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:13:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.352 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:13:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.353 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:13:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:13:14.354 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:13:14.355 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:13:14.355 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:13:14.355 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:14.355 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:14.355 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:14.355 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.355 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.356 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:14.356 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:13:14.356 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.356 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:14.356 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:14.356 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:14.356 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:14.356 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:14.357 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:14.357 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:13:14.357 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:14.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.357 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:14.357 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:14.357 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:14.358 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:14.358 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:14.358 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:14.358 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:13:14.358 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:14.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.358 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.358 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:14.359 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:14.359 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:14.359 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:14.359 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:14.359 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:14.359 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:13:14.359 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:14.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.360 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.360 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:14.360 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:14.360 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:14.360 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:14.360 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:14.360 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:14.361 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:13:14.361 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:14.361 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.361 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.361 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:14.361 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:14.361 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:14.361 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:14.362 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:14.362 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:14.362 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:13:14.362 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:14.362 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.362 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.362 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:14.363 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:14.363 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:14.363 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:14.363 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:14.363 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:14.363 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:13:14.363 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:14.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.364 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.364 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:14.364 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:14.364 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:14.364 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:14.364 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:14.364 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:14.364 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:13:14.365 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:14.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.365 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.365 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:14.365 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:14.366 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:14.366 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:14.366 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:14.366 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:14.366 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:13:14.366 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:14.366 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.366 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:14.367 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:13:14.367 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [ 2023-07-09T02:13:14.367 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.367 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.2a", 2023-07-09T02:13:14.367 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:14.367 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.368 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:14.368 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:14.368 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.368 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.368 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.369 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.37", 2023-07-09T02:13:14.369 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:14.369 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:14.369 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:14.369 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:14.369 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.369 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:14.370 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.370 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:14.370 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:13:14.370 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:13:14.370 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:13:14.370 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:13:14.371 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:13:14.371 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:13:14.371 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:13:14.371 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:13:14.371 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:13:14.371 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:13:14.371 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:13:14.371 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:13:14.372 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:14.372 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:13:14.372 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:13:14.372 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:13:14.373 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:13:14.373 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:13:14.373 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:13:14.373 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:13:14.373 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:13:14.373 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:13:14.373 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:13:14.374 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:13:14.374 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:14.374 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:14.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb51c066280 msgr2=0x7fb51c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:14.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb51c066280 0x7fb51c068730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb520009c30 tx=0x7fb520008040 comp rx=0 tx=0).stop 2023-07-09T02:13:14.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5300b18a0 msgr2=0x7fb5301f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5300b18a0 0x7fb5301f5410 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb524011600 tx=0x7fb5240116f0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 shutdown_connections 2023-07-09T02:13:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb51c066280 0x7fb51c068730 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5300a9400 0x7fb5300a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5300b18a0 0x7fb5301f5410 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 --2- 172.21.15.45:0/1351600615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb518004e90 0x7fb5300b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 >> 172.21.15.45:0/1351600615 conn(0x7fb5300698e0 msgr2=0x7fb53015e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 shutdown_connections 2023-07-09T02:13:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:14.187+0000 7fb535c9c640 1 -- 172.21.15.45:0/1351600615 wait complete. 2023-07-09T02:13:14.377 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:13:14.378 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:13:14.303+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-07-09T02:13:18.002 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:13:18.007 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:13:19.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:13:19.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f123a587640 1 Processor -- start 2023-07-09T02:13:19.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f123a587640 1 -- start start 2023-07-09T02:13:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f123a587640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f123415c870 0x7f12340b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f123a587640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12340b1b50 0x7f123406b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f123a587640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123406bbe0 con 0x7f123406b780 2023-07-09T02:13:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f123a587640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12340d1d80 con 0x7f12340b1b50 2023-07-09T02:13:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f123a587640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340b2090 con 0x7f123415c870 2023-07-09T02:13:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1239d86640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f123406b780 0x7f12340d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46532/0 (socket says 172.21.15.45:46532) 2023-07-09T02:13:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1239d86640 1 -- 172.21.15.45:0/1944010446 learned_addr learned my addr 172.21.15.45:0/1944010446 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1238d84640 1 --2- 172.21.15.45:0/1944010446 >> v2:172.21.15.45:3300/0 conn(0x7f12340b1b50 0x7f123406b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1239585640 1 --2- 172.21.15.45:0/1944010446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f123415c870 0x7f12340b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f122bfff640 1 -- 172.21.15.45:0/1944010446 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476385068 0 0) 0x7f123406bbe0 con 0x7f123406b780 2023-07-09T02:13:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f122bfff640 1 -- 172.21.15.45:0/1944010446 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1220003530 con 0x7f123406b780 2023-07-09T02:13:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1238d84640 1 -- 172.21.15.45:0/1944010446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f123415c870 msgr2=0x7f12340b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1238d84640 1 --2- 172.21.15.45:0/1944010446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f123415c870 0x7f12340b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1238d84640 1 -- 172.21.15.45:0/1944010446 >> v1:172.21.15.45:6789/0 conn(0x7f123406b780 legacy=0x7f12340d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1238d84640 1 -- 172.21.15.45:0/1944010446 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234160520 con 0x7f12340b1b50 2023-07-09T02:13:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.531+0000 7f1239585640 1 --2- 172.21.15.45:0/1944010446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f123415c870 0x7f12340b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f1238d84640 1 --2- 172.21.15.45:0/1944010446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12340b1b50 0x7f123406b240 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f12240097c0 tx=0x7f122401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66617265f5b6f4bf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f122bfff640 1 -- 172.21.15.45:0/1944010446 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12240ab600 con 0x7f12340b1b50 2023-07-09T02:13:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f122bfff640 1 -- 172.21.15.45:0/1944010446 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12240a7050 con 0x7f12340b1b50 2023-07-09T02:13:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f122bfff640 1 -- 172.21.15.45:0/1944010446 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12240ab980 con 0x7f12340b1b50 2023-07-09T02:13:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f123a587640 1 -- 172.21.15.45:0/1944010446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12340b1b50 msgr2=0x7f123406b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f123a587640 1 --2- 172.21.15.45:0/1944010446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12340b1b50 0x7f123406b240 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f12240097c0 tx=0x7f122401c450 comp rx=0 tx=0).stop 2023-07-09T02:13:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f123a587640 1 -- 172.21.15.45:0/1944010446 shutdown_connections 2023-07-09T02:13:19.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f123a587640 1 --2- 172.21.15.45:0/1944010446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12340b1b50 0x7f123406b240 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f123a587640 1 --2- 172.21.15.45:0/1944010446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f123415c870 0x7f12340b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f123a587640 1 -- 172.21.15.45:0/1944010446 >> 172.21.15.45:0/1944010446 conn(0x7f1234070be0 msgr2=0x7f1234070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:19.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f123a587640 1 -- 172.21.15.45:0/1944010446 shutdown_connections 2023-07-09T02:13:19.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.535+0000 7f123a587640 1 -- 172.21.15.45:0/1944010446 wait complete. 2023-07-09T02:13:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 Processor -- start 2023-07-09T02:13:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 -- start start 2023-07-09T02:13:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f123406b780 0x7f123414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12340b1b50 0x7f123415b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f123415c870 0x7f12340b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123415eaf0 con 0x7f123415c870 2023-07-09T02:13:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123415a6d0 con 0x7f123406b780 2023-07-09T02:13:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123415a9b0 con 0x7f12340b1b50 2023-07-09T02:13:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f123415c870 0x7f12340b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f123415c870 0x7f12340b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36234/0 (socket says 172.21.15.45:36234) 2023-07-09T02:13:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 -- 172.21.15.45:0/2434224861 learned_addr learned my addr 172.21.15.45:0/2434224861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239585640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f123406b780 0x7f123414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 -- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12340b1b50 msgr2=0x7f123415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1238d84640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12340b1b50 0x7f123415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12340b1b50 0x7f123415b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 -- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f123406b780 msgr2=0x7f123414fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f123406b780 0x7f123414fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 -- 172.21.15.45:0/2434224861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009420 con 0x7f123415c870 2023-07-09T02:13:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1238d84640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12340b1b50 0x7f123415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1239d86640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f123415c870 0x7f12340b57b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f122c00cb40 tx=0x7f122c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1229ffb640 1 -- 172.21.15.45:0/2434224861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00aca0 con 0x7f123415c870 2023-07-09T02:13:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1229ffb640 1 -- 172.21.15.45:0/2434224861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c00ae00 con 0x7f123415c870 2023-07-09T02:13:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f1229ffb640 1 -- 172.21.15.45:0/2434224861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c012620 con 0x7f123415c870 2023-07-09T02:13:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123415ac90 con 0x7f123415c870 2023-07-09T02:13:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.539+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123415b250 con 0x7f123415c870 2023-07-09T02:13:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.543+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123404e020 con 0x7f123415c870 2023-07-09T02:13:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.543+0000 7f1229ffb640 1 -- 172.21.15.45:0/2434224861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f122c007070 con 0x7f123415c870 2023-07-09T02:13:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.543+0000 7f1229ffb640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1218066280 0x7f1218068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.543+0000 7f1229ffb640 1 -- 172.21.15.45:0/2434224861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f122c083df0 con 0x7f123415c870 2023-07-09T02:13:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.543+0000 7f1239585640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1218066280 0x7f1218068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.543+0000 7f1239585640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1218066280 0x7f1218068730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f123000ba10 tx=0x7f1230008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:19.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.547+0000 7f1229ffb640 1 -- 172.21.15.45:0/2434224861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f122c051220 con 0x7f123415c870 2023-07-09T02:13:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.707+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f12340cfef0 con 0x7f123415c870 2023-07-09T02:13:19.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f1229ffb640 1 -- 172.21.15.45:0/2434224861 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v57) v1 ==== 81+0+37373 (secure 0 0 0) 0x7f122c017090 con 0x7f123415c870 2023-07-09T02:13:19.714 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:19.714 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:19.714 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 57, 2023-07-09T02:13:19.714 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:13:19.715 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:13:19.715 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:13:16.309432+0000", 2023-07-09T02:13:19.715 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:13:19.715 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:13:19.715 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:13:19.715 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:13:19.715 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:13:19.716 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:13:19.716 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:13:19.716 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:13:19.716 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:13:19.716 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:19.716 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:13:19.716 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:13:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:13:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:13:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:13:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 8, 2023-07-09T02:13:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:13:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:13:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "luminous", 2023-07-09T02:13:19.717 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:13:19.718 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:13:19.718 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:13:19.718 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.718 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:13:19.718 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:13:19.718 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:13:19.718 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:19.718 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:19.719 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:19.719 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:19.719 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:19.719 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:19.719 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:19.719 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:19.719 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:19.720 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:19.720 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:19.720 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:19.720 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:13:19.720 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:13:19.720 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:13:19.720 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:13:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:13:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:19.721 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "57", 2023-07-09T02:13:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:19.722 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:19.724 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:19.725 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:19.726 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:13:19.727 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:13:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:13:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:13:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:13:19.728 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:13:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:13:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:13:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:19.729 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.730 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.730 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.730 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:13:19.730 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:13:19.730 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:13:19.730 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:19.730 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:19.731 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:19.731 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:19.731 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:19.731 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:19.731 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:19.731 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:19.731 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:19.731 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:19.732 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:19.732 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:19.732 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:13:19.732 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:13:19.732 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:13:19.732 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:13:19.733 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:13:19.733 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:19.733 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:19.733 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:19.733 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:19.733 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:19.733 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:19.733 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:19.734 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.734 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "57", 2023-07-09T02:13:19.734 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:19.734 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:19.734 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:19.734 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:19.734 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:19.735 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:19.736 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:19.736 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:19.736 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:19.736 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:19.736 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:19.736 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:19.736 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:19.736 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:19.737 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:19.737 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:19.737 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:19.737 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:19.737 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:19.737 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.737 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:19.738 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:19.738 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:19.738 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:19.738 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:19.738 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:19.738 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:19.738 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:19.738 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:19.739 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:19.739 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:19.739 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:13:19.739 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:19.739 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:13:19.739 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.739 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:19.740 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:13:19.740 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:13:19.740 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:13:19.740 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:19.740 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:19.740 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:19.740 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:19.740 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:19.741 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.741 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.741 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.741 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 7, 2023-07-09T02:13:19.741 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:13:19.741 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:45.075187+0000", 2023-07-09T02:13:19.741 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:19.741 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:19.742 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:19.742 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:19.742 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:19.742 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:19.742 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:19.743 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:19.743 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:19.743 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:19.743 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:19.743 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:19.743 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:13:19.743 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:13:19.744 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:13:19.744 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:13:19.744 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:13:19.744 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:19.744 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:19.744 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:19.744 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:19.745 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:19.745 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:19.745 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:19.745 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.745 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "57", 2023-07-09T02:13:19.745 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:19.745 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:19.745 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:19.746 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:19.746 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:19.746 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:19.747 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:19.747 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:19.747 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:19.747 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:19.747 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:19.747 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:19.747 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:19.748 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:19.748 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:19.748 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:19.748 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:19.748 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:19.748 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:19.748 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:19.748 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:19.750 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:19.750 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:19.750 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:19.750 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:19.750 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:19.750 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:19.750 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:19.751 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:19.751 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:19.751 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:19.751 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:13:19.751 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:13:19.751 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:13:19.751 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.752 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:19.752 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:19.752 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:13:19.752 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.752 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:19.752 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:13:19.753 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:13:19.753 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:19.753 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:19.753 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:19.753 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:19.753 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:19.753 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:19.754 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.754 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.754 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.754 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-07-09T02:13:19.754 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:13:19.754 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:46.325197+0000", 2023-07-09T02:13:19.755 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:19.755 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:19.755 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:19.755 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:19.755 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:19.755 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:19.755 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:19.756 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:19.756 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:19.756 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:19.756 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:19.756 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:19.756 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:13:19.756 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:13:19.757 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:13:19.757 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:13:19.757 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:13:19.757 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:19.757 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:19.757 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:19.757 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:19.757 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:19.758 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:19.758 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:19.758 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.758 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "57", 2023-07-09T02:13:19.758 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:19.758 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:19.758 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:19.759 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:19.759 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:19.759 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:19.759 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:19.759 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:19.759 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:19.759 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:19.759 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:19.760 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:19.760 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:19.760 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:19.760 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:19.760 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:19.760 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:19.760 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:19.761 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:19.761 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:19.761 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:19.761 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:19.761 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:19.761 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:19.761 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:19.761 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:19.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.762 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:19.762 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:19.762 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:19.762 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:19.762 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:19.762 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:19.763 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:19.763 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:19.763 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:19.763 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:19.763 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:19.763 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:19.763 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:13:19.764 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:13:19.764 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.764 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:19.764 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:19.764 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:13:19.764 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.765 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.765 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:19.765 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.8799999952316284, 2023-07-09T02:13:19.765 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.8799999952316284, 2023-07-09T02:13:19.765 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:19.765 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.8799999952316284, 2023-07-09T02:13:19.765 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.8799999952316284, 2023-07-09T02:13:19.766 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:19.766 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:19.766 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:19.766 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.766 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.766 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:19.766 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:13:19.766 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.767 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:19.767 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:19.767 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:19.767 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:19.767 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:19.767 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:19.767 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:19.768 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:19.768 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:19.768 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:19.768 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:19.768 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:19.768 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:19.768 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.769 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.769 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.769 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:13:19.769 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:19.769 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.769 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.769 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.770 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:13:19.770 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:19.770 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.770 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.770 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.771 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:19.771 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.771 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.771 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.771 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:13:19.771 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:19.772 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.772 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.772 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.772 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:13:19.772 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:19.772 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.772 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.773 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.773 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:19.773 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.773 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.773 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.773 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:13:19.773 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:19.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.774 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.774 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.774 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:13:19.774 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:19.774 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.774 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.775 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:19.775 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.775 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.775 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.775 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:13:19.775 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:19.775 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.775 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.776 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.776 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:13:19.776 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:19.776 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.776 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.776 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.776 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:13:19.777 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:13:19.777 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:13:19.777 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:13:19.777 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:19.777 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:19.777 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:19.777 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.777 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.778 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.778 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:19.778 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:19.778 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:19.778 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:19.778 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:19.778 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:19.779 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:19.779 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:19.779 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:19.779 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:19.779 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:19.779 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:19.779 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:19.779 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.780 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.780 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.780 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:13:19.780 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:19.780 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.780 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.780 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.781 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:13:19.781 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:19.781 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.781 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.781 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.781 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:19.781 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.781 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.782 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.782 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:13:19.782 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:19.782 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.782 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.782 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.782 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:13:19.783 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:19.783 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.783 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.783 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.783 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:19.783 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.783 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.783 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.784 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:13:19.784 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:19.784 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.784 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.784 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.784 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:13:19.784 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:19.785 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.785 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.785 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.785 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:19.785 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.785 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.785 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.785 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:13:19.786 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:19.786 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.786 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.786 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.786 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:13:19.786 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:19.786 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.787 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.787 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.787 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:13:19.787 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:13:19.787 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:13:19.787 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:13:19.787 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:19.787 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:19.788 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:19.788 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.788 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.788 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.788 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:19.788 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:19.788 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:19.789 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:19.789 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:19.789 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:19.789 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:19.789 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:19.789 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:19.789 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:19.789 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:19.790 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:19.790 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:19.790 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.790 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.790 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.790 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:13:19.790 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:19.790 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.791 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.791 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.791 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:13:19.791 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:19.791 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.791 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.792 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.792 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:19.792 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.792 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.792 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.792 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:13:19.792 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:19.793 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.793 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.793 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.793 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:13:19.793 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:19.793 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.793 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.793 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.794 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:19.794 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.794 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.794 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.794 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:13:19.794 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:19.794 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:13:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:19.796 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.796 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.796 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.796 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:13:19.796 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:19.796 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.796 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.797 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.797 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:13:19.797 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:19.797 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.797 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.797 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.797 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:13:19.797 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:13:19.798 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:13:19.798 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:13:19.798 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:19.798 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:19.798 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:19.798 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.798 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.798 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.799 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:19.799 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:19.799 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:19.799 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:19.799 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:19.799 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:19.799 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:19.799 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:19.800 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:19.800 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 52, 2023-07-09T02:13:19.800 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:19.800 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:19.800 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:19.800 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.800 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.801 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.801 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:13:19.801 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:19.801 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.801 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.801 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.801 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:13:19.801 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:19.802 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.802 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.802 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.802 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:19.802 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.803 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.803 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.803 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:13:19.803 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:19.803 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.803 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.803 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.804 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:13:19.804 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:19.804 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.804 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.804 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.804 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:19.804 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.804 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.805 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.805 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:13:19.805 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:19.805 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.805 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.805 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.805 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:13:19.806 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:19.806 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.806 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.806 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.806 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:19.806 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.806 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.806 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.807 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:13:19.807 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:19.807 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.807 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.807 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.807 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:13:19.807 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:19.807 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.808 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.808 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.808 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:13:19.808 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:13:19.808 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:13:19.808 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:13:19.808 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:19.809 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:19.809 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:19.809 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.809 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.809 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.809 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:19.809 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:19.809 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:19.810 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:19.810 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:19.810 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:19.810 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:19.810 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:19.810 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:19.811 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:19.811 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:19.811 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:19.811 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:19.811 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.811 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.812 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:13:19.812 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:19.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.812 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.812 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:13:19.812 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:19.813 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.813 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.813 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:19.813 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.813 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.813 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.814 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:13:19.814 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:19.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.814 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.814 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.814 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:13:19.814 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:19.814 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.815 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.815 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.815 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:19.815 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.815 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.815 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.815 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:13:19.816 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:19.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.816 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.816 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.816 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:13:19.816 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:19.816 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.816 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:13:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:19.817 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.818 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.818 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.818 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:13:19.818 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:19.818 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.818 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.818 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:13:19.819 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:13:19.819 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:13:19.819 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:13:19.819 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:19.819 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:19.819 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:19.819 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.820 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.820 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:19.820 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:19.820 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:19.820 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:19.820 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:19.820 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:19.821 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:13:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.822 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:13:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.823 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:13:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.824 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:13:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.825 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:13:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:13:19.826 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.827 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:13:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:13:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:19.828 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.829 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.829 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:13:19.829 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:13:19.829 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:13:19.829 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:13:19.829 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:19.830 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:19.830 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:19.830 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.830 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.830 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.830 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:19.830 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:19.830 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:19.831 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:19.831 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:19.831 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:19.831 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:19.831 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:19.831 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:19.831 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:19.831 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:19.832 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:19.832 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:19.832 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.832 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.832 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.832 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:13:19.832 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:19.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.833 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.833 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.833 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:13:19.833 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:19.833 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.833 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.833 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.833 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:19.834 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.834 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.834 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.834 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:13:19.834 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:19.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.834 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.835 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.835 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:13:19.835 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:19.835 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.835 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.835 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:13:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:19.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:13:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.837 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:13:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.838 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:13:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:13:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:13:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:13:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:13:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.840 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:19.841 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.842 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:13:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:13:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.844 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:13:19.845 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:19.845 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.845 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.845 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.845 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:13:19.845 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:19.845 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.845 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.846 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.846 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:19.846 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.846 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.846 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.846 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:13:19.846 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:19.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.847 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.847 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.847 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:13:19.847 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:19.847 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.847 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.848 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:19.848 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:19.848 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.848 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:19.848 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:13:19.848 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:19.848 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.849 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.849 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:19.849 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:13:19.849 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:19.849 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.849 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.849 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.849 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:13:19.850 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:13:19.850 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:13:19.850 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:13:19.850 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:19.850 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:19.850 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:19.850 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.850 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.851 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:19.851 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:13:19.851 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.851 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:19.851 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:19.851 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:19.851 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:19.851 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:19.852 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:19.852 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:13:19.852 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:19.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.852 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.852 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:19.852 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:19.853 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:19.853 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:19.853 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:19.853 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:19.853 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:13:19.853 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:19.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.853 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.854 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:19.854 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:19.854 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:19.854 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:19.854 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:19.854 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:19.854 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:13:19.854 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:19.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.855 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:19.855 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:19.855 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:19.855 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:19.855 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:19.855 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:19.856 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:13:19.856 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:19.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.856 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.856 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:19.856 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:19.856 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:13:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.857 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:19.858 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:19.858 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:19.858 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:19.858 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:19.858 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:19.858 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:13:19.859 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:19.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.859 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.859 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:19.859 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:19.859 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:19.859 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:19.859 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:19.860 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:19.860 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:13:19.860 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:19.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.860 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:19.860 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:19.860 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:19.861 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:19.861 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:19.861 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:19.861 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:13:19.861 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:19.861 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.861 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:19.862 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:13:19.862 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [ 2023-07-09T02:13:19.862 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.862 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.2a", 2023-07-09T02:13:19.862 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:19.862 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.863 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:19.863 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:19.863 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.863 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.863 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.863 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.37", 2023-07-09T02:13:19.863 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:19.864 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:19.864 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:19.864 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:19.864 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.864 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:19.864 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.864 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:19.864 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:13:19.865 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:13:19.865 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:13:19.865 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:13:19.865 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:13:19.865 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:13:19.865 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:13:19.865 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:13:19.865 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:13:19.866 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:13:19.866 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:13:19.866 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:13:19.866 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:19.866 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:13:19.866 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:13:19.866 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:13:19.867 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:13:19.867 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:13:19.867 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:13:19.867 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:13:19.867 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:13:19.867 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:13:19.867 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:13:19.868 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:13:19.868 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:19.868 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:19.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1218066280 msgr2=0x7f1218068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:19.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1218066280 0x7f1218068730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f123000ba10 tx=0x7f1230008040 comp rx=0 tx=0).stop 2023-07-09T02:13:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f123415c870 msgr2=0x7f12340b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f123415c870 0x7f12340b57b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f122c00cb40 tx=0x7f122c00a060 comp rx=0 tx=0).stop 2023-07-09T02:13:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 shutdown_connections 2023-07-09T02:13:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f123415c870 0x7f12340b57b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1218066280 0x7f1218068730 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12340b1b50 0x7f123415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 --2- 172.21.15.45:0/2434224861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f123406b780 0x7f123414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 >> 172.21.15.45:0/2434224861 conn(0x7f1234070be0 msgr2=0x7f12340b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 shutdown_connections 2023-07-09T02:13:19.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:19.711+0000 7f123a587640 1 -- 172.21.15.45:0/2434224861 wait complete. 2023-07-09T02:13:19.872 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-07-09T02:13:19.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:13:20.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f83961d5640 1 Processor -- start 2023-07-09T02:13:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f83961d5640 1 -- start start 2023-07-09T02:13:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f83961d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839015c060 0x7f83900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f83961d5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83900cd120 0x7f83900d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f83961d5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8390160a50 con 0x7f83900d2450 2023-07-09T02:13:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f83961d5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900d28f0 con 0x7f83900cd120 2023-07-09T02:13:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f83961d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83900cfe40 con 0x7f839015c060 2023-07-09T02:13:20.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f8387fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83900cd120 0x7f83900d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f838ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f83900d2450 0x7f83900d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46538/0 (socket says 172.21.15.45:46538) 2023-07-09T02:13:20.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f838ffff640 1 -- 172.21.15.45:0/438874809 learned_addr learned my addr 172.21.15.45:0/438874809 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:20.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f838f7fe640 1 --2- 172.21.15.45:0/438874809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839015c060 0x7f83900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f8387fff640 1 -- 172.21.15.45:0/438874809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839015c060 msgr2=0x7f83900b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f8387fff640 1 --2- 172.21.15.45:0/438874809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839015c060 0x7f83900b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f8387fff640 1 -- 172.21.15.45:0/438874809 >> v1:172.21.15.45:6789/0 conn(0x7f83900d2450 legacy=0x7f83900d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f8387fff640 1 -- 172.21.15.45:0/438874809 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839015c430 con 0x7f83900cd120 2023-07-09T02:13:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.015+0000 7f838effd640 1 -- 172.21.15.45:0/438874809 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226348954 0 0) 0x7f8390160a50 con 0x7f83900d2450 2023-07-09T02:13:20.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f8387fff640 1 --2- 172.21.15.45:0/438874809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f83900d1f10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f83780097c0 tx=0x7f837801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deda304a91cbcbc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:20.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f838effd640 1 -- 172.21.15.45:0/438874809 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780ab600 con 0x7f83900cd120 2023-07-09T02:13:20.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f838effd640 1 -- 172.21.15.45:0/438874809 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83780a7050 con 0x7f83900cd120 2023-07-09T02:13:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f838effd640 1 -- 172.21.15.45:0/438874809 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780ab980 con 0x7f83900cd120 2023-07-09T02:13:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f83961d5640 1 -- 172.21.15.45:0/438874809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 msgr2=0x7f83900d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f83961d5640 1 --2- 172.21.15.45:0/438874809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f83900d1f10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f83780097c0 tx=0x7f837801c450 comp rx=0 tx=0).stop 2023-07-09T02:13:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f83961d5640 1 -- 172.21.15.45:0/438874809 shutdown_connections 2023-07-09T02:13:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f83961d5640 1 --2- 172.21.15.45:0/438874809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f83900d1f10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f83961d5640 1 --2- 172.21.15.45:0/438874809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839015c060 0x7f83900b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f83961d5640 1 -- 172.21.15.45:0/438874809 >> 172.21.15.45:0/438874809 conn(0x7f83900698e0 msgr2=0x7f8390069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f83961d5640 1 -- 172.21.15.45:0/438874809 shutdown_connections 2023-07-09T02:13:20.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.019+0000 7f83961d5640 1 -- 172.21.15.45:0/438874809 wait complete. 2023-07-09T02:13:20.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 Processor -- start 2023-07-09T02:13:20.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 -- start start 2023-07-09T02:13:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f8390153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83900d2450 0x7f839015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f839015c060 0x7f83900ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839015c700 con 0x7f83900cd120 2023-07-09T02:13:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839015c970 con 0x7f839015c060 2023-07-09T02:13:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839015cc50 con 0x7f83900d2450 2023-07-09T02:13:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f8390153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f8390153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36258/0 (socket says 172.21.15.45:36258) 2023-07-09T02:13:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 -- 172.21.15.45:0/3655282057 learned_addr learned my addr 172.21.15.45:0/3655282057 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:20.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 -- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83900d2450 msgr2=0x7f839015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f8387fff640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83900d2450 0x7f839015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838ffff640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f839015c060 0x7f83900ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83900d2450 0x7f839015dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 -- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f839015c060 msgr2=0x7f83900ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f839015c060 0x7f83900ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 -- 172.21.15.45:0/3655282057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009420 con 0x7f83900cd120 2023-07-09T02:13:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f8387fff640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83900d2450 0x7f839015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:20.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838ffff640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f839015c060 0x7f83900ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838f7fe640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f8390153e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f838000d5f0 tx=0x7f838000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838cff9640 1 -- 172.21.15.45:0/3655282057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800125f0 con 0x7f83900cd120 2023-07-09T02:13:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838cff9640 1 -- 172.21.15.45:0/3655282057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8380012750 con 0x7f83900cd120 2023-07-09T02:13:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f838cff9640 1 -- 172.21.15.45:0/3655282057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380012ae0 con 0x7f83900cd120 2023-07-09T02:13:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839015cf30 con 0x7f83900cd120 2023-07-09T02:13:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.023+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8390159ec0 con 0x7f83900cd120 2023-07-09T02:13:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.027+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839004d7d0 con 0x7f83900cd120 2023-07-09T02:13:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.027+0000 7f838cff9640 1 -- 172.21.15.45:0/3655282057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8380012c40 con 0x7f83900cd120 2023-07-09T02:13:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.027+0000 7f838cff9640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8370066280 0x7f8370068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.027+0000 7f838cff9640 1 -- 172.21.15.45:0/3655282057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8380084290 con 0x7f83900cd120 2023-07-09T02:13:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.027+0000 7f8387fff640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8370066280 0x7f8370068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.031+0000 7f8387fff640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8370066280 0x7f8370068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f83780ad000 tx=0x7f83780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.031+0000 7f838cff9640 1 -- 172.21.15.45:0/3655282057 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83800516d0 con 0x7f83900cd120 2023-07-09T02:13:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.187+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f839006baa0 con 0x7f83900cd120 2023-07-09T02:13:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f838cff9640 1 -- 172.21.15.45:0/3655282057 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v57) v1 ==== 81+0+37373 (secure 0 0 0) 0x7f8380007380 con 0x7f83900cd120 2023-07-09T02:13:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:20.194 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 57, 2023-07-09T02:13:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:13:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:13:20.194 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:13:16.309432+0000", 2023-07-09T02:13:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:13:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:13:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:13:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:13:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:13:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:13:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:13:20.195 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:13:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:13:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:13:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:13:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:13:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:13:20.196 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:13:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 8, 2023-07-09T02:13:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:13:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:13:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "luminous", 2023-07-09T02:13:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:13:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:13:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:13:20.197 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.198 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:13:20.198 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:13:20.198 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:13:20.198 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:20.198 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:20.198 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:20.198 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:20.198 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:20.199 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:20.199 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:20.199 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:20.199 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:20.199 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:20.199 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:20.199 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:20.200 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:13:20.200 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:13:20.200 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:13:20.200 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:13:20.200 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:13:20.200 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:20.200 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:20.200 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:20.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:20.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:20.201 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:20.201 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:20.201 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "57", 2023-07-09T02:13:20.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:20.201 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:20.202 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:20.202 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:20.202 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:20.202 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:20.202 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:20.202 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:20.202 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:20.202 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:20.203 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:20.203 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:20.203 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:20.203 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:20.203 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:20.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:20.203 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:20.203 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:20.204 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:20.204 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:20.204 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:20.204 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:20.204 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:20.204 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:20.204 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:20.204 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:20.205 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.205 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:20.205 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:20.205 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:20.205 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:20.205 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:20.205 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:20.205 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:20.206 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:20.206 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:20.206 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:20.206 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:20.206 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:20.206 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:13:20.206 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:13:20.207 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.207 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:20.207 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:13:20.207 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.207 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:20.207 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:13:20.207 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:13:20.207 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:13:20.208 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:13:20.208 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:13:20.208 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:20.208 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:20.208 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:20.208 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.208 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.209 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:13:20.209 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:13:20.209 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:13:20.209 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:20.209 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:20.209 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:20.209 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:20.209 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:20.210 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:20.210 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:20.210 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:20.210 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:20.210 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:20.210 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:20.210 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:20.210 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:13:20.211 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:13:20.211 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:13:20.211 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:13:20.211 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:13:20.211 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:20.211 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:20.211 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:20.211 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:20.212 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:20.212 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:20.212 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:20.212 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.212 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "57", 2023-07-09T02:13:20.212 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:20.212 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:20.212 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:20.213 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:20.213 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:20.213 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:20.213 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:20.213 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:20.213 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:20.213 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:20.214 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:20.214 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:20.214 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:20.214 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:20.214 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:20.214 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:20.214 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:20.214 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:20.215 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:20.215 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:20.215 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:20.215 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:20.215 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:20.215 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:20.215 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:20.215 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:20.216 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.216 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:20.216 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:20.216 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:20.216 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:20.216 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:20.216 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:20.216 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:20.217 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:20.217 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:20.217 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:20.217 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:20.217 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:13:20.217 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:20.217 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:13:20.217 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.218 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:20.218 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:13:20.218 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:13:20.218 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:13:20.218 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:20.218 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:20.218 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:20.218 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 7, 2023-07-09T02:13:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:13:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:45.075187+0000", 2023-07-09T02:13:20.219 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:20.220 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:13:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:13:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:13:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:13:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:13:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "57", 2023-07-09T02:13:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:13:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:13:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:13:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:13:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:13:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:13:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:13:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:13:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-07-09T02:13:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:13:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:12:46.325197+0000", 2023-07-09T02:13:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:13:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:13:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:13:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:13:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:13:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:13:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:13:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:13:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:13:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:13:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:13:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:13:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:13:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:13:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:13:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:13:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:13:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:13:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:13:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:13:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:13:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:13:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:13:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:13:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "57", 2023-07-09T02:13:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:13:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:13:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:13:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:13:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:13:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:13:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:13:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:13:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:13:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:13:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:13:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:13:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:13:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:13:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:13:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:13:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:13:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:13:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:13:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:13:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:13:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:13:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:13:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:13:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:13:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:13:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:13:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:13:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:13:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:13:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:13:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:13:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:13:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:13:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:13:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:13:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:13:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:13:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:13:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:13:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:13:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:13:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:13:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:13:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.8799999952316284, 2023-07-09T02:13:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.8799999952316284, 2023-07-09T02:13:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:13:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.8799999952316284, 2023-07-09T02:13:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.8799999952316284, 2023-07-09T02:13:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:13:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:13:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:13:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:13:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:13:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:13:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:13:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:13:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:13:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.249 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:13:20.249 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:20.249 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.250 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.250 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.250 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:20.250 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.250 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.250 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.251 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:13:20.251 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:20.251 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.251 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.251 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.251 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:13:20.251 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:13:20.252 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.252 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.252 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.252 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:13:20.252 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:13:20.252 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:13:20.252 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:13:20.252 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:20.253 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:20.253 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:20.253 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.253 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.253 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.253 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:20.254 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:20.254 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:20.254 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:20.254 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:20.254 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:20.254 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:20.254 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:20.255 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:20.255 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:20.255 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:20.255 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:20.255 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:20.255 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.255 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.255 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.256 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:13:20.256 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:20.256 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.256 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.256 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.256 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:13:20.256 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:20.257 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.257 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.257 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.257 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:20.257 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.257 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.257 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.257 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:13:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:13:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.259 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.259 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:20.259 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.259 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.259 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.259 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:13:20.259 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:20.259 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.260 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.260 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.260 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:13:20.260 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:20.260 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.260 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.260 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.260 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:20.261 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.261 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.261 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.261 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:13:20.261 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:20.262 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.262 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.262 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.262 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:13:20.262 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:13:20.262 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.262 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.262 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.263 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:13:20.263 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:13:20.263 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:13:20.263 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:13:20.263 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:20.263 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:20.263 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:20.263 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.264 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.264 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.264 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:20.264 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:20.264 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:20.264 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:20.264 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:20.264 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:20.265 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:20.265 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:20.265 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:20.265 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:20.265 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:20.265 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:20.265 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:20.265 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.266 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.266 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.266 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:13:20.266 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:20.266 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.266 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.266 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.266 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:13:20.267 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:20.267 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.267 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.267 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.267 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:20.267 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.267 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.267 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.268 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:13:20.268 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:20.268 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.268 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.268 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.268 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:13:20.268 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:20.269 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.269 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.269 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.269 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:20.269 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.269 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.269 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.269 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:13:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:13:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.270 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.271 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.271 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:20.271 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.271 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.271 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.271 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:13:20.271 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:20.271 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:13:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:13:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:13:20.273 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:13:20.273 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:13:20.273 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:13:20.273 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:20.273 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:20.273 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:20.273 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.273 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.274 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.274 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:20.274 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:20.274 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:20.274 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:20.274 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:20.274 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:20.274 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:20.275 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:20.275 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:20.275 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 52, 2023-07-09T02:13:20.275 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:20.275 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:20.275 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:20.275 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.275 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.276 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.276 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:13:20.276 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:20.276 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.276 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.276 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.276 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:13:20.276 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:20.277 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.277 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.277 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:20.277 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.277 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.277 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.277 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:13:20.278 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:20.278 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.278 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.278 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.278 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:13:20.278 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:20.278 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.278 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.279 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.279 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:20.279 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.279 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.279 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.279 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:13:20.279 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:20.279 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.280 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.280 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.280 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:13:20.280 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:20.280 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.280 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.280 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.281 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:20.281 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.281 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.281 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.281 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:13:20.281 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:20.281 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.281 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.282 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:13:20.282 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:13:20.282 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.282 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.282 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:13:20.283 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:13:20.283 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:13:20.283 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:13:20.283 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:20.283 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:20.283 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:20.283 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.283 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.284 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.284 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:20.284 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:20.284 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:20.284 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:20.284 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:20.284 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:20.284 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:20.285 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:20.285 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:20.285 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:20.285 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:20.285 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:20.285 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:20.285 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.285 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.286 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.286 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:13:20.286 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:20.286 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.286 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.286 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.286 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:13:20.286 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:20.287 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.287 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.287 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:20.287 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.287 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.287 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.287 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:13:20.288 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:20.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.288 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.288 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.288 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:13:20.288 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:20.288 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.288 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.289 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:20.289 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.289 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.289 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.289 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:13:20.289 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:20.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.290 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.290 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.290 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:13:20.290 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:20.290 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.290 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.291 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:20.291 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.291 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.291 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.291 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:13:20.291 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:20.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.291 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.292 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.292 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:13:20.292 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:13:20.292 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.292 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.292 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:13:20.292 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:13:20.293 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:13:20.293 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:13:20.293 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:20.293 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:20.293 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:20.293 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.293 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.294 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:20.294 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:20.294 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:20.294 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:20.294 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:20.294 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:20.294 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:20.294 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:20.295 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:20.295 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:20.295 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:20.295 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:20.295 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:20.295 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.295 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.295 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:13:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:13:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.297 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.297 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.297 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:20.297 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.297 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.297 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.299 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:13:20.299 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:20.299 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.299 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.299 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.299 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:13:20.299 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:20.300 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.300 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.300 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.300 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:20.300 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.300 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.300 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.301 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:13:20.301 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:20.301 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.301 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.301 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.301 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:13:20.301 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:20.301 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.302 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.302 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.302 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:20.302 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.302 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.302 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.302 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:13:20.303 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:20.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.303 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.303 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.303 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:13:20.303 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:13:20.303 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.303 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:13:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:13:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:13:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:13:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:20.304 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:20.305 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:20.306 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:13:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:20.307 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:13:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:13:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.309 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:13:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:20.310 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.311 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.311 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.311 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:13:20.311 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:20.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.311 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.311 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.311 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:13:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.312 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:13:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:13:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:13:20.313 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:13:20.314 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:13:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:13:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:13:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.315 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:13:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:13:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:13:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:13:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:13:20.316 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:13:20.317 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:13:20.317 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:13:20.317 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 46, 2023-07-09T02:13:20.317 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:13:20.317 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:13:20.317 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:13:20.318 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.318 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.318 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.318 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:13:20.318 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:20.318 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.318 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.318 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.320 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.320 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:13:20.320 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:20.320 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.320 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.320 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.320 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:13:20.321 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:20.321 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.321 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.321 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.321 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:13:20.321 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.321 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.322 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.322 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:13:20.322 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:20.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.322 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.322 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.322 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:13:20.322 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:20.323 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.323 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.323 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:13:20.323 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:13:20.323 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.323 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:13:20.324 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:13:20.324 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:20.324 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.324 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.324 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:13:20.324 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:13:20.324 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:13:20.325 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.325 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.325 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:13:20.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:13:20.327 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:13:20.327 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:13:20.327 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:13:20.327 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:13:20.327 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:13:20.327 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.328 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.328 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:20.328 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:13:20.329 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.329 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:13:20.329 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:20.329 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:20.329 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:20.330 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:20.330 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:20.330 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:13:20.330 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:20.330 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.330 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.330 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:13:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:13:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:20.331 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.332 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.332 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:13:20.332 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:20.332 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:20.332 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:20.332 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:20.332 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:20.332 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:13:20.333 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:20.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.333 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:13:20.333 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:20.333 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:20.333 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:20.333 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:20.334 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:20.334 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:13:20.334 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:20.334 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.334 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.334 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:13:20.334 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:20.335 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:20.335 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:20.335 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:20.335 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:20.335 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:13:20.335 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:20.335 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.335 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.336 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:13:20.336 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:20.336 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:20.336 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:20.336 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:20.336 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:20.336 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:13:20.336 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:20.337 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.337 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.337 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:13:20.337 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:20.337 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:20.337 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:20.337 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:20.337 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:20.338 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:13:20.338 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:20.338 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.338 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.338 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:13:20.338 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:13:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:13:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:13:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:13:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:13:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:13:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:13:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.339 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:13:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [ 2023-07-09T02:13:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.2a", 2023-07-09T02:13:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.340 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: "pgid": "8.37", 2023-07-09T02:13:20.341 INFO:teuthology.orchestra.run.smithi045.stdout: "mappings": [ 2023-07-09T02:13:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: "from": 0, 2023-07-09T02:13:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: "to": 6 2023-07-09T02:13:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.342 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:13:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:13:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:13:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:13:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:13:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:13:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:13:20.343 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:13:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:13:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:13:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:13:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:13:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:13:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:20.344 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:13:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:13:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:13:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:13:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:13:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:13:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:13:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:13:20.345 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:13:20.346 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:13:20.346 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:13:20.346 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:20.346 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8370066280 msgr2=0x7f8370068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8370066280 0x7f8370068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f83780ad000 tx=0x7f83780a6000 comp rx=0 tx=0).stop 2023-07-09T02:13:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 msgr2=0x7f8390153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f8390153e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f838000d5f0 tx=0x7f838000dab0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 shutdown_connections 2023-07-09T02:13:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f839015c060 0x7f83900ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8370066280 0x7f8370068730 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83900d2450 0x7f839015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 --2- 172.21.15.45:0/3655282057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83900cd120 0x7f8390153e50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 >> 172.21.15.45:0/3655282057 conn(0x7f83900698e0 msgr2=0x7f83900c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 shutdown_connections 2023-07-09T02:13:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.191+0000 7f83961d5640 1 -- 172.21.15.45:0/3655282057 wait complete. 2023-07-09T02:13:20.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.487+0000 7f51f2caf640 1 Processor -- start 2023-07-09T02:13:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f2caf640 1 -- start start 2023-07-09T02:13:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f2caf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51ec0c8d40 0x7f51ec0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f2caf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51ec160670 0x7f51ec0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f2caf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0cd5d0 con 0x7f51ec0b4910 2023-07-09T02:13:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f2caf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0d2050 con 0x7f51ec160670 2023-07-09T02:13:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f2caf640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0d27a0 con 0x7f51ec0c8d40 2023-07-09T02:13:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f14ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51ec160670 0x7f51ec0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f24ae640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f51ec0b4910 0x7f51ec06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46546/0 (socket says 172.21.15.45:46546) 2023-07-09T02:13:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f24ae640 1 -- 172.21.15.45:0/241008893 learned_addr learned my addr 172.21.15.45:0/241008893 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f1cad640 1 --2- 172.21.15.45:0/241008893 >> v2:172.21.15.155:3300/0 conn(0x7f51ec0c8d40 0x7f51ec0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f14ac640 1 -- 172.21.15.45:0/241008893 >> v2:172.21.15.155:3300/0 conn(0x7f51ec0c8d40 msgr2=0x7f51ec0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f14ac640 1 --2- 172.21.15.45:0/241008893 >> v2:172.21.15.155:3300/0 conn(0x7f51ec0c8d40 0x7f51ec0ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f14ac640 1 -- 172.21.15.45:0/241008893 >> v1:172.21.15.45:6789/0 conn(0x7f51ec0b4910 legacy=0x7f51ec06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f14ac640 1 -- 172.21.15.45:0/241008893 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0b4d20 con 0x7f51ec160670 2023-07-09T02:13:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.491+0000 7f51f0cab640 1 -- 172.21.15.45:0/241008893 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541371967 0 0) 0x7f51ec0cd5d0 con 0x7f51ec0b4910 2023-07-09T02:13:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f14ac640 1 --2- 172.21.15.45:0/241008893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0b43d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0b5540 tx=0x7f51dc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bb531303ab1136 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f0cab640 1 -- 172.21.15.45:0/241008893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0a8950 con 0x7f51ec160670 2023-07-09T02:13:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f0cab640 1 -- 172.21.15.45:0/241008893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc0a8ab0 con 0x7f51ec160670 2023-07-09T02:13:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f0cab640 1 -- 172.21.15.45:0/241008893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0a8e40 con 0x7f51ec160670 2023-07-09T02:13:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 -- 172.21.15.45:0/241008893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 msgr2=0x7f51ec0b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 --2- 172.21.15.45:0/241008893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0b43d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0b5540 tx=0x7f51dc01ec50 comp rx=0 tx=0).stop 2023-07-09T02:13:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 -- 172.21.15.45:0/241008893 shutdown_connections 2023-07-09T02:13:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 --2- 172.21.15.45:0/241008893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0b43d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 --2- 172.21.15.45:0/241008893 >> v2:172.21.15.155:3300/0 conn(0x7f51ec0c8d40 0x7f51ec0ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 -- 172.21.15.45:0/241008893 >> 172.21.15.45:0/241008893 conn(0x7f51ec0d2950 msgr2=0x7f51ec0d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 -- 172.21.15.45:0/241008893 shutdown_connections 2023-07-09T02:13:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 -- 172.21.15.45:0/241008893 wait complete. 2023-07-09T02:13:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 Processor -- start 2023-07-09T02:13:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.495+0000 7f51f2caf640 1 -- start start 2023-07-09T02:13:20.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ec0b4910 0x7f51ec14c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51ec0c8d40 0x7f51ec0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec14c590 con 0x7f51ec160670 2023-07-09T02:13:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0cbaa0 con 0x7f51ec0b4910 2023-07-09T02:13:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0ca5e0 con 0x7f51ec0c8d40 2023-07-09T02:13:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36272/0 (socket says 172.21.15.45:36272) 2023-07-09T02:13:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 -- 172.21.15.45:0/4108251018 learned_addr learned my addr 172.21.15.45:0/4108251018 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:20.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f1cad640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ec0b4910 0x7f51ec14c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f14ac640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51ec0c8d40 0x7f51ec0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 -- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51ec0c8d40 msgr2=0x7f51ec0d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51ec0c8d40 0x7f51ec0d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 -- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ec0b4910 msgr2=0x7f51ec14c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ec0b4910 0x7f51ec14c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 -- 172.21.15.45:0/4108251018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc009420 con 0x7f51ec160670 2023-07-09T02:13:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f24ae640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0d09d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f51e4001570 tx=0x7f51e400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51e27fc640 1 -- 172.21.15.45:0/4108251018 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400a640 con 0x7f51ec160670 2023-07-09T02:13:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51e27fc640 1 -- 172.21.15.45:0/4108251018 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400a7c0 con 0x7f51ec160670 2023-07-09T02:13:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51e27fc640 1 -- 172.21.15.45:0/4108251018 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400ab70 con 0x7f51ec160670 2023-07-09T02:13:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0cbd40 con 0x7f51ec160670 2023-07-09T02:13:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec0cc300 con 0x7f51ec160670 2023-07-09T02:13:20.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.499+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec04e020 con 0x7f51ec160670 2023-07-09T02:13:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.503+0000 7f51e27fc640 1 -- 172.21.15.45:0/4108251018 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51e400acd0 con 0x7f51ec160670 2023-07-09T02:13:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.503+0000 7f51e27fc640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51d0066280 0x7f51d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.503+0000 7f51e27fc640 1 -- 172.21.15.45:0/4108251018 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f51e4083320 con 0x7f51ec160670 2023-07-09T02:13:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.503+0000 7f51f1cad640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51d0066280 0x7f51d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.503+0000 7f51f1cad640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51d0066280 0x7f51d0068730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009b60 tx=0x7f51e8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.507+0000 7f51e27fc640 1 -- 172.21.15.45:0/4108251018 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51e4050770 con 0x7f51ec160670 2023-07-09T02:13:20.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51ec15f910 con 0x7f51ec160670 2023-07-09T02:13:20.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51e27fc640 1 -- 172.21.15.45:0/4108251018 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f51e4053d90 con 0x7f51ec160670 2023-07-09T02:13:20.698 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:20.698 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:13:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:13:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51d0066280 msgr2=0x7f51d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51d0066280 0x7f51d0068730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009b60 tx=0x7f51e8009190 comp rx=0 tx=0).stop 2023-07-09T02:13:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 msgr2=0x7f51ec0d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0d09d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f51e4001570 tx=0x7f51e400cca0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 shutdown_connections 2023-07-09T02:13:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51ec160670 0x7f51ec0d09d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51d0066280 0x7f51d0068730 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51ec0c8d40 0x7f51ec0d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 --2- 172.21.15.45:0/4108251018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ec0b4910 0x7f51ec14c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 >> 172.21.15.45:0/4108251018 conn(0x7f51ec0d2950 msgr2=0x7f51ec0c83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 shutdown_connections 2023-07-09T02:13:20.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:20.695+0000 7f51f2caf640 1 -- 172.21.15.45:0/4108251018 wait complete. 2023-07-09T02:13:20.718 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-07-09T02:13:20.882 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":5628,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":32.939061541000001,"mdsmap_epoch":25,"osdmap_epoch":57,"osdmap_epoch_barrier":53,"uptime":38.700333653000001} 2023-07-09T02:13:20.883 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 5628, "mdsmap_epoch": 25, "osdmap_epoch": 57, "osdmap_epoch_barrier": 53, "rank_uptime": 32.939061541, "state": "up:active", "uptime": 38.700333653, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:13:20.883 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:13:20.883 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:20.884 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:20.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:20.893 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-07-09T02:13:21.329 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records in 2023-07-09T02:13:21.329 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records out 2023-07-09T02:13:21.330 INFO:teuthology.orchestra.run.smithi045.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.383739 s, 137 MB/s 2023-07-09T02:13:21.330 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:13:21.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:13:21.399 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:13:21.463 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:13:21.463 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:21.464 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:21.473 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:21.473 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:21.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f41c5640 1 Processor -- start 2023-07-09T02:13:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f41c5640 1 -- start start 2023-07-09T02:13:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f41c5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4ec15c060 0x7fa4ec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f41c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4ec0cd120 0x7fa4ec0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f41c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec0d2450 0x7fa4ec0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f41c5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec0d28f0 con 0x7fa4ec15c060 2023-07-09T02:13:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f41c5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec160a50 con 0x7fa4ec0cd120 2023-07-09T02:13:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f41c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec15c430 con 0x7fa4ec0d2450 2023-07-09T02:13:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1f61640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4ec15c060 0x7fa4ec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1f61640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4ec15c060 0x7fa4ec0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49196/0 (socket says 172.21.15.45:49196) 2023-07-09T02:13:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1f61640 1 -- 172.21.15.45:0/529841824 learned_addr learned my addr 172.21.15.45:0/529841824 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1f61640 1 -- 172.21.15.45:0/529841824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec0d2450 msgr2=0x7fa4ec0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f2762640 1 --2- 172.21.15.45:0/529841824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec0d2450 0x7fa4ec0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1760640 1 --2- 172.21.15.45:0/529841824 >> v2:172.21.15.155:3300/0 conn(0x7fa4ec0cd120 0x7fa4ec0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1f61640 1 --2- 172.21.15.45:0/529841824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec0d2450 0x7fa4ec0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1f61640 1 -- 172.21.15.45:0/529841824 >> v2:172.21.15.155:3300/0 conn(0x7fa4ec0cd120 msgr2=0x7fa4ec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1f61640 1 --2- 172.21.15.45:0/529841824 >> v2:172.21.15.155:3300/0 conn(0x7fa4ec0cd120 0x7fa4ec0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1f61640 1 -- 172.21.15.45:0/529841824 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec15fb60 con 0x7fa4ec15c060 2023-07-09T02:13:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f2762640 1 --2- 172.21.15.45:0/529841824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec0d2450 0x7fa4ec0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.707+0000 7fa4f1760640 1 --2- 172.21.15.45:0/529841824 >> v2:172.21.15.155:3300/0 conn(0x7fa4ec0cd120 0x7fa4ec0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f1f61640 1 --2- 172.21.15.45:0/529841824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec15c060 0x7fa4ec0b4ed0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec15fac0 tx=0x7fa4e801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e109d3a8942a212d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f0f5f640 1 -- 172.21.15.45:0/529841824 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80ab600 con 0x7fa4ec15c060 2023-07-09T02:13:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f0f5f640 1 -- 172.21.15.45:0/529841824 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e80a7050 con 0x7fa4ec15c060 2023-07-09T02:13:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f0f5f640 1 -- 172.21.15.45:0/529841824 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80ab980 con 0x7fa4ec15c060 2023-07-09T02:13:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 -- 172.21.15.45:0/529841824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec15c060 msgr2=0x7fa4ec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/529841824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec15c060 0x7fa4ec0b4ed0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec15fac0 tx=0x7fa4e801c210 comp rx=0 tx=0).stop 2023-07-09T02:13:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 -- 172.21.15.45:0/529841824 shutdown_connections 2023-07-09T02:13:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/529841824 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec0d2450 0x7fa4ec0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/529841824 >> v2:172.21.15.155:3300/0 conn(0x7fa4ec0cd120 0x7fa4ec0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/529841824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec15c060 0x7fa4ec0b4ed0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 -- 172.21.15.45:0/529841824 >> 172.21.15.45:0/529841824 conn(0x7fa4ec0698e0 msgr2=0x7fa4ec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 -- 172.21.15.45:0/529841824 shutdown_connections 2023-07-09T02:13:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.711+0000 7fa4f41c5640 1 -- 172.21.15.45:0/529841824 wait complete. 2023-07-09T02:13:21.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 Processor -- start 2023-07-09T02:13:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 -- start start 2023-07-09T02:13:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec0cd120 0x7fa4ec15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4ec0d2450 0x7fa4ec0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec15c060 0x7fa4ec14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec151050 con 0x7fa4ec0cd120 2023-07-09T02:13:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0b8340 con 0x7fa4ec0d2450 2023-07-09T02:13:21.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0b8620 con 0x7fa4ec15c060 2023-07-09T02:13:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec0cd120 0x7fa4ec15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec0cd120 0x7fa4ec15b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49210/0 (socket says 172.21.15.45:49210) 2023-07-09T02:13:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 -- 172.21.15.45:0/3344597502 learned_addr learned my addr 172.21.15.45:0/3344597502 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1760640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4ec0d2450 0x7fa4ec0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f2762640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec15c060 0x7fa4ec14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 -- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec15c060 msgr2=0x7fa4ec14fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:21.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec15c060 0x7fa4ec14fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 -- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4ec0d2450 msgr2=0x7fa4ec0b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:21.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4ec0d2450 0x7fa4ec0b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 -- 172.21.15.45:0/3344597502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80094d0 con 0x7fa4ec0cd120 2023-07-09T02:13:21.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f1f61640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec0cd120 0x7fa4ec15b2b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80ae040 tx=0x7fa4e801aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:21.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4e27fc640 1 -- 172.21.15.45:0/3344597502 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80b6620 con 0x7fa4ec0cd120 2023-07-09T02:13:21.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4e27fc640 1 -- 172.21.15.45:0/3344597502 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e80b67a0 con 0x7fa4ec0cd120 2023-07-09T02:13:21.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4e27fc640 1 -- 172.21.15.45:0/3344597502 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80b6b50 con 0x7fa4ec0cd120 2023-07-09T02:13:21.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec1512a0 con 0x7fa4ec0cd120 2023-07-09T02:13:21.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.715+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec15b7f0 con 0x7fa4ec0cd120 2023-07-09T02:13:21.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.719+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec04d7d0 con 0x7fa4ec0cd120 2023-07-09T02:13:21.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.719+0000 7fa4e27fc640 1 -- 172.21.15.45:0/3344597502 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4e80b2040 con 0x7fa4ec0cd120 2023-07-09T02:13:21.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.719+0000 7fa4e27fc640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa4d0066280 0x7fa4d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:21.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.719+0000 7fa4e27fc640 1 -- 172.21.15.45:0/3344597502 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa4e811de80 con 0x7fa4ec0cd120 2023-07-09T02:13:21.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.719+0000 7fa4f1760640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa4d0066280 0x7fa4d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:21.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.719+0000 7fa4f1760640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa4d0066280 0x7fa4d0068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0b3990 tx=0x7fa4dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:21.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.723+0000 7fa4e27fc640 1 -- 172.21.15.45:0/3344597502 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4e80eb2d0 con 0x7fa4ec0cd120 2023-07-09T02:13:21.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.879+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4ec06baa0 con 0x7fa4ec0cd120 2023-07-09T02:13:21.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.879+0000 7fa4e27fc640 1 -- 172.21.15.45:0/3344597502 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18447 (secure 0 0 0) 0x7fa4e80ee8f0 con 0x7fa4ec0cd120 2023-07-09T02:13:21.883 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:21.884 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:16.309432+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:45.075187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:46.325197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.37","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:21.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa4d0066280 msgr2=0x7fa4d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:21.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa4d0066280 0x7fa4d0068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0b3990 tx=0x7fa4dc008040 comp rx=0 tx=0).stop 2023-07-09T02:13:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec0cd120 msgr2=0x7fa4ec15b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec0cd120 0x7fa4ec15b2b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80ae040 tx=0x7fa4e801aa50 comp rx=0 tx=0).stop 2023-07-09T02:13:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 shutdown_connections 2023-07-09T02:13:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa4d0066280 0x7fa4d0068730 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4ec15c060 0x7fa4ec14fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4ec0d2450 0x7fa4ec0b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 --2- 172.21.15.45:0/3344597502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4ec0cd120 0x7fa4ec15b2b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:21.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 >> 172.21.15.45:0/3344597502 conn(0x7fa4ec0698e0 msgr2=0x7fa4ec0b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:21.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 shutdown_connections 2023-07-09T02:13:21.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:21.883+0000 7fa4f41c5640 1 -- 172.21.15.45:0/3344597502 wait complete. 2023-07-09T02:13:21.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:12:45.075187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:12:46.325197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:13:21.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:13:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.047+0000 7f72a303a640 1 Processor -- start 2023-07-09T02:13:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.047+0000 7f72a303a640 1 -- start start 2023-07-09T02:13:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a303a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f729c0b1bc0 0x7f729c069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a303a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f729c0b68b0 0x7f729c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a303a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c0ceff0 con 0x7f729c0d2400 2023-07-09T02:13:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a303a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c0cea70 con 0x7f729c0b1bc0 2023-07-09T02:13:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a303a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c0b1f90 con 0x7f729c0b68b0 2023-07-09T02:13:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2038640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f729c0b1bc0 0x7f729c069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2038640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f729c0b1bc0 0x7f729c069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49214/0 (socket says 172.21.15.45:49214) 2023-07-09T02:13:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2038640 1 -- 172.21.15.45:0/75885547 learned_addr learned my addr 172.21.15.45:0/75885547 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2038640 1 -- 172.21.15.45:0/75885547 >> v2:172.21.15.155:3300/0 conn(0x7f729c0b68b0 msgr2=0x7f729c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2839640 1 --2- 172.21.15.45:0/75885547 >> v2:172.21.15.155:3300/0 conn(0x7f729c0b68b0 0x7f729c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2038640 1 --2- 172.21.15.45:0/75885547 >> v2:172.21.15.155:3300/0 conn(0x7f729c0b68b0 0x7f729c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2038640 1 -- 172.21.15.45:0/75885547 >> v1:172.21.15.155:6789/0 conn(0x7f729c0d2400 legacy=0x7f729c070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2038640 1 -- 172.21.15.45:0/75885547 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0d1500 con 0x7f729c0b1bc0 2023-07-09T02:13:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.051+0000 7f72a2839640 1 --2- 172.21.15.45:0/75885547 >> v2:172.21.15.155:3300/0 conn(0x7f729c0b68b0 0x7f729c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:22.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a2038640 1 --2- 172.21.15.45:0/75885547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b1bc0 0x7f729c069870 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f729c066170 tx=0x7f729801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da315f9456320eba server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a1036640 1 -- 172.21.15.45:0/75885547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72980aa5f0 con 0x7f729c0b1bc0 2023-07-09T02:13:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a1036640 1 -- 172.21.15.45:0/75885547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72980aa750 con 0x7f729c0b1bc0 2023-07-09T02:13:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a1036640 1 -- 172.21.15.45:0/75885547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72980aaae0 con 0x7f729c0b1bc0 2023-07-09T02:13:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- 172.21.15.45:0/75885547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b1bc0 msgr2=0x7f729c069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 --2- 172.21.15.45:0/75885547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b1bc0 0x7f729c069870 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f729c066170 tx=0x7f729801c490 comp rx=0 tx=0).stop 2023-07-09T02:13:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- 172.21.15.45:0/75885547 shutdown_connections 2023-07-09T02:13:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 --2- 172.21.15.45:0/75885547 >> v2:172.21.15.155:3300/0 conn(0x7f729c0b68b0 0x7f729c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 --2- 172.21.15.45:0/75885547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b1bc0 0x7f729c069870 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- 172.21.15.45:0/75885547 >> 172.21.15.45:0/75885547 conn(0x7f729c0d35b0 msgr2=0x7f729c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- 172.21.15.45:0/75885547 shutdown_connections 2023-07-09T02:13:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- 172.21.15.45:0/75885547 wait complete. 2023-07-09T02:13:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 Processor -- start 2023-07-09T02:13:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- start start 2023-07-09T02:13:22.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0b1bc0 0x7f729c0c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b68b0 0x7f729c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0d2400 0x7f729c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1555f0 con 0x7f729c0b68b0 2023-07-09T02:13:22.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0ca050 con 0x7f729c0d2400 2023-07-09T02:13:22.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.055+0000 7f72a303a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0ca330 con 0x7f729c0b1bc0 2023-07-09T02:13:22.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b68b0 0x7f729c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b68b0 0x7f729c15e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49218/0 (socket says 172.21.15.45:49218) 2023-07-09T02:13:22.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a2038640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0b1bc0 0x7f729c0c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 -- 172.21.15.45:0/3558915997 learned_addr learned my addr 172.21.15.45:0/3558915997 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:22.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a2839640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0d2400 0x7f729c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 -- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0b1bc0 msgr2=0x7f729c0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0b1bc0 0x7f729c0c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 -- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0d2400 msgr2=0x7f729c1550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0d2400 0x7f729c1550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 -- 172.21.15.45:0/3558915997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980094d0 con 0x7f729c0b68b0 2023-07-09T02:13:22.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a1837640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b68b0 0x7f729c15e9e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f728c00b3e0 tx=0x7f728c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f7292ffd640 1 -- 172.21.15.45:0/3558915997 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c011830 con 0x7f729c0b68b0 2023-07-09T02:13:22.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f7292ffd640 1 -- 172.21.15.45:0/3558915997 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c011990 con 0x7f729c0b68b0 2023-07-09T02:13:22.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f7292ffd640 1 -- 172.21.15.45:0/3558915997 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c011d80 con 0x7f729c0b68b0 2023-07-09T02:13:22.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c0ca610 con 0x7f729c0b68b0 2023-07-09T02:13:22.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c0cabd0 con 0x7f729c0b68b0 2023-07-09T02:13:22.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c04e020 con 0x7f729c0b68b0 2023-07-09T02:13:22.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.059+0000 7f7292ffd640 1 -- 172.21.15.45:0/3558915997 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f728c01a400 con 0x7f729c0b68b0 2023-07-09T02:13:22.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.063+0000 7f7292ffd640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7280066280 0x7f7280068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.063+0000 7f7292ffd640 1 -- 172.21.15.45:0/3558915997 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f728c083b00 con 0x7f729c0b68b0 2023-07-09T02:13:22.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.063+0000 7f72a2038640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7280066280 0x7f7280068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.063+0000 7f72a2038640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7280066280 0x7f7280068730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f72980ae000 tx=0x7f72980b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.063+0000 7f7292ffd640 1 -- 172.21.15.45:0/3558915997 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f728c085e60 con 0x7f729c0b68b0 2023-07-09T02:13:22.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f729c0b6d00 con 0x7f729c0b68b0 2023-07-09T02:13:22.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f7292ffd640 1 -- 172.21.15.45:0/3558915997 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f728c050fe0 con 0x7f729c0b68b0 2023-07-09T02:13:22.223 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:13:22.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7280066280 msgr2=0x7f7280068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7280066280 0x7f7280068730 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f72980ae000 tx=0x7f72980b5040 comp rx=0 tx=0).stop 2023-07-09T02:13:22.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b68b0 msgr2=0x7f729c15e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b68b0 0x7f729c15e9e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f728c00b3e0 tx=0x7f728c00b8a0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 shutdown_connections 2023-07-09T02:13:22.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f729c0d2400 0x7f729c1550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f729c0b68b0 0x7f729c15e9e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7280066280 0x7f7280068730 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 --2- 172.21.15.45:0/3558915997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f729c0b1bc0 0x7f729c0c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 >> 172.21.15.45:0/3558915997 conn(0x7f729c0d35b0 msgr2=0x7f729c0d1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:22.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.219+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 shutdown_connections 2023-07-09T02:13:22.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.223+0000 7f72a303a640 1 -- 172.21.15.45:0/3558915997 wait complete. 2023-07-09T02:13:22.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:13:22.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0dcb59640 1 Processor -- start 2023-07-09T02:13:22.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0dcb59640 1 -- start start 2023-07-09T02:13:22.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0dcb59640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0d806c110 0x7fe0d806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0dcb59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d80caec0 0x7fe0d80cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0dcb59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d806caa0 con 0x7fe0d8158e30 2023-07-09T02:13:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0dcb59640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d80ccf80 con 0x7fe0d806c110 2023-07-09T02:13:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0dcb59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d80cd540 con 0x7fe0d80caec0 2023-07-09T02:13:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0cffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0d806c110 0x7fe0d806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0cffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0d806c110 0x7fe0d806c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:45910/0 (socket says 172.21.15.45:45910) 2023-07-09T02:13:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0d6d9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d80caec0 0x7fe0d80cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0cffff640 1 -- 172.21.15.45:0/4159112203 learned_addr learned my addr 172.21.15.45:0/4159112203 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0cffff640 1 -- 172.21.15.45:0/4159112203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d80caec0 msgr2=0x7fe0d80cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:22.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0cffff640 1 --2- 172.21.15.45:0/4159112203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d80caec0 0x7fe0d80cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0cffff640 1 -- 172.21.15.45:0/4159112203 >> v1:172.21.15.155:6789/0 conn(0x7fe0d8158e30 legacy=0x7fe0d806f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.387+0000 7fe0cffff640 1 -- 172.21.15.45:0/4159112203 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80cb880 con 0x7fe0d806c110 2023-07-09T02:13:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0cffff640 1 --2- 172.21.15.45:0/4159112203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d806c110 0x7fe0d806c560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009870 tx=0x7fe0c001e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aad4a5ccb2524f08 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0d5d9b640 1 -- 172.21.15.45:0/4159112203 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00a8660 con 0x7fe0d806c110 2023-07-09T02:13:22.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0d5d9b640 1 -- 172.21.15.45:0/4159112203 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c00a87c0 con 0x7fe0d806c110 2023-07-09T02:13:22.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0d5d9b640 1 -- 172.21.15.45:0/4159112203 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00a8b50 con 0x7fe0d806c110 2023-07-09T02:13:22.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0dcb59640 1 -- 172.21.15.45:0/4159112203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d806c110 msgr2=0x7fe0d806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/4159112203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d806c110 0x7fe0d806c560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009870 tx=0x7fe0c001e690 comp rx=0 tx=0).stop 2023-07-09T02:13:22.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0dcb59640 1 -- 172.21.15.45:0/4159112203 shutdown_connections 2023-07-09T02:13:22.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/4159112203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d80caec0 0x7fe0d80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/4159112203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d806c110 0x7fe0d806c560 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0dcb59640 1 -- 172.21.15.45:0/4159112203 >> 172.21.15.45:0/4159112203 conn(0x7fe0d80694b0 msgr2=0x7fe0d80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:22.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0dcb59640 1 -- 172.21.15.45:0/4159112203 shutdown_connections 2023-07-09T02:13:22.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.391+0000 7fe0dcb59640 1 -- 172.21.15.45:0/4159112203 wait complete. 2023-07-09T02:13:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 Processor -- start 2023-07-09T02:13:22.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 -- start start 2023-07-09T02:13:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d806c110 0x7fe0d8149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d80caec0 0x7fe0d815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d8158e30 0x7fe0d80c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d81599e0 con 0x7fe0d80caec0 2023-07-09T02:13:22.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d814eed0 con 0x7fe0d8158e30 2023-07-09T02:13:22.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d81572f0 con 0x7fe0d806c110 2023-07-09T02:13:22.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d80caec0 0x7fe0d815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d80caec0 0x7fe0d815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49220/0 (socket says 172.21.15.45:49220) 2023-07-09T02:13:22.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 -- 172.21.15.45:0/1989200099 learned_addr learned my addr 172.21.15.45:0/1989200099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:22.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0d659c640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d806c110 0x7fe0d8149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0d6d9d640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d8158e30 0x7fe0d80c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 -- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d806c110 msgr2=0x7fe0d8149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d806c110 0x7fe0d8149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 -- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d8158e30 msgr2=0x7fe0d80c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d8158e30 0x7fe0d80c39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 -- 172.21.15.45:0/1989200099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00094d0 con 0x7fe0d80caec0 2023-07-09T02:13:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0d6d9d640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d8158e30 0x7fe0d80c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:22.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0d659c640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d806c110 0x7fe0d8149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0cffff640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d80caec0 0x7fe0d815afe0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe0c001cd40 tx=0x7fe0c001b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0ceffd640 1 -- 172.21.15.45:0/1989200099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00b3860 con 0x7fe0d80caec0 2023-07-09T02:13:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0ceffd640 1 -- 172.21.15.45:0/1989200099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c00b39c0 con 0x7fe0d80caec0 2023-07-09T02:13:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0ceffd640 1 -- 172.21.15.45:0/1989200099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00b3d50 con 0x7fe0d80caec0 2023-07-09T02:13:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.395+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d81575d0 con 0x7fe0d80caec0 2023-07-09T02:13:22.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.399+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d8157b90 con 0x7fe0d80caec0 2023-07-09T02:13:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.399+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d804d7d0 con 0x7fe0d80caec0 2023-07-09T02:13:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.399+0000 7fe0ceffd640 1 -- 172.21.15.45:0/1989200099 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0c00bd450 con 0x7fe0d80caec0 2023-07-09T02:13:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.399+0000 7fe0ceffd640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0b8066280 0x7fe0b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.399+0000 7fe0ceffd640 1 -- 172.21.15.45:0/1989200099 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe0c011e120 con 0x7fe0d80caec0 2023-07-09T02:13:22.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.399+0000 7fe0d659c640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0b8066280 0x7fe0b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.403+0000 7fe0d659c640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0b8066280 0x7fe0b8068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8000f70 tx=0x7fe0c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.403+0000 7fe0ceffd640 1 -- 172.21.15.45:0/1989200099 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0c00eb550 con 0x7fe0d80caec0 2023-07-09T02:13:22.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.559+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe0d814a930 con 0x7fe0d80caec0 2023-07-09T02:13:22.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0ceffd640 1 -- 172.21.15.45:0/1989200099 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0c00eeb70 con 0x7fe0d80caec0 2023-07-09T02:13:22.565 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:13:22.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0b8066280 msgr2=0x7fe0b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0b8066280 0x7fe0b8068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8000f70 tx=0x7fe0c8009040 comp rx=0 tx=0).stop 2023-07-09T02:13:22.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d80caec0 msgr2=0x7fe0d815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d80caec0 0x7fe0d815afe0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe0c001cd40 tx=0x7fe0c001b430 comp rx=0 tx=0).stop 2023-07-09T02:13:22.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 shutdown_connections 2023-07-09T02:13:22.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0d8158e30 0x7fe0d80c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0d80caec0 0x7fe0d815afe0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0b8066280 0x7fe0b8068730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 --2- 172.21.15.45:0/1989200099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0d806c110 0x7fe0d8149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 >> 172.21.15.45:0/1989200099 conn(0x7fe0d80694b0 msgr2=0x7fe0d80ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:22.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 shutdown_connections 2023-07-09T02:13:22.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.563+0000 7fe0dcb59640 1 -- 172.21.15.45:0/1989200099 wait complete. 2023-07-09T02:13:22.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:13:22.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.727+0000 7fab7e798640 1 Processor -- start 2023-07-09T02:13:22.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.727+0000 7fab7e798640 1 -- start start 2023-07-09T02:13:22.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7e798640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab78069f80 0x7fab780b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7e798640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780ceff0 con 0x7fab780d2400 2023-07-09T02:13:22.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7e798640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780d1500 con 0x7fab780b1bc0 2023-07-09T02:13:22.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7e798640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab780cea70 con 0x7fab78069f80 2023-07-09T02:13:22.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7df97640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fab780d2400 0x7fab780b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55580/0 (socket says 172.21.15.45:55580) 2023-07-09T02:13:22.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7df97640 1 -- 172.21.15.45:0/1464177526 learned_addr learned my addr 172.21.15.45:0/1464177526 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7cf95640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab78069f80 0x7fab780b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310435384 0 0) 0x7fab780ceff0 con 0x7fab780d2400 2023-07-09T02:13:22.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab64003530 con 0x7fab780d2400 2023-07-09T02:13:22.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192671897 0 0) 0x7fab64003530 con 0x7fab780d2400 2023-07-09T02:13:22.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab78069f80 msgr2=0x7fab780b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:22.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab78069f80 0x7fab780b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 >> v1:172.21.15.155:6789/0 conn(0x7fab780b1bc0 legacy=0x7fab78069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab780d0f40 con 0x7fab780d2400 2023-07-09T02:13:22.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fab70001a00 con 0x7fab780d2400 2023-07-09T02:13:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 >> v1:172.21.15.45:6789/0 conn(0x7fab780d2400 legacy=0x7fab780b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab640039b0 0x7fab64003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab64004300 0x7fab640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64004fd0 0x7fab6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780cea70 con 0x7fab64004300 2023-07-09T02:13:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6400bed0 con 0x7fab64004fd0 2023-07-09T02:13:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6400c090 con 0x7fab640039b0 2023-07-09T02:13:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7cf95640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab64004300 0x7fab640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7d796640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab640039b0 0x7fab64003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7df97640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64004fd0 0x7fab6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7cf95640 1 -- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab640039b0 msgr2=0x7fab64003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7cf95640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab640039b0 0x7fab64003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7cf95640 1 -- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64004fd0 msgr2=0x7fab6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7cf95640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab64004fd0 0x7fab6400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.731+0000 7fab7cf95640 1 -- 172.21.15.45:0/1464177526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64003530 con 0x7fab64004300 2023-07-09T02:13:22.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7cf95640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab64004300 0x7fab640047d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fab780ce220 tx=0x7fab6801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f424a78554581a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680ad460 con 0x7fab64004300 2023-07-09T02:13:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab680ad5c0 con 0x7fab64004300 2023-07-09T02:13:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab6ffff640 1 -- 172.21.15.45:0/1464177526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680ad970 con 0x7fab64004300 2023-07-09T02:13:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7e798640 1 -- 172.21.15.45:0/1464177526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab64004300 msgr2=0x7fab640047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7e798640 1 --2- 172.21.15.45:0/1464177526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab64004300 0x7fab640047d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fab780ce220 tx=0x7fab6801c8f0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7df97640 1 -- 172.21.15.45:0/1464177526 reap_dead start 2023-07-09T02:13:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7e798640 1 -- 172.21.15.45:0/1464177526 shutdown_connections 2023-07-09T02:13:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7e798640 1 -- 172.21.15.45:0/1464177526 >> 172.21.15.45:0/1464177526 conn(0x7fab780d35b0 msgr2=0x7fab780cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7e798640 1 -- 172.21.15.45:0/1464177526 shutdown_connections 2023-07-09T02:13:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7e798640 1 -- 172.21.15.45:0/1464177526 wait complete. 2023-07-09T02:13:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.735+0000 7fab7e798640 1 Processor -- start 2023-07-09T02:13:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 -- start start 2023-07-09T02:13:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab64004300 0x7fab780cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab78151a10 0x7fab78155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab78151e60 0x7fab780b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780cc5f0 con 0x7fab78151a10 2023-07-09T02:13:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780cc8d0 con 0x7fab78151e60 2023-07-09T02:13:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7815da90 con 0x7fab64004300 2023-07-09T02:13:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab78151a10 0x7fab78155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab78151a10 0x7fab78155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49244/0 (socket says 172.21.15.45:49244) 2023-07-09T02:13:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 -- 172.21.15.45:0/2087994275 learned_addr learned my addr 172.21.15.45:0/2087994275 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7d796640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab64004300 0x7fab780cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7df97640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab78151e60 0x7fab780b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 -- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab64004300 msgr2=0x7fab780cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab64004300 0x7fab780cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 -- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab78151e60 msgr2=0x7fab780b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab78151e60 0x7fab780b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 -- 172.21.15.45:0/2087994275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7815dd70 con 0x7fab78151a10 2023-07-09T02:13:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7d796640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab64004300 0x7fab780cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7df97640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab78151e60 0x7fab780b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7cf95640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab78151a10 0x7fab78155230 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fab680b0040 tx=0x7fab64005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab6dffb640 1 -- 172.21.15.45:0/2087994275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68004500 con 0x7fab78151a10 2023-07-09T02:13:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab6dffb640 1 -- 172.21.15.45:0/2087994275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab680059a0 con 0x7fab78151a10 2023-07-09T02:13:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab6dffb640 1 -- 172.21.15.45:0/2087994275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68005d70 con 0x7fab78151a10 2023-07-09T02:13:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab78155770 con 0x7fab78151a10 2023-07-09T02:13:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab780b31a0 con 0x7fab78151a10 2023-07-09T02:13:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.739+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab78155960 con 0x7fab78151a10 2023-07-09T02:13:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.743+0000 7fab6dffb640 1 -- 172.21.15.45:0/2087994275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab680ad940 con 0x7fab78151a10 2023-07-09T02:13:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.743+0000 7fab6dffb640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab5c0662b0 0x7fab5c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:22.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.743+0000 7fab6dffb640 1 -- 172.21.15.45:0/2087994275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fab6811e100 con 0x7fab78151a10 2023-07-09T02:13:22.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.743+0000 7fab7d796640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab5c0662b0 0x7fab5c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:22.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.743+0000 7fab7d796640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab5c0662b0 0x7fab5c068760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fab74007990 tx=0x7fab74007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.747+0000 7fab6dffb640 1 -- 172.21.15.45:0/2087994275 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab680eefc0 con 0x7fab78151a10 2023-07-09T02:13:22.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.899+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab7815d8f0 con 0x7fab78151a10 2023-07-09T02:13:22.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.899+0000 7fab6dffb640 1 -- 172.21.15.45:0/2087994275 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab7815d8f0 con 0x7fab78151a10 2023-07-09T02:13:22.904 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:13:22.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab5c0662b0 msgr2=0x7fab5c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab5c0662b0 0x7fab5c068760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fab74007990 tx=0x7fab74007920 comp rx=0 tx=0).stop 2023-07-09T02:13:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab78151a10 msgr2=0x7fab78155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab78151a10 0x7fab78155230 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fab680b0040 tx=0x7fab64005800 comp rx=0 tx=0).stop 2023-07-09T02:13:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 shutdown_connections 2023-07-09T02:13:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab78151e60 0x7fab780b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab78151a10 0x7fab78155230 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab5c0662b0 0x7fab5c068760 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 --2- 172.21.15.45:0/2087994275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab64004300 0x7fab780cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:22.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 >> 172.21.15.45:0/2087994275 conn(0x7fab780d35b0 msgr2=0x7fab78069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:22.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 shutdown_connections 2023-07-09T02:13:22.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:22.903+0000 7fab7e798640 1 -- 172.21.15.45:0/2087994275 wait complete. 2023-07-09T02:13:22.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:13:23.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.067+0000 7fb20169c640 1 Processor -- start 2023-07-09T02:13:23.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.067+0000 7fb20169c640 1 -- start start 2023-07-09T02:13:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb20169c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1fc070ca0 0x7fb1fc15c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb20169c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc0694b0 0x7fb1fc0698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb20169c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc0cf340 con 0x7fb1fc06c6f0 2023-07-09T02:13:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb20169c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc069e10 con 0x7fb1fc070ca0 2023-07-09T02:13:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb20169c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc06d290 con 0x7fb1fc0694b0 2023-07-09T02:13:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1fa7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1fc070ca0 0x7fb1fc15c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1faffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb1fc06c6f0 0x7fb1fc06cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55584/0 (socket says 172.21.15.45:55584) 2023-07-09T02:13:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1faffd640 1 -- 172.21.15.45:0/3567307809 learned_addr learned my addr 172.21.15.45:0/3567307809 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/3567307809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc0694b0 0x7fb1fc0698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1fa7fc640 1 -- 172.21.15.45:0/3567307809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc0694b0 msgr2=0x7fb1fc0698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1fa7fc640 1 --2- 172.21.15.45:0/3567307809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc0694b0 0x7fb1fc0698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1fa7fc640 1 -- 172.21.15.45:0/3567307809 >> v1:172.21.15.45:6789/0 conn(0x7fb1fc06c6f0 legacy=0x7fb1fc06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1fa7fc640 1 -- 172.21.15.45:0/3567307809 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc06d570 con 0x7fb1fc070ca0 2023-07-09T02:13:23.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.071+0000 7fb1f9ffb640 1 -- 172.21.15.45:0/3567307809 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877633383 0 0) 0x7fb1fc0cf340 con 0x7fb1fc06c6f0 2023-07-09T02:13:23.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb1fa7fc640 1 --2- 172.21.15.45:0/3567307809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc15c6c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00097c0 tx=0x7fb1f001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bb287eb7d5cc67 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb1f9ffb640 1 -- 172.21.15.45:0/3567307809 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00ac620 con 0x7fb1fc070ca0 2023-07-09T02:13:23.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb1f9ffb640 1 -- 172.21.15.45:0/3567307809 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00ac780 con 0x7fb1fc070ca0 2023-07-09T02:13:23.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb1f9ffb640 1 -- 172.21.15.45:0/3567307809 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00acb10 con 0x7fb1fc070ca0 2023-07-09T02:13:23.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- 172.21.15.45:0/3567307809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 msgr2=0x7fb1fc15c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 --2- 172.21.15.45:0/3567307809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc15c6c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00097c0 tx=0x7fb1f001c3c0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- 172.21.15.45:0/3567307809 shutdown_connections 2023-07-09T02:13:23.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 --2- 172.21.15.45:0/3567307809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc0694b0 0x7fb1fc0698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 --2- 172.21.15.45:0/3567307809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc15c6c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- 172.21.15.45:0/3567307809 >> 172.21.15.45:0/3567307809 conn(0x7fb1fc0650b0 msgr2=0x7fb1fc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:23.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- 172.21.15.45:0/3567307809 shutdown_connections 2023-07-09T02:13:23.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- 172.21.15.45:0/3567307809 wait complete. 2023-07-09T02:13:23.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 Processor -- start 2023-07-09T02:13:23.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- start start 2023-07-09T02:13:23.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1fc0694b0 0x7fb1fc14f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc06c6f0 0x7fb1fc151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1571d0 con 0x7fb1fc070ca0 2023-07-09T02:13:23.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1574b0 con 0x7fb1fc0694b0 2023-07-09T02:13:23.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.075+0000 7fb20169c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc157790 con 0x7fb1fc06c6f0 2023-07-09T02:13:23.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc14ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49260/0 (socket says 172.21.15.45:49260) 2023-07-09T02:13:23.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/2836910060 learned_addr learned my addr 172.21.15.45:0/2836910060 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:23.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1faffd640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1fc0694b0 0x7fb1fc14f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fa7fc640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc06c6f0 0x7fb1fc151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc06c6f0 msgr2=0x7fb1fc151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc06c6f0 0x7fb1fc151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1fc0694b0 msgr2=0x7fb1fc14f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1fc0694b0 0x7fb1fc14f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 -- 172.21.15.45:0/2836910060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009420 con 0x7fb1fc070ca0 2023-07-09T02:13:23.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fa7fc640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc06c6f0 0x7fb1fc151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:23.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1faffd640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1fc0694b0 0x7fb1fc14f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:23.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1fb7fe640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc14ee80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4007e60 tx=0x7fb1f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1e37fe640 1 -- 172.21.15.45:0/2836910060 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4014420 con 0x7fb1fc070ca0 2023-07-09T02:13:23.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1e37fe640 1 -- 172.21.15.45:0/2836910060 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f40145a0 con 0x7fb1fc070ca0 2023-07-09T02:13:23.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1e37fe640 1 -- 172.21.15.45:0/2836910060 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4014950 con 0x7fb1fc070ca0 2023-07-09T02:13:23.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc157a70 con 0x7fb1fc070ca0 2023-07-09T02:13:23.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc14f3c0 con 0x7fb1fc070ca0 2023-07-09T02:13:23.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc071380 con 0x7fb1fc070ca0 2023-07-09T02:13:23.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.079+0000 7fb1e37fe640 1 -- 172.21.15.45:0/2836910060 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1f4014ab0 con 0x7fb1fc070ca0 2023-07-09T02:13:23.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.083+0000 7fb1e37fe640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb1e8066280 0x7fb1e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.083+0000 7fb1e37fe640 1 -- 172.21.15.45:0/2836910060 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb1f4084730 con 0x7fb1fc070ca0 2023-07-09T02:13:23.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.083+0000 7fb1faffd640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb1e8066280 0x7fb1e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.083+0000 7fb1faffd640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb1e8066280 0x7fb1e8068730 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec000f70 tx=0x7fb1ec007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.083+0000 7fb1e37fe640 1 -- 172.21.15.45:0/2836910060 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1f4055560 con 0x7fb1fc070ca0 2023-07-09T02:13:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1fc04d7d0 con 0x7fb1fc070ca0 2023-07-09T02:13:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb1e37fe640 1 -- 172.21.15.45:0/2836910060 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1f40550f0 con 0x7fb1fc070ca0 2023-07-09T02:13:23.242 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:13:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb1e8066280 msgr2=0x7fb1e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb1e8066280 0x7fb1e8068730 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec000f70 tx=0x7fb1ec007cd0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 msgr2=0x7fb1fc14ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc14ee80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4007e60 tx=0x7fb1f400e4b0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 shutdown_connections 2023-07-09T02:13:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc070ca0 0x7fb1fc14ee80 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb1e8066280 0x7fb1e8068730 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1fc06c6f0 0x7fb1fc151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 --2- 172.21.15.45:0/2836910060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1fc0694b0 0x7fb1fc14f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 >> 172.21.15.45:0/2836910060 conn(0x7fb1fc0650b0 msgr2=0x7fb1fc072730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 shutdown_connections 2023-07-09T02:13:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.239+0000 7fb20169c640 1 -- 172.21.15.45:0/2836910060 wait complete. 2023-07-09T02:13:23.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:13:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.403+0000 7fca3566d640 1 Processor -- start 2023-07-09T02:13:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.403+0000 7fca3566d640 1 -- start start 2023-07-09T02:13:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca3566d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca3015c060 0x7fca300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca3566d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cd120 0x7fca300d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca3566d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca30160a50 con 0x7fca300d2450 2023-07-09T02:13:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca3566d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca300d28f0 con 0x7fca3015c060 2023-07-09T02:13:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca3566d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300cfe40 con 0x7fca300cd120 2023-07-09T02:13:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fca300d2450 0x7fca300d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55594/0 (socket says 172.21.15.45:55594) 2023-07-09T02:13:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2f7fe640 1 -- 172.21.15.45:0/2912595915 learned_addr learned my addr 172.21.15.45:0/2912595915 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2effd640 1 --2- 172.21.15.45:0/2912595915 >> v2:172.21.15.155:3300/0 conn(0x7fca3015c060 0x7fca300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca27fff640 1 --2- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cd120 0x7fca300d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2e7fc640 1 -- 172.21.15.45:0/2912595915 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734747695 0 0) 0x7fca30160a50 con 0x7fca300d2450 2023-07-09T02:13:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2e7fc640 1 -- 172.21.15.45:0/2912595915 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca1c003530 con 0x7fca300d2450 2023-07-09T02:13:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2effd640 1 -- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cd120 msgr2=0x7fca300d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2effd640 1 --2- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cd120 0x7fca300d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2effd640 1 -- 172.21.15.45:0/2912595915 >> v1:172.21.15.45:6789/0 conn(0x7fca300d2450 legacy=0x7fca300d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca2effd640 1 -- 172.21.15.45:0/2912595915 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3015c430 con 0x7fca3015c060 2023-07-09T02:13:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.407+0000 7fca27fff640 1 --2- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cd120 0x7fca300d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca2effd640 1 --2- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3015c060 0x7fca300b4ed0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca200097c0 tx=0x7fca2001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351169173fd3f9d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca2e7fc640 1 -- 172.21.15.45:0/2912595915 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200ab600 con 0x7fca3015c060 2023-07-09T02:13:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca2e7fc640 1 -- 172.21.15.45:0/2912595915 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca200a7050 con 0x7fca3015c060 2023-07-09T02:13:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca2e7fc640 1 -- 172.21.15.45:0/2912595915 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200ab980 con 0x7fca3015c060 2023-07-09T02:13:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 -- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3015c060 msgr2=0x7fca300b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 --2- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3015c060 0x7fca300b4ed0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca200097c0 tx=0x7fca2001c450 comp rx=0 tx=0).stop 2023-07-09T02:13:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 -- 172.21.15.45:0/2912595915 shutdown_connections 2023-07-09T02:13:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 --2- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cd120 0x7fca300d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 --2- 172.21.15.45:0/2912595915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3015c060 0x7fca300b4ed0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 -- 172.21.15.45:0/2912595915 >> 172.21.15.45:0/2912595915 conn(0x7fca300698e0 msgr2=0x7fca30069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 -- 172.21.15.45:0/2912595915 shutdown_connections 2023-07-09T02:13:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 -- 172.21.15.45:0/2912595915 wait complete. 2023-07-09T02:13:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 Processor -- start 2023-07-09T02:13:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.411+0000 7fca3566d640 1 -- start start 2023-07-09T02:13:23.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca300cd120 0x7fca300b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300d2450 0x7fca300cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3015c060 0x7fca300b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300b3ed0 con 0x7fca3015c060 2023-07-09T02:13:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300b28f0 con 0x7fca300cd120 2023-07-09T02:13:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300b2bd0 con 0x7fca300d2450 2023-07-09T02:13:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3015c060 0x7fca300b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3015c060 0x7fca300b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49276/0 (socket says 172.21.15.45:49276) 2023-07-09T02:13:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 -- 172.21.15.45:0/2720829074 learned_addr learned my addr 172.21.15.45:0/2720829074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2effd640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca300cd120 0x7fca300b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca27fff640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300d2450 0x7fca300cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 -- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300d2450 msgr2=0x7fca300cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300d2450 0x7fca300cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 -- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca300cd120 msgr2=0x7fca300b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca300cd120 0x7fca300b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 -- 172.21.15.45:0/2720829074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18009420 con 0x7fca3015c060 2023-07-09T02:13:23.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca2f7fe640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3015c060 0x7fca300b5a00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fca2800cb40 tx=0x7fca2800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca277fe640 1 -- 172.21.15.45:0/2720829074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800aca0 con 0x7fca3015c060 2023-07-09T02:13:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca277fe640 1 -- 172.21.15.45:0/2720829074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800ae00 con 0x7fca3015c060 2023-07-09T02:13:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca20009420 con 0x7fca3015c060 2023-07-09T02:13:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca277fe640 1 -- 172.21.15.45:0/2720829074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28012620 con 0x7fca3015c060 2023-07-09T02:13:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca300b3190 con 0x7fca3015c060 2023-07-09T02:13:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.415+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3004d7d0 con 0x7fca3015c060 2023-07-09T02:13:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.419+0000 7fca277fe640 1 -- 172.21.15.45:0/2720829074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca28007070 con 0x7fca3015c060 2023-07-09T02:13:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.419+0000 7fca277fe640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.419+0000 7fca277fe640 1 -- 172.21.15.45:0/2720829074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fca28083df0 con 0x7fca3015c060 2023-07-09T02:13:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.419+0000 7fca2effd640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.419+0000 7fca2effd640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fca200ad000 tx=0x7fca200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.423+0000 7fca277fe640 1 -- 172.21.15.45:0/2720829074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca280511b0 con 0x7fca3015c060 2023-07-09T02:13:23.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fca3015d840 con 0x7fca3015c060 2023-07-09T02:13:23.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca277fe640 1 -- 172.21.15.45:0/2720829074 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) v1 ==== 80+0+0 (secure 0 0 0) 0x7fca28017070 con 0x7fca3015c060 2023-07-09T02:13:23.594 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:13:23.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 msgr2=0x7fca10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fca200ad000 tx=0x7fca200a6000 comp rx=0 tx=0).stop 2023-07-09T02:13:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3015c060 msgr2=0x7fca300b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3015c060 0x7fca300b5a00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fca2800cb40 tx=0x7fca2800a060 comp rx=0 tx=0).stop 2023-07-09T02:13:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 shutdown_connections 2023-07-09T02:13:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3015c060 0x7fca300b5a00 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300d2450 0x7fca300cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 --2- 172.21.15.45:0/2720829074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca300cd120 0x7fca300b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 >> 172.21.15.45:0/2720829074 conn(0x7fca300698e0 msgr2=0x7fca300b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 shutdown_connections 2023-07-09T02:13:23.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.591+0000 7fca3566d640 1 -- 172.21.15.45:0/2720829074 wait complete. 2023-07-09T02:13:23.614 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:13:23.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:23.615 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:13:23.721 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:13:23.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:23.722 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:13:23.732 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:13:23.733 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:23.743 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:13:23.744 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:23.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.935+0000 7f8e39c56640 1 Processor -- start 2023-07-09T02:13:23.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.935+0000 7f8e39c56640 1 -- start start 2023-07-09T02:13:23.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e39c56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e3415c060 0x7f8e340b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e39c56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340cd120 0x7f8e340d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e39c56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8e340d2450 0x7f8e340d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e39c56640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e340d28f0 con 0x7f8e3415c060 2023-07-09T02:13:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e39c56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e34160a50 con 0x7f8e340d2450 2023-07-09T02:13:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e39c56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3415c430 con 0x7f8e340cd120 2023-07-09T02:13:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e3415c060 0x7f8e340b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e3415c060 0x7f8e340b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49286/0 (socket says 172.21.15.45:49286) 2023-07-09T02:13:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 -- 172.21.15.45:0/4202842911 learned_addr learned my addr 172.21.15.45:0/4202842911 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e32ffd640 1 --2- 172.21.15.45:0/4202842911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340cd120 0x7f8e340d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e33fff640 1 --2- 172.21.15.45:0/4202842911 >> v2:172.21.15.155:3300/0 conn(0x7f8e340d2450 0x7f8e340d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 -- 172.21.15.45:0/4202842911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340cd120 msgr2=0x7f8e340d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 --2- 172.21.15.45:0/4202842911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340cd120 0x7f8e340d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 -- 172.21.15.45:0/4202842911 >> v2:172.21.15.155:3300/0 conn(0x7f8e340d2450 msgr2=0x7f8e340d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 --2- 172.21.15.45:0/4202842911 >> v2:172.21.15.155:3300/0 conn(0x7f8e340d2450 0x7f8e340d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 -- 172.21.15.45:0/4202842911 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3415fb60 con 0x7f8e3415c060 2023-07-09T02:13:23.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.939+0000 7f8e337fe640 1 --2- 172.21.15.45:0/4202842911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3415c060 0x7f8e340b4ed0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8e3406b120 tx=0x7f8e2401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6975dc7ccbe725e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e327fc640 1 -- 172.21.15.45:0/4202842911 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240ab600 con 0x7f8e3415c060 2023-07-09T02:13:23.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e327fc640 1 -- 172.21.15.45:0/4202842911 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240a7050 con 0x7f8e3415c060 2023-07-09T02:13:23.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e327fc640 1 -- 172.21.15.45:0/4202842911 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240ab980 con 0x7f8e3415c060 2023-07-09T02:13:23.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- 172.21.15.45:0/4202842911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3415c060 msgr2=0x7f8e340b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 --2- 172.21.15.45:0/4202842911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3415c060 0x7f8e340b4ed0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8e3406b120 tx=0x7f8e2401c210 comp rx=0 tx=0).stop 2023-07-09T02:13:23.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- 172.21.15.45:0/4202842911 shutdown_connections 2023-07-09T02:13:23.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 --2- 172.21.15.45:0/4202842911 >> v2:172.21.15.155:3300/0 conn(0x7f8e340d2450 0x7f8e340d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 --2- 172.21.15.45:0/4202842911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340cd120 0x7f8e340d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 --2- 172.21.15.45:0/4202842911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e3415c060 0x7f8e340b4ed0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- 172.21.15.45:0/4202842911 >> 172.21.15.45:0/4202842911 conn(0x7f8e340698e0 msgr2=0x7f8e34069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- 172.21.15.45:0/4202842911 shutdown_connections 2023-07-09T02:13:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- 172.21.15.45:0/4202842911 wait complete. 2023-07-09T02:13:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 Processor -- start 2023-07-09T02:13:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- start start 2023-07-09T02:13:23.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e340cd120 0x7f8e340cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340d2450 0x7f8e340cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e3415c060 0x7f8e34151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34153510 con 0x7f8e340cd120 2023-07-09T02:13:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341537f0 con 0x7f8e3415c060 2023-07-09T02:13:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.943+0000 7f8e39c56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34153ad0 con 0x7f8e340d2450 2023-07-09T02:13:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e340cd120 0x7f8e340cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e340cd120 0x7f8e340cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49294/0 (socket says 172.21.15.45:49294) 2023-07-09T02:13:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 -- 172.21.15.45:0/1240349072 learned_addr learned my addr 172.21.15.45:0/1240349072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e32ffd640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340d2450 0x7f8e340cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e33fff640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e3415c060 0x7f8e34151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 -- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340d2450 msgr2=0x7f8e340cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340d2450 0x7f8e340cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 -- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e3415c060 msgr2=0x7f8e34151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e3415c060 0x7f8e34151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 -- 172.21.15.45:0/1240349072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240094d0 con 0x7f8e340cd120 2023-07-09T02:13:23.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e337fe640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e340cd120 0x7f8e340cf090 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8e240ae040 tx=0x7f8e2401aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e1bfff640 1 -- 172.21.15.45:0/1240349072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240b6420 con 0x7f8e340cd120 2023-07-09T02:13:23.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e1bfff640 1 -- 172.21.15.45:0/1240349072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240b6580 con 0x7f8e340cd120 2023-07-09T02:13:23.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e34153db0 con 0x7f8e340cd120 2023-07-09T02:13:23.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e1bfff640 1 -- 172.21.15.45:0/1240349072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240b6930 con 0x7f8e340cd120 2023-07-09T02:13:23.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e340b27e0 con 0x7f8e340cd120 2023-07-09T02:13:23.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3404d7d0 con 0x7f8e340cd120 2023-07-09T02:13:23.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.947+0000 7f8e1bfff640 1 -- 172.21.15.45:0/1240349072 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e240b2040 con 0x7f8e340cd120 2023-07-09T02:13:23.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.951+0000 7f8e1bfff640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e200662b0 0x7f8e20068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.951+0000 7f8e1bfff640 1 -- 172.21.15.45:0/1240349072 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8e2411dd40 con 0x7f8e340cd120 2023-07-09T02:13:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.951+0000 7f8e32ffd640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e200662b0 0x7f8e20068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.951+0000 7f8e32ffd640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e200662b0 0x7f8e20068760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e3415f7b0 tx=0x7f8e28009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:23.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:23.955+0000 7f8e1bfff640 1 -- 172.21.15.45:0/1240349072 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e240eb110 con 0x7f8e340cd120 2023-07-09T02:13:24.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e3406a1d0 con 0x7f8e340cd120 2023-07-09T02:13:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e1bfff640 1 -- 172.21.15.45:0/1240349072 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18447 (secure 0 0 0) 0x7f8e2411b820 con 0x7f8e340cd120 2023-07-09T02:13:24.114 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:24.114 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:16.309432+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:45.075187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:46.325197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.37","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e200662b0 msgr2=0x7f8e20068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e200662b0 0x7f8e20068760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e3415f7b0 tx=0x7f8e28009190 comp rx=0 tx=0).stop 2023-07-09T02:13:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e340cd120 msgr2=0x7f8e340cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e340cd120 0x7f8e340cf090 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8e240ae040 tx=0x7f8e2401aa50 comp rx=0 tx=0).stop 2023-07-09T02:13:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 shutdown_connections 2023-07-09T02:13:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e3415c060 0x7f8e34151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e200662b0 0x7f8e20068760 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e340d2450 0x7f8e340cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 --2- 172.21.15.45:0/1240349072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e340cd120 0x7f8e340cf090 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 >> 172.21.15.45:0/1240349072 conn(0x7f8e340698e0 msgr2=0x7f8e340b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 shutdown_connections 2023-07-09T02:13:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.111+0000 7f8e39c56640 1 -- 172.21.15.45:0/1240349072 wait complete. 2023-07-09T02:13:24.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:12:45.075187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:12:46.325197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:13:24.139 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:13:24.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc2cec640 1 Processor -- start 2023-07-09T02:13:24.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc2cec640 1 -- start start 2023-07-09T02:13:24.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc2cec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0d2620 0x7f5bbc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc2cec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5bbc0cd120 0x7f5bbc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc2cec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc160a50 con 0x7f5bbc15c060 2023-07-09T02:13:24.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc2cec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc15c430 con 0x7f5bbc0cd120 2023-07-09T02:13:24.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc2cec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15fb60 con 0x7f5bbc0d2620 2023-07-09T02:13:24.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc1289640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5bbc0cd120 0x7f5bbc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc1289640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5bbc0cd120 0x7f5bbc0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49306/0 (socket says 172.21.15.45:49306) 2023-07-09T02:13:24.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc1289640 1 -- 172.21.15.45:0/3229774586 learned_addr learned my addr 172.21.15.45:0/3229774586 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:24.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bbbfff640 1 --2- 172.21.15.45:0/3229774586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0d2620 0x7f5bbc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc1289640 1 -- 172.21.15.45:0/3229774586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0d2620 msgr2=0x7f5bbc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:24.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc1289640 1 --2- 172.21.15.45:0/3229774586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0d2620 0x7f5bbc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc1289640 1 -- 172.21.15.45:0/3229774586 >> v1:172.21.15.155:6789/0 conn(0x7f5bbc15c060 legacy=0x7f5bbc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.283+0000 7f5bc1289640 1 -- 172.21.15.45:0/3229774586 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc15fe40 con 0x7f5bbc0cd120 2023-07-09T02:13:24.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc1289640 1 --2- 172.21.15.45:0/3229774586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0cd120 0x7f5bbc0cee30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009e50 tx=0x7f5bb401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e248075bc499ad31 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bbb7fe640 1 -- 172.21.15.45:0/3229774586 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40a58a0 con 0x7f5bbc0cd120 2023-07-09T02:13:24.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bbb7fe640 1 -- 172.21.15.45:0/3229774586 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb40a5a00 con 0x7f5bbc0cd120 2023-07-09T02:13:24.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bbb7fe640 1 -- 172.21.15.45:0/3229774586 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40a5d90 con 0x7f5bbc0cd120 2023-07-09T02:13:24.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3229774586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0cd120 msgr2=0x7f5bbc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3229774586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0cd120 0x7f5bbc0cee30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009e50 tx=0x7f5bb401c9e0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3229774586 shutdown_connections 2023-07-09T02:13:24.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3229774586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0cd120 0x7f5bbc0cee30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3229774586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0d2620 0x7f5bbc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3229774586 >> 172.21.15.45:0/3229774586 conn(0x7f5bbc0698e0 msgr2=0x7f5bbc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:24.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3229774586 shutdown_connections 2023-07-09T02:13:24.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.287+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3229774586 wait complete. 2023-07-09T02:13:24.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 Processor -- start 2023-07-09T02:13:24.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 -- start start 2023-07-09T02:13:24.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0cd120 0x7f5bbc15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0d2620 0x7f5bbc1f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bbc15c060 0x7f5bbc158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1f49f0 con 0x7f5bbc0d2620 2023-07-09T02:13:24.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1f4cd0 con 0x7f5bbc15c060 2023-07-09T02:13:24.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1f4fb0 con 0x7f5bbc0cd120 2023-07-09T02:13:24.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0d2620 0x7f5bbc1f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0d2620 0x7f5bbc1f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49316/0 (socket says 172.21.15.45:49316) 2023-07-09T02:13:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 -- 172.21.15.45:0/3017309213 learned_addr learned my addr 172.21.15.45:0/3017309213 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:24.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc0a88640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0cd120 0x7f5bbc15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc1289640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bbc15c060 0x7f5bbc158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 -- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0cd120 msgr2=0x7f5bbc15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0cd120 0x7f5bbc15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 -- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bbc15c060 msgr2=0x7f5bbc158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bbc15c060 0x7f5bbc158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 -- 172.21.15.45:0/3017309213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4009b30 con 0x7f5bbc0d2620 2023-07-09T02:13:24.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bbbfff640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0d2620 0x7f5bbc1f43c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800e900 tx=0x7f5ba800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bb97fa640 1 -- 172.21.15.45:0/3017309213 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8009690 con 0x7f5bbc0d2620 2023-07-09T02:13:24.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bb97fa640 1 -- 172.21.15.45:0/3017309213 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba800ca00 con 0x7f5bbc0d2620 2023-07-09T02:13:24.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bb97fa640 1 -- 172.21.15.45:0/3017309213 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba800cdb0 con 0x7f5bbc0d2620 2023-07-09T02:13:24.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc0b59f0 con 0x7f5bbc0d2620 2023-07-09T02:13:24.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.291+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc1f5290 con 0x7f5bbc0d2620 2023-07-09T02:13:24.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.295+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc15d8e0 con 0x7f5bbc0d2620 2023-07-09T02:13:24.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.295+0000 7f5bb97fa640 1 -- 172.21.15.45:0/3017309213 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ba8013470 con 0x7f5bbc0d2620 2023-07-09T02:13:24.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.295+0000 7f5bb97fa640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ba0066280 0x7f5ba0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.295+0000 7f5bb97fa640 1 -- 172.21.15.45:0/3017309213 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5ba8083f80 con 0x7f5bbc0d2620 2023-07-09T02:13:24.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.295+0000 7f5bc0a88640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ba0066280 0x7f5ba0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.295+0000 7f5bc0a88640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ba0066280 0x7f5ba0068730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0c9ac0 tx=0x7f5bb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.299+0000 7f5bb97fa640 1 -- 172.21.15.45:0/3017309213 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5bbc15d8e0 con 0x7f5bbc0d2620 2023-07-09T02:13:24.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.459+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bbc15d8e0 con 0x7f5bbc0d2620 2023-07-09T02:13:24.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.459+0000 7f5bb97fa640 1 -- 172.21.15.45:0/3017309213 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bbc15d8e0 con 0x7f5bbc0d2620 2023-07-09T02:13:24.464 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:13:24.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ba0066280 msgr2=0x7f5ba0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ba0066280 0x7f5ba0068730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0c9ac0 tx=0x7f5bb0009040 comp rx=0 tx=0).stop 2023-07-09T02:13:24.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0d2620 msgr2=0x7f5bbc1f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0d2620 0x7f5bbc1f43c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800e900 tx=0x7f5ba800edc0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 shutdown_connections 2023-07-09T02:13:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bbc15c060 0x7f5bbc158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bbc0d2620 0x7f5bbc1f43c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5ba0066280 0x7f5ba0068730 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 --2- 172.21.15.45:0/3017309213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bbc0cd120 0x7f5bbc15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 >> 172.21.15.45:0/3017309213 conn(0x7f5bbc0698e0 msgr2=0x7f5bbc069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:24.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 shutdown_connections 2023-07-09T02:13:24.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.463+0000 7f5bc2cec640 1 -- 172.21.15.45:0/3017309213 wait complete. 2023-07-09T02:13:24.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:13:24.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e98d8640 1 Processor -- start 2023-07-09T02:13:24.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e98d8640 1 -- start start 2023-07-09T02:13:24.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e98d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51e415c060 0x7f51e40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e98d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f51e40cd120 0x7f51e40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e98d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e4160a50 con 0x7f51e40d2450 2023-07-09T02:13:24.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e98d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40d28d0 con 0x7f51e415c060 2023-07-09T02:13:24.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e98d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40cfe40 con 0x7f51e40cd120 2023-07-09T02:13:24.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51e415c060 0x7f51e40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51e415c060 0x7f51e40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49318/0 (socket says 172.21.15.45:49318) 2023-07-09T02:13:24.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e2ffd640 1 -- 172.21.15.45:0/3581239923 learned_addr learned my addr 172.21.15.45:0/3581239923 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:24.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51dbfff640 1 --2- 172.21.15.45:0/3581239923 >> v2:172.21.15.155:3300/0 conn(0x7f51e40cd120 0x7f51e40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e2ffd640 1 -- 172.21.15.45:0/3581239923 >> v2:172.21.15.155:3300/0 conn(0x7f51e40cd120 msgr2=0x7f51e40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:24.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e2ffd640 1 --2- 172.21.15.45:0/3581239923 >> v2:172.21.15.155:3300/0 conn(0x7f51e40cd120 0x7f51e40d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e2ffd640 1 -- 172.21.15.45:0/3581239923 >> v1:172.21.15.155:6789/0 conn(0x7f51e40d2450 legacy=0x7f51e40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.627+0000 7f51e2ffd640 1 -- 172.21.15.45:0/3581239923 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e415c430 con 0x7f51e415c060 2023-07-09T02:13:24.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e2ffd640 1 --2- 172.21.15.45:0/3581239923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40b4ed0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f51e415fac0 tx=0x7f51d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92005616e02908f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e27fc640 1 -- 172.21.15.45:0/3581239923 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40ab5f0 con 0x7f51e415c060 2023-07-09T02:13:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e27fc640 1 -- 172.21.15.45:0/3581239923 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d40ab750 con 0x7f51e415c060 2023-07-09T02:13:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e27fc640 1 -- 172.21.15.45:0/3581239923 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40abae0 con 0x7f51e415c060 2023-07-09T02:13:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e98d8640 1 -- 172.21.15.45:0/3581239923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 msgr2=0x7f51e40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e98d8640 1 --2- 172.21.15.45:0/3581239923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40b4ed0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f51e415fac0 tx=0x7f51d401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e98d8640 1 -- 172.21.15.45:0/3581239923 shutdown_connections 2023-07-09T02:13:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e98d8640 1 --2- 172.21.15.45:0/3581239923 >> v2:172.21.15.155:3300/0 conn(0x7f51e40cd120 0x7f51e40d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e98d8640 1 --2- 172.21.15.45:0/3581239923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40b4ed0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e98d8640 1 -- 172.21.15.45:0/3581239923 >> 172.21.15.45:0/3581239923 conn(0x7f51e40698e0 msgr2=0x7f51e4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e98d8640 1 -- 172.21.15.45:0/3581239923 shutdown_connections 2023-07-09T02:13:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.631+0000 7f51e98d8640 1 -- 172.21.15.45:0/3581239923 wait complete. 2023-07-09T02:13:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 Processor -- start 2023-07-09T02:13:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 -- start start 2023-07-09T02:13:24.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51e40cd120 0x7f51e415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51e40d2450 0x7f51e40b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40b4210 con 0x7f51e415c060 2023-07-09T02:13:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40cca30 con 0x7f51e40d2450 2023-07-09T02:13:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40b2f10 con 0x7f51e40cd120 2023-07-09T02:13:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49322/0 (socket says 172.21.15.45:49322) 2023-07-09T02:13:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 -- 172.21.15.45:0/1164045991 learned_addr learned my addr 172.21.15.45:0/1164045991 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e2ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51e40cd120 0x7f51e415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51dbfff640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51e40d2450 0x7f51e40b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 -- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51e40cd120 msgr2=0x7f51e415a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51e40cd120 0x7f51e415a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 -- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51e40d2450 msgr2=0x7f51e40b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51e40d2450 0x7f51e40b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 -- 172.21.15.45:0/1164045991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40094d0 con 0x7f51e415c060 2023-07-09T02:13:24.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e37fe640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40cc4f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00c770 tx=0x7f51dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e0ff9640 1 -- 172.21.15.45:0/1164045991 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc003b80 con 0x7f51e415c060 2023-07-09T02:13:24.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e0ff9640 1 -- 172.21.15.45:0/1164045991 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc003ce0 con 0x7f51e415c060 2023-07-09T02:13:24.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e0ff9640 1 -- 172.21.15.45:0/1164045991 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00aa90 con 0x7f51e415c060 2023-07-09T02:13:24.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.635+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e40b31f0 con 0x7f51e415c060 2023-07-09T02:13:24.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.639+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e40b37b0 con 0x7f51e415c060 2023-07-09T02:13:24.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.639+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e40b39d0 con 0x7f51e415c060 2023-07-09T02:13:24.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.639+0000 7f51e0ff9640 1 -- 172.21.15.45:0/1164045991 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51dc00abf0 con 0x7f51e415c060 2023-07-09T02:13:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.639+0000 7f51e0ff9640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51c4066280 0x7f51c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.639+0000 7f51e0ff9640 1 -- 172.21.15.45:0/1164045991 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f51dc083b10 con 0x7f51e415c060 2023-07-09T02:13:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.639+0000 7f51e2ffd640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51c4066280 0x7f51c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.643+0000 7f51e2ffd640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51c4066280 0x7f51c4068730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f51d40af000 tx=0x7f51d40b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.643+0000 7f51e0ff9640 1 -- 172.21.15.45:0/1164045991 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51dc050f60 con 0x7f51e415c060 2023-07-09T02:13:24.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.795+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51e404d7d0 con 0x7f51e415c060 2023-07-09T02:13:24.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.795+0000 7f51e0ff9640 1 -- 172.21.15.45:0/1164045991 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7f51dc054580 con 0x7f51e415c060 2023-07-09T02:13:24.801 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:13:24.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51c4066280 msgr2=0x7f51c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51c4066280 0x7f51c4068730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f51d40af000 tx=0x7f51d40b6040 comp rx=0 tx=0).stop 2023-07-09T02:13:24.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 msgr2=0x7f51e40cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40cc4f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00c770 tx=0x7f51dc00cc30 comp rx=0 tx=0).stop 2023-07-09T02:13:24.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 shutdown_connections 2023-07-09T02:13:24.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415c060 0x7f51e40cc4f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51e40d2450 0x7f51e40b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f51c4066280 0x7f51c4068730 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 --2- 172.21.15.45:0/1164045991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51e40cd120 0x7f51e415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 >> 172.21.15.45:0/1164045991 conn(0x7f51e40698e0 msgr2=0x7f51e40b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:24.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 shutdown_connections 2023-07-09T02:13:24.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.799+0000 7f51e98d8640 1 -- 172.21.15.45:0/1164045991 wait complete. 2023-07-09T02:13:24.822 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:13:24.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.963+0000 7fc378fd5640 1 Processor -- start 2023-07-09T02:13:24.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.963+0000 7fc378fd5640 1 -- start start 2023-07-09T02:13:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc378fd5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc37415c060 0x7fc3740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc378fd5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3740cd120 0x7fc3740d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc378fd5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc374160a50 con 0x7fc3740d2450 2023-07-09T02:13:24.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc378fd5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3740d28d0 con 0x7fc3740cd120 2023-07-09T02:13:24.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc378fd5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3740cfe40 con 0x7fc37415c060 2023-07-09T02:13:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc36bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3740cd120 0x7fc3740d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc36bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3740cd120 0x7fc3740d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49334/0 (socket says 172.21.15.45:49334) 2023-07-09T02:13:24.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc36bfff640 1 -- 172.21.15.45:0/1473673775 learned_addr learned my addr 172.21.15.45:0/1473673775 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:24.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc37259c640 1 --2- 172.21.15.45:0/1473673775 >> v2:172.21.15.155:3300/0 conn(0x7fc37415c060 0x7fc3740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc36bfff640 1 -- 172.21.15.45:0/1473673775 >> v2:172.21.15.155:3300/0 conn(0x7fc37415c060 msgr2=0x7fc3740b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:24.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc36bfff640 1 --2- 172.21.15.45:0/1473673775 >> v2:172.21.15.155:3300/0 conn(0x7fc37415c060 0x7fc3740b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc36bfff640 1 -- 172.21.15.45:0/1473673775 >> v1:172.21.15.155:6789/0 conn(0x7fc3740d2450 legacy=0x7fc3740d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.967+0000 7fc36bfff640 1 -- 172.21.15.45:0/1473673775 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37415c430 con 0x7fc3740cd120 2023-07-09T02:13:24.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc36bfff640 1 --2- 172.21.15.45:0/1473673775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740cd120 0x7fc3740d1f10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc3740d3ad0 tx=0x7fc35c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b85b919e295845 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc371d9b640 1 -- 172.21.15.45:0/1473673775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0ab5f0 con 0x7fc3740cd120 2023-07-09T02:13:24.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc371d9b640 1 -- 172.21.15.45:0/1473673775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c0ab750 con 0x7fc3740cd120 2023-07-09T02:13:24.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc371d9b640 1 -- 172.21.15.45:0/1473673775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0abae0 con 0x7fc3740cd120 2023-07-09T02:13:24.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 -- 172.21.15.45:0/1473673775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740cd120 msgr2=0x7fc3740d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 --2- 172.21.15.45:0/1473673775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740cd120 0x7fc3740d1f10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc3740d3ad0 tx=0x7fc35c01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 -- 172.21.15.45:0/1473673775 shutdown_connections 2023-07-09T02:13:24.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 --2- 172.21.15.45:0/1473673775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740cd120 0x7fc3740d1f10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 --2- 172.21.15.45:0/1473673775 >> v2:172.21.15.155:3300/0 conn(0x7fc37415c060 0x7fc3740b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 -- 172.21.15.45:0/1473673775 >> 172.21.15.45:0/1473673775 conn(0x7fc3740698e0 msgr2=0x7fc374069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:24.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 -- 172.21.15.45:0/1473673775 shutdown_connections 2023-07-09T02:13:24.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 -- 172.21.15.45:0/1473673775 wait complete. 2023-07-09T02:13:24.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 Processor -- start 2023-07-09T02:13:24.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.971+0000 7fc378fd5640 1 -- start start 2023-07-09T02:13:24.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740cd120 0x7fc3740b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740d2450 0x7fc3741534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc37415c060 0x7fc3740cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740cb4a0 con 0x7fc3740d2450 2023-07-09T02:13:24.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741539f0 con 0x7fc37415c060 2023-07-09T02:13:24.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740cbe70 con 0x7fc3740cd120 2023-07-09T02:13:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740d2450 0x7fc3741534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740d2450 0x7fc3741534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49336/0 (socket says 172.21.15.45:49336) 2023-07-09T02:13:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 -- 172.21.15.45:0/2272113424 learned_addr learned my addr 172.21.15.45:0/2272113424 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc37259c640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740cd120 0x7fc3740b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc372d9d640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc37415c060 0x7fc3740cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 -- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740cd120 msgr2=0x7fc3740b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740cd120 0x7fc3740b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 -- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc37415c060 msgr2=0x7fc3740cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc37415c060 0x7fc3740cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 -- 172.21.15.45:0/2272113424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0094d0 con 0x7fc3740d2450 2023-07-09T02:13:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36bfff640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740d2450 0x7fc3741534b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0190e0 tx=0x7fc35c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36affd640 1 -- 172.21.15.45:0/2272113424 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0be5f0 con 0x7fc3740d2450 2023-07-09T02:13:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36affd640 1 -- 172.21.15.45:0/2272113424 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c0be750 con 0x7fc3740d2450 2023-07-09T02:13:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36affd640 1 -- 172.21.15.45:0/2272113424 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0beae0 con 0x7fc3740d2450 2023-07-09T02:13:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3740ca890 con 0x7fc3740d2450 2023-07-09T02:13:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3740cae50 con 0x7fc3740d2450 2023-07-09T02:13:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3740cb610 con 0x7fc3740d2450 2023-07-09T02:13:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.975+0000 7fc36affd640 1 -- 172.21.15.45:0/2272113424 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc35c0b43f0 con 0x7fc3740d2450 2023-07-09T02:13:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.979+0000 7fc36affd640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc354066280 0x7fc354068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.979+0000 7fc36affd640 1 -- 172.21.15.45:0/2272113424 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc35c0a8050 con 0x7fc3740d2450 2023-07-09T02:13:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.979+0000 7fc37259c640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc354066280 0x7fc354068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.979+0000 7fc37259c640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc354066280 0x7fc354068730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc364009ac0 tx=0x7fc364009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:24.983+0000 7fc36affd640 1 -- 172.21.15.45:0/2272113424 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc35c0ebd30 con 0x7fc3740d2450 2023-07-09T02:13:25.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc37404d7d0 con 0x7fc3740d2450 2023-07-09T02:13:25.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc36affd640 1 -- 172.21.15.45:0/2272113424 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc35c0ef350 con 0x7fc3740d2450 2023-07-09T02:13:25.138 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:13:25.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc354066280 msgr2=0x7fc354068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc354066280 0x7fc354068730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc364009ac0 tx=0x7fc364009190 comp rx=0 tx=0).stop 2023-07-09T02:13:25.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740d2450 msgr2=0x7fc3741534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740d2450 0x7fc3741534b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0190e0 tx=0x7fc35c01ad10 comp rx=0 tx=0).stop 2023-07-09T02:13:25.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 shutdown_connections 2023-07-09T02:13:25.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc37415c060 0x7fc3740cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3740d2450 0x7fc3741534b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc354066280 0x7fc354068730 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 --2- 172.21.15.45:0/2272113424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3740cd120 0x7fc3740b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 >> 172.21.15.45:0/2272113424 conn(0x7fc3740698e0 msgr2=0x7fc3740b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:25.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 shutdown_connections 2023-07-09T02:13:25.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.135+0000 7fc378fd5640 1 -- 172.21.15.45:0/2272113424 wait complete. 2023-07-09T02:13:25.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:13:25.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7c7e9640 1 Processor -- start 2023-07-09T02:13:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7c7e9640 1 -- start start 2023-07-09T02:13:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7c7e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7c7e9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea74160a50 con 0x7fea740d2620 2023-07-09T02:13:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7c7e9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7415c430 con 0x7fea7415c060 2023-07-09T02:13:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7c7e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7415fb60 con 0x7fea740cd120 2023-07-09T02:13:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea79d84640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fea740d2620 0x7fea740cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55608/0 (socket says 172.21.15.45:55608) 2023-07-09T02:13:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea79d84640 1 -- 172.21.15.45:0/3079202564 learned_addr learned my addr 172.21.15.45:0/3079202564 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7ad86640 1 --2- 172.21.15.45:0/3079202564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea79583640 1 -- 172.21.15.45:0/3079202564 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071355848 0 0) 0x7fea74160a50 con 0x7fea740d2620 2023-07-09T02:13:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea79583640 1 -- 172.21.15.45:0/3079202564 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea60003530 con 0x7fea740d2620 2023-07-09T02:13:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea79583640 1 -- 172.21.15.45:0/3079202564 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978460794 0 0) 0x7fea7415c430 con 0x7fea7415c060 2023-07-09T02:13:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea79583640 1 -- 172.21.15.45:0/3079202564 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea74160a50 con 0x7fea7415c060 2023-07-09T02:13:25.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7ad86640 1 -- 172.21.15.45:0/3079202564 >> v1:172.21.15.155:6789/0 conn(0x7fea7415c060 legacy=0x7fea740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea79583640 1 -- 172.21.15.45:0/3079202564 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2034486731 0 0) 0x7fea60003530 con 0x7fea740d2620 2023-07-09T02:13:25.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7ad86640 1 -- 172.21.15.45:0/3079202564 >> v1:172.21.15.45:6789/0 conn(0x7fea740d2620 legacy=0x7fea740cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.303+0000 7fea7ad86640 1 -- 172.21.15.45:0/3079202564 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7415fe40 con 0x7fea740cd120 2023-07-09T02:13:25.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea7ad86640 1 --2- 172.21.15.45:0/3079202564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea740b4ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009dc0 tx=0x7fea6c01c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37dfe02cb66e909f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:25.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea79583640 1 -- 172.21.15.45:0/3079202564 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64001680 con 0x7fea740cd120 2023-07-09T02:13:25.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea79583640 1 -- 172.21.15.45:0/3079202564 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c0a56a0 con 0x7fea740cd120 2023-07-09T02:13:25.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea79583640 1 -- 172.21.15.45:0/3079202564 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c0a5a30 con 0x7fea740cd120 2023-07-09T02:13:25.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3079202564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 msgr2=0x7fea740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea7c7e9640 1 --2- 172.21.15.45:0/3079202564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea740b4ed0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009dc0 tx=0x7fea6c01c860 comp rx=0 tx=0).stop 2023-07-09T02:13:25.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3079202564 shutdown_connections 2023-07-09T02:13:25.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea7c7e9640 1 --2- 172.21.15.45:0/3079202564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea740b4ed0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3079202564 >> 172.21.15.45:0/3079202564 conn(0x7fea740698e0 msgr2=0x7fea74069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:25.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3079202564 shutdown_connections 2023-07-09T02:13:25.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.307+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3079202564 wait complete. 2023-07-09T02:13:25.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 Processor -- start 2023-07-09T02:13:25.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 -- start start 2023-07-09T02:13:25.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea7414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea740d2620 0x7fea7414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7415c060 0x7fea7415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7414f2d0 con 0x7fea7415c060 2023-07-09T02:13:25.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea74152e00 con 0x7fea740d2620 2023-07-09T02:13:25.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7415ece0 con 0x7fea740cd120 2023-07-09T02:13:25.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7415c060 0x7fea7415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7415c060 0x7fea7415e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49342/0 (socket says 172.21.15.45:49342) 2023-07-09T02:13:25.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 -- 172.21.15.45:0/3986688454 learned_addr learned my addr 172.21.15.45:0/3986688454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:25.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 -- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 msgr2=0x7fea7414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7a585640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea7414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea79d84640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea740d2620 0x7fea7414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea7414f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 -- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea740d2620 msgr2=0x7fea7414ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea740d2620 0x7fea7414ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 -- 172.21.15.45:0/3986688454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c009a70 con 0x7fea7415c060 2023-07-09T02:13:25.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7a585640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea7414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:25.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea79d84640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea740d2620 0x7fea7414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:25.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7ad86640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7415c060 0x7fea7415e3b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fea6c01cd40 tx=0x7fea6c019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:25.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea6affd640 1 -- 172.21.15.45:0/3986688454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c0b9650 con 0x7fea7415c060 2023-07-09T02:13:25.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea6affd640 1 -- 172.21.15.45:0/3986688454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c0b97b0 con 0x7fea7415c060 2023-07-09T02:13:25.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea6affd640 1 -- 172.21.15.45:0/3986688454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c0b9b40 con 0x7fea7415c060 2023-07-09T02:13:25.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea740b59f0 con 0x7fea7415c060 2023-07-09T02:13:25.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.311+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7415f2a0 con 0x7fea7415c060 2023-07-09T02:13:25.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.315+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea74152f70 con 0x7fea7415c060 2023-07-09T02:13:25.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.315+0000 7fea6affd640 1 -- 172.21.15.45:0/3986688454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea6c0b9ca0 con 0x7fea7415c060 2023-07-09T02:13:25.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.315+0000 7fea6affd640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea580662b0 0x7fea58068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.315+0000 7fea6affd640 1 -- 172.21.15.45:0/3986688454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fea6c11eff0 con 0x7fea7415c060 2023-07-09T02:13:25.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.315+0000 7fea7a585640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea580662b0 0x7fea58068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.315+0000 7fea7a585640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea580662b0 0x7fea58068760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fea700011f0 tx=0x7fea70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:25.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.319+0000 7fea6affd640 1 -- 172.21.15.45:0/3986688454 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea6c0ec3f0 con 0x7fea7415c060 2023-07-09T02:13:25.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.475+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea7404d7d0 con 0x7fea7415c060 2023-07-09T02:13:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.475+0000 7fea6affd640 1 -- 172.21.15.45:0/3986688454 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea6c0efa10 con 0x7fea7415c060 2023-07-09T02:13:25.480 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:13:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea580662b0 msgr2=0x7fea58068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea580662b0 0x7fea58068760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fea700011f0 tx=0x7fea70009040 comp rx=0 tx=0).stop 2023-07-09T02:13:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7415c060 msgr2=0x7fea7415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7415c060 0x7fea7415e3b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fea6c01cd40 tx=0x7fea6c019600 comp rx=0 tx=0).stop 2023-07-09T02:13:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 shutdown_connections 2023-07-09T02:13:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea7415c060 0x7fea7415e3b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea740d2620 0x7fea7414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea580662b0 0x7fea58068760 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 --2- 172.21.15.45:0/3986688454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea740cd120 0x7fea7414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 >> 172.21.15.45:0/3986688454 conn(0x7fea740698e0 msgr2=0x7fea74069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 shutdown_connections 2023-07-09T02:13:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.479+0000 7fea7c7e9640 1 -- 172.21.15.45:0/3986688454 wait complete. 2023-07-09T02:13:25.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:13:25.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c4dad8640 1 Processor -- start 2023-07-09T02:13:25.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c4dad8640 1 -- start start 2023-07-09T02:13:25.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c4dad8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2c4815c060 0x7f2c480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c4dad8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c480cd120 0x7f2c480d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c4dad8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480d2450 0x7f2c480d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c4dad8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c480d28f0 con 0x7f2c480cd120 2023-07-09T02:13:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c4dad8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c48160a50 con 0x7f2c4815c060 2023-07-09T02:13:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c4dad8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815c430 con 0x7f2c480d2450 2023-07-09T02:13:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c46ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c480cd120 0x7f2c480d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c46ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c480cd120 0x7f2c480d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49344/0 (socket says 172.21.15.45:49344) 2023-07-09T02:13:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c46ffd640 1 -- 172.21.15.45:0/3075624966 learned_addr learned my addr 172.21.15.45:0/3075624966 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c47fff640 1 --2- 172.21.15.45:0/3075624966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480d2450 0x7f2c480d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c477fe640 1 --2- 172.21.15.45:0/3075624966 >> v2:172.21.15.155:3300/0 conn(0x7f2c4815c060 0x7f2c480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c46ffd640 1 -- 172.21.15.45:0/3075624966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480d2450 msgr2=0x7f2c480d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c46ffd640 1 --2- 172.21.15.45:0/3075624966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480d2450 0x7f2c480d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c46ffd640 1 -- 172.21.15.45:0/3075624966 >> v2:172.21.15.155:3300/0 conn(0x7f2c4815c060 msgr2=0x7f2c480b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c46ffd640 1 --2- 172.21.15.45:0/3075624966 >> v2:172.21.15.155:3300/0 conn(0x7f2c4815c060 0x7f2c480b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c46ffd640 1 -- 172.21.15.45:0/3075624966 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4815fb60 con 0x7f2c480cd120 2023-07-09T02:13:25.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c47fff640 1 --2- 172.21.15.45:0/3075624966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480d2450 0x7f2c480d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:25.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.643+0000 7f2c477fe640 1 --2- 172.21.15.45:0/3075624966 >> v2:172.21.15.155:3300/0 conn(0x7f2c4815c060 0x7f2c480b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:25.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c46ffd640 1 --2- 172.21.15.45:0/3075624966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480cd120 0x7f2c480d1f10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2c480d3ad0 tx=0x7f2c3c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da9e7cf64bd86be server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:25.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c467fc640 1 -- 172.21.15.45:0/3075624966 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0ab600 con 0x7f2c480cd120 2023-07-09T02:13:25.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c467fc640 1 -- 172.21.15.45:0/3075624966 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0a7050 con 0x7f2c480cd120 2023-07-09T02:13:25.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c467fc640 1 -- 172.21.15.45:0/3075624966 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0ab980 con 0x7f2c480cd120 2023-07-09T02:13:25.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 -- 172.21.15.45:0/3075624966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480cd120 msgr2=0x7f2c480d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/3075624966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480cd120 0x7f2c480d1f10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2c480d3ad0 tx=0x7f2c3c01c210 comp rx=0 tx=0).stop 2023-07-09T02:13:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 -- 172.21.15.45:0/3075624966 shutdown_connections 2023-07-09T02:13:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/3075624966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480d2450 0x7f2c480d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/3075624966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480cd120 0x7f2c480d1f10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/3075624966 >> v2:172.21.15.155:3300/0 conn(0x7f2c4815c060 0x7f2c480b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 -- 172.21.15.45:0/3075624966 >> 172.21.15.45:0/3075624966 conn(0x7f2c480698e0 msgr2=0x7f2c48069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:25.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 -- 172.21.15.45:0/3075624966 shutdown_connections 2023-07-09T02:13:25.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.647+0000 7f2c4dad8640 1 -- 172.21.15.45:0/3075624966 wait complete. 2023-07-09T02:13:25.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 Processor -- start 2023-07-09T02:13:25.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 -- start start 2023-07-09T02:13:25.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480cd120 0x7f2c481525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480d2450 0x7f2c480b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4815c060 0x7f2c48151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480b1df0 con 0x7f2c480d2450 2023-07-09T02:13:25.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48153e70 con 0x7f2c4815c060 2023-07-09T02:13:25.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815c700 con 0x7f2c480cd120 2023-07-09T02:13:25.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480d2450 0x7f2c480b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480d2450 0x7f2c480b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49360/0 (socket says 172.21.15.45:49360) 2023-07-09T02:13:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 -- 172.21.15.45:0/110462875 learned_addr learned my addr 172.21.15.45:0/110462875 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c47fff640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4815c060 0x7f2c48151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c477fe640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480cd120 0x7f2c481525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 -- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480cd120 msgr2=0x7f2c481525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480cd120 0x7f2c481525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 -- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4815c060 msgr2=0x7f2c48151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4815c060 0x7f2c48151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 -- 172.21.15.45:0/110462875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0094d0 con 0x7f2c480d2450 2023-07-09T02:13:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c46ffd640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480d2450 0x7f2c480b18b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0ae040 tx=0x7f2c3c018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c2ffff640 1 -- 172.21.15.45:0/110462875 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0b4440 con 0x7f2c480d2450 2023-07-09T02:13:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c2ffff640 1 -- 172.21.15.45:0/110462875 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0b45a0 con 0x7f2c480d2450 2023-07-09T02:13:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c2ffff640 1 -- 172.21.15.45:0/110462875 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0b4930 con 0x7f2c480d2450 2023-07-09T02:13:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c480b7fe0 con 0x7f2c480d2450 2023-07-09T02:13:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.651+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c480b85a0 con 0x7f2c480d2450 2023-07-09T02:13:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.655+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4815c8c0 con 0x7f2c480d2450 2023-07-09T02:13:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.655+0000 7f2c2ffff640 1 -- 172.21.15.45:0/110462875 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c3c0b2070 con 0x7f2c480d2450 2023-07-09T02:13:25.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.655+0000 7f2c2ffff640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c34066280 0x7f2c34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:25.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.655+0000 7f2c2ffff640 1 -- 172.21.15.45:0/110462875 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2c3c11dbe0 con 0x7f2c480d2450 2023-07-09T02:13:25.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.655+0000 7f2c477fe640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c34066280 0x7f2c34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.655+0000 7f2c477fe640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c34066280 0x7f2c34068730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b4410 tx=0x7f2c38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:25.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.659+0000 7f2c2ffff640 1 -- 172.21.15.45:0/110462875 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2c3c0eb020 con 0x7f2c480d2450 2023-07-09T02:13:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2c4804d7d0 con 0x7f2c480d2450 2023-07-09T02:13:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c2ffff640 1 -- 172.21.15.45:0/110462875 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2c3c0ee640 con 0x7f2c480d2450 2023-07-09T02:13:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:13:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c34066280 msgr2=0x7f2c34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c34066280 0x7f2c34068730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b4410 tx=0x7f2c38008040 comp rx=0 tx=0).stop 2023-07-09T02:13:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480d2450 msgr2=0x7f2c480b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480d2450 0x7f2c480b18b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0ae040 tx=0x7f2c3c018fb0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 shutdown_connections 2023-07-09T02:13:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4815c060 0x7f2c48151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c480d2450 0x7f2c480b18b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c34066280 0x7f2c34068730 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 --2- 172.21.15.45:0/110462875 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c480cd120 0x7f2c481525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 >> 172.21.15.45:0/110462875 conn(0x7f2c480698e0 msgr2=0x7f2c4815b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 shutdown_connections 2023-07-09T02:13:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:25.827+0000 7f2c4dad8640 1 -- 172.21.15.45:0/110462875 wait complete. 2023-07-09T02:13:25.850 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:13:25.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:25.851 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:13:25.909 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:13:25.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:25.910 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:13:25.920 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:25.920 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:25.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:13:25.932 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:13:25.932 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:25.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:13:25.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:26.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9ecc2ec640 1 Processor -- start 2023-07-09T02:13:26.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9ecc2ec640 1 -- start start 2023-07-09T02:13:26.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9ecc2ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec40d2620 0x7f9ec40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9ecc2ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ec40cd120 0x7f9ec40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9ecc2ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec4160a50 con 0x7f9ec415c060 2023-07-09T02:13:26.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9ecc2ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec415c430 con 0x7f9ec40cd120 2023-07-09T02:13:26.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9ecc2ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415fb60 con 0x7f9ec40d2620 2023-07-09T02:13:26.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9eca088640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9ec415c060 0x7f9ec40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55612/0 (socket says 172.21.15.45:55612) 2023-07-09T02:13:26.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9eca088640 1 -- 172.21.15.45:0/2341087579 learned_addr learned my addr 172.21.15.45:0/2341087579 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:26.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9ec9887640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec40d2620 0x7f9ec40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.111+0000 7f9eca889640 1 --2- 172.21.15.45:0/2341087579 >> v2:172.21.15.155:3300/0 conn(0x7f9ec40cd120 0x7f9ec40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987880055 0 0) 0x7f9ec4160a50 con 0x7f9ec415c060 2023-07-09T02:13:26.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb0003530 con 0x7f9ec415c060 2023-07-09T02:13:26.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4294442500 0 0) 0x7f9eb0003530 con 0x7f9ec415c060 2023-07-09T02:13:26.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec40d2620 msgr2=0x7f9ec40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:26.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec40d2620 0x7f9ec40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 >> v2:172.21.15.155:3300/0 conn(0x7f9ec40cd120 msgr2=0x7f9ec40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:26.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 --2- 172.21.15.45:0/2341087579 >> v2:172.21.15.155:3300/0 conn(0x7f9ec40cd120 0x7f9ec40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec415fe40 con 0x7f9ec415c060 2023-07-09T02:13:26.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f9ec0001680 con 0x7f9ec415c060 2023-07-09T02:13:26.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 >> v1:172.21.15.45:6789/0 conn(0x7f9ec415c060 legacy=0x7f9ec40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0003980 0x7f9eb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec40d2620 0x7f9eb00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0004d10 0x7f9eb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415c430 con 0x7f9eb0004d10 2023-07-09T02:13:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415fb60 con 0x7f9eb0003980 2023-07-09T02:13:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb000b990 con 0x7f9ec40d2620 2023-07-09T02:13:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9eca889640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0004d10 0x7f9eb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9eca088640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0003980 0x7f9eb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9ec9887640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec40d2620 0x7f9eb00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9eca889640 1 -- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec40d2620 msgr2=0x7f9eb00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9eca889640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec40d2620 0x7f9eb00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9eca889640 1 -- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0003980 msgr2=0x7f9eb0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9eca889640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0003980 0x7f9eb0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.115+0000 7f9eca889640 1 -- 172.21.15.45:0/2341087579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0003530 con 0x7f9eb0004d10 2023-07-09T02:13:26.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9eca889640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0004d10 0x7f9eb0005180 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009fc0 tx=0x7f9ebc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbac219954fc79d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0a5cb0 con 0x7f9eb0004d10 2023-07-09T02:13:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc00f040 con 0x7f9eb0004d10 2023-07-09T02:13:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ec9086640 1 -- 172.21.15.45:0/2341087579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0ad680 con 0x7f9eb0004d10 2023-07-09T02:13:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2341087579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0004d10 msgr2=0x7f9eb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ecc2ec640 1 --2- 172.21.15.45:0/2341087579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9eb0004d10 0x7f9eb0005180 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009fc0 tx=0x7f9ebc01cc40 comp rx=0 tx=0).stop 2023-07-09T02:13:26.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9eca889640 1 -- 172.21.15.45:0/2341087579 reap_dead start 2023-07-09T02:13:26.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2341087579 shutdown_connections 2023-07-09T02:13:26.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2341087579 >> 172.21.15.45:0/2341087579 conn(0x7f9ec40698e0 msgr2=0x7f9ec4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:26.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2341087579 shutdown_connections 2023-07-09T02:13:26.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2341087579 wait complete. 2023-07-09T02:13:26.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ecc2ec640 1 Processor -- start 2023-07-09T02:13:26.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.119+0000 7f9ecc2ec640 1 -- start start 2023-07-09T02:13:26.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0004d10 0x7f9ec40ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40b1690 0x7f9ec41f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec41f45c0 0x7f9ec40a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40cad50 con 0x7f9ec40b1690 2023-07-09T02:13:26.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415a5c0 con 0x7f9eb0004d10 2023-07-09T02:13:26.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41f1d00 con 0x7f9ec41f45c0 2023-07-09T02:13:26.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40b1690 0x7f9ec41f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40b1690 0x7f9ec41f17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49382/0 (socket says 172.21.15.45:49382) 2023-07-09T02:13:26.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 -- 172.21.15.45:0/2422035247 learned_addr learned my addr 172.21.15.45:0/2422035247 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:26.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9eca088640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0004d10 0x7f9ec40ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9eca889640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec41f45c0 0x7f9ec40a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 -- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec41f45c0 msgr2=0x7f9ec40a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec41f45c0 0x7f9ec40a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 -- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0004d10 msgr2=0x7f9ec40ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0004d10 0x7f9ec40ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 -- 172.21.15.45:0/2422035247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec40caf80 con 0x7f9ec40b1690 2023-07-09T02:13:26.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9eca889640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec41f45c0 0x7f9ec40a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:26.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ec9887640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40b1690 0x7f9ec41f17c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4011970 tx=0x7f9eb4011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ebaffd640 1 -- 172.21.15.45:0/2422035247 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4004240 con 0x7f9ec40b1690 2023-07-09T02:13:26.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ebaffd640 1 -- 172.21.15.45:0/2422035247 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb40043a0 con 0x7f9ec40b1690 2023-07-09T02:13:26.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec40cb260 con 0x7f9ec40b1690 2023-07-09T02:13:26.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ebaffd640 1 -- 172.21.15.45:0/2422035247 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb400fb00 con 0x7f9ec40b1690 2023-07-09T02:13:26.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec40cb820 con 0x7f9ec40b1690 2023-07-09T02:13:26.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec404d7d0 con 0x7f9ec40b1690 2023-07-09T02:13:26.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.123+0000 7f9ebaffd640 1 -- 172.21.15.45:0/2422035247 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9eb400fc60 con 0x7f9ec40b1690 2023-07-09T02:13:26.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.127+0000 7f9ebaffd640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ea80662b0 0x7f9ea8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.127+0000 7f9ebaffd640 1 -- 172.21.15.45:0/2422035247 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9eb40844b0 con 0x7f9ec40b1690 2023-07-09T02:13:26.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.127+0000 7f9eca088640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ea80662b0 0x7f9ea8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.127+0000 7f9eca088640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ea80662b0 0x7f9ea8068760 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ec415f100 tx=0x7f9ec0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.131+0000 7f9ebaffd640 1 -- 172.21.15.45:0/2422035247 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9eb4051850 con 0x7f9ec40b1690 2023-07-09T02:13:26.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ec406baa0 con 0x7f9ec40b1690 2023-07-09T02:13:26.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ebaffd640 1 -- 172.21.15.45:0/2422035247 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f9eb4054e70 con 0x7f9ec40b1690 2023-07-09T02:13:26.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:26.323 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:13:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:13:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ea80662b0 msgr2=0x7f9ea8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ea80662b0 0x7f9ea8068760 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ec415f100 tx=0x7f9ec0009040 comp rx=0 tx=0).stop 2023-07-09T02:13:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40b1690 msgr2=0x7f9ec41f17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40b1690 0x7f9ec41f17c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4011970 tx=0x7f9eb4011e30 comp rx=0 tx=0).stop 2023-07-09T02:13:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 shutdown_connections 2023-07-09T02:13:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ea80662b0 0x7f9ea8068760 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec41f45c0 0x7f9ec40a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ec40b1690 0x7f9ec41f17c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 --2- 172.21.15.45:0/2422035247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb0004d10 0x7f9ec40ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 >> 172.21.15.45:0/2422035247 conn(0x7f9ec40698e0 msgr2=0x7f9ec40b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 shutdown_connections 2023-07-09T02:13:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.319+0000 7f9ecc2ec640 1 -- 172.21.15.45:0/2422035247 wait complete. 2023-07-09T02:13:26.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.483+0000 7fdbd191f640 1 Processor -- start 2023-07-09T02:13:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.483+0000 7fdbd191f640 1 -- start start 2023-07-09T02:13:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbd191f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0d2620 0x7fdbcc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbd191f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc160a50 con 0x7fdbcc0cd120 2023-07-09T02:13:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbd191f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc15c430 con 0x7fdbcc15c060 2023-07-09T02:13:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbd191f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc15fb60 con 0x7fdbcc0d2620 2023-07-09T02:13:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbcb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdbcc0cd120 0x7fdbcc0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55614/0 (socket says 172.21.15.45:55614) 2023-07-09T02:13:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbcb7fe640 1 -- 172.21.15.45:0/2750719139 learned_addr learned my addr 172.21.15.45:0/2750719139 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbc3fff640 1 --2- 172.21.15.45:0/2750719139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0d2620 0x7fdbcc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbca7fc640 1 -- 172.21.15.45:0/2750719139 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981092948 0 0) 0x7fdbcc160a50 con 0x7fdbcc0cd120 2023-07-09T02:13:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbca7fc640 1 -- 172.21.15.45:0/2750719139 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb8003530 con 0x7fdbcc0cd120 2023-07-09T02:13:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbca7fc640 1 -- 172.21.15.45:0/2750719139 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118060779 0 0) 0x7fdbcc15c430 con 0x7fdbcc15c060 2023-07-09T02:13:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbca7fc640 1 -- 172.21.15.45:0/2750719139 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbcc160a50 con 0x7fdbcc15c060 2023-07-09T02:13:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbc3fff640 1 -- 172.21.15.45:0/2750719139 >> v1:172.21.15.155:6789/0 conn(0x7fdbcc15c060 legacy=0x7fdbcc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbc3fff640 1 -- 172.21.15.45:0/2750719139 >> v1:172.21.15.45:6789/0 conn(0x7fdbcc0cd120 legacy=0x7fdbcc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbca7fc640 1 -- 172.21.15.45:0/2750719139 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1175037924 0 0) 0x7fdbb8003530 con 0x7fdbcc0cd120 2023-07-09T02:13:26.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.487+0000 7fdbc3fff640 1 -- 172.21.15.45:0/2750719139 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc15fe40 con 0x7fdbcc0d2620 2023-07-09T02:13:26.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbc3fff640 1 --2- 172.21.15.45:0/2750719139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0d2620 0x7fdbcc0b4ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097f0 tx=0x7fdbb401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f56068814514d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbca7fc640 1 -- 172.21.15.45:0/2750719139 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4001a00 con 0x7fdbcc0d2620 2023-07-09T02:13:26.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbca7fc640 1 -- 172.21.15.45:0/2750719139 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40a7050 con 0x7fdbcc0d2620 2023-07-09T02:13:26.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbca7fc640 1 -- 172.21.15.45:0/2750719139 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40ab620 con 0x7fdbcc0d2620 2023-07-09T02:13:26.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 -- 172.21.15.45:0/2750719139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0d2620 msgr2=0x7fdbcc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 --2- 172.21.15.45:0/2750719139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0d2620 0x7fdbcc0b4ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097f0 tx=0x7fdbb401c3b0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 -- 172.21.15.45:0/2750719139 shutdown_connections 2023-07-09T02:13:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 --2- 172.21.15.45:0/2750719139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc0d2620 0x7fdbcc0b4ed0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 -- 172.21.15.45:0/2750719139 >> 172.21.15.45:0/2750719139 conn(0x7fdbcc0698e0 msgr2=0x7fdbcc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 -- 172.21.15.45:0/2750719139 shutdown_connections 2023-07-09T02:13:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 -- 172.21.15.45:0/2750719139 wait complete. 2023-07-09T02:13:26.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 Processor -- start 2023-07-09T02:13:26.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.491+0000 7fdbd191f640 1 -- start start 2023-07-09T02:13:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 0x7fdbcc0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc1616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc15c060 0x7fdbcc0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc161c00 con 0x7fdbcc0d2620 2023-07-09T02:13:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc0ca7b0 con 0x7fdbcc0cd120 2023-07-09T02:13:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc0caa90 con 0x7fdbcc15c060 2023-07-09T02:13:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc1616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc1616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49388/0 (socket says 172.21.15.45:49388) 2023-07-09T02:13:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 -- 172.21.15.45:0/4204900882 learned_addr learned my addr 172.21.15.45:0/4204900882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbcb7fe640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc15c060 0x7fdbcc0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbcaffd640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 0x7fdbcc0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 -- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc15c060 msgr2=0x7fdbcc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc15c060 0x7fdbcc0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 -- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 msgr2=0x7fdbcc0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 0x7fdbcc0cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 -- 172.21.15.45:0/4204900882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009420 con 0x7fdbcc0d2620 2023-07-09T02:13:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbcb7fe640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc15c060 0x7fdbcc0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbcaffd640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 0x7fdbcc0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc3fff640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc1616c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097f0 tx=0x7fdbb4019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc8ff9640 1 -- 172.21.15.45:0/4204900882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40b4410 con 0x7fdbcc0d2620 2023-07-09T02:13:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc8ff9640 1 -- 172.21.15.45:0/4204900882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40b4570 con 0x7fdbcc0d2620 2023-07-09T02:13:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc8ff9640 1 -- 172.21.15.45:0/4204900882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40b4900 con 0x7fdbcc0d2620 2023-07-09T02:13:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc0b59f0 con 0x7fdbcc0d2620 2023-07-09T02:13:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc0cb050 con 0x7fdbcc0d2620 2023-07-09T02:13:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc0ca8f0 con 0x7fdbcc0d2620 2023-07-09T02:13:26.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.495+0000 7fdbc8ff9640 1 -- 172.21.15.45:0/4204900882 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdbb40b2040 con 0x7fdbcc0d2620 2023-07-09T02:13:26.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.499+0000 7fdbc8ff9640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac066280 0x7fdbac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.499+0000 7fdbc8ff9640 1 -- 172.21.15.45:0/4204900882 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdbb411d750 con 0x7fdbcc0d2620 2023-07-09T02:13:26.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.499+0000 7fdbcaffd640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac066280 0x7fdbac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.499+0000 7fdbcaffd640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac066280 0x7fdbac068730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0011f0 tx=0x7fdbbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.503+0000 7fdbc8ff9640 1 -- 172.21.15.45:0/4204900882 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbcc0ca8f0 con 0x7fdbcc0d2620 2023-07-09T02:13:26.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.659+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbcc0ca8f0 con 0x7fdbcc0d2620 2023-07-09T02:13:26.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.659+0000 7fdbc8ff9640 1 -- 172.21.15.45:0/4204900882 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18447 (secure 0 0 0) 0x7fdbcc0ca8f0 con 0x7fdbcc0d2620 2023-07-09T02:13:26.664 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:26.664 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:16.309432+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:45.075187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:46.325197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.37","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:26.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac066280 msgr2=0x7fdbac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac066280 0x7fdbac068730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0011f0 tx=0x7fdbbc009040 comp rx=0 tx=0).stop 2023-07-09T02:13:26.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 msgr2=0x7fdbcc1616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc1616c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097f0 tx=0x7fdbb4019150 comp rx=0 tx=0).stop 2023-07-09T02:13:26.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 shutdown_connections 2023-07-09T02:13:26.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbac066280 0x7fdbac068730 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc15c060 0x7fdbcc0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbcc0d2620 0x7fdbcc1616c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 --2- 172.21.15.45:0/4204900882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc0cd120 0x7fdbcc0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 >> 172.21.15.45:0/4204900882 conn(0x7fdbcc0698e0 msgr2=0x7fdbcc0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:26.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 shutdown_connections 2023-07-09T02:13:26.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.663+0000 7fdbd191f640 1 -- 172.21.15.45:0/4204900882 wait complete. 2023-07-09T02:13:26.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:12:45.075187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:12:46.325197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:13:26.686 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:13:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.827+0000 7f529b3ad640 1 Processor -- start 2023-07-09T02:13:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.827+0000 7f529b3ad640 1 -- start start 2023-07-09T02:13:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529b3ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940cd120 0x7f52940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529b3ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5294160a50 con 0x7f52940d2620 2023-07-09T02:13:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529b3ad640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529415c430 con 0x7f529415c060 2023-07-09T02:13:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529b3ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529415fb60 con 0x7f52940cd120 2023-07-09T02:13:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f5298948640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52940d2620 0x7f52940cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55624/0 (socket says 172.21.15.45:55624) 2023-07-09T02:13:26.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f5298948640 1 -- 172.21.15.45:0/390633347 learned_addr learned my addr 172.21.15.45:0/390633347 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529994a640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940cd120 0x7f52940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607882527 0 0) 0x7f5294160a50 con 0x7f52940d2620 2023-07-09T02:13:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5280003530 con 0x7f52940d2620 2023-07-09T02:13:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707186776 0 0) 0x7f529415c430 con 0x7f529415c060 2023-07-09T02:13:26.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5294160a50 con 0x7f529415c060 2023-07-09T02:13:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3528041459 0 0) 0x7f5280003530 con 0x7f52940d2620 2023-07-09T02:13:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940cd120 msgr2=0x7f52940b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940cd120 0x7f52940b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 >> v1:172.21.15.155:6789/0 conn(0x7f529415c060 legacy=0x7f52940d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529415fe40 con 0x7f52940d2620 2023-07-09T02:13:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f5284001680 con 0x7f52940d2620 2023-07-09T02:13:26.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529994a640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940cd120 0x7f52940b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 >> v1:172.21.15.45:6789/0 conn(0x7f52940d2620 legacy=0x7f52940cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5280003b40 0x7f5280003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52800047d0 0x7f5280004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280005180 0x7f528000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529415fb60 con 0x7f52800047d0 2023-07-09T02:13:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528000bfb0 con 0x7f5280005180 2023-07-09T02:13:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528000c170 con 0x7f5280003b40 2023-07-09T02:13:26.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f5298948640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52800047d0 0x7f5280004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529994a640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280005180 0x7f528000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f5299149640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5280003b40 0x7f5280003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529994a640 1 -- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5280003b40 msgr2=0x7f5280003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529994a640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5280003b40 0x7f5280003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529994a640 1 -- 172.21.15.45:0/390633347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52800047d0 msgr2=0x7f5280004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529994a640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52800047d0 0x7f5280004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f529994a640 1 -- 172.21.15.45:0/390633347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280003530 con 0x7f5280005180 2023-07-09T02:13:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.831+0000 7f5298948640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52800047d0 0x7f5280004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529994a640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280005180 0x7f528000b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f52940cd4f0 tx=0x7f528c01cd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbd493eb93285aac server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c003ba0 con 0x7f5280005180 2023-07-09T02:13:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c00f040 con 0x7f5280005180 2023-07-09T02:13:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f528bfff640 1 -- 172.21.15.45:0/390633347 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0a57a0 con 0x7f5280005180 2023-07-09T02:13:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529b3ad640 1 -- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280005180 msgr2=0x7f528000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529b3ad640 1 --2- 172.21.15.45:0/390633347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5280005180 0x7f528000b990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f52940cd4f0 tx=0x7f528c01cd20 comp rx=0 tx=0).stop 2023-07-09T02:13:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529994a640 1 -- 172.21.15.45:0/390633347 reap_dead start 2023-07-09T02:13:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529b3ad640 1 -- 172.21.15.45:0/390633347 shutdown_connections 2023-07-09T02:13:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529b3ad640 1 -- 172.21.15.45:0/390633347 >> 172.21.15.45:0/390633347 conn(0x7f52940698e0 msgr2=0x7f5294069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529b3ad640 1 -- 172.21.15.45:0/390633347 shutdown_connections 2023-07-09T02:13:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529b3ad640 1 -- 172.21.15.45:0/390633347 wait complete. 2023-07-09T02:13:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529b3ad640 1 Processor -- start 2023-07-09T02:13:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.835+0000 7f529b3ad640 1 -- start start 2023-07-09T02:13:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5280005180 0x7f52940ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940c9b10 0x7f52940c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52940b6e40 0x7f52940b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529415cc90 con 0x7f5280005180 2023-07-09T02:13:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52940b77f0 con 0x7f52940b6e40 2023-07-09T02:13:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529415c660 con 0x7f52940c9b10 2023-07-09T02:13:26.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5280005180 0x7f52940ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5280005180 0x7f52940ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49392/0 (socket says 172.21.15.45:49392) 2023-07-09T02:13:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 -- 172.21.15.45:0/948295947 learned_addr learned my addr 172.21.15.45:0/948295947 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529994a640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52940b6e40 0x7f52940b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5298948640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940c9b10 0x7f52940c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 -- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940c9b10 msgr2=0x7f52940c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940c9b10 0x7f52940c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 -- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52940b6e40 msgr2=0x7f52940b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52940b6e40 0x7f52940b72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 -- 172.21.15.45:0/948295947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52940ca360 con 0x7f5280005180 2023-07-09T02:13:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529994a640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52940b6e40 0x7f52940b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5298948640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940c9b10 0x7f52940c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5299149640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5280005180 0x7f52940ccb90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5290012890 tx=0x7f5290012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5289ffb640 1 -- 172.21.15.45:0/948295947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290010bd0 con 0x7f5280005180 2023-07-09T02:13:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5289ffb640 1 -- 172.21.15.45:0/948295947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290010d30 con 0x7f5280005180 2023-07-09T02:13:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f5289ffb640 1 -- 172.21.15.45:0/948295947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900166a0 con 0x7f5280005180 2023-07-09T02:13:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52940ca640 con 0x7f5280005180 2023-07-09T02:13:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52940c8e90 con 0x7f5280005180 2023-07-09T02:13:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.839+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529404d7d0 con 0x7f5280005180 2023-07-09T02:13:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.843+0000 7f5289ffb640 1 -- 172.21.15.45:0/948295947 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5290016800 con 0x7f5280005180 2023-07-09T02:13:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.843+0000 7f5289ffb640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52780662d0 0x7f5278068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.843+0000 7f5289ffb640 1 -- 172.21.15.45:0/948295947 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5290087590 con 0x7f5280005180 2023-07-09T02:13:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.843+0000 7f5298948640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52780662d0 0x7f5278068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.843+0000 7f5298948640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52780662d0 0x7f5278068780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f52940b3ec0 tx=0x7f5284009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.847+0000 7f5289ffb640 1 -- 172.21.15.45:0/948295947 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5290054a40 con 0x7f5280005180 2023-07-09T02:13:27.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:26.999+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f529406baa0 con 0x7f5280005180 2023-07-09T02:13:27.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f5289ffb640 1 -- 172.21.15.45:0/948295947 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5290010ea0 con 0x7f5280005180 2023-07-09T02:13:27.005 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:13:27.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52780662d0 msgr2=0x7f5278068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52780662d0 0x7f5278068780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f52940b3ec0 tx=0x7f5284009040 comp rx=0 tx=0).stop 2023-07-09T02:13:27.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5280005180 msgr2=0x7f52940ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5280005180 0x7f52940ccb90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5290012890 tx=0x7f5290012d50 comp rx=0 tx=0).stop 2023-07-09T02:13:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 shutdown_connections 2023-07-09T02:13:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52940b6e40 0x7f52940b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52780662d0 0x7f5278068780 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52940c9b10 0x7f52940c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 --2- 172.21.15.45:0/948295947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5280005180 0x7f52940ccb90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 >> 172.21.15.45:0/948295947 conn(0x7f52940698e0 msgr2=0x7f52940b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 shutdown_connections 2023-07-09T02:13:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.003+0000 7f529b3ad640 1 -- 172.21.15.45:0/948295947 wait complete. 2023-07-09T02:13:27.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:13:27.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.167+0000 7fa899512640 1 Processor -- start 2023-07-09T02:13:27.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.167+0000 7fa899512640 1 -- start start 2023-07-09T02:13:27.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa899512640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa89406b120 0x7fa89406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa899512640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 0x7fa8940cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa899512640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa894069980 0x7fa894069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa899512640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa894071850 con 0x7fa89406b120 2023-07-09T02:13:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa899512640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940cd300 con 0x7fa894069980 2023-07-09T02:13:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa899512640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89406ba30 con 0x7fa8940d23e0 2023-07-09T02:13:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa893fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa89406b120 0x7fa89406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa893fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa89406b120 0x7fa89406b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49400/0 (socket says 172.21.15.45:49400) 2023-07-09T02:13:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa893fff640 1 -- 172.21.15.45:0/655261772 learned_addr learned my addr 172.21.15.45:0/655261772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa898d11640 1 --2- 172.21.15.45:0/655261772 >> v2:172.21.15.155:3300/0 conn(0x7fa894069980 0x7fa894069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa8937fe640 1 --2- 172.21.15.45:0/655261772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 0x7fa8940cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa893fff640 1 -- 172.21.15.45:0/655261772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 msgr2=0x7fa8940cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:27.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa893fff640 1 --2- 172.21.15.45:0/655261772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 0x7fa8940cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa893fff640 1 -- 172.21.15.45:0/655261772 >> v2:172.21.15.155:3300/0 conn(0x7fa894069980 msgr2=0x7fa894069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa893fff640 1 --2- 172.21.15.45:0/655261772 >> v2:172.21.15.155:3300/0 conn(0x7fa894069980 0x7fa894069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa893fff640 1 -- 172.21.15.45:0/655261772 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940d0e80 con 0x7fa89406b120 2023-07-09T02:13:27.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.171+0000 7fa898d11640 1 --2- 172.21.15.45:0/655261772 >> v2:172.21.15.155:3300/0 conn(0x7fa894069980 0x7fa894069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:27.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa893fff640 1 --2- 172.21.15.45:0/655261772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89406b120 0x7fa89406b4f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa89406abc0 tx=0x7fa88401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e5caeff746217f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa892ffd640 1 -- 172.21.15.45:0/655261772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840aa5f0 con 0x7fa89406b120 2023-07-09T02:13:27.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa892ffd640 1 -- 172.21.15.45:0/655261772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8840aa750 con 0x7fa89406b120 2023-07-09T02:13:27.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa892ffd640 1 -- 172.21.15.45:0/655261772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840aaae0 con 0x7fa89406b120 2023-07-09T02:13:27.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 -- 172.21.15.45:0/655261772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89406b120 msgr2=0x7fa89406b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 --2- 172.21.15.45:0/655261772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89406b120 0x7fa89406b4f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa89406abc0 tx=0x7fa88401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 -- 172.21.15.45:0/655261772 shutdown_connections 2023-07-09T02:13:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 --2- 172.21.15.45:0/655261772 >> v2:172.21.15.155:3300/0 conn(0x7fa894069980 0x7fa894069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 --2- 172.21.15.45:0/655261772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 0x7fa8940cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 --2- 172.21.15.45:0/655261772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa89406b120 0x7fa89406b4f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 -- 172.21.15.45:0/655261772 >> 172.21.15.45:0/655261772 conn(0x7fa8940cf3b0 msgr2=0x7fa8940cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 -- 172.21.15.45:0/655261772 shutdown_connections 2023-07-09T02:13:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 -- 172.21.15.45:0/655261772 wait complete. 2023-07-09T02:13:27.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 Processor -- start 2023-07-09T02:13:27.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 -- start start 2023-07-09T02:13:27.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa894069980 0x7fa89415d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa89406b120 0x7fa89415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 0x7fa8940b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.175+0000 7fa899512640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa894155950 con 0x7fa894069980 2023-07-09T02:13:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa899512640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89415de80 con 0x7fa89406b120 2023-07-09T02:13:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa899512640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8941550b0 con 0x7fa8940d23e0 2023-07-09T02:13:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa894069980 0x7fa89415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa894069980 0x7fa89415d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49406/0 (socket says 172.21.15.45:49406) 2023-07-09T02:13:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 -- 172.21.15.45:0/3432845130 learned_addr learned my addr 172.21.15.45:0/3432845130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa8937fe640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa89406b120 0x7fa89415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa898d11640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 0x7fa8940b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 -- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 msgr2=0x7fa8940b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 0x7fa8940b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 -- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa89406b120 msgr2=0x7fa89415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa89406b120 0x7fa89415e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 -- 172.21.15.45:0/3432845130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840094d0 con 0x7fa894069980 2023-07-09T02:13:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa893fff640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa894069980 0x7fa89415d810 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa88401ab80 tx=0x7fa88401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa890ff9640 1 -- 172.21.15.45:0/3432845130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840aa5f0 con 0x7fa894069980 2023-07-09T02:13:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa890ff9640 1 -- 172.21.15.45:0/3432845130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8840b3800 con 0x7fa894069980 2023-07-09T02:13:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa894155390 con 0x7fa894069980 2023-07-09T02:13:27.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa890ff9640 1 -- 172.21.15.45:0/3432845130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840b3b90 con 0x7fa894069980 2023-07-09T02:13:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8940b3600 con 0x7fa894069980 2023-07-09T02:13:27.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8940b37f0 con 0x7fa894069980 2023-07-09T02:13:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.179+0000 7fa890ff9640 1 -- 172.21.15.45:0/3432845130 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8840b3cf0 con 0x7fa894069980 2023-07-09T02:13:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.183+0000 7fa890ff9640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa880066280 0x7fa880068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.183+0000 7fa890ff9640 1 -- 172.21.15.45:0/3432845130 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa8840a7070 con 0x7fa894069980 2023-07-09T02:13:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.183+0000 7fa8937fe640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa880066280 0x7fa880068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.183+0000 7fa8937fe640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa880066280 0x7fa880068730 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8940c9390 tx=0x7fa888008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.183+0000 7fa890ff9640 1 -- 172.21.15.45:0/3432845130 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8940b37f0 con 0x7fa894069980 2023-07-09T02:13:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa8940b37f0 con 0x7fa894069980 2023-07-09T02:13:27.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa890ff9640 1 -- 172.21.15.45:0/3432845130 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8940b37f0 con 0x7fa894069980 2023-07-09T02:13:27.343 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:13:27.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa880066280 msgr2=0x7fa880068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa880066280 0x7fa880068730 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8940c9390 tx=0x7fa888008040 comp rx=0 tx=0).stop 2023-07-09T02:13:27.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa894069980 msgr2=0x7fa89415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa894069980 0x7fa89415d810 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa88401ab80 tx=0x7fa88401ad10 comp rx=0 tx=0).stop 2023-07-09T02:13:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 shutdown_connections 2023-07-09T02:13:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa880066280 0x7fa880068730 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8940d23e0 0x7fa8940b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa89406b120 0x7fa89415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 --2- 172.21.15.45:0/3432845130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa894069980 0x7fa89415d810 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 >> 172.21.15.45:0/3432845130 conn(0x7fa8940cf3b0 msgr2=0x7fa89415bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:27.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 shutdown_connections 2023-07-09T02:13:27.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.339+0000 7fa899512640 1 -- 172.21.15.45:0/3432845130 wait complete. 2023-07-09T02:13:27.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:13:27.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.503+0000 7fa71e2ec640 1 Processor -- start 2023-07-09T02:13:27.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa71e2ec640 1 -- start start 2023-07-09T02:13:27.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa71e2ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa7180d2620 0x7fa7180b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa71e2ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa7180cd120 0x7fa7180cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa71e2ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa718160a50 con 0x7fa71815c060 2023-07-09T02:13:27.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa71e2ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71815c430 con 0x7fa7180d2620 2023-07-09T02:13:27.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa71e2ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71815fb60 con 0x7fa7180cd120 2023-07-09T02:13:27.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa7177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa7180d2620 0x7fa7180b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa7177fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa7180d2620 0x7fa7180b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49408/0 (socket says 172.21.15.45:49408) 2023-07-09T02:13:27.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa7177fe640 1 -- 172.21.15.45:0/375489345 learned_addr learned my addr 172.21.15.45:0/375489345 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:27.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa71c889640 1 --2- 172.21.15.45:0/375489345 >> v2:172.21.15.155:3300/0 conn(0x7fa7180cd120 0x7fa7180cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa7177fe640 1 -- 172.21.15.45:0/375489345 >> v2:172.21.15.155:3300/0 conn(0x7fa7180cd120 msgr2=0x7fa7180cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:27.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa7177fe640 1 --2- 172.21.15.45:0/375489345 >> v2:172.21.15.155:3300/0 conn(0x7fa7180cd120 0x7fa7180cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa7177fe640 1 -- 172.21.15.45:0/375489345 >> v1:172.21.15.155:6789/0 conn(0x7fa71815c060 legacy=0x7fa7180d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.507+0000 7fa7177fe640 1 -- 172.21.15.45:0/375489345 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71815fe40 con 0x7fa7180d2620 2023-07-09T02:13:27.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa7177fe640 1 --2- 172.21.15.45:0/375489345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180d2620 0x7fa7180b4ed0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa71806b120 tx=0x7fa70c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5abc02d673535c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa716ffd640 1 -- 172.21.15.45:0/375489345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0aa430 con 0x7fa7180d2620 2023-07-09T02:13:27.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa716ffd640 1 -- 172.21.15.45:0/375489345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c0aa590 con 0x7fa7180d2620 2023-07-09T02:13:27.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa716ffd640 1 -- 172.21.15.45:0/375489345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0aa920 con 0x7fa7180d2620 2023-07-09T02:13:27.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 -- 172.21.15.45:0/375489345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180d2620 msgr2=0x7fa7180b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/375489345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180d2620 0x7fa7180b4ed0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa71806b120 tx=0x7fa70c01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 -- 172.21.15.45:0/375489345 shutdown_connections 2023-07-09T02:13:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/375489345 >> v2:172.21.15.155:3300/0 conn(0x7fa7180cd120 0x7fa7180cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/375489345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180d2620 0x7fa7180b4ed0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 -- 172.21.15.45:0/375489345 >> 172.21.15.45:0/375489345 conn(0x7fa7180698e0 msgr2=0x7fa718069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 -- 172.21.15.45:0/375489345 shutdown_connections 2023-07-09T02:13:27.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 -- 172.21.15.45:0/375489345 wait complete. 2023-07-09T02:13:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 Processor -- start 2023-07-09T02:13:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.511+0000 7fa71e2ec640 1 -- start start 2023-07-09T02:13:27.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180cd120 0x7fa7180cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7180d2620 0x7fa7181530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815c060 0x7fa7180d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa718153b50 con 0x7fa7180cd120 2023-07-09T02:13:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7180ccd50 con 0x7fa7180d2620 2023-07-09T02:13:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71815c600 con 0x7fa71815c060 2023-07-09T02:13:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180cd120 0x7fa7180cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180cd120 0x7fa7180cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49418/0 (socket says 172.21.15.45:49418) 2023-07-09T02:13:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 -- 172.21.15.45:0/1999419981 learned_addr learned my addr 172.21.15.45:0/1999419981 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa7177fe640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7180d2620 0x7fa7181530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71c889640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815c060 0x7fa7180d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 -- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815c060 msgr2=0x7fa7180d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815c060 0x7fa7180d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 -- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7180d2620 msgr2=0x7fa7181530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7180d2620 0x7fa7181530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 -- 172.21.15.45:0/1999419981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c0094d0 con 0x7fa7180cd120 2023-07-09T02:13:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71c889640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815c060 0x7fa7180d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa7177fe640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7180d2620 0x7fa7181530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa717fff640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180cd120 0x7fa7180cc6c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa70800c3c0 tx=0x7fa70800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa714ff9640 1 -- 172.21.15.45:0/1999419981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080052d0 con 0x7fa7180cd120 2023-07-09T02:13:27.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa714ff9640 1 -- 172.21.15.45:0/1999419981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa708005430 con 0x7fa7180cd120 2023-07-09T02:13:27.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa714ff9640 1 -- 172.21.15.45:0/1999419981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708003840 con 0x7fa7180cd120 2023-07-09T02:13:27.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7180b59f0 con 0x7fa7180cd120 2023-07-09T02:13:27.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71815cbc0 con 0x7fa7180cd120 2023-07-09T02:13:27.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.515+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71804d7d0 con 0x7fa7180cd120 2023-07-09T02:13:27.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.519+0000 7fa714ff9640 1 -- 172.21.15.45:0/1999419981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7080039a0 con 0x7fa7180cd120 2023-07-09T02:13:27.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.519+0000 7fa714ff9640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa704066280 0x7fa704068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.519+0000 7fa714ff9640 1 -- 172.21.15.45:0/1999419981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa708083200 con 0x7fa7180cd120 2023-07-09T02:13:27.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.519+0000 7fa7177fe640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa704066280 0x7fa704068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.519+0000 7fa7177fe640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa704066280 0x7fa704068730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0ae000 tx=0x7fa70c0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.523+0000 7fa714ff9640 1 -- 172.21.15.45:0/1999419981 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7080506f0 con 0x7fa7180cd120 2023-07-09T02:13:27.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.671+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa71806baa0 con 0x7fa7180cd120 2023-07-09T02:13:27.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa714ff9640 1 -- 172.21.15.45:0/1999419981 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa708053d10 con 0x7fa7180cd120 2023-07-09T02:13:27.677 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:13:27.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa704066280 msgr2=0x7fa704068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa704066280 0x7fa704068730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0ae000 tx=0x7fa70c0b5040 comp rx=0 tx=0).stop 2023-07-09T02:13:27.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180cd120 msgr2=0x7fa7180cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180cd120 0x7fa7180cc6c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa70800c3c0 tx=0x7fa70800c880 comp rx=0 tx=0).stop 2023-07-09T02:13:27.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 shutdown_connections 2023-07-09T02:13:27.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa704066280 0x7fa704068730 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815c060 0x7fa7180d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7180d2620 0x7fa7181530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 --2- 172.21.15.45:0/1999419981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7180cd120 0x7fa7180cc6c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 >> 172.21.15.45:0/1999419981 conn(0x7fa7180698e0 msgr2=0x7fa7180b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:27.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 shutdown_connections 2023-07-09T02:13:27.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.675+0000 7fa71e2ec640 1 -- 172.21.15.45:0/1999419981 wait complete. 2023-07-09T02:13:27.698 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:13:27.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.839+0000 7fa235511640 1 Processor -- start 2023-07-09T02:13:27.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.839+0000 7fa235511640 1 -- start start 2023-07-09T02:13:27.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa235511640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa23015c060 0x7fa2300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa235511640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa230160a50 con 0x7fa2300d2620 2023-07-09T02:13:27.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa235511640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23015c430 con 0x7fa2300cd120 2023-07-09T02:13:27.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa235511640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23015fb60 con 0x7fa23015c060 2023-07-09T02:13:27.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa22effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa23015c060 0x7fa2300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa22f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa2300d2620 0x7fa2300cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55626/0 (socket says 172.21.15.45:55626) 2023-07-09T02:13:27.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa22f7fe640 1 -- 172.21.15.45:0/1305441982 learned_addr learned my addr 172.21.15.45:0/1305441982 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:27.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa22effd640 1 -- 172.21.15.45:0/1305441982 >> v1:172.21.15.155:6789/0 conn(0x7fa2300cd120 legacy=0x7fa2300d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa22effd640 1 -- 172.21.15.45:0/1305441982 >> v1:172.21.15.45:6789/0 conn(0x7fa2300d2620 legacy=0x7fa2300cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.843+0000 7fa22effd640 1 -- 172.21.15.45:0/1305441982 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23015fe40 con 0x7fa23015c060 2023-07-09T02:13:27.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa22effd640 1 --2- 172.21.15.45:0/1305441982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23015c060 0x7fa2300b4ed0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa2200097c0 tx=0x7fa22001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104cf91a19b8a1e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa22e7fc640 1 -- 172.21.15.45:0/1305441982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200ab650 con 0x7fa23015c060 2023-07-09T02:13:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa22e7fc640 1 -- 172.21.15.45:0/1305441982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2200ab7b0 con 0x7fa23015c060 2023-07-09T02:13:27.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa22e7fc640 1 -- 172.21.15.45:0/1305441982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200abb40 con 0x7fa23015c060 2023-07-09T02:13:27.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- 172.21.15.45:0/1305441982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23015c060 msgr2=0x7fa2300b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 --2- 172.21.15.45:0/1305441982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23015c060 0x7fa2300b4ed0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa2200097c0 tx=0x7fa22001c450 comp rx=0 tx=0).stop 2023-07-09T02:13:27.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- 172.21.15.45:0/1305441982 shutdown_connections 2023-07-09T02:13:27.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 --2- 172.21.15.45:0/1305441982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23015c060 0x7fa2300b4ed0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- 172.21.15.45:0/1305441982 >> 172.21.15.45:0/1305441982 conn(0x7fa2300698e0 msgr2=0x7fa230069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:27.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- 172.21.15.45:0/1305441982 shutdown_connections 2023-07-09T02:13:27.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- 172.21.15.45:0/1305441982 wait complete. 2023-07-09T02:13:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 Processor -- start 2023-07-09T02:13:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- start start 2023-07-09T02:13:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2300cd120 0x7fa230158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2300d2620 0x7fa2300c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23015c060 0x7fa2300b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa230158480 con 0x7fa2300d2620 2023-07-09T02:13:27.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa230157800 con 0x7fa2300cd120 2023-07-09T02:13:27.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.847+0000 7fa235511640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa230157ae0 con 0x7fa23015c060 2023-07-09T02:13:27.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2300d2620 0x7fa2300c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2300d2620 0x7fa2300c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49426/0 (socket says 172.21.15.45:49426) 2023-07-09T02:13:27.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 -- 172.21.15.45:0/3421292746 learned_addr learned my addr 172.21.15.45:0/3421292746 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:27.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa22effd640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2300cd120 0x7fa230158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa22f7fe640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23015c060 0x7fa2300b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 -- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23015c060 msgr2=0x7fa2300b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23015c060 0x7fa2300b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 -- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2300cd120 msgr2=0x7fa230158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:27.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2300cd120 0x7fa230158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:27.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 -- 172.21.15.45:0/3421292746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220009420 con 0x7fa2300d2620 2023-07-09T02:13:27.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa22effd640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2300cd120 0x7fa230158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:27.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa227fff640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2300d2620 0x7fa2300c88f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c4d0 tx=0x7fa21800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa2277fe640 1 -- 172.21.15.45:0/3421292746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180052d0 con 0x7fa2300d2620 2023-07-09T02:13:27.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa2277fe640 1 -- 172.21.15.45:0/3421292746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218005430 con 0x7fa2300d2620 2023-07-09T02:13:27.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa2277fe640 1 -- 172.21.15.45:0/3421292746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218012830 con 0x7fa2300d2620 2023-07-09T02:13:27.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2300b59f0 con 0x7fa2300d2620 2023-07-09T02:13:27.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2301580a0 con 0x7fa2300d2620 2023-07-09T02:13:27.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23004d7d0 con 0x7fa2300d2620 2023-07-09T02:13:27.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa2277fe640 1 -- 172.21.15.45:0/3421292746 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa218012990 con 0x7fa2300d2620 2023-07-09T02:13:27.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.851+0000 7fa2277fe640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa210066280 0x7fa210068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:27.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.855+0000 7fa2277fe640 1 -- 172.21.15.45:0/3421292746 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa218083860 con 0x7fa2300d2620 2023-07-09T02:13:27.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.855+0000 7fa22effd640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa210066280 0x7fa210068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:27.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.855+0000 7fa22effd640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa210066280 0x7fa210068730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa2200af000 tx=0x7fa2200a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:27.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:27.855+0000 7fa2277fe640 1 -- 172.21.15.45:0/3421292746 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa218050c90 con 0x7fa2300d2620 2023-07-09T02:13:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa23006baa0 con 0x7fa2300d2620 2023-07-09T02:13:28.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa2277fe640 1 -- 172.21.15.45:0/3421292746 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2180542b0 con 0x7fa2300d2620 2023-07-09T02:13:28.017 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:13:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa210066280 msgr2=0x7fa210068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa210066280 0x7fa210068730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa2200af000 tx=0x7fa2200a7000 comp rx=0 tx=0).stop 2023-07-09T02:13:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2300d2620 msgr2=0x7fa2300c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2300d2620 0x7fa2300c88f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c4d0 tx=0x7fa21800c990 comp rx=0 tx=0).stop 2023-07-09T02:13:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 shutdown_connections 2023-07-09T02:13:28.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa210066280 0x7fa210068730 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23015c060 0x7fa2300b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2300d2620 0x7fa2300c88f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 --2- 172.21.15.45:0/3421292746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2300cd120 0x7fa230158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 >> 172.21.15.45:0/3421292746 conn(0x7fa2300698e0 msgr2=0x7fa2300b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:28.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 shutdown_connections 2023-07-09T02:13:28.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.015+0000 7fa235511640 1 -- 172.21.15.45:0/3421292746 wait complete. 2023-07-09T02:13:28.038 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48fb6d8640 1 Processor -- start 2023-07-09T02:13:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48fb6d8640 1 -- start start 2023-07-09T02:13:28.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48fb6d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48f415c060 0x7f48f40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48fb6d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48f40d2620 0x7f48f40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48fb6d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f4160a50 con 0x7f48f40cd120 2023-07-09T02:13:28.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48fb6d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f415c430 con 0x7f48f415c060 2023-07-09T02:13:28.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48fb6d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f415fb60 con 0x7f48f40d2620 2023-07-09T02:13:28.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f8c73640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f48f40cd120 0x7f48f40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55632/0 (socket says 172.21.15.45:55632) 2023-07-09T02:13:28.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f8c73640 1 -- 172.21.15.45:0/4163927330 learned_addr learned my addr 172.21.15.45:0/4163927330 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:28.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f9474640 1 --2- 172.21.15.45:0/4163927330 >> v2:172.21.15.45:3300/0 conn(0x7f48f415c060 0x7f48f40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f9c75640 1 --2- 172.21.15.45:0/4163927330 >> v2:172.21.15.155:3300/0 conn(0x7f48f40d2620 0x7f48f40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48ebfff640 1 -- 172.21.15.45:0/4163927330 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835728431 0 0) 0x7f48f4160a50 con 0x7f48f40cd120 2023-07-09T02:13:28.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48ebfff640 1 -- 172.21.15.45:0/4163927330 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e0003530 con 0x7f48f40cd120 2023-07-09T02:13:28.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f9474640 1 -- 172.21.15.45:0/4163927330 >> v2:172.21.15.155:3300/0 conn(0x7f48f40d2620 msgr2=0x7f48f40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f9474640 1 --2- 172.21.15.45:0/4163927330 >> v2:172.21.15.155:3300/0 conn(0x7f48f40d2620 0x7f48f40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f9474640 1 -- 172.21.15.45:0/4163927330 >> v1:172.21.15.45:6789/0 conn(0x7f48f40cd120 legacy=0x7f48f40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f9474640 1 -- 172.21.15.45:0/4163927330 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f415fe40 con 0x7f48f415c060 2023-07-09T02:13:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.179+0000 7f48f9c75640 1 --2- 172.21.15.45:0/4163927330 >> v2:172.21.15.155:3300/0 conn(0x7f48f40d2620 0x7f48f40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48f9474640 1 --2- 172.21.15.45:0/4163927330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f415c060 0x7f48f40b4ed0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f48f408bca0 tx=0x7f48f001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3904171b9340ced server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48ebfff640 1 -- 172.21.15.45:0/4163927330 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a7070 con 0x7f48f415c060 2023-07-09T02:13:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48ebfff640 1 -- 172.21.15.45:0/4163927330 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f00ab430 con 0x7f48f415c060 2023-07-09T02:13:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48ebfff640 1 -- 172.21.15.45:0/4163927330 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00ab7a0 con 0x7f48f415c060 2023-07-09T02:13:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48fb6d8640 1 -- 172.21.15.45:0/4163927330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f415c060 msgr2=0x7f48f40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/4163927330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f415c060 0x7f48f40b4ed0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f48f408bca0 tx=0x7f48f001c430 comp rx=0 tx=0).stop 2023-07-09T02:13:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48fb6d8640 1 -- 172.21.15.45:0/4163927330 shutdown_connections 2023-07-09T02:13:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/4163927330 >> v2:172.21.15.155:3300/0 conn(0x7f48f40d2620 0x7f48f40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/4163927330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f415c060 0x7f48f40b4ed0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48fb6d8640 1 -- 172.21.15.45:0/4163927330 >> 172.21.15.45:0/4163927330 conn(0x7f48f40698e0 msgr2=0x7f48f4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48fb6d8640 1 -- 172.21.15.45:0/4163927330 shutdown_connections 2023-07-09T02:13:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.183+0000 7f48fb6d8640 1 -- 172.21.15.45:0/4163927330 wait complete. 2023-07-09T02:13:28.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 Processor -- start 2023-07-09T02:13:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 -- start start 2023-07-09T02:13:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f40cd120 0x7f48f40c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f40d2620 0x7f48f4156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f415c060 0x7f48f4157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f415ed60 con 0x7f48f40cd120 2023-07-09T02:13:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f415e8d0 con 0x7f48f415c060 2023-07-09T02:13:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f415dcc0 con 0x7f48f40d2620 2023-07-09T02:13:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f40cd120 0x7f48f40c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f40cd120 0x7f48f40c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49438/0 (socket says 172.21.15.45:49438) 2023-07-09T02:13:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 -- 172.21.15.45:0/3001368968 learned_addr learned my addr 172.21.15.45:0/3001368968 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9c75640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f415c060 0x7f48f4157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f8c73640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f40d2620 0x7f48f4156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 -- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f40d2620 msgr2=0x7f48f4156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f40d2620 0x7f48f4156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 -- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f415c060 msgr2=0x7f48f4157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f415c060 0x7f48f4157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 -- 172.21.15.45:0/3001368968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0009420 con 0x7f48f40cd120 2023-07-09T02:13:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9c75640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f415c060 0x7f48f4157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f8c73640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f40d2620 0x7f48f4156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48f9474640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f40cd120 0x7f48f40c9380 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f48f001a060 tx=0x7f48f001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48e9ffb640 1 -- 172.21.15.45:0/3001368968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0006e20 con 0x7f48f40cd120 2023-07-09T02:13:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48e9ffb640 1 -- 172.21.15.45:0/3001368968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f00b5610 con 0x7f48f40cd120 2023-07-09T02:13:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48e9ffb640 1 -- 172.21.15.45:0/3001368968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b5980 con 0x7f48f40cd120 2023-07-09T02:13:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f40b59f0 con 0x7f48f40cd120 2023-07-09T02:13:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.187+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f415e280 con 0x7f48f40cd120 2023-07-09T02:13:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.191+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f404d7d0 con 0x7f48f40cd120 2023-07-09T02:13:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.191+0000 7f48e9ffb640 1 -- 172.21.15.45:0/3001368968 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48f00b5ae0 con 0x7f48f40cd120 2023-07-09T02:13:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.191+0000 7f48e9ffb640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48d8066280 0x7f48d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.191+0000 7f48e9ffb640 1 -- 172.21.15.45:0/3001368968 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f48f011e030 con 0x7f48f40cd120 2023-07-09T02:13:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.191+0000 7f48f8c73640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48d8066280 0x7f48d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.191+0000 7f48f8c73640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48d8066280 0x7f48d8068730 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f48f4158390 tx=0x7f48e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.195+0000 7f48e9ffb640 1 -- 172.21.15.45:0/3001368968 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48f00eb520 con 0x7f48f40cd120 2023-07-09T02:13:28.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48f414b3d0 con 0x7f48f40cd120 2023-07-09T02:13:28.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48e9ffb640 1 -- 172.21.15.45:0/3001368968 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f48f00c4090 con 0x7f48f40cd120 2023-07-09T02:13:28.389 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:28.390 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:13:28.390 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:13:28.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48d8066280 msgr2=0x7f48d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48d8066280 0x7f48d8068730 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f48f4158390 tx=0x7f48e4009040 comp rx=0 tx=0).stop 2023-07-09T02:13:28.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f40cd120 msgr2=0x7f48f40c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f40cd120 0x7f48f40c9380 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f48f001a060 tx=0x7f48f001ac70 comp rx=0 tx=0).stop 2023-07-09T02:13:28.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 shutdown_connections 2023-07-09T02:13:28.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48f415c060 0x7f48f4157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48d8066280 0x7f48d8068730 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48f40d2620 0x7f48f4156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 --2- 172.21.15.45:0/3001368968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f40cd120 0x7f48f40c9380 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 >> 172.21.15.45:0/3001368968 conn(0x7f48f40698e0 msgr2=0x7f48f41584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 shutdown_connections 2023-07-09T02:13:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.387+0000 7f48fb6d8640 1 -- 172.21.15.45:0/3001368968 wait complete. 2023-07-09T02:13:28.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcde02d8640 1 Processor -- start 2023-07-09T02:13:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcde02d8640 1 -- start start 2023-07-09T02:13:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcde02d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcdd815c060 0x7fcdd80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcde02d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcdd80d2620 0x7fcdd80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcde02d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd8160a50 con 0x7fcdd80cd120 2023-07-09T02:13:28.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcde02d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd815c430 con 0x7fcdd815c060 2023-07-09T02:13:28.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcde02d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd815fb60 con 0x7fcdd80d2620 2023-07-09T02:13:28.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcddd873640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcdd80cd120 0x7fcdd80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55640/0 (socket says 172.21.15.45:55640) 2023-07-09T02:13:28.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcddd873640 1 -- 172.21.15.45:0/3057004555 learned_addr learned my addr 172.21.15.45:0/3057004555 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:28.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcdde074640 1 --2- 172.21.15.45:0/3057004555 >> v2:172.21.15.45:3300/0 conn(0x7fcdd815c060 0x7fcdd80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcdde875640 1 --2- 172.21.15.45:0/3057004555 >> v2:172.21.15.155:3300/0 conn(0x7fcdd80d2620 0x7fcdd80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcdde074640 1 -- 172.21.15.45:0/3057004555 >> v2:172.21.15.155:3300/0 conn(0x7fcdd80d2620 msgr2=0x7fcdd80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:28.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcdde074640 1 --2- 172.21.15.45:0/3057004555 >> v2:172.21.15.155:3300/0 conn(0x7fcdd80d2620 0x7fcdd80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcdde074640 1 -- 172.21.15.45:0/3057004555 >> v1:172.21.15.45:6789/0 conn(0x7fcdd80cd120 legacy=0x7fcdd80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.551+0000 7fcdde074640 1 -- 172.21.15.45:0/3057004555 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd815fe40 con 0x7fcdd815c060 2023-07-09T02:13:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcdde074640 1 --2- 172.21.15.45:0/3057004555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd815c060 0x7fcdd80b4ed0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcdd808bca0 tx=0x7fcdd401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7864caafe0dc6a9d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcddd072640 1 -- 172.21.15.45:0/3057004555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40a7070 con 0x7fcdd815c060 2023-07-09T02:13:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcddd072640 1 -- 172.21.15.45:0/3057004555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd40ab430 con 0x7fcdd815c060 2023-07-09T02:13:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcddd072640 1 -- 172.21.15.45:0/3057004555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40ab7c0 con 0x7fcdd815c060 2023-07-09T02:13:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcde02d8640 1 -- 172.21.15.45:0/3057004555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd815c060 msgr2=0x7fcdd80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3057004555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd815c060 0x7fcdd80b4ed0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcdd808bca0 tx=0x7fcdd401c430 comp rx=0 tx=0).stop 2023-07-09T02:13:28.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcde02d8640 1 -- 172.21.15.45:0/3057004555 shutdown_connections 2023-07-09T02:13:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3057004555 >> v2:172.21.15.155:3300/0 conn(0x7fcdd80d2620 0x7fcdd80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3057004555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd815c060 0x7fcdd80b4ed0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcde02d8640 1 -- 172.21.15.45:0/3057004555 >> 172.21.15.45:0/3057004555 conn(0x7fcdd80698e0 msgr2=0x7fcdd8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcde02d8640 1 -- 172.21.15.45:0/3057004555 shutdown_connections 2023-07-09T02:13:28.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.555+0000 7fcde02d8640 1 -- 172.21.15.45:0/3057004555 wait complete. 2023-07-09T02:13:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 Processor -- start 2023-07-09T02:13:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 -- start start 2023-07-09T02:13:28.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd80cd120 0x7fcdd81666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d2620 0x7fcdd80ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd815c060 0x7fcdd815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd815c980 con 0x7fcdd80cd120 2023-07-09T02:13:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80cb4c0 con 0x7fcdd80d2620 2023-07-09T02:13:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80caf00 con 0x7fcdd815c060 2023-07-09T02:13:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd80cd120 0x7fcdd81666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd80cd120 0x7fcdd81666c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49456/0 (socket says 172.21.15.45:49456) 2023-07-09T02:13:28.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 -- 172.21.15.45:0/3051146133 learned_addr learned my addr 172.21.15.45:0/3051146133 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:28.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcddd873640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d2620 0x7fcdd80ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde875640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd815c060 0x7fcdd815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 -- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd815c060 msgr2=0x7fcdd815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd815c060 0x7fcdd815ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 -- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d2620 msgr2=0x7fcdd80ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d2620 0x7fcdd80ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 -- 172.21.15.45:0/3051146133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd4009420 con 0x7fcdd80cd120 2023-07-09T02:13:28.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdde074640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd80cd120 0x7fcdd81666c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40ad040 tx=0x7fcdd401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdceffd640 1 -- 172.21.15.45:0/3051146133 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40b5810 con 0x7fcdd80cd120 2023-07-09T02:13:28.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdceffd640 1 -- 172.21.15.45:0/3051146133 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd40b5990 con 0x7fcdd80cd120 2023-07-09T02:13:28.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd80b59f0 con 0x7fcdd80cd120 2023-07-09T02:13:28.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcdceffd640 1 -- 172.21.15.45:0/3051146133 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40b5d40 con 0x7fcdd80cd120 2023-07-09T02:13:28.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.559+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd815c610 con 0x7fcdd80cd120 2023-07-09T02:13:28.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.563+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd804d7d0 con 0x7fcdd80cd120 2023-07-09T02:13:28.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.563+0000 7fcdceffd640 1 -- 172.21.15.45:0/3051146133 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcdd40c83e0 con 0x7fcdd80cd120 2023-07-09T02:13:28.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.563+0000 7fcdceffd640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdbc066280 0x7fcdbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.563+0000 7fcdceffd640 1 -- 172.21.15.45:0/3051146133 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcdd411ee40 con 0x7fcdd80cd120 2023-07-09T02:13:28.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.563+0000 7fcddd873640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdbc066280 0x7fcdbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.563+0000 7fcddd873640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdbc066280 0x7fcdbc068730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcdd81f8b80 tx=0x7fcdc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.567+0000 7fcdceffd640 1 -- 172.21.15.45:0/3051146133 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcdd40ec270 con 0x7fcdd80cd120 2023-07-09T02:13:28.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdd806baa0 con 0x7fcdd80cd120 2023-07-09T02:13:28.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcdceffd640 1 -- 172.21.15.45:0/3051146133 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18447 (secure 0 0 0) 0x7fcdd4006e20 con 0x7fcdd80cd120 2023-07-09T02:13:28.726 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:28.726 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:16.309432+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:45.075187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:46.325197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.37","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:28.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdbc066280 msgr2=0x7fcdbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdbc066280 0x7fcdbc068730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcdd81f8b80 tx=0x7fcdc8009040 comp rx=0 tx=0).stop 2023-07-09T02:13:28.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd80cd120 msgr2=0x7fcdd81666c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd80cd120 0x7fcdd81666c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40ad040 tx=0x7fcdd401ac70 comp rx=0 tx=0).stop 2023-07-09T02:13:28.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 shutdown_connections 2023-07-09T02:13:28.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdbc066280 0x7fcdbc068730 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd815c060 0x7fcdd815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d2620 0x7fcdd80ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 --2- 172.21.15.45:0/3051146133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdd80cd120 0x7fcdd81666c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 >> 172.21.15.45:0/3051146133 conn(0x7fcdd80698e0 msgr2=0x7fcdd8069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:28.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 shutdown_connections 2023-07-09T02:13:28.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.723+0000 7fcde02d8640 1 -- 172.21.15.45:0/3051146133 wait complete. 2023-07-09T02:13:28.750 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:13:28.751 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a2ac5c640 1 Processor -- start 2023-07-09T02:13:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a2ac5c640 1 -- start start 2023-07-09T02:13:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a2ac5c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a2415c060 0x7f0a240b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a2ac5c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a2ac5c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a24160a50 con 0x7f0a240d2450 2023-07-09T02:13:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a2ac5c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a240d28f0 con 0x7f0a2415c060 2023-07-09T02:13:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a2ac5c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240cfe40 con 0x7f0a240cd120 2023-07-09T02:13:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a289f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a2415c060 0x7f0a240b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a23fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a289f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a2415c060 0x7f0a240b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:46216/0 (socket says 172.21.15.45:46216) 2023-07-09T02:13:28.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a289f8640 1 -- 172.21.15.45:0/2227340754 learned_addr learned my addr 172.21.15.45:0/2227340754 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:28.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a289f8640 1 -- 172.21.15.45:0/2227340754 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240cd120 msgr2=0x7f0a240d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:28.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a289f8640 1 --2- 172.21.15.45:0/2227340754 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.891+0000 7f0a289f8640 1 -- 172.21.15.45:0/2227340754 >> v1:172.21.15.155:6789/0 conn(0x7f0a240d2450 legacy=0x7f0a240d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a289f8640 1 -- 172.21.15.45:0/2227340754 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2415c430 con 0x7f0a2415c060 2023-07-09T02:13:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a23fff640 1 --2- 172.21.15.45:0/2227340754 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a289f8640 1 --2- 172.21.15.45:0/2227340754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 0x7f0a240b4ed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009870 tx=0x7f0a1801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da638c8011eea4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a237fe640 1 -- 172.21.15.45:0/2227340754 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180a7070 con 0x7f0a2415c060 2023-07-09T02:13:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a237fe640 1 -- 172.21.15.45:0/2227340754 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a180ab430 con 0x7f0a2415c060 2023-07-09T02:13:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a237fe640 1 -- 172.21.15.45:0/2227340754 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180ab7c0 con 0x7f0a2415c060 2023-07-09T02:13:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/2227340754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 msgr2=0x7f0a240b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/2227340754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 0x7f0a240b4ed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009870 tx=0x7f0a1801c510 comp rx=0 tx=0).stop 2023-07-09T02:13:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/2227340754 shutdown_connections 2023-07-09T02:13:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/2227340754 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/2227340754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 0x7f0a240b4ed0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/2227340754 >> 172.21.15.45:0/2227340754 conn(0x7f0a240698e0 msgr2=0x7f0a24069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/2227340754 shutdown_connections 2023-07-09T02:13:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.895+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/2227340754 wait complete. 2023-07-09T02:13:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a2ac5c640 1 Processor -- start 2023-07-09T02:13:28.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a2ac5c640 1 -- start start 2023-07-09T02:13:28.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a2ac5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240cd120 0x7f0a2415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a2ac5c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 0x7f0a24157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a2ac5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 0x7f0a2415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a2ac5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241575b0 con 0x7f0a240cd120 2023-07-09T02:13:28.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a2ac5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415cc40 con 0x7f0a2415c060 2023-07-09T02:13:28.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a2ac5c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415cf20 con 0x7f0a240d2450 2023-07-09T02:13:28.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240cd120 0x7f0a2415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240cd120 0x7f0a2415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49462/0 (socket says 172.21.15.45:49462) 2023-07-09T02:13:28.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 -- 172.21.15.45:0/3715615758 learned_addr learned my addr 172.21.15.45:0/3715615758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:28.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a23fff640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 0x7f0a24157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a291f9640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 0x7f0a2415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 -- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 msgr2=0x7f0a24157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 0x7f0a24157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 -- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 msgr2=0x7f0a2415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:28.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 0x7f0a2415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 -- 172.21.15.45:0/3715615758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10009420 con 0x7f0a240cd120 2023-07-09T02:13:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.899+0000 7f0a289f8640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240cd120 0x7f0a2415c660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0a180ad040 tx=0x7f0a180192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a217fa640 1 -- 172.21.15.45:0/3715615758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180bc070 con 0x7f0a240cd120 2023-07-09T02:13:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a217fa640 1 -- 172.21.15.45:0/3715615758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a180b4420 con 0x7f0a240cd120 2023-07-09T02:13:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a217fa640 1 -- 172.21.15.45:0/3715615758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a180b47f0 con 0x7f0a240cd120 2023-07-09T02:13:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a180094d0 con 0x7f0a240cd120 2023-07-09T02:13:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2415d4e0 con 0x7f0a240cd120 2023-07-09T02:13:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2415d060 con 0x7f0a240cd120 2023-07-09T02:13:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a217fa640 1 -- 172.21.15.45:0/3715615758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a180b4950 con 0x7f0a240cd120 2023-07-09T02:13:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a217fa640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a08066250 0x7f0a08068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a217fa640 1 -- 172.21.15.45:0/3715615758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0a1811d650 con 0x7f0a240cd120 2023-07-09T02:13:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.903+0000 7f0a23fff640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a08066250 0x7f0a08068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.907+0000 7f0a23fff640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a08066250 0x7f0a08068700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0a241f8150 tx=0x7f0a10009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:28.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:28.907+0000 7f0a217fa640 1 -- 172.21.15.45:0/3715615758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a2415d060 con 0x7f0a240cd120 2023-07-09T02:13:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.095+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a2415d060 con 0x7f0a240cd120 2023-07-09T02:13:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.095+0000 7f0a217fa640 1 -- 172.21.15.45:0/3715615758 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f0a2415d060 con 0x7f0a240cd120 2023-07-09T02:13:29.099 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:29.099 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:13:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:13:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.095+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a08066250 msgr2=0x7f0a08068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.095+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a08066250 0x7f0a08068700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0a241f8150 tx=0x7f0a10009190 comp rx=0 tx=0).stop 2023-07-09T02:13:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.095+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240cd120 msgr2=0x7f0a2415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.095+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240cd120 0x7f0a2415c660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0a180ad040 tx=0x7f0a180192b0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.099+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 shutdown_connections 2023-07-09T02:13:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.099+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a2415c060 0x7f0a2415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.099+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a08066250 0x7f0a08068700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.099+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 0x7f0a24157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.099+0000 7f0a2ac5c640 1 --2- 172.21.15.45:0/3715615758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240cd120 0x7f0a2415c660 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.099+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 >> 172.21.15.45:0/3715615758 conn(0x7f0a240698e0 msgr2=0x7f0a240b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.099+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 shutdown_connections 2023-07-09T02:13:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.099+0000 7f0a2ac5c640 1 -- 172.21.15.45:0/3715615758 wait complete. 2023-07-09T02:13:29.120 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:29.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28c0cec640 1 Processor -- start 2023-07-09T02:13:29.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28c0cec640 1 -- start start 2023-07-09T02:13:29.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28c0cec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28bc15c110 0x7f28bc1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28c0cec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f28bc0ccc50 0x7f28bc0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28c0cec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc0c98c0 con 0x7f28bc0cb0d0 2023-07-09T02:13:29.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28c0cec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc0cd4b0 con 0x7f28bc15c110 2023-07-09T02:13:29.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28c0cec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc160d00 con 0x7f28bc0ccc50 2023-07-09T02:13:29.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28ba59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28bc15c110 0x7f28bc1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28ba59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28bc15c110 0x7f28bc1607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49476/0 (socket says 172.21.15.45:49476) 2023-07-09T02:13:29.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28ba59c640 1 -- 172.21.15.45:0/550138050 learned_addr learned my addr 172.21.15.45:0/550138050 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:29.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28b3fff640 1 --2- 172.21.15.45:0/550138050 >> v2:172.21.15.155:3300/0 conn(0x7f28bc0ccc50 0x7f28bc0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28ba59c640 1 -- 172.21.15.45:0/550138050 >> v2:172.21.15.155:3300/0 conn(0x7f28bc0ccc50 msgr2=0x7f28bc0c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:29.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28ba59c640 1 --2- 172.21.15.45:0/550138050 >> v2:172.21.15.155:3300/0 conn(0x7f28bc0ccc50 0x7f28bc0c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28ba59c640 1 -- 172.21.15.45:0/550138050 >> v1:172.21.15.155:6789/0 conn(0x7f28bc0cb0d0 legacy=0x7f28bc06b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.259+0000 7f28ba59c640 1 -- 172.21.15.45:0/550138050 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0cd1d0 con 0x7f28bc15c110 2023-07-09T02:13:29.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28ba59c640 1 --2- 172.21.15.45:0/550138050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc15c110 0x7f28bc1607c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f28bc06b4a0 tx=0x7f28ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5323a2c0c4972aab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28b9d9b640 1 -- 172.21.15.45:0/550138050 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0ac640 con 0x7f28bc15c110 2023-07-09T02:13:29.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28b9d9b640 1 -- 172.21.15.45:0/550138050 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac0ac7a0 con 0x7f28bc15c110 2023-07-09T02:13:29.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28b9d9b640 1 -- 172.21.15.45:0/550138050 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0acb30 con 0x7f28bc15c110 2023-07-09T02:13:29.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28c0cec640 1 -- 172.21.15.45:0/550138050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc15c110 msgr2=0x7f28bc1607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28c0cec640 1 --2- 172.21.15.45:0/550138050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc15c110 0x7f28bc1607c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f28bc06b4a0 tx=0x7f28ac01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28c0cec640 1 -- 172.21.15.45:0/550138050 shutdown_connections 2023-07-09T02:13:29.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28c0cec640 1 --2- 172.21.15.45:0/550138050 >> v2:172.21.15.155:3300/0 conn(0x7f28bc0ccc50 0x7f28bc0c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28c0cec640 1 --2- 172.21.15.45:0/550138050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc15c110 0x7f28bc1607c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28c0cec640 1 -- 172.21.15.45:0/550138050 >> 172.21.15.45:0/550138050 conn(0x7f28bc0694b0 msgr2=0x7f28bc0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:29.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28c0cec640 1 -- 172.21.15.45:0/550138050 shutdown_connections 2023-07-09T02:13:29.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.263+0000 7f28c0cec640 1 -- 172.21.15.45:0/550138050 wait complete. 2023-07-09T02:13:29.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 Processor -- start 2023-07-09T02:13:29.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 -- start start 2023-07-09T02:13:29.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28bc0cb0d0 0x7f28bc154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc0ccc50 0x7f28bc0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28bc15c110 0x7f28bc15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc155160 con 0x7f28bc0ccc50 2023-07-09T02:13:29.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc13f9c0 con 0x7f28bc15c110 2023-07-09T02:13:29.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0b2ec0 con 0x7f28bc0cb0d0 2023-07-09T02:13:29.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc0ccc50 0x7f28bc0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc0ccc50 0x7f28bc0b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49484/0 (socket says 172.21.15.45:49484) 2023-07-09T02:13:29.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 -- 172.21.15.45:0/4173683413 learned_addr learned my addr 172.21.15.45:0/4173683413 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:29.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28ba59c640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28bc0cb0d0 0x7f28bc154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28bad9d640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28bc15c110 0x7f28bc15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 -- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28bc0cb0d0 msgr2=0x7f28bc154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28bc0cb0d0 0x7f28bc154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 -- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28bc15c110 msgr2=0x7f28bc15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28bc15c110 0x7f28bc15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 -- 172.21.15.45:0/4173683413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0094d0 con 0x7f28bc0ccc50 2023-07-09T02:13:29.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b3fff640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc0ccc50 0x7f28bc0b1fe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f28a400e960 tx=0x7f28a400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b2ffd640 1 -- 172.21.15.45:0/4173683413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4009690 con 0x7f28bc0ccc50 2023-07-09T02:13:29.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b2ffd640 1 -- 172.21.15.45:0/4173683413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a400c9a0 con 0x7f28bc0ccc50 2023-07-09T02:13:29.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc0b31a0 con 0x7f28bc0ccc50 2023-07-09T02:13:29.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28b2ffd640 1 -- 172.21.15.45:0/4173683413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400cd10 con 0x7f28bc0ccc50 2023-07-09T02:13:29.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.267+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc0b3760 con 0x7f28bc0ccc50 2023-07-09T02:13:29.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.271+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc04d7d0 con 0x7f28bc0ccc50 2023-07-09T02:13:29.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.271+0000 7f28b2ffd640 1 -- 172.21.15.45:0/4173683413 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28a4013470 con 0x7f28bc0ccc50 2023-07-09T02:13:29.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.271+0000 7f28b2ffd640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f289c066280 0x7f289c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.271+0000 7f28b2ffd640 1 -- 172.21.15.45:0/4173683413 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f28a4083ec0 con 0x7f28bc0ccc50 2023-07-09T02:13:29.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.271+0000 7f28ba59c640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f289c066280 0x7f289c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.275+0000 7f28ba59c640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f289c066280 0x7f289c068730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0ae000 tx=0x7f28ac0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.275+0000 7f28b2ffd640 1 -- 172.21.15.45:0/4173683413 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28a40513b0 con 0x7f28bc0ccc50 2023-07-09T02:13:29.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28bc0c3b00 con 0x7f28bc0ccc50 2023-07-09T02:13:29.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28b2ffd640 1 -- 172.21.15.45:0/4173683413 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f28a4017090 con 0x7f28bc0ccc50 2023-07-09T02:13:29.467 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:29.467 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:12:47.319387+0000","modified":"2023-07-09T02:12:50.963975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5628":{"gid":5628,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3039557147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3039557147},{"type":"v1","addr":"172.21.15.45:6835","nonce":3039557147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T02:13:29.467 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-07-09T02:13:29.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f289c066280 msgr2=0x7f289c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f289c066280 0x7f289c068730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0ae000 tx=0x7f28ac0a7000 comp rx=0 tx=0).stop 2023-07-09T02:13:29.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc0ccc50 msgr2=0x7f28bc0b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc0ccc50 0x7f28bc0b1fe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f28a400e960 tx=0x7f28a400ee20 comp rx=0 tx=0).stop 2023-07-09T02:13:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 shutdown_connections 2023-07-09T02:13:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28bc15c110 0x7f28bc15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28bc0ccc50 0x7f28bc0b1fe0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f289c066280 0x7f289c068730 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 --2- 172.21.15.45:0/4173683413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28bc0cb0d0 0x7f28bc154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 >> 172.21.15.45:0/4173683413 conn(0x7f28bc0694b0 msgr2=0x7f28bc0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 shutdown_connections 2023-07-09T02:13:29.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.463+0000 7f28c0cec640 1 -- 172.21.15.45:0/4173683413 wait complete. 2023-07-09T02:13:29.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.627+0000 7f02ede9e640 1 Processor -- start 2023-07-09T02:13:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.627+0000 7f02ede9e640 1 -- start start 2023-07-09T02:13:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02ede9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e8164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02ede9e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e806ef30 con 0x7f02e80c8dc0 2023-07-09T02:13:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02ede9e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8165040 con 0x7f02e80ce010 2023-07-09T02:13:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02ede9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806be90 con 0x7f02e81604a0 2023-07-09T02:13:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e6ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f02e80c8dc0 0x7f02e80cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55648/0 (socket says 172.21.15.45:55648) 2023-07-09T02:13:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e6ffd640 1 -- 172.21.15.45:0/1523951505 learned_addr learned my addr 172.21.15.45:0/1523951505 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e77fe640 1 --2- 172.21.15.45:0/1523951505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e8164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e67fc640 1 -- 172.21.15.45:0/1523951505 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862211495 0 0) 0x7f02e806ef30 con 0x7f02e80c8dc0 2023-07-09T02:13:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e67fc640 1 -- 172.21.15.45:0/1523951505 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d0003530 con 0x7f02e80c8dc0 2023-07-09T02:13:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e67fc640 1 -- 172.21.15.45:0/1523951505 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134834549 0 0) 0x7f02e8165040 con 0x7f02e80ce010 2023-07-09T02:13:29.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e67fc640 1 -- 172.21.15.45:0/1523951505 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e806ef30 con 0x7f02e80ce010 2023-07-09T02:13:29.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e77fe640 1 -- 172.21.15.45:0/1523951505 >> v1:172.21.15.155:6789/0 conn(0x7f02e80ce010 legacy=0x7f02e80caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e77fe640 1 -- 172.21.15.45:0/1523951505 >> v1:172.21.15.45:6789/0 conn(0x7f02e80c8dc0 legacy=0x7f02e80cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e67fc640 1 -- 172.21.15.45:0/1523951505 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2219165040 0 0) 0x7f02d0003530 con 0x7f02e80c8dc0 2023-07-09T02:13:29.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.631+0000 7f02e77fe640 1 -- 172.21.15.45:0/1523951505 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e806b210 con 0x7f02e81604a0 2023-07-09T02:13:29.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02e77fe640 1 --2- 172.21.15.45:0/1523951505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e8164b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02d80097f0 tx=0x7f02d801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0db77430d7b18ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02e67fc640 1 -- 172.21.15.45:0/1523951505 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80ac410 con 0x7f02e81604a0 2023-07-09T02:13:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02e67fc640 1 -- 172.21.15.45:0/1523951505 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d80ac570 con 0x7f02e81604a0 2023-07-09T02:13:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02e67fc640 1 -- 172.21.15.45:0/1523951505 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80ac900 con 0x7f02e81604a0 2023-07-09T02:13:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 -- 172.21.15.45:0/1523951505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 msgr2=0x7f02e8164b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 --2- 172.21.15.45:0/1523951505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e8164b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02d80097f0 tx=0x7f02d801c4c0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 -- 172.21.15.45:0/1523951505 shutdown_connections 2023-07-09T02:13:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 --2- 172.21.15.45:0/1523951505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e8164b00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 -- 172.21.15.45:0/1523951505 >> 172.21.15.45:0/1523951505 conn(0x7f02e80694b0 msgr2=0x7f02e80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 -- 172.21.15.45:0/1523951505 shutdown_connections 2023-07-09T02:13:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 -- 172.21.15.45:0/1523951505 wait complete. 2023-07-09T02:13:29.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 Processor -- start 2023-07-09T02:13:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.635+0000 7f02ede9e640 1 -- start start 2023-07-09T02:13:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02e80c8dc0 0x7f02e80af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e80ce010 0x7f02e80c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e80c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8152130 con 0x7f02e80c8dc0 2023-07-09T02:13:29.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e815fca0 con 0x7f02e80ce010 2023-07-09T02:13:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c74f0 con 0x7f02e81604a0 2023-07-09T02:13:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02e80c8dc0 0x7f02e80af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02e80c8dc0 0x7f02e80af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49496/0 (socket says 172.21.15.45:49496) 2023-07-09T02:13:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 -- 172.21.15.45:0/50656798 learned_addr learned my addr 172.21.15.45:0/50656798 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e6ffd640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e80ce010 0x7f02e80c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e7fff640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e80c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 -- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 msgr2=0x7f02e80c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e80c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 -- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e80ce010 msgr2=0x7f02e80c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e80ce010 0x7f02e80c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 -- 172.21.15.45:0/50656798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009420 con 0x7f02e80c8dc0 2023-07-09T02:13:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02e77fe640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02e80c8dc0 0x7f02e80af410 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f02d80af040 tx=0x7f02d8019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02cffff640 1 -- 172.21.15.45:0/50656798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80bc070 con 0x7f02e80c8dc0 2023-07-09T02:13:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02cffff640 1 -- 172.21.15.45:0/50656798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d8006e20 con 0x7f02e80c8dc0 2023-07-09T02:13:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e80c68e0 con 0x7f02e80c8dc0 2023-07-09T02:13:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02cffff640 1 -- 172.21.15.45:0/50656798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80b5410 con 0x7f02e80c8dc0 2023-07-09T02:13:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e80c6ea0 con 0x7f02e80c8dc0 2023-07-09T02:13:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.639+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e804d7d0 con 0x7f02e80c8dc0 2023-07-09T02:13:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.643+0000 7f02cffff640 1 -- 172.21.15.45:0/50656798 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02d80b3040 con 0x7f02e80c8dc0 2023-07-09T02:13:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.643+0000 7f02cffff640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02d4066280 0x7f02d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.643+0000 7f02cffff640 1 -- 172.21.15.45:0/50656798 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f02d811d5d0 con 0x7f02e80c8dc0 2023-07-09T02:13:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.643+0000 7f02e6ffd640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02d4066280 0x7f02d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.643+0000 7f02e6ffd640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02d4066280 0x7f02d4068730 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f02e81fc780 tx=0x7f02dc0078c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.647+0000 7f02cffff640 1 -- 172.21.15.45:0/50656798 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02d80eaa00 con 0x7f02e80c8dc0 2023-07-09T02:13:29.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.799+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02e806ba80 con 0x7f02e80c8dc0 2023-07-09T02:13:29.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02cffff640 1 -- 172.21.15.45:0/50656798 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18447 (secure 0 0 0) 0x7f02d80ee020 con 0x7f02e80c8dc0 2023-07-09T02:13:29.805 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:29.805 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:16.309432+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:12:45.075187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T02:12:46.325197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2a","mappings":[{"from":0,"to":6}]},{"pgid":"8.37","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:29.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02d4066280 msgr2=0x7f02d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02d4066280 0x7f02d4068730 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f02e81fc780 tx=0x7f02dc0078c0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02e80c8dc0 msgr2=0x7f02e80af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02e80c8dc0 0x7f02e80af410 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f02d80af040 tx=0x7f02d8019260 comp rx=0 tx=0).stop 2023-07-09T02:13:29.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 shutdown_connections 2023-07-09T02:13:29.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02d4066280 0x7f02d4068730 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02e81604a0 0x7f02e80c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02e80ce010 0x7f02e80c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 --2- 172.21.15.45:0/50656798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02e80c8dc0 0x7f02e80af410 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 >> 172.21.15.45:0/50656798 conn(0x7f02e80694b0 msgr2=0x7f02e8069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:29.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 shutdown_connections 2023-07-09T02:13:29.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.803+0000 7f02ede9e640 1 -- 172.21.15.45:0/50656798 wait complete. 2023-07-09T02:13:29.827 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:13:29.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.967+0000 7fbc68a31640 1 Processor -- start 2023-07-09T02:13:29.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.967+0000 7fbc68a31640 1 -- start start 2023-07-09T02:13:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc68a31640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc640c8d40 0x7fbc640ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc68a31640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbc64160670 0x7fbc640b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc68a31640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 0x7fbc6406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc68a31640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc640cd5d0 con 0x7fbc640c8d40 2023-07-09T02:13:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc68a31640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc640d2050 con 0x7fbc64160670 2023-07-09T02:13:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc68a31640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc640d27a0 con 0x7fbc640b4910 2023-07-09T02:13:29.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc640c8d40 0x7fbc640ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc640c8d40 0x7fbc640ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49508/0 (socket says 172.21.15.45:49508) 2023-07-09T02:13:29.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 -- 172.21.15.45:0/766232597 learned_addr learned my addr 172.21.15.45:0/766232597 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:29.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 -- 172.21.15.45:0/766232597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 msgr2=0x7fbc6406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:29.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 --2- 172.21.15.45:0/766232597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 0x7fbc6406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 -- 172.21.15.45:0/766232597 >> v2:172.21.15.155:3300/0 conn(0x7fbc64160670 msgr2=0x7fbc640b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:29.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 --2- 172.21.15.45:0/766232597 >> v2:172.21.15.155:3300/0 conn(0x7fbc64160670 0x7fbc640b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 -- 172.21.15.45:0/766232597 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc640b4d20 con 0x7fbc640c8d40 2023-07-09T02:13:29.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.971+0000 7fbc637fe640 1 --2- 172.21.15.45:0/766232597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640ccf10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbc640b2120 tx=0x7fbc5401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0af5e6f10077fa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc627fc640 1 -- 172.21.15.45:0/766232597 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540a89b0 con 0x7fbc640c8d40 2023-07-09T02:13:29.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc627fc640 1 -- 172.21.15.45:0/766232597 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc540a8b10 con 0x7fbc640c8d40 2023-07-09T02:13:29.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc627fc640 1 -- 172.21.15.45:0/766232597 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540a8ea0 con 0x7fbc640c8d40 2023-07-09T02:13:29.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- 172.21.15.45:0/766232597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 msgr2=0x7fbc640ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 --2- 172.21.15.45:0/766232597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640ccf10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbc640b2120 tx=0x7fbc5401ecf0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- 172.21.15.45:0/766232597 shutdown_connections 2023-07-09T02:13:29.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 --2- 172.21.15.45:0/766232597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 0x7fbc6406b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 --2- 172.21.15.45:0/766232597 >> v2:172.21.15.155:3300/0 conn(0x7fbc64160670 0x7fbc640b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 --2- 172.21.15.45:0/766232597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640ccf10 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- 172.21.15.45:0/766232597 >> 172.21.15.45:0/766232597 conn(0x7fbc640d2950 msgr2=0x7fbc640d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:29.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- 172.21.15.45:0/766232597 shutdown_connections 2023-07-09T02:13:29.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- 172.21.15.45:0/766232597 wait complete. 2023-07-09T02:13:29.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 Processor -- start 2023-07-09T02:13:29.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- start start 2023-07-09T02:13:29.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 0x7fbc6415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc64160670 0x7fbc640cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc64148820 con 0x7fbc640c8d40 2023-07-09T02:13:29.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc640b5e70 con 0x7fbc64160670 2023-07-09T02:13:29.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.975+0000 7fbc68a31640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc640b58b0 con 0x7fbc640b4910 2023-07-09T02:13:29.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc637fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 0x7fbc6415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49514/0 (socket says 172.21.15.45:49514) 2023-07-09T02:13:29.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 -- 172.21.15.45:0/141102745 learned_addr learned my addr 172.21.15.45:0/141102745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:29.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc63fff640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc64160670 0x7fbc640cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 -- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 msgr2=0x7fbc6415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 0x7fbc6415bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 -- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc64160670 msgr2=0x7fbc640cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:29.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc64160670 0x7fbc640cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:29.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 -- 172.21.15.45:0/141102745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540094d0 con 0x7fbc640c8d40 2023-07-09T02:13:29.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc62ffd640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640cba20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800b440 tx=0x7fbc5800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc4bfff640 1 -- 172.21.15.45:0/141102745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58011890 con 0x7fbc640c8d40 2023-07-09T02:13:29.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc4bfff640 1 -- 172.21.15.45:0/141102745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc58011a10 con 0x7fbc640c8d40 2023-07-09T02:13:29.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc4bfff640 1 -- 172.21.15.45:0/141102745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58011dc0 con 0x7fbc640c8d40 2023-07-09T02:13:29.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc640b5b90 con 0x7fbc640c8d40 2023-07-09T02:13:29.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6415c330 con 0x7fbc640c8d40 2023-07-09T02:13:29.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6404e020 con 0x7fbc640c8d40 2023-07-09T02:13:29.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.979+0000 7fbc4bfff640 1 -- 172.21.15.45:0/141102745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc5801a400 con 0x7fbc640c8d40 2023-07-09T02:13:29.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.983+0000 7fbc4bfff640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc50066280 0x7fbc50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:29.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.983+0000 7fbc4bfff640 1 -- 172.21.15.45:0/141102745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbc58083ea0 con 0x7fbc640c8d40 2023-07-09T02:13:29.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.983+0000 7fbc637fe640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc50066280 0x7fbc50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:29.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.983+0000 7fbc637fe640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc50066280 0x7fbc50068730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc540b2000 tx=0x7fbc54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:29.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:29.983+0000 7fbc4bfff640 1 -- 172.21.15.45:0/141102745 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc58051420 con 0x7fbc640c8d40 2023-07-09T02:13:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.171+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbc640cb6d0 con 0x7fbc640c8d40 2023-07-09T02:13:30.175 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:13:30.171+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:13:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc4bfff640 1 -- 172.21.15.45:0/141102745 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbc58015020 con 0x7fbc640c8d40 2023-07-09T02:13:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:13:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc50066280 msgr2=0x7fbc50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc50066280 0x7fbc50068730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc540b2000 tx=0x7fbc54008040 comp rx=0 tx=0).stop 2023-07-09T02:13:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 msgr2=0x7fbc640cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640cba20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800b440 tx=0x7fbc5800b900 comp rx=0 tx=0).stop 2023-07-09T02:13:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 shutdown_connections 2023-07-09T02:13:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc64160670 0x7fbc640cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc640c8d40 0x7fbc640cba20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc50066280 0x7fbc50068730 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 --2- 172.21.15.45:0/141102745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc640b4910 0x7fbc6415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 >> 172.21.15.45:0/141102745 conn(0x7fbc640d2950 msgr2=0x7fbc6415fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 shutdown_connections 2023-07-09T02:13:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.179+0000 7fbc68a31640 1 -- 172.21.15.45:0/141102745 wait complete. 2023-07-09T02:13:30.204 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:13:30.247 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.347+0000 7f8e504ec640 1 Processor -- start 2023-07-09T02:13:30.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.347+0000 7f8e504ec640 1 -- start start 2023-07-09T02:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.347+0000 7f8e504ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e4815c060 0x7f8e480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:30.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.347+0000 7f8e504ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e48160a50 con 0x7f8e480d2620 2023-07-09T02:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.347+0000 7f8e504ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4815c430 con 0x7f8e480cd120 2023-07-09T02:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.347+0000 7f8e504ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4815fb60 con 0x7f8e4815c060 2023-07-09T02:13:30.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4e288640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8e4815c060 0x7f8e480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4ea89640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8e480d2620 0x7f8e480cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55658/0 (socket says 172.21.15.45:55658) 2023-07-09T02:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4ea89640 1 -- 172.21.15.45:0/2484542492 learned_addr learned my addr 172.21.15.45:0/2484542492 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4e288640 1 -- 172.21.15.45:0/2484542492 >> v1:172.21.15.155:6789/0 conn(0x7f8e480cd120 legacy=0x7f8e480d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4e288640 1 -- 172.21.15.45:0/2484542492 >> v1:172.21.15.45:6789/0 conn(0x7f8e480d2620 legacy=0x7f8e480cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4e288640 1 -- 172.21.15.45:0/2484542492 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4815fe40 con 0x7f8e4815c060 2023-07-09T02:13:30.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4d286640 1 -- 172.21.15.45:0/2484542492 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684972078 0 0) 0x7f8e48160a50 con 0x7f8e480d2620 2023-07-09T02:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4e288640 1 --2- 172.21.15.45:0/2484542492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480b4ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8e440097c0 tx=0x7f8e4401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d324a3a0c877f24 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4d286640 1 -- 172.21.15.45:0/2484542492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440ab610 con 0x7f8e4815c060 2023-07-09T02:13:30.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4d286640 1 -- 172.21.15.45:0/2484542492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e440ab770 con 0x7f8e4815c060 2023-07-09T02:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.351+0000 7f8e4d286640 1 -- 172.21.15.45:0/2484542492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440abb00 con 0x7f8e4815c060 2023-07-09T02:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- 172.21.15.45:0/2484542492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 msgr2=0x7f8e480b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:30.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 --2- 172.21.15.45:0/2484542492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480b4ed0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8e440097c0 tx=0x7f8e4401c410 comp rx=0 tx=0).stop 2023-07-09T02:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- 172.21.15.45:0/2484542492 shutdown_connections 2023-07-09T02:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 --2- 172.21.15.45:0/2484542492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480b4ed0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- 172.21.15.45:0/2484542492 >> 172.21.15.45:0/2484542492 conn(0x7f8e480698e0 msgr2=0x7f8e48069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- 172.21.15.45:0/2484542492 shutdown_connections 2023-07-09T02:13:30.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- 172.21.15.45:0/2484542492 wait complete. 2023-07-09T02:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 Processor -- start 2023-07-09T02:13:30.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- start start 2023-07-09T02:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e480cd120 0x7f8e480c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e480d2620 0x7f8e48158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4815c7c0 con 0x7f8e4815c060 2023-07-09T02:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4815caa0 con 0x7f8e480cd120 2023-07-09T02:13:30.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e504ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4815cd80 con 0x7f8e480d2620 2023-07-09T02:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4ea89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4ea89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49550/0 (socket says 172.21.15.45:49550) 2023-07-09T02:13:30.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4ea89640 1 -- 172.21.15.45:0/3219900745 learned_addr learned my addr 172.21.15.45:0/3219900745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4da87640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e480d2620 0x7f8e48158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4e288640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e480cd120 0x7f8e480c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4ea89640 1 -- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e480d2620 msgr2=0x7f8e48158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4ea89640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e480d2620 0x7f8e48158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:30.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4ea89640 1 -- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e480cd120 msgr2=0x7f8e480c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4ea89640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e480cd120 0x7f8e480c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.355+0000 7f8e4ea89640 1 -- 172.21.15.45:0/3219900745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e44009420 con 0x7f8e4815c060 2023-07-09T02:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e4ea89640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480cbce0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8e40002240 tx=0x7f8e4000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e3effd640 1 -- 172.21.15.45:0/3219900745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4000cea0 con 0x7f8e4815c060 2023-07-09T02:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e3effd640 1 -- 172.21.15.45:0/3219900745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4000a640 con 0x7f8e4815c060 2023-07-09T02:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e3effd640 1 -- 172.21.15.45:0/3219900745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4000a9f0 con 0x7f8e4815c060 2023-07-09T02:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e480b59f0 con 0x7f8e4815c060 2023-07-09T02:13:30.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4815d340 con 0x7f8e4815c060 2023-07-09T02:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4815d560 con 0x7f8e4815c060 2023-07-09T02:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e3effd640 1 -- 172.21.15.45:0/3219900745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e4000ab50 con 0x7f8e4815c060 2023-07-09T02:13:30.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e3effd640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e2c0662d0 0x7f8e2c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e3effd640 1 -- 172.21.15.45:0/3219900745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f8e400836d0 con 0x7f8e4815c060 2023-07-09T02:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.359+0000 7f8e4e288640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e2c0662d0 0x7f8e2c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:30.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.363+0000 7f8e4e288640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e2c0662d0 0x7f8e2c068780 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e440af000 tx=0x7f8e440a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:30.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.363+0000 7f8e3effd640 1 -- 172.21.15.45:0/3219900745 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e40050b50 con 0x7f8e4815c060 2023-07-09T02:13:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:30.551+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8e4804d7d0 con 0x7f8e4815c060 2023-07-09T02:13:31.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e3effd640 1 -- 172.21.15.45:0/3219900745 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8e40054170 con 0x7f8e4815c060 2023-07-09T02:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e2c0662d0 msgr2=0x7f8e2c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e2c0662d0 0x7f8e2c068780 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e440af000 tx=0x7f8e440a7000 comp rx=0 tx=0).stop 2023-07-09T02:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 msgr2=0x7f8e480cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480cbce0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8e40002240 tx=0x7f8e4000cc50 comp rx=0 tx=0).stop 2023-07-09T02:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 shutdown_connections 2023-07-09T02:13:31.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e4815c060 0x7f8e480cbce0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e2c0662d0 0x7f8e2c068780 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e480d2620 0x7f8e48158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 --2- 172.21.15.45:0/3219900745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e480cd120 0x7f8e480c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 >> 172.21.15.45:0/3219900745 conn(0x7f8e480698e0 msgr2=0x7f8e480b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 shutdown_connections 2023-07-09T02:13:31.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.179+0000 7f8e504ec640 1 -- 172.21.15.45:0/3219900745 wait complete. 2023-07-09T02:13:31.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:13:31.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f9349f59640 1 Processor -- start 2023-07-09T02:13:31.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f9349f59640 1 -- start start 2023-07-09T02:13:31.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f9349f59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f934415c480 0x7f93440cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:31.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f9349f59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93440cecd0 0x7f93440d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:31.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f9349f59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93440d19c0 con 0x7f93440b4490 2023-07-09T02:13:31.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f9349f59640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934415c850 con 0x7f93440cecd0 2023-07-09T02:13:31.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f9349f59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440d1090 con 0x7f934415c480 2023-07-09T02:13:31.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f933bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93440cecd0 0x7f93440d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:31.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f933bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93440cecd0 0x7f93440d1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49556/0 (socket says 172.21.15.45:49556) 2023-07-09T02:13:31.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f933bfff640 1 -- 172.21.15.45:0/2599714775 learned_addr learned my addr 172.21.15.45:0/2599714775 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:31.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f93437fe640 1 --2- 172.21.15.45:0/2599714775 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f934415c480 0x7f93440cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:31.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f933bfff640 1 -- 172.21.15.45:0/2599714775 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f934415c480 msgr2=0x7f93440cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:31.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f933bfff640 1 --2- 172.21.15.45:0/2599714775 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f934415c480 0x7f93440cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f933bfff640 1 -- 172.21.15.45:0/2599714775 >> v1:172.21.15.155:6789/0 conn(0x7f93440b4490 legacy=0x7f93440b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:31.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.399+0000 7f933bfff640 1 -- 172.21.15.45:0/2599714775 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440d1370 con 0x7f93440cecd0 2023-07-09T02:13:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f933bfff640 1 --2- 172.21.15.45:0/2599714775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440cecd0 0x7f93440d1e50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f932c009870 tx=0x7f932c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550c7bdf79008af1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9342ffd640 1 -- 172.21.15.45:0/2599714775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0ac630 con 0x7f93440cecd0 2023-07-09T02:13:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9342ffd640 1 -- 172.21.15.45:0/2599714775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c0ac790 con 0x7f93440cecd0 2023-07-09T02:13:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9342ffd640 1 -- 172.21.15.45:0/2599714775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0acb20 con 0x7f93440cecd0 2023-07-09T02:13:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9349f59640 1 -- 172.21.15.45:0/2599714775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440cecd0 msgr2=0x7f93440d1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9349f59640 1 --2- 172.21.15.45:0/2599714775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440cecd0 0x7f93440d1e50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f932c009870 tx=0x7f932c01c500 comp rx=0 tx=0).stop 2023-07-09T02:13:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9349f59640 1 -- 172.21.15.45:0/2599714775 shutdown_connections 2023-07-09T02:13:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9349f59640 1 --2- 172.21.15.45:0/2599714775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440cecd0 0x7f93440d1e50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9349f59640 1 --2- 172.21.15.45:0/2599714775 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f934415c480 0x7f93440cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9349f59640 1 -- 172.21.15.45:0/2599714775 >> 172.21.15.45:0/2599714775 conn(0x7f93440cf490 msgr2=0x7f93440cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9349f59640 1 -- 172.21.15.45:0/2599714775 shutdown_connections 2023-07-09T02:13:31.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.403+0000 7f9349f59640 1 -- 172.21.15.45:0/2599714775 wait complete. 2023-07-09T02:13:31.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 Processor -- start 2023-07-09T02:13:31.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 -- start start 2023-07-09T02:13:31.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440b4490 0x7f93440c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:31.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93440cecd0 0x7f934414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:31.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934415c480 0x7f93440b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:31.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344157000 con 0x7f93440b4490 2023-07-09T02:13:31.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93441514c0 con 0x7f934415c480 2023-07-09T02:13:31.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440c81e0 con 0x7f93440cecd0 2023-07-09T02:13:31.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440b4490 0x7f93440c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:31.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440b4490 0x7f93440c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49572/0 (socket says 172.21.15.45:49572) 2023-07-09T02:13:31.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 -- 172.21.15.45:0/3437238281 learned_addr learned my addr 172.21.15.45:0/3437238281 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:31.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9343fff640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934415c480 0x7f93440b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:31.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f933bfff640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93440cecd0 0x7f934414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:31.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 -- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93440cecd0 msgr2=0x7f934414fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:31.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93440cecd0 0x7f934414fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 -- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934415c480 msgr2=0x7f93440b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:31.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934415c480 0x7f93440b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:31.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 -- 172.21.15.45:0/3437238281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0094d0 con 0x7f93440b4490 2023-07-09T02:13:31.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f93437fe640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440b4490 0x7f93440c8dc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f933400d620 tx=0x7f933400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:31.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9340ff9640 1 -- 172.21.15.45:0/3437238281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400b620 con 0x7f93440b4490 2023-07-09T02:13:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9340ff9640 1 -- 172.21.15.45:0/3437238281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933400b780 con 0x7f93440b4490 2023-07-09T02:13:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9344150e90 con 0x7f93440b4490 2023-07-09T02:13:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9340ff9640 1 -- 172.21.15.45:0/3437238281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400bb10 con 0x7f93440b4490 2023-07-09T02:13:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.407+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93440c8760 con 0x7f93440b4490 2023-07-09T02:13:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.411+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934404d7d0 con 0x7f93440b4490 2023-07-09T02:13:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.411+0000 7f9340ff9640 1 -- 172.21.15.45:0/3437238281 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f933400bc70 con 0x7f93440b4490 2023-07-09T02:13:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.411+0000 7f9340ff9640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9324066280 0x7f9324068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:31.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.411+0000 7f9340ff9640 1 -- 172.21.15.45:0/3437238281 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f9334084300 con 0x7f93440b4490 2023-07-09T02:13:31.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.411+0000 7f933bfff640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9324066280 0x7f9324068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:31.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.411+0000 7f933bfff640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9324066280 0x7f9324068730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f932c0ae000 tx=0x7f932c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:31.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.415+0000 7f9340ff9640 1 -- 172.21.15.45:0/3437238281 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93340516e0 con 0x7f93440b4490 2023-07-09T02:13:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:31.571+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9344156780 con 0x7f93440b4490 2023-07-09T02:13:32.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.383+0000 7f9340ff9640 1 -- 172.21.15.45:0/3437238281 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9334054d00 con 0x7f93440b4490 2023-07-09T02:13:32.387 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:13:32.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9324066280 msgr2=0x7f9324068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:32.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9324066280 0x7f9324068730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f932c0ae000 tx=0x7f932c008040 comp rx=0 tx=0).stop 2023-07-09T02:13:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440b4490 msgr2=0x7f93440c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440b4490 0x7f93440c8dc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f933400d620 tx=0x7f933400dae0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 shutdown_connections 2023-07-09T02:13:32.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f934415c480 0x7f93440b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9324066280 0x7f9324068730 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93440cecd0 0x7f934414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 --2- 172.21.15.45:0/3437238281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93440b4490 0x7f93440c8dc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 >> 172.21.15.45:0/3437238281 conn(0x7f93440cf490 msgr2=0x7f934415b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:32.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 shutdown_connections 2023-07-09T02:13:32.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.387+0000 7f9349f59640 1 -- 172.21.15.45:0/3437238281 wait complete. 2023-07-09T02:13:32.415 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:13:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3ce1834640 1 Processor -- start 2023-07-09T02:13:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3ce1834640 1 -- start start 2023-07-09T02:13:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3ce1834640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cdc15d5e0 0x7f3cdc0cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3ce1834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc0cf9f0 0x7f3cdc15e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3ce1834640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc15db60 con 0x7f3cdc1534f0 2023-07-09T02:13:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3ce1834640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc1538c0 con 0x7f3cdc15d5e0 2023-07-09T02:13:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3ce1834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0cfe70 con 0x7f3cdc0cf9f0 2023-07-09T02:13:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cd3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cdc15d5e0 0x7f3cdc0cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cd3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3cdc15d5e0 0x7f3cdc0cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60160/0 (socket says 172.21.15.45:60160) 2023-07-09T02:13:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cd3fff640 1 -- 172.21.15.45:0/1158248139 learned_addr learned my addr 172.21.15.45:0/1158248139 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cd3fff640 1 -- 172.21.15.45:0/1158248139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc0cf9f0 msgr2=0x7f3cdc15e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cdb7fe640 1 --2- 172.21.15.45:0/1158248139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc0cf9f0 0x7f3cdc15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:32.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cd3fff640 1 --2- 172.21.15.45:0/1158248139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc0cf9f0 0x7f3cdc15e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cd3fff640 1 -- 172.21.15.45:0/1158248139 >> v1:172.21.15.155:6789/0 conn(0x7f3cdc1534f0 legacy=0x7f3cdc0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:32.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cd3fff640 1 -- 172.21.15.45:0/1158248139 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0cd290 con 0x7f3cdc15d5e0 2023-07-09T02:13:32.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.567+0000 7f3cdb7fe640 1 --2- 172.21.15.45:0/1158248139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc0cf9f0 0x7f3cdc15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:32.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.571+0000 7f3cd3fff640 1 --2- 172.21.15.45:0/1158248139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc15d5e0 0x7f3cdc0cf4b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40098a0 tx=0x7f3cc401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676ab425ff09374f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:32.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.571+0000 7f3cda7fc640 1 -- 172.21.15.45:0/1158248139 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40ab670 con 0x7f3cdc15d5e0 2023-07-09T02:13:32.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.571+0000 7f3cda7fc640 1 -- 172.21.15.45:0/1158248139 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40ab7d0 con 0x7f3cdc15d5e0 2023-07-09T02:13:32.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.571+0000 7f3cda7fc640 1 -- 172.21.15.45:0/1158248139 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40abb60 con 0x7f3cdc15d5e0 2023-07-09T02:13:32.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.571+0000 7f3ce1834640 1 -- 172.21.15.45:0/1158248139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc15d5e0 msgr2=0x7f3cdc0cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:32.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.571+0000 7f3ce1834640 1 --2- 172.21.15.45:0/1158248139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc15d5e0 0x7f3cdc0cf4b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40098a0 tx=0x7f3cc401c4b0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 -- 172.21.15.45:0/1158248139 shutdown_connections 2023-07-09T02:13:32.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 --2- 172.21.15.45:0/1158248139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc0cf9f0 0x7f3cdc15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 --2- 172.21.15.45:0/1158248139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc15d5e0 0x7f3cdc0cf4b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 -- 172.21.15.45:0/1158248139 >> 172.21.15.45:0/1158248139 conn(0x7f3cdc069980 msgr2=0x7f3cdc069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:32.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 -- 172.21.15.45:0/1158248139 shutdown_connections 2023-07-09T02:13:32.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 -- 172.21.15.45:0/1158248139 wait complete. 2023-07-09T02:13:32.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 Processor -- start 2023-07-09T02:13:32.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 -- start start 2023-07-09T02:13:32.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cdc0cf9f0 0x7f3cdc1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:32.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc1534f0 0x7f3cdc147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:32.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc15d5e0 0x7f3cdc0ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:32.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc147f50 con 0x7f3cdc1534f0 2023-07-09T02:13:32.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc148140 con 0x7f3cdc0cf9f0 2023-07-09T02:13:32.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3ce1834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0c9d10 con 0x7f3cdc15d5e0 2023-07-09T02:13:32.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc1534f0 0x7f3cdc147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:32.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc1534f0 0x7f3cdc147a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60176/0 (socket says 172.21.15.45:60176) 2023-07-09T02:13:32.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 -- 172.21.15.45:0/3271574339 learned_addr learned my addr 172.21.15.45:0/3271574339 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:32.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cdb7fe640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc15d5e0 0x7f3cdc0ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:32.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cdaffd640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cdc0cf9f0 0x7f3cdc1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 -- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc15d5e0 msgr2=0x7f3cdc0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc15d5e0 0x7f3cdc0ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 -- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cdc0cf9f0 msgr2=0x7f3cdc1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cdc0cf9f0 0x7f3cdc1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 -- 172.21.15.45:0/3271574339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc40094d0 con 0x7f3cdc1534f0 2023-07-09T02:13:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.575+0000 7f3cd3fff640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc1534f0 0x7f3cdc147a10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40ad040 tx=0x7f3cc4019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3cd8ff9640 1 -- 172.21.15.45:0/3271574339 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40b5810 con 0x7f3cdc1534f0 2023-07-09T02:13:32.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3cd8ff9640 1 -- 172.21.15.45:0/3271574339 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40b59b0 con 0x7f3cdc1534f0 2023-07-09T02:13:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3cd8ff9640 1 -- 172.21.15.45:0/3271574339 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40b5d60 con 0x7f3cdc1534f0 2023-07-09T02:13:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc0c9ff0 con 0x7f3cdc1534f0 2023-07-09T02:13:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc0cad30 con 0x7f3cdc1534f0 2023-07-09T02:13:32.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc0c9b50 con 0x7f3cdc1534f0 2023-07-09T02:13:32.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3cd8ff9640 1 -- 172.21.15.45:0/3271574339 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3cc40b4390 con 0x7f3cdc1534f0 2023-07-09T02:13:32.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3cd8ff9640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cbc066280 0x7f3cbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:32.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3cd8ff9640 1 -- 172.21.15.45:0/3271574339 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f3cc411e740 con 0x7f3cdc1534f0 2023-07-09T02:13:32.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.579+0000 7f3cdaffd640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cbc066280 0x7f3cbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:32.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.583+0000 7f3cdaffd640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cbc066280 0x7f3cbc068730 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc004e30 tx=0x7f3ccc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:32.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.583+0000 7f3cd8ff9640 1 -- 172.21.15.45:0/3271574339 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cc40ebc40 con 0x7f3cdc1534f0 2023-07-09T02:13:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:32.739+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3cdc0caf20 con 0x7f3cdc1534f0 2023-07-09T02:13:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.399+0000 7f3cd8ff9640 1 -- 172.21.15.45:0/3271574339 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3cc40ef260 con 0x7f3cdc1534f0 2023-07-09T02:13:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:13:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cbc066280 msgr2=0x7f3cbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cbc066280 0x7f3cbc068730 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc004e30 tx=0x7f3ccc009040 comp rx=0 tx=0).stop 2023-07-09T02:13:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc1534f0 msgr2=0x7f3cdc147a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc1534f0 0x7f3cdc147a10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40ad040 tx=0x7f3cc4019250 comp rx=0 tx=0).stop 2023-07-09T02:13:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 shutdown_connections 2023-07-09T02:13:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3cbc066280 0x7f3cbc068730 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cdc15d5e0 0x7f3cdc0ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cdc1534f0 0x7f3cdc147a10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 --2- 172.21.15.45:0/3271574339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cdc0cf9f0 0x7f3cdc1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 >> 172.21.15.45:0/3271574339 conn(0x7f3cdc069980 msgr2=0x7f3cdc0b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:33.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 shutdown_connections 2023-07-09T02:13:33.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.403+0000 7f3ce1834640 1 -- 172.21.15.45:0/3271574339 wait complete. 2023-07-09T02:13:33.428 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:13:33.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb534182640 1 Processor -- start 2023-07-09T02:13:33.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb534182640 1 -- start start 2023-07-09T02:13:33.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb534182640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb52c0d2620 0x7fb52c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb534182640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb534182640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52c160a50 con 0x7fb52c15c060 2023-07-09T02:13:33.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb534182640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb52c15c430 con 0x7fb52c0d2620 2023-07-09T02:13:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb534182640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c15fb60 con 0x7fb52c0cd120 2023-07-09T02:13:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53171d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb52c0d2620 0x7fb52c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53271f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53171d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb52c0d2620 0x7fb52c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:39184/0 (socket says 172.21.15.45:39184) 2023-07-09T02:13:33.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53171d640 1 -- 172.21.15.45:0/2061806751 learned_addr learned my addr 172.21.15.45:0/2061806751 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:33.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53171d640 1 -- 172.21.15.45:0/2061806751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 msgr2=0x7fb52c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:33.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53171d640 1 --2- 172.21.15.45:0/2061806751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53171d640 1 -- 172.21.15.45:0/2061806751 >> v1:172.21.15.155:6789/0 conn(0x7fb52c15c060 legacy=0x7fb52c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53171d640 1 -- 172.21.15.45:0/2061806751 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c15fe40 con 0x7fb52c0d2620 2023-07-09T02:13:33.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.571+0000 7fb53271f640 1 --2- 172.21.15.45:0/2061806751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb53171d640 1 --2- 172.21.15.45:0/2061806751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 0x7fb52c0b4ed0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009870 tx=0x7fb51c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d824638b198ddfe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb530f1c640 1 -- 172.21.15.45:0/2061806751 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0aa670 con 0x7fb52c0d2620 2023-07-09T02:13:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb530f1c640 1 -- 172.21.15.45:0/2061806751 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c0aa7d0 con 0x7fb52c0d2620 2023-07-09T02:13:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb530f1c640 1 -- 172.21.15.45:0/2061806751 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0aab60 con 0x7fb52c0d2620 2023-07-09T02:13:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb534182640 1 -- 172.21.15.45:0/2061806751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 msgr2=0x7fb52c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb534182640 1 --2- 172.21.15.45:0/2061806751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 0x7fb52c0b4ed0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009870 tx=0x7fb51c01c510 comp rx=0 tx=0).stop 2023-07-09T02:13:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb534182640 1 -- 172.21.15.45:0/2061806751 shutdown_connections 2023-07-09T02:13:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb534182640 1 --2- 172.21.15.45:0/2061806751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb534182640 1 --2- 172.21.15.45:0/2061806751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 0x7fb52c0b4ed0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.575+0000 7fb534182640 1 -- 172.21.15.45:0/2061806751 >> 172.21.15.45:0/2061806751 conn(0x7fb52c0698e0 msgr2=0x7fb52c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 -- 172.21.15.45:0/2061806751 shutdown_connections 2023-07-09T02:13:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 -- 172.21.15.45:0/2061806751 wait complete. 2023-07-09T02:13:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 Processor -- start 2023-07-09T02:13:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 -- start start 2023-07-09T02:13:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 0x7fb52c153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb52c15c060 0x7fb52c0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c159ec0 con 0x7fb52c15c060 2023-07-09T02:13:33.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c152590 con 0x7fb52c0d2620 2023-07-09T02:13:33.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb534182640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c152870 con 0x7fb52c0cd120 2023-07-09T02:13:33.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb52c15c060 0x7fb52c0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb531f1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb52c15c060 0x7fb52c0b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60180/0 (socket says 172.21.15.45:60180) 2023-07-09T02:13:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 -- 172.21.15.45:0/2034935447 learned_addr learned my addr 172.21.15.45:0/2034935447 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53171d640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 0x7fb52c153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 -- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 msgr2=0x7fb52c151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 -- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 msgr2=0x7fb52c153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 0x7fb52c153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 -- 172.21.15.45:0/2034935447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb524009a70 con 0x7fb52c15c060 2023-07-09T02:13:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.579+0000 7fb53271f640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb52c15c060 0x7fb52c0b44f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb52400efc0 tx=0x7fb524009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb5227fc640 1 -- 172.21.15.45:0/2034935447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524009d70 con 0x7fb52c15c060 2023-07-09T02:13:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb5227fc640 1 -- 172.21.15.45:0/2034935447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52400f040 con 0x7fb52c15c060 2023-07-09T02:13:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c0094d0 con 0x7fb52c15c060 2023-07-09T02:13:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb5227fc640 1 -- 172.21.15.45:0/2034935447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5240039a0 con 0x7fb52c15c060 2023-07-09T02:13:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52c0b59f0 con 0x7fb52c15c060 2023-07-09T02:13:33.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52c04d7d0 con 0x7fb52c15c060 2023-07-09T02:13:33.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb5227fc640 1 -- 172.21.15.45:0/2034935447 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5240144a0 con 0x7fb52c15c060 2023-07-09T02:13:33.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb5227fc640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb510066280 0x7fb510068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb5227fc640 1 -- 172.21.15.45:0/2034935447 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb524084550 con 0x7fb52c15c060 2023-07-09T02:13:33.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.583+0000 7fb531f1e640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb510066280 0x7fb510068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.587+0000 7fb531f1e640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb510066280 0x7fb510068730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb528007fd0 tx=0x7fb528009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:33.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.587+0000 7fb5227fc640 1 -- 172.21.15.45:0/2034935447 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb524055820 con 0x7fb52c15c060 2023-07-09T02:13:33.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.739+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb52c06baa0 con 0x7fb52c15c060 2023-07-09T02:13:33.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.743+0000 7fb5227fc640 1 -- 172.21.15.45:0/2034935447 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5240553b0 con 0x7fb52c15c060 2023-07-09T02:13:33.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb510066280 msgr2=0x7fb510068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb510066280 0x7fb510068730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb528007fd0 tx=0x7fb528009040 comp rx=0 tx=0).stop 2023-07-09T02:13:33.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb52c15c060 msgr2=0x7fb52c0b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb52c15c060 0x7fb52c0b44f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb52400efc0 tx=0x7fb524009f90 comp rx=0 tx=0).stop 2023-07-09T02:13:33.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 shutdown_connections 2023-07-09T02:13:33.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb52c15c060 0x7fb52c0b44f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb52c0d2620 0x7fb52c153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb510066280 0x7fb510068730 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 --2- 172.21.15.45:0/2034935447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb52c0cd120 0x7fb52c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 >> 172.21.15.45:0/2034935447 conn(0x7fb52c0698e0 msgr2=0x7fb52c1586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:33.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 shutdown_connections 2023-07-09T02:13:33.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.747+0000 7fb534182640 1 -- 172.21.15.45:0/2034935447 wait complete. 2023-07-09T02:13:33.770 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-07-09T02:13:33.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd24c56640 1 Processor -- start 2023-07-09T02:13:33.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd24c56640 1 -- start start 2023-07-09T02:13:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd24c56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2620 0x7fbd200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd24c56640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd20160a50 con 0x7fbd2015c060 2023-07-09T02:13:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd24c56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2015c430 con 0x7fbd200cd120 2023-07-09T02:13:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd24c56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015fb60 con 0x7fbd200d2620 2023-07-09T02:13:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd2015c060 0x7fbd200d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44726/0 (socket says 172.21.15.45:44726) 2023-07-09T02:13:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1e59c640 1 -- 172.21.15.45:0/208484374 learned_addr learned my addr 172.21.15.45:0/208484374 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd17fff640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2620 0x7fbd200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061364805 0 0) 0x7fbd20160a50 con 0x7fbd2015c060 2023-07-09T02:13:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd0c003530 con 0x7fbd2015c060 2023-07-09T02:13:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737699340 0 0) 0x7fbd0c003530 con 0x7fbd2015c060 2023-07-09T02:13:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2620 msgr2=0x7fbd200b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2620 0x7fbd200b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 >> v1:172.21.15.155:6789/0 conn(0x7fbd200cd120 legacy=0x7fbd200cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2015fe40 con 0x7fbd2015c060 2023-07-09T02:13:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fbd10001680 con 0x7fbd2015c060 2023-07-09T02:13:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 >> v1:172.21.15.45:6789/0 conn(0x7fbd2015c060 legacy=0x7fbd200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2620 0x7fbd0c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd0c003ef0 0x7fbd0c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c004d10 0x7fbd0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015fb60 con 0x7fbd0c003ef0 2023-07-09T02:13:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c00b9c0 con 0x7fbd0c004d10 2023-07-09T02:13:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c00bb80 con 0x7fbd200d2620 2023-07-09T02:13:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd17fff640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd0c003ef0 0x7fbd0c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1e59c640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2620 0x7fbd0c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.911+0000 7fbd1ed9d640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c004d10 0x7fbd0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd17fff640 1 -- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2620 msgr2=0x7fbd0c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd17fff640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2620 0x7fbd0c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd17fff640 1 -- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c004d10 msgr2=0x7fbd0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd17fff640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c004d10 0x7fbd0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd17fff640 1 -- 172.21.15.45:0/208484374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c003530 con 0x7fbd0c003ef0 2023-07-09T02:13:33.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd1ed9d640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c004d10 0x7fbd0c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd17fff640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd0c003ef0 0x7fbd0c0047d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009ab0 tx=0x7fbd0801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9b05c818c7b1a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080a5620 con 0x7fbd0c003ef0 2023-07-09T02:13:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd080a5780 con 0x7fbd0c003ef0 2023-07-09T02:13:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd1dd9b640 1 -- 172.21.15.45:0/208484374 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080a5b30 con 0x7fbd0c003ef0 2023-07-09T02:13:33.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd24c56640 1 -- 172.21.15.45:0/208484374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd0c003ef0 msgr2=0x7fbd0c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd24c56640 1 --2- 172.21.15.45:0/208484374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd0c003ef0 0x7fbd0c0047d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009ab0 tx=0x7fbd0801ca30 comp rx=0 tx=0).stop 2023-07-09T02:13:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd1ed9d640 1 -- 172.21.15.45:0/208484374 reap_dead start 2023-07-09T02:13:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd24c56640 1 -- 172.21.15.45:0/208484374 shutdown_connections 2023-07-09T02:13:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd24c56640 1 -- 172.21.15.45:0/208484374 >> 172.21.15.45:0/208484374 conn(0x7fbd200698e0 msgr2=0x7fbd20069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd24c56640 1 -- 172.21.15.45:0/208484374 shutdown_connections 2023-07-09T02:13:33.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.915+0000 7fbd24c56640 1 -- 172.21.15.45:0/208484374 wait complete. 2023-07-09T02:13:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd24c56640 1 Processor -- start 2023-07-09T02:13:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd24c56640 1 -- start start 2023-07-09T02:13:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd24c56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c003ef0 0x7fbd200a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd24c56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd201592b0 0x7fbd200cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd24c56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cb0a0 0x7fbd200cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd24c56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200cba30 con 0x7fbd200cb0a0 2023-07-09T02:13:33.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd24c56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2014f220 con 0x7fbd0c003ef0 2023-07-09T02:13:33.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd24c56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015d4e0 con 0x7fbd201592b0 2023-07-09T02:13:33.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cb0a0 0x7fbd200cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cb0a0 0x7fbd200cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60196/0 (socket says 172.21.15.45:60196) 2023-07-09T02:13:33.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 -- 172.21.15.45:0/3888820580 learned_addr learned my addr 172.21.15.45:0/3888820580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:33.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd17fff640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd201592b0 0x7fbd200cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1e59c640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c003ef0 0x7fbd200a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 -- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd201592b0 msgr2=0x7fbd200cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd201592b0 0x7fbd200cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 -- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c003ef0 msgr2=0x7fbd200a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:33.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c003ef0 0x7fbd200a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:33.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 -- 172.21.15.45:0/3888820580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2015d7c0 con 0x7fbd200cb0a0 2023-07-09T02:13:33.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd1ed9d640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cb0a0 0x7fbd200cb4f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbd2006ba70 tx=0x7fbd180058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:33.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd16ffd640 1 -- 172.21.15.45:0/3888820580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18015630 con 0x7fbd200cb0a0 2023-07-09T02:13:33.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.919+0000 7fbd16ffd640 1 -- 172.21.15.45:0/3888820580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180157b0 con 0x7fbd200cb0a0 2023-07-09T02:13:33.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.923+0000 7fbd16ffd640 1 -- 172.21.15.45:0/3888820580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18015b60 con 0x7fbd200cb0a0 2023-07-09T02:13:33.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.923+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2015daa0 con 0x7fbd200cb0a0 2023-07-09T02:13:33.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.923+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2015e060 con 0x7fbd200cb0a0 2023-07-09T02:13:33.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.923+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2015e250 con 0x7fbd200cb0a0 2023-07-09T02:13:33.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.923+0000 7fbd16ffd640 1 -- 172.21.15.45:0/3888820580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd18015cc0 con 0x7fbd200cb0a0 2023-07-09T02:13:33.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.923+0000 7fbd16ffd640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd00066280 0x7fbd00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.923+0000 7fbd16ffd640 1 -- 172.21.15.45:0/3888820580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbd18086500 con 0x7fbd200cb0a0 2023-07-09T02:13:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.923+0000 7fbd1e59c640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd00066280 0x7fbd00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.927+0000 7fbd1e59c640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd00066280 0x7fbd00068730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbd10001ec0 tx=0x7fbd10007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:33.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:33.927+0000 7fbd16ffd640 1 -- 172.21.15.45:0/3888820580 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd18057740 con 0x7fbd200cb0a0 2023-07-09T02:13:34.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.135+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7fbd2004d7d0 con 0x7fbd200cb0a0 2023-07-09T02:13:34.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.395+0000 7fbd16ffd640 1 -- 172.21.15.45:0/3888820580 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v151) v1 ==== 142+0+0 (secure 0 0 0) 0x7fbd180572d0 con 0x7fbd200cb0a0 2023-07-09T02:13:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd00066280 msgr2=0x7fbd00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd00066280 0x7fbd00068730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbd10001ec0 tx=0x7fbd10007040 comp rx=0 tx=0).stop 2023-07-09T02:13:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cb0a0 msgr2=0x7fbd200cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cb0a0 0x7fbd200cb4f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbd2006ba70 tx=0x7fbd180058e0 comp rx=0 tx=0).stop 2023-07-09T02:13:34.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 shutdown_connections 2023-07-09T02:13:34.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cb0a0 0x7fbd200cb4f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:34.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd00066280 0x7fbd00068730 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:34.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd201592b0 0x7fbd200cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:34.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 --2- 172.21.15.45:0/3888820580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd0c003ef0 0x7fbd200a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:34.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 >> 172.21.15.45:0/3888820580 conn(0x7fbd200698e0 msgr2=0x7fbd200d1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 shutdown_connections 2023-07-09T02:13:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.399+0000 7fbd24c56640 1 -- 172.21.15.45:0/3888820580 wait complete. 2023-07-09T02:13:34.422 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-07-09T02:13:34.423 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-07-09T02:13:34.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-07-09T02:13:34.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.563+0000 7ff868c9c640 1 Processor -- start 2023-07-09T02:13:34.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.563+0000 7ff868c9c640 1 -- start start 2023-07-09T02:13:34.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff868c9c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8640d2620 0x7ff8640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:34.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff868c9c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff864160a50 con 0x7ff8640cd120 2023-07-09T02:13:34.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff868c9c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86415c430 con 0x7ff86415c060 2023-07-09T02:13:34.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff868c9c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86415fb60 con 0x7ff8640d2620 2023-07-09T02:13:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff862d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff8640cd120 0x7ff8640cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44736/0 (socket says 172.21.15.45:44736) 2023-07-09T02:13:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff85bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8640d2620 0x7ff8640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:34.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff862d9d640 1 -- 172.21.15.45:0/4059187039 learned_addr learned my addr 172.21.15.45:0/4059187039 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff85bfff640 1 -- 172.21.15.45:0/4059187039 >> v1:172.21.15.155:6789/0 conn(0x7ff86415c060 legacy=0x7ff8640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff85bfff640 1 -- 172.21.15.45:0/4059187039 >> v1:172.21.15.45:6789/0 conn(0x7ff8640cd120 legacy=0x7ff8640cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff85bfff640 1 -- 172.21.15.45:0/4059187039 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86415fe40 con 0x7ff8640d2620 2023-07-09T02:13:34.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.567+0000 7ff861d9b640 1 -- 172.21.15.45:0/4059187039 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064167340 0 0) 0x7ff864160a50 con 0x7ff8640cd120 2023-07-09T02:13:34.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff85bfff640 1 --2- 172.21.15.45:0/4059187039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8640d2620 0x7ff8640b4ed0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0097c0 tx=0x7ff84c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147ee190da1abd97 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:34.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff861d9b640 1 -- 172.21.15.45:0/4059187039 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0ab650 con 0x7ff8640d2620 2023-07-09T02:13:34.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff861d9b640 1 -- 172.21.15.45:0/4059187039 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c0ab7b0 con 0x7ff8640d2620 2023-07-09T02:13:34.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff861d9b640 1 -- 172.21.15.45:0/4059187039 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0abb40 con 0x7ff8640d2620 2023-07-09T02:13:34.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 -- 172.21.15.45:0/4059187039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8640d2620 msgr2=0x7ff8640b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:34.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 --2- 172.21.15.45:0/4059187039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8640d2620 0x7ff8640b4ed0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0097c0 tx=0x7ff84c01c450 comp rx=0 tx=0).stop 2023-07-09T02:13:34.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 -- 172.21.15.45:0/4059187039 shutdown_connections 2023-07-09T02:13:34.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 --2- 172.21.15.45:0/4059187039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8640d2620 0x7ff8640b4ed0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:34.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 -- 172.21.15.45:0/4059187039 >> 172.21.15.45:0/4059187039 conn(0x7ff8640698e0 msgr2=0x7ff864069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:34.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 -- 172.21.15.45:0/4059187039 shutdown_connections 2023-07-09T02:13:34.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 -- 172.21.15.45:0/4059187039 wait complete. 2023-07-09T02:13:34.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 Processor -- start 2023-07-09T02:13:34.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.571+0000 7ff868c9c640 1 -- start start 2023-07-09T02:13:34.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8640cd120 0x7ff86414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:34.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8640d2620 0x7ff86415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:34.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86415c060 0x7ff86415f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:34.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86415f6c0 con 0x7ff86415c060 2023-07-09T02:13:34.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86415e3c0 con 0x7ff8640d2620 2023-07-09T02:13:34.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86415e6a0 con 0x7ff8640cd120 2023-07-09T02:13:34.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86415c060 0x7ff86415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:34.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86415c060 0x7ff86415f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60220/0 (socket says 172.21.15.45:60220) 2023-07-09T02:13:34.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 -- 172.21.15.45:0/3251518634 learned_addr learned my addr 172.21.15.45:0/3251518634 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:34.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff85bfff640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8640d2620 0x7ff86415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:34.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff86259c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8640cd120 0x7ff86414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:34.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 -- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8640cd120 msgr2=0x7ff86414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:34.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8640cd120 0x7ff86414e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:34.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 -- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8640d2620 msgr2=0x7ff86415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:34.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8640d2620 0x7ff86415c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:34.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 -- 172.21.15.45:0/3251518634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c009420 con 0x7ff86415c060 2023-07-09T02:13:34.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff86259c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8640cd120 0x7ff86414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:34.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff862d9d640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86415c060 0x7ff86415f180 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff85c001570 tx=0x7ff85c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:34.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff85affd640 1 -- 172.21.15.45:0/3251518634 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00a640 con 0x7ff86415c060 2023-07-09T02:13:34.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff85affd640 1 -- 172.21.15.45:0/3251518634 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c00a7c0 con 0x7ff86415c060 2023-07-09T02:13:34.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff85affd640 1 -- 172.21.15.45:0/3251518634 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00ab70 con 0x7ff86415c060 2023-07-09T02:13:34.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8640b59f0 con 0x7ff86415c060 2023-07-09T02:13:34.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86415ec60 con 0x7ff86415c060 2023-07-09T02:13:34.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86415eea0 con 0x7ff86415c060 2023-07-09T02:13:34.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.575+0000 7ff85affd640 1 -- 172.21.15.45:0/3251518634 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff85c00acd0 con 0x7ff86415c060 2023-07-09T02:13:34.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.579+0000 7ff85affd640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8440662b0 0x7ff844068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:34.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.579+0000 7ff85affd640 1 -- 172.21.15.45:0/3251518634 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff85c082e80 con 0x7ff86415c060 2023-07-09T02:13:34.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.579+0000 7ff86259c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8440662b0 0x7ff844068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:34.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.579+0000 7ff86259c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8440662b0 0x7ff844068760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff8640d1f30 tx=0x7ff854009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:34.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.583+0000 7ff85affd640 1 -- 172.21.15.45:0/3251518634 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff86415eea0 con 0x7ff86415c060 2023-07-09T02:13:34.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:34.791+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7ff86415eea0 con 0x7ff86415c060 2023-07-09T02:13:35.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.403+0000 7ff85affd640 1 -- 172.21.15.45:0/3251518634 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v152) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff86415eea0 con 0x7ff86415c060 2023-07-09T02:13:35.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8440662b0 msgr2=0x7ff844068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:35.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8440662b0 0x7ff844068760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff8640d1f30 tx=0x7ff854009040 comp rx=0 tx=0).stop 2023-07-09T02:13:35.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86415c060 msgr2=0x7ff86415f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:35.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86415c060 0x7ff86415f180 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff85c001570 tx=0x7ff85c00cca0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 shutdown_connections 2023-07-09T02:13:35.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff86415c060 0x7ff86415f180 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8640d2620 0x7ff86415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8440662b0 0x7ff844068760 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 --2- 172.21.15.45:0/3251518634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8640cd120 0x7ff86414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 >> 172.21.15.45:0/3251518634 conn(0x7ff8640698e0 msgr2=0x7ff8640b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:35.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 shutdown_connections 2023-07-09T02:13:35.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.407+0000 7ff868c9c640 1 -- 172.21.15.45:0/3251518634 wait complete. 2023-07-09T02:13:35.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-07-09T02:13:35.592 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_objectstore":"memstore"} 2023-07-09T02:13:35.592 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-07-09T02:13:35.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:13:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bf31f640 1 Processor -- start 2023-07-09T02:13:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bf31f640 1 -- start start 2023-07-09T02:13:35.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bf31f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc7b815c060 0x7fc7b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bf31f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7b80d2620 0x7fc7b80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bf31f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b8160a50 con 0x7fc7b80cd120 2023-07-09T02:13:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bf31f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b815c430 con 0x7fc7b80d2620 2023-07-09T02:13:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bf31f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b815fb60 con 0x7fc7b815c060 2023-07-09T02:13:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bd8bc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7b80d2620 0x7fc7b80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bd8bc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7b80d2620 0x7fc7b80cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60232/0 (socket says 172.21.15.45:60232) 2023-07-09T02:13:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bd8bc640 1 -- 172.21.15.45:0/3494258771 learned_addr learned my addr 172.21.15.45:0/3494258771 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bd0bb640 1 --2- 172.21.15.45:0/3494258771 >> v2:172.21.15.155:3300/0 conn(0x7fc7b815c060 0x7fc7b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bd8bc640 1 -- 172.21.15.45:0/3494258771 >> v2:172.21.15.155:3300/0 conn(0x7fc7b815c060 msgr2=0x7fc7b80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bd8bc640 1 --2- 172.21.15.45:0/3494258771 >> v2:172.21.15.155:3300/0 conn(0x7fc7b815c060 0x7fc7b80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bd8bc640 1 -- 172.21.15.45:0/3494258771 >> v1:172.21.15.155:6789/0 conn(0x7fc7b80cd120 legacy=0x7fc7b80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.735+0000 7fc7bd8bc640 1 -- 172.21.15.45:0/3494258771 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b815fe40 con 0x7fc7b80d2620 2023-07-09T02:13:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bd8bc640 1 --2- 172.21.15.45:0/3494258771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b80d2620 0x7fc7b80cee30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80d3ad0 tx=0x7fc7b001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8446b6026bf390 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7affff640 1 -- 172.21.15.45:0/3494258771 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00a5820 con 0x7fc7b80d2620 2023-07-09T02:13:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7affff640 1 -- 172.21.15.45:0/3494258771 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b00a5980 con 0x7fc7b80d2620 2023-07-09T02:13:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7affff640 1 -- 172.21.15.45:0/3494258771 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00a5d10 con 0x7fc7b80d2620 2023-07-09T02:13:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bf31f640 1 -- 172.21.15.45:0/3494258771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b80d2620 msgr2=0x7fc7b80cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/3494258771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b80d2620 0x7fc7b80cee30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80d3ad0 tx=0x7fc7b001c960 comp rx=0 tx=0).stop 2023-07-09T02:13:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bf31f640 1 -- 172.21.15.45:0/3494258771 shutdown_connections 2023-07-09T02:13:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/3494258771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b80d2620 0x7fc7b80cee30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/3494258771 >> v2:172.21.15.155:3300/0 conn(0x7fc7b815c060 0x7fc7b80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bf31f640 1 -- 172.21.15.45:0/3494258771 >> 172.21.15.45:0/3494258771 conn(0x7fc7b80698e0 msgr2=0x7fc7b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bf31f640 1 -- 172.21.15.45:0/3494258771 shutdown_connections 2023-07-09T02:13:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.739+0000 7fc7bf31f640 1 -- 172.21.15.45:0/3494258771 wait complete. 2023-07-09T02:13:35.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 Processor -- start 2023-07-09T02:13:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 -- start start 2023-07-09T02:13:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7b80cd120 0x7fc7b815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b80d2620 0x7fc7b80cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b815c060 0x7fc7b8155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b815ed80 con 0x7fc7b815c060 2023-07-09T02:13:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8157520 con 0x7fc7b80d2620 2023-07-09T02:13:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b815eaa0 con 0x7fc7b80cd120 2023-07-09T02:13:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b815c060 0x7fc7b8155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b815c060 0x7fc7b8155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60242/0 (socket says 172.21.15.45:60242) 2023-07-09T02:13:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 -- 172.21.15.45:0/210115595 learned_addr learned my addr 172.21.15.45:0/210115595 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd0bb640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7b80cd120 0x7fc7b815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bc8ba640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b80d2620 0x7fc7b80cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 -- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7b80cd120 msgr2=0x7fc7b815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7b80cd120 0x7fc7b815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 -- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b80d2620 msgr2=0x7fc7b80cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b80d2620 0x7fc7b80cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 -- 172.21.15.45:0/210115595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0009b30 con 0x7fc7b815c060 2023-07-09T02:13:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bc8ba640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b80d2620 0x7fc7b80cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bd8bc640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b815c060 0x7fc7b8155d20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00af040 tx=0x7fc7b0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7adffb640 1 -- 172.21.15.45:0/210115595 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00b8670 con 0x7fc7b815c060 2023-07-09T02:13:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7adffb640 1 -- 172.21.15.45:0/210115595 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b00b8810 con 0x7fc7b815c060 2023-07-09T02:13:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7adffb640 1 -- 172.21.15.45:0/210115595 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00b8bc0 con 0x7fc7b815c060 2023-07-09T02:13:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b80b59f0 con 0x7fc7b815c060 2023-07-09T02:13:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.743+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b80cafa0 con 0x7fc7b815c060 2023-07-09T02:13:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.747+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b80b8a10 con 0x7fc7b815c060 2023-07-09T02:13:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.747+0000 7fc7adffb640 1 -- 172.21.15.45:0/210115595 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7b00b8d20 con 0x7fc7b815c060 2023-07-09T02:13:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.747+0000 7fc7adffb640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc79c0662b0 0x7fc79c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.747+0000 7fc7adffb640 1 -- 172.21.15.45:0/210115595 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc7b011f0b0 con 0x7fc7b815c060 2023-07-09T02:13:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.747+0000 7fc7bd0bb640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc79c0662b0 0x7fc79c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.747+0000 7fc7bd0bb640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc79c0662b0 0x7fc79c068760 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80b4990 tx=0x7fc7b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:35.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.751+0000 7fc7adffb640 1 -- 172.21.15.45:0/210115595 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7b00ec950 con 0x7fc7b815c060 2023-07-09T02:13:35.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.907+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc7b80b8a10 con 0x7fc7b815c060 2023-07-09T02:13:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.911+0000 7fc7adffb640 1 -- 172.21.15.45:0/210115595 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7b00eff70 con 0x7fc7b815c060 2023-07-09T02:13:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc79c0662b0 msgr2=0x7fc79c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc79c0662b0 0x7fc79c068760 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80b4990 tx=0x7fc7b4008040 comp rx=0 tx=0).stop 2023-07-09T02:13:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b815c060 msgr2=0x7fc7b8155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b815c060 0x7fc7b8155d20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00af040 tx=0x7fc7b0019700 comp rx=0 tx=0).stop 2023-07-09T02:13:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 shutdown_connections 2023-07-09T02:13:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7b815c060 0x7fc7b8155d20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b80d2620 0x7fc7b80cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc79c0662b0 0x7fc79c068760 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 --2- 172.21.15.45:0/210115595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7b80cd120 0x7fc7b815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 >> 172.21.15.45:0/210115595 conn(0x7fc7b80698e0 msgr2=0x7fc7b80b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 shutdown_connections 2023-07-09T02:13:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:35.915+0000 7fc7bf31f640 1 -- 172.21.15.45:0/210115595 wait complete. 2023-07-09T02:13:35.937 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:13:35.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:13:35.999 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:13:36.060 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:13:36.060 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:36.061 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:36.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:13:36.070 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:13:36.071 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:36.082 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:13:36.084 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:36.084 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:36.120 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:13:36.121 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:13:36.122 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:36.137 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:13:36.137 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:13:36.138 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:36.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448c648640 1 Processor -- start 2023-07-09T02:13:36.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448c648640 1 -- start start 2023-07-09T02:13:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448c648640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f448415c060 0x7f44840b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448c648640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44840cd120 0x7f44840d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448c648640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484160a50 con 0x7f44840d2450 2023-07-09T02:13:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448c648640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44840d28f0 con 0x7f448415c060 2023-07-09T02:13:36.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448c648640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44840cfe40 con 0x7f44840cd120 2023-07-09T02:13:36.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448a3e4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f448415c060 0x7f44840b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f4489be3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44840cd120 0x7f44840d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448a3e4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f448415c060 0x7f44840b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:39248/0 (socket says 172.21.15.45:39248) 2023-07-09T02:13:36.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448a3e4640 1 -- 172.21.15.45:0/4224393890 learned_addr learned my addr 172.21.15.45:0/4224393890 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:36.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448a3e4640 1 -- 172.21.15.45:0/4224393890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44840cd120 msgr2=0x7f44840d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:36.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448a3e4640 1 --2- 172.21.15.45:0/4224393890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44840cd120 0x7f44840d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448a3e4640 1 -- 172.21.15.45:0/4224393890 >> v1:172.21.15.155:6789/0 conn(0x7f44840d2450 legacy=0x7f44840d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f448a3e4640 1 -- 172.21.15.45:0/4224393890 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448415c430 con 0x7f448415c060 2023-07-09T02:13:36.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.303+0000 7f4489be3640 1 --2- 172.21.15.45:0/4224393890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44840cd120 0x7f44840d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:36.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f448a3e4640 1 --2- 172.21.15.45:0/4224393890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f448415c060 0x7f44840b4ed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f448001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414f9f349f7d2c44 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:36.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f44893e2640 1 -- 172.21.15.45:0/4224393890 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800a7070 con 0x7f448415c060 2023-07-09T02:13:36.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f44893e2640 1 -- 172.21.15.45:0/4224393890 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44800ab430 con 0x7f448415c060 2023-07-09T02:13:36.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f44893e2640 1 -- 172.21.15.45:0/4224393890 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800ab7c0 con 0x7f448415c060 2023-07-09T02:13:36.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f448c648640 1 -- 172.21.15.45:0/4224393890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f448415c060 msgr2=0x7f44840b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f448c648640 1 --2- 172.21.15.45:0/4224393890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f448415c060 0x7f44840b4ed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4480009870 tx=0x7f448001c510 comp rx=0 tx=0).stop 2023-07-09T02:13:36.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f448c648640 1 -- 172.21.15.45:0/4224393890 shutdown_connections 2023-07-09T02:13:36.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f448c648640 1 --2- 172.21.15.45:0/4224393890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44840cd120 0x7f44840d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f448c648640 1 --2- 172.21.15.45:0/4224393890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f448415c060 0x7f44840b4ed0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.307+0000 7f448c648640 1 -- 172.21.15.45:0/4224393890 >> 172.21.15.45:0/4224393890 conn(0x7f44840698e0 msgr2=0x7f4484069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:36.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 -- 172.21.15.45:0/4224393890 shutdown_connections 2023-07-09T02:13:36.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 -- 172.21.15.45:0/4224393890 wait complete. 2023-07-09T02:13:36.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 Processor -- start 2023-07-09T02:13:36.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 -- start start 2023-07-09T02:13:36.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44840cd120 0x7f448415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44840d2450 0x7f4484157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f448415c060 0x7f448415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44841575b0 con 0x7f44840cd120 2023-07-09T02:13:36.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448415cc40 con 0x7f44840d2450 2023-07-09T02:13:36.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448c648640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448415cf20 con 0x7f448415c060 2023-07-09T02:13:36.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44840cd120 0x7f448415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44840cd120 0x7f448415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60252/0 (socket says 172.21.15.45:60252) 2023-07-09T02:13:36.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 -- 172.21.15.45:0/2692964184 learned_addr learned my addr 172.21.15.45:0/2692964184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:36.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f4489be3640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44840d2450 0x7f4484157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448abe5640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f448415c060 0x7f448415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 -- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f448415c060 msgr2=0x7f448415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f448415c060 0x7f448415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 -- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44840d2450 msgr2=0x7f4484157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44840d2450 0x7f4484157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 -- 172.21.15.45:0/2692964184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4474009420 con 0x7f44840cd120 2023-07-09T02:13:36.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.311+0000 7f448a3e4640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44840cd120 0x7f448415c660 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f44800ad040 tx=0x7f44800192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:36.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f447affd640 1 -- 172.21.15.45:0/2692964184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800bc070 con 0x7f44840cd120 2023-07-09T02:13:36.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f447affd640 1 -- 172.21.15.45:0/2692964184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44800b4420 con 0x7f44840cd120 2023-07-09T02:13:36.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f447affd640 1 -- 172.21.15.45:0/2692964184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800b47f0 con 0x7f44840cd120 2023-07-09T02:13:36.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44800094d0 con 0x7f44840cd120 2023-07-09T02:13:36.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448415d4e0 con 0x7f44840cd120 2023-07-09T02:13:36.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448404d7d0 con 0x7f44840cd120 2023-07-09T02:13:36.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f447affd640 1 -- 172.21.15.45:0/2692964184 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44800b4950 con 0x7f44840cd120 2023-07-09T02:13:36.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f447affd640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4468066250 0x7f4468068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f447affd640 1 -- 172.21.15.45:0/2692964184 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f448011d2f0 con 0x7f44840cd120 2023-07-09T02:13:36.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.315+0000 7f4489be3640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4468066250 0x7f4468068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.319+0000 7f4489be3640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4468066250 0x7f4468068700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f44841f8150 tx=0x7f4474009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:36.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.319+0000 7f447affd640 1 -- 172.21.15.45:0/2692964184 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44800eab30 con 0x7f44840cd120 2023-07-09T02:13:36.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.507+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f448415d060 con 0x7f44840cd120 2023-07-09T02:13:36.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.507+0000 7f447affd640 1 -- 172.21.15.45:0/2692964184 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f448415d060 con 0x7f44840cd120 2023-07-09T02:13:36.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:36.512 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5132,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3723082001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3723082001},{"type":"v1","addr":"172.21.15.155:6837","nonce":3723082001}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2724511029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2724511029},{"type":"v1","addr":"172.21.15.155:6836","nonce":2724511029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/909330992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":909330992},{"type":"v1","addr":"172.21.15.45:6834","nonce":909330992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6030,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/612049402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":612049402},{"type":"v1","addr":"172.21.15.45:6835","nonce":612049402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-07-09T02:13:36.513 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2023-07-09T02:13:36.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4468066250 msgr2=0x7f4468068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4468066250 0x7f4468068700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f44841f8150 tx=0x7f4474009190 comp rx=0 tx=0).stop 2023-07-09T02:13:36.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44840cd120 msgr2=0x7f448415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44840cd120 0x7f448415c660 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f44800ad040 tx=0x7f44800192b0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 shutdown_connections 2023-07-09T02:13:36.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4468066250 0x7f4468068700 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f448415c060 0x7f448415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44840d2450 0x7f4484157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 --2- 172.21.15.45:0/2692964184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44840cd120 0x7f448415c660 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 >> 172.21.15.45:0/2692964184 conn(0x7f44840698e0 msgr2=0x7f44840b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:36.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 shutdown_connections 2023-07-09T02:13:36.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.511+0000 7f448c648640 1 -- 172.21.15.45:0/2692964184 wait complete. 2023-07-09T02:13:36.533 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:13:36.534 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:13:36.534 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:13:36.534 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:13:36.535 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:13:36.535 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:13:36.535 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:13:36.536 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:13:36.537 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:13:36.537 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:13:36.537 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:13:36.537 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:13:36.538 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:13:36.538 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:13:36.538 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:13:36.538 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:13:36.547 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:13:36.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:13:36.549 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:13:36.550 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:13:36.551 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:13:36.551 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:13:36.552 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:13:36.553 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:13:36.592 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:13:36.592 DEBUG:teuthology.parallel:result is None 2023-07-09T02:13:36.593 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:13:36.594 DEBUG:teuthology.parallel:result is None 2023-07-09T02:13:36.595 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:13:36.596 DEBUG:teuthology.parallel:result is None 2023-07-09T02:13:36.597 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:13:36.598 DEBUG:teuthology.parallel:result is None 2023-07-09T02:13:36.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:13:36.679 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:13:36.680 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:13:36.687 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:13:36.688 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:13:36.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f77448ec640 1 Processor -- start 2023-07-09T02:13:36.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f77448ec640 1 -- start start 2023-07-09T02:13:36.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f77448ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f774015c060 0x7f77400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f77448ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77400d2620 0x7f77400cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f77448ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7740160a50 con 0x7f77400cd120 2023-07-09T02:13:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f77448ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774015c430 con 0x7f774015c060 2023-07-09T02:13:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f77448ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774015fb60 con 0x7f77400d2620 2023-07-09T02:13:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f773e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f774015c060 0x7f77400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f7737fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f77400cd120 0x7f77400d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44754/0 (socket says 172.21.15.45:44754) 2023-07-09T02:13:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f7737fff640 1 -- 172.21.15.45:0/1546867135 learned_addr learned my addr 172.21.15.45:0/1546867135 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:36.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f773ed9d640 1 --2- 172.21.15.45:0/1546867135 >> v2:172.21.15.155:3300/0 conn(0x7f77400d2620 0x7f77400cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f773e59c640 1 -- 172.21.15.45:0/1546867135 >> v2:172.21.15.155:3300/0 conn(0x7f77400d2620 msgr2=0x7f77400cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:36.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f773e59c640 1 --2- 172.21.15.45:0/1546867135 >> v2:172.21.15.155:3300/0 conn(0x7f77400d2620 0x7f77400cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f773e59c640 1 -- 172.21.15.45:0/1546867135 >> v1:172.21.15.45:6789/0 conn(0x7f77400cd120 legacy=0x7f77400d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f773e59c640 1 -- 172.21.15.45:0/1546867135 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774015fe40 con 0x7f774015c060 2023-07-09T02:13:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.747+0000 7f773dd9b640 1 -- 172.21.15.45:0/1546867135 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282726609 0 0) 0x7f7740160a50 con 0x7f77400cd120 2023-07-09T02:13:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f773e59c640 1 --2- 172.21.15.45:0/1546867135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b4ed0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f774008bca0 tx=0x7f773001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68cd63676572b68 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f773dd9b640 1 -- 172.21.15.45:0/1546867135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300a7070 con 0x7f774015c060 2023-07-09T02:13:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f773dd9b640 1 -- 172.21.15.45:0/1546867135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300ab430 con 0x7f774015c060 2023-07-09T02:13:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f773dd9b640 1 -- 172.21.15.45:0/1546867135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300ab7c0 con 0x7f774015c060 2023-07-09T02:13:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f77448ec640 1 -- 172.21.15.45:0/1546867135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 msgr2=0x7f77400b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f77448ec640 1 --2- 172.21.15.45:0/1546867135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b4ed0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f774008bca0 tx=0x7f773001c430 comp rx=0 tx=0).stop 2023-07-09T02:13:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f77448ec640 1 -- 172.21.15.45:0/1546867135 shutdown_connections 2023-07-09T02:13:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f77448ec640 1 --2- 172.21.15.45:0/1546867135 >> v2:172.21.15.155:3300/0 conn(0x7f77400d2620 0x7f77400cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f77448ec640 1 --2- 172.21.15.45:0/1546867135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b4ed0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f77448ec640 1 -- 172.21.15.45:0/1546867135 >> 172.21.15.45:0/1546867135 conn(0x7f77400698e0 msgr2=0x7f7740069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f77448ec640 1 -- 172.21.15.45:0/1546867135 shutdown_connections 2023-07-09T02:13:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.751+0000 7f77448ec640 1 -- 172.21.15.45:0/1546867135 wait complete. 2023-07-09T02:13:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 Processor -- start 2023-07-09T02:13:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 -- start start 2023-07-09T02:13:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77400cd120 0x7f77400c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77400d2620 0x7f7740153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774015b240 con 0x7f774015c060 2023-07-09T02:13:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774015b6d0 con 0x7f77400cd120 2023-07-09T02:13:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774015a630 con 0x7f77400d2620 2023-07-09T02:13:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60304/0 (socket says 172.21.15.45:60304) 2023-07-09T02:13:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 -- 172.21.15.45:0/2531835203 learned_addr learned my addr 172.21.15.45:0/2531835203 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773e59c640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77400cd120 0x7f77400c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f7737fff640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77400d2620 0x7f7740153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 -- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77400d2620 msgr2=0x7f7740153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77400d2620 0x7f7740153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 -- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77400cd120 msgr2=0x7f77400c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77400cd120 0x7f77400c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 -- 172.21.15.45:0/2531835203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7730009420 con 0x7f774015c060 2023-07-09T02:13:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f773ed9d640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b7c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7738007de0 tx=0x7f773800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f7736ffd640 1 -- 172.21.15.45:0/2531835203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738014620 con 0x7f774015c060 2023-07-09T02:13:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f7736ffd640 1 -- 172.21.15.45:0/2531835203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800ee90 con 0x7f774015c060 2023-07-09T02:13:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f7736ffd640 1 -- 172.21.15.45:0/2531835203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380149e0 con 0x7f774015c060 2023-07-09T02:13:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77400b59f0 con 0x7f774015c060 2023-07-09T02:13:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.755+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774015abf0 con 0x7f774015c060 2023-07-09T02:13:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.759+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774015b3b0 con 0x7f774015c060 2023-07-09T02:13:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.759+0000 7f7736ffd640 1 -- 172.21.15.45:0/2531835203 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7738014b40 con 0x7f774015c060 2023-07-09T02:13:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.759+0000 7f7736ffd640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7720066280 0x7f7720068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.759+0000 7f7736ffd640 1 -- 172.21.15.45:0/2531835203 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7738084340 con 0x7f774015c060 2023-07-09T02:13:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.759+0000 7f773e59c640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7720066280 0x7f7720068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.759+0000 7f773e59c640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7720066280 0x7f7720068730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77300af000 tx=0x7f77300a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.763+0000 7f7736ffd640 1 -- 172.21.15.45:0/2531835203 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7738055580 con 0x7f774015c060 2023-07-09T02:13:36.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:36.927+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f774004d7d0 con 0x7f774015c060 2023-07-09T02:13:37.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f7736ffd640 1 -- 172.21.15.45:0/2531835203 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7738055110 con 0x7f774015c060 2023-07-09T02:13:37.422 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:13:37.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7720066280 msgr2=0x7f7720068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7720066280 0x7f7720068730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f77300af000 tx=0x7f77300a7000 comp rx=0 tx=0).stop 2023-07-09T02:13:37.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 msgr2=0x7f77400b7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b7c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7738007de0 tx=0x7f773800e4b0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 shutdown_connections 2023-07-09T02:13:37.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f774015c060 0x7f77400b7c40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7720066280 0x7f7720068730 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77400d2620 0x7f7740153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 --2- 172.21.15.45:0/2531835203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77400cd120 0x7f77400c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 >> 172.21.15.45:0/2531835203 conn(0x7f77400698e0 msgr2=0x7f77400b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:37.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 shutdown_connections 2023-07-09T02:13:37.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.419+0000 7f77448ec640 1 -- 172.21.15.45:0/2531835203 wait complete. 2023-07-09T02:13:37.447 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:13:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.587+0000 7fd25207b640 1 Processor -- start 2023-07-09T02:13:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd25207b640 1 -- start start 2023-07-09T02:13:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd25207b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd24c0d2620 0x7fd24c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd25207b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c0cd120 0x7fd24c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd25207b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c160a50 con 0x7fd24c15c060 2023-07-09T02:13:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd25207b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c15c430 con 0x7fd24c0d2620 2023-07-09T02:13:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd25207b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c15fb60 con 0x7fd24c0cd120 2023-07-09T02:13:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd24c15c060 0x7fd24c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44760/0 (socket says 172.21.15.45:44760) 2023-07-09T02:13:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24b7fe640 1 -- 172.21.15.45:0/2815171963 learned_addr learned my addr 172.21.15.45:0/2815171963 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24affd640 1 --2- 172.21.15.45:0/2815171963 >> v2:172.21.15.45:3300/0 conn(0x7fd24c0d2620 0x7fd24c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:37.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24a7fc640 1 -- 172.21.15.45:0/2815171963 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255383129 0 0) 0x7fd24c160a50 con 0x7fd24c15c060 2023-07-09T02:13:37.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24a7fc640 1 -- 172.21.15.45:0/2815171963 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd234003530 con 0x7fd24c15c060 2023-07-09T02:13:37.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24bfff640 1 --2- 172.21.15.45:0/2815171963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c0cd120 0x7fd24c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:37.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24affd640 1 -- 172.21.15.45:0/2815171963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c0cd120 msgr2=0x7fd24c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:37.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24affd640 1 --2- 172.21.15.45:0/2815171963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c0cd120 0x7fd24c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24affd640 1 -- 172.21.15.45:0/2815171963 >> v1:172.21.15.45:6789/0 conn(0x7fd24c15c060 legacy=0x7fd24c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24affd640 1 -- 172.21.15.45:0/2815171963 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c15fe40 con 0x7fd24c0d2620 2023-07-09T02:13:37.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.591+0000 7fd24bfff640 1 --2- 172.21.15.45:0/2815171963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c0cd120 0x7fd24c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd24affd640 1 --2- 172.21.15.45:0/2815171963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0d2620 0x7fd24c0b4ed0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd2400097c0 tx=0x7fd24001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ada2bba679d8d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd24a7fc640 1 -- 172.21.15.45:0/2815171963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400ab650 con 0x7fd24c0d2620 2023-07-09T02:13:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd24a7fc640 1 -- 172.21.15.45:0/2815171963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2400ab7b0 con 0x7fd24c0d2620 2023-07-09T02:13:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd24a7fc640 1 -- 172.21.15.45:0/2815171963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400abb40 con 0x7fd24c0d2620 2023-07-09T02:13:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 -- 172.21.15.45:0/2815171963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0d2620 msgr2=0x7fd24c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 --2- 172.21.15.45:0/2815171963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0d2620 0x7fd24c0b4ed0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd2400097c0 tx=0x7fd24001c450 comp rx=0 tx=0).stop 2023-07-09T02:13:37.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 -- 172.21.15.45:0/2815171963 shutdown_connections 2023-07-09T02:13:37.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 --2- 172.21.15.45:0/2815171963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c0cd120 0x7fd24c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 --2- 172.21.15.45:0/2815171963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0d2620 0x7fd24c0b4ed0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 -- 172.21.15.45:0/2815171963 >> 172.21.15.45:0/2815171963 conn(0x7fd24c0698e0 msgr2=0x7fd24c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:37.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 -- 172.21.15.45:0/2815171963 shutdown_connections 2023-07-09T02:13:37.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 -- 172.21.15.45:0/2815171963 wait complete. 2023-07-09T02:13:37.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 Processor -- start 2023-07-09T02:13:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.595+0000 7fd25207b640 1 -- start start 2023-07-09T02:13:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0cd120 0x7fd24c0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd24c0d2620 0x7fd24c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c15c060 0x7fd24c159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b42f0 con 0x7fd24c0cd120 2023-07-09T02:13:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b45d0 con 0x7fd24c0d2620 2023-07-09T02:13:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b48b0 con 0x7fd24c15c060 2023-07-09T02:13:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0cd120 0x7fd24c0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0cd120 0x7fd24c0c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60322/0 (socket says 172.21.15.45:60322) 2023-07-09T02:13:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 -- 172.21.15.45:0/149841302 learned_addr learned my addr 172.21.15.45:0/149841302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24affd640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd24c0d2620 0x7fd24c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24bfff640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c15c060 0x7fd24c159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 -- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c15c060 msgr2=0x7fd24c159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c15c060 0x7fd24c159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 -- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd24c0d2620 msgr2=0x7fd24c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd24c0d2620 0x7fd24c0b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 -- 172.21.15.45:0/149841302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd240009420 con 0x7fd24c0cd120 2023-07-09T02:13:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd24b7fe640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0cd120 0x7fd24c0c8b70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c4d0 tx=0x7fd23c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd233fff640 1 -- 172.21.15.45:0/149841302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c005cf0 con 0x7fd24c0cd120 2023-07-09T02:13:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd233fff640 1 -- 172.21.15.45:0/149841302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c005e50 con 0x7fd24c0cd120 2023-07-09T02:13:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c0b59f0 con 0x7fd24c0cd120 2023-07-09T02:13:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd233fff640 1 -- 172.21.15.45:0/149841302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c007270 con 0x7fd24c0cd120 2023-07-09T02:13:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c15c7b0 con 0x7fd24c0cd120 2023-07-09T02:13:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.599+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c04d7d0 con 0x7fd24c0cd120 2023-07-09T02:13:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.603+0000 7fd233fff640 1 -- 172.21.15.45:0/149841302 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd23c0073d0 con 0x7fd24c0cd120 2023-07-09T02:13:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.603+0000 7fd233fff640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd238066280 0x7fd238068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.603+0000 7fd233fff640 1 -- 172.21.15.45:0/149841302 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd23c082f70 con 0x7fd24c0cd120 2023-07-09T02:13:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.603+0000 7fd24affd640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd238066280 0x7fd238068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.603+0000 7fd24affd640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd238066280 0x7fd238068730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd2400af000 tx=0x7fd2400a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:37.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.607+0000 7fd233fff640 1 -- 172.21.15.45:0/149841302 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd23c0b3700 con 0x7fd24c0cd120 2023-07-09T02:13:37.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.811+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd24c06baa0 con 0x7fd24c0cd120 2023-07-09T02:13:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.811+0000 7fd233fff640 1 -- 172.21.15.45:0/149841302 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd23c017090 con 0x7fd24c0cd120 2023-07-09T02:13:37.816 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:37.816 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:37.816 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:13:37.817 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.817 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:13:37.817 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:13:37.817 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.817 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:13:37.818 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:13:37.818 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:13:37.818 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.818 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.818 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.818 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:13:37.819 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:13:37.819 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.819 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:13:37.819 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:13:37.819 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:13:37.819 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.819 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.820 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.820 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:13:37.820 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:13:37.820 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.820 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:13:37.820 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:13:37.821 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:13:37.821 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.821 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.821 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.821 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.821 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:13:37.821 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:13:37.821 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.822 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:13:37.822 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:13:37.822 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:13:37.822 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.822 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.823 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.823 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:13:37.823 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:13:37.823 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.823 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:13:37.823 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:13:37.824 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.824 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.824 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.824 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.824 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:13:37.824 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:13:37.824 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.825 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:13:37.825 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:13:37.825 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.825 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.825 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.825 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:13:37.826 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:13:37.826 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.826 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:13:37.826 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:13:37.826 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.826 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.826 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.827 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:13:37.827 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:13:37.827 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.827 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:13:37.827 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:13:37.827 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.827 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.828 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.828 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:13:37.828 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:13:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:13:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:13:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.829 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:13:37.830 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:13:37.830 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.830 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:13:37.830 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:13:37.830 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.830 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.830 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.830 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:13:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:13:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:13:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:13:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.832 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.832 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:13:37.832 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:13:37.832 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.832 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:13:37.832 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:13:37.832 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.833 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.833 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.833 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.833 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:13:37.833 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:13:37.834 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.834 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:13:37.834 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:13:37.834 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:13:37.834 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.834 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.834 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:13:37.835 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:13:37.835 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.835 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:13:37.835 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:13:37.835 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:13:37.835 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:13:37.835 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.836 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.836 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:13:37.836 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:13:37.836 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.836 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:13:37.836 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:13:37.837 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:13:37.837 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:13:37.837 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.840 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.840 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:13:37.841 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:13:37.841 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.841 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:13:37.841 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:13:37.841 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:13:37.841 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:13:37.841 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.842 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.842 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.842 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:13:37.842 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:13:37.842 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.842 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:13:37.842 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:13:37.843 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:13:37.843 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.843 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.843 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.843 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:13:37.843 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:13:37.843 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.844 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:13:37.844 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:13:37.844 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.844 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:37.844 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:37.844 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:13:37.845 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:13:37.845 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:13:37.845 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:13:37.845 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:13:37.845 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:13:37.845 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.845 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:37.846 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:13:37.846 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd238066280 msgr2=0x7fd238068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd238066280 0x7fd238068730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd2400af000 tx=0x7fd2400a7000 comp rx=0 tx=0).stop 2023-07-09T02:13:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0cd120 msgr2=0x7fd24c0c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0cd120 0x7fd24c0c8b70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c4d0 tx=0x7fd23c00c990 comp rx=0 tx=0).stop 2023-07-09T02:13:37.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 shutdown_connections 2023-07-09T02:13:37.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd238066280 0x7fd238068730 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd24c15c060 0x7fd24c159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd24c0d2620 0x7fd24c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 --2- 172.21.15.45:0/149841302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd24c0cd120 0x7fd24c0c8b70 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 >> 172.21.15.45:0/149841302 conn(0x7fd24c0698e0 msgr2=0x7fd24c154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:37.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 shutdown_connections 2023-07-09T02:13:37.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.815+0000 7fd25207b640 1 -- 172.21.15.45:0/149841302 wait complete. 2023-07-09T02:13:37.849 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:37.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4509159640 1 Processor -- start 2023-07-09T02:13:37.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4509159640 1 -- start start 2023-07-09T02:13:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4509159640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f450415c060 0x7f45040b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4509159640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45040cd120 0x7f45040d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4509159640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4504160a50 con 0x7f45040d2450 2023-07-09T02:13:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4509159640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45040d28d0 con 0x7f45040cd120 2023-07-09T02:13:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4509159640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45040cfe40 con 0x7f450415c060 2023-07-09T02:13:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f450259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45040cd120 0x7f45040d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f450259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45040cd120 0x7f45040d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60330/0 (socket says 172.21.15.45:60330) 2023-07-09T02:13:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f450259c640 1 -- 172.21.15.45:0/3010435271 learned_addr learned my addr 172.21.15.45:0/3010435271 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:37.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4502d9d640 1 --2- 172.21.15.45:0/3010435271 >> v2:172.21.15.155:3300/0 conn(0x7f450415c060 0x7f45040b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:37.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f450259c640 1 -- 172.21.15.45:0/3010435271 >> v2:172.21.15.155:3300/0 conn(0x7f450415c060 msgr2=0x7f45040b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:37.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f450259c640 1 --2- 172.21.15.45:0/3010435271 >> v2:172.21.15.155:3300/0 conn(0x7f450415c060 0x7f45040b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:37.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f450259c640 1 -- 172.21.15.45:0/3010435271 >> v1:172.21.15.155:6789/0 conn(0x7f45040d2450 legacy=0x7f45040d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:37.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f450259c640 1 -- 172.21.15.45:0/3010435271 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450415c430 con 0x7f45040cd120 2023-07-09T02:13:37.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.991+0000 7f4502d9d640 1 --2- 172.21.15.45:0/3010435271 >> v2:172.21.15.155:3300/0 conn(0x7f450415c060 0x7f45040b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:37.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f450259c640 1 --2- 172.21.15.45:0/3010435271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040d1f10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f45040d3ad0 tx=0x7f44f801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4ddb932fdf0762 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:37.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4501d9b640 1 -- 172.21.15.45:0/3010435271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80ac410 con 0x7f45040cd120 2023-07-09T02:13:37.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4501d9b640 1 -- 172.21.15.45:0/3010435271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f80ac570 con 0x7f45040cd120 2023-07-09T02:13:37.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4501d9b640 1 -- 172.21.15.45:0/3010435271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80ac900 con 0x7f45040cd120 2023-07-09T02:13:37.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4509159640 1 -- 172.21.15.45:0/3010435271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 msgr2=0x7f45040d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:37.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4509159640 1 --2- 172.21.15.45:0/3010435271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040d1f10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f45040d3ad0 tx=0x7f44f801c490 comp rx=0 tx=0).stop 2023-07-09T02:13:37.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4509159640 1 -- 172.21.15.45:0/3010435271 shutdown_connections 2023-07-09T02:13:37.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4509159640 1 --2- 172.21.15.45:0/3010435271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040d1f10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4509159640 1 --2- 172.21.15.45:0/3010435271 >> v2:172.21.15.155:3300/0 conn(0x7f450415c060 0x7f45040b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4509159640 1 -- 172.21.15.45:0/3010435271 >> 172.21.15.45:0/3010435271 conn(0x7f45040698e0 msgr2=0x7f4504069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:38.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4509159640 1 -- 172.21.15.45:0/3010435271 shutdown_connections 2023-07-09T02:13:38.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.995+0000 7f4509159640 1 -- 172.21.15.45:0/3010435271 wait complete. 2023-07-09T02:13:38.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 Processor -- start 2023-07-09T02:13:38.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 -- start start 2023-07-09T02:13:38.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45040d2450 0x7f4504151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450415c060 0x7f450415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040b4460 con 0x7f45040cd120 2023-07-09T02:13:38.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040b4740 con 0x7f450415c060 2023-07-09T02:13:38.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040b4a20 con 0x7f45040d2450 2023-07-09T02:13:38.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60342/0 (socket says 172.21.15.45:60342) 2023-07-09T02:13:38.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 -- 172.21.15.45:0/3392140742 learned_addr learned my addr 172.21.15.45:0/3392140742 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:38.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f450259c640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45040d2450 0x7f4504151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f450359e640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450415c060 0x7f450415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 -- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45040d2450 msgr2=0x7f4504151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45040d2450 0x7f4504151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 -- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450415c060 msgr2=0x7f450415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450415c060 0x7f450415a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 -- 172.21.15.45:0/3392140742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094d0 con 0x7f45040cd120 2023-07-09T02:13:38.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f450259c640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45040d2450 0x7f4504151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:38.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f450359e640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450415c060 0x7f450415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:38.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4502d9d640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040b1690 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c7f0 tx=0x7f44f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:38.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f44eb7fe640 1 -- 172.21.15.45:0/3392140742 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007820 con 0x7f45040cd120 2023-07-09T02:13:38.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f44eb7fe640 1 -- 172.21.15.45:0/3392140742 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f4007980 con 0x7f45040cd120 2023-07-09T02:13:38.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f44eb7fe640 1 -- 172.21.15.45:0/3392140742 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007d30 con 0x7f45040cd120 2023-07-09T02:13:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45040b4d00 con 0x7f45040cd120 2023-07-09T02:13:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45040b1bd0 con 0x7f45040cd120 2023-07-09T02:13:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:37.999+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450404d7d0 con 0x7f45040cd120 2023-07-09T02:13:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.003+0000 7f44eb7fe640 1 -- 172.21.15.45:0/3392140742 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44f40113f0 con 0x7f45040cd120 2023-07-09T02:13:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.003+0000 7f44eb7fe640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44f0066280 0x7f44f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.003+0000 7f44eb7fe640 1 -- 172.21.15.45:0/3392140742 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f44f4083d60 con 0x7f45040cd120 2023-07-09T02:13:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.003+0000 7f450259c640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44f0066280 0x7f44f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.003+0000 7f450259c640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44f0066280 0x7f44f0068730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f44f80ae000 tx=0x7f44f80a6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:38.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.007+0000 7f44eb7fe640 1 -- 172.21.15.45:0/3392140742 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44f4051520 con 0x7f45040cd120 2023-07-09T02:13:38.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45041606b0 con 0x7f45040cd120 2023-07-09T02:13:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f44eb7fe640 1 -- 172.21.15.45:0/3392140742 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f44f4054b40 con 0x7f45040cd120 2023-07-09T02:13:38.167 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:38.167 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":64,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:37.428573+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:38.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44f0066280 msgr2=0x7f44f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44f0066280 0x7f44f0068730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f44f80ae000 tx=0x7f44f80a6040 comp rx=0 tx=0).stop 2023-07-09T02:13:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 msgr2=0x7f45040b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040b1690 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c7f0 tx=0x7f44f400ccb0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 shutdown_connections 2023-07-09T02:13:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450415c060 0x7f450415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44f0066280 0x7f44f0068730 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45040d2450 0x7f4504151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.163+0000 7f4509159640 1 --2- 172.21.15.45:0/3392140742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45040cd120 0x7f45040b1690 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.167+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 >> 172.21.15.45:0/3392140742 conn(0x7f45040698e0 msgr2=0x7f45040b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.167+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 shutdown_connections 2023-07-09T02:13:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.167+0000 7f4509159640 1 -- 172.21.15.45:0/3392140742 wait complete. 2023-07-09T02:13:38.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:13:38.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:13:38.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.331+0000 7fb090982640 1 Processor -- start 2023-07-09T02:13:38.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.331+0000 7fb090982640 1 -- start start 2023-07-09T02:13:38.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb090982640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0c8d10 0x7fb08c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb090982640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c06bf30 con 0x7fb08c0ca0f0 2023-07-09T02:13:38.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb090982640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c06bc50 con 0x7fb08c15db00 2023-07-09T02:13:38.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb090982640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0cab90 con 0x7fb08c0c8d10 2023-07-09T02:13:38.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb08c0ca0f0 0x7fb08c0cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44768/0 (socket says 172.21.15.45:44768) 2023-07-09T02:13:38.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08a59c640 1 -- 172.21.15.45:0/3816837480 learned_addr learned my addr 172.21.15.45:0/3816837480 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:38.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb083fff640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0c8d10 0x7fb08c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458787678 0 0) 0x7fb08c06bf30 con 0x7fb08c0ca0f0 2023-07-09T02:13:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb078003530 con 0x7fb08c0ca0f0 2023-07-09T02:13:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186020875 0 0) 0x7fb078003530 con 0x7fb08c0ca0f0 2023-07-09T02:13:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0c8d10 msgr2=0x7fb08c0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0c8d10 0x7fb08c0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 >> v1:172.21.15.155:6789/0 conn(0x7fb08c15db00 legacy=0x7fb08c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0cae70 con 0x7fb08c0ca0f0 2023-07-09T02:13:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fb07c001680 con 0x7fb08c0ca0f0 2023-07-09T02:13:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 >> v1:172.21.15.45:6789/0 conn(0x7fb08c0ca0f0 legacy=0x7fb08c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0c8d10 0x7fb0780039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb078003ef0 0x7fb0780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb078004d10 0x7fb078005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0cab90 con 0x7fb078004d10 2023-07-09T02:13:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07800ba70 con 0x7fb078003ef0 2023-07-09T02:13:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07800bc30 con 0x7fb08c0c8d10 2023-07-09T02:13:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08a59c640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0c8d10 0x7fb0780039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb083fff640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb078003ef0 0x7fb0780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08ad9d640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb078004d10 0x7fb078005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08ad9d640 1 -- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0c8d10 msgr2=0x7fb0780039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08ad9d640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb08c0c8d10 0x7fb0780039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08ad9d640 1 -- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb078003ef0 msgr2=0x7fb0780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08ad9d640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb078003ef0 0x7fb0780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.335+0000 7fb08ad9d640 1 -- 172.21.15.45:0/3816837480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078003530 con 0x7fb078004d10 2023-07-09T02:13:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb08ad9d640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb078004d10 0x7fb078005180 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb084007fd0 tx=0x7fb08401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d957658c8c48332 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0840a66a0 con 0x7fb078004d10 2023-07-09T02:13:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0840a6800 con 0x7fb078004d10 2023-07-09T02:13:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb089d9b640 1 -- 172.21.15.45:0/3816837480 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0840a6bf0 con 0x7fb078004d10 2023-07-09T02:13:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb090982640 1 -- 172.21.15.45:0/3816837480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb078004d10 msgr2=0x7fb078005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb090982640 1 --2- 172.21.15.45:0/3816837480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb078004d10 0x7fb078005180 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb084007fd0 tx=0x7fb08401c820 comp rx=0 tx=0).stop 2023-07-09T02:13:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb08ad9d640 1 -- 172.21.15.45:0/3816837480 reap_dead start 2023-07-09T02:13:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb090982640 1 -- 172.21.15.45:0/3816837480 shutdown_connections 2023-07-09T02:13:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb090982640 1 -- 172.21.15.45:0/3816837480 >> 172.21.15.45:0/3816837480 conn(0x7fb08c0694b0 msgr2=0x7fb08c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb090982640 1 -- 172.21.15.45:0/3816837480 shutdown_connections 2023-07-09T02:13:38.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.339+0000 7fb090982640 1 -- 172.21.15.45:0/3816837480 wait complete. 2023-07-09T02:13:38.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 Processor -- start 2023-07-09T02:13:38.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 -- start start 2023-07-09T02:13:38.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb078004d10 0x7fb08c15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb08c0b15d0 0x7fb08c14d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c0b2ec0 0x7fb08c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c14de50 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c15d1f0 con 0x7fb08c0b15d0 2023-07-09T02:13:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c14e840 con 0x7fb078004d10 2023-07-09T02:13:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c0b2ec0 0x7fb08c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c0b2ec0 0x7fb08c0b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60370/0 (socket says 172.21.15.45:60370) 2023-07-09T02:13:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 -- 172.21.15.45:0/744210225 learned_addr learned my addr 172.21.15.45:0/744210225 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08a59c640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb078004d10 0x7fb08c15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb083fff640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb08c0b15d0 0x7fb08c14d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 -- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb078004d10 msgr2=0x7fb08c15cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb078004d10 0x7fb08c15cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 -- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb08c0b15d0 msgr2=0x7fb08c14d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb08c0b15d0 0x7fb08c14d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 -- 172.21.15.45:0/744210225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0b1a20 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb08ad9d640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c0b2ec0 0x7fb08c0b3330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb08401c650 tx=0x7fb078005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb082ffd640 1 -- 172.21.15.45:0/744210225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0840a66a0 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb082ffd640 1 -- 172.21.15.45:0/744210225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0840011d0 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb082ffd640 1 -- 172.21.15.45:0/744210225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0840a6bb0 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c0b3c20 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c0b41e0 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.343+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c0b1230 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.347+0000 7fb082ffd640 1 -- 172.21.15.45:0/744210225 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0840a6d10 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.347+0000 7fb082ffd640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb06c066280 0x7fb06c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.347+0000 7fb082ffd640 1 -- 172.21.15.45:0/744210225 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb08411d810 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.347+0000 7fb08a59c640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb06c066280 0x7fb06c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.347+0000 7fb08a59c640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb06c066280 0x7fb06c068730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb07c000c10 tx=0x7fb07c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:38.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.351+0000 7fb082ffd640 1 -- 172.21.15.45:0/744210225 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0840eaf50 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.503+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb08c04d7d0 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb082ffd640 1 -- 172.21.15.45:0/744210225 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0840ac020 con 0x7fb08c0b2ec0 2023-07-09T02:13:38.509 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:13:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb06c066280 msgr2=0x7fb06c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb06c066280 0x7fb06c068730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb07c000c10 tx=0x7fb07c009040 comp rx=0 tx=0).stop 2023-07-09T02:13:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c0b2ec0 msgr2=0x7fb08c0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c0b2ec0 0x7fb08c0b3330 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb08401c650 tx=0x7fb078005800 comp rx=0 tx=0).stop 2023-07-09T02:13:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 shutdown_connections 2023-07-09T02:13:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c0b2ec0 0x7fb08c0b3330 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb08c0b15d0 0x7fb08c14d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb06c066280 0x7fb06c068730 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 --2- 172.21.15.45:0/744210225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb078004d10 0x7fb08c15cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 >> 172.21.15.45:0/744210225 conn(0x7fb08c0694b0 msgr2=0x7fb08c160360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 shutdown_connections 2023-07-09T02:13:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.507+0000 7fb090982640 1 -- 172.21.15.45:0/744210225 wait complete. 2023-07-09T02:13:38.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:13:38.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.671+0000 7f3958fd5640 1 Processor -- start 2023-07-09T02:13:38.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.671+0000 7f3958fd5640 1 -- start start 2023-07-09T02:13:38.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3958fd5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f395415c060 0x7f39540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3958fd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39540cd120 0x7f39540d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3958fd5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39540d2450 0x7f39540d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3958fd5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39540d28f0 con 0x7f39540d2450 2023-07-09T02:13:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3958fd5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3954160a50 con 0x7f395415c060 2023-07-09T02:13:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3958fd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395415c430 con 0x7f39540cd120 2023-07-09T02:13:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3952d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39540d2450 0x7f39540d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3952d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39540d2450 0x7f39540d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60378/0 (socket says 172.21.15.45:60378) 2023-07-09T02:13:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3952d9d640 1 -- 172.21.15.45:0/1478673801 learned_addr learned my addr 172.21.15.45:0/1478673801 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f395259c640 1 --2- 172.21.15.45:0/1478673801 >> v2:172.21.15.155:3300/0 conn(0x7f395415c060 0x7f39540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f394bfff640 1 --2- 172.21.15.45:0/1478673801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39540cd120 0x7f39540d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3952d9d640 1 -- 172.21.15.45:0/1478673801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39540cd120 msgr2=0x7f39540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:38.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3952d9d640 1 --2- 172.21.15.45:0/1478673801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39540cd120 0x7f39540d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3952d9d640 1 -- 172.21.15.45:0/1478673801 >> v2:172.21.15.155:3300/0 conn(0x7f395415c060 msgr2=0x7f39540b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:38.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3952d9d640 1 --2- 172.21.15.45:0/1478673801 >> v2:172.21.15.155:3300/0 conn(0x7f395415c060 0x7f39540b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.675+0000 7f3952d9d640 1 -- 172.21.15.45:0/1478673801 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395415fb60 con 0x7f39540d2450 2023-07-09T02:13:38.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3952d9d640 1 --2- 172.21.15.45:0/1478673801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540d0610 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f39540d3ad0 tx=0x7f394c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ddccbfe7e47b17 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:38.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3951d9b640 1 -- 172.21.15.45:0/1478673801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c0a5560 con 0x7f39540d2450 2023-07-09T02:13:38.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3951d9b640 1 -- 172.21.15.45:0/1478673801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c0a56c0 con 0x7f39540d2450 2023-07-09T02:13:38.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3951d9b640 1 -- 172.21.15.45:0/1478673801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c0a5a50 con 0x7f39540d2450 2023-07-09T02:13:38.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 -- 172.21.15.45:0/1478673801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 msgr2=0x7f39540d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 --2- 172.21.15.45:0/1478673801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540d0610 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f39540d3ad0 tx=0x7f394c01c6e0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 -- 172.21.15.45:0/1478673801 shutdown_connections 2023-07-09T02:13:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 --2- 172.21.15.45:0/1478673801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540d0610 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 --2- 172.21.15.45:0/1478673801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39540cd120 0x7f39540d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 --2- 172.21.15.45:0/1478673801 >> v2:172.21.15.155:3300/0 conn(0x7f395415c060 0x7f39540b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 -- 172.21.15.45:0/1478673801 >> 172.21.15.45:0/1478673801 conn(0x7f39540698e0 msgr2=0x7f3954069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 -- 172.21.15.45:0/1478673801 shutdown_connections 2023-07-09T02:13:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 -- 172.21.15.45:0/1478673801 wait complete. 2023-07-09T02:13:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 Processor -- start 2023-07-09T02:13:38.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.679+0000 7f3958fd5640 1 -- start start 2023-07-09T02:13:38.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39540cd120 0x7f39540b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395415c060 0x7f3954157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39540cc870 con 0x7f39540d2450 2023-07-09T02:13:38.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39540b8630 con 0x7f39540cd120 2023-07-09T02:13:38.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39540b7660 con 0x7f395415c060 2023-07-09T02:13:38.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60380/0 (socket says 172.21.15.45:60380) 2023-07-09T02:13:38.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 -- 172.21.15.45:0/2154119930 learned_addr learned my addr 172.21.15.45:0/2154119930 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:38.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3952d9d640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395415c060 0x7f3954157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f395259c640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39540cd120 0x7f39540b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 -- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395415c060 msgr2=0x7f3954157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395415c060 0x7f3954157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 -- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39540cd120 msgr2=0x7f39540b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39540cd120 0x7f39540b80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 -- 172.21.15.45:0/2154119930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c009b30 con 0x7f39540d2450 2023-07-09T02:13:38.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394bfff640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540cb0a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f393c00d7d0 tx=0x7f393c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:38.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394affd640 1 -- 172.21.15.45:0/2154119930 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c004020 con 0x7f39540d2450 2023-07-09T02:13:38.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394affd640 1 -- 172.21.15.45:0/2154119930 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c004180 con 0x7f39540d2450 2023-07-09T02:13:38.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394affd640 1 -- 172.21.15.45:0/2154119930 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c004330 con 0x7f39540d2450 2023-07-09T02:13:38.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39540ca5c0 con 0x7f39540d2450 2023-07-09T02:13:38.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39540cab80 con 0x7f39540d2450 2023-07-09T02:13:38.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395404d7d0 con 0x7f39540d2450 2023-07-09T02:13:38.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.683+0000 7f394affd640 1 -- 172.21.15.45:0/2154119930 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f393c0096a0 con 0x7f39540d2450 2023-07-09T02:13:38.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.687+0000 7f394affd640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3934066280 0x7f3934068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:38.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.687+0000 7f394affd640 1 -- 172.21.15.45:0/2154119930 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f393c083ce0 con 0x7f39540d2450 2023-07-09T02:13:38.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.687+0000 7f395259c640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3934066280 0x7f3934068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:38.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.687+0000 7f395259c640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3934066280 0x7f3934068730 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39540b7210 tx=0x7f3944008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:38.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.691+0000 7f394affd640 1 -- 172.21.15.45:0/2154119930 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f393c051430 con 0x7f39540d2450 2023-07-09T02:13:38.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.843+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39540b87d0 con 0x7f39540d2450 2023-07-09T02:13:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.843+0000 7f394affd640 1 -- 172.21.15.45:0/2154119930 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f393c0180a0 con 0x7f39540d2450 2023-07-09T02:13:38.848 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:13:38.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3934066280 msgr2=0x7f3934068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3934066280 0x7f3934068730 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39540b7210 tx=0x7f3944008040 comp rx=0 tx=0).stop 2023-07-09T02:13:38.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 msgr2=0x7f39540cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:38.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540cb0a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f393c00d7d0 tx=0x7f393c00dc90 comp rx=0 tx=0).stop 2023-07-09T02:13:38.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 shutdown_connections 2023-07-09T02:13:38.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3934066280 0x7f3934068730 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395415c060 0x7f3954157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39540d2450 0x7f39540cb0a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 --2- 172.21.15.45:0/2154119930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39540cd120 0x7f39540b80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:38.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 >> 172.21.15.45:0/2154119930 conn(0x7f39540698e0 msgr2=0x7f39540b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:38.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 shutdown_connections 2023-07-09T02:13:38.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:38.847+0000 7f3958fd5640 1 -- 172.21.15.45:0/2154119930 wait complete. 2023-07-09T02:13:38.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:13:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.007+0000 7f11c5b3a640 1 Processor -- start 2023-07-09T02:13:39.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.007+0000 7f11c5b3a640 1 -- start start 2023-07-09T02:13:39.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11c5b3a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11c00ca0f0 0x7f11c00cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11c5b3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11c5b3a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c006bf30 con 0x7f11c00cbbb0 2023-07-09T02:13:39.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11c5b3a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c015e4c0 con 0x7f11c00ca0f0 2023-07-09T02:13:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11c5b3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c006bc50 con 0x7f11c015db00 2023-07-09T02:13:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11bf7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11c00ca0f0 0x7f11c00cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11beffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f11c00cbbb0 0x7f11c00c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44772/0 (socket says 172.21.15.45:44772) 2023-07-09T02:13:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11beffd640 1 -- 172.21.15.45:0/2031035814 learned_addr learned my addr 172.21.15.45:0/2031035814 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11bffff640 1 --2- 172.21.15.45:0/2031035814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11bf7fe640 1 -- 172.21.15.45:0/2031035814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 msgr2=0x7f11c015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11bf7fe640 1 --2- 172.21.15.45:0/2031035814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11bf7fe640 1 -- 172.21.15.45:0/2031035814 >> v1:172.21.15.45:6789/0 conn(0x7f11c00cbbb0 legacy=0x7f11c00c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11bf7fe640 1 -- 172.21.15.45:0/2031035814 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c00cab90 con 0x7f11c00ca0f0 2023-07-09T02:13:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11be7fc640 1 -- 172.21.15.45:0/2031035814 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87970718 0 0) 0x7f11c006bf30 con 0x7f11c00cbbb0 2023-07-09T02:13:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.011+0000 7f11bffff640 1 --2- 172.21.15.45:0/2031035814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11bf7fe640 1 --2- 172.21.15.45:0/2031035814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00ca0f0 0x7f11c00cb670 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097c0 tx=0x7f11b001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc8b8cc929a28b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11be7fc640 1 -- 172.21.15.45:0/2031035814 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00ab600 con 0x7f11c00ca0f0 2023-07-09T02:13:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11be7fc640 1 -- 172.21.15.45:0/2031035814 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b00a7050 con 0x7f11c00ca0f0 2023-07-09T02:13:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11be7fc640 1 -- 172.21.15.45:0/2031035814 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00ab980 con 0x7f11c00ca0f0 2023-07-09T02:13:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2031035814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00ca0f0 msgr2=0x7f11c00cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2031035814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00ca0f0 0x7f11c00cb670 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097c0 tx=0x7f11b001c3f0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2031035814 shutdown_connections 2023-07-09T02:13:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2031035814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2031035814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00ca0f0 0x7f11c00cb670 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2031035814 >> 172.21.15.45:0/2031035814 conn(0x7f11c00694b0 msgr2=0x7f11c00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2031035814 shutdown_connections 2023-07-09T02:13:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2031035814 wait complete. 2023-07-09T02:13:39.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 Processor -- start 2023-07-09T02:13:39.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.015+0000 7f11c5b3a640 1 -- start start 2023-07-09T02:13:39.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c00ca0f0 0x7f11c00b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00cbbb0 0x7f11c0143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c0158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00b4490 con 0x7f11c00cbbb0 2023-07-09T02:13:39.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00c7b10 con 0x7f11c00ca0f0 2023-07-09T02:13:39.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00c7df0 con 0x7f11c015db00 2023-07-09T02:13:39.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00cbbb0 0x7f11c0143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00cbbb0 0x7f11c0143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60406/0 (socket says 172.21.15.45:60406) 2023-07-09T02:13:39.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 -- 172.21.15.45:0/2776786017 learned_addr learned my addr 172.21.15.45:0/2776786017 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:39.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11bf7fe640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c00ca0f0 0x7f11c00b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11bffff640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c0158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 -- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 msgr2=0x7f11c0158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c0158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 -- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c00ca0f0 msgr2=0x7f11c00b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c00ca0f0 0x7f11c00b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 -- 172.21.15.45:0/2776786017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009420 con 0x7f11c00cbbb0 2023-07-09T02:13:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11bf7fe640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c00ca0f0 0x7f11c00b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11bffff640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c0158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11beffd640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00cbbb0 0x7f11c0143090 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f11b40011f0 tx=0x7f11b400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11a7fff640 1 -- 172.21.15.45:0/2776786017 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40074e0 con 0x7f11c00cbbb0 2023-07-09T02:13:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11a7fff640 1 -- 172.21.15.45:0/2776786017 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b4007640 con 0x7f11c00cbbb0 2023-07-09T02:13:39.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11a7fff640 1 -- 172.21.15.45:0/2776786017 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4004a10 con 0x7f11c00cbbb0 2023-07-09T02:13:39.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c00c80d0 con 0x7f11c00cbbb0 2023-07-09T02:13:39.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c00c8690 con 0x7f11c00cbbb0 2023-07-09T02:13:39.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c004d7d0 con 0x7f11c00cbbb0 2023-07-09T02:13:39.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.019+0000 7f11a7fff640 1 -- 172.21.15.45:0/2776786017 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11b4004b70 con 0x7f11c00cbbb0 2023-07-09T02:13:39.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.023+0000 7f11a7fff640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11ac066280 0x7f11ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.023+0000 7f11a7fff640 1 -- 172.21.15.45:0/2776786017 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f11b4082c20 con 0x7f11c00cbbb0 2023-07-09T02:13:39.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.023+0000 7f11bf7fe640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11ac066280 0x7f11ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.023+0000 7f11bf7fe640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11ac066280 0x7f11ac068730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ad000 tx=0x7f11b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:39.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.027+0000 7f11a7fff640 1 -- 172.21.15.45:0/2776786017 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11b4050460 con 0x7f11c00cbbb0 2023-07-09T02:13:39.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f11c0164c70 con 0x7f11c00cbbb0 2023-07-09T02:13:39.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11a7fff640 1 -- 172.21.15.45:0/2776786017 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+126 (secure 0 0 0) 0x7f11b4018070 con 0x7f11c00cbbb0 2023-07-09T02:13:39.187 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:39.188 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:13:39.188 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:39.188 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:13:39.188 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:13:39.188 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:13:39.188 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:13:39.188 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:13:39.189 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:13:39.189 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:13:39.189 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:13:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11ac066280 msgr2=0x7f11ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11ac066280 0x7f11ac068730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f11b00ad000 tx=0x7f11b0008040 comp rx=0 tx=0).stop 2023-07-09T02:13:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00cbbb0 msgr2=0x7f11c0143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00cbbb0 0x7f11c0143090 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f11b40011f0 tx=0x7f11b400c9b0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 shutdown_connections 2023-07-09T02:13:39.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11ac066280 0x7f11ac068730 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11c015db00 0x7f11c0158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11c00cbbb0 0x7f11c0143090 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 --2- 172.21.15.45:0/2776786017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11c00ca0f0 0x7f11c00b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 >> 172.21.15.45:0/2776786017 conn(0x7f11c00694b0 msgr2=0x7f11c0153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:39.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 shutdown_connections 2023-07-09T02:13:39.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.183+0000 7f11c5b3a640 1 -- 172.21.15.45:0/2776786017 wait complete. 2023-07-09T02:13:39.207 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:13:39.208 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:13:39.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f32151c5640 1 Processor -- start 2023-07-09T02:13:39.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f32151c5640 1 -- start start 2023-07-09T02:13:39.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f32151c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f321015c480 0x7f32100cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f32151c5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f32100cecd0 0x7f32100d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f32151c5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32100d19c0 con 0x7f32100b4490 2023-07-09T02:13:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f32151c5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321015c850 con 0x7f32100cecd0 2023-07-09T02:13:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f32151c5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32100d1090 con 0x7f321015c480 2023-07-09T02:13:39.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f3207fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f32100cecd0 0x7f32100d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f3207fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f32100cecd0 0x7f32100d1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60416/0 (socket says 172.21.15.45:60416) 2023-07-09T02:13:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f3207fff640 1 -- 172.21.15.45:0/2938916621 learned_addr learned my addr 172.21.15.45:0/2938916621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.351+0000 7f320ed9d640 1 --2- 172.21.15.45:0/2938916621 >> v2:172.21.15.155:3300/0 conn(0x7f321015c480 0x7f32100cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f3207fff640 1 -- 172.21.15.45:0/2938916621 >> v2:172.21.15.155:3300/0 conn(0x7f321015c480 msgr2=0x7f32100cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f3207fff640 1 --2- 172.21.15.45:0/2938916621 >> v2:172.21.15.155:3300/0 conn(0x7f321015c480 0x7f32100cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f3207fff640 1 -- 172.21.15.45:0/2938916621 >> v1:172.21.15.155:6789/0 conn(0x7f32100b4490 legacy=0x7f32100b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:39.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f3207fff640 1 -- 172.21.15.45:0/2938916621 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100d1370 con 0x7f32100cecd0 2023-07-09T02:13:39.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f3207fff640 1 --2- 172.21.15.45:0/2938916621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100cecd0 0x7f32100d1e50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3210069ae0 tx=0x7f31f801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdc6e1962103863 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:39.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f320e59c640 1 -- 172.21.15.45:0/2938916621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f80ac630 con 0x7f32100cecd0 2023-07-09T02:13:39.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f320e59c640 1 -- 172.21.15.45:0/2938916621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f80ac790 con 0x7f32100cecd0 2023-07-09T02:13:39.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f320e59c640 1 -- 172.21.15.45:0/2938916621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f80acb20 con 0x7f32100cecd0 2023-07-09T02:13:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f32151c5640 1 -- 172.21.15.45:0/2938916621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100cecd0 msgr2=0x7f32100d1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f32151c5640 1 --2- 172.21.15.45:0/2938916621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100cecd0 0x7f32100d1e50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3210069ae0 tx=0x7f31f801c4c0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f32151c5640 1 -- 172.21.15.45:0/2938916621 shutdown_connections 2023-07-09T02:13:39.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f32151c5640 1 --2- 172.21.15.45:0/2938916621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100cecd0 0x7f32100d1e50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f32151c5640 1 --2- 172.21.15.45:0/2938916621 >> v2:172.21.15.155:3300/0 conn(0x7f321015c480 0x7f32100cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f32151c5640 1 -- 172.21.15.45:0/2938916621 >> 172.21.15.45:0/2938916621 conn(0x7f32100cf490 msgr2=0x7f32100cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.355+0000 7f32151c5640 1 -- 172.21.15.45:0/2938916621 shutdown_connections 2023-07-09T02:13:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 -- 172.21.15.45:0/2938916621 wait complete. 2023-07-09T02:13:39.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 Processor -- start 2023-07-09T02:13:39.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 -- start start 2023-07-09T02:13:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100b4490 0x7f321015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32100cecd0 0x7f3210150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f321015c480 0x7f321015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321015ed80 con 0x7f32100b4490 2023-07-09T02:13:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321015e170 con 0x7f321015c480 2023-07-09T02:13:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32151c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321015e450 con 0x7f32100cecd0 2023-07-09T02:13:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100b4490 0x7f321015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100b4490 0x7f321015f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60432/0 (socket says 172.21.15.45:60432) 2023-07-09T02:13:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 -- 172.21.15.45:0/2154752488 learned_addr learned my addr 172.21.15.45:0/2154752488 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f3207fff640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32100cecd0 0x7f3210150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320f59e640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f321015c480 0x7f321015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 -- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32100cecd0 msgr2=0x7f3210150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32100cecd0 0x7f3210150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 -- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f321015c480 msgr2=0x7f321015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f321015c480 0x7f321015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 -- 172.21.15.45:0/2154752488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80094d0 con 0x7f32100b4490 2023-07-09T02:13:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f320ed9d640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100b4490 0x7f321015f210 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f320000d5f0 tx=0x7f320000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.359+0000 7f32077fe640 1 -- 172.21.15.45:0/2154752488 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32000125f0 con 0x7f32100b4490 2023-07-09T02:13:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f32077fe640 1 -- 172.21.15.45:0/2154752488 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200012750 con 0x7f32100b4490 2023-07-09T02:13:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f32077fe640 1 -- 172.21.15.45:0/2154752488 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200012ae0 con 0x7f32100b4490 2023-07-09T02:13:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321015e730 con 0x7f32100b4490 2023-07-09T02:13:39.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321015f750 con 0x7f32100b4490 2023-07-09T02:13:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321004d7d0 con 0x7f32100b4490 2023-07-09T02:13:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f32077fe640 1 -- 172.21.15.45:0/2154752488 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3200012c40 con 0x7f32100b4490 2023-07-09T02:13:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f32077fe640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f31f00662b0 0x7f31f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f32077fe640 1 -- 172.21.15.45:0/2154752488 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3200083e80 con 0x7f32100b4490 2023-07-09T02:13:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.363+0000 7f3207fff640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f31f00662b0 0x7f31f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.367+0000 7f3207fff640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f31f00662b0 0x7f31f0068760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f31f80ae000 tx=0x7f31f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:39.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.367+0000 7f32077fe640 1 -- 172.21.15.45:0/2154752488 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32000515d0 con 0x7f32100b4490 2023-07-09T02:13:39.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:39.523+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f32100b1860 con 0x7f32100b4490 2023-07-09T02:13:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.443+0000 7f32077fe640 1 -- 172.21.15.45:0/2154752488 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3200007380 con 0x7f32100b4490 2023-07-09T02:13:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:13:40.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f31f00662b0 msgr2=0x7f31f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:40.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f31f00662b0 0x7f31f0068760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f31f80ae000 tx=0x7f31f8008040 comp rx=0 tx=0).stop 2023-07-09T02:13:40.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100b4490 msgr2=0x7f321015f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:40.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100b4490 0x7f321015f210 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f320000d5f0 tx=0x7f320000dab0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 shutdown_connections 2023-07-09T02:13:40.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f321015c480 0x7f321015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f31f00662b0 0x7f31f0068760 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32100cecd0 0x7f3210150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 --2- 172.21.15.45:0/2154752488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32100b4490 0x7f321015f210 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 >> 172.21.15.45:0/2154752488 conn(0x7f32100cf490 msgr2=0x7f32100b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:40.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 shutdown_connections 2023-07-09T02:13:40.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.447+0000 7f32151c5640 1 -- 172.21.15.45:0/2154752488 wait complete. 2023-07-09T02:13:40.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:13:40.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbf759640 1 Processor -- start 2023-07-09T02:13:40.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbf759640 1 -- start start 2023-07-09T02:13:40.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbf759640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3db815c410 0x7f3db81608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbf759640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80b59b0 0x7f3db80b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbf759640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80ced10 con 0x7f3db80d2340 2023-07-09T02:13:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbf759640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db815c7e0 con 0x7f3db815c410 2023-07-09T02:13:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbf759640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80cd1b0 con 0x7f3db80b59b0 2023-07-09T02:13:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbd4f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3db815c410 0x7f3db81608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbd4f5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3db815c410 0x7f3db81608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60434/0 (socket says 172.21.15.45:60434) 2023-07-09T02:13:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbd4f5640 1 -- 172.21.15.45:0/2764909290 learned_addr learned my addr 172.21.15.45:0/2764909290 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbccf4640 1 --2- 172.21.15.45:0/2764909290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80b59b0 0x7f3db80b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbd4f5640 1 -- 172.21.15.45:0/2764909290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80b59b0 msgr2=0x7f3db80b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbd4f5640 1 --2- 172.21.15.45:0/2764909290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80b59b0 0x7f3db80b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbd4f5640 1 -- 172.21.15.45:0/2764909290 >> v1:172.21.15.155:6789/0 conn(0x7f3db80d2340 legacy=0x7f3db80d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:40.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.627+0000 7f3dbd4f5640 1 -- 172.21.15.45:0/2764909290 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8160de0 con 0x7f3db815c410 2023-07-09T02:13:40.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbd4f5640 1 --2- 172.21.15.45:0/2764909290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db815c410 0x7f3db81608a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009870 tx=0x7f3db401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2981a2de55d15c0b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:40.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3daffff640 1 -- 172.21.15.45:0/2764909290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40ab5f0 con 0x7f3db815c410 2023-07-09T02:13:40.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3daffff640 1 -- 172.21.15.45:0/2764909290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db40ab750 con 0x7f3db815c410 2023-07-09T02:13:40.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3daffff640 1 -- 172.21.15.45:0/2764909290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40abae0 con 0x7f3db815c410 2023-07-09T02:13:40.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbf759640 1 -- 172.21.15.45:0/2764909290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db815c410 msgr2=0x7f3db81608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbf759640 1 --2- 172.21.15.45:0/2764909290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db815c410 0x7f3db81608a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009870 tx=0x7f3db401c510 comp rx=0 tx=0).stop 2023-07-09T02:13:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbf759640 1 -- 172.21.15.45:0/2764909290 shutdown_connections 2023-07-09T02:13:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbf759640 1 --2- 172.21.15.45:0/2764909290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80b59b0 0x7f3db80b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbf759640 1 --2- 172.21.15.45:0/2764909290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db815c410 0x7f3db81608a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbf759640 1 -- 172.21.15.45:0/2764909290 >> 172.21.15.45:0/2764909290 conn(0x7f3db806a590 msgr2=0x7f3db80cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbf759640 1 -- 172.21.15.45:0/2764909290 shutdown_connections 2023-07-09T02:13:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.631+0000 7f3dbf759640 1 -- 172.21.15.45:0/2764909290 wait complete. 2023-07-09T02:13:40.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 Processor -- start 2023-07-09T02:13:40.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 -- start start 2023-07-09T02:13:40.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80b59b0 0x7f3db815b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:40.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80d2340 0x7f3db80cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:40.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c410 0x7f3db80cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:40.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db815d4a0 con 0x7f3db80b59b0 2023-07-09T02:13:40.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8148890 con 0x7f3db815c410 2023-07-09T02:13:40.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8150cc0 con 0x7f3db80d2340 2023-07-09T02:13:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80b59b0 0x7f3db815b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80b59b0 0x7f3db815b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60438/0 (socket says 172.21.15.45:60438) 2023-07-09T02:13:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 -- 172.21.15.45:0/3867338592 learned_addr learned my addr 172.21.15.45:0/3867338592 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbccf4640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80d2340 0x7f3db80cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbdcf6640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c410 0x7f3db80cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 -- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80d2340 msgr2=0x7f3db80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80d2340 0x7f3db80cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 -- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c410 msgr2=0x7f3db80cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c410 0x7f3db80cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 -- 172.21.15.45:0/3867338592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40094d0 con 0x7f3db80b59b0 2023-07-09T02:13:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbd4f5640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80b59b0 0x7f3db815b960 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3db40ad040 tx=0x7f3db401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dadffb640 1 -- 172.21.15.45:0/3867338592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40be5f0 con 0x7f3db80b59b0 2023-07-09T02:13:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dadffb640 1 -- 172.21.15.45:0/3867338592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db40be770 con 0x7f3db80b59b0 2023-07-09T02:13:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dadffb640 1 -- 172.21.15.45:0/3867338592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40beb20 con 0x7f3db80b59b0 2023-07-09T02:13:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.635+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db8150fa0 con 0x7f3db80b59b0 2023-07-09T02:13:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.639+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db8151560 con 0x7f3db80b59b0 2023-07-09T02:13:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.639+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db815d5e0 con 0x7f3db80b59b0 2023-07-09T02:13:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.639+0000 7f3dadffb640 1 -- 172.21.15.45:0/3867338592 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3db40b4600 con 0x7f3db80b59b0 2023-07-09T02:13:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.639+0000 7f3dadffb640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d9c066280 0x7f3d9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.639+0000 7f3dadffb640 1 -- 172.21.15.45:0/3867338592 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f3db40a8050 con 0x7f3db80b59b0 2023-07-09T02:13:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.643+0000 7f3dbccf4640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d9c066280 0x7f3d9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:40.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.643+0000 7f3dbccf4640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d9c066280 0x7f3d9c068730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3db80b7560 tx=0x7f3da8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:40.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.647+0000 7f3dadffb640 1 -- 172.21.15.45:0/3867338592 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3db40ebf60 con 0x7f3db80b59b0 2023-07-09T02:13:40.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:40.799+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3db804d7d0 con 0x7f3db80b59b0 2023-07-09T02:13:41.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.455+0000 7f3dadffb640 1 -- 172.21.15.45:0/3867338592 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3db40ef580 con 0x7f3db80b59b0 2023-07-09T02:13:41.460 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:13:41.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d9c066280 msgr2=0x7f3d9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:41.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d9c066280 0x7f3d9c068730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3db80b7560 tx=0x7f3da8008040 comp rx=0 tx=0).stop 2023-07-09T02:13:41.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80b59b0 msgr2=0x7f3db815b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:41.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80b59b0 0x7f3db815b960 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3db40ad040 tx=0x7f3db401ad50 comp rx=0 tx=0).stop 2023-07-09T02:13:41.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 shutdown_connections 2023-07-09T02:13:41.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c410 0x7f3db80cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d9c066280 0x7f3d9c068730 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80d2340 0x7f3db80cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 --2- 172.21.15.45:0/3867338592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80b59b0 0x7f3db815b960 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 >> 172.21.15.45:0/3867338592 conn(0x7f3db806a590 msgr2=0x7f3db8151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:41.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 shutdown_connections 2023-07-09T02:13:41.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.463+0000 7f3dbf759640 1 -- 172.21.15.45:0/3867338592 wait complete. 2023-07-09T02:13:41.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:13:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.631+0000 7fbd5d4bd640 1 Processor -- start 2023-07-09T02:13:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd5d4bd640 1 -- start start 2023-07-09T02:13:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd5d4bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd5815c060 0x7fbd580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd5d4bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 0x7fbd580cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd5d4bd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd58160a50 con 0x7fbd580cd120 2023-07-09T02:13:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd5d4bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5815c430 con 0x7fbd5815c060 2023-07-09T02:13:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd5d4bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5815fb60 con 0x7fbd580d2620 2023-07-09T02:13:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd56ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd5815c060 0x7fbd580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd56ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd5815c060 0x7fbd580b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33720/0 (socket says 172.21.15.45:33720) 2023-07-09T02:13:41.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd56ffd640 1 -- 172.21.15.45:0/3717220131 learned_addr learned my addr 172.21.15.45:0/3717220131 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:41.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd577fe640 1 --2- 172.21.15.45:0/3717220131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 0x7fbd580cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd56ffd640 1 -- 172.21.15.45:0/3717220131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 msgr2=0x7fbd580cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd56ffd640 1 --2- 172.21.15.45:0/3717220131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 0x7fbd580cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd56ffd640 1 -- 172.21.15.45:0/3717220131 >> v1:172.21.15.155:6789/0 conn(0x7fbd580cd120 legacy=0x7fbd580d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.635+0000 7fbd56ffd640 1 -- 172.21.15.45:0/3717220131 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5815fe40 con 0x7fbd5815c060 2023-07-09T02:13:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd56ffd640 1 --2- 172.21.15.45:0/3717220131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5815c060 0x7fbd580b4ed0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009870 tx=0x7fbd4801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81fe7724cabecc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd567fc640 1 -- 172.21.15.45:0/3717220131 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd480aa670 con 0x7fbd5815c060 2023-07-09T02:13:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd567fc640 1 -- 172.21.15.45:0/3717220131 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd480aa7d0 con 0x7fbd5815c060 2023-07-09T02:13:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd567fc640 1 -- 172.21.15.45:0/3717220131 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd480aab60 con 0x7fbd5815c060 2023-07-09T02:13:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/3717220131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5815c060 msgr2=0x7fbd580b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/3717220131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5815c060 0x7fbd580b4ed0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009870 tx=0x7fbd4801c510 comp rx=0 tx=0).stop 2023-07-09T02:13:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/3717220131 shutdown_connections 2023-07-09T02:13:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/3717220131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 0x7fbd580cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/3717220131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5815c060 0x7fbd580b4ed0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/3717220131 >> 172.21.15.45:0/3717220131 conn(0x7fbd580698e0 msgr2=0x7fbd58069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:41.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/3717220131 shutdown_connections 2023-07-09T02:13:41.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/3717220131 wait complete. 2023-07-09T02:13:41.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 Processor -- start 2023-07-09T02:13:41.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.639+0000 7fbd5d4bd640 1 -- start start 2023-07-09T02:13:41.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd580cd120 0x7fbd580b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:41.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 0x7fbd581534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:41.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd5815c060 0x7fbd5815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:41.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5815c570 con 0x7fbd580cd120 2023-07-09T02:13:41.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580b7b40 con 0x7fbd5815c060 2023-07-09T02:13:41.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5815f150 con 0x7fbd580d2620 2023-07-09T02:13:41.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd580cd120 0x7fbd580b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:41.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd580cd120 0x7fbd580b7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33724/0 (socket says 172.21.15.45:33724) 2023-07-09T02:13:41.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 -- 172.21.15.45:0/998325143 learned_addr learned my addr 172.21.15.45:0/998325143 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:41.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd4ffff640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 0x7fbd581534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:41.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd577fe640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd5815c060 0x7fbd5815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:41.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 -- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 msgr2=0x7fbd581534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:41.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 0x7fbd581534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 -- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd5815c060 msgr2=0x7fbd5815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:41.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd5815c060 0x7fbd5815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:41.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 -- 172.21.15.45:0/998325143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480094d0 con 0x7fbd580cd120 2023-07-09T02:13:41.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd56ffd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd580cd120 0x7fbd580b7600 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbd480ac040 tx=0x7fbd4801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:41.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd4f7fe640 1 -- 172.21.15.45:0/998325143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd480b3800 con 0x7fbd580cd120 2023-07-09T02:13:41.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd4f7fe640 1 -- 172.21.15.45:0/998325143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd480b3980 con 0x7fbd580cd120 2023-07-09T02:13:41.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd4f7fe640 1 -- 172.21.15.45:0/998325143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd480b3d30 con 0x7fbd580cd120 2023-07-09T02:13:41.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd580b59f0 con 0x7fbd580cd120 2023-07-09T02:13:41.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5815caa0 con 0x7fbd580cd120 2023-07-09T02:13:41.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.643+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5804d7d0 con 0x7fbd580cd120 2023-07-09T02:13:41.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.647+0000 7fbd4f7fe640 1 -- 172.21.15.45:0/998325143 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd480c73e0 con 0x7fbd580cd120 2023-07-09T02:13:41.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.647+0000 7fbd4f7fe640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd38066280 0x7fbd38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:41.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.647+0000 7fbd4f7fe640 1 -- 172.21.15.45:0/998325143 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fbd4811e920 con 0x7fbd580cd120 2023-07-09T02:13:41.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.647+0000 7fbd4ffff640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd38066280 0x7fbd38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:41.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.647+0000 7fbd4ffff640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd38066280 0x7fbd38068730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbd5815dee0 tx=0x7fbd40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:41.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.651+0000 7fbd4f7fe640 1 -- 172.21.15.45:0/998325143 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd480ebf20 con 0x7fbd580cd120 2023-07-09T02:13:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:41.839+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbd5806baa0 con 0x7fbd580cd120 2023-07-09T02:13:42.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.455+0000 7fbd4f7fe640 1 -- 172.21.15.45:0/998325143 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v30) v1 ==== 173+0+0 (secure 0 0 0) 0x7fbd480aa630 con 0x7fbd580cd120 2023-07-09T02:13:42.465 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 9 and data pool 10 2023-07-09T02:13:42.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd38066280 msgr2=0x7fbd38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd38066280 0x7fbd38068730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbd5815dee0 tx=0x7fbd40009040 comp rx=0 tx=0).stop 2023-07-09T02:13:42.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd580cd120 msgr2=0x7fbd580b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd580cd120 0x7fbd580b7600 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbd480ac040 tx=0x7fbd4801ad50 comp rx=0 tx=0).stop 2023-07-09T02:13:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 shutdown_connections 2023-07-09T02:13:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd5815c060 0x7fbd5815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd38066280 0x7fbd38068730 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd580d2620 0x7fbd581534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 --2- 172.21.15.45:0/998325143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd580cd120 0x7fbd580b7600 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 >> 172.21.15.45:0/998325143 conn(0x7fbd580698e0 msgr2=0x7fbd5815b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 shutdown_connections 2023-07-09T02:13:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.467+0000 7fbd5d4bd640 1 -- 172.21.15.45:0/998325143 wait complete. 2023-07-09T02:13:42.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:42.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1baa3ac640 1 Processor -- start 2023-07-09T02:13:42.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1baa3ac640 1 -- start start 2023-07-09T02:13:42.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1baa3ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ba415c060 0x7f1ba40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1baa3ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 0x7f1ba40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1baa3ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ba40d2450 0x7f1ba40d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1baa3ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba40d28f0 con 0x7f1ba415c060 2023-07-09T02:13:42.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1baa3ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba4160a50 con 0x7f1ba40d2450 2023-07-09T02:13:42.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1baa3ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba415c430 con 0x7f1ba40cd120 2023-07-09T02:13:42.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ba415c060 0x7f1ba40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ba415c060 0x7f1ba40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33730/0 (socket says 172.21.15.45:33730) 2023-07-09T02:13:42.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba3fff640 1 -- 172.21.15.45:0/1886691980 learned_addr learned my addr 172.21.15.45:0/1886691980 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:42.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba37fe640 1 --2- 172.21.15.45:0/1886691980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 0x7f1ba40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba8949640 1 --2- 172.21.15.45:0/1886691980 >> v2:172.21.15.155:3300/0 conn(0x7f1ba40d2450 0x7f1ba40d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba3fff640 1 -- 172.21.15.45:0/1886691980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 msgr2=0x7f1ba40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:42.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba3fff640 1 --2- 172.21.15.45:0/1886691980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 0x7f1ba40d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba3fff640 1 -- 172.21.15.45:0/1886691980 >> v2:172.21.15.155:3300/0 conn(0x7f1ba40d2450 msgr2=0x7f1ba40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:42.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba3fff640 1 --2- 172.21.15.45:0/1886691980 >> v2:172.21.15.155:3300/0 conn(0x7f1ba40d2450 0x7f1ba40d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.643+0000 7f1ba3fff640 1 -- 172.21.15.45:0/1886691980 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba415fb60 con 0x7f1ba415c060 2023-07-09T02:13:42.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1ba3fff640 1 --2- 172.21.15.45:0/1886691980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba40b4ed0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1ba406b120 tx=0x7f1b9401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3995895eaa8610d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:42.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1ba2ffd640 1 -- 172.21.15.45:0/1886691980 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b940ab600 con 0x7f1ba415c060 2023-07-09T02:13:42.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1ba2ffd640 1 -- 172.21.15.45:0/1886691980 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b940a7050 con 0x7f1ba415c060 2023-07-09T02:13:42.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1ba2ffd640 1 -- 172.21.15.45:0/1886691980 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b940ab980 con 0x7f1ba415c060 2023-07-09T02:13:42.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 -- 172.21.15.45:0/1886691980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 msgr2=0x7f1ba40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/1886691980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba40b4ed0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1ba406b120 tx=0x7f1b9401c210 comp rx=0 tx=0).stop 2023-07-09T02:13:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 -- 172.21.15.45:0/1886691980 shutdown_connections 2023-07-09T02:13:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/1886691980 >> v2:172.21.15.155:3300/0 conn(0x7f1ba40d2450 0x7f1ba40d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/1886691980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 0x7f1ba40d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/1886691980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba40b4ed0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 -- 172.21.15.45:0/1886691980 >> 172.21.15.45:0/1886691980 conn(0x7f1ba40698e0 msgr2=0x7f1ba4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:42.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 -- 172.21.15.45:0/1886691980 shutdown_connections 2023-07-09T02:13:42.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.647+0000 7f1baa3ac640 1 -- 172.21.15.45:0/1886691980 wait complete. 2023-07-09T02:13:42.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 Processor -- start 2023-07-09T02:13:42.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 -- start start 2023-07-09T02:13:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 0x7f1ba40cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ba40d2450 0x7f1ba40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba4151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4153510 con 0x7f1ba415c060 2023-07-09T02:13:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba41537f0 con 0x7f1ba40d2450 2023-07-09T02:13:42.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba4153ad0 con 0x7f1ba40cd120 2023-07-09T02:13:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba4151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba4151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33732/0 (socket says 172.21.15.45:33732) 2023-07-09T02:13:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 -- 172.21.15.45:0/2499390126 learned_addr learned my addr 172.21.15.45:0/2499390126 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba37fe640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ba40d2450 0x7f1ba40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba3fff640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 0x7f1ba40cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 -- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 msgr2=0x7f1ba40cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 0x7f1ba40cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 -- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ba40d2450 msgr2=0x7f1ba40cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ba40d2450 0x7f1ba40cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 -- 172.21.15.45:0/2499390126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b940094d0 con 0x7f1ba415c060 2023-07-09T02:13:42.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba8949640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba4151ef0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c007e40 tx=0x7f1b9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:42.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/2499390126 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c014620 con 0x7f1ba415c060 2023-07-09T02:13:42.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/2499390126 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c00ee90 con 0x7f1ba415c060 2023-07-09T02:13:42.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba4153db0 con 0x7f1ba415c060 2023-07-09T02:13:42.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/2499390126 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c0149e0 con 0x7f1ba415c060 2023-07-09T02:13:42.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.651+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba40b27e0 con 0x7f1ba415c060 2023-07-09T02:13:42.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.655+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba404d7d0 con 0x7f1ba415c060 2023-07-09T02:13:42.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.655+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/2499390126 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b9c014b40 con 0x7f1ba415c060 2023-07-09T02:13:42.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.655+0000 7f1ba0ff9640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b900662b0 0x7f1b90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.655+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/2499390126 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b9c084570 con 0x7f1ba415c060 2023-07-09T02:13:42.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.655+0000 7f1ba3fff640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b900662b0 0x7f1b90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.655+0000 7f1ba3fff640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b900662b0 0x7f1b90068760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b940ad000 tx=0x7f1b940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:42.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.659+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/2499390126 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b9c051aa0 con 0x7f1ba415c060 2023-07-09T02:13:42.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ba406a1d0 con 0x7f1ba415c060 2023-07-09T02:13:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1ba0ff9640 1 -- 172.21.15.45:0/2499390126 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f1b9c0550c0 con 0x7f1ba415c060 2023-07-09T02:13:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:42.823 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:41.846418+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:13:39.573636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T02:13:40.849108+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:42.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b900662b0 msgr2=0x7f1b90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b900662b0 0x7f1b90068760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b940ad000 tx=0x7f1b940a6000 comp rx=0 tx=0).stop 2023-07-09T02:13:42.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 msgr2=0x7f1ba4151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba4151ef0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c007e40 tx=0x7f1b9c00e4b0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 shutdown_connections 2023-07-09T02:13:42.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba415c060 0x7f1ba4151ef0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ba40d2450 0x7f1ba40cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b900662b0 0x7f1b90068760 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 --2- 172.21.15.45:0/2499390126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ba40cd120 0x7f1ba40cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 >> 172.21.15.45:0/2499390126 conn(0x7f1ba40698e0 msgr2=0x7f1ba40b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:42.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 shutdown_connections 2023-07-09T02:13:42.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.819+0000 7f1baa3ac640 1 -- 172.21.15.45:0/2499390126 wait complete. 2023-07-09T02:13:42.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:42.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.983+0000 7fa412959640 1 Processor -- start 2023-07-09T02:13:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.983+0000 7fa412959640 1 -- start start 2023-07-09T02:13:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.983+0000 7fa412959640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa40c0d2620 0x7fa40c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa412959640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c160a50 con 0x7fa40c0cd120 2023-07-09T02:13:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa412959640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c15c430 con 0x7fa40c15c060 2023-07-09T02:13:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa412959640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c15fb60 con 0x7fa40c0d2620 2023-07-09T02:13:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa40b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa40c0d2620 0x7fa40c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa410ef6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa40c0cd120 0x7fa40c0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39110/0 (socket says 172.21.15.45:39110) 2023-07-09T02:13:42.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa410ef6640 1 -- 172.21.15.45:0/817663973 learned_addr learned my addr 172.21.15.45:0/817663973 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:42.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa40b7fe640 1 -- 172.21.15.45:0/817663973 >> v1:172.21.15.155:6789/0 conn(0x7fa40c15c060 legacy=0x7fa40c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa40b7fe640 1 -- 172.21.15.45:0/817663973 >> v1:172.21.15.45:6789/0 conn(0x7fa40c0cd120 legacy=0x7fa40c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa40b7fe640 1 -- 172.21.15.45:0/817663973 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c15fe40 con 0x7fa40c0d2620 2023-07-09T02:13:42.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa40affd640 1 -- 172.21.15.45:0/817663973 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786002697 0 0) 0x7fa40c160a50 con 0x7fa40c0cd120 2023-07-09T02:13:42.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.987+0000 7fa40b7fe640 1 --2- 172.21.15.45:0/817663973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c0d2620 0x7fa40c0b4ed0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa4000097c0 tx=0x7fa40001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b7d8d6bd1e7e41 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:42.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa40affd640 1 -- 172.21.15.45:0/817663973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000ab650 con 0x7fa40c0d2620 2023-07-09T02:13:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa40affd640 1 -- 172.21.15.45:0/817663973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4000ab7b0 con 0x7fa40c0d2620 2023-07-09T02:13:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa40affd640 1 -- 172.21.15.45:0/817663973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000abb40 con 0x7fa40c0d2620 2023-07-09T02:13:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- 172.21.15.45:0/817663973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c0d2620 msgr2=0x7fa40c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 --2- 172.21.15.45:0/817663973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c0d2620 0x7fa40c0b4ed0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa4000097c0 tx=0x7fa40001c450 comp rx=0 tx=0).stop 2023-07-09T02:13:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- 172.21.15.45:0/817663973 shutdown_connections 2023-07-09T02:13:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 --2- 172.21.15.45:0/817663973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c0d2620 0x7fa40c0b4ed0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- 172.21.15.45:0/817663973 >> 172.21.15.45:0/817663973 conn(0x7fa40c0698e0 msgr2=0x7fa40c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:42.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- 172.21.15.45:0/817663973 shutdown_connections 2023-07-09T02:13:42.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- 172.21.15.45:0/817663973 wait complete. 2023-07-09T02:13:42.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 Processor -- start 2023-07-09T02:13:42.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- start start 2023-07-09T02:13:42.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40c0cd120 0x7fa40c14ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40c0d2620 0x7fa40c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c15c060 0x7fa40c0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:42.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c15b8b0 con 0x7fa40c15c060 2023-07-09T02:13:42.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c148cd0 con 0x7fa40c0d2620 2023-07-09T02:13:42.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa412959640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c14bb40 con 0x7fa40c0cd120 2023-07-09T02:13:42.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa410ef6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c15c060 0x7fa40c0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa410ef6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c15c060 0x7fa40c0cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33748/0 (socket says 172.21.15.45:33748) 2023-07-09T02:13:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.991+0000 7fa410ef6640 1 -- 172.21.15.45:0/2646352734 learned_addr learned my addr 172.21.15.45:0/2646352734 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa40bfff640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40c0cd120 0x7fa40c14ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa40b7fe640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40c0d2620 0x7fa40c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa410ef6640 1 -- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40c0cd120 msgr2=0x7fa40c14ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa410ef6640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40c0cd120 0x7fa40c14ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa410ef6640 1 -- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40c0d2620 msgr2=0x7fa40c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa410ef6640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40c0d2620 0x7fa40c15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa410ef6640 1 -- 172.21.15.45:0/2646352734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400009420 con 0x7fa40c15c060 2023-07-09T02:13:42.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa410ef6640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c15c060 0x7fa40c0cc150 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c7a0 tx=0x7fa40400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa408ff9640 1 -- 172.21.15.45:0/2646352734 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400a640 con 0x7fa40c15c060 2023-07-09T02:13:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa408ff9640 1 -- 172.21.15.45:0/2646352734 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400a7a0 con 0x7fa40c15c060 2023-07-09T02:13:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c0b59f0 con 0x7fa40c15c060 2023-07-09T02:13:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa408ff9640 1 -- 172.21.15.45:0/2646352734 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400abd0 con 0x7fa40c15c060 2023-07-09T02:13:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c14b580 con 0x7fa40c15c060 2023-07-09T02:13:43.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c148e60 con 0x7fa40c15c060 2023-07-09T02:13:43.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa408ff9640 1 -- 172.21.15.45:0/2646352734 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa40400ad30 con 0x7fa40c15c060 2023-07-09T02:13:43.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.995+0000 7fa408ff9640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3f80662b0 0x7fa3f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:43.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.999+0000 7fa408ff9640 1 -- 172.21.15.45:0/2646352734 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa404083060 con 0x7fa40c15c060 2023-07-09T02:13:43.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.999+0000 7fa40bfff640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3f80662b0 0x7fa3f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:43.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.999+0000 7fa40bfff640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3f80662b0 0x7fa3f8068760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc007fd0 tx=0x7fa3fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:43.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:42.999+0000 7fa408ff9640 1 -- 172.21.15.45:0/2646352734 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa404050600 con 0x7fa40c15c060 2023-07-09T02:13:43.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.155+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa40c04d7d0 con 0x7fa40c15c060 2023-07-09T02:13:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa408ff9640 1 -- 172.21.15.45:0/2646352734 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18306 (secure 0 0 0) 0x7fa404053c20 con 0x7fa40c15c060 2023-07-09T02:13:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:43.162 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:41.846418+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:13:39.573636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T02:13:40.849108+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3f80662b0 msgr2=0x7fa3f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3f80662b0 0x7fa3f8068760 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc007fd0 tx=0x7fa3fc009040 comp rx=0 tx=0).stop 2023-07-09T02:13:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c15c060 msgr2=0x7fa40c0cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c15c060 0x7fa40c0cc150 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c7a0 tx=0x7fa40400cc60 comp rx=0 tx=0).stop 2023-07-09T02:13:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 shutdown_connections 2023-07-09T02:13:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40c15c060 0x7fa40c0cc150 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40c0d2620 0x7fa40c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3f80662b0 0x7fa3f8068760 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 --2- 172.21.15.45:0/2646352734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40c0cd120 0x7fa40c14ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 >> 172.21.15.45:0/2646352734 conn(0x7fa40c0698e0 msgr2=0x7fa40c0d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 shutdown_connections 2023-07-09T02:13:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.159+0000 7fa412959640 1 -- 172.21.15.45:0/2646352734 wait complete. 2023-07-09T02:13:43.182 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:13:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52f27d2640 1 Processor -- start 2023-07-09T02:13:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52f27d2640 1 -- start start 2023-07-09T02:13:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52f27d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52ec0d2620 0x7f52ec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52f27d2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec160a50 con 0x7f52ec0cd120 2023-07-09T02:13:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52f27d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec15c430 con 0x7f52ec15c060 2023-07-09T02:13:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52f27d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec15fb60 con 0x7f52ec0d2620 2023-07-09T02:13:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52e3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52ec0d2620 0x7f52ec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52f0d6f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52ec0cd120 0x7f52ec0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39112/0 (socket says 172.21.15.45:39112) 2023-07-09T02:13:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52f0d6f640 1 -- 172.21.15.45:0/1746988032 learned_addr learned my addr 172.21.15.45:0/1746988032 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52e3fff640 1 -- 172.21.15.45:0/1746988032 >> v1:172.21.15.155:6789/0 conn(0x7f52ec15c060 legacy=0x7f52ec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52e3fff640 1 -- 172.21.15.45:0/1746988032 >> v1:172.21.15.45:6789/0 conn(0x7f52ec0cd120 legacy=0x7f52ec0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52e3fff640 1 -- 172.21.15.45:0/1746988032 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec15fe40 con 0x7f52ec0d2620 2023-07-09T02:13:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.327+0000 7f52eb7fe640 1 -- 172.21.15.45:0/1746988032 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426224528 0 0) 0x7f52ec15c430 con 0x7f52ec15c060 2023-07-09T02:13:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52e3fff640 1 --2- 172.21.15.45:0/1746988032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0d2620 0x7f52ec0b4ed0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f52d40097c0 tx=0x7f52d401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffefa80f9e637d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52eb7fe640 1 -- 172.21.15.45:0/1746988032 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d40ab600 con 0x7f52ec0d2620 2023-07-09T02:13:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52eb7fe640 1 -- 172.21.15.45:0/1746988032 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d40a7050 con 0x7f52ec0d2620 2023-07-09T02:13:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52eb7fe640 1 -- 172.21.15.45:0/1746988032 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d40ab980 con 0x7f52ec0d2620 2023-07-09T02:13:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52f27d2640 1 -- 172.21.15.45:0/1746988032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0d2620 msgr2=0x7f52ec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52f27d2640 1 --2- 172.21.15.45:0/1746988032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0d2620 0x7f52ec0b4ed0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f52d40097c0 tx=0x7f52d401c310 comp rx=0 tx=0).stop 2023-07-09T02:13:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52f27d2640 1 -- 172.21.15.45:0/1746988032 shutdown_connections 2023-07-09T02:13:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52f27d2640 1 --2- 172.21.15.45:0/1746988032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0d2620 0x7f52ec0b4ed0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52f27d2640 1 -- 172.21.15.45:0/1746988032 >> 172.21.15.45:0/1746988032 conn(0x7f52ec0698e0 msgr2=0x7f52ec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52f27d2640 1 -- 172.21.15.45:0/1746988032 shutdown_connections 2023-07-09T02:13:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52f27d2640 1 -- 172.21.15.45:0/1746988032 wait complete. 2023-07-09T02:13:43.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.331+0000 7f52f27d2640 1 Processor -- start 2023-07-09T02:13:43.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 -- start start 2023-07-09T02:13:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52ec0cd120 0x7f52ec15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52ec0d2620 0x7f52ec156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c060 0x7f52ec1f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec157f10 con 0x7f52ec15c060 2023-07-09T02:13:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec15ab70 con 0x7f52ec0cd120 2023-07-09T02:13:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1f5c60 con 0x7f52ec0d2620 2023-07-09T02:13:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c060 0x7f52ec1f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c060 0x7f52ec1f4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33776/0 (socket says 172.21.15.45:33776) 2023-07-09T02:13:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 -- 172.21.15.45:0/3127052281 learned_addr learned my addr 172.21.15.45:0/3127052281 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:43.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52ebfff640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52ec0cd120 0x7f52ec15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52e3fff640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52ec0d2620 0x7f52ec156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 -- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52ec0d2620 msgr2=0x7f52ec156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52ec0d2620 0x7f52ec156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 -- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52ec0cd120 msgr2=0x7f52ec15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52ec0cd120 0x7f52ec15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 -- 172.21.15.45:0/3127052281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d4009420 con 0x7f52ec15c060 2023-07-09T02:13:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52e3fff640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52ec0d2620 0x7f52ec156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:43.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f0d6f640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c060 0x7f52ec1f4d80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f52e400e580 tx=0x7f52e400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:43.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52e97fa640 1 -- 172.21.15.45:0/3127052281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4012870 con 0x7f52ec15c060 2023-07-09T02:13:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52e97fa640 1 -- 172.21.15.45:0/3127052281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e40129d0 con 0x7f52ec15c060 2023-07-09T02:13:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec157970 con 0x7f52ec15c060 2023-07-09T02:13:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52e97fa640 1 -- 172.21.15.45:0/3127052281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4012d60 con 0x7f52ec15c060 2023-07-09T02:13:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec157290 con 0x7f52ec15c060 2023-07-09T02:13:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.335+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec0d05f0 con 0x7f52ec15c060 2023-07-09T02:13:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.339+0000 7f52e97fa640 1 -- 172.21.15.45:0/3127052281 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52e401c460 con 0x7f52ec15c060 2023-07-09T02:13:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.339+0000 7f52e97fa640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52cc066280 0x7f52cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:43.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.339+0000 7f52e97fa640 1 -- 172.21.15.45:0/3127052281 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52e4086d10 con 0x7f52ec15c060 2023-07-09T02:13:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.339+0000 7f52ebfff640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52cc066280 0x7f52cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:43.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.339+0000 7f52ebfff640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52cc066280 0x7f52cc068730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f52dc000f70 tx=0x7f52dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:43.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.343+0000 7f52e97fa640 1 -- 172.21.15.45:0/3127052281 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52ec0d05f0 con 0x7f52ec15c060 2023-07-09T02:13:43.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:43.535+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f52ec0d05f0 con 0x7f52ec15c060 2023-07-09T02:13:44.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.487+0000 7f52e97fa640 1 -- 172.21.15.45:0/3127052281 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f52ec0d05f0 con 0x7f52ec15c060 2023-07-09T02:13:44.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52cc066280 msgr2=0x7f52cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:44.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52cc066280 0x7f52cc068730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f52dc000f70 tx=0x7f52dc009040 comp rx=0 tx=0).stop 2023-07-09T02:13:44.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c060 msgr2=0x7f52ec1f4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:44.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c060 0x7f52ec1f4d80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f52e400e580 tx=0x7f52e400ea40 comp rx=0 tx=0).stop 2023-07-09T02:13:44.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 shutdown_connections 2023-07-09T02:13:44.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c060 0x7f52ec1f4d80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52cc066280 0x7f52cc068730 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52ec0d2620 0x7f52ec156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 --2- 172.21.15.45:0/3127052281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52ec0cd120 0x7f52ec15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 >> 172.21.15.45:0/3127052281 conn(0x7f52ec0698e0 msgr2=0x7f52ec0b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 shutdown_connections 2023-07-09T02:13:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.491+0000 7f52f27d2640 1 -- 172.21.15.45:0/3127052281 wait complete. 2023-07-09T02:13:44.518 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:13:44.518 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:13:44.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48c89db640 1 Processor -- start 2023-07-09T02:13:44.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48c89db640 1 -- start start 2023-07-09T02:13:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48c89db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48c415c060 0x7f48c40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:44.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48c89db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48c40cd120 0x7f48c40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:44.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48c89db640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c4160a50 con 0x7f48c40d2450 2023-07-09T02:13:44.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48c89db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40d28d0 con 0x7f48c40cd120 2023-07-09T02:13:44.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48c89db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40cfe40 con 0x7f48c415c060 2023-07-09T02:13:44.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48bbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48c40cd120 0x7f48c40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:44.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48bbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48c40cd120 0x7f48c40d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33788/0 (socket says 172.21.15.45:33788) 2023-07-09T02:13:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.667+0000 7f48bbfff640 1 -- 172.21.15.45:0/401550825 learned_addr learned my addr 172.21.15.45:0/401550825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48c259c640 1 --2- 172.21.15.45:0/401550825 >> v2:172.21.15.155:3300/0 conn(0x7f48c415c060 0x7f48c40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48bbfff640 1 -- 172.21.15.45:0/401550825 >> v2:172.21.15.155:3300/0 conn(0x7f48c415c060 msgr2=0x7f48c40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48bbfff640 1 --2- 172.21.15.45:0/401550825 >> v2:172.21.15.155:3300/0 conn(0x7f48c415c060 0x7f48c40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48bbfff640 1 -- 172.21.15.45:0/401550825 >> v1:172.21.15.155:6789/0 conn(0x7f48c40d2450 legacy=0x7f48c40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:44.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48bbfff640 1 -- 172.21.15.45:0/401550825 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c415c430 con 0x7f48c40cd120 2023-07-09T02:13:44.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48c259c640 1 --2- 172.21.15.45:0/401550825 >> v2:172.21.15.155:3300/0 conn(0x7f48c415c060 0x7f48c40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:44.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48bbfff640 1 --2- 172.21.15.45:0/401550825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40cd120 0x7f48c40d1f10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f48c40d3ad0 tx=0x7f48ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c334e8e4808b3ce server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48c1d9b640 1 -- 172.21.15.45:0/401550825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0ab5f0 con 0x7f48c40cd120 2023-07-09T02:13:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48c1d9b640 1 -- 172.21.15.45:0/401550825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac0ab750 con 0x7f48c40cd120 2023-07-09T02:13:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.671+0000 7f48c1d9b640 1 -- 172.21.15.45:0/401550825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0abae0 con 0x7f48c40cd120 2023-07-09T02:13:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- 172.21.15.45:0/401550825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40cd120 msgr2=0x7f48c40d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 --2- 172.21.15.45:0/401550825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40cd120 0x7f48c40d1f10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f48c40d3ad0 tx=0x7f48ac01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- 172.21.15.45:0/401550825 shutdown_connections 2023-07-09T02:13:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 --2- 172.21.15.45:0/401550825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40cd120 0x7f48c40d1f10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 --2- 172.21.15.45:0/401550825 >> v2:172.21.15.155:3300/0 conn(0x7f48c415c060 0x7f48c40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- 172.21.15.45:0/401550825 >> 172.21.15.45:0/401550825 conn(0x7f48c40698e0 msgr2=0x7f48c4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- 172.21.15.45:0/401550825 shutdown_connections 2023-07-09T02:13:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- 172.21.15.45:0/401550825 wait complete. 2023-07-09T02:13:44.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 Processor -- start 2023-07-09T02:13:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- start start 2023-07-09T02:13:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48c40cd120 0x7f48c40b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40d2450 0x7f48c41534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c415c060 0x7f48c40cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40cb4a0 con 0x7f48c40d2450 2023-07-09T02:13:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c41539f0 con 0x7f48c415c060 2023-07-09T02:13:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c89db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40cbe70 con 0x7f48c40cd120 2023-07-09T02:13:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40d2450 0x7f48c41534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40d2450 0x7f48c41534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33804/0 (socket says 172.21.15.45:33804) 2023-07-09T02:13:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48bbfff640 1 -- 172.21.15.45:0/1982840155 learned_addr learned my addr 172.21.15.45:0/1982840155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c2d9d640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c415c060 0x7f48c40cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c259c640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48c40cd120 0x7f48c40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48bbfff640 1 -- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48c40cd120 msgr2=0x7f48c40b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48bbfff640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48c40cd120 0x7f48c40b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48bbfff640 1 -- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c415c060 msgr2=0x7f48c40cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48bbfff640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c415c060 0x7f48c40cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48bbfff640 1 -- 172.21.15.45:0/1982840155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac0094d0 con 0x7f48c40d2450 2023-07-09T02:13:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c2d9d640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c415c060 0x7f48c40cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.675+0000 7f48c259c640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48c40cd120 0x7f48c40b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48bbfff640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40d2450 0x7f48c41534b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0190e0 tx=0x7f48ac01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48baffd640 1 -- 172.21.15.45:0/1982840155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0b4800 con 0x7f48c40d2450 2023-07-09T02:13:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48baffd640 1 -- 172.21.15.45:0/1982840155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac0b4960 con 0x7f48c40d2450 2023-07-09T02:13:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48baffd640 1 -- 172.21.15.45:0/1982840155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0b4cf0 con 0x7f48c40d2450 2023-07-09T02:13:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c40ca890 con 0x7f48c40d2450 2023-07-09T02:13:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c40cae50 con 0x7f48c40d2450 2023-07-09T02:13:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c40cb610 con 0x7f48c40d2450 2023-07-09T02:13:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48baffd640 1 -- 172.21.15.45:0/1982840155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48ac0b3380 con 0x7f48c40d2450 2023-07-09T02:13:44.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48baffd640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48a4066280 0x7f48a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:44.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48baffd640 1 -- 172.21.15.45:0/1982840155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48ac0a8050 con 0x7f48c40d2450 2023-07-09T02:13:44.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.679+0000 7f48c259c640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48a4066280 0x7f48a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:44.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.683+0000 7f48c259c640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48a4066280 0x7f48a4068730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f48b40097a0 tx=0x7f48b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:44.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.683+0000 7f48baffd640 1 -- 172.21.15.45:0/1982840155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48ac0eb6b0 con 0x7f48c40d2450 2023-07-09T02:13:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:44.871+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f48c404d7d0 con 0x7f48c40d2450 2023-07-09T02:13:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48baffd640 1 -- 172.21.15.45:0/1982840155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f48ac0c40c0 con 0x7f48c40d2450 2023-07-09T02:13:45.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48a4066280 msgr2=0x7f48a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48a4066280 0x7f48a4068730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f48b40097a0 tx=0x7f48b4008040 comp rx=0 tx=0).stop 2023-07-09T02:13:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40d2450 msgr2=0x7f48c41534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40d2450 0x7f48c41534b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0190e0 tx=0x7f48ac01ad10 comp rx=0 tx=0).stop 2023-07-09T02:13:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 shutdown_connections 2023-07-09T02:13:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48c415c060 0x7f48c40cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48c40d2450 0x7f48c41534b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f48a4066280 0x7f48a4068730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 --2- 172.21.15.45:0/1982840155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48c40cd120 0x7f48c40b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 >> 172.21.15.45:0/1982840155 conn(0x7f48c40698e0 msgr2=0x7f48c40b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:45.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.491+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 shutdown_connections 2023-07-09T02:13:45.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.495+0000 7f48c89db640 1 -- 172.21.15.45:0/1982840155 wait complete. 2023-07-09T02:13:45.519 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:13:45.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f30004ec640 1 Processor -- start 2023-07-09T02:13:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f30004ec640 1 -- start start 2023-07-09T02:13:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f30004ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2ff815c060 0x7f2ff80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f30004ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff8160a50 con 0x7f2ff80d2620 2023-07-09T02:13:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f30004ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff815c430 con 0x7f2ff80cd120 2023-07-09T02:13:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f30004ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff815fb60 con 0x7f2ff815c060 2023-07-09T02:13:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffea89640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2ff80d2620 0x7f2ff80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39124/0 (socket says 172.21.15.45:39124) 2023-07-09T02:13:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffea89640 1 -- 172.21.15.45:0/826816318 learned_addr learned my addr 172.21.15.45:0/826816318 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffe288640 1 --2- 172.21.15.45:0/826816318 >> v2:172.21.15.155:3300/0 conn(0x7f2ff815c060 0x7f2ff80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898444710 0 0) 0x7f2ff8160a50 con 0x7f2ff80d2620 2023-07-09T02:13:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe4003530 con 0x7f2ff80d2620 2023-07-09T02:13:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1541732074 0 0) 0x7f2fe4003530 con 0x7f2ff80d2620 2023-07-09T02:13:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 >> v2:172.21.15.155:3300/0 conn(0x7f2ff815c060 msgr2=0x7f2ff80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 --2- 172.21.15.45:0/826816318 >> v2:172.21.15.155:3300/0 conn(0x7f2ff815c060 0x7f2ff80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 >> v1:172.21.15.155:6789/0 conn(0x7f2ff80cd120 legacy=0x7f2ff80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff815fe40 con 0x7f2ff80d2620 2023-07-09T02:13:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f2ff0001a00 con 0x7f2ff80d2620 2023-07-09T02:13:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 >> v1:172.21.15.45:6789/0 conn(0x7f2ff80d2620 legacy=0x7f2ff80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fe4003980 0x7f2fe4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2fe4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fe4005030 0x7f2fe400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff815fb60 con 0x7f2fe4004370 2023-07-09T02:13:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe400bf80 con 0x7f2fe4005030 2023-07-09T02:13:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe400c140 con 0x7f2fe4003980 2023-07-09T02:13:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffda87640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2fe4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffe288640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fe4003980 0x7f2fe4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffea89640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fe4005030 0x7f2fe400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffda87640 1 -- 172.21.15.45:0/826816318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fe4003980 msgr2=0x7f2fe4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffda87640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fe4003980 0x7f2fe4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffda87640 1 -- 172.21.15.45:0/826816318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fe4005030 msgr2=0x7f2fe400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffda87640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fe4005030 0x7f2fe400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffda87640 1 -- 172.21.15.45:0/826816318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4003530 con 0x7f2fe4004370 2023-07-09T02:13:45.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.663+0000 7f2ffea89640 1 -- 172.21.15.45:0/826816318 reap_dead start 2023-07-09T02:13:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f2ffda87640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2fe4004830 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80cd570 tx=0x7f2fe801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab50f8a7f4b0ca4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80ab600 con 0x7f2fe4004370 2023-07-09T02:13:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe80a7050 con 0x7f2fe4004370 2023-07-09T02:13:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f2ffd286640 1 -- 172.21.15.45:0/826816318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80ab9e0 con 0x7f2fe4004370 2023-07-09T02:13:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f30004ec640 1 -- 172.21.15.45:0/826816318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 msgr2=0x7f2fe4004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f30004ec640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2fe4004830 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80cd570 tx=0x7f2fe801c450 comp rx=0 tx=0).stop 2023-07-09T02:13:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f30004ec640 1 -- 172.21.15.45:0/826816318 shutdown_connections 2023-07-09T02:13:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f30004ec640 1 --2- 172.21.15.45:0/826816318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2fe4004830 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f30004ec640 1 -- 172.21.15.45:0/826816318 >> 172.21.15.45:0/826816318 conn(0x7f2ff80698e0 msgr2=0x7f2ff8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f30004ec640 1 -- 172.21.15.45:0/826816318 shutdown_connections 2023-07-09T02:13:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.667+0000 7f30004ec640 1 -- 172.21.15.45:0/826816318 wait complete. 2023-07-09T02:13:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 Processor -- start 2023-07-09T02:13:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 -- start start 2023-07-09T02:13:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2ff81f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff815ed70 0x7f2ff80cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff8157ed0 0x7f2ff80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff815e080 con 0x7f2fe4004370 2023-07-09T02:13:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff815e8e0 con 0x7f2ff815ed70 2023-07-09T02:13:45.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80cbaf0 con 0x7f2ff8157ed0 2023-07-09T02:13:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2ff81f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2ff81f8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33812/0 (socket says 172.21.15.45:33812) 2023-07-09T02:13:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 -- 172.21.15.45:0/2248077167 learned_addr learned my addr 172.21.15.45:0/2248077167 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffea89640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff8157ed0 0x7f2ff80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffda87640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff815ed70 0x7f2ff80cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 -- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff8157ed0 msgr2=0x7f2ff80cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff8157ed0 0x7f2ff80cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 -- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff815ed70 msgr2=0x7f2ff80cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff815ed70 0x7f2ff80cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 -- 172.21.15.45:0/2248077167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff815e290 con 0x7f2fe4004370 2023-07-09T02:13:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffea89640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff8157ed0 0x7f2ff80cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2ffe288640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2ff81f8c30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4011900 tx=0x7f2ff40119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2feeffd640 1 -- 172.21.15.45:0/2248077167 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004240 con 0x7f2fe4004370 2023-07-09T02:13:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2feeffd640 1 -- 172.21.15.45:0/2248077167 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff40043a0 con 0x7f2fe4004370 2023-07-09T02:13:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f2feeffd640 1 -- 172.21.15.45:0/2248077167 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4003860 con 0x7f2fe4004370 2023-07-09T02:13:45.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff815e570 con 0x7f2fe4004370 2023-07-09T02:13:45.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.671+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff80ca270 con 0x7f2fe4004370 2023-07-09T02:13:45.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.675+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff804d7d0 con 0x7f2fe4004370 2023-07-09T02:13:45.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.675+0000 7f2feeffd640 1 -- 172.21.15.45:0/2248077167 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ff40039c0 con 0x7f2fe4004370 2023-07-09T02:13:45.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.675+0000 7f2feeffd640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2fdc0662b0 0x7f2fdc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:45.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.675+0000 7f2feeffd640 1 -- 172.21.15.45:0/2248077167 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ff4083fc0 con 0x7f2fe4004370 2023-07-09T02:13:45.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.675+0000 7f2ffda87640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2fdc0662b0 0x7f2fdc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:45.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.679+0000 7f2ffda87640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2fdc0662b0 0x7f2fdc068760 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80ad000 tx=0x7f2fe80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:45.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.679+0000 7f2feeffd640 1 -- 172.21.15.45:0/2248077167 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ff4051450 con 0x7f2fe4004370 2023-07-09T02:13:45.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ff806baa0 con 0x7f2fe4004370 2023-07-09T02:13:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f2feeffd640 1 -- 172.21.15.45:0/2248077167 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f2ff4023090 con 0x7f2fe4004370 2023-07-09T02:13:45.875 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2676442896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2676442896},{"type":"v1","addr":"172.21.15.155:6837","nonce":2676442896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/193698688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":193698688},{"type":"v1","addr":"172.21.15.155:6836","nonce":193698688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1939767585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1939767585},{"type":"v1","addr":"172.21.15.45:6834","nonce":1939767585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:13:41.846779+0000","modified":"2023-07-09T02:13:45.491078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6096":{"gid":6096,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3771949487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3771949487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3771949487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T02:13:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 34 2023-07-09T02:13:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2fdc0662b0 msgr2=0x7f2fdc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2fdc0662b0 0x7f2fdc068760 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80ad000 tx=0x7f2fe80a6000 comp rx=0 tx=0).stop 2023-07-09T02:13:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 msgr2=0x7f2ff81f8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2ff81f8c30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4011900 tx=0x7f2ff40119f0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 shutdown_connections 2023-07-09T02:13:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2fdc0662b0 0x7f2fdc068760 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ff8157ed0 0x7f2ff80cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ff815ed70 0x7f2ff80cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 --2- 172.21.15.45:0/2248077167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fe4004370 0x7f2ff81f8c30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 >> 172.21.15.45:0/2248077167 conn(0x7f2ff80698e0 msgr2=0x7f2ff80b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 shutdown_connections 2023-07-09T02:13:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:45.871+0000 7f30004ec640 1 -- 172.21.15.45:0/2248077167 wait complete. 2023-07-09T02:13:45.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:13:46.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5afc56640 1 Processor -- start 2023-07-09T02:13:46.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5afc56640 1 -- start start 2023-07-09T02:13:46.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5afc56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5a815c060 0x7fd5a80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5afc56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd5a80d2620 0x7fd5a80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5afc56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a8160a50 con 0x7fd5a80cd120 2023-07-09T02:13:46.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5afc56640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a815c430 con 0x7fd5a815c060 2023-07-09T02:13:46.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5afc56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a815fb60 con 0x7fd5a80d2620 2023-07-09T02:13:46.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5ad9f2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5a815c060 0x7fd5a80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5ad9f2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5a815c060 0x7fd5a80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33814/0 (socket says 172.21.15.45:33814) 2023-07-09T02:13:46.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5ad9f2640 1 -- 172.21.15.45:0/196486452 learned_addr learned my addr 172.21.15.45:0/196486452 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:46.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5ae1f3640 1 --2- 172.21.15.45:0/196486452 >> v2:172.21.15.155:3300/0 conn(0x7fd5a80d2620 0x7fd5a80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5ad9f2640 1 -- 172.21.15.45:0/196486452 >> v2:172.21.15.155:3300/0 conn(0x7fd5a80d2620 msgr2=0x7fd5a80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:46.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5ad9f2640 1 --2- 172.21.15.45:0/196486452 >> v2:172.21.15.155:3300/0 conn(0x7fd5a80d2620 0x7fd5a80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5ad9f2640 1 -- 172.21.15.45:0/196486452 >> v1:172.21.15.155:6789/0 conn(0x7fd5a80cd120 legacy=0x7fd5a80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:46.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.039+0000 7fd5ad9f2640 1 -- 172.21.15.45:0/196486452 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a815fe40 con 0x7fd5a815c060 2023-07-09T02:13:46.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5ad9f2640 1 --2- 172.21.15.45:0/196486452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a815c060 0x7fd5a80b4ed0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd5a808bca0 tx=0x7fd5a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08fa0c3e8cc3b7d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5ac9f0640 1 -- 172.21.15.45:0/196486452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40aa5f0 con 0x7fd5a815c060 2023-07-09T02:13:46.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5ac9f0640 1 -- 172.21.15.45:0/196486452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a40aa750 con 0x7fd5a815c060 2023-07-09T02:13:46.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5ac9f0640 1 -- 172.21.15.45:0/196486452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40aaae0 con 0x7fd5a815c060 2023-07-09T02:13:46.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5afc56640 1 -- 172.21.15.45:0/196486452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a815c060 msgr2=0x7fd5a80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5afc56640 1 --2- 172.21.15.45:0/196486452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a815c060 0x7fd5a80b4ed0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd5a808bca0 tx=0x7fd5a401c490 comp rx=0 tx=0).stop 2023-07-09T02:13:46.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5afc56640 1 -- 172.21.15.45:0/196486452 shutdown_connections 2023-07-09T02:13:46.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5afc56640 1 --2- 172.21.15.45:0/196486452 >> v2:172.21.15.155:3300/0 conn(0x7fd5a80d2620 0x7fd5a80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5afc56640 1 --2- 172.21.15.45:0/196486452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a815c060 0x7fd5a80b4ed0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5afc56640 1 -- 172.21.15.45:0/196486452 >> 172.21.15.45:0/196486452 conn(0x7fd5a80698e0 msgr2=0x7fd5a8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:46.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5afc56640 1 -- 172.21.15.45:0/196486452 shutdown_connections 2023-07-09T02:13:46.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.043+0000 7fd5afc56640 1 -- 172.21.15.45:0/196486452 wait complete. 2023-07-09T02:13:46.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 Processor -- start 2023-07-09T02:13:46.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 -- start start 2023-07-09T02:13:46.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a80cd120 0x7fd5a80b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a80d2620 0x7fd5a813e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a815c060 0x7fd5a80c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a815a190 con 0x7fd5a80cd120 2023-07-09T02:13:46.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8159db0 con 0x7fd5a80d2620 2023-07-09T02:13:46.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a815a3e0 con 0x7fd5a815c060 2023-07-09T02:13:46.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a80cd120 0x7fd5a80b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a80cd120 0x7fd5a80b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33816/0 (socket says 172.21.15.45:33816) 2023-07-09T02:13:46.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 -- 172.21.15.45:0/771393935 learned_addr learned my addr 172.21.15.45:0/771393935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:46.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad1f1640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a80d2620 0x7fd5a813e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ae1f3640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a815c060 0x7fd5a80c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 -- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a815c060 msgr2=0x7fd5a80c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a815c060 0x7fd5a80c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 -- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a80d2620 msgr2=0x7fd5a813e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a80d2620 0x7fd5a813e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 -- 172.21.15.45:0/771393935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a40094d0 con 0x7fd5a80cd120 2023-07-09T02:13:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ae1f3640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a815c060 0x7fd5a80c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:46.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5ad9f2640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a80cd120 0x7fd5a80b2b90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd5a401a0c0 tx=0x7fd5a401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd59e7fc640 1 -- 172.21.15.45:0/771393935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40b3800 con 0x7fd5a80cd120 2023-07-09T02:13:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd59e7fc640 1 -- 172.21.15.45:0/771393935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a40b3980 con 0x7fd5a80cd120 2023-07-09T02:13:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd59e7fc640 1 -- 172.21.15.45:0/771393935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40b3d30 con 0x7fd5a80cd120 2023-07-09T02:13:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a80b59f0 con 0x7fd5a80cd120 2023-07-09T02:13:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a815a9a0 con 0x7fd5a80cd120 2023-07-09T02:13:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.047+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a815ab90 con 0x7fd5a80cd120 2023-07-09T02:13:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.051+0000 7fd59e7fc640 1 -- 172.21.15.45:0/771393935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5a40b2380 con 0x7fd5a80cd120 2023-07-09T02:13:46.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.051+0000 7fd59e7fc640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd58c0662b0 0x7fd58c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.051+0000 7fd59e7fc640 1 -- 172.21.15.45:0/771393935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5a40a7070 con 0x7fd5a80cd120 2023-07-09T02:13:46.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.051+0000 7fd5ad1f1640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd58c0662b0 0x7fd58c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.051+0000 7fd5ad1f1640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd58c0662b0 0x7fd58c068760 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80c96d0 tx=0x7fd598007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.055+0000 7fd59e7fc640 1 -- 172.21.15.45:0/771393935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5a40eb6a0 con 0x7fd5a80cd120 2023-07-09T02:13:46.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.207+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5a804d7d0 con 0x7fd5a80cd120 2023-07-09T02:13:46.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd59e7fc640 1 -- 172.21.15.45:0/771393935 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18293 (secure 0 0 0) 0x7fd5a40eecc0 con 0x7fd5a80cd120 2023-07-09T02:13:46.214 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:46.214 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":68,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:13:43.455992+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:13:39.573636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T02:13:40.849108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:13:46.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd58c0662b0 msgr2=0x7fd58c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd58c0662b0 0x7fd58c068760 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80c96d0 tx=0x7fd598007e40 comp rx=0 tx=0).stop 2023-07-09T02:13:46.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a80cd120 msgr2=0x7fd5a80b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a80cd120 0x7fd5a80b2b90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd5a401a0c0 tx=0x7fd5a401acd0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 shutdown_connections 2023-07-09T02:13:46.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd58c0662b0 0x7fd58c068760 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5a815c060 0x7fd5a80c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5a80d2620 0x7fd5a813e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 --2- 172.21.15.45:0/771393935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a80cd120 0x7fd5a80b2b90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 >> 172.21.15.45:0/771393935 conn(0x7fd5a80698e0 msgr2=0x7fd5a80b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:46.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 shutdown_connections 2023-07-09T02:13:46.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.211+0000 7fd5afc56640 1 -- 172.21.15.45:0/771393935 wait complete. 2023-07-09T02:13:46.235 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:13:46.235 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:13:46.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab61f9f640 1 Processor -- start 2023-07-09T02:13:46.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab61f9f640 1 -- start start 2023-07-09T02:13:46.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab61f9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c15c060 0x7fab5c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab61f9f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab5c0cd120 0x7fab5c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab61f9f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c160a50 con 0x7fab5c0d2450 2023-07-09T02:13:46.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab61f9f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c0d28f0 con 0x7fab5c0cd120 2023-07-09T02:13:46.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab61f9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0cfe40 con 0x7fab5c15c060 2023-07-09T02:13:46.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab5affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab5c0cd120 0x7fab5c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab5bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fab5c0d2450 0x7fab5c0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39132/0 (socket says 172.21.15.45:39132) 2023-07-09T02:13:46.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab5bfff640 1 -- 172.21.15.45:0/4119318638 learned_addr learned my addr 172.21.15.45:0/4119318638 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:46.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab5b7fe640 1 --2- 172.21.15.45:0/4119318638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c15c060 0x7fab5c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab5affd640 1 -- 172.21.15.45:0/4119318638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c15c060 msgr2=0x7fab5c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:46.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab5affd640 1 --2- 172.21.15.45:0/4119318638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c15c060 0x7fab5c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab5affd640 1 -- 172.21.15.45:0/4119318638 >> v1:172.21.15.45:6789/0 conn(0x7fab5c0d2450 legacy=0x7fab5c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.375+0000 7fab5affd640 1 -- 172.21.15.45:0/4119318638 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c15c430 con 0x7fab5c0cd120 2023-07-09T02:13:46.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab5affd640 1 --2- 172.21.15.45:0/4119318638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c0d1f10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fab500097c0 tx=0x7fab5001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c2af2c9ded21a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab5a7fc640 1 -- 172.21.15.45:0/4119318638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab500ab600 con 0x7fab5c0cd120 2023-07-09T02:13:46.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab5a7fc640 1 -- 172.21.15.45:0/4119318638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab500a7050 con 0x7fab5c0cd120 2023-07-09T02:13:46.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab5a7fc640 1 -- 172.21.15.45:0/4119318638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab500ab980 con 0x7fab5c0cd120 2023-07-09T02:13:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab61f9f640 1 -- 172.21.15.45:0/4119318638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 msgr2=0x7fab5c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab61f9f640 1 --2- 172.21.15.45:0/4119318638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c0d1f10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fab500097c0 tx=0x7fab5001c450 comp rx=0 tx=0).stop 2023-07-09T02:13:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab61f9f640 1 -- 172.21.15.45:0/4119318638 shutdown_connections 2023-07-09T02:13:46.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab61f9f640 1 --2- 172.21.15.45:0/4119318638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c0d1f10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab61f9f640 1 --2- 172.21.15.45:0/4119318638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c15c060 0x7fab5c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab61f9f640 1 -- 172.21.15.45:0/4119318638 >> 172.21.15.45:0/4119318638 conn(0x7fab5c0698e0 msgr2=0x7fab5c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:46.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab61f9f640 1 -- 172.21.15.45:0/4119318638 shutdown_connections 2023-07-09T02:13:46.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.379+0000 7fab61f9f640 1 -- 172.21.15.45:0/4119318638 wait complete. 2023-07-09T02:13:46.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 Processor -- start 2023-07-09T02:13:46.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 -- start start 2023-07-09T02:13:46.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c0d2450 0x7fab5c15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c15c060 0x7fab5c0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c153940 con 0x7fab5c0cd120 2023-07-09T02:13:46.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c154940 con 0x7fab5c15c060 2023-07-09T02:13:46.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c154c20 con 0x7fab5c0d2450 2023-07-09T02:13:46.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33840/0 (socket says 172.21.15.45:33840) 2023-07-09T02:13:46.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 -- 172.21.15.45:0/1289156537 learned_addr learned my addr 172.21.15.45:0/1289156537 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:46.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 -- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c0d2450 msgr2=0x7fab5c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c0d2450 0x7fab5c15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 -- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c15c060 msgr2=0x7fab5c0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c15c060 0x7fab5c0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 -- 172.21.15.45:0/1289156537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50009420 con 0x7fab5c0cd120 2023-07-09T02:13:46.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab5b7fe640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c153400 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00e870 tx=0x7fab4c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab43fff640 1 -- 172.21.15.45:0/1289156537 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c009510 con 0x7fab5c0cd120 2023-07-09T02:13:46.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab43fff640 1 -- 172.21.15.45:0/1289156537 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c00eec0 con 0x7fab5c0cd120 2023-07-09T02:13:46.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab43fff640 1 -- 172.21.15.45:0/1289156537 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c00cb40 con 0x7fab5c0cd120 2023-07-09T02:13:46.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c154f00 con 0x7fab5c0cd120 2023-07-09T02:13:46.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.383+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c1554c0 con 0x7fab5c0cd120 2023-07-09T02:13:46.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.387+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c04d7d0 con 0x7fab5c0cd120 2023-07-09T02:13:46.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.387+0000 7fab43fff640 1 -- 172.21.15.45:0/1289156537 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab4c00cca0 con 0x7fab5c0cd120 2023-07-09T02:13:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.387+0000 7fab43fff640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab48066280 0x7fab48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.387+0000 7fab43fff640 1 -- 172.21.15.45:0/1289156537 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab4c083e50 con 0x7fab5c0cd120 2023-07-09T02:13:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.387+0000 7fab5affd640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab48066280 0x7fab48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.387+0000 7fab5affd640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab48066280 0x7fab48068730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab500ad000 tx=0x7fab50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.391+0000 7fab43fff640 1 -- 172.21.15.45:0/1289156537 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab4c0512c0 con 0x7fab5c0cd120 2023-07-09T02:13:46.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.543+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab5c160400 con 0x7fab48066280 2023-07-09T02:13:46.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.555+0000 7fab43fff640 1 -- 172.21.15.45:0/1289156537 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295513 (secure 0 0 0) 0x7fab500ab660 con 0x7fab48066280 2023-07-09T02:13:46.561 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:46.562 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:13:46.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab48066280 msgr2=0x7fab48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab48066280 0x7fab48068730 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab500ad000 tx=0x7fab50008040 comp rx=0 tx=0).stop 2023-07-09T02:13:46.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 msgr2=0x7fab5c153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c153400 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00e870 tx=0x7fab4c00ec70 comp rx=0 tx=0).stop 2023-07-09T02:13:46.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 shutdown_connections 2023-07-09T02:13:46.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab5c15c060 0x7fab5c0b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab48066280 0x7fab48068730 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab5c0d2450 0x7fab5c15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 --2- 172.21.15.45:0/1289156537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab5c0cd120 0x7fab5c153400 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 >> 172.21.15.45:0/1289156537 conn(0x7fab5c0698e0 msgr2=0x7fab5c0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:46.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 shutdown_connections 2023-07-09T02:13:46.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.559+0000 7fab61f9f640 1 -- 172.21.15.45:0/1289156537 wait complete. 2023-07-09T02:13:46.581 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2023-07-09T02:13:44.560347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3836,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558663,"statfs":{"total":1600000000,"available":1596071740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.114733"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.449996+0000","last_change":"2023-07-09T02:13:40.449996+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.449996+0000","last_undegraded":"2023-07-09T02:13:40.449996+0000","last_fullsized":"2023-07-09T02:13:40.449996+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.447937+0000","last_change":"2023-07-09T02:13:40.447937+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.447937+0000","last_undegraded":"2023-07-09T02:13:40.447937+0000","last_fullsized":"2023-07-09T02:13:40.447937+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.447893+0000","last_change":"2023-07-09T02:13:40.447893+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.447893+0000","last_undegraded":"2023-07-09T02:13:40.447893+0000","last_fullsized":"2023-07-09T02:13:40.447893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.447541+0000","last_change":"2023-07-09T02:13:40.447541+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.447541+0000","last_undegraded":"2023-07-09T02:13:40.447541+0000","last_fullsized":"2023-07-09T02:13:40.447541+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.452006+0000","last_change":"2023-07-09T02:13:40.452006+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.452006+0000","last_undegraded":"2023-07-09T02:13:40.452006+0000","last_fullsized":"2023-07-09T02:13:40.452006+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.451790+0000","last_change":"2023-07-09T02:13:40.451790+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.451790+0000","last_undegraded":"2023-07-09T02:13:40.451790+0000","last_fullsized":"2023-07-09T02:13:40.451790+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.451164+0000","last_change":"2023-07-09T02:13:40.451164+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.451164+0000","last_undegraded":"2023-07-09T02:13:40.451164+0000","last_fullsized":"2023-07-09T02:13:40.451164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.447437+0000","last_change":"2023-07-09T02:13:40.447437+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.447437+0000","last_undegraded":"2023-07-09T02:13:40.447437+0000","last_fullsized":"2023-07-09T02:13:40.447437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.450074+0000","last_change":"2023-07-09T02:13:40.450074+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.450074+0000","last_undegraded":"2023-07-09T02:13:40.450074+0000","last_fullsized":"2023-07-09T02:13:40.450074+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.449855+0000","last_change":"2023-07-09T02:13:40.449855+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.449855+0000","last_undegraded":"2023-07-09T02:13:40.449855+0000","last_fullsized":"2023-07-09T02:13:40.449855+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.448079+0000","last_change":"2023-07-09T02:13:40.448079+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.448079+0000","last_undegraded":"2023-07-09T02:13:40.448079+0000","last_fullsized":"2023-07-09T02:13:40.448079+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.449904+0000","last_change":"2023-07-09T02:13:40.449904+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.449904+0000","last_undegraded":"2023-07-09T02:13:40.449904+0000","last_fullsized":"2023-07-09T02:13:40.449904+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.449019+0000","last_change":"2023-07-09T02:13:40.449019+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.449019+0000","last_undegraded":"2023-07-09T02:13:40.449019+0000","last_fullsized":"2023-07-09T02:13:40.449019+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.447326+0000","last_change":"2023-07-09T02:13:40.447326+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.447326+0000","last_undegraded":"2023-07-09T02:13:40.447326+0000","last_fullsized":"2023-07-09T02:13:40.447326+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.448721+0000","last_change":"2023-07-09T02:13:40.448721+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.448721+0000","last_undegraded":"2023-07-09T02:13:40.448721+0000","last_fullsized":"2023-07-09T02:13:40.448721+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.449765+0000","last_change":"2023-07-09T02:13:40.449765+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.449765+0000","last_undegraded":"2023-07-09T02:13:40.449765+0000","last_fullsized":"2023-07-09T02:13:40.449765+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.446523+0000","last_change":"2023-07-09T02:13:40.446523+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.446523+0000","last_undegraded":"2023-07-09T02:13:40.446523+0000","last_fullsized":"2023-07-09T02:13:40.446523+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.446632+0000","last_change":"2023-07-09T02:13:40.446632+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.446632+0000","last_undegraded":"2023-07-09T02:13:40.446632+0000","last_fullsized":"2023-07-09T02:13:40.446632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.447463+0000","last_change":"2023-07-09T02:13:40.447463+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.447463+0000","last_undegraded":"2023-07-09T02:13:40.447463+0000","last_fullsized":"2023-07-09T02:13:40.447463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.449640+0000","last_change":"2023-07-09T02:13:40.449640+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.449640+0000","last_undegraded":"2023-07-09T02:13:40.449640+0000","last_fullsized":"2023-07-09T02:13:40.449640+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.448663+0000","last_change":"2023-07-09T02:13:40.448663+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.448663+0000","last_undegraded":"2023-07-09T02:13:40.448663+0000","last_fullsized":"2023-07-09T02:13:40.448663+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.451204+0000","last_change":"2023-07-09T02:13:40.451204+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.451204+0000","last_undegraded":"2023-07-09T02:13:40.451204+0000","last_fullsized":"2023-07-09T02:13:40.451204+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.451159+0000","last_change":"2023-07-09T02:13:40.451159+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.451159+0000","last_undegraded":"2023-07-09T02:13:40.451159+0000","last_fullsized":"2023-07-09T02:13:40.451159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.449519+0000","last_change":"2023-07-09T02:13:40.449519+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.449519+0000","last_undegraded":"2023-07-09T02:13:40.449519+0000","last_fullsized":"2023-07-09T02:13:40.449519+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.451147+0000","last_change":"2023-07-09T02:13:40.451147+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.451147+0000","last_undegraded":"2023-07-09T02:13:40.451147+0000","last_fullsized":"2023-07-09T02:13:40.451147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.450551+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:13:40.450551+0000","last_peered":"2023-07-09T02:13:40.450551+0000","last_clean":"2023-07-09T02:13:40.450551+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:13:40.450551+0000","last_undegraded":"2023-07-09T02:13:40.450551+0000","last_fullsized":"2023-07-09T02:13:40.450551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:31:29.742595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.446104+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:13:40.446104+0000","last_peered":"2023-07-09T02:13:40.446104+0000","last_clean":"2023-07-09T02:13:40.446104+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:13:40.446104+0000","last_undegraded":"2023-07-09T02:13:40.446104+0000","last_fullsized":"2023-07-09T02:13:40.446104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:51.729272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.447536+0000","last_change":"2023-07-09T02:13:40.447536+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.447536+0000","last_undegraded":"2023-07-09T02:13:40.447536+0000","last_fullsized":"2023-07-09T02:13:40.447536+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.450432+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:13:40.450432+0000","last_peered":"2023-07-09T02:13:40.450432+0000","last_clean":"2023-07-09T02:13:40.450432+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:13:40.450432+0000","last_undegraded":"2023-07-09T02:13:40.450432+0000","last_fullsized":"2023-07-09T02:13:40.450432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:25:04.974416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.446514+0000","last_change":"2023-07-09T02:13:40.446514+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.446514+0000","last_undegraded":"2023-07-09T02:13:40.446514+0000","last_fullsized":"2023-07-09T02:13:40.446514+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":88,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.449308+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:13:40.449308+0000","last_peered":"2023-07-09T02:13:40.449308+0000","last_clean":"2023-07-09T02:13:40.449308+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:13:40.449308+0000","last_undegraded":"2023-07-09T02:13:40.449308+0000","last_fullsized":"2023-07-09T02:13:40.449308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:22:39.014003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.447517+0000","last_change":"2023-07-09T02:13:40.447517+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.447517+0000","last_undegraded":"2023-07-09T02:13:40.447517+0000","last_fullsized":"2023-07-09T02:13:40.447517+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.446101+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:13:40.446101+0000","last_peered":"2023-07-09T02:13:40.446101+0000","last_clean":"2023-07-09T02:13:40.446101+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:13:40.446101+0000","last_undegraded":"2023-07-09T02:13:40.446101+0000","last_fullsized":"2023-07-09T02:13:40.446101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:44.186372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.446946+0000","last_change":"2023-07-09T02:13:40.446946+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.446946+0000","last_undegraded":"2023-07-09T02:13:40.446946+0000","last_fullsized":"2023-07-09T02:13:40.446946+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.446457+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:13:40.446457+0000","last_peered":"2023-07-09T02:13:40.446457+0000","last_clean":"2023-07-09T02:13:40.446457+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:13:40.446457+0000","last_undegraded":"2023-07-09T02:13:40.446457+0000","last_fullsized":"2023-07-09T02:13:40.446457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:03:10.565812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.448655+0000","last_change":"2023-07-09T02:13:40.448655+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.448655+0000","last_undegraded":"2023-07-09T02:13:40.448655+0000","last_fullsized":"2023-07-09T02:13:40.448655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.450300+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:13:40.450300+0000","last_peered":"2023-07-09T02:13:40.450300+0000","last_clean":"2023-07-09T02:13:40.450300+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:13:40.450300+0000","last_undegraded":"2023-07-09T02:13:40.450300+0000","last_fullsized":"2023-07-09T02:13:40.450300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:54:13.186720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.449050+0000","last_change":"2023-07-09T02:13:40.449050+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.449050+0000","last_undegraded":"2023-07-09T02:13:40.449050+0000","last_fullsized":"2023-07-09T02:13:40.449050+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.446448+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:13:40.446448+0000","last_peered":"2023-07-09T02:13:40.446448+0000","last_clean":"2023-07-09T02:13:40.446448+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:13:40.446448+0000","last_undegraded":"2023-07-09T02:13:40.446448+0000","last_fullsized":"2023-07-09T02:13:40.446448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:34:55.657378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-09T02:13:41.446102+0000","last_change":"2023-07-09T02:13:41.446102+0000","last_active":"2023-07-09T02:13:41.446102+0000","last_peered":"2023-07-09T02:13:41.446102+0000","last_clean":"2023-07-09T02:13:41.446102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:41.446102+0000","last_undegraded":"2023-07-09T02:13:41.446102+0000","last_fullsized":"2023-07-09T02:13:41.446102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-09T02:13:40.451665+0000","last_change":"2023-07-09T02:13:40.451665+0000","last_active":"2023-07-09T02:13:40.434343+0000","last_peered":"2023-07-09T02:13:40.434343+0000","last_clean":"2023-07-09T02:13:40.434343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T02:13:40.451665+0000","last_undegraded":"2023-07-09T02:13:40.451665+0000","last_fullsized":"2023-07-09T02:13:40.451665+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-09T02:13:40.447226+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:13:40.447226+0000","last_peered":"2023-07-09T02:13:40.447226+0000","last_clean":"2023-07-09T02:13:40.447226+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:13:40.447226+0000","last_undegraded":"2023-07-09T02:13:40.447226+0000","last_fullsized":"2023-07-09T02:13:40.447226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:17:18.879823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":910,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194402,"statfs":{"total":200000000,"available":199067734,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0069999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96099999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.35599999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.54300000000000004},{"interface":"front","average":{"1min":2.3580000000000001,"5min":1.018,"15min":0.79500000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":29.498999999999999,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.55700000000000005}]},{"osd":2,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.72699999999999998,"15min":0.69799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0460000000000003,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":2.028,"5min":0.98399999999999999,"15min":0.81000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":26.524000000000001,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.501}]},{"osd":3,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.3789999999999996,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.238,"5min":0.84399999999999997,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":10.609999999999999,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.439},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.498,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.60199999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":339,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194972,"statfs":{"total":200000000,"available":199651932,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86299999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.89100000000000001,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.60599999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90700000000000003,"5min":1.165,"15min":1.165},"last":0.79100000000000004}]},{"osd":2,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.505,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99299999999999999,"5min":0.996,"15min":0.996},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.56100000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88500000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.40300000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42999999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.45100000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.83799999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194978,"statfs":{"total":200000000,"available":199658102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.57799999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.503,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.62}]},{"osd":2,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.47199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56599999999999995}]},{"osd":3,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53800000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.437},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.48899999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76300000000000001,"15min":0.754},"min":{"1min":0.52700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194978,"statfs":{"total":200000000,"available":199658102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":3.6190000000000002,"5min":1.2490000000000001,"15min":0.85399999999999998},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":50.508000000000003,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.70999999999999996,"15min":0.64000000000000001},"min":{"1min":0.5,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":8.6039999999999992,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.45700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96099999999999997,"5min":1.323,"15min":1.323},"last":0.58299999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":4.8869999999999996,"5min":1.5029999999999999,"15min":0.93899999999999995},"min":{"1min":0.55700000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":71.909000000000006,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.504}]},{"osd":5,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47499999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.68600000000000005,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":7.9909999999999997,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90300000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.1419999999999999,"5min":0.77500000000000002,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":8.0359999999999996,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.61499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194978,"statfs":{"total":200000000,"available":199658102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41099999999999998,"15min":0.41599999999999998},"min":{"1min":0.26500000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.58399999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64100000000000001,"5min":1.198,"15min":1.198},"last":0.40799999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68600000000000005,"5min":1.048,"15min":1.048},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.51800000000000002},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45400000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.51900000000000002,"15min":0.53300000000000003},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":1.155,"15min":1.155},"last":0.375},{"interface":"front","average":{"1min":0.5,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68799999999999994,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85599999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.57899999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.63200000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1,"5min":1,"15min":1},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.75,"5min":0.751,"15min":0.751},"min":{"1min":0.56200000000000006,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.64700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94899999999999995,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.622},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":1.26,"15min":1.26},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.59699999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":339,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194972,"statfs":{"total":200000000,"available":199651932,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.48699999999999999,"15min":0.42299999999999999},"min":{"1min":0.29999999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":7.7450000000000001,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.42899999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.48099999999999998,"15min":0.46500000000000002},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.55600000000000005,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.8710000000000004,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.496}]},{"osd":4,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":0.80200000000000005,"15min":0.749},"min":{"1min":0.52500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.7990000000000004,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85899999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.496,"15min":0.496},"max":{"1min":0.96599999999999997,"5min":1.319,"15min":1.319},"last":0.752},{"interface":"front","average":{"1min":1.1359999999999999,"5min":0.82399999999999995,"15min":0.77200000000000002},"min":{"1min":0.56200000000000006,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":7.8369999999999997,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.626,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.64400000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.79700000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.206,"5min":1.351,"15min":1.351},"last":0.83999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194978,"statfs":{"total":200000000,"available":199658102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.44600000000000001,"15min":0.45400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57499999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.623},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83899999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85699999999999998,"5min":1.163,"15min":1.163},"last":0.41099999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.72199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90200000000000002,"5min":1.026,"15min":1.026},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.78800000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93600000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.71899999999999997,"15min":0.71399999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.748}]},{"osd":6,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.66000000000000003,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.82499999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.92500000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.99199999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.86099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":910,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194402,"statfs":{"total":200000000,"available":199067734,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28899999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.62,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.438,"15min":0.43099999999999999},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.40999999999999998,"15min":0.40400000000000003},"min":{"1min":0.33400000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.51400000000000001,"15min":0.49399999999999999},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.58099999999999996}]},{"osd":4,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.77100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.145,"15min":1.145},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.78100000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80300000000000005,"15min":0.80200000000000005},"min":{"1min":0.57299999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.72699999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55000000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1180000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.76300000000000001}]}]}],"pool_statfs":[]}} 2023-07-09T02:13:46.589 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:13:46.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.767+0000 7f0bd1ffa640 1 Processor -- start 2023-07-09T02:13:46.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.767+0000 7f0bd1ffa640 1 -- start start 2023-07-09T02:13:46.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bd1ffa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bcc15c060 0x7f0bcc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bd1ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bd1ffa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc160a50 con 0x7f0bcc0d2450 2023-07-09T02:13:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bd1ffa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0d28f0 con 0x7f0bcc15c060 2023-07-09T02:13:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bd1ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0cfe40 con 0x7f0bcc0cd120 2023-07-09T02:13:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bcc15c060 0x7f0bcc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bcc15c060 0x7f0bcc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33848/0 (socket says 172.21.15.45:33848) 2023-07-09T02:13:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcb7fe640 1 -- 172.21.15.45:0/1526652593 learned_addr learned my addr 172.21.15.45:0/1526652593 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcaffd640 1 --2- 172.21.15.45:0/1526652593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcb7fe640 1 -- 172.21.15.45:0/1526652593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 msgr2=0x7f0bcc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcb7fe640 1 --2- 172.21.15.45:0/1526652593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcb7fe640 1 -- 172.21.15.45:0/1526652593 >> v1:172.21.15.155:6789/0 conn(0x7f0bcc0d2450 legacy=0x7f0bcc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcb7fe640 1 -- 172.21.15.45:0/1526652593 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc15c430 con 0x7f0bcc15c060 2023-07-09T02:13:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcaffd640 1 --2- 172.21.15.45:0/1526652593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:46.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bcb7fe640 1 --2- 172.21.15.45:0/1526652593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc15c060 0x7f0bcc0b4ed0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009870 tx=0x7f0bbc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219cbb996b4e2b00 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bca7fc640 1 -- 172.21.15.45:0/1526652593 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0a7070 con 0x7f0bcc15c060 2023-07-09T02:13:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bca7fc640 1 -- 172.21.15.45:0/1526652593 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc0ab430 con 0x7f0bcc15c060 2023-07-09T02:13:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.771+0000 7f0bca7fc640 1 -- 172.21.15.45:0/1526652593 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0ab7c0 con 0x7f0bcc15c060 2023-07-09T02:13:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/1526652593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc15c060 msgr2=0x7f0bcc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/1526652593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc15c060 0x7f0bcc0b4ed0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009870 tx=0x7f0bbc01c510 comp rx=0 tx=0).stop 2023-07-09T02:13:46.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/1526652593 shutdown_connections 2023-07-09T02:13:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/1526652593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/1526652593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc15c060 0x7f0bcc0b4ed0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/1526652593 >> 172.21.15.45:0/1526652593 conn(0x7f0bcc0698e0 msgr2=0x7f0bcc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/1526652593 shutdown_connections 2023-07-09T02:13:46.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/1526652593 wait complete. 2023-07-09T02:13:46.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 Processor -- start 2023-07-09T02:13:46.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- start start 2023-07-09T02:13:46.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc0d2450 0x7f0bcc0b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15c060 0x7f0bcc0b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b6710 con 0x7f0bcc0d2450 2023-07-09T02:13:46.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b5360 con 0x7f0bcc15c060 2023-07-09T02:13:46.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bd1ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b4de0 con 0x7f0bcc0cd120 2023-07-09T02:13:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bcaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc0d2450 0x7f0bcc0b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bcaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc0d2450 0x7f0bcc0b7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33854/0 (socket says 172.21.15.45:33854) 2023-07-09T02:13:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bcaffd640 1 -- 172.21.15.45:0/4085452967 learned_addr learned my addr 172.21.15.45:0/4085452967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bcb7fe640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.775+0000 7f0bcbfff640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15c060 0x7f0bcc0b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bcaffd640 1 -- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 msgr2=0x7f0bcc153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bcaffd640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bcaffd640 1 -- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15c060 msgr2=0x7f0bcc0b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bcaffd640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15c060 0x7f0bcc0b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bcaffd640 1 -- 172.21.15.45:0/4085452967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0094d0 con 0x7f0bcc0d2450 2023-07-09T02:13:46.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bcbfff640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15c060 0x7f0bcc0b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:46.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bcaffd640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc0d2450 0x7f0bcc0b7c90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000e7e0 tx=0x7f0bc000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bb3fff640 1 -- 172.21.15.45:0/4085452967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000c6d0 con 0x7f0bcc0d2450 2023-07-09T02:13:46.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bb3fff640 1 -- 172.21.15.45:0/4085452967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc000c830 con 0x7f0bcc0d2450 2023-07-09T02:13:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0b47f0 con 0x7f0bcc0d2450 2023-07-09T02:13:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bb3fff640 1 -- 172.21.15.45:0/4085452967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000cbe0 con 0x7f0bcc0d2450 2023-07-09T02:13:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0b3ff0 con 0x7f0bcc0d2450 2023-07-09T02:13:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc04d7d0 con 0x7f0bcc0d2450 2023-07-09T02:13:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bb3fff640 1 -- 172.21.15.45:0/4085452967 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0bc000cd40 con 0x7f0bcc0d2450 2023-07-09T02:13:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bb3fff640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bb8066280 0x7f0bb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:46.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.779+0000 7f0bb3fff640 1 -- 172.21.15.45:0/4085452967 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bc0083b30 con 0x7f0bcc0d2450 2023-07-09T02:13:46.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.783+0000 7f0bcb7fe640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bb8066280 0x7f0bb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:46.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.783+0000 7f0bcb7fe640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bb8066280 0x7f0bb8068730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0af000 tx=0x7f0bbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:46.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.783+0000 7f0bb3fff640 1 -- 172.21.15.45:0/4085452967 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0bc0054ae0 con 0x7f0bcc0d2450 2023-07-09T02:13:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.935+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bcc160400 con 0x7f0bb8066280 2023-07-09T02:13:46.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.951+0000 7f0bb3fff640 1 -- 172.21.15.45:0/4085452967 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305577 (secure 0 0 0) 0x7f0bbc0bc090 con 0x7f0bb8066280 2023-07-09T02:13:46.956 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:46.958 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:13:46.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bb8066280 msgr2=0x7f0bb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bb8066280 0x7f0bb8068730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0af000 tx=0x7f0bbc008040 comp rx=0 tx=0).stop 2023-07-09T02:13:46.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc0d2450 msgr2=0x7f0bcc0b7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:46.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc0d2450 0x7f0bcc0b7c90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000e7e0 tx=0x7f0bc000eca0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 shutdown_connections 2023-07-09T02:13:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bcc15c060 0x7f0bcc0b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bcc0d2450 0x7f0bcc0b7c90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bb8066280 0x7f0bb8068730 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 --2- 172.21.15.45:0/4085452967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bcc0cd120 0x7f0bcc153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 >> 172.21.15.45:0/4085452967 conn(0x7f0bcc0698e0 msgr2=0x7f0bcc0b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:46.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 shutdown_connections 2023-07-09T02:13:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:46.955+0000 7f0bd1ffa640 1 -- 172.21.15.45:0/4085452967 wait complete. 2023-07-09T02:13:46.977 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-07-09T02:13:46.560832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4036,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558463,"statfs":{"total":1600000000,"available":1595866788,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468175+0000","last_change":"2023-07-09T02:13:42.466124+0000","last_active":"2023-07-09T02:13:43.468175+0000","last_peered":"2023-07-09T02:13:43.468175+0000","last_clean":"2023-07-09T02:13:43.468175+0000","last_became_active":"2023-07-09T02:13:42.465904+0000","last_became_peered":"2023-07-09T02:13:42.465904+0000","last_unstale":"2023-07-09T02:13:43.468175+0000","last_undegraded":"2023-07-09T02:13:43.468175+0000","last_fullsized":"2023-07-09T02:13:43.468175+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:18:58.227065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468298+0000","last_change":"2023-07-09T02:13:42.468568+0000","last_active":"2023-07-09T02:13:43.468298+0000","last_peered":"2023-07-09T02:13:43.468298+0000","last_clean":"2023-07-09T02:13:43.468298+0000","last_became_active":"2023-07-09T02:13:42.468251+0000","last_became_peered":"2023-07-09T02:13:42.468251+0000","last_unstale":"2023-07-09T02:13:43.468298+0000","last_undegraded":"2023-07-09T02:13:43.468298+0000","last_fullsized":"2023-07-09T02:13:43.468298+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:03:15.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468269+0000","last_change":"2023-07-09T02:13:42.477896+0000","last_active":"2023-07-09T02:13:43.468269+0000","last_peered":"2023-07-09T02:13:43.468269+0000","last_clean":"2023-07-09T02:13:43.468269+0000","last_became_active":"2023-07-09T02:13:42.476299+0000","last_became_peered":"2023-07-09T02:13:42.476299+0000","last_unstale":"2023-07-09T02:13:43.468269+0000","last_undegraded":"2023-07-09T02:13:43.468269+0000","last_fullsized":"2023-07-09T02:13:43.468269+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:10:02.591884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467368+0000","last_change":"2023-07-09T02:13:42.473171+0000","last_active":"2023-07-09T02:13:43.467368+0000","last_peered":"2023-07-09T02:13:43.467368+0000","last_clean":"2023-07-09T02:13:43.467368+0000","last_became_active":"2023-07-09T02:13:42.472917+0000","last_became_peered":"2023-07-09T02:13:42.472917+0000","last_unstale":"2023-07-09T02:13:43.467368+0000","last_undegraded":"2023-07-09T02:13:43.467368+0000","last_fullsized":"2023-07-09T02:13:43.467368+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:36:09.747171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459357+0000","last_change":"2023-07-09T02:13:42.469149+0000","last_active":"2023-07-09T02:13:43.459357+0000","last_peered":"2023-07-09T02:13:43.459357+0000","last_clean":"2023-07-09T02:13:43.459357+0000","last_became_active":"2023-07-09T02:13:42.468914+0000","last_became_peered":"2023-07-09T02:13:42.468914+0000","last_unstale":"2023-07-09T02:13:43.459357+0000","last_undegraded":"2023-07-09T02:13:43.459357+0000","last_fullsized":"2023-07-09T02:13:43.459357+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:32:57.037908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460096+0000","last_change":"2023-07-09T02:13:42.473809+0000","last_active":"2023-07-09T02:13:43.460096+0000","last_peered":"2023-07-09T02:13:43.460096+0000","last_clean":"2023-07-09T02:13:43.460096+0000","last_became_active":"2023-07-09T02:13:42.473578+0000","last_became_peered":"2023-07-09T02:13:42.473578+0000","last_unstale":"2023-07-09T02:13:43.460096+0000","last_undegraded":"2023-07-09T02:13:43.460096+0000","last_fullsized":"2023-07-09T02:13:43.460096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:51:55.098579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459258+0000","last_change":"2023-07-09T02:13:42.473090+0000","last_active":"2023-07-09T02:13:43.459258+0000","last_peered":"2023-07-09T02:13:43.459258+0000","last_clean":"2023-07-09T02:13:43.459258+0000","last_became_active":"2023-07-09T02:13:42.472879+0000","last_became_peered":"2023-07-09T02:13:42.472879+0000","last_unstale":"2023-07-09T02:13:43.459258+0000","last_undegraded":"2023-07-09T02:13:43.459258+0000","last_fullsized":"2023-07-09T02:13:43.459258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:41:01.082505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678104+0000","last_change":"2023-07-09T02:13:42.470974+0000","last_active":"2023-07-09T02:13:43.678104+0000","last_peered":"2023-07-09T02:13:43.678104+0000","last_clean":"2023-07-09T02:13:43.678104+0000","last_became_active":"2023-07-09T02:13:42.470758+0000","last_became_peered":"2023-07-09T02:13:42.470758+0000","last_unstale":"2023-07-09T02:13:43.678104+0000","last_undegraded":"2023-07-09T02:13:43.678104+0000","last_fullsized":"2023-07-09T02:13:43.678104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:08:19.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467215+0000","last_change":"2023-07-09T02:13:42.471212+0000","last_active":"2023-07-09T02:13:43.467215+0000","last_peered":"2023-07-09T02:13:43.467215+0000","last_clean":"2023-07-09T02:13:43.467215+0000","last_became_active":"2023-07-09T02:13:42.469747+0000","last_became_peered":"2023-07-09T02:13:42.469747+0000","last_unstale":"2023-07-09T02:13:43.467215+0000","last_undegraded":"2023-07-09T02:13:43.467215+0000","last_fullsized":"2023-07-09T02:13:43.467215+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:46:58.857976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468070+0000","last_change":"2023-07-09T02:13:42.477084+0000","last_active":"2023-07-09T02:13:43.468070+0000","last_peered":"2023-07-09T02:13:43.468070+0000","last_clean":"2023-07-09T02:13:43.468070+0000","last_became_active":"2023-07-09T02:13:42.476537+0000","last_became_peered":"2023-07-09T02:13:42.476537+0000","last_unstale":"2023-07-09T02:13:43.468070+0000","last_undegraded":"2023-07-09T02:13:43.468070+0000","last_fullsized":"2023-07-09T02:13:43.468070+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:04:51.741257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468004+0000","last_change":"2023-07-09T02:13:42.473837+0000","last_active":"2023-07-09T02:13:43.468004+0000","last_peered":"2023-07-09T02:13:43.468004+0000","last_clean":"2023-07-09T02:13:43.468004+0000","last_became_active":"2023-07-09T02:13:42.473448+0000","last_became_peered":"2023-07-09T02:13:42.473448+0000","last_unstale":"2023-07-09T02:13:43.468004+0000","last_undegraded":"2023-07-09T02:13:43.468004+0000","last_fullsized":"2023-07-09T02:13:43.468004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:32:26.743637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678228+0000","last_change":"2023-07-09T02:13:42.468098+0000","last_active":"2023-07-09T02:13:43.678228+0000","last_peered":"2023-07-09T02:13:43.678228+0000","last_clean":"2023-07-09T02:13:43.678228+0000","last_became_active":"2023-07-09T02:13:42.467881+0000","last_became_peered":"2023-07-09T02:13:42.467881+0000","last_unstale":"2023-07-09T02:13:43.678228+0000","last_undegraded":"2023-07-09T02:13:43.678228+0000","last_fullsized":"2023-07-09T02:13:43.678228+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:55:13.673172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678373+0000","last_change":"2023-07-09T02:13:42.468742+0000","last_active":"2023-07-09T02:13:43.678373+0000","last_peered":"2023-07-09T02:13:43.678373+0000","last_clean":"2023-07-09T02:13:43.678373+0000","last_became_active":"2023-07-09T02:13:42.468434+0000","last_became_peered":"2023-07-09T02:13:42.468434+0000","last_unstale":"2023-07-09T02:13:43.678373+0000","last_undegraded":"2023-07-09T02:13:43.678373+0000","last_fullsized":"2023-07-09T02:13:43.678373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:18:58.227065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467357+0000","last_change":"2023-07-09T02:13:42.475836+0000","last_active":"2023-07-09T02:13:43.467357+0000","last_peered":"2023-07-09T02:13:43.467357+0000","last_clean":"2023-07-09T02:13:43.467357+0000","last_became_active":"2023-07-09T02:13:42.475621+0000","last_became_peered":"2023-07-09T02:13:42.475621+0000","last_unstale":"2023-07-09T02:13:43.467357+0000","last_undegraded":"2023-07-09T02:13:43.467357+0000","last_fullsized":"2023-07-09T02:13:43.467357+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:07:51.281420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468294+0000","last_change":"2023-07-09T02:13:42.477205+0000","last_active":"2023-07-09T02:13:43.468294+0000","last_peered":"2023-07-09T02:13:43.468294+0000","last_clean":"2023-07-09T02:13:43.468294+0000","last_became_active":"2023-07-09T02:13:42.476869+0000","last_became_peered":"2023-07-09T02:13:42.476869+0000","last_unstale":"2023-07-09T02:13:43.468294+0000","last_undegraded":"2023-07-09T02:13:43.468294+0000","last_fullsized":"2023-07-09T02:13:43.468294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:12.991776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459480+0000","last_change":"2023-07-09T02:13:42.476862+0000","last_active":"2023-07-09T02:13:43.459480+0000","last_peered":"2023-07-09T02:13:43.459480+0000","last_clean":"2023-07-09T02:13:43.459480+0000","last_became_active":"2023-07-09T02:13:42.475774+0000","last_became_peered":"2023-07-09T02:13:42.475774+0000","last_unstale":"2023-07-09T02:13:43.459480+0000","last_undegraded":"2023-07-09T02:13:43.459480+0000","last_fullsized":"2023-07-09T02:13:43.459480+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:28:11.992385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468024+0000","last_change":"2023-07-09T02:13:42.471196+0000","last_active":"2023-07-09T02:13:43.468024+0000","last_peered":"2023-07-09T02:13:43.468024+0000","last_clean":"2023-07-09T02:13:43.468024+0000","last_became_active":"2023-07-09T02:13:42.470267+0000","last_became_peered":"2023-07-09T02:13:42.470267+0000","last_unstale":"2023-07-09T02:13:43.468024+0000","last_undegraded":"2023-07-09T02:13:43.468024+0000","last_fullsized":"2023-07-09T02:13:43.468024+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:55:13.673172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467258+0000","last_change":"2023-07-09T02:13:42.464271+0000","last_active":"2023-07-09T02:13:43.467258+0000","last_peered":"2023-07-09T02:13:43.467258+0000","last_clean":"2023-07-09T02:13:43.467258+0000","last_became_active":"2023-07-09T02:13:42.463997+0000","last_became_peered":"2023-07-09T02:13:42.463997+0000","last_unstale":"2023-07-09T02:13:43.467258+0000","last_undegraded":"2023-07-09T02:13:43.467258+0000","last_fullsized":"2023-07-09T02:13:43.467258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:51:35.666580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459030+0000","last_change":"2023-07-09T02:13:42.471913+0000","last_active":"2023-07-09T02:13:43.459030+0000","last_peered":"2023-07-09T02:13:43.459030+0000","last_clean":"2023-07-09T02:13:43.459030+0000","last_became_active":"2023-07-09T02:13:42.471482+0000","last_became_peered":"2023-07-09T02:13:42.471482+0000","last_unstale":"2023-07-09T02:13:43.459030+0000","last_undegraded":"2023-07-09T02:13:43.459030+0000","last_fullsized":"2023-07-09T02:13:43.459030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:58.752039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468901+0000","last_change":"2023-07-09T02:13:42.467876+0000","last_active":"2023-07-09T02:13:43.468901+0000","last_peered":"2023-07-09T02:13:43.468901+0000","last_clean":"2023-07-09T02:13:43.468901+0000","last_became_active":"2023-07-09T02:13:42.467548+0000","last_became_peered":"2023-07-09T02:13:42.467548+0000","last_unstale":"2023-07-09T02:13:43.468901+0000","last_undegraded":"2023-07-09T02:13:43.468901+0000","last_fullsized":"2023-07-09T02:13:43.468901+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:49:37.535257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678522+0000","last_change":"2023-07-09T02:13:42.473378+0000","last_active":"2023-07-09T02:13:43.678522+0000","last_peered":"2023-07-09T02:13:43.678522+0000","last_clean":"2023-07-09T02:13:43.678522+0000","last_became_active":"2023-07-09T02:13:42.468585+0000","last_became_peered":"2023-07-09T02:13:42.468585+0000","last_unstale":"2023-07-09T02:13:43.678522+0000","last_undegraded":"2023-07-09T02:13:43.678522+0000","last_fullsized":"2023-07-09T02:13:43.678522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:14:56.318560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468922+0000","last_change":"2023-07-09T02:13:42.475277+0000","last_active":"2023-07-09T02:13:43.468922+0000","last_peered":"2023-07-09T02:13:43.468922+0000","last_clean":"2023-07-09T02:13:43.468922+0000","last_became_active":"2023-07-09T02:13:42.475062+0000","last_became_peered":"2023-07-09T02:13:42.475062+0000","last_unstale":"2023-07-09T02:13:43.468922+0000","last_undegraded":"2023-07-09T02:13:43.468922+0000","last_fullsized":"2023-07-09T02:13:43.468922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:34:33.391822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468830+0000","last_change":"2023-07-09T02:13:42.474344+0000","last_active":"2023-07-09T02:13:43.468830+0000","last_peered":"2023-07-09T02:13:43.468830+0000","last_clean":"2023-07-09T02:13:43.468830+0000","last_became_active":"2023-07-09T02:13:42.474065+0000","last_became_peered":"2023-07-09T02:13:42.474065+0000","last_unstale":"2023-07-09T02:13:43.468830+0000","last_undegraded":"2023-07-09T02:13:43.468830+0000","last_fullsized":"2023-07-09T02:13:43.468830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:00:48.540320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467506+0000","last_change":"2023-07-09T02:13:42.477744+0000","last_active":"2023-07-09T02:13:43.467506+0000","last_peered":"2023-07-09T02:13:43.467506+0000","last_clean":"2023-07-09T02:13:43.467506+0000","last_became_active":"2023-07-09T02:13:42.477505+0000","last_became_peered":"2023-07-09T02:13:42.477505+0000","last_unstale":"2023-07-09T02:13:43.467506+0000","last_undegraded":"2023-07-09T02:13:43.467506+0000","last_fullsized":"2023-07-09T02:13:43.467506+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:51:55.098579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678255+0000","last_change":"2023-07-09T02:13:42.469722+0000","last_active":"2023-07-09T02:13:43.678255+0000","last_peered":"2023-07-09T02:13:43.678255+0000","last_clean":"2023-07-09T02:13:43.678255+0000","last_became_active":"2023-07-09T02:13:42.469031+0000","last_became_peered":"2023-07-09T02:13:42.469031+0000","last_unstale":"2023-07-09T02:13:43.678255+0000","last_undegraded":"2023-07-09T02:13:43.678255+0000","last_fullsized":"2023-07-09T02:13:43.678255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:25:55.671631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678667+0000","last_change":"2023-07-09T02:13:42.474955+0000","last_active":"2023-07-09T02:13:43.678667+0000","last_peered":"2023-07-09T02:13:43.678667+0000","last_clean":"2023-07-09T02:13:43.678667+0000","last_became_active":"2023-07-09T02:13:42.474721+0000","last_became_peered":"2023-07-09T02:13:42.474721+0000","last_unstale":"2023-07-09T02:13:43.678667+0000","last_undegraded":"2023-07-09T02:13:43.678667+0000","last_fullsized":"2023-07-09T02:13:43.678667+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:43.529357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467559+0000","last_change":"2023-07-09T02:13:42.471437+0000","last_active":"2023-07-09T02:13:43.467559+0000","last_peered":"2023-07-09T02:13:43.467559+0000","last_clean":"2023-07-09T02:13:43.467559+0000","last_became_active":"2023-07-09T02:13:42.470341+0000","last_became_peered":"2023-07-09T02:13:42.470341+0000","last_unstale":"2023-07-09T02:13:43.467559+0000","last_undegraded":"2023-07-09T02:13:43.467559+0000","last_fullsized":"2023-07-09T02:13:43.467559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:42:12.064378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468094+0000","last_change":"2023-07-09T02:13:42.469833+0000","last_active":"2023-07-09T02:13:43.468094+0000","last_peered":"2023-07-09T02:13:43.468094+0000","last_clean":"2023-07-09T02:13:43.468094+0000","last_became_active":"2023-07-09T02:13:42.469611+0000","last_became_peered":"2023-07-09T02:13:42.469611+0000","last_unstale":"2023-07-09T02:13:43.468094+0000","last_undegraded":"2023-07-09T02:13:43.468094+0000","last_fullsized":"2023-07-09T02:13:43.468094+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:25:55.671631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467848+0000","last_change":"2023-07-09T02:13:42.471337+0000","last_active":"2023-07-09T02:13:43.467848+0000","last_peered":"2023-07-09T02:13:43.467848+0000","last_clean":"2023-07-09T02:13:43.467848+0000","last_became_active":"2023-07-09T02:13:42.471001+0000","last_became_peered":"2023-07-09T02:13:42.471001+0000","last_unstale":"2023-07-09T02:13:43.467848+0000","last_undegraded":"2023-07-09T02:13:43.467848+0000","last_fullsized":"2023-07-09T02:13:43.467848+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:56:01.295832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678432+0000","last_change":"2023-07-09T02:13:42.469582+0000","last_active":"2023-07-09T02:13:43.678432+0000","last_peered":"2023-07-09T02:13:43.678432+0000","last_clean":"2023-07-09T02:13:43.678432+0000","last_became_active":"2023-07-09T02:13:42.468427+0000","last_became_peered":"2023-07-09T02:13:42.468427+0000","last_unstale":"2023-07-09T02:13:43.678432+0000","last_undegraded":"2023-07-09T02:13:43.678432+0000","last_fullsized":"2023-07-09T02:13:43.678432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:17:15.693995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468126+0000","last_change":"2023-07-09T02:13:42.475172+0000","last_active":"2023-07-09T02:13:43.468126+0000","last_peered":"2023-07-09T02:13:43.468126+0000","last_clean":"2023-07-09T02:13:43.468126+0000","last_became_active":"2023-07-09T02:13:42.474933+0000","last_became_peered":"2023-07-09T02:13:42.474933+0000","last_unstale":"2023-07-09T02:13:43.468126+0000","last_undegraded":"2023-07-09T02:13:43.468126+0000","last_fullsized":"2023-07-09T02:13:43.468126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:23:47.003165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460181+0000","last_change":"2023-07-09T02:13:42.467742+0000","last_active":"2023-07-09T02:13:43.460181+0000","last_peered":"2023-07-09T02:13:43.460181+0000","last_clean":"2023-07-09T02:13:43.460181+0000","last_became_active":"2023-07-09T02:13:42.467524+0000","last_became_peered":"2023-07-09T02:13:42.467524+0000","last_unstale":"2023-07-09T02:13:43.460181+0000","last_undegraded":"2023-07-09T02:13:43.460181+0000","last_fullsized":"2023-07-09T02:13:43.460181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:20:31.801241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.458925+0000","last_change":"2023-07-09T02:13:42.475632+0000","last_active":"2023-07-09T02:13:43.458925+0000","last_peered":"2023-07-09T02:13:43.458925+0000","last_clean":"2023-07-09T02:13:43.458925+0000","last_became_active":"2023-07-09T02:13:42.475136+0000","last_became_peered":"2023-07-09T02:13:42.475136+0000","last_unstale":"2023-07-09T02:13:43.458925+0000","last_undegraded":"2023-07-09T02:13:43.458925+0000","last_fullsized":"2023-07-09T02:13:43.458925+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:17:06.718658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"67'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468215+0000","last_change":"2023-07-09T02:13:41.464720+0000","last_active":"2023-07-09T02:13:43.468215+0000","last_peered":"2023-07-09T02:13:43.468215+0000","last_clean":"2023-07-09T02:13:43.468215+0000","last_became_active":"2023-07-09T02:13:41.464495+0000","last_became_peered":"2023-07-09T02:13:41.464495+0000","last_unstale":"2023-07-09T02:13:43.468215+0000","last_undegraded":"2023-07-09T02:13:43.468215+0000","last_fullsized":"2023-07-09T02:13:43.468215+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:48:43.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467821+0000","last_change":"2023-07-09T02:13:42.467444+0000","last_active":"2023-07-09T02:13:43.467821+0000","last_peered":"2023-07-09T02:13:43.467821+0000","last_clean":"2023-07-09T02:13:43.467821+0000","last_became_active":"2023-07-09T02:13:42.466859+0000","last_became_peered":"2023-07-09T02:13:42.466859+0000","last_unstale":"2023-07-09T02:13:43.467821+0000","last_undegraded":"2023-07-09T02:13:43.467821+0000","last_fullsized":"2023-07-09T02:13:43.467821+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:13:33.294913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460156+0000","last_change":"2023-07-09T02:13:41.467217+0000","last_active":"2023-07-09T02:13:43.460156+0000","last_peered":"2023-07-09T02:13:43.460156+0000","last_clean":"2023-07-09T02:13:43.460156+0000","last_became_active":"2023-07-09T02:13:41.466950+0000","last_became_peered":"2023-07-09T02:13:41.466950+0000","last_unstale":"2023-07-09T02:13:43.460156+0000","last_undegraded":"2023-07-09T02:13:43.460156+0000","last_fullsized":"2023-07-09T02:13:43.460156+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:53:33.176062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460427+0000","last_change":"2023-07-09T02:13:42.474996+0000","last_active":"2023-07-09T02:13:43.460427+0000","last_peered":"2023-07-09T02:13:43.460427+0000","last_clean":"2023-07-09T02:13:43.460427+0000","last_became_active":"2023-07-09T02:13:42.474001+0000","last_became_peered":"2023-07-09T02:13:42.474001+0000","last_unstale":"2023-07-09T02:13:43.460427+0000","last_undegraded":"2023-07-09T02:13:43.460427+0000","last_fullsized":"2023-07-09T02:13:43.460427+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:12.875359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460145+0000","last_change":"2023-07-09T02:13:41.461137+0000","last_active":"2023-07-09T02:13:43.460145+0000","last_peered":"2023-07-09T02:13:43.460145+0000","last_clean":"2023-07-09T02:13:43.460145+0000","last_became_active":"2023-07-09T02:13:41.460882+0000","last_became_peered":"2023-07-09T02:13:41.460882+0000","last_unstale":"2023-07-09T02:13:43.460145+0000","last_undegraded":"2023-07-09T02:13:43.460145+0000","last_fullsized":"2023-07-09T02:13:43.460145+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:35:28.485933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468411+0000","last_change":"2023-07-09T02:13:42.478692+0000","last_active":"2023-07-09T02:13:43.468411+0000","last_peered":"2023-07-09T02:13:43.468411+0000","last_clean":"2023-07-09T02:13:43.468411+0000","last_became_active":"2023-07-09T02:13:42.476989+0000","last_became_peered":"2023-07-09T02:13:42.476989+0000","last_unstale":"2023-07-09T02:13:43.468411+0000","last_undegraded":"2023-07-09T02:13:43.468411+0000","last_fullsized":"2023-07-09T02:13:43.468411+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:37:09.089373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460277+0000","last_change":"2023-07-09T02:13:41.461300+0000","last_active":"2023-07-09T02:13:43.460277+0000","last_peered":"2023-07-09T02:13:43.460277+0000","last_clean":"2023-07-09T02:13:43.460277+0000","last_became_active":"2023-07-09T02:13:41.460566+0000","last_became_peered":"2023-07-09T02:13:41.460566+0000","last_unstale":"2023-07-09T02:13:43.460277+0000","last_undegraded":"2023-07-09T02:13:43.460277+0000","last_fullsized":"2023-07-09T02:13:43.460277+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:07:54.374125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459379+0000","last_change":"2023-07-09T02:13:42.470739+0000","last_active":"2023-07-09T02:13:43.459379+0000","last_peered":"2023-07-09T02:13:43.459379+0000","last_clean":"2023-07-09T02:13:43.459379+0000","last_became_active":"2023-07-09T02:13:42.470489+0000","last_became_peered":"2023-07-09T02:13:42.470489+0000","last_unstale":"2023-07-09T02:13:43.459379+0000","last_undegraded":"2023-07-09T02:13:43.459379+0000","last_fullsized":"2023-07-09T02:13:43.459379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:09:07.846872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.469120+0000","last_change":"2023-07-09T02:13:41.463657+0000","last_active":"2023-07-09T02:13:43.469120+0000","last_peered":"2023-07-09T02:13:43.469120+0000","last_clean":"2023-07-09T02:13:43.469120+0000","last_became_active":"2023-07-09T02:13:41.462690+0000","last_became_peered":"2023-07-09T02:13:41.462690+0000","last_unstale":"2023-07-09T02:13:43.469120+0000","last_undegraded":"2023-07-09T02:13:43.469120+0000","last_fullsized":"2023-07-09T02:13:43.469120+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:17:34.456894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467999+0000","last_change":"2023-07-09T02:13:42.471586+0000","last_active":"2023-07-09T02:13:43.467999+0000","last_peered":"2023-07-09T02:13:43.467999+0000","last_clean":"2023-07-09T02:13:43.467999+0000","last_became_active":"2023-07-09T02:13:42.470580+0000","last_became_peered":"2023-07-09T02:13:42.470580+0000","last_unstale":"2023-07-09T02:13:43.467999+0000","last_undegraded":"2023-07-09T02:13:43.467999+0000","last_fullsized":"2023-07-09T02:13:43.467999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:46:35.479823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.469055+0000","last_change":"2023-07-09T02:13:41.461925+0000","last_active":"2023-07-09T02:13:43.469055+0000","last_peered":"2023-07-09T02:13:43.469055+0000","last_clean":"2023-07-09T02:13:43.469055+0000","last_became_active":"2023-07-09T02:13:41.461674+0000","last_became_peered":"2023-07-09T02:13:41.461674+0000","last_unstale":"2023-07-09T02:13:43.469055+0000","last_undegraded":"2023-07-09T02:13:43.469055+0000","last_fullsized":"2023-07-09T02:13:43.469055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:10:33.703733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.458970+0000","last_change":"2023-07-09T02:13:42.465132+0000","last_active":"2023-07-09T02:13:43.458970+0000","last_peered":"2023-07-09T02:13:43.458970+0000","last_clean":"2023-07-09T02:13:43.458970+0000","last_became_active":"2023-07-09T02:13:42.464458+0000","last_became_peered":"2023-07-09T02:13:42.464458+0000","last_unstale":"2023-07-09T02:13:43.458970+0000","last_undegraded":"2023-07-09T02:13:43.458970+0000","last_fullsized":"2023-07-09T02:13:43.458970+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:49:04.860523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468848+0000","last_change":"2023-07-09T02:13:41.470354+0000","last_active":"2023-07-09T02:13:43.468848+0000","last_peered":"2023-07-09T02:13:43.468848+0000","last_clean":"2023-07-09T02:13:43.468848+0000","last_became_active":"2023-07-09T02:13:41.470140+0000","last_became_peered":"2023-07-09T02:13:41.470140+0000","last_unstale":"2023-07-09T02:13:43.468848+0000","last_undegraded":"2023-07-09T02:13:43.468848+0000","last_fullsized":"2023-07-09T02:13:43.468848+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:21:13.548926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.469039+0000","last_change":"2023-07-09T02:13:42.463610+0000","last_active":"2023-07-09T02:13:43.469039+0000","last_peered":"2023-07-09T02:13:43.469039+0000","last_clean":"2023-07-09T02:13:43.469039+0000","last_became_active":"2023-07-09T02:13:42.463335+0000","last_became_peered":"2023-07-09T02:13:42.463335+0000","last_unstale":"2023-07-09T02:13:43.469039+0000","last_undegraded":"2023-07-09T02:13:43.469039+0000","last_fullsized":"2023-07-09T02:13:43.469039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:21:25.047398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459528+0000","last_change":"2023-07-09T02:13:41.469821+0000","last_active":"2023-07-09T02:13:43.459528+0000","last_peered":"2023-07-09T02:13:43.459528+0000","last_clean":"2023-07-09T02:13:43.459528+0000","last_became_active":"2023-07-09T02:13:41.469496+0000","last_became_peered":"2023-07-09T02:13:41.469496+0000","last_unstale":"2023-07-09T02:13:43.459528+0000","last_undegraded":"2023-07-09T02:13:43.459528+0000","last_fullsized":"2023-07-09T02:13:43.459528+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:31:18.925000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467863+0000","last_change":"2023-07-09T02:13:42.471746+0000","last_active":"2023-07-09T02:13:43.467863+0000","last_peered":"2023-07-09T02:13:43.467863+0000","last_clean":"2023-07-09T02:13:43.467863+0000","last_became_active":"2023-07-09T02:13:42.471347+0000","last_became_peered":"2023-07-09T02:13:42.471347+0000","last_unstale":"2023-07-09T02:13:43.467863+0000","last_undegraded":"2023-07-09T02:13:43.467863+0000","last_fullsized":"2023-07-09T02:13:43.467863+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:08:19.048446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467467+0000","last_change":"2023-07-09T02:13:41.462981+0000","last_active":"2023-07-09T02:13:43.467467+0000","last_peered":"2023-07-09T02:13:43.467467+0000","last_clean":"2023-07-09T02:13:43.467467+0000","last_became_active":"2023-07-09T02:13:41.462353+0000","last_became_peered":"2023-07-09T02:13:41.462353+0000","last_unstale":"2023-07-09T02:13:43.467467+0000","last_undegraded":"2023-07-09T02:13:43.467467+0000","last_fullsized":"2023-07-09T02:13:43.467467+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:32:58.912482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468965+0000","last_change":"2023-07-09T02:13:42.465104+0000","last_active":"2023-07-09T02:13:43.468965+0000","last_peered":"2023-07-09T02:13:43.468965+0000","last_clean":"2023-07-09T02:13:43.468965+0000","last_became_active":"2023-07-09T02:13:42.464870+0000","last_became_peered":"2023-07-09T02:13:42.464870+0000","last_unstale":"2023-07-09T02:13:43.468965+0000","last_undegraded":"2023-07-09T02:13:43.468965+0000","last_fullsized":"2023-07-09T02:13:43.468965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:30:28.116541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467736+0000","last_change":"2023-07-09T02:13:41.462388+0000","last_active":"2023-07-09T02:13:43.467736+0000","last_peered":"2023-07-09T02:13:43.467736+0000","last_clean":"2023-07-09T02:13:43.467736+0000","last_became_active":"2023-07-09T02:13:41.462122+0000","last_became_peered":"2023-07-09T02:13:41.462122+0000","last_unstale":"2023-07-09T02:13:43.467736+0000","last_undegraded":"2023-07-09T02:13:43.467736+0000","last_fullsized":"2023-07-09T02:13:43.467736+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:48:48.695649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.458870+0000","last_change":"2023-07-09T02:13:42.468612+0000","last_active":"2023-07-09T02:13:43.458870+0000","last_peered":"2023-07-09T02:13:43.458870+0000","last_clean":"2023-07-09T02:13:43.458870+0000","last_became_active":"2023-07-09T02:13:42.468395+0000","last_became_peered":"2023-07-09T02:13:42.468395+0000","last_unstale":"2023-07-09T02:13:43.458870+0000","last_undegraded":"2023-07-09T02:13:43.458870+0000","last_fullsized":"2023-07-09T02:13:43.458870+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:11:56.250404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"67'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468548+0000","last_change":"2023-07-09T02:13:41.466984+0000","last_active":"2023-07-09T02:13:43.468548+0000","last_peered":"2023-07-09T02:13:43.468548+0000","last_clean":"2023-07-09T02:13:43.468548+0000","last_became_active":"2023-07-09T02:13:41.466423+0000","last_became_peered":"2023-07-09T02:13:41.466423+0000","last_unstale":"2023-07-09T02:13:43.468548+0000","last_undegraded":"2023-07-09T02:13:43.468548+0000","last_fullsized":"2023-07-09T02:13:43.468548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:03:42.969050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468249+0000","last_change":"2023-07-09T02:13:42.464351+0000","last_active":"2023-07-09T02:13:43.468249+0000","last_peered":"2023-07-09T02:13:43.468249+0000","last_clean":"2023-07-09T02:13:43.468249+0000","last_became_active":"2023-07-09T02:13:42.463537+0000","last_became_peered":"2023-07-09T02:13:42.463537+0000","last_unstale":"2023-07-09T02:13:43.468249+0000","last_undegraded":"2023-07-09T02:13:43.468249+0000","last_fullsized":"2023-07-09T02:13:43.468249+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:54:43.947737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"67'6","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468297+0000","last_change":"2023-07-09T02:13:41.463200+0000","last_active":"2023-07-09T02:13:43.468297+0000","last_peered":"2023-07-09T02:13:43.468297+0000","last_clean":"2023-07-09T02:13:43.468297+0000","last_became_active":"2023-07-09T02:13:41.462956+0000","last_became_peered":"2023-07-09T02:13:41.462956+0000","last_unstale":"2023-07-09T02:13:43.468297+0000","last_undegraded":"2023-07-09T02:13:43.468297+0000","last_fullsized":"2023-07-09T02:13:43.468297+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:14:55.306802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467417+0000","last_change":"2023-07-09T02:13:42.472798+0000","last_active":"2023-07-09T02:13:43.467417+0000","last_peered":"2023-07-09T02:13:43.467417+0000","last_clean":"2023-07-09T02:13:43.467417+0000","last_became_active":"2023-07-09T02:13:42.472030+0000","last_became_peered":"2023-07-09T02:13:42.472030+0000","last_unstale":"2023-07-09T02:13:43.467417+0000","last_undegraded":"2023-07-09T02:13:43.467417+0000","last_fullsized":"2023-07-09T02:13:43.467417+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:34:59.397952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468166+0000","last_change":"2023-07-09T02:13:41.468454+0000","last_active":"2023-07-09T02:13:43.468166+0000","last_peered":"2023-07-09T02:13:43.468166+0000","last_clean":"2023-07-09T02:13:43.468166+0000","last_became_active":"2023-07-09T02:13:41.468027+0000","last_became_peered":"2023-07-09T02:13:41.468027+0000","last_unstale":"2023-07-09T02:13:43.468166+0000","last_undegraded":"2023-07-09T02:13:43.468166+0000","last_fullsized":"2023-07-09T02:13:43.468166+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:32:17.027572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678341+0000","last_change":"2023-07-09T02:13:42.467495+0000","last_active":"2023-07-09T02:13:43.678341+0000","last_peered":"2023-07-09T02:13:43.678341+0000","last_clean":"2023-07-09T02:13:43.678341+0000","last_became_active":"2023-07-09T02:13:42.467255+0000","last_became_peered":"2023-07-09T02:13:42.467255+0000","last_unstale":"2023-07-09T02:13:43.678341+0000","last_undegraded":"2023-07-09T02:13:43.678341+0000","last_fullsized":"2023-07-09T02:13:43.678341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:34.942151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678785+0000","last_change":"2023-07-09T02:13:41.456678+0000","last_active":"2023-07-09T02:13:43.678785+0000","last_peered":"2023-07-09T02:13:43.678785+0000","last_clean":"2023-07-09T02:13:43.678785+0000","last_became_active":"2023-07-09T02:13:41.456458+0000","last_became_peered":"2023-07-09T02:13:41.456458+0000","last_unstale":"2023-07-09T02:13:43.678785+0000","last_undegraded":"2023-07-09T02:13:43.678785+0000","last_fullsized":"2023-07-09T02:13:43.678785+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:27:34.305295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459088+0000","last_change":"2023-07-09T02:13:42.475371+0000","last_active":"2023-07-09T02:13:43.459088+0000","last_peered":"2023-07-09T02:13:43.459088+0000","last_clean":"2023-07-09T02:13:43.459088+0000","last_became_active":"2023-07-09T02:13:42.474782+0000","last_became_peered":"2023-07-09T02:13:42.474782+0000","last_unstale":"2023-07-09T02:13:43.459088+0000","last_undegraded":"2023-07-09T02:13:43.459088+0000","last_fullsized":"2023-07-09T02:13:43.459088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:29:39.226479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468215+0000","last_change":"2023-07-09T02:13:41.466752+0000","last_active":"2023-07-09T02:13:43.468215+0000","last_peered":"2023-07-09T02:13:43.468215+0000","last_clean":"2023-07-09T02:13:43.468215+0000","last_became_active":"2023-07-09T02:13:41.466370+0000","last_became_peered":"2023-07-09T02:13:41.466370+0000","last_unstale":"2023-07-09T02:13:43.468215+0000","last_undegraded":"2023-07-09T02:13:43.468215+0000","last_fullsized":"2023-07-09T02:13:43.468215+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:46:35.208644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468226+0000","last_change":"2023-07-09T02:13:42.471581+0000","last_active":"2023-07-09T02:13:43.468226+0000","last_peered":"2023-07-09T02:13:43.468226+0000","last_clean":"2023-07-09T02:13:43.468226+0000","last_became_active":"2023-07-09T02:13:42.471197+0000","last_became_peered":"2023-07-09T02:13:42.471197+0000","last_unstale":"2023-07-09T02:13:43.468226+0000","last_undegraded":"2023-07-09T02:13:43.468226+0000","last_fullsized":"2023-07-09T02:13:43.468226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:17:15.693995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"67'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467687+0000","last_change":"2023-07-09T02:13:41.469428+0000","last_active":"2023-07-09T02:13:43.467687+0000","last_peered":"2023-07-09T02:13:43.467687+0000","last_clean":"2023-07-09T02:13:43.467687+0000","last_became_active":"2023-07-09T02:13:41.469130+0000","last_became_peered":"2023-07-09T02:13:41.469130+0000","last_unstale":"2023-07-09T02:13:43.467687+0000","last_undegraded":"2023-07-09T02:13:43.467687+0000","last_fullsized":"2023-07-09T02:13:43.467687+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:06:38.288511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460047+0000","last_change":"2023-07-09T02:13:42.464370+0000","last_active":"2023-07-09T02:13:43.460047+0000","last_peered":"2023-07-09T02:13:43.460047+0000","last_clean":"2023-07-09T02:13:43.460047+0000","last_became_active":"2023-07-09T02:13:42.464140+0000","last_became_peered":"2023-07-09T02:13:42.464140+0000","last_unstale":"2023-07-09T02:13:43.460047+0000","last_undegraded":"2023-07-09T02:13:43.460047+0000","last_fullsized":"2023-07-09T02:13:43.460047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:07:51.281420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678409+0000","last_change":"2023-07-09T02:13:41.465018+0000","last_active":"2023-07-09T02:13:43.678409+0000","last_peered":"2023-07-09T02:13:43.678409+0000","last_clean":"2023-07-09T02:13:43.678409+0000","last_became_active":"2023-07-09T02:13:41.464779+0000","last_became_peered":"2023-07-09T02:13:41.464779+0000","last_unstale":"2023-07-09T02:13:43.678409+0000","last_undegraded":"2023-07-09T02:13:43.678409+0000","last_fullsized":"2023-07-09T02:13:43.678409+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:48:43.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459266+0000","last_change":"2023-07-09T02:13:42.476537+0000","last_active":"2023-07-09T02:13:43.459266+0000","last_peered":"2023-07-09T02:13:43.459266+0000","last_clean":"2023-07-09T02:13:43.459266+0000","last_became_active":"2023-07-09T02:13:42.476241+0000","last_became_peered":"2023-07-09T02:13:42.476241+0000","last_unstale":"2023-07-09T02:13:43.459266+0000","last_undegraded":"2023-07-09T02:13:43.459266+0000","last_fullsized":"2023-07-09T02:13:43.459266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:26:19.793220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678562+0000","last_change":"2023-07-09T02:13:41.459484+0000","last_active":"2023-07-09T02:13:43.678562+0000","last_peered":"2023-07-09T02:13:43.678562+0000","last_clean":"2023-07-09T02:13:43.678562+0000","last_became_active":"2023-07-09T02:13:41.458494+0000","last_became_peered":"2023-07-09T02:13:41.458494+0000","last_unstale":"2023-07-09T02:13:43.678562+0000","last_undegraded":"2023-07-09T02:13:43.678562+0000","last_fullsized":"2023-07-09T02:13:43.678562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:10:47.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678482+0000","last_change":"2023-07-09T02:13:42.466692+0000","last_active":"2023-07-09T02:13:43.678482+0000","last_peered":"2023-07-09T02:13:43.678482+0000","last_clean":"2023-07-09T02:13:43.678482+0000","last_became_active":"2023-07-09T02:13:42.466343+0000","last_became_peered":"2023-07-09T02:13:42.466343+0000","last_unstale":"2023-07-09T02:13:43.678482+0000","last_undegraded":"2023-07-09T02:13:43.678482+0000","last_fullsized":"2023-07-09T02:13:43.678482+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:03:15.532032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460272+0000","last_change":"2023-07-09T02:13:41.458671+0000","last_active":"2023-07-09T02:13:43.460272+0000","last_peered":"2023-07-09T02:13:43.460272+0000","last_clean":"2023-07-09T02:13:43.460272+0000","last_became_active":"2023-07-09T02:13:41.458438+0000","last_became_peered":"2023-07-09T02:13:41.458438+0000","last_unstale":"2023-07-09T02:13:43.460272+0000","last_undegraded":"2023-07-09T02:13:43.460272+0000","last_fullsized":"2023-07-09T02:13:43.460272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:15:36.300655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459043+0000","last_change":"2023-07-09T02:13:42.471171+0000","last_active":"2023-07-09T02:13:43.459043+0000","last_peered":"2023-07-09T02:13:43.459043+0000","last_clean":"2023-07-09T02:13:43.459043+0000","last_became_active":"2023-07-09T02:13:42.470886+0000","last_became_peered":"2023-07-09T02:13:42.470886+0000","last_unstale":"2023-07-09T02:13:43.459043+0000","last_undegraded":"2023-07-09T02:13:43.459043+0000","last_fullsized":"2023-07-09T02:13:43.459043+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:07:56.356158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468355+0000","last_change":"2023-07-09T02:13:41.463283+0000","last_active":"2023-07-09T02:13:43.468355+0000","last_peered":"2023-07-09T02:13:43.468355+0000","last_clean":"2023-07-09T02:13:43.468355+0000","last_became_active":"2023-07-09T02:13:41.463037+0000","last_became_peered":"2023-07-09T02:13:41.463037+0000","last_unstale":"2023-07-09T02:13:43.468355+0000","last_undegraded":"2023-07-09T02:13:43.468355+0000","last_fullsized":"2023-07-09T02:13:43.468355+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:10:47.634877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459377+0000","last_change":"2023-07-09T02:13:42.479632+0000","last_active":"2023-07-09T02:13:43.459377+0000","last_peered":"2023-07-09T02:13:43.459377+0000","last_clean":"2023-07-09T02:13:43.459377+0000","last_became_active":"2023-07-09T02:13:42.479202+0000","last_became_peered":"2023-07-09T02:13:42.479202+0000","last_unstale":"2023-07-09T02:13:43.459377+0000","last_undegraded":"2023-07-09T02:13:43.459377+0000","last_fullsized":"2023-07-09T02:13:43.459377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:30:05.465802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467806+0000","last_change":"2023-07-09T02:13:41.465731+0000","last_active":"2023-07-09T02:13:43.467806+0000","last_peered":"2023-07-09T02:13:43.467806+0000","last_clean":"2023-07-09T02:13:43.467806+0000","last_became_active":"2023-07-09T02:13:41.465408+0000","last_became_peered":"2023-07-09T02:13:41.465408+0000","last_unstale":"2023-07-09T02:13:43.467806+0000","last_undegraded":"2023-07-09T02:13:43.467806+0000","last_fullsized":"2023-07-09T02:13:43.467806+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:53:33.176062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467575+0000","last_change":"2023-07-09T02:13:42.472950+0000","last_active":"2023-07-09T02:13:43.467575+0000","last_peered":"2023-07-09T02:13:43.467575+0000","last_clean":"2023-07-09T02:13:43.467575+0000","last_became_active":"2023-07-09T02:13:42.472566+0000","last_became_peered":"2023-07-09T02:13:42.472566+0000","last_unstale":"2023-07-09T02:13:43.467575+0000","last_undegraded":"2023-07-09T02:13:43.467575+0000","last_fullsized":"2023-07-09T02:13:43.467575+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:04:11.658750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.469390+0000","last_change":"2023-07-09T02:13:41.462990+0000","last_active":"2023-07-09T02:13:43.469390+0000","last_peered":"2023-07-09T02:13:43.469390+0000","last_clean":"2023-07-09T02:13:43.469390+0000","last_became_active":"2023-07-09T02:13:41.462389+0000","last_became_peered":"2023-07-09T02:13:41.462389+0000","last_unstale":"2023-07-09T02:13:43.469390+0000","last_undegraded":"2023-07-09T02:13:43.469390+0000","last_fullsized":"2023-07-09T02:13:43.469390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:35:24.811975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468169+0000","last_change":"2023-07-09T02:13:42.471339+0000","last_active":"2023-07-09T02:13:43.468169+0000","last_peered":"2023-07-09T02:13:43.468169+0000","last_clean":"2023-07-09T02:13:43.468169+0000","last_became_active":"2023-07-09T02:13:42.470964+0000","last_became_peered":"2023-07-09T02:13:42.470964+0000","last_unstale":"2023-07-09T02:13:43.468169+0000","last_undegraded":"2023-07-09T02:13:43.468169+0000","last_fullsized":"2023-07-09T02:13:43.468169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:34.942151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.469172+0000","last_change":"2023-07-09T02:13:41.468970+0000","last_active":"2023-07-09T02:13:43.469172+0000","last_peered":"2023-07-09T02:13:43.469172+0000","last_clean":"2023-07-09T02:13:43.469172+0000","last_became_active":"2023-07-09T02:13:41.468746+0000","last_became_peered":"2023-07-09T02:13:41.468746+0000","last_unstale":"2023-07-09T02:13:43.469172+0000","last_undegraded":"2023-07-09T02:13:43.469172+0000","last_fullsized":"2023-07-09T02:13:43.469172+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:18:57.138963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459598+0000","last_change":"2023-07-09T02:13:42.477237+0000","last_active":"2023-07-09T02:13:43.459598+0000","last_peered":"2023-07-09T02:13:43.459598+0000","last_clean":"2023-07-09T02:13:43.459598+0000","last_became_active":"2023-07-09T02:13:42.476079+0000","last_became_peered":"2023-07-09T02:13:42.476079+0000","last_unstale":"2023-07-09T02:13:43.459598+0000","last_undegraded":"2023-07-09T02:13:43.459598+0000","last_fullsized":"2023-07-09T02:13:43.459598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:04:02.967278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468150+0000","last_change":"2023-07-09T02:13:41.469868+0000","last_active":"2023-07-09T02:13:43.468150+0000","last_peered":"2023-07-09T02:13:43.468150+0000","last_clean":"2023-07-09T02:13:43.468150+0000","last_became_active":"2023-07-09T02:13:41.469652+0000","last_became_peered":"2023-07-09T02:13:41.469652+0000","last_unstale":"2023-07-09T02:13:43.468150+0000","last_undegraded":"2023-07-09T02:13:43.468150+0000","last_fullsized":"2023-07-09T02:13:43.468150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:47:16.470910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459132+0000","last_change":"2023-07-09T02:13:42.470001+0000","last_active":"2023-07-09T02:13:43.459132+0000","last_peered":"2023-07-09T02:13:43.459132+0000","last_clean":"2023-07-09T02:13:43.459132+0000","last_became_active":"2023-07-09T02:13:42.469635+0000","last_became_peered":"2023-07-09T02:13:42.469635+0000","last_unstale":"2023-07-09T02:13:43.459132+0000","last_undegraded":"2023-07-09T02:13:43.459132+0000","last_fullsized":"2023-07-09T02:13:43.459132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:04:32.496617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468958+0000","last_change":"2023-07-09T02:13:41.462508+0000","last_active":"2023-07-09T02:13:43.468958+0000","last_peered":"2023-07-09T02:13:43.468958+0000","last_clean":"2023-07-09T02:13:43.468958+0000","last_became_active":"2023-07-09T02:13:41.462286+0000","last_became_peered":"2023-07-09T02:13:41.462286+0000","last_unstale":"2023-07-09T02:13:43.468958+0000","last_undegraded":"2023-07-09T02:13:43.468958+0000","last_fullsized":"2023-07-09T02:13:43.468958+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:56:52.138853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":250,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468074+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:13:43.468074+0000","last_peered":"2023-07-09T02:13:43.468074+0000","last_clean":"2023-07-09T02:13:43.468074+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:13:43.468074+0000","last_undegraded":"2023-07-09T02:13:43.468074+0000","last_fullsized":"2023-07-09T02:13:43.468074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:45:38.505750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678855+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:13:43.678855+0000","last_peered":"2023-07-09T02:13:43.678855+0000","last_clean":"2023-07-09T02:13:43.678855+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:13:43.678855+0000","last_undegraded":"2023-07-09T02:13:43.678855+0000","last_fullsized":"2023-07-09T02:13:43.678855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:31:33.769567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460221+0000","last_change":"2023-07-09T02:13:42.472525+0000","last_active":"2023-07-09T02:13:43.460221+0000","last_peered":"2023-07-09T02:13:43.460221+0000","last_clean":"2023-07-09T02:13:43.460221+0000","last_became_active":"2023-07-09T02:13:42.472302+0000","last_became_peered":"2023-07-09T02:13:42.472302+0000","last_unstale":"2023-07-09T02:13:43.460221+0000","last_undegraded":"2023-07-09T02:13:43.460221+0000","last_fullsized":"2023-07-09T02:13:43.460221+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:56:01.295832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460133+0000","last_change":"2023-07-09T02:13:41.468439+0000","last_active":"2023-07-09T02:13:43.460133+0000","last_peered":"2023-07-09T02:13:43.460133+0000","last_clean":"2023-07-09T02:13:43.460133+0000","last_became_active":"2023-07-09T02:13:41.468288+0000","last_became_peered":"2023-07-09T02:13:41.468288+0000","last_unstale":"2023-07-09T02:13:43.460133+0000","last_undegraded":"2023-07-09T02:13:43.460133+0000","last_fullsized":"2023-07-09T02:13:43.460133+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:32:58.912482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467938+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:13:43.467938+0000","last_peered":"2023-07-09T02:13:43.467938+0000","last_clean":"2023-07-09T02:13:43.467938+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:13:43.467938+0000","last_undegraded":"2023-07-09T02:13:43.467938+0000","last_fullsized":"2023-07-09T02:13:43.467938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:05:25.043246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678631+0000","last_change":"2023-07-09T02:13:42.469870+0000","last_active":"2023-07-09T02:13:43.678631+0000","last_peered":"2023-07-09T02:13:43.678631+0000","last_clean":"2023-07-09T02:13:43.678631+0000","last_became_active":"2023-07-09T02:13:42.469358+0000","last_became_peered":"2023-07-09T02:13:42.469358+0000","last_unstale":"2023-07-09T02:13:43.678631+0000","last_undegraded":"2023-07-09T02:13:43.678631+0000","last_fullsized":"2023-07-09T02:13:43.678631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:50:52.407695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678313+0000","last_change":"2023-07-09T02:13:41.459998+0000","last_active":"2023-07-09T02:13:43.678313+0000","last_peered":"2023-07-09T02:13:43.678313+0000","last_clean":"2023-07-09T02:13:43.678313+0000","last_became_active":"2023-07-09T02:13:41.459384+0000","last_became_peered":"2023-07-09T02:13:41.459384+0000","last_unstale":"2023-07-09T02:13:43.678313+0000","last_undegraded":"2023-07-09T02:13:43.678313+0000","last_fullsized":"2023-07-09T02:13:43.678313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:47:16.470910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459230+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:13:43.459230+0000","last_peered":"2023-07-09T02:13:43.459230+0000","last_clean":"2023-07-09T02:13:43.459230+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:13:43.459230+0000","last_undegraded":"2023-07-09T02:13:43.459230+0000","last_fullsized":"2023-07-09T02:13:43.459230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:32:58.975177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459244+0000","last_change":"2023-07-09T02:13:42.475763+0000","last_active":"2023-07-09T02:13:43.459244+0000","last_peered":"2023-07-09T02:13:43.459244+0000","last_clean":"2023-07-09T02:13:43.459244+0000","last_became_active":"2023-07-09T02:13:42.475536+0000","last_became_peered":"2023-07-09T02:13:42.475536+0000","last_unstale":"2023-07-09T02:13:43.459244+0000","last_undegraded":"2023-07-09T02:13:43.459244+0000","last_fullsized":"2023-07-09T02:13:43.459244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:10:40.272975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.460270+0000","last_change":"2023-07-09T02:13:41.470471+0000","last_active":"2023-07-09T02:13:43.460270+0000","last_peered":"2023-07-09T02:13:43.460270+0000","last_clean":"2023-07-09T02:13:43.460270+0000","last_became_active":"2023-07-09T02:13:41.470233+0000","last_became_peered":"2023-07-09T02:13:41.470233+0000","last_unstale":"2023-07-09T02:13:43.460270+0000","last_undegraded":"2023-07-09T02:13:43.460270+0000","last_fullsized":"2023-07-09T02:13:43.460270+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:04:50.729498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678518+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:13:43.678518+0000","last_peered":"2023-07-09T02:13:43.678518+0000","last_clean":"2023-07-09T02:13:43.678518+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:13:43.678518+0000","last_undegraded":"2023-07-09T02:13:43.678518+0000","last_fullsized":"2023-07-09T02:13:43.678518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:33:21.241000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468017+0000","last_change":"2023-07-09T02:13:42.470941+0000","last_active":"2023-07-09T02:13:43.468017+0000","last_peered":"2023-07-09T02:13:43.468017+0000","last_clean":"2023-07-09T02:13:43.468017+0000","last_became_active":"2023-07-09T02:13:42.470589+0000","last_became_peered":"2023-07-09T02:13:42.470589+0000","last_unstale":"2023-07-09T02:13:43.468017+0000","last_undegraded":"2023-07-09T02:13:43.468017+0000","last_fullsized":"2023-07-09T02:13:43.468017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:15:37.312414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.678131+0000","last_change":"2023-07-09T02:13:41.459751+0000","last_active":"2023-07-09T02:13:43.678131+0000","last_peered":"2023-07-09T02:13:43.678131+0000","last_clean":"2023-07-09T02:13:43.678131+0000","last_became_active":"2023-07-09T02:13:41.459085+0000","last_became_peered":"2023-07-09T02:13:41.459085+0000","last_unstale":"2023-07-09T02:13:43.678131+0000","last_undegraded":"2023-07-09T02:13:43.678131+0000","last_fullsized":"2023-07-09T02:13:43.678131+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:46:34.468065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468462+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:13:43.468462+0000","last_peered":"2023-07-09T02:13:43.468462+0000","last_clean":"2023-07-09T02:13:43.468462+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:13:43.468462+0000","last_undegraded":"2023-07-09T02:13:43.468462+0000","last_fullsized":"2023-07-09T02:13:43.468462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:48:22.065057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459236+0000","last_change":"2023-07-09T02:13:42.468859+0000","last_active":"2023-07-09T02:13:43.459236+0000","last_peered":"2023-07-09T02:13:43.459236+0000","last_clean":"2023-07-09T02:13:43.459236+0000","last_became_active":"2023-07-09T02:13:42.467937+0000","last_became_peered":"2023-07-09T02:13:42.467937+0000","last_unstale":"2023-07-09T02:13:43.459236+0000","last_undegraded":"2023-07-09T02:13:43.459236+0000","last_fullsized":"2023-07-09T02:13:43.459236+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:25:00.569503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468349+0000","last_change":"2023-07-09T02:13:41.468291+0000","last_active":"2023-07-09T02:13:43.468349+0000","last_peered":"2023-07-09T02:13:43.468349+0000","last_clean":"2023-07-09T02:13:43.468349+0000","last_became_active":"2023-07-09T02:13:41.467740+0000","last_became_peered":"2023-07-09T02:13:41.467740+0000","last_unstale":"2023-07-09T02:13:43.468349+0000","last_undegraded":"2023-07-09T02:13:43.468349+0000","last_fullsized":"2023-07-09T02:13:43.468349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:53:13.183860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467663+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:13:43.467663+0000","last_peered":"2023-07-09T02:13:43.467663+0000","last_clean":"2023-07-09T02:13:43.467663+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:13:43.467663+0000","last_undegraded":"2023-07-09T02:13:43.467663+0000","last_fullsized":"2023-07-09T02:13:43.467663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:32:59.155054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467959+0000","last_change":"2023-07-09T02:13:42.467595+0000","last_active":"2023-07-09T02:13:43.467959+0000","last_peered":"2023-07-09T02:13:43.467959+0000","last_clean":"2023-07-09T02:13:43.467959+0000","last_became_active":"2023-07-09T02:13:42.467191+0000","last_became_peered":"2023-07-09T02:13:42.467191+0000","last_unstale":"2023-07-09T02:13:43.467959+0000","last_undegraded":"2023-07-09T02:13:43.467959+0000","last_fullsized":"2023-07-09T02:13:43.467959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:59:50.016825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.467648+0000","last_change":"2023-07-09T02:13:41.463157+0000","last_active":"2023-07-09T02:13:43.467648+0000","last_peered":"2023-07-09T02:13:43.467648+0000","last_clean":"2023-07-09T02:13:43.467648+0000","last_became_active":"2023-07-09T02:13:41.462679+0000","last_became_peered":"2023-07-09T02:13:41.462679+0000","last_unstale":"2023-07-09T02:13:43.467648+0000","last_undegraded":"2023-07-09T02:13:43.467648+0000","last_fullsized":"2023-07-09T02:13:43.467648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:20:30.789482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.468341+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:13:43.468341+0000","last_peered":"2023-07-09T02:13:43.468341+0000","last_clean":"2023-07-09T02:13:43.468341+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:13:43.468341+0000","last_undegraded":"2023-07-09T02:13:43.468341+0000","last_fullsized":"2023-07-09T02:13:43.468341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:33:21.241000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.458823+0000","last_change":"2023-07-09T02:13:42.471756+0000","last_active":"2023-07-09T02:13:43.458823+0000","last_peered":"2023-07-09T02:13:43.458823+0000","last_clean":"2023-07-09T02:13:43.458823+0000","last_became_active":"2023-07-09T02:13:42.471010+0000","last_became_peered":"2023-07-09T02:13:42.471010+0000","last_unstale":"2023-07-09T02:13:43.458823+0000","last_undegraded":"2023-07-09T02:13:43.458823+0000","last_fullsized":"2023-07-09T02:13:43.458823+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:41.446102+0000","last_clean_scrub_stamp":"2023-07-09T02:13:41.446102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:38:59.303440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.469233+0000","last_change":"2023-07-09T02:13:41.465252+0000","last_active":"2023-07-09T02:13:43.469233+0000","last_peered":"2023-07-09T02:13:43.469233+0000","last_clean":"2023-07-09T02:13:43.469233+0000","last_became_active":"2023-07-09T02:13:41.464975+0000","last_became_peered":"2023-07-09T02:13:41.464975+0000","last_unstale":"2023-07-09T02:13:43.469233+0000","last_undegraded":"2023-07-09T02:13:43.469233+0000","last_fullsized":"2023-07-09T02:13:43.469233+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:13:40.434343+0000","last_clean_scrub_stamp":"2023-07-09T02:13:40.434343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:27:13.659751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T02:13:43.459143+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:13:43.459143+0000","last_peered":"2023-07-09T02:13:43.459143+0000","last_clean":"2023-07-09T02:13:43.459143+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:13:43.459143+0000","last_undegraded":"2023-07-09T02:13:43.459143+0000","last_fullsized":"2023-07-09T02:13:43.459143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:29.686711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":937,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194375,"statfs":{"total":200000000,"available":199040387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0069999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96099999999999997,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.84099999999999997},{"interface":"front","average":{"1min":2.3580000000000001,"5min":1.018,"15min":0.79500000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":29.498999999999999,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.72699999999999998,"15min":0.69799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0460000000000003,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":2.028,"5min":0.98399999999999999,"15min":0.81000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":26.524000000000001,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.93700000000000006}]},{"osd":3,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":4.3789999999999996,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.238,"5min":0.84399999999999997,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":10.609999999999999,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.498,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.60199999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":359,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194952,"statfs":{"total":200000000,"available":199631497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86299999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.91300000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.89100000000000001,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.60599999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90700000000000003,"5min":1.165,"15min":1.165},"last":0.78300000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.505,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72099999999999997,"15min":0.72199999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99299999999999999,"5min":0.996,"15min":0.996},"last":0.66800000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.56100000000000005,"5min":0.501,"15min":0.501},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88500000000000001,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94399999999999995,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.86799999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85799999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.84399999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.45100000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.83799999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.75}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":359,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194952,"statfs":{"total":200000000,"available":199631509,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41599999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.66400000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.503,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68300000000000005}]},{"osd":2,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.47199999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69999999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53800000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61199999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.502}]},{"osd":6,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.45600000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71099999999999997,"15min":0.70199999999999996},"min":{"1min":0.47699999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76300000000000001,"15min":0.754},"min":{"1min":0.52700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.75700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194951,"statfs":{"total":200000000,"available":199629967,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":3.6190000000000002,"5min":1.2490000000000001,"15min":0.85399999999999998},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":50.508000000000003,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.70999999999999996,"15min":0.64000000000000001},"min":{"1min":0.5,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":8.6039999999999992,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0189999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.71899999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.45700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.96099999999999997,"5min":1.323,"15min":1.323},"last":0.67800000000000005}]},{"osd":3,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":4.8869999999999996,"5min":1.5029999999999999,"15min":0.93899999999999995},"min":{"1min":0.55700000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":71.909000000000006,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.73899999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44}]},{"osd":6,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.68600000000000005,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":7.9909999999999997,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46899999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:13:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90300000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":0.77500000000000002,"15min":0.71399999999999997},"min":{"1min":0.55100000000000005,"5min":0.503,"15min":0.503},"max":{"1min":8.0359999999999996,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.64400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":359,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194952,"statfs":{"total":200000000,"available":199631531,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41099999999999998,"15min":0.41599999999999998},"min":{"1min":0.26500000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.58399999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64100000000000001,"5min":1.198,"15min":1.198},"last":0.58099999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.68600000000000005,"5min":1.048,"15min":1.048},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.51300000000000001,"15min":0.51800000000000002},"min":{"1min":0.33500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.75,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.51900000000000002,"15min":0.53300000000000003},"min":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":1.155,"15min":1.155},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68799999999999994,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.45400000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72799999999999998,"15min":0.73399999999999999},"min":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85599999999999998,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.292},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.57899999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.3560000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1,"5min":1,"15min":1},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.751,"15min":0.751},"min":{"1min":0.56200000000000006,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.97099999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.64700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94899999999999995,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.1899999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.95999999999999996,"5min":1.26,"15min":1.26},"last":1.367},{"interface":"front","average":{"1min":0.752,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.59699999999999998,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.085}]}]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":359,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194952,"statfs":{"total":200000000,"available":199631531,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.48699999999999999,"15min":0.42299999999999999},"min":{"1min":0.29999999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":7.7450000000000001,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.55800000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.48099999999999998,"15min":0.46500000000000002},"min":{"1min":0.308,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.55600000000000005,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":7.8710000000000004,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.496}]},{"osd":4,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":0.80200000000000005,"15min":0.749},"min":{"1min":0.52500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":7.7990000000000004,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.496,"15min":0.496},"max":{"1min":0.96599999999999997,"5min":1.319,"15min":1.319},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":0.82399999999999995,"15min":0.77200000000000002},"min":{"1min":0.56200000000000006,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":7.8369999999999997,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.626,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.64400000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.89800000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.206,"5min":1.351,"15min":1.351},"last":0.87}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":34,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":362,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194950,"statfs":{"total":200000000,"available":199629203,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.44600000000000001,"15min":0.45400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59799999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45600000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.502}]},{"osd":2,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48599999999999999,"15min":0.49099999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.57499999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.51400000000000001,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83899999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.63500000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78300000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85699999999999998,"5min":1.163,"15min":1.163},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.72199999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90200000000000002,"5min":1.026,"15min":1.026},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73099999999999998,"15min":0.72899999999999998},"min":{"1min":0.56100000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.98999999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56899999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93600000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.71899999999999997,"15min":0.71399999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":1.016}]},{"osd":6,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.66700000000000004,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.66000000000000003,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.92500000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.99199999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":936,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194376,"statfs":{"total":200000000,"available":199041163,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.28899999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.62,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.438,"15min":0.43099999999999999},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.437}]},{"osd":3,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.40999999999999998,"15min":0.40400000000000003},"min":{"1min":0.33400000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.51400000000000001,"15min":0.49399999999999999},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.54800000000000004}]},{"osd":4,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.77100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.032,"5min":1.145,"15min":1.145},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77900000000000003,"15min":0.78100000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.871}]},{"osd":5,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80300000000000005,"15min":0.80200000000000005},"min":{"1min":0.57299999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0389999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.76900000000000002},"min":{"1min":0.55000000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1180000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.89800000000000002}]}]}],"pool_statfs":[]}} 2023-07-09T02:13:46.988 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:13:46.989 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:13:47.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.163+0000 7f50acabd640 1 Processor -- start 2023-07-09T02:13:47.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50acabd640 1 -- start start 2023-07-09T02:13:47.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50acabd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50a80b59b0 0x7f50a80b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50acabd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a80ced10 con 0x7f50a815c410 2023-07-09T02:13:47.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50acabd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a815c7e0 con 0x7f50a80d2340 2023-07-09T02:13:47.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50acabd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a80cd1b0 con 0x7f50a80b59b0 2023-07-09T02:13:47.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50a659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f50a815c410 0x7f50a81608a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39136/0 (socket says 172.21.15.45:39136) 2023-07-09T02:13:47.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50a659c640 1 -- 172.21.15.45:0/797882576 learned_addr learned my addr 172.21.15.45:0/797882576 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:47.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f509dd9b640 1 --2- 172.21.15.45:0/797882576 >> v2:172.21.15.155:3300/0 conn(0x7f50a80b59b0 0x7f50a80b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50a5d9b640 1 -- 172.21.15.45:0/797882576 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951725033 0 0) 0x7f50a80ced10 con 0x7f50a815c410 2023-07-09T02:13:47.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f50a5d9b640 1 -- 172.21.15.45:0/797882576 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5094003530 con 0x7f50a815c410 2023-07-09T02:13:47.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f509dd9b640 1 -- 172.21.15.45:0/797882576 >> v1:172.21.15.155:6789/0 conn(0x7f50a80d2340 legacy=0x7f50a80d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f509dd9b640 1 -- 172.21.15.45:0/797882576 >> v1:172.21.15.45:6789/0 conn(0x7f50a815c410 legacy=0x7f50a81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.167+0000 7f509dd9b640 1 -- 172.21.15.45:0/797882576 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80cef40 con 0x7f50a80b59b0 2023-07-09T02:13:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f509dd9b640 1 --2- 172.21.15.45:0/797882576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a80b59b0 0x7f50a80b45e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f50900097f0 tx=0x7f509001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=862b7da889e1e160 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:47.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50a5d9b640 1 -- 172.21.15.45:0/797882576 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900ab600 con 0x7f50a80b59b0 2023-07-09T02:13:47.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50a5d9b640 1 -- 172.21.15.45:0/797882576 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50900a7050 con 0x7f50a80b59b0 2023-07-09T02:13:47.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50a5d9b640 1 -- 172.21.15.45:0/797882576 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900ab960 con 0x7f50a80b59b0 2023-07-09T02:13:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50acabd640 1 -- 172.21.15.45:0/797882576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a80b59b0 msgr2=0x7f50a80b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50acabd640 1 --2- 172.21.15.45:0/797882576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a80b59b0 0x7f50a80b45e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f50900097f0 tx=0x7f509001c450 comp rx=0 tx=0).stop 2023-07-09T02:13:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50acabd640 1 -- 172.21.15.45:0/797882576 shutdown_connections 2023-07-09T02:13:47.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50acabd640 1 --2- 172.21.15.45:0/797882576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a80b59b0 0x7f50a80b45e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50acabd640 1 -- 172.21.15.45:0/797882576 >> 172.21.15.45:0/797882576 conn(0x7f50a806a590 msgr2=0x7f50a80cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:47.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50acabd640 1 -- 172.21.15.45:0/797882576 shutdown_connections 2023-07-09T02:13:47.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.171+0000 7f50acabd640 1 -- 172.21.15.45:0/797882576 wait complete. 2023-07-09T02:13:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 Processor -- start 2023-07-09T02:13:47.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 -- start start 2023-07-09T02:13:47.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a80b59b0 0x7f50a80ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50a80d2340 0x7f50a80c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a815c410 0x7f50a814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8155b50 con 0x7f50a80b59b0 2023-07-09T02:13:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80c6bd0 con 0x7f50a815c410 2023-07-09T02:13:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80c6e30 con 0x7f50a80d2340 2023-07-09T02:13:47.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a80b59b0 0x7f50a80ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a80b59b0 0x7f50a80ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33860/0 (socket says 172.21.15.45:33860) 2023-07-09T02:13:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 -- 172.21.15.45:0/2912481466 learned_addr learned my addr 172.21.15.45:0/2912481466 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f509dd9b640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50a80d2340 0x7f50a80c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a6d9d640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a815c410 0x7f50a814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 -- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50a80d2340 msgr2=0x7f50a80c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50a80d2340 0x7f50a80c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 -- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a815c410 msgr2=0x7f50a814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a815c410 0x7f50a814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 -- 172.21.15.45:0/2912481466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5090009420 con 0x7f50a80b59b0 2023-07-09T02:13:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a6d9d640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a815c410 0x7f50a814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50a659c640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a80b59b0 0x7f50a80ccb70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f509800c4d0 tx=0x7f509800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:47.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f509f7fe640 1 -- 172.21.15.45:0/2912481466 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098005cf0 con 0x7f50a80b59b0 2023-07-09T02:13:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f509f7fe640 1 -- 172.21.15.45:0/2912481466 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5098005e50 con 0x7f50a80b59b0 2023-07-09T02:13:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a80c7110 con 0x7f50a80b59b0 2023-07-09T02:13:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f509f7fe640 1 -- 172.21.15.45:0/2912481466 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098007270 con 0x7f50a80b59b0 2023-07-09T02:13:47.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a81501b0 con 0x7f50a80b59b0 2023-07-09T02:13:47.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.175+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a80c7350 con 0x7f50a80b59b0 2023-07-09T02:13:47.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.179+0000 7f509f7fe640 1 -- 172.21.15.45:0/2912481466 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50980073d0 con 0x7f50a80b59b0 2023-07-09T02:13:47.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.179+0000 7f509f7fe640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5088066280 0x7f5088068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.179+0000 7f509f7fe640 1 -- 172.21.15.45:0/2912481466 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5098083260 con 0x7f50a80b59b0 2023-07-09T02:13:47.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.179+0000 7f509dd9b640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5088066280 0x7f5088068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.179+0000 7f509dd9b640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5088066280 0x7f5088068730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50900ad000 tx=0x7f50900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:47.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.183+0000 7f509f7fe640 1 -- 172.21.15.45:0/2912481466 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50a80c7350 con 0x7f50a80b59b0 2023-07-09T02:13:47.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.387+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f50a8155640 con 0x7f50a80b59b0 2023-07-09T02:13:47.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f509f7fe640 1 -- 172.21.15.45:0/2912481466 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f50a8155640 con 0x7f50a80b59b0 2023-07-09T02:13:47.395 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:13:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:13:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:13:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:13:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:13:47.398 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:13:47.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5088066280 msgr2=0x7f5088068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5088066280 0x7f5088068730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50900ad000 tx=0x7f50900a6000 comp rx=0 tx=0).stop 2023-07-09T02:13:47.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a80b59b0 msgr2=0x7f50a80ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a80b59b0 0x7f50a80ccb70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f509800c4d0 tx=0x7f509800c990 comp rx=0 tx=0).stop 2023-07-09T02:13:47.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 shutdown_connections 2023-07-09T02:13:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50a815c410 0x7f50a814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5088066280 0x7f5088068730 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50a80d2340 0x7f50a80c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 --2- 172.21.15.45:0/2912481466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a80b59b0 0x7f50a80ccb70 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.391+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 >> 172.21.15.45:0/2912481466 conn(0x7f50a806a590 msgr2=0x7f50a80cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:47.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.395+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 shutdown_connections 2023-07-09T02:13:47.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.395+0000 7f50acabd640 1 -- 172.21.15.45:0/2912481466 wait complete. 2023-07-09T02:13:47.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:47.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.563+0000 7f3b7952c640 1 Processor -- start 2023-07-09T02:13:47.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.563+0000 7f3b7952c640 1 -- start start 2023-07-09T02:13:47.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.563+0000 7f3b7952c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b7415c060 0x7f3b740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b7952c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b740d2620 0x7f3b740cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b7952c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b74160a50 con 0x7f3b740cd120 2023-07-09T02:13:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b7952c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7415c430 con 0x7f3b740d2620 2023-07-09T02:13:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b7952c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7415fb60 con 0x7f3b7415c060 2023-07-09T02:13:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b6bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3b740cd120 0x7f3b740d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39152/0 (socket says 172.21.15.45:39152) 2023-07-09T02:13:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b6bfff640 1 -- 172.21.15.45:0/3921738807 learned_addr learned my addr 172.21.15.45:0/3921738807 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:47.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b72ffd640 1 --2- 172.21.15.45:0/3921738807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b7415c060 0x7f3b740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b737fe640 1 --2- 172.21.15.45:0/3921738807 >> v2:172.21.15.45:3300/0 conn(0x7f3b740d2620 0x7f3b740cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b727fc640 1 -- 172.21.15.45:0/3921738807 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143161807 0 0) 0x7f3b74160a50 con 0x7f3b740cd120 2023-07-09T02:13:47.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b727fc640 1 -- 172.21.15.45:0/3921738807 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b60003530 con 0x7f3b740cd120 2023-07-09T02:13:47.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b72ffd640 1 -- 172.21.15.45:0/3921738807 >> v2:172.21.15.45:3300/0 conn(0x7f3b740d2620 msgr2=0x7f3b740cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:47.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b72ffd640 1 --2- 172.21.15.45:0/3921738807 >> v2:172.21.15.45:3300/0 conn(0x7f3b740d2620 0x7f3b740cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b72ffd640 1 -- 172.21.15.45:0/3921738807 >> v1:172.21.15.45:6789/0 conn(0x7f3b740cd120 legacy=0x7f3b740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b72ffd640 1 -- 172.21.15.45:0/3921738807 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7415fe40 con 0x7f3b7415c060 2023-07-09T02:13:47.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b737fe640 1 --2- 172.21.15.45:0/3921738807 >> v2:172.21.15.45:3300/0 conn(0x7f3b740d2620 0x7f3b740cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:47.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.567+0000 7f3b72ffd640 1 --2- 172.21.15.45:0/3921738807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b7415c060 0x7f3b740b4ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b640097f0 tx=0x7f3b6401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57e20bb913586f38 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:47.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b727fc640 1 -- 172.21.15.45:0/3921738807 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640ab650 con 0x7f3b7415c060 2023-07-09T02:13:47.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b727fc640 1 -- 172.21.15.45:0/3921738807 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b640ab7b0 con 0x7f3b7415c060 2023-07-09T02:13:47.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b727fc640 1 -- 172.21.15.45:0/3921738807 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640abb40 con 0x7f3b7415c060 2023-07-09T02:13:47.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- 172.21.15.45:0/3921738807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b7415c060 msgr2=0x7f3b740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3921738807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b7415c060 0x7f3b740b4ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b640097f0 tx=0x7f3b6401c450 comp rx=0 tx=0).stop 2023-07-09T02:13:47.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- 172.21.15.45:0/3921738807 shutdown_connections 2023-07-09T02:13:47.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3921738807 >> v2:172.21.15.45:3300/0 conn(0x7f3b740d2620 0x7f3b740cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3921738807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b7415c060 0x7f3b740b4ed0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- 172.21.15.45:0/3921738807 >> 172.21.15.45:0/3921738807 conn(0x7f3b740698e0 msgr2=0x7f3b74069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:47.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- 172.21.15.45:0/3921738807 shutdown_connections 2023-07-09T02:13:47.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- 172.21.15.45:0/3921738807 wait complete. 2023-07-09T02:13:47.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 Processor -- start 2023-07-09T02:13:47.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- start start 2023-07-09T02:13:47.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b740cd120 0x7f3b74151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b740d2620 0x7f3b740b8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b7415c060 0x7f3b740b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7415a620 con 0x7f3b740d2620 2023-07-09T02:13:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7415a900 con 0x7f3b7415c060 2023-07-09T02:13:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b7952c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7415abe0 con 0x7f3b740cd120 2023-07-09T02:13:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b740d2620 0x7f3b740b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b72ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b740cd120 0x7f3b74151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b740d2620 0x7f3b740b8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33878/0 (socket says 172.21.15.45:33878) 2023-07-09T02:13:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b6bfff640 1 -- 172.21.15.45:0/3304468340 learned_addr learned my addr 172.21.15.45:0/3304468340 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.571+0000 7f3b737fe640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b7415c060 0x7f3b740b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6bfff640 1 -- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b740cd120 msgr2=0x7f3b74151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6bfff640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b740cd120 0x7f3b74151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6bfff640 1 -- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b7415c060 msgr2=0x7f3b740b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6bfff640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b7415c060 0x7f3b740b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6bfff640 1 -- 172.21.15.45:0/3304468340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c009a70 con 0x7f3b740d2620 2023-07-09T02:13:47.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b72ffd640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b740cd120 0x7f3b74151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:47.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6bfff640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b740d2620 0x7f3b740b8140 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c001ec0 tx=0x7f3b5c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:47.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6b7fe640 1 -- 172.21.15.45:0/3304468340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c005d50 con 0x7f3b740d2620 2023-07-09T02:13:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6b7fe640 1 -- 172.21.15.45:0/3304468340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c007070 con 0x7f3b740d2620 2023-07-09T02:13:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b64009420 con 0x7f3b740d2620 2023-07-09T02:13:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6b7fe640 1 -- 172.21.15.45:0/3304468340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c007420 con 0x7f3b740d2620 2023-07-09T02:13:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b740b59f0 con 0x7f3b740d2620 2023-07-09T02:13:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b74158ec0 con 0x7f3b740d2620 2023-07-09T02:13:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6b7fe640 1 -- 172.21.15.45:0/3304468340 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b5c007580 con 0x7f3b740d2620 2023-07-09T02:13:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6b7fe640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b54066280 0x7f3b54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.575+0000 7f3b6b7fe640 1 -- 172.21.15.45:0/3304468340 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b5c083310 con 0x7f3b740d2620 2023-07-09T02:13:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.579+0000 7f3b72ffd640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b54066280 0x7f3b54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.579+0000 7f3b72ffd640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b54066280 0x7f3b54068730 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3b640af000 tx=0x7f3b640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:47.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.579+0000 7f3b6b7fe640 1 -- 172.21.15.45:0/3304468340 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b74158ec0 con 0x7f3b740d2620 2023-07-09T02:13:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b74158ec0 con 0x7f3b740d2620 2023-07-09T02:13:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b6b7fe640 1 -- 172.21.15.45:0/3304468340 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f3b74158ec0 con 0x7f3b740d2620 2023-07-09T02:13:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2676442896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2676442896},{"type":"v1","addr":"172.21.15.155:6837","nonce":2676442896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/193698688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":193698688},{"type":"v1","addr":"172.21.15.155:6836","nonce":193698688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1939767585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1939767585},{"type":"v1","addr":"172.21.15.45:6834","nonce":1939767585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:13:41.846779+0000","modified":"2023-07-09T02:13:45.491078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6096":{"gid":6096,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3771949487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3771949487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3771949487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T02:13:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 34 2023-07-09T02:13:47.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b54066280 msgr2=0x7f3b54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b54066280 0x7f3b54068730 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3b640af000 tx=0x7f3b640a7000 comp rx=0 tx=0).stop 2023-07-09T02:13:47.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b740d2620 msgr2=0x7f3b740b8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:47.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b740d2620 0x7f3b740b8140 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c001ec0 tx=0x7f3b5c00c960 comp rx=0 tx=0).stop 2023-07-09T02:13:47.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 shutdown_connections 2023-07-09T02:13:47.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b7415c060 0x7f3b740b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b740d2620 0x7f3b740b8140 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b54066280 0x7f3b54068730 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 --2- 172.21.15.45:0/3304468340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3b740cd120 0x7f3b74151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:47.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.771+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 >> 172.21.15.45:0/3304468340 conn(0x7f3b740698e0 msgr2=0x7f3b740b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:47.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.775+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 shutdown_connections 2023-07-09T02:13:47.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:47.775+0000 7f3b7952c640 1 -- 172.21.15.45:0/3304468340 wait complete. 2023-07-09T02:13:48.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:13:48.060 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:13:48.200 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:13:41.846779+0000', 'modified': '2023-07-09T02:13:45.491078+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6096}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6096': {'gid': 6096, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/3771949487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 3771949487}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 3771949487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:13:48.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:13:48.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-09T02:13:48.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759fe34640 1 Processor -- start 2023-07-09T02:13:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759fe34640 1 -- start start 2023-07-09T02:13:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759fe34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f759815c060 0x7f75980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759fe34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980cd120 0x7f75980d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759fe34640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75980d2450 0x7f75980d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759fe34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75980d28f0 con 0x7f759815c060 2023-07-09T02:13:48.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759fe34640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7598160a50 con 0x7f75980d2450 2023-07-09T02:13:48.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759fe34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759815c430 con 0x7f75980cd120 2023-07-09T02:13:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759dbd0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f759815c060 0x7f75980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759dbd0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f759815c060 0x7f75980b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33882/0 (socket says 172.21.15.45:33882) 2023-07-09T02:13:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759dbd0640 1 -- 172.21.15.45:0/343851552 learned_addr learned my addr 172.21.15.45:0/343851552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759e3d1640 1 --2- 172.21.15.45:0/343851552 >> v2:172.21.15.155:3300/0 conn(0x7f75980d2450 0x7f75980d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759d3cf640 1 --2- 172.21.15.45:0/343851552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980cd120 0x7f75980d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759dbd0640 1 -- 172.21.15.45:0/343851552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980cd120 msgr2=0x7f75980d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759dbd0640 1 --2- 172.21.15.45:0/343851552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980cd120 0x7f75980d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759dbd0640 1 -- 172.21.15.45:0/343851552 >> v2:172.21.15.155:3300/0 conn(0x7f75980d2450 msgr2=0x7f75980d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759dbd0640 1 --2- 172.21.15.45:0/343851552 >> v2:172.21.15.155:3300/0 conn(0x7f75980d2450 0x7f75980d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.343+0000 7f759dbd0640 1 -- 172.21.15.45:0/343851552 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759815fb60 con 0x7f759815c060 2023-07-09T02:13:48.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759dbd0640 1 --2- 172.21.15.45:0/343851552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f75980b4ed0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f759806b120 tx=0x7f759401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49574e00e028611e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759cbce640 1 -- 172.21.15.45:0/343851552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940ab600 con 0x7f759815c060 2023-07-09T02:13:48.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759cbce640 1 -- 172.21.15.45:0/343851552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75940a7050 con 0x7f759815c060 2023-07-09T02:13:48.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759cbce640 1 -- 172.21.15.45:0/343851552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940ab980 con 0x7f759815c060 2023-07-09T02:13:48.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 -- 172.21.15.45:0/343851552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 msgr2=0x7f75980b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 --2- 172.21.15.45:0/343851552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f75980b4ed0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f759806b120 tx=0x7f759401c210 comp rx=0 tx=0).stop 2023-07-09T02:13:48.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 -- 172.21.15.45:0/343851552 shutdown_connections 2023-07-09T02:13:48.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 --2- 172.21.15.45:0/343851552 >> v2:172.21.15.155:3300/0 conn(0x7f75980d2450 0x7f75980d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 --2- 172.21.15.45:0/343851552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980cd120 0x7f75980d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 --2- 172.21.15.45:0/343851552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f75980b4ed0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 -- 172.21.15.45:0/343851552 >> 172.21.15.45:0/343851552 conn(0x7f75980698e0 msgr2=0x7f7598069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:48.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 -- 172.21.15.45:0/343851552 shutdown_connections 2023-07-09T02:13:48.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.347+0000 7f759fe34640 1 -- 172.21.15.45:0/343851552 wait complete. 2023-07-09T02:13:48.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 Processor -- start 2023-07-09T02:13:48.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 -- start start 2023-07-09T02:13:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75980cd120 0x7f75980cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980d2450 0x7f75980cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f7598151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7598153510 con 0x7f759815c060 2023-07-09T02:13:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75981537f0 con 0x7f75980cd120 2023-07-09T02:13:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7598153ad0 con 0x7f75980d2450 2023-07-09T02:13:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f7598151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f7598151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33892/0 (socket says 172.21.15.45:33892) 2023-07-09T02:13:48.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 -- 172.21.15.45:0/483208688 learned_addr learned my addr 172.21.15.45:0/483208688 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:48.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759dbd0640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75980cd120 0x7f75980cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759d3cf640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980d2450 0x7f75980cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 -- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980d2450 msgr2=0x7f75980cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980d2450 0x7f75980cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 -- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75980cd120 msgr2=0x7f75980cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75980cd120 0x7f75980cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 -- 172.21.15.45:0/483208688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940094d0 con 0x7f759815c060 2023-07-09T02:13:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759dbd0640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75980cd120 0x7f75980cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759e3d1640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f7598151ef0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f759000efc0 tx=0x7f759000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f758e7fc640 1 -- 172.21.15.45:0/483208688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590014480 con 0x7f759815c060 2023-07-09T02:13:48.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f758e7fc640 1 -- 172.21.15.45:0/483208688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759000f040 con 0x7f759815c060 2023-07-09T02:13:48.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f758e7fc640 1 -- 172.21.15.45:0/483208688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590014820 con 0x7f759815c060 2023-07-09T02:13:48.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 -- 172.21.15.45:0/483208688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7598153db0 con 0x7f759815c060 2023-07-09T02:13:48.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.351+0000 7f759fe34640 1 -- 172.21.15.45:0/483208688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75980b27e0 con 0x7f759815c060 2023-07-09T02:13:48.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.355+0000 7f758e7fc640 1 -- 172.21.15.45:0/483208688 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7590014980 con 0x7f759815c060 2023-07-09T02:13:48.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.355+0000 7f758e7fc640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f757c0662b0 0x7f757c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.355+0000 7f758e7fc640 1 -- 172.21.15.45:0/483208688 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7590084900 con 0x7f759815c060 2023-07-09T02:13:48.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 Processor -- start 2023-07-09T02:13:48.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759dbd0640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f757c0662b0 0x7f757c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- start start 2023-07-09T02:13:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759dbd0640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f757c0662b0 0x7f757c068760 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f75940ad000 tx=0x7f75940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d4513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d3fea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d3ff360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d2c5f80 con 0x55fe6d3fef90 2023-07-09T02:13:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d1ffc60 con 0x55fe6d451010 2023-07-09T02:13:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d253700 con 0x55fe6d451920 2023-07-09T02:13:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d3ff360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d3ff360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33908/0 (socket says 172.21.15.45:33908) 2023-07-09T02:13:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759dbd0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d4513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 -- 172.21.15.45:0/653858082 learned_addr learned my addr 172.21.15.45:0/653858082 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759d3cf640 1 --2- 172.21.15.45:0/653858082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d3fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 -- 172.21.15.45:0/653858082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 msgr2=0x55fe6d3fea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 --2- 172.21.15.45:0/653858082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d3fea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 -- 172.21.15.45:0/653858082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 msgr2=0x55fe6d4513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 --2- 172.21.15.45:0/653858082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d4513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 -- 172.21.15.45:0/653858082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe6cf48890 con 0x55fe6d3fef90 2023-07-09T02:13:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f759e3d1640 1 --2- 172.21.15.45:0/653858082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d3ff360 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f759000c990 tx=0x7f7590059960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bc491177d4d052 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f757b7fe640 1 -- 172.21.15.45:0/653858082 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759006d070 con 0x55fe6d3fef90 2023-07-09T02:13:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f757b7fe640 1 -- 172.21.15.45:0/653858082 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590053d40 con 0x55fe6d3fef90 2023-07-09T02:13:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f757b7fe640 1 -- 172.21.15.45:0/653858082 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590054e90 con 0x55fe6d3fef90 2023-07-09T02:13:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- 172.21.15.45:0/653858082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 msgr2=0x55fe6d3ff360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 --2- 172.21.15.45:0/653858082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d3ff360 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f759000c990 tx=0x7f7590059960 comp rx=0 tx=0).stop 2023-07-09T02:13:48.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- 172.21.15.45:0/653858082 shutdown_connections 2023-07-09T02:13:48.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 --2- 172.21.15.45:0/653858082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d3ff360 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 --2- 172.21.15.45:0/653858082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d3fea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 --2- 172.21.15.45:0/653858082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d4513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- 172.21.15.45:0/653858082 >> 172.21.15.45:0/653858082 conn(0x55fe6d2c1a70 msgr2=0x55fe6d3fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- 172.21.15.45:0/653858082 shutdown_connections 2023-07-09T02:13:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- 172.21.15.45:0/653858082 wait complete. 2023-07-09T02:13:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 -- start start 2023-07-09T02:13:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.359+0000 7f75a31b3000 1 Processor -- start 2023-07-09T02:13:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d3fef90 0x55fe6d412600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d412b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d451920 0x55fe6d413080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d24c7a0 con 0x55fe6d451920 2023-07-09T02:13:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d208f00 con 0x55fe6d451010 2023-07-09T02:13:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d208ba0 con 0x55fe6d3fef90 2023-07-09T02:13:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 10 client.0 _ll_register_callbacks cb 0x55fe6d3ea930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:13:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d451920 0x55fe6d413080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d451920 0x55fe6d413080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33922/0 (socket says 172.21.15.45:33922) 2023-07-09T02:13:48.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 -- 172.21.15.45:0/1973512899 learned_addr learned my addr 172.21.15.45:0/1973512899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:48.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759d3cf640 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d412b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d3fef90 0x55fe6d412600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 -- 172.21.15.45:0/1973512899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d3fef90 msgr2=0x55fe6d412600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d3fef90 0x55fe6d412600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 -- 172.21.15.45:0/1973512899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 msgr2=0x55fe6d412b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d412b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 -- 172.21.15.45:0/1973512899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75980b27e0 con 0x55fe6d451920 2023-07-09T02:13:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759e3d1640 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d451920 0x55fe6d413080 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7590012020 tx=0x7f7590058070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f61fbb8b63dff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f7578ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:13:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f7578ff9640 1 -- 172.21.15.45:0/1973512899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590072070 con 0x55fe6d451920 2023-07-09T02:13:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f7578ff9640 1 -- 172.21.15.45:0/1973512899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7590054e90 con 0x55fe6d451920 2023-07-09T02:13:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 -- 172.21.15.45:0/1973512899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe6d24b0f0 con 0x55fe6d451920 2023-07-09T02:13:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f7578ff9640 1 -- 172.21.15.45:0/1973512899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f759006d040 con 0x55fe6d451920 2023-07-09T02:13:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 10 client.6249 fetch_fsmap learned FSMap version 34 2023-07-09T02:13:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 -- 172.21.15.45:0/1973512899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55fe6d211130 con 0x55fe6d451920 2023-07-09T02:13:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f7578ff9640 1 -- 172.21.15.45:0/1973512899 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fe6d24b0f0 con 0x55fe6d451920 2023-07-09T02:13:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f7578ff9640 1 -- 172.21.15.45:0/1973512899 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7590005d20 con 0x55fe6d451920 2023-07-09T02:13:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 10 client.6249 fetch_fsmap finished waiting for FSMap version 34 2023-07-09T02:13:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 10 client.6249 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T02:13:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 20 client.6249 populate_metadata read hostname 'smithi045' 2023-07-09T02:13:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] conn(0x55fe6d460080 0x55fe6d462460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 4 client.6249 mds_command: new command op to 6096 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:13:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f75a31b3000 1 -- 172.21.15.45:0/1973512899 --> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe6d213e40 con 0x55fe6d460080 2023-07-09T02:13:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] conn(0x55fe6d460080 0x55fe6d462460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f7578ff9640 10 client.6249 ms_handle_connect on v2:172.21.15.45:6833/3771949487 2023-07-09T02:13:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.363+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] conn(0x55fe6d460080 0x55fe6d462460 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d6f702388b7372 server_cookie=97dcfc10fadff73b in_seq=0 out_seq=0 2023-07-09T02:13:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f7578ff9640 1 -- 172.21.15.45:0/1973512899 <== mds.0 v2:172.21.15.45:6833/3771949487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fe6d213e40 con 0x55fe6d460080 2023-07-09T02:13:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f7578ff9640 10 client.6249 handle_command_reply: tid=0 2023-07-09T02:13:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 client.6249 shutdown 2023-07-09T02:13:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 -- 172.21.15.45:0/1973512899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d451920 msgr2=0x55fe6d413080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d451920 0x55fe6d413080 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7590012020 tx=0x7f7590058070 comp rx=0 tx=0).stop 2023-07-09T02:13:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 -- 172.21.15.45:0/1973512899 shutdown_connections 2023-07-09T02:13:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] conn(0x55fe6d460080 0x55fe6d462460 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d451920 0x55fe6d413080 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f7578ff9640 0 client.6249 ms_handle_reset on v2:172.21.15.45:6833/3771949487 2023-07-09T02:13:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d412b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1973512899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d3fef90 0x55fe6d412600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 -- 172.21.15.45:0/1973512899 >> 172.21.15.45:0/1973512899 conn(0x55fe6d2c1a70 msgr2=0x55fe6d3fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 -- 172.21.15.45:0/1973512899 shutdown_connections 2023-07-09T02:13:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 1 -- 172.21.15.45:0/1973512899 wait complete. 2023-07-09T02:13:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.367+0000 7f75a31b3000 20 client.6249 trim_cache size 0 max 16384 2023-07-09T02:13:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 Processor -- start 2023-07-09T02:13:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- start start 2023-07-09T02:13:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d450860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d463b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d4640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6cf09940 con 0x55fe6d3fef90 2023-07-09T02:13:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d249ba0 con 0x55fe6d451010 2023-07-09T02:13:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d1e9ea0 con 0x55fe6d451920 2023-07-09T02:13:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d450860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d450860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33926/0 (socket says 172.21.15.45:33926) 2023-07-09T02:13:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 -- 172.21.15.45:0/1370380413 learned_addr learned my addr 172.21.15.45:0/1370380413 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:48.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759d3cf640 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d463b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759e3d1640 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d4640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 -- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 msgr2=0x55fe6d4640c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d4640c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 -- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 msgr2=0x55fe6d463b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d463b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 -- 172.21.15.45:0/1370380413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe6d1f73c0 con 0x55fe6d3fef90 2023-07-09T02:13:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759e3d1640 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d4640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:48.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d450860 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f759401c250 tx=0x7f7594004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef16ca3dc617f74e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f757bfff640 1 -- 172.21.15.45:0/1370380413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940abd40 con 0x55fe6d3fef90 2023-07-09T02:13:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f757bfff640 1 -- 172.21.15.45:0/1370380413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75940bc040 con 0x55fe6d3fef90 2023-07-09T02:13:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f757bfff640 1 -- 172.21.15.45:0/1370380413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940abea0 con 0x55fe6d3fef90 2023-07-09T02:13:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- 172.21.15.45:0/1370380413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 msgr2=0x55fe6d450860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d450860 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f759401c250 tx=0x7f7594004740 comp rx=0 tx=0).stop 2023-07-09T02:13:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- 172.21.15.45:0/1370380413 shutdown_connections 2023-07-09T02:13:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d4640c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d463b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1370380413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d450860 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- 172.21.15.45:0/1370380413 >> 172.21.15.45:0/1370380413 conn(0x55fe6d2c1a70 msgr2=0x55fe6d462460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- 172.21.15.45:0/1370380413 shutdown_connections 2023-07-09T02:13:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- 172.21.15.45:0/1370380413 wait complete. 2023-07-09T02:13:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.383+0000 7f75a31b3000 1 -- start start 2023-07-09T02:13:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 Processor -- start 2023-07-09T02:13:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d4ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d4aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d44e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d401d60 con 0x55fe6d3fef90 2023-07-09T02:13:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d3feab0 con 0x55fe6d451010 2023-07-09T02:13:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe6d214710 con 0x55fe6d451920 2023-07-09T02:13:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 10 client.0 _ll_register_callbacks cb 0x55fe6d3cb4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:13:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d4ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d4ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33928/0 (socket says 172.21.15.45:33928) 2023-07-09T02:13:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 -- 172.21.15.45:0/1967424003 learned_addr learned my addr 172.21.15.45:0/1967424003 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759d3cf640 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d4aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759e3d1640 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d44e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 -- 172.21.15.45:0/1967424003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 msgr2=0x55fe6d44e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d44e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 -- 172.21.15.45:0/1967424003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 msgr2=0x55fe6d4aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d4aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 -- 172.21.15.45:0/1967424003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759815fb60 con 0x55fe6d3fef90 2023-07-09T02:13:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759dbd0640 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d4ae4f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f759401c250 tx=0x7f759401aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fa49b2ce10f379 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f7578ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:13:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f7578ff9640 1 -- 172.21.15.45:0/1967424003 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940c9070 con 0x55fe6d3fef90 2023-07-09T02:13:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 -- 172.21.15.45:0/1967424003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe6d402920 con 0x55fe6d3fef90 2023-07-09T02:13:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f7578ff9640 1 -- 172.21.15.45:0/1967424003 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75940b5470 con 0x55fe6d3fef90 2023-07-09T02:13:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f7578ff9640 1 -- 172.21.15.45:0/1967424003 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75940b5630 con 0x55fe6d3fef90 2023-07-09T02:13:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 10 client.6255 fetch_fsmap learned FSMap version 34 2023-07-09T02:13:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 -- 172.21.15.45:0/1967424003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55fe6cf48cc0 con 0x55fe6d3fef90 2023-07-09T02:13:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f7578ff9640 1 -- 172.21.15.45:0/1967424003 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fe6d402920 con 0x55fe6d3fef90 2023-07-09T02:13:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f7578ff9640 1 -- 172.21.15.45:0/1967424003 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f75940c1040 con 0x55fe6d3fef90 2023-07-09T02:13:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 10 client.6255 fetch_fsmap finished waiting for FSMap version 34 2023-07-09T02:13:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 10 client.6255 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T02:13:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 20 client.6255 populate_metadata read hostname 'smithi045' 2023-07-09T02:13:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] conn(0x55fe6d4b5350 0x55fe6d4b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 4 client.6255 mds_command: new command op to 6096 tid=0[{"prefix": "status"}] 2023-07-09T02:13:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f75a31b3000 1 -- 172.21.15.45:0/1967424003 --> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fe6d2056f0 con 0x55fe6d4b5350 2023-07-09T02:13:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759d3cf640 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] conn(0x55fe6d4b5350 0x55fe6d4b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f7578ff9640 10 client.6255 ms_handle_connect on v2:172.21.15.45:6833/3771949487 2023-07-09T02:13:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.387+0000 7f759d3cf640 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] conn(0x55fe6d4b5350 0x55fe6d4b7730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edab81a476ee6cfa server_cookie=89169b6f3215133f in_seq=0 out_seq=0 2023-07-09T02:13:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f7578ff9640 1 -- 172.21.15.45:0/1967424003 <== mds.0 v2:172.21.15.45:6833/3771949487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55fe6d2056f0 con 0x55fe6d4b5350 2023-07-09T02:13:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f7578ff9640 10 client.6255 handle_command_reply: tid=0 2023-07-09T02:13:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 client.6255 shutdown 2023-07-09T02:13:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 -- 172.21.15.45:0/1967424003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 msgr2=0x55fe6d4ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d4ae4f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f759401c250 tx=0x7f759401aa50 comp rx=0 tx=0).stop 2023-07-09T02:13:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 -- 172.21.15.45:0/1967424003 shutdown_connections 2023-07-09T02:13:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.45:6833/3771949487,v1:172.21.15.45:6835/3771949487] conn(0x55fe6d4b5350 0x55fe6d4b7730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fe6d451920 0x55fe6d44e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe6d451010 0x55fe6d4aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f7578ff9640 0 client.6255 ms_handle_reset on v2:172.21.15.45:6833/3771949487 2023-07-09T02:13:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 --2- 172.21.15.45:0/1967424003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe6d3fef90 0x55fe6d4ae4f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 -- 172.21.15.45:0/1967424003 >> 172.21.15.45:0/1967424003 conn(0x55fe6d2c1a70 msgr2=0x55fe6d462cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 -- 172.21.15.45:0/1967424003 shutdown_connections 2023-07-09T02:13:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 1 -- 172.21.15.45:0/1967424003 wait complete. 2023-07-09T02:13:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f75a31b3000 20 client.6255 trim_cache size 0 max 16384 2023-07-09T02:13:48.401 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:13:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:13:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:13:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6096, 2023-07-09T02:13:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:13:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:13:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:13:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9376982710000004, 2023-07-09T02:13:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 34, 2023-07-09T02:13:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 68, 2023-07-09T02:13:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 68, 2023-07-09T02:13:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.708052961 2023-07-09T02:13:48.402 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:13:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 -- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f757c0662b0 msgr2=0x7f757c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f757c0662b0 0x7f757c068760 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f75940ad000 tx=0x7f75940a6000 comp rx=0 tx=0).stop 2023-07-09T02:13:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 -- 172.21.15.45:0/483208688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 msgr2=0x7f7598151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f7598151ef0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f759000efc0 tx=0x7f759000c490 comp rx=0 tx=0).stop 2023-07-09T02:13:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 -- 172.21.15.45:0/483208688 shutdown_connections 2023-07-09T02:13:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f759815c060 0x7f7598151ef0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f757c0662b0 0x7f757c068760 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75980d2450 0x7f75980cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 --2- 172.21.15.45:0/483208688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75980cd120 0x7f75980cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 -- 172.21.15.45:0/483208688 >> 172.21.15.45:0/483208688 conn(0x7f75980698e0 msgr2=0x7f75980b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 -- 172.21.15.45:0/483208688 shutdown_connections 2023-07-09T02:13:48.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.391+0000 7f759fe34640 1 -- 172.21.15.45:0/483208688 wait complete. 2023-07-09T02:13:48.412 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:13:48.428 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-07-09T02:13:48.427+0000 7f31b3f97640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:13:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.551+0000 7f0667bfa640 1 Processor -- start 2023-07-09T02:13:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.551+0000 7f0667bfa640 1 -- start start 2023-07-09T02:13:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0667bfa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f066015c060 0x7f06600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0667bfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f06600d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0667bfa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0660160a50 con 0x7f06600d2450 2023-07-09T02:13:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0667bfa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06600d28f0 con 0x7f066015c060 2023-07-09T02:13:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0667bfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600cfe40 con 0x7f06600cd120 2023-07-09T02:13:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0666197640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f06600d2450 0x7f06600d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39164/0 (socket says 172.21.15.45:39164) 2023-07-09T02:13:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0666197640 1 -- 172.21.15.45:0/2346603597 learned_addr learned my addr 172.21.15.45:0/2346603597 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0665195640 1 --2- 172.21.15.45:0/2346603597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f06600d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0665996640 1 --2- 172.21.15.45:0/2346603597 >> v2:172.21.15.155:3300/0 conn(0x7f066015c060 0x7f06600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0664994640 1 -- 172.21.15.45:0/2346603597 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248415637 0 0) 0x7f0660160a50 con 0x7f06600d2450 2023-07-09T02:13:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0664994640 1 -- 172.21.15.45:0/2346603597 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f064c003530 con 0x7f06600d2450 2023-07-09T02:13:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0665195640 1 -- 172.21.15.45:0/2346603597 >> v2:172.21.15.155:3300/0 conn(0x7f066015c060 msgr2=0x7f06600b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0665195640 1 --2- 172.21.15.45:0/2346603597 >> v2:172.21.15.155:3300/0 conn(0x7f066015c060 0x7f06600b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0665195640 1 -- 172.21.15.45:0/2346603597 >> v1:172.21.15.45:6789/0 conn(0x7f06600d2450 legacy=0x7f06600d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0665195640 1 -- 172.21.15.45:0/2346603597 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066015c430 con 0x7f06600cd120 2023-07-09T02:13:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.555+0000 7f0665996640 1 --2- 172.21.15.45:0/2346603597 >> v2:172.21.15.155:3300/0 conn(0x7f066015c060 0x7f06600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:13:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0665195640 1 --2- 172.21.15.45:0/2346603597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f06600d1f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06500097c0 tx=0x7f065001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cbf556438028249 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0664994640 1 -- 172.21.15.45:0/2346603597 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500ab600 con 0x7f06600cd120 2023-07-09T02:13:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0664994640 1 -- 172.21.15.45:0/2346603597 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06500a7050 con 0x7f06600cd120 2023-07-09T02:13:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0664994640 1 -- 172.21.15.45:0/2346603597 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500ab980 con 0x7f06600cd120 2023-07-09T02:13:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 -- 172.21.15.45:0/2346603597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 msgr2=0x7f06600d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 --2- 172.21.15.45:0/2346603597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f06600d1f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06500097c0 tx=0x7f065001c450 comp rx=0 tx=0).stop 2023-07-09T02:13:48.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 -- 172.21.15.45:0/2346603597 shutdown_connections 2023-07-09T02:13:48.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 --2- 172.21.15.45:0/2346603597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f06600d1f10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 --2- 172.21.15.45:0/2346603597 >> v2:172.21.15.155:3300/0 conn(0x7f066015c060 0x7f06600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 -- 172.21.15.45:0/2346603597 >> 172.21.15.45:0/2346603597 conn(0x7f06600698e0 msgr2=0x7f0660069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 -- 172.21.15.45:0/2346603597 shutdown_connections 2023-07-09T02:13:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 -- 172.21.15.45:0/2346603597 wait complete. 2023-07-09T02:13:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 Processor -- start 2023-07-09T02:13:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.559+0000 7f0667bfa640 1 -- start start 2023-07-09T02:13:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f066015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06600d2450 0x7f06600ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f066015c060 0x7f06601532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066015cc40 con 0x7f06600d2450 2023-07-09T02:13:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066015cf20 con 0x7f066015c060 2023-07-09T02:13:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066015d200 con 0x7f06600cd120 2023-07-09T02:13:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06600d2450 0x7f06600ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06600d2450 0x7f06600ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33930/0 (socket says 172.21.15.45:33930) 2023-07-09T02:13:48.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 -- 172.21.15.45:0/3143912343 learned_addr learned my addr 172.21.15.45:0/3143912343 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:48.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665996640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f066015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 -- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 msgr2=0x7f066015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f066015c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0666197640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f066015c060 0x7f06601532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 -- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f066015c060 msgr2=0x7f06601532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f066015c060 0x7f06601532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 -- 172.21.15.45:0/3143912343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c009420 con 0x7f06600d2450 2023-07-09T02:13:48.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0666197640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f066015c060 0x7f06601532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:13:48.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0665195640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06600d2450 0x7f06600ca340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f06500ae040 tx=0x7f065001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f06567fc640 1 -- 172.21.15.45:0/3143912343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500b7450 con 0x7f06600d2450 2023-07-09T02:13:48.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f06567fc640 1 -- 172.21.15.45:0/3143912343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06500b75d0 con 0x7f06600d2450 2023-07-09T02:13:48.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f06567fc640 1 -- 172.21.15.45:0/3143912343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500b7980 con 0x7f06600d2450 2023-07-09T02:13:48.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0650009420 con 0x7f06600d2450 2023-07-09T02:13:48.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066015d7c0 con 0x7f06600d2450 2023-07-09T02:13:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066015d9b0 con 0x7f06600d2450 2023-07-09T02:13:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.563+0000 7f06567fc640 1 -- 172.21.15.45:0/3143912343 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06500b7ae0 con 0x7f06600d2450 2023-07-09T02:13:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.567+0000 7f06567fc640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0644066280 0x7f0644068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.567+0000 7f06567fc640 1 -- 172.21.15.45:0/3143912343 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f065011e550 con 0x7f06600d2450 2023-07-09T02:13:48.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.567+0000 7f0665996640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0644066280 0x7f0644068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:48.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.567+0000 7f0665996640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0644066280 0x7f0644068730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06600b5920 tx=0x7f065c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:48.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.571+0000 7f06567fc640 1 -- 172.21.15.45:0/3143912343 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06500ebae0 con 0x7f06600d2450 2023-07-09T02:13:48.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.755+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f066004d7d0 con 0x7f06600d2450 2023-07-09T02:13:48.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.755+0000 7f06567fc640 1 -- 172.21.15.45:0/3143912343 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f06500ef100 con 0x7f06600d2450 2023-07-09T02:13:48.760 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:13:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0644066280 msgr2=0x7f0644068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0644066280 0x7f0644068730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06600b5920 tx=0x7f065c008040 comp rx=0 tx=0).stop 2023-07-09T02:13:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06600d2450 msgr2=0x7f06600ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06600d2450 0x7f06600ca340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f06500ae040 tx=0x7f065001ac90 comp rx=0 tx=0).stop 2023-07-09T02:13:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 shutdown_connections 2023-07-09T02:13:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f066015c060 0x7f06601532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06600d2450 0x7f06600ca340 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0644066280 0x7f0644068730 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 --2- 172.21.15.45:0/3143912343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06600cd120 0x7f066015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 >> 172.21.15.45:0/3143912343 conn(0x7f06600698e0 msgr2=0x7f06600b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 shutdown_connections 2023-07-09T02:13:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:48.759+0000 7f0667bfa640 1 -- 172.21.15.45:0/3143912343 wait complete. 2023-07-09T02:13:48.781 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:13:48.782 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:13:48.782 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:13:48.782 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:13:48.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:13:48.783 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:13:48.783 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:13:48.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:13:48.784 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:13:48.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:48.786 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:13:48.834 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:13:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:13:48.835 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:13:48.836 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:48.837 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:13:48.837 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:48.837 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:13:48.837 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:48.838 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:13:48.838 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:13:48.839 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:48.839 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:13:48.840 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:13:48.840 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42298sec preferred_lft 42298sec 2023-07-09T02:13:48.840 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:13:48.841 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:48.841 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:13:48.841 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:48.841 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:13:48.842 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:13:48.842 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:48.842 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:13:48.842 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:13:48.843 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:48.843 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:13:48.843 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:48.843 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:13:48.844 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:48.844 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:13:48.844 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:48.845 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:13:48.845 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:48.847 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:13:48.847 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:13:48.847 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:13:48.847 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:48.847 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:13:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:13:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:13:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:48.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:48.849 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:13:48.896 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:13:48.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:48.899 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:13:48.949 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:13:48.949 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:13:48.950 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:13:48.950 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:13:48.950 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:13:48.950 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:13:48.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:48.951 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:13:48.951 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:13:48.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:13:48.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:13:48.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:13:48.952 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:13:49.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:49.046 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:13:49.056 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:13:49.056 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:13:49.056 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:13:49.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:49.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:13:49.122 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:13:49.123 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:13:49.172 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:13:49.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:13:49.173 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:13:49.226 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:13:49.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:49.227 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:13:49.321 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:13:49.321 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:13:49.333 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:13:49.334 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:13:49.334 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:13:49.334 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:13:49.335 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:13:49.338 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:13:49.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:49.339 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:13:49.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:49.364 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:13:49.423 INFO:teuthology.orchestra.run.smithi045.stdout:client5522 2023-07-09T02:13:49.423 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:13:49.424 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:49.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:13:49.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.663+0000 7f9a104bd640 1 Processor -- start 2023-07-09T02:13:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.663+0000 7f9a104bd640 1 -- start start 2023-07-09T02:13:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a104bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a0815c060 0x7f9a080b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a104bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a080d2620 0x7f9a080cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a104bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a08160a50 con 0x7f9a080cd120 2023-07-09T02:13:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a104bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0815c430 con 0x7f9a080d2620 2023-07-09T02:13:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a104bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0815fb60 con 0x7f9a0815c060 2023-07-09T02:13:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0ea5a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a080d2620 0x7f9a080cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0da58640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9a080cd120 0x7f9a080d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39174/0 (socket says 172.21.15.45:39174) 2023-07-09T02:13:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0da58640 1 -- 172.21.15.45:0/1473632560 learned_addr learned my addr 172.21.15.45:0/1473632560 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0e259640 1 --2- 172.21.15.45:0/1473632560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a0815c060 0x7f9a080b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0ea5a640 1 -- 172.21.15.45:0/1473632560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a0815c060 msgr2=0x7f9a080b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:13:49.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0ea5a640 1 --2- 172.21.15.45:0/1473632560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a0815c060 0x7f9a080b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0ea5a640 1 -- 172.21.15.45:0/1473632560 >> v1:172.21.15.45:6789/0 conn(0x7f9a080cd120 legacy=0x7f9a080d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:49.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0ea5a640 1 -- 172.21.15.45:0/1473632560 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0815fe40 con 0x7f9a080d2620 2023-07-09T02:13:49.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0d257640 1 -- 172.21.15.45:0/1473632560 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958672566 0 0) 0x7f9a08160a50 con 0x7f9a080cd120 2023-07-09T02:13:49.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0ea5a640 1 --2- 172.21.15.45:0/1473632560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080d2620 0x7f9a080cee30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009dc0 tx=0x7f9a0001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c025bf76dbe65156 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:49.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.667+0000 7f9a0d257640 1 -- 172.21.15.45:0/1473632560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000a59c0 con 0x7f9a080d2620 2023-07-09T02:13:49.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a0d257640 1 -- 172.21.15.45:0/1473632560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a000a5b20 con 0x7f9a080d2620 2023-07-09T02:13:49.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a0d257640 1 -- 172.21.15.45:0/1473632560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000ad440 con 0x7f9a080d2620 2023-07-09T02:13:49.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- 172.21.15.45:0/1473632560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080d2620 msgr2=0x7f9a080cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:49.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 --2- 172.21.15.45:0/1473632560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080d2620 0x7f9a080cee30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009dc0 tx=0x7f9a0001c900 comp rx=0 tx=0).stop 2023-07-09T02:13:49.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- 172.21.15.45:0/1473632560 shutdown_connections 2023-07-09T02:13:49.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 --2- 172.21.15.45:0/1473632560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080d2620 0x7f9a080cee30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 --2- 172.21.15.45:0/1473632560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a0815c060 0x7f9a080b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- 172.21.15.45:0/1473632560 >> 172.21.15.45:0/1473632560 conn(0x7f9a080698e0 msgr2=0x7f9a08069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:49.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- 172.21.15.45:0/1473632560 shutdown_connections 2023-07-09T02:13:49.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- 172.21.15.45:0/1473632560 wait complete. 2023-07-09T02:13:49.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 Processor -- start 2023-07-09T02:13:49.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- start start 2023-07-09T02:13:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080cd120 0x7f9a08153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a080d2620 0x7f9a08152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a0815c060 0x7f9a081567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0815ad70 con 0x7f9a080cd120 2023-07-09T02:13:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08153130 con 0x7f9a0815c060 2023-07-09T02:13:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a104bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0815a3d0 con 0x7f9a080d2620 2023-07-09T02:13:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a0e259640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080cd120 0x7f9a08153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a0e259640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080cd120 0x7f9a08153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33952/0 (socket says 172.21.15.45:33952) 2023-07-09T02:13:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a0e259640 1 -- 172.21.15.45:0/3047398424 learned_addr learned my addr 172.21.15.45:0/3047398424 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.671+0000 7f9a0da58640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a080d2620 0x7f9a08152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0ea5a640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a0815c060 0x7f9a081567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0e259640 1 -- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a080d2620 msgr2=0x7f9a08152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0e259640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a080d2620 0x7f9a08152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0e259640 1 -- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a0815c060 msgr2=0x7f9a081567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0e259640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a0815c060 0x7f9a081567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0e259640 1 -- 172.21.15.45:0/3047398424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00009a70 con 0x7f9a080cd120 2023-07-09T02:13:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0ea5a640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a0815c060 0x7f9a081567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0da58640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a080d2620 0x7f9a08152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:13:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0e259640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080cd120 0x7f9a08153730 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400d5f0 tx=0x7f9a0400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f99feffd640 1 -- 172.21.15.45:0/3047398424 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040125f0 con 0x7f9a080cd120 2023-07-09T02:13:49.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f99feffd640 1 -- 172.21.15.45:0/3047398424 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04012750 con 0x7f9a080cd120 2023-07-09T02:13:49.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a080b59f0 con 0x7f9a080cd120 2023-07-09T02:13:49.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f99feffd640 1 -- 172.21.15.45:0/3047398424 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04012ae0 con 0x7f9a080cd120 2023-07-09T02:13:49.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0815a990 con 0x7f9a080cd120 2023-07-09T02:13:49.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0804d7d0 con 0x7f9a080cd120 2023-07-09T02:13:49.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f99feffd640 1 -- 172.21.15.45:0/3047398424 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a04012c40 con 0x7f9a080cd120 2023-07-09T02:13:49.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f99feffd640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99ec066280 0x7f99ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:49.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f99feffd640 1 -- 172.21.15.45:0/3047398424 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a04084250 con 0x7f9a080cd120 2023-07-09T02:13:49.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.675+0000 7f9a0da58640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99ec066280 0x7f99ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:49.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.679+0000 7f9a0da58640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99ec066280 0x7f99ec068730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f99f8007fd0 tx=0x7f99f8007c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:49.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.679+0000 7f99feffd640 1 -- 172.21.15.45:0/3047398424 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a040516c0 con 0x7f9a080cd120 2023-07-09T02:13:49.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.867+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9a0815afe0 con 0x7f9a080cd120 2023-07-09T02:13:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.867+0000 7f99feffd640 1 -- 172.21.15.45:0/3047398424 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9a04007380 con 0x7f9a080cd120 2023-07-09T02:13:49.872 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:13:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99ec066280 msgr2=0x7f99ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99ec066280 0x7f99ec068730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f99f8007fd0 tx=0x7f99f8007c20 comp rx=0 tx=0).stop 2023-07-09T02:13:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080cd120 msgr2=0x7f9a08153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080cd120 0x7f9a08153730 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400d5f0 tx=0x7f9a0400dab0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 shutdown_connections 2023-07-09T02:13:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a0815c060 0x7f9a081567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99ec066280 0x7f99ec068730 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a080d2620 0x7f9a08152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 --2- 172.21.15.45:0/3047398424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a080cd120 0x7f9a08153730 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 >> 172.21.15.45:0/3047398424 conn(0x7f9a080698e0 msgr2=0x7f9a080b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 shutdown_connections 2023-07-09T02:13:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:49.871+0000 7f9a104bd640 1 -- 172.21.15.45:0/3047398424 wait complete. 2023-07-09T02:13:49.893 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:13:49.893 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:13:49.894 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:13:49.894 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:13:49.894 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:13:49.895 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:13:49.895 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:13:49.895 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:13:49.896 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:13:49.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:49.896 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:13:49.906 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:13:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:13:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:13:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:13:49.907 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:49.908 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:13:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:13:49.908 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:13:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:49.908 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:13:49.908 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:13:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:49.909 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:13:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:13:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42304sec preferred_lft 42304sec 2023-07-09T02:13:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:13:49.909 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:49.909 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:13:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:13:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:49.910 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:13:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:13:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:13:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:49.910 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:13:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:49.911 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:13:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:13:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:13:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:49.911 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:13:49.911 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:13:49.912 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:13:49.912 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:13:49.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:49.913 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:13:49.978 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:13:49.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:49.980 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:13:50.037 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:13:50.037 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:13:50.037 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:13:50.038 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:13:50.038 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:13:50.038 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:13:50.038 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:13:50.038 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:13:50.039 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:13:50.039 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:13:50.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:50.040 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:13:50.040 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:13:50.041 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:13:50.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:13:50.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:13:50.042 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:13:50.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:50.136 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:13:50.153 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:13:50.153 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:13:50.154 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:13:50.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:50.154 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:13:50.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:13:50.219 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:13:50.270 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:13:50.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:13:50.271 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:13:50.320 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:13:50.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:50.321 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:13:50.417 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:13:50.418 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:13:50.429 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:13:50.429 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:13:50.430 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:13:50.430 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:13:50.430 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:13:50.433 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:13:50.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:50.435 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:13:50.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:13:50.455 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:13:50.511 INFO:teuthology.orchestra.run.smithi155.stdout:client5983 2023-07-09T02:13:50.512 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:13:50.512 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:13:50.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:13:50.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.707+0000 7fa97bd2c640 1 Processor -- start 2023-07-09T02:13:50.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.707+0000 7fa97bd2c640 1 -- start start 2023-07-09T02:13:50.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa97bd2c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa97415c060 0x7fa9740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:50.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa97bd2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa974160a50 con 0x7fa9740cd120 2023-07-09T02:13:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa97bd2c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97415c430 con 0x7fa9740d2620 2023-07-09T02:13:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa97bd2c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97415fb60 con 0x7fa97415c060 2023-07-09T02:13:50.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa9792c7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa9740cd120 0x7fa9740d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39178/0 (socket says 172.21.15.45:39178) 2023-07-09T02:13:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa9792c7640 1 -- 172.21.15.45:0/2117385384 learned_addr learned my addr 172.21.15.45:0/2117385384 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:13:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa979ac8640 1 --2- 172.21.15.45:0/2117385384 >> v2:172.21.15.45:3300/0 conn(0x7fa97415c060 0x7fa9740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa979ac8640 1 -- 172.21.15.45:0/2117385384 >> v1:172.21.15.155:6789/0 conn(0x7fa9740d2620 legacy=0x7fa9740cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa979ac8640 1 -- 172.21.15.45:0/2117385384 >> v1:172.21.15.45:6789/0 conn(0x7fa9740cd120 legacy=0x7fa9740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:50.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa979ac8640 1 -- 172.21.15.45:0/2117385384 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97415fe40 con 0x7fa97415c060 2023-07-09T02:13:50.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.711+0000 7fa978ac6640 1 -- 172.21.15.45:0/2117385384 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412928572 0 0) 0x7fa974160a50 con 0x7fa9740cd120 2023-07-09T02:13:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa979ac8640 1 --2- 172.21.15.45:0/2117385384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa97415c060 0x7fa9740b4ed0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa9700097c0 tx=0x7fa97001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69d3f8280f78fda server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa978ac6640 1 -- 172.21.15.45:0/2117385384 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700ab650 con 0x7fa97415c060 2023-07-09T02:13:50.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa978ac6640 1 -- 172.21.15.45:0/2117385384 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9700ab7b0 con 0x7fa97415c060 2023-07-09T02:13:50.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa978ac6640 1 -- 172.21.15.45:0/2117385384 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700abb40 con 0x7fa97415c060 2023-07-09T02:13:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 -- 172.21.15.45:0/2117385384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa97415c060 msgr2=0x7fa9740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 --2- 172.21.15.45:0/2117385384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa97415c060 0x7fa9740b4ed0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa9700097c0 tx=0x7fa97001c450 comp rx=0 tx=0).stop 2023-07-09T02:13:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 -- 172.21.15.45:0/2117385384 shutdown_connections 2023-07-09T02:13:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 --2- 172.21.15.45:0/2117385384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa97415c060 0x7fa9740b4ed0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 -- 172.21.15.45:0/2117385384 >> 172.21.15.45:0/2117385384 conn(0x7fa9740698e0 msgr2=0x7fa974069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 -- 172.21.15.45:0/2117385384 shutdown_connections 2023-07-09T02:13:50.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 -- 172.21.15.45:0/2117385384 wait complete. 2023-07-09T02:13:50.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 Processor -- start 2023-07-09T02:13:50.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.715+0000 7fa97bd2c640 1 -- start start 2023-07-09T02:13:50.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740cd120 0x7fa974157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:50.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740d2620 0x7fa97415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:50.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97415c060 0x7fa9741587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:50.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9741612e0 con 0x7fa9740cd120 2023-07-09T02:13:50.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97415eef0 con 0x7fa97415c060 2023-07-09T02:13:50.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa974160cb0 con 0x7fa9740d2620 2023-07-09T02:13:50.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740cd120 0x7fa974157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:50.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740cd120 0x7fa974157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33972/0 (socket says 172.21.15.45:33972) 2023-07-09T02:13:50.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 -- 172.21.15.45:0/1524497874 learned_addr learned my addr 172.21.15.45:0/1524497874 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:13:50.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97a2c9640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97415c060 0x7fa9741587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:50.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa9792c7640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740d2620 0x7fa97415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:50.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 -- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740d2620 msgr2=0x7fa97415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:50.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740d2620 0x7fa97415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:50.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 -- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97415c060 msgr2=0x7fa9741587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:50.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97415c060 0x7fa9741587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:50.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 -- 172.21.15.45:0/1524497874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009420 con 0x7fa9740cd120 2023-07-09T02:13:50.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa979ac8640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740cd120 0x7fa974157fb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa9700ad040 tx=0x7fa97001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:50.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa96a7fc640 1 -- 172.21.15.45:0/1524497874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700b5810 con 0x7fa9740cd120 2023-07-09T02:13:50.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa96a7fc640 1 -- 172.21.15.45:0/1524497874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9700b5970 con 0x7fa9740cd120 2023-07-09T02:13:50.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9740b59f0 con 0x7fa9740cd120 2023-07-09T02:13:50.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa96a7fc640 1 -- 172.21.15.45:0/1524497874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700b5d20 con 0x7fa9740cd120 2023-07-09T02:13:50.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97415f420 con 0x7fa9740cd120 2023-07-09T02:13:50.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97404d7d0 con 0x7fa9740cd120 2023-07-09T02:13:50.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.719+0000 7fa96a7fc640 1 -- 172.21.15.45:0/1524497874 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9700bf410 con 0x7fa9740cd120 2023-07-09T02:13:50.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.723+0000 7fa96a7fc640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa958066280 0x7fa958068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:13:50.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.723+0000 7fa96a7fc640 1 -- 172.21.15.45:0/1524497874 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa97011f2f0 con 0x7fa9740cd120 2023-07-09T02:13:50.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.723+0000 7fa9792c7640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa958066280 0x7fa958068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:13:50.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.723+0000 7fa9792c7640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa958066280 0x7fa958068730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa974164b90 tx=0x7fa964007bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:13:50.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.723+0000 7fa96a7fc640 1 -- 172.21.15.45:0/1524497874 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9700ec900 con 0x7fa9740cd120 2023-07-09T02:13:50.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa97406baa0 con 0x7fa9740cd120 2023-07-09T02:13:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa96a7fc640 1 -- 172.21.15.45:0/1524497874 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4675 (secure 0 0 0) 0x7fa9700eff20 con 0x7fa9740cd120 2023-07-09T02:13:50.937 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:13:50.938 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2676442896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2676442896},{"type":"v1","addr":"172.21.15.155:6837","nonce":2676442896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/193698688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":193698688},{"type":"v1","addr":"172.21.15.155:6836","nonce":193698688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1939767585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1939767585},{"type":"v1","addr":"172.21.15.45:6834","nonce":1939767585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:13:41.846779+0000","modified":"2023-07-09T02:13:45.491078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6096":{"gid":6096,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3771949487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3771949487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3771949487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T02:13:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 34 2023-07-09T02:13:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa958066280 msgr2=0x7fa958068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa958066280 0x7fa958068730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa974164b90 tx=0x7fa964007bc0 comp rx=0 tx=0).stop 2023-07-09T02:13:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740cd120 msgr2=0x7fa974157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:13:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740cd120 0x7fa974157fb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa9700ad040 tx=0x7fa97001ac90 comp rx=0 tx=0).stop 2023-07-09T02:13:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 shutdown_connections 2023-07-09T02:13:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97415c060 0x7fa9741587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa958066280 0x7fa958068730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740d2620 0x7fa97415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 --2- 172.21.15.45:0/1524497874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740cd120 0x7fa974157fb0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:13:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 >> 172.21.15.45:0/1524497874 conn(0x7fa9740698e0 msgr2=0x7fa9740b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:13:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 shutdown_connections 2023-07-09T02:13:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:13:50.911+0000 7fa97bd2c640 1 -- 172.21.15.45:0/1524497874 wait complete. 2023-07-09T02:13:50.943 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-07-09T02:13:51.112 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":6096,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.6395402689999994,"mdsmap_epoch":34,"osdmap_epoch":68,"osdmap_epoch_barrier":68,"uptime":14.409866208} 2023-07-09T02:13:51.113 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 6096, "mdsmap_epoch": 34, "osdmap_epoch": 68, "osdmap_epoch_barrier": 68, "rank_uptime": 8.639540269, "state": "up:active", "uptime": 14.409866208, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:13:51.114 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-07-09T02:13:51.275 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_mon_report_interval":"5"} 2023-07-09T02:13:51.276 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-07-09T02:13:51.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-07-09T02:13:51.429 INFO:teuthology.orchestra.run.smithi045.stdout:{"mon_tick_interval":"5"} 2023-07-09T02:13:51.430 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-07-09T02:13:51.430 INFO:tasks.cephfs.test_full:pool capacity 556983872, 531MB should be enough to fill it 2023-07-09T02:13:51.431 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:13:51.431 DEBUG:teuthology.orchestra.run.smithi045:> import time 2023-07-09T02:13:51.431 DEBUG:teuthology.orchestra.run.smithi045:> import datetime 2023-07-09T02:13:51.431 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-07-09T02:13:51.432 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:13:51.432 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.432 DEBUG:teuthology.orchestra.run.smithi045:> # Write some buffered data through before going full, all should be well 2023-07-09T02:13:51.433 DEBUG:teuthology.orchestra.run.smithi045:> print("writing some data through which we expect to succeed") 2023-07-09T02:13:51.433 DEBUG:teuthology.orchestra.run.smithi045:> bytes = 0 2023-07-09T02:13:51.433 DEBUG:teuthology.orchestra.run.smithi045:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-07-09T02:13:51.433 DEBUG:teuthology.orchestra.run.smithi045:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-07-09T02:13:51.434 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-07-09T02:13:51.434 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f) 2023-07-09T02:13:51.435 DEBUG:teuthology.orchestra.run.smithi045:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-07-09T02:13:51.435 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.436 DEBUG:teuthology.orchestra.run.smithi045:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-07-09T02:13:51.436 DEBUG:teuthology.orchestra.run.smithi045:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-07-09T02:13:51.436 DEBUG:teuthology.orchestra.run.smithi045:> # buffered IO, the error should always only appear from fsync and not 2023-07-09T02:13:51.437 DEBUG:teuthology.orchestra.run.smithi045:> # from write 2023-07-09T02:13:51.437 DEBUG:teuthology.orchestra.run.smithi045:> full = False 2023-07-09T02:13:51.437 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.438 DEBUG:teuthology.orchestra.run.smithi045:> for n in range(0, int(531 * 0.9)): 2023-07-09T02:13:51.439 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-07-09T02:13:51.439 DEBUG:teuthology.orchestra.run.smithi045:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-07-09T02:13:51.439 DEBUG:teuthology.orchestra.run.smithi045:> print("done writing {0} bytes".format(bytes)) 2023-07-09T02:13:51.439 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.440 DEBUG:teuthology.orchestra.run.smithi045:> # OK, now we should sneak in under the full condition 2023-07-09T02:13:51.440 DEBUG:teuthology.orchestra.run.smithi045:> # due to the time it takes the OSDs to report to the 2023-07-09T02:13:51.440 DEBUG:teuthology.orchestra.run.smithi045:> # mons, and get a successful fsync on our full-making data 2023-07-09T02:13:51.441 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f) 2023-07-09T02:13:51.441 DEBUG:teuthology.orchestra.run.smithi045:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-07-09T02:13:51.442 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.442 DEBUG:teuthology.orchestra.run.smithi045:> # buffered write, add more dirty data to the buffer 2023-07-09T02:13:51.442 DEBUG:teuthology.orchestra.run.smithi045:> print("starting buffered write") 2023-07-09T02:13:51.442 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-07-09T02:13:51.443 DEBUG:teuthology.orchestra.run.smithi045:> for n in range(0, int(531 * 0.2)): 2023-07-09T02:13:51.444 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-07-09T02:13:51.444 DEBUG:teuthology.orchestra.run.smithi045:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-07-09T02:13:51.444 DEBUG:teuthology.orchestra.run.smithi045:> time.sleep(15.0) 2023-07-09T02:13:51.445 DEBUG:teuthology.orchestra.run.smithi045:> except OSError: 2023-07-09T02:13:51.446 DEBUG:teuthology.orchestra.run.smithi045:> pass; 2023-07-09T02:13:51.446 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.447 DEBUG:teuthology.orchestra.run.smithi045:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-07-09T02:13:51.447 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.447 DEBUG:teuthology.orchestra.run.smithi045:> # Wait long enough for a background flush that should fail 2023-07-09T02:13:51.447 DEBUG:teuthology.orchestra.run.smithi045:> time.sleep(30) 2023-07-09T02:13:51.448 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.448 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-07-09T02:13:51.448 DEBUG:teuthology.orchestra.run.smithi045:> # ...and check that the failed background flush is reflected in fclose 2023-07-09T02:13:51.448 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-07-09T02:13:51.449 DEBUG:teuthology.orchestra.run.smithi045:> os.close(f) 2023-07-09T02:13:51.449 DEBUG:teuthology.orchestra.run.smithi045:> except OSError: 2023-07-09T02:13:51.449 DEBUG:teuthology.orchestra.run.smithi045:> print("close() returned an error as expected") 2023-07-09T02:13:51.449 DEBUG:teuthology.orchestra.run.smithi045:> else: 2023-07-09T02:13:51.450 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("close() failed to raise error") 2023-07-09T02:13:51.450 DEBUG:teuthology.orchestra.run.smithi045:> else: 2023-07-09T02:13:51.450 DEBUG:teuthology.orchestra.run.smithi045:> # The kernel cephfs client does not raise errors on fclose 2023-07-09T02:13:51.450 DEBUG:teuthology.orchestra.run.smithi045:> os.close(f) 2023-07-09T02:13:51.451 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:13:51.451 DEBUG:teuthology.orchestra.run.smithi045:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-07-09T02:13:51.452 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:13:51.873 INFO:teuthology.orchestra.run.smithi045.stdout:writing some data through which we expect to succeed 2023-07-09T02:13:51.873 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-07-09T02:13:51.874 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-07-09T02:13:51.874 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-07-09T02:13:51.874 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-07-09T02:13:51.874 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-07-09T02:13:51.875 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-07-09T02:13:51.875 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-07-09T02:13:51.875 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-07-09T02:13:51.876 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-07-09T02:13:51.876 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-07-09T02:13:51.877 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-07-09T02:13:51.877 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-07-09T02:13:51.878 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-07-09T02:13:51.878 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-07-09T02:13:51.878 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-07-09T02:13:51.878 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-07-09T02:13:51.879 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-07-09T02:13:51.879 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-07-09T02:13:51.879 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-07-09T02:13:51.879 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-07-09T02:13:51.880 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-07-09T02:13:51.881 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-07-09T02:13:51.881 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-07-09T02:13:51.881 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-07-09T02:13:51.882 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-07-09T02:13:51.882 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-07-09T02:13:51.882 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-07-09T02:13:51.882 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-07-09T02:13:51.882 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-07-09T02:13:51.882 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-07-09T02:13:51.882 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-07-09T02:13:51.883 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-07-09T02:13:51.883 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-07-09T02:13:51.883 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-07-09T02:13:51.883 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-07-09T02:13:51.883 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-07-09T02:13:51.883 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-07-09T02:13:51.883 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-07-09T02:13:51.883 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-07-09T02:13:51.884 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-07-09T02:13:51.884 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-07-09T02:13:51.884 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-07-09T02:13:51.884 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-07-09T02:13:51.884 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-07-09T02:13:51.884 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-07-09T02:13:51.884 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-07-09T02:13:51.884 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-07-09T02:13:51.885 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-07-09T02:13:51.885 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-07-09T02:13:51.885 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-07-09T02:13:51.885 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-07-09T02:13:51.885 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-07-09T02:13:51.885 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-07-09T02:13:51.885 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-07-09T02:13:51.886 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-07-09T02:13:51.886 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-07-09T02:13:51.886 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-07-09T02:13:51.886 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-07-09T02:13:51.886 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-07-09T02:13:51.886 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-07-09T02:13:51.886 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-07-09T02:13:51.886 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-07-09T02:13:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-07-09T02:13:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-07-09T02:13:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-07-09T02:13:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-07-09T02:13:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-07-09T02:13:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-07-09T02:13:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-07-09T02:13:51.887 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-07-09T02:13:51.888 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-07-09T02:13:51.888 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-07-09T02:13:51.888 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-07-09T02:13:51.888 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-07-09T02:13:51.888 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-07-09T02:13:51.888 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-07-09T02:13:51.888 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-07-09T02:13:51.889 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-07-09T02:13:51.889 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-07-09T02:13:51.889 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-07-09T02:13:51.889 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-07-09T02:13:51.889 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-07-09T02:13:51.889 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-07-09T02:13:51.889 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-07-09T02:13:51.889 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-07-09T02:13:51.890 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-07-09T02:13:51.890 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-07-09T02:13:51.890 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-07-09T02:13:51.890 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-07-09T02:13:51.890 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-07-09T02:13:51.890 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-07-09T02:13:51.890 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-07-09T02:13:51.890 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-07-09T02:13:51.891 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-07-09T02:13:51.891 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-07-09T02:13:51.891 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-07-09T02:13:51.891 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-07-09T02:13:51.891 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-07-09T02:13:51.891 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-07-09T02:13:51.891 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-07-09T02:13:51.892 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-07-09T02:13:51.892 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-07-09T02:13:51.892 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-07-09T02:13:51.892 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-07-09T02:13:51.892 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-07-09T02:13:51.892 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-07-09T02:13:51.892 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-07-09T02:13:51.892 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-07-09T02:13:51.893 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-07-09T02:13:51.893 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-07-09T02:13:51.893 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-07-09T02:13:51.893 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-07-09T02:13:51.893 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-07-09T02:13:51.893 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-07-09T02:13:51.893 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-07-09T02:13:51.893 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-07-09T02:13:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-07-09T02:13:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-07-09T02:13:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-07-09T02:13:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-07-09T02:13:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-07-09T02:13:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-07-09T02:13:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-07-09T02:13:51.894 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-07-09T02:13:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-07-09T02:13:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-07-09T02:13:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-07-09T02:13:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-07-09T02:13:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-07-09T02:13:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-07-09T02:13:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-07-09T02:13:51.895 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-07-09T02:13:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-07-09T02:13:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-07-09T02:13:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-07-09T02:13:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-07-09T02:13:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-07-09T02:13:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-07-09T02:13:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-07-09T02:13:51.896 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-07-09T02:13:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-07-09T02:13:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-07-09T02:13:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-07-09T02:13:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-07-09T02:13:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-07-09T02:13:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-07-09T02:13:51.897 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-07-09T02:13:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-07-09T02:13:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-07-09T02:13:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-07-09T02:13:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-07-09T02:13:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-07-09T02:13:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-07-09T02:13:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-07-09T02:13:51.898 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-07-09T02:13:52.043 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-07-09T02:13:52.043 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-07-09T02:13:52.044 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-07-09T02:13:52.044 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-07-09T02:13:52.044 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-07-09T02:13:52.045 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-07-09T02:13:52.045 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-07-09T02:13:52.045 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-07-09T02:13:52.046 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-07-09T02:13:52.046 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-07-09T02:13:52.046 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-07-09T02:13:52.047 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-07-09T02:13:52.047 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-07-09T02:13:52.047 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-07-09T02:13:52.047 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-07-09T02:13:52.047 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-07-09T02:13:52.048 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-07-09T02:13:52.048 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-07-09T02:13:52.048 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-07-09T02:13:52.048 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-07-09T02:13:52.048 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-07-09T02:13:52.049 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-07-09T02:13:52.049 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-07-09T02:13:52.049 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-07-09T02:13:52.049 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-07-09T02:13:52.049 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-07-09T02:13:52.049 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-07-09T02:13:52.050 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-07-09T02:13:52.050 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-07-09T02:13:52.050 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-07-09T02:13:52.050 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-07-09T02:13:52.050 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-07-09T02:13:52.050 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-07-09T02:13:52.051 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-07-09T02:13:52.051 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-07-09T02:13:52.051 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-07-09T02:13:52.051 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-07-09T02:13:52.051 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-07-09T02:13:52.051 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-07-09T02:13:52.052 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-07-09T02:13:52.052 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-07-09T02:13:52.052 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-07-09T02:13:52.052 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-07-09T02:13:52.052 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-07-09T02:13:52.052 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-07-09T02:13:52.052 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-07-09T02:13:52.053 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-07-09T02:13:52.053 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-07-09T02:13:52.053 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-07-09T02:13:52.053 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-07-09T02:13:52.053 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-07-09T02:13:52.053 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-07-09T02:13:52.053 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-07-09T02:13:52.054 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-07-09T02:13:52.054 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-07-09T02:13:52.054 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-07-09T02:13:52.054 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-07-09T02:13:52.054 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-07-09T02:13:52.054 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-07-09T02:13:52.054 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-07-09T02:13:52.055 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-07-09T02:13:52.055 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-07-09T02:13:52.055 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-07-09T02:13:52.055 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-07-09T02:13:52.055 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-07-09T02:13:52.055 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-07-09T02:13:52.056 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-07-09T02:13:52.056 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-07-09T02:13:52.056 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-07-09T02:13:52.056 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-07-09T02:13:52.056 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-07-09T02:13:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-07-09T02:13:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-07-09T02:13:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-07-09T02:13:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-07-09T02:13:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-07-09T02:13:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-07-09T02:13:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-07-09T02:13:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-07-09T02:13:52.058 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-07-09T02:13:52.058 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-07-09T02:13:52.058 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-07-09T02:13:52.058 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-07-09T02:13:52.058 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-07-09T02:13:52.058 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-07-09T02:13:52.059 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-07-09T02:13:52.059 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-07-09T02:13:52.059 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-07-09T02:13:52.059 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-07-09T02:13:52.059 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-07-09T02:13:52.059 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-07-09T02:13:52.059 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-07-09T02:13:52.060 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-07-09T02:13:52.060 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-07-09T02:13:52.060 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-07-09T02:13:52.060 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-07-09T02:13:52.060 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-07-09T02:13:52.060 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-07-09T02:13:52.061 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-07-09T02:13:52.061 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-07-09T02:13:52.061 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-07-09T02:13:52.061 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-07-09T02:13:52.061 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-07-09T02:13:52.062 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-07-09T02:13:52.062 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-07-09T02:13:52.062 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-07-09T02:13:52.063 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-07-09T02:13:52.063 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-07-09T02:13:52.063 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-07-09T02:13:52.063 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-07-09T02:13:52.064 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-07-09T02:13:52.064 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-07-09T02:13:52.064 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-07-09T02:13:52.064 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-07-09T02:13:52.065 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-07-09T02:13:52.065 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-07-09T02:13:52.065 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-07-09T02:13:52.066 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-07-09T02:13:52.066 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-07-09T02:13:52.066 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-07-09T02:13:52.066 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-07-09T02:13:52.067 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-07-09T02:13:52.067 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-07-09T02:13:52.067 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-07-09T02:13:52.068 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-07-09T02:13:52.068 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-07-09T02:13:52.068 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-07-09T02:13:52.068 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-07-09T02:13:52.068 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-07-09T02:13:52.069 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-07-09T02:13:52.069 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-07-09T02:13:52.069 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-07-09T02:13:52.069 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-07-09T02:13:52.069 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-07-09T02:13:52.069 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-07-09T02:13:52.070 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-07-09T02:13:52.070 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-07-09T02:13:52.070 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-07-09T02:13:52.070 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-07-09T02:13:52.071 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-07-09T02:13:52.071 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-07-09T02:13:52.071 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-07-09T02:13:52.072 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-07-09T02:13:52.072 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-07-09T02:13:52.073 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-07-09T02:13:52.073 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-07-09T02:13:52.073 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-07-09T02:13:52.073 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-07-09T02:13:52.074 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-07-09T02:13:52.074 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-07-09T02:13:52.074 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-07-09T02:13:52.074 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-07-09T02:13:52.075 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-07-09T02:13:52.075 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-07-09T02:13:52.214 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-07-09T02:13:52.214 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-07-09T02:13:52.214 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-07-09T02:13:52.214 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-07-09T02:13:52.214 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-07-09T02:13:52.214 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-07-09T02:13:52.215 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-07-09T02:13:52.215 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-07-09T02:13:52.215 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-07-09T02:13:52.215 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-07-09T02:13:52.215 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-07-09T02:13:52.215 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-07-09T02:13:52.215 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-07-09T02:13:52.216 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-07-09T02:13:52.216 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-07-09T02:13:52.216 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-07-09T02:13:52.216 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-07-09T02:13:52.216 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-07-09T02:13:52.216 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-07-09T02:13:52.216 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-07-09T02:13:52.216 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-07-09T02:13:52.217 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-07-09T02:13:52.217 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-07-09T02:13:52.217 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-07-09T02:13:52.217 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-07-09T02:13:52.217 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-07-09T02:13:52.217 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-07-09T02:13:52.217 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-07-09T02:13:52.217 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-07-09T02:13:52.218 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-07-09T02:13:52.218 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-07-09T02:13:52.218 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-07-09T02:13:52.218 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-07-09T02:13:52.218 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-07-09T02:13:52.218 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-07-09T02:13:52.218 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-07-09T02:13:52.219 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-07-09T02:13:52.219 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-07-09T02:13:52.219 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-07-09T02:13:52.219 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-07-09T02:13:52.219 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-07-09T02:13:52.219 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-07-09T02:13:52.219 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-07-09T02:13:52.219 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-07-09T02:13:52.220 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-07-09T02:13:52.220 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-07-09T02:13:52.220 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-07-09T02:13:52.220 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-07-09T02:13:52.220 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-07-09T02:13:52.220 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-07-09T02:13:52.220 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-07-09T02:13:52.220 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-07-09T02:13:52.221 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-07-09T02:13:52.221 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-07-09T02:13:52.221 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-07-09T02:13:52.221 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-07-09T02:13:52.221 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-07-09T02:13:52.221 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-07-09T02:13:52.221 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-07-09T02:13:52.221 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-07-09T02:13:52.222 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-07-09T02:13:52.222 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-07-09T02:13:52.222 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-07-09T02:13:52.222 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-07-09T02:13:52.222 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-07-09T02:13:52.222 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-07-09T02:13:52.222 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-07-09T02:13:52.222 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-07-09T02:13:52.223 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-07-09T02:13:52.223 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-07-09T02:13:52.223 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-07-09T02:13:52.224 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-07-09T02:13:52.224 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-07-09T02:13:52.224 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-07-09T02:13:52.224 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-07-09T02:13:52.224 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-07-09T02:13:52.225 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-07-09T02:13:52.225 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-07-09T02:13:52.225 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-07-09T02:13:52.225 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-07-09T02:13:52.225 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-07-09T02:13:52.225 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-07-09T02:13:52.225 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-07-09T02:13:52.225 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-07-09T02:13:52.226 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-07-09T02:13:52.226 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-07-09T02:13:52.226 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-07-09T02:13:52.226 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-07-09T02:13:52.226 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-07-09T02:13:52.226 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-07-09T02:13:52.226 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-07-09T02:13:52.227 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-07-09T02:13:52.227 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-07-09T02:13:52.227 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-07-09T02:13:52.227 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-07-09T02:13:52.227 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-07-09T02:13:52.227 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-07-09T02:13:52.227 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-07-09T02:13:52.227 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-07-09T02:13:52.228 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-07-09T02:13:52.228 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-07-09T02:13:52.228 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-07-09T02:13:52.228 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-07-09T02:13:52.228 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-07-09T02:13:52.228 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-07-09T02:13:52.228 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-07-09T02:13:52.228 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-07-09T02:13:52.229 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-07-09T02:13:52.229 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-07-09T02:13:52.229 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-07-09T02:13:52.229 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-07-09T02:13:52.229 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-07-09T02:13:52.229 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-07-09T02:13:52.229 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-07-09T02:13:52.229 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-07-09T02:13:52.230 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-07-09T02:13:52.230 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-07-09T02:13:52.230 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-07-09T02:13:52.230 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-07-09T02:13:52.230 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-07-09T02:13:52.230 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-07-09T02:13:52.230 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-07-09T02:13:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-07-09T02:13:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-07-09T02:13:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-07-09T02:13:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-07-09T02:13:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-07-09T02:13:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-07-09T02:13:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-07-09T02:13:52.231 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-07-09T02:13:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-07-09T02:13:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-07-09T02:13:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-07-09T02:13:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-07-09T02:13:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-07-09T02:13:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-07-09T02:13:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-07-09T02:13:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-07-09T02:13:52.233 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-07-09T02:13:52.233 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-07-09T02:13:52.233 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-07-09T02:13:52.233 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-07-09T02:13:52.233 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-07-09T02:13:52.233 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-07-09T02:13:52.233 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-07-09T02:13:52.233 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-07-09T02:13:52.234 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-07-09T02:13:52.234 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-07-09T02:13:52.234 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-07-09T02:13:52.234 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-07-09T02:13:52.234 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-07-09T02:13:52.234 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-07-09T02:13:52.234 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-07-09T02:13:52.234 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-07-09T02:13:56.534 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:13:56.531+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check failed: 3 full osd(s) (OSD_FULL) 2023-07-09T02:14:11.343 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:14:11.342+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL) 2023-07-09T02:14:18.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:14:18.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:14:48.237 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:14:48.246 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:14:53.521 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-07-09T02:14:53.521 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-07-09T02:14:53.522 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-07-09T02:14:53.522 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-07-09T02:14:53.522 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-07-09T02:14:53.522 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-07-09T02:14:53.522 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-07-09T02:14:53.522 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-07-09T02:14:53.522 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-07-09T02:14:53.522 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-07-09T02:14:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-07-09T02:14:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-07-09T02:14:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-07-09T02:14:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-07-09T02:14:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-07-09T02:14:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:done writing 500695040 bytes 2023-07-09T02:14:53.523 INFO:teuthology.orchestra.run.smithi045.stdout:successfully fsync'ed prior to getting full state reported 2023-07-09T02:14:53.524 INFO:teuthology.orchestra.run.smithi045.stdout:starting buffered write 2023-07-09T02:14:53.524 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:14:53.524 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:14:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-07-09T02:14:53.602 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:14:53.602 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:14:53.651 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:14:53.699 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:14:53.700 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:14:53.700 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:14:53.709 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:14:53.710 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:14:53.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:14:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f333b53a640 1 Processor -- start 2023-07-09T02:14:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f333b53a640 1 -- start start 2023-07-09T02:14:53.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f333b53a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f33340b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:53.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f333b53a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33340cd120 0x7f33340d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f333b53a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33340d2450 0x7f33340d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f333b53a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33340d28f0 con 0x7f33340d2450 2023-07-09T02:14:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f333b53a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3334160a50 con 0x7f33340cd120 2023-07-09T02:14:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f333b53a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333415c430 con 0x7f333415c060 2023-07-09T02:14:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3339ad7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33340d2450 0x7f33340d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3339ad7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33340d2450 0x7f33340d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34378/0 (socket says 172.21.15.45:34378) 2023-07-09T02:14:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3339ad7640 1 -- 172.21.15.45:0/234660265 learned_addr learned my addr 172.21.15.45:0/234660265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:53.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3338ad5640 1 --2- 172.21.15.45:0/234660265 >> v2:172.21.15.155:3300/0 conn(0x7f33340cd120 0x7f33340d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:53.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f33392d6640 1 --2- 172.21.15.45:0/234660265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f33340b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:53.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3339ad7640 1 -- 172.21.15.45:0/234660265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 msgr2=0x7f33340b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:53.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3339ad7640 1 --2- 172.21.15.45:0/234660265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f33340b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:53.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3339ad7640 1 -- 172.21.15.45:0/234660265 >> v2:172.21.15.155:3300/0 conn(0x7f33340cd120 msgr2=0x7f33340d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:53.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3339ad7640 1 --2- 172.21.15.45:0/234660265 >> v2:172.21.15.155:3300/0 conn(0x7f33340cd120 0x7f33340d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:53.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f3339ad7640 1 -- 172.21.15.45:0/234660265 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333415fb60 con 0x7f33340d2450 2023-07-09T02:14:53.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.950+0000 7f33392d6640 1 --2- 172.21.15.45:0/234660265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f33340b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:53.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f3339ad7640 1 --2- 172.21.15.45:0/234660265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340d0610 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f33340b5600 tx=0x7f332c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6673672cae21e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:53.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f332bfff640 1 -- 172.21.15.45:0/234660265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c0a5560 con 0x7f33340d2450 2023-07-09T02:14:53.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f332bfff640 1 -- 172.21.15.45:0/234660265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c0a56c0 con 0x7f33340d2450 2023-07-09T02:14:53.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f332bfff640 1 -- 172.21.15.45:0/234660265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c0a5a50 con 0x7f33340d2450 2023-07-09T02:14:53.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 -- 172.21.15.45:0/234660265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 msgr2=0x7f33340d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:53.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 --2- 172.21.15.45:0/234660265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340d0610 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f33340b5600 tx=0x7f332c01c6e0 comp rx=0 tx=0).stop 2023-07-09T02:14:53.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 -- 172.21.15.45:0/234660265 shutdown_connections 2023-07-09T02:14:53.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 --2- 172.21.15.45:0/234660265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340d0610 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:53.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 --2- 172.21.15.45:0/234660265 >> v2:172.21.15.155:3300/0 conn(0x7f33340cd120 0x7f33340d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:53.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 --2- 172.21.15.45:0/234660265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f33340b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:53.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 -- 172.21.15.45:0/234660265 >> 172.21.15.45:0/234660265 conn(0x7f33340698e0 msgr2=0x7f3334069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:53.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 -- 172.21.15.45:0/234660265 shutdown_connections 2023-07-09T02:14:53.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.954+0000 7f333b53a640 1 -- 172.21.15.45:0/234660265 wait complete. 2023-07-09T02:14:53.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 Processor -- start 2023-07-09T02:14:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 -- start start 2023-07-09T02:14:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33340cd120 0x7f3334151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f333415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33341f4fe0 con 0x7f33340d2450 2023-07-09T02:14:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3334151fb0 con 0x7f33340cd120 2023-07-09T02:14:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33341f4680 con 0x7f333415c060 2023-07-09T02:14:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34390/0 (socket says 172.21.15.45:34390) 2023-07-09T02:14:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 -- 172.21.15.45:0/684677253 learned_addr learned my addr 172.21.15.45:0/684677253 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f33392d6640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33340cd120 0x7f3334151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3339ad7640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f333415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 -- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 msgr2=0x7f333415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f333415ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 -- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33340cd120 msgr2=0x7f3334151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33340cd120 0x7f3334151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 -- 172.21.15.45:0/684677253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c009b30 con 0x7f33340d2450 2023-07-09T02:14:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3339ad7640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f333415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:14:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3338ad5640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340ca7e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f332400e8b0 tx=0x7f332400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3329ffb640 1 -- 172.21.15.45:0/684677253 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400c940 con 0x7f33340d2450 2023-07-09T02:14:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3329ffb640 1 -- 172.21.15.45:0/684677253 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400caa0 con 0x7f33340d2450 2023-07-09T02:14:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f3329ffb640 1 -- 172.21.15.45:0/684677253 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400ce30 con 0x7f33340d2450 2023-07-09T02:14:53.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33341f4920 con 0x7f33340d2450 2023-07-09T02:14:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.958+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33341f5400 con 0x7f33340d2450 2023-07-09T02:14:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.962+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333404d7d0 con 0x7f33340d2450 2023-07-09T02:14:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.962+0000 7f3329ffb640 1 -- 172.21.15.45:0/684677253 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3324013470 con 0x7f33340d2450 2023-07-09T02:14:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.962+0000 7f3329ffb640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3318066280 0x7f3318068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.962+0000 7f3329ffb640 1 -- 172.21.15.45:0/684677253 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f3324083c90 con 0x7f33340d2450 2023-07-09T02:14:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.962+0000 7f3329ffb640 1 -- 172.21.15.45:0/684677253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f331806e5a0 con 0x7f33340d2450 2023-07-09T02:14:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.962+0000 7f33392d6640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3318066280 0x7f3318068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:53.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.962+0000 7f33392d6640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3318066280 0x7f3318068730 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3334158a80 tx=0x7f3330008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:53.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:53.966+0000 7f3329ffb640 1 -- 172.21.15.45:0/684677253 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3324050fe0 con 0x7f33340d2450 2023-07-09T02:14:54.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.122+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f333406baa0 con 0x7f33340d2450 2023-07-09T02:14:54.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f3329ffb640 1 -- 172.21.15.45:0/684677253 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18603 (secure 0 0 0) 0x7f3324021090 con 0x7f33340d2450 2023-07-09T02:14:54.125 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:14:54.126 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":72,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:14:07.323559+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:13:39.573636+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T02:13:40.849108+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:14:54.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3318066280 msgr2=0x7f3318068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3318066280 0x7f3318068730 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3334158a80 tx=0x7f3330008040 comp rx=0 tx=0).stop 2023-07-09T02:14:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 msgr2=0x7f33340ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340ca7e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f332400e8b0 tx=0x7f332400ed70 comp rx=0 tx=0).stop 2023-07-09T02:14:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 shutdown_connections 2023-07-09T02:14:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3318066280 0x7f3318068730 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333415c060 0x7f333415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33340d2450 0x7f33340ca7e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 --2- 172.21.15.45:0/684677253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33340cd120 0x7f3334151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 >> 172.21.15.45:0/684677253 conn(0x7f33340698e0 msgr2=0x7f33340b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:54.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 shutdown_connections 2023-07-09T02:14:54.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.126+0000 7f333b53a640 1 -- 172.21.15.45:0/684677253 wait complete. 2023-07-09T02:14:54.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:13:39.573636+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:13:40.849108+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:14:54.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:14:54.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a3893640 1 Processor -- start 2023-07-09T02:14:54.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a3893640 1 -- start start 2023-07-09T02:14:54.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a3893640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f949c1604a0 0x7f949c164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a3893640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c06ef30 con 0x7f949c0ce010 2023-07-09T02:14:54.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a3893640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c165040 con 0x7f949c0c8dc0 2023-07-09T02:14:54.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a3893640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c06be90 con 0x7f949c1604a0 2023-07-09T02:14:54.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a162f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f949c1604a0 0x7f949c164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a1e30640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f949c0ce010 0x7f949c0caaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54648/0 (socket says 172.21.15.45:54648) 2023-07-09T02:14:54.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a1e30640 1 -- 172.21.15.45:0/1254619426 learned_addr learned my addr 172.21.15.45:0/1254619426 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:54.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a162f640 1 -- 172.21.15.45:0/1254619426 >> v1:172.21.15.155:6789/0 conn(0x7f949c0c8dc0 legacy=0x7f949c0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a162f640 1 -- 172.21.15.45:0/1254619426 >> v1:172.21.15.45:6789/0 conn(0x7f949c0ce010 legacy=0x7f949c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.294+0000 7f94a162f640 1 -- 172.21.15.45:0/1254619426 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c06b210 con 0x7f949c1604a0 2023-07-09T02:14:54.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f94a162f640 1 --2- 172.21.15.45:0/1254619426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c164b00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f94980097c0 tx=0x7f949801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76caf925b42c3915 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:54.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f9493fff640 1 -- 172.21.15.45:0/1254619426 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980ab600 con 0x7f949c1604a0 2023-07-09T02:14:54.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f9493fff640 1 -- 172.21.15.45:0/1254619426 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94980a7050 con 0x7f949c1604a0 2023-07-09T02:14:54.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f9493fff640 1 -- 172.21.15.45:0/1254619426 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980ab980 con 0x7f949c1604a0 2023-07-09T02:14:54.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f94a3893640 1 -- 172.21.15.45:0/1254619426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 msgr2=0x7f949c164b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f94a3893640 1 --2- 172.21.15.45:0/1254619426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c164b00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f94980097c0 tx=0x7f949801c480 comp rx=0 tx=0).stop 2023-07-09T02:14:54.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f94a3893640 1 -- 172.21.15.45:0/1254619426 shutdown_connections 2023-07-09T02:14:54.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f94a3893640 1 --2- 172.21.15.45:0/1254619426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c164b00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f94a3893640 1 -- 172.21.15.45:0/1254619426 >> 172.21.15.45:0/1254619426 conn(0x7f949c0694b0 msgr2=0x7f949c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:54.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f94a3893640 1 -- 172.21.15.45:0/1254619426 shutdown_connections 2023-07-09T02:14:54.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.298+0000 7f94a3893640 1 -- 172.21.15.45:0/1254619426 wait complete. 2023-07-09T02:14:54.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 Processor -- start 2023-07-09T02:14:54.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 -- start start 2023-07-09T02:14:54.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949c0c8dc0 0x7f949c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c0ce010 0x7f949c14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c14c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c149810 con 0x7f949c1604a0 2023-07-09T02:14:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0c44e0 con 0x7f949c0ce010 2023-07-09T02:14:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1564f0 con 0x7f949c0c8dc0 2023-07-09T02:14:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c14c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c14c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34404/0 (socket says 172.21.15.45:34404) 2023-07-09T02:14:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 -- 172.21.15.45:0/1715316181 learned_addr learned my addr 172.21.15.45:0/1715316181 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a0e2e640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c0ce010 0x7f949c14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a162f640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949c0c8dc0 0x7f949c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 -- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949c0c8dc0 msgr2=0x7f949c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949c0c8dc0 0x7f949c0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 -- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c0ce010 msgr2=0x7f949c14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c0ce010 0x7f949c14c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 -- 172.21.15.45:0/1715316181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498009420 con 0x7f949c1604a0 2023-07-09T02:14:54.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a1e30640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c14c810 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f949400cbc0 tx=0x7f949400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:54.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f9491ffb640 1 -- 172.21.15.45:0/1715316181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400ad40 con 0x7f949c1604a0 2023-07-09T02:14:54.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f9491ffb640 1 -- 172.21.15.45:0/1715316181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494012400 con 0x7f949c1604a0 2023-07-09T02:14:54.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f9491ffb640 1 -- 172.21.15.45:0/1715316181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949400aea0 con 0x7f949c1604a0 2023-07-09T02:14:54.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c1567d0 con 0x7f949c1604a0 2023-07-09T02:14:54.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.302+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c0c8340 con 0x7f949c1604a0 2023-07-09T02:14:54.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.306+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c156350 con 0x7f949c1604a0 2023-07-09T02:14:54.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.306+0000 7f9491ffb640 1 -- 172.21.15.45:0/1715316181 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9494007070 con 0x7f949c1604a0 2023-07-09T02:14:54.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.306+0000 7f9491ffb640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9480066280 0x7f9480068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.306+0000 7f9491ffb640 1 -- 172.21.15.45:0/1715316181 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f9494083de0 con 0x7f949c1604a0 2023-07-09T02:14:54.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.306+0000 7f9491ffb640 1 -- 172.21.15.45:0/1715316181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f948006e5a0 con 0x7f949c1604a0 2023-07-09T02:14:54.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.306+0000 7f94a162f640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9480066280 0x7f9480068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.306+0000 7f94a162f640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9480066280 0x7f9480068730 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f94980ad000 tx=0x7f9498008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:54.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.310+0000 7f9491ffb640 1 -- 172.21.15.45:0/1715316181 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9494017070 con 0x7f949c1604a0 2023-07-09T02:14:54.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.470+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f949c04d7d0 con 0x7f949c1604a0 2023-07-09T02:14:54.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.470+0000 7f9491ffb640 1 -- 172.21.15.45:0/1715316181 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f949c156350 con 0x7f949c1604a0 2023-07-09T02:14:54.471 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:14:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9480066280 msgr2=0x7f9480068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9480066280 0x7f9480068730 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f94980ad000 tx=0x7f9498008040 comp rx=0 tx=0).stop 2023-07-09T02:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 msgr2=0x7f949c14c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c14c810 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f949400cbc0 tx=0x7f949400a430 comp rx=0 tx=0).stop 2023-07-09T02:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 shutdown_connections 2023-07-09T02:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f949c1604a0 0x7f949c14c810 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c0ce010 0x7f949c14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9480066280 0x7f9480068730 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 --2- 172.21.15.45:0/1715316181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949c0c8dc0 0x7f949c0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 >> 172.21.15.45:0/1715316181 conn(0x7f949c0694b0 msgr2=0x7f949c0cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 shutdown_connections 2023-07-09T02:14:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.474+0000 7f94a3893640 1 -- 172.21.15.45:0/1715316181 wait complete. 2023-07-09T02:14:54.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:14:54.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.638+0000 7f056af00640 1 Processor -- start 2023-07-09T02:14:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f056af00640 1 -- start start 2023-07-09T02:14:54.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f056af00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05640c8d10 0x7f05640c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f056af00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056406bf30 con 0x7f05640ca0f0 2023-07-09T02:14:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f056af00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056406bc50 con 0x7f056415db00 2023-07-09T02:14:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f056af00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640cab90 con 0x7f05640c8d10 2023-07-09T02:14:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f0563fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05640c8d10 0x7f05640c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f0568c9c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f05640ca0f0 0x7f05640cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54658/0 (socket says 172.21.15.45:54658) 2023-07-09T02:14:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f0568c9c640 1 -- 172.21.15.45:0/1594438852 learned_addr learned my addr 172.21.15.45:0/1594438852 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f0563fff640 1 -- 172.21.15.45:0/1594438852 >> v1:172.21.15.155:6789/0 conn(0x7f056415db00 legacy=0x7f056406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f0563fff640 1 -- 172.21.15.45:0/1594438852 >> v1:172.21.15.45:6789/0 conn(0x7f05640ca0f0 legacy=0x7f05640cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f0563fff640 1 -- 172.21.15.45:0/1594438852 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640cae70 con 0x7f05640c8d10 2023-07-09T02:14:54.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.642+0000 7f05637fe640 1 -- 172.21.15.45:0/1594438852 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282930334 0 0) 0x7f056406bf30 con 0x7f05640ca0f0 2023-07-09T02:14:54.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f0563fff640 1 --2- 172.21.15.45:0/1594438852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640c8d10 0x7f05640c9160 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f05500097c0 tx=0x7f055001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b64e0d9ca3a53d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:54.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f05637fe640 1 -- 172.21.15.45:0/1594438852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05500ac630 con 0x7f05640c8d10 2023-07-09T02:14:54.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f05637fe640 1 -- 172.21.15.45:0/1594438852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05500ac790 con 0x7f05640c8d10 2023-07-09T02:14:54.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f05637fe640 1 -- 172.21.15.45:0/1594438852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05500acb20 con 0x7f05640c8d10 2023-07-09T02:14:54.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 -- 172.21.15.45:0/1594438852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640c8d10 msgr2=0x7f05640c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 --2- 172.21.15.45:0/1594438852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640c8d10 0x7f05640c9160 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f05500097c0 tx=0x7f055001c3b0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 -- 172.21.15.45:0/1594438852 shutdown_connections 2023-07-09T02:14:54.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 --2- 172.21.15.45:0/1594438852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640c8d10 0x7f05640c9160 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 -- 172.21.15.45:0/1594438852 >> 172.21.15.45:0/1594438852 conn(0x7f05640694b0 msgr2=0x7f05640698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:54.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 -- 172.21.15.45:0/1594438852 shutdown_connections 2023-07-09T02:14:54.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 -- 172.21.15.45:0/1594438852 wait complete. 2023-07-09T02:14:54.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 Processor -- start 2023-07-09T02:14:54.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.646+0000 7f056af00640 1 -- start start 2023-07-09T02:14:54.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05640c8d10 0x7f05640b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640ca0f0 0x7f056414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f056415db00 0x7f05640b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b3050 con 0x7f05640ca0f0 2023-07-09T02:14:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b3330 con 0x7f05640c8d10 2023-07-09T02:14:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b3610 con 0x7f056415db00 2023-07-09T02:14:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640ca0f0 0x7f056414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640ca0f0 0x7f056414f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34410/0 (socket says 172.21.15.45:34410) 2023-07-09T02:14:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 -- 172.21.15.45:0/2473169021 learned_addr learned my addr 172.21.15.45:0/2473169021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0568c9c640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05640c8d10 0x7f05640b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056949d640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f056415db00 0x7f05640b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 -- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f056415db00 msgr2=0x7f05640b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f056415db00 0x7f05640b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 -- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05640c8d10 msgr2=0x7f05640b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05640c8d10 0x7f05640b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 -- 172.21.15.45:0/2473169021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550009420 con 0x7f05640ca0f0 2023-07-09T02:14:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f0563fff640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640ca0f0 0x7f056414f250 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0550018fc0 tx=0x7f055001abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f05617fa640 1 -- 172.21.15.45:0/2473169021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05500b8650 con 0x7f05640ca0f0 2023-07-09T02:14:54.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f05617fa640 1 -- 172.21.15.45:0/2473169021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05500b87d0 con 0x7f05640ca0f0 2023-07-09T02:14:54.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f05617fa640 1 -- 172.21.15.45:0/2473169021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05500b8b80 con 0x7f05640ca0f0 2023-07-09T02:14:54.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05640b38f0 con 0x7f05640ca0f0 2023-07-09T02:14:54.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05640b4630 con 0x7f05640ca0f0 2023-07-09T02:14:54.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.650+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056404d7d0 con 0x7f05640ca0f0 2023-07-09T02:14:54.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.654+0000 7f05617fa640 1 -- 172.21.15.45:0/2473169021 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05500b8ce0 con 0x7f05640ca0f0 2023-07-09T02:14:54.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.654+0000 7f05617fa640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05480662b0 0x7f0548068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.654+0000 7f05617fa640 1 -- 172.21.15.45:0/2473169021 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f055011e7a0 con 0x7f05640ca0f0 2023-07-09T02:14:54.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.654+0000 7f05617fa640 1 -- 172.21.15.45:0/2473169021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f054806e5d0 con 0x7f05640ca0f0 2023-07-09T02:14:54.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.654+0000 7f0568c9c640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05480662b0 0x7f0548068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.654+0000 7f0568c9c640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05480662b0 0x7f0548068760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0558007fd0 tx=0x7f0558007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:54.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.658+0000 7f05617fa640 1 -- 172.21.15.45:0/2473169021 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f055011ce60 con 0x7f05640ca0f0 2023-07-09T02:14:54.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.814+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f056406c540 con 0x7f05640ca0f0 2023-07-09T02:14:54.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.814+0000 7f05617fa640 1 -- 172.21.15.45:0/2473169021 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05500bc020 con 0x7f05640ca0f0 2023-07-09T02:14:54.816 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:14:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05480662b0 msgr2=0x7f0548068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05480662b0 0x7f0548068760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0558007fd0 tx=0x7f0558007d60 comp rx=0 tx=0).stop 2023-07-09T02:14:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640ca0f0 msgr2=0x7f056414f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640ca0f0 0x7f056414f250 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0550018fc0 tx=0x7f055001abf0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 shutdown_connections 2023-07-09T02:14:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05480662b0 0x7f0548068760 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f056415db00 0x7f05640b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05640ca0f0 0x7f056414f250 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 --2- 172.21.15.45:0/2473169021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05640c8d10 0x7f05640b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 >> 172.21.15.45:0/2473169021 conn(0x7f05640694b0 msgr2=0x7f05640cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 shutdown_connections 2023-07-09T02:14:54.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.818+0000 7f056af00640 1 -- 172.21.15.45:0/2473169021 wait complete. 2023-07-09T02:14:54.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:14:54.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.982+0000 7f99bf911640 1 Processor -- start 2023-07-09T02:14:54.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.982+0000 7f99bf911640 1 -- start start 2023-07-09T02:14:54.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.982+0000 7f99bf911640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b815c060 0x7f99b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bf911640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f99b80cd120 0x7f99b80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bf911640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b8160a50 con 0x7f99b80d2450 2023-07-09T02:14:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bf911640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b80d28f0 con 0x7f99b80cd120 2023-07-09T02:14:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bf911640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80cfe40 con 0x7f99b815c060 2023-07-09T02:14:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bdeae640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99b80d2450 0x7f99b80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54662/0 (socket says 172.21.15.45:54662) 2023-07-09T02:14:54.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bdeae640 1 -- 172.21.15.45:0/2606266859 learned_addr learned my addr 172.21.15.45:0/2606266859 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:54.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bceac640 1 --2- 172.21.15.45:0/2606266859 >> v2:172.21.15.155:3300/0 conn(0x7f99b80cd120 0x7f99b80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bd6ad640 1 --2- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b815c060 0x7f99b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99affff640 1 -- 172.21.15.45:0/2606266859 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474128272 0 0) 0x7f99b8160a50 con 0x7f99b80d2450 2023-07-09T02:14:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99affff640 1 -- 172.21.15.45:0/2606266859 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a4003530 con 0x7f99b80d2450 2023-07-09T02:14:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bceac640 1 -- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b815c060 msgr2=0x7f99b80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bceac640 1 --2- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b815c060 0x7f99b80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bceac640 1 -- 172.21.15.45:0/2606266859 >> v1:172.21.15.45:6789/0 conn(0x7f99b80d2450 legacy=0x7f99b80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bceac640 1 -- 172.21.15.45:0/2606266859 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b815c430 con 0x7f99b80cd120 2023-07-09T02:14:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.986+0000 7f99bd6ad640 1 --2- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b815c060 0x7f99b80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:14:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bceac640 1 --2- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80cd120 0x7f99b80d1f10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f99a80097c0 tx=0x7f99a801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80ac6a816c924b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:54.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99affff640 1 -- 172.21.15.45:0/2606266859 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80ab600 con 0x7f99b80cd120 2023-07-09T02:14:54.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99affff640 1 -- 172.21.15.45:0/2606266859 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a80a7050 con 0x7f99b80cd120 2023-07-09T02:14:54.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99affff640 1 -- 172.21.15.45:0/2606266859 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80ab960 con 0x7f99b80cd120 2023-07-09T02:14:54.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 -- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80cd120 msgr2=0x7f99b80d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 --2- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80cd120 0x7f99b80d1f10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f99a80097c0 tx=0x7f99a801c450 comp rx=0 tx=0).stop 2023-07-09T02:14:54.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 -- 172.21.15.45:0/2606266859 shutdown_connections 2023-07-09T02:14:54.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 --2- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80cd120 0x7f99b80d1f10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 --2- 172.21.15.45:0/2606266859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b815c060 0x7f99b80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 -- 172.21.15.45:0/2606266859 >> 172.21.15.45:0/2606266859 conn(0x7f99b80698e0 msgr2=0x7f99b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:54.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 -- 172.21.15.45:0/2606266859 shutdown_connections 2023-07-09T02:14:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 -- 172.21.15.45:0/2606266859 wait complete. 2023-07-09T02:14:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 Processor -- start 2023-07-09T02:14:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 -- start start 2023-07-09T02:14:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b80cd120 0x7f99b8153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80d2450 0x7f99b815ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99b815c060 0x7f99b8156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.990+0000 7f99bf911640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815de90 con 0x7f99b815c060 2023-07-09T02:14:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bf911640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815d210 con 0x7f99b80d2450 2023-07-09T02:14:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bf911640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815d4f0 con 0x7f99b80cd120 2023-07-09T02:14:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99b815c060 0x7f99b8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99b815c060 0x7f99b8156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34426/0 (socket says 172.21.15.45:34426) 2023-07-09T02:14:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 -- 172.21.15.45:0/2031542645 learned_addr learned my addr 172.21.15.45:0/2031542645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bceac640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80d2450 0x7f99b815ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bd6ad640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b80cd120 0x7f99b8153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 -- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b80cd120 msgr2=0x7f99b8153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b80cd120 0x7f99b8153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 -- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80d2450 msgr2=0x7f99b815ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80d2450 0x7f99b815ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 -- 172.21.15.45:0/2031542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4009420 con 0x7f99b815c060 2023-07-09T02:14:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bdeae640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99b815c060 0x7f99b8156370 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f99b000cb40 tx=0x7f99b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99adffb640 1 -- 172.21.15.45:0/2031542645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000aca0 con 0x7f99b815c060 2023-07-09T02:14:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99adffb640 1 -- 172.21.15.45:0/2031542645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000ae00 con 0x7f99b815c060 2023-07-09T02:14:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99adffb640 1 -- 172.21.15.45:0/2031542645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0012620 con 0x7f99b815c060 2023-07-09T02:14:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a8009420 con 0x7f99b815c060 2023-07-09T02:14:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b815dab0 con 0x7f99b815c060 2023-07-09T02:14:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b815dfd0 con 0x7f99b815c060 2023-07-09T02:14:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.994+0000 7f99adffb640 1 -- 172.21.15.45:0/2031542645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99b0007070 con 0x7f99b815c060 2023-07-09T02:14:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.998+0000 7f99adffb640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f999c066280 0x7f999c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.998+0000 7f99adffb640 1 -- 172.21.15.45:0/2031542645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f99b0083dd0 con 0x7f99b815c060 2023-07-09T02:14:54.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.998+0000 7f99adffb640 1 -- 172.21.15.45:0/2031542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f999c06e5a0 con 0x7f99b815c060 2023-07-09T02:14:54.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.998+0000 7f99bd6ad640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f999c066280 0x7f999c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:54.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:54.998+0000 7f99bd6ad640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f999c066280 0x7f999c068730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009c50 tx=0x7f99b4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:55.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.002+0000 7f99adffb640 1 -- 172.21.15.45:0/2031542645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99b0017060 con 0x7f99b815c060 2023-07-09T02:14:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.154+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99b81603d0 con 0x7f99b815c060 2023-07-09T02:14:55.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.154+0000 7f99adffb640 1 -- 172.21.15.45:0/2031542645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99b815dfd0 con 0x7f99b815c060 2023-07-09T02:14:55.156 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:14:55.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f999c066280 msgr2=0x7f999c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f999c066280 0x7f999c068730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009c50 tx=0x7f99b4009190 comp rx=0 tx=0).stop 2023-07-09T02:14:55.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99b815c060 msgr2=0x7f99b8156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99b815c060 0x7f99b8156370 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f99b000cb40 tx=0x7f99b000a060 comp rx=0 tx=0).stop 2023-07-09T02:14:55.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 shutdown_connections 2023-07-09T02:14:55.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99b815c060 0x7f99b8156370 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99b80d2450 0x7f99b815ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f999c066280 0x7f999c068730 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 --2- 172.21.15.45:0/2031542645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99b80cd120 0x7f99b8153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 >> 172.21.15.45:0/2031542645 conn(0x7f99b80698e0 msgr2=0x7f99b80b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:55.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 shutdown_connections 2023-07-09T02:14:55.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.158+0000 7f99bf911640 1 -- 172.21.15.45:0/2031542645 wait complete. 2023-07-09T02:14:55.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:14:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06acc0b640 1 Processor -- start 2023-07-09T02:14:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06acc0b640 1 -- start start 2023-07-09T02:14:55.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06acc0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06a815c060 0x7f06a80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06acc0b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a8160a50 con 0x7f06a80cd120 2023-07-09T02:14:55.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06acc0b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a815c430 con 0x7f06a80d2620 2023-07-09T02:14:55.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06acc0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a815fb60 con 0x7f06a815c060 2023-07-09T02:14:55.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06a659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06a815c060 0x7f06a80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06a5d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f06a80cd120 0x7f06a80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54664/0 (socket says 172.21.15.45:54664) 2023-07-09T02:14:55.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06a5d9b640 1 -- 172.21.15.45:0/953199081 learned_addr learned my addr 172.21.15.45:0/953199081 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:55.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06a659c640 1 -- 172.21.15.45:0/953199081 >> v1:172.21.15.155:6789/0 conn(0x7f06a80d2620 legacy=0x7f06a80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:55.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06a659c640 1 -- 172.21.15.45:0/953199081 >> v1:172.21.15.45:6789/0 conn(0x7f06a80cd120 legacy=0x7f06a80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.326+0000 7f06a659c640 1 -- 172.21.15.45:0/953199081 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a815fe40 con 0x7f06a815c060 2023-07-09T02:14:55.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06a659c640 1 --2- 172.21.15.45:0/953199081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a80b4ed0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f06980097c0 tx=0x7f069801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4669d609031fc86d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06a559a640 1 -- 172.21.15.45:0/953199081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06980ab610 con 0x7f06a815c060 2023-07-09T02:14:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06a559a640 1 -- 172.21.15.45:0/953199081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06980ab770 con 0x7f06a815c060 2023-07-09T02:14:55.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06a559a640 1 -- 172.21.15.45:0/953199081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06980abb00 con 0x7f06a815c060 2023-07-09T02:14:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06acc0b640 1 -- 172.21.15.45:0/953199081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 msgr2=0x7f06a80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06acc0b640 1 --2- 172.21.15.45:0/953199081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a80b4ed0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f06980097c0 tx=0x7f069801c410 comp rx=0 tx=0).stop 2023-07-09T02:14:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06acc0b640 1 -- 172.21.15.45:0/953199081 shutdown_connections 2023-07-09T02:14:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06acc0b640 1 --2- 172.21.15.45:0/953199081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a80b4ed0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06acc0b640 1 -- 172.21.15.45:0/953199081 >> 172.21.15.45:0/953199081 conn(0x7f06a80698e0 msgr2=0x7f06a8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:55.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06acc0b640 1 -- 172.21.15.45:0/953199081 shutdown_connections 2023-07-09T02:14:55.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.330+0000 7f06acc0b640 1 -- 172.21.15.45:0/953199081 wait complete. 2023-07-09T02:14:55.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 Processor -- start 2023-07-09T02:14:55.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 -- start start 2023-07-09T02:14:55.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a80cd120 0x7f06a814f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a80d2620 0x7f06a814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a814ca10 con 0x7f06a815c060 2023-07-09T02:14:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a81532c0 con 0x7f06a80cd120 2023-07-09T02:14:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a815cb60 con 0x7f06a80d2620 2023-07-09T02:14:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a815c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34436/0 (socket says 172.21.15.45:34436) 2023-07-09T02:14:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 -- 172.21.15.45:0/1964016985 learned_addr learned my addr 172.21.15.45:0/1964016985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a659c640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a80cd120 0x7f06a814f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a5d9b640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a80d2620 0x7f06a814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 -- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a80d2620 msgr2=0x7f06a814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a80d2620 0x7f06a814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 -- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a80cd120 msgr2=0x7f06a814f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a80cd120 0x7f06a814f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 -- 172.21.15.45:0/1964016985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0698009420 con 0x7f06a815c060 2023-07-09T02:14:55.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a5d9b640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a80d2620 0x7f06a814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:55.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06a6d9d640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a815c620 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c780 tx=0x7f06a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:55.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f0696ffd640 1 -- 172.21.15.45:0/1964016985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a000aa50 con 0x7f06a815c060 2023-07-09T02:14:55.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f0696ffd640 1 -- 172.21.15.45:0/1964016985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a000abf0 con 0x7f06a815c060 2023-07-09T02:14:55.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f0696ffd640 1 -- 172.21.15.45:0/1964016985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a000ce30 con 0x7f06a815c060 2023-07-09T02:14:55.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a80b59f0 con 0x7f06a815c060 2023-07-09T02:14:55.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a815d110 con 0x7f06a815c060 2023-07-09T02:14:55.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.334+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a8153430 con 0x7f06a815c060 2023-07-09T02:14:55.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.338+0000 7f0696ffd640 1 -- 172.21.15.45:0/1964016985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06a0012420 con 0x7f06a815c060 2023-07-09T02:14:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.338+0000 7f0696ffd640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06880662b0 0x7f0688068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.338+0000 7f0696ffd640 1 -- 172.21.15.45:0/1964016985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f06a0083e30 con 0x7f06a815c060 2023-07-09T02:14:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.338+0000 7f0696ffd640 1 -- 172.21.15.45:0/1964016985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f068806e5d0 con 0x7f06a815c060 2023-07-09T02:14:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.338+0000 7f06a659c640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06880662b0 0x7f0688068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.338+0000 7f06a659c640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06880662b0 0x7f0688068760 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f06980af000 tx=0x7f06980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:55.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.342+0000 7f0696ffd640 1 -- 172.21.15.45:0/1964016985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06a0054ca0 con 0x7f06a815c060 2023-07-09T02:14:55.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.498+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06a804d7d0 con 0x7f06a815c060 2023-07-09T02:14:55.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.498+0000 7f0696ffd640 1 -- 172.21.15.45:0/1964016985 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06a0003eb0 con 0x7f06a815c060 2023-07-09T02:14:55.502 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:14:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06880662b0 msgr2=0x7f0688068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06880662b0 0x7f0688068760 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f06980af000 tx=0x7f06980a7000 comp rx=0 tx=0).stop 2023-07-09T02:14:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 msgr2=0x7f06a815c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a815c620 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c780 tx=0x7f06a000cc40 comp rx=0 tx=0).stop 2023-07-09T02:14:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 shutdown_connections 2023-07-09T02:14:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a815c060 0x7f06a815c620 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06880662b0 0x7f0688068760 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a80d2620 0x7f06a814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 --2- 172.21.15.45:0/1964016985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a80cd120 0x7f06a814f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 >> 172.21.15.45:0/1964016985 conn(0x7f06a80698e0 msgr2=0x7f06a80b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 shutdown_connections 2023-07-09T02:14:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.502+0000 7f06acc0b640 1 -- 172.21.15.45:0/1964016985 wait complete. 2023-07-09T02:14:55.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:14:55.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297cbfa640 1 Processor -- start 2023-07-09T02:14:55.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297cbfa640 1 -- start start 2023-07-09T02:14:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297cbfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f297815c060 0x7f29780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297cbfa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29780cd120 0x7f29780d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297cbfa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2978160a50 con 0x7f29780d2450 2023-07-09T02:14:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297cbfa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29780d28f0 con 0x7f29780cd120 2023-07-09T02:14:55.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297cbfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780cfe40 con 0x7f297815c060 2023-07-09T02:14:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f296ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29780cd120 0x7f29780d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f2976d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f29780d2450 0x7f29780d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54680/0 (socket says 172.21.15.45:54680) 2023-07-09T02:14:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f2976d9d640 1 -- 172.21.15.45:0/4062664206 learned_addr learned my addr 172.21.15.45:0/4062664206 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297659c640 1 --2- 172.21.15.45:0/4062664206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f297815c060 0x7f29780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f296ffff640 1 -- 172.21.15.45:0/4062664206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f297815c060 msgr2=0x7f29780b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f296ffff640 1 --2- 172.21.15.45:0/4062664206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f297815c060 0x7f29780b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f296ffff640 1 -- 172.21.15.45:0/4062664206 >> v1:172.21.15.45:6789/0 conn(0x7f29780d2450 legacy=0x7f29780d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f296ffff640 1 -- 172.21.15.45:0/4062664206 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297815c430 con 0x7f29780cd120 2023-07-09T02:14:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f297659c640 1 --2- 172.21.15.45:0/4062664206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f297815c060 0x7f29780b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:55.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.666+0000 7f2975d9b640 1 -- 172.21.15.45:0/4062664206 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642689024 0 0) 0x7f2978160a50 con 0x7f29780d2450 2023-07-09T02:14:55.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f296ffff640 1 --2- 172.21.15.45:0/4062664206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29780cd120 0x7f29780d1f10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f29600097c0 tx=0x7f296001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd618e606a11fcf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:55.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f2975d9b640 1 -- 172.21.15.45:0/4062664206 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29600ab600 con 0x7f29780cd120 2023-07-09T02:14:55.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f2975d9b640 1 -- 172.21.15.45:0/4062664206 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29600a7050 con 0x7f29780cd120 2023-07-09T02:14:55.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f2975d9b640 1 -- 172.21.15.45:0/4062664206 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29600ab980 con 0x7f29780cd120 2023-07-09T02:14:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f297cbfa640 1 -- 172.21.15.45:0/4062664206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29780cd120 msgr2=0x7f29780d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f297cbfa640 1 --2- 172.21.15.45:0/4062664206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29780cd120 0x7f29780d1f10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f29600097c0 tx=0x7f296001c450 comp rx=0 tx=0).stop 2023-07-09T02:14:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f297cbfa640 1 -- 172.21.15.45:0/4062664206 shutdown_connections 2023-07-09T02:14:55.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f297cbfa640 1 --2- 172.21.15.45:0/4062664206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29780cd120 0x7f29780d1f10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f297cbfa640 1 --2- 172.21.15.45:0/4062664206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f297815c060 0x7f29780b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f297cbfa640 1 -- 172.21.15.45:0/4062664206 >> 172.21.15.45:0/4062664206 conn(0x7f29780698e0 msgr2=0x7f2978069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:55.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f297cbfa640 1 -- 172.21.15.45:0/4062664206 shutdown_connections 2023-07-09T02:14:55.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.670+0000 7f297cbfa640 1 -- 172.21.15.45:0/4062664206 wait complete. 2023-07-09T02:14:55.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 Processor -- start 2023-07-09T02:14:55.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 -- start start 2023-07-09T02:14:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29780cd120 0x7f2978153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29780d2450 0x7f297815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297815c060 0x7f29780ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297815c700 con 0x7f297815c060 2023-07-09T02:14:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297815c970 con 0x7f29780d2450 2023-07-09T02:14:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297815cc50 con 0x7f29780cd120 2023-07-09T02:14:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297815c060 0x7f29780ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297815c060 0x7f29780ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34448/0 (socket says 172.21.15.45:34448) 2023-07-09T02:14:55.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 -- 172.21.15.45:0/929549068 learned_addr learned my addr 172.21.15.45:0/929549068 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297659c640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29780cd120 0x7f2978153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f296ffff640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29780d2450 0x7f297815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 -- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29780cd120 msgr2=0x7f2978153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29780cd120 0x7f2978153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 -- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29780d2450 msgr2=0x7f297815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29780d2450 0x7f297815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 -- 172.21.15.45:0/929549068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960009420 con 0x7f297815c060 2023-07-09T02:14:55.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f2976d9d640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297815c060 0x7f29780ca370 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f297000c7a0 tx=0x7f297000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:55.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f296effd640 1 -- 172.21.15.45:0/929549068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000a640 con 0x7f297815c060 2023-07-09T02:14:55.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f296effd640 1 -- 172.21.15.45:0/929549068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000a7a0 con 0x7f297815c060 2023-07-09T02:14:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f296effd640 1 -- 172.21.15.45:0/929549068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000abd0 con 0x7f297815c060 2023-07-09T02:14:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297815cf30 con 0x7f297815c060 2023-07-09T02:14:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.674+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2978159ec0 con 0x7f297815c060 2023-07-09T02:14:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.678+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297804d7d0 con 0x7f297815c060 2023-07-09T02:14:55.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.678+0000 7f296effd640 1 -- 172.21.15.45:0/929549068 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f297000ad30 con 0x7f297815c060 2023-07-09T02:14:55.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.678+0000 7f296effd640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2958066280 0x7f2958068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:55.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.678+0000 7f296effd640 1 -- 172.21.15.45:0/929549068 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2970083410 con 0x7f297815c060 2023-07-09T02:14:55.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.678+0000 7f296effd640 1 -- 172.21.15.45:0/929549068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f295806e5a0 con 0x7f297815c060 2023-07-09T02:14:55.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.678+0000 7f297659c640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2958066280 0x7f2958068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:55.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.678+0000 7f297659c640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2958066280 0x7f2958068730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f29780b6780 tx=0x7f2968008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:55.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.682+0000 7f296effd640 1 -- 172.21.15.45:0/929549068 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2970018060 con 0x7f297815c060 2023-07-09T02:14:55.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.850+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f297806baa0 con 0x7f297815c060 2023-07-09T02:14:55.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.850+0000 7f296effd640 1 -- 172.21.15.45:0/929549068 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2970050760 con 0x7f297815c060 2023-07-09T02:14:55.852 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:14:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.850+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2958066280 msgr2=0x7f2958068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2958066280 0x7f2958068730 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f29780b6780 tx=0x7f2968008040 comp rx=0 tx=0).stop 2023-07-09T02:14:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297815c060 msgr2=0x7f29780ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297815c060 0x7f29780ca370 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f297000c7a0 tx=0x7f297000cc60 comp rx=0 tx=0).stop 2023-07-09T02:14:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 shutdown_connections 2023-07-09T02:14:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f297815c060 0x7f29780ca370 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29780d2450 0x7f297815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2958066280 0x7f2958068730 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 --2- 172.21.15.45:0/929549068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29780cd120 0x7f2978153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 >> 172.21.15.45:0/929549068 conn(0x7f29780698e0 msgr2=0x7f29780c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 shutdown_connections 2023-07-09T02:14:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:55.854+0000 7f297cbfa640 1 -- 172.21.15.45:0/929549068 wait complete. 2023-07-09T02:14:55.873 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:14:55.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:14:55.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:14:55.949 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:14:55.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:14:55.950 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:14:55.960 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:14:55.960 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:14:55.970 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:14:55.970 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:14:56.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:14:56.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.162+0000 7ff09d937640 1 Processor -- start 2023-07-09T02:14:56.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.162+0000 7ff09d937640 1 -- start start 2023-07-09T02:14:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff09d937640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff09815c060 0x7ff0980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff09d937640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0980cd120 0x7ff0980d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff09d937640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff098160a50 con 0x7ff0980d2450 2023-07-09T02:14:56.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff09d937640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0980d28d0 con 0x7ff0980cd120 2023-07-09T02:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff09d937640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0980cfe40 con 0x7ff09815c060 2023-07-09T02:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff0977fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0980d2450 0x7ff0980d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54682/0 (socket says 172.21.15.45:54682) 2023-07-09T02:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff0977fe640 1 -- 172.21.15.45:0/3545521961 learned_addr learned my addr 172.21.15.45:0/3545521961 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff0967fc640 1 --2- 172.21.15.45:0/3545521961 >> v2:172.21.15.45:3300/0 conn(0x7ff0980cd120 0x7ff0980d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff096ffd640 1 --2- 172.21.15.45:0/3545521961 >> v2:172.21.15.155:3300/0 conn(0x7ff09815c060 0x7ff0980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff0967fc640 1 -- 172.21.15.45:0/3545521961 >> v2:172.21.15.155:3300/0 conn(0x7ff09815c060 msgr2=0x7ff0980b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff0967fc640 1 --2- 172.21.15.45:0/3545521961 >> v2:172.21.15.155:3300/0 conn(0x7ff09815c060 0x7ff0980b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff0967fc640 1 -- 172.21.15.45:0/3545521961 >> v1:172.21.15.45:6789/0 conn(0x7ff0980d2450 legacy=0x7ff0980d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff0967fc640 1 -- 172.21.15.45:0/3545521961 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09815c430 con 0x7ff0980cd120 2023-07-09T02:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff095ffb640 1 -- 172.21.15.45:0/3545521961 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441772886 0 0) 0x7ff098160a50 con 0x7ff0980d2450 2023-07-09T02:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.166+0000 7ff096ffd640 1 --2- 172.21.15.45:0/3545521961 >> v2:172.21.15.155:3300/0 conn(0x7ff09815c060 0x7ff0980b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff0967fc640 1 --2- 172.21.15.45:0/3545521961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980cd120 0x7ff0980d1f10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff0980d3ad0 tx=0x7ff08c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b416626f82da48a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff095ffb640 1 -- 172.21.15.45:0/3545521961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c004230 con 0x7ff0980cd120 2023-07-09T02:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff095ffb640 1 -- 172.21.15.45:0/3545521961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c0a7050 con 0x7ff0980cd120 2023-07-09T02:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff095ffb640 1 -- 172.21.15.45:0/3545521961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c003620 con 0x7ff0980cd120 2023-07-09T02:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 -- 172.21.15.45:0/3545521961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980cd120 msgr2=0x7ff0980d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 --2- 172.21.15.45:0/3545521961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980cd120 0x7ff0980d1f10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff0980d3ad0 tx=0x7ff08c01c430 comp rx=0 tx=0).stop 2023-07-09T02:14:56.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 -- 172.21.15.45:0/3545521961 shutdown_connections 2023-07-09T02:14:56.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 --2- 172.21.15.45:0/3545521961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980cd120 0x7ff0980d1f10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 --2- 172.21.15.45:0/3545521961 >> v2:172.21.15.155:3300/0 conn(0x7ff09815c060 0x7ff0980b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 -- 172.21.15.45:0/3545521961 >> 172.21.15.45:0/3545521961 conn(0x7ff0980698e0 msgr2=0x7ff098069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:56.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 -- 172.21.15.45:0/3545521961 shutdown_connections 2023-07-09T02:14:56.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 -- 172.21.15.45:0/3545521961 wait complete. 2023-07-09T02:14:56.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 Processor -- start 2023-07-09T02:14:56.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.170+0000 7ff09d937640 1 -- start start 2023-07-09T02:14:56.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0980cd120 0x7ff0980b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980d2450 0x7ff0981f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09815c060 0x7ff0980b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0980b3d90 con 0x7ff0980d2450 2023-07-09T02:14:56.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0980b33a0 con 0x7ff0980cd120 2023-07-09T02:14:56.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0980b4050 con 0x7ff09815c060 2023-07-09T02:14:56.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980d2450 0x7ff0981f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980d2450 0x7ff0981f81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34466/0 (socket says 172.21.15.45:34466) 2023-07-09T02:14:56.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 -- 172.21.15.45:0/1435699648 learned_addr learned my addr 172.21.15.45:0/1435699648 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:56.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff096ffd640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0980cd120 0x7ff0980b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0977fe640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09815c060 0x7ff0980b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 -- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09815c060 msgr2=0x7ff0980b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09815c060 0x7ff0980b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 -- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0980cd120 msgr2=0x7ff0980b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0980cd120 0x7ff0980b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 -- 172.21.15.45:0/1435699648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009420 con 0x7ff0980d2450 2023-07-09T02:14:56.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff096ffd640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0980cd120 0x7ff0980b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff0967fc640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980d2450 0x7ff0981f81d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff08c019040 tx=0x7ff08c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff07ffff640 1 -- 172.21.15.45:0/1435699648 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c003bf0 con 0x7ff0980d2450 2023-07-09T02:14:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff07ffff640 1 -- 172.21.15.45:0/1435699648 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c003d50 con 0x7ff0980d2450 2023-07-09T02:14:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff07ffff640 1 -- 172.21.15.45:0/1435699648 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0ab640 con 0x7ff0980d2450 2023-07-09T02:14:56.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0980b4330 con 0x7ff0980d2450 2023-07-09T02:14:56.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0981f8710 con 0x7ff0980d2450 2023-07-09T02:14:56.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.174+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0980d20d0 con 0x7ff0980d2450 2023-07-09T02:14:56.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.178+0000 7ff07ffff640 1 -- 172.21.15.45:0/1435699648 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff08c0b2040 con 0x7ff0980d2450 2023-07-09T02:14:56.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.178+0000 7ff07ffff640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0840662b0 0x7ff084068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.178+0000 7ff07ffff640 1 -- 172.21.15.45:0/1435699648 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff08c11ddb0 con 0x7ff0980d2450 2023-07-09T02:14:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.178+0000 7ff07ffff640 1 -- 172.21.15.45:0/1435699648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7ff08406e5d0 con 0x7ff0980d2450 2023-07-09T02:14:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.178+0000 7ff096ffd640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0840662b0 0x7ff084068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.178+0000 7ff096ffd640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0840662b0 0x7ff084068760 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff08800b990 tx=0x7ff088008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.182+0000 7ff07ffff640 1 -- 172.21.15.45:0/1435699648 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff08c0b0060 con 0x7ff0980d2450 2023-07-09T02:14:56.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.338+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff09804d7d0 con 0x7ff0980d2450 2023-07-09T02:14:56.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.338+0000 7ff07ffff640 1 -- 172.21.15.45:0/1435699648 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18603 (secure 0 0 0) 0x7ff08c0b0070 con 0x7ff0980d2450 2023-07-09T02:14:56.340 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:14:56.341 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":72,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:14:07.323559+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:13:39.573636+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T02:13:40.849108+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:14:56.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0840662b0 msgr2=0x7ff084068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0840662b0 0x7ff084068760 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff08800b990 tx=0x7ff088008040 comp rx=0 tx=0).stop 2023-07-09T02:14:56.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980d2450 msgr2=0x7ff0981f81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980d2450 0x7ff0981f81d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff08c019040 tx=0x7ff08c0191d0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 shutdown_connections 2023-07-09T02:14:56.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff0840662b0 0x7ff084068760 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09815c060 0x7ff0980b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0980d2450 0x7ff0981f81d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 --2- 172.21.15.45:0/1435699648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0980cd120 0x7ff0980b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 >> 172.21.15.45:0/1435699648 conn(0x7ff0980698e0 msgr2=0x7ff09815b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:56.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 shutdown_connections 2023-07-09T02:14:56.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.342+0000 7ff09d937640 1 -- 172.21.15.45:0/1435699648 wait complete. 2023-07-09T02:14:56.362 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:13:39.573636+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:13:40.849108+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:14:56.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:14:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd541819640 1 Processor -- start 2023-07-09T02:14:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd541819640 1 -- start start 2023-07-09T02:14:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd541819640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd53c15c060 0x7fd53c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd541819640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c160a50 con 0x7fd53c0cd120 2023-07-09T02:14:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd541819640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c15c430 con 0x7fd53c0d2620 2023-07-09T02:14:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd541819640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c15fb60 con 0x7fd53c15c060 2023-07-09T02:14:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd533fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd53c0cd120 0x7fd53c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54698/0 (socket says 172.21.15.45:54698) 2023-07-09T02:14:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd533fff640 1 -- 172.21.15.45:0/1563467148 learned_addr learned my addr 172.21.15.45:0/1563467148 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd53affd640 1 --2- 172.21.15.45:0/1563467148 >> v2:172.21.15.155:3300/0 conn(0x7fd53c15c060 0x7fd53c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062000158 0 0) 0x7fd53c160a50 con 0x7fd53c0cd120 2023-07-09T02:14:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.510+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd528003530 con 0x7fd53c0cd120 2023-07-09T02:14:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675730031 0 0) 0x7fd53c15c430 con 0x7fd53c0d2620 2023-07-09T02:14:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd53c160a50 con 0x7fd53c0d2620 2023-07-09T02:14:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2214558219 0 0) 0x7fd528003530 con 0x7fd53c0cd120 2023-07-09T02:14:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 >> v2:172.21.15.155:3300/0 conn(0x7fd53c15c060 msgr2=0x7fd53c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 --2- 172.21.15.45:0/1563467148 >> v2:172.21.15.155:3300/0 conn(0x7fd53c15c060 0x7fd53c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 >> v1:172.21.15.155:6789/0 conn(0x7fd53c0d2620 legacy=0x7fd53c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c15fe40 con 0x7fd53c0cd120 2023-07-09T02:14:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fd524001680 con 0x7fd53c0cd120 2023-07-09T02:14:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 >> v1:172.21.15.45:6789/0 conn(0x7fd53c0cd120 legacy=0x7fd53c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd528003b10 0x7fd528003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5280047d0 0x7fd528004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd52800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c15fb60 con 0x7fd528005180 2023-07-09T02:14:56.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52800bfe0 con 0x7fd528003b10 2023-07-09T02:14:56.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52800c1a0 con 0x7fd5280047d0 2023-07-09T02:14:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53b7fe640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd52800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53affd640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd528003b10 0x7fd528003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd533fff640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5280047d0 0x7fd528004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53b7fe640 1 -- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5280047d0 msgr2=0x7fd528004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53b7fe640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5280047d0 0x7fd528004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53b7fe640 1 -- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd528003b10 msgr2=0x7fd528003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53b7fe640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd528003b10 0x7fd528003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53b7fe640 1 -- 172.21.15.45:0/1563467148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528003530 con 0x7fd528005180 2023-07-09T02:14:56.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53affd640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd528003b10 0x7fd528003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:14:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53b7fe640 1 -- 172.21.15.45:0/1563467148 reap_dead start 2023-07-09T02:14:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.514+0000 7fd53b7fe640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd52800b990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06b140 tx=0x7fd53401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315c091c5d44edab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524007ea0 con 0x7fd528005180 2023-07-09T02:14:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534003b80 con 0x7fd528005180 2023-07-09T02:14:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd53a7fc640 1 -- 172.21.15.45:0/1563467148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5340050d0 con 0x7fd528005180 2023-07-09T02:14:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- 172.21.15.45:0/1563467148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 msgr2=0x7fd52800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd52800b990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06b140 tx=0x7fd53401c880 comp rx=0 tx=0).stop 2023-07-09T02:14:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- 172.21.15.45:0/1563467148 shutdown_connections 2023-07-09T02:14:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 --2- 172.21.15.45:0/1563467148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd52800b990 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- 172.21.15.45:0/1563467148 >> 172.21.15.45:0/1563467148 conn(0x7fd53c0698e0 msgr2=0x7fd53c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- 172.21.15.45:0/1563467148 shutdown_connections 2023-07-09T02:14:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- 172.21.15.45:0/1563467148 wait complete. 2023-07-09T02:14:56.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 Processor -- start 2023-07-09T02:14:56.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- start start 2023-07-09T02:14:56.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd53c1f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd53c1f4ec0 0x7fd53c1f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd53c1f5870 0x7fd53c14a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1f5ce0 con 0x7fd528005180 2023-07-09T02:14:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0cc4d0 con 0x7fd53c1f4ec0 2023-07-09T02:14:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd541819640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0cb950 con 0x7fd53c1f5870 2023-07-09T02:14:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd53affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd53c1f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd53affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd53c1f1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34488/0 (socket says 172.21.15.45:34488) 2023-07-09T02:14:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd53affd640 1 -- 172.21.15.45:0/1801897127 learned_addr learned my addr 172.21.15.45:0/1801897127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd53b7fe640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd53c1f5870 0x7fd53c14a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.518+0000 7fd533fff640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd53c1f4ec0 0x7fd53c1f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd53affd640 1 -- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd53c1f5870 msgr2=0x7fd53c14a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd53affd640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd53c1f5870 0x7fd53c14a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd53affd640 1 -- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd53c1f4ec0 msgr2=0x7fd53c1f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd53affd640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd53c1f4ec0 0x7fd53c1f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd53affd640 1 -- 172.21.15.45:0/1801897127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0cbc30 con 0x7fd528005180 2023-07-09T02:14:56.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd53b7fe640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd53c1f5870 0x7fd53c14a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:56.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd53affd640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd53c1f1130 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd52c011ac0 tx=0x7fd52c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd538ff9640 1 -- 172.21.15.45:0/1801897127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00fc10 con 0x7fd528005180 2023-07-09T02:14:56.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd538ff9640 1 -- 172.21.15.45:0/1801897127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c00fd70 con 0x7fd528005180 2023-07-09T02:14:56.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c0cbf10 con 0x7fd528005180 2023-07-09T02:14:56.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd538ff9640 1 -- 172.21.15.45:0/1801897127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00fee0 con 0x7fd528005180 2023-07-09T02:14:56.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c1f1670 con 0x7fd528005180 2023-07-09T02:14:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c04d7d0 con 0x7fd528005180 2023-07-09T02:14:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.522+0000 7fd538ff9640 1 -- 172.21.15.45:0/1801897127 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd52c004240 con 0x7fd528005180 2023-07-09T02:14:56.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.526+0000 7fd538ff9640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd51c066280 0x7fd51c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.526+0000 7fd538ff9640 1 -- 172.21.15.45:0/1801897127 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd52c0845d0 con 0x7fd528005180 2023-07-09T02:14:56.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.526+0000 7fd538ff9640 1 -- 172.21.15.45:0/1801897127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fd51c06e5a0 con 0x7fd528005180 2023-07-09T02:14:56.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.526+0000 7fd533fff640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd51c066280 0x7fd51c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.526+0000 7fd533fff640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd51c066280 0x7fd51c068730 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0b3320 tx=0x7fd524009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.530+0000 7fd538ff9640 1 -- 172.21.15.45:0/1801897127 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd52c022060 con 0x7fd528005180 2023-07-09T02:14:56.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd53c1603d0 con 0x7fd528005180 2023-07-09T02:14:56.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd538ff9640 1 -- 172.21.15.45:0/1801897127 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd52c051920 con 0x7fd528005180 2023-07-09T02:14:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:14:56.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd51c066280 msgr2=0x7fd51c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd51c066280 0x7fd51c068730 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0b3320 tx=0x7fd524009040 comp rx=0 tx=0).stop 2023-07-09T02:14:56.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 msgr2=0x7fd53c1f1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd53c1f1130 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd52c011ac0 tx=0x7fd52c011f80 comp rx=0 tx=0).stop 2023-07-09T02:14:56.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 shutdown_connections 2023-07-09T02:14:56.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd51c066280 0x7fd51c068730 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd53c1f5870 0x7fd53c14a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd53c1f4ec0 0x7fd53c1f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 --2- 172.21.15.45:0/1801897127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd528005180 0x7fd53c1f1130 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 >> 172.21.15.45:0/1801897127 conn(0x7fd53c0698e0 msgr2=0x7fd53c0b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:56.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 shutdown_connections 2023-07-09T02:14:56.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.762+0000 7fd541819640 1 -- 172.21.15.45:0/1801897127 wait complete. 2023-07-09T02:14:56.783 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:14:56.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc3c6d640 1 Processor -- start 2023-07-09T02:14:56.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc3c6d640 1 -- start start 2023-07-09T02:14:56.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc3c6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 0x7effbc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc3c6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effbc0d2620 0x7effbc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc3c6d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc160a50 con 0x7effbc0cd120 2023-07-09T02:14:56.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc3c6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc15c430 con 0x7effbc0d2620 2023-07-09T02:14:56.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc3c6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15fb60 con 0x7effbc15c060 2023-07-09T02:14:56.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc1208640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7effbc0cd120 0x7effbc0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54710/0 (socket says 172.21.15.45:54710) 2023-07-09T02:14:56.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc1208640 1 -- 172.21.15.45:0/1153081469 learned_addr learned my addr 172.21.15.45:0/1153081469 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:56.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc220a640 1 --2- 172.21.15.45:0/1153081469 >> v2:172.21.15.45:3300/0 conn(0x7effbc0d2620 0x7effbc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc1a09640 1 --2- 172.21.15.45:0/1153081469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 0x7effbc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc220a640 1 -- 172.21.15.45:0/1153081469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 msgr2=0x7effbc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:56.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc220a640 1 --2- 172.21.15.45:0/1153081469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 0x7effbc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc220a640 1 -- 172.21.15.45:0/1153081469 >> v1:172.21.15.45:6789/0 conn(0x7effbc0cd120 legacy=0x7effbc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc220a640 1 -- 172.21.15.45:0/1153081469 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc15fe40 con 0x7effbc0d2620 2023-07-09T02:14:56.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.930+0000 7effc0a07640 1 -- 172.21.15.45:0/1153081469 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723672170 0 0) 0x7effbc160a50 con 0x7effbc0cd120 2023-07-09T02:14:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc220a640 1 --2- 172.21.15.45:0/1153081469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc0cee30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7effb4009dc0 tx=0x7effb401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd7eaddb39f715 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc0a07640 1 -- 172.21.15.45:0/1153081469 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40a59c0 con 0x7effbc0d2620 2023-07-09T02:14:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc0a07640 1 -- 172.21.15.45:0/1153081469 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb40a5b20 con 0x7effbc0d2620 2023-07-09T02:14:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc0a07640 1 -- 172.21.15.45:0/1153081469 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40ad440 con 0x7effbc0d2620 2023-07-09T02:14:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc3c6d640 1 -- 172.21.15.45:0/1153081469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 msgr2=0x7effbc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1153081469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc0cee30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7effb4009dc0 tx=0x7effb401c900 comp rx=0 tx=0).stop 2023-07-09T02:14:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc3c6d640 1 -- 172.21.15.45:0/1153081469 shutdown_connections 2023-07-09T02:14:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1153081469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc0cee30 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1153081469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 0x7effbc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc3c6d640 1 -- 172.21.15.45:0/1153081469 >> 172.21.15.45:0/1153081469 conn(0x7effbc0698e0 msgr2=0x7effbc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc3c6d640 1 -- 172.21.15.45:0/1153081469 shutdown_connections 2023-07-09T02:14:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.934+0000 7effc3c6d640 1 -- 172.21.15.45:0/1153081469 wait complete. 2023-07-09T02:14:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 Processor -- start 2023-07-09T02:14:56.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 -- start start 2023-07-09T02:14:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effbc0cd120 0x7effbc153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 0x7effbc1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc154520 con 0x7effbc0d2620 2023-07-09T02:14:56.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15c600 con 0x7effbc0cd120 2023-07-09T02:14:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc15c8a0 con 0x7effbc15c060 2023-07-09T02:14:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc1582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34498/0 (socket says 172.21.15.45:34498) 2023-07-09T02:14:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 -- 172.21.15.45:0/1313465344 learned_addr learned my addr 172.21.15.45:0/1313465344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1a09640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effbc0cd120 0x7effbc153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc220a640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 0x7effbc1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 -- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 msgr2=0x7effbc1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 0x7effbc1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 -- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effbc0cd120 msgr2=0x7effbc153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effbc0cd120 0x7effbc153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 -- 172.21.15.45:0/1313465344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4009a70 con 0x7effbc0d2620 2023-07-09T02:14:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc1208640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc1582a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7effac00c4b0 tx=0x7effac00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effb27fc640 1 -- 172.21.15.45:0/1313465344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0074e0 con 0x7effbc0d2620 2023-07-09T02:14:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effb27fc640 1 -- 172.21.15.45:0/1313465344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac007660 con 0x7effbc0d2620 2023-07-09T02:14:56.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc0b59f0 con 0x7effbc0d2620 2023-07-09T02:14:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effb27fc640 1 -- 172.21.15.45:0/1313465344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac004a30 con 0x7effbc0d2620 2023-07-09T02:14:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.938+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc15ce60 con 0x7effbc0d2620 2023-07-09T02:14:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.942+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc04d7d0 con 0x7effbc0d2620 2023-07-09T02:14:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.942+0000 7effb27fc640 1 -- 172.21.15.45:0/1313465344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7effac004b90 con 0x7effbc0d2620 2023-07-09T02:14:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.942+0000 7effb27fc640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7effa0066280 0x7effa0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.942+0000 7effb27fc640 1 -- 172.21.15.45:0/1313465344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7effac082ff0 con 0x7effbc0d2620 2023-07-09T02:14:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.942+0000 7effc1a09640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7effa0066280 0x7effa0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.942+0000 7effb27fc640 1 -- 172.21.15.45:0/1313465344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7effa006e5a0 con 0x7effbc0d2620 2023-07-09T02:14:56.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.942+0000 7effc1a09640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7effa0066280 0x7effa0068730 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7effbc0ccd90 tx=0x7effb8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:56.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:56.946+0000 7effb27fc640 1 -- 172.21.15.45:0/1313465344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effac0b3700 con 0x7effbc0d2620 2023-07-09T02:14:57.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.102+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7effbc0b1920 con 0x7effbc0d2620 2023-07-09T02:14:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effb27fc640 1 -- 172.21.15.45:0/1313465344 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7effac018070 con 0x7effbc0d2620 2023-07-09T02:14:57.105 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:14:57.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7effa0066280 msgr2=0x7effa0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7effa0066280 0x7effa0068730 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7effbc0ccd90 tx=0x7effb8009190 comp rx=0 tx=0).stop 2023-07-09T02:14:57.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 msgr2=0x7effbc1582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc1582a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7effac00c4b0 tx=0x7effac00c970 comp rx=0 tx=0).stop 2023-07-09T02:14:57.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 shutdown_connections 2023-07-09T02:14:57.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7effa0066280 0x7effa0068730 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7effbc15c060 0x7effbc1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc0d2620 0x7effbc1582a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 --2- 172.21.15.45:0/1313465344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effbc0cd120 0x7effbc153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 >> 172.21.15.45:0/1313465344 conn(0x7effbc0698e0 msgr2=0x7effbc15b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:57.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 shutdown_connections 2023-07-09T02:14:57.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.106+0000 7effc3c6d640 1 -- 172.21.15.45:0/1313465344 wait complete. 2023-07-09T02:14:57.126 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:14:57.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe1684d8640 1 Processor -- start 2023-07-09T02:14:57.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe1684d8640 1 -- start start 2023-07-09T02:14:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe1684d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe16015c060 0x7fe1600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe1684d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600cd120 0x7fe1600d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe1684d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe160160a50 con 0x7fe1600d2450 2023-07-09T02:14:57.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe1684d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600d28f0 con 0x7fe16015c060 2023-07-09T02:14:57.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe1684d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600cfe40 con 0x7fe1600cd120 2023-07-09T02:14:57.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe165a73640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600cd120 0x7fe1600d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe165a73640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600cd120 0x7fe1600d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:53656/0 (socket says 172.21.15.45:53656) 2023-07-09T02:14:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe165a73640 1 -- 172.21.15.45:0/1925189731 learned_addr learned my addr 172.21.15.45:0/1925189731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe166274640 1 --2- 172.21.15.45:0/1925189731 >> v2:172.21.15.155:3300/0 conn(0x7fe16015c060 0x7fe1600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe165a73640 1 -- 172.21.15.45:0/1925189731 >> v2:172.21.15.155:3300/0 conn(0x7fe16015c060 msgr2=0x7fe1600b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe165a73640 1 --2- 172.21.15.45:0/1925189731 >> v2:172.21.15.155:3300/0 conn(0x7fe16015c060 0x7fe1600b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe165a73640 1 -- 172.21.15.45:0/1925189731 >> v1:172.21.15.155:6789/0 conn(0x7fe1600d2450 legacy=0x7fe1600d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.274+0000 7fe165a73640 1 -- 172.21.15.45:0/1925189731 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16015c430 con 0x7fe1600cd120 2023-07-09T02:14:57.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe165a73640 1 --2- 172.21.15.45:0/1925189731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600cd120 0x7fe1600d1f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe150009870 tx=0x7fe15001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d651c755ccb0c54 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe165272640 1 -- 172.21.15.45:0/1925189731 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500a7070 con 0x7fe1600cd120 2023-07-09T02:14:57.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe165272640 1 -- 172.21.15.45:0/1925189731 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500ab430 con 0x7fe1600cd120 2023-07-09T02:14:57.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe165272640 1 -- 172.21.15.45:0/1925189731 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500ab7c0 con 0x7fe1600cd120 2023-07-09T02:14:57.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe1684d8640 1 -- 172.21.15.45:0/1925189731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600cd120 msgr2=0x7fe1600d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1925189731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600cd120 0x7fe1600d1f10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe150009870 tx=0x7fe15001c510 comp rx=0 tx=0).stop 2023-07-09T02:14:57.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe1684d8640 1 -- 172.21.15.45:0/1925189731 shutdown_connections 2023-07-09T02:14:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1925189731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600cd120 0x7fe1600d1f10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1925189731 >> v2:172.21.15.155:3300/0 conn(0x7fe16015c060 0x7fe1600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe1684d8640 1 -- 172.21.15.45:0/1925189731 >> 172.21.15.45:0/1925189731 conn(0x7fe1600698e0 msgr2=0x7fe160069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe1684d8640 1 -- 172.21.15.45:0/1925189731 shutdown_connections 2023-07-09T02:14:57.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.278+0000 7fe1684d8640 1 -- 172.21.15.45:0/1925189731 wait complete. 2023-07-09T02:14:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 Processor -- start 2023-07-09T02:14:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 -- start start 2023-07-09T02:14:57.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1600cd120 0x7fe1601516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600d2450 0x7fe1600b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16015c060 0x7fe160156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600b6820 con 0x7fe16015c060 2023-07-09T02:14:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16015d540 con 0x7fe1600cd120 2023-07-09T02:14:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600b6540 con 0x7fe1600d2450 2023-07-09T02:14:57.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16015c060 0x7fe160156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16015c060 0x7fe160156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34510/0 (socket says 172.21.15.45:34510) 2023-07-09T02:14:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 -- 172.21.15.45:0/1432727661 learned_addr learned my addr 172.21.15.45:0/1432727661 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe165a73640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600d2450 0x7fe1600b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166274640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1600cd120 0x7fe1601516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 -- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600d2450 msgr2=0x7fe1600b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600d2450 0x7fe1600b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 -- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1600cd120 msgr2=0x7fe1601516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1600cd120 0x7fe1601516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 -- 172.21.15.45:0/1432727661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1500094d0 con 0x7fe16015c060 2023-07-09T02:14:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe166a75640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16015c060 0x7fe160156b60 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c770 tx=0x7fe15800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe156ffd640 1 -- 172.21.15.45:0/1432727661 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158003b80 con 0x7fe16015c060 2023-07-09T02:14:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe156ffd640 1 -- 172.21.15.45:0/1432727661 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe158003ce0 con 0x7fe16015c060 2023-07-09T02:14:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16015cef0 con 0x7fe16015c060 2023-07-09T02:14:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe156ffd640 1 -- 172.21.15.45:0/1432727661 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800aa90 con 0x7fe16015c060 2023-07-09T02:14:57.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16015f390 con 0x7fe16015c060 2023-07-09T02:14:57.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.282+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16015cd50 con 0x7fe16015c060 2023-07-09T02:14:57.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.286+0000 7fe156ffd640 1 -- 172.21.15.45:0/1432727661 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe15800abf0 con 0x7fe16015c060 2023-07-09T02:14:57.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.286+0000 7fe156ffd640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe144066280 0x7fe144068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.286+0000 7fe156ffd640 1 -- 172.21.15.45:0/1432727661 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe158083ae0 con 0x7fe16015c060 2023-07-09T02:14:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.286+0000 7fe156ffd640 1 -- 172.21.15.45:0/1432727661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fe14406e5a0 con 0x7fe16015c060 2023-07-09T02:14:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.286+0000 7fe166274640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe144066280 0x7fe144068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.286+0000 7fe166274640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe144066280 0x7fe144068730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009ac0 tx=0x7fe15c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.290+0000 7fe156ffd640 1 -- 172.21.15.45:0/1432727661 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe16015cd50 con 0x7fe16015c060 2023-07-09T02:14:57.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.442+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe16015cd50 con 0x7fe16015c060 2023-07-09T02:14:57.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.442+0000 7fe156ffd640 1 -- 172.21.15.45:0/1432727661 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe16015cd50 con 0x7fe16015c060 2023-07-09T02:14:57.444 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:14:57.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe144066280 msgr2=0x7fe144068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe144066280 0x7fe144068730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009ac0 tx=0x7fe15c009190 comp rx=0 tx=0).stop 2023-07-09T02:14:57.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16015c060 msgr2=0x7fe160156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16015c060 0x7fe160156b60 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c770 tx=0x7fe15800cc30 comp rx=0 tx=0).stop 2023-07-09T02:14:57.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 shutdown_connections 2023-07-09T02:14:57.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16015c060 0x7fe160156b60 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe144066280 0x7fe144068730 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1600d2450 0x7fe1600b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 --2- 172.21.15.45:0/1432727661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1600cd120 0x7fe1601516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 >> 172.21.15.45:0/1432727661 conn(0x7fe1600698e0 msgr2=0x7fe1600b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:57.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 shutdown_connections 2023-07-09T02:14:57.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.446+0000 7fe1684d8640 1 -- 172.21.15.45:0/1432727661 wait complete. 2023-07-09T02:14:57.465 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:14:57.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.610+0000 7fd8118d8640 1 Processor -- start 2023-07-09T02:14:57.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.610+0000 7fd8118d8640 1 -- start start 2023-07-09T02:14:57.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd8118d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd80c06b120 0x7fd80c06b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd8118d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 0x7fd80c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd8118d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c0cd320 con 0x7fd80c069980 2023-07-09T02:14:57.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd8118d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c071850 con 0x7fd80c06b120 2023-07-09T02:14:57.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd8118d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c06ba30 con 0x7fd80c0d2400 2023-07-09T02:14:57.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd80c069980 0x7fd80c069df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54716/0 (socket says 172.21.15.45:54716) 2023-07-09T02:14:57.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80b7fe640 1 -- 172.21.15.45:0/785280081 learned_addr learned my addr 172.21.15.45:0/785280081 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:57.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80affd640 1 --2- 172.21.15.45:0/785280081 >> v2:172.21.15.155:3300/0 conn(0x7fd80c06b120 0x7fd80c06b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80a7fc640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 0x7fd80c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370175894 0 0) 0x7fd80c0cd320 con 0x7fd80c069980 2023-07-09T02:14:57.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f4003530 con 0x7fd80c069980 2023-07-09T02:14:57.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2807804428 0 0) 0x7fd7f4003530 con 0x7fd80c069980 2023-07-09T02:14:57.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 msgr2=0x7fd80c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:57.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 0x7fd80c0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 >> v2:172.21.15.155:3300/0 conn(0x7fd80c06b120 msgr2=0x7fd80c06b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:57.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 --2- 172.21.15.45:0/785280081 >> v2:172.21.15.155:3300/0 conn(0x7fd80c06b120 0x7fd80c06b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c0d0ea0 con 0x7fd80c069980 2023-07-09T02:14:57.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fd804001a00 con 0x7fd80c069980 2023-07-09T02:14:57.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80a7fc640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 0x7fd80c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:14:57.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80affd640 1 --2- 172.21.15.45:0/785280081 >> v2:172.21.15.155:3300/0 conn(0x7fd80c06b120 0x7fd80c06b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:14:57.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 >> v1:172.21.15.45:6789/0 conn(0x7fd80c069980 legacy=0x7fd80c069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd7f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f40043b0 0x7fd7f4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 0x7fd7f4004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c071850 con 0x7fd7f4003980 2023-07-09T02:14:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c06ba30 con 0x7fd7f40043b0 2023-07-09T02:14:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f400b990 con 0x7fd80c0d2400 2023-07-09T02:14:57.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80affd640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd7f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80a7fc640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f40043b0 0x7fd7f4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80b7fe640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 0x7fd7f4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80affd640 1 -- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 msgr2=0x7fd7f4004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:57.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80affd640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c0d2400 0x7fd7f4004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80affd640 1 -- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f40043b0 msgr2=0x7fd7f4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:57.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80affd640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7f40043b0 0x7fd7f4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.614+0000 7fd80affd640 1 -- 172.21.15.45:0/785280081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009420 con 0x7fd7f4003980 2023-07-09T02:14:57.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd80affd640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd7f4003d90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009cb0 tx=0x7fd7fc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acc949e0f318577 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0a58e0 con 0x7fd7f4003980 2023-07-09T02:14:57.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0a5a40 con 0x7fd7f4003980 2023-07-09T02:14:57.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd809ffb640 1 -- 172.21.15.45:0/785280081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0a5df0 con 0x7fd7f4003980 2023-07-09T02:14:57.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd8118d8640 1 -- 172.21.15.45:0/785280081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 msgr2=0x7fd7f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd8118d8640 1 --2- 172.21.15.45:0/785280081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd7f4003d90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009cb0 tx=0x7fd7fc01cc40 comp rx=0 tx=0).stop 2023-07-09T02:14:57.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd80b7fe640 1 -- 172.21.15.45:0/785280081 reap_dead start 2023-07-09T02:14:57.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd8118d8640 1 -- 172.21.15.45:0/785280081 shutdown_connections 2023-07-09T02:14:57.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd8118d8640 1 -- 172.21.15.45:0/785280081 >> 172.21.15.45:0/785280081 conn(0x7fd80c0cf3d0 msgr2=0x7fd80c0cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:57.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd8118d8640 1 -- 172.21.15.45:0/785280081 shutdown_connections 2023-07-09T02:14:57.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd8118d8640 1 -- 172.21.15.45:0/785280081 wait complete. 2023-07-09T02:14:57.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.618+0000 7fd8118d8640 1 Processor -- start 2023-07-09T02:14:57.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 -- start start 2023-07-09T02:14:57.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd80c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c1428e0 0x7fd80c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd80c158770 0x7fd80c158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c15d290 con 0x7fd7f4003980 2023-07-09T02:14:57.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c162590 con 0x7fd80c158770 2023-07-09T02:14:57.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c162870 con 0x7fd80c1428e0 2023-07-09T02:14:57.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd80c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd80c15a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34536/0 (socket says 172.21.15.45:34536) 2023-07-09T02:14:57.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 -- 172.21.15.45:0/2336964734 learned_addr learned my addr 172.21.15.45:0/2336964734 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:57.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80a7fc640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c1428e0 0x7fd80c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80b7fe640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd80c158770 0x7fd80c158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 -- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c1428e0 msgr2=0x7fd80c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c1428e0 0x7fd80c157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 -- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd80c158770 msgr2=0x7fd80c158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd80c158770 0x7fd80c158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 -- 172.21.15.45:0/2336964734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c142d30 con 0x7fd7f4003980 2023-07-09T02:14:57.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd80affd640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd80c15a780 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0b0040 tx=0x7fd7f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd7f3fff640 1 -- 172.21.15.45:0/2336964734 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc004220 con 0x7fd7f4003980 2023-07-09T02:14:57.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd7f3fff640 1 -- 172.21.15.45:0/2336964734 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0043a0 con 0x7fd7f4003980 2023-07-09T02:14:57.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd7f3fff640 1 -- 172.21.15.45:0/2336964734 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc004510 con 0x7fd7f4003980 2023-07-09T02:14:57.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c15d570 con 0x7fd7f4003980 2023-07-09T02:14:57.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c159120 con 0x7fd7f4003980 2023-07-09T02:14:57.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.622+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c162a30 con 0x7fd7f4003980 2023-07-09T02:14:57.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.626+0000 7fd7f3fff640 1 -- 172.21.15.45:0/2336964734 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7fc0b4040 con 0x7fd7f4003980 2023-07-09T02:14:57.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.626+0000 7fd7f3fff640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7f80662b0 0x7fd7f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.626+0000 7fd7f3fff640 1 -- 172.21.15.45:0/2336964734 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd7fc11d640 con 0x7fd7f4003980 2023-07-09T02:14:57.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.626+0000 7fd7f3fff640 1 -- 172.21.15.45:0/2336964734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fd7f806e5d0 con 0x7fd7f4003980 2023-07-09T02:14:57.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.626+0000 7fd80a7fc640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7f80662b0 0x7fd7f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.626+0000 7fd80a7fc640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7f80662b0 0x7fd7f8068760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd80c1624c0 tx=0x7fd800009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.630+0000 7fd7f3fff640 1 -- 172.21.15.45:0/2336964734 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7fc0eaa40 con 0x7fd7f4003980 2023-07-09T02:14:57.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.782+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd80c0d2270 con 0x7fd7f4003980 2023-07-09T02:14:57.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.782+0000 7fd7f3fff640 1 -- 172.21.15.45:0/2336964734 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7fc0be020 con 0x7fd7f4003980 2023-07-09T02:14:57.783 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:14:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7f80662b0 msgr2=0x7fd7f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7f80662b0 0x7fd7f8068760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd80c1624c0 tx=0x7fd800009190 comp rx=0 tx=0).stop 2023-07-09T02:14:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 msgr2=0x7fd80c15a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd80c15a780 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0b0040 tx=0x7fd7f4005800 comp rx=0 tx=0).stop 2023-07-09T02:14:57.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 shutdown_connections 2023-07-09T02:14:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd80c158770 0x7fd80c158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7f80662b0 0x7fd7f8068760 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd80c1428e0 0x7fd80c157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 --2- 172.21.15.45:0/2336964734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f4003980 0x7fd80c15a780 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 >> 172.21.15.45:0/2336964734 conn(0x7fd80c0cf3d0 msgr2=0x7fd80c159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:57.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 shutdown_connections 2023-07-09T02:14:57.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.786+0000 7fd8118d8640 1 -- 172.21.15.45:0/2336964734 wait complete. 2023-07-09T02:14:57.805 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:14:57.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.946+0000 7f22001d5640 1 Processor -- start 2023-07-09T02:14:57.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.946+0000 7f22001d5640 1 -- start start 2023-07-09T02:14:57.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f22001d5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21f80d2620 0x7f21f80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f22001d5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21f80cd120 0x7f21f80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f22001d5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f8160a50 con 0x7f21f815c060 2023-07-09T02:14:57.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f22001d5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f815c430 con 0x7f21f80cd120 2023-07-09T02:14:57.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f22001d5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f815fb60 con 0x7f21f80d2620 2023-07-09T02:14:57.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fdf71640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21f815c060 0x7f21f80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54724/0 (socket says 172.21.15.45:54724) 2023-07-09T02:14:57.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fdf71640 1 -- 172.21.15.45:0/3314014984 learned_addr learned my addr 172.21.15.45:0/3314014984 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:57.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fe772640 1 --2- 172.21.15.45:0/3314014984 >> v2:172.21.15.45:3300/0 conn(0x7f21f80cd120 0x7f21f80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fd770640 1 --2- 172.21.15.45:0/3314014984 >> v2:172.21.15.155:3300/0 conn(0x7f21f80d2620 0x7f21f80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fcf6f640 1 -- 172.21.15.45:0/3314014984 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596902424 0 0) 0x7f21f8160a50 con 0x7f21f815c060 2023-07-09T02:14:57.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fcf6f640 1 -- 172.21.15.45:0/3314014984 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e4003530 con 0x7f21f815c060 2023-07-09T02:14:57.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fe772640 1 -- 172.21.15.45:0/3314014984 >> v2:172.21.15.155:3300/0 conn(0x7f21f80d2620 msgr2=0x7f21f80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:57.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fe772640 1 --2- 172.21.15.45:0/3314014984 >> v2:172.21.15.155:3300/0 conn(0x7f21f80d2620 0x7f21f80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fe772640 1 -- 172.21.15.45:0/3314014984 >> v1:172.21.15.45:6789/0 conn(0x7f21f815c060 legacy=0x7f21f80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.950+0000 7f21fe772640 1 -- 172.21.15.45:0/3314014984 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f815fe40 con 0x7f21f80cd120 2023-07-09T02:14:57.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f21fe772640 1 --2- 172.21.15.45:0/3314014984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f80cd120 0x7f21f80cee30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f21f815fac0 tx=0x7f21f001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05a7f42e94b2684 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f21fcf6f640 1 -- 172.21.15.45:0/3314014984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a59a0 con 0x7f21f80cd120 2023-07-09T02:14:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f21fcf6f640 1 -- 172.21.15.45:0/3314014984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f00a5b00 con 0x7f21f80cd120 2023-07-09T02:14:57.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f21fcf6f640 1 -- 172.21.15.45:0/3314014984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a5e90 con 0x7f21f80cd120 2023-07-09T02:14:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 -- 172.21.15.45:0/3314014984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f80cd120 msgr2=0x7f21f80cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 --2- 172.21.15.45:0/3314014984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f80cd120 0x7f21f80cee30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f21f815fac0 tx=0x7f21f001c8e0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 -- 172.21.15.45:0/3314014984 shutdown_connections 2023-07-09T02:14:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 --2- 172.21.15.45:0/3314014984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f80cd120 0x7f21f80cee30 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 --2- 172.21.15.45:0/3314014984 >> v2:172.21.15.155:3300/0 conn(0x7f21f80d2620 0x7f21f80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 -- 172.21.15.45:0/3314014984 >> 172.21.15.45:0/3314014984 conn(0x7f21f80698e0 msgr2=0x7f21f8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 -- 172.21.15.45:0/3314014984 shutdown_connections 2023-07-09T02:14:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 -- 172.21.15.45:0/3314014984 wait complete. 2023-07-09T02:14:57.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 Processor -- start 2023-07-09T02:14:57.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.954+0000 7f22001d5640 1 -- start start 2023-07-09T02:14:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f80cd120 0x7f21f815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f80d2620 0x7f21f80c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815c060 0x7f21f80c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f815ecb0 con 0x7f21f815c060 2023-07-09T02:14:57.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f815f610 con 0x7f21f80cd120 2023-07-09T02:14:57.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80ca050 con 0x7f21f80d2620 2023-07-09T02:14:57.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fe772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815c060 0x7f21f80c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f80cd120 0x7f21f815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f80cd120 0x7f21f815f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:41470/0 (socket says 172.21.15.45:41470) 2023-07-09T02:14:57.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 -- 172.21.15.45:0/452809718 learned_addr learned my addr 172.21.15.45:0/452809718 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:57.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fd770640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f80d2620 0x7f21f80c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fe772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815c060 0x7f21f80c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34554/0 (socket says 172.21.15.45:34554) 2023-07-09T02:14:57.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 -- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f80d2620 msgr2=0x7f21f80c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f80d2620 0x7f21f80c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 -- 172.21.15.45:0/452809718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815c060 msgr2=0x7f21f80c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:57.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815c060 0x7f21f80c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:57.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 -- 172.21.15.45:0/452809718 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009a70 con 0x7f21f80cd120 2023-07-09T02:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fe772640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815c060 0x7f21f80c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21fdf71640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f80cd120 0x7f21f815f0d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c420 tx=0x7f21f400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21ee7fc640 1 -- 172.21.15.45:0/452809718 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4005cf0 con 0x7f21f80cd120 2023-07-09T02:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21ee7fc640 1 -- 172.21.15.45:0/452809718 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4005e50 con 0x7f21f80cd120 2023-07-09T02:14:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21ee7fc640 1 -- 172.21.15.45:0/452809718 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f40072d0 con 0x7f21f80cd120 2023-07-09T02:14:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f80b59f0 con 0x7f21f80cd120 2023-07-09T02:14:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f815e310 con 0x7f21f80cd120 2023-07-09T02:14:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f804d7d0 con 0x7f21f80cd120 2023-07-09T02:14:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.958+0000 7f21ee7fc640 1 -- 172.21.15.45:0/452809718 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21f4007430 con 0x7f21f80cd120 2023-07-09T02:14:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.962+0000 7f21ee7fc640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.962+0000 7f21ee7fc640 1 -- 172.21.15.45:0/452809718 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f21f4083360 con 0x7f21f80cd120 2023-07-09T02:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.962+0000 7f21ee7fc640 1 -- 172.21.15.45:0/452809718 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f21dc06e5a0 con 0x7f21f80cd120 2023-07-09T02:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.962+0000 7f21fd770640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.962+0000 7f21fd770640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cd0f0 tx=0x7f21e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:57.966+0000 7f21ee7fc640 1 -- 172.21.15.45:0/452809718 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21f4050760 con 0x7f21f80cd120 2023-07-09T02:14:58.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.130+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f21f806baa0 con 0x7f21f80cd120 2023-07-09T02:14:58.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.130+0000 7f21ee7fc640 1 -- 172.21.15.45:0/452809718 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f21f4017020 con 0x7f21f80cd120 2023-07-09T02:14:58.130 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:14:58.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 msgr2=0x7f21dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cd0f0 tx=0x7f21e8008040 comp rx=0 tx=0).stop 2023-07-09T02:14:58.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f80cd120 msgr2=0x7f21f815f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f80cd120 0x7f21f815f0d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c420 tx=0x7f21f400c8e0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 shutdown_connections 2023-07-09T02:14:58.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815c060 0x7f21f80c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f80d2620 0x7f21f80c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 --2- 172.21.15.45:0/452809718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f80cd120 0x7f21f815f0d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 >> 172.21.15.45:0/452809718 conn(0x7f21f80698e0 msgr2=0x7f21f80b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:58.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 shutdown_connections 2023-07-09T02:14:58.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.134+0000 7f22001d5640 1 -- 172.21.15.45:0/452809718 wait complete. 2023-07-09T02:14:58.152 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:14:58.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:14:58.153 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:14:58.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:14:58.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:14:58.205 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:14:58.214 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:14:58.215 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:14:58.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:14:58.225 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:14:58.225 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:14:58.264 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:14:58.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:14:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.410+0000 7f6de2f2c640 1 Processor -- start 2023-07-09T02:14:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.410+0000 7f6de2f2c640 1 -- start start 2023-07-09T02:14:58.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.410+0000 7f6de2f2c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6ddc0d2620 0x7f6ddc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.410+0000 7f6de2f2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc160a50 con 0x7f6ddc0cd120 2023-07-09T02:14:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.410+0000 7f6de2f2c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc15c430 con 0x7f6ddc15c060 2023-07-09T02:14:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.410+0000 7f6de2f2c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc15fb60 con 0x7f6ddc0d2620 2023-07-09T02:14:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.410+0000 7f6de14c9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6ddc0cd120 0x7f6ddc0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54738/0 (socket says 172.21.15.45:54738) 2023-07-09T02:14:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.410+0000 7f6de14c9640 1 -- 172.21.15.45:0/2593120509 learned_addr learned my addr 172.21.15.45:0/2593120509 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:14:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddbfff640 1 --2- 172.21.15.45:0/2593120509 >> v2:172.21.15.155:3300/0 conn(0x7f6ddc0d2620 0x7f6ddc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39914888 0 0) 0x7f6ddc160a50 con 0x7f6ddc0cd120 2023-07-09T02:14:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dcc003530 con 0x7f6ddc0cd120 2023-07-09T02:14:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491819159 0 0) 0x7f6ddc15c430 con 0x7f6ddc15c060 2023-07-09T02:14:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ddc160a50 con 0x7f6ddc15c060 2023-07-09T02:14:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2541296241 0 0) 0x7f6dcc003530 con 0x7f6ddc0cd120 2023-07-09T02:14:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 >> v2:172.21.15.155:3300/0 conn(0x7f6ddc0d2620 msgr2=0x7f6ddc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 --2- 172.21.15.45:0/2593120509 >> v2:172.21.15.155:3300/0 conn(0x7f6ddc0d2620 0x7f6ddc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 >> v1:172.21.15.155:6789/0 conn(0x7f6ddc15c060 legacy=0x7f6ddc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc15fe40 con 0x7f6ddc0cd120 2023-07-09T02:14:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f6dd4001a00 con 0x7f6ddc0cd120 2023-07-09T02:14:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 >> v1:172.21.15.45:6789/0 conn(0x7f6ddc0cd120 legacy=0x7f6ddc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6dcc003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0047d0 0x7f6dcc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc005180 0x7f6dcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc15fb60 con 0x7f6dcc0047d0 2023-07-09T02:14:58.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc00bfe0 con 0x7f6dcc003b10 2023-07-09T02:14:58.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc00c1a0 con 0x7f6dcc005180 2023-07-09T02:14:58.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddbfff640 1 --2- 172.21.15.45:0/2593120509 >> v2:172.21.15.155:3300/0 conn(0x7f6ddc0d2620 0x7f6ddc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:14:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6de0cc8640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6dcc003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6ddbfff640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0047d0 0x7f6dcc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6de14c9640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc005180 0x7f6dcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6de0cc8640 1 -- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc005180 msgr2=0x7f6dcc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6de0cc8640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc005180 0x7f6dcc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6de0cc8640 1 -- 172.21.15.45:0/2593120509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0047d0 msgr2=0x7f6dcc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6de0cc8640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0047d0 0x7f6dcc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6de0cc8640 1 -- 172.21.15.45:0/2593120509 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc003530 con 0x7f6dcc003b10 2023-07-09T02:14:58.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.414+0000 7f6de14c9640 1 -- 172.21.15.45:0/2593120509 reap_dead start 2023-07-09T02:14:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de0cc8640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6dcc003f00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00018c0 tx=0x7f6dd001ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d20c52c005eb9372 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00052d0 con 0x7f6dcc003b10 2023-07-09T02:14:58.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd0005430 con 0x7f6dcc003b10 2023-07-09T02:14:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6ddb7fe640 1 -- 172.21.15.45:0/2593120509 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0003820 con 0x7f6dcc003b10 2023-07-09T02:14:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 -- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 msgr2=0x7f6dcc003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6dcc003f00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00018c0 tx=0x7f6dd001ecd0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 -- 172.21.15.45:0/2593120509 shutdown_connections 2023-07-09T02:14:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 --2- 172.21.15.45:0/2593120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6dcc003f00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 -- 172.21.15.45:0/2593120509 >> 172.21.15.45:0/2593120509 conn(0x7f6ddc0698e0 msgr2=0x7f6ddc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 -- 172.21.15.45:0/2593120509 shutdown_connections 2023-07-09T02:14:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 -- 172.21.15.45:0/2593120509 wait complete. 2023-07-09T02:14:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 Processor -- start 2023-07-09T02:14:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.418+0000 7f6de2f2c640 1 -- start start 2023-07-09T02:14:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6ddc0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ddc156ea0 0x7f6ddc1f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ddc0cbda0 0x7f6ddc0b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0cb8a0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0b5390 con 0x7f6dcc003b10 2023-07-09T02:14:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0cc5f0 con 0x7f6ddc156ea0 2023-07-09T02:14:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ddc0cbda0 0x7f6ddc0b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ddc0cbda0 0x7f6ddc0b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34562/0 (socket says 172.21.15.45:34562) 2023-07-09T02:14:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 -- 172.21.15.45:0/1858130704 learned_addr learned my addr 172.21.15.45:0/1858130704 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:58.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de0cc8640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6ddc0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6ddbfff640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ddc156ea0 0x7f6ddc1f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 -- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ddc156ea0 msgr2=0x7f6ddc1f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ddc156ea0 0x7f6ddc1f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 -- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 msgr2=0x7f6ddc0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6ddc0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 -- 172.21.15.45:0/1858130704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc0cc8d0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de14c9640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ddc0cbda0 0x7f6ddc0b3a90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc06a730 tx=0x7f6dd4007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:58.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40114f0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd4011670 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc1f1b80 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4011a20 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc1f28c0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc1f20a0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.422+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6dd4011b80 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.426+0000 7f6dd97fa640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dc0066280 0x7f6dc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.426+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f6dd40835c0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.426+0000 7f6de0cc8640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dc0066280 0x7f6dc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.426+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f6dc006e5a0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.426+0000 7f6de0cc8640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dc0066280 0x7f6dc0068730 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00b0000 tx=0x7f6dd00b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:58.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.430+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6dd4019060 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.503 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:14:58.502+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-07-09T02:14:58.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.506+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(73..73 src has 1..73) v4 ==== 441+0+0 (secure 0 0 0) 0x7f6dd4011e30 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.510+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f6dc006eec0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ddc04d7d0 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6dd97fa640 1 -- 172.21.15.45:0/1858130704 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f6dd4019070 con 0x7f6ddc0cbda0 2023-07-09T02:14:58.622 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:14:58.622 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2676442896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2676442896},{"type":"v1","addr":"172.21.15.155:6837","nonce":2676442896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/193698688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":193698688},{"type":"v1","addr":"172.21.15.155:6836","nonce":193698688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1939767585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1939767585},{"type":"v1","addr":"172.21.15.45:6834","nonce":1939767585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:13:41.846779+0000","modified":"2023-07-09T02:13:45.491078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6096":{"gid":6096,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3771949487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3771949487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3771949487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T02:14:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 34 2023-07-09T02:14:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dc0066280 msgr2=0x7f6dc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dc0066280 0x7f6dc0068730 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00b0000 tx=0x7f6dd00b2040 comp rx=0 tx=0).stop 2023-07-09T02:14:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ddc0cbda0 msgr2=0x7f6ddc0b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ddc0cbda0 0x7f6ddc0b3a90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc06a730 tx=0x7f6dd4007a20 comp rx=0 tx=0).stop 2023-07-09T02:14:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 shutdown_connections 2023-07-09T02:14:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ddc0cbda0 0x7f6ddc0b3a90 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dc0066280 0x7f6dc0068730 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ddc156ea0 0x7f6ddc1f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 --2- 172.21.15.45:0/1858130704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003b10 0x7f6ddc0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 >> 172.21.15.45:0/1858130704 conn(0x7f6ddc0698e0 msgr2=0x7f6ddc159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 shutdown_connections 2023-07-09T02:14:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.622+0000 7f6de2f2c640 1 -- 172.21.15.45:0/1858130704 wait complete. 2023-07-09T02:14:58.644 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:14:58.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.786+0000 7f06aab1e640 1 Processor -- start 2023-07-09T02:14:58.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.786+0000 7f06aab1e640 1 -- start start 2023-07-09T02:14:58.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06aab1e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06a4142500 0x7f06a40cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06aab1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a40cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06aab1e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a40cf320 con 0x7f06a4160630 2023-07-09T02:14:58.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06aab1e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a40cd6d0 con 0x7f06a4142500 2023-07-09T02:14:58.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06aab1e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a415d590 con 0x7f06a4069bc0 2023-07-09T02:14:58.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a90bb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a40cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a88ba640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06a4142500 0x7f06a40cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a88ba640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06a4142500 0x7f06a40cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:41514/0 (socket says 172.21.15.45:41514) 2023-07-09T02:14:58.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a88ba640 1 -- 172.21.15.45:0/2137483172 learned_addr learned my addr 172.21.15.45:0/2137483172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:58.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a37fe640 1 -- 172.21.15.45:0/2137483172 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272123798 0 0) 0x7f06a40cf320 con 0x7f06a4160630 2023-07-09T02:14:58.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a90bb640 1 -- 172.21.15.45:0/2137483172 >> v2:172.21.15.155:3300/0 conn(0x7f06a4142500 msgr2=0x7f06a40cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:58.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a90bb640 1 --2- 172.21.15.45:0/2137483172 >> v2:172.21.15.155:3300/0 conn(0x7f06a4142500 0x7f06a40cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a90bb640 1 -- 172.21.15.45:0/2137483172 >> v1:172.21.15.155:6789/0 conn(0x7f06a4160630 legacy=0x7f06a40694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a90bb640 1 -- 172.21.15.45:0/2137483172 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a415c7d0 con 0x7f06a4069bc0 2023-07-09T02:14:58.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.790+0000 7f06a88ba640 1 --2- 172.21.15.45:0/2137483172 >> v2:172.21.15.155:3300/0 conn(0x7f06a4142500 0x7f06a40cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:14:58.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06a90bb640 1 --2- 172.21.15.45:0/2137483172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a40cf620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f069c009d90 tx=0x7f069c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=397703cd0359be80 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:58.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06a37fe640 1 -- 172.21.15.45:0/2137483172 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c0a59e0 con 0x7f06a4069bc0 2023-07-09T02:14:58.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06a37fe640 1 -- 172.21.15.45:0/2137483172 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c0a5b40 con 0x7f06a4069bc0 2023-07-09T02:14:58.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06a37fe640 1 -- 172.21.15.45:0/2137483172 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c0ad440 con 0x7f06a4069bc0 2023-07-09T02:14:58.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06aab1e640 1 -- 172.21.15.45:0/2137483172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 msgr2=0x7f06a40cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06aab1e640 1 --2- 172.21.15.45:0/2137483172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a40cf620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f069c009d90 tx=0x7f069c01c920 comp rx=0 tx=0).stop 2023-07-09T02:14:58.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06aab1e640 1 -- 172.21.15.45:0/2137483172 shutdown_connections 2023-07-09T02:14:58.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06aab1e640 1 --2- 172.21.15.45:0/2137483172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a40cf620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06aab1e640 1 --2- 172.21.15.45:0/2137483172 >> v2:172.21.15.155:3300/0 conn(0x7f06a4142500 0x7f06a40cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06aab1e640 1 -- 172.21.15.45:0/2137483172 >> 172.21.15.45:0/2137483172 conn(0x7f06a40650b0 msgr2=0x7f06a40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:58.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06aab1e640 1 -- 172.21.15.45:0/2137483172 shutdown_connections 2023-07-09T02:14:58.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.794+0000 7f06aab1e640 1 -- 172.21.15.45:0/2137483172 wait complete. 2023-07-09T02:14:58.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 Processor -- start 2023-07-09T02:14:58.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 -- start start 2023-07-09T02:14:58.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a41f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a4142500 0x7f06a413f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a4160630 0x7f06a40c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a41f5170 con 0x7f06a4160630 2023-07-09T02:14:58.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a41525d0 con 0x7f06a4142500 2023-07-09T02:14:58.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a41528b0 con 0x7f06a4069bc0 2023-07-09T02:14:58.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a41f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a90bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a4160630 0x7f06a40c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a4142500 0x7f06a413f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a41f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:53762/0 (socket says 172.21.15.45:53762) 2023-07-09T02:14:58.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 -- 172.21.15.45:0/1237561265 learned_addr learned my addr 172.21.15.45:0/1237561265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:58.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 -- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a4142500 msgr2=0x7f06a413f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a4142500 0x7f06a413f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 -- 172.21.15.45:0/1237561265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a4160630 msgr2=0x7f06a40c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a4160630 0x7f06a40c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 -- 172.21.15.45:0/1237561265 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980094d0 con 0x7f06a4069bc0 2023-07-09T02:14:58.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a88ba640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a41f4c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f069800e9d0 tx=0x7f069800ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:58.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a17fa640 1 -- 172.21.15.45:0/1237561265 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069800ca60 con 0x7f06a4069bc0 2023-07-09T02:14:58.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a17fa640 1 -- 172.21.15.45:0/1237561265 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069800cbc0 con 0x7f06a4069bc0 2023-07-09T02:14:58.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c009a70 con 0x7f06a4069bc0 2023-07-09T02:14:58.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06a17fa640 1 -- 172.21.15.45:0/1237561265 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698013470 con 0x7f06a4069bc0 2023-07-09T02:14:58.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a4152e70 con 0x7f06a4069bc0 2023-07-09T02:14:58.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.798+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a4160a50 con 0x7f06a4069bc0 2023-07-09T02:14:58.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.802+0000 7f06a17fa640 1 -- 172.21.15.45:0/1237561265 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f069803b080 con 0x7f06a4069bc0 2023-07-09T02:14:58.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.802+0000 7f06a17fa640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0688066280 0x7f0688068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:58.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.802+0000 7f06a17fa640 1 -- 172.21.15.45:0/1237561265 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f06980841b0 con 0x7f06a4069bc0 2023-07-09T02:14:58.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.802+0000 7f06a17fa640 1 -- 172.21.15.45:0/1237561265 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f068806e5a0 con 0x7f06a4069bc0 2023-07-09T02:14:58.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.802+0000 7f06a3fff640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0688066280 0x7f0688068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:58.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.802+0000 7f06a3fff640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0688066280 0x7f0688068730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06a4141f20 tx=0x7f0690009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:58.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.806+0000 7f06a17fa640 1 -- 172.21.15.45:0/1237561265 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0698051630 con 0x7f06a4069bc0 2023-07-09T02:14:58.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.958+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06a4160a50 con 0x7f06a4069bc0 2023-07-09T02:14:58.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06a17fa640 1 -- 172.21.15.45:0/1237561265 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+18596 (secure 0 0 0) 0x7f06a4160a50 con 0x7f06a4069bc0 2023-07-09T02:14:58.964 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:14:58.965 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":73,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:14:58.504790+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:13:39.573636+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T02:13:40.849108+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","full","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:14:58.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0688066280 msgr2=0x7f0688068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0688066280 0x7f0688068730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06a4141f20 tx=0x7f0690009040 comp rx=0 tx=0).stop 2023-07-09T02:14:58.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 msgr2=0x7f06a41f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:58.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a41f4c30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f069800e9d0 tx=0x7f069800ee90 comp rx=0 tx=0).stop 2023-07-09T02:14:58.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 shutdown_connections 2023-07-09T02:14:58.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06a4160630 0x7f06a40c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a4142500 0x7f06a413f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0688066280 0x7f0688068730 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 --2- 172.21.15.45:0/1237561265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06a4069bc0 0x7f06a41f4c30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:58.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 >> 172.21.15.45:0/1237561265 conn(0x7f06a40650b0 msgr2=0x7f06a40c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:58.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 shutdown_connections 2023-07-09T02:14:58.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:58.962+0000 7f06aab1e640 1 -- 172.21.15.45:0/1237561265 wait complete. 2023-07-09T02:14:58.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:13:39.573636+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:13:40.849108+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:14:58.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:14:59.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a5540b640 1 Processor -- start 2023-07-09T02:14:59.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a5540b640 1 -- start start 2023-07-09T02:14:59.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a5540b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a5015c060 0x7f8a500b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a5540b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a500cd120 0x7f8a500d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a5540b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a500d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a5540b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a500d28f0 con 0x7f8a500cd120 2023-07-09T02:14:59.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a5540b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a50160a50 con 0x7f8a5015c060 2023-07-09T02:14:59.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a5540b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5015c430 con 0x7f8a500d2450 2023-07-09T02:14:59.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a500cd120 0x7f8a500d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a500cd120 0x7f8a500d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34574/0 (socket says 172.21.15.45:34574) 2023-07-09T02:14:59.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4e7fc640 1 -- 172.21.15.45:0/3259180524 learned_addr learned my addr 172.21.15.45:0/3259180524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:59.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4f7fe640 1 --2- 172.21.15.45:0/3259180524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a500d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4effd640 1 --2- 172.21.15.45:0/3259180524 >> v2:172.21.15.155:3300/0 conn(0x7f8a5015c060 0x7f8a500b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4e7fc640 1 -- 172.21.15.45:0/3259180524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 msgr2=0x7f8a500d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:59.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4e7fc640 1 --2- 172.21.15.45:0/3259180524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a500d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4e7fc640 1 -- 172.21.15.45:0/3259180524 >> v2:172.21.15.155:3300/0 conn(0x7f8a5015c060 msgr2=0x7f8a500b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:59.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4e7fc640 1 --2- 172.21.15.45:0/3259180524 >> v2:172.21.15.155:3300/0 conn(0x7f8a5015c060 0x7f8a500b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4e7fc640 1 -- 172.21.15.45:0/3259180524 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5015fb60 con 0x7f8a500cd120 2023-07-09T02:14:59.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4f7fe640 1 --2- 172.21.15.45:0/3259180524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a500d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:59.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.134+0000 7f8a4effd640 1 --2- 172.21.15.45:0/3259180524 >> v2:172.21.15.155:3300/0 conn(0x7f8a5015c060 0x7f8a500b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:59.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a4e7fc640 1 --2- 172.21.15.45:0/3259180524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a500cd120 0x7f8a500d1f10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8a500d3ad0 tx=0x7f8a4401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0cd2c1898e9395 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a4dffb640 1 -- 172.21.15.45:0/3259180524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440ab600 con 0x7f8a500cd120 2023-07-09T02:14:59.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a4dffb640 1 -- 172.21.15.45:0/3259180524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a440a7050 con 0x7f8a500cd120 2023-07-09T02:14:59.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a4dffb640 1 -- 172.21.15.45:0/3259180524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440ab980 con 0x7f8a500cd120 2023-07-09T02:14:59.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 -- 172.21.15.45:0/3259180524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a500cd120 msgr2=0x7f8a500d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 --2- 172.21.15.45:0/3259180524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a500cd120 0x7f8a500d1f10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8a500d3ad0 tx=0x7f8a4401c210 comp rx=0 tx=0).stop 2023-07-09T02:14:59.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 -- 172.21.15.45:0/3259180524 shutdown_connections 2023-07-09T02:14:59.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 --2- 172.21.15.45:0/3259180524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a500d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 --2- 172.21.15.45:0/3259180524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a500cd120 0x7f8a500d1f10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 --2- 172.21.15.45:0/3259180524 >> v2:172.21.15.155:3300/0 conn(0x7f8a5015c060 0x7f8a500b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 -- 172.21.15.45:0/3259180524 >> 172.21.15.45:0/3259180524 conn(0x7f8a500698e0 msgr2=0x7f8a50069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:59.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 -- 172.21.15.45:0/3259180524 shutdown_connections 2023-07-09T02:14:59.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.138+0000 7f8a5540b640 1 -- 172.21.15.45:0/3259180524 wait complete. 2023-07-09T02:14:59.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 Processor -- start 2023-07-09T02:14:59.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 -- start start 2023-07-09T02:14:59.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a500cd120 0x7f8a50151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a5015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a5015c060 0x7f8a500b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a501517d0 con 0x7f8a5015c060 2023-07-09T02:14:59.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5015b140 con 0x7f8a500cd120 2023-07-09T02:14:59.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5015b420 con 0x7f8a500d2450 2023-07-09T02:14:59.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a5015c060 0x7f8a500b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a5015c060 0x7f8a500b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34582/0 (socket says 172.21.15.45:34582) 2023-07-09T02:14:59.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 -- 172.21.15.45:0/1373444580 learned_addr learned my addr 172.21.15.45:0/1373444580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:59.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4e7fc640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a5015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4effd640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a500cd120 0x7f8a50151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 -- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 msgr2=0x7f8a5015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a5015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 -- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a500cd120 msgr2=0x7f8a50151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a500cd120 0x7f8a50151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 -- 172.21.15.45:0/1373444580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a440094d0 con 0x7f8a5015c060 2023-07-09T02:14:59.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4effd640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a500cd120 0x7f8a50151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:14:59.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a4f7fe640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a5015c060 0x7f8a500b5b30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8a48007e10 tx=0x7f8a4800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a377fe640 1 -- 172.21.15.45:0/1373444580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48003ba0 con 0x7f8a5015c060 2023-07-09T02:14:59.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a377fe640 1 -- 172.21.15.45:0/1373444580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4800f040 con 0x7f8a5015c060 2023-07-09T02:14:59.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a377fe640 1 -- 172.21.15.45:0/1373444580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4800de80 con 0x7f8a5015c060 2023-07-09T02:14:59.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5015b700 con 0x7f8a5015c060 2023-07-09T02:14:59.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.142+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5015dc90 con 0x7f8a5015c060 2023-07-09T02:14:59.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.146+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5015b8f0 con 0x7f8a5015c060 2023-07-09T02:14:59.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.146+0000 7f8a377fe640 1 -- 172.21.15.45:0/1373444580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a48004030 con 0x7f8a5015c060 2023-07-09T02:14:59.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.146+0000 7f8a377fe640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a3c066280 0x7f8a3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.146+0000 7f8a377fe640 1 -- 172.21.15.45:0/1373444580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f8a48084160 con 0x7f8a5015c060 2023-07-09T02:14:59.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.146+0000 7f8a377fe640 1 -- 172.21.15.45:0/1373444580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f8a3c06e5a0 con 0x7f8a5015c060 2023-07-09T02:14:59.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.146+0000 7f8a4effd640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a3c066280 0x7f8a3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.146+0000 7f8a4effd640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a3c066280 0x7f8a3c068730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8a500b1c30 tx=0x7f8a40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.150+0000 7f8a377fe640 1 -- 172.21.15.45:0/1373444580 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a48051540 con 0x7f8a5015c060 2023-07-09T02:14:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.302+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a5015de80 con 0x7f8a5015c060 2023-07-09T02:14:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.302+0000 7f8a377fe640 1 -- 172.21.15.45:0/1373444580 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a4801a070 con 0x7f8a5015c060 2023-07-09T02:14:59.304 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:14:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a3c066280 msgr2=0x7f8a3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a3c066280 0x7f8a3c068730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8a500b1c30 tx=0x7f8a40008040 comp rx=0 tx=0).stop 2023-07-09T02:14:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a5015c060 msgr2=0x7f8a500b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a5015c060 0x7f8a500b5b30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8a48007e10 tx=0x7f8a4800d4a0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 shutdown_connections 2023-07-09T02:14:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a5015c060 0x7f8a500b5b30 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a3c066280 0x7f8a3c068730 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a500d2450 0x7f8a5015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 --2- 172.21.15.45:0/1373444580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a500cd120 0x7f8a50151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 >> 172.21.15.45:0/1373444580 conn(0x7f8a500698e0 msgr2=0x7f8a500b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 shutdown_connections 2023-07-09T02:14:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.306+0000 7f8a5540b640 1 -- 172.21.15.45:0/1373444580 wait complete. 2023-07-09T02:14:59.325 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:14:59.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.474+0000 7f8f5338f640 1 Processor -- start 2023-07-09T02:14:59.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.474+0000 7f8f5338f640 1 -- start start 2023-07-09T02:14:59.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5338f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8f4c0d2620 0x7f8f4c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5338f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f4c0cd120 0x7f8f4c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5338f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c160a50 con 0x7f8f4c15c060 2023-07-09T02:14:59.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5338f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c15c430 con 0x7f8f4c0cd120 2023-07-09T02:14:59.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5338f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c15fb60 con 0x7f8f4c0d2620 2023-07-09T02:14:59.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5192c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f4c0cd120 0x7f8f4c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5192c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f4c0cd120 0x7f8f4c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34598/0 (socket says 172.21.15.45:34598) 2023-07-09T02:14:59.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5192c640 1 -- 172.21.15.45:0/2878320715 learned_addr learned my addr 172.21.15.45:0/2878320715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5192c640 1 -- 172.21.15.45:0/2878320715 >> v2:172.21.15.155:3300/0 conn(0x7f8f4c0d2620 msgr2=0x7f8f4c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5092a640 1 --2- 172.21.15.45:0/2878320715 >> v2:172.21.15.155:3300/0 conn(0x7f8f4c0d2620 0x7f8f4c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5192c640 1 --2- 172.21.15.45:0/2878320715 >> v2:172.21.15.155:3300/0 conn(0x7f8f4c0d2620 0x7f8f4c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5192c640 1 -- 172.21.15.45:0/2878320715 >> v1:172.21.15.155:6789/0 conn(0x7f8f4c15c060 legacy=0x7f8f4c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:59.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5192c640 1 -- 172.21.15.45:0/2878320715 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c15fe40 con 0x7f8f4c0cd120 2023-07-09T02:14:59.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.478+0000 7f8f5092a640 1 --2- 172.21.15.45:0/2878320715 >> v2:172.21.15.155:3300/0 conn(0x7f8f4c0d2620 0x7f8f4c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:14:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5192c640 1 --2- 172.21.15.45:0/2878320715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0cd120 0x7f8f4c0cee30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c15fac0 tx=0x7f8f4401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f837d5b4562137 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f43fff640 1 -- 172.21.15.45:0/2878320715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f440a5820 con 0x7f8f4c0cd120 2023-07-09T02:14:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f43fff640 1 -- 172.21.15.45:0/2878320715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f440a5980 con 0x7f8f4c0cd120 2023-07-09T02:14:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f43fff640 1 -- 172.21.15.45:0/2878320715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f440a5d10 con 0x7f8f4c0cd120 2023-07-09T02:14:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- 172.21.15.45:0/2878320715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0cd120 msgr2=0x7f8f4c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 --2- 172.21.15.45:0/2878320715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0cd120 0x7f8f4c0cee30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c15fac0 tx=0x7f8f4401c960 comp rx=0 tx=0).stop 2023-07-09T02:14:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- 172.21.15.45:0/2878320715 shutdown_connections 2023-07-09T02:14:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 --2- 172.21.15.45:0/2878320715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0cd120 0x7f8f4c0cee30 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 --2- 172.21.15.45:0/2878320715 >> v2:172.21.15.155:3300/0 conn(0x7f8f4c0d2620 0x7f8f4c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- 172.21.15.45:0/2878320715 >> 172.21.15.45:0/2878320715 conn(0x7f8f4c0698e0 msgr2=0x7f8f4c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- 172.21.15.45:0/2878320715 shutdown_connections 2023-07-09T02:14:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- 172.21.15.45:0/2878320715 wait complete. 2023-07-09T02:14:59.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 Processor -- start 2023-07-09T02:14:59.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- start start 2023-07-09T02:14:59.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f4c0cd120 0x7f8f4c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0d2620 0x7f8f4c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4c15c060 0x7f8f4c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c15c670 con 0x7f8f4c0d2620 2023-07-09T02:14:59.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c15af60 con 0x7f8f4c0cd120 2023-07-09T02:14:59.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.482+0000 7f8f5338f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c1593c0 con 0x7f8f4c15c060 2023-07-09T02:14:59.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0d2620 0x7f8f4c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0d2620 0x7f8f4c15ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34612/0 (socket says 172.21.15.45:34612) 2023-07-09T02:14:59.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 -- 172.21.15.45:0/4089095721 learned_addr learned my addr 172.21.15.45:0/4089095721 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:59.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5112b640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f4c0cd120 0x7f8f4c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5192c640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4c15c060 0x7f8f4c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 -- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4c15c060 msgr2=0x7f8f4c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4c15c060 0x7f8f4c15aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 -- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f4c0cd120 msgr2=0x7f8f4c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f4c0cd120 0x7f8f4c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 -- 172.21.15.45:0/4089095721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44009b30 con 0x7f8f4c0d2620 2023-07-09T02:14:59.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5092a640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0d2620 0x7f8f4c15ec50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c7f0 tx=0x7f8f3c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00cea0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c007a30 con 0x7f8f4c0d2620 2023-07-09T02:14:59.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c007dc0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c0b59f0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c159980 con 0x7f8f4c0d2620 2023-07-09T02:14:59.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c15c7b0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.486+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f3c0113f0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.490+0000 7f8f41ffb640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f300662b0 0x7f8f30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.490+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f8f3c083e60 con 0x7f8f4c0d2620 2023-07-09T02:14:59.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.490+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f8f3006e5d0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.490+0000 7f8f5112b640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f300662b0 0x7f8f30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.490+0000 7f8f5112b640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f300662b0 0x7f8f30068760 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8f480098e0 tx=0x7f8f48009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.494+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f4c15c7b0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.514+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(74..74 src has 1..74) v4 ==== 441+0+0 (secure 0 0 0) 0x7f8f3c058ec0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.514+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f8f3006eef0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.650+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8f4c15c7b0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.650+0000 7f8f41ffb640 1 -- 172.21.15.45:0/4089095721 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v74) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8f4c15c7b0 con 0x7f8f4c0d2620 2023-07-09T02:14:59.652 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:14:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f300662b0 msgr2=0x7f8f30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f300662b0 0x7f8f30068760 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8f480098e0 tx=0x7f8f48009060 comp rx=0 tx=0).stop 2023-07-09T02:14:59.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0d2620 msgr2=0x7f8f4c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0d2620 0x7f8f4c15ec50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c7f0 tx=0x7f8f3c00ccb0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 shutdown_connections 2023-07-09T02:14:59.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f300662b0 0x7f8f30068760 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f4c15c060 0x7f8f4c15aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f4c0d2620 0x7f8f4c15ec50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 --2- 172.21.15.45:0/4089095721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f4c0cd120 0x7f8f4c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 >> 172.21.15.45:0/4089095721 conn(0x7f8f4c0698e0 msgr2=0x7f8f4c0b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 shutdown_connections 2023-07-09T02:14:59.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.654+0000 7f8f5338f640 1 -- 172.21.15.45:0/4089095721 wait complete. 2023-07-09T02:14:59.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:14:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b4d311640 1 Processor -- start 2023-07-09T02:14:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b4d311640 1 -- start start 2023-07-09T02:14:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b4d311640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b4815c060 0x7f2b480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b4d311640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2b480cd120 0x7f2b480d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b4d311640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b48160a50 con 0x7f2b480d2450 2023-07-09T02:14:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b4d311640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b480d28d0 con 0x7f2b4815c060 2023-07-09T02:14:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b4d311640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b480cfe40 con 0x7f2b480cd120 2023-07-09T02:14:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b46ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b4815c060 0x7f2b480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b46ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b4815c060 0x7f2b480b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34624/0 (socket says 172.21.15.45:34624) 2023-07-09T02:14:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b46ffd640 1 -- 172.21.15.45:0/2703431445 learned_addr learned my addr 172.21.15.45:0/2703431445 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b3ffff640 1 --2- 172.21.15.45:0/2703431445 >> v2:172.21.15.155:3300/0 conn(0x7f2b480cd120 0x7f2b480d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b46ffd640 1 -- 172.21.15.45:0/2703431445 >> v2:172.21.15.155:3300/0 conn(0x7f2b480cd120 msgr2=0x7f2b480d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:14:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b46ffd640 1 --2- 172.21.15.45:0/2703431445 >> v2:172.21.15.155:3300/0 conn(0x7f2b480cd120 0x7f2b480d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b46ffd640 1 -- 172.21.15.45:0/2703431445 >> v1:172.21.15.155:6789/0 conn(0x7f2b480d2450 legacy=0x7f2b480d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.818+0000 7f2b46ffd640 1 -- 172.21.15.45:0/2703431445 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4815c430 con 0x7f2b4815c060 2023-07-09T02:14:59.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b46ffd640 1 --2- 172.21.15.45:0/2703431445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b4815c060 0x7f2b480b4ed0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2b4815fac0 tx=0x7f2b3801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7168de06f1ef7f99 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b467fc640 1 -- 172.21.15.45:0/2703431445 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380ab5f0 con 0x7f2b4815c060 2023-07-09T02:14:59.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b467fc640 1 -- 172.21.15.45:0/2703431445 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b380ab750 con 0x7f2b4815c060 2023-07-09T02:14:59.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b467fc640 1 -- 172.21.15.45:0/2703431445 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380abae0 con 0x7f2b4815c060 2023-07-09T02:14:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b4d311640 1 -- 172.21.15.45:0/2703431445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b4815c060 msgr2=0x7f2b480b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b4d311640 1 --2- 172.21.15.45:0/2703431445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b4815c060 0x7f2b480b4ed0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2b4815fac0 tx=0x7f2b3801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b4d311640 1 -- 172.21.15.45:0/2703431445 shutdown_connections 2023-07-09T02:14:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b4d311640 1 --2- 172.21.15.45:0/2703431445 >> v2:172.21.15.155:3300/0 conn(0x7f2b480cd120 0x7f2b480d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b4d311640 1 --2- 172.21.15.45:0/2703431445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b4815c060 0x7f2b480b4ed0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b4d311640 1 -- 172.21.15.45:0/2703431445 >> 172.21.15.45:0/2703431445 conn(0x7f2b480698e0 msgr2=0x7f2b48069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b4d311640 1 -- 172.21.15.45:0/2703431445 shutdown_connections 2023-07-09T02:14:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.822+0000 7f2b4d311640 1 -- 172.21.15.45:0/2703431445 wait complete. 2023-07-09T02:14:59.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 Processor -- start 2023-07-09T02:14:59.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 -- start start 2023-07-09T02:14:59.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b480cd120 0x7f2b4815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b480d2450 0x7f2b480b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b4815c060 0x7f2b480cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480b4210 con 0x7f2b480cd120 2023-07-09T02:14:59.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480cca30 con 0x7f2b480d2450 2023-07-09T02:14:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480b2f10 con 0x7f2b4815c060 2023-07-09T02:14:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b480cd120 0x7f2b4815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b480cd120 0x7f2b4815a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34628/0 (socket says 172.21.15.45:34628) 2023-07-09T02:14:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 -- 172.21.15.45:0/1545652879 learned_addr learned my addr 172.21.15.45:0/1545652879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:14:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b3ffff640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b480d2450 0x7f2b480b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b477fe640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b4815c060 0x7f2b480cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 -- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b4815c060 msgr2=0x7f2b480cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b4815c060 0x7f2b480cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 -- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b480d2450 msgr2=0x7f2b480b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b480d2450 0x7f2b480b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 -- 172.21.15.45:0/1545652879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380094d0 con 0x7f2b480cd120 2023-07-09T02:14:59.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b3ffff640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b480d2450 0x7f2b480b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:14:59.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b46ffd640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b480cd120 0x7f2b4815a770 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2b380190e0 tx=0x7f2b3801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b3f7fe640 1 -- 172.21.15.45:0/1545652879 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380be5f0 con 0x7f2b480cd120 2023-07-09T02:14:59.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b3f7fe640 1 -- 172.21.15.45:0/1545652879 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b380be770 con 0x7f2b480cd120 2023-07-09T02:14:59.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.826+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b480b31f0 con 0x7f2b480cd120 2023-07-09T02:14:59.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.830+0000 7f2b3f7fe640 1 -- 172.21.15.45:0/1545652879 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380beb20 con 0x7f2b480cd120 2023-07-09T02:14:59.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.830+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b480b37b0 con 0x7f2b480cd120 2023-07-09T02:14:59.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.830+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b480b39a0 con 0x7f2b480cd120 2023-07-09T02:14:59.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.830+0000 7f2b3f7fe640 1 -- 172.21.15.45:0/1545652879 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b380b43f0 con 0x7f2b480cd120 2023-07-09T02:14:59.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.830+0000 7f2b3f7fe640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2b28066280 0x7f2b28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:14:59.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.830+0000 7f2b3f7fe640 1 -- 172.21.15.45:0/1545652879 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2b380a8050 con 0x7f2b480cd120 2023-07-09T02:14:59.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.830+0000 7f2b3ffff640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2b28066280 0x7f2b28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:14:59.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.830+0000 7f2b3f7fe640 1 -- 172.21.15.45:0/1545652879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f2b2806e5a0 con 0x7f2b480cd120 2023-07-09T02:14:59.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.834+0000 7f2b3ffff640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2b28066280 0x7f2b28068730 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2b480b6890 tx=0x7f2b30009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:14:59.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.834+0000 7f2b3f7fe640 1 -- 172.21.15.45:0/1545652879 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b380ebcb0 con 0x7f2b480cd120 2023-07-09T02:14:59.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.990+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b4804d7d0 con 0x7f2b480cd120 2023-07-09T02:14:59.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.990+0000 7f2b3f7fe640 1 -- 172.21.15.45:0/1545652879 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b380c40a0 con 0x7f2b480cd120 2023-07-09T02:14:59.992 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:14:59.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2b28066280 msgr2=0x7f2b28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2b28066280 0x7f2b28068730 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2b480b6890 tx=0x7f2b30009190 comp rx=0 tx=0).stop 2023-07-09T02:14:59.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b480cd120 msgr2=0x7f2b4815a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:14:59.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b480cd120 0x7f2b4815a770 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2b380190e0 tx=0x7f2b3801ad10 comp rx=0 tx=0).stop 2023-07-09T02:14:59.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 shutdown_connections 2023-07-09T02:14:59.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2b28066280 0x7f2b28068730 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b4815c060 0x7f2b480cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b480d2450 0x7f2b480b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 --2- 172.21.15.45:0/1545652879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b480cd120 0x7f2b4815a770 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:14:59.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 >> 172.21.15.45:0/1545652879 conn(0x7f2b480698e0 msgr2=0x7f2b480b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:14:59.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 shutdown_connections 2023-07-09T02:14:59.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:14:59.994+0000 7f2b4d311640 1 -- 172.21.15.45:0/1545652879 wait complete. 2023-07-09T02:15:00.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:15:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f46791e9640 1 Processor -- start 2023-07-09T02:15:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f46791e9640 1 -- start start 2023-07-09T02:15:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f46791e9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f46740c8d10 0x7f46740c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f46791e9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f467415db00 0x7f467415df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f46791e9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467406bf30 con 0x7f46740ca0f0 2023-07-09T02:15:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f46791e9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467415e480 con 0x7f46740c8d10 2023-07-09T02:15:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f46791e9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467406bc50 con 0x7f467415db00 2023-07-09T02:15:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f4672d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f46740ca0f0 0x7f46740cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54750/0 (socket says 172.21.15.45:54750) 2023-07-09T02:15:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f4672d9d640 1 -- 172.21.15.45:0/2506445335 learned_addr learned my addr 172.21.15.45:0/2506445335 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f466bfff640 1 --2- 172.21.15.45:0/2506445335 >> v2:172.21.15.45:3300/0 conn(0x7f46740c8d10 0x7f46740c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f467359e640 1 --2- 172.21.15.45:0/2506445335 >> v2:172.21.15.155:3300/0 conn(0x7f467415db00 0x7f467415df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f467259c640 1 -- 172.21.15.45:0/2506445335 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90003930 0 0) 0x7f467406bf30 con 0x7f46740ca0f0 2023-07-09T02:15:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f467259c640 1 -- 172.21.15.45:0/2506445335 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4660003530 con 0x7f46740ca0f0 2023-07-09T02:15:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f466bfff640 1 -- 172.21.15.45:0/2506445335 >> v2:172.21.15.155:3300/0 conn(0x7f467415db00 msgr2=0x7f467415df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f466bfff640 1 --2- 172.21.15.45:0/2506445335 >> v2:172.21.15.155:3300/0 conn(0x7f467415db00 0x7f467415df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f466bfff640 1 -- 172.21.15.45:0/2506445335 >> v1:172.21.15.45:6789/0 conn(0x7f46740ca0f0 legacy=0x7f46740cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.158+0000 7f466bfff640 1 -- 172.21.15.45:0/2506445335 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740cab90 con 0x7f46740c8d10 2023-07-09T02:15:00.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f466bfff640 1 --2- 172.21.15.45:0/2506445335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46740c8d10 0x7f46740c9160 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f467406eec0 tx=0x7f465c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504998b6de6d22da server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f467259c640 1 -- 172.21.15.45:0/2506445335 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0ac630 con 0x7f46740c8d10 2023-07-09T02:15:00.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f467259c640 1 -- 172.21.15.45:0/2506445335 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c0ac790 con 0x7f46740c8d10 2023-07-09T02:15:00.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f467259c640 1 -- 172.21.15.45:0/2506445335 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0acb20 con 0x7f46740c8d10 2023-07-09T02:15:00.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f46791e9640 1 -- 172.21.15.45:0/2506445335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46740c8d10 msgr2=0x7f46740c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f46791e9640 1 --2- 172.21.15.45:0/2506445335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46740c8d10 0x7f46740c9160 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f467406eec0 tx=0x7f465c01c3d0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f46791e9640 1 -- 172.21.15.45:0/2506445335 shutdown_connections 2023-07-09T02:15:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f46791e9640 1 --2- 172.21.15.45:0/2506445335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46740c8d10 0x7f46740c9160 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f46791e9640 1 --2- 172.21.15.45:0/2506445335 >> v2:172.21.15.155:3300/0 conn(0x7f467415db00 0x7f467415df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f46791e9640 1 -- 172.21.15.45:0/2506445335 >> 172.21.15.45:0/2506445335 conn(0x7f46740694b0 msgr2=0x7f46740698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f46791e9640 1 -- 172.21.15.45:0/2506445335 shutdown_connections 2023-07-09T02:15:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.162+0000 7f46791e9640 1 -- 172.21.15.45:0/2506445335 wait complete. 2023-07-09T02:15:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 Processor -- start 2023-07-09T02:15:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 -- start start 2023-07-09T02:15:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46740c8d10 0x7f467414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46740ca0f0 0x7f46741511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f467415db00 0x7f4674153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4674152b60 con 0x7f467415db00 2023-07-09T02:15:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467414edc0 con 0x7f46740c8d10 2023-07-09T02:15:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467414dd50 con 0x7f46740ca0f0 2023-07-09T02:15:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f467415db00 0x7f4674153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f467415db00 0x7f4674153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34634/0 (socket says 172.21.15.45:34634) 2023-07-09T02:15:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 -- 172.21.15.45:0/3399108342 learned_addr learned my addr 172.21.15.45:0/3399108342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f4672d9d640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46740c8d10 0x7f467414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f466bfff640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46740ca0f0 0x7f46741511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 -- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46740ca0f0 msgr2=0x7f46741511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46740ca0f0 0x7f46741511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 -- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46740c8d10 msgr2=0x7f467414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46740c8d10 0x7f467414e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 -- 172.21.15.45:0/3399108342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c009420 con 0x7f467415db00 2023-07-09T02:15:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f467359e640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f467415db00 0x7f4674153070 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f466c00efc0 tx=0x7f466c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f466b7fe640 1 -- 172.21.15.45:0/3399108342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c009ba0 con 0x7f467415db00 2023-07-09T02:15:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f466b7fe640 1 -- 172.21.15.45:0/3399108342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c00f040 con 0x7f467415db00 2023-07-09T02:15:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f466b7fe640 1 -- 172.21.15.45:0/3399108342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0146c0 con 0x7f467415db00 2023-07-09T02:15:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4674151ee0 con 0x7f467415db00 2023-07-09T02:15:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.166+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46741524a0 con 0x7f467415db00 2023-07-09T02:15:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.170+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467404d7d0 con 0x7f467415db00 2023-07-09T02:15:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.170+0000 7f466b7fe640 1 -- 172.21.15.45:0/3399108342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f466c014820 con 0x7f467415db00 2023-07-09T02:15:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.170+0000 7f466b7fe640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4654066280 0x7f4654068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.170+0000 7f466b7fe640 1 -- 172.21.15.45:0/3399108342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f466c0848a0 con 0x7f467415db00 2023-07-09T02:15:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.170+0000 7f466b7fe640 1 -- 172.21.15.45:0/3399108342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f465406e5a0 con 0x7f467415db00 2023-07-09T02:15:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.170+0000 7f4672d9d640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4654066280 0x7f4654068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.170+0000 7f4672d9d640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4654066280 0x7f4654068730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f46640011f0 tx=0x7f4664009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.174+0000 7f466b7fe640 1 -- 172.21.15.45:0/3399108342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f466c051c80 con 0x7f467415db00 2023-07-09T02:15:00.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46740c5550 con 0x7f467415db00 2023-07-09T02:15:00.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f466b7fe640 1 -- 172.21.15.45:0/3399108342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7f466c018030 con 0x7f467415db00 2023-07-09T02:15:00.330 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:15:00.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4654066280 msgr2=0x7f4654068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4654066280 0x7f4654068730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f46640011f0 tx=0x7f4664009040 comp rx=0 tx=0).stop 2023-07-09T02:15:00.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f467415db00 msgr2=0x7f4674153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f467415db00 0x7f4674153070 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f466c00efc0 tx=0x7f466c00c490 comp rx=0 tx=0).stop 2023-07-09T02:15:00.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 shutdown_connections 2023-07-09T02:15:00.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f467415db00 0x7f4674153070 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4654066280 0x7f4654068730 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46740ca0f0 0x7f46741511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 --2- 172.21.15.45:0/3399108342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46740c8d10 0x7f467414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 >> 172.21.15.45:0/3399108342 conn(0x7f46740694b0 msgr2=0x7f4674150120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:00.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 shutdown_connections 2023-07-09T02:15:00.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.330+0000 7f46791e9640 1 -- 172.21.15.45:0/3399108342 wait complete. 2023-07-09T02:15:00.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:15:00.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.494+0000 7fea223e1640 1 Processor -- start 2023-07-09T02:15:00.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.494+0000 7fea223e1640 1 -- start start 2023-07-09T02:15:00.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea223e1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fea1c0cd120 0x7fea1c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea223e1640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c160a50 con 0x7fea1c15c060 2023-07-09T02:15:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea223e1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c15c430 con 0x7fea1c0d2620 2023-07-09T02:15:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea223e1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c15fb60 con 0x7fea1c0cd120 2023-07-09T02:15:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea1bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fea1c15c060 0x7fea1c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54754/0 (socket says 172.21.15.45:54754) 2023-07-09T02:15:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea1bfff640 1 -- 172.21.15.45:0/1529620774 learned_addr learned my addr 172.21.15.45:0/1529620774 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea2097e640 1 --2- 172.21.15.45:0/1529620774 >> v2:172.21.15.155:3300/0 conn(0x7fea1c0cd120 0x7fea1c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea1affd640 1 -- 172.21.15.45:0/1529620774 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472305994 0 0) 0x7fea1c160a50 con 0x7fea1c15c060 2023-07-09T02:15:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea1affd640 1 -- 172.21.15.45:0/1529620774 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea04003530 con 0x7fea1c15c060 2023-07-09T02:15:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea1affd640 1 -- 172.21.15.45:0/1529620774 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948750284 0 0) 0x7fea04003530 con 0x7fea1c15c060 2023-07-09T02:15:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea2097e640 1 -- 172.21.15.45:0/1529620774 >> v1:172.21.15.155:6789/0 conn(0x7fea1c0d2620 legacy=0x7fea1c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea2097e640 1 -- 172.21.15.45:0/1529620774 >> v1:172.21.15.45:6789/0 conn(0x7fea1c15c060 legacy=0x7fea1c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.498+0000 7fea2097e640 1 -- 172.21.15.45:0/1529620774 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c15fe40 con 0x7fea1c0cd120 2023-07-09T02:15:00.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea2097e640 1 --2- 172.21.15.45:0/1529620774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c0cd120 0x7fea1c0b4ed0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea14009d90 tx=0x7fea1401c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0bd2bc50417cc23 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea1affd640 1 -- 172.21.15.45:0/1529620774 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c001680 con 0x7fea1c0cd120 2023-07-09T02:15:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea1affd640 1 -- 172.21.15.45:0/1529620774 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea140a5570 con 0x7fea1c0cd120 2023-07-09T02:15:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea1affd640 1 -- 172.21.15.45:0/1529620774 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea140a58e0 con 0x7fea1c0cd120 2023-07-09T02:15:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- 172.21.15.45:0/1529620774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c0cd120 msgr2=0x7fea1c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 --2- 172.21.15.45:0/1529620774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c0cd120 0x7fea1c0b4ed0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fea14009d90 tx=0x7fea1401c6f0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- 172.21.15.45:0/1529620774 shutdown_connections 2023-07-09T02:15:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 --2- 172.21.15.45:0/1529620774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c0cd120 0x7fea1c0b4ed0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- 172.21.15.45:0/1529620774 >> 172.21.15.45:0/1529620774 conn(0x7fea1c0698e0 msgr2=0x7fea1c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- 172.21.15.45:0/1529620774 shutdown_connections 2023-07-09T02:15:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- 172.21.15.45:0/1529620774 wait complete. 2023-07-09T02:15:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 Processor -- start 2023-07-09T02:15:00.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- start start 2023-07-09T02:15:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea1c0cd120 0x7fea1c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea1c0d2620 0x7fea1c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c15c060 0x7fea1c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15b970 con 0x7fea1c0d2620 2023-07-09T02:15:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15dff0 con 0x7fea1c15c060 2023-07-09T02:15:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.502+0000 7fea223e1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c15e180 con 0x7fea1c0cd120 2023-07-09T02:15:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea1c0d2620 0x7fea1c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea1c0d2620 0x7fea1c152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34648/0 (socket says 172.21.15.45:34648) 2023-07-09T02:15:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 -- 172.21.15.45:0/469081051 learned_addr learned my addr 172.21.15.45:0/469081051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1bfff640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea1c0cd120 0x7fea1c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea2097e640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c15c060 0x7fea1c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 -- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea1c0cd120 msgr2=0x7fea1c14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea1c0cd120 0x7fea1c14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 -- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c15c060 msgr2=0x7fea1c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c15c060 0x7fea1c0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 -- 172.21.15.45:0/469081051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009a70 con 0x7fea1c0d2620 2023-07-09T02:15:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea1b7fe640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea1c0d2620 0x7fea1c152ab0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fea1000c750 tx=0x7fea1000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10005270 con 0x7fea1c0d2620 2023-07-09T02:15:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea100053f0 con 0x7fea1c0d2620 2023-07-09T02:15:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000a880 con 0x7fea1c0d2620 2023-07-09T02:15:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0b59f0 con 0x7fea1c0d2620 2023-07-09T02:15:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c1535e0 con 0x7fea1c0d2620 2023-07-09T02:15:00.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c15e2f0 con 0x7fea1c0d2620 2023-07-09T02:15:00.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.506+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea1000a9e0 con 0x7fea1c0d2620 2023-07-09T02:15:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.510+0000 7fea18ff9640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea08066280 0x7fea08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.510+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fea10083570 con 0x7fea1c0d2620 2023-07-09T02:15:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.510+0000 7fea1bfff640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea08066280 0x7fea08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.510+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7fea0806e5a0 con 0x7fea1c0d2620 2023-07-09T02:15:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.510+0000 7fea1bfff640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea08066280 0x7fea08068730 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0011f0 tx=0x7fea0c001bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.514+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea10017060 con 0x7fea1c0d2620 2023-07-09T02:15:00.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.522+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(75..75 src has 1..75) v4 ==== 1951+0+0 (secure 0 0 0) 0x7fea10058600 con 0x7fea1c0d2620 2023-07-09T02:15:00.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.522+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7fea0806fd10 con 0x7fea1c0d2620 2023-07-09T02:15:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.702+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea1c04d7d0 con 0x7fea1c0d2620 2023-07-09T02:15:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.702+0000 7fea18ff9640 1 -- 172.21.15.45:0/469081051 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4675 (secure 0 0 0) 0x7fea10017030 con 0x7fea1c0d2620 2023-07-09T02:15:00.705 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:00.705 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2676442896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2676442896},{"type":"v1","addr":"172.21.15.155:6837","nonce":2676442896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/193698688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":193698688},{"type":"v1","addr":"172.21.15.155:6836","nonce":193698688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1939767585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1939767585},{"type":"v1","addr":"172.21.15.45:6834","nonce":1939767585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:13:41.846779+0000","modified":"2023-07-09T02:13:45.491078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6096":{"gid":6096,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3771949487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3771949487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3771949487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T02:15:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 34 2023-07-09T02:15:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea08066280 msgr2=0x7fea08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea08066280 0x7fea08068730 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0011f0 tx=0x7fea0c001bf0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea1c0d2620 msgr2=0x7fea1c152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea1c0d2620 0x7fea1c152ab0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fea1000c750 tx=0x7fea1000cc10 comp rx=0 tx=0).stop 2023-07-09T02:15:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 shutdown_connections 2023-07-09T02:15:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea1c15c060 0x7fea1c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea1c0d2620 0x7fea1c152ab0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea08066280 0x7fea08068730 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 --2- 172.21.15.45:0/469081051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea1c0cd120 0x7fea1c14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 >> 172.21.15.45:0/469081051 conn(0x7fea1c0698e0 msgr2=0x7fea1c0b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 shutdown_connections 2023-07-09T02:15:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.706+0000 7fea223e1640 1 -- 172.21.15.45:0/469081051 wait complete. 2023-07-09T02:15:00.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:15:00.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e96cbd640 1 Processor -- start 2023-07-09T02:15:00.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e96cbd640 1 -- start start 2023-07-09T02:15:00.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e96cbd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e9015c060 0x7f4e900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e96cbd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e900cd120 0x7f4e900d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e96cbd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e90160a50 con 0x7f4e900d2450 2023-07-09T02:15:00.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e96cbd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e900d28f0 con 0x7f4e900cd120 2023-07-09T02:15:00.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e96cbd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900cfe40 con 0x7f4e9015c060 2023-07-09T02:15:00.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e8ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e900cd120 0x7f4e900d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e9525a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4e900d2450 0x7f4e900d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54768/0 (socket says 172.21.15.45:54768) 2023-07-09T02:15:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e9525a640 1 -- 172.21.15.45:0/3539665842 learned_addr learned my addr 172.21.15.45:0/3539665842 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:00.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e94a59640 1 --2- 172.21.15.45:0/3539665842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e9015c060 0x7f4e900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e8ffff640 1 -- 172.21.15.45:0/3539665842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e9015c060 msgr2=0x7f4e900b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e8ffff640 1 --2- 172.21.15.45:0/3539665842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e9015c060 0x7f4e900b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e8ffff640 1 -- 172.21.15.45:0/3539665842 >> v1:172.21.15.45:6789/0 conn(0x7f4e900d2450 legacy=0x7f4e900d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e8ffff640 1 -- 172.21.15.45:0/3539665842 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9015c430 con 0x7f4e900cd120 2023-07-09T02:15:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.870+0000 7f4e8f7fe640 1 -- 172.21.15.45:0/3539665842 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053795800 0 0) 0x7f4e90160a50 con 0x7f4e900d2450 2023-07-09T02:15:00.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e8ffff640 1 --2- 172.21.15.45:0/3539665842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e900cd120 0x7f4e900d1f10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0097c0 tx=0x7f4e7c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5921b9c485d0a253 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e8f7fe640 1 -- 172.21.15.45:0/3539665842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0ab600 con 0x7f4e900cd120 2023-07-09T02:15:00.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e8f7fe640 1 -- 172.21.15.45:0/3539665842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c0a7050 con 0x7f4e900cd120 2023-07-09T02:15:00.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e8f7fe640 1 -- 172.21.15.45:0/3539665842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0ab980 con 0x7f4e900cd120 2023-07-09T02:15:00.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e96cbd640 1 -- 172.21.15.45:0/3539665842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e900cd120 msgr2=0x7f4e900d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/3539665842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e900cd120 0x7f4e900d1f10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0097c0 tx=0x7f4e7c01c450 comp rx=0 tx=0).stop 2023-07-09T02:15:00.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e96cbd640 1 -- 172.21.15.45:0/3539665842 shutdown_connections 2023-07-09T02:15:00.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/3539665842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e900cd120 0x7f4e900d1f10 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/3539665842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e9015c060 0x7f4e900b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e96cbd640 1 -- 172.21.15.45:0/3539665842 >> 172.21.15.45:0/3539665842 conn(0x7f4e900698e0 msgr2=0x7f4e90069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:00.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e96cbd640 1 -- 172.21.15.45:0/3539665842 shutdown_connections 2023-07-09T02:15:00.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.874+0000 7f4e96cbd640 1 -- 172.21.15.45:0/3539665842 wait complete. 2023-07-09T02:15:00.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 Processor -- start 2023-07-09T02:15:00.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 -- start start 2023-07-09T02:15:00.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e900cd120 0x7f4e900b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e900d2450 0x7f4e90153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e9015c060 0x7f4e90152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900cc990 con 0x7f4e9015c060 2023-07-09T02:15:00.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9015c9e0 con 0x7f4e900cd120 2023-07-09T02:15:00.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9015ccc0 con 0x7f4e900d2450 2023-07-09T02:15:00.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e9015c060 0x7f4e90152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e9015c060 0x7f4e90152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34664/0 (socket says 172.21.15.45:34664) 2023-07-09T02:15:00.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 -- 172.21.15.45:0/4262201622 learned_addr learned my addr 172.21.15.45:0/4262201622 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:00.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e94a59640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e900cd120 0x7f4e900b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e8ffff640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e900d2450 0x7f4e90153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 -- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e900d2450 msgr2=0x7f4e90153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e900d2450 0x7f4e90153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 -- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e900cd120 msgr2=0x7f4e900b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:00.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e900cd120 0x7f4e900b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:00.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 -- 172.21.15.45:0/4262201622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c009420 con 0x7f4e9015c060 2023-07-09T02:15:00.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e9525a640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e9015c060 0x7f4e90152210 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4e88001570 tx=0x7f4e8800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e8d7fa640 1 -- 172.21.15.45:0/4262201622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800a640 con 0x7f4e9015c060 2023-07-09T02:15:00.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e8d7fa640 1 -- 172.21.15.45:0/4262201622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8800a7c0 con 0x7f4e9015c060 2023-07-09T02:15:00.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e8d7fa640 1 -- 172.21.15.45:0/4262201622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800ab70 con 0x7f4e9015c060 2023-07-09T02:15:00.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9015cfa0 con 0x7f4e9015c060 2023-07-09T02:15:00.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.878+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9015d560 con 0x7f4e9015c060 2023-07-09T02:15:00.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.882+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9015d750 con 0x7f4e9015c060 2023-07-09T02:15:00.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.882+0000 7f4e8d7fa640 1 -- 172.21.15.45:0/4262201622 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e8800acd0 con 0x7f4e9015c060 2023-07-09T02:15:00.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.882+0000 7f4e8d7fa640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e74066280 0x7f4e74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:00.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.882+0000 7f4e8d7fa640 1 -- 172.21.15.45:0/4262201622 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4e880832a0 con 0x7f4e9015c060 2023-07-09T02:15:00.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.882+0000 7f4e94a59640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e74066280 0x7f4e74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:00.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.882+0000 7f4e94a59640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e74066280 0x7f4e74068730 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4e840079c0 tx=0x7f4e84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:00.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:00.886+0000 7f4e8d7fa640 1 -- 172.21.15.45:0/4262201622 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e880506b0 con 0x7f4e9015c060 2023-07-09T02:15:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.042+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e9004d7d0 con 0x7f4e9015c060 2023-07-09T02:15:01.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e8d7fa640 1 -- 172.21.15.45:0/4262201622 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18626 (secure 0 0 0) 0x7f4e88018090 con 0x7f4e9015c060 2023-07-09T02:15:01.045 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:01.045 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:15:00.515456+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:13:39.573636+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T02:13:40.849108+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:15:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e74066280 msgr2=0x7f4e74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e74066280 0x7f4e74068730 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4e840079c0 tx=0x7f4e84008040 comp rx=0 tx=0).stop 2023-07-09T02:15:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e9015c060 msgr2=0x7f4e90152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e9015c060 0x7f4e90152210 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4e88001570 tx=0x7f4e8800cca0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 shutdown_connections 2023-07-09T02:15:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e9015c060 0x7f4e90152210 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e74066280 0x7f4e74068730 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e900d2450 0x7f4e90153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 --2- 172.21.15.45:0/4262201622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e900cd120 0x7f4e900b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 >> 172.21.15.45:0/4262201622 conn(0x7f4e900698e0 msgr2=0x7f4e901573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 shutdown_connections 2023-07-09T02:15:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.046+0000 7f4e96cbd640 1 -- 172.21.15.45:0/4262201622 wait complete. 2023-07-09T02:15:01.066 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:15:01.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:15:01.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ceee19640 1 Processor -- start 2023-07-09T02:15:01.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ceee19640 1 -- start start 2023-07-09T02:15:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ceee19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ce815c060 0x7f8ce80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ceee19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80d2620 0x7f8ce80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ceee19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce8160a50 con 0x7f8ce80cd120 2023-07-09T02:15:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ceee19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce815c430 con 0x7f8ce815c060 2023-07-09T02:15:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ceee19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce815fb60 con 0x7f8ce80d2620 2023-07-09T02:15:01.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ce7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8ce80cd120 0x7f8ce80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54770/0 (socket says 172.21.15.45:54770) 2023-07-09T02:15:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8ce7fff640 1 -- 172.21.15.45:0/1338482618 learned_addr learned my addr 172.21.15.45:0/1338482618 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.210+0000 7f8cecbb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ce815c060 0x7f8ce80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8ced3b6640 1 --2- 172.21.15.45:0/1338482618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80d2620 0x7f8ce80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8cecbb5640 1 -- 172.21.15.45:0/1338482618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80d2620 msgr2=0x7f8ce80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8cecbb5640 1 --2- 172.21.15.45:0/1338482618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80d2620 0x7f8ce80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8cecbb5640 1 -- 172.21.15.45:0/1338482618 >> v1:172.21.15.45:6789/0 conn(0x7f8ce80cd120 legacy=0x7f8ce80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8cecbb5640 1 -- 172.21.15.45:0/1338482618 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce815fe40 con 0x7f8ce815c060 2023-07-09T02:15:01.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8ce77fe640 1 -- 172.21.15.45:0/1338482618 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271836092 0 0) 0x7f8ce8160a50 con 0x7f8ce80cd120 2023-07-09T02:15:01.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8ced3b6640 1 --2- 172.21.15.45:0/1338482618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80d2620 0x7f8ce80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:01.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8cecbb5640 1 --2- 172.21.15.45:0/1338482618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce815c060 0x7f8ce80b4ed0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097c0 tx=0x7f8cdc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0deba8dba15e1f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8ce77fe640 1 -- 172.21.15.45:0/1338482618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0ab650 con 0x7f8ce815c060 2023-07-09T02:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8ce77fe640 1 -- 172.21.15.45:0/1338482618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0ab7b0 con 0x7f8ce815c060 2023-07-09T02:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8ce77fe640 1 -- 172.21.15.45:0/1338482618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0abb40 con 0x7f8ce815c060 2023-07-09T02:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8ceee19640 1 -- 172.21.15.45:0/1338482618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce815c060 msgr2=0x7f8ce80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.214+0000 7f8ceee19640 1 --2- 172.21.15.45:0/1338482618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce815c060 0x7f8ce80b4ed0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097c0 tx=0x7f8cdc01c450 comp rx=0 tx=0).stop 2023-07-09T02:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 -- 172.21.15.45:0/1338482618 shutdown_connections 2023-07-09T02:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 --2- 172.21.15.45:0/1338482618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80d2620 0x7f8ce80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 --2- 172.21.15.45:0/1338482618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce815c060 0x7f8ce80b4ed0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 -- 172.21.15.45:0/1338482618 >> 172.21.15.45:0/1338482618 conn(0x7f8ce80698e0 msgr2=0x7f8ce8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 -- 172.21.15.45:0/1338482618 shutdown_connections 2023-07-09T02:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 -- 172.21.15.45:0/1338482618 wait complete. 2023-07-09T02:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 Processor -- start 2023-07-09T02:15:01.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 -- start start 2023-07-09T02:15:01.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80cd120 0x7f8ce814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce80d2620 0x7f8ce815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce815c060 0x7f8ce815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8152310 con 0x7f8ce80d2620 2023-07-09T02:15:01.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce81f88f0 con 0x7f8ce815c060 2023-07-09T02:15:01.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ceee19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce815c7a0 con 0x7f8ce80cd120 2023-07-09T02:15:01.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ce7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce80d2620 0x7f8ce815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ce7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce80d2620 0x7f8ce815a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34680/0 (socket says 172.21.15.45:34680) 2023-07-09T02:15:01.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ce7fff640 1 -- 172.21.15.45:0/4266399634 learned_addr learned my addr 172.21.15.45:0/4266399634 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:01.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8cecbb5640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80cd120 0x7f8ce814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ced3b6640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce815c060 0x7f8ce815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ce7fff640 1 -- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80cd120 msgr2=0x7f8ce814e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ce7fff640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80cd120 0x7f8ce814e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ce7fff640 1 -- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce815c060 msgr2=0x7f8ce815a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ce7fff640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce815c060 0x7f8ce815a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.218+0000 7f8ce7fff640 1 -- 172.21.15.45:0/4266399634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc009420 con 0x7f8ce80d2620 2023-07-09T02:15:01.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ce7fff640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce80d2620 0x7f8ce815a2e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c4b0 tx=0x7f8cd400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ce57fa640 1 -- 172.21.15.45:0/4266399634 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40074e0 con 0x7f8ce80d2620 2023-07-09T02:15:01.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ce57fa640 1 -- 172.21.15.45:0/4266399634 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd4007660 con 0x7f8ce80d2620 2023-07-09T02:15:01.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce80b59f0 con 0x7f8ce80d2620 2023-07-09T02:15:01.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ce57fa640 1 -- 172.21.15.45:0/4266399634 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4004a30 con 0x7f8ce80d2620 2023-07-09T02:15:01.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce815cd60 con 0x7f8ce80d2620 2023-07-09T02:15:01.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce815c600 con 0x7f8ce80d2620 2023-07-09T02:15:01.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ce57fa640 1 -- 172.21.15.45:0/4266399634 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8cd4004b90 con 0x7f8ce80d2620 2023-07-09T02:15:01.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.222+0000 7f8ce57fa640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ccc066280 0x7f8ccc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.226+0000 7f8ce57fa640 1 -- 172.21.15.45:0/4266399634 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f8cd4083270 con 0x7f8ce80d2620 2023-07-09T02:15:01.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.226+0000 7f8cecbb5640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ccc066280 0x7f8ccc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.226+0000 7f8cecbb5640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ccc066280 0x7f8ccc068730 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0af000 tx=0x7f8cdc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.230+0000 7f8ce57fa640 1 -- 172.21.15.45:0/4266399634 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ce815c600 con 0x7f8ce80d2620 2023-07-09T02:15:01.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.418+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce815c600 con 0x7f8ce80d2620 2023-07-09T02:15:01.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.418+0000 7f8ce57fa640 1 -- 172.21.15.45:0/4266399634 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f8ce815c600 con 0x7f8ce80d2620 2023-07-09T02:15:01.422 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:01.422 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2676442896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2676442896},{"type":"v1","addr":"172.21.15.155:6837","nonce":2676442896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/193698688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":193698688},{"type":"v1","addr":"172.21.15.155:6836","nonce":193698688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1939767585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1939767585},{"type":"v1","addr":"172.21.15.45:6834","nonce":1939767585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:13:41.846779+0000","modified":"2023-07-09T02:13:45.491078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6096":{"gid":6096,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3771949487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3771949487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3771949487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T02:15:01.423 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 34 2023-07-09T02:15:01.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ccc066280 msgr2=0x7f8ccc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ccc066280 0x7f8ccc068730 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0af000 tx=0x7f8cdc0a7000 comp rx=0 tx=0).stop 2023-07-09T02:15:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce80d2620 msgr2=0x7f8ce815a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce80d2620 0x7f8ce815a2e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c4b0 tx=0x7f8cd400c970 comp rx=0 tx=0).stop 2023-07-09T02:15:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 shutdown_connections 2023-07-09T02:15:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ce815c060 0x7f8ce815a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ce80d2620 0x7f8ce815a2e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ccc066280 0x7f8ccc068730 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 --2- 172.21.15.45:0/4266399634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ce80cd120 0x7f8ce814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 >> 172.21.15.45:0/4266399634 conn(0x7f8ce80698e0 msgr2=0x7f8ce80b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:01.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 shutdown_connections 2023-07-09T02:15:01.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.422+0000 7f8ceee19640 1 -- 172.21.15.45:0/4266399634 wait complete. 2023-07-09T02:15:01.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:15:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.586+0000 7f935ff59640 1 Processor -- start 2023-07-09T02:15:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.586+0000 7f935ff59640 1 -- start start 2023-07-09T02:15:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935ff59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93580cd290 0x7f93580cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935ff59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9358071140 con 0x7f935806aa40 2023-07-09T02:15:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935ff59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93580b3160 con 0x7f935806a5c0 2023-07-09T02:15:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935ff59640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935806b010 con 0x7f93580cd290 2023-07-09T02:15:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935dcf5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93580cd290 0x7f93580cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935e4f6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f935806aa40 0x7f93580b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54776/0 (socket says 172.21.15.45:54776) 2023-07-09T02:15:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935e4f6640 1 -- 172.21.15.45:0/2801941584 learned_addr learned my addr 172.21.15.45:0/2801941584 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935dcf5640 1 -- 172.21.15.45:0/2801941584 >> v1:172.21.15.155:6789/0 conn(0x7f935806a5c0 legacy=0x7f93580b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935dcf5640 1 -- 172.21.15.45:0/2801941584 >> v1:172.21.15.45:6789/0 conn(0x7f935806aa40 legacy=0x7f93580b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935dcf5640 1 -- 172.21.15.45:0/2801941584 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93580cdba0 con 0x7f93580cd290 2023-07-09T02:15:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.590+0000 7f935ccf3640 1 -- 172.21.15.45:0/2801941584 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288254786 0 0) 0x7f9358071140 con 0x7f935806aa40 2023-07-09T02:15:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935dcf5640 1 --2- 172.21.15.45:0/2801941584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93580cd290 0x7f93580cd660 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f93540097c0 tx=0x7f935401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f06c5b0cf28864 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ccf3640 1 -- 172.21.15.45:0/2801941584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540ab600 con 0x7f93580cd290 2023-07-09T02:15:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ccf3640 1 -- 172.21.15.45:0/2801941584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93540a7050 con 0x7f93580cd290 2023-07-09T02:15:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ccf3640 1 -- 172.21.15.45:0/2801941584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540ab980 con 0x7f93580cd290 2023-07-09T02:15:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 -- 172.21.15.45:0/2801941584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93580cd290 msgr2=0x7f93580cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 --2- 172.21.15.45:0/2801941584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93580cd290 0x7f93580cd660 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f93540097c0 tx=0x7f935401c3f0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 -- 172.21.15.45:0/2801941584 shutdown_connections 2023-07-09T02:15:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 --2- 172.21.15.45:0/2801941584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93580cd290 0x7f93580cd660 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 -- 172.21.15.45:0/2801941584 >> 172.21.15.45:0/2801941584 conn(0x7f935806d140 msgr2=0x7f935806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 -- 172.21.15.45:0/2801941584 shutdown_connections 2023-07-09T02:15:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 -- 172.21.15.45:0/2801941584 wait complete. 2023-07-09T02:15:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 Processor -- start 2023-07-09T02:15:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.594+0000 7f935ff59640 1 -- start start 2023-07-09T02:15:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935806a5c0 0x7f935814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f935806aa40 0x7f93581517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93580cd290 0x7f93581551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581575c0 con 0x7f935806a5c0 2023-07-09T02:15:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358153c40 con 0x7f93580cd290 2023-07-09T02:15:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9358153f20 con 0x7f935806aa40 2023-07-09T02:15:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935806a5c0 0x7f935814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935806a5c0 0x7f935814fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34704/0 (socket says 172.21.15.45:34704) 2023-07-09T02:15:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 -- 172.21.15.45:0/1801247264 learned_addr learned my addr 172.21.15.45:0/1801247264 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935d4f4640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f935806aa40 0x7f93581517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935e4f6640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93580cd290 0x7f93581551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 -- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f935806aa40 msgr2=0x7f93581517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f935806aa40 0x7f93581517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 -- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93580cd290 msgr2=0x7f93581551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93580cd290 0x7f93581551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 -- 172.21.15.45:0/1801247264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9354009420 con 0x7f935806a5c0 2023-07-09T02:15:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935dcf5640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935806a5c0 0x7f935814fcb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9354019000 tx=0x7f935401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f934e7fc640 1 -- 172.21.15.45:0/1801247264 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540b7650 con 0x7f935806a5c0 2023-07-09T02:15:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f934e7fc640 1 -- 172.21.15.45:0/1801247264 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93540abe90 con 0x7f935806a5c0 2023-07-09T02:15:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f934e7fc640 1 -- 172.21.15.45:0/1801247264 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540b7a10 con 0x7f935806a5c0 2023-07-09T02:15:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9358154200 con 0x7f935806a5c0 2023-07-09T02:15:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93581547c0 con 0x7f935806a5c0 2023-07-09T02:15:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935804d7d0 con 0x7f935806a5c0 2023-07-09T02:15:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.598+0000 7f934e7fc640 1 -- 172.21.15.45:0/1801247264 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93540b7b70 con 0x7f935806a5c0 2023-07-09T02:15:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.602+0000 7f934e7fc640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f933c066280 0x7f933c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.602+0000 7f934e7fc640 1 -- 172.21.15.45:0/1801247264 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f935411e710 con 0x7f935806a5c0 2023-07-09T02:15:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.602+0000 7f935d4f4640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f933c066280 0x7f933c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.602+0000 7f935d4f4640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f933c066280 0x7f933c068730 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9358153aa0 tx=0x7f9348009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.606+0000 7f934e7fc640 1 -- 172.21.15.45:0/1801247264 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93540ebc10 con 0x7f935806a5c0 2023-07-09T02:15:01.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.790+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f935806f3a0 con 0x7f935806a5c0 2023-07-09T02:15:01.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.790+0000 7f934e7fc640 1 -- 172.21.15.45:0/1801247264 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f93540ef230 con 0x7f935806a5c0 2023-07-09T02:15:01.792 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:01.793 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2676442896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2676442896},{"type":"v1","addr":"172.21.15.155:6837","nonce":2676442896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/193698688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":193698688},{"type":"v1","addr":"172.21.15.155:6836","nonce":193698688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1939767585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1939767585},{"type":"v1","addr":"172.21.15.45:6834","nonce":1939767585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:13:41.846779+0000","modified":"2023-07-09T02:13:45.491078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6096":{"gid":6096,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/3771949487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3771949487},{"type":"v1","addr":"172.21.15.45:6835","nonce":3771949487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T02:15:01.793 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 34 2023-07-09T02:15:01.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f933c066280 msgr2=0x7f933c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f933c066280 0x7f933c068730 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9358153aa0 tx=0x7f9348009040 comp rx=0 tx=0).stop 2023-07-09T02:15:01.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935806a5c0 msgr2=0x7f935814fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935806a5c0 0x7f935814fcb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9354019000 tx=0x7f935401ac30 comp rx=0 tx=0).stop 2023-07-09T02:15:01.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 shutdown_connections 2023-07-09T02:15:01.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93580cd290 0x7f93581551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f933c066280 0x7f933c068730 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f935806aa40 0x7f93581517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 --2- 172.21.15.45:0/1801247264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935806a5c0 0x7f935814fcb0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 >> 172.21.15.45:0/1801247264 conn(0x7f935806d140 msgr2=0x7f9358071600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:01.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 shutdown_connections 2023-07-09T02:15:01.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.794+0000 7f935ff59640 1 -- 172.21.15.45:0/1801247264 wait complete. 2023-07-09T02:15:01.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:15:01.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.954+0000 7f8a79f40640 1 Processor -- start 2023-07-09T02:15:01.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.954+0000 7f8a79f40640 1 -- start start 2023-07-09T02:15:01.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a79f40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a7415c060 0x7f8a740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a79f40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a740cd120 0x7f8a740d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a79f40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a74160a50 con 0x7f8a740d2450 2023-07-09T02:15:01.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a79f40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a740d28d0 con 0x7f8a7415c060 2023-07-09T02:15:01.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a79f40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a740cfe40 con 0x7f8a740cd120 2023-07-09T02:15:01.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a737fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a7415c060 0x7f8a740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a73fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8a740d2450 0x7f8a740d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49344/0 (socket says 172.21.15.45:49344) 2023-07-09T02:15:01.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a73fff640 1 -- 172.21.15.45:0/3965083866 learned_addr learned my addr 172.21.15.45:0/3965083866 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:01.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a72ffd640 1 --2- 172.21.15.45:0/3965083866 >> v2:172.21.15.155:3300/0 conn(0x7f8a740cd120 0x7f8a740d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a737fe640 1 -- 172.21.15.45:0/3965083866 >> v2:172.21.15.155:3300/0 conn(0x7f8a740cd120 msgr2=0x7f8a740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:01.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a737fe640 1 --2- 172.21.15.45:0/3965083866 >> v2:172.21.15.155:3300/0 conn(0x7f8a740cd120 0x7f8a740d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a737fe640 1 -- 172.21.15.45:0/3965083866 >> v1:172.21.15.45:6789/0 conn(0x7f8a740d2450 legacy=0x7f8a740d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a737fe640 1 -- 172.21.15.45:0/3965083866 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7415c430 con 0x7f8a7415c060 2023-07-09T02:15:01.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.958+0000 7f8a72ffd640 1 --2- 172.21.15.45:0/3965083866 >> v2:172.21.15.155:3300/0 conn(0x7f8a740cd120 0x7f8a740d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:01.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a737fe640 1 --2- 172.21.15.45:0/3965083866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a7415c060 0x7f8a740b4ed0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8a7415fac0 tx=0x7f8a6401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d419c7d880de1a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a727fc640 1 -- 172.21.15.45:0/3965083866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64004230 con 0x7f8a7415c060 2023-07-09T02:15:01.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a727fc640 1 -- 172.21.15.45:0/3965083866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a640a7050 con 0x7f8a7415c060 2023-07-09T02:15:01.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a727fc640 1 -- 172.21.15.45:0/3965083866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64003620 con 0x7f8a7415c060 2023-07-09T02:15:01.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 -- 172.21.15.45:0/3965083866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a7415c060 msgr2=0x7f8a740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3965083866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a7415c060 0x7f8a740b4ed0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8a7415fac0 tx=0x7f8a6401c430 comp rx=0 tx=0).stop 2023-07-09T02:15:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 -- 172.21.15.45:0/3965083866 shutdown_connections 2023-07-09T02:15:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3965083866 >> v2:172.21.15.155:3300/0 conn(0x7f8a740cd120 0x7f8a740d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3965083866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a7415c060 0x7f8a740b4ed0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 -- 172.21.15.45:0/3965083866 >> 172.21.15.45:0/3965083866 conn(0x7f8a740698e0 msgr2=0x7f8a74069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 -- 172.21.15.45:0/3965083866 shutdown_connections 2023-07-09T02:15:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 -- 172.21.15.45:0/3965083866 wait complete. 2023-07-09T02:15:01.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 Processor -- start 2023-07-09T02:15:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.962+0000 7f8a79f40640 1 -- start start 2023-07-09T02:15:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a740cd120 0x7f8a741519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a740d2450 0x7f8a740b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7415c060 0x7f8a740b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7415c960 con 0x7f8a740cd120 2023-07-09T02:15:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74151f20 con 0x7f8a740d2450 2023-07-09T02:15:01.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7415ec70 con 0x7f8a7415c060 2023-07-09T02:15:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a740cd120 0x7f8a741519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a740cd120 0x7f8a741519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55188/0 (socket says 172.21.15.45:55188) 2023-07-09T02:15:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 -- 172.21.15.45:0/3935139214 learned_addr learned my addr 172.21.15.45:0/3935139214 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a73fff640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7415c060 0x7f8a740b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a72ffd640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a740d2450 0x7f8a740b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 -- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7415c060 msgr2=0x7f8a740b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7415c060 0x7f8a740b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 -- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a740d2450 msgr2=0x7f8a740b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:01.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a740d2450 0x7f8a740b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 -- 172.21.15.45:0/3935139214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64009420 con 0x7f8a740cd120 2023-07-09T02:15:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a73fff640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7415c060 0x7f8a740b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a737fe640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a740cd120 0x7f8a741519e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8a6401a060 tx=0x7f8a640191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a5bfff640 1 -- 172.21.15.45:0/3935139214 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64003c70 con 0x7f8a740cd120 2023-07-09T02:15:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a5bfff640 1 -- 172.21.15.45:0/3935139214 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a64003df0 con 0x7f8a740cd120 2023-07-09T02:15:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a5bfff640 1 -- 172.21.15.45:0/3935139214 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a640ab680 con 0x7f8a740cd120 2023-07-09T02:15:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7415ef50 con 0x7f8a740cd120 2023-07-09T02:15:01.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7415f510 con 0x7f8a740cd120 2023-07-09T02:15:01.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7404d7d0 con 0x7f8a740cd120 2023-07-09T02:15:01.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.966+0000 7f8a5bfff640 1 -- 172.21.15.45:0/3935139214 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a640b2040 con 0x7f8a740cd120 2023-07-09T02:15:01.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.970+0000 7f8a5bfff640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a600662b0 0x7f8a60068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:01.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.970+0000 7f8a5bfff640 1 -- 172.21.15.45:0/3935139214 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f8a6411df30 con 0x7f8a740cd120 2023-07-09T02:15:01.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.970+0000 7f8a72ffd640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a600662b0 0x7f8a60068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:01.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.970+0000 7f8a72ffd640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a600662b0 0x7f8a60068760 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a74166ec0 tx=0x7f8a68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:01.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:01.974+0000 7f8a5bfff640 1 -- 172.21.15.45:0/3935139214 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a640eb310 con 0x7f8a740cd120 2023-07-09T02:15:02.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.130+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a740ccf00 con 0x7f8a740cd120 2023-07-09T02:15:02.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.130+0000 7f8a5bfff640 1 -- 172.21.15.45:0/3935139214 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18626 (secure 0 0 0) 0x7f8a640b9090 con 0x7f8a740cd120 2023-07-09T02:15:02.132 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:02.132 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:15:00.515456+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:13:39.573636+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T02:13:40.849108+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.19","mappings":[{"from":4,"to":5}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:15:02.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a600662b0 msgr2=0x7f8a60068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a600662b0 0x7f8a60068760 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a74166ec0 tx=0x7f8a68008040 comp rx=0 tx=0).stop 2023-07-09T02:15:02.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a740cd120 msgr2=0x7f8a741519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a740cd120 0x7f8a741519e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8a6401a060 tx=0x7f8a640191d0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 shutdown_connections 2023-07-09T02:15:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8a600662b0 0x7f8a60068760 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a7415c060 0x7f8a740b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a740d2450 0x7f8a740b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 --2- 172.21.15.45:0/3935139214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a740cd120 0x7f8a741519e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 >> 172.21.15.45:0/3935139214 conn(0x7f8a740698e0 msgr2=0x7f8a740b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:02.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 shutdown_connections 2023-07-09T02:15:02.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.134+0000 7f8a79f40640 1 -- 172.21.15.45:0/3935139214 wait complete. 2023-07-09T02:15:02.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:15:02.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0aec856640 1 Processor -- start 2023-07-09T02:15:02.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0aec856640 1 -- start start 2023-07-09T02:15:02.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0aec856640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ae815c060 0x7f0ae80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0aec856640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0aec856640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae8160a50 con 0x7f0ae80d2450 2023-07-09T02:15:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0aec856640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae80d28f0 con 0x7f0ae815c060 2023-07-09T02:15:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0aec856640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80cfe40 con 0x7f0ae80cd120 2023-07-09T02:15:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae6d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0ae80d2450 0x7f0ae80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49354/0 (socket says 172.21.15.45:49354) 2023-07-09T02:15:02.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae6d9d640 1 -- 172.21.15.45:0/3960780310 learned_addr learned my addr 172.21.15.45:0/3960780310 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae659c640 1 --2- 172.21.15.45:0/3960780310 >> v2:172.21.15.155:3300/0 conn(0x7f0ae815c060 0x7f0ae80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0adffff640 1 --2- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae5d9b640 1 -- 172.21.15.45:0/3960780310 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340877859 0 0) 0x7f0ae8160a50 con 0x7f0ae80d2450 2023-07-09T02:15:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae5d9b640 1 -- 172.21.15.45:0/3960780310 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad4003530 con 0x7f0ae80d2450 2023-07-09T02:15:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae659c640 1 -- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 msgr2=0x7f0ae80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae659c640 1 --2- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae659c640 1 -- 172.21.15.45:0/3960780310 >> v1:172.21.15.45:6789/0 conn(0x7f0ae80d2450 legacy=0x7f0ae80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0ae659c640 1 -- 172.21.15.45:0/3960780310 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae815c430 con 0x7f0ae815c060 2023-07-09T02:15:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.298+0000 7f0adffff640 1 --2- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:15:02.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0ae659c640 1 --2- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae815c060 0x7f0ae80b4ed0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80097c0 tx=0x7f0ad801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77349d87e1d3e3d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:02.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0ae5d9b640 1 -- 172.21.15.45:0/3960780310 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80ab600 con 0x7f0ae815c060 2023-07-09T02:15:02.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0ae5d9b640 1 -- 172.21.15.45:0/3960780310 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad80a7050 con 0x7f0ae815c060 2023-07-09T02:15:02.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0ae5d9b640 1 -- 172.21.15.45:0/3960780310 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80ab960 con 0x7f0ae815c060 2023-07-09T02:15:02.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0aec856640 1 -- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae815c060 msgr2=0x7f0ae80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0aec856640 1 --2- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae815c060 0x7f0ae80b4ed0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80097c0 tx=0x7f0ad801c450 comp rx=0 tx=0).stop 2023-07-09T02:15:02.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0aec856640 1 -- 172.21.15.45:0/3960780310 shutdown_connections 2023-07-09T02:15:02.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0aec856640 1 --2- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0aec856640 1 --2- 172.21.15.45:0/3960780310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae815c060 0x7f0ae80b4ed0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0aec856640 1 -- 172.21.15.45:0/3960780310 >> 172.21.15.45:0/3960780310 conn(0x7f0ae80698e0 msgr2=0x7f0ae8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:02.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0aec856640 1 -- 172.21.15.45:0/3960780310 shutdown_connections 2023-07-09T02:15:02.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.302+0000 7f0aec856640 1 -- 172.21.15.45:0/3960780310 wait complete. 2023-07-09T02:15:02.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0aec856640 1 Processor -- start 2023-07-09T02:15:02.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0aec856640 1 -- start start 2023-07-09T02:15:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0aec856640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0aec856640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae80d2450 0x7f0ae80b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0aec856640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae815c060 0x7f0ae80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0aec856640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80b41d0 con 0x7f0ae815c060 2023-07-09T02:15:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0aec856640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80b3550 con 0x7f0ae80d2450 2023-07-09T02:15:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0aec856640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80b3830 con 0x7f0ae80cd120 2023-07-09T02:15:02.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae815c060 0x7f0ae80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae815c060 0x7f0ae80b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55194/0 (socket says 172.21.15.45:55194) 2023-07-09T02:15:02.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 -- 172.21.15.45:0/2703407686 learned_addr learned my addr 172.21.15.45:0/2703407686 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:02.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0adffff640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae80d2450 0x7f0ae80b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 -- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 msgr2=0x7f0ae815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae815f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 -- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae80d2450 msgr2=0x7f0ae80b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae80d2450 0x7f0ae80b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 -- 172.21.15.45:0/2703407686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0009420 con 0x7f0ae815c060 2023-07-09T02:15:02.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0ae6d9d640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae815c060 0x7f0ae80b60e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000cb40 tx=0x7f0ae000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:02.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.306+0000 7f0adeffd640 1 -- 172.21.15.45:0/2703407686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae000aca0 con 0x7f0ae815c060 2023-07-09T02:15:02.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0adeffd640 1 -- 172.21.15.45:0/2703407686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae000ae00 con 0x7f0ae815c060 2023-07-09T02:15:02.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0adeffd640 1 -- 172.21.15.45:0/2703407686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0012620 con 0x7f0ae815c060 2023-07-09T02:15:02.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad8009420 con 0x7f0ae815c060 2023-07-09T02:15:02.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae80b3df0 con 0x7f0ae815c060 2023-07-09T02:15:02.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae80b4310 con 0x7f0ae815c060 2023-07-09T02:15:02.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0adeffd640 1 -- 172.21.15.45:0/2703407686 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ae0007070 con 0x7f0ae815c060 2023-07-09T02:15:02.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0adeffd640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0ac8066280 0x7f0ac8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0adeffd640 1 -- 172.21.15.45:0/2703407686 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0ae0083eb0 con 0x7f0ae815c060 2023-07-09T02:15:02.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.310+0000 7f0ae659c640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0ac8066280 0x7f0ac8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.314+0000 7f0ae659c640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0ac8066280 0x7f0ac8068730 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80ad000 tx=0x7f0ad8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:02.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.314+0000 7f0adeffd640 1 -- 172.21.15.45:0/2703407686 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ae80b4310 con 0x7f0ae815c060 2023-07-09T02:15:02.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.506+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0ae80b4310 con 0x7f0ae815c060 2023-07-09T02:15:02.506 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:15:02.506+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:15:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.510+0000 7f0adeffd640 1 -- 172.21.15.45:0/2703407686 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0ae80b4310 con 0x7f0ae815c060 2023-07-09T02:15:02.512 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:15:02.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0ac8066280 msgr2=0x7f0ac8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0ac8066280 0x7f0ac8068730 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80ad000 tx=0x7f0ad8008040 comp rx=0 tx=0).stop 2023-07-09T02:15:02.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae815c060 msgr2=0x7f0ae80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae815c060 0x7f0ae80b60e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000cb40 tx=0x7f0ae000a060 comp rx=0 tx=0).stop 2023-07-09T02:15:02.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 shutdown_connections 2023-07-09T02:15:02.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae815c060 0x7f0ae80b60e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ae80d2450 0x7f0ae80b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0ac8066280 0x7f0ac8068730 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 --2- 172.21.15.45:0/2703407686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ae80cd120 0x7f0ae815f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 >> 172.21.15.45:0/2703407686 conn(0x7f0ae80698e0 msgr2=0x7f0ae80b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:02.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 shutdown_connections 2023-07-09T02:15:02.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.514+0000 7f0aec856640 1 -- 172.21.15.45:0/2703407686 wait complete. 2023-07-09T02:15:02.522 INFO:tasks.ceph.mds.c.smithi045.stderr: -9981> 2023-07-09T02:13:48.427+0000 7f31b3f97640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:15:02.537 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:15:02.578 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:15:02.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355ebd5640 1 Processor -- start 2023-07-09T02:15:02.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355ebd5640 1 -- start start 2023-07-09T02:15:02.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355ebd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f355815c060 0x7f35580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355ebd5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35580d2620 0x7f35580cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355ebd5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3558160a50 con 0x7f35580cd120 2023-07-09T02:15:02.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355ebd5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355815c430 con 0x7f35580d2620 2023-07-09T02:15:02.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355ebd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355815fb60 con 0x7f355815c060 2023-07-09T02:15:02.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355c971640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f355815c060 0x7f35580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355c971640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f355815c060 0x7f35580b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:33434/0 (socket says 172.21.15.45:33434) 2023-07-09T02:15:02.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355c971640 1 -- 172.21.15.45:0/3735841070 learned_addr learned my addr 172.21.15.45:0/3735841070 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:02.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355d172640 1 --2- 172.21.15.45:0/3735841070 >> v2:172.21.15.155:3300/0 conn(0x7f35580d2620 0x7f35580cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355c971640 1 -- 172.21.15.45:0/3735841070 >> v2:172.21.15.155:3300/0 conn(0x7f35580d2620 msgr2=0x7f35580cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:02.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355c971640 1 --2- 172.21.15.45:0/3735841070 >> v2:172.21.15.155:3300/0 conn(0x7f35580d2620 0x7f35580cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355c971640 1 -- 172.21.15.45:0/3735841070 >> v1:172.21.15.155:6789/0 conn(0x7f35580cd120 legacy=0x7f35580d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.686+0000 7f355c971640 1 -- 172.21.15.45:0/3735841070 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355815fe40 con 0x7f355815c060 2023-07-09T02:15:02.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355c971640 1 --2- 172.21.15.45:0/3735841070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f355815c060 0x7f35580b4ed0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f354c0098a0 tx=0x7f354c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e926fa885794a48 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:02.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f35577fe640 1 -- 172.21.15.45:0/3735841070 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0aa650 con 0x7f355815c060 2023-07-09T02:15:02.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f35577fe640 1 -- 172.21.15.45:0/3735841070 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0aa7b0 con 0x7f355815c060 2023-07-09T02:15:02.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f35577fe640 1 -- 172.21.15.45:0/3735841070 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0aab40 con 0x7f355815c060 2023-07-09T02:15:02.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355ebd5640 1 -- 172.21.15.45:0/3735841070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f355815c060 msgr2=0x7f35580b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355ebd5640 1 --2- 172.21.15.45:0/3735841070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f355815c060 0x7f35580b4ed0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f354c0098a0 tx=0x7f354c01c4f0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355ebd5640 1 -- 172.21.15.45:0/3735841070 shutdown_connections 2023-07-09T02:15:02.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355ebd5640 1 --2- 172.21.15.45:0/3735841070 >> v2:172.21.15.155:3300/0 conn(0x7f35580d2620 0x7f35580cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355ebd5640 1 --2- 172.21.15.45:0/3735841070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f355815c060 0x7f35580b4ed0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355ebd5640 1 -- 172.21.15.45:0/3735841070 >> 172.21.15.45:0/3735841070 conn(0x7f35580698e0 msgr2=0x7f3558069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:02.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355ebd5640 1 -- 172.21.15.45:0/3735841070 shutdown_connections 2023-07-09T02:15:02.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.690+0000 7f355ebd5640 1 -- 172.21.15.45:0/3735841070 wait complete. 2023-07-09T02:15:02.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 Processor -- start 2023-07-09T02:15:02.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 -- start start 2023-07-09T02:15:02.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35580cd120 0x7f355814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35580d2620 0x7f355814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f355815c060 0x7f3558152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35580b29b0 con 0x7f355815c060 2023-07-09T02:15:02.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35581535b0 con 0x7f35580d2620 2023-07-09T02:15:02.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3558152ff0 con 0x7f35580cd120 2023-07-09T02:15:02.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f355815c060 0x7f3558152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355c971640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35580cd120 0x7f355814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f355815c060 0x7f3558152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55220/0 (socket says 172.21.15.45:55220) 2023-07-09T02:15:02.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 -- 172.21.15.45:0/1893254762 learned_addr learned my addr 172.21.15.45:0/1893254762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:02.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f3557fff640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35580d2620 0x7f355814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 -- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35580cd120 msgr2=0x7f355814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35580cd120 0x7f355814b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 -- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35580d2620 msgr2=0x7f355814dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:02.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35580d2620 0x7f355814dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 -- 172.21.15.45:0/1893254762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c0094d0 con 0x7f355815c060 2023-07-09T02:15:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355d172640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f355815c060 0x7f3558152680 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f355000ef90 tx=0x7f355000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f35557fa640 1 -- 172.21.15.45:0/1893254762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550009ca0 con 0x7f355815c060 2023-07-09T02:15:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f35557fa640 1 -- 172.21.15.45:0/1893254762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000f040 con 0x7f355815c060 2023-07-09T02:15:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f35557fa640 1 -- 172.21.15.45:0/1893254762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500146c0 con 0x7f355815c060 2023-07-09T02:15:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.694+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35580b59f0 con 0x7f355815c060 2023-07-09T02:15:02.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.698+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35580b2640 con 0x7f355815c060 2023-07-09T02:15:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.698+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35580b2800 con 0x7f355815c060 2023-07-09T02:15:02.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.698+0000 7f35557fa640 1 -- 172.21.15.45:0/1893254762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3550014820 con 0x7f355815c060 2023-07-09T02:15:02.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.698+0000 7f35557fa640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f353c066280 0x7f353c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:02.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.698+0000 7f35557fa640 1 -- 172.21.15.45:0/1893254762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f3550084c60 con 0x7f355815c060 2023-07-09T02:15:02.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.698+0000 7f355c971640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f353c066280 0x7f353c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:02.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.702+0000 7f355c971640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f353c066280 0x7f353c068730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f354c0ae000 tx=0x7f354c0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:02.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.702+0000 7f35557fa640 1 -- 172.21.15.45:0/1893254762 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3550052000 con 0x7f355815c060 2023-07-09T02:15:02.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:02.890+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35580b24a0 con 0x7f355815c060 2023-07-09T02:15:03.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.526+0000 7f35557fa640 1 -- 172.21.15.45:0/1893254762 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f35580b24a0 con 0x7f355815c060 2023-07-09T02:15:03.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f353c066280 msgr2=0x7f353c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:03.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f353c066280 0x7f353c068730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f354c0ae000 tx=0x7f354c0b5040 comp rx=0 tx=0).stop 2023-07-09T02:15:03.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f355815c060 msgr2=0x7f3558152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:03.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f355815c060 0x7f3558152680 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f355000ef90 tx=0x7f355000c490 comp rx=0 tx=0).stop 2023-07-09T02:15:03.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 shutdown_connections 2023-07-09T02:15:03.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f355815c060 0x7f3558152680 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35580d2620 0x7f355814dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f353c066280 0x7f353c068730 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 --2- 172.21.15.45:0/1893254762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35580cd120 0x7f355814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 >> 172.21.15.45:0/1893254762 conn(0x7f35580698e0 msgr2=0x7f3558069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:03.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 shutdown_connections 2023-07-09T02:15:03.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.530+0000 7f355ebd5640 1 -- 172.21.15.45:0/1893254762 wait complete. 2023-07-09T02:15:03.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:15:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.742+0000 7fd52169e640 1 Processor -- start 2023-07-09T02:15:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.742+0000 7fd52169e640 1 -- start start 2023-07-09T02:15:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd52169e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd51c15c280 0x7fd51c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd52169e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd51c069980 0x7fd51c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd52169e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c0cced0 con 0x7fd51c0cead0 2023-07-09T02:15:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd52169e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c0cd6e0 con 0x7fd51c069980 2023-07-09T02:15:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd52169e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c0d0450 con 0x7fd51c15c280 2023-07-09T02:15:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd520e9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd51c069980 0x7fd51c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd51b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd51c0cead0 0x7fd51c160600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49376/0 (socket says 172.21.15.45:49376) 2023-07-09T02:15:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd51b7fe640 1 -- 172.21.15.45:0/810932029 learned_addr learned my addr 172.21.15.45:0/810932029 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd51bfff640 1 --2- 172.21.15.45:0/810932029 >> v2:172.21.15.155:3300/0 conn(0x7fd51c15c280 0x7fd51c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd51affd640 1 -- 172.21.15.45:0/810932029 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481821279 0 0) 0x7fd51c0cced0 con 0x7fd51c0cead0 2023-07-09T02:15:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd51affd640 1 -- 172.21.15.45:0/810932029 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd504003530 con 0x7fd51c0cead0 2023-07-09T02:15:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd520e9d640 1 -- 172.21.15.45:0/810932029 >> v2:172.21.15.155:3300/0 conn(0x7fd51c15c280 msgr2=0x7fd51c0b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd520e9d640 1 --2- 172.21.15.45:0/810932029 >> v2:172.21.15.155:3300/0 conn(0x7fd51c15c280 0x7fd51c0b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd520e9d640 1 -- 172.21.15.45:0/810932029 >> v1:172.21.15.45:6789/0 conn(0x7fd51c0cead0 legacy=0x7fd51c160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.746+0000 7fd520e9d640 1 -- 172.21.15.45:0/810932029 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0cef40 con 0x7fd51c069980 2023-07-09T02:15:03.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd520e9d640 1 --2- 172.21.15.45:0/810932029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c069980 0x7fd51c069e00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0b53f0 tx=0x7fd51401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73947320dfd4e957 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:03.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd51affd640 1 -- 172.21.15.45:0/810932029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140a58e0 con 0x7fd51c069980 2023-07-09T02:15:03.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd51affd640 1 -- 172.21.15.45:0/810932029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5140a5a40 con 0x7fd51c069980 2023-07-09T02:15:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd51affd640 1 -- 172.21.15.45:0/810932029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140a5dd0 con 0x7fd51c069980 2023-07-09T02:15:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 -- 172.21.15.45:0/810932029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c069980 msgr2=0x7fd51c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 --2- 172.21.15.45:0/810932029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c069980 0x7fd51c069e00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0b53f0 tx=0x7fd51401c910 comp rx=0 tx=0).stop 2023-07-09T02:15:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 -- 172.21.15.45:0/810932029 shutdown_connections 2023-07-09T02:15:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 --2- 172.21.15.45:0/810932029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c069980 0x7fd51c069e00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 --2- 172.21.15.45:0/810932029 >> v2:172.21.15.155:3300/0 conn(0x7fd51c15c280 0x7fd51c0b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 -- 172.21.15.45:0/810932029 >> 172.21.15.45:0/810932029 conn(0x7fd51c0cff90 msgr2=0x7fd51c0d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 -- 172.21.15.45:0/810932029 shutdown_connections 2023-07-09T02:15:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 -- 172.21.15.45:0/810932029 wait complete. 2023-07-09T02:15:03.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 Processor -- start 2023-07-09T02:15:03.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.750+0000 7fd52169e640 1 -- start start 2023-07-09T02:15:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd51c069980 0x7fd51c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd51c0cead0 0x7fd51c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c15c280 0x7fd51c15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:03.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b6710 con 0x7fd51c15c280 2023-07-09T02:15:03.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b6cc0 con 0x7fd51c0cead0 2023-07-09T02:15:03.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b7690 con 0x7fd51c069980 2023-07-09T02:15:03.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c15c280 0x7fd51c15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:03.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c15c280 0x7fd51c15afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55248/0 (socket says 172.21.15.45:55248) 2023-07-09T02:15:03.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 -- 172.21.15.45:0/1337391989 learned_addr learned my addr 172.21.15.45:0/1337391989 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:03.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd51bfff640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd51c069980 0x7fd51c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:03.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd51b7fe640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd51c0cead0 0x7fd51c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:03.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 -- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd51c069980 msgr2=0x7fd51c0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:03.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd51c069980 0x7fd51c0b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 -- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd51c0cead0 msgr2=0x7fd51c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:03.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd51c0cead0 0x7fd51c153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:03.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 -- 172.21.15.45:0/1337391989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514009a70 con 0x7fd51c15c280 2023-07-09T02:15:03.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd520e9d640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c15c280 0x7fd51c15afd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd514019520 tx=0x7fd5140196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:03.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd518ff9640 1 -- 172.21.15.45:0/1337391989 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514007000 con 0x7fd51c15c280 2023-07-09T02:15:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd518ff9640 1 -- 172.21.15.45:0/1337391989 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5140ad850 con 0x7fd51c15c280 2023-07-09T02:15:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c0cbaa0 con 0x7fd51c15c280 2023-07-09T02:15:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd518ff9640 1 -- 172.21.15.45:0/1337391989 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140adc00 con 0x7fd51c15c280 2023-07-09T02:15:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c0b6950 con 0x7fd51c15c280 2023-07-09T02:15:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.754+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c0cbf50 con 0x7fd51c15c280 2023-07-09T02:15:03.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.758+0000 7fd518ff9640 1 -- 172.21.15.45:0/1337391989 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5140b4070 con 0x7fd51c15c280 2023-07-09T02:15:03.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.758+0000 7fd518ff9640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd508066280 0x7fd508068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:03.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.758+0000 7fd518ff9640 1 -- 172.21.15.45:0/1337391989 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd51411e9d0 con 0x7fd51c15c280 2023-07-09T02:15:03.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.758+0000 7fd51bfff640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd508066280 0x7fd508068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:03.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.758+0000 7fd51bfff640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd508066280 0x7fd508068730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd51c1f76e0 tx=0x7fd50c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.762+0000 7fd518ff9640 1 -- 172.21.15.45:0/1337391989 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5140ebd70 con 0x7fd51c15c280 2023-07-09T02:15:03.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:03.918+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd51c0b6e50 con 0x7fd51c15c280 2023-07-09T02:15:04.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.534+0000 7fd518ff9640 1 -- 172.21.15.45:0/1337391989 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd5140b20d0 con 0x7fd51c15c280 2023-07-09T02:15:04.536 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:15:04.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd508066280 msgr2=0x7fd508068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:04.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd508066280 0x7fd508068730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd51c1f76e0 tx=0x7fd50c009190 comp rx=0 tx=0).stop 2023-07-09T02:15:04.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c15c280 msgr2=0x7fd51c15afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:04.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c15c280 0x7fd51c15afd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd514019520 tx=0x7fd5140196b0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 shutdown_connections 2023-07-09T02:15:04.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51c15c280 0x7fd51c15afd0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd51c0cead0 0x7fd51c153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd508066280 0x7fd508068730 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 --2- 172.21.15.45:0/1337391989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd51c069980 0x7fd51c0b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 >> 172.21.15.45:0/1337391989 conn(0x7fd51c0cff90 msgr2=0x7fd51c0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:04.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 shutdown_connections 2023-07-09T02:15:04.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.538+0000 7fd52169e640 1 -- 172.21.15.45:0/1337391989 wait complete. 2023-07-09T02:15:04.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:15:04.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f2233456640 1 Processor -- start 2023-07-09T02:15:04.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f2233456640 1 -- start start 2023-07-09T02:15:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f2233456640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f222c0cd060 0x7f222c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f2233456640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f222c0b4490 0x7f222c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f2233456640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c0d19c0 con 0x7f222c15c480 2023-07-09T02:15:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f2233456640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c15c850 con 0x7f222c0b4490 2023-07-09T02:15:04.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f2233456640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c0b4e50 con 0x7f222c0cd060 2023-07-09T02:15:04.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f22319f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f222c0b4490 0x7f222c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:04.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f22311f2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f222c15c480 0x7f222c0d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49390/0 (socket says 172.21.15.45:49390) 2023-07-09T02:15:04.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f22311f2640 1 -- 172.21.15.45:0/1868867407 learned_addr learned my addr 172.21.15.45:0/1868867407 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f22309f1640 1 --2- 172.21.15.45:0/1868867407 >> v2:172.21.15.155:3300/0 conn(0x7f222c0cd060 0x7f222c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f22319f3640 1 -- 172.21.15.45:0/1868867407 >> v2:172.21.15.155:3300/0 conn(0x7f222c0cd060 msgr2=0x7f222c0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f22319f3640 1 --2- 172.21.15.45:0/1868867407 >> v2:172.21.15.155:3300/0 conn(0x7f222c0cd060 0x7f222c0cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f22319f3640 1 -- 172.21.15.45:0/1868867407 >> v1:172.21.15.45:6789/0 conn(0x7f222c15c480 legacy=0x7f222c0d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f22319f3640 1 -- 172.21.15.45:0/1868867407 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0cf210 con 0x7f222c0b4490 2023-07-09T02:15:04.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.710+0000 7f2223fff640 1 -- 172.21.15.45:0/1868867407 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742477712 0 0) 0x7f222c0d19c0 con 0x7f222c15c480 2023-07-09T02:15:04.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f22319f3640 1 --2- 172.21.15.45:0/1868867407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c0b4490 0x7f222c0b4910 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f222c0b1840 tx=0x7f222401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40fbf057b50c429 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:04.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2223fff640 1 -- 172.21.15.45:0/1868867407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240a58c0 con 0x7f222c0b4490 2023-07-09T02:15:04.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2223fff640 1 -- 172.21.15.45:0/1868867407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22240a5a20 con 0x7f222c0b4490 2023-07-09T02:15:04.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2223fff640 1 -- 172.21.15.45:0/1868867407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240a5db0 con 0x7f222c0b4490 2023-07-09T02:15:04.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2233456640 1 -- 172.21.15.45:0/1868867407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c0b4490 msgr2=0x7f222c0b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:04.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2233456640 1 --2- 172.21.15.45:0/1868867407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c0b4490 0x7f222c0b4910 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f222c0b1840 tx=0x7f222401c910 comp rx=0 tx=0).stop 2023-07-09T02:15:04.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2233456640 1 -- 172.21.15.45:0/1868867407 shutdown_connections 2023-07-09T02:15:04.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2233456640 1 --2- 172.21.15.45:0/1868867407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c0b4490 0x7f222c0b4910 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2233456640 1 --2- 172.21.15.45:0/1868867407 >> v2:172.21.15.155:3300/0 conn(0x7f222c0cd060 0x7f222c0cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2233456640 1 -- 172.21.15.45:0/1868867407 >> 172.21.15.45:0/1868867407 conn(0x7f222c0cf490 msgr2=0x7f222c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2233456640 1 -- 172.21.15.45:0/1868867407 shutdown_connections 2023-07-09T02:15:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.714+0000 7f2233456640 1 -- 172.21.15.45:0/1868867407 wait complete. 2023-07-09T02:15:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 Processor -- start 2023-07-09T02:15:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 -- start start 2023-07-09T02:15:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f222c0b4490 0x7f222c149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f222c0cd060 0x7f222c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c15c480 0x7f222c15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c149cd0 con 0x7f222c15c480 2023-07-09T02:15:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0cae60 con 0x7f222c0cd060 2023-07-09T02:15:04.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0cb140 con 0x7f222c0b4490 2023-07-09T02:15:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c15c480 0x7f222c15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22311f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f222c0b4490 0x7f222c149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c15c480 0x7f222c15eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55256/0 (socket says 172.21.15.45:55256) 2023-07-09T02:15:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 -- 172.21.15.45:0/1691494316 learned_addr learned my addr 172.21.15.45:0/1691494316 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22309f1640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f222c0cd060 0x7f222c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 -- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f222c0b4490 msgr2=0x7f222c149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f222c0b4490 0x7f222c149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 -- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f222c0cd060 msgr2=0x7f222c0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f222c0cd060 0x7f222c0c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 -- 172.21.15.45:0/1691494316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2224009a70 con 0x7f222c15c480 2023-07-09T02:15:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22309f1640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f222c0cd060 0x7f222c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:15:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f22319f3640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c15c480 0x7f222c15eba0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2224019520 tx=0x7f22240196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2221ffb640 1 -- 172.21.15.45:0/1691494316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240b9860 con 0x7f222c15c480 2023-07-09T02:15:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2221ffb640 1 -- 172.21.15.45:0/1691494316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22240b99c0 con 0x7f222c15c480 2023-07-09T02:15:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2221ffb640 1 -- 172.21.15.45:0/1691494316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240b9d50 con 0x7f222c15c480 2023-07-09T02:15:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.718+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c0cb420 con 0x7f222c15c480 2023-07-09T02:15:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.722+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c0cb9e0 con 0x7f222c15c480 2023-07-09T02:15:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.722+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c04d7d0 con 0x7f222c15c480 2023-07-09T02:15:04.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.722+0000 7f2221ffb640 1 -- 172.21.15.45:0/1691494316 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22240c4460 con 0x7f222c15c480 2023-07-09T02:15:04.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.722+0000 7f2221ffb640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2210066280 0x7f2210068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:04.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.722+0000 7f2221ffb640 1 -- 172.21.15.45:0/1691494316 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5826+0+0 (secure 0 0 0) 0x7f222411eef0 con 0x7f222c15c480 2023-07-09T02:15:04.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.726+0000 7f22311f2640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2210066280 0x7f2210068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:04.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.726+0000 7f22311f2640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2210066280 0x7f2210068730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2228000f70 tx=0x7f2228007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:04.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.726+0000 7f2221ffb640 1 -- 172.21.15.45:0/1691494316 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22240ec460 con 0x7f222c15c480 2023-07-09T02:15:04.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:04.882+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f222c0cbbd0 con 0x7f222c15c480 2023-07-09T02:15:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.542+0000 7f2221ffb640 1 -- 172.21.15.45:0/1691494316 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) v1 ==== 169+0+0 (secure 0 0 0) 0x7f22240b2020 con 0x7f222c15c480 2023-07-09T02:15:05.544 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:15:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2210066280 msgr2=0x7f2210068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2210066280 0x7f2210068730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2228000f70 tx=0x7f2228007df0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c15c480 msgr2=0x7f222c15eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:05.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c15c480 0x7f222c15eba0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2224019520 tx=0x7f22240196b0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 shutdown_connections 2023-07-09T02:15:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f222c15c480 0x7f222c15eba0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f222c0cd060 0x7f222c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2210066280 0x7f2210068730 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 --2- 172.21.15.45:0/1691494316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f222c0b4490 0x7f222c149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 >> 172.21.15.45:0/1691494316 conn(0x7f222c0cf490 msgr2=0x7f222c0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 shutdown_connections 2023-07-09T02:15:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.546+0000 7f2233456640 1 -- 172.21.15.45:0/1691494316 wait complete. 2023-07-09T02:15:05.568 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:15:05.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b9d3ac640 1 Processor -- start 2023-07-09T02:15:05.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b9d3ac640 1 -- start start 2023-07-09T02:15:05.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b9d3ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6b9806b120 0x7f6b9806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b9d3ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980b5830 0x7f6b980b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b9d3ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b980cd320 con 0x7f6b980d2400 2023-07-09T02:15:05.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b9d3ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b98071850 con 0x7f6b9806b120 2023-07-09T02:15:05.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b9d3ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9806ba30 con 0x7f6b980b5830 2023-07-09T02:15:05.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b8ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6b980d2400 0x7f6b980cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49404/0 (socket says 172.21.15.45:49404) 2023-07-09T02:15:05.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.714+0000 7f6b8ffff640 1 -- 172.21.15.45:0/3052517073 learned_addr learned my addr 172.21.15.45:0/3052517073 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:05.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b96ffd640 1 --2- 172.21.15.45:0/3052517073 >> v2:172.21.15.155:3300/0 conn(0x7f6b9806b120 0x7f6b9806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b977fe640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980b5830 0x7f6b980b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316789559 0 0) 0x7f6b980cd320 con 0x7f6b980d2400 2023-07-09T02:15:05.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b84003530 con 0x7f6b980d2400 2023-07-09T02:15:05.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084370441 0 0) 0x7f6b84003530 con 0x7f6b980d2400 2023-07-09T02:15:05.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980b5830 msgr2=0x7f6b980b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:05.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980b5830 0x7f6b980b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 >> v2:172.21.15.155:3300/0 conn(0x7f6b9806b120 msgr2=0x7f6b9806b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:05.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 --2- 172.21.15.45:0/3052517073 >> v2:172.21.15.155:3300/0 conn(0x7f6b9806b120 0x7f6b9806b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b980d0ea0 con 0x7f6b980d2400 2023-07-09T02:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f6b80001680 con 0x7f6b980d2400 2023-07-09T02:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 >> v1:172.21.15.45:6789/0 conn(0x7f6b980d2400 legacy=0x7f6b980cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980b5830 0x7f6b84003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84003f00 0x7f6b840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84004d10 0x7f6b84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b98071850 con 0x7f6b84004d10 2023-07-09T02:15:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9806ba30 con 0x7f6b84003f00 2023-07-09T02:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8400b990 con 0x7f6b980b5830 2023-07-09T02:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b977fe640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84004d10 0x7f6b84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b8ffff640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84003f00 0x7f6b840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b96ffd640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980b5830 0x7f6b84003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b977fe640 1 -- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980b5830 msgr2=0x7f6b84003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b977fe640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980b5830 0x7f6b84003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b977fe640 1 -- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84003f00 msgr2=0x7f6b840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:05.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b977fe640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84003f00 0x7f6b840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.718+0000 7f6b977fe640 1 -- 172.21.15.45:0/3052517073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b84003530 con 0x7f6b84004d10 2023-07-09T02:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b977fe640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84004d10 0x7f6b84005180 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009fc0 tx=0x7f6b9001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad218fd8387be99 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b900a5c70 con 0x7f6b84004d10 2023-07-09T02:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9000f040 con 0x7f6b84004d10 2023-07-09T02:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b967fc640 1 -- 172.21.15.45:0/3052517073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b900ad440 con 0x7f6b84004d10 2023-07-09T02:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/3052517073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84004d10 msgr2=0x7f6b84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:05.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 --2- 172.21.15.45:0/3052517073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b84004d10 0x7f6b84005180 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009fc0 tx=0x7f6b9001cc60 comp rx=0 tx=0).stop 2023-07-09T02:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b977fe640 1 -- 172.21.15.45:0/3052517073 reap_dead start 2023-07-09T02:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/3052517073 shutdown_connections 2023-07-09T02:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/3052517073 >> 172.21.15.45:0/3052517073 conn(0x7f6b980cf3d0 msgr2=0x7f6b980cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/3052517073 shutdown_connections 2023-07-09T02:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/3052517073 wait complete. 2023-07-09T02:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 Processor -- start 2023-07-09T02:15:05.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- start start 2023-07-09T02:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84004d10 0x7f6b9815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b981f2480 0x7f6b980cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980cc0a0 0x7f6b980a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980cc540 con 0x7f6b981f2480 2023-07-09T02:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9815a830 con 0x7f6b84004d10 2023-07-09T02:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b9d3ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9815dcf0 con 0x7f6b980cc0a0 2023-07-09T02:15:05.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.722+0000 7f6b8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b981f2480 0x7f6b980cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b981f2480 0x7f6b980cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55274/0 (socket says 172.21.15.45:55274) 2023-07-09T02:15:05.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8ffff640 1 -- 172.21.15.45:0/1594472337 learned_addr learned my addr 172.21.15.45:0/1594472337 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:05.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b977fe640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980cc0a0 0x7f6b980a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b96ffd640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84004d10 0x7f6b9815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8ffff640 1 -- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980cc0a0 msgr2=0x7f6b980a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:05.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8ffff640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980cc0a0 0x7f6b980a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8ffff640 1 -- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84004d10 msgr2=0x7f6b9815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:05.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8ffff640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84004d10 0x7f6b9815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8ffff640 1 -- 172.21.15.45:0/1594472337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9815df90 con 0x7f6b981f2480 2023-07-09T02:15:05.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8ffff640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b981f2480 0x7f6b980cbb60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6b80001cd0 tx=0x7f6b800076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:05.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8f7fe640 1 -- 172.21.15.45:0/1594472337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8000f9c0 con 0x7f6b981f2480 2023-07-09T02:15:05.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8f7fe640 1 -- 172.21.15.45:0/1594472337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8000fb60 con 0x7f6b981f2480 2023-07-09T02:15:05.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8f7fe640 1 -- 172.21.15.45:0/1594472337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800133f0 con 0x7f6b981f2480 2023-07-09T02:15:05.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9815e270 con 0x7f6b981f2480 2023-07-09T02:15:05.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b980aabe0 con 0x7f6b981f2480 2023-07-09T02:15:05.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b980d2270 con 0x7f6b981f2480 2023-07-09T02:15:05.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.726+0000 7f6b8f7fe640 1 -- 172.21.15.45:0/1594472337 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b80013550 con 0x7f6b981f2480 2023-07-09T02:15:05.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.730+0000 7f6b8f7fe640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b78066280 0x7f6b78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:05.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.730+0000 7f6b8f7fe640 1 -- 172.21.15.45:0/1594472337 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6b80083b30 con 0x7f6b981f2480 2023-07-09T02:15:05.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.730+0000 7f6b96ffd640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b78066280 0x7f6b78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:05.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.730+0000 7f6b96ffd640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b78066280 0x7f6b78068730 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b9815db10 tx=0x7f6b88009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:05.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.734+0000 7f6b8f7fe640 1 -- 172.21.15.45:0/1594472337 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b800512c0 con 0x7f6b981f2480 2023-07-09T02:15:05.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.886+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6b9804e020 con 0x7f6b981f2480 2023-07-09T02:15:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.890+0000 7f6b8f7fe640 1 -- 172.21.15.45:0/1594472337 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b800548e0 con 0x7f6b981f2480 2023-07-09T02:15:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b78066280 msgr2=0x7f6b78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b78066280 0x7f6b78068730 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b9815db10 tx=0x7f6b88009190 comp rx=0 tx=0).stop 2023-07-09T02:15:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b981f2480 msgr2=0x7f6b980cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b981f2480 0x7f6b980cbb60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6b80001cd0 tx=0x7f6b800076e0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 shutdown_connections 2023-07-09T02:15:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b78066280 0x7f6b78068730 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b980cc0a0 0x7f6b980a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b981f2480 0x7f6b980cbb60 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 --2- 172.21.15.45:0/1594472337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b84004d10 0x7f6b9815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 >> 172.21.15.45:0/1594472337 conn(0x7f6b980cf3d0 msgr2=0x7f6b980b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 shutdown_connections 2023-07-09T02:15:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:05.894+0000 7f6b9d3ac640 1 -- 172.21.15.45:0/1594472337 wait complete. 2023-07-09T02:15:05.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-07-09T02:15:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.054+0000 7ff97993a640 1 Processor -- start 2023-07-09T02:15:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.054+0000 7ff97993a640 1 -- start start 2023-07-09T02:15:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff97993a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9740d2620 0x7ff9740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff97993a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740cd120 0x7ff9740cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff97993a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff974160a50 con 0x7ff97415c060 2023-07-09T02:15:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff97993a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97415c430 con 0x7ff9740d2620 2023-07-09T02:15:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff97993a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97415fb60 con 0x7ff9740cd120 2023-07-09T02:15:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff96bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9740d2620 0x7ff9740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff96bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9740d2620 0x7ff9740b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55282/0 (socket says 172.21.15.45:55282) 2023-07-09T02:15:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff96bfff640 1 -- 172.21.15.45:0/2240934313 learned_addr learned my addr 172.21.15.45:0/2240934313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff9737fe640 1 --2- 172.21.15.45:0/2240934313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740cd120 0x7ff9740cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff96bfff640 1 -- 172.21.15.45:0/2240934313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740cd120 msgr2=0x7ff9740cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff96bfff640 1 --2- 172.21.15.45:0/2240934313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740cd120 0x7ff9740cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff96bfff640 1 -- 172.21.15.45:0/2240934313 >> v1:172.21.15.155:6789/0 conn(0x7ff97415c060 legacy=0x7ff9740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.058+0000 7ff96bfff640 1 -- 172.21.15.45:0/2240934313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97415fe40 con 0x7ff9740d2620 2023-07-09T02:15:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff96bfff640 1 --2- 172.21.15.45:0/2240934313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740d2620 0x7ff9740b4ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009870 tx=0x7ff95c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8c4dc10c5baf81 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff9727fc640 1 -- 172.21.15.45:0/2240934313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0aa670 con 0x7ff9740d2620 2023-07-09T02:15:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff9727fc640 1 -- 172.21.15.45:0/2240934313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c0aa7d0 con 0x7ff9740d2620 2023-07-09T02:15:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff9727fc640 1 -- 172.21.15.45:0/2240934313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0aab60 con 0x7ff9740d2620 2023-07-09T02:15:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 -- 172.21.15.45:0/2240934313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740d2620 msgr2=0x7ff9740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 --2- 172.21.15.45:0/2240934313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740d2620 0x7ff9740b4ed0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009870 tx=0x7ff95c01c510 comp rx=0 tx=0).stop 2023-07-09T02:15:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 -- 172.21.15.45:0/2240934313 shutdown_connections 2023-07-09T02:15:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 --2- 172.21.15.45:0/2240934313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740cd120 0x7ff9740cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 --2- 172.21.15.45:0/2240934313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740d2620 0x7ff9740b4ed0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 -- 172.21.15.45:0/2240934313 >> 172.21.15.45:0/2240934313 conn(0x7ff9740698e0 msgr2=0x7ff974069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 -- 172.21.15.45:0/2240934313 shutdown_connections 2023-07-09T02:15:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 -- 172.21.15.45:0/2240934313 wait complete. 2023-07-09T02:15:06.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 Processor -- start 2023-07-09T02:15:06.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.062+0000 7ff97993a640 1 -- start start 2023-07-09T02:15:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740cd120 0x7ff97415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d2620 0x7ff9740c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97415c060 0x7ff974156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97415ec00 con 0x7ff9740cd120 2023-07-09T02:15:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97415b220 con 0x7ff9740d2620 2023-07-09T02:15:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97415e5b0 con 0x7ff97415c060 2023-07-09T02:15:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740cd120 0x7ff97415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740cd120 0x7ff97415ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55290/0 (socket says 172.21.15.45:55290) 2023-07-09T02:15:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 -- 172.21.15.45:0/3384056872 learned_addr learned my addr 172.21.15.45:0/3384056872 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:06.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff9737fe640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97415c060 0x7ff974156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff96bfff640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d2620 0x7ff9740c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 -- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97415c060 msgr2=0x7ff974156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97415c060 0x7ff974156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 -- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d2620 msgr2=0x7ff9740c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d2620 0x7ff9740c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 -- 172.21.15.45:0/3384056872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c0094d0 con 0x7ff9740cd120 2023-07-09T02:15:06.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff972ffd640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740cd120 0x7ff97415ac40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c500 tx=0x7ff96400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:06.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff970ff9640 1 -- 172.21.15.45:0/3384056872 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964005220 con 0x7ff9740cd120 2023-07-09T02:15:06.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff970ff9640 1 -- 172.21.15.45:0/3384056872 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964005380 con 0x7ff9740cd120 2023-07-09T02:15:06.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff970ff9640 1 -- 172.21.15.45:0/3384056872 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964007270 con 0x7ff9740cd120 2023-07-09T02:15:06.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9740b59f0 con 0x7ff9740cd120 2023-07-09T02:15:06.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9740c9500 con 0x7ff9740cd120 2023-07-09T02:15:06.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97404d7d0 con 0x7ff9740cd120 2023-07-09T02:15:06.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.066+0000 7ff970ff9640 1 -- 172.21.15.45:0/3384056872 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9640073d0 con 0x7ff9740cd120 2023-07-09T02:15:06.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.070+0000 7ff970ff9640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff954066280 0x7ff954068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.070+0000 7ff970ff9640 1 -- 172.21.15.45:0/3384056872 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff9640831c0 con 0x7ff9740cd120 2023-07-09T02:15:06.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.070+0000 7ff96bfff640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff954066280 0x7ff954068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.070+0000 7ff96bfff640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff954066280 0x7ff954068730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0ae000 tx=0x7ff95c0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:06.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.074+0000 7ff970ff9640 1 -- 172.21.15.45:0/3384056872 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff964050a00 con 0x7ff9740cd120 2023-07-09T02:15:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.290+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7ff97406baa0 con 0x7ff9740cd120 2023-07-09T02:15:06.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff970ff9640 1 -- 172.21.15.45:0/3384056872 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v217) v1 ==== 134+0+0 (secure 0 0 0) 0x7ff964054020 con 0x7ff9740cd120 2023-07-09T02:15:06.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff954066280 msgr2=0x7ff954068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff954066280 0x7ff954068730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0ae000 tx=0x7ff95c0b5040 comp rx=0 tx=0).stop 2023-07-09T02:15:06.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740cd120 msgr2=0x7ff97415ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740cd120 0x7ff97415ac40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c500 tx=0x7ff96400c9c0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 shutdown_connections 2023-07-09T02:15:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff954066280 0x7ff954068730 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97415c060 0x7ff974156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d2620 0x7ff9740c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 --2- 172.21.15.45:0/3384056872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9740cd120 0x7ff97415ac40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 >> 172.21.15.45:0/3384056872 conn(0x7ff9740698e0 msgr2=0x7ff9740d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:06.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 shutdown_connections 2023-07-09T02:15:06.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.546+0000 7ff97993a640 1 -- 172.21.15.45:0/3384056872 wait complete. 2023-07-09T02:15:06.570 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-07-09T02:15:06.571 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-07-09T02:15:06.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-07-09T02:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.714+0000 7ff19ffac640 1 Processor -- start 2023-07-09T02:15:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.714+0000 7ff19ffac640 1 -- start start 2023-07-09T02:15:06.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19ffac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1980ca0f0 0x7ff1980cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19ffac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff19815db00 0x7ff19815df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19ffac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19806bf30 con 0x7ff1980cbbb0 2023-07-09T02:15:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19ffac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19815e480 con 0x7ff1980ca0f0 2023-07-09T02:15:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19ffac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19806bc50 con 0x7ff19815db00 2023-07-09T02:15:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19dd48640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1980ca0f0 0x7ff1980cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19d547640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1980cbbb0 0x7ff1980c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49408/0 (socket says 172.21.15.45:49408) 2023-07-09T02:15:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19d547640 1 -- 172.21.15.45:0/28869005 learned_addr learned my addr 172.21.15.45:0/28869005 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19e549640 1 --2- 172.21.15.45:0/28869005 >> v2:172.21.15.155:3300/0 conn(0x7ff19815db00 0x7ff19815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19dd48640 1 -- 172.21.15.45:0/28869005 >> v2:172.21.15.155:3300/0 conn(0x7ff19815db00 msgr2=0x7ff19815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19dd48640 1 --2- 172.21.15.45:0/28869005 >> v2:172.21.15.155:3300/0 conn(0x7ff19815db00 0x7ff19815df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19dd48640 1 -- 172.21.15.45:0/28869005 >> v1:172.21.15.45:6789/0 conn(0x7ff1980cbbb0 legacy=0x7ff1980c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19dd48640 1 -- 172.21.15.45:0/28869005 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980cab90 con 0x7ff1980ca0f0 2023-07-09T02:15:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.718+0000 7ff19cd46640 1 -- 172.21.15.45:0/28869005 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688152929 0 0) 0x7ff19806bf30 con 0x7ff1980cbbb0 2023-07-09T02:15:06.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19dd48640 1 --2- 172.21.15.45:0/28869005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff1980cb670 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff19806eec0 tx=0x7ff19401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83679ce00175fe0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:06.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19cd46640 1 -- 172.21.15.45:0/28869005 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1940ab600 con 0x7ff1980ca0f0 2023-07-09T02:15:06.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19cd46640 1 -- 172.21.15.45:0/28869005 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1940a7050 con 0x7ff1980ca0f0 2023-07-09T02:15:06.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19cd46640 1 -- 172.21.15.45:0/28869005 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1940ab980 con 0x7ff1980ca0f0 2023-07-09T02:15:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- 172.21.15.45:0/28869005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 msgr2=0x7ff1980cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 --2- 172.21.15.45:0/28869005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff1980cb670 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff19806eec0 tx=0x7ff19401c3d0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- 172.21.15.45:0/28869005 shutdown_connections 2023-07-09T02:15:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 --2- 172.21.15.45:0/28869005 >> v2:172.21.15.155:3300/0 conn(0x7ff19815db00 0x7ff19815df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 --2- 172.21.15.45:0/28869005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff1980cb670 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- 172.21.15.45:0/28869005 >> 172.21.15.45:0/28869005 conn(0x7ff1980694b0 msgr2=0x7ff1980698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:06.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- 172.21.15.45:0/28869005 shutdown_connections 2023-07-09T02:15:06.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- 172.21.15.45:0/28869005 wait complete. 2023-07-09T02:15:06.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 Processor -- start 2023-07-09T02:15:06.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- start start 2023-07-09T02:15:06.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff19814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1980cbbb0 0x7ff1980c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff19815db00 0x7ff19814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980b1d40 con 0x7ff1980ca0f0 2023-07-09T02:15:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19814ad00 con 0x7ff19815db00 2023-07-09T02:15:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.722+0000 7ff19ffac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff198149e30 con 0x7ff1980cbbb0 2023-07-09T02:15:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff19814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff19814cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55316/0 (socket says 172.21.15.45:55316) 2023-07-09T02:15:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 -- 172.21.15.45:0/528282091 learned_addr learned my addr 172.21.15.45:0/528282091 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19d547640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1980cbbb0 0x7ff1980c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19e549640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff19815db00 0x7ff19814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 -- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1980cbbb0 msgr2=0x7ff1980c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1980cbbb0 0x7ff1980c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 -- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff19815db00 msgr2=0x7ff19814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff19815db00 0x7ff19814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 -- 172.21.15.45:0/528282091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194009420 con 0x7ff1980ca0f0 2023-07-09T02:15:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19dd48640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff19814cff0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff1940ae040 tx=0x7ff19401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff18e7fc640 1 -- 172.21.15.45:0/528282091 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1940abe90 con 0x7ff1980ca0f0 2023-07-09T02:15:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff18e7fc640 1 -- 172.21.15.45:0/528282091 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1940b7450 con 0x7ff1980ca0f0 2023-07-09T02:15:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff18e7fc640 1 -- 172.21.15.45:0/528282091 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1940b7820 con 0x7ff1980ca0f0 2023-07-09T02:15:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19814a3e0 con 0x7ff1980ca0f0 2023-07-09T02:15:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1980b1a60 con 0x7ff1980ca0f0 2023-07-09T02:15:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19814a730 con 0x7ff1980ca0f0 2023-07-09T02:15:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.726+0000 7ff18e7fc640 1 -- 172.21.15.45:0/528282091 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1940b7980 con 0x7ff1980ca0f0 2023-07-09T02:15:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.730+0000 7ff18e7fc640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff17c066280 0x7ff17c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.730+0000 7ff18e7fc640 1 -- 172.21.15.45:0/528282091 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff19411e200 con 0x7ff1980ca0f0 2023-07-09T02:15:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.730+0000 7ff19d547640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff17c066280 0x7ff17c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:06.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.730+0000 7ff19d547640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff17c066280 0x7ff17c068730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff1981f6200 tx=0x7ff188007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:06.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.734+0000 7ff18e7fc640 1 -- 172.21.15.45:0/528282091 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1940eb900 con 0x7ff1980ca0f0 2023-07-09T02:15:06.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:06.950+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7ff19804d7d0 con 0x7ff1980ca0f0 2023-07-09T02:15:07.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.550+0000 7ff18e7fc640 1 -- 172.21.15.45:0/528282091 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v218) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff1940eef20 con 0x7ff1980ca0f0 2023-07-09T02:15:07.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff17c066280 msgr2=0x7ff17c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:07.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff17c066280 0x7ff17c068730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff1981f6200 tx=0x7ff188007b60 comp rx=0 tx=0).stop 2023-07-09T02:15:07.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 msgr2=0x7ff19814cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:07.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff19814cff0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff1940ae040 tx=0x7ff19401ac10 comp rx=0 tx=0).stop 2023-07-09T02:15:07.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 shutdown_connections 2023-07-09T02:15:07.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff19815db00 0x7ff19814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff17c066280 0x7ff17c068730 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1980cbbb0 0x7ff1980c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 --2- 172.21.15.45:0/528282091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1980ca0f0 0x7ff19814cff0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 >> 172.21.15.45:0/528282091 conn(0x7ff1980694b0 msgr2=0x7ff19815b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:07.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 shutdown_connections 2023-07-09T02:15:07.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.554+0000 7ff19ffac640 1 -- 172.21.15.45:0/528282091 wait complete. 2023-07-09T02:15:07.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-07-09T02:15:07.738 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_objectstore":"memstore"} 2023-07-09T02:15:07.739 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-07-09T02:15:07.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:15:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f1d234640 1 Processor -- start 2023-07-09T02:15:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f1d234640 1 -- start start 2023-07-09T02:15:07.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f1d234640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f1815c060 0x7f5f180b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:07.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f1d234640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 0x7f5f180d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:07.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f1d234640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f18160a50 con 0x7f5f180d2450 2023-07-09T02:15:07.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f1d234640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180d28f0 con 0x7f5f1815c060 2023-07-09T02:15:07.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f1d234640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180cfe40 con 0x7f5f180cd120 2023-07-09T02:15:07.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f16d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f1815c060 0x7f5f180b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:07.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f16d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f1815c060 0x7f5f180b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55326/0 (socket says 172.21.15.45:55326) 2023-07-09T02:15:07.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f16d9d640 1 -- 172.21.15.45:0/4085268024 learned_addr learned my addr 172.21.15.45:0/4085268024 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:07.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f1659c640 1 --2- 172.21.15.45:0/4085268024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 0x7f5f180d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:07.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f16d9d640 1 -- 172.21.15.45:0/4085268024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 msgr2=0x7f5f180d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:07.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f16d9d640 1 --2- 172.21.15.45:0/4085268024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 0x7f5f180d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f16d9d640 1 -- 172.21.15.45:0/4085268024 >> v1:172.21.15.155:6789/0 conn(0x7f5f180d2450 legacy=0x7f5f180d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:07.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.886+0000 7f5f16d9d640 1 -- 172.21.15.45:0/4085268024 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1815c430 con 0x7f5f1815c060 2023-07-09T02:15:07.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f16d9d640 1 --2- 172.21.15.45:0/4085268024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b4ed0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009870 tx=0x7f5f0801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27e248ec52ed4ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:07.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f15d9b640 1 -- 172.21.15.45:0/4085268024 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080a7070 con 0x7f5f1815c060 2023-07-09T02:15:07.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f15d9b640 1 -- 172.21.15.45:0/4085268024 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f080ab430 con 0x7f5f1815c060 2023-07-09T02:15:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f15d9b640 1 -- 172.21.15.45:0/4085268024 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080ab7c0 con 0x7f5f1815c060 2023-07-09T02:15:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f1d234640 1 -- 172.21.15.45:0/4085268024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 msgr2=0x7f5f180b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f1d234640 1 --2- 172.21.15.45:0/4085268024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b4ed0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009870 tx=0x7f5f0801c510 comp rx=0 tx=0).stop 2023-07-09T02:15:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f1d234640 1 -- 172.21.15.45:0/4085268024 shutdown_connections 2023-07-09T02:15:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f1d234640 1 --2- 172.21.15.45:0/4085268024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 0x7f5f180d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f1d234640 1 --2- 172.21.15.45:0/4085268024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b4ed0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f1d234640 1 -- 172.21.15.45:0/4085268024 >> 172.21.15.45:0/4085268024 conn(0x7f5f180698e0 msgr2=0x7f5f18069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f1d234640 1 -- 172.21.15.45:0/4085268024 shutdown_connections 2023-07-09T02:15:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.890+0000 7f5f1d234640 1 -- 172.21.15.45:0/4085268024 wait complete. 2023-07-09T02:15:07.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 Processor -- start 2023-07-09T02:15:07.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 -- start start 2023-07-09T02:15:07.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 0x7f5f180cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:07.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f180d2450 0x7f5f181f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:07.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:07.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180c9eb0 con 0x7f5f1815c060 2023-07-09T02:15:07.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180c9bb0 con 0x7f5f180d2450 2023-07-09T02:15:07.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181f8100 con 0x7f5f180cd120 2023-07-09T02:15:07.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:07.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55332/0 (socket says 172.21.15.45:55332) 2023-07-09T02:15:07.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 -- 172.21.15.45:0/2707484622 learned_addr learned my addr 172.21.15.45:0/2707484622 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:07.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1659c640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f180d2450 0x7f5f181f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:07.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f16d9d640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 0x7f5f180cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:07.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 -- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 msgr2=0x7f5f180cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:07.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 0x7f5f180cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 -- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f180d2450 msgr2=0x7f5f181f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:07.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f180d2450 0x7f5f181f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:07.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 -- 172.21.15.45:0/2707484622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080094d0 con 0x7f5f1815c060 2023-07-09T02:15:07.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1759e640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b2460 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c770 tx=0x7f5f1000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:07.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5eff7fe640 1 -- 172.21.15.45:0/2707484622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10003b80 con 0x7f5f1815c060 2023-07-09T02:15:07.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5eff7fe640 1 -- 172.21.15.45:0/2707484622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10003ce0 con 0x7f5f1815c060 2023-07-09T02:15:07.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5eff7fe640 1 -- 172.21.15.45:0/2707484622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000aa90 con 0x7f5f1815c060 2023-07-09T02:15:07.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f181f83e0 con 0x7f5f1815c060 2023-07-09T02:15:07.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.894+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f181f86c0 con 0x7f5f1815c060 2023-07-09T02:15:07.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.898+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f180ca020 con 0x7f5f1815c060 2023-07-09T02:15:07.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.898+0000 7f5eff7fe640 1 -- 172.21.15.45:0/2707484622 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f1000abf0 con 0x7f5f1815c060 2023-07-09T02:15:07.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.898+0000 7f5eff7fe640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f04066280 0x7f5f04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:07.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.898+0000 7f5eff7fe640 1 -- 172.21.15.45:0/2707484622 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5f100837a0 con 0x7f5f1815c060 2023-07-09T02:15:07.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.898+0000 7f5f16d9d640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f04066280 0x7f5f04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:07.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.898+0000 7f5f16d9d640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f04066280 0x7f5f04068730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f080af000 tx=0x7f5f08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:07.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:07.902+0000 7f5eff7fe640 1 -- 172.21.15.45:0/2707484622 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f10050f50 con 0x7f5f1815c060 2023-07-09T02:15:08.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.054+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5f1804d7d0 con 0x7f5f1815c060 2023-07-09T02:15:08.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5eff7fe640 1 -- 172.21.15.45:0/2707484622 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5f10054570 con 0x7f5f1815c060 2023-07-09T02:15:08.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f04066280 msgr2=0x7f5f04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f04066280 0x7f5f04068730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f080af000 tx=0x7f5f08008040 comp rx=0 tx=0).stop 2023-07-09T02:15:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 msgr2=0x7f5f180b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b2460 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c770 tx=0x7f5f1000cc30 comp rx=0 tx=0).stop 2023-07-09T02:15:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 shutdown_connections 2023-07-09T02:15:08.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f1815c060 0x7f5f180b2460 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f180d2450 0x7f5f181f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f04066280 0x7f5f04068730 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 --2- 172.21.15.45:0/2707484622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f180cd120 0x7f5f180cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 >> 172.21.15.45:0/2707484622 conn(0x7f5f180698e0 msgr2=0x7f5f180b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:08.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 shutdown_connections 2023-07-09T02:15:08.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.062+0000 7f5f1d234640 1 -- 172.21.15.45:0/2707484622 wait complete. 2023-07-09T02:15:08.082 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:15:08.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:15:08.151 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:15:08.207 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:15:08.208 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:15:08.209 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:08.219 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:15:08.219 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:15:08.220 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:08.230 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:15:08.230 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:15:08.231 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:08.273 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:15:08.273 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:15:08.274 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:08.285 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:15:08.286 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:15:08.286 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:15:08.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f83715a9640 1 Processor -- start 2023-07-09T02:15:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f83715a9640 1 -- start start 2023-07-09T02:15:08.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f83715a9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f836c06b240 0x7f836c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f83715a9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0b2090 con 0x7f836c0d0d70 2023-07-09T02:15:08.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f83715a9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c160520 con 0x7f836c15c870 2023-07-09T02:15:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f83715a9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c06bc00 con 0x7f836c06b240 2023-07-09T02:15:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f8370da8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f836c0d0d70 0x7f836c0d11b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49418/0 (socket says 172.21.15.45:49418) 2023-07-09T02:15:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f8370da8640 1 -- 172.21.15.45:0/933207627 learned_addr learned my addr 172.21.15.45:0/933207627 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836b7fe640 1 --2- 172.21.15.45:0/933207627 >> v2:172.21.15.155:3300/0 conn(0x7f836c06b240 0x7f836c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976437303 0 0) 0x7f836c0b2090 con 0x7f836c0d0d70 2023-07-09T02:15:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8354003530 con 0x7f836c0d0d70 2023-07-09T02:15:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417348433 0 0) 0x7f836c160520 con 0x7f836c15c870 2023-07-09T02:15:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f836c0b2090 con 0x7f836c15c870 2023-07-09T02:15:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1142396934 0 0) 0x7f8354003530 con 0x7f836c0d0d70 2023-07-09T02:15:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 >> v2:172.21.15.155:3300/0 conn(0x7f836c06b240 msgr2=0x7f836c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 --2- 172.21.15.45:0/933207627 >> v2:172.21.15.155:3300/0 conn(0x7f836c06b240 0x7f836c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 >> v1:172.21.15.155:6789/0 conn(0x7f836c15c870 legacy=0x7f836c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c160800 con 0x7f836c0d0d70 2023-07-09T02:15:08.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f8364001a00 con 0x7f836c0d0d70 2023-07-09T02:15:08.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 >> v1:172.21.15.45:6789/0 conn(0x7f836c0d0d70 legacy=0x7f836c0d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8354003b10 0x7f8354003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83540047d0 0x7f8354004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8354005180 0x7f835400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c06bc00 con 0x7f8354005180 2023-07-09T02:15:08.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835400bfe0 con 0x7f8354003b10 2023-07-09T02:15:08.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835400c1a0 con 0x7f83540047d0 2023-07-09T02:15:08.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836bfff640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8354003b10 0x7f8354003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f8370da8640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8354005180 0x7f835400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836b7fe640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83540047d0 0x7f8354004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836bfff640 1 -- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83540047d0 msgr2=0x7f8354004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:08.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836bfff640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83540047d0 0x7f8354004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836bfff640 1 -- 172.21.15.45:0/933207627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8354005180 msgr2=0x7f835400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:08.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836bfff640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8354005180 0x7f835400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836bfff640 1 -- 172.21.15.45:0/933207627 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354003530 con 0x7f8354003b10 2023-07-09T02:15:08.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f836b7fe640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83540047d0 0x7f8354004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:15:08.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f8370da8640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8354005180 0x7f835400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:15:08.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.466+0000 7f8370da8640 1 -- 172.21.15.45:0/933207627 reap_dead start 2023-07-09T02:15:08.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f836bfff640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8354003b10 0x7f8354003f00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f835c0018d0 tx=0x7f835c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69b6cccb19a4c85c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:08.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0052d0 con 0x7f8354003b10 2023-07-09T02:15:08.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0a8050 con 0x7f8354003b10 2023-07-09T02:15:08.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f836affd640 1 -- 172.21.15.45:0/933207627 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c003600 con 0x7f8354003b10 2023-07-09T02:15:08.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f83715a9640 1 -- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8354003b10 msgr2=0x7f8354003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f83715a9640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8354003b10 0x7f8354003f00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f835c0018d0 tx=0x7f835c01c540 comp rx=0 tx=0).stop 2023-07-09T02:15:08.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f83715a9640 1 -- 172.21.15.45:0/933207627 shutdown_connections 2023-07-09T02:15:08.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f83715a9640 1 --2- 172.21.15.45:0/933207627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8354003b10 0x7f8354003f00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f83715a9640 1 -- 172.21.15.45:0/933207627 >> 172.21.15.45:0/933207627 conn(0x7f836c070be0 msgr2=0x7f836c070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:08.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f83715a9640 1 -- 172.21.15.45:0/933207627 shutdown_connections 2023-07-09T02:15:08.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.470+0000 7f83715a9640 1 -- 172.21.15.45:0/933207627 wait complete. 2023-07-09T02:15:08.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 Processor -- start 2023-07-09T02:15:08.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 -- start start 2023-07-09T02:15:08.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8354003b10 0x7f836c0d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f836c0ca6b0 0x7f836c0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f836c0cab20 0x7f836c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c98c0 con 0x7f836c0ca6b0 2023-07-09T02:15:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c15b8d0 con 0x7f836c0cab20 2023-07-09T02:15:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c9bd0 con 0x7f8354003b10 2023-07-09T02:15:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f836c0ca6b0 0x7f836c0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f836c0ca6b0 0x7f836c0cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55352/0 (socket says 172.21.15.45:55352) 2023-07-09T02:15:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 -- 172.21.15.45:0/2401196328 learned_addr learned my addr 172.21.15.45:0/2401196328 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f8370da8640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f836c0cab20 0x7f836c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836bfff640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8354003b10 0x7f836c0d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 -- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8354003b10 msgr2=0x7f836c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8354003b10 0x7f836c0d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 -- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f836c0cab20 msgr2=0x7f836c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f836c0cab20 0x7f836c0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 -- 172.21.15.45:0/2401196328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0c9eb0 con 0x7f836c0ca6b0 2023-07-09T02:15:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836bfff640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8354003b10 0x7f836c0d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f8370da8640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f836c0cab20 0x7f836c0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f836b7fe640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f836c0ca6b0 0x7f836c0cb5d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8360011bd0 tx=0x7f8360011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:08.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f8368ff9640 1 -- 172.21.15.45:0/2401196328 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360004020 con 0x7f836c0ca6b0 2023-07-09T02:15:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f8368ff9640 1 -- 172.21.15.45:0/2401196328 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360004180 con 0x7f836c0ca6b0 2023-07-09T02:15:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c0ca190 con 0x7f836c0ca6b0 2023-07-09T02:15:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.474+0000 7f8368ff9640 1 -- 172.21.15.45:0/2401196328 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360004510 con 0x7f836c0ca6b0 2023-07-09T02:15:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.478+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0d1ae0 con 0x7f836c0ca6b0 2023-07-09T02:15:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.478+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c0c9a10 con 0x7f836c0ca6b0 2023-07-09T02:15:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.478+0000 7f8368ff9640 1 -- 172.21.15.45:0/2401196328 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f836000f820 con 0x7f836c0ca6b0 2023-07-09T02:15:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.478+0000 7f8368ff9640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83580662b0 0x7f8358068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.478+0000 7f8368ff9640 1 -- 172.21.15.45:0/2401196328 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8360083c00 con 0x7f836c0ca6b0 2023-07-09T02:15:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.478+0000 7f836bfff640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83580662b0 0x7f8358068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.478+0000 7f836bfff640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83580662b0 0x7f8358068760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f835c0ad000 tx=0x7f835c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.482+0000 7f8368ff9640 1 -- 172.21.15.45:0/2401196328 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8360054da0 con 0x7f836c0ca6b0 2023-07-09T02:15:08.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f836c04e020 con 0x7f836c0ca6b0 2023-07-09T02:15:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f8368ff9640 1 -- 172.21.15.45:0/2401196328 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f8360022090 con 0x7f836c0ca6b0 2023-07-09T02:15:08.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:08.671 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2676442896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2676442896},{"type":"v1","addr":"172.21.15.155:6837","nonce":2676442896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/193698688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":193698688},{"type":"v1","addr":"172.21.15.155:6836","nonce":193698688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1939767585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1939767585},{"type":"v1","addr":"172.21.15.45:6834","nonce":1939767585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1396776302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1396776302},{"type":"v1","addr":"172.21.15.45:6835","nonce":1396776302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-07-09T02:15:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-07-09T02:15:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83580662b0 msgr2=0x7f8358068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83580662b0 0x7f8358068760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f835c0ad000 tx=0x7f835c009040 comp rx=0 tx=0).stop 2023-07-09T02:15:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f836c0ca6b0 msgr2=0x7f836c0cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f836c0ca6b0 0x7f836c0cb5d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8360011bd0 tx=0x7f8360011cc0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 shutdown_connections 2023-07-09T02:15:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f836c0cab20 0x7f836c0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f836c0ca6b0 0x7f836c0cb5d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83580662b0 0x7f8358068760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 --2- 172.21.15.45:0/2401196328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8354003b10 0x7f836c0d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 >> 172.21.15.45:0/2401196328 conn(0x7f836c070be0 msgr2=0x7f836c15f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 shutdown_connections 2023-07-09T02:15:08.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.670+0000 7f83715a9640 1 -- 172.21.15.45:0/2401196328 wait complete. 2023-07-09T02:15:08.692 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:15:08.692 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:15:08.693 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:15:08.693 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:15:08.693 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:15:08.694 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:15:08.694 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:15:08.694 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:15:08.695 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:15:08.695 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:15:08.695 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:15:08.696 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:15:08.696 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:15:08.696 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:15:08.697 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:15:08.697 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:15:08.705 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:15:08.706 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:15:08.707 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:15:08.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:15:08.710 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:15:08.710 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:15:08.711 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:15:08.711 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:15:08.751 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:15:08.751 DEBUG:teuthology.parallel:result is None 2023-07-09T02:15:08.753 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:15:08.754 DEBUG:teuthology.parallel:result is None 2023-07-09T02:15:08.755 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:15:08.755 DEBUG:teuthology.parallel:result is None 2023-07-09T02:15:08.757 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:15:08.757 DEBUG:teuthology.parallel:result is None 2023-07-09T02:15:08.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:15:08.840 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:15:08.843 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:15:08.848 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:15:08.848 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:15:08.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.906+0000 7fea26f9f640 1 Processor -- start 2023-07-09T02:15:08.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.906+0000 7fea26f9f640 1 -- start start 2023-07-09T02:15:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea26f9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea2015c060 0x7fea200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea26f9f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea200d2620 0x7fea200cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea26f9f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea20160a50 con 0x7fea200cd120 2023-07-09T02:15:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea26f9f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2015c430 con 0x7fea200d2620 2023-07-09T02:15:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea26f9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2015fb60 con 0x7fea2015c060 2023-07-09T02:15:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea2553c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea200d2620 0x7fea200cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea2553c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea200d2620 0x7fea200cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55380/0 (socket says 172.21.15.45:55380) 2023-07-09T02:15:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea2553c640 1 -- 172.21.15.45:0/2433022007 learned_addr learned my addr 172.21.15.45:0/2433022007 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea24d3b640 1 --2- 172.21.15.45:0/2433022007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea2015c060 0x7fea200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea2553c640 1 -- 172.21.15.45:0/2433022007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea2015c060 msgr2=0x7fea200b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea2553c640 1 --2- 172.21.15.45:0/2433022007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea2015c060 0x7fea200b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea2553c640 1 -- 172.21.15.45:0/2433022007 >> v1:172.21.15.155:6789/0 conn(0x7fea200cd120 legacy=0x7fea200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea2553c640 1 -- 172.21.15.45:0/2433022007 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2015fe40 con 0x7fea200d2620 2023-07-09T02:15:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.910+0000 7fea2553c640 1 --2- 172.21.15.45:0/2433022007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cee30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fea18009e80 tx=0x7fea1801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e719e9d910324f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea1f7fe640 1 -- 172.21.15.45:0/2433022007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180a5880 con 0x7fea200d2620 2023-07-09T02:15:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea1f7fe640 1 -- 172.21.15.45:0/2433022007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea180a59e0 con 0x7fea200d2620 2023-07-09T02:15:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea1f7fe640 1 -- 172.21.15.45:0/2433022007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180a5d70 con 0x7fea200d2620 2023-07-09T02:15:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- 172.21.15.45:0/2433022007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 msgr2=0x7fea200cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 --2- 172.21.15.45:0/2433022007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cee30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fea18009e80 tx=0x7fea1801c9c0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- 172.21.15.45:0/2433022007 shutdown_connections 2023-07-09T02:15:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 --2- 172.21.15.45:0/2433022007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cee30 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 --2- 172.21.15.45:0/2433022007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea2015c060 0x7fea200b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- 172.21.15.45:0/2433022007 >> 172.21.15.45:0/2433022007 conn(0x7fea200698e0 msgr2=0x7fea20069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- 172.21.15.45:0/2433022007 shutdown_connections 2023-07-09T02:15:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- 172.21.15.45:0/2433022007 wait complete. 2023-07-09T02:15:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 Processor -- start 2023-07-09T02:15:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- start start 2023-07-09T02:15:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea200cd120 0x7fea20151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea2015c060 0x7fea200b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20153d50 con 0x7fea200d2620 2023-07-09T02:15:08.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea201528e0 con 0x7fea2015c060 2023-07-09T02:15:08.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.914+0000 7fea26f9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea20152bc0 con 0x7fea200cd120 2023-07-09T02:15:08.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55396/0 (socket says 172.21.15.45:55396) 2023-07-09T02:15:08.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 -- 172.21.15.45:0/371002621 learned_addr learned my addr 172.21.15.45:0/371002621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:08.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea2553c640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea2015c060 0x7fea200b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea24d3b640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea200cd120 0x7fea20151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 -- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea200cd120 msgr2=0x7fea20151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea200cd120 0x7fea20151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 -- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea2015c060 msgr2=0x7fea200b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:08.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea2015c060 0x7fea200b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:08.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 -- 172.21.15.45:0/371002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18009b30 con 0x7fea200d2620 2023-07-09T02:15:08.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1ffff640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cc8e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c4d0 tx=0x7fea0c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:08.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1d7fa640 1 -- 172.21.15.45:0/371002621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0052d0 con 0x7fea200d2620 2023-07-09T02:15:08.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1d7fa640 1 -- 172.21.15.45:0/371002621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c005430 con 0x7fea200d2620 2023-07-09T02:15:08.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1d7fa640 1 -- 172.21.15.45:0/371002621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c012830 con 0x7fea200d2620 2023-07-09T02:15:08.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea200b59f0 con 0x7fea200d2620 2023-07-09T02:15:08.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea20153180 con 0x7fea200d2620 2023-07-09T02:15:08.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea200cf170 con 0x7fea200d2620 2023-07-09T02:15:08.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1d7fa640 1 -- 172.21.15.45:0/371002621 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea0c012990 con 0x7fea200d2620 2023-07-09T02:15:08.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1d7fa640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea04066280 0x7fea04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:08.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.918+0000 7fea1d7fa640 1 -- 172.21.15.45:0/371002621 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fea0c083480 con 0x7fea200d2620 2023-07-09T02:15:08.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.922+0000 7fea24d3b640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea04066280 0x7fea04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:08.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.922+0000 7fea24d3b640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea04066280 0x7fea04068730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fea14009ac0 tx=0x7fea14009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:08.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:08.922+0000 7fea1d7fa640 1 -- 172.21.15.45:0/371002621 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea0c050c30 con 0x7fea200d2620 2023-07-09T02:15:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:09.090+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fea2004d7d0 con 0x7fea200d2620 2023-07-09T02:15:10.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea1d7fa640 1 -- 172.21.15.45:0/371002621 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7fea0c054250 con 0x7fea200d2620 2023-07-09T02:15:10.357 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:15:10.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea04066280 msgr2=0x7fea04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea04066280 0x7fea04068730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fea14009ac0 tx=0x7fea14009190 comp rx=0 tx=0).stop 2023-07-09T02:15:10.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 msgr2=0x7fea200cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cc8e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c4d0 tx=0x7fea0c00c990 comp rx=0 tx=0).stop 2023-07-09T02:15:10.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 shutdown_connections 2023-07-09T02:15:10.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea2015c060 0x7fea200b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea200d2620 0x7fea200cc8e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea04066280 0x7fea04068730 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 --2- 172.21.15.45:0/371002621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea200cd120 0x7fea20151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 >> 172.21.15.45:0/371002621 conn(0x7fea200698e0 msgr2=0x7fea200b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:10.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 shutdown_connections 2023-07-09T02:15:10.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.358+0000 7fea26f9f640 1 -- 172.21.15.45:0/371002621 wait complete. 2023-07-09T02:15:10.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:15:10.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.530+0000 7fe0fbd1f640 1 Processor -- start 2023-07-09T02:15:10.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.530+0000 7fe0fbd1f640 1 -- start start 2023-07-09T02:15:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0fbd1f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f415c060 0x7fe0f40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0fbd1f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f4160a50 con 0x7fe0f40cd120 2023-07-09T02:15:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0fbd1f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f415c430 con 0x7fe0f40d2620 2023-07-09T02:15:10.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0fbd1f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f415fb60 con 0x7fe0f415c060 2023-07-09T02:15:10.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f92ba640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe0f40cd120 0x7fe0f40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49442/0 (socket says 172.21.15.45:49442) 2023-07-09T02:15:10.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f92ba640 1 -- 172.21.15.45:0/2471528962 learned_addr learned my addr 172.21.15.45:0/2471528962 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:10.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f9abb640 1 --2- 172.21.15.45:0/2471528962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f415c060 0x7fe0f40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f8ab9640 1 -- 172.21.15.45:0/2471528962 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414226372 0 0) 0x7fe0f4160a50 con 0x7fe0f40cd120 2023-07-09T02:15:10.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f8ab9640 1 -- 172.21.15.45:0/2471528962 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e0003530 con 0x7fe0f40cd120 2023-07-09T02:15:10.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f8ab9640 1 -- 172.21.15.45:0/2471528962 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735659363 0 0) 0x7fe0f415c430 con 0x7fe0f40d2620 2023-07-09T02:15:10.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f8ab9640 1 -- 172.21.15.45:0/2471528962 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f4160a50 con 0x7fe0f40d2620 2023-07-09T02:15:10.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f9abb640 1 -- 172.21.15.45:0/2471528962 >> v1:172.21.15.155:6789/0 conn(0x7fe0f40d2620 legacy=0x7fe0f40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f9abb640 1 -- 172.21.15.45:0/2471528962 >> v1:172.21.15.45:6789/0 conn(0x7fe0f40cd120 legacy=0x7fe0f40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.534+0000 7fe0f9abb640 1 -- 172.21.15.45:0/2471528962 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f415fe40 con 0x7fe0f415c060 2023-07-09T02:15:10.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0f9abb640 1 --2- 172.21.15.45:0/2471528962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f415c060 0x7fe0f40b4ed0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0009820 tx=0x7fe0f001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf8f5b69bb3a7c53 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:10.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0f8ab9640 1 -- 172.21.15.45:0/2471528962 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00ab670 con 0x7fe0f415c060 2023-07-09T02:15:10.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0f8ab9640 1 -- 172.21.15.45:0/2471528962 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f00ab7d0 con 0x7fe0f415c060 2023-07-09T02:15:10.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0f8ab9640 1 -- 172.21.15.45:0/2471528962 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00abb60 con 0x7fe0f415c060 2023-07-09T02:15:10.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2471528962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f415c060 msgr2=0x7fe0f40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 --2- 172.21.15.45:0/2471528962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f415c060 0x7fe0f40b4ed0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0009820 tx=0x7fe0f001c470 comp rx=0 tx=0).stop 2023-07-09T02:15:10.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2471528962 shutdown_connections 2023-07-09T02:15:10.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 --2- 172.21.15.45:0/2471528962 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f415c060 0x7fe0f40b4ed0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2471528962 >> 172.21.15.45:0/2471528962 conn(0x7fe0f40698e0 msgr2=0x7fe0f4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:10.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2471528962 shutdown_connections 2023-07-09T02:15:10.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2471528962 wait complete. 2023-07-09T02:15:10.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 Processor -- start 2023-07-09T02:15:10.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.538+0000 7fe0fbd1f640 1 -- start start 2023-07-09T02:15:10.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f40cd120 0x7fe0f40b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0f40d2620 0x7fe0f415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f415c060 0x7fe0f415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4154da0 con 0x7fe0f415c060 2023-07-09T02:15:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f415d4a0 con 0x7fe0f40d2620 2023-07-09T02:15:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4159850 con 0x7fe0f40cd120 2023-07-09T02:15:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f415c060 0x7fe0f415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f415c060 0x7fe0f415c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55412/0 (socket says 172.21.15.45:55412) 2023-07-09T02:15:10.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 -- 172.21.15.45:0/2914411868 learned_addr learned my addr 172.21.15.45:0/2914411868 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:10.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0f92ba640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0f40d2620 0x7fe0f415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0f9abb640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f40cd120 0x7fe0f40b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 -- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f40cd120 msgr2=0x7fe0f40b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f40cd120 0x7fe0f40b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 -- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0f40d2620 msgr2=0x7fe0f415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0f40d2620 0x7fe0f415a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 -- 172.21.15.45:0/2914411868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f0009420 con 0x7fe0f415c060 2023-07-09T02:15:10.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0f9abb640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f40cd120 0x7fe0f40b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:10.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fa2bc640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f415c060 0x7fe0f415c930 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00c730 tx=0x7fe0ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:10.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0ea7fc640 1 -- 172.21.15.45:0/2914411868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec003b80 con 0x7fe0f415c060 2023-07-09T02:15:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0ea7fc640 1 -- 172.21.15.45:0/2914411868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec003ce0 con 0x7fe0f415c060 2023-07-09T02:15:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f40b59f0 con 0x7fe0f415c060 2023-07-09T02:15:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0ea7fc640 1 -- 172.21.15.45:0/2914411868 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00aa90 con 0x7fe0f415c060 2023-07-09T02:15:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f4159e10 con 0x7fe0f415c060 2023-07-09T02:15:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.542+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f404d7d0 con 0x7fe0f415c060 2023-07-09T02:15:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.546+0000 7fe0ea7fc640 1 -- 172.21.15.45:0/2914411868 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0ec00abf0 con 0x7fe0f415c060 2023-07-09T02:15:10.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.546+0000 7fe0ea7fc640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d8066280 0x7fe0d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.546+0000 7fe0ea7fc640 1 -- 172.21.15.45:0/2914411868 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe0ec0837c0 con 0x7fe0f415c060 2023-07-09T02:15:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.546+0000 7fe0f9abb640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d8066280 0x7fe0d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.546+0000 7fe0f9abb640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d8066280 0x7fe0d8068730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00af000 tx=0x7fe0f00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:10.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.550+0000 7fe0ea7fc640 1 -- 172.21.15.45:0/2914411868 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0ec050f80 con 0x7fe0f415c060 2023-07-09T02:15:10.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.758+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe0f406baa0 con 0x7fe0f415c060 2023-07-09T02:15:10.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.758+0000 7fe0ea7fc640 1 -- 172.21.15.45:0/2914411868 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe0ec058e60 con 0x7fe0f415c060 2023-07-09T02:15:10.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:10.761 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:15:10.761 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:15:10.761 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.761 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:15:10.762 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:15:10.762 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.762 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:15:10.762 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:15:10.762 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:15:10.762 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.762 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.763 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.763 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:15:10.763 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:15:10.763 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.763 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:15:10.763 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:15:10.763 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:15:10.763 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.764 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.764 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.764 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.764 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:15:10.764 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:15:10.764 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.764 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:15:10.765 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:15:10.765 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:15:10.765 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.765 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.766 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.766 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.766 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:15:10.766 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:15:10.767 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.767 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:15:10.767 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:15:10.767 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:15:10.768 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.768 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.768 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.769 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:15:10.769 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:15:10.770 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.770 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:15:10.770 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:15:10.771 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.771 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.771 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.771 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.772 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:15:10.772 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:15:10.772 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.772 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:15:10.773 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:15:10.773 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.773 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.773 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.774 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.774 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:15:10.774 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:15:10.774 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.775 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:15:10.775 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:15:10.775 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.776 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.776 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.776 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:15:10.776 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:15:10.777 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.777 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:15:10.777 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:15:10.777 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.778 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.778 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.778 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.779 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:15:10.779 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:15:10.779 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.779 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:15:10.780 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:15:10.780 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.780 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.781 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.782 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.782 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:15:10.782 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:15:10.782 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.783 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:15:10.783 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:15:10.783 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.783 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.784 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.784 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.784 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:15:10.784 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:15:10.785 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.785 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:15:10.785 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:15:10.785 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.786 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.786 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.786 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.786 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:15:10.787 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:15:10.787 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.787 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:15:10.787 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:15:10.788 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.788 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.788 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.788 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.789 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:15:10.789 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:15:10.789 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:15:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:15:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:15:10.790 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.791 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.791 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.791 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:15:10.791 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:15:10.792 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.792 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:15:10.792 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:15:10.792 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:15:10.793 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:15:10.793 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.793 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.793 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.794 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:15:10.794 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:15:10.794 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.794 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:15:10.795 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:15:10.795 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:15:10.795 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:15:10.795 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.796 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.796 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.796 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:15:10.796 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:15:10.797 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.797 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:15:10.797 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:15:10.797 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:15:10.798 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:15:10.798 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.798 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.798 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.799 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:15:10.799 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:15:10.799 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.799 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:15:10.800 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:15:10.800 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:15:10.800 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.801 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.801 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.801 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.801 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:15:10.802 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:15:10.802 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.802 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:15:10.802 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:15:10.803 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.803 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.803 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:10.803 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:10.804 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:15:10.804 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:15:10.804 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:15:10.804 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:15:10.805 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:15:10.805 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:15:10.805 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.805 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:10.806 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:15:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:15:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d8066280 msgr2=0x7fe0d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d8066280 0x7fe0d8068730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00af000 tx=0x7fe0f00a7000 comp rx=0 tx=0).stop 2023-07-09T02:15:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f415c060 msgr2=0x7fe0f415c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f415c060 0x7fe0f415c930 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00c730 tx=0x7fe0ec00cbf0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 shutdown_connections 2023-07-09T02:15:10.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f415c060 0x7fe0f415c930 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0f40d2620 0x7fe0f415a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d8066280 0x7fe0d8068730 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 --2- 172.21.15.45:0/2914411868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0f40cd120 0x7fe0f40b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 >> 172.21.15.45:0/2914411868 conn(0x7fe0f40698e0 msgr2=0x7fe0f40b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 shutdown_connections 2023-07-09T02:15:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.762+0000 7fe0fbd1f640 1 -- 172.21.15.45:0/2914411868 wait complete. 2023-07-09T02:15:10.812 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:15:10.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.954+0000 7f2946cb3640 1 Processor -- start 2023-07-09T02:15:10.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.954+0000 7f2946cb3640 1 -- start start 2023-07-09T02:15:10.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.954+0000 7f2946cb3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29400cd290 0x7f29400cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.954+0000 7f2946cb3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f294006a5c0 0x7f294006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.954+0000 7f2946cb3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2940071140 con 0x7f29400b2340 2023-07-09T02:15:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.954+0000 7f2946cb3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294006b010 con 0x7f294006a5c0 2023-07-09T02:15:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.954+0000 7f2946cb3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29400cdba0 con 0x7f29400cd290 2023-07-09T02:15:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.954+0000 7f293ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f294006a5c0 0x7f294006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f294006a5c0 0x7f294006aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55420/0 (socket says 172.21.15.45:55420) 2023-07-09T02:15:10.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293ffff640 1 -- 172.21.15.45:0/1906065961 learned_addr learned my addr 172.21.15.45:0/1906065961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:10.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f2944a4f640 1 --2- 172.21.15.45:0/1906065961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29400cd290 0x7f29400cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293ffff640 1 -- 172.21.15.45:0/1906065961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29400cd290 msgr2=0x7f29400cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:10.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293ffff640 1 --2- 172.21.15.45:0/1906065961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29400cd290 0x7f29400cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293ffff640 1 -- 172.21.15.45:0/1906065961 >> v1:172.21.15.45:6789/0 conn(0x7f29400b2340 legacy=0x7f29400b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293ffff640 1 -- 172.21.15.45:0/1906065961 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294015c970 con 0x7f294006a5c0 2023-07-09T02:15:10.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293ffff640 1 --2- 172.21.15.45:0/1906065961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f294006a5c0 0x7f294006aa10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f292c009870 tx=0x7f292c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abc3a8aac5e7aab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:10.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293f7fe640 1 -- 172.21.15.45:0/1906065961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0a7070 con 0x7f294006a5c0 2023-07-09T02:15:10.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293f7fe640 1 -- 172.21.15.45:0/1906065961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c0ab430 con 0x7f294006a5c0 2023-07-09T02:15:10.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.958+0000 7f293f7fe640 1 -- 172.21.15.45:0/1906065961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0ab7c0 con 0x7f294006a5c0 2023-07-09T02:15:10.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- 172.21.15.45:0/1906065961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f294006a5c0 msgr2=0x7f294006aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 --2- 172.21.15.45:0/1906065961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f294006a5c0 0x7f294006aa10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f292c009870 tx=0x7f292c01c540 comp rx=0 tx=0).stop 2023-07-09T02:15:10.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- 172.21.15.45:0/1906065961 shutdown_connections 2023-07-09T02:15:10.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 --2- 172.21.15.45:0/1906065961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f294006a5c0 0x7f294006aa10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 --2- 172.21.15.45:0/1906065961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29400cd290 0x7f29400cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- 172.21.15.45:0/1906065961 >> 172.21.15.45:0/1906065961 conn(0x7f294006d140 msgr2=0x7f294006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:10.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- 172.21.15.45:0/1906065961 shutdown_connections 2023-07-09T02:15:10.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- 172.21.15.45:0/1906065961 wait complete. 2023-07-09T02:15:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 Processor -- start 2023-07-09T02:15:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- start start 2023-07-09T02:15:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294006a5c0 0x7f29401557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400b2340 0x7f2940155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29400cd290 0x7f29400b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294015e3f0 con 0x7f29400b2340 2023-07-09T02:15:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400b6440 con 0x7f29400cd290 2023-07-09T02:15:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2946cb3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2940156440 con 0x7f294006a5c0 2023-07-09T02:15:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f293ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400b2340 0x7f2940155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f293ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400b2340 0x7f2940155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55422/0 (socket says 172.21.15.45:55422) 2023-07-09T02:15:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f293ffff640 1 -- 172.21.15.45:0/161447820 learned_addr learned my addr 172.21.15.45:0/161447820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2944a4f640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294006a5c0 0x7f29401557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f293ffff640 1 -- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294006a5c0 msgr2=0x7f29401557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f293ffff640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294006a5c0 0x7f29401557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f293ffff640 1 -- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29400cd290 msgr2=0x7f29400b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f2945250640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29400cd290 0x7f29400b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f293ffff640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29400cd290 0x7f29400b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.962+0000 7f293ffff640 1 -- 172.21.15.45:0/161447820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c0094d0 con 0x7f29400b2340 2023-07-09T02:15:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f293ffff640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400b2340 0x7f2940155d30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f292c0ad040 tx=0x7f292c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f293d7fa640 1 -- 172.21.15.45:0/161447820 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0b4830 con 0x7f29400b2340 2023-07-09T02:15:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f293d7fa640 1 -- 172.21.15.45:0/161447820 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c0b4990 con 0x7f29400b2340 2023-07-09T02:15:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294015da50 con 0x7f29400b2340 2023-07-09T02:15:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f293d7fa640 1 -- 172.21.15.45:0/161447820 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0b4d40 con 0x7f29400b2340 2023-07-09T02:15:10.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294015e010 con 0x7f29400b2340 2023-07-09T02:15:10.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294004d7d0 con 0x7f29400b2340 2023-07-09T02:15:10.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f293d7fa640 1 -- 172.21.15.45:0/161447820 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f292c0c0460 con 0x7f29400b2340 2023-07-09T02:15:10.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f293d7fa640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2924066280 0x7f2924068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:10.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.966+0000 7f293d7fa640 1 -- 172.21.15.45:0/161447820 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f292c11de00 con 0x7f29400b2340 2023-07-09T02:15:10.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.970+0000 7f2944a4f640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2924066280 0x7f2924068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:10.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.970+0000 7f2944a4f640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2924066280 0x7f2924068730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f293400b930 tx=0x7f2934008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:10.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:10.970+0000 7f293d7fa640 1 -- 172.21.15.45:0/161447820 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f292c0eb530 con 0x7f29400b2340 2023-07-09T02:15:11.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f294015d1e0 con 0x7f29400b2340 2023-07-09T02:15:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f293d7fa640 1 -- 172.21.15.45:0/161447820 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+14640 (secure 0 0 0) 0x7f292c0eeb50 con 0x7f29400b2340 2023-07-09T02:15:11.130 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:11.131 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:15:10.353527+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:15:11.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2924066280 msgr2=0x7f2924068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2924066280 0x7f2924068730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f293400b930 tx=0x7f2934008040 comp rx=0 tx=0).stop 2023-07-09T02:15:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400b2340 msgr2=0x7f2940155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400b2340 0x7f2940155d30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f292c0ad040 tx=0x7f292c0192e0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 shutdown_connections 2023-07-09T02:15:11.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29400cd290 0x7f29400b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29400b2340 0x7f2940155d30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2924066280 0x7f2924068730 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 --2- 172.21.15.45:0/161447820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f294006a5c0 0x7f29401557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 >> 172.21.15.45:0/161447820 conn(0x7f294006d140 msgr2=0x7f29400b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:11.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 shutdown_connections 2023-07-09T02:15:11.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.130+0000 7f2946cb3640 1 -- 172.21.15.45:0/161447820 wait complete. 2023-07-09T02:15:11.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:15:11.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:15:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f3dcec640 1 Processor -- start 2023-07-09T02:15:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f3dcec640 1 -- start start 2023-07-09T02:15:11.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f3dcec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1f380c8d10 0x7f1f380c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f3dcec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f3815db00 0x7f1f3815df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f3dcec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3806bf30 con 0x7f1f380ca0f0 2023-07-09T02:15:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f3dcec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3815e480 con 0x7f1f3815db00 2023-07-09T02:15:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f3dcec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3806bc50 con 0x7f1f380c8d10 2023-07-09T02:15:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f3815db00 0x7f1f3815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f3815db00 0x7f1f3815df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55428/0 (socket says 172.21.15.45:55428) 2023-07-09T02:15:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f37fff640 1 -- 172.21.15.45:0/972663805 learned_addr learned my addr 172.21.15.45:0/972663805 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.298+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/972663805 >> v2:172.21.15.155:3300/0 conn(0x7f1f380c8d10 0x7f1f380c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f37fff640 1 -- 172.21.15.45:0/972663805 >> v2:172.21.15.155:3300/0 conn(0x7f1f380c8d10 msgr2=0x7f1f380c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f37fff640 1 --2- 172.21.15.45:0/972663805 >> v2:172.21.15.155:3300/0 conn(0x7f1f380c8d10 0x7f1f380c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f37fff640 1 -- 172.21.15.45:0/972663805 >> v1:172.21.15.45:6789/0 conn(0x7f1f380ca0f0 legacy=0x7f1f380cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f37fff640 1 -- 172.21.15.45:0/972663805 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f380cab90 con 0x7f1f3815db00 2023-07-09T02:15:11.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f37fff640 1 --2- 172.21.15.45:0/972663805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3815db00 0x7f1f3815df40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1f3806ebb0 tx=0x7f1f3001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48632921aaebeb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f367fc640 1 -- 172.21.15.45:0/972663805 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f300a5800 con 0x7f1f3815db00 2023-07-09T02:15:11.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f367fc640 1 -- 172.21.15.45:0/972663805 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f300a5960 con 0x7f1f3815db00 2023-07-09T02:15:11.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f367fc640 1 -- 172.21.15.45:0/972663805 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f300a5cf0 con 0x7f1f3815db00 2023-07-09T02:15:11.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f3dcec640 1 -- 172.21.15.45:0/972663805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3815db00 msgr2=0x7f1f3815df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/972663805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3815db00 0x7f1f3815df40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1f3806ebb0 tx=0x7f1f3001c940 comp rx=0 tx=0).stop 2023-07-09T02:15:11.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f3dcec640 1 -- 172.21.15.45:0/972663805 shutdown_connections 2023-07-09T02:15:11.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/972663805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3815db00 0x7f1f3815df40 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/972663805 >> v2:172.21.15.155:3300/0 conn(0x7f1f380c8d10 0x7f1f380c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f3dcec640 1 -- 172.21.15.45:0/972663805 >> 172.21.15.45:0/972663805 conn(0x7f1f380694b0 msgr2=0x7f1f380698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:11.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f3dcec640 1 -- 172.21.15.45:0/972663805 shutdown_connections 2023-07-09T02:15:11.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.302+0000 7f1f3dcec640 1 -- 172.21.15.45:0/972663805 wait complete. 2023-07-09T02:15:11.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 Processor -- start 2023-07-09T02:15:11.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 -- start start 2023-07-09T02:15:11.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f380c8d10 0x7f1f38151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f380ca0f0 0x7f1f380b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3815db00 0x7f1f38145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f38152440 con 0x7f1f380c8d10 2023-07-09T02:15:11.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f380b1db0 con 0x7f1f380ca0f0 2023-07-09T02:15:11.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3814e700 con 0x7f1f3815db00 2023-07-09T02:15:11.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f380c8d10 0x7f1f38151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f380c8d10 0x7f1f38151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55444/0 (socket says 172.21.15.45:55444) 2023-07-09T02:15:11.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 -- 172.21.15.45:0/2691358206 learned_addr learned my addr 172.21.15.45:0/2691358206 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:11.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f380ca0f0 0x7f1f380b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f37fff640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3815db00 0x7f1f38145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 -- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3815db00 msgr2=0x7f1f38145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3815db00 0x7f1f38145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 -- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f380ca0f0 msgr2=0x7f1f380b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f380ca0f0 0x7f1f380b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 -- 172.21.15.45:0/2691358206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30009b30 con 0x7f1f380c8d10 2023-07-09T02:15:11.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f377fe640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f380c8d10 0x7f1f38151f00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c500 tx=0x7f1f2800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f1ffff640 1 -- 172.21.15.45:0/2691358206 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28005220 con 0x7f1f380c8d10 2023-07-09T02:15:11.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f1ffff640 1 -- 172.21.15.45:0/2691358206 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28005380 con 0x7f1f380c8d10 2023-07-09T02:15:11.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f1ffff640 1 -- 172.21.15.45:0/2691358206 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28007270 con 0x7f1f380c8d10 2023-07-09T02:15:11.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.306+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f38152630 con 0x7f1f380c8d10 2023-07-09T02:15:11.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.310+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3814ec80 con 0x7f1f380c8d10 2023-07-09T02:15:11.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.310+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3804d7d0 con 0x7f1f380c8d10 2023-07-09T02:15:11.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.310+0000 7f1f1ffff640 1 -- 172.21.15.45:0/2691358206 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f280073d0 con 0x7f1f380c8d10 2023-07-09T02:15:11.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.310+0000 7f1f1ffff640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f24066280 0x7f1f24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.310+0000 7f1f1ffff640 1 -- 172.21.15.45:0/2691358206 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1f28083210 con 0x7f1f380c8d10 2023-07-09T02:15:11.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.310+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f24066280 0x7f1f24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.314+0000 7f1f36ffd640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f24066280 0x7f1f24068730 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007a60 tx=0x7f1f2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.314+0000 7f1f1ffff640 1 -- 172.21.15.45:0/2691358206 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f28050aa0 con 0x7f1f380c8d10 2023-07-09T02:15:11.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f38152970 con 0x7f1f380c8d10 2023-07-09T02:15:11.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f1ffff640 1 -- 172.21.15.45:0/2691358206 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f280540c0 con 0x7f1f380c8d10 2023-07-09T02:15:11.469 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:15:11.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f24066280 msgr2=0x7f1f24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f24066280 0x7f1f24068730 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007a60 tx=0x7f1f2c008040 comp rx=0 tx=0).stop 2023-07-09T02:15:11.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f380c8d10 msgr2=0x7f1f38151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f380c8d10 0x7f1f38151f00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c500 tx=0x7f1f2800c9c0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 shutdown_connections 2023-07-09T02:15:11.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1f24066280 0x7f1f24068730 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f3815db00 0x7f1f38145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f380ca0f0 0x7f1f380b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 --2- 172.21.15.45:0/2691358206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f380c8d10 0x7f1f38151f00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 >> 172.21.15.45:0/2691358206 conn(0x7f1f380694b0 msgr2=0x7f1f380c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:11.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 shutdown_connections 2023-07-09T02:15:11.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.470+0000 7f1f3dcec640 1 -- 172.21.15.45:0/2691358206 wait complete. 2023-07-09T02:15:11.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:15:11.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb715418640 1 Processor -- start 2023-07-09T02:15:11.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb715418640 1 -- start start 2023-07-09T02:15:11.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb715418640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb71015c060 0x7fb7100b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb715418640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7100cd120 0x7fb7100d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb715418640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb710160a50 con 0x7fb7100d2450 2023-07-09T02:15:11.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb715418640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7100d28f0 con 0x7fb7100cd120 2023-07-09T02:15:11.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb715418640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100cfe40 con 0x7fb71015c060 2023-07-09T02:15:11.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb70e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7100cd120 0x7fb7100d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb70e7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7100cd120 0x7fb7100d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34576/0 (socket says 172.21.15.45:34576) 2023-07-09T02:15:11.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb70e7fc640 1 -- 172.21.15.45:0/2441828618 learned_addr learned my addr 172.21.15.45:0/2441828618 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:11.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb70effd640 1 --2- 172.21.15.45:0/2441828618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb71015c060 0x7fb7100b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb70e7fc640 1 -- 172.21.15.45:0/2441828618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb71015c060 msgr2=0x7fb7100b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:11.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb70e7fc640 1 --2- 172.21.15.45:0/2441828618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb71015c060 0x7fb7100b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb70e7fc640 1 -- 172.21.15.45:0/2441828618 >> v1:172.21.15.155:6789/0 conn(0x7fb7100d2450 legacy=0x7fb7100d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.638+0000 7fb70e7fc640 1 -- 172.21.15.45:0/2441828618 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71015c430 con 0x7fb7100cd120 2023-07-09T02:15:11.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb70e7fc640 1 --2- 172.21.15.45:0/2441828618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7100cd120 0x7fb7100d1f10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb704009870 tx=0x7fb70401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73be83fbf29dd9d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb70dffb640 1 -- 172.21.15.45:0/2441828618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7040a7070 con 0x7fb7100cd120 2023-07-09T02:15:11.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb70dffb640 1 -- 172.21.15.45:0/2441828618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7040ab430 con 0x7fb7100cd120 2023-07-09T02:15:11.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb70dffb640 1 -- 172.21.15.45:0/2441828618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7040ab7c0 con 0x7fb7100cd120 2023-07-09T02:15:11.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb715418640 1 -- 172.21.15.45:0/2441828618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7100cd120 msgr2=0x7fb7100d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb715418640 1 --2- 172.21.15.45:0/2441828618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7100cd120 0x7fb7100d1f10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb704009870 tx=0x7fb70401c510 comp rx=0 tx=0).stop 2023-07-09T02:15:11.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb715418640 1 -- 172.21.15.45:0/2441828618 shutdown_connections 2023-07-09T02:15:11.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb715418640 1 --2- 172.21.15.45:0/2441828618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7100cd120 0x7fb7100d1f10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb715418640 1 --2- 172.21.15.45:0/2441828618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb71015c060 0x7fb7100b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb715418640 1 -- 172.21.15.45:0/2441828618 >> 172.21.15.45:0/2441828618 conn(0x7fb7100698e0 msgr2=0x7fb710069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:11.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb715418640 1 -- 172.21.15.45:0/2441828618 shutdown_connections 2023-07-09T02:15:11.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.642+0000 7fb715418640 1 -- 172.21.15.45:0/2441828618 wait complete. 2023-07-09T02:15:11.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 Processor -- start 2023-07-09T02:15:11.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 -- start start 2023-07-09T02:15:11.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7100cd120 0x7fb7100b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7100d2450 0x7fb7100b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71015c060 0x7fb71015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100b1e00 con 0x7fb71015c060 2023-07-09T02:15:11.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100b1bd0 con 0x7fb7100cd120 2023-07-09T02:15:11.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71015e910 con 0x7fb7100d2450 2023-07-09T02:15:11.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71015c060 0x7fb71015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71015c060 0x7fb71015c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34580/0 (socket says 172.21.15.45:34580) 2023-07-09T02:15:11.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 -- 172.21.15.45:0/199478666 learned_addr learned my addr 172.21.15.45:0/199478666 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:11.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70e7fc640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7100d2450 0x7fb7100b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70effd640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7100cd120 0x7fb7100b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 -- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7100d2450 msgr2=0x7fb7100b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7100d2450 0x7fb7100b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 -- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7100cd120 msgr2=0x7fb7100b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7100cd120 0x7fb7100b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 -- 172.21.15.45:0/199478666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7040094d0 con 0x7fb71015c060 2023-07-09T02:15:11.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb70f7fe640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71015c060 0x7fb71015c660 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c770 tx=0x7fb70800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb6f77fe640 1 -- 172.21.15.45:0/199478666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708003b80 con 0x7fb71015c060 2023-07-09T02:15:11.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb6f77fe640 1 -- 172.21.15.45:0/199478666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708003ce0 con 0x7fb71015c060 2023-07-09T02:15:11.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb6f77fe640 1 -- 172.21.15.45:0/199478666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800aa90 con 0x7fb71015c060 2023-07-09T02:15:11.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71015ebf0 con 0x7fb71015c060 2023-07-09T02:15:11.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71015f1b0 con 0x7fb71015c060 2023-07-09T02:15:11.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.646+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71015f3a0 con 0x7fb71015c060 2023-07-09T02:15:11.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.650+0000 7fb6f77fe640 1 -- 172.21.15.45:0/199478666 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb70800abf0 con 0x7fb71015c060 2023-07-09T02:15:11.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.650+0000 7fb6f77fe640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6fc066280 0x7fb6fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.650+0000 7fb6f77fe640 1 -- 172.21.15.45:0/199478666 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb708083670 con 0x7fb71015c060 2023-07-09T02:15:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.650+0000 7fb70effd640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6fc066280 0x7fb6fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.650+0000 7fb70effd640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6fc066280 0x7fb6fc068730 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb71015e700 tx=0x7fb700008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.654+0000 7fb6f77fe640 1 -- 172.21.15.45:0/199478666 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb708050f80 con 0x7fb71015c060 2023-07-09T02:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.806+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb71004d7d0 con 0x7fb71015c060 2023-07-09T02:15:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.806+0000 7fb6f77fe640 1 -- 172.21.15.45:0/199478666 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb7080545a0 con 0x7fb71015c060 2023-07-09T02:15:11.808 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6fc066280 msgr2=0x7fb6fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6fc066280 0x7fb6fc068730 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb71015e700 tx=0x7fb700008040 comp rx=0 tx=0).stop 2023-07-09T02:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71015c060 msgr2=0x7fb71015c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71015c060 0x7fb71015c660 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c770 tx=0x7fb70800cc30 comp rx=0 tx=0).stop 2023-07-09T02:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 shutdown_connections 2023-07-09T02:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71015c060 0x7fb71015c660 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6fc066280 0x7fb6fc068730 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7100d2450 0x7fb7100b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 --2- 172.21.15.45:0/199478666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7100cd120 0x7fb7100b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 >> 172.21.15.45:0/199478666 conn(0x7fb7100698e0 msgr2=0x7fb7101576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 shutdown_connections 2023-07-09T02:15:11.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.810+0000 7fb715418640 1 -- 172.21.15.45:0/199478666 wait complete. 2023-07-09T02:15:11.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:15:11.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.970+0000 7f9403893640 1 Processor -- start 2023-07-09T02:15:11.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.970+0000 7f9403893640 1 -- start start 2023-07-09T02:15:11.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9403893640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f93fc0d2620 0x7f93fc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9403893640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93fc160a50 con 0x7f93fc0cd120 2023-07-09T02:15:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9403893640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93fc15c430 con 0x7f93fc15c060 2023-07-09T02:15:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9403893640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc15fb60 con 0x7f93fc0d2620 2023-07-09T02:15:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9401e30640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f93fc0cd120 0x7f93fc0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38778/0 (socket says 172.21.15.45:38778) 2023-07-09T02:15:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9401e30640 1 -- 172.21.15.45:0/2266177231 learned_addr learned my addr 172.21.15.45:0/2266177231 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9400e2e640 1 --2- 172.21.15.45:0/2266177231 >> v2:172.21.15.155:3300/0 conn(0x7f93fc0d2620 0x7f93fc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f93f3fff640 1 -- 172.21.15.45:0/2266177231 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775774534 0 0) 0x7f93fc160a50 con 0x7f93fc0cd120 2023-07-09T02:15:11.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f93f3fff640 1 -- 172.21.15.45:0/2266177231 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e8003530 con 0x7f93fc0cd120 2023-07-09T02:15:11.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f93f3fff640 1 -- 172.21.15.45:0/2266177231 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550618619 0 0) 0x7f93fc15c430 con 0x7f93fc15c060 2023-07-09T02:15:11.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f93f3fff640 1 -- 172.21.15.45:0/2266177231 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc160a50 con 0x7f93fc15c060 2023-07-09T02:15:11.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9400e2e640 1 -- 172.21.15.45:0/2266177231 >> v1:172.21.15.155:6789/0 conn(0x7f93fc15c060 legacy=0x7f93fc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9400e2e640 1 -- 172.21.15.45:0/2266177231 >> v1:172.21.15.45:6789/0 conn(0x7f93fc0cd120 legacy=0x7f93fc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f93f3fff640 1 -- 172.21.15.45:0/2266177231 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842422316 0 0) 0x7f93e8003530 con 0x7f93fc0cd120 2023-07-09T02:15:11.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.974+0000 7f9400e2e640 1 -- 172.21.15.45:0/2266177231 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc15fe40 con 0x7f93fc0d2620 2023-07-09T02:15:11.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9400e2e640 1 --2- 172.21.15.45:0/2266177231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 0x7f93fc0b4ed0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0097c0 tx=0x7f93ec01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b7f7ab06ea38f71 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f93f3fff640 1 -- 172.21.15.45:0/2266177231 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4001a00 con 0x7f93fc0d2620 2023-07-09T02:15:11.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f93f3fff640 1 -- 172.21.15.45:0/2266177231 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec0a7050 con 0x7f93fc0d2620 2023-07-09T02:15:11.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f93f3fff640 1 -- 172.21.15.45:0/2266177231 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0ab620 con 0x7f93fc0d2620 2023-07-09T02:15:11.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 -- 172.21.15.45:0/2266177231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 msgr2=0x7f93fc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 --2- 172.21.15.45:0/2266177231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 0x7f93fc0b4ed0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0097c0 tx=0x7f93ec01c370 comp rx=0 tx=0).stop 2023-07-09T02:15:11.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 -- 172.21.15.45:0/2266177231 shutdown_connections 2023-07-09T02:15:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 --2- 172.21.15.45:0/2266177231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 0x7f93fc0b4ed0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 -- 172.21.15.45:0/2266177231 >> 172.21.15.45:0/2266177231 conn(0x7f93fc0698e0 msgr2=0x7f93fc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 -- 172.21.15.45:0/2266177231 shutdown_connections 2023-07-09T02:15:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 -- 172.21.15.45:0/2266177231 wait complete. 2023-07-09T02:15:11.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 Processor -- start 2023-07-09T02:15:11.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.978+0000 7f9403893640 1 -- start start 2023-07-09T02:15:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93fc0cd120 0x7f93fc0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 0x7f93fc160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93fc15c060 0x7f93fc161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc1617a0 con 0x7f93fc15c060 2023-07-09T02:15:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc161a50 con 0x7f93fc0d2620 2023-07-09T02:15:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc161d30 con 0x7f93fc0cd120 2023-07-09T02:15:11.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93fc15c060 0x7f93fc161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93fc15c060 0x7f93fc161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34592/0 (socket says 172.21.15.45:34592) 2023-07-09T02:15:11.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 -- 172.21.15.45:0/2678280002 learned_addr learned my addr 172.21.15.45:0/2678280002 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:11.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9400e2e640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 0x7f93fc160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f940162f640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93fc0cd120 0x7f93fc0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 -- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93fc0cd120 msgr2=0x7f93fc0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93fc0cd120 0x7f93fc0b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 -- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 msgr2=0x7f93fc160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:11.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 0x7f93fc160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:11.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 -- 172.21.15.45:0/2678280002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec009420 con 0x7f93fc15c060 2023-07-09T02:15:11.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9401e30640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93fc15c060 0x7f93fc161260 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f93f4002010 tx=0x7f93f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f93f1ffb640 1 -- 172.21.15.45:0/2678280002 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4012400 con 0x7f93fc15c060 2023-07-09T02:15:11.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f93f1ffb640 1 -- 172.21.15.45:0/2678280002 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f4012580 con 0x7f93fc15c060 2023-07-09T02:15:11.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc0b59f0 con 0x7f93fc15c060 2023-07-09T02:15:11.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f93f1ffb640 1 -- 172.21.15.45:0/2678280002 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4012970 con 0x7f93fc15c060 2023-07-09T02:15:11.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc1622f0 con 0x7f93fc15c060 2023-07-09T02:15:11.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc04d7d0 con 0x7f93fc15c060 2023-07-09T02:15:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.982+0000 7f93f1ffb640 1 -- 172.21.15.45:0/2678280002 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93f4012ad0 con 0x7f93fc15c060 2023-07-09T02:15:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.986+0000 7f93f1ffb640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93e0066280 0x7f93e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.986+0000 7f93f1ffb640 1 -- 172.21.15.45:0/2678280002 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f93f4084080 con 0x7f93fc15c060 2023-07-09T02:15:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.986+0000 7f940162f640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93e0066280 0x7f93e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:11.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.986+0000 7f940162f640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93e0066280 0x7f93e0068730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f93f80011f0 tx=0x7f93f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:11.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:11.990+0000 7f93f1ffb640 1 -- 172.21.15.45:0/2678280002 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93f40b4700 con 0x7f93fc15c060 2023-07-09T02:15:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.146+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f93fc06baa0 con 0x7f93fc15c060 2023-07-09T02:15:12.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.146+0000 7f93f1ffb640 1 -- 172.21.15.45:0/2678280002 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+126 (secure 0 0 0) 0x7f93f40518f0 con 0x7f93fc15c060 2023-07-09T02:15:12.147 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:12.147 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:15:12.147 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:12.147 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:15:12.148 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:15:12.148 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:15:12.148 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:15:12.148 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:15:12.148 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:15:12.148 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:15:12.148 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:15:12.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93e0066280 msgr2=0x7f93e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93e0066280 0x7f93e0068730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f93f80011f0 tx=0x7f93f8009040 comp rx=0 tx=0).stop 2023-07-09T02:15:12.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93fc15c060 msgr2=0x7f93fc161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93fc15c060 0x7f93fc161260 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f93f4002010 tx=0x7f93f400a430 comp rx=0 tx=0).stop 2023-07-09T02:15:12.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 shutdown_connections 2023-07-09T02:15:12.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93fc15c060 0x7f93fc161260 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93fc0d2620 0x7f93fc160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93e0066280 0x7f93e0068730 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 --2- 172.21.15.45:0/2678280002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93fc0cd120 0x7f93fc0b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 >> 172.21.15.45:0/2678280002 conn(0x7f93fc0698e0 msgr2=0x7f93fc0b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:12.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 shutdown_connections 2023-07-09T02:15:12.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.150+0000 7f9403893640 1 -- 172.21.15.45:0/2678280002 wait complete. 2023-07-09T02:15:12.168 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:15:12.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:15:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.314+0000 7fd6cbe0b640 1 Processor -- start 2023-07-09T02:15:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.314+0000 7fd6cbe0b640 1 -- start start 2023-07-09T02:15:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6cbe0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c40b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6cbe0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6c40b3e90 0x7fd6c40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6cbe0b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40cd540 con 0x7fd6c40cafc0 2023-07-09T02:15:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6cbe0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c40cd350 con 0x7fd6c40b3e90 2023-07-09T02:15:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6cbe0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c9bd0 con 0x7fd6c40c9660 2023-07-09T02:15:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c9ba7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd6c40cafc0 0x7fd6c40cb390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38792/0 (socket says 172.21.15.45:38792) 2023-07-09T02:15:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c9ba7640 1 -- 172.21.15.45:0/632875331 learned_addr learned my addr 172.21.15.45:0/632875331 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:12.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c93a6640 1 --2- 172.21.15.45:0/632875331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c40b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6ca3a8640 1 --2- 172.21.15.45:0/632875331 >> v2:172.21.15.155:3300/0 conn(0x7fd6c40b3e90 0x7fd6c40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c8ba5640 1 -- 172.21.15.45:0/632875331 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747646281 0 0) 0x7fd6c40cd540 con 0x7fd6c40cafc0 2023-07-09T02:15:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c8ba5640 1 -- 172.21.15.45:0/632875331 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b0003530 con 0x7fd6c40cafc0 2023-07-09T02:15:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c93a6640 1 -- 172.21.15.45:0/632875331 >> v2:172.21.15.155:3300/0 conn(0x7fd6c40b3e90 msgr2=0x7fd6c40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c93a6640 1 --2- 172.21.15.45:0/632875331 >> v2:172.21.15.155:3300/0 conn(0x7fd6c40b3e90 0x7fd6c40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c93a6640 1 -- 172.21.15.45:0/632875331 >> v1:172.21.15.45:6789/0 conn(0x7fd6c40cafc0 legacy=0x7fd6c40cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.318+0000 7fd6c93a6640 1 -- 172.21.15.45:0/632875331 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40cd7e0 con 0x7fd6c40c9660 2023-07-09T02:15:12.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6c93a6640 1 --2- 172.21.15.45:0/632875331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c40b1600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40097c0 tx=0x7fd6b401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec46b0b0791593b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:12.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6c8ba5640 1 -- 172.21.15.45:0/632875331 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40a8970 con 0x7fd6c40c9660 2023-07-09T02:15:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6c8ba5640 1 -- 172.21.15.45:0/632875331 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b40a8ad0 con 0x7fd6c40c9660 2023-07-09T02:15:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6c8ba5640 1 -- 172.21.15.45:0/632875331 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40a8e60 con 0x7fd6c40c9660 2023-07-09T02:15:12.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/632875331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 msgr2=0x7fd6c40b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/632875331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c40b1600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40097c0 tx=0x7fd6b401ec70 comp rx=0 tx=0).stop 2023-07-09T02:15:12.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/632875331 shutdown_connections 2023-07-09T02:15:12.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/632875331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c40b1600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/632875331 >> v2:172.21.15.155:3300/0 conn(0x7fd6c40b3e90 0x7fd6c40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/632875331 >> 172.21.15.45:0/632875331 conn(0x7fd6c406ae60 msgr2=0x7fd6c406b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/632875331 shutdown_connections 2023-07-09T02:15:12.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/632875331 wait complete. 2023-07-09T02:15:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 Processor -- start 2023-07-09T02:15:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.322+0000 7fd6cbe0b640 1 -- start start 2023-07-09T02:15:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c40b3e90 0x7fd6c4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c41f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6c40cafc0 0x7fd6c414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4072160 con 0x7fd6c40b3e90 2023-07-09T02:15:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c41f1bd0 con 0x7fd6c40cafc0 2023-07-09T02:15:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4071e80 con 0x7fd6c40c9660 2023-07-09T02:15:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c40b3e90 0x7fd6c4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c40b3e90 0x7fd6c4157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34600/0 (socket says 172.21.15.45:34600) 2023-07-09T02:15:12.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 -- 172.21.15.45:0/849350848 learned_addr learned my addr 172.21.15.45:0/849350848 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c93a6640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c41f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6ca3a8640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6c40cafc0 0x7fd6c414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 -- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 msgr2=0x7fd6c41f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c41f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 -- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6c40cafc0 msgr2=0x7fd6c414a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6c40cafc0 0x7fd6c414a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 -- 172.21.15.45:0/849350848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009420 con 0x7fd6c40b3e90 2023-07-09T02:15:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6ca3a8640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6c40cafc0 0x7fd6c414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6c9ba7640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c40b3e90 0x7fd6c4157080 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000c420 tx=0x7fd6c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6ba7fc640 1 -- 172.21.15.45:0/849350848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0005cf0 con 0x7fd6c40b3e90 2023-07-09T02:15:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6ba7fc640 1 -- 172.21.15.45:0/849350848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c0005e50 con 0x7fd6c40b3e90 2023-07-09T02:15:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c40c6f10 con 0x7fd6c40b3e90 2023-07-09T02:15:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6ba7fc640 1 -- 172.21.15.45:0/849350848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c00072d0 con 0x7fd6c40b3e90 2023-07-09T02:15:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c40c74d0 con 0x7fd6c40b3e90 2023-07-09T02:15:12.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c40c6d70 con 0x7fd6c40b3e90 2023-07-09T02:15:12.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.326+0000 7fd6ba7fc640 1 -- 172.21.15.45:0/849350848 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6c0007430 con 0x7fd6c40b3e90 2023-07-09T02:15:12.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.330+0000 7fd6ba7fc640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6a8066280 0x7fd6a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.330+0000 7fd6ba7fc640 1 -- 172.21.15.45:0/849350848 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd6c0082f50 con 0x7fd6c40b3e90 2023-07-09T02:15:12.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.330+0000 7fd6c93a6640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6a8066280 0x7fd6a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.330+0000 7fd6c93a6640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6a8066280 0x7fd6a8068730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40b2000 tx=0x7fd6b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:12.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.334+0000 7fd6ba7fc640 1 -- 172.21.15.45:0/849350848 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6c40c6d70 con 0x7fd6c40b3e90 2023-07-09T02:15:12.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.486+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd6c40c6d70 con 0x7fd6c40b3e90 2023-07-09T02:15:12.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.574+0000 7fd6ba7fc640 1 -- 172.21.15.45:0/849350848 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd6c40c6d70 con 0x7fd6c40b3e90 2023-07-09T02:15:12.575 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:15:12.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6a8066280 msgr2=0x7fd6a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6a8066280 0x7fd6a8068730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40b2000 tx=0x7fd6b4008040 comp rx=0 tx=0).stop 2023-07-09T02:15:12.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c40b3e90 msgr2=0x7fd6c4157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c40b3e90 0x7fd6c4157080 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000c420 tx=0x7fd6c000c8e0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 shutdown_connections 2023-07-09T02:15:12.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6c40cafc0 0x7fd6c414a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6a8066280 0x7fd6a8068730 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6c40c9660 0x7fd6c41f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 --2- 172.21.15.45:0/849350848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c40b3e90 0x7fd6c4157080 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 >> 172.21.15.45:0/849350848 conn(0x7fd6c406ae60 msgr2=0x7fd6c406b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:12.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 shutdown_connections 2023-07-09T02:15:12.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.578+0000 7fd6cbe0b640 1 -- 172.21.15.45:0/849350848 wait complete. 2023-07-09T02:15:12.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:15:12.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f6611f640 1 Processor -- start 2023-07-09T02:15:12.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f6611f640 1 -- start start 2023-07-09T02:15:12.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f6611f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f6015c3b0 0x7f5f600cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f6611f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f600b1990 0x7f5f600d2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f6611f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f600d2d50 0x7f5f6015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f6611f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f600cf370 con 0x7f5f600b1990 2023-07-09T02:15:12.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f6611f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f600d31d0 con 0x7f5f6015c3b0 2023-07-09T02:15:12.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f6611f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600cf510 con 0x7f5f600d2d50 2023-07-09T02:15:12.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f600b1990 0x7f5f600d2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f600b1990 0x7f5f600d2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34608/0 (socket says 172.21.15.45:34608) 2023-07-09T02:15:12.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5effd640 1 -- 172.21.15.45:0/470323573 learned_addr learned my addr 172.21.15.45:0/470323573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:12.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5ffff640 1 --2- 172.21.15.45:0/470323573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f600d2d50 0x7f5f6015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5f7fe640 1 --2- 172.21.15.45:0/470323573 >> v2:172.21.15.155:3300/0 conn(0x7f5f6015c3b0 0x7f5f600cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5effd640 1 -- 172.21.15.45:0/470323573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f600d2d50 msgr2=0x7f5f6015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:12.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5effd640 1 --2- 172.21.15.45:0/470323573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f600d2d50 0x7f5f6015ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5effd640 1 -- 172.21.15.45:0/470323573 >> v2:172.21.15.155:3300/0 conn(0x7f5f6015c3b0 msgr2=0x7f5f600cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:12.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5effd640 1 --2- 172.21.15.45:0/470323573 >> v2:172.21.15.155:3300/0 conn(0x7f5f6015c3b0 0x7f5f600cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.750+0000 7f5f5effd640 1 -- 172.21.15.45:0/470323573 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f600b1f00 con 0x7f5f600b1990 2023-07-09T02:15:12.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f5effd640 1 --2- 172.21.15.45:0/470323573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600b1990 0x7f5f600d2810 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5f600b4ec0 tx=0x7f5f5401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f09befdb58df362 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:12.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f5e7fc640 1 -- 172.21.15.45:0/470323573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540ab600 con 0x7f5f600b1990 2023-07-09T02:15:12.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f5e7fc640 1 -- 172.21.15.45:0/470323573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f540a7050 con 0x7f5f600b1990 2023-07-09T02:15:12.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f5e7fc640 1 -- 172.21.15.45:0/470323573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540ab980 con 0x7f5f600b1990 2023-07-09T02:15:12.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 -- 172.21.15.45:0/470323573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600b1990 msgr2=0x7f5f600d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 --2- 172.21.15.45:0/470323573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600b1990 0x7f5f600d2810 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5f600b4ec0 tx=0x7f5f5401c180 comp rx=0 tx=0).stop 2023-07-09T02:15:12.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 -- 172.21.15.45:0/470323573 shutdown_connections 2023-07-09T02:15:12.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 --2- 172.21.15.45:0/470323573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f600d2d50 0x7f5f6015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 --2- 172.21.15.45:0/470323573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600b1990 0x7f5f600d2810 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 --2- 172.21.15.45:0/470323573 >> v2:172.21.15.155:3300/0 conn(0x7f5f6015c3b0 0x7f5f600cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 -- 172.21.15.45:0/470323573 >> 172.21.15.45:0/470323573 conn(0x7f5f60070be0 msgr2=0x7f5f60070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 -- 172.21.15.45:0/470323573 shutdown_connections 2023-07-09T02:15:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.754+0000 7f5f6611f640 1 -- 172.21.15.45:0/470323573 wait complete. 2023-07-09T02:15:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 Processor -- start 2023-07-09T02:15:12.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 -- start start 2023-07-09T02:15:12.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f600b1990 0x7f5f60146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600d2d50 0x7f5f6015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6015c3b0 0x7f5f600d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6015d200 con 0x7f5f600d2d50 2023-07-09T02:15:12.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60146f00 con 0x7f5f600b1990 2023-07-09T02:15:12.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60147f10 con 0x7f5f6015c3b0 2023-07-09T02:15:12.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600d2d50 0x7f5f6015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600d2d50 0x7f5f6015ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34616/0 (socket says 172.21.15.45:34616) 2023-07-09T02:15:12.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 -- 172.21.15.45:0/2388294586 learned_addr learned my addr 172.21.15.45:0/2388294586 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 -- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6015c3b0 msgr2=0x7f5f600d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6015c3b0 0x7f5f600d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 -- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f600b1990 msgr2=0x7f5f60146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f600b1990 0x7f5f60146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 -- 172.21.15.45:0/2388294586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540094d0 con 0x7f5f600d2d50 2023-07-09T02:15:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f5effd640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600d2d50 0x7f5f6015ca20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5f5401a830 tx=0x7f5f54018f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f47fff640 1 -- 172.21.15.45:0/2388294586 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540abe30 con 0x7f5f600d2d50 2023-07-09T02:15:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f47fff640 1 -- 172.21.15.45:0/2388294586 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f540b4420 con 0x7f5f600d2d50 2023-07-09T02:15:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f47fff640 1 -- 172.21.15.45:0/2388294586 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540b4790 con 0x7f5f600d2d50 2023-07-09T02:15:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6015cf60 con 0x7f5f600d2d50 2023-07-09T02:15:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.758+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f60147430 con 0x7f5f600d2d50 2023-07-09T02:15:12.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.762+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6004d7d0 con 0x7f5f600d2d50 2023-07-09T02:15:12.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.762+0000 7f5f47fff640 1 -- 172.21.15.45:0/2388294586 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f540b2070 con 0x7f5f600d2d50 2023-07-09T02:15:12.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.762+0000 7f5f47fff640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:12.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.762+0000 7f5f47fff640 1 -- 172.21.15.45:0/2388294586 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5f5411d6a0 con 0x7f5f600d2d50 2023-07-09T02:15:12.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.762+0000 7f5f5f7fe640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:12.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.762+0000 7f5f5f7fe640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f50006aa0 tx=0x7f5f50006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:12.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.766+0000 7f5f47fff640 1 -- 172.21.15.45:0/2388294586 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f540eacf0 con 0x7f5f600d2d50 2023-07-09T02:15:12.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:12.926+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5f6015fd10 con 0x7f5f600d2d50 2023-07-09T02:15:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.586+0000 7f5f47fff640 1 -- 172.21.15.45:0/2388294586 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5f540ee310 con 0x7f5f600d2d50 2023-07-09T02:15:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:15:13.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 msgr2=0x7f5f4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:13.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f50006aa0 tx=0x7f5f50006a30 comp rx=0 tx=0).stop 2023-07-09T02:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600d2d50 msgr2=0x7f5f6015ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600d2d50 0x7f5f6015ca20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5f5401a830 tx=0x7f5f54018f20 comp rx=0 tx=0).stop 2023-07-09T02:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 shutdown_connections 2023-07-09T02:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6015c3b0 0x7f5f600d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f600d2d50 0x7f5f6015ca20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 --2- 172.21.15.45:0/2388294586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f600b1990 0x7f5f60146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 >> 172.21.15.45:0/2388294586 conn(0x7f5f60070be0 msgr2=0x7f5f60151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:13.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 shutdown_connections 2023-07-09T02:15:13.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.598+0000 7f5f6611f640 1 -- 172.21.15.45:0/2388294586 wait complete. 2023-07-09T02:15:13.621 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:15:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08d1c6d640 1 Processor -- start 2023-07-09T02:15:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08d1c6d640 1 -- start start 2023-07-09T02:15:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08d1c6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08cc15c060 0x7f08cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08d1c6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f08cc0cd120 0x7f08cc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08d1c6d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc160a50 con 0x7f08cc0d2450 2023-07-09T02:15:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08d1c6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0d28d0 con 0x7f08cc15c060 2023-07-09T02:15:13.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08d1c6d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0cfe40 con 0x7f08cc0cd120 2023-07-09T02:15:13.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08cb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08cc15c060 0x7f08cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:13.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08cb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08cc15c060 0x7f08cc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34622/0 (socket says 172.21.15.45:34622) 2023-07-09T02:15:13.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08cb7fe640 1 -- 172.21.15.45:0/936281251 learned_addr learned my addr 172.21.15.45:0/936281251 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:13.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08caffd640 1 --2- 172.21.15.45:0/936281251 >> v2:172.21.15.155:3300/0 conn(0x7f08cc0cd120 0x7f08cc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:13.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08cb7fe640 1 -- 172.21.15.45:0/936281251 >> v2:172.21.15.155:3300/0 conn(0x7f08cc0cd120 msgr2=0x7f08cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:13.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08cb7fe640 1 --2- 172.21.15.45:0/936281251 >> v2:172.21.15.155:3300/0 conn(0x7f08cc0cd120 0x7f08cc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08cb7fe640 1 -- 172.21.15.45:0/936281251 >> v1:172.21.15.45:6789/0 conn(0x7f08cc0d2450 legacy=0x7f08cc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:13.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.770+0000 7f08cb7fe640 1 -- 172.21.15.45:0/936281251 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc15c430 con 0x7f08cc15c060 2023-07-09T02:15:13.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08cb7fe640 1 --2- 172.21.15.45:0/936281251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b4ed0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f08cc15fac0 tx=0x7f08bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d9a36e8d8c2b2d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:13.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08ca7fc640 1 -- 172.21.15.45:0/936281251 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0ab5f0 con 0x7f08cc15c060 2023-07-09T02:15:13.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08ca7fc640 1 -- 172.21.15.45:0/936281251 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc0ab750 con 0x7f08cc15c060 2023-07-09T02:15:13.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08ca7fc640 1 -- 172.21.15.45:0/936281251 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0abae0 con 0x7f08cc15c060 2023-07-09T02:15:13.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08d1c6d640 1 -- 172.21.15.45:0/936281251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 msgr2=0x7f08cc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:13.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/936281251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b4ed0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f08cc15fac0 tx=0x7f08bc01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08d1c6d640 1 -- 172.21.15.45:0/936281251 shutdown_connections 2023-07-09T02:15:13.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/936281251 >> v2:172.21.15.155:3300/0 conn(0x7f08cc0cd120 0x7f08cc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/936281251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b4ed0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08d1c6d640 1 -- 172.21.15.45:0/936281251 >> 172.21.15.45:0/936281251 conn(0x7f08cc0698e0 msgr2=0x7f08cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:13.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08d1c6d640 1 -- 172.21.15.45:0/936281251 shutdown_connections 2023-07-09T02:15:13.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.774+0000 7f08d1c6d640 1 -- 172.21.15.45:0/936281251 wait complete. 2023-07-09T02:15:13.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 Processor -- start 2023-07-09T02:15:13.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 -- start start 2023-07-09T02:15:13.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08cc0cd120 0x7f08cc0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:13.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08cc0d2450 0x7f08cc153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:13.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:13.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0b4240 con 0x7f08cc15c060 2023-07-09T02:15:13.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0cab60 con 0x7f08cc0cd120 2023-07-09T02:15:13.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15a770 con 0x7f08cc0d2450 2023-07-09T02:15:13.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:13.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34636/0 (socket says 172.21.15.45:34636) 2023-07-09T02:15:13.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 -- 172.21.15.45:0/3754980965 learned_addr learned my addr 172.21.15.45:0/3754980965 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:13.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cb7fe640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08cc0cd120 0x7f08cc0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:13.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08caffd640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08cc0d2450 0x7f08cc153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:13.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 -- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08cc0d2450 msgr2=0x7f08cc153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:13.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08cc0d2450 0x7f08cc153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 -- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08cc0cd120 msgr2=0x7f08cc0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:13.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08cc0cd120 0x7f08cc0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:13.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 -- 172.21.15.45:0/3754980965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0094d0 con 0x7f08cc15c060 2023-07-09T02:15:13.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08cbfff640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b2460 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f08c400c770 tx=0x7f08c400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:13.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08b3fff640 1 -- 172.21.15.45:0/3754980965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4003b80 con 0x7f08cc15c060 2023-07-09T02:15:13.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08b3fff640 1 -- 172.21.15.45:0/3754980965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4003ce0 con 0x7f08cc15c060 2023-07-09T02:15:13.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08b3fff640 1 -- 172.21.15.45:0/3754980965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400aa90 con 0x7f08cc15c060 2023-07-09T02:15:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc15aa50 con 0x7f08cc15c060 2023-07-09T02:15:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.778+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc0cae00 con 0x7f08cc15c060 2023-07-09T02:15:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.782+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc04d7d0 con 0x7f08cc15c060 2023-07-09T02:15:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.782+0000 7f08b3fff640 1 -- 172.21.15.45:0/3754980965 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08c400abf0 con 0x7f08cc15c060 2023-07-09T02:15:13.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.782+0000 7f08b3fff640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08b8066280 0x7f08b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:13.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.782+0000 7f08b3fff640 1 -- 172.21.15.45:0/3754980965 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f08c4084650 con 0x7f08cc15c060 2023-07-09T02:15:13.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.786+0000 7f08cb7fe640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08b8066280 0x7f08b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:13.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.786+0000 7f08cb7fe640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08b8066280 0x7f08b8068730 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0af000 tx=0x7f08bc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:13.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.786+0000 7f08b3fff640 1 -- 172.21.15.45:0/3754980965 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08c4051b10 con 0x7f08cc15c060 2023-07-09T02:15:13.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:13.974+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f08cc06baa0 con 0x7f08cc15c060 2023-07-09T02:15:14.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.586+0000 7f08b3fff640 1 -- 172.21.15.45:0/3754980965 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v38) v1 ==== 174+0+0 (secure 0 0 0) 0x7f08c4055130 con 0x7f08cc15c060 2023-07-09T02:15:14.586 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 11 and data pool 12 2023-07-09T02:15:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08b8066280 msgr2=0x7f08b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08b8066280 0x7f08b8068730 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0af000 tx=0x7f08bc0a7000 comp rx=0 tx=0).stop 2023-07-09T02:15:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 msgr2=0x7f08cc0b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b2460 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f08c400c770 tx=0x7f08c400cc30 comp rx=0 tx=0).stop 2023-07-09T02:15:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 shutdown_connections 2023-07-09T02:15:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc15c060 0x7f08cc0b2460 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08b8066280 0x7f08b8068730 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f08cc0d2450 0x7f08cc153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 --2- 172.21.15.45:0/3754980965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08cc0cd120 0x7f08cc0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 >> 172.21.15.45:0/3754980965 conn(0x7f08cc0698e0 msgr2=0x7f08cc0b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 shutdown_connections 2023-07-09T02:15:14.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.590+0000 7f08d1c6d640 1 -- 172.21.15.45:0/3754980965 wait complete. 2023-07-09T02:15:14.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:15:14.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aaf09e640 1 Processor -- start 2023-07-09T02:15:14.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aaf09e640 1 -- start start 2023-07-09T02:15:14.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aaf09e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3aa80cd120 0x7f3aa80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:14.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aaf09e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa8160a50 con 0x7f3aa80d2620 2023-07-09T02:15:14.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aaf09e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa815c430 con 0x7f3aa815c060 2023-07-09T02:15:14.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aaf09e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa815fb60 con 0x7f3aa80cd120 2023-07-09T02:15:14.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3aa80d2620 0x7f3aa80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38812/0 (socket says 172.21.15.45:38812) 2023-07-09T02:15:14.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa7fff640 1 -- 172.21.15.45:0/729629408 learned_addr learned my addr 172.21.15.45:0/729629408 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:14.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aad63b640 1 --2- 172.21.15.45:0/729629408 >> v2:172.21.15.155:3300/0 conn(0x7f3aa80cd120 0x7f3aa80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:14.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216223943 0 0) 0x7f3aa8160a50 con 0x7f3aa80d2620 2023-07-09T02:15:14.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a98003530 con 0x7f3aa80d2620 2023-07-09T02:15:14.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539122168 0 0) 0x7f3aa815c430 con 0x7f3aa815c060 2023-07-09T02:15:14.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa8160a50 con 0x7f3aa815c060 2023-07-09T02:15:14.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268495024 0 0) 0x7f3a98003530 con 0x7f3aa80d2620 2023-07-09T02:15:14.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 >> v2:172.21.15.155:3300/0 conn(0x7f3aa80cd120 msgr2=0x7f3aa80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:14.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 --2- 172.21.15.45:0/729629408 >> v2:172.21.15.155:3300/0 conn(0x7f3aa80cd120 0x7f3aa80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 >> v1:172.21.15.155:6789/0 conn(0x7f3aa815c060 legacy=0x7f3aa80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa815fe40 con 0x7f3aa80d2620 2023-07-09T02:15:14.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f3a94001680 con 0x7f3aa80d2620 2023-07-09T02:15:14.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 >> v1:172.21.15.45:6789/0 conn(0x7f3aa80d2620 legacy=0x7f3aa80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a98003b60 0x7f3a98003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:14.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a980047d0 0x7f3a98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:14.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a98005180 0x7f3a9800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:14.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa815fb60 con 0x7f3a980047d0 2023-07-09T02:15:14.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9800c060 con 0x7f3a98005180 2023-07-09T02:15:14.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9800c1f0 con 0x7f3a98003b60 2023-07-09T02:15:14.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa7fff640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a980047d0 0x7f3a98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:14.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aace3a640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a98003b60 0x7f3a98003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:14.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aad63b640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a98005180 0x7f3a9800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:14.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa7fff640 1 -- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a98003b60 msgr2=0x7f3a98003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:14.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa7fff640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a98003b60 0x7f3a98003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa7fff640 1 -- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a98005180 msgr2=0x7f3a9800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:14.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa7fff640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a98005180 0x7f3a9800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aa7fff640 1 -- 172.21.15.45:0/729629408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98003530 con 0x7f3a980047d0 2023-07-09T02:15:14.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aad63b640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a98005180 0x7f3a9800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:14.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.758+0000 7f3aad63b640 1 -- 172.21.15.45:0/729629408 reap_dead start 2023-07-09T02:15:14.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aa7fff640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a980047d0 0x7f3a98004c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80d2a10 tx=0x7f3a9401caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5649b00426604c43 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:14.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94005ae0 con 0x7f3a980047d0 2023-07-09T02:15:14.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a94005c40 con 0x7f3a980047d0 2023-07-09T02:15:14.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aa77fe640 1 -- 172.21.15.45:0/729629408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a940a59d0 con 0x7f3a980047d0 2023-07-09T02:15:14.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aaf09e640 1 -- 172.21.15.45:0/729629408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a980047d0 msgr2=0x7f3a98004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aaf09e640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a980047d0 0x7f3a98004c40 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80d2a10 tx=0x7f3a9401caa0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aaf09e640 1 -- 172.21.15.45:0/729629408 shutdown_connections 2023-07-09T02:15:14.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aaf09e640 1 --2- 172.21.15.45:0/729629408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a980047d0 0x7f3a98004c40 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aaf09e640 1 -- 172.21.15.45:0/729629408 >> 172.21.15.45:0/729629408 conn(0x7f3aa80698e0 msgr2=0x7f3aa8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:14.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aaf09e640 1 -- 172.21.15.45:0/729629408 shutdown_connections 2023-07-09T02:15:14.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.762+0000 7f3aaf09e640 1 -- 172.21.15.45:0/729629408 wait complete. 2023-07-09T02:15:14.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aaf09e640 1 Processor -- start 2023-07-09T02:15:14.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aaf09e640 1 -- start start 2023-07-09T02:15:14.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aaf09e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a980047d0 0x7f3aa8159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:14.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aaf09e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3aa81f17d0 0x7f3aa8158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:14.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aaf09e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa80ca020 0x7f3aa80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:14.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aaf09e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa815c660 con 0x7f3aa80ca020 2023-07-09T02:15:14.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aaf09e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80ccc30 con 0x7f3aa81f17d0 2023-07-09T02:15:14.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aaf09e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80cc3f0 con 0x7f3a980047d0 2023-07-09T02:15:14.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa80ca020 0x7f3aa80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:14.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa80ca020 0x7f3aa80ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34660/0 (socket says 172.21.15.45:34660) 2023-07-09T02:15:14.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aa7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3aa81f17d0 0x7f3aa8158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:14.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 -- 172.21.15.45:0/2344927950 learned_addr learned my addr 172.21.15.45:0/2344927950 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:14.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aace3a640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a980047d0 0x7f3aa8159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:14.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 -- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a980047d0 msgr2=0x7f3aa8159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a980047d0 0x7f3aa8159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 -- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3aa81f17d0 msgr2=0x7f3aa8158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3aa81f17d0 0x7f3aa8158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 -- 172.21.15.45:0/2344927950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa80cc670 con 0x7f3aa80ca020 2023-07-09T02:15:14.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aad63b640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa80ca020 0x7f3aa80ca490 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3aa806a730 tx=0x7f3aa0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:14.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.766+0000 7f3aa57fa640 1 -- 172.21.15.45:0/2344927950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa001a070 con 0x7f3aa80ca020 2023-07-09T02:15:14.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aa57fa640 1 -- 172.21.15.45:0/2344927950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa000f040 con 0x7f3aa80ca020 2023-07-09T02:15:14.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aa57fa640 1 -- 172.21.15.45:0/2344927950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000e070 con 0x7f3aa80ca020 2023-07-09T02:15:14.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa80cc950 con 0x7f3aa80ca020 2023-07-09T02:15:14.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa815cb20 con 0x7f3aa80ca020 2023-07-09T02:15:14.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa815cd10 con 0x7f3aa80ca020 2023-07-09T02:15:14.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aa57fa640 1 -- 172.21.15.45:0/2344927950 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3aa0015710 con 0x7f3aa80ca020 2023-07-09T02:15:14.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aa57fa640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3a8c066280 0x7f3a8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:14.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aa57fa640 1 -- 172.21.15.45:0/2344927950 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3aa0083810 con 0x7f3aa80ca020 2023-07-09T02:15:14.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aace3a640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3a8c066280 0x7f3a8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:14.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.770+0000 7f3aace3a640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3a8c066280 0x7f3a8c068730 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c000c10 tx=0x7f3a9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:14.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.774+0000 7f3aa57fa640 1 -- 172.21.15.45:0/2344927950 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3aa0050d30 con 0x7f3aa80ca020 2023-07-09T02:15:14.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.930+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3aa804d7d0 con 0x7f3aa80ca020 2023-07-09T02:15:14.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.930+0000 7f3aa57fa640 1 -- 172.21.15.45:0/2344927950 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18367 (secure 0 0 0) 0x7f3aa0054350 con 0x7f3aa80ca020 2023-07-09T02:15:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:14.932 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:15:13.976843+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:15:12.532657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T02:15:12.972198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:15:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3a8c066280 msgr2=0x7f3a8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3a8c066280 0x7f3a8c068730 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c000c10 tx=0x7f3a9c009040 comp rx=0 tx=0).stop 2023-07-09T02:15:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa80ca020 msgr2=0x7f3aa80ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa80ca020 0x7f3aa80ca490 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3aa806a730 tx=0x7f3aa0007dd0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 shutdown_connections 2023-07-09T02:15:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa80ca020 0x7f3aa80ca490 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3aa81f17d0 0x7f3aa8158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3a8c066280 0x7f3a8c068730 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 --2- 172.21.15.45:0/2344927950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a980047d0 0x7f3aa8159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 >> 172.21.15.45:0/2344927950 conn(0x7f3aa80698e0 msgr2=0x7f3aa80cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 shutdown_connections 2023-07-09T02:15:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:14.934+0000 7f3aaf09e640 1 -- 172.21.15.45:0/2344927950 wait complete. 2023-07-09T02:15:14.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:15:15.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddf12d8640 1 Processor -- start 2023-07-09T02:15:15.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddf12d8640 1 -- start start 2023-07-09T02:15:15.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddf12d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fddec15c060 0x7fddec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddf12d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0d2620 0x7fddec0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddf12d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec160a50 con 0x7fddec0cd120 2023-07-09T02:15:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddf12d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec15c430 con 0x7fddec15c060 2023-07-09T02:15:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddf12d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec15fb60 con 0x7fddec0d2620 2023-07-09T02:15:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddeaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fddec15c060 0x7fddec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddeaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fddec15c060 0x7fddec0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34666/0 (socket says 172.21.15.45:34666) 2023-07-09T02:15:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddeaffd640 1 -- 172.21.15.45:0/2159807051 learned_addr learned my addr 172.21.15.45:0/2159807051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:15.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddeb7fe640 1 --2- 172.21.15.45:0/2159807051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0d2620 0x7fddec0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddeaffd640 1 -- 172.21.15.45:0/2159807051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0d2620 msgr2=0x7fddec0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddeaffd640 1 --2- 172.21.15.45:0/2159807051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0d2620 0x7fddec0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.098+0000 7fddeaffd640 1 -- 172.21.15.45:0/2159807051 >> v1:172.21.15.45:6789/0 conn(0x7fddec0cd120 legacy=0x7fddec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddeaffd640 1 -- 172.21.15.45:0/2159807051 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec15fe40 con 0x7fddec15c060 2023-07-09T02:15:15.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddeb7fe640 1 --2- 172.21.15.45:0/2159807051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0d2620 0x7fddec0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:15.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddeaffd640 1 --2- 172.21.15.45:0/2159807051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0b4ed0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009870 tx=0x7fdddc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2905ddc5dc67020 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:15.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddea7fc640 1 -- 172.21.15.45:0/2159807051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0aa670 con 0x7fddec15c060 2023-07-09T02:15:15.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddea7fc640 1 -- 172.21.15.45:0/2159807051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc0aa7d0 con 0x7fddec15c060 2023-07-09T02:15:15.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddea7fc640 1 -- 172.21.15.45:0/2159807051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0aab60 con 0x7fddec15c060 2023-07-09T02:15:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddf12d8640 1 -- 172.21.15.45:0/2159807051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 msgr2=0x7fddec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddf12d8640 1 --2- 172.21.15.45:0/2159807051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0b4ed0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009870 tx=0x7fdddc01c510 comp rx=0 tx=0).stop 2023-07-09T02:15:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddf12d8640 1 -- 172.21.15.45:0/2159807051 shutdown_connections 2023-07-09T02:15:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddf12d8640 1 --2- 172.21.15.45:0/2159807051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0d2620 0x7fddec0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddf12d8640 1 --2- 172.21.15.45:0/2159807051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0b4ed0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddf12d8640 1 -- 172.21.15.45:0/2159807051 >> 172.21.15.45:0/2159807051 conn(0x7fddec0698e0 msgr2=0x7fddec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.102+0000 7fddf12d8640 1 -- 172.21.15.45:0/2159807051 shutdown_connections 2023-07-09T02:15:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 -- 172.21.15.45:0/2159807051 wait complete. 2023-07-09T02:15:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 Processor -- start 2023-07-09T02:15:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 -- start start 2023-07-09T02:15:15.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0cd120 0x7fddec15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddec0d2620 0x7fddec153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec15d440 con 0x7fddec15c060 2023-07-09T02:15:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec157bc0 con 0x7fddec0d2620 2023-07-09T02:15:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec15c570 con 0x7fddec0cd120 2023-07-09T02:15:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34682/0 (socket says 172.21.15.45:34682) 2023-07-09T02:15:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 -- 172.21.15.45:0/540969337 learned_addr learned my addr 172.21.15.45:0/540969337 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeaffd640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0cd120 0x7fddec15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fdde3fff640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddec0d2620 0x7fddec153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 -- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0cd120 msgr2=0x7fddec15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0cd120 0x7fddec15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 -- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddec0d2620 msgr2=0x7fddec153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddec0d2620 0x7fddec153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 -- 172.21.15.45:0/540969337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0094d0 con 0x7fddec15c060 2023-07-09T02:15:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fdde3fff640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddec0d2620 0x7fddec153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:15.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddeb7fe640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0c9100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdde400ce70 tx=0x7fdde400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:15.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fdde37fe640 1 -- 172.21.15.45:0/540969337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4003ba0 con 0x7fddec15c060 2023-07-09T02:15:15.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fdde37fe640 1 -- 172.21.15.45:0/540969337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde4003d20 con 0x7fddec15c060 2023-07-09T02:15:15.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fdde37fe640 1 -- 172.21.15.45:0/540969337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde400d880 con 0x7fddec15c060 2023-07-09T02:15:15.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.106+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec0b59f0 con 0x7fddec15c060 2023-07-09T02:15:15.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.110+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec15c7c0 con 0x7fddec15c060 2023-07-09T02:15:15.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.110+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec15d580 con 0x7fddec15c060 2023-07-09T02:15:15.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.110+0000 7fdde37fe640 1 -- 172.21.15.45:0/540969337 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdde400d9e0 con 0x7fddec15c060 2023-07-09T02:15:15.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.110+0000 7fdde37fe640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fddcc066280 0x7fddcc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.110+0000 7fdde37fe640 1 -- 172.21.15.45:0/540969337 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdde40844f0 con 0x7fddec15c060 2023-07-09T02:15:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.110+0000 7fddeaffd640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fddcc066280 0x7fddcc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.114+0000 7fddeaffd640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fddcc066280 0x7fddcc068730 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0ae000 tx=0x7fdddc0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.114+0000 7fdde37fe640 1 -- 172.21.15.45:0/540969337 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddec15d580 con 0x7fddec15c060 2023-07-09T02:15:15.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.278+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddec15d580 con 0x7fddec15c060 2023-07-09T02:15:15.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fdde37fe640 1 -- 172.21.15.45:0/540969337 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18367 (secure 0 0 0) 0x7fddec15d580 con 0x7fddec15c060 2023-07-09T02:15:15.281 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:15.282 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:15:13.976843+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:15:12.532657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T02:15:12.972198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:15:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fddcc066280 msgr2=0x7fddcc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fddcc066280 0x7fddcc068730 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0ae000 tx=0x7fdddc0b5040 comp rx=0 tx=0).stop 2023-07-09T02:15:15.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 msgr2=0x7fddec0c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0c9100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdde400ce70 tx=0x7fdde400a710 comp rx=0 tx=0).stop 2023-07-09T02:15:15.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 shutdown_connections 2023-07-09T02:15:15.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddec15c060 0x7fddec0c9100 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddec0d2620 0x7fddec153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fddcc066280 0x7fddcc068730 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 --2- 172.21.15.45:0/540969337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddec0cd120 0x7fddec15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 >> 172.21.15.45:0/540969337 conn(0x7fddec0698e0 msgr2=0x7fddec1585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 shutdown_connections 2023-07-09T02:15:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.282+0000 7fddf12d8640 1 -- 172.21.15.45:0/540969337 wait complete. 2023-07-09T02:15:15.302 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:15:15.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fd218f640 1 Processor -- start 2023-07-09T02:15:15.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fd218f640 1 -- start start 2023-07-09T02:15:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fd218f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc15c060 0x7f1fcc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fd218f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fcc0cd120 0x7f1fcc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fd218f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc160a50 con 0x7f1fcc0d2450 2023-07-09T02:15:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fd218f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc0d28f0 con 0x7f1fcc0cd120 2023-07-09T02:15:15.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fd218f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0cfe40 con 0x7f1fcc15c060 2023-07-09T02:15:15.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fcaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fcc0cd120 0x7f1fcc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fcaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fcc0cd120 0x7f1fcc0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34694/0 (socket says 172.21.15.45:34694) 2023-07-09T02:15:15.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fcaffd640 1 -- 172.21.15.45:0/2827109906 learned_addr learned my addr 172.21.15.45:0/2827109906 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:15.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fcb7fe640 1 --2- 172.21.15.45:0/2827109906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc15c060 0x7f1fcc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fcaffd640 1 -- 172.21.15.45:0/2827109906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc15c060 msgr2=0x7f1fcc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:15.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fcaffd640 1 --2- 172.21.15.45:0/2827109906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc15c060 0x7f1fcc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fcaffd640 1 -- 172.21.15.45:0/2827109906 >> v1:172.21.15.155:6789/0 conn(0x7f1fcc0d2450 legacy=0x7f1fcc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.450+0000 7f1fcaffd640 1 -- 172.21.15.45:0/2827109906 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc15c430 con 0x7f1fcc0cd120 2023-07-09T02:15:15.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fcaffd640 1 --2- 172.21.15.45:0/2827109906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc0cd120 0x7f1fcc0d1f10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009870 tx=0x7f1fc001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33865937a47de8b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:15.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fca7fc640 1 -- 172.21.15.45:0/2827109906 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00a7070 con 0x7f1fcc0cd120 2023-07-09T02:15:15.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fca7fc640 1 -- 172.21.15.45:0/2827109906 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00ab430 con 0x7f1fcc0cd120 2023-07-09T02:15:15.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fca7fc640 1 -- 172.21.15.45:0/2827109906 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00ab7c0 con 0x7f1fcc0cd120 2023-07-09T02:15:15.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fd218f640 1 -- 172.21.15.45:0/2827109906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc0cd120 msgr2=0x7f1fcc0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2827109906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc0cd120 0x7f1fcc0d1f10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009870 tx=0x7f1fc001c510 comp rx=0 tx=0).stop 2023-07-09T02:15:15.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fd218f640 1 -- 172.21.15.45:0/2827109906 shutdown_connections 2023-07-09T02:15:15.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2827109906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc0cd120 0x7f1fcc0d1f10 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2827109906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc15c060 0x7f1fcc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fd218f640 1 -- 172.21.15.45:0/2827109906 >> 172.21.15.45:0/2827109906 conn(0x7f1fcc0698e0 msgr2=0x7f1fcc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:15.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fd218f640 1 -- 172.21.15.45:0/2827109906 shutdown_connections 2023-07-09T02:15:15.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.454+0000 7f1fd218f640 1 -- 172.21.15.45:0/2827109906 wait complete. 2023-07-09T02:15:15.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 Processor -- start 2023-07-09T02:15:15.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 -- start start 2023-07-09T02:15:15.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fcc0cd120 0x7f1fcc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc0d2450 0x7f1fcc0b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc15c060 0x7f1fcc15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0b1e00 con 0x7f1fcc15c060 2023-07-09T02:15:15.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0b1bd0 con 0x7f1fcc0cd120 2023-07-09T02:15:15.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc15e910 con 0x7f1fcc0d2450 2023-07-09T02:15:15.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc15c060 0x7f1fcc15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc15c060 0x7f1fcc15c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34706/0 (socket says 172.21.15.45:34706) 2023-07-09T02:15:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 -- 172.21.15.45:0/2297421544 learned_addr learned my addr 172.21.15.45:0/2297421544 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcaffd640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc0d2450 0x7f1fcc0b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcb7fe640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fcc0cd120 0x7f1fcc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 -- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc0d2450 msgr2=0x7f1fcc0b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc0d2450 0x7f1fcc0b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 -- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fcc0cd120 msgr2=0x7f1fcc0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fcc0cd120 0x7f1fcc0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:15.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 -- 172.21.15.45:0/2297421544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00094d0 con 0x7f1fcc15c060 2023-07-09T02:15:15.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fcbfff640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc15c060 0x7f1fcc15c660 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c770 tx=0x7f1fc400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:15.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fb3fff640 1 -- 172.21.15.45:0/2297421544 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4003b80 con 0x7f1fcc15c060 2023-07-09T02:15:15.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fb3fff640 1 -- 172.21.15.45:0/2297421544 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc4003ce0 con 0x7f1fcc15c060 2023-07-09T02:15:15.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fb3fff640 1 -- 172.21.15.45:0/2297421544 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400aa90 con 0x7f1fcc15c060 2023-07-09T02:15:15.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc15ebf0 con 0x7f1fcc15c060 2023-07-09T02:15:15.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc15f1b0 con 0x7f1fcc15c060 2023-07-09T02:15:15.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.458+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc15f3a0 con 0x7f1fcc15c060 2023-07-09T02:15:15.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.462+0000 7f1fb3fff640 1 -- 172.21.15.45:0/2297421544 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1fc400abf0 con 0x7f1fcc15c060 2023-07-09T02:15:15.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.462+0000 7f1fb3fff640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fb8066280 0x7f1fb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:15.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.462+0000 7f1fb3fff640 1 -- 172.21.15.45:0/2297421544 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1fc4083a60 con 0x7f1fcc15c060 2023-07-09T02:15:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.462+0000 7f1fcb7fe640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fb8066280 0x7f1fb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:15.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.462+0000 7f1fcb7fe640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fb8066280 0x7f1fb8068730 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc15e700 tx=0x7f1fbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:15.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.466+0000 7f1fb3fff640 1 -- 172.21.15.45:0/2297421544 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fc4050f80 con 0x7f1fcc15c060 2023-07-09T02:15:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:15.658+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1fcc04d7d0 con 0x7f1fcc15c060 2023-07-09T02:15:16.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.606+0000 7f1fb3fff640 1 -- 172.21.15.45:0/2297421544 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1fc40545a0 con 0x7f1fcc15c060 2023-07-09T02:15:16.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fb8066280 msgr2=0x7f1fb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:16.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fb8066280 0x7f1fb8068730 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc15e700 tx=0x7f1fbc008040 comp rx=0 tx=0).stop 2023-07-09T02:15:16.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc15c060 msgr2=0x7f1fcc15c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc15c060 0x7f1fcc15c660 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c770 tx=0x7f1fc400cc30 comp rx=0 tx=0).stop 2023-07-09T02:15:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 shutdown_connections 2023-07-09T02:15:16.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fcc15c060 0x7f1fcc15c660 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fb8066280 0x7f1fb8068730 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fcc0d2450 0x7f1fcc0b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 --2- 172.21.15.45:0/2297421544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fcc0cd120 0x7f1fcc0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 >> 172.21.15.45:0/2297421544 conn(0x7f1fcc0698e0 msgr2=0x7f1fcc1576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 shutdown_connections 2023-07-09T02:15:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.610+0000 7f1fd218f640 1 -- 172.21.15.45:0/2297421544 wait complete. 2023-07-09T02:15:16.633 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:15:16.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:15:16.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.782+0000 7f76fbabd640 1 Processor -- start 2023-07-09T02:15:16.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.782+0000 7f76fbabd640 1 -- start start 2023-07-09T02:15:16.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76fbabd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76f4158e30 0x7f76f406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:16.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76fbabd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406fd10 0x7f76f406c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:16.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76fbabd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f76f406c650 0x7f76f40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:16.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76fbabd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f406cad0 con 0x7f76f4158e30 2023-07-09T02:15:16.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76fbabd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f40ccf80 con 0x7f76f406c650 2023-07-09T02:15:16.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76fbabd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40cd540 con 0x7f76f406fd10 2023-07-09T02:15:16.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9859640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76f4158e30 0x7f76f406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9859640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76f4158e30 0x7f76f406f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34720/0 (socket says 172.21.15.45:34720) 2023-07-09T02:15:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9859640 1 -- 172.21.15.45:0/3778438966 learned_addr learned my addr 172.21.15.45:0/3778438966 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9058640 1 --2- 172.21.15.45:0/3778438966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406fd10 0x7f76f406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76fa05a640 1 --2- 172.21.15.45:0/3778438966 >> v2:172.21.15.155:3300/0 conn(0x7f76f406c650 0x7f76f40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9859640 1 -- 172.21.15.45:0/3778438966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406fd10 msgr2=0x7f76f406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9859640 1 --2- 172.21.15.45:0/3778438966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406fd10 0x7f76f406c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9859640 1 -- 172.21.15.45:0/3778438966 >> v2:172.21.15.155:3300/0 conn(0x7f76f406c650 msgr2=0x7f76f40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:16.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9859640 1 --2- 172.21.15.45:0/3778438966 >> v2:172.21.15.155:3300/0 conn(0x7f76f406c650 0x7f76f40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9859640 1 -- 172.21.15.45:0/3778438966 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f40c8fb0 con 0x7f76f4158e30 2023-07-09T02:15:16.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76fa05a640 1 --2- 172.21.15.45:0/3778438966 >> v2:172.21.15.155:3300/0 conn(0x7f76f406c650 0x7f76f40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:16.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.786+0000 7f76f9058640 1 --2- 172.21.15.45:0/3778438966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406fd10 0x7f76f406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:16.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76f9859640 1 --2- 172.21.15.45:0/3778438966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f406f7d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f76f40adf40 tx=0x7f76f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e000a418942bb07d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:16.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76f8857640 1 -- 172.21.15.45:0/3778438966 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00ab620 con 0x7f76f4158e30 2023-07-09T02:15:16.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76f8857640 1 -- 172.21.15.45:0/3778438966 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00ab780 con 0x7f76f4158e30 2023-07-09T02:15:16.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76f8857640 1 -- 172.21.15.45:0/3778438966 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00abb10 con 0x7f76f4158e30 2023-07-09T02:15:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 -- 172.21.15.45:0/3778438966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 msgr2=0x7f76f406f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 --2- 172.21.15.45:0/3778438966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f406f7d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f76f40adf40 tx=0x7f76f001c440 comp rx=0 tx=0).stop 2023-07-09T02:15:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 -- 172.21.15.45:0/3778438966 shutdown_connections 2023-07-09T02:15:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 --2- 172.21.15.45:0/3778438966 >> v2:172.21.15.155:3300/0 conn(0x7f76f406c650 0x7f76f40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 --2- 172.21.15.45:0/3778438966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406fd10 0x7f76f406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 --2- 172.21.15.45:0/3778438966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f406f7d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 -- 172.21.15.45:0/3778438966 >> 172.21.15.45:0/3778438966 conn(0x7f76f40694b0 msgr2=0x7f76f40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 -- 172.21.15.45:0/3778438966 shutdown_connections 2023-07-09T02:15:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 -- 172.21.15.45:0/3778438966 wait complete. 2023-07-09T02:15:16.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 Processor -- start 2023-07-09T02:15:16.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 -- start start 2023-07-09T02:15:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406c650 0x7f76f4146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f406fd10 0x7f76f414c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f4144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40b0a90 con 0x7f76f4158e30 2023-07-09T02:15:16.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.790+0000 7f76fbabd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f415b540 con 0x7f76f406fd10 2023-07-09T02:15:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fbabd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f415c310 con 0x7f76f406c650 2023-07-09T02:15:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f4144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76f9859640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406c650 0x7f76f4146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76f9058640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f406fd10 0x7f76f414c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f4144060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34736/0 (socket says 172.21.15.45:34736) 2023-07-09T02:15:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 -- 172.21.15.45:0/2644485099 learned_addr learned my addr 172.21.15.45:0/2644485099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 -- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406c650 msgr2=0x7f76f4146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:16.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406c650 0x7f76f4146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 -- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f406fd10 msgr2=0x7f76f414c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f406fd10 0x7f76f414c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:16.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 -- 172.21.15.45:0/2644485099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00094d0 con 0x7f76f4158e30 2023-07-09T02:15:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fa05a640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f4144060 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f76ec007e40 tx=0x7f76ec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76ea7fc640 1 -- 172.21.15.45:0/2644485099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec003ba0 con 0x7f76f4158e30 2023-07-09T02:15:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76ea7fc640 1 -- 172.21.15.45:0/2644485099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec00f040 con 0x7f76f4158e30 2023-07-09T02:15:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76ea7fc640 1 -- 172.21.15.45:0/2644485099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00de80 con 0x7f76f4158e30 2023-07-09T02:15:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f415b790 con 0x7f76f4158e30 2023-07-09T02:15:16.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f415bd50 con 0x7f76f4158e30 2023-07-09T02:15:16.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f414e870 con 0x7f76f4158e30 2023-07-09T02:15:16.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.794+0000 7f76ea7fc640 1 -- 172.21.15.45:0/2644485099 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76ec004030 con 0x7f76f4158e30 2023-07-09T02:15:16.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.798+0000 7f76ea7fc640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d8066280 0x7f76d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:16.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.798+0000 7f76ea7fc640 1 -- 172.21.15.45:0/2644485099 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76ec083fc0 con 0x7f76f4158e30 2023-07-09T02:15:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.798+0000 7f76f9859640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d8066280 0x7f76d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:16.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.798+0000 7f76f9859640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d8066280 0x7f76d8068730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f76f00af000 tx=0x7f76f00b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:16.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.802+0000 7f76ea7fc640 1 -- 172.21.15.45:0/2644485099 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76ec0514e0 con 0x7f76f4158e30 2023-07-09T02:15:16.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:16.986+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f76f404d7d0 con 0x7f76f4158e30 2023-07-09T02:15:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76ea7fc640 1 -- 172.21.15.45:0/2644485099 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7f76ec01a0c0 con 0x7f76f4158e30 2023-07-09T02:15:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d8066280 msgr2=0x7f76d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d8066280 0x7f76d8068730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f76f00af000 tx=0x7f76f00b6040 comp rx=0 tx=0).stop 2023-07-09T02:15:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 msgr2=0x7f76f4144060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f4144060 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f76ec007e40 tx=0x7f76ec00d4a0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 shutdown_connections 2023-07-09T02:15:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76f4158e30 0x7f76f4144060 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76f406fd10 0x7f76f414c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d8066280 0x7f76d8068730 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 --2- 172.21.15.45:0/2644485099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76f406c650 0x7f76f4146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 >> 172.21.15.45:0/2644485099 conn(0x7f76f40694b0 msgr2=0x7f76f40c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:17.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 shutdown_connections 2023-07-09T02:15:17.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.610+0000 7f76fbabd640 1 -- 172.21.15.45:0/2644485099 wait complete. 2023-07-09T02:15:17.634 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:15:17.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:15:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5640b9f640 1 Processor -- start 2023-07-09T02:15:17.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5640b9f640 1 -- start start 2023-07-09T02:15:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5640b9f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f563c06b000 0x7f563c159660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:17.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5640b9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 0x7f563c0c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5640b9f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f563c0cb5c0 0x7f563c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5640b9f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c06b3d0 con 0x7f563c0cb5c0 2023-07-09T02:15:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5640b9f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c06b690 con 0x7f563c06b000 2023-07-09T02:15:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5640b9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c06b970 con 0x7f563c0cb140 2023-07-09T02:15:17.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f563c0cb5c0 0x7f563c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f563c0cb5c0 0x7f563c155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34740/0 (socket says 172.21.15.45:34740) 2023-07-09T02:15:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563ad9d640 1 -- 172.21.15.45:0/688652852 learned_addr learned my addr 172.21.15.45:0/688652852 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563a59c640 1 --2- 172.21.15.45:0/688652852 >> v2:172.21.15.155:3300/0 conn(0x7f563c06b000 0x7f563c159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:17.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f5639d9b640 1 --2- 172.21.15.45:0/688652852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 0x7f563c0c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563ad9d640 1 -- 172.21.15.45:0/688652852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 msgr2=0x7f563c0c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563ad9d640 1 --2- 172.21.15.45:0/688652852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 0x7f563c0c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563ad9d640 1 -- 172.21.15.45:0/688652852 >> v2:172.21.15.155:3300/0 conn(0x7f563c06b000 msgr2=0x7f563c159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563ad9d640 1 --2- 172.21.15.45:0/688652852 >> v2:172.21.15.155:3300/0 conn(0x7f563c06b000 0x7f563c159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.782+0000 7f563ad9d640 1 -- 172.21.15.45:0/688652852 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c06bc50 con 0x7f563c0cb5c0 2023-07-09T02:15:17.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f563ad9d640 1 --2- 172.21.15.45:0/688652852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c155c30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f563c06ec20 tx=0x7f563401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e55f8afa31e0ec6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:17.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f563959a640 1 -- 172.21.15.45:0/688652852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340af400 con 0x7f563c0cb5c0 2023-07-09T02:15:17.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f563959a640 1 -- 172.21.15.45:0/688652852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56340ab050 con 0x7f563c0cb5c0 2023-07-09T02:15:17.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f563959a640 1 -- 172.21.15.45:0/688652852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340af780 con 0x7f563c0cb5c0 2023-07-09T02:15:17.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 -- 172.21.15.45:0/688652852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 msgr2=0x7f563c155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:17.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 --2- 172.21.15.45:0/688652852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c155c30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f563c06ec20 tx=0x7f563401f1c0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 -- 172.21.15.45:0/688652852 shutdown_connections 2023-07-09T02:15:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 --2- 172.21.15.45:0/688652852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c155c30 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 --2- 172.21.15.45:0/688652852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 0x7f563c0c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 --2- 172.21.15.45:0/688652852 >> v2:172.21.15.155:3300/0 conn(0x7f563c06b000 0x7f563c159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 -- 172.21.15.45:0/688652852 >> 172.21.15.45:0/688652852 conn(0x7f563c0694b0 msgr2=0x7f563c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 -- 172.21.15.45:0/688652852 shutdown_connections 2023-07-09T02:15:17.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.786+0000 7f5640b9f640 1 -- 172.21.15.45:0/688652852 wait complete. 2023-07-09T02:15:17.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 Processor -- start 2023-07-09T02:15:17.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 -- start start 2023-07-09T02:15:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f563c06b000 0x7f563c0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 0x7f563c14a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:17.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:17.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0b30d0 con 0x7f563c0cb5c0 2023-07-09T02:15:17.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0b27a0 con 0x7f563c06b000 2023-07-09T02:15:17.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0b2a80 con 0x7f563c0cb140 2023-07-09T02:15:17.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:17.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c0c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34756/0 (socket says 172.21.15.45:34756) 2023-07-09T02:15:17.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 -- 172.21.15.45:0/3446234282 learned_addr learned my addr 172.21.15.45:0/3446234282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:17.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5639d9b640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 0x7f563c14a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:17.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563a59c640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f563c06b000 0x7f563c0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:17.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 -- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 msgr2=0x7f563c14a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:17.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 0x7f563c14a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 -- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f563c06b000 msgr2=0x7f563c0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:17.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f563c06b000 0x7f563c0b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 -- 172.21.15.45:0/3446234282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634009b30 con 0x7f563c0cb5c0 2023-07-09T02:15:17.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f563ad9d640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c0c5790 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f56340b2040 tx=0x7f563401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:17.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f562affd640 1 -- 172.21.15.45:0/3446234282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340afc80 con 0x7f563c0cb5c0 2023-07-09T02:15:17.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f562affd640 1 -- 172.21.15.45:0/3446234282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56340afe00 con 0x7f563c0cb5c0 2023-07-09T02:15:17.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f562affd640 1 -- 172.21.15.45:0/3446234282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340ba660 con 0x7f563c0cb5c0 2023-07-09T02:15:17.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0b2d60 con 0x7f563c0cb5c0 2023-07-09T02:15:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c0b23c0 con 0x7f563c0cb5c0 2023-07-09T02:15:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.790+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c0b3240 con 0x7f563c0cb5c0 2023-07-09T02:15:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.794+0000 7f562affd640 1 -- 172.21.15.45:0/3446234282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56340b6040 con 0x7f563c0cb5c0 2023-07-09T02:15:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.794+0000 7f562affd640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f561c066280 0x7f561c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.794+0000 7f562affd640 1 -- 172.21.15.45:0/3446234282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5634121f00 con 0x7f563c0cb5c0 2023-07-09T02:15:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.794+0000 7f563a59c640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f561c066280 0x7f561c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:17.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.794+0000 7f563a59c640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f561c066280 0x7f561c068730 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f562c0099d0 tx=0x7f562c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:17.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.798+0000 7f562affd640 1 -- 172.21.15.45:0/3446234282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56340ef3a0 con 0x7f563c0cb5c0 2023-07-09T02:15:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f563c0b2ef0 con 0x7f563c0cb5c0 2023-07-09T02:15:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f562affd640 1 -- 172.21.15.45:0/3446234282 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f5634009510 con 0x7f563c0cb5c0 2023-07-09T02:15:17.982 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:17.983 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1384902817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1384902817},{"type":"v1","addr":"172.21.15.45:6835","nonce":1384902817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/324339930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":324339930},{"type":"v1","addr":"172.21.15.155:6836","nonce":324339930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/355258806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":355258806},{"type":"v1","addr":"172.21.15.45:6833","nonce":355258806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:15:13.977165+0000","modified":"2023-07-09T02:15:17.606626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6537":{"gid":6537,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1667885237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1667885237},{"type":"v1","addr":"172.21.15.155:6837","nonce":1667885237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T02:15:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-07-09T02:15:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f561c066280 msgr2=0x7f561c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f561c066280 0x7f561c068730 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f562c0099d0 tx=0x7f562c008040 comp rx=0 tx=0).stop 2023-07-09T02:15:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 msgr2=0x7f563c0c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c0c5790 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f56340b2040 tx=0x7f563401bf60 comp rx=0 tx=0).stop 2023-07-09T02:15:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 shutdown_connections 2023-07-09T02:15:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f563c0cb5c0 0x7f563c0c5790 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f561c066280 0x7f561c068730 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f563c0cb140 0x7f563c14a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 --2- 172.21.15.45:0/3446234282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f563c06b000 0x7f563c0b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 >> 172.21.15.45:0/3446234282 conn(0x7f563c0694b0 msgr2=0x7f563c14ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 shutdown_connections 2023-07-09T02:15:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:17.982+0000 7f5640b9f640 1 -- 172.21.15.45:0/3446234282 wait complete. 2023-07-09T02:15:18.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:15:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5edebd640 1 Processor -- start 2023-07-09T02:15:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5edebd640 1 -- start start 2023-07-09T02:15:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5edebd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e815c060 0x7fb5e80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5edebd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5e80cd120 0x7fb5e80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5edebd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e8160a50 con 0x7fb5e80d2450 2023-07-09T02:15:18.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5edebd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e80d28f0 con 0x7fb5e80cd120 2023-07-09T02:15:18.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5edebd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80cfe40 con 0x7fb5e815c060 2023-07-09T02:15:18.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5e80cd120 0x7fb5e80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5e80cd120 0x7fb5e80d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34766/0 (socket says 172.21.15.45:34766) 2023-07-09T02:15:18.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5dffff640 1 -- 172.21.15.45:0/2460429334 learned_addr learned my addr 172.21.15.45:0/2460429334 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:18.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5e77fe640 1 --2- 172.21.15.45:0/2460429334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e815c060 0x7fb5e80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5dffff640 1 -- 172.21.15.45:0/2460429334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e815c060 msgr2=0x7fb5e80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:18.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5dffff640 1 --2- 172.21.15.45:0/2460429334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e815c060 0x7fb5e80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5dffff640 1 -- 172.21.15.45:0/2460429334 >> v1:172.21.15.155:6789/0 conn(0x7fb5e80d2450 legacy=0x7fb5e80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.146+0000 7fb5dffff640 1 -- 172.21.15.45:0/2460429334 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e815c430 con 0x7fb5e80cd120 2023-07-09T02:15:18.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5dffff640 1 --2- 172.21.15.45:0/2460429334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e80cd120 0x7fb5e80d1f10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009870 tx=0x7fb5d001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379787f31c5f6190 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5e6ffd640 1 -- 172.21.15.45:0/2460429334 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00a7070 con 0x7fb5e80cd120 2023-07-09T02:15:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5e6ffd640 1 -- 172.21.15.45:0/2460429334 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d00ab430 con 0x7fb5e80cd120 2023-07-09T02:15:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5e6ffd640 1 -- 172.21.15.45:0/2460429334 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00ab7c0 con 0x7fb5e80cd120 2023-07-09T02:15:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5edebd640 1 -- 172.21.15.45:0/2460429334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e80cd120 msgr2=0x7fb5e80d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5edebd640 1 --2- 172.21.15.45:0/2460429334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e80cd120 0x7fb5e80d1f10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009870 tx=0x7fb5d001c510 comp rx=0 tx=0).stop 2023-07-09T02:15:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5edebd640 1 -- 172.21.15.45:0/2460429334 shutdown_connections 2023-07-09T02:15:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5edebd640 1 --2- 172.21.15.45:0/2460429334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e80cd120 0x7fb5e80d1f10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5edebd640 1 --2- 172.21.15.45:0/2460429334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e815c060 0x7fb5e80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5edebd640 1 -- 172.21.15.45:0/2460429334 >> 172.21.15.45:0/2460429334 conn(0x7fb5e80698e0 msgr2=0x7fb5e8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5edebd640 1 -- 172.21.15.45:0/2460429334 shutdown_connections 2023-07-09T02:15:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.150+0000 7fb5edebd640 1 -- 172.21.15.45:0/2460429334 wait complete. 2023-07-09T02:15:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 Processor -- start 2023-07-09T02:15:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 -- start start 2023-07-09T02:15:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e80cd120 0x7fb5e8154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5e80d2450 0x7fb5e80b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e815c060 0x7fb5e8156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e81554c0 con 0x7fb5e815c060 2023-07-09T02:15:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80c9ff0 con 0x7fb5e80d2450 2023-07-09T02:15:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80ca2d0 con 0x7fb5e80cd120 2023-07-09T02:15:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e815c060 0x7fb5e8156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e815c060 0x7fb5e8156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34780/0 (socket says 172.21.15.45:34780) 2023-07-09T02:15:18.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 -- 172.21.15.45:0/164725979 learned_addr learned my addr 172.21.15.45:0/164725979 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:18.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5dffff640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5e80d2450 0x7fb5e80b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e77fe640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e80cd120 0x7fb5e8154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 -- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e80cd120 msgr2=0x7fb5e8154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e80cd120 0x7fb5e8154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 -- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5e80d2450 msgr2=0x7fb5e80b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5e80d2450 0x7fb5e80b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 -- 172.21.15.45:0/164725979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00094d0 con 0x7fb5e815c060 2023-07-09T02:15:18.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e77fe640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e80cd120 0x7fb5e8154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:18.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e7fff640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e815c060 0x7fb5e8156e40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000c770 tx=0x7fb5e000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e4ff9640 1 -- 172.21.15.45:0/164725979 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0003b80 con 0x7fb5e815c060 2023-07-09T02:15:18.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e4ff9640 1 -- 172.21.15.45:0/164725979 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e0003ce0 con 0x7fb5e815c060 2023-07-09T02:15:18.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5e4ff9640 1 -- 172.21.15.45:0/164725979 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e000aa90 con 0x7fb5e815c060 2023-07-09T02:15:18.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e80ca5b0 con 0x7fb5e815c060 2023-07-09T02:15:18.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.154+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e80cab70 con 0x7fb5e815c060 2023-07-09T02:15:18.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.158+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e804d7d0 con 0x7fb5e815c060 2023-07-09T02:15:18.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.158+0000 7fb5e4ff9640 1 -- 172.21.15.45:0/164725979 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5e000abf0 con 0x7fb5e815c060 2023-07-09T02:15:18.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.158+0000 7fb5e4ff9640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5c8066280 0x7fb5c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.158+0000 7fb5e4ff9640 1 -- 172.21.15.45:0/164725979 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5e0083c80 con 0x7fb5e815c060 2023-07-09T02:15:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.158+0000 7fb5e77fe640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5c8066280 0x7fb5c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.158+0000 7fb5e77fe640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5c8066280 0x7fb5c8068730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009a40 tx=0x7fb5d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.162+0000 7fb5e4ff9640 1 -- 172.21.15.45:0/164725979 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5e0051060 con 0x7fb5e815c060 2023-07-09T02:15:18.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.318+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5e806baa0 con 0x7fb5e815c060 2023-07-09T02:15:18.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.318+0000 7fb5e4ff9640 1 -- 172.21.15.45:0/164725979 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+18354 (secure 0 0 0) 0x7fb5e0054680 con 0x7fb5e815c060 2023-07-09T02:15:18.318 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:18.319 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:15:15.337856+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:15:12.532657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T02:15:12.972198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:15:18.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5c8066280 msgr2=0x7fb5c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5c8066280 0x7fb5c8068730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009a40 tx=0x7fb5d8008040 comp rx=0 tx=0).stop 2023-07-09T02:15:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e815c060 msgr2=0x7fb5e8156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e815c060 0x7fb5e8156e40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000c770 tx=0x7fb5e000cc30 comp rx=0 tx=0).stop 2023-07-09T02:15:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 shutdown_connections 2023-07-09T02:15:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5e815c060 0x7fb5e8156e40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5e80d2450 0x7fb5e80b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5c8066280 0x7fb5c8068730 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 --2- 172.21.15.45:0/164725979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5e80cd120 0x7fb5e8154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 >> 172.21.15.45:0/164725979 conn(0x7fb5e80698e0 msgr2=0x7fb5e815b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:18.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 shutdown_connections 2023-07-09T02:15:18.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.322+0000 7fb5edebd640 1 -- 172.21.15.45:0/164725979 wait complete. 2023-07-09T02:15:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:15:18.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:15:18.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:15:18.395 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:15:18.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.482+0000 7f626cd11640 1 Processor -- start 2023-07-09T02:15:18.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.482+0000 7f626cd11640 1 -- start start 2023-07-09T02:15:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626cd11640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626815c060 0x7f62680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626cd11640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6268160a50 con 0x7f62680cd120 2023-07-09T02:15:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626cd11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626815c430 con 0x7f62680d2620 2023-07-09T02:15:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626cd11640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626815fb60 con 0x7f626815c060 2023-07-09T02:15:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626815c060 0x7f62680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626815c060 0x7f62680b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34790/0 (socket says 172.21.15.45:34790) 2023-07-09T02:15:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626659c640 1 -- 172.21.15.45:0/1012905769 learned_addr learned my addr 172.21.15.45:0/1012905769 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:18.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626659c640 1 -- 172.21.15.45:0/1012905769 >> v1:172.21.15.155:6789/0 conn(0x7f62680d2620 legacy=0x7f62680cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:18.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626659c640 1 -- 172.21.15.45:0/1012905769 >> v1:172.21.15.45:6789/0 conn(0x7f62680cd120 legacy=0x7f62680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626659c640 1 -- 172.21.15.45:0/1012905769 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626815fe40 con 0x7f626815c060 2023-07-09T02:15:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.486+0000 7f626659c640 1 --2- 172.21.15.45:0/1012905769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f62680b4ed0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6258009870 tx=0x7f625801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204572d2ddd58cbf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f6265d9b640 1 -- 172.21.15.45:0/1012905769 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580aa430 con 0x7f626815c060 2023-07-09T02:15:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f6265d9b640 1 -- 172.21.15.45:0/1012905769 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580aa590 con 0x7f626815c060 2023-07-09T02:15:18.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f6265d9b640 1 -- 172.21.15.45:0/1012905769 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580aa920 con 0x7f626815c060 2023-07-09T02:15:18.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- 172.21.15.45:0/1012905769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 msgr2=0x7f62680b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 --2- 172.21.15.45:0/1012905769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f62680b4ed0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6258009870 tx=0x7f625801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- 172.21.15.45:0/1012905769 shutdown_connections 2023-07-09T02:15:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 --2- 172.21.15.45:0/1012905769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f62680b4ed0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- 172.21.15.45:0/1012905769 >> 172.21.15.45:0/1012905769 conn(0x7f62680698e0 msgr2=0x7f6268069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- 172.21.15.45:0/1012905769 shutdown_connections 2023-07-09T02:15:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- 172.21.15.45:0/1012905769 wait complete. 2023-07-09T02:15:18.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 Processor -- start 2023-07-09T02:15:18.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- start start 2023-07-09T02:15:18.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680cd120 0x7f6268152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62680d2620 0x7f6268155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f626815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268151bd0 con 0x7f626815c060 2023-07-09T02:15:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626815ec30 con 0x7f62680cd120 2023-07-09T02:15:18.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f626cd11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268151880 con 0x7f62680d2620 2023-07-09T02:15:18.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f6266d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f626815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f6266d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f626815dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34798/0 (socket says 172.21.15.45:34798) 2023-07-09T02:15:18.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.490+0000 7f6266d9d640 1 -- 172.21.15.45:0/2920531355 learned_addr learned my addr 172.21.15.45:0/2920531355 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:18.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f626659c640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680cd120 0x7f6268152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f625ffff640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62680d2620 0x7f6268155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f6266d9d640 1 -- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62680d2620 msgr2=0x7f6268155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f6266d9d640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62680d2620 0x7f6268155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f6266d9d640 1 -- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680cd120 msgr2=0x7f6268152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f6266d9d640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680cd120 0x7f6268152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f6266d9d640 1 -- 172.21.15.45:0/2920531355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62580094d0 con 0x7f626815c060 2023-07-09T02:15:18.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f625ffff640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62680d2620 0x7f6268155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:18.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f626659c640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680cd120 0x7f6268152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:18.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f6266d9d640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f626815dc90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f626000c780 tx=0x7f626000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f625effd640 1 -- 172.21.15.45:0/2920531355 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000aa50 con 0x7f626815c060 2023-07-09T02:15:18.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f625effd640 1 -- 172.21.15.45:0/2920531355 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626000abf0 con 0x7f626815c060 2023-07-09T02:15:18.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f625effd640 1 -- 172.21.15.45:0/2920531355 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626000ce30 con 0x7f626815c060 2023-07-09T02:15:18.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62680b59f0 con 0x7f626815c060 2023-07-09T02:15:18.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626815e950 con 0x7f626815c060 2023-07-09T02:15:18.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6268151d80 con 0x7f626815c060 2023-07-09T02:15:18.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.494+0000 7f625effd640 1 -- 172.21.15.45:0/2920531355 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6260012420 con 0x7f626815c060 2023-07-09T02:15:18.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.498+0000 7f625effd640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6248066280 0x7f6248068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.498+0000 7f625effd640 1 -- 172.21.15.45:0/2920531355 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6260084190 con 0x7f626815c060 2023-07-09T02:15:18.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.498+0000 7f626659c640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6248066280 0x7f6248068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.498+0000 7f626659c640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6248066280 0x7f6248068730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f62580ae000 tx=0x7f62580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.502+0000 7f625effd640 1 -- 172.21.15.45:0/2920531355 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6268151d80 con 0x7f626815c060 2023-07-09T02:15:18.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.654+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62680b5870 con 0x7f6248066280 2023-07-09T02:15:18.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.662+0000 7f625effd640 1 -- 172.21.15.45:0/2920531355 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305451 (secure 0 0 0) 0x7f62580aa9a0 con 0x7f6248066280 2023-07-09T02:15:18.666 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:18.667 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:15:18.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6248066280 msgr2=0x7f6248068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6248066280 0x7f6248068730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f62580ae000 tx=0x7f62580a7000 comp rx=0 tx=0).stop 2023-07-09T02:15:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 msgr2=0x7f626815dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f626815dc90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f626000c780 tx=0x7f626000cc40 comp rx=0 tx=0).stop 2023-07-09T02:15:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 shutdown_connections 2023-07-09T02:15:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815c060 0x7f626815dc90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6248066280 0x7f6248068730 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62680d2620 0x7f6268155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 --2- 172.21.15.45:0/2920531355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62680cd120 0x7f6268152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 >> 172.21.15.45:0/2920531355 conn(0x7f62680698e0 msgr2=0x7f62680b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:18.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 shutdown_connections 2023-07-09T02:15:18.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.666+0000 7f626cd11640 1 -- 172.21.15.45:0/2920531355 wait complete. 2023-07-09T02:15:18.687 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2023-07-09T02:15:18.584453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5011,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557488,"statfs":{"total":1600000000,"available":1594868620,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001356"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347111+0000","last_change":"2023-07-09T02:15:14.345656+0000","last_active":"2023-07-09T02:15:14.347111+0000","last_peered":"2023-07-09T02:15:14.347111+0000","last_clean":"2023-07-09T02:15:14.347111+0000","last_became_active":"2023-07-09T02:15:14.345248+0000","last_became_peered":"2023-07-09T02:15:14.345248+0000","last_unstale":"2023-07-09T02:15:14.347111+0000","last_undegraded":"2023-07-09T02:15:14.347111+0000","last_fullsized":"2023-07-09T02:15:14.347111+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:05:46.478880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342727+0000","last_change":"2023-07-09T02:15:14.349377+0000","last_active":"2023-07-09T02:15:15.342727+0000","last_peered":"2023-07-09T02:15:15.342727+0000","last_clean":"2023-07-09T02:15:15.342727+0000","last_became_active":"2023-07-09T02:15:14.349068+0000","last_became_peered":"2023-07-09T02:15:14.349068+0000","last_unstale":"2023-07-09T02:15:15.342727+0000","last_undegraded":"2023-07-09T02:15:15.342727+0000","last_fullsized":"2023-07-09T02:15:15.342727+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:41:47.353211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347735+0000","last_change":"2023-07-09T02:15:14.347674+0000","last_active":"2023-07-09T02:15:14.347735+0000","last_peered":"2023-07-09T02:15:14.347735+0000","last_clean":"2023-07-09T02:15:14.347735+0000","last_became_active":"2023-07-09T02:15:14.347275+0000","last_became_peered":"2023-07-09T02:15:14.347275+0000","last_unstale":"2023-07-09T02:15:14.347735+0000","last_undegraded":"2023-07-09T02:15:14.347735+0000","last_fullsized":"2023-07-09T02:15:14.347735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:30:29.057749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341573+0000","last_change":"2023-07-09T02:15:14.352152+0000","last_active":"2023-07-09T02:15:15.341573+0000","last_peered":"2023-07-09T02:15:15.341573+0000","last_clean":"2023-07-09T02:15:15.341573+0000","last_became_active":"2023-07-09T02:15:14.351905+0000","last_became_peered":"2023-07-09T02:15:14.351905+0000","last_unstale":"2023-07-09T02:15:15.341573+0000","last_undegraded":"2023-07-09T02:15:15.341573+0000","last_fullsized":"2023-07-09T02:15:15.341573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:48:19.211779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.345398+0000","last_change":"2023-07-09T02:15:14.342980+0000","last_active":"2023-07-09T02:15:14.345398+0000","last_peered":"2023-07-09T02:15:14.345398+0000","last_clean":"2023-07-09T02:15:14.345398+0000","last_became_active":"2023-07-09T02:15:14.342718+0000","last_became_peered":"2023-07-09T02:15:14.342718+0000","last_unstale":"2023-07-09T02:15:14.345398+0000","last_undegraded":"2023-07-09T02:15:14.345398+0000","last_fullsized":"2023-07-09T02:15:14.345398+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:47.661325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350605+0000","last_change":"2023-07-09T02:15:14.350242+0000","last_active":"2023-07-09T02:15:14.350605+0000","last_peered":"2023-07-09T02:15:14.350605+0000","last_clean":"2023-07-09T02:15:14.350605+0000","last_became_active":"2023-07-09T02:15:14.350025+0000","last_became_peered":"2023-07-09T02:15:14.350025+0000","last_unstale":"2023-07-09T02:15:14.350605+0000","last_undegraded":"2023-07-09T02:15:14.350605+0000","last_fullsized":"2023-07-09T02:15:14.350605+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:59:36.007973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.354489+0000","last_change":"2023-07-09T02:15:14.354289+0000","last_active":"2023-07-09T02:15:14.354489+0000","last_peered":"2023-07-09T02:15:14.354489+0000","last_clean":"2023-07-09T02:15:14.354489+0000","last_became_active":"2023-07-09T02:15:14.353229+0000","last_became_peered":"2023-07-09T02:15:14.353229+0000","last_unstale":"2023-07-09T02:15:14.354489+0000","last_undegraded":"2023-07-09T02:15:14.354489+0000","last_fullsized":"2023-07-09T02:15:14.354489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:44:20.254809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.345424+0000","last_change":"2023-07-09T02:15:14.343943+0000","last_active":"2023-07-09T02:15:14.345424+0000","last_peered":"2023-07-09T02:15:14.345424+0000","last_clean":"2023-07-09T02:15:14.345424+0000","last_became_active":"2023-07-09T02:15:14.343672+0000","last_became_peered":"2023-07-09T02:15:14.343672+0000","last_unstale":"2023-07-09T02:15:14.345424+0000","last_undegraded":"2023-07-09T02:15:14.345424+0000","last_fullsized":"2023-07-09T02:15:14.345424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:39:30.264028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340076+0000","last_change":"2023-07-09T02:15:14.347397+0000","last_active":"2023-07-09T02:15:15.340076+0000","last_peered":"2023-07-09T02:15:15.340076+0000","last_clean":"2023-07-09T02:15:15.340076+0000","last_became_active":"2023-07-09T02:15:14.346948+0000","last_became_peered":"2023-07-09T02:15:14.346948+0000","last_unstale":"2023-07-09T02:15:15.340076+0000","last_undegraded":"2023-07-09T02:15:15.340076+0000","last_fullsized":"2023-07-09T02:15:15.340076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:25:15.772881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341589+0000","last_change":"2023-07-09T02:15:14.351335+0000","last_active":"2023-07-09T02:15:15.341589+0000","last_peered":"2023-07-09T02:15:15.341589+0000","last_clean":"2023-07-09T02:15:15.341589+0000","last_became_active":"2023-07-09T02:15:14.350889+0000","last_became_peered":"2023-07-09T02:15:14.350889+0000","last_unstale":"2023-07-09T02:15:15.341589+0000","last_undegraded":"2023-07-09T02:15:15.341589+0000","last_fullsized":"2023-07-09T02:15:15.341589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:11:39.506572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342715+0000","last_change":"2023-07-09T02:15:14.355215+0000","last_active":"2023-07-09T02:15:15.342715+0000","last_peered":"2023-07-09T02:15:15.342715+0000","last_clean":"2023-07-09T02:15:15.342715+0000","last_became_active":"2023-07-09T02:15:14.354684+0000","last_became_peered":"2023-07-09T02:15:14.354684+0000","last_unstale":"2023-07-09T02:15:15.342715+0000","last_undegraded":"2023-07-09T02:15:15.342715+0000","last_fullsized":"2023-07-09T02:15:15.342715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:11:03.529141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341589+0000","last_change":"2023-07-09T02:15:14.354038+0000","last_active":"2023-07-09T02:15:15.341589+0000","last_peered":"2023-07-09T02:15:15.341589+0000","last_clean":"2023-07-09T02:15:15.341589+0000","last_became_active":"2023-07-09T02:15:14.353710+0000","last_became_peered":"2023-07-09T02:15:14.353710+0000","last_unstale":"2023-07-09T02:15:15.341589+0000","last_undegraded":"2023-07-09T02:15:15.341589+0000","last_fullsized":"2023-07-09T02:15:15.341589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:37:45.261519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353473+0000","last_change":"2023-07-09T02:15:14.353322+0000","last_active":"2023-07-09T02:15:14.353473+0000","last_peered":"2023-07-09T02:15:14.353473+0000","last_clean":"2023-07-09T02:15:14.353473+0000","last_became_active":"2023-07-09T02:15:14.353079+0000","last_became_peered":"2023-07-09T02:15:14.353079+0000","last_unstale":"2023-07-09T02:15:14.353473+0000","last_undegraded":"2023-07-09T02:15:14.353473+0000","last_fullsized":"2023-07-09T02:15:14.353473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:50:16.618733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350171+0000","last_change":"2023-07-09T02:15:14.349979+0000","last_active":"2023-07-09T02:15:14.350171+0000","last_peered":"2023-07-09T02:15:14.350171+0000","last_clean":"2023-07-09T02:15:14.350171+0000","last_became_active":"2023-07-09T02:15:14.349594+0000","last_became_peered":"2023-07-09T02:15:14.349594+0000","last_unstale":"2023-07-09T02:15:14.350171+0000","last_undegraded":"2023-07-09T02:15:14.350171+0000","last_fullsized":"2023-07-09T02:15:14.350171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:29.436548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342965+0000","last_change":"2023-07-09T02:15:14.354973+0000","last_active":"2023-07-09T02:15:15.342965+0000","last_peered":"2023-07-09T02:15:15.342965+0000","last_clean":"2023-07-09T02:15:15.342965+0000","last_became_active":"2023-07-09T02:15:14.354708+0000","last_became_peered":"2023-07-09T02:15:14.354708+0000","last_unstale":"2023-07-09T02:15:15.342965+0000","last_undegraded":"2023-07-09T02:15:15.342965+0000","last_fullsized":"2023-07-09T02:15:15.342965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:23:28.401434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350080+0000","last_change":"2023-07-09T02:15:14.349995+0000","last_active":"2023-07-09T02:15:14.350080+0000","last_peered":"2023-07-09T02:15:14.350080+0000","last_clean":"2023-07-09T02:15:14.350080+0000","last_became_active":"2023-07-09T02:15:14.349646+0000","last_became_peered":"2023-07-09T02:15:14.349646+0000","last_unstale":"2023-07-09T02:15:14.350080+0000","last_undegraded":"2023-07-09T02:15:14.350080+0000","last_fullsized":"2023-07-09T02:15:14.350080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:09:01.220742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.351253+0000","last_change":"2023-07-09T02:15:14.351119+0000","last_active":"2023-07-09T02:15:14.351253+0000","last_peered":"2023-07-09T02:15:14.351253+0000","last_clean":"2023-07-09T02:15:14.351253+0000","last_became_active":"2023-07-09T02:15:14.350825+0000","last_became_peered":"2023-07-09T02:15:14.350825+0000","last_unstale":"2023-07-09T02:15:14.351253+0000","last_undegraded":"2023-07-09T02:15:14.351253+0000","last_fullsized":"2023-07-09T02:15:14.351253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:52:24.536987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347584+0000","last_change":"2023-07-09T02:15:14.347505+0000","last_active":"2023-07-09T02:15:14.347584+0000","last_peered":"2023-07-09T02:15:14.347584+0000","last_clean":"2023-07-09T02:15:14.347584+0000","last_became_active":"2023-07-09T02:15:14.346948+0000","last_became_peered":"2023-07-09T02:15:14.346948+0000","last_unstale":"2023-07-09T02:15:14.347584+0000","last_undegraded":"2023-07-09T02:15:14.347584+0000","last_fullsized":"2023-07-09T02:15:14.347584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:04:02.431571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.351712+0000","last_change":"2023-07-09T02:15:14.351644+0000","last_active":"2023-07-09T02:15:14.351712+0000","last_peered":"2023-07-09T02:15:14.351712+0000","last_clean":"2023-07-09T02:15:14.351712+0000","last_became_active":"2023-07-09T02:15:14.350690+0000","last_became_peered":"2023-07-09T02:15:14.350690+0000","last_unstale":"2023-07-09T02:15:14.351712+0000","last_undegraded":"2023-07-09T02:15:14.351712+0000","last_fullsized":"2023-07-09T02:15:14.351712+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:43:10.992912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.348721+0000","last_change":"2023-07-09T02:15:14.348512+0000","last_active":"2023-07-09T02:15:14.348721+0000","last_peered":"2023-07-09T02:15:14.348721+0000","last_clean":"2023-07-09T02:15:14.348721+0000","last_became_active":"2023-07-09T02:15:14.348235+0000","last_became_peered":"2023-07-09T02:15:14.348235+0000","last_unstale":"2023-07-09T02:15:14.348721+0000","last_undegraded":"2023-07-09T02:15:14.348721+0000","last_fullsized":"2023-07-09T02:15:14.348721+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:05:59.259966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340222+0000","last_change":"2023-07-09T02:15:14.347946+0000","last_active":"2023-07-09T02:15:15.340222+0000","last_peered":"2023-07-09T02:15:15.340222+0000","last_clean":"2023-07-09T02:15:15.340222+0000","last_became_active":"2023-07-09T02:15:14.347102+0000","last_became_peered":"2023-07-09T02:15:14.347102+0000","last_unstale":"2023-07-09T02:15:15.340222+0000","last_undegraded":"2023-07-09T02:15:15.340222+0000","last_fullsized":"2023-07-09T02:15:15.340222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:05:25.344662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353680+0000","last_change":"2023-07-09T02:15:14.353591+0000","last_active":"2023-07-09T02:15:14.353680+0000","last_peered":"2023-07-09T02:15:14.353680+0000","last_clean":"2023-07-09T02:15:14.353680+0000","last_became_active":"2023-07-09T02:15:14.353275+0000","last_became_peered":"2023-07-09T02:15:14.353275+0000","last_unstale":"2023-07-09T02:15:14.353680+0000","last_undegraded":"2023-07-09T02:15:14.353680+0000","last_fullsized":"2023-07-09T02:15:14.353680+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:48:49.611961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340076+0000","last_change":"2023-07-09T02:15:14.349454+0000","last_active":"2023-07-09T02:15:15.340076+0000","last_peered":"2023-07-09T02:15:15.340076+0000","last_clean":"2023-07-09T02:15:15.340076+0000","last_became_active":"2023-07-09T02:15:14.349080+0000","last_became_peered":"2023-07-09T02:15:14.349080+0000","last_unstale":"2023-07-09T02:15:15.340076+0000","last_undegraded":"2023-07-09T02:15:15.340076+0000","last_fullsized":"2023-07-09T02:15:15.340076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:32:09.998171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343181+0000","last_change":"2023-07-09T02:15:14.349227+0000","last_active":"2023-07-09T02:15:15.343181+0000","last_peered":"2023-07-09T02:15:15.343181+0000","last_clean":"2023-07-09T02:15:15.343181+0000","last_became_active":"2023-07-09T02:15:14.349001+0000","last_became_peered":"2023-07-09T02:15:14.349001+0000","last_unstale":"2023-07-09T02:15:15.343181+0000","last_undegraded":"2023-07-09T02:15:15.343181+0000","last_fullsized":"2023-07-09T02:15:15.343181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:19:22.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343063+0000","last_change":"2023-07-09T02:15:14.352199+0000","last_active":"2023-07-09T02:15:15.343063+0000","last_peered":"2023-07-09T02:15:15.343063+0000","last_clean":"2023-07-09T02:15:15.343063+0000","last_became_active":"2023-07-09T02:15:14.351934+0000","last_became_peered":"2023-07-09T02:15:14.351934+0000","last_unstale":"2023-07-09T02:15:15.343063+0000","last_undegraded":"2023-07-09T02:15:15.343063+0000","last_fullsized":"2023-07-09T02:15:15.343063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:13:43.274564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341663+0000","last_change":"2023-07-09T02:15:14.351531+0000","last_active":"2023-07-09T02:15:15.341663+0000","last_peered":"2023-07-09T02:15:15.341663+0000","last_clean":"2023-07-09T02:15:15.341663+0000","last_became_active":"2023-07-09T02:15:14.350971+0000","last_became_peered":"2023-07-09T02:15:14.350971+0000","last_unstale":"2023-07-09T02:15:15.341663+0000","last_undegraded":"2023-07-09T02:15:15.341663+0000","last_fullsized":"2023-07-09T02:15:15.341663+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:52:15.366972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353114+0000","last_change":"2023-07-09T02:15:14.352999+0000","last_active":"2023-07-09T02:15:14.353114+0000","last_peered":"2023-07-09T02:15:14.353114+0000","last_clean":"2023-07-09T02:15:14.353114+0000","last_became_active":"2023-07-09T02:15:14.352484+0000","last_became_peered":"2023-07-09T02:15:14.352484+0000","last_unstale":"2023-07-09T02:15:14.353114+0000","last_undegraded":"2023-07-09T02:15:14.353114+0000","last_fullsized":"2023-07-09T02:15:14.353114+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:19:09.169683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.349527+0000","last_change":"2023-07-09T02:15:14.349048+0000","last_active":"2023-07-09T02:15:14.349527+0000","last_peered":"2023-07-09T02:15:14.349527+0000","last_clean":"2023-07-09T02:15:14.349527+0000","last_became_active":"2023-07-09T02:15:14.348771+0000","last_became_peered":"2023-07-09T02:15:14.348771+0000","last_unstale":"2023-07-09T02:15:14.349527+0000","last_undegraded":"2023-07-09T02:15:14.349527+0000","last_fullsized":"2023-07-09T02:15:14.349527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:37:23.712930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343253+0000","last_change":"2023-07-09T02:15:14.352815+0000","last_active":"2023-07-09T02:15:15.343253+0000","last_peered":"2023-07-09T02:15:15.343253+0000","last_clean":"2023-07-09T02:15:15.343253+0000","last_became_active":"2023-07-09T02:15:14.352427+0000","last_became_peered":"2023-07-09T02:15:14.352427+0000","last_unstale":"2023-07-09T02:15:15.343253+0000","last_undegraded":"2023-07-09T02:15:15.343253+0000","last_fullsized":"2023-07-09T02:15:15.343253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:59:21.014382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.349641+0000","last_change":"2023-07-09T02:15:14.349111+0000","last_active":"2023-07-09T02:15:14.349641+0000","last_peered":"2023-07-09T02:15:14.349641+0000","last_clean":"2023-07-09T02:15:14.349641+0000","last_became_active":"2023-07-09T02:15:14.348884+0000","last_became_peered":"2023-07-09T02:15:14.348884+0000","last_unstale":"2023-07-09T02:15:14.349641+0000","last_undegraded":"2023-07-09T02:15:14.349641+0000","last_fullsized":"2023-07-09T02:15:14.349641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:49:13.241019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.351276+0000","last_change":"2023-07-09T02:15:14.351175+0000","last_active":"2023-07-09T02:15:14.351276+0000","last_peered":"2023-07-09T02:15:14.351276+0000","last_clean":"2023-07-09T02:15:14.351276+0000","last_became_active":"2023-07-09T02:15:14.350944+0000","last_became_peered":"2023-07-09T02:15:14.350944+0000","last_unstale":"2023-07-09T02:15:14.351276+0000","last_undegraded":"2023-07-09T02:15:14.351276+0000","last_fullsized":"2023-07-09T02:15:14.351276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:55:30.637061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.349623+0000","last_change":"2023-07-09T02:15:14.347663+0000","last_active":"2023-07-09T02:15:14.349623+0000","last_peered":"2023-07-09T02:15:14.349623+0000","last_clean":"2023-07-09T02:15:14.349623+0000","last_became_active":"2023-07-09T02:15:14.344445+0000","last_became_peered":"2023-07-09T02:15:14.344445+0000","last_unstale":"2023-07-09T02:15:14.349623+0000","last_undegraded":"2023-07-09T02:15:14.349623+0000","last_fullsized":"2023-07-09T02:15:14.349623+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:59:27.584584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350479+0000","last_change":"2023-07-09T02:15:14.350380+0000","last_active":"2023-07-09T02:15:14.350479+0000","last_peered":"2023-07-09T02:15:14.350479+0000","last_clean":"2023-07-09T02:15:14.350479+0000","last_became_active":"2023-07-09T02:15:14.349572+0000","last_became_peered":"2023-07-09T02:15:14.349572+0000","last_unstale":"2023-07-09T02:15:14.350479+0000","last_undegraded":"2023-07-09T02:15:14.350479+0000","last_fullsized":"2023-07-09T02:15:14.350479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:28.448504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"87'4","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.598682+0000","last_change":"2023-07-09T02:15:13.599578+0000","last_active":"2023-07-09T02:15:14.598682+0000","last_peered":"2023-07-09T02:15:14.598682+0000","last_clean":"2023-07-09T02:15:14.598682+0000","last_became_active":"2023-07-09T02:15:13.593953+0000","last_became_peered":"2023-07-09T02:15:13.593953+0000","last_unstale":"2023-07-09T02:15:14.598682+0000","last_undegraded":"2023-07-09T02:15:14.598682+0000","last_fullsized":"2023-07-09T02:15:14.598682+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:58:14.650817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343309+0000","last_change":"2023-07-09T02:15:14.352649+0000","last_active":"2023-07-09T02:15:15.343309+0000","last_peered":"2023-07-09T02:15:15.343309+0000","last_clean":"2023-07-09T02:15:15.343309+0000","last_became_active":"2023-07-09T02:15:14.352125+0000","last_became_peered":"2023-07-09T02:15:14.352125+0000","last_unstale":"2023-07-09T02:15:15.343309+0000","last_undegraded":"2023-07-09T02:15:15.343309+0000","last_fullsized":"2023-07-09T02:15:15.343309+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:15:17.595902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.597579+0000","last_change":"2023-07-09T02:15:13.594030+0000","last_active":"2023-07-09T02:15:14.597579+0000","last_peered":"2023-07-09T02:15:14.597579+0000","last_clean":"2023-07-09T02:15:14.597579+0000","last_became_active":"2023-07-09T02:15:13.593597+0000","last_became_peered":"2023-07-09T02:15:13.593597+0000","last_unstale":"2023-07-09T02:15:14.597579+0000","last_undegraded":"2023-07-09T02:15:14.597579+0000","last_fullsized":"2023-07-09T02:15:14.597579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:56:25.772152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340298+0000","last_change":"2023-07-09T02:15:14.348070+0000","last_active":"2023-07-09T02:15:15.340298+0000","last_peered":"2023-07-09T02:15:15.340298+0000","last_clean":"2023-07-09T02:15:15.340298+0000","last_became_active":"2023-07-09T02:15:14.347801+0000","last_became_peered":"2023-07-09T02:15:14.347801+0000","last_unstale":"2023-07-09T02:15:15.340298+0000","last_undegraded":"2023-07-09T02:15:15.340298+0000","last_fullsized":"2023-07-09T02:15:15.340298+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:57:17.284401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.594239+0000","last_change":"2023-07-09T02:15:13.592719+0000","last_active":"2023-07-09T02:15:14.594239+0000","last_peered":"2023-07-09T02:15:14.594239+0000","last_clean":"2023-07-09T02:15:14.594239+0000","last_became_active":"2023-07-09T02:15:13.592363+0000","last_became_peered":"2023-07-09T02:15:13.592363+0000","last_unstale":"2023-07-09T02:15:14.594239+0000","last_undegraded":"2023-07-09T02:15:14.594239+0000","last_fullsized":"2023-07-09T02:15:14.594239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:55:58.556109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340077+0000","last_change":"2023-07-09T02:15:14.351132+0000","last_active":"2023-07-09T02:15:15.340077+0000","last_peered":"2023-07-09T02:15:15.340077+0000","last_clean":"2023-07-09T02:15:15.340077+0000","last_became_active":"2023-07-09T02:15:14.349955+0000","last_became_peered":"2023-07-09T02:15:14.349955+0000","last_unstale":"2023-07-09T02:15:15.340077+0000","last_undegraded":"2023-07-09T02:15:15.340077+0000","last_fullsized":"2023-07-09T02:15:15.340077+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:18:21.395344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.595780+0000","last_change":"2023-07-09T02:15:13.598543+0000","last_active":"2023-07-09T02:15:14.595780+0000","last_peered":"2023-07-09T02:15:14.595780+0000","last_clean":"2023-07-09T02:15:14.595780+0000","last_became_active":"2023-07-09T02:15:13.597909+0000","last_became_peered":"2023-07-09T02:15:13.597909+0000","last_unstale":"2023-07-09T02:15:14.595780+0000","last_undegraded":"2023-07-09T02:15:14.595780+0000","last_fullsized":"2023-07-09T02:15:14.595780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:25:32.861415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342912+0000","last_change":"2023-07-09T02:15:14.355070+0000","last_active":"2023-07-09T02:15:15.342912+0000","last_peered":"2023-07-09T02:15:15.342912+0000","last_clean":"2023-07-09T02:15:15.342912+0000","last_became_active":"2023-07-09T02:15:14.352984+0000","last_became_peered":"2023-07-09T02:15:14.352984+0000","last_unstale":"2023-07-09T02:15:15.342912+0000","last_undegraded":"2023-07-09T02:15:15.342912+0000","last_fullsized":"2023-07-09T02:15:15.342912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:31:15.633484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"87'1","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340548+0000","last_change":"2023-07-09T02:15:13.595379+0000","last_active":"2023-07-09T02:15:15.340548+0000","last_peered":"2023-07-09T02:15:15.340548+0000","last_clean":"2023-07-09T02:15:15.340548+0000","last_became_active":"2023-07-09T02:15:13.595151+0000","last_became_peered":"2023-07-09T02:15:13.595151+0000","last_unstale":"2023-07-09T02:15:15.340548+0000","last_undegraded":"2023-07-09T02:15:15.340548+0000","last_fullsized":"2023-07-09T02:15:15.340548+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:36:39.761980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343129+0000","last_change":"2023-07-09T02:15:14.349458+0000","last_active":"2023-07-09T02:15:15.343129+0000","last_peered":"2023-07-09T02:15:15.343129+0000","last_clean":"2023-07-09T02:15:15.343129+0000","last_became_active":"2023-07-09T02:15:14.349188+0000","last_became_peered":"2023-07-09T02:15:14.349188+0000","last_unstale":"2023-07-09T02:15:15.343129+0000","last_undegraded":"2023-07-09T02:15:15.343129+0000","last_fullsized":"2023-07-09T02:15:15.343129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:44:05.532048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"87'1","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341707+0000","last_change":"2023-07-09T02:15:13.592494+0000","last_active":"2023-07-09T02:15:15.341707+0000","last_peered":"2023-07-09T02:15:15.341707+0000","last_clean":"2023-07-09T02:15:15.341707+0000","last_became_active":"2023-07-09T02:15:13.592263+0000","last_became_peered":"2023-07-09T02:15:13.592263+0000","last_unstale":"2023-07-09T02:15:15.341707+0000","last_undegraded":"2023-07-09T02:15:15.341707+0000","last_fullsized":"2023-07-09T02:15:15.341707+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:04:20.262055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340429+0000","last_change":"2023-07-09T02:15:14.347239+0000","last_active":"2023-07-09T02:15:15.340429+0000","last_peered":"2023-07-09T02:15:15.340429+0000","last_clean":"2023-07-09T02:15:15.340429+0000","last_became_active":"2023-07-09T02:15:14.346646+0000","last_became_peered":"2023-07-09T02:15:14.346646+0000","last_unstale":"2023-07-09T02:15:15.340429+0000","last_undegraded":"2023-07-09T02:15:15.340429+0000","last_fullsized":"2023-07-09T02:15:15.340429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:58:03.358113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343360+0000","last_change":"2023-07-09T02:15:13.597339+0000","last_active":"2023-07-09T02:15:15.343360+0000","last_peered":"2023-07-09T02:15:15.343360+0000","last_clean":"2023-07-09T02:15:15.343360+0000","last_became_active":"2023-07-09T02:15:13.597103+0000","last_became_peered":"2023-07-09T02:15:13.597103+0000","last_unstale":"2023-07-09T02:15:15.343360+0000","last_undegraded":"2023-07-09T02:15:15.343360+0000","last_fullsized":"2023-07-09T02:15:15.343360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:36:40.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.354184+0000","last_change":"2023-07-09T02:15:14.353972+0000","last_active":"2023-07-09T02:15:14.354184+0000","last_peered":"2023-07-09T02:15:14.354184+0000","last_clean":"2023-07-09T02:15:14.354184+0000","last_became_active":"2023-07-09T02:15:14.353612+0000","last_became_peered":"2023-07-09T02:15:14.353612+0000","last_unstale":"2023-07-09T02:15:14.354184+0000","last_undegraded":"2023-07-09T02:15:14.354184+0000","last_fullsized":"2023-07-09T02:15:14.354184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:24:00.444800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.340200+0000","last_change":"2023-07-09T02:15:13.593111+0000","last_active":"2023-07-09T02:15:14.340200+0000","last_peered":"2023-07-09T02:15:14.340200+0000","last_clean":"2023-07-09T02:15:14.340200+0000","last_became_active":"2023-07-09T02:15:13.592666+0000","last_became_peered":"2023-07-09T02:15:13.592666+0000","last_unstale":"2023-07-09T02:15:14.340200+0000","last_undegraded":"2023-07-09T02:15:14.340200+0000","last_fullsized":"2023-07-09T02:15:14.340200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:25:59.707883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342747+0000","last_change":"2023-07-09T02:15:14.344625+0000","last_active":"2023-07-09T02:15:15.342747+0000","last_peered":"2023-07-09T02:15:15.342747+0000","last_clean":"2023-07-09T02:15:15.342747+0000","last_became_active":"2023-07-09T02:15:14.343693+0000","last_became_peered":"2023-07-09T02:15:14.343693+0000","last_unstale":"2023-07-09T02:15:15.342747+0000","last_undegraded":"2023-07-09T02:15:15.342747+0000","last_fullsized":"2023-07-09T02:15:15.342747+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:03:29.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.340886+0000","last_change":"2023-07-09T02:15:13.595641+0000","last_active":"2023-07-09T02:15:14.340886+0000","last_peered":"2023-07-09T02:15:14.340886+0000","last_clean":"2023-07-09T02:15:14.340886+0000","last_became_active":"2023-07-09T02:15:13.595245+0000","last_became_peered":"2023-07-09T02:15:13.595245+0000","last_unstale":"2023-07-09T02:15:14.340886+0000","last_undegraded":"2023-07-09T02:15:14.340886+0000","last_fullsized":"2023-07-09T02:15:14.340886+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:58.974214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341747+0000","last_change":"2023-07-09T02:15:14.352909+0000","last_active":"2023-07-09T02:15:15.341747+0000","last_peered":"2023-07-09T02:15:15.341747+0000","last_clean":"2023-07-09T02:15:15.341747+0000","last_became_active":"2023-07-09T02:15:14.352645+0000","last_became_peered":"2023-07-09T02:15:14.352645+0000","last_unstale":"2023-07-09T02:15:15.341747+0000","last_undegraded":"2023-07-09T02:15:15.341747+0000","last_fullsized":"2023-07-09T02:15:15.341747+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:32:18.467449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341878+0000","last_change":"2023-07-09T02:15:13.597203+0000","last_active":"2023-07-09T02:15:15.341878+0000","last_peered":"2023-07-09T02:15:15.341878+0000","last_clean":"2023-07-09T02:15:15.341878+0000","last_became_active":"2023-07-09T02:15:13.596988+0000","last_became_peered":"2023-07-09T02:15:13.596988+0000","last_unstale":"2023-07-09T02:15:15.341878+0000","last_undegraded":"2023-07-09T02:15:15.341878+0000","last_fullsized":"2023-07-09T02:15:15.341878+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:01:09.416249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.348270+0000","last_change":"2023-07-09T02:15:14.348197+0000","last_active":"2023-07-09T02:15:14.348270+0000","last_peered":"2023-07-09T02:15:14.348270+0000","last_clean":"2023-07-09T02:15:14.348270+0000","last_became_active":"2023-07-09T02:15:14.347971+0000","last_became_peered":"2023-07-09T02:15:14.347971+0000","last_unstale":"2023-07-09T02:15:14.348270+0000","last_undegraded":"2023-07-09T02:15:14.348270+0000","last_fullsized":"2023-07-09T02:15:14.348270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:40:02.947395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"87'3","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.598135+0000","last_change":"2023-07-09T02:15:13.594190+0000","last_active":"2023-07-09T02:15:14.598135+0000","last_peered":"2023-07-09T02:15:14.598135+0000","last_clean":"2023-07-09T02:15:14.598135+0000","last_became_active":"2023-07-09T02:15:13.593571+0000","last_became_peered":"2023-07-09T02:15:13.593571+0000","last_unstale":"2023-07-09T02:15:14.598135+0000","last_undegraded":"2023-07-09T02:15:14.598135+0000","last_fullsized":"2023-07-09T02:15:14.598135+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:35:35.233664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353500+0000","last_change":"2023-07-09T02:15:14.353264+0000","last_active":"2023-07-09T02:15:14.353500+0000","last_peered":"2023-07-09T02:15:14.353500+0000","last_clean":"2023-07-09T02:15:14.353500+0000","last_became_active":"2023-07-09T02:15:14.353025+0000","last_became_peered":"2023-07-09T02:15:14.353025+0000","last_unstale":"2023-07-09T02:15:14.353500+0000","last_undegraded":"2023-07-09T02:15:14.353500+0000","last_fullsized":"2023-07-09T02:15:14.353500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:31:42.916753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"87'6","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.599368+0000","last_change":"2023-07-09T02:15:13.591899+0000","last_active":"2023-07-09T02:15:14.599368+0000","last_peered":"2023-07-09T02:15:14.599368+0000","last_clean":"2023-07-09T02:15:14.599368+0000","last_became_active":"2023-07-09T02:15:13.590849+0000","last_became_peered":"2023-07-09T02:15:13.590849+0000","last_unstale":"2023-07-09T02:15:14.599368+0000","last_undegraded":"2023-07-09T02:15:14.599368+0000","last_fullsized":"2023-07-09T02:15:14.599368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:03:28.015976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341735+0000","last_change":"2023-07-09T02:15:14.354101+0000","last_active":"2023-07-09T02:15:15.341735+0000","last_peered":"2023-07-09T02:15:15.341735+0000","last_clean":"2023-07-09T02:15:15.341735+0000","last_became_active":"2023-07-09T02:15:14.353727+0000","last_became_peered":"2023-07-09T02:15:14.353727+0000","last_unstale":"2023-07-09T02:15:15.341735+0000","last_undegraded":"2023-07-09T02:15:15.341735+0000","last_fullsized":"2023-07-09T02:15:15.341735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:19:54.332631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341764+0000","last_change":"2023-07-09T02:15:13.599175+0000","last_active":"2023-07-09T02:15:15.341764+0000","last_peered":"2023-07-09T02:15:15.341764+0000","last_clean":"2023-07-09T02:15:15.341764+0000","last_became_active":"2023-07-09T02:15:13.598907+0000","last_became_peered":"2023-07-09T02:15:13.598907+0000","last_unstale":"2023-07-09T02:15:15.341764+0000","last_undegraded":"2023-07-09T02:15:15.341764+0000","last_fullsized":"2023-07-09T02:15:15.341764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:37:24.396406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350233+0000","last_change":"2023-07-09T02:15:14.350151+0000","last_active":"2023-07-09T02:15:14.350233+0000","last_peered":"2023-07-09T02:15:14.350233+0000","last_clean":"2023-07-09T02:15:14.350233+0000","last_became_active":"2023-07-09T02:15:14.349910+0000","last_became_peered":"2023-07-09T02:15:14.349910+0000","last_unstale":"2023-07-09T02:15:14.350233+0000","last_undegraded":"2023-07-09T02:15:14.350233+0000","last_fullsized":"2023-07-09T02:15:14.350233+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:40:41.604871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.341394+0000","last_change":"2023-07-09T02:15:13.595509+0000","last_active":"2023-07-09T02:15:14.341394+0000","last_peered":"2023-07-09T02:15:14.341394+0000","last_clean":"2023-07-09T02:15:14.341394+0000","last_became_active":"2023-07-09T02:15:13.594785+0000","last_became_peered":"2023-07-09T02:15:13.594785+0000","last_unstale":"2023-07-09T02:15:14.341394+0000","last_undegraded":"2023-07-09T02:15:14.341394+0000","last_fullsized":"2023-07-09T02:15:14.341394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:51:23.696816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353028+0000","last_change":"2023-07-09T02:15:14.352710+0000","last_active":"2023-07-09T02:15:14.353028+0000","last_peered":"2023-07-09T02:15:14.353028+0000","last_clean":"2023-07-09T02:15:14.353028+0000","last_became_active":"2023-07-09T02:15:14.352426+0000","last_became_peered":"2023-07-09T02:15:14.352426+0000","last_unstale":"2023-07-09T02:15:14.353028+0000","last_undegraded":"2023-07-09T02:15:14.353028+0000","last_fullsized":"2023-07-09T02:15:14.353028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:20:28.334671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339544+0000","last_change":"2023-07-09T02:15:13.596380+0000","last_active":"2023-07-09T02:15:14.339544+0000","last_peered":"2023-07-09T02:15:14.339544+0000","last_clean":"2023-07-09T02:15:14.339544+0000","last_became_active":"2023-07-09T02:15:13.595508+0000","last_became_peered":"2023-07-09T02:15:13.595508+0000","last_unstale":"2023-07-09T02:15:14.339544+0000","last_undegraded":"2023-07-09T02:15:14.339544+0000","last_fullsized":"2023-07-09T02:15:14.339544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:16:27.440020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.356095+0000","last_change":"2023-07-09T02:15:14.354627+0000","last_active":"2023-07-09T02:15:14.356095+0000","last_peered":"2023-07-09T02:15:14.356095+0000","last_clean":"2023-07-09T02:15:14.356095+0000","last_became_active":"2023-07-09T02:15:14.354365+0000","last_became_peered":"2023-07-09T02:15:14.354365+0000","last_unstale":"2023-07-09T02:15:14.356095+0000","last_undegraded":"2023-07-09T02:15:14.356095+0000","last_fullsized":"2023-07-09T02:15:14.356095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:32:45.146633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"87'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342883+0000","last_change":"2023-07-09T02:15:13.590497+0000","last_active":"2023-07-09T02:15:15.342883+0000","last_peered":"2023-07-09T02:15:15.342883+0000","last_clean":"2023-07-09T02:15:15.342883+0000","last_became_active":"2023-07-09T02:15:13.590101+0000","last_became_peered":"2023-07-09T02:15:13.590101+0000","last_unstale":"2023-07-09T02:15:15.342883+0000","last_undegraded":"2023-07-09T02:15:15.342883+0000","last_fullsized":"2023-07-09T02:15:15.342883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:29:42.673015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340265+0000","last_change":"2023-07-09T02:15:14.351267+0000","last_active":"2023-07-09T02:15:15.340265+0000","last_peered":"2023-07-09T02:15:15.340265+0000","last_clean":"2023-07-09T02:15:15.340265+0000","last_became_active":"2023-07-09T02:15:14.350932+0000","last_became_peered":"2023-07-09T02:15:14.350932+0000","last_unstale":"2023-07-09T02:15:15.340265+0000","last_undegraded":"2023-07-09T02:15:15.340265+0000","last_fullsized":"2023-07-09T02:15:15.340265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:35:27.786748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341997+0000","last_change":"2023-07-09T02:15:13.591679+0000","last_active":"2023-07-09T02:15:15.341997+0000","last_peered":"2023-07-09T02:15:15.341997+0000","last_clean":"2023-07-09T02:15:15.341997+0000","last_became_active":"2023-07-09T02:15:13.591458+0000","last_became_peered":"2023-07-09T02:15:13.591458+0000","last_unstale":"2023-07-09T02:15:15.341997+0000","last_undegraded":"2023-07-09T02:15:15.341997+0000","last_fullsized":"2023-07-09T02:15:15.341997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:41:33.787845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.354166+0000","last_change":"2023-07-09T02:15:14.353833+0000","last_active":"2023-07-09T02:15:14.354166+0000","last_peered":"2023-07-09T02:15:14.354166+0000","last_clean":"2023-07-09T02:15:14.354166+0000","last_became_active":"2023-07-09T02:15:14.353246+0000","last_became_peered":"2023-07-09T02:15:14.353246+0000","last_unstale":"2023-07-09T02:15:14.354166+0000","last_undegraded":"2023-07-09T02:15:14.354166+0000","last_fullsized":"2023-07-09T02:15:14.354166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:17:43.247442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342999+0000","last_change":"2023-07-09T02:15:13.598670+0000","last_active":"2023-07-09T02:15:15.342999+0000","last_peered":"2023-07-09T02:15:15.342999+0000","last_clean":"2023-07-09T02:15:15.342999+0000","last_became_active":"2023-07-09T02:15:13.598404+0000","last_became_peered":"2023-07-09T02:15:13.598404+0000","last_unstale":"2023-07-09T02:15:15.342999+0000","last_undegraded":"2023-07-09T02:15:15.342999+0000","last_fullsized":"2023-07-09T02:15:15.342999+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:55:15.668038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340255+0000","last_change":"2023-07-09T02:15:14.350979+0000","last_active":"2023-07-09T02:15:15.340255+0000","last_peered":"2023-07-09T02:15:15.340255+0000","last_clean":"2023-07-09T02:15:15.340255+0000","last_became_active":"2023-07-09T02:15:14.349629+0000","last_became_peered":"2023-07-09T02:15:14.349629+0000","last_unstale":"2023-07-09T02:15:15.340255+0000","last_undegraded":"2023-07-09T02:15:15.340255+0000","last_fullsized":"2023-07-09T02:15:15.340255+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:55:12.178347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339853+0000","last_change":"2023-07-09T02:15:13.598203+0000","last_active":"2023-07-09T02:15:14.339853+0000","last_peered":"2023-07-09T02:15:14.339853+0000","last_clean":"2023-07-09T02:15:14.339853+0000","last_became_active":"2023-07-09T02:15:13.597778+0000","last_became_peered":"2023-07-09T02:15:13.597778+0000","last_unstale":"2023-07-09T02:15:14.339853+0000","last_undegraded":"2023-07-09T02:15:14.339853+0000","last_fullsized":"2023-07-09T02:15:14.339853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:29:23.594134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343026+0000","last_change":"2023-07-09T02:15:14.346856+0000","last_active":"2023-07-09T02:15:15.343026+0000","last_peered":"2023-07-09T02:15:15.343026+0000","last_clean":"2023-07-09T02:15:15.343026+0000","last_became_active":"2023-07-09T02:15:14.346617+0000","last_became_peered":"2023-07-09T02:15:14.346617+0000","last_unstale":"2023-07-09T02:15:15.343026+0000","last_undegraded":"2023-07-09T02:15:15.343026+0000","last_fullsized":"2023-07-09T02:15:15.343026+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:48:17.709745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.340543+0000","last_change":"2023-07-09T02:15:13.592584+0000","last_active":"2023-07-09T02:15:14.340543+0000","last_peered":"2023-07-09T02:15:14.340543+0000","last_clean":"2023-07-09T02:15:14.340543+0000","last_became_active":"2023-07-09T02:15:13.591445+0000","last_became_peered":"2023-07-09T02:15:13.591445+0000","last_unstale":"2023-07-09T02:15:14.340543+0000","last_undegraded":"2023-07-09T02:15:14.340543+0000","last_fullsized":"2023-07-09T02:15:14.340543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:36:43.977635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353046+0000","last_change":"2023-07-09T02:15:14.352805+0000","last_active":"2023-07-09T02:15:14.353046+0000","last_peered":"2023-07-09T02:15:14.353046+0000","last_clean":"2023-07-09T02:15:14.353046+0000","last_became_active":"2023-07-09T02:15:14.352573+0000","last_became_peered":"2023-07-09T02:15:14.352573+0000","last_unstale":"2023-07-09T02:15:14.353046+0000","last_undegraded":"2023-07-09T02:15:14.353046+0000","last_fullsized":"2023-07-09T02:15:14.353046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:53:02.856603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.348936+0000","last_change":"2023-07-09T02:15:13.598685+0000","last_active":"2023-07-09T02:15:14.348936+0000","last_peered":"2023-07-09T02:15:14.348936+0000","last_clean":"2023-07-09T02:15:14.348936+0000","last_became_active":"2023-07-09T02:15:13.598202+0000","last_became_peered":"2023-07-09T02:15:13.598202+0000","last_unstale":"2023-07-09T02:15:14.348936+0000","last_undegraded":"2023-07-09T02:15:14.348936+0000","last_fullsized":"2023-07-09T02:15:14.348936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:09:22.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.356761+0000","last_change":"2023-07-09T02:15:14.356680+0000","last_active":"2023-07-09T02:15:14.356761+0000","last_peered":"2023-07-09T02:15:14.356761+0000","last_clean":"2023-07-09T02:15:14.356761+0000","last_became_active":"2023-07-09T02:15:14.356229+0000","last_became_peered":"2023-07-09T02:15:14.356229+0000","last_unstale":"2023-07-09T02:15:14.356761+0000","last_undegraded":"2023-07-09T02:15:14.356761+0000","last_fullsized":"2023-07-09T02:15:14.356761+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:54:21.066106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339946+0000","last_change":"2023-07-09T02:15:13.596538+0000","last_active":"2023-07-09T02:15:14.339946+0000","last_peered":"2023-07-09T02:15:14.339946+0000","last_clean":"2023-07-09T02:15:14.339946+0000","last_became_active":"2023-07-09T02:15:13.595840+0000","last_became_peered":"2023-07-09T02:15:13.595840+0000","last_unstale":"2023-07-09T02:15:14.339946+0000","last_undegraded":"2023-07-09T02:15:14.339946+0000","last_fullsized":"2023-07-09T02:15:14.339946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:29:06.438513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.354351+0000","last_change":"2023-07-09T02:15:14.354261+0000","last_active":"2023-07-09T02:15:14.354351+0000","last_peered":"2023-07-09T02:15:14.354351+0000","last_clean":"2023-07-09T02:15:14.354351+0000","last_became_active":"2023-07-09T02:15:14.353977+0000","last_became_peered":"2023-07-09T02:15:14.353977+0000","last_unstale":"2023-07-09T02:15:14.354351+0000","last_undegraded":"2023-07-09T02:15:14.354351+0000","last_fullsized":"2023-07-09T02:15:14.354351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:21:42.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.346037+0000","last_change":"2023-07-09T02:15:13.595221+0000","last_active":"2023-07-09T02:15:14.346037+0000","last_peered":"2023-07-09T02:15:14.346037+0000","last_clean":"2023-07-09T02:15:14.346037+0000","last_became_active":"2023-07-09T02:15:13.594995+0000","last_became_peered":"2023-07-09T02:15:13.594995+0000","last_unstale":"2023-07-09T02:15:14.346037+0000","last_undegraded":"2023-07-09T02:15:14.346037+0000","last_fullsized":"2023-07-09T02:15:14.346037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:16:29.285016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.346466+0000","last_change":"2023-07-09T02:15:14.346352+0000","last_active":"2023-07-09T02:15:14.346466+0000","last_peered":"2023-07-09T02:15:14.346466+0000","last_clean":"2023-07-09T02:15:14.346466+0000","last_became_active":"2023-07-09T02:15:14.346134+0000","last_became_peered":"2023-07-09T02:15:14.346134+0000","last_unstale":"2023-07-09T02:15:14.346466+0000","last_undegraded":"2023-07-09T02:15:14.346466+0000","last_fullsized":"2023-07-09T02:15:14.346466+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:32:15.651656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.342228+0000","last_change":"2023-07-09T02:15:13.595822+0000","last_active":"2023-07-09T02:15:14.342228+0000","last_peered":"2023-07-09T02:15:14.342228+0000","last_clean":"2023-07-09T02:15:14.342228+0000","last_became_active":"2023-07-09T02:15:13.595532+0000","last_became_peered":"2023-07-09T02:15:13.595532+0000","last_unstale":"2023-07-09T02:15:14.342228+0000","last_undegraded":"2023-07-09T02:15:14.342228+0000","last_fullsized":"2023-07-09T02:15:14.342228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:40:45.562585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347093+0000","last_change":"2023-07-09T02:15:14.345499+0000","last_active":"2023-07-09T02:15:14.347093+0000","last_peered":"2023-07-09T02:15:14.347093+0000","last_clean":"2023-07-09T02:15:14.347093+0000","last_became_active":"2023-07-09T02:15:14.344326+0000","last_became_peered":"2023-07-09T02:15:14.344326+0000","last_unstale":"2023-07-09T02:15:14.347093+0000","last_undegraded":"2023-07-09T02:15:14.347093+0000","last_fullsized":"2023-07-09T02:15:14.347093+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:23:28.529139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.345025+0000","last_change":"2023-07-09T02:15:13.598324+0000","last_active":"2023-07-09T02:15:14.345025+0000","last_peered":"2023-07-09T02:15:14.345025+0000","last_clean":"2023-07-09T02:15:14.345025+0000","last_became_active":"2023-07-09T02:15:13.597803+0000","last_became_peered":"2023-07-09T02:15:13.597803+0000","last_unstale":"2023-07-09T02:15:14.345025+0000","last_undegraded":"2023-07-09T02:15:14.345025+0000","last_fullsized":"2023-07-09T02:15:14.345025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:29:15.748389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":283,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339959+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:15:14.339959+0000","last_peered":"2023-07-09T02:15:14.339959+0000","last_clean":"2023-07-09T02:15:14.339959+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:15:14.339959+0000","last_undegraded":"2023-07-09T02:15:14.339959+0000","last_fullsized":"2023-07-09T02:15:14.339959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:04:55.530281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341757+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:15:15.341757+0000","last_peered":"2023-07-09T02:15:15.341757+0000","last_clean":"2023-07-09T02:15:15.341757+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:15:15.341757+0000","last_undegraded":"2023-07-09T02:15:15.341757+0000","last_fullsized":"2023-07-09T02:15:15.341757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:14:21.559850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343191+0000","last_change":"2023-07-09T02:15:14.348639+0000","last_active":"2023-07-09T02:15:15.343191+0000","last_peered":"2023-07-09T02:15:15.343191+0000","last_clean":"2023-07-09T02:15:15.343191+0000","last_became_active":"2023-07-09T02:15:14.348418+0000","last_became_peered":"2023-07-09T02:15:14.348418+0000","last_unstale":"2023-07-09T02:15:15.343191+0000","last_undegraded":"2023-07-09T02:15:15.343191+0000","last_fullsized":"2023-07-09T02:15:15.343191+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:30:12.615902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.346126+0000","last_change":"2023-07-09T02:15:13.595542+0000","last_active":"2023-07-09T02:15:14.346126+0000","last_peered":"2023-07-09T02:15:14.346126+0000","last_clean":"2023-07-09T02:15:14.346126+0000","last_became_active":"2023-07-09T02:15:13.595319+0000","last_became_peered":"2023-07-09T02:15:13.595319+0000","last_unstale":"2023-07-09T02:15:14.346126+0000","last_undegraded":"2023-07-09T02:15:14.346126+0000","last_fullsized":"2023-07-09T02:15:14.346126+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:05:12.116020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339667+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:15:14.339667+0000","last_peered":"2023-07-09T02:15:14.339667+0000","last_clean":"2023-07-09T02:15:14.339667+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:15:14.339667+0000","last_undegraded":"2023-07-09T02:15:14.339667+0000","last_fullsized":"2023-07-09T02:15:14.339667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:18:45.528318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.356584+0000","last_change":"2023-07-09T02:15:14.356502+0000","last_active":"2023-07-09T02:15:14.356584+0000","last_peered":"2023-07-09T02:15:14.356584+0000","last_clean":"2023-07-09T02:15:14.356584+0000","last_became_active":"2023-07-09T02:15:14.354203+0000","last_became_peered":"2023-07-09T02:15:14.354203+0000","last_unstale":"2023-07-09T02:15:14.356584+0000","last_undegraded":"2023-07-09T02:15:14.356584+0000","last_fullsized":"2023-07-09T02:15:14.356584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:12.444082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347131+0000","last_change":"2023-07-09T02:15:13.597278+0000","last_active":"2023-07-09T02:15:14.347131+0000","last_peered":"2023-07-09T02:15:14.347131+0000","last_clean":"2023-07-09T02:15:14.347131+0000","last_became_active":"2023-07-09T02:15:13.596856+0000","last_became_peered":"2023-07-09T02:15:13.596856+0000","last_unstale":"2023-07-09T02:15:14.347131+0000","last_undegraded":"2023-07-09T02:15:14.347131+0000","last_fullsized":"2023-07-09T02:15:14.347131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:58:03.875603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.340437+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:15:14.340437+0000","last_peered":"2023-07-09T02:15:14.340437+0000","last_clean":"2023-07-09T02:15:14.340437+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:15:14.340437+0000","last_undegraded":"2023-07-09T02:15:14.340437+0000","last_fullsized":"2023-07-09T02:15:14.340437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:07:13.492655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342859+0000","last_change":"2023-07-09T02:15:14.352813+0000","last_active":"2023-07-09T02:15:15.342859+0000","last_peered":"2023-07-09T02:15:15.342859+0000","last_clean":"2023-07-09T02:15:15.342859+0000","last_became_active":"2023-07-09T02:15:14.352527+0000","last_became_peered":"2023-07-09T02:15:14.352527+0000","last_unstale":"2023-07-09T02:15:15.342859+0000","last_undegraded":"2023-07-09T02:15:15.342859+0000","last_fullsized":"2023-07-09T02:15:15.342859+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:01:10.945862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.596374+0000","last_change":"2023-07-09T02:15:13.600799+0000","last_active":"2023-07-09T02:15:14.596374+0000","last_peered":"2023-07-09T02:15:14.596374+0000","last_clean":"2023-07-09T02:15:14.596374+0000","last_became_active":"2023-07-09T02:15:13.600180+0000","last_became_peered":"2023-07-09T02:15:13.600180+0000","last_unstale":"2023-07-09T02:15:14.596374+0000","last_undegraded":"2023-07-09T02:15:14.596374+0000","last_fullsized":"2023-07-09T02:15:14.596374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:50:04.718042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342150+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:15:15.342150+0000","last_peered":"2023-07-09T02:15:15.342150+0000","last_clean":"2023-07-09T02:15:15.342150+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:15:15.342150+0000","last_undegraded":"2023-07-09T02:15:15.342150+0000","last_fullsized":"2023-07-09T02:15:15.342150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:29:20.600357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.345441+0000","last_change":"2023-07-09T02:15:14.344901+0000","last_active":"2023-07-09T02:15:14.345441+0000","last_peered":"2023-07-09T02:15:14.345441+0000","last_clean":"2023-07-09T02:15:14.345441+0000","last_became_active":"2023-07-09T02:15:14.344655+0000","last_became_peered":"2023-07-09T02:15:14.344655+0000","last_unstale":"2023-07-09T02:15:14.345441+0000","last_undegraded":"2023-07-09T02:15:14.345441+0000","last_fullsized":"2023-07-09T02:15:14.345441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:20:30.356358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.596472+0000","last_change":"2023-07-09T02:15:13.591963+0000","last_active":"2023-07-09T02:15:14.596472+0000","last_peered":"2023-07-09T02:15:14.596472+0000","last_clean":"2023-07-09T02:15:14.596472+0000","last_became_active":"2023-07-09T02:15:13.591700+0000","last_became_peered":"2023-07-09T02:15:13.591700+0000","last_unstale":"2023-07-09T02:15:14.596472+0000","last_undegraded":"2023-07-09T02:15:14.596472+0000","last_fullsized":"2023-07-09T02:15:14.596472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:46.815454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":134,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.343162+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:15:14.343162+0000","last_peered":"2023-07-09T02:15:14.343162+0000","last_clean":"2023-07-09T02:15:14.343162+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:15:14.343162+0000","last_undegraded":"2023-07-09T02:15:14.343162+0000","last_fullsized":"2023-07-09T02:15:14.343162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:07:05.732533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.351570+0000","last_change":"2023-07-09T02:15:14.351415+0000","last_active":"2023-07-09T02:15:14.351570+0000","last_peered":"2023-07-09T02:15:14.351570+0000","last_clean":"2023-07-09T02:15:14.351570+0000","last_became_active":"2023-07-09T02:15:14.351204+0000","last_became_peered":"2023-07-09T02:15:14.351204+0000","last_unstale":"2023-07-09T02:15:14.351570+0000","last_undegraded":"2023-07-09T02:15:14.351570+0000","last_fullsized":"2023-07-09T02:15:14.351570+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:41:40.201573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.342868+0000","last_change":"2023-07-09T02:15:13.597816+0000","last_active":"2023-07-09T02:15:14.342868+0000","last_peered":"2023-07-09T02:15:14.342868+0000","last_clean":"2023-07-09T02:15:14.342868+0000","last_became_active":"2023-07-09T02:15:13.597550+0000","last_became_peered":"2023-07-09T02:15:13.597550+0000","last_unstale":"2023-07-09T02:15:14.342868+0000","last_undegraded":"2023-07-09T02:15:14.342868+0000","last_fullsized":"2023-07-09T02:15:14.342868+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:46:17.824650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339492+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:15:14.339492+0000","last_peered":"2023-07-09T02:15:14.339492+0000","last_clean":"2023-07-09T02:15:14.339492+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:15:14.339492+0000","last_undegraded":"2023-07-09T02:15:14.339492+0000","last_fullsized":"2023-07-09T02:15:14.339492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:45:02.410078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.352326+0000","last_change":"2023-07-09T02:15:14.352232+0000","last_active":"2023-07-09T02:15:14.352326+0000","last_peered":"2023-07-09T02:15:14.352326+0000","last_clean":"2023-07-09T02:15:14.352326+0000","last_became_active":"2023-07-09T02:15:14.351669+0000","last_became_peered":"2023-07-09T02:15:14.351669+0000","last_unstale":"2023-07-09T02:15:14.352326+0000","last_undegraded":"2023-07-09T02:15:14.352326+0000","last_fullsized":"2023-07-09T02:15:14.352326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:41:28.043664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.593285+0000","last_change":"2023-07-09T02:15:13.593840+0000","last_active":"2023-07-09T02:15:14.593285+0000","last_peered":"2023-07-09T02:15:14.593285+0000","last_clean":"2023-07-09T02:15:14.593285+0000","last_became_active":"2023-07-09T02:15:13.593277+0000","last_became_peered":"2023-07-09T02:15:13.593277+0000","last_unstale":"2023-07-09T02:15:14.593285+0000","last_undegraded":"2023-07-09T02:15:14.593285+0000","last_fullsized":"2023-07-09T02:15:14.593285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:11:14.097221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.343616+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:15:14.343616+0000","last_peered":"2023-07-09T02:15:14.343616+0000","last_clean":"2023-07-09T02:15:14.343616+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:15:14.343616+0000","last_undegraded":"2023-07-09T02:15:14.343616+0000","last_fullsized":"2023-07-09T02:15:14.343616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:01:18.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353455+0000","last_change":"2023-07-09T02:15:14.352860+0000","last_active":"2023-07-09T02:15:14.353455+0000","last_peered":"2023-07-09T02:15:14.353455+0000","last_clean":"2023-07-09T02:15:14.353455+0000","last_became_active":"2023-07-09T02:15:14.352587+0000","last_became_peered":"2023-07-09T02:15:14.352587+0000","last_unstale":"2023-07-09T02:15:14.353455+0000","last_undegraded":"2023-07-09T02:15:14.353455+0000","last_fullsized":"2023-07-09T02:15:14.353455+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:12:20.775928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340542+0000","last_change":"2023-07-09T02:15:13.590742+0000","last_active":"2023-07-09T02:15:15.340542+0000","last_peered":"2023-07-09T02:15:15.340542+0000","last_clean":"2023-07-09T02:15:15.340542+0000","last_became_active":"2023-07-09T02:15:13.590511+0000","last_became_peered":"2023-07-09T02:15:13.590511+0000","last_unstale":"2023-07-09T02:15:15.340542+0000","last_undegraded":"2023-07-09T02:15:15.340542+0000","last_fullsized":"2023-07-09T02:15:15.340542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:48:54.316061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.346480+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:15:14.346480+0000","last_peered":"2023-07-09T02:15:14.346480+0000","last_clean":"2023-07-09T02:15:14.346480+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:15:14.346480+0000","last_undegraded":"2023-07-09T02:15:14.346480+0000","last_fullsized":"2023-07-09T02:15:14.346480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:52.800386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1058,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194254,"statfs":{"total":200000000,"available":198916370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.747},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2330000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.501},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1839999999999999,"5min":1.423,"15min":1.423},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":1.026,"15min":0.79800000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73899999999999999,"15min":0.70199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0840000000000001,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.97999999999999998,"15min":0.80900000000000005},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99099999999999999,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.45400000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.67500000000000004},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83799999999999997,"15min":0.77600000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1120000000000001,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.56000000000000005,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0009999999999999,"5min":1.087,"15min":1.087},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":483,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194829,"statfs":{"total":200000000,"available":199505196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.53800000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.73399999999999999},"min":{"1min":0.55900000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92200000000000004,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85699999999999998,"5min":1.165,"15min":1.165},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71299999999999997,"15min":0.68799999999999994},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.72099999999999997,"15min":0.70599999999999996},"min":{"1min":0.64000000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89800000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.625},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.51400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.75800000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.44600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.69999999999999996,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":481,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194830,"statfs":{"total":200000000,"available":199506726,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69499999999999995,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98599999999999999,"5min":1.179,"15min":1.179},"last":0.51900000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92300000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.58399999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.73999999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.432,"15min":0.432},"max":{"1min":1.0169999999999999,"5min":1.103,"15min":1.103},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69399999999999995,"15min":0.68300000000000005},"min":{"1min":0.57299999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.878,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.71699999999999997,"15min":0.69499999999999995},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94599999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.82399999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64000000000000001,"15min":0.628},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.874,"5min":1.054,"15min":1.054},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.91900000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71599999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.876,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.999,"5min":1.091,"15min":1.091},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":483,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194829,"statfs":{"total":200000000,"available":199505092,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.2430000000000001,"15min":0.85199999999999998},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89400000000000002,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66100000000000003,"15min":0.67500000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.72299999999999998,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98199999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.625}]},{"osd":2,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.44,"5min":0.439,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94299999999999995,"5min":1.323,"15min":1.323},"last":0.501}]},{"osd":3,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89400000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.512,"15min":0.94199999999999995},"min":{"1min":0.48499999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.95099999999999996,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.434},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86699999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47299999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68000000000000005,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93100000000000005,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.77900000000000003,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95399999999999996,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194830,"statfs":{"total":200000000,"available":199506178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.42299999999999999,"15min":0.41999999999999998},"min":{"1min":0.29799999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.79700000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.33700000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.87,"5min":1.198,"15min":1.198},"last":0.44600000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.33400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79900000000000004,"5min":1.048,"15min":1.048},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.55000000000000004}]},{"osd":2,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76700000000000002,"5min":1.155,"15min":1.155},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.56299999999999994},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.73699999999999999,"15min":0.69999999999999996},"min":{"1min":0.54000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2829999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.749,"15min":0.71499999999999997},"min":{"1min":0.59599999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.59599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.101,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.64900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.244,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.59499999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.226,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78100000000000003,"15min":0.77400000000000002},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1859999999999999,"5min":1.367,"15min":1.367},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77500000000000002,"15min":0.76700000000000002},"min":{"1min":0.58099999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194830,"statfs":{"total":200000000,"available":199506018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.42999999999999999},"min":{"1min":0.32800000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.76700000000000002,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42599999999999999},"min":{"1min":0.35999999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":1.127,"15min":1.127},"last":0.433}]},{"osd":1,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73799999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.52200000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.37},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56999999999999995,"15min":0.5},"min":{"1min":0.41099999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.626}]},{"osd":4,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82099999999999995,"15min":0.755},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0149999999999999,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.753},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.71099999999999997},"min":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":1.161,"15min":1.161},"last":0.85299999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73599999999999999,"15min":0.71999999999999997},"min":{"1min":0.57699999999999996,"5min":0.496,"15min":0.496},"max":{"1min":0.97599999999999998,"5min":1.319,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.83199999999999996,"15min":0.77400000000000002},"min":{"1min":0.624,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96099999999999997,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.90700000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78100000000000003,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.091,"5min":1.101,"15min":1.101},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.82599999999999996,"15min":0.80700000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.069,"5min":1.452,"15min":1.452},"last":0.91800000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.74199999999999999,"15min":0.71399999999999997},"min":{"1min":0.56899999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.208,"15min":1.208},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.60699999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0189999999999999,"5min":1.351,"15min":1.351},"last":0.96599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":481,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194830,"statfs":{"total":200000000,"available":199506648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.67000000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.45300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.47999999999999998,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73999999999999999,"5min":1.163,"15min":1.163},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.58299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97499999999999998,"5min":1.026,"15min":1.026},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.75700000000000001,"15min":0.73799999999999999},"min":{"1min":0.59799999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73999999999999999,"15min":0.72599999999999998},"min":{"1min":0.59599999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.87},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.626,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.71199999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79900000000000004,"15min":0.78100000000000003},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.80000000000000004,"15min":0.77600000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.77600000000000002,"15min":0.76400000000000001},"min":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0469999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.129,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1058,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194254,"statfs":{"total":200000000,"available":198916392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42999999999999999,"15min":0.41499999999999998},"min":{"1min":0.33200000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.49299999999999999,"15min":0.46400000000000002},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.45400000000000001},"min":{"1min":0.376,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71599999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.29899999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.432,"15min":0.41099999999999998},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.501},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76600000000000001,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.46000000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.145,"15min":1.145},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0589999999999999,"5min":1.153,"15min":1.153},"last":0.55400000000000005}]},{"osd":5,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.57399999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.78600000000000003,"15min":0.78300000000000003},"min":{"1min":0.59499999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0860000000000001,"5min":1.238,"15min":1.238},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.59699999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96999999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.53300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96199999999999997,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0389999999999999,"5min":1.472,"15min":1.472},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.53600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0629999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.53600000000000003}]}]}],"pool_statfs":[]}} 2023-07-09T02:15:18.697 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:15:18.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdcc31f640 1 Processor -- start 2023-07-09T02:15:18.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdcc31f640 1 -- start start 2023-07-09T02:15:18.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdcc31f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc415c060 0x7efdc40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdcc31f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efdc40cd120 0x7efdc40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdcc31f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc4160a50 con 0x7efdc40d2450 2023-07-09T02:15:18.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdcc31f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc40d28f0 con 0x7efdc40cd120 2023-07-09T02:15:18.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdcc31f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40cfe40 con 0x7efdc415c060 2023-07-09T02:15:18.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdca8bc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efdc40d2450 0x7efdc40d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38844/0 (socket says 172.21.15.45:38844) 2023-07-09T02:15:18.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdca8bc640 1 -- 172.21.15.45:0/1748994089 learned_addr learned my addr 172.21.15.45:0/1748994089 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc98ba640 1 --2- 172.21.15.45:0/1748994089 >> v2:172.21.15.155:3300/0 conn(0x7efdc40cd120 0x7efdc40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdca0bb640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc415c060 0x7efdc40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790915794 0 0) 0x7efdc4160a50 con 0x7efdc40d2450 2023-07-09T02:15:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb0003530 con 0x7efdc40d2450 2023-07-09T02:15:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1135292584 0 0) 0x7efdb0003530 con 0x7efdc40d2450 2023-07-09T02:15:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc415c060 msgr2=0x7efdc40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc415c060 0x7efdc40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 >> v2:172.21.15.155:3300/0 conn(0x7efdc40cd120 msgr2=0x7efdc40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 --2- 172.21.15.45:0/1748994089 >> v2:172.21.15.155:3300/0 conn(0x7efdc40cd120 0x7efdc40d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc415c430 con 0x7efdc40d2450 2023-07-09T02:15:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7efdbc001a00 con 0x7efdc40d2450 2023-07-09T02:15:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 >> v1:172.21.15.45:6789/0 conn(0x7efdc40d2450 legacy=0x7efdc40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.870+0000 7efdc90b9640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc415c060 0x7efdb0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc90b9640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0003f00 0x7efdb00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc90b9640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb0004d10 0x7efdb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40cfe40 con 0x7efdb0004d10 2023-07-09T02:15:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb000b990 con 0x7efdb0003f00 2023-07-09T02:15:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb000bad0 con 0x7efdc415c060 2023-07-09T02:15:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdca8bc640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb0004d10 0x7efdb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc98ba640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0003f00 0x7efdb00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdca0bb640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc415c060 0x7efdb0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdca8bc640 1 -- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc415c060 msgr2=0x7efdb0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdca8bc640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc415c060 0x7efdb0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdca8bc640 1 -- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0003f00 msgr2=0x7efdb00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdca8bc640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0003f00 0x7efdb00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdca8bc640 1 -- 172.21.15.45:0/1748994089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0003530 con 0x7efdb0004d10 2023-07-09T02:15:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdca8bc640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb0004d10 0x7efdb0005180 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00a860 tx=0x7efdbc01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b216c21b229348 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0ad630 con 0x7efdb0004d10 2023-07-09T02:15:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc0a8070 con 0x7efdb0004d10 2023-07-09T02:15:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.874+0000 7efdc90b9640 1 -- 172.21.15.45:0/1748994089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0ada30 con 0x7efdb0004d10 2023-07-09T02:15:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- 172.21.15.45:0/1748994089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb0004d10 msgr2=0x7efdb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 --2- 172.21.15.45:0/1748994089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb0004d10 0x7efdb0005180 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00a860 tx=0x7efdbc01d360 comp rx=0 tx=0).stop 2023-07-09T02:15:18.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdca8bc640 1 -- 172.21.15.45:0/1748994089 reap_dead start 2023-07-09T02:15:18.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- 172.21.15.45:0/1748994089 shutdown_connections 2023-07-09T02:15:18.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- 172.21.15.45:0/1748994089 >> 172.21.15.45:0/1748994089 conn(0x7efdc40698e0 msgr2=0x7efdc4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:18.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- 172.21.15.45:0/1748994089 shutdown_connections 2023-07-09T02:15:18.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- 172.21.15.45:0/1748994089 wait complete. 2023-07-09T02:15:18.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 Processor -- start 2023-07-09T02:15:18.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- start start 2023-07-09T02:15:18.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0004d10 0x7efdc40b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdc40cca50 0x7efdc41f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc41f2200 0x7efdc41f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc4159580 con 0x7efdc40cca50 2023-07-09T02:15:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc40ca440 con 0x7efdb0004d10 2023-07-09T02:15:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdcc31f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc41f2bb0 con 0x7efdc41f2200 2023-07-09T02:15:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdc98ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdc40cca50 0x7efdc41f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdc98ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdc40cca50 0x7efdc41f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34822/0 (socket says 172.21.15.45:34822) 2023-07-09T02:15:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdc98ba640 1 -- 172.21.15.45:0/1197392032 learned_addr learned my addr 172.21.15.45:0/1197392032 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdca0bb640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0004d10 0x7efdc40b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.878+0000 7efdca8bc640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc41f2200 0x7efdc41f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdc98ba640 1 -- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc41f2200 msgr2=0x7efdc41f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdc98ba640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc41f2200 0x7efdc41f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdc98ba640 1 -- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0004d10 msgr2=0x7efdc40b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdc98ba640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0004d10 0x7efdc40b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdc98ba640 1 -- 172.21.15.45:0/1197392032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc40b8200 con 0x7efdc40cca50 2023-07-09T02:15:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdca8bc640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc41f2200 0x7efdc41f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdc98ba640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdc40cca50 0x7efdc41f1cc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efdb4011930 tx=0x7efdb4011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdbaffd640 1 -- 172.21.15.45:0/1197392032 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb400fa30 con 0x7efdc40cca50 2023-07-09T02:15:18.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdbaffd640 1 -- 172.21.15.45:0/1197392032 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb400fb90 con 0x7efdc40cca50 2023-07-09T02:15:18.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdbaffd640 1 -- 172.21.15.45:0/1197392032 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4014440 con 0x7efdc40cca50 2023-07-09T02:15:18.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc40ccec0 con 0x7efdc40cca50 2023-07-09T02:15:18.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc40b7c40 con 0x7efdc40cca50 2023-07-09T02:15:18.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc40ca220 con 0x7efdc40cca50 2023-07-09T02:15:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdbaffd640 1 -- 172.21.15.45:0/1197392032 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efdb40145a0 con 0x7efdc40cca50 2023-07-09T02:15:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdbaffd640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efda80662b0 0x7efda8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.882+0000 7efdbaffd640 1 -- 172.21.15.45:0/1197392032 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efdb40844f0 con 0x7efdc40cca50 2023-07-09T02:15:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.886+0000 7efdca0bb640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efda80662b0 0x7efda8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.886+0000 7efdca0bb640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efda80662b0 0x7efda8068760 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efdc40d2310 tx=0x7efdc0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:18.886+0000 7efdbaffd640 1 -- 172.21.15.45:0/1197392032 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efdb40518d0 con 0x7efdc40cca50 2023-07-09T02:15:19.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.038+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efdc415fe40 con 0x7efda80662b0 2023-07-09T02:15:19.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.046+0000 7efdbaffd640 1 -- 172.21.15.45:0/1197392032 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305451 (secure 0 0 0) 0x7efdc0019070 con 0x7efda80662b0 2023-07-09T02:15:19.051 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:15:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efda80662b0 msgr2=0x7efda8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efda80662b0 0x7efda8068760 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efdc40d2310 tx=0x7efdc0009190 comp rx=0 tx=0).stop 2023-07-09T02:15:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdc40cca50 msgr2=0x7efdc41f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdc40cca50 0x7efdc41f1cc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efdb4011930 tx=0x7efdb4011d30 comp rx=0 tx=0).stop 2023-07-09T02:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 shutdown_connections 2023-07-09T02:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efda80662b0 0x7efda8068760 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc41f2200 0x7efdc41f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdc40cca50 0x7efdc41f1cc0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 --2- 172.21.15.45:0/1197392032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb0004d10 0x7efdc40b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 >> 172.21.15.45:0/1197392032 conn(0x7efdc40698e0 msgr2=0x7efdc415e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 shutdown_connections 2023-07-09T02:15:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.050+0000 7efdcc31f640 1 -- 172.21.15.45:0/1197392032 wait complete. 2023-07-09T02:15:19.070 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2023-07-09T02:15:18.584453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5011,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557488,"statfs":{"total":1600000000,"available":1594868620,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001356"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347111+0000","last_change":"2023-07-09T02:15:14.345656+0000","last_active":"2023-07-09T02:15:14.347111+0000","last_peered":"2023-07-09T02:15:14.347111+0000","last_clean":"2023-07-09T02:15:14.347111+0000","last_became_active":"2023-07-09T02:15:14.345248+0000","last_became_peered":"2023-07-09T02:15:14.345248+0000","last_unstale":"2023-07-09T02:15:14.347111+0000","last_undegraded":"2023-07-09T02:15:14.347111+0000","last_fullsized":"2023-07-09T02:15:14.347111+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:05:46.478880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342727+0000","last_change":"2023-07-09T02:15:14.349377+0000","last_active":"2023-07-09T02:15:15.342727+0000","last_peered":"2023-07-09T02:15:15.342727+0000","last_clean":"2023-07-09T02:15:15.342727+0000","last_became_active":"2023-07-09T02:15:14.349068+0000","last_became_peered":"2023-07-09T02:15:14.349068+0000","last_unstale":"2023-07-09T02:15:15.342727+0000","last_undegraded":"2023-07-09T02:15:15.342727+0000","last_fullsized":"2023-07-09T02:15:15.342727+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:41:47.353211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347735+0000","last_change":"2023-07-09T02:15:14.347674+0000","last_active":"2023-07-09T02:15:14.347735+0000","last_peered":"2023-07-09T02:15:14.347735+0000","last_clean":"2023-07-09T02:15:14.347735+0000","last_became_active":"2023-07-09T02:15:14.347275+0000","last_became_peered":"2023-07-09T02:15:14.347275+0000","last_unstale":"2023-07-09T02:15:14.347735+0000","last_undegraded":"2023-07-09T02:15:14.347735+0000","last_fullsized":"2023-07-09T02:15:14.347735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:30:29.057749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341573+0000","last_change":"2023-07-09T02:15:14.352152+0000","last_active":"2023-07-09T02:15:15.341573+0000","last_peered":"2023-07-09T02:15:15.341573+0000","last_clean":"2023-07-09T02:15:15.341573+0000","last_became_active":"2023-07-09T02:15:14.351905+0000","last_became_peered":"2023-07-09T02:15:14.351905+0000","last_unstale":"2023-07-09T02:15:15.341573+0000","last_undegraded":"2023-07-09T02:15:15.341573+0000","last_fullsized":"2023-07-09T02:15:15.341573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:48:19.211779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.345398+0000","last_change":"2023-07-09T02:15:14.342980+0000","last_active":"2023-07-09T02:15:14.345398+0000","last_peered":"2023-07-09T02:15:14.345398+0000","last_clean":"2023-07-09T02:15:14.345398+0000","last_became_active":"2023-07-09T02:15:14.342718+0000","last_became_peered":"2023-07-09T02:15:14.342718+0000","last_unstale":"2023-07-09T02:15:14.345398+0000","last_undegraded":"2023-07-09T02:15:14.345398+0000","last_fullsized":"2023-07-09T02:15:14.345398+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:47.661325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350605+0000","last_change":"2023-07-09T02:15:14.350242+0000","last_active":"2023-07-09T02:15:14.350605+0000","last_peered":"2023-07-09T02:15:14.350605+0000","last_clean":"2023-07-09T02:15:14.350605+0000","last_became_active":"2023-07-09T02:15:14.350025+0000","last_became_peered":"2023-07-09T02:15:14.350025+0000","last_unstale":"2023-07-09T02:15:14.350605+0000","last_undegraded":"2023-07-09T02:15:14.350605+0000","last_fullsized":"2023-07-09T02:15:14.350605+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:59:36.007973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.354489+0000","last_change":"2023-07-09T02:15:14.354289+0000","last_active":"2023-07-09T02:15:14.354489+0000","last_peered":"2023-07-09T02:15:14.354489+0000","last_clean":"2023-07-09T02:15:14.354489+0000","last_became_active":"2023-07-09T02:15:14.353229+0000","last_became_peered":"2023-07-09T02:15:14.353229+0000","last_unstale":"2023-07-09T02:15:14.354489+0000","last_undegraded":"2023-07-09T02:15:14.354489+0000","last_fullsized":"2023-07-09T02:15:14.354489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:44:20.254809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.345424+0000","last_change":"2023-07-09T02:15:14.343943+0000","last_active":"2023-07-09T02:15:14.345424+0000","last_peered":"2023-07-09T02:15:14.345424+0000","last_clean":"2023-07-09T02:15:14.345424+0000","last_became_active":"2023-07-09T02:15:14.343672+0000","last_became_peered":"2023-07-09T02:15:14.343672+0000","last_unstale":"2023-07-09T02:15:14.345424+0000","last_undegraded":"2023-07-09T02:15:14.345424+0000","last_fullsized":"2023-07-09T02:15:14.345424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:39:30.264028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340076+0000","last_change":"2023-07-09T02:15:14.347397+0000","last_active":"2023-07-09T02:15:15.340076+0000","last_peered":"2023-07-09T02:15:15.340076+0000","last_clean":"2023-07-09T02:15:15.340076+0000","last_became_active":"2023-07-09T02:15:14.346948+0000","last_became_peered":"2023-07-09T02:15:14.346948+0000","last_unstale":"2023-07-09T02:15:15.340076+0000","last_undegraded":"2023-07-09T02:15:15.340076+0000","last_fullsized":"2023-07-09T02:15:15.340076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:25:15.772881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341589+0000","last_change":"2023-07-09T02:15:14.351335+0000","last_active":"2023-07-09T02:15:15.341589+0000","last_peered":"2023-07-09T02:15:15.341589+0000","last_clean":"2023-07-09T02:15:15.341589+0000","last_became_active":"2023-07-09T02:15:14.350889+0000","last_became_peered":"2023-07-09T02:15:14.350889+0000","last_unstale":"2023-07-09T02:15:15.341589+0000","last_undegraded":"2023-07-09T02:15:15.341589+0000","last_fullsized":"2023-07-09T02:15:15.341589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:11:39.506572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342715+0000","last_change":"2023-07-09T02:15:14.355215+0000","last_active":"2023-07-09T02:15:15.342715+0000","last_peered":"2023-07-09T02:15:15.342715+0000","last_clean":"2023-07-09T02:15:15.342715+0000","last_became_active":"2023-07-09T02:15:14.354684+0000","last_became_peered":"2023-07-09T02:15:14.354684+0000","last_unstale":"2023-07-09T02:15:15.342715+0000","last_undegraded":"2023-07-09T02:15:15.342715+0000","last_fullsized":"2023-07-09T02:15:15.342715+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:11:03.529141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341589+0000","last_change":"2023-07-09T02:15:14.354038+0000","last_active":"2023-07-09T02:15:15.341589+0000","last_peered":"2023-07-09T02:15:15.341589+0000","last_clean":"2023-07-09T02:15:15.341589+0000","last_became_active":"2023-07-09T02:15:14.353710+0000","last_became_peered":"2023-07-09T02:15:14.353710+0000","last_unstale":"2023-07-09T02:15:15.341589+0000","last_undegraded":"2023-07-09T02:15:15.341589+0000","last_fullsized":"2023-07-09T02:15:15.341589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:37:45.261519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353473+0000","last_change":"2023-07-09T02:15:14.353322+0000","last_active":"2023-07-09T02:15:14.353473+0000","last_peered":"2023-07-09T02:15:14.353473+0000","last_clean":"2023-07-09T02:15:14.353473+0000","last_became_active":"2023-07-09T02:15:14.353079+0000","last_became_peered":"2023-07-09T02:15:14.353079+0000","last_unstale":"2023-07-09T02:15:14.353473+0000","last_undegraded":"2023-07-09T02:15:14.353473+0000","last_fullsized":"2023-07-09T02:15:14.353473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:50:16.618733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350171+0000","last_change":"2023-07-09T02:15:14.349979+0000","last_active":"2023-07-09T02:15:14.350171+0000","last_peered":"2023-07-09T02:15:14.350171+0000","last_clean":"2023-07-09T02:15:14.350171+0000","last_became_active":"2023-07-09T02:15:14.349594+0000","last_became_peered":"2023-07-09T02:15:14.349594+0000","last_unstale":"2023-07-09T02:15:14.350171+0000","last_undegraded":"2023-07-09T02:15:14.350171+0000","last_fullsized":"2023-07-09T02:15:14.350171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:29.436548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342965+0000","last_change":"2023-07-09T02:15:14.354973+0000","last_active":"2023-07-09T02:15:15.342965+0000","last_peered":"2023-07-09T02:15:15.342965+0000","last_clean":"2023-07-09T02:15:15.342965+0000","last_became_active":"2023-07-09T02:15:14.354708+0000","last_became_peered":"2023-07-09T02:15:14.354708+0000","last_unstale":"2023-07-09T02:15:15.342965+0000","last_undegraded":"2023-07-09T02:15:15.342965+0000","last_fullsized":"2023-07-09T02:15:15.342965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:23:28.401434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350080+0000","last_change":"2023-07-09T02:15:14.349995+0000","last_active":"2023-07-09T02:15:14.350080+0000","last_peered":"2023-07-09T02:15:14.350080+0000","last_clean":"2023-07-09T02:15:14.350080+0000","last_became_active":"2023-07-09T02:15:14.349646+0000","last_became_peered":"2023-07-09T02:15:14.349646+0000","last_unstale":"2023-07-09T02:15:14.350080+0000","last_undegraded":"2023-07-09T02:15:14.350080+0000","last_fullsized":"2023-07-09T02:15:14.350080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:09:01.220742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.351253+0000","last_change":"2023-07-09T02:15:14.351119+0000","last_active":"2023-07-09T02:15:14.351253+0000","last_peered":"2023-07-09T02:15:14.351253+0000","last_clean":"2023-07-09T02:15:14.351253+0000","last_became_active":"2023-07-09T02:15:14.350825+0000","last_became_peered":"2023-07-09T02:15:14.350825+0000","last_unstale":"2023-07-09T02:15:14.351253+0000","last_undegraded":"2023-07-09T02:15:14.351253+0000","last_fullsized":"2023-07-09T02:15:14.351253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:52:24.536987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347584+0000","last_change":"2023-07-09T02:15:14.347505+0000","last_active":"2023-07-09T02:15:14.347584+0000","last_peered":"2023-07-09T02:15:14.347584+0000","last_clean":"2023-07-09T02:15:14.347584+0000","last_became_active":"2023-07-09T02:15:14.346948+0000","last_became_peered":"2023-07-09T02:15:14.346948+0000","last_unstale":"2023-07-09T02:15:14.347584+0000","last_undegraded":"2023-07-09T02:15:14.347584+0000","last_fullsized":"2023-07-09T02:15:14.347584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:04:02.431571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.351712+0000","last_change":"2023-07-09T02:15:14.351644+0000","last_active":"2023-07-09T02:15:14.351712+0000","last_peered":"2023-07-09T02:15:14.351712+0000","last_clean":"2023-07-09T02:15:14.351712+0000","last_became_active":"2023-07-09T02:15:14.350690+0000","last_became_peered":"2023-07-09T02:15:14.350690+0000","last_unstale":"2023-07-09T02:15:14.351712+0000","last_undegraded":"2023-07-09T02:15:14.351712+0000","last_fullsized":"2023-07-09T02:15:14.351712+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:43:10.992912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.348721+0000","last_change":"2023-07-09T02:15:14.348512+0000","last_active":"2023-07-09T02:15:14.348721+0000","last_peered":"2023-07-09T02:15:14.348721+0000","last_clean":"2023-07-09T02:15:14.348721+0000","last_became_active":"2023-07-09T02:15:14.348235+0000","last_became_peered":"2023-07-09T02:15:14.348235+0000","last_unstale":"2023-07-09T02:15:14.348721+0000","last_undegraded":"2023-07-09T02:15:14.348721+0000","last_fullsized":"2023-07-09T02:15:14.348721+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:05:59.259966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340222+0000","last_change":"2023-07-09T02:15:14.347946+0000","last_active":"2023-07-09T02:15:15.340222+0000","last_peered":"2023-07-09T02:15:15.340222+0000","last_clean":"2023-07-09T02:15:15.340222+0000","last_became_active":"2023-07-09T02:15:14.347102+0000","last_became_peered":"2023-07-09T02:15:14.347102+0000","last_unstale":"2023-07-09T02:15:15.340222+0000","last_undegraded":"2023-07-09T02:15:15.340222+0000","last_fullsized":"2023-07-09T02:15:15.340222+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:05:25.344662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353680+0000","last_change":"2023-07-09T02:15:14.353591+0000","last_active":"2023-07-09T02:15:14.353680+0000","last_peered":"2023-07-09T02:15:14.353680+0000","last_clean":"2023-07-09T02:15:14.353680+0000","last_became_active":"2023-07-09T02:15:14.353275+0000","last_became_peered":"2023-07-09T02:15:14.353275+0000","last_unstale":"2023-07-09T02:15:14.353680+0000","last_undegraded":"2023-07-09T02:15:14.353680+0000","last_fullsized":"2023-07-09T02:15:14.353680+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:48:49.611961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340076+0000","last_change":"2023-07-09T02:15:14.349454+0000","last_active":"2023-07-09T02:15:15.340076+0000","last_peered":"2023-07-09T02:15:15.340076+0000","last_clean":"2023-07-09T02:15:15.340076+0000","last_became_active":"2023-07-09T02:15:14.349080+0000","last_became_peered":"2023-07-09T02:15:14.349080+0000","last_unstale":"2023-07-09T02:15:15.340076+0000","last_undegraded":"2023-07-09T02:15:15.340076+0000","last_fullsized":"2023-07-09T02:15:15.340076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:32:09.998171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343181+0000","last_change":"2023-07-09T02:15:14.349227+0000","last_active":"2023-07-09T02:15:15.343181+0000","last_peered":"2023-07-09T02:15:15.343181+0000","last_clean":"2023-07-09T02:15:15.343181+0000","last_became_active":"2023-07-09T02:15:14.349001+0000","last_became_peered":"2023-07-09T02:15:14.349001+0000","last_unstale":"2023-07-09T02:15:15.343181+0000","last_undegraded":"2023-07-09T02:15:15.343181+0000","last_fullsized":"2023-07-09T02:15:15.343181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:19:22.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343063+0000","last_change":"2023-07-09T02:15:14.352199+0000","last_active":"2023-07-09T02:15:15.343063+0000","last_peered":"2023-07-09T02:15:15.343063+0000","last_clean":"2023-07-09T02:15:15.343063+0000","last_became_active":"2023-07-09T02:15:14.351934+0000","last_became_peered":"2023-07-09T02:15:14.351934+0000","last_unstale":"2023-07-09T02:15:15.343063+0000","last_undegraded":"2023-07-09T02:15:15.343063+0000","last_fullsized":"2023-07-09T02:15:15.343063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:13:43.274564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341663+0000","last_change":"2023-07-09T02:15:14.351531+0000","last_active":"2023-07-09T02:15:15.341663+0000","last_peered":"2023-07-09T02:15:15.341663+0000","last_clean":"2023-07-09T02:15:15.341663+0000","last_became_active":"2023-07-09T02:15:14.350971+0000","last_became_peered":"2023-07-09T02:15:14.350971+0000","last_unstale":"2023-07-09T02:15:15.341663+0000","last_undegraded":"2023-07-09T02:15:15.341663+0000","last_fullsized":"2023-07-09T02:15:15.341663+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:52:15.366972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353114+0000","last_change":"2023-07-09T02:15:14.352999+0000","last_active":"2023-07-09T02:15:14.353114+0000","last_peered":"2023-07-09T02:15:14.353114+0000","last_clean":"2023-07-09T02:15:14.353114+0000","last_became_active":"2023-07-09T02:15:14.352484+0000","last_became_peered":"2023-07-09T02:15:14.352484+0000","last_unstale":"2023-07-09T02:15:14.353114+0000","last_undegraded":"2023-07-09T02:15:14.353114+0000","last_fullsized":"2023-07-09T02:15:14.353114+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:19:09.169683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.349527+0000","last_change":"2023-07-09T02:15:14.349048+0000","last_active":"2023-07-09T02:15:14.349527+0000","last_peered":"2023-07-09T02:15:14.349527+0000","last_clean":"2023-07-09T02:15:14.349527+0000","last_became_active":"2023-07-09T02:15:14.348771+0000","last_became_peered":"2023-07-09T02:15:14.348771+0000","last_unstale":"2023-07-09T02:15:14.349527+0000","last_undegraded":"2023-07-09T02:15:14.349527+0000","last_fullsized":"2023-07-09T02:15:14.349527+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:37:23.712930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343253+0000","last_change":"2023-07-09T02:15:14.352815+0000","last_active":"2023-07-09T02:15:15.343253+0000","last_peered":"2023-07-09T02:15:15.343253+0000","last_clean":"2023-07-09T02:15:15.343253+0000","last_became_active":"2023-07-09T02:15:14.352427+0000","last_became_peered":"2023-07-09T02:15:14.352427+0000","last_unstale":"2023-07-09T02:15:15.343253+0000","last_undegraded":"2023-07-09T02:15:15.343253+0000","last_fullsized":"2023-07-09T02:15:15.343253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:59:21.014382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.349641+0000","last_change":"2023-07-09T02:15:14.349111+0000","last_active":"2023-07-09T02:15:14.349641+0000","last_peered":"2023-07-09T02:15:14.349641+0000","last_clean":"2023-07-09T02:15:14.349641+0000","last_became_active":"2023-07-09T02:15:14.348884+0000","last_became_peered":"2023-07-09T02:15:14.348884+0000","last_unstale":"2023-07-09T02:15:14.349641+0000","last_undegraded":"2023-07-09T02:15:14.349641+0000","last_fullsized":"2023-07-09T02:15:14.349641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:49:13.241019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.351276+0000","last_change":"2023-07-09T02:15:14.351175+0000","last_active":"2023-07-09T02:15:14.351276+0000","last_peered":"2023-07-09T02:15:14.351276+0000","last_clean":"2023-07-09T02:15:14.351276+0000","last_became_active":"2023-07-09T02:15:14.350944+0000","last_became_peered":"2023-07-09T02:15:14.350944+0000","last_unstale":"2023-07-09T02:15:14.351276+0000","last_undegraded":"2023-07-09T02:15:14.351276+0000","last_fullsized":"2023-07-09T02:15:14.351276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:55:30.637061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.349623+0000","last_change":"2023-07-09T02:15:14.347663+0000","last_active":"2023-07-09T02:15:14.349623+0000","last_peered":"2023-07-09T02:15:14.349623+0000","last_clean":"2023-07-09T02:15:14.349623+0000","last_became_active":"2023-07-09T02:15:14.344445+0000","last_became_peered":"2023-07-09T02:15:14.344445+0000","last_unstale":"2023-07-09T02:15:14.349623+0000","last_undegraded":"2023-07-09T02:15:14.349623+0000","last_fullsized":"2023-07-09T02:15:14.349623+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:59:27.584584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350479+0000","last_change":"2023-07-09T02:15:14.350380+0000","last_active":"2023-07-09T02:15:14.350479+0000","last_peered":"2023-07-09T02:15:14.350479+0000","last_clean":"2023-07-09T02:15:14.350479+0000","last_became_active":"2023-07-09T02:15:14.349572+0000","last_became_peered":"2023-07-09T02:15:14.349572+0000","last_unstale":"2023-07-09T02:15:14.350479+0000","last_undegraded":"2023-07-09T02:15:14.350479+0000","last_fullsized":"2023-07-09T02:15:14.350479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:28.448504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"87'4","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.598682+0000","last_change":"2023-07-09T02:15:13.599578+0000","last_active":"2023-07-09T02:15:14.598682+0000","last_peered":"2023-07-09T02:15:14.598682+0000","last_clean":"2023-07-09T02:15:14.598682+0000","last_became_active":"2023-07-09T02:15:13.593953+0000","last_became_peered":"2023-07-09T02:15:13.593953+0000","last_unstale":"2023-07-09T02:15:14.598682+0000","last_undegraded":"2023-07-09T02:15:14.598682+0000","last_fullsized":"2023-07-09T02:15:14.598682+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:58:14.650817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343309+0000","last_change":"2023-07-09T02:15:14.352649+0000","last_active":"2023-07-09T02:15:15.343309+0000","last_peered":"2023-07-09T02:15:15.343309+0000","last_clean":"2023-07-09T02:15:15.343309+0000","last_became_active":"2023-07-09T02:15:14.352125+0000","last_became_peered":"2023-07-09T02:15:14.352125+0000","last_unstale":"2023-07-09T02:15:15.343309+0000","last_undegraded":"2023-07-09T02:15:15.343309+0000","last_fullsized":"2023-07-09T02:15:15.343309+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:15:17.595902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.597579+0000","last_change":"2023-07-09T02:15:13.594030+0000","last_active":"2023-07-09T02:15:14.597579+0000","last_peered":"2023-07-09T02:15:14.597579+0000","last_clean":"2023-07-09T02:15:14.597579+0000","last_became_active":"2023-07-09T02:15:13.593597+0000","last_became_peered":"2023-07-09T02:15:13.593597+0000","last_unstale":"2023-07-09T02:15:14.597579+0000","last_undegraded":"2023-07-09T02:15:14.597579+0000","last_fullsized":"2023-07-09T02:15:14.597579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:56:25.772152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340298+0000","last_change":"2023-07-09T02:15:14.348070+0000","last_active":"2023-07-09T02:15:15.340298+0000","last_peered":"2023-07-09T02:15:15.340298+0000","last_clean":"2023-07-09T02:15:15.340298+0000","last_became_active":"2023-07-09T02:15:14.347801+0000","last_became_peered":"2023-07-09T02:15:14.347801+0000","last_unstale":"2023-07-09T02:15:15.340298+0000","last_undegraded":"2023-07-09T02:15:15.340298+0000","last_fullsized":"2023-07-09T02:15:15.340298+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:57:17.284401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.594239+0000","last_change":"2023-07-09T02:15:13.592719+0000","last_active":"2023-07-09T02:15:14.594239+0000","last_peered":"2023-07-09T02:15:14.594239+0000","last_clean":"2023-07-09T02:15:14.594239+0000","last_became_active":"2023-07-09T02:15:13.592363+0000","last_became_peered":"2023-07-09T02:15:13.592363+0000","last_unstale":"2023-07-09T02:15:14.594239+0000","last_undegraded":"2023-07-09T02:15:14.594239+0000","last_fullsized":"2023-07-09T02:15:14.594239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:55:58.556109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340077+0000","last_change":"2023-07-09T02:15:14.351132+0000","last_active":"2023-07-09T02:15:15.340077+0000","last_peered":"2023-07-09T02:15:15.340077+0000","last_clean":"2023-07-09T02:15:15.340077+0000","last_became_active":"2023-07-09T02:15:14.349955+0000","last_became_peered":"2023-07-09T02:15:14.349955+0000","last_unstale":"2023-07-09T02:15:15.340077+0000","last_undegraded":"2023-07-09T02:15:15.340077+0000","last_fullsized":"2023-07-09T02:15:15.340077+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:18:21.395344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.595780+0000","last_change":"2023-07-09T02:15:13.598543+0000","last_active":"2023-07-09T02:15:14.595780+0000","last_peered":"2023-07-09T02:15:14.595780+0000","last_clean":"2023-07-09T02:15:14.595780+0000","last_became_active":"2023-07-09T02:15:13.597909+0000","last_became_peered":"2023-07-09T02:15:13.597909+0000","last_unstale":"2023-07-09T02:15:14.595780+0000","last_undegraded":"2023-07-09T02:15:14.595780+0000","last_fullsized":"2023-07-09T02:15:14.595780+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:25:32.861415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342912+0000","last_change":"2023-07-09T02:15:14.355070+0000","last_active":"2023-07-09T02:15:15.342912+0000","last_peered":"2023-07-09T02:15:15.342912+0000","last_clean":"2023-07-09T02:15:15.342912+0000","last_became_active":"2023-07-09T02:15:14.352984+0000","last_became_peered":"2023-07-09T02:15:14.352984+0000","last_unstale":"2023-07-09T02:15:15.342912+0000","last_undegraded":"2023-07-09T02:15:15.342912+0000","last_fullsized":"2023-07-09T02:15:15.342912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:31:15.633484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"87'1","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340548+0000","last_change":"2023-07-09T02:15:13.595379+0000","last_active":"2023-07-09T02:15:15.340548+0000","last_peered":"2023-07-09T02:15:15.340548+0000","last_clean":"2023-07-09T02:15:15.340548+0000","last_became_active":"2023-07-09T02:15:13.595151+0000","last_became_peered":"2023-07-09T02:15:13.595151+0000","last_unstale":"2023-07-09T02:15:15.340548+0000","last_undegraded":"2023-07-09T02:15:15.340548+0000","last_fullsized":"2023-07-09T02:15:15.340548+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:36:39.761980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343129+0000","last_change":"2023-07-09T02:15:14.349458+0000","last_active":"2023-07-09T02:15:15.343129+0000","last_peered":"2023-07-09T02:15:15.343129+0000","last_clean":"2023-07-09T02:15:15.343129+0000","last_became_active":"2023-07-09T02:15:14.349188+0000","last_became_peered":"2023-07-09T02:15:14.349188+0000","last_unstale":"2023-07-09T02:15:15.343129+0000","last_undegraded":"2023-07-09T02:15:15.343129+0000","last_fullsized":"2023-07-09T02:15:15.343129+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:44:05.532048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"87'1","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341707+0000","last_change":"2023-07-09T02:15:13.592494+0000","last_active":"2023-07-09T02:15:15.341707+0000","last_peered":"2023-07-09T02:15:15.341707+0000","last_clean":"2023-07-09T02:15:15.341707+0000","last_became_active":"2023-07-09T02:15:13.592263+0000","last_became_peered":"2023-07-09T02:15:13.592263+0000","last_unstale":"2023-07-09T02:15:15.341707+0000","last_undegraded":"2023-07-09T02:15:15.341707+0000","last_fullsized":"2023-07-09T02:15:15.341707+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:04:20.262055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340429+0000","last_change":"2023-07-09T02:15:14.347239+0000","last_active":"2023-07-09T02:15:15.340429+0000","last_peered":"2023-07-09T02:15:15.340429+0000","last_clean":"2023-07-09T02:15:15.340429+0000","last_became_active":"2023-07-09T02:15:14.346646+0000","last_became_peered":"2023-07-09T02:15:14.346646+0000","last_unstale":"2023-07-09T02:15:15.340429+0000","last_undegraded":"2023-07-09T02:15:15.340429+0000","last_fullsized":"2023-07-09T02:15:15.340429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:58:03.358113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343360+0000","last_change":"2023-07-09T02:15:13.597339+0000","last_active":"2023-07-09T02:15:15.343360+0000","last_peered":"2023-07-09T02:15:15.343360+0000","last_clean":"2023-07-09T02:15:15.343360+0000","last_became_active":"2023-07-09T02:15:13.597103+0000","last_became_peered":"2023-07-09T02:15:13.597103+0000","last_unstale":"2023-07-09T02:15:15.343360+0000","last_undegraded":"2023-07-09T02:15:15.343360+0000","last_fullsized":"2023-07-09T02:15:15.343360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:36:40.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.354184+0000","last_change":"2023-07-09T02:15:14.353972+0000","last_active":"2023-07-09T02:15:14.354184+0000","last_peered":"2023-07-09T02:15:14.354184+0000","last_clean":"2023-07-09T02:15:14.354184+0000","last_became_active":"2023-07-09T02:15:14.353612+0000","last_became_peered":"2023-07-09T02:15:14.353612+0000","last_unstale":"2023-07-09T02:15:14.354184+0000","last_undegraded":"2023-07-09T02:15:14.354184+0000","last_fullsized":"2023-07-09T02:15:14.354184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:24:00.444800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.340200+0000","last_change":"2023-07-09T02:15:13.593111+0000","last_active":"2023-07-09T02:15:14.340200+0000","last_peered":"2023-07-09T02:15:14.340200+0000","last_clean":"2023-07-09T02:15:14.340200+0000","last_became_active":"2023-07-09T02:15:13.592666+0000","last_became_peered":"2023-07-09T02:15:13.592666+0000","last_unstale":"2023-07-09T02:15:14.340200+0000","last_undegraded":"2023-07-09T02:15:14.340200+0000","last_fullsized":"2023-07-09T02:15:14.340200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:25:59.707883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342747+0000","last_change":"2023-07-09T02:15:14.344625+0000","last_active":"2023-07-09T02:15:15.342747+0000","last_peered":"2023-07-09T02:15:15.342747+0000","last_clean":"2023-07-09T02:15:15.342747+0000","last_became_active":"2023-07-09T02:15:14.343693+0000","last_became_peered":"2023-07-09T02:15:14.343693+0000","last_unstale":"2023-07-09T02:15:15.342747+0000","last_undegraded":"2023-07-09T02:15:15.342747+0000","last_fullsized":"2023-07-09T02:15:15.342747+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:03:29.415585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.340886+0000","last_change":"2023-07-09T02:15:13.595641+0000","last_active":"2023-07-09T02:15:14.340886+0000","last_peered":"2023-07-09T02:15:14.340886+0000","last_clean":"2023-07-09T02:15:14.340886+0000","last_became_active":"2023-07-09T02:15:13.595245+0000","last_became_peered":"2023-07-09T02:15:13.595245+0000","last_unstale":"2023-07-09T02:15:14.340886+0000","last_undegraded":"2023-07-09T02:15:14.340886+0000","last_fullsized":"2023-07-09T02:15:14.340886+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:13:58.974214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341747+0000","last_change":"2023-07-09T02:15:14.352909+0000","last_active":"2023-07-09T02:15:15.341747+0000","last_peered":"2023-07-09T02:15:15.341747+0000","last_clean":"2023-07-09T02:15:15.341747+0000","last_became_active":"2023-07-09T02:15:14.352645+0000","last_became_peered":"2023-07-09T02:15:14.352645+0000","last_unstale":"2023-07-09T02:15:15.341747+0000","last_undegraded":"2023-07-09T02:15:15.341747+0000","last_fullsized":"2023-07-09T02:15:15.341747+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:32:18.467449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341878+0000","last_change":"2023-07-09T02:15:13.597203+0000","last_active":"2023-07-09T02:15:15.341878+0000","last_peered":"2023-07-09T02:15:15.341878+0000","last_clean":"2023-07-09T02:15:15.341878+0000","last_became_active":"2023-07-09T02:15:13.596988+0000","last_became_peered":"2023-07-09T02:15:13.596988+0000","last_unstale":"2023-07-09T02:15:15.341878+0000","last_undegraded":"2023-07-09T02:15:15.341878+0000","last_fullsized":"2023-07-09T02:15:15.341878+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:01:09.416249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.348270+0000","last_change":"2023-07-09T02:15:14.348197+0000","last_active":"2023-07-09T02:15:14.348270+0000","last_peered":"2023-07-09T02:15:14.348270+0000","last_clean":"2023-07-09T02:15:14.348270+0000","last_became_active":"2023-07-09T02:15:14.347971+0000","last_became_peered":"2023-07-09T02:15:14.347971+0000","last_unstale":"2023-07-09T02:15:14.348270+0000","last_undegraded":"2023-07-09T02:15:14.348270+0000","last_fullsized":"2023-07-09T02:15:14.348270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:40:02.947395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"87'3","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.598135+0000","last_change":"2023-07-09T02:15:13.594190+0000","last_active":"2023-07-09T02:15:14.598135+0000","last_peered":"2023-07-09T02:15:14.598135+0000","last_clean":"2023-07-09T02:15:14.598135+0000","last_became_active":"2023-07-09T02:15:13.593571+0000","last_became_peered":"2023-07-09T02:15:13.593571+0000","last_unstale":"2023-07-09T02:15:14.598135+0000","last_undegraded":"2023-07-09T02:15:14.598135+0000","last_fullsized":"2023-07-09T02:15:14.598135+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:35:35.233664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353500+0000","last_change":"2023-07-09T02:15:14.353264+0000","last_active":"2023-07-09T02:15:14.353500+0000","last_peered":"2023-07-09T02:15:14.353500+0000","last_clean":"2023-07-09T02:15:14.353500+0000","last_became_active":"2023-07-09T02:15:14.353025+0000","last_became_peered":"2023-07-09T02:15:14.353025+0000","last_unstale":"2023-07-09T02:15:14.353500+0000","last_undegraded":"2023-07-09T02:15:14.353500+0000","last_fullsized":"2023-07-09T02:15:14.353500+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:31:42.916753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"87'6","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.599368+0000","last_change":"2023-07-09T02:15:13.591899+0000","last_active":"2023-07-09T02:15:14.599368+0000","last_peered":"2023-07-09T02:15:14.599368+0000","last_clean":"2023-07-09T02:15:14.599368+0000","last_became_active":"2023-07-09T02:15:13.590849+0000","last_became_peered":"2023-07-09T02:15:13.590849+0000","last_unstale":"2023-07-09T02:15:14.599368+0000","last_undegraded":"2023-07-09T02:15:14.599368+0000","last_fullsized":"2023-07-09T02:15:14.599368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:03:28.015976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341735+0000","last_change":"2023-07-09T02:15:14.354101+0000","last_active":"2023-07-09T02:15:15.341735+0000","last_peered":"2023-07-09T02:15:15.341735+0000","last_clean":"2023-07-09T02:15:15.341735+0000","last_became_active":"2023-07-09T02:15:14.353727+0000","last_became_peered":"2023-07-09T02:15:14.353727+0000","last_unstale":"2023-07-09T02:15:15.341735+0000","last_undegraded":"2023-07-09T02:15:15.341735+0000","last_fullsized":"2023-07-09T02:15:15.341735+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:19:54.332631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341764+0000","last_change":"2023-07-09T02:15:13.599175+0000","last_active":"2023-07-09T02:15:15.341764+0000","last_peered":"2023-07-09T02:15:15.341764+0000","last_clean":"2023-07-09T02:15:15.341764+0000","last_became_active":"2023-07-09T02:15:13.598907+0000","last_became_peered":"2023-07-09T02:15:13.598907+0000","last_unstale":"2023-07-09T02:15:15.341764+0000","last_undegraded":"2023-07-09T02:15:15.341764+0000","last_fullsized":"2023-07-09T02:15:15.341764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:37:24.396406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.350233+0000","last_change":"2023-07-09T02:15:14.350151+0000","last_active":"2023-07-09T02:15:14.350233+0000","last_peered":"2023-07-09T02:15:14.350233+0000","last_clean":"2023-07-09T02:15:14.350233+0000","last_became_active":"2023-07-09T02:15:14.349910+0000","last_became_peered":"2023-07-09T02:15:14.349910+0000","last_unstale":"2023-07-09T02:15:14.350233+0000","last_undegraded":"2023-07-09T02:15:14.350233+0000","last_fullsized":"2023-07-09T02:15:14.350233+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:40:41.604871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.341394+0000","last_change":"2023-07-09T02:15:13.595509+0000","last_active":"2023-07-09T02:15:14.341394+0000","last_peered":"2023-07-09T02:15:14.341394+0000","last_clean":"2023-07-09T02:15:14.341394+0000","last_became_active":"2023-07-09T02:15:13.594785+0000","last_became_peered":"2023-07-09T02:15:13.594785+0000","last_unstale":"2023-07-09T02:15:14.341394+0000","last_undegraded":"2023-07-09T02:15:14.341394+0000","last_fullsized":"2023-07-09T02:15:14.341394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:51:23.696816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353028+0000","last_change":"2023-07-09T02:15:14.352710+0000","last_active":"2023-07-09T02:15:14.353028+0000","last_peered":"2023-07-09T02:15:14.353028+0000","last_clean":"2023-07-09T02:15:14.353028+0000","last_became_active":"2023-07-09T02:15:14.352426+0000","last_became_peered":"2023-07-09T02:15:14.352426+0000","last_unstale":"2023-07-09T02:15:14.353028+0000","last_undegraded":"2023-07-09T02:15:14.353028+0000","last_fullsized":"2023-07-09T02:15:14.353028+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:20:28.334671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339544+0000","last_change":"2023-07-09T02:15:13.596380+0000","last_active":"2023-07-09T02:15:14.339544+0000","last_peered":"2023-07-09T02:15:14.339544+0000","last_clean":"2023-07-09T02:15:14.339544+0000","last_became_active":"2023-07-09T02:15:13.595508+0000","last_became_peered":"2023-07-09T02:15:13.595508+0000","last_unstale":"2023-07-09T02:15:14.339544+0000","last_undegraded":"2023-07-09T02:15:14.339544+0000","last_fullsized":"2023-07-09T02:15:14.339544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:16:27.440020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.356095+0000","last_change":"2023-07-09T02:15:14.354627+0000","last_active":"2023-07-09T02:15:14.356095+0000","last_peered":"2023-07-09T02:15:14.356095+0000","last_clean":"2023-07-09T02:15:14.356095+0000","last_became_active":"2023-07-09T02:15:14.354365+0000","last_became_peered":"2023-07-09T02:15:14.354365+0000","last_unstale":"2023-07-09T02:15:14.356095+0000","last_undegraded":"2023-07-09T02:15:14.356095+0000","last_fullsized":"2023-07-09T02:15:14.356095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:32:45.146633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"87'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342883+0000","last_change":"2023-07-09T02:15:13.590497+0000","last_active":"2023-07-09T02:15:15.342883+0000","last_peered":"2023-07-09T02:15:15.342883+0000","last_clean":"2023-07-09T02:15:15.342883+0000","last_became_active":"2023-07-09T02:15:13.590101+0000","last_became_peered":"2023-07-09T02:15:13.590101+0000","last_unstale":"2023-07-09T02:15:15.342883+0000","last_undegraded":"2023-07-09T02:15:15.342883+0000","last_fullsized":"2023-07-09T02:15:15.342883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:29:42.673015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340265+0000","last_change":"2023-07-09T02:15:14.351267+0000","last_active":"2023-07-09T02:15:15.340265+0000","last_peered":"2023-07-09T02:15:15.340265+0000","last_clean":"2023-07-09T02:15:15.340265+0000","last_became_active":"2023-07-09T02:15:14.350932+0000","last_became_peered":"2023-07-09T02:15:14.350932+0000","last_unstale":"2023-07-09T02:15:15.340265+0000","last_undegraded":"2023-07-09T02:15:15.340265+0000","last_fullsized":"2023-07-09T02:15:15.340265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:35:27.786748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341997+0000","last_change":"2023-07-09T02:15:13.591679+0000","last_active":"2023-07-09T02:15:15.341997+0000","last_peered":"2023-07-09T02:15:15.341997+0000","last_clean":"2023-07-09T02:15:15.341997+0000","last_became_active":"2023-07-09T02:15:13.591458+0000","last_became_peered":"2023-07-09T02:15:13.591458+0000","last_unstale":"2023-07-09T02:15:15.341997+0000","last_undegraded":"2023-07-09T02:15:15.341997+0000","last_fullsized":"2023-07-09T02:15:15.341997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:41:33.787845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.354166+0000","last_change":"2023-07-09T02:15:14.353833+0000","last_active":"2023-07-09T02:15:14.354166+0000","last_peered":"2023-07-09T02:15:14.354166+0000","last_clean":"2023-07-09T02:15:14.354166+0000","last_became_active":"2023-07-09T02:15:14.353246+0000","last_became_peered":"2023-07-09T02:15:14.353246+0000","last_unstale":"2023-07-09T02:15:14.354166+0000","last_undegraded":"2023-07-09T02:15:14.354166+0000","last_fullsized":"2023-07-09T02:15:14.354166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:17:43.247442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342999+0000","last_change":"2023-07-09T02:15:13.598670+0000","last_active":"2023-07-09T02:15:15.342999+0000","last_peered":"2023-07-09T02:15:15.342999+0000","last_clean":"2023-07-09T02:15:15.342999+0000","last_became_active":"2023-07-09T02:15:13.598404+0000","last_became_peered":"2023-07-09T02:15:13.598404+0000","last_unstale":"2023-07-09T02:15:15.342999+0000","last_undegraded":"2023-07-09T02:15:15.342999+0000","last_fullsized":"2023-07-09T02:15:15.342999+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:55:15.668038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340255+0000","last_change":"2023-07-09T02:15:14.350979+0000","last_active":"2023-07-09T02:15:15.340255+0000","last_peered":"2023-07-09T02:15:15.340255+0000","last_clean":"2023-07-09T02:15:15.340255+0000","last_became_active":"2023-07-09T02:15:14.349629+0000","last_became_peered":"2023-07-09T02:15:14.349629+0000","last_unstale":"2023-07-09T02:15:15.340255+0000","last_undegraded":"2023-07-09T02:15:15.340255+0000","last_fullsized":"2023-07-09T02:15:15.340255+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:55:12.178347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339853+0000","last_change":"2023-07-09T02:15:13.598203+0000","last_active":"2023-07-09T02:15:14.339853+0000","last_peered":"2023-07-09T02:15:14.339853+0000","last_clean":"2023-07-09T02:15:14.339853+0000","last_became_active":"2023-07-09T02:15:13.597778+0000","last_became_peered":"2023-07-09T02:15:13.597778+0000","last_unstale":"2023-07-09T02:15:14.339853+0000","last_undegraded":"2023-07-09T02:15:14.339853+0000","last_fullsized":"2023-07-09T02:15:14.339853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:29:23.594134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343026+0000","last_change":"2023-07-09T02:15:14.346856+0000","last_active":"2023-07-09T02:15:15.343026+0000","last_peered":"2023-07-09T02:15:15.343026+0000","last_clean":"2023-07-09T02:15:15.343026+0000","last_became_active":"2023-07-09T02:15:14.346617+0000","last_became_peered":"2023-07-09T02:15:14.346617+0000","last_unstale":"2023-07-09T02:15:15.343026+0000","last_undegraded":"2023-07-09T02:15:15.343026+0000","last_fullsized":"2023-07-09T02:15:15.343026+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:48:17.709745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.340543+0000","last_change":"2023-07-09T02:15:13.592584+0000","last_active":"2023-07-09T02:15:14.340543+0000","last_peered":"2023-07-09T02:15:14.340543+0000","last_clean":"2023-07-09T02:15:14.340543+0000","last_became_active":"2023-07-09T02:15:13.591445+0000","last_became_peered":"2023-07-09T02:15:13.591445+0000","last_unstale":"2023-07-09T02:15:14.340543+0000","last_undegraded":"2023-07-09T02:15:14.340543+0000","last_fullsized":"2023-07-09T02:15:14.340543+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:36:43.977635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353046+0000","last_change":"2023-07-09T02:15:14.352805+0000","last_active":"2023-07-09T02:15:14.353046+0000","last_peered":"2023-07-09T02:15:14.353046+0000","last_clean":"2023-07-09T02:15:14.353046+0000","last_became_active":"2023-07-09T02:15:14.352573+0000","last_became_peered":"2023-07-09T02:15:14.352573+0000","last_unstale":"2023-07-09T02:15:14.353046+0000","last_undegraded":"2023-07-09T02:15:14.353046+0000","last_fullsized":"2023-07-09T02:15:14.353046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:53:02.856603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.348936+0000","last_change":"2023-07-09T02:15:13.598685+0000","last_active":"2023-07-09T02:15:14.348936+0000","last_peered":"2023-07-09T02:15:14.348936+0000","last_clean":"2023-07-09T02:15:14.348936+0000","last_became_active":"2023-07-09T02:15:13.598202+0000","last_became_peered":"2023-07-09T02:15:13.598202+0000","last_unstale":"2023-07-09T02:15:14.348936+0000","last_undegraded":"2023-07-09T02:15:14.348936+0000","last_fullsized":"2023-07-09T02:15:14.348936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:09:22.991257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.356761+0000","last_change":"2023-07-09T02:15:14.356680+0000","last_active":"2023-07-09T02:15:14.356761+0000","last_peered":"2023-07-09T02:15:14.356761+0000","last_clean":"2023-07-09T02:15:14.356761+0000","last_became_active":"2023-07-09T02:15:14.356229+0000","last_became_peered":"2023-07-09T02:15:14.356229+0000","last_unstale":"2023-07-09T02:15:14.356761+0000","last_undegraded":"2023-07-09T02:15:14.356761+0000","last_fullsized":"2023-07-09T02:15:14.356761+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:54:21.066106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339946+0000","last_change":"2023-07-09T02:15:13.596538+0000","last_active":"2023-07-09T02:15:14.339946+0000","last_peered":"2023-07-09T02:15:14.339946+0000","last_clean":"2023-07-09T02:15:14.339946+0000","last_became_active":"2023-07-09T02:15:13.595840+0000","last_became_peered":"2023-07-09T02:15:13.595840+0000","last_unstale":"2023-07-09T02:15:14.339946+0000","last_undegraded":"2023-07-09T02:15:14.339946+0000","last_fullsized":"2023-07-09T02:15:14.339946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:29:06.438513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.354351+0000","last_change":"2023-07-09T02:15:14.354261+0000","last_active":"2023-07-09T02:15:14.354351+0000","last_peered":"2023-07-09T02:15:14.354351+0000","last_clean":"2023-07-09T02:15:14.354351+0000","last_became_active":"2023-07-09T02:15:14.353977+0000","last_became_peered":"2023-07-09T02:15:14.353977+0000","last_unstale":"2023-07-09T02:15:14.354351+0000","last_undegraded":"2023-07-09T02:15:14.354351+0000","last_fullsized":"2023-07-09T02:15:14.354351+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:21:42.465212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.346037+0000","last_change":"2023-07-09T02:15:13.595221+0000","last_active":"2023-07-09T02:15:14.346037+0000","last_peered":"2023-07-09T02:15:14.346037+0000","last_clean":"2023-07-09T02:15:14.346037+0000","last_became_active":"2023-07-09T02:15:13.594995+0000","last_became_peered":"2023-07-09T02:15:13.594995+0000","last_unstale":"2023-07-09T02:15:14.346037+0000","last_undegraded":"2023-07-09T02:15:14.346037+0000","last_fullsized":"2023-07-09T02:15:14.346037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:16:29.285016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.346466+0000","last_change":"2023-07-09T02:15:14.346352+0000","last_active":"2023-07-09T02:15:14.346466+0000","last_peered":"2023-07-09T02:15:14.346466+0000","last_clean":"2023-07-09T02:15:14.346466+0000","last_became_active":"2023-07-09T02:15:14.346134+0000","last_became_peered":"2023-07-09T02:15:14.346134+0000","last_unstale":"2023-07-09T02:15:14.346466+0000","last_undegraded":"2023-07-09T02:15:14.346466+0000","last_fullsized":"2023-07-09T02:15:14.346466+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:32:15.651656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.342228+0000","last_change":"2023-07-09T02:15:13.595822+0000","last_active":"2023-07-09T02:15:14.342228+0000","last_peered":"2023-07-09T02:15:14.342228+0000","last_clean":"2023-07-09T02:15:14.342228+0000","last_became_active":"2023-07-09T02:15:13.595532+0000","last_became_peered":"2023-07-09T02:15:13.595532+0000","last_unstale":"2023-07-09T02:15:14.342228+0000","last_undegraded":"2023-07-09T02:15:14.342228+0000","last_fullsized":"2023-07-09T02:15:14.342228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:40:45.562585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347093+0000","last_change":"2023-07-09T02:15:14.345499+0000","last_active":"2023-07-09T02:15:14.347093+0000","last_peered":"2023-07-09T02:15:14.347093+0000","last_clean":"2023-07-09T02:15:14.347093+0000","last_became_active":"2023-07-09T02:15:14.344326+0000","last_became_peered":"2023-07-09T02:15:14.344326+0000","last_unstale":"2023-07-09T02:15:14.347093+0000","last_undegraded":"2023-07-09T02:15:14.347093+0000","last_fullsized":"2023-07-09T02:15:14.347093+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:23:28.529139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.345025+0000","last_change":"2023-07-09T02:15:13.598324+0000","last_active":"2023-07-09T02:15:14.345025+0000","last_peered":"2023-07-09T02:15:14.345025+0000","last_clean":"2023-07-09T02:15:14.345025+0000","last_became_active":"2023-07-09T02:15:13.597803+0000","last_became_peered":"2023-07-09T02:15:13.597803+0000","last_unstale":"2023-07-09T02:15:14.345025+0000","last_undegraded":"2023-07-09T02:15:14.345025+0000","last_fullsized":"2023-07-09T02:15:14.345025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:29:15.748389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":283,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339959+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:15:14.339959+0000","last_peered":"2023-07-09T02:15:14.339959+0000","last_clean":"2023-07-09T02:15:14.339959+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:15:14.339959+0000","last_undegraded":"2023-07-09T02:15:14.339959+0000","last_fullsized":"2023-07-09T02:15:14.339959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:04:55.530281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.341757+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:15:15.341757+0000","last_peered":"2023-07-09T02:15:15.341757+0000","last_clean":"2023-07-09T02:15:15.341757+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:15:15.341757+0000","last_undegraded":"2023-07-09T02:15:15.341757+0000","last_fullsized":"2023-07-09T02:15:15.341757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:14:21.559850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.343191+0000","last_change":"2023-07-09T02:15:14.348639+0000","last_active":"2023-07-09T02:15:15.343191+0000","last_peered":"2023-07-09T02:15:15.343191+0000","last_clean":"2023-07-09T02:15:15.343191+0000","last_became_active":"2023-07-09T02:15:14.348418+0000","last_became_peered":"2023-07-09T02:15:14.348418+0000","last_unstale":"2023-07-09T02:15:15.343191+0000","last_undegraded":"2023-07-09T02:15:15.343191+0000","last_fullsized":"2023-07-09T02:15:15.343191+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:30:12.615902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.346126+0000","last_change":"2023-07-09T02:15:13.595542+0000","last_active":"2023-07-09T02:15:14.346126+0000","last_peered":"2023-07-09T02:15:14.346126+0000","last_clean":"2023-07-09T02:15:14.346126+0000","last_became_active":"2023-07-09T02:15:13.595319+0000","last_became_peered":"2023-07-09T02:15:13.595319+0000","last_unstale":"2023-07-09T02:15:14.346126+0000","last_undegraded":"2023-07-09T02:15:14.346126+0000","last_fullsized":"2023-07-09T02:15:14.346126+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:05:12.116020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339667+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:15:14.339667+0000","last_peered":"2023-07-09T02:15:14.339667+0000","last_clean":"2023-07-09T02:15:14.339667+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:15:14.339667+0000","last_undegraded":"2023-07-09T02:15:14.339667+0000","last_fullsized":"2023-07-09T02:15:14.339667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:18:45.528318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.356584+0000","last_change":"2023-07-09T02:15:14.356502+0000","last_active":"2023-07-09T02:15:14.356584+0000","last_peered":"2023-07-09T02:15:14.356584+0000","last_clean":"2023-07-09T02:15:14.356584+0000","last_became_active":"2023-07-09T02:15:14.354203+0000","last_became_peered":"2023-07-09T02:15:14.354203+0000","last_unstale":"2023-07-09T02:15:14.356584+0000","last_undegraded":"2023-07-09T02:15:14.356584+0000","last_fullsized":"2023-07-09T02:15:14.356584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:12.444082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.347131+0000","last_change":"2023-07-09T02:15:13.597278+0000","last_active":"2023-07-09T02:15:14.347131+0000","last_peered":"2023-07-09T02:15:14.347131+0000","last_clean":"2023-07-09T02:15:14.347131+0000","last_became_active":"2023-07-09T02:15:13.596856+0000","last_became_peered":"2023-07-09T02:15:13.596856+0000","last_unstale":"2023-07-09T02:15:14.347131+0000","last_undegraded":"2023-07-09T02:15:14.347131+0000","last_fullsized":"2023-07-09T02:15:14.347131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:58:03.875603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.340437+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:15:14.340437+0000","last_peered":"2023-07-09T02:15:14.340437+0000","last_clean":"2023-07-09T02:15:14.340437+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:15:14.340437+0000","last_undegraded":"2023-07-09T02:15:14.340437+0000","last_fullsized":"2023-07-09T02:15:14.340437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:07:13.492655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342859+0000","last_change":"2023-07-09T02:15:14.352813+0000","last_active":"2023-07-09T02:15:15.342859+0000","last_peered":"2023-07-09T02:15:15.342859+0000","last_clean":"2023-07-09T02:15:15.342859+0000","last_became_active":"2023-07-09T02:15:14.352527+0000","last_became_peered":"2023-07-09T02:15:14.352527+0000","last_unstale":"2023-07-09T02:15:15.342859+0000","last_undegraded":"2023-07-09T02:15:15.342859+0000","last_fullsized":"2023-07-09T02:15:15.342859+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:01:10.945862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"87'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.596374+0000","last_change":"2023-07-09T02:15:13.600799+0000","last_active":"2023-07-09T02:15:14.596374+0000","last_peered":"2023-07-09T02:15:14.596374+0000","last_clean":"2023-07-09T02:15:14.596374+0000","last_became_active":"2023-07-09T02:15:13.600180+0000","last_became_peered":"2023-07-09T02:15:13.600180+0000","last_unstale":"2023-07-09T02:15:14.596374+0000","last_undegraded":"2023-07-09T02:15:14.596374+0000","last_fullsized":"2023-07-09T02:15:14.596374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:50:04.718042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.342150+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:15:15.342150+0000","last_peered":"2023-07-09T02:15:15.342150+0000","last_clean":"2023-07-09T02:15:15.342150+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:15:15.342150+0000","last_undegraded":"2023-07-09T02:15:15.342150+0000","last_fullsized":"2023-07-09T02:15:15.342150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:29:20.600357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.345441+0000","last_change":"2023-07-09T02:15:14.344901+0000","last_active":"2023-07-09T02:15:14.345441+0000","last_peered":"2023-07-09T02:15:14.345441+0000","last_clean":"2023-07-09T02:15:14.345441+0000","last_became_active":"2023-07-09T02:15:14.344655+0000","last_became_peered":"2023-07-09T02:15:14.344655+0000","last_unstale":"2023-07-09T02:15:14.345441+0000","last_undegraded":"2023-07-09T02:15:14.345441+0000","last_fullsized":"2023-07-09T02:15:14.345441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:20:30.356358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.596472+0000","last_change":"2023-07-09T02:15:13.591963+0000","last_active":"2023-07-09T02:15:14.596472+0000","last_peered":"2023-07-09T02:15:14.596472+0000","last_clean":"2023-07-09T02:15:14.596472+0000","last_became_active":"2023-07-09T02:15:13.591700+0000","last_became_peered":"2023-07-09T02:15:13.591700+0000","last_unstale":"2023-07-09T02:15:14.596472+0000","last_undegraded":"2023-07-09T02:15:14.596472+0000","last_fullsized":"2023-07-09T02:15:14.596472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:46.815454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":134,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.343162+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:15:14.343162+0000","last_peered":"2023-07-09T02:15:14.343162+0000","last_clean":"2023-07-09T02:15:14.343162+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:15:14.343162+0000","last_undegraded":"2023-07-09T02:15:14.343162+0000","last_fullsized":"2023-07-09T02:15:14.343162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:07:05.732533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.351570+0000","last_change":"2023-07-09T02:15:14.351415+0000","last_active":"2023-07-09T02:15:14.351570+0000","last_peered":"2023-07-09T02:15:14.351570+0000","last_clean":"2023-07-09T02:15:14.351570+0000","last_became_active":"2023-07-09T02:15:14.351204+0000","last_became_peered":"2023-07-09T02:15:14.351204+0000","last_unstale":"2023-07-09T02:15:14.351570+0000","last_undegraded":"2023-07-09T02:15:14.351570+0000","last_fullsized":"2023-07-09T02:15:14.351570+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:41:40.201573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.342868+0000","last_change":"2023-07-09T02:15:13.597816+0000","last_active":"2023-07-09T02:15:14.342868+0000","last_peered":"2023-07-09T02:15:14.342868+0000","last_clean":"2023-07-09T02:15:14.342868+0000","last_became_active":"2023-07-09T02:15:13.597550+0000","last_became_peered":"2023-07-09T02:15:13.597550+0000","last_unstale":"2023-07-09T02:15:14.342868+0000","last_undegraded":"2023-07-09T02:15:14.342868+0000","last_fullsized":"2023-07-09T02:15:14.342868+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:46:17.824650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.339492+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:15:14.339492+0000","last_peered":"2023-07-09T02:15:14.339492+0000","last_clean":"2023-07-09T02:15:14.339492+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:15:14.339492+0000","last_undegraded":"2023-07-09T02:15:14.339492+0000","last_fullsized":"2023-07-09T02:15:14.339492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:45:02.410078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.352326+0000","last_change":"2023-07-09T02:15:14.352232+0000","last_active":"2023-07-09T02:15:14.352326+0000","last_peered":"2023-07-09T02:15:14.352326+0000","last_clean":"2023-07-09T02:15:14.352326+0000","last_became_active":"2023-07-09T02:15:14.351669+0000","last_became_peered":"2023-07-09T02:15:14.351669+0000","last_unstale":"2023-07-09T02:15:14.352326+0000","last_undegraded":"2023-07-09T02:15:14.352326+0000","last_fullsized":"2023-07-09T02:15:14.352326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:41:28.043664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"87'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.593285+0000","last_change":"2023-07-09T02:15:13.593840+0000","last_active":"2023-07-09T02:15:14.593285+0000","last_peered":"2023-07-09T02:15:14.593285+0000","last_clean":"2023-07-09T02:15:14.593285+0000","last_became_active":"2023-07-09T02:15:13.593277+0000","last_became_peered":"2023-07-09T02:15:13.593277+0000","last_unstale":"2023-07-09T02:15:14.593285+0000","last_undegraded":"2023-07-09T02:15:14.593285+0000","last_fullsized":"2023-07-09T02:15:14.593285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:11:14.097221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.343616+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:15:14.343616+0000","last_peered":"2023-07-09T02:15:14.343616+0000","last_clean":"2023-07-09T02:15:14.343616+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:15:14.343616+0000","last_undegraded":"2023-07-09T02:15:14.343616+0000","last_fullsized":"2023-07-09T02:15:14.343616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:01:18.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.353455+0000","last_change":"2023-07-09T02:15:14.352860+0000","last_active":"2023-07-09T02:15:14.353455+0000","last_peered":"2023-07-09T02:15:14.353455+0000","last_clean":"2023-07-09T02:15:14.353455+0000","last_became_active":"2023-07-09T02:15:14.352587+0000","last_became_peered":"2023-07-09T02:15:14.352587+0000","last_unstale":"2023-07-09T02:15:14.353455+0000","last_undegraded":"2023-07-09T02:15:14.353455+0000","last_fullsized":"2023-07-09T02:15:14.353455+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:13.575395+0000","last_clean_scrub_stamp":"2023-07-09T02:15:13.575395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:12:20.775928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"87'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-09T02:15:15.340542+0000","last_change":"2023-07-09T02:15:13.590742+0000","last_active":"2023-07-09T02:15:15.340542+0000","last_peered":"2023-07-09T02:15:15.340542+0000","last_clean":"2023-07-09T02:15:15.340542+0000","last_became_active":"2023-07-09T02:15:13.590511+0000","last_became_peered":"2023-07-09T02:15:13.590511+0000","last_unstale":"2023-07-09T02:15:15.340542+0000","last_undegraded":"2023-07-09T02:15:15.340542+0000","last_fullsized":"2023-07-09T02:15:15.340542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:15:12.567562+0000","last_clean_scrub_stamp":"2023-07-09T02:15:12.567562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:48:54.316061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-09T02:15:14.346480+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:15:14.346480+0000","last_peered":"2023-07-09T02:15:14.346480+0000","last_clean":"2023-07-09T02:15:14.346480+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:15:14.346480+0000","last_undegraded":"2023-07-09T02:15:14.346480+0000","last_fullsized":"2023-07-09T02:15:14.346480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:52.800386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1058,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194254,"statfs":{"total":200000000,"available":198916370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.747},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2330000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.501},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.67600000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1839999999999999,"5min":1.423,"15min":1.423},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":1.026,"15min":0.79800000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73899999999999999,"15min":0.70199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0840000000000001,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.97999999999999998,"15min":0.80900000000000005},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99099999999999999,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.45400000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72099999999999997,"15min":0.67500000000000004},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83799999999999997,"15min":0.77600000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1120000000000001,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.56000000000000005,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0009999999999999,"5min":1.087,"15min":1.087},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.54400000000000004,"5min":0.438,"15min":0.438},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":483,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194829,"statfs":{"total":200000000,"available":199505196,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.53800000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71799999999999997,"15min":0.73399999999999999},"min":{"1min":0.55900000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92200000000000004,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.85699999999999998,"5min":1.165,"15min":1.165},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71299999999999997,"15min":0.68799999999999994},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90200000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.57499999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.72099999999999997,"15min":0.70599999999999996},"min":{"1min":0.64000000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89800000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.42899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.625},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.72999999999999998,"15min":0.73099999999999998},"min":{"1min":0.51400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.75800000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.624,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84099999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.44600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:15:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.69999999999999996,"15min":0.69499999999999995},"min":{"1min":0.55400000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.47699999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":481,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194830,"statfs":{"total":200000000,"available":199506726,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.47199999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69499999999999995,"15min":0.68999999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98599999999999999,"5min":1.179,"15min":1.179},"last":0.51900000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.52800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92300000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.58399999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.73999999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.501,"5min":0.432,"15min":0.432},"max":{"1min":1.0169999999999999,"5min":1.103,"15min":1.103},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69399999999999995,"15min":0.68300000000000005},"min":{"1min":0.57299999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.878,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.71699999999999997,"15min":0.69499999999999995},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94599999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96999999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.82399999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64000000000000001,"15min":0.628},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.874,"5min":1.054,"15min":1.054},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.91900000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:15:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71599999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.876,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.754},"min":{"1min":0.55300000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.999,"5min":1.091,"15min":1.091},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":483,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194829,"statfs":{"total":200000000,"available":199505092,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":1.2430000000000001,"15min":0.85199999999999998},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89400000000000002,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66100000000000003,"15min":0.67500000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92700000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.72299999999999998,"15min":0.64400000000000002},"min":{"1min":0.434,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90200000000000002,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.49199999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98199999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.625}]},{"osd":2,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.44,"5min":0.439,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94299999999999995,"5min":1.323,"15min":1.323},"last":0.501}]},{"osd":3,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89400000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":1.512,"15min":0.94199999999999995},"min":{"1min":0.48499999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.95099999999999996,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.61899999999999999},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.434},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.628,"15min":0.65100000000000002},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86699999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47299999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68000000000000005,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93100000000000005,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:15:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.77900000000000003,"15min":0.71499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95399999999999996,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194830,"statfs":{"total":200000000,"available":199506178,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.42299999999999999,"15min":0.41999999999999998},"min":{"1min":0.29799999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.79700000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.33700000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.87,"5min":1.198,"15min":1.198},"last":0.44600000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.33400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79900000000000004,"5min":1.048,"15min":1.048},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.55000000000000004}]},{"osd":2,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76700000000000002,"5min":1.155,"15min":1.155},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.56299999999999994},"min":{"1min":0.433,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76300000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.73699999999999999,"15min":0.69999999999999996},"min":{"1min":0.54000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2829999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.749,"15min":0.71499999999999997},"min":{"1min":0.59599999999999997,"5min":0.496,"15min":0.496},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75600000000000001,"15min":0.753},"min":{"1min":0.59599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.101,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.64900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.244,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.59499999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.226,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78100000000000003,"15min":0.77400000000000002},"min":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1859999999999999,"5min":1.367,"15min":1.367},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77500000000000002,"15min":0.76700000000000002},"min":{"1min":0.58099999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194830,"statfs":{"total":200000000,"available":199506018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.42999999999999999},"min":{"1min":0.32800000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.76700000000000002,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.438,"15min":0.42599999999999999},"min":{"1min":0.35999999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":1.127,"15min":1.127},"last":0.433}]},{"osd":1,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70099999999999996,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73799999999999999,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.52200000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.35699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90300000000000002,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.37},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56999999999999995,"15min":0.5},"min":{"1min":0.41099999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83299999999999996,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.626}]},{"osd":4,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82099999999999995,"15min":0.755},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0149999999999999,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.753},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.71099999999999997},"min":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97799999999999998,"5min":1.161,"15min":1.161},"last":0.85299999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73599999999999999,"15min":0.71999999999999997},"min":{"1min":0.57699999999999996,"5min":0.496,"15min":0.496},"max":{"1min":0.97599999999999998,"5min":1.319,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.83199999999999996,"15min":0.77400000000000002},"min":{"1min":0.624,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96099999999999997,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.90700000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78100000000000003,"15min":0.76200000000000001},"min":{"1min":0.60599999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.091,"5min":1.101,"15min":1.101},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.82599999999999996,"15min":0.80700000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.069,"5min":1.452,"15min":1.452},"last":0.91800000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.74199999999999999,"15min":0.71399999999999997},"min":{"1min":0.56899999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0369999999999999,"5min":1.208,"15min":1.208},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.60699999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0189999999999999,"5min":1.351,"15min":1.351},"last":0.96599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":481,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194830,"statfs":{"total":200000000,"available":199506648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.67000000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46300000000000002,"15min":0.45700000000000002},"min":{"1min":0.33600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71299999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.45300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.76600000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.47999999999999998,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73999999999999999,"5min":1.163,"15min":1.163},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.58299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97499999999999998,"5min":1.026,"15min":1.026},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.75700000000000001,"15min":0.73799999999999999},"min":{"1min":0.59799999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73999999999999999,"15min":0.72599999999999998},"min":{"1min":0.59599999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.87},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.626,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.71199999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.79900000000000004,"15min":0.78100000000000003},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.80000000000000004,"15min":0.77600000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.77600000000000002,"15min":0.76400000000000001},"min":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0469999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56599999999999995,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.129,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1058,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194254,"statfs":{"total":200000000,"available":198916392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42999999999999999,"15min":0.41499999999999998},"min":{"1min":0.33200000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.49299999999999999,"15min":0.46400000000000002},"min":{"1min":0.40999999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69499999999999995,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.45400000000000001},"min":{"1min":0.376,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71599999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.46500000000000002,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.29899999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.432,"15min":0.41099999999999998},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63300000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.501},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76600000000000001,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.46000000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.002,"5min":1.145,"15min":1.145},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55400000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0589999999999999,"5min":1.153,"15min":1.153},"last":0.55400000000000005}]},{"osd":5,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79500000000000004,"15min":0.79900000000000004},"min":{"1min":0.57399999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.78600000000000003,"15min":0.78300000000000003},"min":{"1min":0.59499999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0860000000000001,"5min":1.238,"15min":1.238},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.59699999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96999999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.53300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96199999999999997,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0389999999999999,"5min":1.472,"15min":1.472},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.53600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0629999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.53600000000000003}]}]}],"pool_statfs":[]}} 2023-07-09T02:15:19.077 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:15:19.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:15:19.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f11dba640 1 Processor -- start 2023-07-09T02:15:19.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f11dba640 1 -- start start 2023-07-09T02:15:19.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f11dba640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2f0c15c410 0x7f2f0c1608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f11dba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c0b4cf0 0x7f2f0c0d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f11dba640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0ced10 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f11dba640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c15c7e0 con 0x7f2f0c15c410 2023-07-09T02:15:19.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f11dba640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0cd1b0 con 0x7f2f0c0b4cf0 2023-07-09T02:15:19.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2f0c0b59b0 0x7f2f0c0b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38856/0 (socket says 172.21.15.45:38856) 2023-07-09T02:15:19.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0affd640 1 -- 172.21.15.45:0/3735227384 learned_addr learned my addr 172.21.15.45:0/3735227384 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:19.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0bfff640 1 --2- 172.21.15.45:0/3735227384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c0b4cf0 0x7f2f0c0d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0b7fe640 1 --2- 172.21.15.45:0/3735227384 >> v2:172.21.15.155:3300/0 conn(0x7f2f0c15c410 0x7f2f0c1608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0a7fc640 1 -- 172.21.15.45:0/3735227384 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284201417 0 0) 0x7f2f0c0ced10 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0a7fc640 1 -- 172.21.15.45:0/3735227384 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef4003530 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0b7fe640 1 -- 172.21.15.45:0/3735227384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c0b4cf0 msgr2=0x7f2f0c0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:19.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0b7fe640 1 --2- 172.21.15.45:0/3735227384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c0b4cf0 0x7f2f0c0d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0b7fe640 1 -- 172.21.15.45:0/3735227384 >> v1:172.21.15.45:6789/0 conn(0x7f2f0c0b59b0 legacy=0x7f2f0c0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.266+0000 7f2f0b7fe640 1 -- 172.21.15.45:0/3735227384 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c160de0 con 0x7f2f0c15c410 2023-07-09T02:15:19.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f0b7fe640 1 --2- 172.21.15.45:0/3735227384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c15c410 0x7f2f0c1608a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0097f0 tx=0x7f2efc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c47942f4d86897c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:19.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f0a7fc640 1 -- 172.21.15.45:0/3735227384 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0ab450 con 0x7f2f0c15c410 2023-07-09T02:15:19.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f0a7fc640 1 -- 172.21.15.45:0/3735227384 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc0ab5b0 con 0x7f2f0c15c410 2023-07-09T02:15:19.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f0a7fc640 1 -- 172.21.15.45:0/3735227384 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0ab940 con 0x7f2f0c15c410 2023-07-09T02:15:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f11dba640 1 -- 172.21.15.45:0/3735227384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c15c410 msgr2=0x7f2f0c1608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f11dba640 1 --2- 172.21.15.45:0/3735227384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c15c410 0x7f2f0c1608a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0097f0 tx=0x7f2efc01c450 comp rx=0 tx=0).stop 2023-07-09T02:15:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f11dba640 1 -- 172.21.15.45:0/3735227384 shutdown_connections 2023-07-09T02:15:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f11dba640 1 --2- 172.21.15.45:0/3735227384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c0b4cf0 0x7f2f0c0d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f11dba640 1 --2- 172.21.15.45:0/3735227384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c15c410 0x7f2f0c1608a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f11dba640 1 -- 172.21.15.45:0/3735227384 >> 172.21.15.45:0/3735227384 conn(0x7f2f0c06a590 msgr2=0x7f2f0c0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f11dba640 1 -- 172.21.15.45:0/3735227384 shutdown_connections 2023-07-09T02:15:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.270+0000 7f2f11dba640 1 -- 172.21.15.45:0/3735227384 wait complete. 2023-07-09T02:15:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 Processor -- start 2023-07-09T02:15:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 -- start start 2023-07-09T02:15:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c0b4cf0 0x7f2f0c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0c0b59b0 0x7f2f0c0b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c15c410 0x7f2f0c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0ca7e0 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b7e20 con 0x7f2f0c0b4cf0 2023-07-09T02:15:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b7860 con 0x7f2f0c15c410 2023-07-09T02:15:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0c0b59b0 0x7f2f0c0b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0c0b59b0 0x7f2f0c0b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34828/0 (socket says 172.21.15.45:34828) 2023-07-09T02:15:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 -- 172.21.15.45:0/1390221981 learned_addr learned my addr 172.21.15.45:0/1390221981 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0b7fe640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c0b4cf0 0x7f2f0c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0bfff640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c15c410 0x7f2f0c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 -- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c15c410 msgr2=0x7f2f0c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c15c410 0x7f2f0c06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 -- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c0b4cf0 msgr2=0x7f2f0c150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c0b4cf0 0x7f2f0c150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 -- 172.21.15.45:0/1390221981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc009420 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0b7fe640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c0b4cf0 0x7f2f0c150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0bfff640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c15c410 0x7f2f0c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f0affd640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0c0b59b0 0x7f2f0c0b7010 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c420 tx=0x7f2f0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2ef3fff640 1 -- 172.21.15.45:0/1390221981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00005cf0 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2ef3fff640 1 -- 172.21.15.45:0/1390221981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f00005e50 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2ef3fff640 1 -- 172.21.15.45:0/1390221981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000072d0 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c0b7b40 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.274+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c1514a0 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.278+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0ca950 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.278+0000 7f2ef3fff640 1 -- 172.21.15.45:0/1390221981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f00007430 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.278+0000 7f2ef3fff640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ef8066280 0x7f2ef8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.278+0000 7f2ef3fff640 1 -- 172.21.15.45:0/1390221981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f00083330 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.278+0000 7f2f0b7fe640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ef8066280 0x7f2ef8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.278+0000 7f2f0b7fe640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ef8066280 0x7f2ef8068730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0af000 tx=0x7f2efc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.282+0000 7f2ef3fff640 1 -- 172.21.15.45:0/1390221981 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f000507c0 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.497+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2f0c04d7d0 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.501+0000 7f2ef3fff640 1 -- 172.21.15.45:0/1390221981 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2f00053de0 con 0x7f2f0c0b59b0 2023-07-09T02:15:19.503 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:15:19.503 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:15:19.503 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:15:19.503 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:15:19.503 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:15:19.504 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:15:19.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ef8066280 msgr2=0x7f2ef8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ef8066280 0x7f2ef8068730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0af000 tx=0x7f2efc008040 comp rx=0 tx=0).stop 2023-07-09T02:15:19.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0c0b59b0 msgr2=0x7f2f0c0b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0c0b59b0 0x7f2f0c0b7010 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c420 tx=0x7f2f0000c8e0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 shutdown_connections 2023-07-09T02:15:19.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ef8066280 0x7f2ef8068730 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f0c15c410 0x7f2f0c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f0c0b59b0 0x7f2f0c0b7010 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 --2- 172.21.15.45:0/1390221981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f0c0b4cf0 0x7f2f0c150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 >> 172.21.15.45:0/1390221981 conn(0x7f2f0c06a590 msgr2=0x7f2f0c152180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:19.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 shutdown_connections 2023-07-09T02:15:19.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.505+0000 7f2f11dba640 1 -- 172.21.15.45:0/1390221981 wait complete. 2023-07-09T02:15:19.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:15:19.566 INFO:tasks.ceph.mds.b.smithi155.stderr:2023-07-09T02:15:19.563+0000 7ff7ab299640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:15:19.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.665+0000 7fbcef0ec640 1 Processor -- start 2023-07-09T02:15:19.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.665+0000 7fbcef0ec640 1 -- start start 2023-07-09T02:15:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbcef0ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce80cd120 0x7fbce80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbcef0ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce8160a50 con 0x7fbce815c060 2023-07-09T02:15:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbcef0ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce815c430 con 0x7fbce80d2620 2023-07-09T02:15:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbcef0ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce815fb60 con 0x7fbce80cd120 2023-07-09T02:15:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbcece88640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbce815c060 0x7fbce80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38866/0 (socket says 172.21.15.45:38866) 2023-07-09T02:15:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbcece88640 1 -- 172.21.15.45:0/3403055615 learned_addr learned my addr 172.21.15.45:0/3403055615 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbced689640 1 --2- 172.21.15.45:0/3403055615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce80cd120 0x7fbce80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbce77fe640 1 -- 172.21.15.45:0/3403055615 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827761792 0 0) 0x7fbce8160a50 con 0x7fbce815c060 2023-07-09T02:15:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbce77fe640 1 -- 172.21.15.45:0/3403055615 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd8003530 con 0x7fbce815c060 2023-07-09T02:15:19.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbce77fe640 1 -- 172.21.15.45:0/3403055615 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699464380 0 0) 0x7fbce815c430 con 0x7fbce80d2620 2023-07-09T02:15:19.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbce77fe640 1 -- 172.21.15.45:0/3403055615 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce8160a50 con 0x7fbce80d2620 2023-07-09T02:15:19.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbced689640 1 -- 172.21.15.45:0/3403055615 >> v1:172.21.15.155:6789/0 conn(0x7fbce80d2620 legacy=0x7fbce80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbced689640 1 -- 172.21.15.45:0/3403055615 >> v1:172.21.15.45:6789/0 conn(0x7fbce815c060 legacy=0x7fbce80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.669+0000 7fbced689640 1 -- 172.21.15.45:0/3403055615 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce815fe40 con 0x7fbce80cd120 2023-07-09T02:15:19.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbced689640 1 --2- 172.21.15.45:0/3403055615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce80cd120 0x7fbce80b4ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009dc0 tx=0x7fbce001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db18437cbfb3d13 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:19.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbce77fe640 1 -- 172.21.15.45:0/3403055615 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00a5a00 con 0x7fbce80cd120 2023-07-09T02:15:19.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbce77fe640 1 -- 172.21.15.45:0/3403055615 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce00a5b60 con 0x7fbce80cd120 2023-07-09T02:15:19.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbce77fe640 1 -- 172.21.15.45:0/3403055615 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00ad440 con 0x7fbce80cd120 2023-07-09T02:15:19.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3403055615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce80cd120 msgr2=0x7fbce80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 --2- 172.21.15.45:0/3403055615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce80cd120 0x7fbce80b4ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009dc0 tx=0x7fbce001c940 comp rx=0 tx=0).stop 2023-07-09T02:15:19.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3403055615 shutdown_connections 2023-07-09T02:15:19.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 --2- 172.21.15.45:0/3403055615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce80cd120 0x7fbce80b4ed0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3403055615 >> 172.21.15.45:0/3403055615 conn(0x7fbce80698e0 msgr2=0x7fbce8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:19.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3403055615 shutdown_connections 2023-07-09T02:15:19.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3403055615 wait complete. 2023-07-09T02:15:19.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 Processor -- start 2023-07-09T02:15:19.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.673+0000 7fbcef0ec640 1 -- start start 2023-07-09T02:15:19.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbce80cd120 0x7fbce8157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce80d2620 0x7fbce81544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce815c060 0x7fbce80cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce81582c0 con 0x7fbce80d2620 2023-07-09T02:15:19.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8156ce0 con 0x7fbce80cd120 2023-07-09T02:15:19.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8156fc0 con 0x7fbce815c060 2023-07-09T02:15:19.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce80d2620 0x7fbce81544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce80d2620 0x7fbce81544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34830/0 (socket says 172.21.15.45:34830) 2023-07-09T02:15:19.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 -- 172.21.15.45:0/3561725786 learned_addr learned my addr 172.21.15.45:0/3561725786 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:19.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcece88640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbce80cd120 0x7fbce8157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbced689640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce815c060 0x7fbce80cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 -- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce815c060 msgr2=0x7fbce80cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce815c060 0x7fbce80cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 -- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbce80cd120 msgr2=0x7fbce8157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbce80cd120 0x7fbce8157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 -- 172.21.15.45:0/3561725786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009a70 con 0x7fbce80d2620 2023-07-09T02:15:19.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce7fff640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce80d2620 0x7fbce81544c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c500 tx=0x7fbcd400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:19.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce57fa640 1 -- 172.21.15.45:0/3561725786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40052d0 con 0x7fbce80d2620 2023-07-09T02:15:19.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce57fa640 1 -- 172.21.15.45:0/3561725786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd4005430 con 0x7fbce80d2620 2023-07-09T02:15:19.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce80b59f0 con 0x7fbce80d2620 2023-07-09T02:15:19.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce57fa640 1 -- 172.21.15.45:0/3561725786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4012870 con 0x7fbce80d2620 2023-07-09T02:15:19.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce8157580 con 0x7fbce80d2620 2023-07-09T02:15:19.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce804d7d0 con 0x7fbce80d2620 2023-07-09T02:15:19.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.677+0000 7fbce57fa640 1 -- 172.21.15.45:0/3561725786 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbcd40129d0 con 0x7fbce80d2620 2023-07-09T02:15:19.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.681+0000 7fbce57fa640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbccc066280 0x7fbccc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:19.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.681+0000 7fbce57fa640 1 -- 172.21.15.45:0/3561725786 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbcd40838a0 con 0x7fbce80d2620 2023-07-09T02:15:19.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.681+0000 7fbcece88640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbccc066280 0x7fbccc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:19.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.681+0000 7fbcece88640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbccc066280 0x7fbccc068730 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0011f0 tx=0x7fbcdc007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:19.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.685+0000 7fbce57fa640 1 -- 172.21.15.45:0/3561725786 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbcd4050d40 con 0x7fbce80d2620 2023-07-09T02:15:19.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.869+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbce80b37b0 con 0x7fbce80d2620 2023-07-09T02:15:19.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbce57fa640 1 -- 172.21.15.45:0/3561725786 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fbcd4054360 con 0x7fbce80d2620 2023-07-09T02:15:19.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:19.874 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1384902817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1384902817},{"type":"v1","addr":"172.21.15.45:6835","nonce":1384902817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/324339930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":324339930},{"type":"v1","addr":"172.21.15.155:6836","nonce":324339930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/355258806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":355258806},{"type":"v1","addr":"172.21.15.45:6833","nonce":355258806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:15:13.977165+0000","modified":"2023-07-09T02:15:17.606626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6537":{"gid":6537,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1667885237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1667885237},{"type":"v1","addr":"172.21.15.155:6837","nonce":1667885237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T02:15:19.874 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-07-09T02:15:19.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbccc066280 msgr2=0x7fbccc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbccc066280 0x7fbccc068730 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0011f0 tx=0x7fbcdc007d40 comp rx=0 tx=0).stop 2023-07-09T02:15:19.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce80d2620 msgr2=0x7fbce81544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:19.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce80d2620 0x7fbce81544c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c500 tx=0x7fbcd400c9c0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 shutdown_connections 2023-07-09T02:15:19.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbccc066280 0x7fbccc068730 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbce815c060 0x7fbce80cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce80d2620 0x7fbce81544c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 --2- 172.21.15.45:0/3561725786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbce80cd120 0x7fbce8157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:19.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 >> 172.21.15.45:0/3561725786 conn(0x7fbce80698e0 msgr2=0x7fbce80b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:19.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 shutdown_connections 2023-07-09T02:15:19.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:19.873+0000 7fbcef0ec640 1 -- 172.21.15.45:0/3561725786 wait complete. 2023-07-09T02:15:20.296 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:15:13.977165+0000', 'modified': '2023-07-09T02:15:17.606626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6537}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6537': {'gid': 6537, 'name': 'b', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6837/1667885237', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6835', 'nonce': 1667885237}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 1667885237}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:15:20.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:15:20.298 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-09T02:15:20.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.445+0000 7f2e106ec640 1 Processor -- start 2023-07-09T02:15:20.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.445+0000 7f2e106ec640 1 -- start start 2023-07-09T02:15:20.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.445+0000 7f2e106ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e080b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.445+0000 7f2e106ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e080cd120 0x7f2e080cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e106ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e08160a50 con 0x7f2e0815c060 2023-07-09T02:15:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e106ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0815c430 con 0x7f2e080cd120 2023-07-09T02:15:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e106ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0815fb60 con 0x7f2e080d2620 2023-07-09T02:15:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0e488640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2e0815c060 0x7f2e080d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38880/0 (socket says 172.21.15.45:38880) 2023-07-09T02:15:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0e488640 1 -- 172.21.15.45:0/2644084135 learned_addr learned my addr 172.21.15.45:0/2644084135 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/2644084135 >> v2:172.21.15.45:3300/0 conn(0x7f2e080cd120 0x7f2e080cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/2644084135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e080b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0ec89640 1 -- 172.21.15.45:0/2644084135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 msgr2=0x7f2e080b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/2644084135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e080b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0ec89640 1 -- 172.21.15.45:0/2644084135 >> v1:172.21.15.45:6789/0 conn(0x7f2e0815c060 legacy=0x7f2e080d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0ec89640 1 -- 172.21.15.45:0/2644084135 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0815fe40 con 0x7f2e080cd120 2023-07-09T02:15:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/2644084135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e080b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0d486640 1 -- 172.21.15.45:0/2644084135 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858590882 0 0) 0x7f2e08160a50 con 0x7f2e0815c060 2023-07-09T02:15:20.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/2644084135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e080cee30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009d90 tx=0x7f2e0001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29526f9220eca3e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0d486640 1 -- 172.21.15.45:0/2644084135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000a59e0 con 0x7f2e080cd120 2023-07-09T02:15:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.449+0000 7f2e0d486640 1 -- 172.21.15.45:0/2644084135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e000a5b40 con 0x7f2e080cd120 2023-07-09T02:15:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e0d486640 1 -- 172.21.15.45:0/2644084135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000ad440 con 0x7f2e080cd120 2023-07-09T02:15:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- 172.21.15.45:0/2644084135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 msgr2=0x7f2e080cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 --2- 172.21.15.45:0/2644084135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e080cee30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009d90 tx=0x7f2e0001c920 comp rx=0 tx=0).stop 2023-07-09T02:15:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- 172.21.15.45:0/2644084135 shutdown_connections 2023-07-09T02:15:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 --2- 172.21.15.45:0/2644084135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e080cee30 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 --2- 172.21.15.45:0/2644084135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e080b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- 172.21.15.45:0/2644084135 >> 172.21.15.45:0/2644084135 conn(0x7f2e080698e0 msgr2=0x7f2e08069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- 172.21.15.45:0/2644084135 shutdown_connections 2023-07-09T02:15:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- 172.21.15.45:0/2644084135 wait complete. 2023-07-09T02:15:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 Processor -- start 2023-07-09T02:15:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- start start 2023-07-09T02:15:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e08151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e0815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e0815c060 0x7f2e0815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0815d780 con 0x7f2e080cd120 2023-07-09T02:15:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e08151fb0 con 0x7f2e0815c060 2023-07-09T02:15:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e106ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0815cb00 con 0x7f2e080d2620 2023-07-09T02:15:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e0e488640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e08151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e0e488640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e08151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34854/0 (socket says 172.21.15.45:34854) 2023-07-09T02:15:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e0e488640 1 -- 172.21.15.45:0/4064524416 learned_addr learned my addr 172.21.15.45:0/4064524416 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:20.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e0815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.453+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e0815c060 0x7f2e0815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2e0e488640 1 -- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 msgr2=0x7f2e0815ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2e0e488640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e0815ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2e0e488640 1 -- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e0815c060 msgr2=0x7f2e0815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2e0e488640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e0815c060 0x7f2e0815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2e0e488640 1 -- 172.21.15.45:0/4064524416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00009a70 con 0x7f2e080cd120 2023-07-09T02:15:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2e0e488640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e08151a70 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400c480 tx=0x7f2e0400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2dfeffd640 1 -- 172.21.15.45:0/4064524416 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040074e0 con 0x7f2e080cd120 2023-07-09T02:15:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2dfeffd640 1 -- 172.21.15.45:0/4064524416 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e04007660 con 0x7f2e080cd120 2023-07-09T02:15:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2dfeffd640 1 -- 172.21.15.45:0/4064524416 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04004a30 con 0x7f2e080cd120 2023-07-09T02:15:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2e106ec640 1 -- 172.21.15.45:0/4064524416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e080b59f0 con 0x7f2e080cd120 2023-07-09T02:15:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2e106ec640 1 -- 172.21.15.45:0/4064524416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0815d0c0 con 0x7f2e080cd120 2023-07-09T02:15:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2dfeffd640 1 -- 172.21.15.45:0/4064524416 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e04004b90 con 0x7f2e080cd120 2023-07-09T02:15:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2dfeffd640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2dec066280 0x7f2dec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.457+0000 7f2dfeffd640 1 -- 172.21.15.45:0/4064524416 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e04082f30 con 0x7f2e080cd120 2023-07-09T02:15:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2dec066280 0x7f2dec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 Processor -- start 2023-07-09T02:15:20.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- start start 2023-07-09T02:15:20.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2dec066280 0x7f2dec068730 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2e08157c80 tx=0x7f2df8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf13bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbec9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbeca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbd90f80 con 0x55c1bbf14110 2023-07-09T02:15:20.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbccac60 con 0x55c1bbec9f90 2023-07-09T02:15:20.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbd1e700 con 0x55c1bbf13800 2023-07-09T02:15:20.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbec9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbec9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34864/0 (socket says 172.21.15.45:34864) 2023-07-09T02:15:20.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 -- 172.21.15.45:0/2859312139 learned_addr learned my addr 172.21.15.45:0/2859312139 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbeca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0e488640 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf13bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 -- 172.21.15.45:0/2859312139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 msgr2=0x55c1bbf13bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf13bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 -- 172.21.15.45:0/2859312139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 msgr2=0x55c1bbeca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbeca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 -- 172.21.15.45:0/2859312139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1bba13890 con 0x55c1bbf14110 2023-07-09T02:15:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbec9a50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2df8010890 tx=0x7f2df8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aecaf950645b5fe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2debfff640 1 -- 172.21.15.45:0/2859312139 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8015bf0 con 0x55c1bbf14110 2023-07-09T02:15:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2debfff640 1 -- 172.21.15.45:0/2859312139 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df801a070 con 0x55c1bbf14110 2023-07-09T02:15:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2debfff640 1 -- 172.21.15.45:0/2859312139 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8021440 con 0x55c1bbf14110 2023-07-09T02:15:20.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- 172.21.15.45:0/2859312139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 msgr2=0x55c1bbec9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbec9a50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2df8010890 tx=0x7f2df8013000 comp rx=0 tx=0).stop 2023-07-09T02:15:20.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- 172.21.15.45:0/2859312139 shutdown_connections 2023-07-09T02:15:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbeca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbec9a50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 --2- 172.21.15.45:0/2859312139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf13bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- 172.21.15.45:0/2859312139 >> 172.21.15.45:0/2859312139 conn(0x55c1bbd8ca70 msgr2=0x55c1bbec8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- 172.21.15.45:0/2859312139 shutdown_connections 2023-07-09T02:15:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.461+0000 7f2e13a66000 1 -- 172.21.15.45:0/2859312139 wait complete. 2023-07-09T02:15:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 -- start start 2023-07-09T02:15:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 Processor -- start 2023-07-09T02:15:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbed4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbed5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbed5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbd177a0 con 0x55c1bbf14110 2023-07-09T02:15:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbcd3f00 con 0x55c1bbec9f90 2023-07-09T02:15:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbcd3ba0 con 0x55c1bbf13800 2023-07-09T02:15:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 10 client.0 _ll_register_callbacks cb 0x55c1bbeb5930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:15:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbed5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbed5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34880/0 (socket says 172.21.15.45:34880) 2023-07-09T02:15:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 -- 172.21.15.45:0/3819189434 learned_addr learned my addr 172.21.15.45:0/3819189434 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbed5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0e488640 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbed4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 -- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 msgr2=0x55c1bbed5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbed5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 -- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 msgr2=0x55c1bbed4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbed4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 -- 172.21.15.45:0/3819189434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df800e050 con 0x55c1bbf14110 2023-07-09T02:15:20.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbed5a50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2e000b0040 tx=0x7f2e0001b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e897b71ae24e46 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2de97fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:15:20.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2de97fa640 1 -- 172.21.15.45:0/3819189434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000ada10 con 0x55c1bbf14110 2023-07-09T02:15:20.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2de97fa640 1 -- 172.21.15.45:0/3819189434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e000be070 con 0x55c1bbf14110 2023-07-09T02:15:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 -- 172.21.15.45:0/3819189434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1bbd160f0 con 0x55c1bbf14110 2023-07-09T02:15:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2de97fa640 1 -- 172.21.15.45:0/3819189434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e000adb70 con 0x55c1bbf14110 2023-07-09T02:15:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 10 client.6672 fetch_fsmap learned FSMap version 42 2023-07-09T02:15:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 -- 172.21.15.45:0/3819189434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55c1bbcdc130 con 0x55c1bbf14110 2023-07-09T02:15:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2de97fa640 1 -- 172.21.15.45:0/3819189434 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c1bbd160f0 con 0x55c1bbf14110 2023-07-09T02:15:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2de97fa640 1 -- 172.21.15.45:0/3819189434 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2e000adcd0 con 0x55c1bbf14110 2023-07-09T02:15:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 10 client.6672 fetch_fsmap finished waiting for FSMap version 42 2023-07-09T02:15:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 10 client.6672 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T02:15:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 20 client.6672 populate_metadata read hostname 'smithi045' 2023-07-09T02:15:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] conn(0x55c1bbed6320 0x55c1bbf24d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 4 client.6672 mds_command: new command op to 6537 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:15:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.465+0000 7f2e13a66000 1 -- 172.21.15.45:0/3819189434 --> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1bbcdee40 con 0x55c1bbed6320 2023-07-09T02:15:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e0e488640 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] conn(0x55c1bbed6320 0x55c1bbf24d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e0e488640 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] conn(0x55c1bbed6320 0x55c1bbf24d50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6ce1edc71631da7 server_cookie=80f2a4c2707535e3 in_seq=0 out_seq=0 2023-07-09T02:15:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2de97fa640 10 client.6672 ms_handle_connect on v2:172.21.15.155:6835/1667885237 2023-07-09T02:15:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2de97fa640 1 -- 172.21.15.45:0/3819189434 <== mds.0 v2:172.21.15.155:6835/1667885237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c1bbcdee40 con 0x55c1bbed6320 2023-07-09T02:15:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2de97fa640 10 client.6672 handle_command_reply: tid=0 2023-07-09T02:15:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 client.6672 shutdown 2023-07-09T02:15:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 -- 172.21.15.45:0/3819189434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 msgr2=0x55c1bbed5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbed5a50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2e000b0040 tx=0x7f2e0001b160 comp rx=0 tx=0).stop 2023-07-09T02:15:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 -- 172.21.15.45:0/3819189434 shutdown_connections 2023-07-09T02:15:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbed5a50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] conn(0x55c1bbed6320 0x55c1bbf24d50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbed5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 --2- 172.21.15.45:0/3819189434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbed4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 -- 172.21.15.45:0/3819189434 >> 172.21.15.45:0/3819189434 conn(0x55c1bbd8ca70 msgr2=0x55c1bbec8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2de97fa640 0 client.6672 ms_handle_reset on v2:172.21.15.155:6835/1667885237 2023-07-09T02:15:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 -- 172.21.15.45:0/3819189434 shutdown_connections 2023-07-09T02:15:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 1 -- 172.21.15.45:0/3819189434 wait complete. 2023-07-09T02:15:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.469+0000 7f2e13a66000 20 client.6672 trim_cache size 0 max 16384 2023-07-09T02:15:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e13a66000 1 Processor -- start 2023-07-09T02:15:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e13a66000 1 -- start start 2023-07-09T02:15:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbec9f90 0x55c1bbf26470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf13800 0x55c1bbf269b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbf14110 0x55c1bbf0e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e13a66000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1bb9d4940 con 0x55c1bbf13800 2023-07-09T02:15:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e13a66000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbec9ab0 con 0x55c1bbf14110 2023-07-09T02:15:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e13a66000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbce6230 con 0x55c1bbec9f90 2023-07-09T02:15:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf13800 0x55c1bbf269b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf13800 0x55c1bbf269b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34882/0 (socket says 172.21.15.45:34882) 2023-07-09T02:15:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 -- 172.21.15.45:0/1624773276 learned_addr learned my addr 172.21.15.45:0/1624773276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbf14110 0x55c1bbf0e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0e488640 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbec9f90 0x55c1bbf26470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 -- 172.21.15.45:0/1624773276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbec9f90 msgr2=0x55c1bbf26470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbec9f90 0x55c1bbf26470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 -- 172.21.15.45:0/1624773276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbf14110 msgr2=0x55c1bbf0e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbf14110 0x55c1bbf0e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 -- 172.21.15.45:0/1624773276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e08152c20 con 0x55c1bbf13800 2023-07-09T02:15:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf13800 0x55c1bbf269b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2df8008010 tx=0x7f2df8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9f6feaa85eb99d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2dfcff9640 1 -- 172.21.15.45:0/1624773276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8015de0 con 0x55c1bbf13800 2023-07-09T02:15:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2dfcff9640 1 -- 172.21.15.45:0/1624773276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df801a040 con 0x55c1bbf13800 2023-07-09T02:15:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.485+0000 7f2dfcff9640 1 -- 172.21.15.45:0/1624773276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8021680 con 0x55c1bbf13800 2023-07-09T02:15:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- 172.21.15.45:0/1624773276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf13800 msgr2=0x55c1bbf269b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf13800 0x55c1bbf269b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2df8008010 tx=0x7f2df8015000 comp rx=0 tx=0).stop 2023-07-09T02:15:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- 172.21.15.45:0/1624773276 shutdown_connections 2023-07-09T02:15:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbf14110 0x55c1bbf0e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf13800 0x55c1bbf269b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 --2- 172.21.15.45:0/1624773276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbec9f90 0x55c1bbf26470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- 172.21.15.45:0/1624773276 >> 172.21.15.45:0/1624773276 conn(0x55c1bbd8ca70 msgr2=0x55c1bbf24d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- 172.21.15.45:0/1624773276 shutdown_connections 2023-07-09T02:15:20.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- 172.21.15.45:0/1624773276 wait complete. 2023-07-09T02:15:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- start start 2023-07-09T02:15:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 Processor -- start 2023-07-09T02:15:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbf70520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf11510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbf11a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbd13110 con 0x55c1bbf14110 2023-07-09T02:15:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbd14fb0 con 0x55c1bbec9f90 2023-07-09T02:15:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c1bbd16630 con 0x55c1bbf13800 2023-07-09T02:15:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 10 client.0 _ll_register_callbacks cb 0x55c1bbe964d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:15:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbf11a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbf11a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34894/0 (socket says 172.21.15.45:34894) 2023-07-09T02:15:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 -- 172.21.15.45:0/321706859 learned_addr learned my addr 172.21.15.45:0/321706859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0e488640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbf70520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf11510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 -- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 msgr2=0x55c1bbf11510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf11510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 -- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 msgr2=0x55c1bbf70520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbf70520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 -- 172.21.15.45:0/321706859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1bba13890 con 0x55c1bbf14110 2023-07-09T02:15:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0e488640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbf70520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0dc87640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e0ec89640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbf11a50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2e000a5b10 tx=0x7f2e000a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11301cac9694e2a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2de97fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:15:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2de97fa640 1 -- 172.21.15.45:0/321706859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000c3cb0 con 0x55c1bbf14110 2023-07-09T02:15:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2de97fa640 1 -- 172.21.15.45:0/321706859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e000be040 con 0x55c1bbf14110 2023-07-09T02:15:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- 172.21.15.45:0/321706859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1bbecd920 con 0x55c1bbf14110 2023-07-09T02:15:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2de97fa640 1 -- 172.21.15.45:0/321706859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e000c3e10 con 0x55c1bbf14110 2023-07-09T02:15:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 10 client.6678 fetch_fsmap learned FSMap version 42 2023-07-09T02:15:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.489+0000 7f2e13a66000 1 -- 172.21.15.45:0/321706859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55c1bbcc23c0 con 0x55c1bbf14110 2023-07-09T02:15:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2de97fa640 1 -- 172.21.15.45:0/321706859 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c1bbecd920 con 0x55c1bbf14110 2023-07-09T02:15:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2de97fa640 1 -- 172.21.15.45:0/321706859 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2e000d4060 con 0x55c1bbf14110 2023-07-09T02:15:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 10 client.6678 fetch_fsmap finished waiting for FSMap version 42 2023-07-09T02:15:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 10 client.6678 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T02:15:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 20 client.6678 populate_metadata read hostname 'smithi045' 2023-07-09T02:15:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] conn(0x55c1bbf11f90 0x55c1bbf12360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 4 client.6678 mds_command: new command op to 6537 tid=0[{"prefix": "status"}] 2023-07-09T02:15:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 -- 172.21.15.45:0/321706859 --> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c1bbcd06f0 con 0x55c1bbf11f90 2023-07-09T02:15:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e0e488640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] conn(0x55c1bbf11f90 0x55c1bbf12360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e0e488640 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] conn(0x55c1bbf11f90 0x55c1bbf12360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bae20d70323b40e8 server_cookie=effe205c6a0b8c6 in_seq=0 out_seq=0 2023-07-09T02:15:20.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2de97fa640 10 client.6678 ms_handle_connect on v2:172.21.15.155:6835/1667885237 2023-07-09T02:15:20.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2de97fa640 1 -- 172.21.15.45:0/321706859 <== mds.0 v2:172.21.15.155:6835/1667885237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c1bbcd06f0 con 0x55c1bbf11f90 2023-07-09T02:15:20.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2de97fa640 10 client.6678 handle_command_reply: tid=0 2023-07-09T02:15:20.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 client.6678 shutdown 2023-07-09T02:15:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 -- 172.21.15.45:0/321706859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 msgr2=0x55c1bbf11a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbf11a50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2e000a5b10 tx=0x7f2e000a7000 comp rx=0 tx=0).stop 2023-07-09T02:15:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 -- 172.21.15.45:0/321706859 shutdown_connections 2023-07-09T02:15:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c1bbf14110 0x55c1bbf11a50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:6835/1667885237,v1:172.21.15.155:6837/1667885237] conn(0x55c1bbf11f90 0x55c1bbf12360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55c1bbf13800 0x55c1bbf11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 --2- 172.21.15.45:0/321706859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1bbec9f90 0x55c1bbf70520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2de97fa640 0 client.6678 ms_handle_reset on v2:172.21.15.155:6835/1667885237 2023-07-09T02:15:20.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 -- 172.21.15.45:0/321706859 >> 172.21.15.45:0/321706859 conn(0x55c1bbd8ca70 msgr2=0x55c1bbf24d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:20.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 -- 172.21.15.45:0/321706859 shutdown_connections 2023-07-09T02:15:20.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 1 -- 172.21.15.45:0/321706859 wait complete. 2023-07-09T02:15:20.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e13a66000 20 client.6678 trim_cache size 0 max 16384 2023-07-09T02:15:20.503 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:15:20.504 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:15:20.504 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:15:20.504 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6537, 2023-07-09T02:15:20.504 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:15:20.504 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:15:20.504 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:15:20.504 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9096379639999999, 2023-07-09T02:15:20.505 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 42, 2023-07-09T02:15:20.505 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2023-07-09T02:15:20.505 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 88, 2023-07-09T02:15:20.505 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.641935079 2023-07-09T02:15:20.505 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:15:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 -- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2dec066280 msgr2=0x7f2dec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2dec066280 0x7f2dec068730 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2e08157c80 tx=0x7f2df8008040 comp rx=0 tx=0).stop 2023-07-09T02:15:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 -- 172.21.15.45:0/4064524416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 msgr2=0x7f2e08151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e08151a70 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400c480 tx=0x7f2e0400c940 comp rx=0 tx=0).stop 2023-07-09T02:15:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 -- 172.21.15.45:0/4064524416 shutdown_connections 2023-07-09T02:15:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e0815c060 0x7f2e0815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2dec066280 0x7f2dec068730 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080d2620 0x7f2e0815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 --2- 172.21.15.45:0/4064524416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080cd120 0x7f2e08151a70 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 -- 172.21.15.45:0/4064524416 >> 172.21.15.45:0/4064524416 conn(0x7f2e080698e0 msgr2=0x7f2e080b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 -- 172.21.15.45:0/4064524416 shutdown_connections 2023-07-09T02:15:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.493+0000 7f2e106ec640 1 -- 172.21.15.45:0/4064524416 wait complete. 2023-07-09T02:15:20.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:15:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3939be2640 1 Processor -- start 2023-07-09T02:15:20.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3939be2640 1 -- start start 2023-07-09T02:15:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3939be2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39340d2620 0x7f39340b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3939be2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39340cd120 0x7f39340cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3939be2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3934160a50 con 0x7f393415c060 2023-07-09T02:15:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3939be2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393415c430 con 0x7f39340d2620 2023-07-09T02:15:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3939be2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393415fb60 con 0x7f39340cd120 2023-07-09T02:15:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3932ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39340d2620 0x7f39340b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3933fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39340cd120 0x7f39340cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3933fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39340cd120 0x7f39340cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:57482/0 (socket says 172.21.15.45:57482) 2023-07-09T02:15:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3933fff640 1 -- 172.21.15.45:0/2623913635 learned_addr learned my addr 172.21.15.45:0/2623913635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f39337fe640 1 --1- 172.21.15.45:0/2623913635 >> v1:172.21.15.155:6789/0 conn(0x7f393415c060 0x7f39340d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:48886/0 (socket says 172.21.15.45:48886) 2023-07-09T02:15:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3933fff640 1 -- 172.21.15.45:0/2623913635 >> v2:172.21.15.155:3300/0 conn(0x7f39340d2620 msgr2=0x7f39340b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3933fff640 1 --2- 172.21.15.45:0/2623913635 >> v2:172.21.15.155:3300/0 conn(0x7f39340d2620 0x7f39340b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3933fff640 1 -- 172.21.15.45:0/2623913635 >> v1:172.21.15.155:6789/0 conn(0x7f393415c060 legacy=0x7f39340d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f3933fff640 1 -- 172.21.15.45:0/2623913635 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393415fe40 con 0x7f39340cd120 2023-07-09T02:15:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.657+0000 7f39327fc640 1 -- 172.21.15.45:0/2623913635 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767331732 0 0) 0x7f3934160a50 con 0x7f393415c060 2023-07-09T02:15:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3933fff640 1 --2- 172.21.15.45:0/2623913635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39340cd120 0x7f39340cee30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f392c009e50 tx=0x7f392c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea0e8358956c034d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f39327fc640 1 -- 172.21.15.45:0/2623913635 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0a58a0 con 0x7f39340cd120 2023-07-09T02:15:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f39327fc640 1 -- 172.21.15.45:0/2623913635 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c0a5a00 con 0x7f39340cd120 2023-07-09T02:15:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f39327fc640 1 -- 172.21.15.45:0/2623913635 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0a5d90 con 0x7f39340cd120 2023-07-09T02:15:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3939be2640 1 -- 172.21.15.45:0/2623913635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39340cd120 msgr2=0x7f39340cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3939be2640 1 --2- 172.21.15.45:0/2623913635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39340cd120 0x7f39340cee30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f392c009e50 tx=0x7f392c01c9e0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3939be2640 1 -- 172.21.15.45:0/2623913635 shutdown_connections 2023-07-09T02:15:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3939be2640 1 --2- 172.21.15.45:0/2623913635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39340cd120 0x7f39340cee30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3939be2640 1 --2- 172.21.15.45:0/2623913635 >> v2:172.21.15.155:3300/0 conn(0x7f39340d2620 0x7f39340b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3939be2640 1 -- 172.21.15.45:0/2623913635 >> 172.21.15.45:0/2623913635 conn(0x7f39340698e0 msgr2=0x7f3934069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3939be2640 1 -- 172.21.15.45:0/2623913635 shutdown_connections 2023-07-09T02:15:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.661+0000 7f3939be2640 1 -- 172.21.15.45:0/2623913635 wait complete. 2023-07-09T02:15:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 Processor -- start 2023-07-09T02:15:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 -- start start 2023-07-09T02:15:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39340cd120 0x7f3934155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39340d2620 0x7f3934154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f393415c060 0x7f393415d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3934157550 con 0x7f39340d2620 2023-07-09T02:15:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3934154fe0 con 0x7f39340cd120 2023-07-09T02:15:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39340caf80 con 0x7f393415c060 2023-07-09T02:15:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39340d2620 0x7f3934154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39340d2620 0x7f3934154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34904/0 (socket says 172.21.15.45:34904) 2023-07-09T02:15:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 -- 172.21.15.45:0/2833174854 learned_addr learned my addr 172.21.15.45:0/2833174854 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f39337fe640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39340cd120 0x7f3934155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3933fff640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f393415c060 0x7f393415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 -- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f393415c060 msgr2=0x7f393415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f393415c060 0x7f393415d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 -- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39340cd120 msgr2=0x7f3934155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39340cd120 0x7f3934155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 -- 172.21.15.45:0/2833174854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c009b30 con 0x7f39340d2620 2023-07-09T02:15:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3933fff640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f393415c060 0x7f393415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3932ffd640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39340d2620 0x7f3934154aa0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f392800e900 tx=0x7f392800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f391bfff640 1 -- 172.21.15.45:0/2833174854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928009690 con 0x7f39340d2620 2023-07-09T02:15:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f391bfff640 1 -- 172.21.15.45:0/2833174854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392800ca00 con 0x7f39340d2620 2023-07-09T02:15:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f391bfff640 1 -- 172.21.15.45:0/2833174854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392800cdb0 con 0x7f39340d2620 2023-07-09T02:15:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39340b59f0 con 0x7f39340d2620 2023-07-09T02:15:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.665+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39340cb1d0 con 0x7f39340d2620 2023-07-09T02:15:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.669+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393404d7d0 con 0x7f39340d2620 2023-07-09T02:15:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.669+0000 7f391bfff640 1 -- 172.21.15.45:0/2833174854 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3928013470 con 0x7f39340d2620 2023-07-09T02:15:20.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.669+0000 7f391bfff640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3920066280 0x7f3920068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:20.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.669+0000 7f391bfff640 1 -- 172.21.15.45:0/2833174854 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3928083f90 con 0x7f39340d2620 2023-07-09T02:15:20.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.669+0000 7f39337fe640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3920066280 0x7f3920068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:20.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.669+0000 7f39337fe640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3920066280 0x7f3920068730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3924000f70 tx=0x7f3924007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:20.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.673+0000 7f391bfff640 1 -- 172.21.15.45:0/2833174854 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3928051390 con 0x7f39340d2620 2023-07-09T02:15:20.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f393406baa0 con 0x7f39340d2620 2023-07-09T02:15:20.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f391bfff640 1 -- 172.21.15.45:0/2833174854 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3928021070 con 0x7f39340d2620 2023-07-09T02:15:20.866 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:15:20.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3920066280 msgr2=0x7f3920068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3920066280 0x7f3920068730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3924000f70 tx=0x7f3924007df0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39340d2620 msgr2=0x7f3934154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:20.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39340d2620 0x7f3934154aa0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f392800e900 tx=0x7f392800edc0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 shutdown_connections 2023-07-09T02:15:20.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3920066280 0x7f3920068730 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f393415c060 0x7f393415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39340d2620 0x7f3934154aa0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 --2- 172.21.15.45:0/2833174854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39340cd120 0x7f3934155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 >> 172.21.15.45:0/2833174854 conn(0x7f39340698e0 msgr2=0x7f39340b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 shutdown_connections 2023-07-09T02:15:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:20.865+0000 7f3939be2640 1 -- 172.21.15.45:0/2833174854 wait complete. 2023-07-09T02:15:20.888 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:15:20.889 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:15:20.889 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:15:20.889 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:15:20.889 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:15:20.890 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:15:20.890 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:15:20.890 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:15:20.891 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:15:20.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:20.892 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:15:20.903 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:15:20.903 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:15:20.904 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:15:20.904 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:20.904 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:15:20.904 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:20.904 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:15:20.904 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:20.905 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:15:20.905 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:15:20.905 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:20.905 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:15:20.905 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:15:20.905 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-07-09T02:15:20.905 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:15:20.905 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:20.906 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:15:20.906 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:20.906 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:15:20.906 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:15:20.906 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:20.906 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:15:20.906 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:15:20.907 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:20.907 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:15:20.907 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:20.907 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:15:20.907 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:20.907 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:15:20.907 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:20.907 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:15:20.908 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:20.908 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:15:20.908 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:15:20.908 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:15:20.908 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:20.908 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:15:20.908 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:15:20.909 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:15:20.909 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:20.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:20.909 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:15:20.968 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:15:20.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:20.970 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:15:21.025 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:15:21.026 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:15:21.027 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:15:21.027 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:15:21.027 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:15:21.027 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:15:21.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:21.028 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:15:21.028 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:15:21.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:15:21.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:15:21.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:15:21.030 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:15:21.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:21.125 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:15:21.135 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:15:21.136 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:15:21.137 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:15:21.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:21.138 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:15:21.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:15:21.198 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:15:21.249 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:15:21.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:15:21.250 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:15:21.304 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:15:21.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:21.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:15:21.399 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:15:21.400 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:15:21.412 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:15:21.413 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:15:21.413 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:15:21.413 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:15:21.413 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:15:21.416 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:15:21.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:21.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:15:21.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:21.440 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:15:21.499 INFO:teuthology.orchestra.run.smithi045.stdout:client6684 2023-07-09T02:15:21.499 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:15:21.500 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:21.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:15:21.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f136569c640 1 Processor -- start 2023-07-09T02:15:21.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f136569c640 1 -- start start 2023-07-09T02:15:21.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f136569c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f136015c060 0x7f13600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f136569c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13600cd120 0x7f13600d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f136569c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1360160a50 con 0x7f13600d2450 2023-07-09T02:15:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f136569c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600d28d0 con 0x7f13600cd120 2023-07-09T02:15:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f136569c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600cfe40 con 0x7f136015c060 2023-07-09T02:15:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f1357fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13600cd120 0x7f13600d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:21.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f1357fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13600cd120 0x7f13600d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49138/0 (socket says 172.21.15.45:49138) 2023-07-09T02:15:21.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f1357fff640 1 -- 172.21.15.45:0/3669724855 learned_addr learned my addr 172.21.15.45:0/3669724855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.737+0000 7f135effd640 1 --2- 172.21.15.45:0/3669724855 >> v2:172.21.15.155:3300/0 conn(0x7f136015c060 0x7f13600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f1357fff640 1 -- 172.21.15.45:0/3669724855 >> v2:172.21.15.155:3300/0 conn(0x7f136015c060 msgr2=0x7f13600b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f1357fff640 1 --2- 172.21.15.45:0/3669724855 >> v2:172.21.15.155:3300/0 conn(0x7f136015c060 0x7f13600b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f1357fff640 1 -- 172.21.15.45:0/3669724855 >> v1:172.21.15.45:6789/0 conn(0x7f13600d2450 legacy=0x7f13600d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f1357fff640 1 -- 172.21.15.45:0/3669724855 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136015c430 con 0x7f13600cd120 2023-07-09T02:15:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f135effd640 1 --2- 172.21.15.45:0/3669724855 >> v2:172.21.15.155:3300/0 conn(0x7f136015c060 0x7f13600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f135e7fc640 1 -- 172.21.15.45:0/3669724855 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830205003 0 0) 0x7f1360160a50 con 0x7f13600d2450 2023-07-09T02:15:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f1357fff640 1 --2- 172.21.15.45:0/3669724855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13600cd120 0x7f13600d1f10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f13600d3ad0 tx=0x7f134801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8e8aebd04ec47e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f135e7fc640 1 -- 172.21.15.45:0/3669724855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480ab5f0 con 0x7f13600cd120 2023-07-09T02:15:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f135e7fc640 1 -- 172.21.15.45:0/3669724855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13480ab750 con 0x7f13600cd120 2023-07-09T02:15:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f135e7fc640 1 -- 172.21.15.45:0/3669724855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480abae0 con 0x7f13600cd120 2023-07-09T02:15:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f136569c640 1 -- 172.21.15.45:0/3669724855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13600cd120 msgr2=0x7f13600d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f136569c640 1 --2- 172.21.15.45:0/3669724855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13600cd120 0x7f13600d1f10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f13600d3ad0 tx=0x7f134801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f136569c640 1 -- 172.21.15.45:0/3669724855 shutdown_connections 2023-07-09T02:15:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f136569c640 1 --2- 172.21.15.45:0/3669724855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13600cd120 0x7f13600d1f10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f136569c640 1 --2- 172.21.15.45:0/3669724855 >> v2:172.21.15.155:3300/0 conn(0x7f136015c060 0x7f13600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f136569c640 1 -- 172.21.15.45:0/3669724855 >> 172.21.15.45:0/3669724855 conn(0x7f13600698e0 msgr2=0x7f1360069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.741+0000 7f136569c640 1 -- 172.21.15.45:0/3669724855 shutdown_connections 2023-07-09T02:15:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 -- 172.21.15.45:0/3669724855 wait complete. 2023-07-09T02:15:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 Processor -- start 2023-07-09T02:15:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 -- start start 2023-07-09T02:15:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13600cd120 0x7f1360151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13600d2450 0x7f1360156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136015c060 0x7f136015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:21.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13601519b0 con 0x7f136015c060 2023-07-09T02:15:21.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13600b3270 con 0x7f13600cd120 2023-07-09T02:15:21.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1360156ec0 con 0x7f13600d2450 2023-07-09T02:15:21.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136015c060 0x7f136015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:21.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136015c060 0x7f136015d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49146/0 (socket says 172.21.15.45:49146) 2023-07-09T02:15:21.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 -- 172.21.15.45:0/2496622882 learned_addr learned my addr 172.21.15.45:0/2496622882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:21.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f1357fff640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13600d2450 0x7f1360156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:21.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135effd640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13600cd120 0x7f1360151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:21.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 -- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13600d2450 msgr2=0x7f1360156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:21.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13600d2450 0x7f1360156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 -- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13600cd120 msgr2=0x7f1360151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:21.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13600cd120 0x7f1360151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 -- 172.21.15.45:0/2496622882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480094d0 con 0x7f136015c060 2023-07-09T02:15:21.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f135f7fe640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136015c060 0x7f136015d110 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1358001570 tx=0x7f135800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:21.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f13577fe640 1 -- 172.21.15.45:0/2496622882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358003db0 con 0x7f136015c060 2023-07-09T02:15:21.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f13577fe640 1 -- 172.21.15.45:0/2496622882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1358005070 con 0x7f136015c060 2023-07-09T02:15:21.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f13577fe640 1 -- 172.21.15.45:0/2496622882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358005420 con 0x7f136015c060 2023-07-09T02:15:21.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13601571a0 con 0x7f136015c060 2023-07-09T02:15:21.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.745+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13600b34c0 con 0x7f136015c060 2023-07-09T02:15:21.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.749+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13600b36b0 con 0x7f136015c060 2023-07-09T02:15:21.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.749+0000 7f13577fe640 1 -- 172.21.15.45:0/2496622882 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1358005580 con 0x7f136015c060 2023-07-09T02:15:21.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.749+0000 7f13577fe640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1340066280 0x7f1340068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:21.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.749+0000 7f13577fe640 1 -- 172.21.15.45:0/2496622882 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1358083630 con 0x7f136015c060 2023-07-09T02:15:21.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.749+0000 7f135effd640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1340066280 0x7f1340068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:21.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.753+0000 7f135effd640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1340066280 0x7f1340068730 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f135000ba10 tx=0x7f1350008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:21.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.753+0000 7f13577fe640 1 -- 172.21.15.45:0/2496622882 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1358050ab0 con 0x7f136015c060 2023-07-09T02:15:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.941+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f136004d7d0 con 0x7f136015c060 2023-07-09T02:15:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f13577fe640 1 -- 172.21.15.45:0/2496622882 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f13580540d0 con 0x7f136015c060 2023-07-09T02:15:21.945 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:15:21.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1340066280 msgr2=0x7f1340068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:21.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1340066280 0x7f1340068730 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f135000ba10 tx=0x7f1350008040 comp rx=0 tx=0).stop 2023-07-09T02:15:21.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136015c060 msgr2=0x7f136015d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:21.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136015c060 0x7f136015d110 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1358001570 tx=0x7f135800cd20 comp rx=0 tx=0).stop 2023-07-09T02:15:21.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 shutdown_connections 2023-07-09T02:15:21.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136015c060 0x7f136015d110 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1340066280 0x7f1340068730 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13600d2450 0x7f1360156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 --2- 172.21.15.45:0/2496622882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13600cd120 0x7f1360151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:21.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 >> 172.21.15.45:0/2496622882 conn(0x7f13600698e0 msgr2=0x7f136015b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:21.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 shutdown_connections 2023-07-09T02:15:21.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:21.945+0000 7f136569c640 1 -- 172.21.15.45:0/2496622882 wait complete. 2023-07-09T02:15:21.965 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:15:21.966 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:15:21.966 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:15:21.966 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:15:21.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:15:21.967 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:15:21.968 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:15:21.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:15:21.969 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:15:21.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:21.970 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:15:21.980 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:15:21.980 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:15:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:15:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:15:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:21.981 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:15:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:21.981 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:15:21.982 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:15:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:15:21.982 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:15:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:21.982 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:15:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:21.982 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:15:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42212sec preferred_lft 42212sec 2023-07-09T02:15:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:15:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:21.983 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:15:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:15:21.983 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:21.983 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:15:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:15:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:15:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:15:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:21.984 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:15:21.984 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:15:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:15:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:21.985 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:15:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:15:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:15:21.985 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:15:21.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:21.987 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:15:22.049 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:15:22.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:22.053 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:15:22.104 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:15:22.105 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:15:22.105 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:15:22.106 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:15:22.106 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:15:22.107 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:15:22.107 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:15:22.107 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:15:22.108 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:15:22.109 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:15:22.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:22.110 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:15:22.111 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:15:22.111 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:15:22.112 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:15:22.112 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:15:22.112 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:15:22.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:22.204 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:15:22.214 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:15:22.214 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:15:22.215 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:15:22.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:22.215 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:15:22.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:15:22.278 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:15:22.328 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:15:22.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:15:22.329 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:15:22.380 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:15:22.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:22.381 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:15:22.475 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:15:22.475 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:15:22.486 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:15:22.487 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:15:22.487 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:15:22.487 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:15:22.487 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:15:22.491 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:15:22.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:22.492 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:15:22.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:22.512 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:15:22.563 INFO:teuthology.orchestra.run.smithi155.stdout:client6343 2023-07-09T02:15:22.563 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:15:22.564 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:22.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:15:22.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.765+0000 7f78d152c640 1 Processor -- start 2023-07-09T02:15:22.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78d152c640 1 -- start start 2023-07-09T02:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78d152c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78cc15c060 0x7f78cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:22.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78d152c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc0cd120 0x7f78cc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:22.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78d152c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78cc0d2450 0x7f78cc0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:22.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78d152c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc0d28f0 con 0x7f78cc0d2450 2023-07-09T02:15:22.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78d152c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc160a50 con 0x7f78cc15c060 2023-07-09T02:15:22.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78d152c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15c430 con 0x7f78cc0cd120 2023-07-09T02:15:22.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78cb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78cc0d2450 0x7f78cc0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:22.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78cb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78cc0d2450 0x7f78cc0d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49152/0 (socket says 172.21.15.45:49152) 2023-07-09T02:15:22.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78cb7fe640 1 -- 172.21.15.45:0/3926805752 learned_addr learned my addr 172.21.15.45:0/3926805752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78ca7fc640 1 --2- 172.21.15.45:0/3926805752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc0cd120 0x7f78cc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78caffd640 1 --2- 172.21.15.45:0/3926805752 >> v2:172.21.15.155:3300/0 conn(0x7f78cc15c060 0x7f78cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78cb7fe640 1 -- 172.21.15.45:0/3926805752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc0cd120 msgr2=0x7f78cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78cb7fe640 1 --2- 172.21.15.45:0/3926805752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc0cd120 0x7f78cc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78cb7fe640 1 -- 172.21.15.45:0/3926805752 >> v2:172.21.15.155:3300/0 conn(0x7f78cc15c060 msgr2=0x7f78cc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78cb7fe640 1 --2- 172.21.15.45:0/3926805752 >> v2:172.21.15.155:3300/0 conn(0x7f78cc15c060 0x7f78cc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.769+0000 7f78cb7fe640 1 -- 172.21.15.45:0/3926805752 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc15fb60 con 0x7f78cc0d2450 2023-07-09T02:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78cb7fe640 1 --2- 172.21.15.45:0/3926805752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d2450 0x7f78cc0d0610 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0d3ad0 tx=0x7f78c401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225731a60b9cf282 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:22.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78c9ffb640 1 -- 172.21.15.45:0/3926805752 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c40a5560 con 0x7f78cc0d2450 2023-07-09T02:15:22.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78c9ffb640 1 -- 172.21.15.45:0/3926805752 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c40a56c0 con 0x7f78cc0d2450 2023-07-09T02:15:22.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78c9ffb640 1 -- 172.21.15.45:0/3926805752 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c40a5a50 con 0x7f78cc0d2450 2023-07-09T02:15:22.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 -- 172.21.15.45:0/3926805752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d2450 msgr2=0x7f78cc0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:22.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 --2- 172.21.15.45:0/3926805752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d2450 0x7f78cc0d0610 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0d3ad0 tx=0x7f78c401c6e0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 -- 172.21.15.45:0/3926805752 shutdown_connections 2023-07-09T02:15:22.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 --2- 172.21.15.45:0/3926805752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d2450 0x7f78cc0d0610 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 --2- 172.21.15.45:0/3926805752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc0cd120 0x7f78cc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 --2- 172.21.15.45:0/3926805752 >> v2:172.21.15.155:3300/0 conn(0x7f78cc15c060 0x7f78cc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 -- 172.21.15.45:0/3926805752 >> 172.21.15.45:0/3926805752 conn(0x7f78cc0698e0 msgr2=0x7f78cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 -- 172.21.15.45:0/3926805752 shutdown_connections 2023-07-09T02:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 -- 172.21.15.45:0/3926805752 wait complete. 2023-07-09T02:15:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 Processor -- start 2023-07-09T02:15:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.773+0000 7f78d152c640 1 -- start start 2023-07-09T02:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0cd120 0x7f78cc1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78cc0d2450 0x7f78cc0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc15c060 0x7f78cc0cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc152820 con 0x7f78cc0cd120 2023-07-09T02:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc153730 con 0x7f78cc0d2450 2023-07-09T02:15:22.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc152b20 con 0x7f78cc15c060 2023-07-09T02:15:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0cd120 0x7f78cc1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0cd120 0x7f78cc1522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49162/0 (socket says 172.21.15.45:49162) 2023-07-09T02:15:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 -- 172.21.15.45:0/2513530349 learned_addr learned my addr 172.21.15.45:0/2513530349 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 -- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc15c060 msgr2=0x7f78cc0cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc15c060 0x7f78cc0cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 -- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78cc0d2450 msgr2=0x7f78cc0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78cc0d2450 0x7f78cc0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 -- 172.21.15.45:0/2513530349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c4009b30 con 0x7f78cc0cd120 2023-07-09T02:15:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78caffd640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0cd120 0x7f78cc1522e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00e8a0 tx=0x7f78bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78b37fe640 1 -- 172.21.15.45:0/2513530349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc009510 con 0x7f78cc0cd120 2023-07-09T02:15:22.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78b37fe640 1 -- 172.21.15.45:0/2513530349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc00c940 con 0x7f78cc0cd120 2023-07-09T02:15:22.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78b37fe640 1 -- 172.21.15.45:0/2513530349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc00ccb0 con 0x7f78cc0cd120 2023-07-09T02:15:22.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc152e00 con 0x7f78cc0cd120 2023-07-09T02:15:22.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc1533c0 con 0x7f78cc0cd120 2023-07-09T02:15:22.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.777+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc04d7d0 con 0x7f78cc0cd120 2023-07-09T02:15:22.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.781+0000 7f78b37fe640 1 -- 172.21.15.45:0/2513530349 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78bc013470 con 0x7f78cc0cd120 2023-07-09T02:15:22.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.781+0000 7f78b37fe640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78b80662b0 0x7f78b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:22.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.781+0000 7f78b37fe640 1 -- 172.21.15.45:0/2513530349 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78bc083ea0 con 0x7f78cc0cd120 2023-07-09T02:15:22.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.781+0000 7f78ca7fc640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78b80662b0 0x7f78b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:22.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.781+0000 7f78ca7fc640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78b80662b0 0x7f78b8068760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006aa0 tx=0x7f78c0006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:22.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.785+0000 7f78b37fe640 1 -- 172.21.15.45:0/2513530349 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78bc054d10 con 0x7f78cc0cd120 2023-07-09T02:15:22.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.969+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78cc15b890 con 0x7f78cc0cd120 2023-07-09T02:15:22.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.969+0000 7f78b37fe640 1 -- 172.21.15.45:0/2513530349 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f78bc017090 con 0x7f78cc0cd120 2023-07-09T02:15:22.972 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:22.972 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1384902817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1384902817},{"type":"v1","addr":"172.21.15.45:6835","nonce":1384902817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/324339930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":324339930},{"type":"v1","addr":"172.21.15.155:6836","nonce":324339930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/355258806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":355258806},{"type":"v1","addr":"172.21.15.45:6833","nonce":355258806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:15:13.977165+0000","modified":"2023-07-09T02:15:17.606626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6537":{"gid":6537,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1667885237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1667885237},{"type":"v1","addr":"172.21.15.155:6837","nonce":1667885237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T02:15:22.973 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-07-09T02:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78b80662b0 msgr2=0x7f78b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78b80662b0 0x7f78b8068760 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006aa0 tx=0x7f78c0006a30 comp rx=0 tx=0).stop 2023-07-09T02:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0cd120 msgr2=0x7f78cc1522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0cd120 0x7f78cc1522e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00e8a0 tx=0x7f78bc00eca0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 shutdown_connections 2023-07-09T02:15:22.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78b80662b0 0x7f78b8068760 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78cc15c060 0x7f78cc0cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78cc0d2450 0x7f78cc0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 --2- 172.21.15.45:0/2513530349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0cd120 0x7f78cc1522e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 >> 172.21.15.45:0/2513530349 conn(0x7f78cc0698e0 msgr2=0x7f78cc1548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 shutdown_connections 2023-07-09T02:15:22.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:22.973+0000 7f78d152c640 1 -- 172.21.15.45:0/2513530349 wait complete. 2023-07-09T02:15:22.993 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-07-09T02:15:23.150 INFO:teuthology.orchestra.run.smithi155.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":6537,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5507759490000002,"mdsmap_epoch":42,"osdmap_epoch":88,"osdmap_epoch_barrier":88,"uptime":14.283059133} 2023-07-09T02:15:23.151 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 6537, "mdsmap_epoch": 42, "osdmap_epoch": 88, "osdmap_epoch_barrier": 88, "rank_uptime": 8.550775949, "state": "up:active", "uptime": 14.283059133, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:15:23.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-07-09T02:15:23.311 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_mon_report_interval":"5"} 2023-07-09T02:15:23.312 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-07-09T02:15:23.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-07-09T02:15:23.466 INFO:teuthology.orchestra.run.smithi045.stdout:{"mon_tick_interval":"5"} 2023-07-09T02:15:23.466 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-07-09T02:15:23.467 INFO:tasks.cephfs.test_full:pool capacity 556983872, 531MB should be enough to fill it 2023-07-09T02:15:23.467 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:15:23.468 DEBUG:teuthology.orchestra.run.smithi045:> import time 2023-07-09T02:15:23.468 DEBUG:teuthology.orchestra.run.smithi045:> import datetime 2023-07-09T02:15:23.468 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-07-09T02:15:23.469 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:15:23.469 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:15:23.470 DEBUG:teuthology.orchestra.run.smithi045:> # Write some buffered data through before going full, all should be well 2023-07-09T02:15:23.470 DEBUG:teuthology.orchestra.run.smithi045:> print("writing some data through which we expect to succeed") 2023-07-09T02:15:23.471 DEBUG:teuthology.orchestra.run.smithi045:> bytes = 0 2023-07-09T02:15:23.472 DEBUG:teuthology.orchestra.run.smithi045:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-07-09T02:15:23.472 DEBUG:teuthology.orchestra.run.smithi045:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-07-09T02:15:23.473 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-07-09T02:15:23.474 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f) 2023-07-09T02:15:23.475 DEBUG:teuthology.orchestra.run.smithi045:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-07-09T02:15:23.475 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:15:23.475 DEBUG:teuthology.orchestra.run.smithi045:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-07-09T02:15:23.476 DEBUG:teuthology.orchestra.run.smithi045:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-07-09T02:15:23.477 DEBUG:teuthology.orchestra.run.smithi045:> # buffered IO, the error should always only appear from fsync and not 2023-07-09T02:15:23.477 DEBUG:teuthology.orchestra.run.smithi045:> # from write 2023-07-09T02:15:23.478 DEBUG:teuthology.orchestra.run.smithi045:> full = False 2023-07-09T02:15:23.478 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:15:23.479 DEBUG:teuthology.orchestra.run.smithi045:> for n in range(0, int(531 * 1.1)): 2023-07-09T02:15:23.479 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-07-09T02:15:23.480 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-07-09T02:15:23.481 DEBUG:teuthology.orchestra.run.smithi045:> print("wrote bytes via buffered write, moving on to fsync") 2023-07-09T02:15:23.481 DEBUG:teuthology.orchestra.run.smithi045:> except OSError as e: 2023-07-09T02:15:23.481 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-07-09T02:15:23.482 DEBUG:teuthology.orchestra.run.smithi045:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-07-09T02:15:23.482 DEBUG:teuthology.orchestra.run.smithi045:> raise 2023-07-09T02:15:23.482 DEBUG:teuthology.orchestra.run.smithi045:> else: 2023-07-09T02:15:23.483 DEBUG:teuthology.orchestra.run.smithi045:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-07-09T02:15:23.483 DEBUG:teuthology.orchestra.run.smithi045:> full = True 2023-07-09T02:15:23.483 DEBUG:teuthology.orchestra.run.smithi045:> break 2023-07-09T02:15:23.483 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:15:23.484 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-07-09T02:15:23.484 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f) 2023-07-09T02:15:23.484 DEBUG:teuthology.orchestra.run.smithi045:> print("fsync'"'"'ed successfully") 2023-07-09T02:15:23.485 DEBUG:teuthology.orchestra.run.smithi045:> except OSError as e: 2023-07-09T02:15:23.485 DEBUG:teuthology.orchestra.run.smithi045:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-07-09T02:15:23.485 DEBUG:teuthology.orchestra.run.smithi045:> full = True 2023-07-09T02:15:23.485 DEBUG:teuthology.orchestra.run.smithi045:> break 2023-07-09T02:15:23.486 DEBUG:teuthology.orchestra.run.smithi045:> else: 2023-07-09T02:15:23.486 DEBUG:teuthology.orchestra.run.smithi045:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-07-09T02:15:23.486 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:15:23.487 DEBUG:teuthology.orchestra.run.smithi045:> if n > 531 * 0.9: 2023-07-09T02:15:23.487 DEBUG:teuthology.orchestra.run.smithi045:> # Be cautious in the last region where we expect to hit 2023-07-09T02:15:23.488 DEBUG:teuthology.orchestra.run.smithi045:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-07-09T02:15:23.488 DEBUG:teuthology.orchestra.run.smithi045:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-07-09T02:15:23.489 DEBUG:teuthology.orchestra.run.smithi045:> time.sleep(15.0) 2023-07-09T02:15:23.489 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:15:23.489 DEBUG:teuthology.orchestra.run.smithi045:> if not full: 2023-07-09T02:15:23.490 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-07-09T02:15:23.490 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:15:23.490 DEBUG:teuthology.orchestra.run.smithi045:> # close() should not raise an error because we already caught it in 2023-07-09T02:15:23.490 DEBUG:teuthology.orchestra.run.smithi045:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-07-09T02:15:23.491 DEBUG:teuthology.orchestra.run.smithi045:> # since then because all IOs got cancelled on the full flag. 2023-07-09T02:15:23.491 DEBUG:teuthology.orchestra.run.smithi045:> print("calling close") 2023-07-09T02:15:23.491 DEBUG:teuthology.orchestra.run.smithi045:> os.close(f) 2023-07-09T02:15:23.491 DEBUG:teuthology.orchestra.run.smithi045:> print("close() did not raise error") 2023-07-09T02:15:23.492 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:15:23.492 DEBUG:teuthology.orchestra.run.smithi045:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-07-09T02:15:23.492 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:15:24.384 INFO:teuthology.orchestra.run.smithi045.stdout:writing some data through which we expect to succeed 2023-07-09T02:15:24.385 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-07-09T02:15:24.385 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.385 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.385 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 1.00 MB 2023-07-09T02:15:24.386 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.386 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.386 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 2.00 MB 2023-07-09T02:15:24.387 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.387 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.388 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 3.00 MB 2023-07-09T02:15:24.388 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.388 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.388 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 4.00 MB 2023-07-09T02:15:24.388 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.389 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.389 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 5.00 MB 2023-07-09T02:15:24.389 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.389 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.389 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 6.00 MB 2023-07-09T02:15:24.390 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.390 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.390 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 7.00 MB 2023-07-09T02:15:24.390 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.391 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.391 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 8.00 MB 2023-07-09T02:15:24.392 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.392 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.392 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 9.00 MB 2023-07-09T02:15:24.392 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.393 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.393 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 10.00 MB 2023-07-09T02:15:24.393 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.393 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.393 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 11.00 MB 2023-07-09T02:15:24.394 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.394 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.394 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 12.00 MB 2023-07-09T02:15:24.394 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.394 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.394 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 13.00 MB 2023-07-09T02:15:24.395 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.395 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.395 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 14.00 MB 2023-07-09T02:15:24.395 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.395 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.395 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 15.00 MB 2023-07-09T02:15:24.396 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.396 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.396 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 16.00 MB 2023-07-09T02:15:24.396 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 17.00 MB 2023-07-09T02:15:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 18.00 MB 2023-07-09T02:15:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 19.00 MB 2023-07-09T02:15:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 20.00 MB 2023-07-09T02:15:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.399 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.399 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 21.00 MB 2023-07-09T02:15:24.399 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.399 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.400 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 22.00 MB 2023-07-09T02:15:24.400 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.400 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.401 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 23.00 MB 2023-07-09T02:15:24.401 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.401 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.401 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 24.00 MB 2023-07-09T02:15:24.402 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.402 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.402 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 25.00 MB 2023-07-09T02:15:24.403 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.407 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.408 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 26.00 MB 2023-07-09T02:15:24.408 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.408 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.409 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 27.00 MB 2023-07-09T02:15:24.409 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.409 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.409 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 28.00 MB 2023-07-09T02:15:24.409 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.410 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.410 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 29.00 MB 2023-07-09T02:15:24.410 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.411 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.411 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 30.00 MB 2023-07-09T02:15:24.411 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.412 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.412 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 31.00 MB 2023-07-09T02:15:24.412 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.412 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.413 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 32.00 MB 2023-07-09T02:15:24.413 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.413 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.413 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 33.00 MB 2023-07-09T02:15:24.413 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.413 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.413 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 34.00 MB 2023-07-09T02:15:24.414 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.415 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.415 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 35.00 MB 2023-07-09T02:15:24.415 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.415 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.415 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 36.00 MB 2023-07-09T02:15:24.415 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.416 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.416 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 37.00 MB 2023-07-09T02:15:24.416 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.416 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.417 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 38.00 MB 2023-07-09T02:15:24.417 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.417 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.417 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 39.00 MB 2023-07-09T02:15:24.418 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.418 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.418 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 40.00 MB 2023-07-09T02:15:24.418 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 41.00 MB 2023-07-09T02:15:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 42.00 MB 2023-07-09T02:15:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 43.00 MB 2023-07-09T02:15:24.420 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.420 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.420 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 44.00 MB 2023-07-09T02:15:24.420 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.420 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.421 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 45.00 MB 2023-07-09T02:15:24.421 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.421 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.421 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 46.00 MB 2023-07-09T02:15:24.421 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.421 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.421 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 47.00 MB 2023-07-09T02:15:24.422 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.422 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.422 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 48.00 MB 2023-07-09T02:15:24.422 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.422 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.422 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 49.00 MB 2023-07-09T02:15:24.422 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.422 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.423 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 50.00 MB 2023-07-09T02:15:24.423 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.423 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.423 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 51.00 MB 2023-07-09T02:15:24.423 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.423 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.423 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 52.00 MB 2023-07-09T02:15:24.423 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.424 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.424 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 53.00 MB 2023-07-09T02:15:24.424 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.424 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.424 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 54.00 MB 2023-07-09T02:15:24.424 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.425 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.425 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 55.00 MB 2023-07-09T02:15:24.425 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.425 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.425 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 56.00 MB 2023-07-09T02:15:24.426 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.426 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.426 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 57.00 MB 2023-07-09T02:15:24.426 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.426 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.426 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 58.00 MB 2023-07-09T02:15:24.427 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.427 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.427 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 59.00 MB 2023-07-09T02:15:24.427 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.427 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.427 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 60.00 MB 2023-07-09T02:15:24.427 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.427 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 61.00 MB 2023-07-09T02:15:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 62.00 MB 2023-07-09T02:15:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 63.00 MB 2023-07-09T02:15:24.429 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.429 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.429 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 64.00 MB 2023-07-09T02:15:24.429 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.429 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.429 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 65.00 MB 2023-07-09T02:15:24.429 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.430 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.430 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 66.00 MB 2023-07-09T02:15:24.430 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.430 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.430 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 67.00 MB 2023-07-09T02:15:24.431 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.431 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.431 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 68.00 MB 2023-07-09T02:15:24.431 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.432 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.432 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 69.00 MB 2023-07-09T02:15:24.432 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.433 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.433 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 70.00 MB 2023-07-09T02:15:24.433 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.433 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.434 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 71.00 MB 2023-07-09T02:15:24.434 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.434 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.434 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 72.00 MB 2023-07-09T02:15:24.435 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.435 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.435 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 73.00 MB 2023-07-09T02:15:24.435 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.436 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.436 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 74.00 MB 2023-07-09T02:15:24.436 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.437 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.437 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 75.00 MB 2023-07-09T02:15:24.437 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.437 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.437 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 76.00 MB 2023-07-09T02:15:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 77.00 MB 2023-07-09T02:15:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 78.00 MB 2023-07-09T02:15:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.439 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 79.00 MB 2023-07-09T02:15:24.439 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.439 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.439 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 80.00 MB 2023-07-09T02:15:24.923 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.924 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.924 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 81.00 MB 2023-07-09T02:15:24.925 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.925 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.925 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 82.00 MB 2023-07-09T02:15:24.925 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.926 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.926 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 83.00 MB 2023-07-09T02:15:24.926 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.926 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.926 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 84.00 MB 2023-07-09T02:15:24.926 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.927 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.927 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 85.00 MB 2023-07-09T02:15:24.927 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.927 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.927 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 86.00 MB 2023-07-09T02:15:24.928 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.928 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.928 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 87.00 MB 2023-07-09T02:15:24.928 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.928 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.928 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 88.00 MB 2023-07-09T02:15:24.929 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.929 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.929 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 89.00 MB 2023-07-09T02:15:24.929 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.929 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.929 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 90.00 MB 2023-07-09T02:15:24.930 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.930 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.930 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 91.00 MB 2023-07-09T02:15:24.930 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.931 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.931 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 92.00 MB 2023-07-09T02:15:24.931 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.931 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.931 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 93.00 MB 2023-07-09T02:15:24.931 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.932 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.932 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 94.00 MB 2023-07-09T02:15:24.932 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.932 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.932 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 95.00 MB 2023-07-09T02:15:24.932 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.933 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.933 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 96.00 MB 2023-07-09T02:15:24.933 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.933 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.933 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 97.00 MB 2023-07-09T02:15:24.933 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.934 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.934 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 98.00 MB 2023-07-09T02:15:24.934 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.934 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.934 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 99.00 MB 2023-07-09T02:15:24.935 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.935 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.935 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 100.00 MB 2023-07-09T02:15:24.935 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.935 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.936 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 101.00 MB 2023-07-09T02:15:24.936 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.936 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.936 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 102.00 MB 2023-07-09T02:15:24.937 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.937 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.937 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 103.00 MB 2023-07-09T02:15:24.937 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.937 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.937 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 104.00 MB 2023-07-09T02:15:24.938 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.938 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.938 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 105.00 MB 2023-07-09T02:15:24.938 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.938 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.938 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 106.00 MB 2023-07-09T02:15:24.938 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.939 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.939 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 107.00 MB 2023-07-09T02:15:24.939 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.939 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.939 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 108.00 MB 2023-07-09T02:15:24.940 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.940 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.940 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 109.00 MB 2023-07-09T02:15:24.940 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.940 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.941 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 110.00 MB 2023-07-09T02:15:24.941 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.941 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.941 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 111.00 MB 2023-07-09T02:15:24.941 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.942 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.942 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 112.00 MB 2023-07-09T02:15:24.942 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.942 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.942 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 113.00 MB 2023-07-09T02:15:24.942 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.943 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.943 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 114.00 MB 2023-07-09T02:15:24.943 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.943 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.943 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 115.00 MB 2023-07-09T02:15:24.943 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.943 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 116.00 MB 2023-07-09T02:15:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 117.00 MB 2023-07-09T02:15:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.944 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 118.00 MB 2023-07-09T02:15:24.945 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.945 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.945 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 119.00 MB 2023-07-09T02:15:24.945 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.945 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.945 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 120.00 MB 2023-07-09T02:15:24.945 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.946 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.946 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 121.00 MB 2023-07-09T02:15:24.946 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.946 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.946 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 122.00 MB 2023-07-09T02:15:24.946 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.946 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.947 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 123.00 MB 2023-07-09T02:15:24.947 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.947 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.947 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 124.00 MB 2023-07-09T02:15:24.947 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.948 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.948 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 125.00 MB 2023-07-09T02:15:24.948 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.948 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.948 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 126.00 MB 2023-07-09T02:15:24.948 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.949 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.949 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 127.00 MB 2023-07-09T02:15:24.949 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.949 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.949 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 128.00 MB 2023-07-09T02:15:24.949 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.949 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.950 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 129.00 MB 2023-07-09T02:15:24.950 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.950 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.950 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 130.00 MB 2023-07-09T02:15:24.950 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.950 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.950 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 131.00 MB 2023-07-09T02:15:24.951 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.951 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.951 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 132.00 MB 2023-07-09T02:15:24.951 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.951 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.951 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 133.00 MB 2023-07-09T02:15:24.951 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.952 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.952 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 134.00 MB 2023-07-09T02:15:24.952 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.952 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.952 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 135.00 MB 2023-07-09T02:15:24.952 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.952 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.953 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 136.00 MB 2023-07-09T02:15:24.953 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.953 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.953 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 137.00 MB 2023-07-09T02:15:24.953 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.953 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.953 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 138.00 MB 2023-07-09T02:15:24.954 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.954 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.954 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 139.00 MB 2023-07-09T02:15:24.954 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.954 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.954 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 140.00 MB 2023-07-09T02:15:24.954 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.955 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.955 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 141.00 MB 2023-07-09T02:15:24.955 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.955 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.955 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 142.00 MB 2023-07-09T02:15:24.955 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.955 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.956 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 143.00 MB 2023-07-09T02:15:24.956 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.956 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.956 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 144.00 MB 2023-07-09T02:15:24.956 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.956 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.956 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 145.00 MB 2023-07-09T02:15:24.957 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.957 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.957 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 146.00 MB 2023-07-09T02:15:24.957 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.957 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.957 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 147.00 MB 2023-07-09T02:15:24.957 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.958 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.958 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 148.00 MB 2023-07-09T02:15:24.958 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.958 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.958 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 149.00 MB 2023-07-09T02:15:24.958 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.958 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.959 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 150.00 MB 2023-07-09T02:15:24.959 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.959 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.959 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 151.00 MB 2023-07-09T02:15:24.959 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.960 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.960 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 152.00 MB 2023-07-09T02:15:24.960 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.960 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.960 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 153.00 MB 2023-07-09T02:15:24.961 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.961 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.961 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 154.00 MB 2023-07-09T02:15:24.961 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.961 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.961 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 155.00 MB 2023-07-09T02:15:24.962 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.962 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.962 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 156.00 MB 2023-07-09T02:15:24.962 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.962 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.963 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 157.00 MB 2023-07-09T02:15:24.963 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.963 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.963 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 158.00 MB 2023-07-09T02:15:24.964 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.964 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.964 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 159.00 MB 2023-07-09T02:15:24.964 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:24.965 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:24.965 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 160.00 MB 2023-07-09T02:15:24.965 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.455 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.455 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 161.00 MB 2023-07-09T02:15:25.456 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.456 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.456 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 162.00 MB 2023-07-09T02:15:25.456 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 163.00 MB 2023-07-09T02:15:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 164.00 MB 2023-07-09T02:15:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 165.00 MB 2023-07-09T02:15:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 166.00 MB 2023-07-09T02:15:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.459 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 167.00 MB 2023-07-09T02:15:25.459 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.459 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.459 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 168.00 MB 2023-07-09T02:15:25.459 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.460 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.460 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 169.00 MB 2023-07-09T02:15:25.460 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.460 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.460 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 170.00 MB 2023-07-09T02:15:25.460 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.460 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.461 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 171.00 MB 2023-07-09T02:15:25.461 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.461 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.461 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 172.00 MB 2023-07-09T02:15:25.461 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.462 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.462 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 173.00 MB 2023-07-09T02:15:25.462 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.462 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.462 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 174.00 MB 2023-07-09T02:15:25.462 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.462 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.463 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 175.00 MB 2023-07-09T02:15:25.463 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.463 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.463 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 176.00 MB 2023-07-09T02:15:25.463 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.463 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.463 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 177.00 MB 2023-07-09T02:15:25.464 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.464 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.464 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 178.00 MB 2023-07-09T02:15:25.464 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.464 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.464 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 179.00 MB 2023-07-09T02:15:25.464 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.465 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.465 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 180.00 MB 2023-07-09T02:15:25.465 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.465 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.465 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 181.00 MB 2023-07-09T02:15:25.465 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.465 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.465 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 182.00 MB 2023-07-09T02:15:25.466 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.466 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.466 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 183.00 MB 2023-07-09T02:15:25.466 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.466 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.466 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 184.00 MB 2023-07-09T02:15:25.466 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.466 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.467 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 185.00 MB 2023-07-09T02:15:25.467 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.467 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.467 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 186.00 MB 2023-07-09T02:15:25.467 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.467 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.467 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 187.00 MB 2023-07-09T02:15:25.468 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.468 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.468 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 188.00 MB 2023-07-09T02:15:25.468 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.468 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.469 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 189.00 MB 2023-07-09T02:15:25.469 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.469 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.469 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 190.00 MB 2023-07-09T02:15:25.469 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.470 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.470 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 191.00 MB 2023-07-09T02:15:25.470 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.470 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.470 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 192.00 MB 2023-07-09T02:15:25.470 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.470 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.471 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 193.00 MB 2023-07-09T02:15:25.471 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.471 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.471 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 194.00 MB 2023-07-09T02:15:25.471 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.471 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.471 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 195.00 MB 2023-07-09T02:15:25.471 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.472 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.472 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 196.00 MB 2023-07-09T02:15:25.472 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.472 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.472 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 197.00 MB 2023-07-09T02:15:25.472 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.473 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.473 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 198.00 MB 2023-07-09T02:15:25.473 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.473 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.473 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 199.00 MB 2023-07-09T02:15:25.473 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.473 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.474 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 200.00 MB 2023-07-09T02:15:25.474 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.474 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.474 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 201.00 MB 2023-07-09T02:15:25.474 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.474 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.474 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 202.00 MB 2023-07-09T02:15:25.475 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.475 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.475 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 203.00 MB 2023-07-09T02:15:25.475 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.475 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.475 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 204.00 MB 2023-07-09T02:15:25.475 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.477 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.477 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 205.00 MB 2023-07-09T02:15:25.477 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.478 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.478 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 206.00 MB 2023-07-09T02:15:25.478 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.478 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.479 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 207.00 MB 2023-07-09T02:15:25.479 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.479 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.479 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 208.00 MB 2023-07-09T02:15:25.479 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.479 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.480 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 209.00 MB 2023-07-09T02:15:25.480 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.480 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.480 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 210.00 MB 2023-07-09T02:15:25.480 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.480 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.481 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 211.00 MB 2023-07-09T02:15:25.481 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.481 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.481 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 212.00 MB 2023-07-09T02:15:25.482 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.482 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.482 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 213.00 MB 2023-07-09T02:15:25.482 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.483 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.483 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 214.00 MB 2023-07-09T02:15:25.483 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.484 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.484 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 215.00 MB 2023-07-09T02:15:25.484 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.484 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.484 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 216.00 MB 2023-07-09T02:15:25.484 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.484 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.485 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 217.00 MB 2023-07-09T02:15:25.485 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.485 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.485 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 218.00 MB 2023-07-09T02:15:25.486 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.486 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.486 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 219.00 MB 2023-07-09T02:15:25.487 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.487 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.487 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 220.00 MB 2023-07-09T02:15:25.487 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.488 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.489 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 221.00 MB 2023-07-09T02:15:25.489 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.489 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.489 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 222.00 MB 2023-07-09T02:15:25.490 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.490 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.490 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 223.00 MB 2023-07-09T02:15:25.491 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.491 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.491 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 224.00 MB 2023-07-09T02:15:25.491 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 225.00 MB 2023-07-09T02:15:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 226.00 MB 2023-07-09T02:15:25.493 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.493 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.493 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 227.00 MB 2023-07-09T02:15:25.493 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.494 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.494 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 228.00 MB 2023-07-09T02:15:25.494 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.494 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.494 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 229.00 MB 2023-07-09T02:15:25.495 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.495 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.495 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 230.00 MB 2023-07-09T02:15:25.495 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.495 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.495 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 231.00 MB 2023-07-09T02:15:25.496 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.496 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.496 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 232.00 MB 2023-07-09T02:15:25.496 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.497 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.497 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 233.00 MB 2023-07-09T02:15:25.497 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.497 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.498 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 234.00 MB 2023-07-09T02:15:25.498 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.498 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 235.00 MB 2023-07-09T02:15:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 236.00 MB 2023-07-09T02:15:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.499 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 237.00 MB 2023-07-09T02:15:25.500 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.500 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.500 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 238.00 MB 2023-07-09T02:15:25.500 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.500 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.501 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 239.00 MB 2023-07-09T02:15:25.501 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.501 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.501 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 240.00 MB 2023-07-09T02:15:25.501 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.501 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.991 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 241.00 MB 2023-07-09T02:15:25.992 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.992 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.992 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 242.00 MB 2023-07-09T02:15:25.992 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.992 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.992 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 243.00 MB 2023-07-09T02:15:25.992 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.993 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.993 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 244.00 MB 2023-07-09T02:15:25.993 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.993 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.993 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 245.00 MB 2023-07-09T02:15:25.993 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.993 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.994 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 246.00 MB 2023-07-09T02:15:25.994 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.994 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.994 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 247.00 MB 2023-07-09T02:15:25.994 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.994 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.994 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 248.00 MB 2023-07-09T02:15:25.994 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.995 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.995 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 249.00 MB 2023-07-09T02:15:25.995 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.995 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.995 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 250.00 MB 2023-07-09T02:15:25.995 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.995 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.996 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 251.00 MB 2023-07-09T02:15:25.996 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.996 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.996 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 252.00 MB 2023-07-09T02:15:25.996 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.996 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.996 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 253.00 MB 2023-07-09T02:15:25.997 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.997 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.997 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 254.00 MB 2023-07-09T02:15:25.997 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.997 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.997 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 255.00 MB 2023-07-09T02:15:25.997 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.997 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.998 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 256.00 MB 2023-07-09T02:15:25.998 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.998 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.998 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 257.00 MB 2023-07-09T02:15:25.998 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.998 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.998 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 258.00 MB 2023-07-09T02:15:25.999 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.999 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.999 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 259.00 MB 2023-07-09T02:15:25.999 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.999 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:25.999 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 260.00 MB 2023-07-09T02:15:25.999 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:25.999 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.000 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 261.00 MB 2023-07-09T02:15:26.000 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.000 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.000 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 262.00 MB 2023-07-09T02:15:26.000 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.000 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.000 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 263.00 MB 2023-07-09T02:15:26.001 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.001 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.001 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 264.00 MB 2023-07-09T02:15:26.001 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.001 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.001 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 265.00 MB 2023-07-09T02:15:26.001 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.001 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.002 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 266.00 MB 2023-07-09T02:15:26.002 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.002 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.002 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 267.00 MB 2023-07-09T02:15:26.002 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.002 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.002 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 268.00 MB 2023-07-09T02:15:26.003 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.003 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.003 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 269.00 MB 2023-07-09T02:15:26.003 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.003 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.003 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 270.00 MB 2023-07-09T02:15:26.003 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.003 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.004 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 271.00 MB 2023-07-09T02:15:26.004 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.004 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.004 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 272.00 MB 2023-07-09T02:15:26.004 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.004 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.004 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 273.00 MB 2023-07-09T02:15:26.005 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.005 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.005 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 274.00 MB 2023-07-09T02:15:26.005 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.005 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.005 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 275.00 MB 2023-07-09T02:15:26.006 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.007 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.007 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 276.00 MB 2023-07-09T02:15:26.007 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.007 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.007 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 277.00 MB 2023-07-09T02:15:26.007 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.007 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.008 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 278.00 MB 2023-07-09T02:15:26.008 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.008 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.008 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 279.00 MB 2023-07-09T02:15:26.008 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.008 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.008 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 280.00 MB 2023-07-09T02:15:26.009 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.009 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.009 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 281.00 MB 2023-07-09T02:15:26.009 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.009 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.009 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 282.00 MB 2023-07-09T02:15:26.009 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.009 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.010 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 283.00 MB 2023-07-09T02:15:26.010 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.010 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.010 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 284.00 MB 2023-07-09T02:15:26.010 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.010 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.011 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 285.00 MB 2023-07-09T02:15:26.011 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.011 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.011 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 286.00 MB 2023-07-09T02:15:26.011 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.011 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.011 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 287.00 MB 2023-07-09T02:15:26.011 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.012 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.012 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 288.00 MB 2023-07-09T02:15:26.012 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.012 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.012 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 289.00 MB 2023-07-09T02:15:26.012 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.012 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.013 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 290.00 MB 2023-07-09T02:15:26.013 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.013 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.013 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 291.00 MB 2023-07-09T02:15:26.013 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.013 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.013 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 292.00 MB 2023-07-09T02:15:26.014 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.014 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.014 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 293.00 MB 2023-07-09T02:15:26.014 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.014 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.014 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 294.00 MB 2023-07-09T02:15:26.014 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.014 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 295.00 MB 2023-07-09T02:15:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 296.00 MB 2023-07-09T02:15:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 297.00 MB 2023-07-09T02:15:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.016 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.016 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 298.00 MB 2023-07-09T02:15:26.016 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.016 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.016 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 299.00 MB 2023-07-09T02:15:26.016 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.016 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 300.00 MB 2023-07-09T02:15:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 301.00 MB 2023-07-09T02:15:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 302.00 MB 2023-07-09T02:15:26.017 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.018 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.018 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 303.00 MB 2023-07-09T02:15:26.018 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.018 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.018 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 304.00 MB 2023-07-09T02:15:26.018 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.019 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.019 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 305.00 MB 2023-07-09T02:15:26.019 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.019 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.019 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 306.00 MB 2023-07-09T02:15:26.019 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.019 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.020 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 307.00 MB 2023-07-09T02:15:26.020 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.020 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.020 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 308.00 MB 2023-07-09T02:15:26.020 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.020 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.020 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 309.00 MB 2023-07-09T02:15:26.021 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.021 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.021 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 310.00 MB 2023-07-09T02:15:26.021 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.021 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.021 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 311.00 MB 2023-07-09T02:15:26.021 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.021 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.022 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 312.00 MB 2023-07-09T02:15:26.022 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.022 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.022 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 313.00 MB 2023-07-09T02:15:26.022 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.022 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.022 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 314.00 MB 2023-07-09T02:15:26.023 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.023 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.023 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 315.00 MB 2023-07-09T02:15:26.023 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.023 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.023 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 316.00 MB 2023-07-09T02:15:26.023 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.023 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.024 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 317.00 MB 2023-07-09T02:15:26.024 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.024 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.024 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 318.00 MB 2023-07-09T02:15:26.024 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.024 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.024 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 319.00 MB 2023-07-09T02:15:26.024 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.025 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.025 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 320.00 MB 2023-07-09T02:15:26.025 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.025 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.025 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 321.00 MB 2023-07-09T02:15:26.527 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.527 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.527 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 322.00 MB 2023-07-09T02:15:26.527 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.527 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.527 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 323.00 MB 2023-07-09T02:15:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 324.00 MB 2023-07-09T02:15:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 325.00 MB 2023-07-09T02:15:26.528 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 326.00 MB 2023-07-09T02:15:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 327.00 MB 2023-07-09T02:15:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.529 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 328.00 MB 2023-07-09T02:15:26.530 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.530 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.530 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 329.00 MB 2023-07-09T02:15:26.530 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.530 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.530 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 330.00 MB 2023-07-09T02:15:26.530 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.531 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.531 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 331.00 MB 2023-07-09T02:15:26.531 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.531 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.531 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 332.00 MB 2023-07-09T02:15:26.531 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.531 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.531 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 333.00 MB 2023-07-09T02:15:26.532 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.532 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.532 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 334.00 MB 2023-07-09T02:15:26.532 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.532 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.532 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 335.00 MB 2023-07-09T02:15:26.532 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.532 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 336.00 MB 2023-07-09T02:15:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 337.00 MB 2023-07-09T02:15:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 338.00 MB 2023-07-09T02:15:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.534 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.534 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 339.00 MB 2023-07-09T02:15:26.534 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.534 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.534 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 340.00 MB 2023-07-09T02:15:26.534 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.534 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.534 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 341.00 MB 2023-07-09T02:15:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 342.00 MB 2023-07-09T02:15:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 343.00 MB 2023-07-09T02:15:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.536 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 344.00 MB 2023-07-09T02:15:26.536 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.536 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.536 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 345.00 MB 2023-07-09T02:15:26.536 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.536 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.536 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 346.00 MB 2023-07-09T02:15:26.537 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.537 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.537 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 347.00 MB 2023-07-09T02:15:26.537 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.537 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.537 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 348.00 MB 2023-07-09T02:15:26.537 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.537 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.538 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 349.00 MB 2023-07-09T02:15:26.538 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.538 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.538 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 350.00 MB 2023-07-09T02:15:26.538 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.538 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.538 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 351.00 MB 2023-07-09T02:15:26.538 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.539 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.539 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 352.00 MB 2023-07-09T02:15:26.539 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.539 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.539 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 353.00 MB 2023-07-09T02:15:26.539 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.539 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.539 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 354.00 MB 2023-07-09T02:15:26.540 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.540 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.540 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 355.00 MB 2023-07-09T02:15:26.540 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.540 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.540 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 356.00 MB 2023-07-09T02:15:26.540 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.540 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.541 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 357.00 MB 2023-07-09T02:15:26.541 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.541 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.541 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 358.00 MB 2023-07-09T02:15:26.541 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.541 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.541 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 359.00 MB 2023-07-09T02:15:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 360.00 MB 2023-07-09T02:15:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 361.00 MB 2023-07-09T02:15:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.542 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.543 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 362.00 MB 2023-07-09T02:15:26.543 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.543 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.543 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 363.00 MB 2023-07-09T02:15:26.543 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.543 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.543 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 364.00 MB 2023-07-09T02:15:26.543 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.544 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.544 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 365.00 MB 2023-07-09T02:15:26.544 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.544 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.544 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 366.00 MB 2023-07-09T02:15:26.544 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.544 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.544 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 367.00 MB 2023-07-09T02:15:26.545 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.545 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.545 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 368.00 MB 2023-07-09T02:15:26.545 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.545 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.545 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 369.00 MB 2023-07-09T02:15:26.545 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.545 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 370.00 MB 2023-07-09T02:15:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 371.00 MB 2023-07-09T02:15:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 372.00 MB 2023-07-09T02:15:26.546 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.547 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.547 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 373.00 MB 2023-07-09T02:15:26.547 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.547 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.547 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 374.00 MB 2023-07-09T02:15:26.547 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.547 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 375.00 MB 2023-07-09T02:15:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 376.00 MB 2023-07-09T02:15:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 377.00 MB 2023-07-09T02:15:26.548 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 378.00 MB 2023-07-09T02:15:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 379.00 MB 2023-07-09T02:15:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 380.00 MB 2023-07-09T02:15:26.550 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.550 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.550 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 381.00 MB 2023-07-09T02:15:26.550 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.550 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.550 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 382.00 MB 2023-07-09T02:15:26.550 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.550 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.551 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 383.00 MB 2023-07-09T02:15:26.551 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.551 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.551 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 384.00 MB 2023-07-09T02:15:26.551 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.551 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.551 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 385.00 MB 2023-07-09T02:15:26.552 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.552 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.552 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 386.00 MB 2023-07-09T02:15:26.552 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.552 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.552 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 387.00 MB 2023-07-09T02:15:26.552 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.552 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 388.00 MB 2023-07-09T02:15:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 389.00 MB 2023-07-09T02:15:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 390.00 MB 2023-07-09T02:15:26.553 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.554 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.554 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 391.00 MB 2023-07-09T02:15:26.554 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.554 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.554 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 392.00 MB 2023-07-09T02:15:26.554 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.554 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.554 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 393.00 MB 2023-07-09T02:15:26.555 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.555 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.555 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 394.00 MB 2023-07-09T02:15:26.555 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.555 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.555 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 395.00 MB 2023-07-09T02:15:26.555 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.555 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.556 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 396.00 MB 2023-07-09T02:15:26.556 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.556 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.556 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 397.00 MB 2023-07-09T02:15:26.556 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.556 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.556 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 398.00 MB 2023-07-09T02:15:26.556 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 399.00 MB 2023-07-09T02:15:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 400.00 MB 2023-07-09T02:15:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:26.557 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:26.558 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 401.00 MB 2023-07-09T02:15:30.376 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:15:30.373+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-07-09T02:15:48.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:15:48.519 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:15:57.073 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.074 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.074 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 402.00 MB 2023-07-09T02:15:57.074 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.075 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.075 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 403.00 MB 2023-07-09T02:15:57.075 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.075 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.075 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 404.00 MB 2023-07-09T02:15:57.075 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.075 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.076 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 405.00 MB 2023-07-09T02:15:57.076 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.076 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.076 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 406.00 MB 2023-07-09T02:15:57.076 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.076 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.076 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 407.00 MB 2023-07-09T02:15:57.077 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.077 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.077 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 408.00 MB 2023-07-09T02:15:57.077 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.077 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.077 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 409.00 MB 2023-07-09T02:15:57.077 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.078 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.078 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 410.00 MB 2023-07-09T02:15:57.078 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.078 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.078 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 411.00 MB 2023-07-09T02:15:57.078 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.078 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.079 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 412.00 MB 2023-07-09T02:15:57.079 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.079 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.079 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 413.00 MB 2023-07-09T02:15:57.079 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.080 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.080 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 414.00 MB 2023-07-09T02:15:57.080 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.080 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.081 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 415.00 MB 2023-07-09T02:15:57.081 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.081 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.081 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 416.00 MB 2023-07-09T02:15:57.081 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.081 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.082 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 417.00 MB 2023-07-09T02:15:57.082 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.082 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.082 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 418.00 MB 2023-07-09T02:15:57.082 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.082 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.082 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 419.00 MB 2023-07-09T02:15:57.083 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.083 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.083 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 420.00 MB 2023-07-09T02:15:57.083 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.083 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.083 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 421.00 MB 2023-07-09T02:15:57.083 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.084 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.084 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 422.00 MB 2023-07-09T02:15:57.084 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.084 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.084 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 423.00 MB 2023-07-09T02:15:57.084 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.084 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.085 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 424.00 MB 2023-07-09T02:15:57.085 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.085 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.085 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 425.00 MB 2023-07-09T02:15:57.085 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.085 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.085 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 426.00 MB 2023-07-09T02:15:57.086 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.086 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.086 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 427.00 MB 2023-07-09T02:15:57.086 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.086 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.086 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 428.00 MB 2023-07-09T02:15:57.086 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.086 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.087 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 429.00 MB 2023-07-09T02:15:57.087 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.087 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.087 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 430.00 MB 2023-07-09T02:15:57.087 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.087 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.088 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 431.00 MB 2023-07-09T02:15:57.088 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.088 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.088 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 432.00 MB 2023-07-09T02:15:57.088 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.089 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.089 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 433.00 MB 2023-07-09T02:15:57.089 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.089 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.089 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 434.00 MB 2023-07-09T02:15:57.089 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.089 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.090 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 435.00 MB 2023-07-09T02:15:57.090 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.090 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.090 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 436.00 MB 2023-07-09T02:15:57.090 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.090 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.090 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 437.00 MB 2023-07-09T02:15:57.091 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.091 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.091 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 438.00 MB 2023-07-09T02:15:57.091 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.091 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.091 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 439.00 MB 2023-07-09T02:15:57.091 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.092 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.092 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 440.00 MB 2023-07-09T02:15:57.092 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.092 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.092 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 441.00 MB 2023-07-09T02:15:57.092 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.093 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.093 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 442.00 MB 2023-07-09T02:15:57.093 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.093 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.093 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 443.00 MB 2023-07-09T02:15:57.093 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.093 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.094 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 444.00 MB 2023-07-09T02:15:57.094 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.094 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.094 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 445.00 MB 2023-07-09T02:15:57.094 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.095 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.095 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 446.00 MB 2023-07-09T02:15:57.095 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.095 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.095 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 447.00 MB 2023-07-09T02:15:57.095 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.095 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.096 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 448.00 MB 2023-07-09T02:15:57.096 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.096 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.096 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 449.00 MB 2023-07-09T02:15:57.096 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.096 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.097 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 450.00 MB 2023-07-09T02:15:57.097 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.097 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.097 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 451.00 MB 2023-07-09T02:15:57.097 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.097 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.097 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 452.00 MB 2023-07-09T02:15:57.098 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.098 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.098 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 453.00 MB 2023-07-09T02:15:57.098 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.098 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.098 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 454.00 MB 2023-07-09T02:15:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 455.00 MB 2023-07-09T02:15:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 456.00 MB 2023-07-09T02:15:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.100 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.100 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 457.00 MB 2023-07-09T02:15:57.100 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.100 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.100 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 458.00 MB 2023-07-09T02:15:57.100 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.100 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.101 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 459.00 MB 2023-07-09T02:15:57.101 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.101 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.101 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 460.00 MB 2023-07-09T02:15:57.101 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.101 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.101 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 461.00 MB 2023-07-09T02:15:57.102 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.102 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.102 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 462.00 MB 2023-07-09T02:15:57.102 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.102 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.102 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 463.00 MB 2023-07-09T02:15:57.103 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.103 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.103 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 464.00 MB 2023-07-09T02:15:57.103 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.103 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.103 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 465.00 MB 2023-07-09T02:15:57.103 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.104 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.104 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 466.00 MB 2023-07-09T02:15:57.104 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.104 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.104 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 467.00 MB 2023-07-09T02:15:57.104 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.104 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.105 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 468.00 MB 2023-07-09T02:15:57.105 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.105 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.105 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 469.00 MB 2023-07-09T02:15:57.105 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.106 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.106 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 470.00 MB 2023-07-09T02:15:57.106 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.106 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.106 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 471.00 MB 2023-07-09T02:15:57.106 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.106 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.107 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 472.00 MB 2023-07-09T02:15:57.107 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.107 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.107 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 473.00 MB 2023-07-09T02:15:57.107 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.107 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.107 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 474.00 MB 2023-07-09T02:15:57.108 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.108 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.108 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 475.00 MB 2023-07-09T02:15:57.108 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.108 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.108 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 476.00 MB 2023-07-09T02:15:57.108 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.109 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.109 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 477.00 MB 2023-07-09T02:15:57.109 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.109 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.109 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 478.00 MB 2023-07-09T02:15:57.110 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.110 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.110 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 479.00 MB 2023-07-09T02:15:57.110 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:15:57.111 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:15:57.111 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:15:57.111 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 480.00 MB 2023-07-09T02:15:57.112 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:15:57.154 INFO:teuthology.orchestra.run.smithi045.stdout:Reached fullness after 480.00 MB 2023-07-09T02:15:57.155 INFO:teuthology.orchestra.run.smithi045.stdout:calling close 2023-07-09T02:15:57.155 INFO:teuthology.orchestra.run.smithi045.stdout:close() did not raise error 2023-07-09T02:15:57.198 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:15:57.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:15:57.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:15:57.307 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:15:57.308 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:15:57.308 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:57.317 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:15:57.318 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:57.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:15:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.557+0000 7f12de53a640 1 Processor -- start 2023-07-09T02:15:57.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.557+0000 7f12de53a640 1 -- start start 2023-07-09T02:15:57.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.557+0000 7f12de53a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12d80ca0f0 0x7f12d80cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.557+0000 7f12de53a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d815db00 0x7f12d815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.557+0000 7f12de53a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d806bf30 con 0x7f12d80cbbb0 2023-07-09T02:15:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.557+0000 7f12de53a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d815e4c0 con 0x7f12d80ca0f0 2023-07-09T02:15:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.557+0000 7f12de53a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d806bc50 con 0x7f12d815db00 2023-07-09T02:15:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12d80ca0f0 0x7f12d80cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f12d80cbbb0 0x7f12d80c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51146/0 (socket says 172.21.15.45:51146) 2023-07-09T02:15:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d77fe640 1 -- 172.21.15.45:0/2747465628 learned_addr learned my addr 172.21.15.45:0/2747465628 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12dcad7640 1 --2- 172.21.15.45:0/2747465628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d815db00 0x7f12d815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d7fff640 1 -- 172.21.15.45:0/2747465628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d815db00 msgr2=0x7f12d815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d7fff640 1 --2- 172.21.15.45:0/2747465628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d815db00 0x7f12d815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d7fff640 1 -- 172.21.15.45:0/2747465628 >> v1:172.21.15.45:6789/0 conn(0x7f12d80cbbb0 legacy=0x7f12d80c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d6ffd640 1 -- 172.21.15.45:0/2747465628 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935855959 0 0) 0x7f12d806bf30 con 0x7f12d80cbbb0 2023-07-09T02:15:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d7fff640 1 -- 172.21.15.45:0/2747465628 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d80cab90 con 0x7f12d80ca0f0 2023-07-09T02:15:57.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d7fff640 1 --2- 172.21.15.45:0/2747465628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80ca0f0 0x7f12d80cb670 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f12c80097c0 tx=0x7f12c801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15815abe68d40e47 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d6ffd640 1 -- 172.21.15.45:0/2747465628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80ab600 con 0x7f12d80ca0f0 2023-07-09T02:15:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d6ffd640 1 -- 172.21.15.45:0/2747465628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c80a7050 con 0x7f12d80ca0f0 2023-07-09T02:15:57.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.561+0000 7f12d6ffd640 1 -- 172.21.15.45:0/2747465628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80ab980 con 0x7f12d80ca0f0 2023-07-09T02:15:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- 172.21.15.45:0/2747465628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80ca0f0 msgr2=0x7f12d80cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 --2- 172.21.15.45:0/2747465628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80ca0f0 0x7f12d80cb670 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f12c80097c0 tx=0x7f12c801c3f0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- 172.21.15.45:0/2747465628 shutdown_connections 2023-07-09T02:15:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 --2- 172.21.15.45:0/2747465628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d815db00 0x7f12d815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 --2- 172.21.15.45:0/2747465628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80ca0f0 0x7f12d80cb670 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- 172.21.15.45:0/2747465628 >> 172.21.15.45:0/2747465628 conn(0x7f12d80694b0 msgr2=0x7f12d80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- 172.21.15.45:0/2747465628 shutdown_connections 2023-07-09T02:15:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- 172.21.15.45:0/2747465628 wait complete. 2023-07-09T02:15:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 Processor -- start 2023-07-09T02:15:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- start start 2023-07-09T02:15:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d80ca0f0 0x7f12d80b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80cbbb0 0x7f12d8153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d815db00 0x7f12d80b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80b2020 con 0x7f12d815db00 2023-07-09T02:15:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80b2300 con 0x7f12d80ca0f0 2023-07-09T02:15:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12de53a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80b25e0 con 0x7f12d80cbbb0 2023-07-09T02:15:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12dcad7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d815db00 0x7f12d80b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12dcad7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d815db00 0x7f12d80b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55882/0 (socket says 172.21.15.45:55882) 2023-07-09T02:15:57.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12dcad7640 1 -- 172.21.15.45:0/4161099348 learned_addr learned my addr 172.21.15.45:0/4161099348 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:57.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.565+0000 7f12d7fff640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d80ca0f0 0x7f12d80b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d77fe640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80cbbb0 0x7f12d8153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12dcad7640 1 -- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80cbbb0 msgr2=0x7f12d8153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12dcad7640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80cbbb0 0x7f12d8153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12dcad7640 1 -- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d80ca0f0 msgr2=0x7f12d80b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12dcad7640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d80ca0f0 0x7f12d80b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12dcad7640 1 -- 172.21.15.45:0/4161099348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8009420 con 0x7f12d815db00 2023-07-09T02:15:57.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d77fe640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80cbbb0 0x7f12d8153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:57.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12dcad7640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d815db00 0x7f12d80b15d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007e60 tx=0x7f12d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:57.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d4ff9640 1 -- 172.21.15.45:0/4161099348 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0014420 con 0x7f12d815db00 2023-07-09T02:15:57.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d4ff9640 1 -- 172.21.15.45:0/4161099348 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d00145a0 con 0x7f12d815db00 2023-07-09T02:15:57.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d4ff9640 1 -- 172.21.15.45:0/4161099348 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0014950 con 0x7f12d815db00 2023-07-09T02:15:57.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d80b28c0 con 0x7f12d815db00 2023-07-09T02:15:57.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d814f5b0 con 0x7f12d815db00 2023-07-09T02:15:57.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d804d7d0 con 0x7f12d815db00 2023-07-09T02:15:57.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d4ff9640 1 -- 172.21.15.45:0/4161099348 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12d0014ab0 con 0x7f12d815db00 2023-07-09T02:15:57.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d4ff9640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12c4066280 0x7f12c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d4ff9640 1 -- 172.21.15.45:0/4161099348 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12d00846f0 con 0x7f12d815db00 2023-07-09T02:15:57.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.569+0000 7f12d4ff9640 1 -- 172.21.15.45:0/4161099348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7f12c406e3c0 con 0x7f12d815db00 2023-07-09T02:15:57.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.573+0000 7f12d7fff640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12c4066280 0x7f12c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.573+0000 7f12d7fff640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12c4066280 0x7f12c4068730 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f12c80ad000 tx=0x7f12c80a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:57.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.573+0000 7f12d4ff9640 1 -- 172.21.15.45:0/4161099348 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12d0055560 con 0x7f12d815db00 2023-07-09T02:15:57.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.733+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12d8164c70 con 0x7f12d815db00 2023-07-09T02:15:57.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.733+0000 7f12d4ff9640 1 -- 172.21.15.45:0/4161099348 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+18418 (secure 0 0 0) 0x7f12d00550f0 con 0x7f12d815db00 2023-07-09T02:15:57.735 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:57.736 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:15:31.380843+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:15:12.532657+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T02:15:12.972198+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["backfillfull","exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:15:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12c4066280 msgr2=0x7f12c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12c4066280 0x7f12c4068730 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f12c80ad000 tx=0x7f12c80a4f90 comp rx=0 tx=0).stop 2023-07-09T02:15:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d815db00 msgr2=0x7f12d80b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d815db00 0x7f12d80b15d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007e60 tx=0x7f12d000e4b0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 shutdown_connections 2023-07-09T02:15:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d815db00 0x7f12d80b15d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12c4066280 0x7f12c4068730 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80cbbb0 0x7f12d8153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 --2- 172.21.15.45:0/4161099348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d80ca0f0 0x7f12d80b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 >> 172.21.15.45:0/4161099348 conn(0x7f12d80694b0 msgr2=0x7f12d814fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 shutdown_connections 2023-07-09T02:15:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.737+0000 7f12de53a640 1 -- 172.21.15.45:0/4161099348 wait complete. 2023-07-09T02:15:57.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:15:12.532657+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:15:12.972198+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:15:57.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:15:57.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.901+0000 7f7f670d8640 1 Processor -- start 2023-07-09T02:15:57.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.901+0000 7f7f670d8640 1 -- start start 2023-07-09T02:15:57.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f670d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f670d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7f600cd120 0x7f7f600d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f670d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7f600d2450 0x7f7f600d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f670d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f600d28f0 con 0x7f7f600cd120 2023-07-09T02:15:57.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f670d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f60160a50 con 0x7f7f600d2450 2023-07-09T02:15:57.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f670d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6015c430 con 0x7f7f6015c060 2023-07-09T02:15:57.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f5ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7f600cd120 0x7f7f600d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f5ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7f600cd120 0x7f7f600d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55898/0 (socket says 172.21.15.45:55898) 2023-07-09T02:15:57.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f5ffff640 1 -- 172.21.15.45:0/4020812202 learned_addr learned my addr 172.21.15.45:0/4020812202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:57.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f64e74640 1 --2- 172.21.15.45:0/4020812202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f65675640 1 --2- 172.21.15.45:0/4020812202 >> v2:172.21.15.155:3300/0 conn(0x7f7f600d2450 0x7f7f600d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f5ffff640 1 -- 172.21.15.45:0/4020812202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 msgr2=0x7f7f600b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:57.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f5ffff640 1 --2- 172.21.15.45:0/4020812202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f600b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f5ffff640 1 -- 172.21.15.45:0/4020812202 >> v2:172.21.15.155:3300/0 conn(0x7f7f600d2450 msgr2=0x7f7f600d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:57.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f5ffff640 1 --2- 172.21.15.45:0/4020812202 >> v2:172.21.15.155:3300/0 conn(0x7f7f600d2450 0x7f7f600d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.905+0000 7f7f5ffff640 1 -- 172.21.15.45:0/4020812202 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6015fb60 con 0x7f7f600cd120 2023-07-09T02:15:57.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f5ffff640 1 --2- 172.21.15.45:0/4020812202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f600d1f10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7f6006b120 tx=0x7f7f4c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddac05251a89f48 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:57.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f5f7fe640 1 -- 172.21.15.45:0/4020812202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0ab600 con 0x7f7f600cd120 2023-07-09T02:15:57.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f5f7fe640 1 -- 172.21.15.45:0/4020812202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0a7050 con 0x7f7f600cd120 2023-07-09T02:15:57.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f5f7fe640 1 -- 172.21.15.45:0/4020812202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0ab980 con 0x7f7f600cd120 2023-07-09T02:15:57.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 -- 172.21.15.45:0/4020812202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 msgr2=0x7f7f600d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 --2- 172.21.15.45:0/4020812202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f600d1f10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7f6006b120 tx=0x7f7f4c01c210 comp rx=0 tx=0).stop 2023-07-09T02:15:57.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 -- 172.21.15.45:0/4020812202 shutdown_connections 2023-07-09T02:15:57.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 --2- 172.21.15.45:0/4020812202 >> v2:172.21.15.155:3300/0 conn(0x7f7f600d2450 0x7f7f600d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 --2- 172.21.15.45:0/4020812202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f600d1f10 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 --2- 172.21.15.45:0/4020812202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 -- 172.21.15.45:0/4020812202 >> 172.21.15.45:0/4020812202 conn(0x7f7f600698e0 msgr2=0x7f7f60069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:57.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 -- 172.21.15.45:0/4020812202 shutdown_connections 2023-07-09T02:15:57.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 -- 172.21.15.45:0/4020812202 wait complete. 2023-07-09T02:15:57.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 Processor -- start 2023-07-09T02:15:57.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.909+0000 7f7f670d8640 1 -- start start 2023-07-09T02:15:57.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f60156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600d2450 0x7f7f601539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f60153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60156920 con 0x7f7f600cd120 2023-07-09T02:15:57.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60156c00 con 0x7f7f600d2450 2023-07-09T02:15:57.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f60156ee0 con 0x7f7f6015c060 2023-07-09T02:15:57.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f60156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f60156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55900/0 (socket says 172.21.15.45:55900) 2023-07-09T02:15:57.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 -- 172.21.15.45:0/667152646 learned_addr learned my addr 172.21.15.45:0/667152646 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:57.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f5ffff640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600d2450 0x7f7f601539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f65675640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f60153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 -- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 msgr2=0x7f7f60153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f60153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 -- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600d2450 msgr2=0x7f7f601539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:57.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600d2450 0x7f7f601539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:57.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 -- 172.21.15.45:0/667152646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c0094d0 con 0x7f7f600cd120 2023-07-09T02:15:57.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f65675640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f60153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:57.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f64e74640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f60156270 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400e870 tx=0x7f7f5400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:57.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f5d7fa640 1 -- 172.21.15.45:0/667152646 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54009510 con 0x7f7f600cd120 2023-07-09T02:15:57.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f5d7fa640 1 -- 172.21.15.45:0/667152646 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5400eec0 con 0x7f7f600cd120 2023-07-09T02:15:57.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f601571c0 con 0x7f7f600cd120 2023-07-09T02:15:57.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f5d7fa640 1 -- 172.21.15.45:0/667152646 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400cb40 con 0x7f7f600cd120 2023-07-09T02:15:57.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f60154be0 con 0x7f7f600cd120 2023-07-09T02:15:57.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6004d7d0 con 0x7f7f600cd120 2023-07-09T02:15:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.913+0000 7f7f5d7fa640 1 -- 172.21.15.45:0/667152646 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f5400cca0 con 0x7f7f600cd120 2023-07-09T02:15:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.917+0000 7f7f5d7fa640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f440662b0 0x7f7f44068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.917+0000 7f7f5d7fa640 1 -- 172.21.15.45:0/667152646 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f54083d50 con 0x7f7f600cd120 2023-07-09T02:15:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.917+0000 7f7f5d7fa640 1 -- 172.21.15.45:0/667152646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7f7f4406e3f0 con 0x7f7f600cd120 2023-07-09T02:15:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.917+0000 7f7f5ffff640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f440662b0 0x7f7f44068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.917+0000 7f7f5ffff640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f440662b0 0x7f7f44068760 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0ad000 tx=0x7f7f4c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:57.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:57.921+0000 7f7f5d7fa640 1 -- 172.21.15.45:0/667152646 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f54017060 con 0x7f7f600cd120 2023-07-09T02:15:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.073+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f6006baa0 con 0x7f7f600cd120 2023-07-09T02:15:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.073+0000 7f7f5d7fa640 1 -- 172.21.15.45:0/667152646 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f54021070 con 0x7f7f600cd120 2023-07-09T02:15:58.075 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:15:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f440662b0 msgr2=0x7f7f44068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f440662b0 0x7f7f44068760 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0ad000 tx=0x7f7f4c0a6000 comp rx=0 tx=0).stop 2023-07-09T02:15:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 msgr2=0x7f7f60156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f60156270 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400e870 tx=0x7f7f5400ec70 comp rx=0 tx=0).stop 2023-07-09T02:15:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 shutdown_connections 2023-07-09T02:15:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f440662b0 0x7f7f44068760 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6015c060 0x7f7f60153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600d2450 0x7f7f601539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 --2- 172.21.15.45:0/667152646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f600cd120 0x7f7f60156270 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 >> 172.21.15.45:0/667152646 conn(0x7f7f600698e0 msgr2=0x7f7f600cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:58.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 shutdown_connections 2023-07-09T02:15:58.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.077+0000 7f7f670d8640 1 -- 172.21.15.45:0/667152646 wait complete. 2023-07-09T02:15:58.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:15:58.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f0211d11640 1 Processor -- start 2023-07-09T02:15:58.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f0211d11640 1 -- start start 2023-07-09T02:15:58.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f0211d11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0d2620 0x7f020c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f0211d11640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c160a50 con 0x7f020c0cd120 2023-07-09T02:15:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f0211d11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c15c430 con 0x7f020c15c060 2023-07-09T02:15:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f0211d11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c15fb60 con 0x7f020c0d2620 2023-07-09T02:15:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f020bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f020c0cd120 0x7f020c0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51152/0 (socket says 172.21.15.45:51152) 2023-07-09T02:15:58.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f020bfff640 1 -- 172.21.15.45:0/2612243692 learned_addr learned my addr 172.21.15.45:0/2612243692 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.241+0000 7f020affd640 1 --2- 172.21.15.45:0/2612243692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0d2620 0x7f020c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020a7fc640 1 -- 172.21.15.45:0/2612243692 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852399499 0 0) 0x7f020c160a50 con 0x7f020c0cd120 2023-07-09T02:15:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020a7fc640 1 -- 172.21.15.45:0/2612243692 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f4003530 con 0x7f020c0cd120 2023-07-09T02:15:58.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020a7fc640 1 -- 172.21.15.45:0/2612243692 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324999438 0 0) 0x7f020c15c430 con 0x7f020c15c060 2023-07-09T02:15:58.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020affd640 1 -- 172.21.15.45:0/2612243692 >> v1:172.21.15.155:6789/0 conn(0x7f020c15c060 legacy=0x7f020c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020affd640 1 -- 172.21.15.45:0/2612243692 >> v1:172.21.15.45:6789/0 conn(0x7f020c0cd120 legacy=0x7f020c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020affd640 1 -- 172.21.15.45:0/2612243692 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c15fe40 con 0x7f020c0d2620 2023-07-09T02:15:58.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020affd640 1 --2- 172.21.15.45:0/2612243692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0d2620 0x7f020c0b4ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02000097f0 tx=0x7f020001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5dc7ea1468cbb74 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020a7fc640 1 -- 172.21.15.45:0/2612243692 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02000aa5f0 con 0x7f020c0d2620 2023-07-09T02:15:58.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020a7fc640 1 -- 172.21.15.45:0/2612243692 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02000aa750 con 0x7f020c0d2620 2023-07-09T02:15:58.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f020a7fc640 1 -- 172.21.15.45:0/2612243692 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02000aaae0 con 0x7f020c0d2620 2023-07-09T02:15:58.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f0211d11640 1 -- 172.21.15.45:0/2612243692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0d2620 msgr2=0x7f020c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.245+0000 7f0211d11640 1 --2- 172.21.15.45:0/2612243692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0d2620 0x7f020c0b4ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02000097f0 tx=0x7f020001c490 comp rx=0 tx=0).stop 2023-07-09T02:15:58.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 -- 172.21.15.45:0/2612243692 shutdown_connections 2023-07-09T02:15:58.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 --2- 172.21.15.45:0/2612243692 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0d2620 0x7f020c0b4ed0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 -- 172.21.15.45:0/2612243692 >> 172.21.15.45:0/2612243692 conn(0x7f020c0698e0 msgr2=0x7f020c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:58.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 -- 172.21.15.45:0/2612243692 shutdown_connections 2023-07-09T02:15:58.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 -- 172.21.15.45:0/2612243692 wait complete. 2023-07-09T02:15:58.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 Processor -- start 2023-07-09T02:15:58.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 -- start start 2023-07-09T02:15:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0cd120 0x7f020c151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c0d2620 0x7f020c14f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c15c060 0x7f020c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0cb660 con 0x7f020c15c060 2023-07-09T02:15:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c14f680 con 0x7f020c0d2620 2023-07-09T02:15:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f0211d11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c153d70 con 0x7f020c0cd120 2023-07-09T02:15:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c15c060 0x7f020c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c15c060 0x7f020c155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55916/0 (socket says 172.21.15.45:55916) 2023-07-09T02:15:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020bfff640 1 -- 172.21.15.45:0/2698025205 learned_addr learned my addr 172.21.15.45:0/2698025205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020affd640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c0d2620 0x7f020c14f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020b7fe640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0cd120 0x7f020c151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020bfff640 1 -- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0cd120 msgr2=0x7f020c151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020bfff640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0cd120 0x7f020c151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020bfff640 1 -- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c0d2620 msgr2=0x7f020c14f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020bfff640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c0d2620 0x7f020c14f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020bfff640 1 -- 172.21.15.45:0/2698025205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200009420 con 0x7f020c15c060 2023-07-09T02:15:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020b7fe640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0cd120 0x7f020c151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:15:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.249+0000 7f020affd640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c0d2620 0x7f020c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f020bfff640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c15c060 0x7f020c155270 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f020400cb40 tx=0x7f020400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f01f3fff640 1 -- 172.21.15.45:0/2698025205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400aca0 con 0x7f020c15c060 2023-07-09T02:15:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f01f3fff640 1 -- 172.21.15.45:0/2698025205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020400ae00 con 0x7f020c15c060 2023-07-09T02:15:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f01f3fff640 1 -- 172.21.15.45:0/2698025205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204012620 con 0x7f020c15c060 2023-07-09T02:15:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c0b59f0 con 0x7f020c15c060 2023-07-09T02:15:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c0cbb50 con 0x7f020c15c060 2023-07-09T02:15:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c04d7d0 con 0x7f020c15c060 2023-07-09T02:15:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f01f3fff640 1 -- 172.21.15.45:0/2698025205 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0204007070 con 0x7f020c15c060 2023-07-09T02:15:58.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f01f3fff640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f8066280 0x7f01f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f01f3fff640 1 -- 172.21.15.45:0/2698025205 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0204083e40 con 0x7f020c15c060 2023-07-09T02:15:58.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f01f3fff640 1 -- 172.21.15.45:0/2698025205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7f01f806e3c0 con 0x7f020c15c060 2023-07-09T02:15:58.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.253+0000 7f020b7fe640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f8066280 0x7f01f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.257+0000 7f020b7fe640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f8066280 0x7f01f8068730 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f01fc000f70 tx=0x7f01fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.257+0000 7f01f3fff640 1 -- 172.21.15.45:0/2698025205 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0204017060 con 0x7f020c15c060 2023-07-09T02:15:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.409+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f020c06baa0 con 0x7f020c15c060 2023-07-09T02:15:58.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f01f3fff640 1 -- 172.21.15.45:0/2698025205 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0204051220 con 0x7f020c15c060 2023-07-09T02:15:58.412 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:15:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f8066280 msgr2=0x7f01f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f8066280 0x7f01f8068730 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f01fc000f70 tx=0x7f01fc009040 comp rx=0 tx=0).stop 2023-07-09T02:15:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c15c060 msgr2=0x7f020c155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c15c060 0x7f020c155270 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f020400cb40 tx=0x7f020400a060 comp rx=0 tx=0).stop 2023-07-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 shutdown_connections 2023-07-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f020c15c060 0x7f020c155270 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020c0d2620 0x7f020c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f8066280 0x7f01f8068730 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 --2- 172.21.15.45:0/2698025205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f020c0cd120 0x7f020c151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 >> 172.21.15.45:0/2698025205 conn(0x7f020c0698e0 msgr2=0x7f020c0b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 shutdown_connections 2023-07-09T02:15:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.413+0000 7f0211d11640 1 -- 172.21.15.45:0/2698025205 wait complete. 2023-07-09T02:15:58.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:15:58.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.577+0000 7f9ba7e0b640 1 Processor -- start 2023-07-09T02:15:58.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba7e0b640 1 -- start start 2023-07-09T02:15:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba7e0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ba015c060 0x7f9ba00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba7e0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ba00cd120 0x7f9ba00d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba7e0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba00d2450 0x7f9ba00d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba7e0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba00d28f0 con 0x7f9ba00cd120 2023-07-09T02:15:58.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba7e0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba0160a50 con 0x7f9ba015c060 2023-07-09T02:15:58.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba7e0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba015c430 con 0x7f9ba00d2450 2023-07-09T02:15:58.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba53a6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ba00cd120 0x7f9ba00d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba53a6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ba00cd120 0x7f9ba00d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55926/0 (socket says 172.21.15.45:55926) 2023-07-09T02:15:58.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba53a6640 1 -- 172.21.15.45:0/687809265 learned_addr learned my addr 172.21.15.45:0/687809265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:58.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba63a8640 1 --2- 172.21.15.45:0/687809265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba00d2450 0x7f9ba00d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba5ba7640 1 --2- 172.21.15.45:0/687809265 >> v2:172.21.15.155:3300/0 conn(0x7f9ba015c060 0x7f9ba00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba53a6640 1 -- 172.21.15.45:0/687809265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba00d2450 msgr2=0x7f9ba00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba53a6640 1 --2- 172.21.15.45:0/687809265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba00d2450 0x7f9ba00d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba53a6640 1 -- 172.21.15.45:0/687809265 >> v2:172.21.15.155:3300/0 conn(0x7f9ba015c060 msgr2=0x7f9ba00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba53a6640 1 --2- 172.21.15.45:0/687809265 >> v2:172.21.15.155:3300/0 conn(0x7f9ba015c060 0x7f9ba00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba53a6640 1 -- 172.21.15.45:0/687809265 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba015fb60 con 0x7f9ba00cd120 2023-07-09T02:15:58.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.581+0000 7f9ba5ba7640 1 --2- 172.21.15.45:0/687809265 >> v2:172.21.15.155:3300/0 conn(0x7f9ba015c060 0x7f9ba00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:58.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba53a6640 1 --2- 172.21.15.45:0/687809265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00cd120 0x7f9ba00d1f10 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00d3ad0 tx=0x7f9b9001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb60d29b55c5d48e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba4ba5640 1 -- 172.21.15.45:0/687809265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900ab600 con 0x7f9ba00cd120 2023-07-09T02:15:58.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba4ba5640 1 -- 172.21.15.45:0/687809265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b900a7050 con 0x7f9ba00cd120 2023-07-09T02:15:58.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba4ba5640 1 -- 172.21.15.45:0/687809265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900ab980 con 0x7f9ba00cd120 2023-07-09T02:15:58.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/687809265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00cd120 msgr2=0x7f9ba00d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/687809265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00cd120 0x7f9ba00d1f10 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00d3ad0 tx=0x7f9b9001c210 comp rx=0 tx=0).stop 2023-07-09T02:15:58.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/687809265 shutdown_connections 2023-07-09T02:15:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/687809265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba00d2450 0x7f9ba00d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/687809265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00cd120 0x7f9ba00d1f10 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/687809265 >> v2:172.21.15.155:3300/0 conn(0x7f9ba015c060 0x7f9ba00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/687809265 >> 172.21.15.45:0/687809265 conn(0x7f9ba00698e0 msgr2=0x7f9ba0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/687809265 shutdown_connections 2023-07-09T02:15:58.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/687809265 wait complete. 2023-07-09T02:15:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 Processor -- start 2023-07-09T02:15:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.585+0000 7f9ba7e0b640 1 -- start start 2023-07-09T02:15:58.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba00cd120 0x7f9ba01f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00d2450 0x7f9ba00ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba015c060 0x7f9ba00cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0155e80 con 0x7f9ba00d2450 2023-07-09T02:15:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba01f4ca0 con 0x7f9ba00cd120 2023-07-09T02:15:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba01f4f80 con 0x7f9ba015c060 2023-07-09T02:15:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00d2450 0x7f9ba00ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00d2450 0x7f9ba00ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55930/0 (socket says 172.21.15.45:55930) 2023-07-09T02:15:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 -- 172.21.15.45:0/1670405868 learned_addr learned my addr 172.21.15.45:0/1670405868 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:58.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 -- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba015c060 msgr2=0x7f9ba00cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba015c060 0x7f9ba00cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 -- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba00cd120 msgr2=0x7f9ba01f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba00cd120 0x7f9ba01f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 -- 172.21.15.45:0/1670405868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900094d0 con 0x7f9ba00d2450 2023-07-09T02:15:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba53a6640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00d2450 0x7f9ba00ced30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9b900ae040 tx=0x7f9b90018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9b967fc640 1 -- 172.21.15.45:0/1670405868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900b4440 con 0x7f9ba00d2450 2023-07-09T02:15:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9b967fc640 1 -- 172.21.15.45:0/1670405868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b900b45a0 con 0x7f9ba00d2450 2023-07-09T02:15:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9b967fc640 1 -- 172.21.15.45:0/1670405868 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900b4930 con 0x7f9ba00d2450 2023-07-09T02:15:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba01f5260 con 0x7f9ba00d2450 2023-07-09T02:15:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba015d570 con 0x7f9ba00d2450 2023-07-09T02:15:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.589+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba0155ff0 con 0x7f9ba00d2450 2023-07-09T02:15:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.593+0000 7f9b967fc640 1 -- 172.21.15.45:0/1670405868 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b900b2070 con 0x7f9ba00d2450 2023-07-09T02:15:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.593+0000 7f9b967fc640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b840662b0 0x7f9b84068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.593+0000 7f9b967fc640 1 -- 172.21.15.45:0/1670405868 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b9011dbd0 con 0x7f9ba00d2450 2023-07-09T02:15:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.593+0000 7f9b967fc640 1 -- 172.21.15.45:0/1670405868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7f9b8406e3f0 con 0x7f9ba00d2450 2023-07-09T02:15:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.593+0000 7f9ba5ba7640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b840662b0 0x7f9b84068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.593+0000 7f9ba5ba7640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b840662b0 0x7f9b84068760 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c006f10 tx=0x7f9b9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.597+0000 7f9b967fc640 1 -- 172.21.15.45:0/1670405868 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b900eafb0 con 0x7f9ba00d2450 2023-07-09T02:15:58.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.749+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ba006baa0 con 0x7f9ba00d2450 2023-07-09T02:15:58.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.749+0000 7f9b967fc640 1 -- 172.21.15.45:0/1670405868 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b900ee5d0 con 0x7f9ba00d2450 2023-07-09T02:15:58.751 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:15:58.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b840662b0 msgr2=0x7f9b84068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b840662b0 0x7f9b84068760 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c006f10 tx=0x7f9b9c008040 comp rx=0 tx=0).stop 2023-07-09T02:15:58.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00d2450 msgr2=0x7f9ba00ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00d2450 0x7f9ba00ced30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9b900ae040 tx=0x7f9b90018fb0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 shutdown_connections 2023-07-09T02:15:58.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b840662b0 0x7f9b84068760 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ba015c060 0x7f9ba00cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ba00d2450 0x7f9ba00ced30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 --2- 172.21.15.45:0/1670405868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba00cd120 0x7f9ba01f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 >> 172.21.15.45:0/1670405868 conn(0x7f9ba00698e0 msgr2=0x7f9ba00b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:58.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 shutdown_connections 2023-07-09T02:15:58.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.753+0000 7f9ba7e0b640 1 -- 172.21.15.45:0/1670405868 wait complete. 2023-07-09T02:15:58.772 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:15:58.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc426d8640 1 Processor -- start 2023-07-09T02:15:58.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc426d8640 1 -- start start 2023-07-09T02:15:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc426d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c06b800 0x7fbc3c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc426d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbc3c0ac870 0x7fbc3c06c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc426d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc3c0694b0 0x7fbc3c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc426d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c06c110 con 0x7fbc3c0694b0 2023-07-09T02:15:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc426d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0acde0 con 0x7fbc3c0ac870 2023-07-09T02:15:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc426d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ad0c0 con 0x7fbc3c06b800 2023-07-09T02:15:58.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc40c75640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc3c0694b0 0x7fbc3c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc40c75640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc3c0694b0 0x7fbc3c0ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55942/0 (socket says 172.21.15.45:55942) 2023-07-09T02:15:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc40c75640 1 -- 172.21.15.45:0/1785347234 learned_addr learned my addr 172.21.15.45:0/1785347234 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc3b7fe640 1 --2- 172.21.15.45:0/1785347234 >> v2:172.21.15.155:3300/0 conn(0x7fbc3c0ac870 0x7fbc3c06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc3bfff640 1 --2- 172.21.15.45:0/1785347234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c06b800 0x7fbc3c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc40c75640 1 -- 172.21.15.45:0/1785347234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c06b800 msgr2=0x7fbc3c06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc40c75640 1 --2- 172.21.15.45:0/1785347234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c06b800 0x7fbc3c06bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc40c75640 1 -- 172.21.15.45:0/1785347234 >> v2:172.21.15.155:3300/0 conn(0x7fbc3c0ac870 msgr2=0x7fbc3c06c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc40c75640 1 --2- 172.21.15.45:0/1785347234 >> v2:172.21.15.155:3300/0 conn(0x7fbc3c0ac870 0x7fbc3c06c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc40c75640 1 -- 172.21.15.45:0/1785347234 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0ad3a0 con 0x7fbc3c0694b0 2023-07-09T02:15:58.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.917+0000 7fbc3b7fe640 1 --2- 172.21.15.45:0/1785347234 >> v2:172.21.15.155:3300/0 conn(0x7fbc3c0ac870 0x7fbc3c06c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc40c75640 1 --2- 172.21.15.45:0/1785347234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0694b0 0x7fbc3c0ce270 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c06f100 tx=0x7fbc3401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a0dabd306e9b87 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc3affd640 1 -- 172.21.15.45:0/1785347234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340a5820 con 0x7fbc3c0694b0 2023-07-09T02:15:58.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc3affd640 1 -- 172.21.15.45:0/1785347234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc340a5980 con 0x7fbc3c0694b0 2023-07-09T02:15:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc3affd640 1 -- 172.21.15.45:0/1785347234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340a5d10 con 0x7fbc3c0694b0 2023-07-09T02:15:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 -- 172.21.15.45:0/1785347234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0694b0 msgr2=0x7fbc3c0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 --2- 172.21.15.45:0/1785347234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0694b0 0x7fbc3c0ce270 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c06f100 tx=0x7fbc3401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 -- 172.21.15.45:0/1785347234 shutdown_connections 2023-07-09T02:15:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 --2- 172.21.15.45:0/1785347234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0694b0 0x7fbc3c0ce270 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 --2- 172.21.15.45:0/1785347234 >> v2:172.21.15.155:3300/0 conn(0x7fbc3c0ac870 0x7fbc3c06c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 --2- 172.21.15.45:0/1785347234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c06b800 0x7fbc3c06bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 -- 172.21.15.45:0/1785347234 >> 172.21.15.45:0/1785347234 conn(0x7fbc3c0cfb50 msgr2=0x7fbc3c0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:58.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 -- 172.21.15.45:0/1785347234 shutdown_connections 2023-07-09T02:15:58.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.921+0000 7fbc426d8640 1 -- 172.21.15.45:0/1785347234 wait complete. 2023-07-09T02:15:58.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 Processor -- start 2023-07-09T02:15:58.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 -- start start 2023-07-09T02:15:58.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c0694b0 0x7fbc3c1660d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc3c06b800 0x7fbc3c14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0ac870 0x7fbc3c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c150c90 con 0x7fbc3c0ac870 2023-07-09T02:15:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c14f4d0 con 0x7fbc3c06b800 2023-07-09T02:15:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c15b640 con 0x7fbc3c0694b0 2023-07-09T02:15:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0ac870 0x7fbc3c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0ac870 0x7fbc3c159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55944/0 (socket says 172.21.15.45:55944) 2023-07-09T02:15:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 -- 172.21.15.45:0/999376055 learned_addr learned my addr 172.21.15.45:0/999376055 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc3b7fe640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc3c06b800 0x7fbc3c14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc3bfff640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c0694b0 0x7fbc3c1660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 -- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c0694b0 msgr2=0x7fbc3c1660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c0694b0 0x7fbc3c1660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 -- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc3c06b800 msgr2=0x7fbc3c14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:58.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc3c06b800 0x7fbc3c14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:58.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 -- 172.21.15.45:0/999376055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc34009b30 con 0x7fbc3c0ac870 2023-07-09T02:15:58.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc3b7fe640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc3c06b800 0x7fbc3c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:58.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc3bfff640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c0694b0 0x7fbc3c1660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:58.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc40c75640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0ac870 0x7fbc3c159a70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbc3401d240 tx=0x7fbc34019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc38ff9640 1 -- 172.21.15.45:0/999376055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340b8670 con 0x7fbc3c0ac870 2023-07-09T02:15:58.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc38ff9640 1 -- 172.21.15.45:0/999376055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc340b87d0 con 0x7fbc3c0ac870 2023-07-09T02:15:58.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc38ff9640 1 -- 172.21.15.45:0/999376055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340b8b80 con 0x7fbc3c0ac870 2023-07-09T02:15:58.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.925+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c15b900 con 0x7fbc3c0ac870 2023-07-09T02:15:58.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.929+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c1511a0 con 0x7fbc3c0ac870 2023-07-09T02:15:58.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.929+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c06ae60 con 0x7fbc3c0ac870 2023-07-09T02:15:58.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.929+0000 7fbc38ff9640 1 -- 172.21.15.45:0/999376055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc340b8ce0 con 0x7fbc3c0ac870 2023-07-09T02:15:58.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.929+0000 7fbc38ff9640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc28066280 0x7fbc28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:58.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.929+0000 7fbc38ff9640 1 -- 172.21.15.45:0/999376055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc3411f500 con 0x7fbc3c0ac870 2023-07-09T02:15:58.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.929+0000 7fbc38ff9640 1 -- 172.21.15.45:0/999376055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7fbc2806e3c0 con 0x7fbc3c0ac870 2023-07-09T02:15:58.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.929+0000 7fbc3bfff640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc28066280 0x7fbc28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:58.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.933+0000 7fbc3bfff640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc28066280 0x7fbc28068730 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c004660 tx=0x7fbc2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:58.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:58.933+0000 7fbc38ff9640 1 -- 172.21.15.45:0/999376055 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc340eca00 con 0x7fbc3c0ac870 2023-07-09T02:15:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.085+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc3c151390 con 0x7fbc3c0ac870 2023-07-09T02:15:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.085+0000 7fbc38ff9640 1 -- 172.21.15.45:0/999376055 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc340f0020 con 0x7fbc3c0ac870 2023-07-09T02:15:59.089 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:15:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc28066280 msgr2=0x7fbc28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc28066280 0x7fbc28068730 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c004660 tx=0x7fbc2c008040 comp rx=0 tx=0).stop 2023-07-09T02:15:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0ac870 msgr2=0x7fbc3c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0ac870 0x7fbc3c159a70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbc3401d240 tx=0x7fbc34019740 comp rx=0 tx=0).stop 2023-07-09T02:15:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 shutdown_connections 2023-07-09T02:15:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc3c0ac870 0x7fbc3c159a70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc3c06b800 0x7fbc3c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc28066280 0x7fbc28068730 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 --2- 172.21.15.45:0/999376055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc3c0694b0 0x7fbc3c1660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 >> 172.21.15.45:0/999376055 conn(0x7fbc3c0cfb50 msgr2=0x7fbc3c14fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:59.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 shutdown_connections 2023-07-09T02:15:59.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.089+0000 7fbc426d8640 1 -- 172.21.15.45:0/999376055 wait complete. 2023-07-09T02:15:59.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:15:59.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.253+0000 7fca375fa640 1 Processor -- start 2023-07-09T02:15:59.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.253+0000 7fca375fa640 1 -- start start 2023-07-09T02:15:59.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.253+0000 7fca375fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca300c8dc0 0x7fca300cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca375fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cde40 0x7fca300caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca375fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3006ef30 con 0x7fca301604a0 2023-07-09T02:15:59.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca375fa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3006be90 con 0x7fca300c8dc0 2023-07-09T02:15:59.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca375fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3006b000 con 0x7fca300cde40 2023-07-09T02:15:59.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35396640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fca301604a0 0x7fca30164b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51154/0 (socket says 172.21.15.45:51154) 2023-07-09T02:15:59.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35396640 1 -- 172.21.15.45:0/317480349 learned_addr learned my addr 172.21.15.45:0/317480349 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:59.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca34b95640 1 --2- 172.21.15.45:0/317480349 >> v2:172.21.15.155:3300/0 conn(0x7fca300c8dc0 0x7fca300cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35b97640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cde40 0x7fca300caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833667797 0 0) 0x7fca3006ef30 con 0x7fca301604a0 2023-07-09T02:15:59.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca1c003530 con 0x7fca301604a0 2023-07-09T02:15:59.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1757297743 0 0) 0x7fca1c003530 con 0x7fca301604a0 2023-07-09T02:15:59.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cde40 msgr2=0x7fca300caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:59.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cde40 0x7fca300caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 >> v2:172.21.15.155:3300/0 conn(0x7fca300c8dc0 msgr2=0x7fca300cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:59.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 --2- 172.21.15.45:0/317480349 >> v2:172.21.15.155:3300/0 conn(0x7fca300c8dc0 0x7fca300cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3006b210 con 0x7fca301604a0 2023-07-09T02:15:59.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fca2c001680 con 0x7fca301604a0 2023-07-09T02:15:59.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 >> v1:172.21.15.45:6789/0 conn(0x7fca301604a0 legacy=0x7fca30164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cde40 0x7fca1c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c003f00 0x7fca1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca1c004d10 0x7fca1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3006be90 con 0x7fca1c004d10 2023-07-09T02:15:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3006b000 con 0x7fca1c003f00 2023-07-09T02:15:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c00b990 con 0x7fca300cde40 2023-07-09T02:15:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35b97640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca1c004d10 0x7fca1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35396640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cde40 0x7fca1c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca34b95640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c003f00 0x7fca1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35b97640 1 -- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cde40 msgr2=0x7fca1c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:59.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35b97640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300cde40 0x7fca1c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35b97640 1 -- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c003f00 msgr2=0x7fca1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:59.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35b97640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c003f00 0x7fca1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.257+0000 7fca35b97640 1 -- 172.21.15.45:0/317480349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c003530 con 0x7fca1c004d10 2023-07-09T02:15:59.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca35b97640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca1c004d10 0x7fca1c005180 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fca28009fc0 tx=0x7fca2801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdf4eac5dd2d8e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:59.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280a5c70 con 0x7fca1c004d10 2023-07-09T02:15:59.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800f040 con 0x7fca1c004d10 2023-07-09T02:15:59.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca27fff640 1 -- 172.21.15.45:0/317480349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280ad440 con 0x7fca1c004d10 2023-07-09T02:15:59.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca375fa640 1 -- 172.21.15.45:0/317480349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca1c004d10 msgr2=0x7fca1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca375fa640 1 --2- 172.21.15.45:0/317480349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca1c004d10 0x7fca1c005180 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fca28009fc0 tx=0x7fca2801cc60 comp rx=0 tx=0).stop 2023-07-09T02:15:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca35b97640 1 -- 172.21.15.45:0/317480349 reap_dead start 2023-07-09T02:15:59.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca375fa640 1 -- 172.21.15.45:0/317480349 shutdown_connections 2023-07-09T02:15:59.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca375fa640 1 -- 172.21.15.45:0/317480349 >> 172.21.15.45:0/317480349 conn(0x7fca300694b0 msgr2=0x7fca300698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:59.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca375fa640 1 -- 172.21.15.45:0/317480349 shutdown_connections 2023-07-09T02:15:59.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca375fa640 1 -- 172.21.15.45:0/317480349 wait complete. 2023-07-09T02:15:59.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca375fa640 1 Processor -- start 2023-07-09T02:15:59.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.261+0000 7fca375fa640 1 -- start start 2023-07-09T02:15:59.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004d10 0x7fca300c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca301fa010 0x7fca300b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca301f9390 0x7fca301f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca30155900 con 0x7fca301fa010 2023-07-09T02:15:59.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca301f9d40 con 0x7fca301f9390 2023-07-09T02:15:59.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300b1110 con 0x7fca1c004d10 2023-07-09T02:15:59.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca301fa010 0x7fca300b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca301fa010 0x7fca300b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55960/0 (socket says 172.21.15.45:55960) 2023-07-09T02:15:59.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 -- 172.21.15.45:0/3952837447 learned_addr learned my addr 172.21.15.45:0/3952837447 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:59.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca35396640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004d10 0x7fca300c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca35b97640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca301f9390 0x7fca301f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 -- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004d10 msgr2=0x7fca300c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004d10 0x7fca300c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 -- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca301f9390 msgr2=0x7fca301f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca301f9390 0x7fca301f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 -- 172.21.15.45:0/3952837447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300b0b50 con 0x7fca301fa010 2023-07-09T02:15:59.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca35b97640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca301f9390 0x7fca301f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:15:59.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca34b95640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca301fa010 0x7fca300b0200 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fca20011a30 tx=0x7fca20011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:59.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca25ffb640 1 -- 172.21.15.45:0/3952837447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000fa90 con 0x7fca301fa010 2023-07-09T02:15:59.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca25ffb640 1 -- 172.21.15.45:0/3952837447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2000fbf0 con 0x7fca301fa010 2023-07-09T02:15:59.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca25ffb640 1 -- 172.21.15.45:0/3952837447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20014440 con 0x7fca301fa010 2023-07-09T02:15:59.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca300b0e30 con 0x7fca301fa010 2023-07-09T02:15:59.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca300b0740 con 0x7fca301fa010 2023-07-09T02:15:59.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.265+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3004d7d0 con 0x7fca301fa010 2023-07-09T02:15:59.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.269+0000 7fca25ffb640 1 -- 172.21.15.45:0/3952837447 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca200145a0 con 0x7fca301fa010 2023-07-09T02:15:59.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.269+0000 7fca25ffb640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.269+0000 7fca25ffb640 1 -- 172.21.15.45:0/3952837447 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca20084470 con 0x7fca301fa010 2023-07-09T02:15:59.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.269+0000 7fca25ffb640 1 -- 172.21.15.45:0/3952837447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7fca1406e3c0 con 0x7fca301fa010 2023-07-09T02:15:59.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.269+0000 7fca35396640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.269+0000 7fca35396640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001060 tx=0x7fca2c007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.273+0000 7fca25ffb640 1 -- 172.21.15.45:0/3952837447 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca20051a40 con 0x7fca301fa010 2023-07-09T02:15:59.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.437+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fca3006c740 con 0x7fca301fa010 2023-07-09T02:15:59.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.437+0000 7fca25ffb640 1 -- 172.21.15.45:0/3952837447 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v91) v1 ==== 80+0+0 (secure 0 0 0) 0x7fca20022070 con 0x7fca301fa010 2023-07-09T02:15:59.440 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:15:59.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 msgr2=0x7fca14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001060 tx=0x7fca2c007900 comp rx=0 tx=0).stop 2023-07-09T02:15:59.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca301fa010 msgr2=0x7fca300b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca301fa010 0x7fca300b0200 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fca20011a30 tx=0x7fca20011e30 comp rx=0 tx=0).stop 2023-07-09T02:15:59.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 shutdown_connections 2023-07-09T02:15:59.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca301f9390 0x7fca301f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca301fa010 0x7fca300b0200 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 --2- 172.21.15.45:0/3952837447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004d10 0x7fca300c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 >> 172.21.15.45:0/3952837447 conn(0x7fca300694b0 msgr2=0x7fca3015a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:59.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 shutdown_connections 2023-07-09T02:15:59.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.441+0000 7fca375fa640 1 -- 172.21.15.45:0/3952837447 wait complete. 2023-07-09T02:15:59.461 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:15:59.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:59.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:15:59.520 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:15:59.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:15:59.521 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:15:59.531 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:15:59.532 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:59.543 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:15:59.543 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:15:59.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:15:59.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ee3d2640 1 Processor -- start 2023-07-09T02:15:59.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ee3d2640 1 -- start start 2023-07-09T02:15:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ee3d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2e806b240 0x7fe2e806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ee3d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e80d0d70 0x7fe2e80d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ee3d2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e80b2090 con 0x7fe2e815c870 2023-07-09T02:15:59.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ee3d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e806bc00 con 0x7fe2e806b240 2023-07-09T02:15:59.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ee3d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8160520 con 0x7fe2e80d0d70 2023-07-09T02:15:59.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ed3d0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe2e815c870 0x7fe2e80b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51156/0 (socket says 172.21.15.45:51156) 2023-07-09T02:15:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ed3d0640 1 -- 172.21.15.45:0/2726377476 learned_addr learned my addr 172.21.15.45:0/2726377476 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:15:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ecbcf640 1 --2- 172.21.15.45:0/2726377476 >> v2:172.21.15.155:3300/0 conn(0x7fe2e806b240 0x7fe2e806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2edbd1640 1 --2- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e80d0d70 0x7fe2e80d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2dffff640 1 -- 172.21.15.45:0/2726377476 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563756647 0 0) 0x7fe2e80b2090 con 0x7fe2e815c870 2023-07-09T02:15:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2dffff640 1 -- 172.21.15.45:0/2726377476 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4003530 con 0x7fe2e815c870 2023-07-09T02:15:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ecbcf640 1 -- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e80d0d70 msgr2=0x7fe2e80d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:15:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ecbcf640 1 --2- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e80d0d70 0x7fe2e80d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ecbcf640 1 -- 172.21.15.45:0/2726377476 >> v1:172.21.15.45:6789/0 conn(0x7fe2e815c870 legacy=0x7fe2e80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2ecbcf640 1 -- 172.21.15.45:0/2726377476 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e8160800 con 0x7fe2e806b240 2023-07-09T02:15:59.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.801+0000 7fe2edbd1640 1 --2- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e80d0d70 0x7fe2e80d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:15:59.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ecbcf640 1 --2- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e806b240 0x7fe2e806b6c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80097c0 tx=0x7fe2d801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16e0d577aa75b2a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:59.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2dffff640 1 -- 172.21.15.45:0/2726377476 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80ab650 con 0x7fe2e806b240 2023-07-09T02:15:59.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2dffff640 1 -- 172.21.15.45:0/2726377476 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d80ab7b0 con 0x7fe2e806b240 2023-07-09T02:15:59.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2dffff640 1 -- 172.21.15.45:0/2726377476 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80abb40 con 0x7fe2e806b240 2023-07-09T02:15:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e806b240 msgr2=0x7fe2e806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e806b240 0x7fe2e806b6c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80097c0 tx=0x7fe2d801c450 comp rx=0 tx=0).stop 2023-07-09T02:15:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/2726377476 shutdown_connections 2023-07-09T02:15:59.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e80d0d70 0x7fe2e80d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/2726377476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e806b240 0x7fe2e806b6c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/2726377476 >> 172.21.15.45:0/2726377476 conn(0x7fe2e8070be0 msgr2=0x7fe2e8070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:59.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/2726377476 shutdown_connections 2023-07-09T02:15:59.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.805+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/2726377476 wait complete. 2023-07-09T02:15:59.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 Processor -- start 2023-07-09T02:15:59.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 -- start start 2023-07-09T02:15:59.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e806b240 0x7fe2e814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e80d0d70 0x7fe2e80b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e815c870 0x7fe2e8158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80b6fb0 con 0x7fe2e80d0d70 2023-07-09T02:15:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e81501e0 con 0x7fe2e815c870 2023-07-09T02:15:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80b6cd0 con 0x7fe2e806b240 2023-07-09T02:15:59.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e80d0d70 0x7fe2e80b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e80d0d70 0x7fe2e80b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55976/0 (socket says 172.21.15.45:55976) 2023-07-09T02:15:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 -- 172.21.15.45:0/3579964397 learned_addr learned my addr 172.21.15.45:0/3579964397 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:15:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ed3d0640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e806b240 0x7fe2e814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2edbd1640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e815c870 0x7fe2e8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 -- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e806b240 msgr2=0x7fe2e814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e806b240 0x7fe2e814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 -- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e815c870 msgr2=0x7fe2e8158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e815c870 0x7fe2e8158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 -- 172.21.15.45:0/3579964397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0009a70 con 0x7fe2e80d0d70 2023-07-09T02:15:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ecbcf640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e80d0d70 0x7fe2e80b6230 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80ad040 tx=0x7fe2d801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ddffb640 1 -- 172.21.15.45:0/3579964397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80bf610 con 0x7fe2e80d0d70 2023-07-09T02:15:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ddffb640 1 -- 172.21.15.45:0/3579964397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d80bf7b0 con 0x7fe2e80d0d70 2023-07-09T02:15:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ddffb640 1 -- 172.21.15.45:0/3579964397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80bfb60 con 0x7fe2e80d0d70 2023-07-09T02:15:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d8009420 con 0x7fe2e80d0d70 2023-07-09T02:15:59.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e815e640 con 0x7fe2e80d0d70 2023-07-09T02:15:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.809+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e804e020 con 0x7fe2e80d0d70 2023-07-09T02:15:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.813+0000 7fe2ddffb640 1 -- 172.21.15.45:0/3579964397 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2d80b5400 con 0x7fe2e80d0d70 2023-07-09T02:15:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.813+0000 7fe2ddffb640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2cc0662b0 0x7fe2cc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:15:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.813+0000 7fe2ddffb640 1 -- 172.21.15.45:0/3579964397 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2d811e650 con 0x7fe2e80d0d70 2023-07-09T02:15:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.813+0000 7fe2ddffb640 1 -- 172.21.15.45:0/3579964397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7fe2cc06e3f0 con 0x7fe2e80d0d70 2023-07-09T02:15:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.813+0000 7fe2ed3d0640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2cc0662b0 0x7fe2cc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:15:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.813+0000 7fe2ed3d0640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2cc0662b0 0x7fe2cc068760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4005890 tx=0x7fe2e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:15:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.817+0000 7fe2ddffb640 1 -- 172.21.15.45:0/3579964397 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2d80ebc10 con 0x7fe2e80d0d70 2023-07-09T02:15:59.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.973+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2e80cfef0 con 0x7fe2e80d0d70 2023-07-09T02:15:59.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ddffb640 1 -- 172.21.15.45:0/3579964397 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+18418 (secure 0 0 0) 0x7fe2d8006e20 con 0x7fe2e80d0d70 2023-07-09T02:15:59.976 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:15:59.977 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:15:31.380843+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:15:12.532657+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T02:15:12.972198+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["backfillfull","exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:15:59.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2cc0662b0 msgr2=0x7fe2cc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2cc0662b0 0x7fe2cc068760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4005890 tx=0x7fe2e4009040 comp rx=0 tx=0).stop 2023-07-09T02:15:59.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e80d0d70 msgr2=0x7fe2e80b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:15:59.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e80d0d70 0x7fe2e80b6230 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80ad040 tx=0x7fe2d801ac90 comp rx=0 tx=0).stop 2023-07-09T02:15:59.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 shutdown_connections 2023-07-09T02:15:59.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2e815c870 0x7fe2e8158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2e80d0d70 0x7fe2e80b6230 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2cc0662b0 0x7fe2cc068760 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 --2- 172.21.15.45:0/3579964397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2e806b240 0x7fe2e814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:15:59.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 >> 172.21.15.45:0/3579964397 conn(0x7fe2e8070be0 msgr2=0x7fe2e80b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:15:59.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 shutdown_connections 2023-07-09T02:15:59.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:15:59.977+0000 7fe2ee3d2640 1 -- 172.21.15.45:0/3579964397 wait complete. 2023-07-09T02:15:59.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:15:12.532657+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:15:12.972198+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:15:59.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:16:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f72188d8640 1 Processor -- start 2023-07-09T02:16:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f72188d8640 1 -- start start 2023-07-09T02:16:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f72188d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f721415c060 0x7f72140b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f72188d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f72140cd120 0x7f72140d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f72188d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7214160a50 con 0x7f72140d2450 2023-07-09T02:16:00.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f72188d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140d28d0 con 0x7f721415c060 2023-07-09T02:16:00.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f72188d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140cfe40 con 0x7f72140cd120 2023-07-09T02:16:00.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f721259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f721415c060 0x7f72140b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f721259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f721415c060 0x7f72140b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55980/0 (socket says 172.21.15.45:55980) 2023-07-09T02:16:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f721259c640 1 -- 172.21.15.45:0/3031433487 learned_addr learned my addr 172.21.15.45:0/3031433487 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f720bfff640 1 --2- 172.21.15.45:0/3031433487 >> v2:172.21.15.155:3300/0 conn(0x7f72140cd120 0x7f72140d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f721259c640 1 -- 172.21.15.45:0/3031433487 >> v2:172.21.15.155:3300/0 conn(0x7f72140cd120 msgr2=0x7f72140d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f721259c640 1 --2- 172.21.15.45:0/3031433487 >> v2:172.21.15.155:3300/0 conn(0x7f72140cd120 0x7f72140d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f721259c640 1 -- 172.21.15.45:0/3031433487 >> v1:172.21.15.45:6789/0 conn(0x7f72140d2450 legacy=0x7f72140d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.145+0000 7f721259c640 1 -- 172.21.15.45:0/3031433487 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721415c430 con 0x7f721415c060 2023-07-09T02:16:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f721259c640 1 --2- 172.21.15.45:0/3031433487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721415c060 0x7f72140b4ed0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f721415fac0 tx=0x7f720401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cd9e0d8f525a82 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f7211d9b640 1 -- 172.21.15.45:0/3031433487 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72040ab5f0 con 0x7f721415c060 2023-07-09T02:16:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f7211d9b640 1 -- 172.21.15.45:0/3031433487 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72040ab750 con 0x7f721415c060 2023-07-09T02:16:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f7211d9b640 1 -- 172.21.15.45:0/3031433487 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72040abae0 con 0x7f721415c060 2023-07-09T02:16:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 -- 172.21.15.45:0/3031433487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721415c060 msgr2=0x7f72140b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 --2- 172.21.15.45:0/3031433487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721415c060 0x7f72140b4ed0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f721415fac0 tx=0x7f720401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 -- 172.21.15.45:0/3031433487 shutdown_connections 2023-07-09T02:16:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 --2- 172.21.15.45:0/3031433487 >> v2:172.21.15.155:3300/0 conn(0x7f72140cd120 0x7f72140d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 --2- 172.21.15.45:0/3031433487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f721415c060 0x7f72140b4ed0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 -- 172.21.15.45:0/3031433487 >> 172.21.15.45:0/3031433487 conn(0x7f72140698e0 msgr2=0x7f7214069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:00.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 -- 172.21.15.45:0/3031433487 shutdown_connections 2023-07-09T02:16:00.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 -- 172.21.15.45:0/3031433487 wait complete. 2023-07-09T02:16:00.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.149+0000 7f72188d8640 1 Processor -- start 2023-07-09T02:16:00.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 -- start start 2023-07-09T02:16:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72140cd120 0x7f721415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72140d2450 0x7f72140b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f721415c060 0x7f72140cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140b4210 con 0x7f72140d2450 2023-07-09T02:16:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140cca30 con 0x7f72140cd120 2023-07-09T02:16:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140b2f10 con 0x7f721415c060 2023-07-09T02:16:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72140d2450 0x7f72140b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72140d2450 0x7f72140b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55996/0 (socket says 172.21.15.45:55996) 2023-07-09T02:16:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 -- 172.21.15.45:0/2986359704 learned_addr learned my addr 172.21.15.45:0/2986359704 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f721259c640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72140cd120 0x7f721415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f7212d9d640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f721415c060 0x7f72140cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 -- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f721415c060 msgr2=0x7f72140cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f721415c060 0x7f72140cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 -- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72140cd120 msgr2=0x7f721415a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72140cd120 0x7f721415a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 -- 172.21.15.45:0/2986359704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040094d0 con 0x7f72140d2450 2023-07-09T02:16:00.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f7212d9d640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f721415c060 0x7f72140cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:00.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720bfff640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72140d2450 0x7f72140b3cd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00e900 tx=0x7f71fc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720affd640 1 -- 172.21.15.45:0/2986359704 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc009690 con 0x7f72140d2450 2023-07-09T02:16:00.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720affd640 1 -- 172.21.15.45:0/2986359704 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00ca00 con 0x7f72140d2450 2023-07-09T02:16:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f720affd640 1 -- 172.21.15.45:0/2986359704 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00cd90 con 0x7f72140d2450 2023-07-09T02:16:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72140b31f0 con 0x7f72140d2450 2023-07-09T02:16:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72140b37b0 con 0x7f72140d2450 2023-07-09T02:16:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.153+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721404d7d0 con 0x7f72140d2450 2023-07-09T02:16:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.157+0000 7f720affd640 1 -- 172.21.15.45:0/2986359704 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71fc013470 con 0x7f72140d2450 2023-07-09T02:16:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.157+0000 7f720affd640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71f4066280 0x7f71f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.157+0000 7f720affd640 1 -- 172.21.15.45:0/2986359704 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71fc083f70 con 0x7f72140d2450 2023-07-09T02:16:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.157+0000 7f720affd640 1 -- 172.21.15.45:0/2986359704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7f71f406e3c0 con 0x7f72140d2450 2023-07-09T02:16:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.157+0000 7f721259c640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71f4066280 0x7f71f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.157+0000 7f721259c640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71f4066280 0x7f71f4068730 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f72040af000 tx=0x7f72040b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.161+0000 7f720affd640 1 -- 172.21.15.45:0/2986359704 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71fc017060 con 0x7f72140d2450 2023-07-09T02:16:00.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.313+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f721406baa0 con 0x7f72140d2450 2023-07-09T02:16:00.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.313+0000 7f720affd640 1 -- 172.21.15.45:0/2986359704 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71fc021070 con 0x7f72140d2450 2023-07-09T02:16:00.316 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:16:00.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71f4066280 msgr2=0x7f71f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71f4066280 0x7f71f4068730 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f72040af000 tx=0x7f72040b6040 comp rx=0 tx=0).stop 2023-07-09T02:16:00.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72140d2450 msgr2=0x7f72140b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72140d2450 0x7f72140b3cd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00e900 tx=0x7f71fc00edc0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 shutdown_connections 2023-07-09T02:16:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f71f4066280 0x7f71f4068730 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f721415c060 0x7f72140cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72140d2450 0x7f72140b3cd0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 --2- 172.21.15.45:0/2986359704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72140cd120 0x7f721415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 >> 172.21.15.45:0/2986359704 conn(0x7f72140698e0 msgr2=0x7f72140b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:00.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 shutdown_connections 2023-07-09T02:16:00.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.317+0000 7f72188d8640 1 -- 172.21.15.45:0/2986359704 wait complete. 2023-07-09T02:16:00.336 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:16:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.481+0000 7fab7ac9e640 1 Processor -- start 2023-07-09T02:16:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.481+0000 7fab7ac9e640 1 -- start start 2023-07-09T02:16:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.481+0000 7fab7ac9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740d2620 0x7fab740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.481+0000 7fab7ac9e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab740cd120 0x7fab740cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.481+0000 7fab7ac9e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab74160a50 con 0x7fab7415c060 2023-07-09T02:16:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.481+0000 7fab7ac9e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7415c430 con 0x7fab740cd120 2023-07-09T02:16:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.481+0000 7fab7ac9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7415fb60 con 0x7fab740d2620 2023-07-09T02:16:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab78a3a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fab7415c060 0x7fab740d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51180/0 (socket says 172.21.15.45:51180) 2023-07-09T02:16:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab78a3a640 1 -- 172.21.15.45:0/691242787 learned_addr learned my addr 172.21.15.45:0/691242787 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab7923b640 1 --2- 172.21.15.45:0/691242787 >> v2:172.21.15.45:3300/0 conn(0x7fab740cd120 0x7fab740cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab73fff640 1 --2- 172.21.15.45:0/691242787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740d2620 0x7fab740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab7923b640 1 -- 172.21.15.45:0/691242787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740d2620 msgr2=0x7fab740b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:00.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab7923b640 1 --2- 172.21.15.45:0/691242787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740d2620 0x7fab740b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab7923b640 1 -- 172.21.15.45:0/691242787 >> v1:172.21.15.45:6789/0 conn(0x7fab7415c060 legacy=0x7fab740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab7923b640 1 -- 172.21.15.45:0/691242787 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7415fe40 con 0x7fab740cd120 2023-07-09T02:16:00.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab73fff640 1 --2- 172.21.15.45:0/691242787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740d2620 0x7fab740b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:00.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab7923b640 1 --2- 172.21.15.45:0/691242787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab740cee30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009d90 tx=0x7fab6c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba235789e405b803 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab737fe640 1 -- 172.21.15.45:0/691242787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0a59e0 con 0x7fab740cd120 2023-07-09T02:16:00.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab737fe640 1 -- 172.21.15.45:0/691242787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c0a5b40 con 0x7fab740cd120 2023-07-09T02:16:00.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.485+0000 7fab737fe640 1 -- 172.21.15.45:0/691242787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0ad440 con 0x7fab740cd120 2023-07-09T02:16:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- 172.21.15.45:0/691242787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 msgr2=0x7fab740cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/691242787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab740cee30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fab6c009d90 tx=0x7fab6c01c920 comp rx=0 tx=0).stop 2023-07-09T02:16:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- 172.21.15.45:0/691242787 shutdown_connections 2023-07-09T02:16:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/691242787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab740cee30 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/691242787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab740d2620 0x7fab740b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- 172.21.15.45:0/691242787 >> 172.21.15.45:0/691242787 conn(0x7fab740698e0 msgr2=0x7fab74069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:00.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- 172.21.15.45:0/691242787 shutdown_connections 2023-07-09T02:16:00.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- 172.21.15.45:0/691242787 wait complete. 2023-07-09T02:16:00.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 Processor -- start 2023-07-09T02:16:00.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- start start 2023-07-09T02:16:00.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab74153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab740d2620 0x7fab740b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab7415c060 0x7fab741567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab74154000 con 0x7fab740cd120 2023-07-09T02:16:00.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740b30b0 con 0x7fab740d2620 2023-07-09T02:16:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab7ac9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab740b2680 con 0x7fab7415c060 2023-07-09T02:16:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab78a3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab74153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab78a3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab74153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56004/0 (socket says 172.21.15.45:56004) 2023-07-09T02:16:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab78a3a640 1 -- 172.21.15.45:0/2030540389 learned_addr learned my addr 172.21.15.45:0/2030540389 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab78a3a640 1 -- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab7415c060 msgr2=0x7fab741567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab78a3a640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab7415c060 0x7fab741567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab78a3a640 1 -- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab740d2620 msgr2=0x7fab740b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab78a3a640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab740d2620 0x7fab740b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.489+0000 7fab78a3a640 1 -- 172.21.15.45:0/2030540389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60009420 con 0x7fab740cd120 2023-07-09T02:16:00.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab78a3a640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab74153900 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c430 tx=0x7fab6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab717fa640 1 -- 172.21.15.45:0/2030540389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68005cf0 con 0x7fab740cd120 2023-07-09T02:16:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab717fa640 1 -- 172.21.15.45:0/2030540389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab68005e50 con 0x7fab740cd120 2023-07-09T02:16:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab717fa640 1 -- 172.21.15.45:0/2030540389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680072d0 con 0x7fab740cd120 2023-07-09T02:16:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c009a70 con 0x7fab740cd120 2023-07-09T02:16:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab740b59f0 con 0x7fab740cd120 2023-07-09T02:16:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7404d7d0 con 0x7fab740cd120 2023-07-09T02:16:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab717fa640 1 -- 172.21.15.45:0/2030540389 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab68007430 con 0x7fab740cd120 2023-07-09T02:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab717fa640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab58066280 0x7fab58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.493+0000 7fab717fa640 1 -- 172.21.15.45:0/2030540389 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab680831e0 con 0x7fab740cd120 2023-07-09T02:16:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.497+0000 7fab73fff640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab58066280 0x7fab58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.497+0000 7fab717fa640 1 -- 172.21.15.45:0/2030540389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7fab5806e3c0 con 0x7fab740cd120 2023-07-09T02:16:00.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.497+0000 7fab73fff640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab58066280 0x7fab58068730 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fab60006e90 tx=0x7fab60006de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.497+0000 7fab717fa640 1 -- 172.21.15.45:0/2030540389 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab68050700 con 0x7fab740cd120 2023-07-09T02:16:00.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.653+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab7406baa0 con 0x7fab740cd120 2023-07-09T02:16:00.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.653+0000 7fab717fa640 1 -- 172.21.15.45:0/2030540389 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab68017020 con 0x7fab740cd120 2023-07-09T02:16:00.656 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:16:00.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab58066280 msgr2=0x7fab58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab58066280 0x7fab58068730 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fab60006e90 tx=0x7fab60006de0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 msgr2=0x7fab74153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab74153900 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c430 tx=0x7fab6800c8f0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 shutdown_connections 2023-07-09T02:16:00.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fab58066280 0x7fab58068730 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab7415c060 0x7fab741567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab740d2620 0x7fab740b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 --2- 172.21.15.45:0/2030540389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab740cd120 0x7fab74153900 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 >> 172.21.15.45:0/2030540389 conn(0x7fab740698e0 msgr2=0x7fab7415b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:00.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 shutdown_connections 2023-07-09T02:16:00.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.657+0000 7fab7ac9e640 1 -- 172.21.15.45:0/2030540389 wait complete. 2023-07-09T02:16:00.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:16:00.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.821+0000 7fc58529c640 1 Processor -- start 2023-07-09T02:16:00.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.821+0000 7fc58529c640 1 -- start start 2023-07-09T02:16:00.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc58529c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc58015c060 0x7fc5800b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc58529c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc5800d2620 0x7fc5800cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc58529c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc580160a50 con 0x7fc5800cd120 2023-07-09T02:16:00.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc58529c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58015c430 con 0x7fc5800d2620 2023-07-09T02:16:00.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc58529c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58015fb60 con 0x7fc58015c060 2023-07-09T02:16:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc5800d2620 0x7fc5800cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc5800d2620 0x7fc5800cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56008/0 (socket says 172.21.15.45:56008) 2023-07-09T02:16:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57f7fe640 1 -- 172.21.15.45:0/3440742421 learned_addr learned my addr 172.21.15.45:0/3440742421 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57effd640 1 --2- 172.21.15.45:0/3440742421 >> v2:172.21.15.155:3300/0 conn(0x7fc58015c060 0x7fc5800b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57f7fe640 1 -- 172.21.15.45:0/3440742421 >> v2:172.21.15.155:3300/0 conn(0x7fc58015c060 msgr2=0x7fc5800b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57f7fe640 1 --2- 172.21.15.45:0/3440742421 >> v2:172.21.15.155:3300/0 conn(0x7fc58015c060 0x7fc5800b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57f7fe640 1 -- 172.21.15.45:0/3440742421 >> v1:172.21.15.155:6789/0 conn(0x7fc5800cd120 legacy=0x7fc5800d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57f7fe640 1 -- 172.21.15.45:0/3440742421 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58015fe40 con 0x7fc5800d2620 2023-07-09T02:16:00.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.825+0000 7fc57f7fe640 1 --2- 172.21.15.45:0/3440742421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5800d2620 0x7fc5800cee30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc5800d3ad0 tx=0x7fc57801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50abcbfc3b0c4430 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc57e7fc640 1 -- 172.21.15.45:0/3440742421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780a5820 con 0x7fc5800d2620 2023-07-09T02:16:00.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc57e7fc640 1 -- 172.21.15.45:0/3440742421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5780a5980 con 0x7fc5800d2620 2023-07-09T02:16:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc57e7fc640 1 -- 172.21.15.45:0/3440742421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780a5d10 con 0x7fc5800d2620 2023-07-09T02:16:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- 172.21.15.45:0/3440742421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5800d2620 msgr2=0x7fc5800cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 --2- 172.21.15.45:0/3440742421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5800d2620 0x7fc5800cee30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc5800d3ad0 tx=0x7fc57801c960 comp rx=0 tx=0).stop 2023-07-09T02:16:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- 172.21.15.45:0/3440742421 shutdown_connections 2023-07-09T02:16:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 --2- 172.21.15.45:0/3440742421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5800d2620 0x7fc5800cee30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 --2- 172.21.15.45:0/3440742421 >> v2:172.21.15.155:3300/0 conn(0x7fc58015c060 0x7fc5800b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- 172.21.15.45:0/3440742421 >> 172.21.15.45:0/3440742421 conn(0x7fc5800698e0 msgr2=0x7fc580069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- 172.21.15.45:0/3440742421 shutdown_connections 2023-07-09T02:16:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- 172.21.15.45:0/3440742421 wait complete. 2023-07-09T02:16:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 Processor -- start 2023-07-09T02:16:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- start start 2023-07-09T02:16:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5800cd120 0x7fc58015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5800d2620 0x7fc5800cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58015c060 0x7fc580155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58015ed80 con 0x7fc58015c060 2023-07-09T02:16:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580157520 con 0x7fc5800cd120 2023-07-09T02:16:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc58529c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58015eaa0 con 0x7fc5800d2620 2023-07-09T02:16:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc57f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58015c060 0x7fc580155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc57f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58015c060 0x7fc580155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56024/0 (socket says 172.21.15.45:56024) 2023-07-09T02:16:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.829+0000 7fc57f7fe640 1 -- 172.21.15.45:0/2835937720 learned_addr learned my addr 172.21.15.45:0/2835937720 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc57effd640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5800cd120 0x7fc58015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc577fff640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5800d2620 0x7fc5800cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc57f7fe640 1 -- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5800d2620 msgr2=0x7fc5800cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc57f7fe640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5800d2620 0x7fc5800cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc57f7fe640 1 -- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5800cd120 msgr2=0x7fc58015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc57f7fe640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5800cd120 0x7fc58015e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc57f7fe640 1 -- 172.21.15.45:0/2835937720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578009b30 con 0x7fc58015c060 2023-07-09T02:16:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc57f7fe640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58015c060 0x7fc580155d20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc5780af040 tx=0x7fc578019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc5777fe640 1 -- 172.21.15.45:0/2835937720 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b8670 con 0x7fc58015c060 2023-07-09T02:16:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc5777fe640 1 -- 172.21.15.45:0/2835937720 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5780b8810 con 0x7fc58015c060 2023-07-09T02:16:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5800b59f0 con 0x7fc58015c060 2023-07-09T02:16:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc5777fe640 1 -- 172.21.15.45:0/2835937720 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b8bc0 con 0x7fc58015c060 2023-07-09T02:16:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5800cafa0 con 0x7fc58015c060 2023-07-09T02:16:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5800b8a10 con 0x7fc58015c060 2023-07-09T02:16:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc5777fe640 1 -- 172.21.15.45:0/2835937720 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc5780b8d20 con 0x7fc58015c060 2023-07-09T02:16:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.833+0000 7fc5777fe640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc5600662b0 0x7fc560068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.837+0000 7fc5777fe640 1 -- 172.21.15.45:0/2835937720 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc57811f380 con 0x7fc58015c060 2023-07-09T02:16:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.837+0000 7fc5777fe640 1 -- 172.21.15.45:0/2835937720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7fc56006e3f0 con 0x7fc58015c060 2023-07-09T02:16:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.837+0000 7fc57effd640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc5600662b0 0x7fc560068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.837+0000 7fc57effd640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc5600662b0 0x7fc560068760 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5800b4990 tx=0x7fc570008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.837+0000 7fc5777fe640 1 -- 172.21.15.45:0/2835937720 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5780ec930 con 0x7fc58015c060 2023-07-09T02:16:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5800b8a10 con 0x7fc58015c060 2023-07-09T02:16:00.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc5777fe640 1 -- 172.21.15.45:0/2835937720 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5780eff50 con 0x7fc58015c060 2023-07-09T02:16:00.994 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:16:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc5600662b0 msgr2=0x7fc560068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc5600662b0 0x7fc560068760 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5800b4990 tx=0x7fc570008040 comp rx=0 tx=0).stop 2023-07-09T02:16:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58015c060 msgr2=0x7fc580155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:00.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58015c060 0x7fc580155d20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc5780af040 tx=0x7fc578019700 comp rx=0 tx=0).stop 2023-07-09T02:16:00.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 shutdown_connections 2023-07-09T02:16:00.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58015c060 0x7fc580155d20 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc5600662b0 0x7fc560068760 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5800d2620 0x7fc5800cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 --2- 172.21.15.45:0/2835937720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5800cd120 0x7fc58015e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:00.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 >> 172.21.15.45:0/2835937720 conn(0x7fc5800698e0 msgr2=0x7fc5800b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:00.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 shutdown_connections 2023-07-09T02:16:00.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:00.993+0000 7fc58529c640 1 -- 172.21.15.45:0/2835937720 wait complete. 2023-07-09T02:16:01.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:16:01.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f3974640 1 Processor -- start 2023-07-09T02:16:01.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f3974640 1 -- start start 2023-07-09T02:16:01.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f3974640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0ec15c060 0x7fe0ec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f3974640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0d2620 0x7fe0ec0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f3974640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec160a50 con 0x7fe0ec0cd120 2023-07-09T02:16:01.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f3974640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec15c430 con 0x7fe0ec15c060 2023-07-09T02:16:01.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f3974640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec15fb60 con 0x7fe0ec0d2620 2023-07-09T02:16:01.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f1710640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0ec15c060 0x7fe0ec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f1f11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0d2620 0x7fe0ec0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f0f0f640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe0ec0cd120 0x7fe0ec0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:43536/0 (socket says 172.21.15.45:43536) 2023-07-09T02:16:01.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f0f0f640 1 -- 172.21.15.45:0/2825772437 learned_addr learned my addr 172.21.15.45:0/2825772437 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:01.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f1710640 1 -- 172.21.15.45:0/2825772437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0d2620 msgr2=0x7fe0ec0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:01.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f1710640 1 --2- 172.21.15.45:0/2825772437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0d2620 0x7fe0ec0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f1710640 1 -- 172.21.15.45:0/2825772437 >> v1:172.21.15.155:6789/0 conn(0x7fe0ec0cd120 legacy=0x7fe0ec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.161+0000 7fe0f1710640 1 -- 172.21.15.45:0/2825772437 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec15fe40 con 0x7fe0ec15c060 2023-07-09T02:16:01.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f1710640 1 --2- 172.21.15.45:0/2825772437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 0x7fe0ec0b4ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80097c0 tx=0x7fe0e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be57ff480d14b4e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:01.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0e3fff640 1 -- 172.21.15.45:0/2825772437 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80ab650 con 0x7fe0ec15c060 2023-07-09T02:16:01.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0e3fff640 1 -- 172.21.15.45:0/2825772437 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e80ab7b0 con 0x7fe0ec15c060 2023-07-09T02:16:01.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0e3fff640 1 -- 172.21.15.45:0/2825772437 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80abb40 con 0x7fe0ec15c060 2023-07-09T02:16:01.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f3974640 1 -- 172.21.15.45:0/2825772437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 msgr2=0x7fe0ec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f3974640 1 --2- 172.21.15.45:0/2825772437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 0x7fe0ec0b4ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80097c0 tx=0x7fe0e801c450 comp rx=0 tx=0).stop 2023-07-09T02:16:01.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f3974640 1 -- 172.21.15.45:0/2825772437 shutdown_connections 2023-07-09T02:16:01.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f3974640 1 --2- 172.21.15.45:0/2825772437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0d2620 0x7fe0ec0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f3974640 1 --2- 172.21.15.45:0/2825772437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 0x7fe0ec0b4ed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f3974640 1 -- 172.21.15.45:0/2825772437 >> 172.21.15.45:0/2825772437 conn(0x7fe0ec0698e0 msgr2=0x7fe0ec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f3974640 1 -- 172.21.15.45:0/2825772437 shutdown_connections 2023-07-09T02:16:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.165+0000 7fe0f3974640 1 -- 172.21.15.45:0/2825772437 wait complete. 2023-07-09T02:16:01.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 Processor -- start 2023-07-09T02:16:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 -- start start 2023-07-09T02:16:01.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0cd120 0x7fe0ec0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec0d2620 0x7fe0ec153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 0x7fe0ec154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0cb750 con 0x7fe0ec0d2620 2023-07-09T02:16:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0cab40 con 0x7fe0ec15c060 2023-07-09T02:16:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0cae20 con 0x7fe0ec0cd120 2023-07-09T02:16:01.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec0d2620 0x7fe0ec153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec0d2620 0x7fe0ec153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56040/0 (socket says 172.21.15.45:56040) 2023-07-09T02:16:01.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 -- 172.21.15.45:0/805627208 learned_addr learned my addr 172.21.15.45:0/805627208 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:01.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f1f11640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 0x7fe0ec154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f1710640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0cd120 0x7fe0ec0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 -- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0cd120 msgr2=0x7fe0ec0ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0cd120 0x7fe0ec0ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 -- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 msgr2=0x7fe0ec154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 0x7fe0ec154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 -- 172.21.15.45:0/805627208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e8009420 con 0x7fe0ec0d2620 2023-07-09T02:16:01.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f0f0f640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec0d2620 0x7fe0ec153f30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c4d0 tx=0x7fe0dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:01.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0e1ffb640 1 -- 172.21.15.45:0/805627208 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc005cf0 con 0x7fe0ec0d2620 2023-07-09T02:16:01.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0e1ffb640 1 -- 172.21.15.45:0/805627208 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc005e50 con 0x7fe0ec0d2620 2023-07-09T02:16:01.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0e1ffb640 1 -- 172.21.15.45:0/805627208 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc007270 con 0x7fe0ec0d2620 2023-07-09T02:16:01.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.169+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec0b59f0 con 0x7fe0ec0d2620 2023-07-09T02:16:01.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.173+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec0cb3e0 con 0x7fe0ec0d2620 2023-07-09T02:16:01.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.173+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec04d7d0 con 0x7fe0ec0d2620 2023-07-09T02:16:01.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.173+0000 7fe0e1ffb640 1 -- 172.21.15.45:0/805627208 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0dc0073d0 con 0x7fe0ec0d2620 2023-07-09T02:16:01.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.173+0000 7fe0e1ffb640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d0066280 0x7fe0d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.173+0000 7fe0e1ffb640 1 -- 172.21.15.45:0/805627208 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0dc083140 con 0x7fe0ec0d2620 2023-07-09T02:16:01.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.173+0000 7fe0e1ffb640 1 -- 172.21.15.45:0/805627208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7fe0d006e3c0 con 0x7fe0ec0d2620 2023-07-09T02:16:01.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.173+0000 7fe0f1710640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d0066280 0x7fe0d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.173+0000 7fe0f1710640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d0066280 0x7fe0d0068730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80af000 tx=0x7fe0e80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:01.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.177+0000 7fe0e1ffb640 1 -- 172.21.15.45:0/805627208 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0dc050660 con 0x7fe0ec0d2620 2023-07-09T02:16:01.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0ec06baa0 con 0x7fe0ec0d2620 2023-07-09T02:16:01.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0e1ffb640 1 -- 172.21.15.45:0/805627208 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0dc017020 con 0x7fe0ec0d2620 2023-07-09T02:16:01.334 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:16:01.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d0066280 msgr2=0x7fe0d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d0066280 0x7fe0d0068730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80af000 tx=0x7fe0e80a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:01.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec0d2620 msgr2=0x7fe0ec153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec0d2620 0x7fe0ec153f30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c4d0 tx=0x7fe0dc00c990 comp rx=0 tx=0).stop 2023-07-09T02:16:01.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 shutdown_connections 2023-07-09T02:16:01.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0ec15c060 0x7fe0ec154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0ec0d2620 0x7fe0ec153f30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe0d0066280 0x7fe0d0068730 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 --2- 172.21.15.45:0/805627208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0ec0cd120 0x7fe0ec0ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 >> 172.21.15.45:0/805627208 conn(0x7fe0ec0698e0 msgr2=0x7fe0ec069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:01.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 shutdown_connections 2023-07-09T02:16:01.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.333+0000 7fe0f3974640 1 -- 172.21.15.45:0/805627208 wait complete. 2023-07-09T02:16:01.355 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:16:01.457 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:16:01.457+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-07-09T02:16:01.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa2d8d8640 1 Processor -- start 2023-07-09T02:16:01.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa2d8d8640 1 -- start start 2023-07-09T02:16:01.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa2d8d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa280b8090 0x7ffa280cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa2d8d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 0x7ffa280b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa2d8d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa280b4cf0 con 0x7ffa280b4870 2023-07-09T02:16:01.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa2d8d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa280d0890 con 0x7ffa280b8090 2023-07-09T02:16:01.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa2d8d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2815d190 con 0x7ffa280d03f0 2023-07-09T02:16:01.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa26ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa280b8090 0x7ffa280cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa267fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 0x7ffa280b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa26ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa280b8090 0x7ffa280cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:44946/0 (socket says 172.21.15.45:44946) 2023-07-09T02:16:01.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa26ffd640 1 -- 172.21.15.45:0/1471586201 learned_addr learned my addr 172.21.15.45:0/1471586201 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:01.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa277fe640 1 --1- 172.21.15.45:0/1471586201 >> v1:172.21.15.155:6789/0 conn(0x7ffa280b4870 0x7ffa2815fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:43542/0 (socket says 172.21.15.45:43542) 2023-07-09T02:16:01.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa26ffd640 1 -- 172.21.15.45:0/1471586201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 msgr2=0x7ffa280b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:01.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa26ffd640 1 --2- 172.21.15.45:0/1471586201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 0x7ffa280b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa26ffd640 1 -- 172.21.15.45:0/1471586201 >> v1:172.21.15.155:6789/0 conn(0x7ffa280b4870 legacy=0x7ffa2815fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa25ffb640 1 -- 172.21.15.45:0/1471586201 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180752133 0 0) 0x7ffa280b4cf0 con 0x7ffa280b4870 2023-07-09T02:16:01.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.501+0000 7ffa26ffd640 1 -- 172.21.15.45:0/1471586201 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280ccf10 con 0x7ffa280b8090 2023-07-09T02:16:01.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa26ffd640 1 --2- 172.21.15.45:0/1471586201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 0x7ffa280cea70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffa18006fd0 tx=0x7ffa1801c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e4070ab584a0d69 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa25ffb640 1 -- 172.21.15.45:0/1471586201 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180aa5f0 con 0x7ffa280b8090 2023-07-09T02:16:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa25ffb640 1 -- 172.21.15.45:0/1471586201 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180aa750 con 0x7ffa280b8090 2023-07-09T02:16:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa25ffb640 1 -- 172.21.15.45:0/1471586201 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180aaae0 con 0x7ffa280b8090 2023-07-09T02:16:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/1471586201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 msgr2=0x7ffa280cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/1471586201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 0x7ffa280cea70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffa18006fd0 tx=0x7ffa1801c4f0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/1471586201 shutdown_connections 2023-07-09T02:16:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/1471586201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 0x7ffa280b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/1471586201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 0x7ffa280cea70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/1471586201 >> 172.21.15.45:0/1471586201 conn(0x7ffa280d28b0 msgr2=0x7ffa280d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/1471586201 shutdown_connections 2023-07-09T02:16:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/1471586201 wait complete. 2023-07-09T02:16:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.505+0000 7ffa2d8d8640 1 Processor -- start 2023-07-09T02:16:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 -- start start 2023-07-09T02:16:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280b4870 0x7ffa2815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 0x7ffa280cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 0x7ffa280c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280cbc80 con 0x7ffa280b4870 2023-07-09T02:16:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280cbf20 con 0x7ffa280b8090 2023-07-09T02:16:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280cc200 con 0x7ffa280d03f0 2023-07-09T02:16:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280b4870 0x7ffa2815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280b4870 0x7ffa2815c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56050/0 (socket says 172.21.15.45:56050) 2023-07-09T02:16:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 -- 172.21.15.45:0/4269877626 learned_addr learned my addr 172.21.15.45:0/4269877626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa267fc640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 0x7ffa280cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa277fe640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 0x7ffa280c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 -- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 msgr2=0x7ffa280c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 0x7ffa280c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 -- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 msgr2=0x7ffa280cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 0x7ffa280cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 -- 172.21.15.45:0/4269877626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009480 con 0x7ffa280b4870 2023-07-09T02:16:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa26ffd640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280b4870 0x7ffa2815c860 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ffa1801aba0 tx=0x7ffa18019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa0ffff640 1 -- 172.21.15.45:0/4269877626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180aaac0 con 0x7ffa280b4870 2023-07-09T02:16:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa0ffff640 1 -- 172.21.15.45:0/4269877626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180aac20 con 0x7ffa280b4870 2023-07-09T02:16:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa280cc4e0 con 0x7ffa280b4870 2023-07-09T02:16:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa0ffff640 1 -- 172.21.15.45:0/4269877626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18003620 con 0x7ffa280b4870 2023-07-09T02:16:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa280ccaa0 con 0x7ffa280b4870 2023-07-09T02:16:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.509+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2804e020 con 0x7ffa280b4870 2023-07-09T02:16:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.513+0000 7ffa0ffff640 1 -- 172.21.15.45:0/4269877626 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa18003780 con 0x7ffa280b4870 2023-07-09T02:16:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.513+0000 7ffa0ffff640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa14066280 0x7ffa14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.513+0000 7ffa0ffff640 1 -- 172.21.15.45:0/4269877626 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa180a7070 con 0x7ffa280b4870 2023-07-09T02:16:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.513+0000 7ffa0ffff640 1 -- 172.21.15.45:0/4269877626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7ffa1406e3c0 con 0x7ffa280b4870 2023-07-09T02:16:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.513+0000 7ffa267fc640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa14066280 0x7ffa14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.513+0000 7ffa267fc640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa14066280 0x7ffa14068730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffa280b77e0 tx=0x7ffa1c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:01.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.517+0000 7ffa0ffff640 1 -- 172.21.15.45:0/4269877626 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa180c3060 con 0x7ffa280b4870 2023-07-09T02:16:01.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.681+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa280716f0 con 0x7ffa280b4870 2023-07-09T02:16:01.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.681+0000 7ffa0ffff640 1 -- 172.21.15.45:0/4269877626 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa180ebea0 con 0x7ffa280b4870 2023-07-09T02:16:01.684 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:16:01.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa14066280 msgr2=0x7ffa14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa14066280 0x7ffa14068730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffa280b77e0 tx=0x7ffa1c009190 comp rx=0 tx=0).stop 2023-07-09T02:16:01.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280b4870 msgr2=0x7ffa2815c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280b4870 0x7ffa2815c860 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ffa1801aba0 tx=0x7ffa18019290 comp rx=0 tx=0).stop 2023-07-09T02:16:01.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 shutdown_connections 2023-07-09T02:16:01.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa14066280 0x7ffa14068730 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa280d03f0 0x7ffa280c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280b8090 0x7ffa280cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 --2- 172.21.15.45:0/4269877626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280b4870 0x7ffa2815c860 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 >> 172.21.15.45:0/4269877626 conn(0x7ffa280d28b0 msgr2=0x7ffa2815e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:01.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 shutdown_connections 2023-07-09T02:16:01.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.685+0000 7ffa2d8d8640 1 -- 172.21.15.45:0/4269877626 wait complete. 2023-07-09T02:16:01.705 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:16:01.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:01.706 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:16:01.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:16:01.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:01.777 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:16:01.788 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:01.788 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:01.797 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:16:01.797 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:16:01.798 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:01.842 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:16:01.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:01.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb602456640 1 Processor -- start 2023-07-09T02:16:01.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb602456640 1 -- start start 2023-07-09T02:16:01.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb602456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 0x7fb5fc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb602456640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5fc0cd120 0x7fb5fc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb602456640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc160a50 con 0x7fb5fc15c060 2023-07-09T02:16:01.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb602456640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5fc15c430 con 0x7fb5fc0cd120 2023-07-09T02:16:01.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb602456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc15fb60 con 0x7fb5fc0d2620 2023-07-09T02:16:01.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb6009f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5fc0cd120 0x7fb5fc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb6009f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5fc0cd120 0x7fb5fc0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53564/0 (socket says 172.21.15.45:53564) 2023-07-09T02:16:01.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb6009f3640 1 -- 172.21.15.45:0/173120899 learned_addr learned my addr 172.21.15.45:0/173120899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb5f3fff640 1 --2- 172.21.15.45:0/173120899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 0x7fb5fc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb6009f3640 1 -- 172.21.15.45:0/173120899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 msgr2=0x7fb5fc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb6009f3640 1 --2- 172.21.15.45:0/173120899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 0x7fb5fc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb6009f3640 1 -- 172.21.15.45:0/173120899 >> v1:172.21.15.155:6789/0 conn(0x7fb5fc15c060 legacy=0x7fb5fc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.985+0000 7fb6009f3640 1 -- 172.21.15.45:0/173120899 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc15fe40 con 0x7fb5fc0cd120 2023-07-09T02:16:01.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb6009f3640 1 --2- 172.21.15.45:0/173120899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc0cd120 0x7fb5fc0cee30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009e50 tx=0x7fb5f401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ed694a51850e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:01.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb5fb7fe640 1 -- 172.21.15.45:0/173120899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a5820 con 0x7fb5fc0cd120 2023-07-09T02:16:01.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb5fb7fe640 1 -- 172.21.15.45:0/173120899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f40a5980 con 0x7fb5fc0cd120 2023-07-09T02:16:01.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb5fb7fe640 1 -- 172.21.15.45:0/173120899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a5d10 con 0x7fb5fc0cd120 2023-07-09T02:16:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb602456640 1 -- 172.21.15.45:0/173120899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc0cd120 msgr2=0x7fb5fc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb602456640 1 --2- 172.21.15.45:0/173120899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc0cd120 0x7fb5fc0cee30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009e50 tx=0x7fb5f401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb602456640 1 -- 172.21.15.45:0/173120899 shutdown_connections 2023-07-09T02:16:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb602456640 1 --2- 172.21.15.45:0/173120899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc0cd120 0x7fb5fc0cee30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb602456640 1 --2- 172.21.15.45:0/173120899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 0x7fb5fc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb602456640 1 -- 172.21.15.45:0/173120899 >> 172.21.15.45:0/173120899 conn(0x7fb5fc0698e0 msgr2=0x7fb5fc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb602456640 1 -- 172.21.15.45:0/173120899 shutdown_connections 2023-07-09T02:16:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.989+0000 7fb602456640 1 -- 172.21.15.45:0/173120899 wait complete. 2023-07-09T02:16:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 Processor -- start 2023-07-09T02:16:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 -- start start 2023-07-09T02:16:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5fc0cd120 0x7fb5fc15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 0x7fb5fc15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc15c060 0x7fb5fc15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc158e30 con 0x7fb5fc15c060 2023-07-09T02:16:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc15e780 con 0x7fb5fc0cd120 2023-07-09T02:16:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc15ea60 con 0x7fb5fc0d2620 2023-07-09T02:16:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc15c060 0x7fb5fc15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc15c060 0x7fb5fc15cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53568/0 (socket says 172.21.15.45:53568) 2023-07-09T02:16:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 -- 172.21.15.45:0/3362473927 learned_addr learned my addr 172.21.15.45:0/3362473927 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb5f3fff640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 0x7fb5fc15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb5fbfff640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5fc0cd120 0x7fb5fc15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 -- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 msgr2=0x7fb5fc15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 0x7fb5fc15c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 -- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5fc0cd120 msgr2=0x7fb5fc15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5fc0cd120 0x7fb5fc15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:01.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 -- 172.21.15.45:0/3362473927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4009b30 con 0x7fb5fc15c060 2023-07-09T02:16:01.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb6009f3640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc15c060 0x7fb5fc15cab0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40af040 tx=0x7fb5f4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb5f97fa640 1 -- 172.21.15.45:0/3362473927 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b8670 con 0x7fb5fc15c060 2023-07-09T02:16:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb5f97fa640 1 -- 172.21.15.45:0/3362473927 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f40b87d0 con 0x7fb5fc15c060 2023-07-09T02:16:02.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc0b59f0 con 0x7fb5fc15c060 2023-07-09T02:16:02.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb5f97fa640 1 -- 172.21.15.45:0/3362473927 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b8b60 con 0x7fb5fc15c060 2023-07-09T02:16:02.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.993+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc159360 con 0x7fb5fc15c060 2023-07-09T02:16:02.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.997+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc04d7d0 con 0x7fb5fc15c060 2023-07-09T02:16:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.997+0000 7fb5f97fa640 1 -- 172.21.15.45:0/3362473927 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5f40b8cc0 con 0x7fb5fc15c060 2023-07-09T02:16:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.997+0000 7fb5f97fa640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5dc066280 0x7fb5dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.997+0000 7fb5f97fa640 1 -- 172.21.15.45:0/3362473927 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5f411f3c0 con 0x7fb5fc15c060 2023-07-09T02:16:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.997+0000 7fb5f97fa640 1 -- 172.21.15.45:0/3362473927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7fb5dc06e3c0 con 0x7fb5fc15c060 2023-07-09T02:16:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.997+0000 7fb5fbfff640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5dc066280 0x7fb5dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:01.997+0000 7fb5fbfff640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5dc066280 0x7fb5dc068730 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00b810 tx=0x7fb5ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.001+0000 7fb5f97fa640 1 -- 172.21.15.45:0/3362473927 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5f40ec830 con 0x7fb5fc15c060 2023-07-09T02:16:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.189+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5fc15b4b0 con 0x7fb5fc15c060 2023-07-09T02:16:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.189+0000 7fb5f97fa640 1 -- 172.21.15.45:0/3362473927 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fb5f40bc070 con 0x7fb5fc15c060 2023-07-09T02:16:02.190 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:02.191 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1384902817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1384902817},{"type":"v1","addr":"172.21.15.45:6835","nonce":1384902817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/324339930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":324339930},{"type":"v1","addr":"172.21.15.155:6836","nonce":324339930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/355258806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":355258806},{"type":"v1","addr":"172.21.15.45:6833","nonce":355258806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:15:13.977165+0000","modified":"2023-07-09T02:15:17.606626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6537":{"gid":6537,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1667885237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1667885237},{"type":"v1","addr":"172.21.15.155:6837","nonce":1667885237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T02:16:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-07-09T02:16:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.189+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5dc066280 msgr2=0x7fb5dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.189+0000 7fb602456640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5dc066280 0x7fb5dc068730 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00b810 tx=0x7fb5ec008040 comp rx=0 tx=0).stop 2023-07-09T02:16:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.189+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc15c060 msgr2=0x7fb5fc15cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.189+0000 7fb602456640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc15c060 0x7fb5fc15cab0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40af040 tx=0x7fb5f4019740 comp rx=0 tx=0).stop 2023-07-09T02:16:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.193+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 shutdown_connections 2023-07-09T02:16:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.193+0000 7fb602456640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5fc15c060 0x7fb5fc15cab0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.193+0000 7fb602456640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5dc066280 0x7fb5dc068730 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.193+0000 7fb602456640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5fc0d2620 0x7fb5fc15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.193+0000 7fb602456640 1 --2- 172.21.15.45:0/3362473927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5fc0cd120 0x7fb5fc15e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.193+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 >> 172.21.15.45:0/3362473927 conn(0x7fb5fc0698e0 msgr2=0x7fb5fc1550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:02.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.193+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 shutdown_connections 2023-07-09T02:16:02.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.193+0000 7fb602456640 1 -- 172.21.15.45:0/3362473927 wait complete. 2023-07-09T02:16:02.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:02.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dbab70640 1 Processor -- start 2023-07-09T02:16:02.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dbab70640 1 -- start start 2023-07-09T02:16:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dbab70640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3db406b240 0x7f3db406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dbab70640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d0d70 0x7f3db40d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dbab70640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db40b2090 con 0x7f3db415c870 2023-07-09T02:16:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dbab70640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db406bc00 con 0x7f3db406b240 2023-07-09T02:16:02.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dbab70640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4160520 con 0x7f3db40d0d70 2023-07-09T02:16:02.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3db9b6e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3db415c870 0x7f3db40b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33534/0 (socket says 172.21.15.45:33534) 2023-07-09T02:16:02.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3db9b6e640 1 -- 172.21.15.45:0/2045005798 learned_addr learned my addr 172.21.15.45:0/2045005798 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:02.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dba36f640 1 --2- 172.21.15.45:0/2045005798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d0d70 0x7f3db40d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3db936d640 1 --2- 172.21.15.45:0/2045005798 >> v2:172.21.15.155:3300/0 conn(0x7f3db406b240 0x7f3db406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3db8b6c640 1 -- 172.21.15.45:0/2045005798 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949497791 0 0) 0x7f3db40b2090 con 0x7f3db415c870 2023-07-09T02:16:02.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3db8b6c640 1 -- 172.21.15.45:0/2045005798 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da0003530 con 0x7f3db415c870 2023-07-09T02:16:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3db8b6c640 1 -- 172.21.15.45:0/2045005798 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3985768913 0 0) 0x7f3da0003530 con 0x7f3db415c870 2023-07-09T02:16:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dba36f640 1 -- 172.21.15.45:0/2045005798 >> v2:172.21.15.155:3300/0 conn(0x7f3db406b240 msgr2=0x7f3db406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dba36f640 1 --2- 172.21.15.45:0/2045005798 >> v2:172.21.15.155:3300/0 conn(0x7f3db406b240 0x7f3db406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dba36f640 1 -- 172.21.15.45:0/2045005798 >> v1:172.21.15.45:6789/0 conn(0x7f3db415c870 legacy=0x7f3db40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.357+0000 7f3dba36f640 1 -- 172.21.15.45:0/2045005798 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db4160800 con 0x7f3db40d0d70 2023-07-09T02:16:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dba36f640 1 --2- 172.21.15.45:0/2045005798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d0d70 0x7f3db40d11b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009d90 tx=0x7f3dac01c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0607bc01b3a6bbb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3db8b6c640 1 -- 172.21.15.45:0/2045005798 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db00016a0 con 0x7f3db40d0d70 2023-07-09T02:16:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3db8b6c640 1 -- 172.21.15.45:0/2045005798 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac0a5640 con 0x7f3db40d0d70 2023-07-09T02:16:02.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3db8b6c640 1 -- 172.21.15.45:0/2045005798 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac0a59d0 con 0x7f3db40d0d70 2023-07-09T02:16:02.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dbab70640 1 -- 172.21.15.45:0/2045005798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d0d70 msgr2=0x7f3db40d11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dbab70640 1 --2- 172.21.15.45:0/2045005798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d0d70 0x7f3db40d11b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009d90 tx=0x7f3dac01c840 comp rx=0 tx=0).stop 2023-07-09T02:16:02.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dbab70640 1 -- 172.21.15.45:0/2045005798 shutdown_connections 2023-07-09T02:16:02.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dbab70640 1 --2- 172.21.15.45:0/2045005798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d0d70 0x7f3db40d11b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dbab70640 1 --2- 172.21.15.45:0/2045005798 >> v2:172.21.15.155:3300/0 conn(0x7f3db406b240 0x7f3db406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dbab70640 1 -- 172.21.15.45:0/2045005798 >> 172.21.15.45:0/2045005798 conn(0x7f3db4070be0 msgr2=0x7f3db4070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:02.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dbab70640 1 -- 172.21.15.45:0/2045005798 shutdown_connections 2023-07-09T02:16:02.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.361+0000 7f3dbab70640 1 -- 172.21.15.45:0/2045005798 wait complete. 2023-07-09T02:16:02.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 Processor -- start 2023-07-09T02:16:02.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 -- start start 2023-07-09T02:16:02.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db406b240 0x7f3db4158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db40d0d70 0x7f3db415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db415c870 0x7f3db415f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40ccf00 con 0x7f3db40d0d70 2023-07-09T02:16:02.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40cbe60 con 0x7f3db406b240 2023-07-09T02:16:02.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40cc140 con 0x7f3db415c870 2023-07-09T02:16:02.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db40d0d70 0x7f3db415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db40d0d70 0x7f3db415ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53572/0 (socket says 172.21.15.45:53572) 2023-07-09T02:16:02.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 -- 172.21.15.45:0/713926254 learned_addr learned my addr 172.21.15.45:0/713926254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:02.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dba36f640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db415c870 0x7f3db415f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db9b6e640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db406b240 0x7f3db4158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 -- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db415c870 msgr2=0x7f3db415f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db415c870 0x7f3db415f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 -- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db406b240 msgr2=0x7f3db4158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db406b240 0x7f3db4158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 -- 172.21.15.45:0/713926254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac009a70 con 0x7f3db40d0d70 2023-07-09T02:16:02.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db9b6e640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db406b240 0x7f3db4158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:02.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3db936d640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db40d0d70 0x7f3db415ef80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e930 tx=0x7f3da400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:02.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4009690 con 0x7f3db40d0d70 2023-07-09T02:16:02.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da400ca00 con 0x7f3db40d0d70 2023-07-09T02:16:02.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400cd70 con 0x7f3db40d0d70 2023-07-09T02:16:02.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db40cc420 con 0x7f3db40d0d70 2023-07-09T02:16:02.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db40cc9e0 con 0x7f3db40d0d70 2023-07-09T02:16:02.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.365+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db40ccba0 con 0x7f3db40d0d70 2023-07-09T02:16:02.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.369+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3da4013470 con 0x7f3db40d0d70 2023-07-09T02:16:02.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.369+0000 7f3daa7fc640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.369+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3da4083fe0 con 0x7f3db40d0d70 2023-07-09T02:16:02.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.369+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7f3d9806e3c0 con 0x7f3db40d0d70 2023-07-09T02:16:02.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.369+0000 7f3db9b6e640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.369+0000 7f3db9b6e640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3db0001210 tx=0x7f3db0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:02.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.373+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3da4017060 con 0x7f3db40d0d70 2023-07-09T02:16:02.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.477+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(93..93 src has 1..93) v4 ==== 296+0+0 (secure 0 0 0) 0x7f3da4059140 con 0x7f3db40d0d70 2023-07-09T02:16:02.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.477+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7f3d9806ec00 con 0x7f3db40d0d70 2023-07-09T02:16:02.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3db40b5410 con 0x7f3db40d0d70 2023-07-09T02:16:02.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3daa7fc640 1 -- 172.21.15.45:0/713926254 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+18396 (secure 0 0 0) 0x7f3da4017030 con 0x7f3db40d0d70 2023-07-09T02:16:02.539 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:02.539 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":93,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:02.468127+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:15:12.532657+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T02:15:12.972198+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["backfillfull","exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:02.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 msgr2=0x7f3d98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3db0001210 tx=0x7f3db0009040 comp rx=0 tx=0).stop 2023-07-09T02:16:02.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db40d0d70 msgr2=0x7f3db415ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db40d0d70 0x7f3db415ef80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e930 tx=0x7f3da400edf0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 shutdown_connections 2023-07-09T02:16:02.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db415c870 0x7f3db415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db40d0d70 0x7f3db415ef80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 --2- 172.21.15.45:0/713926254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db406b240 0x7f3db4158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 >> 172.21.15.45:0/713926254 conn(0x7f3db4070be0 msgr2=0x7f3db40b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:02.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 shutdown_connections 2023-07-09T02:16:02.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.537+0000 7f3dbab70640 1 -- 172.21.15.45:0/713926254 wait complete. 2023-07-09T02:16:02.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:15:12.532657+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:15:12.972198+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:16:02.560 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:16:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.705+0000 7ff875f11640 1 Processor -- start 2023-07-09T02:16:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.705+0000 7ff875f11640 1 -- start start 2023-07-09T02:16:02.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.705+0000 7ff875f11640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff87015c060 0x7ff8700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.705+0000 7ff875f11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 0x7ff8700cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.705+0000 7ff875f11640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff870160a50 con 0x7ff8700cd120 2023-07-09T02:16:02.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.705+0000 7ff875f11640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87015c430 con 0x7ff87015c060 2023-07-09T02:16:02.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.705+0000 7ff875f11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87015fb60 con 0x7ff8700d2620 2023-07-09T02:16:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff87015c060 0x7ff8700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff87015c060 0x7ff8700b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53580/0 (socket says 172.21.15.45:53580) 2023-07-09T02:16:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86f7fe640 1 -- 172.21.15.45:0/527740462 learned_addr learned my addr 172.21.15.45:0/527740462 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86ffff640 1 --2- 172.21.15.45:0/527740462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 0x7ff8700cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86f7fe640 1 -- 172.21.15.45:0/527740462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 msgr2=0x7ff8700cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86f7fe640 1 --2- 172.21.15.45:0/527740462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 0x7ff8700cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86f7fe640 1 -- 172.21.15.45:0/527740462 >> v1:172.21.15.45:6789/0 conn(0x7ff8700cd120 legacy=0x7ff8700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86f7fe640 1 -- 172.21.15.45:0/527740462 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87015fe40 con 0x7ff87015c060 2023-07-09T02:16:02.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86f7fe640 1 --2- 172.21.15.45:0/527740462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff87015c060 0x7ff8700b4ed0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff860009870 tx=0x7ff86001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56b9b2d21863d00 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:02.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86e7fc640 1 -- 172.21.15.45:0/527740462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600aa670 con 0x7ff87015c060 2023-07-09T02:16:02.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86e7fc640 1 -- 172.21.15.45:0/527740462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8600aa7d0 con 0x7ff87015c060 2023-07-09T02:16:02.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.709+0000 7ff86e7fc640 1 -- 172.21.15.45:0/527740462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600aab60 con 0x7ff87015c060 2023-07-09T02:16:02.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- 172.21.15.45:0/527740462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff87015c060 msgr2=0x7ff8700b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 --2- 172.21.15.45:0/527740462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff87015c060 0x7ff8700b4ed0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff860009870 tx=0x7ff86001c510 comp rx=0 tx=0).stop 2023-07-09T02:16:02.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- 172.21.15.45:0/527740462 shutdown_connections 2023-07-09T02:16:02.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 --2- 172.21.15.45:0/527740462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 0x7ff8700cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 --2- 172.21.15.45:0/527740462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff87015c060 0x7ff8700b4ed0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- 172.21.15.45:0/527740462 >> 172.21.15.45:0/527740462 conn(0x7ff8700698e0 msgr2=0x7ff870069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:02.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- 172.21.15.45:0/527740462 shutdown_connections 2023-07-09T02:16:02.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- 172.21.15.45:0/527740462 wait complete. 2023-07-09T02:16:02.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 Processor -- start 2023-07-09T02:16:02.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- start start 2023-07-09T02:16:02.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8700cd120 0x7ff8700ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 0x7ff870153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff87015c060 0x7ff870154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700cb750 con 0x7ff8700cd120 2023-07-09T02:16:02.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700cab40 con 0x7ff87015c060 2023-07-09T02:16:02.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff875f11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700cae20 con 0x7ff8700d2620 2023-07-09T02:16:02.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff86f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8700cd120 0x7ff8700ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff86f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8700cd120 0x7ff8700ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53586/0 (socket says 172.21.15.45:53586) 2023-07-09T02:16:02.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.713+0000 7ff86f7fe640 1 -- 172.21.15.45:0/3895016611 learned_addr learned my addr 172.21.15.45:0/3895016611 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:02.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff86f7fe640 1 -- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 msgr2=0x7ff870153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff86f7fe640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 0x7ff870153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff86f7fe640 1 -- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff87015c060 msgr2=0x7ff870154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff86f7fe640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff87015c060 0x7ff870154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff86f7fe640 1 -- 172.21.15.45:0/3895016611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600094d0 con 0x7ff8700cd120 2023-07-09T02:16:02.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff86f7fe640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8700cd120 0x7ff8700ca4d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff8600ac040 tx=0x7ff86001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:02.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff857fff640 1 -- 172.21.15.45:0/3895016611 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600bd5f0 con 0x7ff8700cd120 2023-07-09T02:16:02.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff857fff640 1 -- 172.21.15.45:0/3895016611 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8600bd770 con 0x7ff8700cd120 2023-07-09T02:16:02.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8700b59f0 con 0x7ff8700cd120 2023-07-09T02:16:02.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff857fff640 1 -- 172.21.15.45:0/3895016611 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600bdb20 con 0x7ff8700cd120 2023-07-09T02:16:02.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8700cb3e0 con 0x7ff8700cd120 2023-07-09T02:16:02.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87004d7d0 con 0x7ff8700cd120 2023-07-09T02:16:02.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff857fff640 1 -- 172.21.15.45:0/3895016611 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8600b3600 con 0x7ff8700cd120 2023-07-09T02:16:02.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff857fff640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff85c066280 0x7ff85c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:02.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff857fff640 1 -- 172.21.15.45:0/3895016611 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff86011f2b0 con 0x7ff8700cd120 2023-07-09T02:16:02.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.717+0000 7ff857fff640 1 -- 172.21.15.45:0/3895016611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7ff85c06e3c0 con 0x7ff8700cd120 2023-07-09T02:16:02.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.721+0000 7ff86effd640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff85c066280 0x7ff85c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:02.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.721+0000 7ff86effd640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff85c066280 0x7ff85c068730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff864000f70 tx=0x7ff8640079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:02.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.721+0000 7ff857fff640 1 -- 172.21.15.45:0/3895016611 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8600ec720 con 0x7ff8700cd120 2023-07-09T02:16:02.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.877+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8700caf60 con 0x7ff8700cd120 2023-07-09T02:16:02.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff857fff640 1 -- 172.21.15.45:0/3895016611 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8700caf60 con 0x7ff8700cd120 2023-07-09T02:16:02.881 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:16:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff85c066280 msgr2=0x7ff85c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff85c066280 0x7ff85c068730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff864000f70 tx=0x7ff8640079c0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8700cd120 msgr2=0x7ff8700ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8700cd120 0x7ff8700ca4d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff8600ac040 tx=0x7ff86001ad50 comp rx=0 tx=0).stop 2023-07-09T02:16:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 shutdown_connections 2023-07-09T02:16:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff87015c060 0x7ff870154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff85c066280 0x7ff85c068730 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8700d2620 0x7ff870153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 --2- 172.21.15.45:0/3895016611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8700cd120 0x7ff8700ca4d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 >> 172.21.15.45:0/3895016611 conn(0x7ff8700698e0 msgr2=0x7ff870069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 shutdown_connections 2023-07-09T02:16:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:02.881+0000 7ff875f11640 1 -- 172.21.15.45:0/3895016611 wait complete. 2023-07-09T02:16:02.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:16:03.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.045+0000 7f54ffe7b640 1 Processor -- start 2023-07-09T02:16:03.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.045+0000 7f54ffe7b640 1 -- start start 2023-07-09T02:16:03.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54ffe7b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54f815c060 0x7f54f80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54ffe7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80cd120 0x7f54f80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54ffe7b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f54f80d2450 0x7f54f80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54ffe7b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f80d28f0 con 0x7f54f815c060 2023-07-09T02:16:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54ffe7b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f8160a50 con 0x7f54f80d2450 2023-07-09T02:16:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54ffe7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f815c430 con 0x7f54f80cd120 2023-07-09T02:16:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fdc17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54f815c060 0x7f54f80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fdc17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54f815c060 0x7f54f80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53594/0 (socket says 172.21.15.45:53594) 2023-07-09T02:16:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fdc17640 1 -- 172.21.15.45:0/1529116930 learned_addr learned my addr 172.21.15.45:0/1529116930 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:03.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fd416640 1 --2- 172.21.15.45:0/1529116930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80cd120 0x7f54f80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fe418640 1 --2- 172.21.15.45:0/1529116930 >> v2:172.21.15.155:3300/0 conn(0x7f54f80d2450 0x7f54f80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fdc17640 1 -- 172.21.15.45:0/1529116930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80cd120 msgr2=0x7f54f80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fdc17640 1 --2- 172.21.15.45:0/1529116930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80cd120 0x7f54f80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fdc17640 1 -- 172.21.15.45:0/1529116930 >> v2:172.21.15.155:3300/0 conn(0x7f54f80d2450 msgr2=0x7f54f80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fdc17640 1 --2- 172.21.15.45:0/1529116930 >> v2:172.21.15.155:3300/0 conn(0x7f54f80d2450 0x7f54f80d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fdc17640 1 -- 172.21.15.45:0/1529116930 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f815fb60 con 0x7f54f815c060 2023-07-09T02:16:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.049+0000 7f54fd416640 1 --2- 172.21.15.45:0/1529116930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80cd120 0x7f54f80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:03.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54fdc17640 1 --2- 172.21.15.45:0/1529116930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f80b4ed0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f54f806b120 tx=0x7f54f401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b482d823269ea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54fcc15640 1 -- 172.21.15.45:0/1529116930 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40ab600 con 0x7f54f815c060 2023-07-09T02:16:03.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54fcc15640 1 -- 172.21.15.45:0/1529116930 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40a7050 con 0x7f54f815c060 2023-07-09T02:16:03.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54fcc15640 1 -- 172.21.15.45:0/1529116930 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40ab980 con 0x7f54f815c060 2023-07-09T02:16:03.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 -- 172.21.15.45:0/1529116930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 msgr2=0x7f54f80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/1529116930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f80b4ed0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f54f806b120 tx=0x7f54f401c210 comp rx=0 tx=0).stop 2023-07-09T02:16:03.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 -- 172.21.15.45:0/1529116930 shutdown_connections 2023-07-09T02:16:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/1529116930 >> v2:172.21.15.155:3300/0 conn(0x7f54f80d2450 0x7f54f80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/1529116930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80cd120 0x7f54f80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/1529116930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f80b4ed0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 -- 172.21.15.45:0/1529116930 >> 172.21.15.45:0/1529116930 conn(0x7f54f80698e0 msgr2=0x7f54f8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 -- 172.21.15.45:0/1529116930 shutdown_connections 2023-07-09T02:16:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 -- 172.21.15.45:0/1529116930 wait complete. 2023-07-09T02:16:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 Processor -- start 2023-07-09T02:16:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.053+0000 7f54ffe7b640 1 -- start start 2023-07-09T02:16:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f80cd120 0x7f54f8154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80d2450 0x7f54f8154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f815d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8154b60 con 0x7f54f815c060 2023-07-09T02:16:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f8154880 con 0x7f54f80cd120 2023-07-09T02:16:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f80b35e0 con 0x7f54f80d2450 2023-07-09T02:16:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f815d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53610/0 (socket says 172.21.15.45:53610) 2023-07-09T02:16:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 -- 172.21.15.45:0/4075579616 learned_addr learned my addr 172.21.15.45:0/4075579616 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fdc17640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f80cd120 0x7f54f8154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fd416640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80d2450 0x7f54f8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 -- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80d2450 msgr2=0x7f54f8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80d2450 0x7f54f8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 -- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f80cd120 msgr2=0x7f54f8154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f80cd120 0x7f54f8154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 -- 172.21.15.45:0/4075579616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f40094d0 con 0x7f54f815c060 2023-07-09T02:16:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54fe418640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f815d150 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f54f0007e40 tx=0x7f54f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ee7fc640 1 -- 172.21.15.45:0/4075579616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0014620 con 0x7f54f815c060 2023-07-09T02:16:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ee7fc640 1 -- 172.21.15.45:0/4075579616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f000ee90 con 0x7f54f815c060 2023-07-09T02:16:03.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ee7fc640 1 -- 172.21.15.45:0/4075579616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f00149e0 con 0x7f54f815c060 2023-07-09T02:16:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f80b38c0 con 0x7f54f815c060 2023-07-09T02:16:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f80cce70 con 0x7f54f815c060 2023-07-09T02:16:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f804d7d0 con 0x7f54f815c060 2023-07-09T02:16:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.057+0000 7f54ee7fc640 1 -- 172.21.15.45:0/4075579616 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54f0014b40 con 0x7f54f815c060 2023-07-09T02:16:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.061+0000 7f54ee7fc640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54dc066280 0x7f54dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.061+0000 7f54ee7fc640 1 -- 172.21.15.45:0/4075579616 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54f00844f0 con 0x7f54f815c060 2023-07-09T02:16:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.061+0000 7f54ee7fc640 1 -- 172.21.15.45:0/4075579616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7f54dc06e3c0 con 0x7f54f815c060 2023-07-09T02:16:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.061+0000 7f54fdc17640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54dc066280 0x7f54dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.061+0000 7f54fdc17640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54dc066280 0x7f54dc068730 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f54f40ad000 tx=0x7f54f40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.065+0000 7f54ee7fc640 1 -- 172.21.15.45:0/4075579616 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54f0051ab0 con 0x7f54f815c060 2023-07-09T02:16:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.217+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54f81603d0 con 0x7f54f815c060 2023-07-09T02:16:03.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ee7fc640 1 -- 172.21.15.45:0/4075579616 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54f00550d0 con 0x7f54f815c060 2023-07-09T02:16:03.221 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:16:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54dc066280 msgr2=0x7f54dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54dc066280 0x7f54dc068730 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f54f40ad000 tx=0x7f54f40a6000 comp rx=0 tx=0).stop 2023-07-09T02:16:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 msgr2=0x7f54f815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f815d150 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f54f0007e40 tx=0x7f54f000e4b0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 shutdown_connections 2023-07-09T02:16:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54f815c060 0x7f54f815d150 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54dc066280 0x7f54dc068730 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54f80d2450 0x7f54f8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 --2- 172.21.15.45:0/4075579616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54f80cd120 0x7f54f8154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 >> 172.21.15.45:0/4075579616 conn(0x7f54f80698e0 msgr2=0x7f54f815b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:03.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 shutdown_connections 2023-07-09T02:16:03.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.221+0000 7f54ffe7b640 1 -- 172.21.15.45:0/4075579616 wait complete. 2023-07-09T02:16:03.241 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:16:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.385+0000 7f4f00a19640 1 Processor -- start 2023-07-09T02:16:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.385+0000 7f4f00a19640 1 -- start start 2023-07-09T02:16:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.385+0000 7f4f00a19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4efc0d2620 0x7f4efc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4f00a19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc160a50 con 0x7f4efc0cd120 2023-07-09T02:16:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4f00a19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc15c430 con 0x7f4efc15c060 2023-07-09T02:16:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4f00a19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4efc15fb60 con 0x7f4efc0d2620 2023-07-09T02:16:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4efc0d2620 0x7f4efc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4efc0d2620 0x7f4efc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53620/0 (socket says 172.21.15.45:53620) 2023-07-09T02:16:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef3fff640 1 -- 172.21.15.45:0/2906473744 learned_addr learned my addr 172.21.15.45:0/2906473744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef3fff640 1 -- 172.21.15.45:0/2906473744 >> v1:172.21.15.155:6789/0 conn(0x7f4efc15c060 legacy=0x7f4efc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef3fff640 1 -- 172.21.15.45:0/2906473744 >> v1:172.21.15.45:6789/0 conn(0x7f4efc0cd120 legacy=0x7f4efc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef3fff640 1 -- 172.21.15.45:0/2906473744 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc15fe40 con 0x7f4efc0d2620 2023-07-09T02:16:03.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef3fff640 1 --2- 172.21.15.45:0/2906473744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0d2620 0x7f4efc0b4ed0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009870 tx=0x7f4ee401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d613e89a11cbf9f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef9d9b640 1 -- 172.21.15.45:0/2906473744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40aa670 con 0x7f4efc0d2620 2023-07-09T02:16:03.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef9d9b640 1 -- 172.21.15.45:0/2906473744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee40aa7d0 con 0x7f4efc0d2620 2023-07-09T02:16:03.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.389+0000 7f4ef9d9b640 1 -- 172.21.15.45:0/2906473744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40aab60 con 0x7f4efc0d2620 2023-07-09T02:16:03.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- 172.21.15.45:0/2906473744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0d2620 msgr2=0x7f4efc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 --2- 172.21.15.45:0/2906473744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0d2620 0x7f4efc0b4ed0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009870 tx=0x7f4ee401c510 comp rx=0 tx=0).stop 2023-07-09T02:16:03.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- 172.21.15.45:0/2906473744 shutdown_connections 2023-07-09T02:16:03.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 --2- 172.21.15.45:0/2906473744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0d2620 0x7f4efc0b4ed0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- 172.21.15.45:0/2906473744 >> 172.21.15.45:0/2906473744 conn(0x7f4efc0698e0 msgr2=0x7f4efc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- 172.21.15.45:0/2906473744 shutdown_connections 2023-07-09T02:16:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- 172.21.15.45:0/2906473744 wait complete. 2023-07-09T02:16:03.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 Processor -- start 2023-07-09T02:16:03.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- start start 2023-07-09T02:16:03.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0cd120 0x7f4efc14d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0d2620 0x7f4efc0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15c060 0x7f4efc0b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc14da90 con 0x7f4efc0cd120 2023-07-09T02:16:03.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc155770 con 0x7f4efc0d2620 2023-07-09T02:16:03.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4f00a19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc154b60 con 0x7f4efc15c060 2023-07-09T02:16:03.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4efa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0cd120 0x7f4efc14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4efa59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0cd120 0x7f4efc14d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53622/0 (socket says 172.21.15.45:53622) 2023-07-09T02:16:03.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4efa59c640 1 -- 172.21.15.45:0/1595887493 learned_addr learned my addr 172.21.15.45:0/1595887493 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:03.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4ef3fff640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0d2620 0x7f4efc0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.393+0000 7f4efad9d640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15c060 0x7f4efc0b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4efa59c640 1 -- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15c060 msgr2=0x7f4efc0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4efa59c640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15c060 0x7f4efc0b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4efa59c640 1 -- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0d2620 msgr2=0x7f4efc0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4efa59c640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0d2620 0x7f4efc0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4efa59c640 1 -- 172.21.15.45:0/1595887493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee40094d0 con 0x7f4efc0cd120 2023-07-09T02:16:03.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4ef3fff640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0d2620 0x7f4efc0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:03.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4efa59c640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0cd120 0x7f4efc14d550 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c3c0 tx=0x7f4eec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec0052d0 con 0x7f4efc0cd120 2023-07-09T02:16:03.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec005430 con 0x7f4efc0cd120 2023-07-09T02:16:03.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec003840 con 0x7f4efc0cd120 2023-07-09T02:16:03.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc0b59f0 con 0x7f4efc0cd120 2023-07-09T02:16:03.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc155120 con 0x7f4efc0cd120 2023-07-09T02:16:03.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc04d7d0 con 0x7f4efc0cd120 2023-07-09T02:16:03.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4eec0039a0 con 0x7f4efc0cd120 2023-07-09T02:16:03.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4ef2ffd640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4edc0662b0 0x7f4edc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.397+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4eec0832c0 con 0x7f4efc0cd120 2023-07-09T02:16:03.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.401+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7f4edc06e3f0 con 0x7f4efc0cd120 2023-07-09T02:16:03.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.401+0000 7f4ef3fff640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4edc0662b0 0x7f4edc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.401+0000 7f4ef3fff640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4edc0662b0 0x7f4edc068760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40ae000 tx=0x7f4ee40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.401+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4eec0506a0 con 0x7f4efc0cd120 2023-07-09T02:16:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.477+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(94..94 src has 1..94) v4 ==== 296+0+0 (secure 0 0 0) 0x7f4eec058320 con 0x7f4efc0cd120 2023-07-09T02:16:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.481+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f4edc06ec30 con 0x7f4efc0cd120 2023-07-09T02:16:03.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4efc06baa0 con 0x7f4efc0cd120 2023-07-09T02:16:03.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4ef2ffd640 1 -- 172.21.15.45:0/1595887493 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4eec017060 con 0x7f4efc0cd120 2023-07-09T02:16:03.561 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:16:03.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4edc0662b0 msgr2=0x7f4edc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4edc0662b0 0x7f4edc068760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40ae000 tx=0x7f4ee40a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:03.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0cd120 msgr2=0x7f4efc14d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0cd120 0x7f4efc14d550 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c3c0 tx=0x7f4eec00c880 comp rx=0 tx=0).stop 2023-07-09T02:16:03.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 shutdown_connections 2023-07-09T02:16:03.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4edc0662b0 0x7f4edc068760 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15c060 0x7f4efc0b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0d2620 0x7f4efc0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 --2- 172.21.15.45:0/1595887493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0cd120 0x7f4efc14d550 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 >> 172.21.15.45:0/1595887493 conn(0x7f4efc0698e0 msgr2=0x7f4efc0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:03.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 shutdown_connections 2023-07-09T02:16:03.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.561+0000 7f4f00a19640 1 -- 172.21.15.45:0/1595887493 wait complete. 2023-07-09T02:16:03.582 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:16:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8228540640 1 Processor -- start 2023-07-09T02:16:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8228540640 1 -- start start 2023-07-09T02:16:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8228540640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f822015c060 0x7f82200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8228540640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82200cd120 0x7f82200d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8228540640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f82200d2450 0x7f82200d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8228540640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200d28f0 con 0x7f82200cd120 2023-07-09T02:16:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8228540640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8220160a50 con 0x7f82200d2450 2023-07-09T02:16:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8228540640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822015c430 con 0x7f822015c060 2023-07-09T02:16:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8225adb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82200cd120 0x7f82200d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8225adb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82200cd120 0x7f82200d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53624/0 (socket says 172.21.15.45:53624) 2023-07-09T02:16:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8225adb640 1 -- 172.21.15.45:0/184090777 learned_addr learned my addr 172.21.15.45:0/184090777 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f82262dc640 1 --2- 172.21.15.45:0/184090777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f822015c060 0x7f82200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8226add640 1 --2- 172.21.15.45:0/184090777 >> v2:172.21.15.155:3300/0 conn(0x7f82200d2450 0x7f82200d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8225adb640 1 -- 172.21.15.45:0/184090777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f822015c060 msgr2=0x7f82200b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8225adb640 1 --2- 172.21.15.45:0/184090777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f822015c060 0x7f82200b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8225adb640 1 -- 172.21.15.45:0/184090777 >> v2:172.21.15.155:3300/0 conn(0x7f82200d2450 msgr2=0x7f82200d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:03.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8225adb640 1 --2- 172.21.15.45:0/184090777 >> v2:172.21.15.155:3300/0 conn(0x7f82200d2450 0x7f82200d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.729+0000 7f8225adb640 1 -- 172.21.15.45:0/184090777 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822015fb60 con 0x7f82200cd120 2023-07-09T02:16:03.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8225adb640 1 --2- 172.21.15.45:0/184090777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200d1f10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f822006b120 tx=0x7f821001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0302d4ed51febe0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f82252da640 1 -- 172.21.15.45:0/184090777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100ab600 con 0x7f82200cd120 2023-07-09T02:16:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f82252da640 1 -- 172.21.15.45:0/184090777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82100a7050 con 0x7f82200cd120 2023-07-09T02:16:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f82252da640 1 -- 172.21.15.45:0/184090777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100ab980 con 0x7f82200cd120 2023-07-09T02:16:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 -- 172.21.15.45:0/184090777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 msgr2=0x7f82200d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 --2- 172.21.15.45:0/184090777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200d1f10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f822006b120 tx=0x7f821001c210 comp rx=0 tx=0).stop 2023-07-09T02:16:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 -- 172.21.15.45:0/184090777 shutdown_connections 2023-07-09T02:16:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 --2- 172.21.15.45:0/184090777 >> v2:172.21.15.155:3300/0 conn(0x7f82200d2450 0x7f82200d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 --2- 172.21.15.45:0/184090777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200d1f10 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 --2- 172.21.15.45:0/184090777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f822015c060 0x7f82200b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 -- 172.21.15.45:0/184090777 >> 172.21.15.45:0/184090777 conn(0x7f82200698e0 msgr2=0x7f8220069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 -- 172.21.15.45:0/184090777 shutdown_connections 2023-07-09T02:16:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.733+0000 7f8228540640 1 -- 172.21.15.45:0/184090777 wait complete. 2023-07-09T02:16:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 Processor -- start 2023-07-09T02:16:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 -- start start 2023-07-09T02:16:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82200d2450 0x7f8220141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822015c060 0x7f822015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200c8d90 con 0x7f82200cd120 2023-07-09T02:16:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200b72d0 con 0x7f822015c060 2023-07-09T02:16:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822015d100 con 0x7f82200d2450 2023-07-09T02:16:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53628/0 (socket says 172.21.15.45:53628) 2023-07-09T02:16:03.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 -- 172.21.15.45:0/3658970996 learned_addr learned my addr 172.21.15.45:0/3658970996 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:03.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8225adb640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82200d2450 0x7f8220141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8226add640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822015c060 0x7f822015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 -- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82200d2450 msgr2=0x7f8220141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82200d2450 0x7f8220141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 -- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822015c060 msgr2=0x7f822015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822015c060 0x7f822015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 -- 172.21.15.45:0/3658970996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82100094d0 con 0x7f82200cd120 2023-07-09T02:16:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8226add640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822015c060 0x7f822015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f82262dc640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200c8850 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d5f0 tx=0x7f821c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8216ffd640 1 -- 172.21.15.45:0/3658970996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c0125f0 con 0x7f82200cd120 2023-07-09T02:16:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8216ffd640 1 -- 172.21.15.45:0/3658970996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c012750 con 0x7f82200cd120 2023-07-09T02:16:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8216ffd640 1 -- 172.21.15.45:0/3658970996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c012ae0 con 0x7f82200cd120 2023-07-09T02:16:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822015d3e0 con 0x7f82200cd120 2023-07-09T02:16:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.737+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82200b7870 con 0x7f82200cd120 2023-07-09T02:16:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.741+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822004d7d0 con 0x7f82200cd120 2023-07-09T02:16:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.741+0000 7f8216ffd640 1 -- 172.21.15.45:0/3658970996 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f821c012c40 con 0x7f82200cd120 2023-07-09T02:16:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.741+0000 7f8216ffd640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8204066280 0x7f8204068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.741+0000 7f8216ffd640 1 -- 172.21.15.45:0/3658970996 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f821c084210 con 0x7f82200cd120 2023-07-09T02:16:03.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.741+0000 7f8216ffd640 1 -- 172.21.15.45:0/3658970996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f820406e3c0 con 0x7f82200cd120 2023-07-09T02:16:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.741+0000 7f8225adb640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8204066280 0x7f8204068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.741+0000 7f8225adb640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8204066280 0x7f8204068730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f82100ad000 tx=0x7f82100a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.745+0000 7f8216ffd640 1 -- 172.21.15.45:0/3658970996 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f821c0515f0 con 0x7f82200cd120 2023-07-09T02:16:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.897+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f822006baa0 con 0x7f82200cd120 2023-07-09T02:16:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.897+0000 7f8216ffd640 1 -- 172.21.15.45:0/3658970996 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f821c007380 con 0x7f82200cd120 2023-07-09T02:16:03.901 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:16:03.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8204066280 msgr2=0x7f8204068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8204066280 0x7f8204068730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f82100ad000 tx=0x7f82100a6000 comp rx=0 tx=0).stop 2023-07-09T02:16:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 msgr2=0x7f82200c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200c8850 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d5f0 tx=0x7f821c00dab0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 shutdown_connections 2023-07-09T02:16:03.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822015c060 0x7f822015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8204066280 0x7f8204068730 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82200d2450 0x7f8220141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 --2- 172.21.15.45:0/3658970996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82200cd120 0x7f82200c8850 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 >> 172.21.15.45:0/3658970996 conn(0x7f82200698e0 msgr2=0x7f82200b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 shutdown_connections 2023-07-09T02:16:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:03.901+0000 7f8228540640 1 -- 172.21.15.45:0/3658970996 wait complete. 2023-07-09T02:16:03.922 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:04.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f2925ffa640 1 Processor -- start 2023-07-09T02:16:04.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f2925ffa640 1 -- start start 2023-07-09T02:16:04.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f2925ffa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f29200c8d10 0x7f29200c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f2925ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f292015db00 0x7f292015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f2925ffa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292006bf30 con 0x7f29200ca0f0 2023-07-09T02:16:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f2925ffa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292015e4c0 con 0x7f29200c8d10 2023-07-09T02:16:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f2925ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292006bc50 con 0x7f292015db00 2023-07-09T02:16:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f291f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f29200ca0f0 0x7f29200cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33564/0 (socket says 172.21.15.45:33564) 2023-07-09T02:16:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f291f7fe640 1 -- 172.21.15.45:0/1919766059 learned_addr learned my addr 172.21.15.45:0/1919766059 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f291effd640 1 --2- 172.21.15.45:0/1919766059 >> v2:172.21.15.155:3300/0 conn(0x7f29200c8d10 0x7f29200c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f291ffff640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f292015db00 0x7f292015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797714166 0 0) 0x7f292006bf30 con 0x7f29200ca0f0 2023-07-09T02:16:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.065+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2908003530 con 0x7f29200ca0f0 2023-07-09T02:16:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896228449 0 0) 0x7f2908003530 con 0x7f29200ca0f0 2023-07-09T02:16:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f292015db00 msgr2=0x7f292015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f292015db00 0x7f292015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 >> v2:172.21.15.155:3300/0 conn(0x7f29200c8d10 msgr2=0x7f29200c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:04.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 --2- 172.21.15.45:0/1919766059 >> v2:172.21.15.155:3300/0 conn(0x7f29200c8d10 0x7f29200c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200cab90 con 0x7f29200ca0f0 2023-07-09T02:16:04.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f2910001680 con 0x7f29200ca0f0 2023-07-09T02:16:04.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 >> v1:172.21.15.45:6789/0 conn(0x7f29200ca0f0 legacy=0x7f29200cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2908003980 0x7f2908003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29080043b0 0x7f2908004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f292015db00 0x7f2908004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292015e4c0 con 0x7f2908003980 2023-07-09T02:16:04.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292006bc50 con 0x7f29080043b0 2023-07-09T02:16:04.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290800fda0 con 0x7f292015db00 2023-07-09T02:16:04.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291f7fe640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2908003980 0x7f2908003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291ffff640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f292015db00 0x7f2908004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291effd640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29080043b0 0x7f2908004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291f7fe640 1 -- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f292015db00 msgr2=0x7f2908004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:04.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291f7fe640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f292015db00 0x7f2908004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291f7fe640 1 -- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29080043b0 msgr2=0x7f2908004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:04.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291f7fe640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29080043b0 0x7f2908004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291f7fe640 1 -- 172.21.15.45:0/1919766059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908003530 con 0x7f2908003980 2023-07-09T02:16:04.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291effd640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29080043b0 0x7f2908004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.069+0000 7f291f7fe640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2908003980 0x7f2908003d90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f291000c270 tx=0x7f291001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e08bc542719582 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100058e0 con 0x7f2908003980 2023-07-09T02:16:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910005a40 con 0x7f2908003980 2023-07-09T02:16:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f291e7fc640 1 -- 172.21.15.45:0/1919766059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910005c10 con 0x7f2908003980 2023-07-09T02:16:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- 172.21.15.45:0/1919766059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2908003980 msgr2=0x7f2908003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 --2- 172.21.15.45:0/1919766059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2908003980 0x7f2908003d90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f291000c270 tx=0x7f291001cc60 comp rx=0 tx=0).stop 2023-07-09T02:16:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f291ffff640 1 -- 172.21.15.45:0/1919766059 reap_dead start 2023-07-09T02:16:04.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- 172.21.15.45:0/1919766059 shutdown_connections 2023-07-09T02:16:04.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- 172.21.15.45:0/1919766059 >> 172.21.15.45:0/1919766059 conn(0x7f29200694b0 msgr2=0x7f29200698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:04.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- 172.21.15.45:0/1919766059 shutdown_connections 2023-07-09T02:16:04.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- 172.21.15.45:0/1919766059 wait complete. 2023-07-09T02:16:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 Processor -- start 2023-07-09T02:16:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- start start 2023-07-09T02:16:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2908003980 0x7f292014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29201f0fd0 0x7f29200b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2920153420 0x7f292014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200b3680 con 0x7f29201f0fd0 2023-07-09T02:16:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200b2b60 con 0x7f2920153420 2023-07-09T02:16:04.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f2925ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29200b2de0 con 0x7f2908003980 2023-07-09T02:16:04.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.073+0000 7f291effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29201f0fd0 0x7f29200b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29201f0fd0 0x7f29200b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53642/0 (socket says 172.21.15.45:53642) 2023-07-09T02:16:04.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291effd640 1 -- 172.21.15.45:0/2755153246 learned_addr learned my addr 172.21.15.45:0/2755153246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291f7fe640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2908003980 0x7f292014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291ffff640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2920153420 0x7f292014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291effd640 1 -- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2908003980 msgr2=0x7f292014efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291effd640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2908003980 0x7f292014efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291effd640 1 -- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2920153420 msgr2=0x7f292014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291effd640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2920153420 0x7f292014e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291effd640 1 -- 172.21.15.45:0/2755153246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200b30c0 con 0x7f29201f0fd0 2023-07-09T02:16:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291ffff640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2920153420 0x7f292014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f291effd640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29201f0fd0 0x7f29200b2620 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f2914009160 tx=0x7f2914011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f2907fff640 1 -- 172.21.15.45:0/2755153246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914004220 con 0x7f29201f0fd0 2023-07-09T02:16:04.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f2907fff640 1 -- 172.21.15.45:0/2755153246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2914004380 con 0x7f29201f0fd0 2023-07-09T02:16:04.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f2907fff640 1 -- 172.21.15.45:0/2755153246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914015890 con 0x7f29201f0fd0 2023-07-09T02:16:04.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29200b33a0 con 0x7f29201f0fd0 2023-07-09T02:16:04.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29201f1440 con 0x7f29201f0fd0 2023-07-09T02:16:04.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2920162e00 con 0x7f29201f0fd0 2023-07-09T02:16:04.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f2907fff640 1 -- 172.21.15.45:0/2755153246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29140159f0 con 0x7f29201f0fd0 2023-07-09T02:16:04.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.077+0000 7f2907fff640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f290c066280 0x7f290c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.081+0000 7f2907fff640 1 -- 172.21.15.45:0/2755153246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29140840f0 con 0x7f29201f0fd0 2023-07-09T02:16:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.081+0000 7f2907fff640 1 -- 172.21.15.45:0/2755153246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f290c06e3c0 con 0x7f29201f0fd0 2023-07-09T02:16:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.081+0000 7f291f7fe640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f290c066280 0x7f290c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.081+0000 7f291f7fe640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f290c066280 0x7f290c068730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f29100aa000 tx=0x7f2910001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.081+0000 7f2907fff640 1 -- 172.21.15.45:0/2755153246 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2914022060 con 0x7f29201f0fd0 2023-07-09T02:16:04.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f292004d7d0 con 0x7f29201f0fd0 2023-07-09T02:16:04.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2907fff640 1 -- 172.21.15.45:0/2755153246 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f2914051580 con 0x7f29201f0fd0 2023-07-09T02:16:04.269 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:04.270 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1384902817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1384902817},{"type":"v1","addr":"172.21.15.45:6835","nonce":1384902817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/324339930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":324339930},{"type":"v1","addr":"172.21.15.155:6836","nonce":324339930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/355258806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":355258806},{"type":"v1","addr":"172.21.15.45:6833","nonce":355258806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:15:13.977165+0000","modified":"2023-07-09T02:15:17.606626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6537":{"gid":6537,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1667885237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1667885237},{"type":"v1","addr":"172.21.15.155:6837","nonce":1667885237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T02:16:04.270 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-07-09T02:16:04.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f290c066280 msgr2=0x7f290c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f290c066280 0x7f290c068730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f29100aa000 tx=0x7f2910001a80 comp rx=0 tx=0).stop 2023-07-09T02:16:04.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29201f0fd0 msgr2=0x7f29200b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29201f0fd0 0x7f29200b2620 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f2914009160 tx=0x7f2914011a60 comp rx=0 tx=0).stop 2023-07-09T02:16:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 shutdown_connections 2023-07-09T02:16:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2920153420 0x7f292014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29201f0fd0 0x7f29200b2620 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f290c066280 0x7f290c068730 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 --2- 172.21.15.45:0/2755153246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2908003980 0x7f292014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 >> 172.21.15.45:0/2755153246 conn(0x7f29200694b0 msgr2=0x7f2920069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 shutdown_connections 2023-07-09T02:16:04.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.269+0000 7f2925ffa640 1 -- 172.21.15.45:0/2755153246 wait complete. 2023-07-09T02:16:04.290 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:04.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f72913ac640 1 Processor -- start 2023-07-09T02:16:04.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f72913ac640 1 -- start start 2023-07-09T02:16:04.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f72913ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0d2620 0x7f728c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f72913ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f728c0cd120 0x7f728c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f72913ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c160a50 con 0x7f728c15c060 2023-07-09T02:16:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f72913ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c15c430 con 0x7f728c0cd120 2023-07-09T02:16:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f72913ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c15fb60 con 0x7f728c0d2620 2023-07-09T02:16:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f728affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f728c15c060 0x7f728c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33576/0 (socket says 172.21.15.45:33576) 2023-07-09T02:16:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f728affd640 1 -- 172.21.15.45:0/1537078114 learned_addr learned my addr 172.21.15.45:0/1537078114 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f728b7fe640 1 --2- 172.21.15.45:0/1537078114 >> v2:172.21.15.45:3300/0 conn(0x7f728c0cd120 0x7f728c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f7283fff640 1 --2- 172.21.15.45:0/1537078114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0d2620 0x7f728c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f728b7fe640 1 -- 172.21.15.45:0/1537078114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0d2620 msgr2=0x7f728c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:04.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f728b7fe640 1 --2- 172.21.15.45:0/1537078114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0d2620 0x7f728c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f728b7fe640 1 -- 172.21.15.45:0/1537078114 >> v1:172.21.15.45:6789/0 conn(0x7f728c15c060 legacy=0x7f728c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f728b7fe640 1 -- 172.21.15.45:0/1537078114 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c15fe40 con 0x7f728c0cd120 2023-07-09T02:16:04.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.433+0000 7f7283fff640 1 --2- 172.21.15.45:0/1537078114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0d2620 0x7f728c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:04.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f728b7fe640 1 --2- 172.21.15.45:0/1537078114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c0cd120 0x7f728c0cee30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7284009d90 tx=0x7f728401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7b09cabd952980 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f728a7fc640 1 -- 172.21.15.45:0/1537078114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840a59e0 con 0x7f728c0cd120 2023-07-09T02:16:04.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f728a7fc640 1 -- 172.21.15.45:0/1537078114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72840a5b40 con 0x7f728c0cd120 2023-07-09T02:16:04.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f728a7fc640 1 -- 172.21.15.45:0/1537078114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840ad440 con 0x7f728c0cd120 2023-07-09T02:16:04.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f72913ac640 1 -- 172.21.15.45:0/1537078114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c0cd120 msgr2=0x7f728c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f72913ac640 1 --2- 172.21.15.45:0/1537078114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c0cd120 0x7f728c0cee30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7284009d90 tx=0x7f728401c920 comp rx=0 tx=0).stop 2023-07-09T02:16:04.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f72913ac640 1 -- 172.21.15.45:0/1537078114 shutdown_connections 2023-07-09T02:16:04.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f72913ac640 1 --2- 172.21.15.45:0/1537078114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c0cd120 0x7f728c0cee30 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f72913ac640 1 --2- 172.21.15.45:0/1537078114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0d2620 0x7f728c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f72913ac640 1 -- 172.21.15.45:0/1537078114 >> 172.21.15.45:0/1537078114 conn(0x7f728c0698e0 msgr2=0x7f728c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:04.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f72913ac640 1 -- 172.21.15.45:0/1537078114 shutdown_connections 2023-07-09T02:16:04.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.437+0000 7f72913ac640 1 -- 172.21.15.45:0/1537078114 wait complete. 2023-07-09T02:16:04.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 Processor -- start 2023-07-09T02:16:04.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 -- start start 2023-07-09T02:16:04.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0cd120 0x7f728c15c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f728c0d2620 0x7f728c15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c15c060 0x7f728c0c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c15cf70 con 0x7f728c15c060 2023-07-09T02:16:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c15d250 con 0x7f728c0d2620 2023-07-09T02:16:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c15d530 con 0x7f728c0cd120 2023-07-09T02:16:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c15c060 0x7f728c0c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c15c060 0x7f728c0c9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53652/0 (socket says 172.21.15.45:53652) 2023-07-09T02:16:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 -- 172.21.15.45:0/1869871839 learned_addr learned my addr 172.21.15.45:0/1869871839 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728affd640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0cd120 0x7f728c15c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f7283fff640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f728c0d2620 0x7f728c15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 -- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0cd120 msgr2=0x7f728c15c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0cd120 0x7f728c15c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 -- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f728c0d2620 msgr2=0x7f728c15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f728c0d2620 0x7f728c15e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 -- 172.21.15.45:0/1869871839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7284009a70 con 0x7f728c15c060 2023-07-09T02:16:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f7283fff640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f728c0d2620 0x7f728c15e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f728b7fe640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c15c060 0x7f728c0c9f90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f72840b0040 tx=0x7f72840196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840ade40 con 0x7f728c15c060 2023-07-09T02:16:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7284009450 con 0x7f728c15c060 2023-07-09T02:16:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840b9690 con 0x7f728c15c060 2023-07-09T02:16:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c0b59f0 con 0x7f728c15c060 2023-07-09T02:16:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.441+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c15daf0 con 0x7f728c15c060 2023-07-09T02:16:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.445+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c15dce0 con 0x7f728c15c060 2023-07-09T02:16:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.445+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72840b97f0 con 0x7f728c15c060 2023-07-09T02:16:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.445+0000 7f72837fe640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f726c066280 0x7f726c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.445+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f728411f5f0 con 0x7f728c15c060 2023-07-09T02:16:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.445+0000 7f728affd640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f726c066280 0x7f726c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.445+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=95}) v3 -- 0x7f726c06e3c0 con 0x7f728c15c060 2023-07-09T02:16:04.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.445+0000 7f728affd640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f726c066280 0x7f726c068730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f727c005890 tx=0x7f727c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.449+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72840eca60 con 0x7f728c15c060 2023-07-09T02:16:04.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.481+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(95..95 src has 1..95) v4 ==== 1806+0+0 (secure 0 0 0) 0x7f72840f46e0 con 0x7f728c15c060 2023-07-09T02:16:04.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.481+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=96}) v3 -- 0x7f726c06f8c0 con 0x7f728c15c060 2023-07-09T02:16:04.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.609+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f728c15d390 con 0x7f728c15c060 2023-07-09T02:16:04.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.609+0000 7f72837fe640 1 -- 172.21.15.45:0/1869871839 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18354 (secure 0 0 0) 0x7f728c15d390 con 0x7f728c15c060 2023-07-09T02:16:04.612 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:04.612 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":95,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:04.481770+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:15:12.532657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T02:15:12.972198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:04.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f726c066280 msgr2=0x7f726c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f726c066280 0x7f726c068730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f727c005890 tx=0x7f727c009040 comp rx=0 tx=0).stop 2023-07-09T02:16:04.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c15c060 msgr2=0x7f728c0c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c15c060 0x7f728c0c9f90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f72840b0040 tx=0x7f72840196c0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 shutdown_connections 2023-07-09T02:16:04.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f728c15c060 0x7f728c0c9f90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f728c0d2620 0x7f728c15e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f726c066280 0x7f726c068730 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 --2- 172.21.15.45:0/1869871839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f728c0cd120 0x7f728c15c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 >> 172.21.15.45:0/1869871839 conn(0x7f728c0698e0 msgr2=0x7f728c0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:04.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 shutdown_connections 2023-07-09T02:16:04.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.613+0000 7f72913ac640 1 -- 172.21.15.45:0/1869871839 wait complete. 2023-07-09T02:16:04.633 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:16:04.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:04.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848759e640 1 Processor -- start 2023-07-09T02:16:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848759e640 1 -- start start 2023-07-09T02:16:04.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b4ae0 0x7f84880ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8488160670 0x7f84880d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84880cd5d0 con 0x7f84880c8d40 2023-07-09T02:16:04.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84880d2050 con 0x7f8488160670 2023-07-09T02:16:04.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84880d27a0 con 0x7f84880b4ae0 2023-07-09T02:16:04.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84880c8d40 0x7f84880b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33586/0 (socket says 172.21.15.45:33586) 2023-07-09T02:16:04.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f848659c640 1 -- 172.21.15.45:0/3806292175 learned_addr learned my addr 172.21.15.45:0/3806292175 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f8486d9d640 1 --2- 172.21.15.45:0/3806292175 >> v2:172.21.15.45:3300/0 conn(0x7f8488160670 0x7f84880d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f847ffff640 1 --2- 172.21.15.45:0/3806292175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b4ae0 0x7f84880ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f8486d9d640 1 -- 172.21.15.45:0/3806292175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b4ae0 msgr2=0x7f84880ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f8486d9d640 1 --2- 172.21.15.45:0/3806292175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b4ae0 0x7f84880ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f8486d9d640 1 -- 172.21.15.45:0/3806292175 >> v1:172.21.15.45:6789/0 conn(0x7f84880c8d40 legacy=0x7f84880b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.777+0000 7f8486d9d640 1 -- 172.21.15.45:0/3806292175 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84880ced30 con 0x7f8488160670 2023-07-09T02:16:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f8486d9d640 1 --2- 172.21.15.45:0/3806292175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f84880d0490 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8480009d90 tx=0x7f848001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb708d1a06f248f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f8485d9b640 1 -- 172.21.15.45:0/3806292175 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800af600 con 0x7f8488160670 2023-07-09T02:16:04.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f8485d9b640 1 -- 172.21.15.45:0/3806292175 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84800ab050 con 0x7f8488160670 2023-07-09T02:16:04.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f8485d9b640 1 -- 172.21.15.45:0/3806292175 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800af980 con 0x7f8488160670 2023-07-09T02:16:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f848759e640 1 -- 172.21.15.45:0/3806292175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 msgr2=0x7f84880d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f848759e640 1 --2- 172.21.15.45:0/3806292175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f84880d0490 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8480009d90 tx=0x7f848001f130 comp rx=0 tx=0).stop 2023-07-09T02:16:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f848759e640 1 -- 172.21.15.45:0/3806292175 shutdown_connections 2023-07-09T02:16:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f848759e640 1 --2- 172.21.15.45:0/3806292175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f84880d0490 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f848759e640 1 --2- 172.21.15.45:0/3806292175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b4ae0 0x7f84880ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f848759e640 1 -- 172.21.15.45:0/3806292175 >> 172.21.15.45:0/3806292175 conn(0x7f84880d2950 msgr2=0x7f84880d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f848759e640 1 -- 172.21.15.45:0/3806292175 shutdown_connections 2023-07-09T02:16:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.781+0000 7f848759e640 1 -- 172.21.15.45:0/3806292175 wait complete. 2023-07-09T02:16:04.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 Processor -- start 2023-07-09T02:16:04.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 -- start start 2023-07-09T02:16:04.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b4ae0 0x7f8488159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880c8d40 0x7f848815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f848815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84880b5a20 con 0x7f8488160670 2023-07-09T02:16:04.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488160250 con 0x7f84880b4ae0 2023-07-09T02:16:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8488159a40 con 0x7f84880c8d40 2023-07-09T02:16:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f848815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f848815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53672/0 (socket says 172.21.15.45:53672) 2023-07-09T02:16:04.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 -- 172.21.15.45:0/508712058 learned_addr learned my addr 172.21.15.45:0/508712058 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848659c640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b4ae0 0x7f8488159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f847ffff640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880c8d40 0x7f848815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 -- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880c8d40 msgr2=0x7f848815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880c8d40 0x7f848815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 -- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b4ae0 msgr2=0x7f8488159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b4ae0 0x7f8488159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 -- 172.21.15.45:0/508712058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8480009a70 con 0x7f8488160670 2023-07-09T02:16:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f847ffff640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880c8d40 0x7f848815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848659c640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b4ae0 0x7f8488159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f8486d9d640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f848815c710 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8480009d90 tx=0x7f848001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f847effd640 1 -- 172.21.15.45:0/508712058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480009450 con 0x7f8488160670 2023-07-09T02:16:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f847effd640 1 -- 172.21.15.45:0/508712058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84800b9620 con 0x7f8488160670 2023-07-09T02:16:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f847effd640 1 -- 172.21.15.45:0/508712058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800b99d0 con 0x7f8488160670 2023-07-09T02:16:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848815f9b0 con 0x7f8488160670 2023-07-09T02:16:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.785+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848815ff70 con 0x7f8488160670 2023-07-09T02:16:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.789+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84880b5780 con 0x7f8488160670 2023-07-09T02:16:04.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.789+0000 7f847effd640 1 -- 172.21.15.45:0/508712058 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84800b6070 con 0x7f8488160670 2023-07-09T02:16:04.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.789+0000 7f847effd640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84680662b0 0x7f8468068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:04.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.789+0000 7f847effd640 1 -- 172.21.15.45:0/508712058 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84801223f0 con 0x7f8488160670 2023-07-09T02:16:04.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.789+0000 7f848659c640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84680662b0 0x7f8468068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:04.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.789+0000 7f848659c640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84680662b0 0x7f8468068760 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8478005890 tx=0x7f8478009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:04.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.793+0000 7f847effd640 1 -- 172.21.15.45:0/508712058 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84880b5780 con 0x7f8488160670 2023-07-09T02:16:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.977+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84880b5b60 con 0x7f8488160670 2023-07-09T02:16:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f847effd640 1 -- 172.21.15.45:0/508712058 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f84880b5b60 con 0x7f8488160670 2023-07-09T02:16:04.981 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:04.981 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1384902817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1384902817},{"type":"v1","addr":"172.21.15.45:6835","nonce":1384902817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/324339930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":324339930},{"type":"v1","addr":"172.21.15.155:6836","nonce":324339930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/355258806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":355258806},{"type":"v1","addr":"172.21.15.45:6833","nonce":355258806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:15:13.977165+0000","modified":"2023-07-09T02:15:17.606626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6537":{"gid":6537,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1667885237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1667885237},{"type":"v1","addr":"172.21.15.155:6837","nonce":1667885237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T02:16:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-07-09T02:16:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84680662b0 msgr2=0x7f8468068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84680662b0 0x7f8468068760 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8478005890 tx=0x7f8478009040 comp rx=0 tx=0).stop 2023-07-09T02:16:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 msgr2=0x7f848815c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f848815c710 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8480009d90 tx=0x7f848001bed0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 shutdown_connections 2023-07-09T02:16:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8488160670 0x7f848815c710 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84680662b0 0x7f8468068760 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880c8d40 0x7f848815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 --2- 172.21.15.45:0/508712058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880b4ae0 0x7f8488159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 >> 172.21.15.45:0/508712058 conn(0x7f84880d2950 msgr2=0x7f84880c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 shutdown_connections 2023-07-09T02:16:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:04.981+0000 7f848759e640 1 -- 172.21.15.45:0/508712058 wait complete. 2023-07-09T02:16:05.002 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:05.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f108dbe9640 1 Processor -- start 2023-07-09T02:16:05.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f108dbe9640 1 -- start start 2023-07-09T02:16:05.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f108dbe9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f108806aa40 0x7f10881604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f108dbe9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1088071140 con 0x7f10880cd290 2023-07-09T02:16:05.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f108dbe9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108806b010 con 0x7f108806a5c0 2023-07-09T02:16:05.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f108dbe9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108815c970 con 0x7f108806aa40 2023-07-09T02:16:05.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f10877fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f10880cd290 0x7f10880cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33600/0 (socket says 172.21.15.45:33600) 2023-07-09T02:16:05.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f10877fe640 1 -- 172.21.15.45:0/191973895 learned_addr learned my addr 172.21.15.45:0/191973895 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:05.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f1087fff640 1 --2- 172.21.15.45:0/191973895 >> v2:172.21.15.155:3300/0 conn(0x7f108806aa40 0x7f10881604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f1086ffd640 1 -- 172.21.15.45:0/191973895 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20887095 0 0) 0x7f1088071140 con 0x7f10880cd290 2023-07-09T02:16:05.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f1086ffd640 1 -- 172.21.15.45:0/191973895 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1074003530 con 0x7f10880cd290 2023-07-09T02:16:05.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f1087fff640 1 -- 172.21.15.45:0/191973895 >> v1:172.21.15.155:6789/0 conn(0x7f108806a5c0 legacy=0x7f108815fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f1087fff640 1 -- 172.21.15.45:0/191973895 >> v1:172.21.15.45:6789/0 conn(0x7f10880cd290 legacy=0x7f10880cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.145+0000 7f1087fff640 1 -- 172.21.15.45:0/191973895 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108815cc50 con 0x7f108806aa40 2023-07-09T02:16:05.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f1087fff640 1 --2- 172.21.15.45:0/191973895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 0x7f10881604e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1080009d90 tx=0x7f108001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc55feaa722fab29 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f1086ffd640 1 -- 172.21.15.45:0/191973895 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800a5810 con 0x7f108806aa40 2023-07-09T02:16:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f1086ffd640 1 -- 172.21.15.45:0/191973895 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800a5970 con 0x7f108806aa40 2023-07-09T02:16:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f1086ffd640 1 -- 172.21.15.45:0/191973895 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800a5d00 con 0x7f108806aa40 2023-07-09T02:16:05.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f108dbe9640 1 -- 172.21.15.45:0/191973895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 msgr2=0x7f10881604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f108dbe9640 1 --2- 172.21.15.45:0/191973895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 0x7f10881604e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1080009d90 tx=0x7f108001c950 comp rx=0 tx=0).stop 2023-07-09T02:16:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f108dbe9640 1 -- 172.21.15.45:0/191973895 shutdown_connections 2023-07-09T02:16:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f108dbe9640 1 --2- 172.21.15.45:0/191973895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 0x7f10881604e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f108dbe9640 1 -- 172.21.15.45:0/191973895 >> 172.21.15.45:0/191973895 conn(0x7f108806d140 msgr2=0x7f108806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:05.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f108dbe9640 1 -- 172.21.15.45:0/191973895 shutdown_connections 2023-07-09T02:16:05.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.149+0000 7f108dbe9640 1 -- 172.21.15.45:0/191973895 wait complete. 2023-07-09T02:16:05.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 Processor -- start 2023-07-09T02:16:05.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 -- start start 2023-07-09T02:16:05.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108806a5c0 0x7f108814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 0x7f108814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10880cd290 0x7f10881f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108814a190 con 0x7f10880cd290 2023-07-09T02:16:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1088147b10 con 0x7f108806aa40 2023-07-09T02:16:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108814f140 con 0x7f108806a5c0 2023-07-09T02:16:05.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10880cd290 0x7f10881f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10880cd290 0x7f10881f88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53680/0 (socket says 172.21.15.45:53680) 2023-07-09T02:16:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 -- 172.21.15.45:0/2161407660 learned_addr learned my addr 172.21.15.45:0/2161407660 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f107ffff640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 0x7f108814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f10877fe640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108806a5c0 0x7f108814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 -- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108806a5c0 msgr2=0x7f108814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108806a5c0 0x7f108814ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 -- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 msgr2=0x7f108814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 0x7f108814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 -- 172.21.15.45:0/2161407660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080009a70 con 0x7f10880cd290 2023-07-09T02:16:05.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1087fff640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10880cd290 0x7f10881f88d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1080019560 tx=0x7f10800196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1084ff9640 1 -- 172.21.15.45:0/2161407660 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800b9650 con 0x7f10880cd290 2023-07-09T02:16:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1084ff9640 1 -- 172.21.15.45:0/2161407660 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800b97d0 con 0x7f10880cd290 2023-07-09T02:16:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108814f420 con 0x7f10880cd290 2023-07-09T02:16:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f1084ff9640 1 -- 172.21.15.45:0/2161407660 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800b9b80 con 0x7f10880cd290 2023-07-09T02:16:05.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.153+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10881477a0 con 0x7f10880cd290 2023-07-09T02:16:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.157+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108814a2d0 con 0x7f10880cd290 2023-07-09T02:16:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.157+0000 7f1084ff9640 1 -- 172.21.15.45:0/2161407660 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10800b9ce0 con 0x7f10880cd290 2023-07-09T02:16:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.157+0000 7f1084ff9640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1068066280 0x7f1068068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.157+0000 7f1084ff9640 1 -- 172.21.15.45:0/2161407660 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f108011ee60 con 0x7f10880cd290 2023-07-09T02:16:05.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.157+0000 7f10877fe640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1068066280 0x7f1068068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.157+0000 7f10877fe640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1068066280 0x7f1068068730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f10780011f0 tx=0x7f1078009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.161+0000 7f1084ff9640 1 -- 172.21.15.45:0/2161407660 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f108814a2d0 con 0x7f10880cd290 2023-07-09T02:16:05.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f108814a2d0 con 0x7f10880cd290 2023-07-09T02:16:05.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f1084ff9640 1 -- 172.21.15.45:0/2161407660 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f108814a2d0 con 0x7f10880cd290 2023-07-09T02:16:05.349 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:05.349 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1384902817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1384902817},{"type":"v1","addr":"172.21.15.45:6835","nonce":1384902817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/324339930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":324339930},{"type":"v1","addr":"172.21.15.155:6836","nonce":324339930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/355258806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":355258806},{"type":"v1","addr":"172.21.15.45:6833","nonce":355258806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:15:13.977165+0000","modified":"2023-07-09T02:15:17.606626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6537":{"gid":6537,"name":"b","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1667885237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1667885237},{"type":"v1","addr":"172.21.15.155:6837","nonce":1667885237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T02:16:05.350 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-07-09T02:16:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1068066280 msgr2=0x7f1068068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1068066280 0x7f1068068730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f10780011f0 tx=0x7f1078009040 comp rx=0 tx=0).stop 2023-07-09T02:16:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10880cd290 msgr2=0x7f10881f88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10880cd290 0x7f10881f88d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1080019560 tx=0x7f10800196f0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 shutdown_connections 2023-07-09T02:16:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10880cd290 0x7f10881f88d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108806aa40 0x7f108814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1068066280 0x7f1068068730 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 --2- 172.21.15.45:0/2161407660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108806a5c0 0x7f108814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 >> 172.21.15.45:0/2161407660 conn(0x7f108806d140 msgr2=0x7f108806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 shutdown_connections 2023-07-09T02:16:05.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.349+0000 7f108dbe9640 1 -- 172.21.15.45:0/2161407660 wait complete. 2023-07-09T02:16:05.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3898e6d640 1 Processor -- start 2023-07-09T02:16:05.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3898e6d640 1 -- start start 2023-07-09T02:16:05.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3898e6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389415c060 0x7f38940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3898e6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f38940cd120 0x7f38940d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3898e6d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3894160a50 con 0x7f38940d2450 2023-07-09T02:16:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3898e6d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38940d28f0 con 0x7f38940cd120 2023-07-09T02:16:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3898e6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940cfe40 con 0x7f389415c060 2023-07-09T02:16:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3892d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f38940d2450 0x7f38940d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33610/0 (socket says 172.21.15.45:33610) 2023-07-09T02:16:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3892d9d640 1 -- 172.21.15.45:0/2065155693 learned_addr learned my addr 172.21.15.45:0/2065155693 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f388bfff640 1 --2- 172.21.15.45:0/2065155693 >> v2:172.21.15.155:3300/0 conn(0x7f38940cd120 0x7f38940d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f389259c640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389415c060 0x7f38940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951365345 0 0) 0x7f3894160a50 con 0x7f38940d2450 2023-07-09T02:16:05.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3880003530 con 0x7f38940d2450 2023-07-09T02:16:05.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 277667413 0 0) 0x7f3880003530 con 0x7f38940d2450 2023-07-09T02:16:05.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389415c060 msgr2=0x7f38940b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389415c060 0x7f38940b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 >> v2:172.21.15.155:3300/0 conn(0x7f38940cd120 msgr2=0x7f38940d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 --2- 172.21.15.45:0/2065155693 >> v2:172.21.15.155:3300/0 conn(0x7f38940cd120 0x7f38940d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389415c430 con 0x7f38940d2450 2023-07-09T02:16:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f388c001a00 con 0x7f38940d2450 2023-07-09T02:16:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.517+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 >> v1:172.21.15.45:6789/0 conn(0x7f38940d2450 legacy=0x7f38940d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389415c060 0x7f3880003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3880003f00 0x7f38800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880004d10 0x7f3880005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940cfe40 con 0x7f3880003f00 2023-07-09T02:16:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388000b990 con 0x7f3880004d10 2023-07-09T02:16:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388000bad0 con 0x7f389415c060 2023-07-09T02:16:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f388bfff640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3880003f00 0x7f38800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f389259c640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389415c060 0x7f3880003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3892d9d640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880004d10 0x7f3880005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f388bfff640 1 -- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389415c060 msgr2=0x7f3880003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:05.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f388bfff640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389415c060 0x7f3880003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f388bfff640 1 -- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880004d10 msgr2=0x7f3880005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:05.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f388bfff640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880004d10 0x7f3880005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f388bfff640 1 -- 172.21.15.45:0/2065155693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880003530 con 0x7f3880003f00 2023-07-09T02:16:05.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f388bfff640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3880003f00 0x7f38800047d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f387c009ab0 tx=0x7f387c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722d2aa69de344fd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c0a5550 con 0x7f3880003f00 2023-07-09T02:16:05.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c0a56b0 con 0x7f3880003f00 2023-07-09T02:16:05.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.521+0000 7f3891d9b640 1 -- 172.21.15.45:0/2065155693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c0a5a60 con 0x7f3880003f00 2023-07-09T02:16:05.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- 172.21.15.45:0/2065155693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3880003f00 msgr2=0x7f38800047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 --2- 172.21.15.45:0/2065155693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3880003f00 0x7f38800047d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f387c009ab0 tx=0x7f387c01ca70 comp rx=0 tx=0).stop 2023-07-09T02:16:05.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3892d9d640 1 -- 172.21.15.45:0/2065155693 reap_dead start 2023-07-09T02:16:05.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- 172.21.15.45:0/2065155693 shutdown_connections 2023-07-09T02:16:05.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- 172.21.15.45:0/2065155693 >> 172.21.15.45:0/2065155693 conn(0x7f38940698e0 msgr2=0x7f3894069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:05.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- 172.21.15.45:0/2065155693 shutdown_connections 2023-07-09T02:16:05.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- 172.21.15.45:0/2065155693 wait complete. 2023-07-09T02:16:05.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 Processor -- start 2023-07-09T02:16:05.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- start start 2023-07-09T02:16:05.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880003f00 0x7f38940c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38941f5790 0x7f38940b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38940b6dd0 0x7f38940b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940cb4b0 con 0x7f38940b6dd0 2023-07-09T02:16:05.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940cb020 con 0x7f3880003f00 2023-07-09T02:16:05.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3898e6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b7780 con 0x7f38941f5790 2023-07-09T02:16:05.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3892d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38940b6dd0 0x7f38940b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3892d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38940b6dd0 0x7f38940b7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53696/0 (socket says 172.21.15.45:53696) 2023-07-09T02:16:05.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f3892d9d640 1 -- 172.21.15.45:0/2553401942 learned_addr learned my addr 172.21.15.45:0/2553401942 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:05.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f389259c640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880003f00 0x7f38940c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.525+0000 7f388bfff640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38941f5790 0x7f38940b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3892d9d640 1 -- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38941f5790 msgr2=0x7f38940b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3892d9d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38941f5790 0x7f38940b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3892d9d640 1 -- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880003f00 msgr2=0x7f38940c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3892d9d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880003f00 0x7f38940c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3892d9d640 1 -- 172.21.15.45:0/2553401942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940ca410 con 0x7f38940b6dd0 2023-07-09T02:16:05.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f388bfff640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38941f5790 0x7f38940b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:05.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3892d9d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38940b6dd0 0x7f38940b7240 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f388c000f90 tx=0x7f388c011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f388affd640 1 -- 172.21.15.45:0/2553401942 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c014370 con 0x7f38940b6dd0 2023-07-09T02:16:05.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f388affd640 1 -- 172.21.15.45:0/2553401942 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c0144d0 con 0x7f38940b6dd0 2023-07-09T02:16:05.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f388affd640 1 -- 172.21.15.45:0/2553401942 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c014880 con 0x7f38940b6dd0 2023-07-09T02:16:05.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940ca6f0 con 0x7f38940b6dd0 2023-07-09T02:16:05.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38940cacb0 con 0x7f38940b6dd0 2023-07-09T02:16:05.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38940cb1b0 con 0x7f38940b6dd0 2023-07-09T02:16:05.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f388affd640 1 -- 172.21.15.45:0/2553401942 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f388c0149e0 con 0x7f38940b6dd0 2023-07-09T02:16:05.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f388affd640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38740662b0 0x7f3874068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f388affd640 1 -- 172.21.15.45:0/2553401942 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f388c085d00 con 0x7f38940b6dd0 2023-07-09T02:16:05.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.529+0000 7f389259c640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38740662b0 0x7f3874068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.533+0000 7f389259c640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38740662b0 0x7f3874068760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3884009b00 tx=0x7f3884009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.533+0000 7f388affd640 1 -- 172.21.15.45:0/2553401942 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f388c0530e0 con 0x7f38940b6dd0 2023-07-09T02:16:05.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.693+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f389404d7d0 con 0x7f38940b6dd0 2023-07-09T02:16:05.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.693+0000 7f388affd640 1 -- 172.21.15.45:0/2553401942 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18354 (secure 0 0 0) 0x7f388c0837d0 con 0x7f38940b6dd0 2023-07-09T02:16:05.696 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:05.696 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":95,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:04.481770+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:15:12.532657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T02:15:12.972198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:05.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38740662b0 msgr2=0x7f3874068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38740662b0 0x7f3874068760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3884009b00 tx=0x7f3884009190 comp rx=0 tx=0).stop 2023-07-09T02:16:05.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38940b6dd0 msgr2=0x7f38940b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38940b6dd0 0x7f38940b7240 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f388c000f90 tx=0x7f388c011790 comp rx=0 tx=0).stop 2023-07-09T02:16:05.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 shutdown_connections 2023-07-09T02:16:05.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38940b6dd0 0x7f38940b7240 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38740662b0 0x7f3874068760 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38941f5790 0x7f38940b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 --2- 172.21.15.45:0/2553401942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3880003f00 0x7f38940c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 >> 172.21.15.45:0/2553401942 conn(0x7f38940698e0 msgr2=0x7f389415eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:05.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 shutdown_connections 2023-07-09T02:16:05.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.697+0000 7f3898e6d640 1 -- 172.21.15.45:0/2553401942 wait complete. 2023-07-09T02:16:05.717 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:16:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91d0dd2640 1 Processor -- start 2023-07-09T02:16:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91d0dd2640 1 -- start start 2023-07-09T02:16:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91d0dd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91d0dd2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0cd5d0 con 0x7f91cc0b4ae0 2023-07-09T02:16:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91d0dd2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0d2050 con 0x7f91cc0c8d40 2023-07-09T02:16:05.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91d0dd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0d27a0 con 0x7f91cc0ccf10 2023-07-09T02:16:05.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91caffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f91cc0b4ae0 0x7f91cc0d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33626/0 (socket says 172.21.15.45:33626) 2023-07-09T02:16:05.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91caffd640 1 -- 172.21.15.45:0/902892559 learned_addr learned my addr 172.21.15.45:0/902892559 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91cbfff640 1 --2- 172.21.15.45:0/902892559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91ca7fc640 1 -- 172.21.15.45:0/902892559 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686633849 0 0) 0x7f91cc0cd5d0 con 0x7f91cc0b4ae0 2023-07-09T02:16:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91ca7fc640 1 -- 172.21.15.45:0/902892559 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b4003530 con 0x7f91cc0b4ae0 2023-07-09T02:16:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91ca7fc640 1 -- 172.21.15.45:0/902892559 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103360699 0 0) 0x7f91cc0d2050 con 0x7f91cc0c8d40 2023-07-09T02:16:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91ca7fc640 1 -- 172.21.15.45:0/902892559 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91cc0cd5d0 con 0x7f91cc0c8d40 2023-07-09T02:16:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91cbfff640 1 -- 172.21.15.45:0/902892559 >> v1:172.21.15.155:6789/0 conn(0x7f91cc0c8d40 legacy=0x7f91cc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91cbfff640 1 -- 172.21.15.45:0/902892559 >> v1:172.21.15.45:6789/0 conn(0x7f91cc0b4ae0 legacy=0x7f91cc0d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91ca7fc640 1 -- 172.21.15.45:0/902892559 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1732892132 0 0) 0x7f91b4003530 con 0x7f91cc0b4ae0 2023-07-09T02:16:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.861+0000 7f91cbfff640 1 -- 172.21.15.45:0/902892559 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0cd370 con 0x7f91cc0ccf10 2023-07-09T02:16:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91cbfff640 1 --2- 172.21.15.45:0/902892559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc160670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009dc0 tx=0x7f91c401f080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b69cc1d900a83fc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91ca7fc640 1 -- 172.21.15.45:0/902892559 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0001680 con 0x7f91cc0ccf10 2023-07-09T02:16:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91ca7fc640 1 -- 172.21.15.45:0/902892559 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c40a8c10 con 0x7f91cc0ccf10 2023-07-09T02:16:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91ca7fc640 1 -- 172.21.15.45:0/902892559 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c40b0440 con 0x7f91cc0ccf10 2023-07-09T02:16:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91d0dd2640 1 -- 172.21.15.45:0/902892559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 msgr2=0x7f91cc160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91d0dd2640 1 --2- 172.21.15.45:0/902892559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc160670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009dc0 tx=0x7f91c401f080 comp rx=0 tx=0).stop 2023-07-09T02:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91d0dd2640 1 -- 172.21.15.45:0/902892559 shutdown_connections 2023-07-09T02:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91d0dd2640 1 --2- 172.21.15.45:0/902892559 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc160670 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91d0dd2640 1 -- 172.21.15.45:0/902892559 >> 172.21.15.45:0/902892559 conn(0x7f91cc0d2950 msgr2=0x7f91cc0d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91d0dd2640 1 -- 172.21.15.45:0/902892559 shutdown_connections 2023-07-09T02:16:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.865+0000 7f91d0dd2640 1 -- 172.21.15.45:0/902892559 wait complete. 2023-07-09T02:16:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 Processor -- start 2023-07-09T02:16:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 -- start start 2023-07-09T02:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc0b4ae0 0x7f91cc15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc0c8d40 0x7f91cc0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc0b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc15a9d0 con 0x7f91cc0c8d40 2023-07-09T02:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc1f24b0 con 0x7f91cc0b4ae0 2023-07-09T02:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0c9ac0 con 0x7f91cc0ccf10 2023-07-09T02:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc0c8d40 0x7f91cc0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc0c8d40 0x7f91cc0b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53712/0 (socket says 172.21.15.45:53712) 2023-07-09T02:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 -- 172.21.15.45:0/2421983309 learned_addr learned my addr 172.21.15.45:0/2421983309 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91cb7fe640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc0b4ae0 0x7f91cc15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91cbfff640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc0b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 -- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 msgr2=0x7f91cc0b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc0b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 -- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc0b4ae0 msgr2=0x7f91cc15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc0b4ae0 0x7f91cc15cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 -- 172.21.15.45:0/2421983309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4009a70 con 0x7f91cc0c8d40 2023-07-09T02:16:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91caffd640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc0c8d40 0x7f91cc0b7950 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f91c0005890 tx=0x7f91c000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91b3fff640 1 -- 172.21.15.45:0/2421983309 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0005ae0 con 0x7f91cc0c8d40 2023-07-09T02:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91b3fff640 1 -- 172.21.15.45:0/2421983309 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0005c40 con 0x7f91cc0c8d40 2023-07-09T02:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91b3fff640 1 -- 172.21.15.45:0/2421983309 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0007070 con 0x7f91cc0c8d40 2023-07-09T02:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc0c9da0 con 0x7f91cc0c8d40 2023-07-09T02:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.869+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc0ca860 con 0x7f91cc0c8d40 2023-07-09T02:16:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.873+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc04e020 con 0x7f91cc0c8d40 2023-07-09T02:16:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.873+0000 7f91b3fff640 1 -- 172.21.15.45:0/2421983309 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f91c00071d0 con 0x7f91cc0c8d40 2023-07-09T02:16:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.873+0000 7f91b3fff640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f91b8066280 0x7f91b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.873+0000 7f91b3fff640 1 -- 172.21.15.45:0/2421983309 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91c0083430 con 0x7f91cc0c8d40 2023-07-09T02:16:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.873+0000 7f91cb7fe640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f91b8066280 0x7f91b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.873+0000 7f91cb7fe640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f91b8066280 0x7f91b8068730 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0011f0 tx=0x7f91bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:05.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:05.877+0000 7f91b3fff640 1 -- 172.21.15.45:0/2421983309 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91c00508d0 con 0x7f91cc0c8d40 2023-07-09T02:16:06.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.061+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f91cc06a360 con 0x7f91cc0c8d40 2023-07-09T02:16:06.065 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:16:06.065+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:16:06.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.069+0000 7f91b3fff640 1 -- 172.21.15.45:0/2421983309 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7f91c0053ef0 con 0x7f91cc0c8d40 2023-07-09T02:16:06.071 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:16:06.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f91b8066280 msgr2=0x7f91b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:06.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f91b8066280 0x7f91b8068730 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0011f0 tx=0x7f91bc009040 comp rx=0 tx=0).stop 2023-07-09T02:16:06.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc0c8d40 msgr2=0x7f91cc0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:06.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc0c8d40 0x7f91cc0b7950 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f91c0005890 tx=0x7f91c000cbe0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 shutdown_connections 2023-07-09T02:16:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f91b8066280 0x7f91b8068730 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91cc0ccf10 0x7f91cc0b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91cc0c8d40 0x7f91cc0b7950 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 --2- 172.21.15.45:0/2421983309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc0b4ae0 0x7f91cc15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 >> 172.21.15.45:0/2421983309 conn(0x7f91cc0d2950 msgr2=0x7f91cc0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 shutdown_connections 2023-07-09T02:16:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.073+0000 7f91d0dd2640 1 -- 172.21.15.45:0/2421983309 wait complete. 2023-07-09T02:16:06.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:16:06.138 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:16:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea6631f640 1 Processor -- start 2023-07-09T02:16:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea6631f640 1 -- start start 2023-07-09T02:16:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea6631f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fea6015c060 0x7fea600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea6631f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea600cd120 0x7fea600d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea6631f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea60160a50 con 0x7fea600d2450 2023-07-09T02:16:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea6631f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600d28d0 con 0x7fea600cd120 2023-07-09T02:16:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea6631f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600cfe40 con 0x7fea6015c060 2023-07-09T02:16:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea600cd120 0x7fea600d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea600cd120 0x7fea600d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53724/0 (socket says 172.21.15.45:53724) 2023-07-09T02:16:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5f7fe640 1 -- 172.21.15.45:0/4273583681 learned_addr learned my addr 172.21.15.45:0/4273583681 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5ffff640 1 --2- 172.21.15.45:0/4273583681 >> v2:172.21.15.155:3300/0 conn(0x7fea6015c060 0x7fea600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5f7fe640 1 -- 172.21.15.45:0/4273583681 >> v2:172.21.15.155:3300/0 conn(0x7fea6015c060 msgr2=0x7fea600b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5f7fe640 1 --2- 172.21.15.45:0/4273583681 >> v2:172.21.15.155:3300/0 conn(0x7fea6015c060 0x7fea600b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5f7fe640 1 -- 172.21.15.45:0/4273583681 >> v1:172.21.15.155:6789/0 conn(0x7fea600d2450 legacy=0x7fea600d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5f7fe640 1 -- 172.21.15.45:0/4273583681 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6015c430 con 0x7fea600cd120 2023-07-09T02:16:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.237+0000 7fea5ffff640 1 --2- 172.21.15.45:0/4273583681 >> v2:172.21.15.155:3300/0 conn(0x7fea6015c060 0x7fea600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea5f7fe640 1 --2- 172.21.15.45:0/4273583681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600cd120 0x7fea600d1f10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fea600d3ad0 tx=0x7fea5401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737ce62f4be696f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea5effd640 1 -- 172.21.15.45:0/4273583681 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540ab5f0 con 0x7fea600cd120 2023-07-09T02:16:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea5effd640 1 -- 172.21.15.45:0/4273583681 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea540ab750 con 0x7fea600cd120 2023-07-09T02:16:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea5effd640 1 -- 172.21.15.45:0/4273583681 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540abae0 con 0x7fea600cd120 2023-07-09T02:16:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea6631f640 1 -- 172.21.15.45:0/4273583681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600cd120 msgr2=0x7fea600d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea6631f640 1 --2- 172.21.15.45:0/4273583681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600cd120 0x7fea600d1f10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fea600d3ad0 tx=0x7fea5401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea6631f640 1 -- 172.21.15.45:0/4273583681 shutdown_connections 2023-07-09T02:16:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea6631f640 1 --2- 172.21.15.45:0/4273583681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600cd120 0x7fea600d1f10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea6631f640 1 --2- 172.21.15.45:0/4273583681 >> v2:172.21.15.155:3300/0 conn(0x7fea6015c060 0x7fea600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea6631f640 1 -- 172.21.15.45:0/4273583681 >> 172.21.15.45:0/4273583681 conn(0x7fea600698e0 msgr2=0x7fea60069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea6631f640 1 -- 172.21.15.45:0/4273583681 shutdown_connections 2023-07-09T02:16:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.241+0000 7fea6631f640 1 -- 172.21.15.45:0/4273583681 wait complete. 2023-07-09T02:16:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 Processor -- start 2023-07-09T02:16:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 -- start start 2023-07-09T02:16:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea600cd120 0x7fea600b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600d2450 0x7fea601534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015c060 0x7fea600cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600cb4a0 con 0x7fea600d2450 2023-07-09T02:16:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea601539f0 con 0x7fea600cd120 2023-07-09T02:16:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600cbe70 con 0x7fea6015c060 2023-07-09T02:16:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600d2450 0x7fea601534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600d2450 0x7fea601534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53740/0 (socket says 172.21.15.45:53740) 2023-07-09T02:16:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 -- 172.21.15.45:0/4123606368 learned_addr learned my addr 172.21.15.45:0/4123606368 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5ffff640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea600cd120 0x7fea600b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea648bc640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015c060 0x7fea600cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 -- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015c060 msgr2=0x7fea600cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015c060 0x7fea600cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 -- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea600cd120 msgr2=0x7fea600b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea600cd120 0x7fea600b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 -- 172.21.15.45:0/4123606368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea540094d0 con 0x7fea600d2450 2023-07-09T02:16:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5f7fe640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600d2450 0x7fea601534b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fea540190e0 tx=0x7fea5401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5cff9640 1 -- 172.21.15.45:0/4123606368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540b4800 con 0x7fea600d2450 2023-07-09T02:16:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5cff9640 1 -- 172.21.15.45:0/4123606368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea540b4960 con 0x7fea600d2450 2023-07-09T02:16:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea5cff9640 1 -- 172.21.15.45:0/4123606368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540b4cf0 con 0x7fea600d2450 2023-07-09T02:16:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea600ca890 con 0x7fea600d2450 2023-07-09T02:16:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.245+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea600cae50 con 0x7fea600d2450 2023-07-09T02:16:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.249+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea600cb610 con 0x7fea600d2450 2023-07-09T02:16:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.249+0000 7fea5cff9640 1 -- 172.21.15.45:0/4123606368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea540b3380 con 0x7fea600d2450 2023-07-09T02:16:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.249+0000 7fea5cff9640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea4c066280 0x7fea4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.249+0000 7fea5cff9640 1 -- 172.21.15.45:0/4123606368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fea540a8050 con 0x7fea600d2450 2023-07-09T02:16:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.249+0000 7fea5ffff640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea4c066280 0x7fea4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.249+0000 7fea5ffff640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea4c066280 0x7fea4c068730 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fea500045f0 tx=0x7fea50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.253+0000 7fea5cff9640 1 -- 172.21.15.45:0/4123606368 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea540eb710 con 0x7fea600d2450 2023-07-09T02:16:06.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:06.441+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fea6004d7d0 con 0x7fea600d2450 2023-07-09T02:16:07.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.069+0000 7fea5cff9640 1 -- 172.21.15.45:0/4123606368 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7fea540eed30 con 0x7fea600d2450 2023-07-09T02:16:07.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea4c066280 msgr2=0x7fea4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:07.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea4c066280 0x7fea4c068730 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fea500045f0 tx=0x7fea50008040 comp rx=0 tx=0).stop 2023-07-09T02:16:07.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600d2450 msgr2=0x7fea601534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600d2450 0x7fea601534b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fea540190e0 tx=0x7fea5401ad10 comp rx=0 tx=0).stop 2023-07-09T02:16:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 shutdown_connections 2023-07-09T02:16:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fea4c066280 0x7fea4c068730 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea6015c060 0x7fea600cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea600d2450 0x7fea601534b0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 --2- 172.21.15.45:0/4123606368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea600cd120 0x7fea600b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 >> 172.21.15.45:0/4123606368 conn(0x7fea600698e0 msgr2=0x7fea600b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 shutdown_connections 2023-07-09T02:16:07.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.073+0000 7fea6631f640 1 -- 172.21.15.45:0/4123606368 wait complete. 2023-07-09T02:16:07.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:16:07.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb862ca640 1 Processor -- start 2023-07-09T02:16:07.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb862ca640 1 -- start start 2023-07-09T02:16:07.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb862ca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcb8015c480 0x7fcb800cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:07.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb862ca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb800cecd0 0x7fcb800d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb862ca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb800d19c0 con 0x7fcb800b4490 2023-07-09T02:16:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb862ca640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8015c850 con 0x7fcb800cecd0 2023-07-09T02:16:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb862ca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb800d1090 con 0x7fcb8015c480 2023-07-09T02:16:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb7f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb800cecd0 0x7fcb800d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb7f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb800cecd0 0x7fcb800d1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53742/0 (socket says 172.21.15.45:53742) 2023-07-09T02:16:07.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb7f7fe640 1 -- 172.21.15.45:0/3391611272 learned_addr learned my addr 172.21.15.45:0/3391611272 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb7ffff640 1 --2- 172.21.15.45:0/3391611272 >> v2:172.21.15.155:3300/0 conn(0x7fcb8015c480 0x7fcb800cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb7f7fe640 1 -- 172.21.15.45:0/3391611272 >> v2:172.21.15.155:3300/0 conn(0x7fcb8015c480 msgr2=0x7fcb800cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb7f7fe640 1 --2- 172.21.15.45:0/3391611272 >> v2:172.21.15.155:3300/0 conn(0x7fcb8015c480 0x7fcb800cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb7f7fe640 1 -- 172.21.15.45:0/3391611272 >> v1:172.21.15.155:6789/0 conn(0x7fcb800b4490 legacy=0x7fcb800b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:07.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.245+0000 7fcb7f7fe640 1 -- 172.21.15.45:0/3391611272 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800d1370 con 0x7fcb800cecd0 2023-07-09T02:16:07.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb7f7fe640 1 --2- 172.21.15.45:0/3391611272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb800d1e50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fcb80069ae0 tx=0x7fcb7401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649f9e3e441f2761 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb7effd640 1 -- 172.21.15.45:0/3391611272 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740ac630 con 0x7fcb800cecd0 2023-07-09T02:16:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb7effd640 1 -- 172.21.15.45:0/3391611272 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740ac790 con 0x7fcb800cecd0 2023-07-09T02:16:07.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb7effd640 1 -- 172.21.15.45:0/3391611272 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740acb20 con 0x7fcb800cecd0 2023-07-09T02:16:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb862ca640 1 -- 172.21.15.45:0/3391611272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 msgr2=0x7fcb800d1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3391611272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb800d1e50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fcb80069ae0 tx=0x7fcb7401c4c0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb862ca640 1 -- 172.21.15.45:0/3391611272 shutdown_connections 2023-07-09T02:16:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3391611272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb800d1e50 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3391611272 >> v2:172.21.15.155:3300/0 conn(0x7fcb8015c480 0x7fcb800cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb862ca640 1 -- 172.21.15.45:0/3391611272 >> 172.21.15.45:0/3391611272 conn(0x7fcb800cf490 msgr2=0x7fcb800cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb862ca640 1 -- 172.21.15.45:0/3391611272 shutdown_connections 2023-07-09T02:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.249+0000 7fcb862ca640 1 -- 172.21.15.45:0/3391611272 wait complete. 2023-07-09T02:16:07.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 Processor -- start 2023-07-09T02:16:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 -- start start 2023-07-09T02:16:07.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb800b4490 0x7fcb8015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb80150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb8015c480 0x7fcb8015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015ed80 con 0x7fcb800cecd0 2023-07-09T02:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015e170 con 0x7fcb8015c480 2023-07-09T02:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8015e450 con 0x7fcb800b4490 2023-07-09T02:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb80150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:07.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb80150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53752/0 (socket says 172.21.15.45:53752) 2023-07-09T02:16:07.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 -- 172.21.15.45:0/3356108526 learned_addr learned my addr 172.21.15.45:0/3356108526 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:07.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7ffff640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb800b4490 0x7fcb8015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb84867640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb8015c480 0x7fcb8015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 -- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb800b4490 msgr2=0x7fcb8015f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb800b4490 0x7fcb8015f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 -- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb8015c480 msgr2=0x7fcb8015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb8015c480 0x7fcb8015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 -- 172.21.15.45:0/3356108526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740094d0 con 0x7fcb800cecd0 2023-07-09T02:16:07.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7f7fe640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb80150860 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fcb7401a0f0 tx=0x7fcb74019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7cff9640 1 -- 172.21.15.45:0/3356108526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740b5640 con 0x7fcb800cecd0 2023-07-09T02:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7cff9640 1 -- 172.21.15.45:0/3356108526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740b57a0 con 0x7fcb800cecd0 2023-07-09T02:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb7cff9640 1 -- 172.21.15.45:0/3356108526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740b5b10 con 0x7fcb800cecd0 2023-07-09T02:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8015e730 con 0x7fcb800cecd0 2023-07-09T02:16:07.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8015f750 con 0x7fcb800cecd0 2023-07-09T02:16:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.253+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8015eef0 con 0x7fcb800cecd0 2023-07-09T02:16:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.257+0000 7fcb7cff9640 1 -- 172.21.15.45:0/3356108526 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb740b3070 con 0x7fcb800cecd0 2023-07-09T02:16:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.257+0000 7fcb7cff9640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb6c0662b0 0x7fcb6c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.257+0000 7fcb7cff9640 1 -- 172.21.15.45:0/3356108526 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fcb7411de60 con 0x7fcb800cecd0 2023-07-09T02:16:07.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.257+0000 7fcb7ffff640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb6c0662b0 0x7fcb6c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:07.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.257+0000 7fcb7ffff640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb6c0662b0 0x7fcb6c068760 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000b930 tx=0x7fcb70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:07.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.261+0000 7fcb7cff9640 1 -- 172.21.15.45:0/3356108526 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb740eb270 con 0x7fcb800cecd0 2023-07-09T02:16:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:07.413+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb8004d7d0 con 0x7fcb800cecd0 2023-07-09T02:16:08.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb7cff9640 1 -- 172.21.15.45:0/3356108526 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcb740a80d0 con 0x7fcb800cecd0 2023-07-09T02:16:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:16:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb6c0662b0 msgr2=0x7fcb6c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb6c0662b0 0x7fcb6c068760 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000b930 tx=0x7fcb70008040 comp rx=0 tx=0).stop 2023-07-09T02:16:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 msgr2=0x7fcb80150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb80150860 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fcb7401a0f0 tx=0x7fcb74019260 comp rx=0 tx=0).stop 2023-07-09T02:16:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 shutdown_connections 2023-07-09T02:16:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb8015c480 0x7fcb8015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb800cecd0 0x7fcb80150860 secure :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fcb7401a0f0 tx=0x7fcb74019260 comp rx=0 tx=0).stop 2023-07-09T02:16:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb6c0662b0 0x7fcb6c068760 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 --2- 172.21.15.45:0/3356108526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb800b4490 0x7fcb8015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.073+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 >> 172.21.15.45:0/3356108526 conn(0x7fcb800cf490 msgr2=0x7fcb800b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:08.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.077+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 shutdown_connections 2023-07-09T02:16:08.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.077+0000 7fcb862ca640 1 -- 172.21.15.45:0/3356108526 wait complete. 2023-07-09T02:16:08.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:16:08.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa717c18640 1 Processor -- start 2023-07-09T02:16:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa717c18640 1 -- start start 2023-07-09T02:16:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa717c18640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa71015c480 0x7fa7100cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:08.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa717c18640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100b4490 0x7fa7100b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:08.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa717c18640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100d19c0 con 0x7fa7100cecd0 2023-07-09T02:16:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa717c18640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71015c850 con 0x7fa71015c480 2023-07-09T02:16:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa717c18640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100b4e50 con 0x7fa7100b4490 2023-07-09T02:16:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7159b4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa71015c480 0x7fa7100cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7161b5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100b4490 0x7fa7100b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7161b5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100b4490 0x7fa7100b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:60636/0 (socket says 172.21.15.45:60636) 2023-07-09T02:16:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7161b5640 1 -- 172.21.15.45:0/3542894641 learned_addr learned my addr 172.21.15.45:0/3542894641 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7159b4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa71015c480 0x7fa7100cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:51364/0 (socket says 172.21.15.45:51364) 2023-07-09T02:16:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7161b5640 1 -- 172.21.15.45:0/3542894641 >> v2:172.21.15.155:3300/0 conn(0x7fa71015c480 msgr2=0x7fa7100cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7161b5640 1 --2- 172.21.15.45:0/3542894641 >> v2:172.21.15.155:3300/0 conn(0x7fa71015c480 0x7fa7100cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7161b5640 1 -- 172.21.15.45:0/3542894641 >> v1:172.21.15.155:6789/0 conn(0x7fa7100cecd0 legacy=0x7fa7100d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7161b5640 1 -- 172.21.15.45:0/3542894641 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7100d1090 con 0x7fa7100b4490 2023-07-09T02:16:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7159b4640 1 --2- 172.21.15.45:0/3542894641 >> v2:172.21.15.155:3300/0 conn(0x7fa71015c480 0x7fa7100cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:08.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.249+0000 7fa7149b2640 1 -- 172.21.15.45:0/3542894641 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949956776 0 0) 0x7fa7100d19c0 con 0x7fa7100cecd0 2023-07-09T02:16:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa7161b5640 1 --2- 172.21.15.45:0/3542894641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100b4490 0x7fa7100b4910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa708009e50 tx=0x7fa70801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5449d104234cd436 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa7149b2640 1 -- 172.21.15.45:0/3542894641 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080a57f0 con 0x7fa7100b4490 2023-07-09T02:16:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa7149b2640 1 -- 172.21.15.45:0/3542894641 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080a5950 con 0x7fa7100b4490 2023-07-09T02:16:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa7149b2640 1 -- 172.21.15.45:0/3542894641 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080a5ce0 con 0x7fa7100b4490 2023-07-09T02:16:08.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa717c18640 1 -- 172.21.15.45:0/3542894641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100b4490 msgr2=0x7fa7100b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:08.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa717c18640 1 --2- 172.21.15.45:0/3542894641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100b4490 0x7fa7100b4910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa708009e50 tx=0x7fa70801ca10 comp rx=0 tx=0).stop 2023-07-09T02:16:08.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa717c18640 1 -- 172.21.15.45:0/3542894641 shutdown_connections 2023-07-09T02:16:08.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa717c18640 1 --2- 172.21.15.45:0/3542894641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100b4490 0x7fa7100b4910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:08.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa717c18640 1 --2- 172.21.15.45:0/3542894641 >> v2:172.21.15.155:3300/0 conn(0x7fa71015c480 0x7fa7100cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:08.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa717c18640 1 -- 172.21.15.45:0/3542894641 >> 172.21.15.45:0/3542894641 conn(0x7fa7100cf490 msgr2=0x7fa7100cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:08.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa717c18640 1 -- 172.21.15.45:0/3542894641 shutdown_connections 2023-07-09T02:16:08.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.253+0000 7fa717c18640 1 -- 172.21.15.45:0/3542894641 wait complete. 2023-07-09T02:16:08.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 Processor -- start 2023-07-09T02:16:08.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 -- start start 2023-07-09T02:16:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7100b4490 0x7fa71015f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100cecd0 0x7fa71014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71015c480 0x7fa7100b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71014d610 con 0x7fa71015c480 2023-07-09T02:16:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71014dc50 con 0x7fa7100b4490 2023-07-09T02:16:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71014df30 con 0x7fa7100cecd0 2023-07-09T02:16:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71015c480 0x7fa7100b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71015c480 0x7fa7100b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53760/0 (socket says 172.21.15.45:53760) 2023-07-09T02:16:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 -- 172.21.15.45:0/3636635330 learned_addr learned my addr 172.21.15.45:0/3636635330 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7159b4640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7100b4490 0x7fa71015f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7151b3640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100cecd0 0x7fa71014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 -- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100cecd0 msgr2=0x7fa71014d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:08.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100cecd0 0x7fa71014d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 -- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7100b4490 msgr2=0x7fa71015f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7100b4490 0x7fa71015f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 -- 172.21.15.45:0/3636635330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c009420 con 0x7fa71015c480 2023-07-09T02:16:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7161b5640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71015c480 0x7fa7100b1870 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa7080af040 tx=0x7fa7080197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7067fc640 1 -- 172.21.15.45:0/3636635330 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080b8670 con 0x7fa71015c480 2023-07-09T02:16:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7067fc640 1 -- 172.21.15.45:0/3636635330 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080b87d0 con 0x7fa71015c480 2023-07-09T02:16:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa7067fc640 1 -- 172.21.15.45:0/3636635330 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080b8b80 con 0x7fa71015c480 2023-07-09T02:16:08.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa708009b30 con 0x7fa71015c480 2023-07-09T02:16:08.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.257+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71014e4f0 con 0x7fa71015c480 2023-07-09T02:16:08.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.261+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7100cf0e0 con 0x7fa71015c480 2023-07-09T02:16:08.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.261+0000 7fa7067fc640 1 -- 172.21.15.45:0/3636635330 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7080b8ce0 con 0x7fa71015c480 2023-07-09T02:16:08.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.261+0000 7fa7067fc640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6f4066280 0x7fa6f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:08.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.261+0000 7fa7067fc640 1 -- 172.21.15.45:0/3636635330 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fa70811eec0 con 0x7fa71015c480 2023-07-09T02:16:08.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.261+0000 7fa7159b4640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6f4066280 0x7fa6f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:08.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.261+0000 7fa7159b4640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6f4066280 0x7fa6f4068730 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009c50 tx=0x7fa70c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:08.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.265+0000 7fa7067fc640 1 -- 172.21.15.45:0/3636635330 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7100cf0e0 con 0x7fa71015c480 2023-07-09T02:16:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:08.425+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa7100cf0e0 con 0x7fa71015c480 2023-07-09T02:16:09.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.077+0000 7fa7067fc640 1 -- 172.21.15.45:0/3636635330 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa7100cf0e0 con 0x7fa71015c480 2023-07-09T02:16:09.078 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:16:09.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6f4066280 msgr2=0x7fa6f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6f4066280 0x7fa6f4068730 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009c50 tx=0x7fa70c009190 comp rx=0 tx=0).stop 2023-07-09T02:16:09.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71015c480 msgr2=0x7fa7100b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71015c480 0x7fa7100b1870 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa7080af040 tx=0x7fa7080197b0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 shutdown_connections 2023-07-09T02:16:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71015c480 0x7fa7100b1870 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6f4066280 0x7fa6f4068730 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100cecd0 0x7fa71014d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 --2- 172.21.15.45:0/3636635330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7100b4490 0x7fa71015f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 >> 172.21.15.45:0/3636635330 conn(0x7fa7100cf490 msgr2=0x7fa7100cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 shutdown_connections 2023-07-09T02:16:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.081+0000 7fa717c18640 1 -- 172.21.15.45:0/3636635330 wait complete. 2023-07-09T02:16:09.104 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:16:09.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.249+0000 7f576979f640 1 Processor -- start 2023-07-09T02:16:09.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.249+0000 7f576979f640 1 -- start start 2023-07-09T02:16:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.249+0000 7f576979f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.249+0000 7f576979f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640cd120 0x7f57640d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f576979f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5764160a50 con 0x7f57640d2450 2023-07-09T02:16:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f576979f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640d28f0 con 0x7f576415c060 2023-07-09T02:16:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f576979f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640cfe40 con 0x7f57640cd120 2023-07-09T02:16:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f57637fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f57640d2450 0x7f57640d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:44054/0 (socket says 172.21.15.45:44054) 2023-07-09T02:16:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f57637fe640 1 -- 172.21.15.45:0/1320198579 learned_addr learned my addr 172.21.15.45:0/1320198579 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f57627fc640 1 --2- 172.21.15.45:0/1320198579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640cd120 0x7f57640d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f5762ffd640 1 --2- 172.21.15.45:0/1320198579 >> v2:172.21.15.155:3300/0 conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f5761ffb640 1 -- 172.21.15.45:0/1320198579 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529405657 0 0) 0x7f5764160a50 con 0x7f57640d2450 2023-07-09T02:16:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f57627fc640 1 -- 172.21.15.45:0/1320198579 >> v2:172.21.15.155:3300/0 conn(0x7f576415c060 msgr2=0x7f57640b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f57627fc640 1 --2- 172.21.15.45:0/1320198579 >> v2:172.21.15.155:3300/0 conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f57627fc640 1 -- 172.21.15.45:0/1320198579 >> v1:172.21.15.155:6789/0 conn(0x7f57640d2450 legacy=0x7f57640d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f57627fc640 1 -- 172.21.15.45:0/1320198579 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576415c430 con 0x7f57640cd120 2023-07-09T02:16:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.253+0000 7f5762ffd640 1 --2- 172.21.15.45:0/1320198579 >> v2:172.21.15.155:3300/0 conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:09.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f57627fc640 1 --2- 172.21.15.45:0/1320198579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640cd120 0x7f57640d1f10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57580097c0 tx=0x7f575801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=496460a394a757 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:09.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f5761ffb640 1 -- 172.21.15.45:0/1320198579 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580ab600 con 0x7f57640cd120 2023-07-09T02:16:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f5761ffb640 1 -- 172.21.15.45:0/1320198579 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57580a7050 con 0x7f57640cd120 2023-07-09T02:16:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f5761ffb640 1 -- 172.21.15.45:0/1320198579 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580ab980 con 0x7f57640cd120 2023-07-09T02:16:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 -- 172.21.15.45:0/1320198579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640cd120 msgr2=0x7f57640d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 --2- 172.21.15.45:0/1320198579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640cd120 0x7f57640d1f10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57580097c0 tx=0x7f575801c450 comp rx=0 tx=0).stop 2023-07-09T02:16:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 -- 172.21.15.45:0/1320198579 shutdown_connections 2023-07-09T02:16:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 --2- 172.21.15.45:0/1320198579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640cd120 0x7f57640d1f10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 --2- 172.21.15.45:0/1320198579 >> v2:172.21.15.155:3300/0 conn(0x7f576415c060 0x7f57640b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 -- 172.21.15.45:0/1320198579 >> 172.21.15.45:0/1320198579 conn(0x7f57640698e0 msgr2=0x7f5764069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 -- 172.21.15.45:0/1320198579 shutdown_connections 2023-07-09T02:16:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 -- 172.21.15.45:0/1320198579 wait complete. 2023-07-09T02:16:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 Processor -- start 2023-07-09T02:16:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 -- start start 2023-07-09T02:16:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f57640c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.257+0000 7f576979f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640d2450 0x7f57640b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f576979f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f576415c060 0x7f57640b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f576979f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640c9d20 con 0x7f57640cd120 2023-07-09T02:16:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f576979f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640c9020 con 0x7f576415c060 2023-07-09T02:16:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f576979f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b24a0 con 0x7f57640d2450 2023-07-09T02:16:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f57640c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f57640c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53768/0 (socket says 172.21.15.45:53768) 2023-07-09T02:16:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 -- 172.21.15.45:0/146556140 learned_addr learned my addr 172.21.15.45:0/146556140 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f57627fc640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640d2450 0x7f57640b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f57637fe640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f576415c060 0x7f57640b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 -- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640d2450 msgr2=0x7f57640b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640d2450 0x7f57640b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 -- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f576415c060 msgr2=0x7f57640b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f576415c060 0x7f57640b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 -- 172.21.15.45:0/146556140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754009420 con 0x7f57640cd120 2023-07-09T02:16:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f57637fe640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f576415c060 0x7f57640b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f5762ffd640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f57640c8ae0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f575400e9b0 tx=0x7f575400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f574b7fe640 1 -- 172.21.15.45:0/146556140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400ca00 con 0x7f57640cd120 2023-07-09T02:16:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f574b7fe640 1 -- 172.21.15.45:0/146556140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400cb60 con 0x7f57640cd120 2023-07-09T02:16:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f574b7fe640 1 -- 172.21.15.45:0/146556140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754013470 con 0x7f57640cd120 2023-07-09T02:16:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5758009420 con 0x7f57640cd120 2023-07-09T02:16:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57640b29d0 con 0x7f57640cd120 2023-07-09T02:16:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576404d7d0 con 0x7f57640cd120 2023-07-09T02:16:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.261+0000 7f574b7fe640 1 -- 172.21.15.45:0/146556140 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57540135d0 con 0x7f57640cd120 2023-07-09T02:16:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.265+0000 7f574b7fe640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5750066280 0x7f5750068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.265+0000 7f574b7fe640 1 -- 172.21.15.45:0/146556140 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5754083c30 con 0x7f57640cd120 2023-07-09T02:16:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.265+0000 7f57627fc640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5750066280 0x7f5750068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.265+0000 7f57627fc640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5750066280 0x7f5750068730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f57580ad000 tx=0x7f57580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.269+0000 7f574b7fe640 1 -- 172.21.15.45:0/146556140 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57540513e0 con 0x7f57640cd120 2023-07-09T02:16:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.429+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f576406baa0 con 0x7f57640cd120 2023-07-09T02:16:09.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f574b7fe640 1 -- 172.21.15.45:0/146556140 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5754054a00 con 0x7f57640cd120 2023-07-09T02:16:09.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5750066280 msgr2=0x7f5750068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5750066280 0x7f5750068730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f57580ad000 tx=0x7f57580a6000 comp rx=0 tx=0).stop 2023-07-09T02:16:09.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 msgr2=0x7f57640c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f57640c8ae0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f575400e9b0 tx=0x7f575400ee70 comp rx=0 tx=0).stop 2023-07-09T02:16:09.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 shutdown_connections 2023-07-09T02:16:09.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f576415c060 0x7f57640b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5750066280 0x7f5750068730 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57640d2450 0x7f57640b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 --2- 172.21.15.45:0/146556140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57640cd120 0x7f57640c8ae0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 >> 172.21.15.45:0/146556140 conn(0x7f57640698e0 msgr2=0x7f576415b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:09.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 shutdown_connections 2023-07-09T02:16:09.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.433+0000 7f576979f640 1 -- 172.21.15.45:0/146556140 wait complete. 2023-07-09T02:16:09.455 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-07-09T02:16:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.597+0000 7f5ce7112640 1 Processor -- start 2023-07-09T02:16:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.597+0000 7f5ce7112640 1 -- start start 2023-07-09T02:16:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce7112640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00b4ae0 0x7f5ce00ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce7112640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ce0160670 0x7f5ce00d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce7112640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce00cd5d0 con 0x7f5ce00c8d40 2023-07-09T02:16:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce7112640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00d2050 con 0x7f5ce0160670 2023-07-09T02:16:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce7112640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00d27a0 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce6110640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5ce00c8d40 0x7f5ce00b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33638/0 (socket says 172.21.15.45:33638) 2023-07-09T02:16:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce6110640 1 -- 172.21.15.45:0/1470810611 learned_addr learned my addr 172.21.15.45:0/1470810611 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce6911640 1 --2- 172.21.15.45:0/1470810611 >> v2:172.21.15.45:3300/0 conn(0x7f5ce0160670 0x7f5ce00d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce590f640 1 --2- 172.21.15.45:0/1470810611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00b4ae0 0x7f5ce00ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce510e640 1 -- 172.21.15.45:0/1470810611 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328398665 0 0) 0x7f5ce00cd5d0 con 0x7f5ce00c8d40 2023-07-09T02:16:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce510e640 1 -- 172.21.15.45:0/1470810611 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ccc003530 con 0x7f5ce00c8d40 2023-07-09T02:16:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce6911640 1 -- 172.21.15.45:0/1470810611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00b4ae0 msgr2=0x7f5ce00ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce6911640 1 --2- 172.21.15.45:0/1470810611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00b4ae0 0x7f5ce00ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce6911640 1 -- 172.21.15.45:0/1470810611 >> v1:172.21.15.45:6789/0 conn(0x7f5ce00c8d40 legacy=0x7f5ce00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.601+0000 7f5ce6911640 1 -- 172.21.15.45:0/1470810611 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00ced30 con 0x7f5ce0160670 2023-07-09T02:16:09.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce6911640 1 --2- 172.21.15.45:0/1470810611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce0160670 0x7f5ce00d0490 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009d90 tx=0x7f5cd801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee6c4f4a57fc62d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:09.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce510e640 1 -- 172.21.15.45:0/1470810611 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80af600 con 0x7f5ce0160670 2023-07-09T02:16:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce510e640 1 -- 172.21.15.45:0/1470810611 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd80ab050 con 0x7f5ce0160670 2023-07-09T02:16:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce510e640 1 -- 172.21.15.45:0/1470810611 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80af980 con 0x7f5ce0160670 2023-07-09T02:16:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 -- 172.21.15.45:0/1470810611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce0160670 msgr2=0x7f5ce00d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 --2- 172.21.15.45:0/1470810611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce0160670 0x7f5ce00d0490 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009d90 tx=0x7f5cd801f130 comp rx=0 tx=0).stop 2023-07-09T02:16:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 -- 172.21.15.45:0/1470810611 shutdown_connections 2023-07-09T02:16:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 --2- 172.21.15.45:0/1470810611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce0160670 0x7f5ce00d0490 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 --2- 172.21.15.45:0/1470810611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00b4ae0 0x7f5ce00ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 -- 172.21.15.45:0/1470810611 >> 172.21.15.45:0/1470810611 conn(0x7f5ce00d2950 msgr2=0x7f5ce00d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 -- 172.21.15.45:0/1470810611 shutdown_connections 2023-07-09T02:16:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 -- 172.21.15.45:0/1470810611 wait complete. 2023-07-09T02:16:09.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 Processor -- start 2023-07-09T02:16:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.605+0000 7f5ce7112640 1 -- start start 2023-07-09T02:16:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce00b4ae0 0x7f5ce00ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00c8d40 0x7f5ce0150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0160670 0x7f5ce015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00c9990 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00ca510 con 0x7f5ce0160670 2023-07-09T02:16:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00cae70 con 0x7f5ce00c8d40 2023-07-09T02:16:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce00b4ae0 0x7f5ce00ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce00b4ae0 0x7f5ce00ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53788/0 (socket says 172.21.15.45:53788) 2023-07-09T02:16:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 -- 172.21.15.45:0/121280132 learned_addr learned my addr 172.21.15.45:0/121280132 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce590f640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00c8d40 0x7f5ce0150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6911640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0160670 0x7f5ce015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 -- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00c8d40 msgr2=0x7f5ce0150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00c8d40 0x7f5ce0150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 -- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0160670 msgr2=0x7f5ce015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0160670 0x7f5ce015a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 -- 172.21.15.45:0/121280132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009a70 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce590f640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00c8d40 0x7f5ce0150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:09.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce6110640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce00b4ae0 0x7f5ce00ca930 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c500 tx=0x7f5cdc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:09.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5cd6ffd640 1 -- 172.21.15.45:0/121280132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc005cf0 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5cd6ffd640 1 -- 172.21.15.45:0/121280132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc005e50 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5cd6ffd640 1 -- 172.21.15.45:0/121280132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0072f0 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce00c9b70 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce00ca130 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce004e020 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.609+0000 7f5cd6ffd640 1 -- 172.21.15.45:0/121280132 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5cdc007450 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.613+0000 7f5cd6ffd640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5cc4066280 0x7f5cc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.613+0000 7f5cd6ffd640 1 -- 172.21.15.45:0/121280132 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5cdc082f40 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.613+0000 7f5ce590f640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5cc4066280 0x7f5cc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.613+0000 7f5ce590f640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5cc4066280 0x7f5cc4068730 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0160060 tx=0x7f5cd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:09.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.617+0000 7f5cd6ffd640 1 -- 172.21.15.45:0/121280132 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5cdc050780 con 0x7f5ce00b4ae0 2023-07-09T02:16:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:09.825+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f5ce006a360 con 0x7f5ce00b4ae0 2023-07-09T02:16:10.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.077+0000 7f5cd6ffd640 1 -- 172.21.15.45:0/121280132 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v264) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5cdc0170c0 con 0x7f5ce00b4ae0 2023-07-09T02:16:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5cc4066280 msgr2=0x7f5cc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5cc4066280 0x7f5cc4068730 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0160060 tx=0x7f5cd0008040 comp rx=0 tx=0).stop 2023-07-09T02:16:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce00b4ae0 msgr2=0x7f5ce00ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce00b4ae0 0x7f5ce00ca930 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c500 tx=0x7f5cdc00c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 shutdown_connections 2023-07-09T02:16:10.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ce0160670 0x7f5ce015a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5cc4066280 0x7f5cc4068730 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ce00c8d40 0x7f5ce0150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 --2- 172.21.15.45:0/121280132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ce00b4ae0 0x7f5ce00ca930 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 >> 172.21.15.45:0/121280132 conn(0x7f5ce00d2950 msgr2=0x7f5ce00c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 shutdown_connections 2023-07-09T02:16:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.081+0000 7f5ce7112640 1 -- 172.21.15.45:0/121280132 wait complete. 2023-07-09T02:16:10.100 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-07-09T02:16:10.101 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-07-09T02:16:10.101 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-07-09T02:16:10.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.241+0000 7f927fbe2640 1 Processor -- start 2023-07-09T02:16:10.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.241+0000 7f927fbe2640 1 -- start start 2023-07-09T02:16:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927fbe2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f927815c060 0x7f92780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927fbe2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f92780d2620 0x7f92780cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927fbe2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9278160a50 con 0x7f92780cd120 2023-07-09T02:16:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927fbe2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927815c430 con 0x7f927815c060 2023-07-09T02:16:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927fbe2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927815fb60 con 0x7f92780d2620 2023-07-09T02:16:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927d97e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f927815c060 0x7f92780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927d17d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f92780cd120 0x7f92780d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33640/0 (socket says 172.21.15.45:33640) 2023-07-09T02:16:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927d97e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f927815c060 0x7f92780b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53790/0 (socket says 172.21.15.45:53790) 2023-07-09T02:16:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927d17d640 1 -- 172.21.15.45:0/3230673223 learned_addr learned my addr 172.21.15.45:0/3230673223 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927e17f640 1 --2- 172.21.15.45:0/3230673223 >> v2:172.21.15.155:3300/0 conn(0x7f92780d2620 0x7f92780cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927d97e640 1 -- 172.21.15.45:0/3230673223 >> v2:172.21.15.155:3300/0 conn(0x7f92780d2620 msgr2=0x7f92780cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927d97e640 1 --2- 172.21.15.45:0/3230673223 >> v2:172.21.15.155:3300/0 conn(0x7f92780d2620 0x7f92780cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927d97e640 1 -- 172.21.15.45:0/3230673223 >> v1:172.21.15.45:6789/0 conn(0x7f92780cd120 legacy=0x7f92780d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:10.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.245+0000 7f927d97e640 1 -- 172.21.15.45:0/3230673223 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927815fe40 con 0x7f927815c060 2023-07-09T02:16:10.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927d97e640 1 --2- 172.21.15.45:0/3230673223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f927815c060 0x7f92780b4ed0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f927808bca0 tx=0x7f927401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7c32b3fddc8acb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:10.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927c97c640 1 -- 172.21.15.45:0/3230673223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92740a7070 con 0x7f927815c060 2023-07-09T02:16:10.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927c97c640 1 -- 172.21.15.45:0/3230673223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92740ab430 con 0x7f927815c060 2023-07-09T02:16:10.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927c97c640 1 -- 172.21.15.45:0/3230673223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92740ab7c0 con 0x7f927815c060 2023-07-09T02:16:10.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 -- 172.21.15.45:0/3230673223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f927815c060 msgr2=0x7f92780b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:10.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 --2- 172.21.15.45:0/3230673223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f927815c060 0x7f92780b4ed0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f927808bca0 tx=0x7f927401c430 comp rx=0 tx=0).stop 2023-07-09T02:16:10.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 -- 172.21.15.45:0/3230673223 shutdown_connections 2023-07-09T02:16:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 --2- 172.21.15.45:0/3230673223 >> v2:172.21.15.155:3300/0 conn(0x7f92780d2620 0x7f92780cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 --2- 172.21.15.45:0/3230673223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f927815c060 0x7f92780b4ed0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 -- 172.21.15.45:0/3230673223 >> 172.21.15.45:0/3230673223 conn(0x7f92780698e0 msgr2=0x7f9278069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 -- 172.21.15.45:0/3230673223 shutdown_connections 2023-07-09T02:16:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 -- 172.21.15.45:0/3230673223 wait complete. 2023-07-09T02:16:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 Processor -- start 2023-07-09T02:16:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 -- start start 2023-07-09T02:16:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92780cd120 0x7f92781666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780d2620 0x7f92780ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927815c060 0x7f927815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:10.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.249+0000 7f927fbe2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927815c980 con 0x7f92780d2620 2023-07-09T02:16:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927fbe2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780cb4c0 con 0x7f92780cd120 2023-07-09T02:16:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927fbe2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92780caf00 con 0x7f927815c060 2023-07-09T02:16:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780d2620 0x7f92780ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780d2620 0x7f92780ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53802/0 (socket says 172.21.15.45:53802) 2023-07-09T02:16:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 -- 172.21.15.45:0/16471974 learned_addr learned my addr 172.21.15.45:0/16471974 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d97e640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92780cd120 0x7f92781666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:10.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927e17f640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927815c060 0x7f927815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 -- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927815c060 msgr2=0x7f927815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927815c060 0x7f927815ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 -- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92780cd120 msgr2=0x7f92781666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92780cd120 0x7f92781666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 -- 172.21.15.45:0/16471974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9274009420 con 0x7f92780d2620 2023-07-09T02:16:10.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927d17d640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780d2620 0x7f92780ca520 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f926800c4d0 tx=0x7f926800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:10.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f926e7fc640 1 -- 172.21.15.45:0/16471974 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268005cf0 con 0x7f92780d2620 2023-07-09T02:16:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f926e7fc640 1 -- 172.21.15.45:0/16471974 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268005e50 con 0x7f92780d2620 2023-07-09T02:16:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f926e7fc640 1 -- 172.21.15.45:0/16471974 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268007270 con 0x7f92780d2620 2023-07-09T02:16:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92780b59f0 con 0x7f92780d2620 2023-07-09T02:16:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927815c610 con 0x7f92780d2620 2023-07-09T02:16:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927815cb30 con 0x7f92780d2620 2023-07-09T02:16:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.253+0000 7f926e7fc640 1 -- 172.21.15.45:0/16471974 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92680073d0 con 0x7f92780d2620 2023-07-09T02:16:10.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.257+0000 7f926e7fc640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f925c066280 0x7f925c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.257+0000 7f926e7fc640 1 -- 172.21.15.45:0/16471974 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9268082e70 con 0x7f92780d2620 2023-07-09T02:16:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.257+0000 7f927d97e640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f925c066280 0x7f925c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:10.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.257+0000 7f927d97e640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f925c066280 0x7f925c068730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f92740af000 tx=0x7f92740a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:10.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.261+0000 7f926e7fc640 1 -- 172.21.15.45:0/16471974 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f927815cb30 con 0x7f92780d2620 2023-07-09T02:16:10.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:10.465+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f927804d7d0 con 0x7f92780d2620 2023-07-09T02:16:11.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.081+0000 7f926e7fc640 1 -- 172.21.15.45:0/16471974 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v265) v1 ==== 140+0+0 (secure 0 0 0) 0x7f92680170d0 con 0x7f92780d2620 2023-07-09T02:16:11.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f925c066280 msgr2=0x7f925c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f925c066280 0x7f925c068730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f92740af000 tx=0x7f92740a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:11.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780d2620 msgr2=0x7f92780ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780d2620 0x7f92780ca520 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f926800c4d0 tx=0x7f926800c990 comp rx=0 tx=0).stop 2023-07-09T02:16:11.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 shutdown_connections 2023-07-09T02:16:11.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f925c066280 0x7f925c068730 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927815c060 0x7f927815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780d2620 0x7f92780ca520 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 --2- 172.21.15.45:0/16471974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92780cd120 0x7f92781666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 >> 172.21.15.45:0/16471974 conn(0x7f92780698e0 msgr2=0x7f9278069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:11.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 shutdown_connections 2023-07-09T02:16:11.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.085+0000 7f927fbe2640 1 -- 172.21.15.45:0/16471974 wait complete. 2023-07-09T02:16:11.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-07-09T02:16:11.269 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_objectstore":"memstore"} 2023-07-09T02:16:11.269 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-07-09T02:16:11.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:16:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.413+0000 7f387bb74640 1 Processor -- start 2023-07-09T02:16:11.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.413+0000 7f387bb74640 1 -- start start 2023-07-09T02:16:11.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f387bb74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f387415c060 0x7f38740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f387bb74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38740cd120 0x7f38740d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f387bb74640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3874160a50 con 0x7f38740d2450 2023-07-09T02:16:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f387bb74640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38740d28f0 con 0x7f387415c060 2023-07-09T02:16:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f387bb74640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38740cfe40 con 0x7f38740cd120 2023-07-09T02:16:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f3879910640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f387415c060 0x7f38740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f387a111640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f38740d2450 0x7f38740d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33642/0 (socket says 172.21.15.45:33642) 2023-07-09T02:16:11.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f387a111640 1 -- 172.21.15.45:0/433975361 learned_addr learned my addr 172.21.15.45:0/433975361 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f387910f640 1 --2- 172.21.15.45:0/433975361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38740cd120 0x7f38740d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f3879910640 1 -- 172.21.15.45:0/433975361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38740cd120 msgr2=0x7f38740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f3879910640 1 --2- 172.21.15.45:0/433975361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38740cd120 0x7f38740d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f3879910640 1 -- 172.21.15.45:0/433975361 >> v1:172.21.15.45:6789/0 conn(0x7f38740d2450 legacy=0x7f38740d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f3879910640 1 -- 172.21.15.45:0/433975361 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387415c430 con 0x7f387415c060 2023-07-09T02:16:11.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.417+0000 7f3879910640 1 --2- 172.21.15.45:0/433975361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f387415c060 0x7f38740b4ed0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f38700097c0 tx=0x7f387001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2daf83a40557ba8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:11.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387890e640 1 -- 172.21.15.45:0/433975361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38700ab600 con 0x7f387415c060 2023-07-09T02:16:11.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387890e640 1 -- 172.21.15.45:0/433975361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38700a7050 con 0x7f387415c060 2023-07-09T02:16:11.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387890e640 1 -- 172.21.15.45:0/433975361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38700ab980 con 0x7f387415c060 2023-07-09T02:16:11.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- 172.21.15.45:0/433975361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f387415c060 msgr2=0x7f38740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 --2- 172.21.15.45:0/433975361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f387415c060 0x7f38740b4ed0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f38700097c0 tx=0x7f387001c450 comp rx=0 tx=0).stop 2023-07-09T02:16:11.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- 172.21.15.45:0/433975361 shutdown_connections 2023-07-09T02:16:11.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 --2- 172.21.15.45:0/433975361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f38740cd120 0x7f38740d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 --2- 172.21.15.45:0/433975361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f387415c060 0x7f38740b4ed0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- 172.21.15.45:0/433975361 >> 172.21.15.45:0/433975361 conn(0x7f38740698e0 msgr2=0x7f3874069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- 172.21.15.45:0/433975361 shutdown_connections 2023-07-09T02:16:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- 172.21.15.45:0/433975361 wait complete. 2023-07-09T02:16:11.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 Processor -- start 2023-07-09T02:16:11.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- start start 2023-07-09T02:16:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38740cd120 0x7f3874152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38740d2450 0x7f387415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387415c060 0x7f3874155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741531e0 con 0x7f38740d2450 2023-07-09T02:16:11.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741562e0 con 0x7f38740cd120 2023-07-09T02:16:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387bb74640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38741565c0 con 0x7f387415c060 2023-07-09T02:16:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387910f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38740d2450 0x7f387415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387910f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38740d2450 0x7f387415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53822/0 (socket says 172.21.15.45:53822) 2023-07-09T02:16:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.421+0000 7f387910f640 1 -- 172.21.15.45:0/2542349215 learned_addr learned my addr 172.21.15.45:0/2542349215 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f3879910640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38740cd120 0x7f3874152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387a111640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387415c060 0x7f3874155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387910f640 1 -- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387415c060 msgr2=0x7f3874155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387910f640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387415c060 0x7f3874155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387910f640 1 -- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38740cd120 msgr2=0x7f3874152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387910f640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38740cd120 0x7f3874152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387910f640 1 -- 172.21.15.45:0/2542349215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3870009420 con 0x7f38740d2450 2023-07-09T02:16:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387910f640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38740d2450 0x7f387415c660 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f386400d5c0 tx=0x7f386400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f386a7fc640 1 -- 172.21.15.45:0/2542349215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640125f0 con 0x7f38740d2450 2023-07-09T02:16:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f386a7fc640 1 -- 172.21.15.45:0/2542349215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864012750 con 0x7f38740d2450 2023-07-09T02:16:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f386a7fc640 1 -- 172.21.15.45:0/2542349215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864012b00 con 0x7f38740d2450 2023-07-09T02:16:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38741568a0 con 0x7f38740d2450 2023-07-09T02:16:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387415e330 con 0x7f38740d2450 2023-07-09T02:16:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387404d7d0 con 0x7f38740d2450 2023-07-09T02:16:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.425+0000 7f386a7fc640 1 -- 172.21.15.45:0/2542349215 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3864012c60 con 0x7f38740d2450 2023-07-09T02:16:11.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.429+0000 7f386a7fc640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3858066280 0x7f3858068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.429+0000 7f386a7fc640 1 -- 172.21.15.45:0/2542349215 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3864083c70 con 0x7f38740d2450 2023-07-09T02:16:11.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.429+0000 7f3879910640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3858066280 0x7f3858068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.429+0000 7f3879910640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3858066280 0x7f3858068730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f38700ad000 tx=0x7f38700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:11.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.429+0000 7f386a7fc640 1 -- 172.21.15.45:0/2542349215 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3864051420 con 0x7f38740d2450 2023-07-09T02:16:11.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.585+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f387406baa0 con 0x7f38740d2450 2023-07-09T02:16:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f386a7fc640 1 -- 172.21.15.45:0/2542349215 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3864054a40 con 0x7f38740d2450 2023-07-09T02:16:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3858066280 msgr2=0x7f3858068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3858066280 0x7f3858068730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f38700ad000 tx=0x7f38700a6000 comp rx=0 tx=0).stop 2023-07-09T02:16:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38740d2450 msgr2=0x7f387415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38740d2450 0x7f387415c660 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f386400d5c0 tx=0x7f386400da80 comp rx=0 tx=0).stop 2023-07-09T02:16:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 shutdown_connections 2023-07-09T02:16:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3858066280 0x7f3858068730 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f387415c060 0x7f3874155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38740d2450 0x7f387415c660 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 --2- 172.21.15.45:0/2542349215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38740cd120 0x7f3874152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 >> 172.21.15.45:0/2542349215 conn(0x7f38740698e0 msgr2=0x7f38740d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 shutdown_connections 2023-07-09T02:16:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.589+0000 7f387bb74640 1 -- 172.21.15.45:0/2542349215 wait complete. 2023-07-09T02:16:11.610 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:16:11.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:16:11.667 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:16:11.727 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:16:11.727 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:11.728 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:11.737 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:16:11.737 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:16:11.738 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:11.747 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:16:11.748 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:11.748 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:11.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:16:11.793 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:16:11.793 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:11.802 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:16:11.802 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:16:11.803 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:11.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca385e2640 1 Processor -- start 2023-07-09T02:16:11.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca385e2640 1 -- start start 2023-07-09T02:16:11.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca385e2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca3006c110 0x7fca3006c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca385e2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300caec0 0x7fca300cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca385e2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3006caa0 con 0x7fca30158e30 2023-07-09T02:16:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca385e2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca300ccf80 con 0x7fca3006c110 2023-07-09T02:16:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca385e2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300cd540 con 0x7fca300caec0 2023-07-09T02:16:11.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca35b7d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca3006c110 0x7fca3006c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca35b7d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca3006c110 0x7fca3006c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34222/0 (socket says 172.21.15.45:34222) 2023-07-09T02:16:11.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca35b7d640 1 -- 172.21.15.45:0/1394139018 learned_addr learned my addr 172.21.15.45:0/1394139018 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:11.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.977+0000 7fca36b7f640 1 --2- 172.21.15.45:0/1394139018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300caec0 0x7fca300cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca35b7d640 1 -- 172.21.15.45:0/1394139018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300caec0 msgr2=0x7fca300cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca35b7d640 1 --2- 172.21.15.45:0/1394139018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300caec0 0x7fca300cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca35b7d640 1 -- 172.21.15.45:0/1394139018 >> v1:172.21.15.155:6789/0 conn(0x7fca30158e30 legacy=0x7fca3006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca35b7d640 1 -- 172.21.15.45:0/1394139018 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300cb880 con 0x7fca3006c110 2023-07-09T02:16:11.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca36b7f640 1 --2- 172.21.15.45:0/1394139018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300caec0 0x7fca300cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:11.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca35b7d640 1 --2- 172.21.15.45:0/1394139018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3006c110 0x7fca3006c560 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fca20009870 tx=0x7fca2001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde50084937a0c04 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:11.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca3537c640 1 -- 172.21.15.45:0/1394139018 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200ab600 con 0x7fca3006c110 2023-07-09T02:16:11.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca3537c640 1 -- 172.21.15.45:0/1394139018 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca200ab760 con 0x7fca3006c110 2023-07-09T02:16:11.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca3537c640 1 -- 172.21.15.45:0/1394139018 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200abaf0 con 0x7fca3006c110 2023-07-09T02:16:11.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca385e2640 1 -- 172.21.15.45:0/1394139018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3006c110 msgr2=0x7fca3006c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.981+0000 7fca385e2640 1 --2- 172.21.15.45:0/1394139018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3006c110 0x7fca3006c560 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fca20009870 tx=0x7fca2001c440 comp rx=0 tx=0).stop 2023-07-09T02:16:11.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 -- 172.21.15.45:0/1394139018 shutdown_connections 2023-07-09T02:16:11.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 --2- 172.21.15.45:0/1394139018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300caec0 0x7fca300cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 --2- 172.21.15.45:0/1394139018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3006c110 0x7fca3006c560 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 -- 172.21.15.45:0/1394139018 >> 172.21.15.45:0/1394139018 conn(0x7fca300694b0 msgr2=0x7fca300698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:11.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 -- 172.21.15.45:0/1394139018 shutdown_connections 2023-07-09T02:16:11.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 -- 172.21.15.45:0/1394139018 wait complete. 2023-07-09T02:16:11.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 Processor -- start 2023-07-09T02:16:11.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 -- start start 2023-07-09T02:16:11.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3006c110 0x7fca3014bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300caec0 0x7fca300c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca30158e30 0x7fca300c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3014d800 con 0x7fca300caec0 2023-07-09T02:16:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3015a430 con 0x7fca30158e30 2023-07-09T02:16:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca385e2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3014eee0 con 0x7fca3006c110 2023-07-09T02:16:11.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300caec0 0x7fca300c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300caec0 0x7fca300c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34224/0 (socket says 172.21.15.45:34224) 2023-07-09T02:16:11.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 -- 172.21.15.45:0/715392715 learned_addr learned my addr 172.21.15.45:0/715392715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:11.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca36b7f640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca30158e30 0x7fca300c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca3637e640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3006c110 0x7fca3014bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 -- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3006c110 msgr2=0x7fca3014bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3006c110 0x7fca3014bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 -- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca30158e30 msgr2=0x7fca300c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:11.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca30158e30 0x7fca300c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:11.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 -- 172.21.15.45:0/715392715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200094d0 con 0x7fca300caec0 2023-07-09T02:16:11.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca36b7f640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca30158e30 0x7fca300c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:11.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca3637e640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3006c110 0x7fca3014bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:11.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.985+0000 7fca35b7d640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300caec0 0x7fca300c3540 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fca200ad040 tx=0x7fca2001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:11.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca26ffd640 1 -- 172.21.15.45:0/715392715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200b4800 con 0x7fca300caec0 2023-07-09T02:16:11.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca26ffd640 1 -- 172.21.15.45:0/715392715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca200b4960 con 0x7fca300caec0 2023-07-09T02:16:11.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca26ffd640 1 -- 172.21.15.45:0/715392715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200b4d10 con 0x7fca300caec0 2023-07-09T02:16:11.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3014dc20 con 0x7fca300caec0 2023-07-09T02:16:11.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3014d140 con 0x7fca300caec0 2023-07-09T02:16:11.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3014d940 con 0x7fca300caec0 2023-07-09T02:16:11.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca26ffd640 1 -- 172.21.15.45:0/715392715 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca200b3380 con 0x7fca300caec0 2023-07-09T02:16:11.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca26ffd640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:11.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca26ffd640 1 -- 172.21.15.45:0/715392715 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fca2011dfd0 con 0x7fca300caec0 2023-07-09T02:16:11.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.989+0000 7fca3637e640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:11.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.993+0000 7fca3637e640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0098b0 tx=0x7fca2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:11.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:11.993+0000 7fca26ffd640 1 -- 172.21.15.45:0/715392715 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca3014d940 con 0x7fca300caec0 2023-07-09T02:16:12.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.181+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca3006caa0 con 0x7fca300caec0 2023-07-09T02:16:12.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.181+0000 7fca26ffd640 1 -- 172.21.15.45:0/715392715 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fca200c4de0 con 0x7fca300caec0 2023-07-09T02:16:12.184 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:12.185 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1384902817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1384902817},{"type":"v1","addr":"172.21.15.45:6835","nonce":1384902817}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5684,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/324339930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":324339930},{"type":"v1","addr":"172.21.15.155:6836","nonce":324339930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6472,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3137070933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3137070933},{"type":"v1","addr":"172.21.15.155:6837","nonce":3137070933}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/355258806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":355258806},{"type":"v1","addr":"172.21.15.45:6833","nonce":355258806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2023-07-09T02:16:12.185 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 44 2023-07-09T02:16:12.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 msgr2=0x7fca14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:12.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0098b0 tx=0x7fca2c008040 comp rx=0 tx=0).stop 2023-07-09T02:16:12.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300caec0 msgr2=0x7fca300c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:12.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300caec0 0x7fca300c3540 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fca200ad040 tx=0x7fca2001ac80 comp rx=0 tx=0).stop 2023-07-09T02:16:12.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 shutdown_connections 2023-07-09T02:16:12.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca30158e30 0x7fca300c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:12.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300caec0 0x7fca300c3540 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:12.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca14066280 0x7fca14068730 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:12.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 --2- 172.21.15.45:0/715392715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3006c110 0x7fca3014bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:12.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 >> 172.21.15.45:0/715392715 conn(0x7fca300694b0 msgr2=0x7fca3006f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:12.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 shutdown_connections 2023-07-09T02:16:12.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.185+0000 7fca385e2640 1 -- 172.21.15.45:0/715392715 wait complete. 2023-07-09T02:16:12.206 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:16:12.206 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:16:12.207 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:16:12.207 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:16:12.207 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:16:12.208 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:16:12.208 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:16:12.209 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:16:12.209 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:16:12.209 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:16:12.210 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:16:12.211 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:16:12.211 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:16:12.211 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:16:12.212 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:16:12.212 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:16:12.218 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:16:12.218 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:16:12.220 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:16:12.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:16:12.226 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:16:12.226 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:16:12.228 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:16:12.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:16:12.270 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:16:12.271 DEBUG:teuthology.parallel:result is None 2023-07-09T02:16:12.274 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:16:12.274 DEBUG:teuthology.parallel:result is None 2023-07-09T02:16:12.275 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:16:12.276 DEBUG:teuthology.parallel:result is None 2023-07-09T02:16:12.278 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:16:12.279 DEBUG:teuthology.parallel:result is None 2023-07-09T02:16:12.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:16:12.359 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:16:12.360 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:16:12.367 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:16:12.368 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:16:12.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc80c34640 1 Processor -- start 2023-07-09T02:16:12.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc80c34640 1 -- start start 2023-07-09T02:16:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc80c34640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc7c15c060 0x7fcc7c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc80c34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c160a50 con 0x7fcc7c0cd120 2023-07-09T02:16:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc80c34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c15c430 con 0x7fcc7c0d2620 2023-07-09T02:16:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc80c34640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7c15fb60 con 0x7fcc7c15c060 2023-07-09T02:16:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc79d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcc7c0cd120 0x7fcc7c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36858/0 (socket says 172.21.15.45:36858) 2023-07-09T02:16:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc79d9b640 1 -- 172.21.15.45:0/109598235 learned_addr learned my addr 172.21.15.45:0/109598235 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc7a59c640 1 --2- 172.21.15.45:0/109598235 >> v2:172.21.15.155:3300/0 conn(0x7fcc7c15c060 0x7fcc7c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc7959a640 1 -- 172.21.15.45:0/109598235 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881272827 0 0) 0x7fcc7c160a50 con 0x7fcc7c0cd120 2023-07-09T02:16:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc7959a640 1 -- 172.21.15.45:0/109598235 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc64003530 con 0x7fcc7c0cd120 2023-07-09T02:16:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc7959a640 1 -- 172.21.15.45:0/109598235 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211907307 0 0) 0x7fcc7c15c430 con 0x7fcc7c0d2620 2023-07-09T02:16:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc7a59c640 1 -- 172.21.15.45:0/109598235 >> v1:172.21.15.155:6789/0 conn(0x7fcc7c0d2620 legacy=0x7fcc7c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc7a59c640 1 -- 172.21.15.45:0/109598235 >> v1:172.21.15.45:6789/0 conn(0x7fcc7c0cd120 legacy=0x7fcc7c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.429+0000 7fcc7a59c640 1 -- 172.21.15.45:0/109598235 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c15fe40 con 0x7fcc7c15c060 2023-07-09T02:16:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc7a59c640 1 --2- 172.21.15.45:0/109598235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c15c060 0x7fcc7c0b4ed0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0097c0 tx=0x7fcc6c01c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8daaf7cf7070fa6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc7959a640 1 -- 172.21.15.45:0/109598235 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70001680 con 0x7fcc7c15c060 2023-07-09T02:16:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc7959a640 1 -- 172.21.15.45:0/109598235 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c0a7050 con 0x7fcc7c15c060 2023-07-09T02:16:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc7959a640 1 -- 172.21.15.45:0/109598235 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0ab620 con 0x7fcc7c15c060 2023-07-09T02:16:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc80c34640 1 -- 172.21.15.45:0/109598235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c15c060 msgr2=0x7fcc7c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc80c34640 1 --2- 172.21.15.45:0/109598235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c15c060 0x7fcc7c0b4ed0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0097c0 tx=0x7fcc6c01c290 comp rx=0 tx=0).stop 2023-07-09T02:16:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc80c34640 1 -- 172.21.15.45:0/109598235 shutdown_connections 2023-07-09T02:16:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc80c34640 1 --2- 172.21.15.45:0/109598235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c15c060 0x7fcc7c0b4ed0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc80c34640 1 -- 172.21.15.45:0/109598235 >> 172.21.15.45:0/109598235 conn(0x7fcc7c0698e0 msgr2=0x7fcc7c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc80c34640 1 -- 172.21.15.45:0/109598235 shutdown_connections 2023-07-09T02:16:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.433+0000 7fcc80c34640 1 -- 172.21.15.45:0/109598235 wait complete. 2023-07-09T02:16:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 Processor -- start 2023-07-09T02:16:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 -- start start 2023-07-09T02:16:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc7c0cd120 0x7fcc7c14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c0d2620 0x7fcc7c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc7c15c060 0x7fcc7c159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c159a60 con 0x7fcc7c0cd120 2023-07-09T02:16:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c154770 con 0x7fcc7c0d2620 2023-07-09T02:16:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c154a50 con 0x7fcc7c15c060 2023-07-09T02:16:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc7c0cd120 0x7fcc7c14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc7c0cd120 0x7fcc7c14ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34260/0 (socket says 172.21.15.45:34260) 2023-07-09T02:16:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 -- 172.21.15.45:0/2438575132 learned_addr learned my addr 172.21.15.45:0/2438575132 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc79d9b640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c0d2620 0x7fcc7c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7ad9d640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc7c15c060 0x7fcc7c159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 -- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc7c15c060 msgr2=0x7fcc7c159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:12.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc7c15c060 0x7fcc7c159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:12.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 -- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c0d2620 msgr2=0x7fcc7c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:12.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c0d2620 0x7fcc7c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:12.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 -- 172.21.15.45:0/2438575132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c009420 con 0x7fcc7c0cd120 2023-07-09T02:16:12.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc7a59c640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc7c0cd120 0x7fcc7c14ee90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0097c0 tx=0x7fcc6c01aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:12.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc6affd640 1 -- 172.21.15.45:0/2438575132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0abd80 con 0x7fcc7c0cd120 2023-07-09T02:16:12.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc6affd640 1 -- 172.21.15.45:0/2438575132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c004020 con 0x7fcc7c0cd120 2023-07-09T02:16:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c0b59f0 con 0x7fcc7c0cd120 2023-07-09T02:16:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc6affd640 1 -- 172.21.15.45:0/2438575132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0043d0 con 0x7fcc7c0cd120 2023-07-09T02:16:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.437+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c1596f0 con 0x7fcc7c0cd120 2023-07-09T02:16:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.441+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7c04d7d0 con 0x7fcc7c0cd120 2023-07-09T02:16:12.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.441+0000 7fcc6affd640 1 -- 172.21.15.45:0/2438575132 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc6c003620 con 0x7fcc7c0cd120 2023-07-09T02:16:12.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.441+0000 7fcc6affd640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc5c066280 0x7fcc5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:12.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.441+0000 7fcc6affd640 1 -- 172.21.15.45:0/2438575132 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcc6c11d990 con 0x7fcc7c0cd120 2023-07-09T02:16:12.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.441+0000 7fcc79d9b640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc5c066280 0x7fcc5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:12.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.441+0000 7fcc79d9b640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc5c066280 0x7fcc5c068730 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcc70001610 tx=0x7fcc70001560 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.445+0000 7fcc6affd640 1 -- 172.21.15.45:0/2438575132 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc6c0eb1d0 con 0x7fcc7c0cd120 2023-07-09T02:16:12.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:12.609+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcc7c06b850 con 0x7fcc7c0cd120 2023-07-09T02:16:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.105+0000 7fcc6affd640 1 -- 172.21.15.45:0/2438575132 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v100) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcc6c0ee7f0 con 0x7fcc7c0cd120 2023-07-09T02:16:13.108 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:16:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc5c066280 msgr2=0x7fcc5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc5c066280 0x7fcc5c068730 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcc70001610 tx=0x7fcc70001560 comp rx=0 tx=0).stop 2023-07-09T02:16:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc7c0cd120 msgr2=0x7fcc7c14ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc7c0cd120 0x7fcc7c14ee90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0097c0 tx=0x7fcc6c01aad0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 shutdown_connections 2023-07-09T02:16:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc5c066280 0x7fcc5c068730 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc7c15c060 0x7fcc7c159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc7c0d2620 0x7fcc7c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 --2- 172.21.15.45:0/2438575132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc7c0cd120 0x7fcc7c14ee90 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 >> 172.21.15.45:0/2438575132 conn(0x7fcc7c0698e0 msgr2=0x7fcc7c0b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 shutdown_connections 2023-07-09T02:16:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.109+0000 7fcc80c34640 1 -- 172.21.15.45:0/2438575132 wait complete. 2023-07-09T02:16:13.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:16:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.273+0000 7f47a9cec640 1 Processor -- start 2023-07-09T02:16:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a9cec640 1 -- start start 2023-07-09T02:16:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a9cec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47a40d2620 0x7f47a40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a9cec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a4160a50 con 0x7f47a415c060 2023-07-09T02:16:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a9cec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a415c430 con 0x7f47a40cd120 2023-07-09T02:16:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a9cec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a415fb60 con 0x7f47a40d2620 2023-07-09T02:16:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47a40d2620 0x7f47a40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47a40d2620 0x7f47a40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34264/0 (socket says 172.21.15.45:34264) 2023-07-09T02:16:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a2ffd640 1 -- 172.21.15.45:0/212719939 learned_addr learned my addr 172.21.15.45:0/212719939 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a37fe640 1 --1- 172.21.15.45:0/212719939 >> v1:172.21.15.45:6789/0 conn(0x7f47a415c060 0x7f47a40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36874/0 (socket says 172.21.15.45:36874) 2023-07-09T02:16:13.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a2ffd640 1 -- 172.21.15.45:0/212719939 >> v1:172.21.15.155:6789/0 conn(0x7f47a40cd120 legacy=0x7f47a40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a2ffd640 1 -- 172.21.15.45:0/212719939 >> v1:172.21.15.45:6789/0 conn(0x7f47a415c060 legacy=0x7f47a40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a2ffd640 1 -- 172.21.15.45:0/212719939 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a415fe40 con 0x7f47a40d2620 2023-07-09T02:16:13.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.277+0000 7f47a27fc640 1 -- 172.21.15.45:0/212719939 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682412866 0 0) 0x7f47a4160a50 con 0x7f47a415c060 2023-07-09T02:16:13.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a2ffd640 1 --2- 172.21.15.45:0/212719939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d2620 0x7f47a40b4ed0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4798009870 tx=0x7f479801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e90dc5b96db611 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:13.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a27fc640 1 -- 172.21.15.45:0/212719939 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980aa670 con 0x7f47a40d2620 2023-07-09T02:16:13.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a27fc640 1 -- 172.21.15.45:0/212719939 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47980aa7d0 con 0x7f47a40d2620 2023-07-09T02:16:13.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a27fc640 1 -- 172.21.15.45:0/212719939 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980aab60 con 0x7f47a40d2620 2023-07-09T02:16:13.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 -- 172.21.15.45:0/212719939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d2620 msgr2=0x7f47a40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 --2- 172.21.15.45:0/212719939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d2620 0x7f47a40b4ed0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4798009870 tx=0x7f479801c510 comp rx=0 tx=0).stop 2023-07-09T02:16:13.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 -- 172.21.15.45:0/212719939 shutdown_connections 2023-07-09T02:16:13.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 --2- 172.21.15.45:0/212719939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d2620 0x7f47a40b4ed0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 -- 172.21.15.45:0/212719939 >> 172.21.15.45:0/212719939 conn(0x7f47a40698e0 msgr2=0x7f47a4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:13.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 -- 172.21.15.45:0/212719939 shutdown_connections 2023-07-09T02:16:13.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 -- 172.21.15.45:0/212719939 wait complete. 2023-07-09T02:16:13.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 Processor -- start 2023-07-09T02:16:13.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.281+0000 7f47a9cec640 1 -- start start 2023-07-09T02:16:13.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40cd120 0x7f47a4151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a40d2620 0x7f47a415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47a415c060 0x7f47a4153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4153770 con 0x7f47a40cd120 2023-07-09T02:16:13.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a41529b0 con 0x7f47a40d2620 2023-07-09T02:16:13.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4152c90 con 0x7f47a415c060 2023-07-09T02:16:13.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40cd120 0x7f47a4151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40cd120 0x7f47a4151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34266/0 (socket says 172.21.15.45:34266) 2023-07-09T02:16:13.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 -- 172.21.15.45:0/2529694256 learned_addr learned my addr 172.21.15.45:0/2529694256 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:13.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a2ffd640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a40d2620 0x7f47a415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a3fff640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47a415c060 0x7f47a4153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 -- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47a415c060 msgr2=0x7f47a4153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47a415c060 0x7f47a4153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 -- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a40d2620 msgr2=0x7f47a415acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a40d2620 0x7f47a415acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 -- 172.21.15.45:0/2529694256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980094d0 con 0x7f47a40cd120 2023-07-09T02:16:13.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a37fe640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40cd120 0x7f47a4151700 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f479400c410 tx=0x7f479400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:13.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f478bfff640 1 -- 172.21.15.45:0/2529694256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47940074e0 con 0x7f47a40cd120 2023-07-09T02:16:13.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f478bfff640 1 -- 172.21.15.45:0/2529694256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794007640 con 0x7f47a40cd120 2023-07-09T02:16:13.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a40b59f0 con 0x7f47a40cd120 2023-07-09T02:16:13.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f478bfff640 1 -- 172.21.15.45:0/2529694256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794004a30 con 0x7f47a40cd120 2023-07-09T02:16:13.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a4153250 con 0x7f47a40cd120 2023-07-09T02:16:13.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a404d7d0 con 0x7f47a40cd120 2023-07-09T02:16:13.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.285+0000 7f478bfff640 1 -- 172.21.15.45:0/2529694256 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4794004b90 con 0x7f47a40cd120 2023-07-09T02:16:13.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.289+0000 7f478bfff640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f47900662b0 0x7f4790068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.289+0000 7f478bfff640 1 -- 172.21.15.45:0/2529694256 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f47940836f0 con 0x7f47a40cd120 2023-07-09T02:16:13.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.289+0000 7f47a2ffd640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f47900662b0 0x7f4790068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.289+0000 7f47a2ffd640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f47900662b0 0x7f4790068760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f47980ae000 tx=0x7f47980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.293+0000 7f478bfff640 1 -- 172.21.15.45:0/2529694256 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4794050ee0 con 0x7f47a40cd120 2023-07-09T02:16:13.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.497+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f47a406baa0 con 0x7f47a40cd120 2023-07-09T02:16:13.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.497+0000 7f478bfff640 1 -- 172.21.15.45:0/2529694256 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4794054500 con 0x7f47a40cd120 2023-07-09T02:16:13.499 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:13.499 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:13.499 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:16:13.499 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.500 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:16:13.500 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:16:13.500 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.500 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:16:13.500 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:16:13.500 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:16:13.500 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:16:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:16:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:16:13.501 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:16:13.502 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:16:13.502 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.502 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.502 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:16:13.502 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:16:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:16:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:16:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:16:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.504 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:16:13.504 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:16:13.504 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.504 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:16:13.504 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:16:13.504 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:16:13.504 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.505 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.505 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.505 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:16:13.505 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:16:13.505 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.505 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:16:13.506 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:16:13.506 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.506 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.506 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:16:13.506 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:16:13.506 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.507 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:16:13.507 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:16:13.507 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.507 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.507 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.507 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:16:13.508 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:16:13.508 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.508 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:16:13.508 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:16:13.508 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.508 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.509 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.509 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:16:13.509 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:16:13.509 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.509 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:16:13.509 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:16:13.509 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.509 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:16:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:16:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:16:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:16:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:16:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:16:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:16:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:16:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:16:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:16:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.513 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:16:13.513 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:16:13.513 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.513 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.513 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.513 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:16:13.514 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:16:13.514 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.514 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:16:13.514 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:16:13.514 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.514 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.514 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.515 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:16:13.515 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:16:13.515 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.515 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:16:13.515 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:16:13.515 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:16:13.516 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.516 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.516 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:16:13.516 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:16:13.516 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.516 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:16:13.516 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:16:13.517 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:16:13.517 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:16:13.517 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.517 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:16:13.517 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:16:13.517 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.518 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:16:13.518 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:16:13.518 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:16:13.518 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:16:13.518 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.518 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.518 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:16:13.519 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:16:13.519 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.519 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:16:13.519 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:16:13.519 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:16:13.519 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:16:13.519 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:16:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:16:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:16:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:16:13.520 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:16:13.521 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.521 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.521 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.521 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:16:13.521 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:16:13.521 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.521 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:16:13.522 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:16:13.522 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.522 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:13.522 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:13.522 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:16:13.522 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:16:13.523 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:16:13.523 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:16:13.523 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:16:13.523 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:16:13.523 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.523 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:13.523 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:13.523 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f47900662b0 msgr2=0x7f4790068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f47900662b0 0x7f4790068760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f47980ae000 tx=0x7f47980a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40cd120 msgr2=0x7f47a4151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40cd120 0x7f47a4151700 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f479400c410 tx=0x7f479400c8d0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 shutdown_connections 2023-07-09T02:16:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f47900662b0 0x7f4790068760 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47a415c060 0x7f47a4153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47a40d2620 0x7f47a415acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 --2- 172.21.15.45:0/2529694256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40cd120 0x7f47a4151700 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 >> 172.21.15.45:0/2529694256 conn(0x7f47a40698e0 msgr2=0x7f47a40b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 shutdown_connections 2023-07-09T02:16:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.501+0000 7f47a9cec640 1 -- 172.21.15.45:0/2529694256 wait complete. 2023-07-09T02:16:13.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc0ba7b640 1 Processor -- start 2023-07-09T02:16:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc0ba7b640 1 -- start start 2023-07-09T02:16:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc0ba7b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdc040ca0f0 0x7fdc040cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc0ba7b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0406bf30 con 0x7fdc0415db00 2023-07-09T02:16:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc0ba7b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0406bc50 con 0x7fdc040cbbb0 2023-07-09T02:16:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc0ba7b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc040cab90 con 0x7fdc040ca0f0 2023-07-09T02:16:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc0a018640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdc0415db00 0x7fdc0406b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36882/0 (socket says 172.21.15.45:36882) 2023-07-09T02:16:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc0a018640 1 -- 172.21.15.45:0/3482218659 learned_addr learned my addr 172.21.15.45:0/3482218659 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.669+0000 7fdc09817640 1 --2- 172.21.15.45:0/3482218659 >> v2:172.21.15.155:3300/0 conn(0x7fdc040ca0f0 0x7fdc040cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc08815640 1 -- 172.21.15.45:0/3482218659 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149978782 0 0) 0x7fdc0406bf30 con 0x7fdc0415db00 2023-07-09T02:16:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc08815640 1 -- 172.21.15.45:0/3482218659 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf0003530 con 0x7fdc0415db00 2023-07-09T02:16:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc09817640 1 -- 172.21.15.45:0/3482218659 >> v1:172.21.15.155:6789/0 conn(0x7fdc040cbbb0 legacy=0x7fdc040c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc09817640 1 -- 172.21.15.45:0/3482218659 >> v1:172.21.15.45:6789/0 conn(0x7fdc0415db00 legacy=0x7fdc0406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc09817640 1 -- 172.21.15.45:0/3482218659 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040cae70 con 0x7fdc040ca0f0 2023-07-09T02:16:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc09817640 1 --2- 172.21.15.45:0/3482218659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040ca0f0 0x7fdc040cb670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdc000097c0 tx=0x7fdc0001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29f1e8e56a1b712a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc08815640 1 -- 172.21.15.45:0/3482218659 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc000ab600 con 0x7fdc040ca0f0 2023-07-09T02:16:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc08815640 1 -- 172.21.15.45:0/3482218659 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc000a7050 con 0x7fdc040ca0f0 2023-07-09T02:16:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.673+0000 7fdc08815640 1 -- 172.21.15.45:0/3482218659 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc000ab960 con 0x7fdc040ca0f0 2023-07-09T02:16:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3482218659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040ca0f0 msgr2=0x7fdc040cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 --2- 172.21.15.45:0/3482218659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040ca0f0 0x7fdc040cb670 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdc000097c0 tx=0x7fdc0001c3f0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3482218659 shutdown_connections 2023-07-09T02:16:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 --2- 172.21.15.45:0/3482218659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040ca0f0 0x7fdc040cb670 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3482218659 >> 172.21.15.45:0/3482218659 conn(0x7fdc040694b0 msgr2=0x7fdc040698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3482218659 shutdown_connections 2023-07-09T02:16:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3482218659 wait complete. 2023-07-09T02:16:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 Processor -- start 2023-07-09T02:16:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- start start 2023-07-09T02:16:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc040ca0f0 0x7fdc040c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040cbbb0 0x7fdc0413bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc0415db00 0x7fdc041387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040c7c10 con 0x7fdc0415db00 2023-07-09T02:16:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0413c0a0 con 0x7fdc040cbbb0 2023-07-09T02:16:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0ba7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040c8a00 con 0x7fdc040ca0f0 2023-07-09T02:16:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0a018640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc0415db00 0x7fdc041387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0a018640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc0415db00 0x7fdc041387a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34272/0 (socket says 172.21.15.45:34272) 2023-07-09T02:16:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0a018640 1 -- 172.21.15.45:0/3168811841 learned_addr learned my addr 172.21.15.45:0/3168811841 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:13.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc09817640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc040ca0f0 0x7fdc040c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc09016640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040cbbb0 0x7fdc0413bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0a018640 1 -- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc040ca0f0 msgr2=0x7fdc040c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0a018640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc040ca0f0 0x7fdc040c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0a018640 1 -- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040cbbb0 msgr2=0x7fdc0413bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.677+0000 7fdc0a018640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040cbbb0 0x7fdc0413bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdc0a018640 1 -- 172.21.15.45:0/3168811841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00009420 con 0x7fdc0415db00 2023-07-09T02:16:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdc0a018640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc0415db00 0x7fdc041387a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00cad0 tx=0x7fdbfc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdbfa7fc640 1 -- 172.21.15.45:0/3168811841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc00ac30 con 0x7fdc0415db00 2023-07-09T02:16:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdbfa7fc640 1 -- 172.21.15.45:0/3168811841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc00ad90 con 0x7fdc0415db00 2023-07-09T02:16:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdbfa7fc640 1 -- 172.21.15.45:0/3168811841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc012620 con 0x7fdc0415db00 2023-07-09T02:16:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc040c7df0 con 0x7fdc0415db00 2023-07-09T02:16:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc040c83b0 con 0x7fdc0415db00 2023-07-09T02:16:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc04139100 con 0x7fdc0415db00 2023-07-09T02:16:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdbfa7fc640 1 -- 172.21.15.45:0/3168811841 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdbfc007070 con 0x7fdc0415db00 2023-07-09T02:16:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdbfa7fc640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbe8066280 0x7fdbe8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdbfa7fc640 1 -- 172.21.15.45:0/3168811841 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdbfc083990 con 0x7fdc0415db00 2023-07-09T02:16:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.681+0000 7fdc09817640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbe8066280 0x7fdbe8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.685+0000 7fdc09817640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbe8066280 0x7fdbe8068730 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdc000ad000 tx=0x7fdc000a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:13.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.685+0000 7fdbfa7fc640 1 -- 172.21.15.45:0/3168811841 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc04139100 con 0x7fdc0415db00 2023-07-09T02:16:13.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.841+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc04139100 con 0x7fdc0415db00 2023-07-09T02:16:13.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.841+0000 7fdbfa7fc640 1 -- 172.21.15.45:0/3168811841 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+14641 (secure 0 0 0) 0x7fdc04139100 con 0x7fdc0415db00 2023-07-09T02:16:13.845 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:13.845 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":102,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:13.115661+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:13.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbe8066280 msgr2=0x7fdbe8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbe8066280 0x7fdbe8068730 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdc000ad000 tx=0x7fdc000a4f90 comp rx=0 tx=0).stop 2023-07-09T02:16:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc0415db00 msgr2=0x7fdc041387a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc0415db00 0x7fdc041387a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00cad0 tx=0x7fdbfc00cf90 comp rx=0 tx=0).stop 2023-07-09T02:16:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 shutdown_connections 2023-07-09T02:16:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc0415db00 0x7fdc041387a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc040cbbb0 0x7fdc0413bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbe8066280 0x7fdbe8068730 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 --2- 172.21.15.45:0/3168811841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc040ca0f0 0x7fdc040c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 >> 172.21.15.45:0/3168811841 conn(0x7fdc040694b0 msgr2=0x7fdc04070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 shutdown_connections 2023-07-09T02:16:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:13.845+0000 7fdc0ba7b640 1 -- 172.21.15.45:0/3168811841 wait complete. 2023-07-09T02:16:13.865 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:16:13.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:16:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.009+0000 7f8fba18f640 1 Processor -- start 2023-07-09T02:16:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.009+0000 7f8fba18f640 1 -- start start 2023-07-09T02:16:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fba18f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8fb40ca0f0 0x7f8fb40cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fba18f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb406bf30 con 0x7f8fb415db00 2023-07-09T02:16:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fba18f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb406bc50 con 0x7f8fb40cbbb0 2023-07-09T02:16:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fba18f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40cab90 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fb3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8fb415db00 0x7f8fb406b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36896/0 (socket says 172.21.15.45:36896) 2023-07-09T02:16:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fb3fff640 1 -- 172.21.15.45:0/1004382451 learned_addr learned my addr 172.21.15.45:0/1004382451 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fb37fe640 1 --2- 172.21.15.45:0/1004382451 >> v2:172.21.15.155:3300/0 conn(0x7f8fb40ca0f0 0x7f8fb40cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fb27fc640 1 -- 172.21.15.45:0/1004382451 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715388012 0 0) 0x7f8fb406bf30 con 0x7f8fb415db00 2023-07-09T02:16:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fb27fc640 1 -- 172.21.15.45:0/1004382451 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f9c003530 con 0x7f8fb415db00 2023-07-09T02:16:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fb37fe640 1 -- 172.21.15.45:0/1004382451 >> v1:172.21.15.155:6789/0 conn(0x7f8fb40cbbb0 legacy=0x7f8fb40c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fb37fe640 1 -- 172.21.15.45:0/1004382451 >> v1:172.21.15.45:6789/0 conn(0x7f8fb415db00 legacy=0x7f8fb406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.013+0000 7f8fb37fe640 1 -- 172.21.15.45:0/1004382451 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40cae70 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fb37fe640 1 --2- 172.21.15.45:0/1004382451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb40cb670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40097c0 tx=0x7f8fa401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a1b6f741614af3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fb27fc640 1 -- 172.21.15.45:0/1004382451 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40ab600 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fb27fc640 1 -- 172.21.15.45:0/1004382451 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa40a7050 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fb27fc640 1 -- 172.21.15.45:0/1004382451 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40ab980 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 -- 172.21.15.45:0/1004382451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40ca0f0 msgr2=0x7f8fb40cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 --2- 172.21.15.45:0/1004382451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb40cb670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40097c0 tx=0x7f8fa401c3f0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 -- 172.21.15.45:0/1004382451 shutdown_connections 2023-07-09T02:16:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 --2- 172.21.15.45:0/1004382451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb40cb670 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 -- 172.21.15.45:0/1004382451 >> 172.21.15.45:0/1004382451 conn(0x7f8fb40694b0 msgr2=0x7f8fb40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 -- 172.21.15.45:0/1004382451 shutdown_connections 2023-07-09T02:16:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 -- 172.21.15.45:0/1004382451 wait complete. 2023-07-09T02:16:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 Processor -- start 2023-07-09T02:16:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.017+0000 7f8fba18f640 1 -- start start 2023-07-09T02:16:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb4145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40cbbb0 0x7f8fb40c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fb415db00 0x7f8fb41450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40c8660 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4146250 con 0x7f8fb40cbbb0 2023-07-09T02:16:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40c7900 con 0x7f8fb415db00 2023-07-09T02:16:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb4145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb4145990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34282/0 (socket says 172.21.15.45:34282) 2023-07-09T02:16:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 -- 172.21.15.45:0/4211774300 learned_addr learned my addr 172.21.15.45:0/4211774300 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb2ffd640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40cbbb0 0x7f8fb40c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 -- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fb415db00 msgr2=0x7f8fb41450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb3fff640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fb415db00 0x7f8fb41450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fb415db00 0x7f8fb41450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 -- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40cbbb0 msgr2=0x7f8fb40c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40cbbb0 0x7f8fb40c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 -- 172.21.15.45:0/4211774300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4009420 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb2ffd640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40cbbb0 0x7f8fb40c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb3fff640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fb415db00 0x7f8fb41450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fb37fe640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb4145990 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40ae040 tx=0x7f8fa401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8f9bfff640 1 -- 172.21.15.45:0/4211774300 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40b7450 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8f9bfff640 1 -- 172.21.15.45:0/4211774300 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa40b75b0 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8f9bfff640 1 -- 172.21.15.45:0/4211774300 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40b7960 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb40c70a0 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb40c7620 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb404d7d0 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.021+0000 7f8f9bfff640 1 -- 172.21.15.45:0/4211774300 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8fa40b7ac0 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.025+0000 7f8f9bfff640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8fa0066280 0x7f8fa0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.025+0000 7f8f9bfff640 1 -- 172.21.15.45:0/4211774300 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8fa411e090 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.025+0000 7f8fb2ffd640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8fa0066280 0x7f8fa0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.025+0000 7f8fb2ffd640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8fa0066280 0x7f8fa0068730 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8fb406a040 tx=0x7f8fa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.029+0000 7f8f9bfff640 1 -- 172.21.15.45:0/4211774300 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8fa40eb850 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.181+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fb406c540 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8f9bfff640 1 -- 172.21.15.45:0/4211774300 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fa40eee70 con 0x7f8fb40ca0f0 2023-07-09T02:16:14.190 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:16:14.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8fa0066280 msgr2=0x7f8fa0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8fa0066280 0x7f8fa0068730 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8fb406a040 tx=0x7f8fa8009040 comp rx=0 tx=0).stop 2023-07-09T02:16:14.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb40ca0f0 msgr2=0x7f8fb4145990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb4145990 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40ae040 tx=0x7f8fa401ac30 comp rx=0 tx=0).stop 2023-07-09T02:16:14.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 shutdown_connections 2023-07-09T02:16:14.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8fa0066280 0x7f8fa0068730 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8fb415db00 0x7f8fb41450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fb40cbbb0 0x7f8fb40c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 --2- 172.21.15.45:0/4211774300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb40ca0f0 0x7f8fb4145990 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 >> 172.21.15.45:0/4211774300 conn(0x7f8fb40694b0 msgr2=0x7f8fb40c4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 shutdown_connections 2023-07-09T02:16:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.185+0000 7f8fba18f640 1 -- 172.21.15.45:0/4211774300 wait complete. 2023-07-09T02:16:14.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:16:14.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a62b59640 1 Processor -- start 2023-07-09T02:16:14.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a62b59640 1 -- start start 2023-07-09T02:16:14.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a62b59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a62b59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c160a50 con 0x7f1a5c15c060 2023-07-09T02:16:14.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a62b59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c15c430 con 0x7f1a5c0cd120 2023-07-09T02:16:14.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a62b59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c15fb60 con 0x7f1a5c0d2620 2023-07-09T02:16:14.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a608f5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1a5c15c060 0x7f1a5c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36912/0 (socket says 172.21.15.45:36912) 2023-07-09T02:16:14.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a608f5640 1 -- 172.21.15.45:0/12043411 learned_addr learned my addr 172.21.15.45:0/12043411 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a5bfff640 1 --2- 172.21.15.45:0/12043411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a5b7fe640 1 -- 172.21.15.45:0/12043411 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781999783 0 0) 0x7f1a5c160a50 con 0x7f1a5c15c060 2023-07-09T02:16:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a5b7fe640 1 -- 172.21.15.45:0/12043411 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a4c003530 con 0x7f1a5c15c060 2023-07-09T02:16:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a5b7fe640 1 -- 172.21.15.45:0/12043411 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422722783 0 0) 0x7f1a5c15c430 con 0x7f1a5c0cd120 2023-07-09T02:16:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.353+0000 7f1a5b7fe640 1 -- 172.21.15.45:0/12043411 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a5c160a50 con 0x7f1a5c0cd120 2023-07-09T02:16:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a5bfff640 1 -- 172.21.15.45:0/12043411 >> v1:172.21.15.155:6789/0 conn(0x7f1a5c0cd120 legacy=0x7f1a5c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a5b7fe640 1 -- 172.21.15.45:0/12043411 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070578183 0 0) 0x7f1a4c003530 con 0x7f1a5c15c060 2023-07-09T02:16:14.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a5bfff640 1 -- 172.21.15.45:0/12043411 >> v1:172.21.15.45:6789/0 conn(0x7f1a5c15c060 legacy=0x7f1a5c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a5bfff640 1 -- 172.21.15.45:0/12043411 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c15fe40 con 0x7f1a5c0d2620 2023-07-09T02:16:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a5bfff640 1 --2- 172.21.15.45:0/12043411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c0b4ed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a480097f0 tx=0x7f1a4801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5126a7e83d4ef1d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a5b7fe640 1 -- 172.21.15.45:0/12043411 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50001680 con 0x7f1a5c0d2620 2023-07-09T02:16:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a5b7fe640 1 -- 172.21.15.45:0/12043411 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a480a7050 con 0x7f1a5c0d2620 2023-07-09T02:16:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a5b7fe640 1 -- 172.21.15.45:0/12043411 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480ab620 con 0x7f1a5c0d2620 2023-07-09T02:16:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.357+0000 7f1a62b59640 1 -- 172.21.15.45:0/12043411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 msgr2=0x7f1a5c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 --2- 172.21.15.45:0/12043411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c0b4ed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a480097f0 tx=0x7f1a4801c3b0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 -- 172.21.15.45:0/12043411 shutdown_connections 2023-07-09T02:16:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 --2- 172.21.15.45:0/12043411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c0b4ed0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 -- 172.21.15.45:0/12043411 >> 172.21.15.45:0/12043411 conn(0x7f1a5c0698e0 msgr2=0x7f1a5c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 -- 172.21.15.45:0/12043411 shutdown_connections 2023-07-09T02:16:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 -- 172.21.15.45:0/12043411 wait complete. 2023-07-09T02:16:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 Processor -- start 2023-07-09T02:16:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 -- start start 2023-07-09T02:16:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a5c0cd120 0x7f1a5c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c13d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a5c15c060 0x7f1a5c15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c13e260 con 0x7f1a5c15c060 2023-07-09T02:16:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c13e540 con 0x7f1a5c0cd120 2023-07-09T02:16:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a62b59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c13e820 con 0x7f1a5c0d2620 2023-07-09T02:16:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a610f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a5c15c060 0x7f1a5c15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a610f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a5c15c060 0x7f1a5c15ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34294/0 (socket says 172.21.15.45:34294) 2023-07-09T02:16:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a610f6640 1 -- 172.21.15.45:0/2013849111 learned_addr learned my addr 172.21.15.45:0/2013849111 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a608f5640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a5c0cd120 0x7f1a5c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a5bfff640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c13d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a610f6640 1 -- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 msgr2=0x7f1a5c13d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a610f6640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c13d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a610f6640 1 -- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a5c0cd120 msgr2=0x7f1a5c1517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a610f6640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a5c0cd120 0x7f1a5c1517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.361+0000 7f1a610f6640 1 -- 172.21.15.45:0/2013849111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48009420 con 0x7f1a5c15c060 2023-07-09T02:16:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a610f6640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a5c15c060 0x7f1a5c15ee70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c790 tx=0x7f1a5400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a597fa640 1 -- 172.21.15.45:0/2013849111 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400cea0 con 0x7f1a5c15c060 2023-07-09T02:16:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a597fa640 1 -- 172.21.15.45:0/2013849111 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54003b80 con 0x7f1a5c15c060 2023-07-09T02:16:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a597fa640 1 -- 172.21.15.45:0/2013849111 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400a850 con 0x7f1a5c15c060 2023-07-09T02:16:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c0b59f0 con 0x7f1a5c15c060 2023-07-09T02:16:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c15e950 con 0x7f1a5c15c060 2023-07-09T02:16:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c15e4d0 con 0x7f1a5c15c060 2023-07-09T02:16:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a597fa640 1 -- 172.21.15.45:0/2013849111 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a5400a9b0 con 0x7f1a5c15c060 2023-07-09T02:16:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a597fa640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1a40066280 0x7f1a40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a597fa640 1 -- 172.21.15.45:0/2013849111 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1a54083750 con 0x7f1a5c15c060 2023-07-09T02:16:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.365+0000 7f1a608f5640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1a40066280 0x7f1a40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.369+0000 7f1a608f5640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1a40066280 0x7f1a40068730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1a50000f70 tx=0x7f1a500016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.369+0000 7f1a597fa640 1 -- 172.21.15.45:0/2013849111 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a5c15e4d0 con 0x7f1a5c15c060 2023-07-09T02:16:14.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a5c15e4d0 con 0x7f1a5c15c060 2023-07-09T02:16:14.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a597fa640 1 -- 172.21.15.45:0/2013849111 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1a5c15e4d0 con 0x7f1a5c15c060 2023-07-09T02:16:14.526 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:16:14.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1a40066280 msgr2=0x7f1a40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1a40066280 0x7f1a40068730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1a50000f70 tx=0x7f1a500016c0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a5c15c060 msgr2=0x7f1a5c15ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a5c15c060 0x7f1a5c15ee70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c790 tx=0x7f1a5400cc50 comp rx=0 tx=0).stop 2023-07-09T02:16:14.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 shutdown_connections 2023-07-09T02:16:14.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a5c15c060 0x7f1a5c15ee70 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1a40066280 0x7f1a40068730 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a5c0d2620 0x7f1a5c13d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 --2- 172.21.15.45:0/2013849111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a5c0cd120 0x7f1a5c1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 >> 172.21.15.45:0/2013849111 conn(0x7f1a5c0698e0 msgr2=0x7f1a5c0b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 shutdown_connections 2023-07-09T02:16:14.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.525+0000 7f1a62b59640 1 -- 172.21.15.45:0/2013849111 wait complete. 2023-07-09T02:16:14.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:16:14.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8265834640 1 Processor -- start 2023-07-09T02:16:14.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8265834640 1 -- start start 2023-07-09T02:16:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8265834640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f826006a5c0 0x7f826015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8265834640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8260071140 con 0x7f82600cd290 2023-07-09T02:16:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8265834640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826006b010 con 0x7f826006aa40 2023-07-09T02:16:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8265834640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826015c970 con 0x7f826006a5c0 2023-07-09T02:16:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8257fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f826006a5c0 0x7f826015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8257fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f826006a5c0 0x7f826015fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34300/0 (socket says 172.21.15.45:34300) 2023-07-09T02:16:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8257fff640 1 -- 172.21.15.45:0/1105937756 learned_addr learned my addr 172.21.15.45:0/1105937756 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f825effd640 1 --1- 172.21.15.45:0/1105937756 >> v1:172.21.15.45:6789/0 conn(0x7f82600cd290 0x7f82600cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36914/0 (socket says 172.21.15.45:36914) 2023-07-09T02:16:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8257fff640 1 -- 172.21.15.45:0/1105937756 >> v1:172.21.15.155:6789/0 conn(0x7f826006aa40 legacy=0x7f8260160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8257fff640 1 -- 172.21.15.45:0/1105937756 >> v1:172.21.15.45:6789/0 conn(0x7f82600cd290 legacy=0x7f82600cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.689+0000 7f8257fff640 1 -- 172.21.15.45:0/1105937756 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826015cc50 con 0x7f826006a5c0 2023-07-09T02:16:14.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f8257fff640 1 --2- 172.21.15.45:0/1105937756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826006a5c0 0x7f826015fdd0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8248009870 tx=0x7f824801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ec444df540b11e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f825e7fc640 1 -- 172.21.15.45:0/1105937756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480ab600 con 0x7f826006a5c0 2023-07-09T02:16:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f825e7fc640 1 -- 172.21.15.45:0/1105937756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82480a7050 con 0x7f826006a5c0 2023-07-09T02:16:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f825e7fc640 1 -- 172.21.15.45:0/1105937756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480ab980 con 0x7f826006a5c0 2023-07-09T02:16:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f8265834640 1 -- 172.21.15.45:0/1105937756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826006a5c0 msgr2=0x7f826015fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f8265834640 1 --2- 172.21.15.45:0/1105937756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826006a5c0 0x7f826015fdd0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8248009870 tx=0x7f824801c540 comp rx=0 tx=0).stop 2023-07-09T02:16:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f8265834640 1 -- 172.21.15.45:0/1105937756 shutdown_connections 2023-07-09T02:16:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f8265834640 1 --2- 172.21.15.45:0/1105937756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f826006a5c0 0x7f826015fdd0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f8265834640 1 -- 172.21.15.45:0/1105937756 >> 172.21.15.45:0/1105937756 conn(0x7f826006d140 msgr2=0x7f826006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f8265834640 1 -- 172.21.15.45:0/1105937756 shutdown_connections 2023-07-09T02:16:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.693+0000 7f8265834640 1 -- 172.21.15.45:0/1105937756 wait complete. 2023-07-09T02:16:14.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 Processor -- start 2023-07-09T02:16:14.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 -- start start 2023-07-09T02:16:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f826006a5c0 0x7f82600ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826006aa40 0x7f8260145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82600cd290 0x7f82600c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82601470c0 con 0x7f82600cd290 2023-07-09T02:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8260157f80 con 0x7f826006aa40 2023-07-09T02:16:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8260158260 con 0x7f826006a5c0 2023-07-09T02:16:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82600cd290 0x7f82600c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82600cd290 0x7f82600c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34306/0 (socket says 172.21.15.45:34306) 2023-07-09T02:16:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 -- 172.21.15.45:0/3590604331 learned_addr learned my addr 172.21.15.45:0/3590604331 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825effd640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f826006a5c0 0x7f82600ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8257fff640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826006aa40 0x7f8260145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 -- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f826006a5c0 msgr2=0x7f82600ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f826006a5c0 0x7f82600ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 -- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826006aa40 msgr2=0x7f8260145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826006aa40 0x7f8260145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 -- 172.21.15.45:0/3590604331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82480094d0 con 0x7f82600cd290 2023-07-09T02:16:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825effd640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f826006a5c0 0x7f82600ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825f7fe640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82600cd290 0x7f82600c34e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f825800c770 tx=0x7f825800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825cff9640 1 -- 172.21.15.45:0/3590604331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258003b80 con 0x7f82600cd290 2023-07-09T02:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825cff9640 1 -- 172.21.15.45:0/3590604331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258003ce0 con 0x7f82600cd290 2023-07-09T02:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8260147360 con 0x7f82600cd290 2023-07-09T02:16:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.697+0000 7f825cff9640 1 -- 172.21.15.45:0/3590604331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825800aa90 con 0x7f82600cd290 2023-07-09T02:16:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.701+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8260158540 con 0x7f82600cd290 2023-07-09T02:16:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.701+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82601475a0 con 0x7f82600cd290 2023-07-09T02:16:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.701+0000 7f825cff9640 1 -- 172.21.15.45:0/3590604331 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f825800abf0 con 0x7f82600cd290 2023-07-09T02:16:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.701+0000 7f825cff9640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82400662b0 0x7f8240068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.701+0000 7f825cff9640 1 -- 172.21.15.45:0/3590604331 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f82580837f0 con 0x7f82600cd290 2023-07-09T02:16:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.701+0000 7f825effd640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82400662b0 0x7f8240068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.705+0000 7f825effd640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82400662b0 0x7f8240068760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8250000f70 tx=0x7f8250007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.705+0000 7f825cff9640 1 -- 172.21.15.45:0/3590604331 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82601475a0 con 0x7f82600cd290 2023-07-09T02:16:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.865+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8260147550 con 0x7f82600cd290 2023-07-09T02:16:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.865+0000 7f825cff9640 1 -- 172.21.15.45:0/3590604331 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v102) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8258050f20 con 0x7f82600cd290 2023-07-09T02:16:14.867 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:14.867 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:16:14.867 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:14.868 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:16:14.868 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:16:14.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:14.868 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:14.868 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:16:14.868 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:16:14.868 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:14.869 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:16:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82400662b0 msgr2=0x7f8240068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82400662b0 0x7f8240068760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8250000f70 tx=0x7f8250007d70 comp rx=0 tx=0).stop 2023-07-09T02:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82600cd290 msgr2=0x7f82600c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82600cd290 0x7f82600c34e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f825800c770 tx=0x7f825800cc30 comp rx=0 tx=0).stop 2023-07-09T02:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 shutdown_connections 2023-07-09T02:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82600cd290 0x7f82600c34e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f826006aa40 0x7f8260145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82400662b0 0x7f8240068760 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 --2- 172.21.15.45:0/3590604331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f826006a5c0 0x7f82600ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 >> 172.21.15.45:0/3590604331 conn(0x7f826006d140 msgr2=0x7f826015a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 shutdown_connections 2023-07-09T02:16:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:14.869+0000 7f8265834640 1 -- 172.21.15.45:0/3590604331 wait complete. 2023-07-09T02:16:14.888 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:16:14.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:16:15.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.033+0000 7f74da419640 1 Processor -- start 2023-07-09T02:16:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.033+0000 7f74da419640 1 -- start start 2023-07-09T02:16:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74da419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d40cd060 0x7f74d40cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74da419640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74d40b4490 0x7f74d40b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74da419640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d40d19c0 con 0x7f74d415c480 2023-07-09T02:16:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74da419640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d415c850 con 0x7f74d40b4490 2023-07-09T02:16:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74da419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d40b4e50 con 0x7f74d40cd060 2023-07-09T02:16:15.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d89b6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74d40b4490 0x7f74d40b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:15.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d37fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d40cd060 0x7f74d40cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:15.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d89b6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74d40b4490 0x7f74d40b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:50006/0 (socket says 172.21.15.45:50006) 2023-07-09T02:16:15.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d89b6640 1 -- 172.21.15.45:0/2432701771 learned_addr learned my addr 172.21.15.45:0/2432701771 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:15.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d3fff640 1 --1- 172.21.15.45:0/2432701771 >> v1:172.21.15.155:6789/0 conn(0x7f74d415c480 0x7f74d40d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:40934/0 (socket says 172.21.15.45:40934) 2023-07-09T02:16:15.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d89b6640 1 -- 172.21.15.45:0/2432701771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d40cd060 msgr2=0x7f74d40cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d89b6640 1 --2- 172.21.15.45:0/2432701771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d40cd060 0x7f74d40cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d89b6640 1 -- 172.21.15.45:0/2432701771 >> v1:172.21.15.155:6789/0 conn(0x7f74d415c480 legacy=0x7f74d40d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.037+0000 7f74d89b6640 1 -- 172.21.15.45:0/2432701771 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d40cf210 con 0x7f74d40b4490 2023-07-09T02:16:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74d89b6640 1 --2- 172.21.15.45:0/2432701771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 0x7f74d40b4910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009e50 tx=0x7f74cc01ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae9e34576eaad09 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74d2ffd640 1 -- 172.21.15.45:0/2432701771 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0a57d0 con 0x7f74d40b4490 2023-07-09T02:16:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74d2ffd640 1 -- 172.21.15.45:0/2432701771 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc0a5930 con 0x7f74d40b4490 2023-07-09T02:16:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74d2ffd640 1 -- 172.21.15.45:0/2432701771 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0a5cc0 con 0x7f74d40b4490 2023-07-09T02:16:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 -- 172.21.15.45:0/2432701771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 msgr2=0x7f74d40b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 --2- 172.21.15.45:0/2432701771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 0x7f74d40b4910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009e50 tx=0x7f74cc01ca10 comp rx=0 tx=0).stop 2023-07-09T02:16:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 -- 172.21.15.45:0/2432701771 shutdown_connections 2023-07-09T02:16:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 --2- 172.21.15.45:0/2432701771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 0x7f74d40b4910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 --2- 172.21.15.45:0/2432701771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d40cd060 0x7f74d40cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 -- 172.21.15.45:0/2432701771 >> 172.21.15.45:0/2432701771 conn(0x7f74d40cf490 msgr2=0x7f74d40cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 -- 172.21.15.45:0/2432701771 shutdown_connections 2023-07-09T02:16:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 -- 172.21.15.45:0/2432701771 wait complete. 2023-07-09T02:16:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 Processor -- start 2023-07-09T02:16:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.041+0000 7f74da419640 1 -- start start 2023-07-09T02:16:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 0x7f74d40b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40cd060 0x7f74d414af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d415c480 0x7f74d414c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d414c4e0 con 0x7f74d40cd060 2023-07-09T02:16:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d414e660 con 0x7f74d40b4490 2023-07-09T02:16:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d414b8d0 con 0x7f74d415c480 2023-07-09T02:16:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40cd060 0x7f74d414af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40cd060 0x7f74d414af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34312/0 (socket says 172.21.15.45:34312) 2023-07-09T02:16:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 -- 172.21.15.45:0/2082355407 learned_addr learned my addr 172.21.15.45:0/2082355407 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d3fff640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 0x7f74d40b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d89b6640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d415c480 0x7f74d414c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 -- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d415c480 msgr2=0x7f74d414c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d415c480 0x7f74d414c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 -- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 msgr2=0x7f74d40b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 0x7f74d40b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 -- 172.21.15.45:0/2082355407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc009b30 con 0x7f74d40cd060 2023-07-09T02:16:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d37fe640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40cd060 0x7f74d414af20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f74c800e930 tx=0x7f74c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d0ff9640 1 -- 172.21.15.45:0/2082355407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8009690 con 0x7f74d40cd060 2023-07-09T02:16:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d0ff9640 1 -- 172.21.15.45:0/2082355407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c800ca00 con 0x7f74d40cd060 2023-07-09T02:16:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d0ff9640 1 -- 172.21.15.45:0/2082355407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800cd70 con 0x7f74d40cd060 2023-07-09T02:16:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d414bbb0 con 0x7f74d40cd060 2023-07-09T02:16:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d414c170 con 0x7f74d40cd060 2023-07-09T02:16:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d414c690 con 0x7f74d40cd060 2023-07-09T02:16:15.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.045+0000 7f74d0ff9640 1 -- 172.21.15.45:0/2082355407 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74c8013470 con 0x7f74d40cd060 2023-07-09T02:16:15.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.049+0000 7f74d0ff9640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74c00662b0 0x7f74c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:15.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.049+0000 7f74d0ff9640 1 -- 172.21.15.45:0/2082355407 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f74c8083b60 con 0x7f74d40cd060 2023-07-09T02:16:15.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.049+0000 7f74d3fff640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74c00662b0 0x7f74c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.049+0000 7f74d3fff640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74c00662b0 0x7f74c0068760 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f74c4000f70 tx=0x7f74c4007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.053+0000 7f74d0ff9640 1 -- 172.21.15.45:0/2082355407 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74d414c690 con 0x7f74d40cd060 2023-07-09T02:16:15.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:15.205+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f74d404d7d0 con 0x7f74d40cd060 2023-07-09T02:16:16.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.113+0000 7f74d0ff9640 1 -- 172.21.15.45:0/2082355407 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v103) v1 ==== 138+0+0 (secure 0 0 0) 0x7f74c80170b0 con 0x7f74d40cd060 2023-07-09T02:16:16.115 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:16:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74c00662b0 msgr2=0x7f74c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74c00662b0 0x7f74c0068760 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f74c4000f70 tx=0x7f74c4007e50 comp rx=0 tx=0).stop 2023-07-09T02:16:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40cd060 msgr2=0x7f74d414af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40cd060 0x7f74d414af20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f74c800e930 tx=0x7f74c800edf0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 shutdown_connections 2023-07-09T02:16:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74c00662b0 0x7f74c0068760 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d415c480 0x7f74d414c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74d40cd060 0x7f74d414af20 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 --2- 172.21.15.45:0/2082355407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d40b4490 0x7f74d40b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 >> 172.21.15.45:0/2082355407 conn(0x7f74d40cf490 msgr2=0x7f74d40b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 shutdown_connections 2023-07-09T02:16:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.121+0000 7f74da419640 1 -- 172.21.15.45:0/2082355407 wait complete. 2023-07-09T02:16:16.144 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:16:16.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.297+0000 7f624f456640 1 Processor -- start 2023-07-09T02:16:16.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.297+0000 7f624f456640 1 -- start start 2023-07-09T02:16:16.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.297+0000 7f624f456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6248160990 0x7f62480cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:16.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.297+0000 7f624f456640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6248164610 0x7f6248164a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:16.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.297+0000 7f624f456640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62480ce6e0 con 0x7f62480c8d00 2023-07-09T02:16:16.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.297+0000 7f624f456640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62480cf580 con 0x7f6248164610 2023-07-09T02:16:16.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.297+0000 7f624f456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62480c9510 con 0x7f6248160990 2023-07-09T02:16:16.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d1f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6248160990 0x7f62480cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:16.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d9f3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6248164610 0x7f6248164a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:16.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d1f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6248160990 0x7f62480cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:57662/0 (socket says 172.21.15.45:57662) 2023-07-09T02:16:16.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d1f2640 1 -- 172.21.15.45:0/132598788 learned_addr learned my addr 172.21.15.45:0/132598788 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:16.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d1f2640 1 -- 172.21.15.45:0/132598788 >> v2:172.21.15.155:3300/0 conn(0x7f6248164610 msgr2=0x7f6248164a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:16.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d1f2640 1 --2- 172.21.15.45:0/132598788 >> v2:172.21.15.155:3300/0 conn(0x7f6248164610 0x7f6248164a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d1f2640 1 -- 172.21.15.45:0/132598788 >> v1:172.21.15.155:6789/0 conn(0x7f62480c8d00 legacy=0x7f62480cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:16.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d1f2640 1 -- 172.21.15.45:0/132598788 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480c97f0 con 0x7f6248160990 2023-07-09T02:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.301+0000 7f624d1f2640 1 --2- 172.21.15.45:0/132598788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6248160990 0x7f62480cba60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f62440098a0 tx=0x7f624401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3034ed1704cc1df server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f623ffff640 1 -- 172.21.15.45:0/132598788 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440aa670 con 0x7f6248160990 2023-07-09T02:16:16.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f623ffff640 1 -- 172.21.15.45:0/132598788 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62440aa7d0 con 0x7f6248160990 2023-07-09T02:16:16.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f623ffff640 1 -- 172.21.15.45:0/132598788 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440aab60 con 0x7f6248160990 2023-07-09T02:16:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 -- 172.21.15.45:0/132598788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6248160990 msgr2=0x7f62480cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 --2- 172.21.15.45:0/132598788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6248160990 0x7f62480cba60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f62440098a0 tx=0x7f624401c4f0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 -- 172.21.15.45:0/132598788 shutdown_connections 2023-07-09T02:16:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 --2- 172.21.15.45:0/132598788 >> v2:172.21.15.155:3300/0 conn(0x7f6248164610 0x7f6248164a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 --2- 172.21.15.45:0/132598788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6248160990 0x7f62480cba60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 -- 172.21.15.45:0/132598788 >> 172.21.15.45:0/132598788 conn(0x7f62480694b0 msgr2=0x7f62480698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 -- 172.21.15.45:0/132598788 shutdown_connections 2023-07-09T02:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 -- 172.21.15.45:0/132598788 wait complete. 2023-07-09T02:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 Processor -- start 2023-07-09T02:16:16.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.305+0000 7f624f456640 1 -- start start 2023-07-09T02:16:16.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62480c8d00 0x7f6248149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:16.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6248160990 0x7f62480b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:16.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6248164610 0x7f624815cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:16.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624815c650 con 0x7f6248164610 2023-07-09T02:16:16.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480b4540 con 0x7f6248160990 2023-07-09T02:16:16.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62480b3f80 con 0x7f62480c8d00 2023-07-09T02:16:16.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d9f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6248164610 0x7f624815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:16.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62480c8d00 0x7f6248149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:16.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62480c8d00 0x7f6248149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:57666/0 (socket says 172.21.15.45:57666) 2023-07-09T02:16:16.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 -- 172.21.15.45:0/228796597 learned_addr learned my addr 172.21.15.45:0/228796597 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:16.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624c9f1640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6248160990 0x7f62480b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:16.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 -- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6248160990 msgr2=0x7f62480b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:16.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6248160990 0x7f62480b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 -- 172.21.15.45:0/228796597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6248164610 msgr2=0x7f624815cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6248164610 0x7f624815cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 -- 172.21.15.45:0/228796597 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440094d0 con 0x7f62480c8d00 2023-07-09T02:16:16.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d9f3640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6248164610 0x7f624815cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624d1f2640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62480c8d00 0x7f6248149010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f624401a120 tx=0x7f624401ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f623dffb640 1 -- 172.21.15.45:0/228796597 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440bd5f0 con 0x7f62480c8d00 2023-07-09T02:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f623dffb640 1 -- 172.21.15.45:0/228796597 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62440bd750 con 0x7f62480c8d00 2023-07-09T02:16:16.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62480b4260 con 0x7f62480c8d00 2023-07-09T02:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f623dffb640 1 -- 172.21.15.45:0/228796597 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440bdae0 con 0x7f62480c8d00 2023-07-09T02:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624815e150 con 0x7f62480c8d00 2023-07-09T02:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.309+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624815dcd0 con 0x7f62480c8d00 2023-07-09T02:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.313+0000 7f623dffb640 1 -- 172.21.15.45:0/228796597 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62440b33f0 con 0x7f62480c8d00 2023-07-09T02:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.313+0000 7f623dffb640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f622c0662b0 0x7f622c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.313+0000 7f623dffb640 1 -- 172.21.15.45:0/228796597 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f624411dcb0 con 0x7f62480c8d00 2023-07-09T02:16:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.313+0000 7f624c9f1640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f622c0662b0 0x7f622c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.313+0000 7f624c9f1640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f622c0662b0 0x7f622c068760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6248072d00 tx=0x7f6238009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:16.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.317+0000 7f623dffb640 1 -- 172.21.15.45:0/228796597 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62440eb500 con 0x7f62480c8d00 2023-07-09T02:16:16.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:16.473+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f624815dcd0 con 0x7f62480c8d00 2023-07-09T02:16:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.133+0000 7f623dffb640 1 -- 172.21.15.45:0/228796597 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v104) v1 ==== 170+0+0 (secure 0 0 0) 0x7f624815dcd0 con 0x7f62480c8d00 2023-07-09T02:16:17.134 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:16:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f622c0662b0 msgr2=0x7f622c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f622c0662b0 0x7f622c068760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6248072d00 tx=0x7f6238009040 comp rx=0 tx=0).stop 2023-07-09T02:16:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62480c8d00 msgr2=0x7f6248149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62480c8d00 0x7f6248149010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f624401a120 tx=0x7f624401ad30 comp rx=0 tx=0).stop 2023-07-09T02:16:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 shutdown_connections 2023-07-09T02:16:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6248164610 0x7f624815cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6248160990 0x7f62480b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f622c0662b0 0x7f622c068760 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 --2- 172.21.15.45:0/228796597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62480c8d00 0x7f6248149010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 >> 172.21.15.45:0/228796597 conn(0x7f62480694b0 msgr2=0x7f6248069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 shutdown_connections 2023-07-09T02:16:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.137+0000 7f624f456640 1 -- 172.21.15.45:0/228796597 wait complete. 2023-07-09T02:16:17.160 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:16:17.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.305+0000 7f3181fc5640 1 Processor -- start 2023-07-09T02:16:17.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.305+0000 7f3181fc5640 1 -- start start 2023-07-09T02:16:17.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f3181fc5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f317c0d2620 0x7f317c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:17.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f3181fc5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317c160a50 con 0x7f317c0cd120 2023-07-09T02:16:17.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f3181fc5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317c15c430 con 0x7f317c15c060 2023-07-09T02:16:17.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f3181fc5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c15fb60 con 0x7f317c0d2620 2023-07-09T02:16:17.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f317affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f317c0d2620 0x7f317c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:17.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f317bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f317c0cd120 0x7f317c0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36928/0 (socket says 172.21.15.45:36928) 2023-07-09T02:16:17.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f317bfff640 1 -- 172.21.15.45:0/803447841 learned_addr learned my addr 172.21.15.45:0/803447841 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:17.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f317affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f317c0d2620 0x7f317c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34332/0 (socket says 172.21.15.45:34332) 2023-07-09T02:16:17.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f317affd640 1 -- 172.21.15.45:0/803447841 >> v1:172.21.15.155:6789/0 conn(0x7f317c15c060 legacy=0x7f317c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:17.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f317affd640 1 -- 172.21.15.45:0/803447841 >> v1:172.21.15.45:6789/0 conn(0x7f317c0cd120 legacy=0x7f317c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:17.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.309+0000 7f317affd640 1 -- 172.21.15.45:0/803447841 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c15fe40 con 0x7f317c0d2620 2023-07-09T02:16:17.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f317affd640 1 --2- 172.21.15.45:0/803447841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0d2620 0x7f317c0b4ed0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f31700097c0 tx=0x7f317001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c34e3d677eceac server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:17.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f317a7fc640 1 -- 172.21.15.45:0/803447841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700ab650 con 0x7f317c0d2620 2023-07-09T02:16:17.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f317a7fc640 1 -- 172.21.15.45:0/803447841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31700ab7b0 con 0x7f317c0d2620 2023-07-09T02:16:17.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f317a7fc640 1 -- 172.21.15.45:0/803447841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700abb40 con 0x7f317c0d2620 2023-07-09T02:16:17.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 -- 172.21.15.45:0/803447841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0d2620 msgr2=0x7f317c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:17.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 --2- 172.21.15.45:0/803447841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0d2620 0x7f317c0b4ed0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f31700097c0 tx=0x7f317001c450 comp rx=0 tx=0).stop 2023-07-09T02:16:17.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 -- 172.21.15.45:0/803447841 shutdown_connections 2023-07-09T02:16:17.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 --2- 172.21.15.45:0/803447841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0d2620 0x7f317c0b4ed0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:17.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 -- 172.21.15.45:0/803447841 >> 172.21.15.45:0/803447841 conn(0x7f317c0698e0 msgr2=0x7f317c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:17.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 -- 172.21.15.45:0/803447841 shutdown_connections 2023-07-09T02:16:17.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 -- 172.21.15.45:0/803447841 wait complete. 2023-07-09T02:16:17.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 Processor -- start 2023-07-09T02:16:17.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.313+0000 7f3181fc5640 1 -- start start 2023-07-09T02:16:17.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0cd120 0x7f317c0c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:17.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f317c0d2620 0x7f317c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:17.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f317c15c060 0x7f317c0b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:17.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1553e0 con 0x7f317c0cd120 2023-07-09T02:16:17.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1556c0 con 0x7f317c15c060 2023-07-09T02:16:17.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1559a0 con 0x7f317c0d2620 2023-07-09T02:16:17.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0cd120 0x7f317c0c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:17.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0cd120 0x7f317c0c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34336/0 (socket says 172.21.15.45:34336) 2023-07-09T02:16:17.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 -- 172.21.15.45:0/498381341 learned_addr learned my addr 172.21.15.45:0/498381341 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:17.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317bfff640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f317c15c060 0x7f317c0b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:17.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317affd640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f317c0d2620 0x7f317c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:17.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 -- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f317c0d2620 msgr2=0x7f317c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:17.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f317c0d2620 0x7f317c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:17.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 -- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f317c15c060 msgr2=0x7f317c0b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:17.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f317c15c060 0x7f317c0b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:17.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 -- 172.21.15.45:0/498381341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3170009420 con 0x7f317c0cd120 2023-07-09T02:16:17.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f317b7fe640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0cd120 0x7f317c0c8d30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c3c0 tx=0x7f316c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:17.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3163fff640 1 -- 172.21.15.45:0/498381341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c0052d0 con 0x7f317c0cd120 2023-07-09T02:16:17.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3163fff640 1 -- 172.21.15.45:0/498381341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c005430 con 0x7f317c0cd120 2023-07-09T02:16:17.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c0b59f0 con 0x7f317c0cd120 2023-07-09T02:16:17.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3163fff640 1 -- 172.21.15.45:0/498381341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c003840 con 0x7f317c0cd120 2023-07-09T02:16:17.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c0c9d30 con 0x7f317c0cd120 2023-07-09T02:16:17.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c04d7d0 con 0x7f317c0cd120 2023-07-09T02:16:17.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.317+0000 7f3163fff640 1 -- 172.21.15.45:0/498381341 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f316c0039a0 con 0x7f317c0cd120 2023-07-09T02:16:17.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.321+0000 7f3163fff640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3168066280 0x7f3168068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:17.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.321+0000 7f3163fff640 1 -- 172.21.15.45:0/498381341 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f316c083170 con 0x7f317c0cd120 2023-07-09T02:16:17.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.321+0000 7f317affd640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3168066280 0x7f3168068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:17.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.321+0000 7f317affd640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3168066280 0x7f3168068730 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f31700af000 tx=0x7f31700a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:17.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.325+0000 7f3163fff640 1 -- 172.21.15.45:0/498381341 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f316c0506f0 con 0x7f317c0cd120 2023-07-09T02:16:17.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:17.513+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f317c06baa0 con 0x7f317c0cd120 2023-07-09T02:16:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.129+0000 7f3163fff640 1 -- 172.21.15.45:0/498381341 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7f316c053d10 con 0x7f317c0cd120 2023-07-09T02:16:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 13 and data pool 14 2023-07-09T02:16:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.141+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3168066280 msgr2=0x7f3168068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.141+0000 7f3181fc5640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3168066280 0x7f3168068730 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f31700af000 tx=0x7f31700a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.141+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0cd120 msgr2=0x7f317c0c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.141+0000 7f3181fc5640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0cd120 0x7f317c0c8d30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f316c00c3c0 tx=0x7f316c00c880 comp rx=0 tx=0).stop 2023-07-09T02:16:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.145+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 shutdown_connections 2023-07-09T02:16:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.145+0000 7f3181fc5640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f317c15c060 0x7f317c0b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.145+0000 7f3181fc5640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3168066280 0x7f3168068730 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.145+0000 7f3181fc5640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f317c0d2620 0x7f317c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.145+0000 7f3181fc5640 1 --2- 172.21.15.45:0/498381341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f317c0cd120 0x7f317c0c8d30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.145+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 >> 172.21.15.45:0/498381341 conn(0x7f317c0698e0 msgr2=0x7f317c0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.145+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 shutdown_connections 2023-07-09T02:16:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.145+0000 7f3181fc5640 1 -- 172.21.15.45:0/498381341 wait complete. 2023-07-09T02:16:18.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:18.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.313+0000 7ff5eea19640 1 Processor -- start 2023-07-09T02:16:18.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.313+0000 7ff5eea19640 1 -- start start 2023-07-09T02:16:18.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5eea19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5e815c060 0x7ff5e80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5eea19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e80cd120 0x7ff5e80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5eea19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e8160a50 con 0x7ff5e80d2450 2023-07-09T02:16:18.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5eea19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e80d28f0 con 0x7ff5e815c060 2023-07-09T02:16:18.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5eea19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80cfe40 con 0x7ff5e80cd120 2023-07-09T02:16:18.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5e815c060 0x7ff5e80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5e815c060 0x7ff5e80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34360/0 (socket says 172.21.15.45:34360) 2023-07-09T02:16:18.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e7fff640 1 -- 172.21.15.45:0/3451436238 learned_addr learned my addr 172.21.15.45:0/3451436238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5ecfb6640 1 --1- 172.21.15.45:0/3451436238 >> v1:172.21.15.45:6789/0 conn(0x7ff5e80d2450 0x7ff5e80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36942/0 (socket says 172.21.15.45:36942) 2023-07-09T02:16:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e77fe640 1 --2- 172.21.15.45:0/3451436238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e80cd120 0x7ff5e80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e7fff640 1 -- 172.21.15.45:0/3451436238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e80cd120 msgr2=0x7ff5e80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e7fff640 1 --2- 172.21.15.45:0/3451436238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e80cd120 0x7ff5e80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e7fff640 1 -- 172.21.15.45:0/3451436238 >> v1:172.21.15.45:6789/0 conn(0x7ff5e80d2450 legacy=0x7ff5e80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e7fff640 1 -- 172.21.15.45:0/3451436238 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e815c430 con 0x7ff5e815c060 2023-07-09T02:16:18.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e6ffd640 1 -- 172.21.15.45:0/3451436238 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749717520 0 0) 0x7ff5e8160a50 con 0x7ff5e80d2450 2023-07-09T02:16:18.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.317+0000 7ff5e77fe640 1 --2- 172.21.15.45:0/3451436238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e80cd120 0x7ff5e80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5e7fff640 1 --2- 172.21.15.45:0/3451436238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e815c060 0x7ff5e80b4ed0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009870 tx=0x7ff5d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb51307eb165f73 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5e6ffd640 1 -- 172.21.15.45:0/3451436238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80a7070 con 0x7ff5e815c060 2023-07-09T02:16:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5e6ffd640 1 -- 172.21.15.45:0/3451436238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d80ab430 con 0x7ff5e815c060 2023-07-09T02:16:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5e6ffd640 1 -- 172.21.15.45:0/3451436238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80ab7c0 con 0x7ff5e815c060 2023-07-09T02:16:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 -- 172.21.15.45:0/3451436238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e815c060 msgr2=0x7ff5e80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 --2- 172.21.15.45:0/3451436238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e815c060 0x7ff5e80b4ed0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009870 tx=0x7ff5d801c510 comp rx=0 tx=0).stop 2023-07-09T02:16:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 -- 172.21.15.45:0/3451436238 shutdown_connections 2023-07-09T02:16:18.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 --2- 172.21.15.45:0/3451436238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e80cd120 0x7ff5e80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 --2- 172.21.15.45:0/3451436238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e815c060 0x7ff5e80b4ed0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 -- 172.21.15.45:0/3451436238 >> 172.21.15.45:0/3451436238 conn(0x7ff5e80698e0 msgr2=0x7ff5e8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:18.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 -- 172.21.15.45:0/3451436238 shutdown_connections 2023-07-09T02:16:18.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 -- 172.21.15.45:0/3451436238 wait complete. 2023-07-09T02:16:18.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.321+0000 7ff5eea19640 1 Processor -- start 2023-07-09T02:16:18.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 -- start start 2023-07-09T02:16:18.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e80cd120 0x7ff5e815cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e80d2450 0x7ff5e815b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e815c060 0x7ff5e80b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8153cc0 con 0x7ff5e80cd120 2023-07-09T02:16:18.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80caa70 con 0x7ff5e80d2450 2023-07-09T02:16:18.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80c9e60 con 0x7ff5e815c060 2023-07-09T02:16:18.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e80cd120 0x7ff5e815cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e80cd120 0x7ff5e815cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34374/0 (socket says 172.21.15.45:34374) 2023-07-09T02:16:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 -- 172.21.15.45:0/2873214675 learned_addr learned my addr 172.21.15.45:0/2873214675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 -- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e815c060 msgr2=0x7ff5e80b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5ecfb6640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e815c060 0x7ff5e80b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e77fe640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e80d2450 0x7ff5e815b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e815c060 0x7ff5e80b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 -- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e80d2450 msgr2=0x7ff5e815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e80d2450 0x7ff5e815b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 -- 172.21.15.45:0/2873214675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d80094d0 con 0x7ff5e80cd120 2023-07-09T02:16:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5ecfb6640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e815c060 0x7ff5e80b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e77fe640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e80d2450 0x7ff5e815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e7fff640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e80cd120 0x7ff5e815cb00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80ad040 tx=0x7ff5d80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e4ff9640 1 -- 172.21.15.45:0/2873214675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80bc070 con 0x7ff5e80cd120 2023-07-09T02:16:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e4ff9640 1 -- 172.21.15.45:0/2873214675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d80b4420 con 0x7ff5e80cd120 2023-07-09T02:16:18.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5e4ff9640 1 -- 172.21.15.45:0/2873214675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80b47f0 con 0x7ff5e80cd120 2023-07-09T02:16:18.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e80ca140 con 0x7ff5e80cd120 2023-07-09T02:16:18.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e80ca700 con 0x7ff5e80cd120 2023-07-09T02:16:18.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.325+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e804d7d0 con 0x7ff5e80cd120 2023-07-09T02:16:18.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.329+0000 7ff5e4ff9640 1 -- 172.21.15.45:0/2873214675 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5d80b4950 con 0x7ff5e80cd120 2023-07-09T02:16:18.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.329+0000 7ff5e4ff9640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff5d4066280 0x7ff5d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.329+0000 7ff5e4ff9640 1 -- 172.21.15.45:0/2873214675 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5d811d740 con 0x7ff5e80cd120 2023-07-09T02:16:18.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.329+0000 7ff5e77fe640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff5d4066280 0x7ff5d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.329+0000 7ff5e77fe640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff5d4066280 0x7ff5d4068730 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80ccb10 tx=0x7ff5dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:18.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.333+0000 7ff5e4ff9640 1 -- 172.21.15.45:0/2873214675 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5d80eabb0 con 0x7ff5e80cd120 2023-07-09T02:16:18.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.489+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5e806baa0 con 0x7ff5e80cd120 2023-07-09T02:16:18.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.489+0000 7ff5e4ff9640 1 -- 172.21.15.45:0/2873214675 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+18318 (secure 0 0 0) 0x7ff5d80ee1d0 con 0x7ff5e80cd120 2023-07-09T02:16:18.491 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:18.491 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":105,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:17.518235+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:16:15.254129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T02:16:16.522380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff5d4066280 msgr2=0x7ff5d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff5d4066280 0x7ff5d4068730 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80ccb10 tx=0x7ff5dc008040 comp rx=0 tx=0).stop 2023-07-09T02:16:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e80cd120 msgr2=0x7ff5e815cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e80cd120 0x7ff5e815cb00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80ad040 tx=0x7ff5d80192b0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 shutdown_connections 2023-07-09T02:16:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff5d4066280 0x7ff5d4068730 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5e815c060 0x7ff5e80b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5e80d2450 0x7ff5e815b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 --2- 172.21.15.45:0/2873214675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5e80cd120 0x7ff5e815cb00 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 >> 172.21.15.45:0/2873214675 conn(0x7ff5e80698e0 msgr2=0x7ff5e80b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 shutdown_connections 2023-07-09T02:16:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.493+0000 7ff5eea19640 1 -- 172.21.15.45:0/2873214675 wait complete. 2023-07-09T02:16:18.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:18.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:16:18.582 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fb59e640 1 Processor -- start 2023-07-09T02:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fb59e640 1 -- start start 2023-07-09T02:16:18.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fb59e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fb59e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0b2090 con 0x7f78fc06b950 2023-07-09T02:16:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fb59e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc160520 con 0x7f78fc0b1b50 2023-07-09T02:16:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fb59e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc160800 con 0x7f78fc15c870 2023-07-09T02:16:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f78fc06b950 0x7f78fc0d0d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36952/0 (socket says 172.21.15.45:36952) 2023-07-09T02:16:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fad9d640 1 -- 172.21.15.45:0/2437515393 learned_addr learned my addr 172.21.15.45:0/2437515393 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:18.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fa59c640 1 --2- 172.21.15.45:0/2437515393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78f9d9b640 1 -- 172.21.15.45:0/2437515393 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30618385 0 0) 0x7f78fc0b2090 con 0x7f78fc06b950 2023-07-09T02:16:18.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78f9d9b640 1 -- 172.21.15.45:0/2437515393 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e8003530 con 0x7f78fc06b950 2023-07-09T02:16:18.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78f9d9b640 1 -- 172.21.15.45:0/2437515393 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495962020 0 0) 0x7f78fc160520 con 0x7f78fc0b1b50 2023-07-09T02:16:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78f9d9b640 1 -- 172.21.15.45:0/2437515393 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78fc0b2090 con 0x7f78fc0b1b50 2023-07-09T02:16:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fa59c640 1 -- 172.21.15.45:0/2437515393 >> v1:172.21.15.155:6789/0 conn(0x7f78fc0b1b50 legacy=0x7f78fc06b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fa59c640 1 -- 172.21.15.45:0/2437515393 >> v1:172.21.15.45:6789/0 conn(0x7f78fc06b950 legacy=0x7f78fc0d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.657+0000 7f78fa59c640 1 -- 172.21.15.45:0/2437515393 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc160ae0 con 0x7f78fc15c870 2023-07-09T02:16:18.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78fa59c640 1 --2- 172.21.15.45:0/2437515393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b1610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0097f0 tx=0x7f78ec01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d25f998cbb38f20a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:18.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78f9d9b640 1 -- 172.21.15.45:0/2437515393 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0a7070 con 0x7f78fc15c870 2023-07-09T02:16:18.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78f9d9b640 1 -- 172.21.15.45:0/2437515393 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0ab430 con 0x7f78fc15c870 2023-07-09T02:16:18.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78f9d9b640 1 -- 172.21.15.45:0/2437515393 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0ab7a0 con 0x7f78fc15c870 2023-07-09T02:16:18.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78fb59e640 1 -- 172.21.15.45:0/2437515393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 msgr2=0x7f78fc0b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78fb59e640 1 --2- 172.21.15.45:0/2437515393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b1610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0097f0 tx=0x7f78ec01c490 comp rx=0 tx=0).stop 2023-07-09T02:16:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78fb59e640 1 -- 172.21.15.45:0/2437515393 shutdown_connections 2023-07-09T02:16:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78fb59e640 1 --2- 172.21.15.45:0/2437515393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b1610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78fb59e640 1 -- 172.21.15.45:0/2437515393 >> 172.21.15.45:0/2437515393 conn(0x7f78fc070be0 msgr2=0x7f78fc070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:18.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78fb59e640 1 -- 172.21.15.45:0/2437515393 shutdown_connections 2023-07-09T02:16:18.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.661+0000 7f78fb59e640 1 -- 172.21.15.45:0/2437515393 wait complete. 2023-07-09T02:16:18.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 Processor -- start 2023-07-09T02:16:18.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 -- start start 2023-07-09T02:16:18.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78fc06b950 0x7f78fc0b8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0b1b50 0x7f78fc15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c9a30 con 0x7f78fc0b1b50 2023-07-09T02:16:18.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0cd190 con 0x7f78fc06b950 2023-07-09T02:16:18.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc15ba60 con 0x7f78fc15c870 2023-07-09T02:16:18.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0b1b50 0x7f78fc15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0b1b50 0x7f78fc15fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34384/0 (socket says 172.21.15.45:34384) 2023-07-09T02:16:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 -- 172.21.15.45:0/702366361 learned_addr learned my addr 172.21.15.45:0/702366361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fa59c640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78fc06b950 0x7f78fc0b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fad9d640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 -- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 msgr2=0x7f78fc0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 -- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78fc06b950 msgr2=0x7f78fc0b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78fc06b950 0x7f78fc0b8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 -- 172.21.15.45:0/702366361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec009420 con 0x7f78fc0b1b50 2023-07-09T02:16:18.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fa59c640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78fc06b950 0x7f78fc0b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:18.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fad9d640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:18.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f3fff640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0b1b50 0x7f78fc15fa90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c490 tx=0x7f78e400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:18.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f2ffd640 1 -- 172.21.15.45:0/702366361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e40052d0 con 0x7f78fc0b1b50 2023-07-09T02:16:18.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f2ffd640 1 -- 172.21.15.45:0/702366361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4005430 con 0x7f78fc0b1b50 2023-07-09T02:16:18.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc0cd410 con 0x7f78fc0b1b50 2023-07-09T02:16:18.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78f2ffd640 1 -- 172.21.15.45:0/702366361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4012870 con 0x7f78fc0b1b50 2023-07-09T02:16:18.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.665+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc15b680 con 0x7f78fc0b1b50 2023-07-09T02:16:18.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.669+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc0d3ab0 con 0x7f78fc0b1b50 2023-07-09T02:16:18.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.669+0000 7f78f2ffd640 1 -- 172.21.15.45:0/702366361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78e40129d0 con 0x7f78fc0b1b50 2023-07-09T02:16:18.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.669+0000 7f78f2ffd640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78dc066280 0x7f78dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:18.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.669+0000 7f78f2ffd640 1 -- 172.21.15.45:0/702366361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78e4083a20 con 0x7f78fc0b1b50 2023-07-09T02:16:18.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.669+0000 7f78fa59c640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78dc066280 0x7f78dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:18.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.669+0000 7f78fa59c640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78dc066280 0x7f78dc068730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0af000 tx=0x7f78ec0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:18.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.673+0000 7f78f2ffd640 1 -- 172.21.15.45:0/702366361 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78e4050e00 con 0x7f78fc0b1b50 2023-07-09T02:16:18.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.829+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78fc04e020 con 0x7f78fc0b1b50 2023-07-09T02:16:18.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78f2ffd640 1 -- 172.21.15.45:0/702366361 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+18318 (secure 0 0 0) 0x7f78e4083020 con 0x7f78fc0b1b50 2023-07-09T02:16:18.833 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:18.834 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":105,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:17.518235+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:16:15.254129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T02:16:16.522380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:18.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78dc066280 msgr2=0x7f78dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78dc066280 0x7f78dc068730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0af000 tx=0x7f78ec0a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:18.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0b1b50 msgr2=0x7f78fc15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:18.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0b1b50 0x7f78fc15fa90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c490 tx=0x7f78e400c950 comp rx=0 tx=0).stop 2023-07-09T02:16:18.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 shutdown_connections 2023-07-09T02:16:18.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78dc066280 0x7f78dc068730 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78fc15c870 0x7f78fc0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78fc0b1b50 0x7f78fc15fa90 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 --2- 172.21.15.45:0/702366361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78fc06b950 0x7f78fc0b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:18.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 >> 172.21.15.45:0/702366361 conn(0x7f78fc070be0 msgr2=0x7f78fc0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:18.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 shutdown_connections 2023-07-09T02:16:18.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:18.833+0000 7f78fb59e640 1 -- 172.21.15.45:0/702366361 wait complete. 2023-07-09T02:16:18.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:16:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066fed8640 1 Processor -- start 2023-07-09T02:16:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066fed8640 1 -- start start 2023-07-09T02:16:19.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066fed8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f066815c060 0x7f06680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:19.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066fed8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06680cd120 0x7f06680d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:19.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066fed8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0668160a50 con 0x7f06680d2450 2023-07-09T02:16:19.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066fed8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680d28f0 con 0x7f06680cd120 2023-07-09T02:16:19.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066fed8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06680cfe40 con 0x7f066815c060 2023-07-09T02:16:19.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066dc74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f066815c060 0x7f06680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:19.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066d473640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06680cd120 0x7f06680d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:19.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066dc74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f066815c060 0x7f06680b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:57702/0 (socket says 172.21.15.45:57702) 2023-07-09T02:16:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066dc74640 1 -- 172.21.15.45:0/329811796 learned_addr learned my addr 172.21.15.45:0/329811796 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066e475640 1 --1- 172.21.15.45:0/329811796 >> v1:172.21.15.155:6789/0 conn(0x7f06680d2450 0x7f06680d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:40970/0 (socket says 172.21.15.45:40970) 2023-07-09T02:16:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066dc74640 1 -- 172.21.15.45:0/329811796 >> v2:172.21.15.155:3300/0 conn(0x7f06680cd120 msgr2=0x7f06680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066dc74640 1 --2- 172.21.15.45:0/329811796 >> v2:172.21.15.155:3300/0 conn(0x7f06680cd120 0x7f06680d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066dc74640 1 -- 172.21.15.45:0/329811796 >> v1:172.21.15.155:6789/0 conn(0x7f06680d2450 legacy=0x7f06680d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.045+0000 7f066dc74640 1 -- 172.21.15.45:0/329811796 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066815c430 con 0x7f066815c060 2023-07-09T02:16:19.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066dc74640 1 --2- 172.21.15.45:0/329811796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f066815c060 0x7f06680b4ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0664009870 tx=0x7f066401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab3a01062d4d1a8f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:19.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066cc72640 1 -- 172.21.15.45:0/329811796 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06640a7070 con 0x7f066815c060 2023-07-09T02:16:19.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066cc72640 1 -- 172.21.15.45:0/329811796 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06640ab430 con 0x7f066815c060 2023-07-09T02:16:19.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066cc72640 1 -- 172.21.15.45:0/329811796 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06640ab7c0 con 0x7f066815c060 2023-07-09T02:16:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066fed8640 1 -- 172.21.15.45:0/329811796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f066815c060 msgr2=0x7f06680b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066fed8640 1 --2- 172.21.15.45:0/329811796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f066815c060 0x7f06680b4ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0664009870 tx=0x7f066401c510 comp rx=0 tx=0).stop 2023-07-09T02:16:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066fed8640 1 -- 172.21.15.45:0/329811796 shutdown_connections 2023-07-09T02:16:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066fed8640 1 --2- 172.21.15.45:0/329811796 >> v2:172.21.15.155:3300/0 conn(0x7f06680cd120 0x7f06680d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066fed8640 1 --2- 172.21.15.45:0/329811796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f066815c060 0x7f06680b4ed0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066fed8640 1 -- 172.21.15.45:0/329811796 >> 172.21.15.45:0/329811796 conn(0x7f06680698e0 msgr2=0x7f0668069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066fed8640 1 -- 172.21.15.45:0/329811796 shutdown_connections 2023-07-09T02:16:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.049+0000 7f066fed8640 1 -- 172.21.15.45:0/329811796 wait complete. 2023-07-09T02:16:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 Processor -- start 2023-07-09T02:16:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 -- start start 2023-07-09T02:16:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680cd120 0x7f0668153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680d2450 0x7f0668158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f066815c060 0x7f06680ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668159f20 con 0x7f066815c060 2023-07-09T02:16:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06681539d0 con 0x7f06680cd120 2023-07-09T02:16:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668159680 con 0x7f06680d2450 2023-07-09T02:16:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f066815c060 0x7f06680ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f066815c060 0x7f06680ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34396/0 (socket says 172.21.15.45:34396) 2023-07-09T02:16:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 -- 172.21.15.45:0/1293377777 learned_addr learned my addr 172.21.15.45:0/1293377777 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066dc74640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680cd120 0x7f0668153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066d473640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680d2450 0x7f0668158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 -- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680d2450 msgr2=0x7f0668158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680d2450 0x7f0668158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 -- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680cd120 msgr2=0x7f0668153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680cd120 0x7f0668153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 -- 172.21.15.45:0/1293377777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06640094d0 con 0x7f066815c060 2023-07-09T02:16:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066e475640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f066815c060 0x7f06680ca2b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f066000c7a0 tx=0x7f066000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f065e7fc640 1 -- 172.21.15.45:0/1293377777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000a640 con 0x7f066815c060 2023-07-09T02:16:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f065e7fc640 1 -- 172.21.15.45:0/1293377777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066000a7a0 con 0x7f066815c060 2023-07-09T02:16:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0668159960 con 0x7f066815c060 2023-07-09T02:16:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f065e7fc640 1 -- 172.21.15.45:0/1293377777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000ab10 con 0x7f066815c060 2023-07-09T02:16:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.053+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066815db40 con 0x7f066815c060 2023-07-09T02:16:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.057+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066815d9a0 con 0x7f066815c060 2023-07-09T02:16:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.057+0000 7f065e7fc640 1 -- 172.21.15.45:0/1293377777 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f066000ac70 con 0x7f066815c060 2023-07-09T02:16:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.057+0000 7f065e7fc640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f064c066280 0x7f064c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.057+0000 7f065e7fc640 1 -- 172.21.15.45:0/1293377777 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0660083560 con 0x7f066815c060 2023-07-09T02:16:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.057+0000 7f066dc74640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f064c066280 0x7f064c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:19.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.057+0000 7f066dc74640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f064c066280 0x7f064c068730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f06640af000 tx=0x7f0664008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.061+0000 7f065e7fc640 1 -- 172.21.15.45:0/1293377777 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f066815d9a0 con 0x7f066815c060 2023-07-09T02:16:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:19.249+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f066815d9a0 con 0x7f066815c060 2023-07-09T02:16:20.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.157+0000 7f065e7fc640 1 -- 172.21.15.45:0/1293377777 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7f066815d9a0 con 0x7f066815c060 2023-07-09T02:16:20.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f064c066280 msgr2=0x7f064c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:20.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f064c066280 0x7f064c068730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f06640af000 tx=0x7f0664008040 comp rx=0 tx=0).stop 2023-07-09T02:16:20.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f066815c060 msgr2=0x7f06680ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:20.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f066815c060 0x7f06680ca2b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f066000c7a0 tx=0x7f066000cc60 comp rx=0 tx=0).stop 2023-07-09T02:16:20.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 shutdown_connections 2023-07-09T02:16:20.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f066815c060 0x7f06680ca2b0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f064c066280 0x7f064c068730 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680d2450 0x7f0668158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 --2- 172.21.15.45:0/1293377777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680cd120 0x7f0668153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 >> 172.21.15.45:0/1293377777 conn(0x7f06680698e0 msgr2=0x7f06680b6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 shutdown_connections 2023-07-09T02:16:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.161+0000 7f066fed8640 1 -- 172.21.15.45:0/1293377777 wait complete. 2023-07-09T02:16:20.183 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:16:20.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:16:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca3486d640 1 Processor -- start 2023-07-09T02:16:20.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca3486d640 1 -- start start 2023-07-09T02:16:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca3486d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca3006b800 0x7fca3006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca3486d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300694b0 0x7fca300ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca3486d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3006c110 con 0x7fca300ac870 2023-07-09T02:16:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca3486d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca300acde0 con 0x7fca3006b800 2023-07-09T02:16:20.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca3486d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300ad0c0 con 0x7fca300694b0 2023-07-09T02:16:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca2e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca3006b800 0x7fca3006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca2e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fca3006b800 0x7fca3006bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34412/0 (socket says 172.21.15.45:34412) 2023-07-09T02:16:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca2e59c640 1 -- 172.21.15.45:0/2709255279 learned_addr learned my addr 172.21.15.45:0/2709255279 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca2ed9d640 1 --2- 172.21.15.45:0/2709255279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300694b0 0x7fca300ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:20.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca2e59c640 1 -- 172.21.15.45:0/2709255279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300694b0 msgr2=0x7fca300ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:20.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca2e59c640 1 --2- 172.21.15.45:0/2709255279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300694b0 0x7fca300ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca2e59c640 1 -- 172.21.15.45:0/2709255279 >> v1:172.21.15.155:6789/0 conn(0x7fca300ac870 legacy=0x7fca3006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:20.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.337+0000 7fca2e59c640 1 -- 172.21.15.45:0/2709255279 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300ad3a0 con 0x7fca3006b800 2023-07-09T02:16:20.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca2e59c640 1 --2- 172.21.15.45:0/2709255279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3006b800 0x7fca3006bbd0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fca20009870 tx=0x7fca2001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956fef8af9f1c402 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:20.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca2dd9b640 1 -- 172.21.15.45:0/2709255279 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200a9400 con 0x7fca3006b800 2023-07-09T02:16:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca2dd9b640 1 -- 172.21.15.45:0/2709255279 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca200a9560 con 0x7fca3006b800 2023-07-09T02:16:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca2dd9b640 1 -- 172.21.15.45:0/2709255279 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200a98f0 con 0x7fca3006b800 2023-07-09T02:16:20.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 -- 172.21.15.45:0/2709255279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3006b800 msgr2=0x7fca3006bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 --2- 172.21.15.45:0/2709255279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3006b800 0x7fca3006bbd0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fca20009870 tx=0x7fca2001c540 comp rx=0 tx=0).stop 2023-07-09T02:16:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 -- 172.21.15.45:0/2709255279 shutdown_connections 2023-07-09T02:16:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 --2- 172.21.15.45:0/2709255279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300694b0 0x7fca300ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 --2- 172.21.15.45:0/2709255279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca3006b800 0x7fca3006bbd0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 -- 172.21.15.45:0/2709255279 >> 172.21.15.45:0/2709255279 conn(0x7fca300cfb50 msgr2=0x7fca300cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 -- 172.21.15.45:0/2709255279 shutdown_connections 2023-07-09T02:16:20.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 -- 172.21.15.45:0/2709255279 wait complete. 2023-07-09T02:16:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.341+0000 7fca3486d640 1 Processor -- start 2023-07-09T02:16:20.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 -- start start 2023-07-09T02:16:20.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300694b0 0x7fca300c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:20.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3006b800 0x7fca300c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:20.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300ac870 0x7fca300b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:20.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300cc270 con 0x7fca300694b0 2023-07-09T02:16:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c2ff0 con 0x7fca3006b800 2023-07-09T02:16:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c32d0 con 0x7fca300ac870 2023-07-09T02:16:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300694b0 0x7fca300c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300694b0 0x7fca300c2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34414/0 (socket says 172.21.15.45:34414) 2023-07-09T02:16:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 -- 172.21.15.45:0/3948930473 learned_addr learned my addr 172.21.15.45:0/3948930473 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca27fff640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3006b800 0x7fca300c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:20.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2ed9d640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300ac870 0x7fca300b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:20.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 -- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300ac870 msgr2=0x7fca300b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300ac870 0x7fca300b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 -- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3006b800 msgr2=0x7fca300c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3006b800 0x7fca300c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 -- 172.21.15.45:0/3948930473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200094d0 con 0x7fca300694b0 2023-07-09T02:16:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca27fff640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3006b800 0x7fca300c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca2e59c640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300694b0 0x7fca300c2960 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fca2001abf0 tx=0x7fca2001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:20.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca26ffd640 1 -- 172.21.15.45:0/3948930473 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200a9400 con 0x7fca300694b0 2023-07-09T02:16:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca26ffd640 1 -- 172.21.15.45:0/3948930473 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca200b1820 con 0x7fca300694b0 2023-07-09T02:16:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca300c35b0 con 0x7fca300694b0 2023-07-09T02:16:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca26ffd640 1 -- 172.21.15.45:0/3948930473 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200b1bd0 con 0x7fca300694b0 2023-07-09T02:16:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca300c3b70 con 0x7fca300694b0 2023-07-09T02:16:20.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.345+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3006ae60 con 0x7fca300694b0 2023-07-09T02:16:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.349+0000 7fca26ffd640 1 -- 172.21.15.45:0/3948930473 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca200b1d30 con 0x7fca300694b0 2023-07-09T02:16:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.349+0000 7fca26ffd640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.349+0000 7fca26ffd640 1 -- 172.21.15.45:0/3948930473 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca2011e830 con 0x7fca300694b0 2023-07-09T02:16:20.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.349+0000 7fca27fff640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:20.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.349+0000 7fca27fff640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fca18000f70 tx=0x7fca18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:20.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.353+0000 7fca26ffd640 1 -- 172.21.15.45:0/3948930473 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca200ebd30 con 0x7fca300694b0 2023-07-09T02:16:20.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:20.541+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fca300c3410 con 0x7fca300694b0 2023-07-09T02:16:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca26ffd640 1 -- 172.21.15.45:0/3948930473 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7fca300c3410 con 0x7fca300694b0 2023-07-09T02:16:21.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 msgr2=0x7fca10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fca18000f70 tx=0x7fca18009040 comp rx=0 tx=0).stop 2023-07-09T02:16:21.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300694b0 msgr2=0x7fca300c2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300694b0 0x7fca300c2960 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fca2001abf0 tx=0x7fca2001ad80 comp rx=0 tx=0).stop 2023-07-09T02:16:21.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 shutdown_connections 2023-07-09T02:16:21.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fca10066280 0x7fca10068730 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca300ac870 0x7fca300b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca3006b800 0x7fca300c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 --2- 172.21.15.45:0/3948930473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca300694b0 0x7fca300c2960 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 >> 172.21.15.45:0/3948930473 conn(0x7fca300cfb50 msgr2=0x7fca30070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 shutdown_connections 2023-07-09T02:16:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.165+0000 7fca3486d640 1 -- 172.21.15.45:0/3948930473 wait complete. 2023-07-09T02:16:21.189 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:16:21.190 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:21.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.333+0000 7fdcf3c9c640 1 Processor -- start 2023-07-09T02:16:21.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.333+0000 7fdcf3c9c640 1 -- start start 2023-07-09T02:16:21.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf3c9c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdcec15c060 0x7fdcec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf3c9c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcec160a50 con 0x7fdcec0d2620 2023-07-09T02:16:21.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf3c9c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcec15c430 con 0x7fdcec0cd120 2023-07-09T02:16:21.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf3c9c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcec15fb60 con 0x7fdcec15c060 2023-07-09T02:16:21.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf2239640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdcec0d2620 0x7fdcec0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36954/0 (socket says 172.21.15.45:36954) 2023-07-09T02:16:21.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf2239640 1 -- 172.21.15.45:0/636220867 learned_addr learned my addr 172.21.15.45:0/636220867 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:21.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf1a38640 1 --2- 172.21.15.45:0/636220867 >> v2:172.21.15.155:3300/0 conn(0x7fdcec15c060 0x7fdcec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf0a36640 1 -- 172.21.15.45:0/636220867 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835139888 0 0) 0x7fdcec160a50 con 0x7fdcec0d2620 2023-07-09T02:16:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf0a36640 1 -- 172.21.15.45:0/636220867 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd8003530 con 0x7fdcec0d2620 2023-07-09T02:16:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf1a38640 1 -- 172.21.15.45:0/636220867 >> v1:172.21.15.155:6789/0 conn(0x7fdcec0cd120 legacy=0x7fdcec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf1a38640 1 -- 172.21.15.45:0/636220867 >> v1:172.21.15.45:6789/0 conn(0x7fdcec0d2620 legacy=0x7fdcec0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.337+0000 7fdcf1a38640 1 -- 172.21.15.45:0/636220867 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec15fe40 con 0x7fdcec15c060 2023-07-09T02:16:21.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf1a38640 1 --2- 172.21.15.45:0/636220867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec15c060 0x7fdcec0b4ed0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdce80097c0 tx=0x7fdce801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bc24ef3b49375b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:21.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf0a36640 1 -- 172.21.15.45:0/636220867 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80ab650 con 0x7fdcec15c060 2023-07-09T02:16:21.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf0a36640 1 -- 172.21.15.45:0/636220867 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce80ab7b0 con 0x7fdcec15c060 2023-07-09T02:16:21.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf0a36640 1 -- 172.21.15.45:0/636220867 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80abb40 con 0x7fdcec15c060 2023-07-09T02:16:21.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/636220867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec15c060 msgr2=0x7fdcec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 --2- 172.21.15.45:0/636220867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec15c060 0x7fdcec0b4ed0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdce80097c0 tx=0x7fdce801c450 comp rx=0 tx=0).stop 2023-07-09T02:16:21.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/636220867 shutdown_connections 2023-07-09T02:16:21.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 --2- 172.21.15.45:0/636220867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec15c060 0x7fdcec0b4ed0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/636220867 >> 172.21.15.45:0/636220867 conn(0x7fdcec0698e0 msgr2=0x7fdcec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:21.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/636220867 shutdown_connections 2023-07-09T02:16:21.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/636220867 wait complete. 2023-07-09T02:16:21.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 Processor -- start 2023-07-09T02:16:21.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.341+0000 7fdcf3c9c640 1 -- start start 2023-07-09T02:16:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec0cd120 0x7fdcec160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcec0d2620 0x7fdcec1f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcec15c060 0x7fdcec157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec162450 con 0x7fdcec15c060 2023-07-09T02:16:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec1613b0 con 0x7fdcec0cd120 2023-07-09T02:16:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcec161690 con 0x7fdcec0d2620 2023-07-09T02:16:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcec15c060 0x7fdcec157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf1a38640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec0cd120 0x7fdcec160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcec15c060 0x7fdcec157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34422/0 (socket says 172.21.15.45:34422) 2023-07-09T02:16:21.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 -- 172.21.15.45:0/3094809687 learned_addr learned my addr 172.21.15.45:0/3094809687 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:21.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf1237640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcec0d2620 0x7fdcec1f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 -- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcec0d2620 msgr2=0x7fdcec1f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcec0d2620 0x7fdcec1f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 -- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec0cd120 msgr2=0x7fdcec160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec0cd120 0x7fdcec160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 -- 172.21.15.45:0/3094809687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8009420 con 0x7fdcec15c060 2023-07-09T02:16:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf2239640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcec15c060 0x7fdcec157640 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fdce400cae0 tx=0x7fdce400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdce27fc640 1 -- 172.21.15.45:0/3094809687 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400ac40 con 0x7fdcec15c060 2023-07-09T02:16:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdce27fc640 1 -- 172.21.15.45:0/3094809687 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce400ada0 con 0x7fdcec15c060 2023-07-09T02:16:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcec0b59f0 con 0x7fdcec15c060 2023-07-09T02:16:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdce27fc640 1 -- 172.21.15.45:0/3094809687 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4012640 con 0x7fdcec15c060 2023-07-09T02:16:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcec161c50 con 0x7fdcec15c060 2023-07-09T02:16:21.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcec04d7d0 con 0x7fdcec15c060 2023-07-09T02:16:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.345+0000 7fdce27fc640 1 -- 172.21.15.45:0/3094809687 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdce4007070 con 0x7fdcec15c060 2023-07-09T02:16:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.349+0000 7fdce27fc640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdcd0066280 0x7fdcd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.349+0000 7fdce27fc640 1 -- 172.21.15.45:0/3094809687 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdce4083d60 con 0x7fdcec15c060 2023-07-09T02:16:21.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.349+0000 7fdcf1a38640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdcd0066280 0x7fdcd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.349+0000 7fdcf1a38640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdcd0066280 0x7fdcd0068730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fdce80af000 tx=0x7fdce80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:21.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.353+0000 7fdce27fc640 1 -- 172.21.15.45:0/3094809687 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdce40511f0 con 0x7fdcec15c060 2023-07-09T02:16:21.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcec06baa0 con 0x7fdcec15c060 2023-07-09T02:16:21.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdce27fc640 1 -- 172.21.15.45:0/3094809687 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fdce4017090 con 0x7fdcec15c060 2023-07-09T02:16:21.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:21.543 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:21.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdcd0066280 msgr2=0x7fdcd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdcd0066280 0x7fdcd0068730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fdce80af000 tx=0x7fdce80a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:21.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcec15c060 msgr2=0x7fdcec157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcec15c060 0x7fdcec157640 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fdce400cae0 tx=0x7fdce400a060 comp rx=0 tx=0).stop 2023-07-09T02:16:21.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 shutdown_connections 2023-07-09T02:16:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcec15c060 0x7fdcec157640 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdcd0066280 0x7fdcd0068730 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdcec0d2620 0x7fdcec1f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 --2- 172.21.15.45:0/3094809687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcec0cd120 0x7fdcec160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 >> 172.21.15.45:0/3094809687 conn(0x7fdcec0698e0 msgr2=0x7fdcec0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 shutdown_connections 2023-07-09T02:16:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.541+0000 7fdcf3c9c640 1 -- 172.21.15.45:0/3094809687 wait complete. 2023-07-09T02:16:21.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bb4982640 1 Processor -- start 2023-07-09T02:16:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bb4982640 1 -- start start 2023-07-09T02:16:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bb4982640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb015c060 0x7f0bb00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bb4982640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0bb00d2620 0x7f0bb00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bb4982640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb0160a50 con 0x7f0bb00cd120 2023-07-09T02:16:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bb4982640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb015c430 con 0x7f0bb00d2620 2023-07-09T02:16:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bb4982640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb015fb60 con 0x7f0bb015c060 2023-07-09T02:16:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb015c060 0x7f0bb00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0baed9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0bb00d2620 0x7f0bb00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bae59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb015c060 0x7f0bb00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:51314/0 (socket says 172.21.15.45:51314) 2023-07-09T02:16:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bae59c640 1 -- 172.21.15.45:0/3883204120 learned_addr learned my addr 172.21.15.45:0/3883204120 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bae59c640 1 -- 172.21.15.45:0/3883204120 >> v2:172.21.15.155:3300/0 conn(0x7f0bb00d2620 msgr2=0x7f0bb00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bae59c640 1 --2- 172.21.15.45:0/3883204120 >> v2:172.21.15.155:3300/0 conn(0x7f0bb00d2620 0x7f0bb00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bae59c640 1 -- 172.21.15.45:0/3883204120 >> v1:172.21.15.155:6789/0 conn(0x7f0bb00cd120 legacy=0x7f0bb00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0bae59c640 1 -- 172.21.15.45:0/3883204120 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb015fe40 con 0x7f0bb015c060 2023-07-09T02:16:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.705+0000 7f0badd9b640 1 -- 172.21.15.45:0/3883204120 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913870984 0 0) 0x7f0bb0160a50 con 0x7f0bb00cd120 2023-07-09T02:16:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bae59c640 1 --2- 172.21.15.45:0/3883204120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb015c060 0x7f0bb00b4ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00098a0 tx=0x7f0ba001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4cff13c8cab12b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0badd9b640 1 -- 172.21.15.45:0/3883204120 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00aa650 con 0x7f0bb015c060 2023-07-09T02:16:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0badd9b640 1 -- 172.21.15.45:0/3883204120 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba00aa7b0 con 0x7f0bb015c060 2023-07-09T02:16:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0badd9b640 1 -- 172.21.15.45:0/3883204120 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00aab40 con 0x7f0bb015c060 2023-07-09T02:16:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bb4982640 1 -- 172.21.15.45:0/3883204120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb015c060 msgr2=0x7f0bb00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bb4982640 1 --2- 172.21.15.45:0/3883204120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb015c060 0x7f0bb00b4ed0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00098a0 tx=0x7f0ba001c4f0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bb4982640 1 -- 172.21.15.45:0/3883204120 shutdown_connections 2023-07-09T02:16:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bb4982640 1 --2- 172.21.15.45:0/3883204120 >> v2:172.21.15.155:3300/0 conn(0x7f0bb00d2620 0x7f0bb00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bb4982640 1 --2- 172.21.15.45:0/3883204120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb015c060 0x7f0bb00b4ed0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bb4982640 1 -- 172.21.15.45:0/3883204120 >> 172.21.15.45:0/3883204120 conn(0x7f0bb00698e0 msgr2=0x7f0bb0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bb4982640 1 -- 172.21.15.45:0/3883204120 shutdown_connections 2023-07-09T02:16:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.709+0000 7f0bb4982640 1 -- 172.21.15.45:0/3883204120 wait complete. 2023-07-09T02:16:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 Processor -- start 2023-07-09T02:16:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 -- start start 2023-07-09T02:16:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb00cd120 0x7f0bb00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb00d2620 0x7f0bb00b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb015c060 0x7f0bb00b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00c8e00 con 0x7f0bb015c060 2023-07-09T02:16:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb015df90 con 0x7f0bb00d2620 2023-07-09T02:16:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb015d380 con 0x7f0bb00cd120 2023-07-09T02:16:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb015c060 0x7f0bb00b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb015c060 0x7f0bb00b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49962/0 (socket says 172.21.15.45:49962) 2023-07-09T02:16:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 -- 172.21.15.45:0/422706168 learned_addr learned my addr 172.21.15.45:0/422706168 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bae59c640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb00cd120 0x7f0bb00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0ba7fff640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb00d2620 0x7f0bb00b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 -- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb00cd120 msgr2=0x7f0bb00c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb00cd120 0x7f0bb00c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 -- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb00d2620 msgr2=0x7f0bb00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb00d2620 0x7f0bb00b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 -- 172.21.15.45:0/422706168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba00094d0 con 0x7f0bb015c060 2023-07-09T02:16:21.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0ba7fff640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb00d2620 0x7f0bb00b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0baed9d640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb015c060 0x7f0bb00b60c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800ef90 tx=0x7f0ba800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0ba6ffd640 1 -- 172.21.15.45:0/422706168 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8009ca0 con 0x7f0bb015c060 2023-07-09T02:16:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0ba6ffd640 1 -- 172.21.15.45:0/422706168 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba800f040 con 0x7f0bb015c060 2023-07-09T02:16:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0ba6ffd640 1 -- 172.21.15.45:0/422706168 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80146c0 con 0x7f0bb015c060 2023-07-09T02:16:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb00b59f0 con 0x7f0bb015c060 2023-07-09T02:16:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.713+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb015d940 con 0x7f0bb015c060 2023-07-09T02:16:21.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.717+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb004d7d0 con 0x7f0bb015c060 2023-07-09T02:16:21.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.717+0000 7f0ba6ffd640 1 -- 172.21.15.45:0/422706168 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ba8014820 con 0x7f0bb015c060 2023-07-09T02:16:21.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.717+0000 7f0ba6ffd640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b900662b0 0x7f0b90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:21.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.717+0000 7f0ba6ffd640 1 -- 172.21.15.45:0/422706168 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ba8084cb0 con 0x7f0bb015c060 2023-07-09T02:16:21.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.717+0000 7f0bae59c640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b900662b0 0x7f0b90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:21.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.717+0000 7f0bae59c640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b900662b0 0x7f0b90068760 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00ae000 tx=0x7f0ba00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.721+0000 7f0ba6ffd640 1 -- 172.21.15.45:0/422706168 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ba8052090 con 0x7f0bb015c060 2023-07-09T02:16:21.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.877+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bb006baa0 con 0x7f0bb015c060 2023-07-09T02:16:21.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.877+0000 7f0ba6ffd640 1 -- 172.21.15.45:0/422706168 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18305 (secure 0 0 0) 0x7f0ba8018090 con 0x7f0bb015c060 2023-07-09T02:16:21.878 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:21.879 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":106,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:19.125030+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:16:15.254129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T02:16:16.522380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:21.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.877+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b900662b0 msgr2=0x7f0b90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.877+0000 7f0bb4982640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b900662b0 0x7f0b90068760 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00ae000 tx=0x7f0ba00a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:21.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.877+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb015c060 msgr2=0x7f0bb00b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:21.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.877+0000 7f0bb4982640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb015c060 0x7f0bb00b60c0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800ef90 tx=0x7f0ba800c490 comp rx=0 tx=0).stop 2023-07-09T02:16:21.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.881+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 shutdown_connections 2023-07-09T02:16:21.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.881+0000 7f0bb4982640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bb015c060 0x7f0bb00b60c0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.881+0000 7f0bb4982640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb00d2620 0x7f0bb00b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.881+0000 7f0bb4982640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b900662b0 0x7f0b90068760 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.881+0000 7f0bb4982640 1 --2- 172.21.15.45:0/422706168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb00cd120 0x7f0bb00c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:21.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.881+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 >> 172.21.15.45:0/422706168 conn(0x7f0bb00698e0 msgr2=0x7f0bb00b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:21.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.881+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 shutdown_connections 2023-07-09T02:16:21.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:21.881+0000 7f0bb4982640 1 -- 172.21.15.45:0/422706168 wait complete. 2023-07-09T02:16:21.899 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:16:21.900 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:16:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.041+0000 7fa73ec9e640 1 Processor -- start 2023-07-09T02:16:22.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.041+0000 7fa73ec9e640 1 -- start start 2023-07-09T02:16:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.041+0000 7fa73ec9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa73815c060 0x7fa7380b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73ec9e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa738160a50 con 0x7fa7380d2620 2023-07-09T02:16:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73ec9e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73815c430 con 0x7fa7380cd120 2023-07-09T02:16:22.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73ec9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73815fb60 con 0x7fa73815c060 2023-07-09T02:16:22.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73d23b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa7380d2620 0x7fa7380cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55092/0 (socket says 172.21.15.45:55092) 2023-07-09T02:16:22.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73d23b640 1 -- 172.21.15.45:0/1208393289 learned_addr learned my addr 172.21.15.45:0/1208393289 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73ca3a640 1 --2- 172.21.15.45:0/1208393289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa73815c060 0x7fa7380b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa7377fe640 1 -- 172.21.15.45:0/1208393289 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110769604 0 0) 0x7fa738160a50 con 0x7fa7380d2620 2023-07-09T02:16:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa7377fe640 1 -- 172.21.15.45:0/1208393289 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa728003530 con 0x7fa7380d2620 2023-07-09T02:16:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa7377fe640 1 -- 172.21.15.45:0/1208393289 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776042460 0 0) 0x7fa73815c430 con 0x7fa7380cd120 2023-07-09T02:16:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa7377fe640 1 -- 172.21.15.45:0/1208393289 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa738160a50 con 0x7fa7380cd120 2023-07-09T02:16:22.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa7377fe640 1 -- 172.21.15.45:0/1208393289 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4065105448 0 0) 0x7fa728003530 con 0x7fa7380d2620 2023-07-09T02:16:22.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73ca3a640 1 -- 172.21.15.45:0/1208393289 >> v1:172.21.15.155:6789/0 conn(0x7fa7380cd120 legacy=0x7fa7380d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73ca3a640 1 -- 172.21.15.45:0/1208393289 >> v1:172.21.15.45:6789/0 conn(0x7fa7380d2620 legacy=0x7fa7380cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.045+0000 7fa73ca3a640 1 -- 172.21.15.45:0/1208393289 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73815fe40 con 0x7fa73815c060 2023-07-09T02:16:22.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ca3a640 1 --2- 172.21.15.45:0/1208393289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa73815c060 0x7fa7380b4ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009820 tx=0x7fa72c01c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93b7b965b7277c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa7377fe640 1 -- 172.21.15.45:0/1208393289 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730001a00 con 0x7fa73815c060 2023-07-09T02:16:22.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa7377fe640 1 -- 172.21.15.45:0/1208393289 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c0a7050 con 0x7fa73815c060 2023-07-09T02:16:22.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa7377fe640 1 -- 172.21.15.45:0/1208393289 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c004250 con 0x7fa73815c060 2023-07-09T02:16:22.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- 172.21.15.45:0/1208393289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa73815c060 msgr2=0x7fa7380b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 --2- 172.21.15.45:0/1208393289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa73815c060 0x7fa7380b4ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009820 tx=0x7fa72c01c390 comp rx=0 tx=0).stop 2023-07-09T02:16:22.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- 172.21.15.45:0/1208393289 shutdown_connections 2023-07-09T02:16:22.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 --2- 172.21.15.45:0/1208393289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa73815c060 0x7fa7380b4ed0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- 172.21.15.45:0/1208393289 >> 172.21.15.45:0/1208393289 conn(0x7fa7380698e0 msgr2=0x7fa738069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:22.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- 172.21.15.45:0/1208393289 shutdown_connections 2023-07-09T02:16:22.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- 172.21.15.45:0/1208393289 wait complete. 2023-07-09T02:16:22.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 Processor -- start 2023-07-09T02:16:22.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- start start 2023-07-09T02:16:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7380cd120 0x7fa73814e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7380d2620 0x7fa73815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa73815c060 0x7fa73815b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73815a100 con 0x7fa73815c060 2023-07-09T02:16:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73814e7e0 con 0x7fa7380cd120 2023-07-09T02:16:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.049+0000 7fa73ec9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7381597f0 con 0x7fa7380d2620 2023-07-09T02:16:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa73815c060 0x7fa73815b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa73815c060 0x7fa73815b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49972/0 (socket says 172.21.15.45:49972) 2023-07-09T02:16:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 -- 172.21.15.45:0/3628459898 learned_addr learned my addr 172.21.15.45:0/3628459898 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73ca3a640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7380cd120 0x7fa73814e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa737fff640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7380d2620 0x7fa73815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 -- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7380d2620 msgr2=0x7fa73815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7380d2620 0x7fa73815a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 -- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7380cd120 msgr2=0x7fa73814e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7380cd120 0x7fa73814e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 -- 172.21.15.45:0/3628459898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009420 con 0x7fa73815c060 2023-07-09T02:16:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73ca3a640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7380cd120 0x7fa73814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73d23b640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa73815c060 0x7fa73815b350 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa730005c10 tx=0x7fa73000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa7357fa640 1 -- 172.21.15.45:0/3628459898 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000ce30 con 0x7fa73815c060 2023-07-09T02:16:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa7357fa640 1 -- 172.21.15.45:0/3628459898 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730012400 con 0x7fa73815c060 2023-07-09T02:16:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa7357fa640 1 -- 172.21.15.45:0/3628459898 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300127f0 con 0x7fa73815c060 2023-07-09T02:16:22.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7380b59f0 con 0x7fa73815c060 2023-07-09T02:16:22.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73815b890 con 0x7fa73815c060 2023-07-09T02:16:22.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73815a240 con 0x7fa73815c060 2023-07-09T02:16:22.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa7357fa640 1 -- 172.21.15.45:0/3628459898 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa730007070 con 0x7fa73815c060 2023-07-09T02:16:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa7357fa640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa71c0662b0 0x7fa71c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.053+0000 7fa7357fa640 1 -- 172.21.15.45:0/3628459898 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa730083ce0 con 0x7fa73815c060 2023-07-09T02:16:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.057+0000 7fa73ca3a640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa71c0662b0 0x7fa71c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.057+0000 7fa73ca3a640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa71c0662b0 0x7fa71c068760 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0ad000 tx=0x7fa72c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.057+0000 7fa7357fa640 1 -- 172.21.15.45:0/3628459898 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa73815a240 con 0x7fa73815c060 2023-07-09T02:16:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.213+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7380b5870 con 0x7fa71c0662b0 2023-07-09T02:16:22.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.225+0000 7fa7357fa640 1 -- 172.21.15.45:0/3628459898 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305860 (secure 0 0 0) 0x7fa72c004310 con 0x7fa71c0662b0 2023-07-09T02:16:22.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:22.229 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa71c0662b0 msgr2=0x7fa71c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa71c0662b0 0x7fa71c068760 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0ad000 tx=0x7fa72c008040 comp rx=0 tx=0).stop 2023-07-09T02:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa73815c060 msgr2=0x7fa73815b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa73815c060 0x7fa73815b350 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fa730005c10 tx=0x7fa73000a430 comp rx=0 tx=0).stop 2023-07-09T02:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 shutdown_connections 2023-07-09T02:16:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa73815c060 0x7fa73815b350 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa71c0662b0 0x7fa71c068760 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7380d2620 0x7fa73815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 --2- 172.21.15.45:0/3628459898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7380cd120 0x7fa73814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 >> 172.21.15.45:0/3628459898 conn(0x7fa7380698e0 msgr2=0x7fa7380b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 shutdown_connections 2023-07-09T02:16:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.229+0000 7fa73ec9e640 1 -- 172.21.15.45:0/3628459898 wait complete. 2023-07-09T02:16:22.248 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2023-07-09T02:16:20.600093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5965,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556534,"statfs":{"total":1600000000,"available":1593891308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.485758"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300094+0000","last_change":"2023-07-09T02:16:18.138809+0000","last_active":"2023-07-09T02:16:19.300094+0000","last_peered":"2023-07-09T02:16:19.300094+0000","last_clean":"2023-07-09T02:16:19.300094+0000","last_became_active":"2023-07-09T02:16:18.138297+0000","last_became_peered":"2023-07-09T02:16:18.138297+0000","last_unstale":"2023-07-09T02:16:19.300094+0000","last_undegraded":"2023-07-09T02:16:19.300094+0000","last_fullsized":"2023-07-09T02:16:19.300094+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:10:17.228744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128182+0000","last_change":"2023-07-09T02:16:18.132439+0000","last_active":"2023-07-09T02:16:19.128182+0000","last_peered":"2023-07-09T02:16:19.128182+0000","last_clean":"2023-07-09T02:16:19.128182+0000","last_became_active":"2023-07-09T02:16:18.132206+0000","last_became_peered":"2023-07-09T02:16:18.132206+0000","last_unstale":"2023-07-09T02:16:19.128182+0000","last_undegraded":"2023-07-09T02:16:19.128182+0000","last_fullsized":"2023-07-09T02:16:19.128182+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:22:24.778956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299807+0000","last_change":"2023-07-09T02:16:18.133760+0000","last_active":"2023-07-09T02:16:19.299807+0000","last_peered":"2023-07-09T02:16:19.299807+0000","last_clean":"2023-07-09T02:16:19.299807+0000","last_became_active":"2023-07-09T02:16:18.133538+0000","last_became_peered":"2023-07-09T02:16:18.133538+0000","last_unstale":"2023-07-09T02:16:19.299807+0000","last_undegraded":"2023-07-09T02:16:19.299807+0000","last_fullsized":"2023-07-09T02:16:19.299807+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:50:44.315343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305162+0000","last_change":"2023-07-09T02:16:18.144252+0000","last_active":"2023-07-09T02:16:19.305162+0000","last_peered":"2023-07-09T02:16:19.305162+0000","last_clean":"2023-07-09T02:16:19.305162+0000","last_became_active":"2023-07-09T02:16:18.143588+0000","last_became_peered":"2023-07-09T02:16:18.143588+0000","last_unstale":"2023-07-09T02:16:19.305162+0000","last_undegraded":"2023-07-09T02:16:19.305162+0000","last_fullsized":"2023-07-09T02:16:19.305162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:43:53.996868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127315+0000","last_change":"2023-07-09T02:16:18.137583+0000","last_active":"2023-07-09T02:16:19.127315+0000","last_peered":"2023-07-09T02:16:19.127315+0000","last_clean":"2023-07-09T02:16:19.127315+0000","last_became_active":"2023-07-09T02:16:18.137199+0000","last_became_peered":"2023-07-09T02:16:18.137199+0000","last_unstale":"2023-07-09T02:16:19.127315+0000","last_undegraded":"2023-07-09T02:16:19.127315+0000","last_fullsized":"2023-07-09T02:16:19.127315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:52:58.818942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130312+0000","last_change":"2023-07-09T02:16:18.146413+0000","last_active":"2023-07-09T02:16:19.130312+0000","last_peered":"2023-07-09T02:16:19.130312+0000","last_clean":"2023-07-09T02:16:19.130312+0000","last_became_active":"2023-07-09T02:16:18.145854+0000","last_became_peered":"2023-07-09T02:16:18.145854+0000","last_unstale":"2023-07-09T02:16:19.130312+0000","last_undegraded":"2023-07-09T02:16:19.130312+0000","last_fullsized":"2023-07-09T02:16:19.130312+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:09:24.114793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.298960+0000","last_change":"2023-07-09T02:16:18.142962+0000","last_active":"2023-07-09T02:16:19.298960+0000","last_peered":"2023-07-09T02:16:19.298960+0000","last_clean":"2023-07-09T02:16:19.298960+0000","last_became_active":"2023-07-09T02:16:18.142774+0000","last_became_peered":"2023-07-09T02:16:18.142774+0000","last_unstale":"2023-07-09T02:16:19.298960+0000","last_undegraded":"2023-07-09T02:16:19.298960+0000","last_fullsized":"2023-07-09T02:16:19.298960+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:40:10.223063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305091+0000","last_change":"2023-07-09T02:16:18.148509+0000","last_active":"2023-07-09T02:16:19.305091+0000","last_peered":"2023-07-09T02:16:19.305091+0000","last_clean":"2023-07-09T02:16:19.305091+0000","last_became_active":"2023-07-09T02:16:18.145679+0000","last_became_peered":"2023-07-09T02:16:18.145679+0000","last_unstale":"2023-07-09T02:16:19.305091+0000","last_undegraded":"2023-07-09T02:16:19.305091+0000","last_fullsized":"2023-07-09T02:16:19.305091+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:51:22.354344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.126981+0000","last_change":"2023-07-09T02:16:18.133864+0000","last_active":"2023-07-09T02:16:19.126981+0000","last_peered":"2023-07-09T02:16:19.126981+0000","last_clean":"2023-07-09T02:16:19.126981+0000","last_became_active":"2023-07-09T02:16:18.133519+0000","last_became_peered":"2023-07-09T02:16:18.133519+0000","last_unstale":"2023-07-09T02:16:19.126981+0000","last_undegraded":"2023-07-09T02:16:19.126981+0000","last_fullsized":"2023-07-09T02:16:19.126981+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:50:32.187069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305813+0000","last_change":"2023-07-09T02:16:18.142500+0000","last_active":"2023-07-09T02:16:19.305813+0000","last_peered":"2023-07-09T02:16:19.305813+0000","last_clean":"2023-07-09T02:16:19.305813+0000","last_became_active":"2023-07-09T02:16:18.142046+0000","last_became_peered":"2023-07-09T02:16:18.142046+0000","last_unstale":"2023-07-09T02:16:19.305813+0000","last_undegraded":"2023-07-09T02:16:19.305813+0000","last_fullsized":"2023-07-09T02:16:19.305813+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:44:03.333167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127315+0000","last_change":"2023-07-09T02:16:18.135522+0000","last_active":"2023-07-09T02:16:19.127315+0000","last_peered":"2023-07-09T02:16:19.127315+0000","last_clean":"2023-07-09T02:16:19.127315+0000","last_became_active":"2023-07-09T02:16:18.135117+0000","last_became_peered":"2023-07-09T02:16:18.135117+0000","last_unstale":"2023-07-09T02:16:19.127315+0000","last_undegraded":"2023-07-09T02:16:19.127315+0000","last_fullsized":"2023-07-09T02:16:19.127315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:27:05.243431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305425+0000","last_change":"2023-07-09T02:16:18.144805+0000","last_active":"2023-07-09T02:16:19.305425+0000","last_peered":"2023-07-09T02:16:19.305425+0000","last_clean":"2023-07-09T02:16:19.305425+0000","last_became_active":"2023-07-09T02:16:18.144498+0000","last_became_peered":"2023-07-09T02:16:18.144498+0000","last_unstale":"2023-07-09T02:16:19.305425+0000","last_undegraded":"2023-07-09T02:16:19.305425+0000","last_fullsized":"2023-07-09T02:16:19.305425+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:40:27.306659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305221+0000","last_change":"2023-07-09T02:16:18.148697+0000","last_active":"2023-07-09T02:16:19.305221+0000","last_peered":"2023-07-09T02:16:19.305221+0000","last_clean":"2023-07-09T02:16:19.305221+0000","last_became_active":"2023-07-09T02:16:18.145971+0000","last_became_peered":"2023-07-09T02:16:18.145971+0000","last_unstale":"2023-07-09T02:16:19.305221+0000","last_undegraded":"2023-07-09T02:16:19.305221+0000","last_fullsized":"2023-07-09T02:16:19.305221+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:39.063095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127695+0000","last_change":"2023-07-09T02:16:18.142591+0000","last_active":"2023-07-09T02:16:19.127695+0000","last_peered":"2023-07-09T02:16:19.127695+0000","last_clean":"2023-07-09T02:16:19.127695+0000","last_became_active":"2023-07-09T02:16:18.142327+0000","last_became_peered":"2023-07-09T02:16:18.142327+0000","last_unstale":"2023-07-09T02:16:19.127695+0000","last_undegraded":"2023-07-09T02:16:19.127695+0000","last_fullsized":"2023-07-09T02:16:19.127695+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:12:15.023576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305193+0000","last_change":"2023-07-09T02:16:18.142452+0000","last_active":"2023-07-09T02:16:19.305193+0000","last_peered":"2023-07-09T02:16:19.305193+0000","last_clean":"2023-07-09T02:16:19.305193+0000","last_became_active":"2023-07-09T02:16:18.142240+0000","last_became_peered":"2023-07-09T02:16:18.142240+0000","last_unstale":"2023-07-09T02:16:19.305193+0000","last_undegraded":"2023-07-09T02:16:19.305193+0000","last_fullsized":"2023-07-09T02:16:19.305193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:23:58.756222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130048+0000","last_change":"2023-07-09T02:16:18.137535+0000","last_active":"2023-07-09T02:16:19.130048+0000","last_peered":"2023-07-09T02:16:19.130048+0000","last_clean":"2023-07-09T02:16:19.130048+0000","last_became_active":"2023-07-09T02:16:18.134975+0000","last_became_peered":"2023-07-09T02:16:18.134975+0000","last_unstale":"2023-07-09T02:16:19.130048+0000","last_undegraded":"2023-07-09T02:16:19.130048+0000","last_fullsized":"2023-07-09T02:16:19.130048+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:43:07.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.129932+0000","last_change":"2023-07-09T02:16:18.137721+0000","last_active":"2023-07-09T02:16:19.129932+0000","last_peered":"2023-07-09T02:16:19.129932+0000","last_clean":"2023-07-09T02:16:19.129932+0000","last_became_active":"2023-07-09T02:16:18.137048+0000","last_became_peered":"2023-07-09T02:16:18.137048+0000","last_unstale":"2023-07-09T02:16:19.129932+0000","last_undegraded":"2023-07-09T02:16:19.129932+0000","last_fullsized":"2023-07-09T02:16:19.129932+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:48:51.114438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300006+0000","last_change":"2023-07-09T02:16:18.129735+0000","last_active":"2023-07-09T02:16:19.300006+0000","last_peered":"2023-07-09T02:16:19.300006+0000","last_clean":"2023-07-09T02:16:19.300006+0000","last_became_active":"2023-07-09T02:16:18.129510+0000","last_became_peered":"2023-07-09T02:16:18.129510+0000","last_unstale":"2023-07-09T02:16:19.300006+0000","last_undegraded":"2023-07-09T02:16:19.300006+0000","last_fullsized":"2023-07-09T02:16:19.300006+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:01:17.799641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127124+0000","last_change":"2023-07-09T02:16:18.140256+0000","last_active":"2023-07-09T02:16:19.127124+0000","last_peered":"2023-07-09T02:16:19.127124+0000","last_clean":"2023-07-09T02:16:19.127124+0000","last_became_active":"2023-07-09T02:16:18.139922+0000","last_became_peered":"2023-07-09T02:16:18.139922+0000","last_unstale":"2023-07-09T02:16:19.127124+0000","last_undegraded":"2023-07-09T02:16:19.127124+0000","last_fullsized":"2023-07-09T02:16:19.127124+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:25:14.212120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305324+0000","last_change":"2023-07-09T02:16:18.144240+0000","last_active":"2023-07-09T02:16:19.305324+0000","last_peered":"2023-07-09T02:16:19.305324+0000","last_clean":"2023-07-09T02:16:19.305324+0000","last_became_active":"2023-07-09T02:16:18.143492+0000","last_became_peered":"2023-07-09T02:16:18.143492+0000","last_unstale":"2023-07-09T02:16:19.305324+0000","last_undegraded":"2023-07-09T02:16:19.305324+0000","last_fullsized":"2023-07-09T02:16:19.305324+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:15:56.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127495+0000","last_change":"2023-07-09T02:16:18.135349+0000","last_active":"2023-07-09T02:16:19.127495+0000","last_peered":"2023-07-09T02:16:19.127495+0000","last_clean":"2023-07-09T02:16:19.127495+0000","last_became_active":"2023-07-09T02:16:18.134738+0000","last_became_peered":"2023-07-09T02:16:18.134738+0000","last_unstale":"2023-07-09T02:16:19.127495+0000","last_undegraded":"2023-07-09T02:16:19.127495+0000","last_fullsized":"2023-07-09T02:16:19.127495+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:13:52.839025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127007+0000","last_change":"2023-07-09T02:16:18.138668+0000","last_active":"2023-07-09T02:16:19.127007+0000","last_peered":"2023-07-09T02:16:19.127007+0000","last_clean":"2023-07-09T02:16:19.127007+0000","last_became_active":"2023-07-09T02:16:18.138425+0000","last_became_peered":"2023-07-09T02:16:18.138425+0000","last_unstale":"2023-07-09T02:16:19.127007+0000","last_undegraded":"2023-07-09T02:16:19.127007+0000","last_fullsized":"2023-07-09T02:16:19.127007+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:56:38.197421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.298775+0000","last_change":"2023-07-09T02:16:18.143934+0000","last_active":"2023-07-09T02:16:19.298775+0000","last_peered":"2023-07-09T02:16:19.298775+0000","last_clean":"2023-07-09T02:16:19.298775+0000","last_became_active":"2023-07-09T02:16:18.143802+0000","last_became_peered":"2023-07-09T02:16:18.143802+0000","last_unstale":"2023-07-09T02:16:19.298775+0000","last_undegraded":"2023-07-09T02:16:19.298775+0000","last_fullsized":"2023-07-09T02:16:19.298775+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:50:44.315343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299955+0000","last_change":"2023-07-09T02:16:18.138482+0000","last_active":"2023-07-09T02:16:19.299955+0000","last_peered":"2023-07-09T02:16:19.299955+0000","last_clean":"2023-07-09T02:16:19.299955+0000","last_became_active":"2023-07-09T02:16:18.138256+0000","last_became_peered":"2023-07-09T02:16:18.138256+0000","last_unstale":"2023-07-09T02:16:19.299955+0000","last_undegraded":"2023-07-09T02:16:19.299955+0000","last_fullsized":"2023-07-09T02:16:19.299955+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:43.027612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128692+0000","last_change":"2023-07-09T02:16:18.135576+0000","last_active":"2023-07-09T02:16:19.128692+0000","last_peered":"2023-07-09T02:16:19.128692+0000","last_clean":"2023-07-09T02:16:19.128692+0000","last_became_active":"2023-07-09T02:16:18.135349+0000","last_became_peered":"2023-07-09T02:16:18.135349+0000","last_unstale":"2023-07-09T02:16:19.128692+0000","last_undegraded":"2023-07-09T02:16:19.128692+0000","last_fullsized":"2023-07-09T02:16:19.128692+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:37:32.370659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127963+0000","last_change":"2023-07-09T02:16:18.140585+0000","last_active":"2023-07-09T02:16:19.127963+0000","last_peered":"2023-07-09T02:16:19.127963+0000","last_clean":"2023-07-09T02:16:19.127963+0000","last_became_active":"2023-07-09T02:16:18.140371+0000","last_became_peered":"2023-07-09T02:16:18.140371+0000","last_unstale":"2023-07-09T02:16:19.127963+0000","last_undegraded":"2023-07-09T02:16:19.127963+0000","last_fullsized":"2023-07-09T02:16:19.127963+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:49:22.751631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305539+0000","last_change":"2023-07-09T02:16:18.137550+0000","last_active":"2023-07-09T02:16:19.305539+0000","last_peered":"2023-07-09T02:16:19.305539+0000","last_clean":"2023-07-09T02:16:19.305539+0000","last_became_active":"2023-07-09T02:16:18.137340+0000","last_became_peered":"2023-07-09T02:16:18.137340+0000","last_unstale":"2023-07-09T02:16:19.305539+0000","last_undegraded":"2023-07-09T02:16:19.305539+0000","last_fullsized":"2023-07-09T02:16:19.305539+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:04:13.442905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305562+0000","last_change":"2023-07-09T02:16:18.146728+0000","last_active":"2023-07-09T02:16:19.305562+0000","last_peered":"2023-07-09T02:16:19.305562+0000","last_clean":"2023-07-09T02:16:19.305562+0000","last_became_active":"2023-07-09T02:16:18.145358+0000","last_became_peered":"2023-07-09T02:16:18.145358+0000","last_unstale":"2023-07-09T02:16:19.305562+0000","last_undegraded":"2023-07-09T02:16:19.305562+0000","last_fullsized":"2023-07-09T02:16:19.305562+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:54:12.319906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299016+0000","last_change":"2023-07-09T02:16:18.138779+0000","last_active":"2023-07-09T02:16:19.299016+0000","last_peered":"2023-07-09T02:16:19.299016+0000","last_clean":"2023-07-09T02:16:19.299016+0000","last_became_active":"2023-07-09T02:16:18.138557+0000","last_became_peered":"2023-07-09T02:16:18.138557+0000","last_unstale":"2023-07-09T02:16:19.299016+0000","last_undegraded":"2023-07-09T02:16:19.299016+0000","last_fullsized":"2023-07-09T02:16:19.299016+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:47:32.827940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127716+0000","last_change":"2023-07-09T02:16:18.137448+0000","last_active":"2023-07-09T02:16:19.127716+0000","last_peered":"2023-07-09T02:16:19.127716+0000","last_clean":"2023-07-09T02:16:19.127716+0000","last_became_active":"2023-07-09T02:16:18.136755+0000","last_became_peered":"2023-07-09T02:16:18.136755+0000","last_unstale":"2023-07-09T02:16:19.127716+0000","last_undegraded":"2023-07-09T02:16:19.127716+0000","last_fullsized":"2023-07-09T02:16:19.127716+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:01:06.911461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128789+0000","last_change":"2023-07-09T02:16:18.140537+0000","last_active":"2023-07-09T02:16:19.128789+0000","last_peered":"2023-07-09T02:16:19.128789+0000","last_clean":"2023-07-09T02:16:19.128789+0000","last_became_active":"2023-07-09T02:16:18.140109+0000","last_became_peered":"2023-07-09T02:16:18.140109+0000","last_unstale":"2023-07-09T02:16:19.128789+0000","last_undegraded":"2023-07-09T02:16:19.128789+0000","last_fullsized":"2023-07-09T02:16:19.128789+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:52.003565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130064+0000","last_change":"2023-07-09T02:16:18.137585+0000","last_active":"2023-07-09T02:16:19.130064+0000","last_peered":"2023-07-09T02:16:19.130064+0000","last_clean":"2023-07-09T02:16:19.130064+0000","last_became_active":"2023-07-09T02:16:18.136731+0000","last_became_peered":"2023-07-09T02:16:18.136731+0000","last_unstale":"2023-07-09T02:16:19.130064+0000","last_undegraded":"2023-07-09T02:16:19.130064+0000","last_fullsized":"2023-07-09T02:16:19.130064+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:20:56.684376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130446+0000","last_change":"2023-07-09T02:16:18.137982+0000","last_active":"2023-07-09T02:16:19.130446+0000","last_peered":"2023-07-09T02:16:19.130446+0000","last_clean":"2023-07-09T02:16:19.130446+0000","last_became_active":"2023-07-09T02:16:18.137749+0000","last_became_peered":"2023-07-09T02:16:18.137749+0000","last_unstale":"2023-07-09T02:16:19.130446+0000","last_undegraded":"2023-07-09T02:16:19.130446+0000","last_fullsized":"2023-07-09T02:16:19.130446+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:11:51.905903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"105'4","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.298958+0000","last_change":"2023-07-09T02:16:17.132506+0000","last_active":"2023-07-09T02:16:19.298958+0000","last_peered":"2023-07-09T02:16:19.298958+0000","last_clean":"2023-07-09T02:16:19.298958+0000","last_became_active":"2023-07-09T02:16:17.132283+0000","last_became_peered":"2023-07-09T02:16:17.132283+0000","last_unstale":"2023-07-09T02:16:19.298958+0000","last_undegraded":"2023-07-09T02:16:19.298958+0000","last_fullsized":"2023-07-09T02:16:19.298958+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:42.020109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130177+0000","last_change":"2023-07-09T02:16:18.139552+0000","last_active":"2023-07-09T02:16:19.130177+0000","last_peered":"2023-07-09T02:16:19.130177+0000","last_clean":"2023-07-09T02:16:19.130177+0000","last_became_active":"2023-07-09T02:16:18.139323+0000","last_became_peered":"2023-07-09T02:16:18.139323+0000","last_unstale":"2023-07-09T02:16:19.130177+0000","last_undegraded":"2023-07-09T02:16:19.130177+0000","last_fullsized":"2023-07-09T02:16:19.130177+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:03:22.836532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127513+0000","last_change":"2023-07-09T02:16:17.132552+0000","last_active":"2023-07-09T02:16:19.127513+0000","last_peered":"2023-07-09T02:16:19.127513+0000","last_clean":"2023-07-09T02:16:19.127513+0000","last_became_active":"2023-07-09T02:16:17.132066+0000","last_became_peered":"2023-07-09T02:16:17.132066+0000","last_unstale":"2023-07-09T02:16:19.127513+0000","last_undegraded":"2023-07-09T02:16:19.127513+0000","last_fullsized":"2023-07-09T02:16:19.127513+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:09:10.803739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299190+0000","last_change":"2023-07-09T02:16:18.142629+0000","last_active":"2023-07-09T02:16:19.299190+0000","last_peered":"2023-07-09T02:16:19.299190+0000","last_clean":"2023-07-09T02:16:19.299190+0000","last_became_active":"2023-07-09T02:16:18.142394+0000","last_became_peered":"2023-07-09T02:16:18.142394+0000","last_unstale":"2023-07-09T02:16:19.299190+0000","last_undegraded":"2023-07-09T02:16:19.299190+0000","last_fullsized":"2023-07-09T02:16:19.299190+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:18:41.554042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299536+0000","last_change":"2023-07-09T02:16:17.137499+0000","last_active":"2023-07-09T02:16:19.299536+0000","last_peered":"2023-07-09T02:16:19.299536+0000","last_clean":"2023-07-09T02:16:19.299536+0000","last_became_active":"2023-07-09T02:16:17.136972+0000","last_became_peered":"2023-07-09T02:16:17.136972+0000","last_unstale":"2023-07-09T02:16:19.299536+0000","last_undegraded":"2023-07-09T02:16:19.299536+0000","last_fullsized":"2023-07-09T02:16:19.299536+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:24.910941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.129952+0000","last_change":"2023-07-09T02:16:18.141227+0000","last_active":"2023-07-09T02:16:19.129952+0000","last_peered":"2023-07-09T02:16:19.129952+0000","last_clean":"2023-07-09T02:16:19.129952+0000","last_became_active":"2023-07-09T02:16:18.140941+0000","last_became_peered":"2023-07-09T02:16:18.140941+0000","last_unstale":"2023-07-09T02:16:19.129952+0000","last_undegraded":"2023-07-09T02:16:19.129952+0000","last_fullsized":"2023-07-09T02:16:19.129952+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:15:43.616259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299023+0000","last_change":"2023-07-09T02:16:17.134659+0000","last_active":"2023-07-09T02:16:19.299023+0000","last_peered":"2023-07-09T02:16:19.299023+0000","last_clean":"2023-07-09T02:16:19.299023+0000","last_became_active":"2023-07-09T02:16:17.134356+0000","last_became_peered":"2023-07-09T02:16:17.134356+0000","last_unstale":"2023-07-09T02:16:19.299023+0000","last_undegraded":"2023-07-09T02:16:19.299023+0000","last_fullsized":"2023-07-09T02:16:19.299023+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:01:16.792138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305455+0000","last_change":"2023-07-09T02:16:18.144423+0000","last_active":"2023-07-09T02:16:19.305455+0000","last_peered":"2023-07-09T02:16:19.305455+0000","last_clean":"2023-07-09T02:16:19.305455+0000","last_became_active":"2023-07-09T02:16:18.143805+0000","last_became_peered":"2023-07-09T02:16:18.143805+0000","last_unstale":"2023-07-09T02:16:19.305455+0000","last_undegraded":"2023-07-09T02:16:19.305455+0000","last_fullsized":"2023-07-09T02:16:19.305455+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:23:17.096179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127548+0000","last_change":"2023-07-09T02:16:17.131988+0000","last_active":"2023-07-09T02:16:19.127548+0000","last_peered":"2023-07-09T02:16:19.127548+0000","last_clean":"2023-07-09T02:16:19.127548+0000","last_became_active":"2023-07-09T02:16:17.131769+0000","last_became_peered":"2023-07-09T02:16:17.131769+0000","last_unstale":"2023-07-09T02:16:19.127548+0000","last_undegraded":"2023-07-09T02:16:19.127548+0000","last_fullsized":"2023-07-09T02:16:19.127548+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:37:00.255221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299248+0000","last_change":"2023-07-09T02:16:18.136548+0000","last_active":"2023-07-09T02:16:19.299248+0000","last_peered":"2023-07-09T02:16:19.299248+0000","last_clean":"2023-07-09T02:16:19.299248+0000","last_became_active":"2023-07-09T02:16:18.136218+0000","last_became_peered":"2023-07-09T02:16:18.136218+0000","last_unstale":"2023-07-09T02:16:19.299248+0000","last_undegraded":"2023-07-09T02:16:19.299248+0000","last_fullsized":"2023-07-09T02:16:19.299248+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:13:54.647293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305428+0000","last_change":"2023-07-09T02:16:17.130362+0000","last_active":"2023-07-09T02:16:19.305428+0000","last_peered":"2023-07-09T02:16:19.305428+0000","last_clean":"2023-07-09T02:16:19.305428+0000","last_became_active":"2023-07-09T02:16:17.129945+0000","last_became_peered":"2023-07-09T02:16:17.129945+0000","last_unstale":"2023-07-09T02:16:19.305428+0000","last_undegraded":"2023-07-09T02:16:19.305428+0000","last_fullsized":"2023-07-09T02:16:19.305428+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:38:55.508874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130099+0000","last_change":"2023-07-09T02:16:18.143167+0000","last_active":"2023-07-09T02:16:19.130099+0000","last_peered":"2023-07-09T02:16:19.130099+0000","last_clean":"2023-07-09T02:16:19.130099+0000","last_became_active":"2023-07-09T02:16:18.142951+0000","last_became_peered":"2023-07-09T02:16:18.142951+0000","last_unstale":"2023-07-09T02:16:19.130099+0000","last_undegraded":"2023-07-09T02:16:19.130099+0000","last_fullsized":"2023-07-09T02:16:19.130099+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:32:08.985700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300077+0000","last_change":"2023-07-09T02:16:17.136371+0000","last_active":"2023-07-09T02:16:19.300077+0000","last_peered":"2023-07-09T02:16:19.300077+0000","last_clean":"2023-07-09T02:16:19.300077+0000","last_became_active":"2023-07-09T02:16:17.136140+0000","last_became_peered":"2023-07-09T02:16:17.136140+0000","last_unstale":"2023-07-09T02:16:19.300077+0000","last_undegraded":"2023-07-09T02:16:19.300077+0000","last_fullsized":"2023-07-09T02:16:19.300077+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:46.434628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305649+0000","last_change":"2023-07-09T02:16:18.143100+0000","last_active":"2023-07-09T02:16:19.305649+0000","last_peered":"2023-07-09T02:16:19.305649+0000","last_clean":"2023-07-09T02:16:19.305649+0000","last_became_active":"2023-07-09T02:16:18.142867+0000","last_became_peered":"2023-07-09T02:16:18.142867+0000","last_unstale":"2023-07-09T02:16:19.305649+0000","last_undegraded":"2023-07-09T02:16:19.305649+0000","last_fullsized":"2023-07-09T02:16:19.305649+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:31:16.034954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299273+0000","last_change":"2023-07-09T02:16:17.137185+0000","last_active":"2023-07-09T02:16:19.299273+0000","last_peered":"2023-07-09T02:16:19.299273+0000","last_clean":"2023-07-09T02:16:19.299273+0000","last_became_active":"2023-07-09T02:16:17.136325+0000","last_became_peered":"2023-07-09T02:16:17.136325+0000","last_unstale":"2023-07-09T02:16:19.299273+0000","last_undegraded":"2023-07-09T02:16:19.299273+0000","last_fullsized":"2023-07-09T02:16:19.299273+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:38:30.325364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127261+0000","last_change":"2023-07-09T02:16:18.138200+0000","last_active":"2023-07-09T02:16:19.127261+0000","last_peered":"2023-07-09T02:16:19.127261+0000","last_clean":"2023-07-09T02:16:19.127261+0000","last_became_active":"2023-07-09T02:16:18.137981+0000","last_became_peered":"2023-07-09T02:16:18.137981+0000","last_unstale":"2023-07-09T02:16:19.127261+0000","last_undegraded":"2023-07-09T02:16:19.127261+0000","last_fullsized":"2023-07-09T02:16:19.127261+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:32:02.152350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128909+0000","last_change":"2023-07-09T02:16:17.130368+0000","last_active":"2023-07-09T02:16:19.128909+0000","last_peered":"2023-07-09T02:16:19.128909+0000","last_clean":"2023-07-09T02:16:19.128909+0000","last_became_active":"2023-07-09T02:16:17.130138+0000","last_became_peered":"2023-07-09T02:16:17.130138+0000","last_unstale":"2023-07-09T02:16:19.128909+0000","last_undegraded":"2023-07-09T02:16:19.128909+0000","last_fullsized":"2023-07-09T02:16:19.128909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:11:50.898400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299711+0000","last_change":"2023-07-09T02:16:18.139427+0000","last_active":"2023-07-09T02:16:19.299711+0000","last_peered":"2023-07-09T02:16:19.299711+0000","last_clean":"2023-07-09T02:16:19.299711+0000","last_became_active":"2023-07-09T02:16:18.139176+0000","last_became_peered":"2023-07-09T02:16:18.139176+0000","last_unstale":"2023-07-09T02:16:19.299711+0000","last_undegraded":"2023-07-09T02:16:19.299711+0000","last_fullsized":"2023-07-09T02:16:19.299711+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:37:51.175888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300148+0000","last_change":"2023-07-09T02:16:17.133091+0000","last_active":"2023-07-09T02:16:19.300148+0000","last_peered":"2023-07-09T02:16:19.300148+0000","last_clean":"2023-07-09T02:16:19.300148+0000","last_became_active":"2023-07-09T02:16:17.132705+0000","last_became_peered":"2023-07-09T02:16:17.132705+0000","last_unstale":"2023-07-09T02:16:19.300148+0000","last_undegraded":"2023-07-09T02:16:19.300148+0000","last_fullsized":"2023-07-09T02:16:19.300148+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:15.057620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300079+0000","last_change":"2023-07-09T02:16:18.131922+0000","last_active":"2023-07-09T02:16:19.300079+0000","last_peered":"2023-07-09T02:16:19.300079+0000","last_clean":"2023-07-09T02:16:19.300079+0000","last_became_active":"2023-07-09T02:16:18.131703+0000","last_became_peered":"2023-07-09T02:16:18.131703+0000","last_unstale":"2023-07-09T02:16:19.300079+0000","last_undegraded":"2023-07-09T02:16:19.300079+0000","last_fullsized":"2023-07-09T02:16:19.300079+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:04:55.436786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127176+0000","last_change":"2023-07-09T02:16:17.131447+0000","last_active":"2023-07-09T02:16:19.127176+0000","last_peered":"2023-07-09T02:16:19.127176+0000","last_clean":"2023-07-09T02:16:19.127176+0000","last_became_active":"2023-07-09T02:16:17.131168+0000","last_became_peered":"2023-07-09T02:16:17.131168+0000","last_unstale":"2023-07-09T02:16:19.127176+0000","last_undegraded":"2023-07-09T02:16:19.127176+0000","last_fullsized":"2023-07-09T02:16:19.127176+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:22:31.441660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305335+0000","last_change":"2023-07-09T02:16:18.141060+0000","last_active":"2023-07-09T02:16:19.305335+0000","last_peered":"2023-07-09T02:16:19.305335+0000","last_clean":"2023-07-09T02:16:19.305335+0000","last_became_active":"2023-07-09T02:16:18.140842+0000","last_became_peered":"2023-07-09T02:16:18.140842+0000","last_unstale":"2023-07-09T02:16:19.305335+0000","last_undegraded":"2023-07-09T02:16:19.305335+0000","last_fullsized":"2023-07-09T02:16:19.305335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:23:45.399633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"105'6","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130065+0000","last_change":"2023-07-09T02:16:17.132694+0000","last_active":"2023-07-09T02:16:19.130065+0000","last_peered":"2023-07-09T02:16:19.130065+0000","last_clean":"2023-07-09T02:16:19.130065+0000","last_became_active":"2023-07-09T02:16:17.132460+0000","last_became_peered":"2023-07-09T02:16:17.132460+0000","last_unstale":"2023-07-09T02:16:19.130065+0000","last_undegraded":"2023-07-09T02:16:19.130065+0000","last_fullsized":"2023-07-09T02:16:19.130065+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:22:23.771453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305811+0000","last_change":"2023-07-09T02:16:18.149007+0000","last_active":"2023-07-09T02:16:19.305811+0000","last_peered":"2023-07-09T02:16:19.305811+0000","last_clean":"2023-07-09T02:16:19.305811+0000","last_became_active":"2023-07-09T02:16:18.146265+0000","last_became_peered":"2023-07-09T02:16:18.146265+0000","last_unstale":"2023-07-09T02:16:19.305811+0000","last_undegraded":"2023-07-09T02:16:19.305811+0000","last_fullsized":"2023-07-09T02:16:19.305811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:34:10.364678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299422+0000","last_change":"2023-07-09T02:16:17.137356+0000","last_active":"2023-07-09T02:16:19.299422+0000","last_peered":"2023-07-09T02:16:19.299422+0000","last_clean":"2023-07-09T02:16:19.299422+0000","last_became_active":"2023-07-09T02:16:17.136640+0000","last_became_peered":"2023-07-09T02:16:17.136640+0000","last_unstale":"2023-07-09T02:16:19.299422+0000","last_undegraded":"2023-07-09T02:16:19.299422+0000","last_fullsized":"2023-07-09T02:16:19.299422+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:00:43.449540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127193+0000","last_change":"2023-07-09T02:16:18.135515+0000","last_active":"2023-07-09T02:16:19.127193+0000","last_peered":"2023-07-09T02:16:19.127193+0000","last_clean":"2023-07-09T02:16:19.127193+0000","last_became_active":"2023-07-09T02:16:18.135272+0000","last_became_peered":"2023-07-09T02:16:18.135272+0000","last_unstale":"2023-07-09T02:16:19.127193+0000","last_undegraded":"2023-07-09T02:16:19.127193+0000","last_fullsized":"2023-07-09T02:16:19.127193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:40:23.957310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130498+0000","last_change":"2023-07-09T02:16:17.130224+0000","last_active":"2023-07-09T02:16:19.130498+0000","last_peered":"2023-07-09T02:16:19.130498+0000","last_clean":"2023-07-09T02:16:19.130498+0000","last_became_active":"2023-07-09T02:16:17.129865+0000","last_became_peered":"2023-07-09T02:16:17.129865+0000","last_unstale":"2023-07-09T02:16:19.130498+0000","last_undegraded":"2023-07-09T02:16:19.130498+0000","last_fullsized":"2023-07-09T02:16:19.130498+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:22:07.072392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305322+0000","last_change":"2023-07-09T02:16:18.142021+0000","last_active":"2023-07-09T02:16:19.305322+0000","last_peered":"2023-07-09T02:16:19.305322+0000","last_clean":"2023-07-09T02:16:19.305322+0000","last_became_active":"2023-07-09T02:16:18.141800+0000","last_became_peered":"2023-07-09T02:16:18.141800+0000","last_unstale":"2023-07-09T02:16:19.305322+0000","last_undegraded":"2023-07-09T02:16:19.305322+0000","last_fullsized":"2023-07-09T02:16:19.305322+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:39:47.680729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305758+0000","last_change":"2023-07-09T02:16:17.135464+0000","last_active":"2023-07-09T02:16:19.305758+0000","last_peered":"2023-07-09T02:16:19.305758+0000","last_clean":"2023-07-09T02:16:19.305758+0000","last_became_active":"2023-07-09T02:16:17.135016+0000","last_became_peered":"2023-07-09T02:16:17.135016+0000","last_unstale":"2023-07-09T02:16:19.305758+0000","last_undegraded":"2023-07-09T02:16:19.305758+0000","last_fullsized":"2023-07-09T02:16:19.305758+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:35:27.973342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305973+0000","last_change":"2023-07-09T02:16:18.142303+0000","last_active":"2023-07-09T02:16:19.305973+0000","last_peered":"2023-07-09T02:16:19.305973+0000","last_clean":"2023-07-09T02:16:19.305973+0000","last_became_active":"2023-07-09T02:16:18.141742+0000","last_became_peered":"2023-07-09T02:16:18.141742+0000","last_unstale":"2023-07-09T02:16:19.305973+0000","last_undegraded":"2023-07-09T02:16:19.305973+0000","last_fullsized":"2023-07-09T02:16:19.305973+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:38:34.570839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"105'8","reported_seq":21,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305692+0000","last_change":"2023-07-09T02:16:17.130219+0000","last_active":"2023-07-09T02:16:19.305692+0000","last_peered":"2023-07-09T02:16:19.305692+0000","last_clean":"2023-07-09T02:16:19.305692+0000","last_became_active":"2023-07-09T02:16:17.129189+0000","last_became_peered":"2023-07-09T02:16:17.129189+0000","last_unstale":"2023-07-09T02:16:19.305692+0000","last_undegraded":"2023-07-09T02:16:19.305692+0000","last_fullsized":"2023-07-09T02:16:19.305692+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:00.633093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299035+0000","last_change":"2023-07-09T02:16:18.137794+0000","last_active":"2023-07-09T02:16:19.299035+0000","last_peered":"2023-07-09T02:16:19.299035+0000","last_clean":"2023-07-09T02:16:19.299035+0000","last_became_active":"2023-07-09T02:16:18.137554+0000","last_became_peered":"2023-07-09T02:16:18.137554+0000","last_unstale":"2023-07-09T02:16:19.299035+0000","last_undegraded":"2023-07-09T02:16:19.299035+0000","last_fullsized":"2023-07-09T02:16:19.299035+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:47.442131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299099+0000","last_change":"2023-07-09T02:16:17.136837+0000","last_active":"2023-07-09T02:16:19.299099+0000","last_peered":"2023-07-09T02:16:19.299099+0000","last_clean":"2023-07-09T02:16:19.299099+0000","last_became_active":"2023-07-09T02:16:17.136578+0000","last_became_peered":"2023-07-09T02:16:17.136578+0000","last_unstale":"2023-07-09T02:16:19.299099+0000","last_undegraded":"2023-07-09T02:16:19.299099+0000","last_fullsized":"2023-07-09T02:16:19.299099+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:18:52.857554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.129932+0000","last_change":"2023-07-09T02:16:18.138571+0000","last_active":"2023-07-09T02:16:19.129932+0000","last_peered":"2023-07-09T02:16:19.129932+0000","last_clean":"2023-07-09T02:16:19.129932+0000","last_became_active":"2023-07-09T02:16:18.138346+0000","last_became_peered":"2023-07-09T02:16:18.138346+0000","last_unstale":"2023-07-09T02:16:19.129932+0000","last_undegraded":"2023-07-09T02:16:19.129932+0000","last_fullsized":"2023-07-09T02:16:19.129932+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:06:06.215524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127291+0000","last_change":"2023-07-09T02:16:17.128301+0000","last_active":"2023-07-09T02:16:19.127291+0000","last_peered":"2023-07-09T02:16:19.127291+0000","last_clean":"2023-07-09T02:16:19.127291+0000","last_became_active":"2023-07-09T02:16:17.128059+0000","last_became_peered":"2023-07-09T02:16:17.128059+0000","last_unstale":"2023-07-09T02:16:19.127291+0000","last_undegraded":"2023-07-09T02:16:19.127291+0000","last_fullsized":"2023-07-09T02:16:19.127291+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:45:37.934831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130439+0000","last_change":"2023-07-09T02:16:18.135593+0000","last_active":"2023-07-09T02:16:19.130439+0000","last_peered":"2023-07-09T02:16:19.130439+0000","last_clean":"2023-07-09T02:16:19.130439+0000","last_became_active":"2023-07-09T02:16:18.135046+0000","last_became_peered":"2023-07-09T02:16:18.135046+0000","last_unstale":"2023-07-09T02:16:19.130439+0000","last_undegraded":"2023-07-09T02:16:19.130439+0000","last_fullsized":"2023-07-09T02:16:19.130439+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:39:18.786406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127847+0000","last_change":"2023-07-09T02:16:17.132406+0000","last_active":"2023-07-09T02:16:19.127847+0000","last_peered":"2023-07-09T02:16:19.127847+0000","last_clean":"2023-07-09T02:16:19.127847+0000","last_became_active":"2023-07-09T02:16:17.131466+0000","last_became_peered":"2023-07-09T02:16:17.131466+0000","last_unstale":"2023-07-09T02:16:19.127847+0000","last_undegraded":"2023-07-09T02:16:19.127847+0000","last_fullsized":"2023-07-09T02:16:19.127847+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:26:44.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128320+0000","last_change":"2023-07-09T02:16:18.132919+0000","last_active":"2023-07-09T02:16:19.128320+0000","last_peered":"2023-07-09T02:16:19.128320+0000","last_clean":"2023-07-09T02:16:19.128320+0000","last_became_active":"2023-07-09T02:16:18.132684+0000","last_became_peered":"2023-07-09T02:16:18.132684+0000","last_unstale":"2023-07-09T02:16:19.128320+0000","last_undegraded":"2023-07-09T02:16:19.128320+0000","last_fullsized":"2023-07-09T02:16:19.128320+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:03:22.836532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299156+0000","last_change":"2023-07-09T02:16:17.134764+0000","last_active":"2023-07-09T02:16:19.299156+0000","last_peered":"2023-07-09T02:16:19.299156+0000","last_clean":"2023-07-09T02:16:19.299156+0000","last_became_active":"2023-07-09T02:16:17.134522+0000","last_became_peered":"2023-07-09T02:16:17.134522+0000","last_unstale":"2023-07-09T02:16:19.299156+0000","last_undegraded":"2023-07-09T02:16:19.299156+0000","last_fullsized":"2023-07-09T02:16:19.299156+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:15.057620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305042+0000","last_change":"2023-07-09T02:16:18.135121+0000","last_active":"2023-07-09T02:16:19.305042+0000","last_peered":"2023-07-09T02:16:19.305042+0000","last_clean":"2023-07-09T02:16:19.305042+0000","last_became_active":"2023-07-09T02:16:18.134903+0000","last_became_peered":"2023-07-09T02:16:18.134903+0000","last_unstale":"2023-07-09T02:16:19.305042+0000","last_undegraded":"2023-07-09T02:16:19.305042+0000","last_fullsized":"2023-07-09T02:16:19.305042+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:55:47.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130571+0000","last_change":"2023-07-09T02:16:17.130085+0000","last_active":"2023-07-09T02:16:19.130571+0000","last_peered":"2023-07-09T02:16:19.130571+0000","last_clean":"2023-07-09T02:16:19.130571+0000","last_became_active":"2023-07-09T02:16:17.129571+0000","last_became_peered":"2023-07-09T02:16:17.129571+0000","last_unstale":"2023-07-09T02:16:19.130571+0000","last_undegraded":"2023-07-09T02:16:19.130571+0000","last_fullsized":"2023-07-09T02:16:19.130571+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:44.013348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299919+0000","last_change":"2023-07-09T02:16:18.142267+0000","last_active":"2023-07-09T02:16:19.299919+0000","last_peered":"2023-07-09T02:16:19.299919+0000","last_clean":"2023-07-09T02:16:19.299919+0000","last_became_active":"2023-07-09T02:16:18.142050+0000","last_became_peered":"2023-07-09T02:16:18.142050+0000","last_unstale":"2023-07-09T02:16:19.299919+0000","last_undegraded":"2023-07-09T02:16:19.299919+0000","last_fullsized":"2023-07-09T02:16:19.299919+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:55:04.216485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128504+0000","last_change":"2023-07-09T02:16:17.129119+0000","last_active":"2023-07-09T02:16:19.128504+0000","last_peered":"2023-07-09T02:16:19.128504+0000","last_clean":"2023-07-09T02:16:19.128504+0000","last_became_active":"2023-07-09T02:16:17.128705+0000","last_became_peered":"2023-07-09T02:16:17.128705+0000","last_unstale":"2023-07-09T02:16:19.128504+0000","last_undegraded":"2023-07-09T02:16:19.128504+0000","last_fullsized":"2023-07-09T02:16:19.128504+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:14:36.957175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299075+0000","last_change":"2023-07-09T02:16:18.141994+0000","last_active":"2023-07-09T02:16:19.299075+0000","last_peered":"2023-07-09T02:16:19.299075+0000","last_clean":"2023-07-09T02:16:19.299075+0000","last_became_active":"2023-07-09T02:16:18.141731+0000","last_became_peered":"2023-07-09T02:16:18.141731+0000","last_unstale":"2023-07-09T02:16:19.299075+0000","last_undegraded":"2023-07-09T02:16:19.299075+0000","last_fullsized":"2023-07-09T02:16:19.299075+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:04:55.436786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299102+0000","last_change":"2023-07-09T02:16:17.134981+0000","last_active":"2023-07-09T02:16:19.299102+0000","last_peered":"2023-07-09T02:16:19.299102+0000","last_clean":"2023-07-09T02:16:19.299102+0000","last_became_active":"2023-07-09T02:16:17.134724+0000","last_became_peered":"2023-07-09T02:16:17.134724+0000","last_unstale":"2023-07-09T02:16:19.299102+0000","last_undegraded":"2023-07-09T02:16:19.299102+0000","last_fullsized":"2023-07-09T02:16:19.299102+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:10:16.221241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130385+0000","last_change":"2023-07-09T02:16:18.137384+0000","last_active":"2023-07-09T02:16:19.130385+0000","last_peered":"2023-07-09T02:16:19.130385+0000","last_clean":"2023-07-09T02:16:19.130385+0000","last_became_active":"2023-07-09T02:16:18.134671+0000","last_became_peered":"2023-07-09T02:16:18.134671+0000","last_unstale":"2023-07-09T02:16:19.130385+0000","last_undegraded":"2023-07-09T02:16:19.130385+0000","last_fullsized":"2023-07-09T02:16:19.130385+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:52.003565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299324+0000","last_change":"2023-07-09T02:16:17.136536+0000","last_active":"2023-07-09T02:16:19.299324+0000","last_peered":"2023-07-09T02:16:19.299324+0000","last_clean":"2023-07-09T02:16:19.299324+0000","last_became_active":"2023-07-09T02:16:17.136283+0000","last_became_peered":"2023-07-09T02:16:17.136283+0000","last_unstale":"2023-07-09T02:16:19.299324+0000","last_undegraded":"2023-07-09T02:16:19.299324+0000","last_fullsized":"2023-07-09T02:16:19.299324+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:48:02.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299828+0000","last_change":"2023-07-09T02:16:18.141555+0000","last_active":"2023-07-09T02:16:19.299828+0000","last_peered":"2023-07-09T02:16:19.299828+0000","last_clean":"2023-07-09T02:16:19.299828+0000","last_became_active":"2023-07-09T02:16:18.141385+0000","last_became_peered":"2023-07-09T02:16:18.141385+0000","last_unstale":"2023-07-09T02:16:19.299828+0000","last_undegraded":"2023-07-09T02:16:19.299828+0000","last_fullsized":"2023-07-09T02:16:19.299828+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:08:57.898119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305916+0000","last_change":"2023-07-09T02:16:17.127099+0000","last_active":"2023-07-09T02:16:19.305916+0000","last_peered":"2023-07-09T02:16:19.305916+0000","last_clean":"2023-07-09T02:16:19.305916+0000","last_became_active":"2023-07-09T02:16:17.126861+0000","last_became_peered":"2023-07-09T02:16:17.126861+0000","last_unstale":"2023-07-09T02:16:19.305916+0000","last_undegraded":"2023-07-09T02:16:19.305916+0000","last_fullsized":"2023-07-09T02:16:19.305916+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:29:07.726475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":317,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299911+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:16:19.299911+0000","last_peered":"2023-07-09T02:16:19.299911+0000","last_clean":"2023-07-09T02:16:19.299911+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:16:19.299911+0000","last_undegraded":"2023-07-09T02:16:19.299911+0000","last_fullsized":"2023-07-09T02:16:19.299911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:26:40.593032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":179,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128984+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:16:19.128984+0000","last_peered":"2023-07-09T02:16:19.128984+0000","last_clean":"2023-07-09T02:16:19.128984+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:16:19.128984+0000","last_undegraded":"2023-07-09T02:16:19.128984+0000","last_fullsized":"2023-07-09T02:16:19.128984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:17:02.068112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130194+0000","last_change":"2023-07-09T02:16:18.137856+0000","last_active":"2023-07-09T02:16:19.130194+0000","last_peered":"2023-07-09T02:16:19.130194+0000","last_clean":"2023-07-09T02:16:19.130194+0000","last_became_active":"2023-07-09T02:16:18.137375+0000","last_became_peered":"2023-07-09T02:16:18.137375+0000","last_unstale":"2023-07-09T02:16:19.130194+0000","last_undegraded":"2023-07-09T02:16:19.130194+0000","last_fullsized":"2023-07-09T02:16:19.130194+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:14:37.964678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299463+0000","last_change":"2023-07-09T02:16:17.135471+0000","last_active":"2023-07-09T02:16:19.299463+0000","last_peered":"2023-07-09T02:16:19.299463+0000","last_clean":"2023-07-09T02:16:19.299463+0000","last_became_active":"2023-07-09T02:16:17.134737+0000","last_became_peered":"2023-07-09T02:16:17.134737+0000","last_unstale":"2023-07-09T02:16:19.299463+0000","last_undegraded":"2023-07-09T02:16:19.299463+0000","last_fullsized":"2023-07-09T02:16:19.299463+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:35:16.852275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299672+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:16:19.299672+0000","last_peered":"2023-07-09T02:16:19.299672+0000","last_clean":"2023-07-09T02:16:19.299672+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:16:19.299672+0000","last_undegraded":"2023-07-09T02:16:19.299672+0000","last_fullsized":"2023-07-09T02:16:19.299672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:55:01.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.298860+0000","last_change":"2023-07-09T02:16:18.138138+0000","last_active":"2023-07-09T02:16:19.298860+0000","last_peered":"2023-07-09T02:16:19.298860+0000","last_clean":"2023-07-09T02:16:19.298860+0000","last_became_active":"2023-07-09T02:16:18.137939+0000","last_became_peered":"2023-07-09T02:16:18.137939+0000","last_unstale":"2023-07-09T02:16:19.298860+0000","last_undegraded":"2023-07-09T02:16:19.298860+0000","last_fullsized":"2023-07-09T02:16:19.298860+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:55:04.216485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299629+0000","last_change":"2023-07-09T02:16:17.136084+0000","last_active":"2023-07-09T02:16:19.299629+0000","last_peered":"2023-07-09T02:16:19.299629+0000","last_clean":"2023-07-09T02:16:19.299629+0000","last_became_active":"2023-07-09T02:16:17.135853+0000","last_became_peered":"2023-07-09T02:16:17.135853+0000","last_unstale":"2023-07-09T02:16:19.299629+0000","last_undegraded":"2023-07-09T02:16:19.299629+0000","last_fullsized":"2023-07-09T02:16:19.299629+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:09:19.595705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305257+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:16:19.305257+0000","last_peered":"2023-07-09T02:16:19.305257+0000","last_clean":"2023-07-09T02:16:19.305257+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:16:19.305257+0000","last_undegraded":"2023-07-09T02:16:19.305257+0000","last_fullsized":"2023-07-09T02:16:19.305257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:49:58.173986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127855+0000","last_change":"2023-07-09T02:16:18.136975+0000","last_active":"2023-07-09T02:16:19.127855+0000","last_peered":"2023-07-09T02:16:19.127855+0000","last_clean":"2023-07-09T02:16:19.127855+0000","last_became_active":"2023-07-09T02:16:18.136436+0000","last_became_peered":"2023-07-09T02:16:18.136436+0000","last_unstale":"2023-07-09T02:16:19.127855+0000","last_undegraded":"2023-07-09T02:16:19.127855+0000","last_fullsized":"2023-07-09T02:16:19.127855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:38:48.801372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127646+0000","last_change":"2023-07-09T02:16:17.132545+0000","last_active":"2023-07-09T02:16:19.127646+0000","last_peered":"2023-07-09T02:16:19.127646+0000","last_clean":"2023-07-09T02:16:19.127646+0000","last_became_active":"2023-07-09T02:16:17.131760+0000","last_became_peered":"2023-07-09T02:16:17.131760+0000","last_unstale":"2023-07-09T02:16:19.127646+0000","last_undegraded":"2023-07-09T02:16:19.127646+0000","last_fullsized":"2023-07-09T02:16:19.127646+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:30:54.714727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":179,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128599+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:16:19.128599+0000","last_peered":"2023-07-09T02:16:19.128599+0000","last_clean":"2023-07-09T02:16:19.128599+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:16:19.128599+0000","last_undegraded":"2023-07-09T02:16:19.128599+0000","last_fullsized":"2023-07-09T02:16:19.128599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:03:51.863322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130195+0000","last_change":"2023-07-09T02:16:18.146278+0000","last_active":"2023-07-09T02:16:19.130195+0000","last_peered":"2023-07-09T02:16:19.130195+0000","last_clean":"2023-07-09T02:16:19.130195+0000","last_became_active":"2023-07-09T02:16:18.145573+0000","last_became_peered":"2023-07-09T02:16:18.145573+0000","last_unstale":"2023-07-09T02:16:19.130195+0000","last_undegraded":"2023-07-09T02:16:19.130195+0000","last_fullsized":"2023-07-09T02:16:19.130195+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:08:57.875104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128306+0000","last_change":"2023-07-09T02:16:17.129060+0000","last_active":"2023-07-09T02:16:19.128306+0000","last_peered":"2023-07-09T02:16:19.128306+0000","last_clean":"2023-07-09T02:16:19.128306+0000","last_became_active":"2023-07-09T02:16:17.128762+0000","last_became_peered":"2023-07-09T02:16:17.128762+0000","last_unstale":"2023-07-09T02:16:19.128306+0000","last_undegraded":"2023-07-09T02:16:19.128306+0000","last_fullsized":"2023-07-09T02:16:19.128306+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:32:07.978197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305533+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:16:19.305533+0000","last_peered":"2023-07-09T02:16:19.305533+0000","last_clean":"2023-07-09T02:16:19.305533+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:16:19.305533+0000","last_undegraded":"2023-07-09T02:16:19.305533+0000","last_fullsized":"2023-07-09T02:16:19.305533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:33.234615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128769+0000","last_change":"2023-07-09T02:16:18.128955+0000","last_active":"2023-07-09T02:16:19.128769+0000","last_peered":"2023-07-09T02:16:19.128769+0000","last_clean":"2023-07-09T02:16:19.128769+0000","last_became_active":"2023-07-09T02:16:18.128767+0000","last_became_peered":"2023-07-09T02:16:18.128767+0000","last_unstale":"2023-07-09T02:16:19.128769+0000","last_undegraded":"2023-07-09T02:16:19.128769+0000","last_fullsized":"2023-07-09T02:16:19.128769+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:09:24.114793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305165+0000","last_change":"2023-07-09T02:16:17.131065+0000","last_active":"2023-07-09T02:16:19.305165+0000","last_peered":"2023-07-09T02:16:19.305165+0000","last_clean":"2023-07-09T02:16:19.305165+0000","last_became_active":"2023-07-09T02:16:17.130818+0000","last_became_peered":"2023-07-09T02:16:17.130818+0000","last_unstale":"2023-07-09T02:16:19.305165+0000","last_undegraded":"2023-07-09T02:16:19.305165+0000","last_fullsized":"2023-07-09T02:16:19.305165+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:56:19.312740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299471+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:16:19.299471+0000","last_peered":"2023-07-09T02:16:19.299471+0000","last_clean":"2023-07-09T02:16:19.299471+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:16:19.299471+0000","last_undegraded":"2023-07-09T02:16:19.299471+0000","last_fullsized":"2023-07-09T02:16:19.299471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:39:05.250361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128230+0000","last_change":"2023-07-09T02:16:18.139819+0000","last_active":"2023-07-09T02:16:19.128230+0000","last_peered":"2023-07-09T02:16:19.128230+0000","last_clean":"2023-07-09T02:16:19.128230+0000","last_became_active":"2023-07-09T02:16:18.139551+0000","last_became_peered":"2023-07-09T02:16:18.139551+0000","last_unstale":"2023-07-09T02:16:19.128230+0000","last_undegraded":"2023-07-09T02:16:19.128230+0000","last_fullsized":"2023-07-09T02:16:19.128230+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:20:56.684376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128836+0000","last_change":"2023-07-09T02:16:17.125676+0000","last_active":"2023-07-09T02:16:19.128836+0000","last_peered":"2023-07-09T02:16:19.128836+0000","last_clean":"2023-07-09T02:16:19.128836+0000","last_became_active":"2023-07-09T02:16:17.125408+0000","last_became_peered":"2023-07-09T02:16:17.125408+0000","last_unstale":"2023-07-09T02:16:19.128836+0000","last_undegraded":"2023-07-09T02:16:19.128836+0000","last_fullsized":"2023-07-09T02:16:19.128836+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:39:17.778903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305885+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:16:19.305885+0000","last_peered":"2023-07-09T02:16:19.305885+0000","last_clean":"2023-07-09T02:16:19.305885+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:16:19.305885+0000","last_undegraded":"2023-07-09T02:16:19.305885+0000","last_fullsized":"2023-07-09T02:16:19.305885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:12:09.937740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130311+0000","last_change":"2023-07-09T02:16:18.136498+0000","last_active":"2023-07-09T02:16:19.130311+0000","last_peered":"2023-07-09T02:16:19.130311+0000","last_clean":"2023-07-09T02:16:19.130311+0000","last_became_active":"2023-07-09T02:16:18.135374+0000","last_became_peered":"2023-07-09T02:16:18.135374+0000","last_unstale":"2023-07-09T02:16:19.130311+0000","last_undegraded":"2023-07-09T02:16:19.130311+0000","last_fullsized":"2023-07-09T02:16:19.130311+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:37:32.370659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305487+0000","last_change":"2023-07-09T02:16:17.132887+0000","last_active":"2023-07-09T02:16:19.305487+0000","last_peered":"2023-07-09T02:16:19.305487+0000","last_clean":"2023-07-09T02:16:19.305487+0000","last_became_active":"2023-07-09T02:16:17.132527+0000","last_became_peered":"2023-07-09T02:16:17.132527+0000","last_unstale":"2023-07-09T02:16:19.305487+0000","last_undegraded":"2023-07-09T02:16:19.305487+0000","last_fullsized":"2023-07-09T02:16:19.305487+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:06:23.524465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299288+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:16:19.299288+0000","last_peered":"2023-07-09T02:16:19.299288+0000","last_clean":"2023-07-09T02:16:19.299288+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:16:19.299288+0000","last_undegraded":"2023-07-09T02:16:19.299288+0000","last_fullsized":"2023-07-09T02:16:19.299288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:20.975752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1177,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194134,"statfs":{"total":200000000,"available":198794172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.204,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":1.423,"15min":1.423},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.032,"15min":0.80000000000000004},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.117,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.028,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.755},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.97899999999999998,"15min":0.80900000000000005},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93999999999999995,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.68000000000000005}]},{"osd":3,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84199999999999997,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.242,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.77300000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78600000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.38700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.94999999999999996,"5min":1.048,"15min":1.048},"last":0.42799999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.87,"5min":1.087,"15min":1.087},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.46700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":603,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.97499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70399999999999996,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86899999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88,"5min":1.165,"15min":1.165},"last":0.82399999999999995}]},{"osd":2,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71499999999999997,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.749}]},{"osd":3,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72699999999999998,"15min":0.70799999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88800000000000001,"5min":1.45,"15min":1.45},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.56000000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.72699999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88900000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.48699999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96799999999999997,"5min":1.117,"15min":1.117},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85699999999999998,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95599999999999996,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48999999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91000000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384596,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":1.179,"15min":1.179},"last":0.77600000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.65700000000000003},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67800000000000005,"15min":0.65200000000000002},"min":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80100000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69199999999999995}]},{"osd":2,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92400000000000004,"5min":1.103,"15min":1.103},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69799999999999995,"15min":0.68400000000000005},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89900000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71799999999999997,"15min":0.69499999999999995},"min":{"1min":0.52200000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.875,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.56299999999999994,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.60799999999999998},"min":{"1min":0.39400000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.88700000000000001,"5min":1.008,"15min":1.008},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.629},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89700000000000002,"5min":1.054,"15min":1.054},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.70299999999999996},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95599999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":1.091,"15min":1.091},"last":0.754}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":601,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384436,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":1.2529999999999999,"15min":0.85499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.89000000000000001,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65800000000000003,"15min":0.67400000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.873,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84199999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.008,"5min":1.323,"15min":1.323},"last":0.73599999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90600000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.518,"15min":0.94399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85899999999999999,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.94699999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.64700000000000002},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41099999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68000000000000005,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80500000000000005,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.70699999999999996},"min":{"1min":0.45200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.48799999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93899999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78200000000000003,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92700000000000005,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.58799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384596,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.26400000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.198,"15min":1.198},"last":0.439}]},{"osd":1,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":1.048,"15min":1.048},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.32500000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":1.155,"15min":1.155},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0229999999999999,"5min":1.302,"15min":1.302},"last":1.27},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75600000000000001,"15min":0.70599999999999996},"min":{"1min":0.56599999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.006,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.71899999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0940000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97799999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.56000000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0569999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.228,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.748}]},{"osd":7,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.58099999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1359999999999999,"5min":1.367,"15min":1.367},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.76900000000000002},"min":{"1min":0.67400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95299999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384596,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51600000000000001,"15min":0.432},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61099999999999999,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.57199999999999995,"5min":1.127,"15min":1.127},"last":0.51900000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.34100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60099999999999998,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.52100000000000002},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67600000000000005,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.44700000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.5},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57999999999999996,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81999999999999995,"15min":0.755},"min":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90100000000000002,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.627},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.161,"15min":1.161},"last":0.77900000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.72199999999999998},"min":{"1min":0.51100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.004,"5min":1.319,"15min":1.319},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.83399999999999996,"15min":0.77500000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94999999999999996,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79300000000000004,"15min":0.76600000000000001},"min":{"1min":0.60299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.075,"5min":1.101,"15min":1.101},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.82899999999999996,"15min":0.80800000000000005},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0580000000000001,"5min":1.452,"15min":1.452},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.754,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.056,"5min":1.208,"15min":1.208},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77400000000000002,"15min":0.77200000000000002},"min":{"1min":0.55300000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97099999999999997,"5min":1.351,"15min":1.351},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":601,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.46200000000000002},"min":{"1min":0.308,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54500000000000004}]},{"osd":2,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.501,"15min":0.496},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68600000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.621},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":1.163,"15min":1.163},"last":0.58899999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.026,"15min":1.026},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77800000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.745,"15min":0.72699999999999998},"min":{"1min":0.53400000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95999999999999996,"5min":1.034,"15min":1.034},"last":0.75800000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.80000000000000004,"15min":0.78100000000000003},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0900000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78000000000000003,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0229999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98199999999999998,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1179,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194132,"statfs":{"total":200000000,"available":198791958,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.41699999999999998},"min":{"1min":0.26300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.627,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.503,"15min":0.46700000000000003},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.36699999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59299999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47299999999999998,"15min":0.443},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.32800000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.443,"15min":0.41499999999999998},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60599999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.53900000000000003,"15min":0.502},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.626,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.145,"15min":1.145},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.153,"15min":1.153},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0669999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.504,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.238,"15min":1.238},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93899999999999995,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.53800000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0389999999999999,"5min":1.472,"15min":1.472},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54700000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98299999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.627}]}]}],"pool_statfs":[]}} 2023-07-09T02:16:22.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:16:22.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f0976d11640 1 Processor -- start 2023-07-09T02:16:22.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f0976d11640 1 -- start start 2023-07-09T02:16:22.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f0976d11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f097015c060 0x7f09700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f0976d11640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09700d2620 0x7f09700cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f0976d11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0970160a50 con 0x7f09700cd120 2023-07-09T02:16:22.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f0976d11640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097015c430 con 0x7f09700d2620 2023-07-09T02:16:22.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f0976d11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097015fb60 con 0x7f097015c060 2023-07-09T02:16:22.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f09752ae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09700d2620 0x7f09700cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f09752ae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09700d2620 0x7f09700cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49986/0 (socket says 172.21.15.45:49986) 2023-07-09T02:16:22.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f09752ae640 1 -- 172.21.15.45:0/600530509 learned_addr learned my addr 172.21.15.45:0/600530509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:22.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f0974aad640 1 --2- 172.21.15.45:0/600530509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f097015c060 0x7f09700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f09752ae640 1 -- 172.21.15.45:0/600530509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f097015c060 msgr2=0x7f09700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:22.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f09752ae640 1 --2- 172.21.15.45:0/600530509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f097015c060 0x7f09700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f09752ae640 1 -- 172.21.15.45:0/600530509 >> v1:172.21.15.155:6789/0 conn(0x7f09700cd120 legacy=0x7f09700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.433+0000 7f09752ae640 1 -- 172.21.15.45:0/600530509 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097015fe40 con 0x7f09700d2620 2023-07-09T02:16:22.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f09752ae640 1 --2- 172.21.15.45:0/600530509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f09700cee30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0968009e80 tx=0x7f096801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fff29b9f21cf24c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f096f7fe640 1 -- 172.21.15.45:0/600530509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09680a5880 con 0x7f09700d2620 2023-07-09T02:16:22.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f096f7fe640 1 -- 172.21.15.45:0/600530509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09680a59e0 con 0x7f09700d2620 2023-07-09T02:16:22.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f096f7fe640 1 -- 172.21.15.45:0/600530509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09680a5d70 con 0x7f09700d2620 2023-07-09T02:16:22.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f0976d11640 1 -- 172.21.15.45:0/600530509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 msgr2=0x7f09700cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f0976d11640 1 --2- 172.21.15.45:0/600530509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f09700cee30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0968009e80 tx=0x7f096801c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f0976d11640 1 -- 172.21.15.45:0/600530509 shutdown_connections 2023-07-09T02:16:22.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f0976d11640 1 --2- 172.21.15.45:0/600530509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f09700cee30 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f0976d11640 1 --2- 172.21.15.45:0/600530509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f097015c060 0x7f09700b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f0976d11640 1 -- 172.21.15.45:0/600530509 >> 172.21.15.45:0/600530509 conn(0x7f09700698e0 msgr2=0x7f0970069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:22.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f0976d11640 1 -- 172.21.15.45:0/600530509 shutdown_connections 2023-07-09T02:16:22.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.437+0000 7f0976d11640 1 -- 172.21.15.45:0/600530509 wait complete. 2023-07-09T02:16:22.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 Processor -- start 2023-07-09T02:16:22.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 -- start start 2023-07-09T02:16:22.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09700cd120 0x7f097015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f097015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f097015c060 0x7f0970151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0970152990 con 0x7f09700d2620 2023-07-09T02:16:22.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0970152c70 con 0x7f097015c060 2023-07-09T02:16:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0970152f50 con 0x7f09700cd120 2023-07-09T02:16:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f097015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f097015a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49992/0 (socket says 172.21.15.45:49992) 2023-07-09T02:16:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 -- 172.21.15.45:0/421163102 learned_addr learned my addr 172.21.15.45:0/421163102 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f09752ae640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f097015c060 0x7f0970151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0974aad640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09700cd120 0x7f097015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 -- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09700cd120 msgr2=0x7f097015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09700cd120 0x7f097015b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 -- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f097015c060 msgr2=0x7f0970151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f097015c060 0x7f0970151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 -- 172.21.15.45:0/421163102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0968009b30 con 0x7f09700d2620 2023-07-09T02:16:22.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f09752ae640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f097015c060 0x7f0970151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:22.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096ffff640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f097015a6e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c4d0 tx=0x7f095c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096d7fa640 1 -- 172.21.15.45:0/421163102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c0052d0 con 0x7f09700d2620 2023-07-09T02:16:22.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096d7fa640 1 -- 172.21.15.45:0/421163102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c005430 con 0x7f09700d2620 2023-07-09T02:16:22.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f096d7fa640 1 -- 172.21.15.45:0/421163102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c012830 con 0x7f09700d2620 2023-07-09T02:16:22.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09700b59f0 con 0x7f09700d2620 2023-07-09T02:16:22.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.441+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097015b7c0 con 0x7f09700d2620 2023-07-09T02:16:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.445+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0970153750 con 0x7f09700d2620 2023-07-09T02:16:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.445+0000 7f096d7fa640 1 -- 172.21.15.45:0/421163102 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f095c012990 con 0x7f09700d2620 2023-07-09T02:16:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.445+0000 7f096d7fa640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09540662b0 0x7f0954068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.445+0000 7f096d7fa640 1 -- 172.21.15.45:0/421163102 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f095c0838b0 con 0x7f09700d2620 2023-07-09T02:16:22.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.445+0000 7f0974aad640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09540662b0 0x7f0954068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.445+0000 7f0974aad640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09540662b0 0x7f0954068760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0964009a50 tx=0x7f0964008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.449+0000 7f096d7fa640 1 -- 172.21.15.45:0/421163102 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0970153750 con 0x7f09700d2620 2023-07-09T02:16:22.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.601+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0970152de0 con 0x7f09540662b0 2023-07-09T02:16:22.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.609+0000 7f096d7fa640 1 -- 172.21.15.45:0/421163102 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305860 (secure 0 0 0) 0x7f0970152de0 con 0x7f09540662b0 2023-07-09T02:16:22.613 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:16:22.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09540662b0 msgr2=0x7f0954068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09540662b0 0x7f0954068760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0964009a50 tx=0x7f0964008040 comp rx=0 tx=0).stop 2023-07-09T02:16:22.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 msgr2=0x7f097015a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f097015a6e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c4d0 tx=0x7f095c00c990 comp rx=0 tx=0).stop 2023-07-09T02:16:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 shutdown_connections 2023-07-09T02:16:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f097015c060 0x7f0970151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09700d2620 0x7f097015a6e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09540662b0 0x7f0954068760 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 --2- 172.21.15.45:0/421163102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09700cd120 0x7f097015b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 >> 172.21.15.45:0/421163102 conn(0x7f09700698e0 msgr2=0x7f09700b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 shutdown_connections 2023-07-09T02:16:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.613+0000 7f0976d11640 1 -- 172.21.15.45:0/421163102 wait complete. 2023-07-09T02:16:22.632 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2023-07-09T02:16:22.600629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5965,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556534,"statfs":{"total":1600000000,"available":1593891308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001384"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300094+0000","last_change":"2023-07-09T02:16:18.138809+0000","last_active":"2023-07-09T02:16:19.300094+0000","last_peered":"2023-07-09T02:16:19.300094+0000","last_clean":"2023-07-09T02:16:19.300094+0000","last_became_active":"2023-07-09T02:16:18.138297+0000","last_became_peered":"2023-07-09T02:16:18.138297+0000","last_unstale":"2023-07-09T02:16:19.300094+0000","last_undegraded":"2023-07-09T02:16:19.300094+0000","last_fullsized":"2023-07-09T02:16:19.300094+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:10:17.228744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128182+0000","last_change":"2023-07-09T02:16:18.132439+0000","last_active":"2023-07-09T02:16:19.128182+0000","last_peered":"2023-07-09T02:16:19.128182+0000","last_clean":"2023-07-09T02:16:19.128182+0000","last_became_active":"2023-07-09T02:16:18.132206+0000","last_became_peered":"2023-07-09T02:16:18.132206+0000","last_unstale":"2023-07-09T02:16:19.128182+0000","last_undegraded":"2023-07-09T02:16:19.128182+0000","last_fullsized":"2023-07-09T02:16:19.128182+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:22:24.778956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299807+0000","last_change":"2023-07-09T02:16:18.133760+0000","last_active":"2023-07-09T02:16:19.299807+0000","last_peered":"2023-07-09T02:16:19.299807+0000","last_clean":"2023-07-09T02:16:19.299807+0000","last_became_active":"2023-07-09T02:16:18.133538+0000","last_became_peered":"2023-07-09T02:16:18.133538+0000","last_unstale":"2023-07-09T02:16:19.299807+0000","last_undegraded":"2023-07-09T02:16:19.299807+0000","last_fullsized":"2023-07-09T02:16:19.299807+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:50:44.315343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305162+0000","last_change":"2023-07-09T02:16:18.144252+0000","last_active":"2023-07-09T02:16:19.305162+0000","last_peered":"2023-07-09T02:16:19.305162+0000","last_clean":"2023-07-09T02:16:19.305162+0000","last_became_active":"2023-07-09T02:16:18.143588+0000","last_became_peered":"2023-07-09T02:16:18.143588+0000","last_unstale":"2023-07-09T02:16:19.305162+0000","last_undegraded":"2023-07-09T02:16:19.305162+0000","last_fullsized":"2023-07-09T02:16:19.305162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:43:53.996868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127315+0000","last_change":"2023-07-09T02:16:18.137583+0000","last_active":"2023-07-09T02:16:19.127315+0000","last_peered":"2023-07-09T02:16:19.127315+0000","last_clean":"2023-07-09T02:16:19.127315+0000","last_became_active":"2023-07-09T02:16:18.137199+0000","last_became_peered":"2023-07-09T02:16:18.137199+0000","last_unstale":"2023-07-09T02:16:19.127315+0000","last_undegraded":"2023-07-09T02:16:19.127315+0000","last_fullsized":"2023-07-09T02:16:19.127315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:52:58.818942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130312+0000","last_change":"2023-07-09T02:16:18.146413+0000","last_active":"2023-07-09T02:16:19.130312+0000","last_peered":"2023-07-09T02:16:19.130312+0000","last_clean":"2023-07-09T02:16:19.130312+0000","last_became_active":"2023-07-09T02:16:18.145854+0000","last_became_peered":"2023-07-09T02:16:18.145854+0000","last_unstale":"2023-07-09T02:16:19.130312+0000","last_undegraded":"2023-07-09T02:16:19.130312+0000","last_fullsized":"2023-07-09T02:16:19.130312+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:09:24.114793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.298960+0000","last_change":"2023-07-09T02:16:18.142962+0000","last_active":"2023-07-09T02:16:19.298960+0000","last_peered":"2023-07-09T02:16:19.298960+0000","last_clean":"2023-07-09T02:16:19.298960+0000","last_became_active":"2023-07-09T02:16:18.142774+0000","last_became_peered":"2023-07-09T02:16:18.142774+0000","last_unstale":"2023-07-09T02:16:19.298960+0000","last_undegraded":"2023-07-09T02:16:19.298960+0000","last_fullsized":"2023-07-09T02:16:19.298960+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:40:10.223063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305091+0000","last_change":"2023-07-09T02:16:18.148509+0000","last_active":"2023-07-09T02:16:19.305091+0000","last_peered":"2023-07-09T02:16:19.305091+0000","last_clean":"2023-07-09T02:16:19.305091+0000","last_became_active":"2023-07-09T02:16:18.145679+0000","last_became_peered":"2023-07-09T02:16:18.145679+0000","last_unstale":"2023-07-09T02:16:19.305091+0000","last_undegraded":"2023-07-09T02:16:19.305091+0000","last_fullsized":"2023-07-09T02:16:19.305091+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:51:22.354344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.126981+0000","last_change":"2023-07-09T02:16:18.133864+0000","last_active":"2023-07-09T02:16:19.126981+0000","last_peered":"2023-07-09T02:16:19.126981+0000","last_clean":"2023-07-09T02:16:19.126981+0000","last_became_active":"2023-07-09T02:16:18.133519+0000","last_became_peered":"2023-07-09T02:16:18.133519+0000","last_unstale":"2023-07-09T02:16:19.126981+0000","last_undegraded":"2023-07-09T02:16:19.126981+0000","last_fullsized":"2023-07-09T02:16:19.126981+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:50:32.187069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305813+0000","last_change":"2023-07-09T02:16:18.142500+0000","last_active":"2023-07-09T02:16:19.305813+0000","last_peered":"2023-07-09T02:16:19.305813+0000","last_clean":"2023-07-09T02:16:19.305813+0000","last_became_active":"2023-07-09T02:16:18.142046+0000","last_became_peered":"2023-07-09T02:16:18.142046+0000","last_unstale":"2023-07-09T02:16:19.305813+0000","last_undegraded":"2023-07-09T02:16:19.305813+0000","last_fullsized":"2023-07-09T02:16:19.305813+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:44:03.333167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127315+0000","last_change":"2023-07-09T02:16:18.135522+0000","last_active":"2023-07-09T02:16:19.127315+0000","last_peered":"2023-07-09T02:16:19.127315+0000","last_clean":"2023-07-09T02:16:19.127315+0000","last_became_active":"2023-07-09T02:16:18.135117+0000","last_became_peered":"2023-07-09T02:16:18.135117+0000","last_unstale":"2023-07-09T02:16:19.127315+0000","last_undegraded":"2023-07-09T02:16:19.127315+0000","last_fullsized":"2023-07-09T02:16:19.127315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:27:05.243431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305425+0000","last_change":"2023-07-09T02:16:18.144805+0000","last_active":"2023-07-09T02:16:19.305425+0000","last_peered":"2023-07-09T02:16:19.305425+0000","last_clean":"2023-07-09T02:16:19.305425+0000","last_became_active":"2023-07-09T02:16:18.144498+0000","last_became_peered":"2023-07-09T02:16:18.144498+0000","last_unstale":"2023-07-09T02:16:19.305425+0000","last_undegraded":"2023-07-09T02:16:19.305425+0000","last_fullsized":"2023-07-09T02:16:19.305425+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:40:27.306659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305221+0000","last_change":"2023-07-09T02:16:18.148697+0000","last_active":"2023-07-09T02:16:19.305221+0000","last_peered":"2023-07-09T02:16:19.305221+0000","last_clean":"2023-07-09T02:16:19.305221+0000","last_became_active":"2023-07-09T02:16:18.145971+0000","last_became_peered":"2023-07-09T02:16:18.145971+0000","last_unstale":"2023-07-09T02:16:19.305221+0000","last_undegraded":"2023-07-09T02:16:19.305221+0000","last_fullsized":"2023-07-09T02:16:19.305221+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:39.063095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127695+0000","last_change":"2023-07-09T02:16:18.142591+0000","last_active":"2023-07-09T02:16:19.127695+0000","last_peered":"2023-07-09T02:16:19.127695+0000","last_clean":"2023-07-09T02:16:19.127695+0000","last_became_active":"2023-07-09T02:16:18.142327+0000","last_became_peered":"2023-07-09T02:16:18.142327+0000","last_unstale":"2023-07-09T02:16:19.127695+0000","last_undegraded":"2023-07-09T02:16:19.127695+0000","last_fullsized":"2023-07-09T02:16:19.127695+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:12:15.023576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305193+0000","last_change":"2023-07-09T02:16:18.142452+0000","last_active":"2023-07-09T02:16:19.305193+0000","last_peered":"2023-07-09T02:16:19.305193+0000","last_clean":"2023-07-09T02:16:19.305193+0000","last_became_active":"2023-07-09T02:16:18.142240+0000","last_became_peered":"2023-07-09T02:16:18.142240+0000","last_unstale":"2023-07-09T02:16:19.305193+0000","last_undegraded":"2023-07-09T02:16:19.305193+0000","last_fullsized":"2023-07-09T02:16:19.305193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:23:58.756222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130048+0000","last_change":"2023-07-09T02:16:18.137535+0000","last_active":"2023-07-09T02:16:19.130048+0000","last_peered":"2023-07-09T02:16:19.130048+0000","last_clean":"2023-07-09T02:16:19.130048+0000","last_became_active":"2023-07-09T02:16:18.134975+0000","last_became_peered":"2023-07-09T02:16:18.134975+0000","last_unstale":"2023-07-09T02:16:19.130048+0000","last_undegraded":"2023-07-09T02:16:19.130048+0000","last_fullsized":"2023-07-09T02:16:19.130048+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:43:07.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.129932+0000","last_change":"2023-07-09T02:16:18.137721+0000","last_active":"2023-07-09T02:16:19.129932+0000","last_peered":"2023-07-09T02:16:19.129932+0000","last_clean":"2023-07-09T02:16:19.129932+0000","last_became_active":"2023-07-09T02:16:18.137048+0000","last_became_peered":"2023-07-09T02:16:18.137048+0000","last_unstale":"2023-07-09T02:16:19.129932+0000","last_undegraded":"2023-07-09T02:16:19.129932+0000","last_fullsized":"2023-07-09T02:16:19.129932+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:48:51.114438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300006+0000","last_change":"2023-07-09T02:16:18.129735+0000","last_active":"2023-07-09T02:16:19.300006+0000","last_peered":"2023-07-09T02:16:19.300006+0000","last_clean":"2023-07-09T02:16:19.300006+0000","last_became_active":"2023-07-09T02:16:18.129510+0000","last_became_peered":"2023-07-09T02:16:18.129510+0000","last_unstale":"2023-07-09T02:16:19.300006+0000","last_undegraded":"2023-07-09T02:16:19.300006+0000","last_fullsized":"2023-07-09T02:16:19.300006+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:01:17.799641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127124+0000","last_change":"2023-07-09T02:16:18.140256+0000","last_active":"2023-07-09T02:16:19.127124+0000","last_peered":"2023-07-09T02:16:19.127124+0000","last_clean":"2023-07-09T02:16:19.127124+0000","last_became_active":"2023-07-09T02:16:18.139922+0000","last_became_peered":"2023-07-09T02:16:18.139922+0000","last_unstale":"2023-07-09T02:16:19.127124+0000","last_undegraded":"2023-07-09T02:16:19.127124+0000","last_fullsized":"2023-07-09T02:16:19.127124+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:25:14.212120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305324+0000","last_change":"2023-07-09T02:16:18.144240+0000","last_active":"2023-07-09T02:16:19.305324+0000","last_peered":"2023-07-09T02:16:19.305324+0000","last_clean":"2023-07-09T02:16:19.305324+0000","last_became_active":"2023-07-09T02:16:18.143492+0000","last_became_peered":"2023-07-09T02:16:18.143492+0000","last_unstale":"2023-07-09T02:16:19.305324+0000","last_undegraded":"2023-07-09T02:16:19.305324+0000","last_fullsized":"2023-07-09T02:16:19.305324+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:15:56.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127495+0000","last_change":"2023-07-09T02:16:18.135349+0000","last_active":"2023-07-09T02:16:19.127495+0000","last_peered":"2023-07-09T02:16:19.127495+0000","last_clean":"2023-07-09T02:16:19.127495+0000","last_became_active":"2023-07-09T02:16:18.134738+0000","last_became_peered":"2023-07-09T02:16:18.134738+0000","last_unstale":"2023-07-09T02:16:19.127495+0000","last_undegraded":"2023-07-09T02:16:19.127495+0000","last_fullsized":"2023-07-09T02:16:19.127495+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:13:52.839025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127007+0000","last_change":"2023-07-09T02:16:18.138668+0000","last_active":"2023-07-09T02:16:19.127007+0000","last_peered":"2023-07-09T02:16:19.127007+0000","last_clean":"2023-07-09T02:16:19.127007+0000","last_became_active":"2023-07-09T02:16:18.138425+0000","last_became_peered":"2023-07-09T02:16:18.138425+0000","last_unstale":"2023-07-09T02:16:19.127007+0000","last_undegraded":"2023-07-09T02:16:19.127007+0000","last_fullsized":"2023-07-09T02:16:19.127007+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:56:38.197421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.298775+0000","last_change":"2023-07-09T02:16:18.143934+0000","last_active":"2023-07-09T02:16:19.298775+0000","last_peered":"2023-07-09T02:16:19.298775+0000","last_clean":"2023-07-09T02:16:19.298775+0000","last_became_active":"2023-07-09T02:16:18.143802+0000","last_became_peered":"2023-07-09T02:16:18.143802+0000","last_unstale":"2023-07-09T02:16:19.298775+0000","last_undegraded":"2023-07-09T02:16:19.298775+0000","last_fullsized":"2023-07-09T02:16:19.298775+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:50:44.315343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299955+0000","last_change":"2023-07-09T02:16:18.138482+0000","last_active":"2023-07-09T02:16:19.299955+0000","last_peered":"2023-07-09T02:16:19.299955+0000","last_clean":"2023-07-09T02:16:19.299955+0000","last_became_active":"2023-07-09T02:16:18.138256+0000","last_became_peered":"2023-07-09T02:16:18.138256+0000","last_unstale":"2023-07-09T02:16:19.299955+0000","last_undegraded":"2023-07-09T02:16:19.299955+0000","last_fullsized":"2023-07-09T02:16:19.299955+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:43.027612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128692+0000","last_change":"2023-07-09T02:16:18.135576+0000","last_active":"2023-07-09T02:16:19.128692+0000","last_peered":"2023-07-09T02:16:19.128692+0000","last_clean":"2023-07-09T02:16:19.128692+0000","last_became_active":"2023-07-09T02:16:18.135349+0000","last_became_peered":"2023-07-09T02:16:18.135349+0000","last_unstale":"2023-07-09T02:16:19.128692+0000","last_undegraded":"2023-07-09T02:16:19.128692+0000","last_fullsized":"2023-07-09T02:16:19.128692+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:37:32.370659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127963+0000","last_change":"2023-07-09T02:16:18.140585+0000","last_active":"2023-07-09T02:16:19.127963+0000","last_peered":"2023-07-09T02:16:19.127963+0000","last_clean":"2023-07-09T02:16:19.127963+0000","last_became_active":"2023-07-09T02:16:18.140371+0000","last_became_peered":"2023-07-09T02:16:18.140371+0000","last_unstale":"2023-07-09T02:16:19.127963+0000","last_undegraded":"2023-07-09T02:16:19.127963+0000","last_fullsized":"2023-07-09T02:16:19.127963+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:49:22.751631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305539+0000","last_change":"2023-07-09T02:16:18.137550+0000","last_active":"2023-07-09T02:16:19.305539+0000","last_peered":"2023-07-09T02:16:19.305539+0000","last_clean":"2023-07-09T02:16:19.305539+0000","last_became_active":"2023-07-09T02:16:18.137340+0000","last_became_peered":"2023-07-09T02:16:18.137340+0000","last_unstale":"2023-07-09T02:16:19.305539+0000","last_undegraded":"2023-07-09T02:16:19.305539+0000","last_fullsized":"2023-07-09T02:16:19.305539+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:04:13.442905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305562+0000","last_change":"2023-07-09T02:16:18.146728+0000","last_active":"2023-07-09T02:16:19.305562+0000","last_peered":"2023-07-09T02:16:19.305562+0000","last_clean":"2023-07-09T02:16:19.305562+0000","last_became_active":"2023-07-09T02:16:18.145358+0000","last_became_peered":"2023-07-09T02:16:18.145358+0000","last_unstale":"2023-07-09T02:16:19.305562+0000","last_undegraded":"2023-07-09T02:16:19.305562+0000","last_fullsized":"2023-07-09T02:16:19.305562+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:54:12.319906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299016+0000","last_change":"2023-07-09T02:16:18.138779+0000","last_active":"2023-07-09T02:16:19.299016+0000","last_peered":"2023-07-09T02:16:19.299016+0000","last_clean":"2023-07-09T02:16:19.299016+0000","last_became_active":"2023-07-09T02:16:18.138557+0000","last_became_peered":"2023-07-09T02:16:18.138557+0000","last_unstale":"2023-07-09T02:16:19.299016+0000","last_undegraded":"2023-07-09T02:16:19.299016+0000","last_fullsized":"2023-07-09T02:16:19.299016+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:47:32.827940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127716+0000","last_change":"2023-07-09T02:16:18.137448+0000","last_active":"2023-07-09T02:16:19.127716+0000","last_peered":"2023-07-09T02:16:19.127716+0000","last_clean":"2023-07-09T02:16:19.127716+0000","last_became_active":"2023-07-09T02:16:18.136755+0000","last_became_peered":"2023-07-09T02:16:18.136755+0000","last_unstale":"2023-07-09T02:16:19.127716+0000","last_undegraded":"2023-07-09T02:16:19.127716+0000","last_fullsized":"2023-07-09T02:16:19.127716+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:01:06.911461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128789+0000","last_change":"2023-07-09T02:16:18.140537+0000","last_active":"2023-07-09T02:16:19.128789+0000","last_peered":"2023-07-09T02:16:19.128789+0000","last_clean":"2023-07-09T02:16:19.128789+0000","last_became_active":"2023-07-09T02:16:18.140109+0000","last_became_peered":"2023-07-09T02:16:18.140109+0000","last_unstale":"2023-07-09T02:16:19.128789+0000","last_undegraded":"2023-07-09T02:16:19.128789+0000","last_fullsized":"2023-07-09T02:16:19.128789+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:52.003565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130064+0000","last_change":"2023-07-09T02:16:18.137585+0000","last_active":"2023-07-09T02:16:19.130064+0000","last_peered":"2023-07-09T02:16:19.130064+0000","last_clean":"2023-07-09T02:16:19.130064+0000","last_became_active":"2023-07-09T02:16:18.136731+0000","last_became_peered":"2023-07-09T02:16:18.136731+0000","last_unstale":"2023-07-09T02:16:19.130064+0000","last_undegraded":"2023-07-09T02:16:19.130064+0000","last_fullsized":"2023-07-09T02:16:19.130064+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:20:56.684376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130446+0000","last_change":"2023-07-09T02:16:18.137982+0000","last_active":"2023-07-09T02:16:19.130446+0000","last_peered":"2023-07-09T02:16:19.130446+0000","last_clean":"2023-07-09T02:16:19.130446+0000","last_became_active":"2023-07-09T02:16:18.137749+0000","last_became_peered":"2023-07-09T02:16:18.137749+0000","last_unstale":"2023-07-09T02:16:19.130446+0000","last_undegraded":"2023-07-09T02:16:19.130446+0000","last_fullsized":"2023-07-09T02:16:19.130446+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:11:51.905903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"105'4","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.298958+0000","last_change":"2023-07-09T02:16:17.132506+0000","last_active":"2023-07-09T02:16:19.298958+0000","last_peered":"2023-07-09T02:16:19.298958+0000","last_clean":"2023-07-09T02:16:19.298958+0000","last_became_active":"2023-07-09T02:16:17.132283+0000","last_became_peered":"2023-07-09T02:16:17.132283+0000","last_unstale":"2023-07-09T02:16:19.298958+0000","last_undegraded":"2023-07-09T02:16:19.298958+0000","last_fullsized":"2023-07-09T02:16:19.298958+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:42.020109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130177+0000","last_change":"2023-07-09T02:16:18.139552+0000","last_active":"2023-07-09T02:16:19.130177+0000","last_peered":"2023-07-09T02:16:19.130177+0000","last_clean":"2023-07-09T02:16:19.130177+0000","last_became_active":"2023-07-09T02:16:18.139323+0000","last_became_peered":"2023-07-09T02:16:18.139323+0000","last_unstale":"2023-07-09T02:16:19.130177+0000","last_undegraded":"2023-07-09T02:16:19.130177+0000","last_fullsized":"2023-07-09T02:16:19.130177+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:03:22.836532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127513+0000","last_change":"2023-07-09T02:16:17.132552+0000","last_active":"2023-07-09T02:16:19.127513+0000","last_peered":"2023-07-09T02:16:19.127513+0000","last_clean":"2023-07-09T02:16:19.127513+0000","last_became_active":"2023-07-09T02:16:17.132066+0000","last_became_peered":"2023-07-09T02:16:17.132066+0000","last_unstale":"2023-07-09T02:16:19.127513+0000","last_undegraded":"2023-07-09T02:16:19.127513+0000","last_fullsized":"2023-07-09T02:16:19.127513+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:09:10.803739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299190+0000","last_change":"2023-07-09T02:16:18.142629+0000","last_active":"2023-07-09T02:16:19.299190+0000","last_peered":"2023-07-09T02:16:19.299190+0000","last_clean":"2023-07-09T02:16:19.299190+0000","last_became_active":"2023-07-09T02:16:18.142394+0000","last_became_peered":"2023-07-09T02:16:18.142394+0000","last_unstale":"2023-07-09T02:16:19.299190+0000","last_undegraded":"2023-07-09T02:16:19.299190+0000","last_fullsized":"2023-07-09T02:16:19.299190+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:18:41.554042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299536+0000","last_change":"2023-07-09T02:16:17.137499+0000","last_active":"2023-07-09T02:16:19.299536+0000","last_peered":"2023-07-09T02:16:19.299536+0000","last_clean":"2023-07-09T02:16:19.299536+0000","last_became_active":"2023-07-09T02:16:17.136972+0000","last_became_peered":"2023-07-09T02:16:17.136972+0000","last_unstale":"2023-07-09T02:16:19.299536+0000","last_undegraded":"2023-07-09T02:16:19.299536+0000","last_fullsized":"2023-07-09T02:16:19.299536+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:24.910941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.129952+0000","last_change":"2023-07-09T02:16:18.141227+0000","last_active":"2023-07-09T02:16:19.129952+0000","last_peered":"2023-07-09T02:16:19.129952+0000","last_clean":"2023-07-09T02:16:19.129952+0000","last_became_active":"2023-07-09T02:16:18.140941+0000","last_became_peered":"2023-07-09T02:16:18.140941+0000","last_unstale":"2023-07-09T02:16:19.129952+0000","last_undegraded":"2023-07-09T02:16:19.129952+0000","last_fullsized":"2023-07-09T02:16:19.129952+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:15:43.616259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299023+0000","last_change":"2023-07-09T02:16:17.134659+0000","last_active":"2023-07-09T02:16:19.299023+0000","last_peered":"2023-07-09T02:16:19.299023+0000","last_clean":"2023-07-09T02:16:19.299023+0000","last_became_active":"2023-07-09T02:16:17.134356+0000","last_became_peered":"2023-07-09T02:16:17.134356+0000","last_unstale":"2023-07-09T02:16:19.299023+0000","last_undegraded":"2023-07-09T02:16:19.299023+0000","last_fullsized":"2023-07-09T02:16:19.299023+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:01:16.792138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305455+0000","last_change":"2023-07-09T02:16:18.144423+0000","last_active":"2023-07-09T02:16:19.305455+0000","last_peered":"2023-07-09T02:16:19.305455+0000","last_clean":"2023-07-09T02:16:19.305455+0000","last_became_active":"2023-07-09T02:16:18.143805+0000","last_became_peered":"2023-07-09T02:16:18.143805+0000","last_unstale":"2023-07-09T02:16:19.305455+0000","last_undegraded":"2023-07-09T02:16:19.305455+0000","last_fullsized":"2023-07-09T02:16:19.305455+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:23:17.096179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127548+0000","last_change":"2023-07-09T02:16:17.131988+0000","last_active":"2023-07-09T02:16:19.127548+0000","last_peered":"2023-07-09T02:16:19.127548+0000","last_clean":"2023-07-09T02:16:19.127548+0000","last_became_active":"2023-07-09T02:16:17.131769+0000","last_became_peered":"2023-07-09T02:16:17.131769+0000","last_unstale":"2023-07-09T02:16:19.127548+0000","last_undegraded":"2023-07-09T02:16:19.127548+0000","last_fullsized":"2023-07-09T02:16:19.127548+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:37:00.255221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299248+0000","last_change":"2023-07-09T02:16:18.136548+0000","last_active":"2023-07-09T02:16:19.299248+0000","last_peered":"2023-07-09T02:16:19.299248+0000","last_clean":"2023-07-09T02:16:19.299248+0000","last_became_active":"2023-07-09T02:16:18.136218+0000","last_became_peered":"2023-07-09T02:16:18.136218+0000","last_unstale":"2023-07-09T02:16:19.299248+0000","last_undegraded":"2023-07-09T02:16:19.299248+0000","last_fullsized":"2023-07-09T02:16:19.299248+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:13:54.647293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305428+0000","last_change":"2023-07-09T02:16:17.130362+0000","last_active":"2023-07-09T02:16:19.305428+0000","last_peered":"2023-07-09T02:16:19.305428+0000","last_clean":"2023-07-09T02:16:19.305428+0000","last_became_active":"2023-07-09T02:16:17.129945+0000","last_became_peered":"2023-07-09T02:16:17.129945+0000","last_unstale":"2023-07-09T02:16:19.305428+0000","last_undegraded":"2023-07-09T02:16:19.305428+0000","last_fullsized":"2023-07-09T02:16:19.305428+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:38:55.508874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130099+0000","last_change":"2023-07-09T02:16:18.143167+0000","last_active":"2023-07-09T02:16:19.130099+0000","last_peered":"2023-07-09T02:16:19.130099+0000","last_clean":"2023-07-09T02:16:19.130099+0000","last_became_active":"2023-07-09T02:16:18.142951+0000","last_became_peered":"2023-07-09T02:16:18.142951+0000","last_unstale":"2023-07-09T02:16:19.130099+0000","last_undegraded":"2023-07-09T02:16:19.130099+0000","last_fullsized":"2023-07-09T02:16:19.130099+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:32:08.985700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300077+0000","last_change":"2023-07-09T02:16:17.136371+0000","last_active":"2023-07-09T02:16:19.300077+0000","last_peered":"2023-07-09T02:16:19.300077+0000","last_clean":"2023-07-09T02:16:19.300077+0000","last_became_active":"2023-07-09T02:16:17.136140+0000","last_became_peered":"2023-07-09T02:16:17.136140+0000","last_unstale":"2023-07-09T02:16:19.300077+0000","last_undegraded":"2023-07-09T02:16:19.300077+0000","last_fullsized":"2023-07-09T02:16:19.300077+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:46.434628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305649+0000","last_change":"2023-07-09T02:16:18.143100+0000","last_active":"2023-07-09T02:16:19.305649+0000","last_peered":"2023-07-09T02:16:19.305649+0000","last_clean":"2023-07-09T02:16:19.305649+0000","last_became_active":"2023-07-09T02:16:18.142867+0000","last_became_peered":"2023-07-09T02:16:18.142867+0000","last_unstale":"2023-07-09T02:16:19.305649+0000","last_undegraded":"2023-07-09T02:16:19.305649+0000","last_fullsized":"2023-07-09T02:16:19.305649+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:31:16.034954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299273+0000","last_change":"2023-07-09T02:16:17.137185+0000","last_active":"2023-07-09T02:16:19.299273+0000","last_peered":"2023-07-09T02:16:19.299273+0000","last_clean":"2023-07-09T02:16:19.299273+0000","last_became_active":"2023-07-09T02:16:17.136325+0000","last_became_peered":"2023-07-09T02:16:17.136325+0000","last_unstale":"2023-07-09T02:16:19.299273+0000","last_undegraded":"2023-07-09T02:16:19.299273+0000","last_fullsized":"2023-07-09T02:16:19.299273+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:38:30.325364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127261+0000","last_change":"2023-07-09T02:16:18.138200+0000","last_active":"2023-07-09T02:16:19.127261+0000","last_peered":"2023-07-09T02:16:19.127261+0000","last_clean":"2023-07-09T02:16:19.127261+0000","last_became_active":"2023-07-09T02:16:18.137981+0000","last_became_peered":"2023-07-09T02:16:18.137981+0000","last_unstale":"2023-07-09T02:16:19.127261+0000","last_undegraded":"2023-07-09T02:16:19.127261+0000","last_fullsized":"2023-07-09T02:16:19.127261+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:32:02.152350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128909+0000","last_change":"2023-07-09T02:16:17.130368+0000","last_active":"2023-07-09T02:16:19.128909+0000","last_peered":"2023-07-09T02:16:19.128909+0000","last_clean":"2023-07-09T02:16:19.128909+0000","last_became_active":"2023-07-09T02:16:17.130138+0000","last_became_peered":"2023-07-09T02:16:17.130138+0000","last_unstale":"2023-07-09T02:16:19.128909+0000","last_undegraded":"2023-07-09T02:16:19.128909+0000","last_fullsized":"2023-07-09T02:16:19.128909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:11:50.898400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299711+0000","last_change":"2023-07-09T02:16:18.139427+0000","last_active":"2023-07-09T02:16:19.299711+0000","last_peered":"2023-07-09T02:16:19.299711+0000","last_clean":"2023-07-09T02:16:19.299711+0000","last_became_active":"2023-07-09T02:16:18.139176+0000","last_became_peered":"2023-07-09T02:16:18.139176+0000","last_unstale":"2023-07-09T02:16:19.299711+0000","last_undegraded":"2023-07-09T02:16:19.299711+0000","last_fullsized":"2023-07-09T02:16:19.299711+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:37:51.175888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300148+0000","last_change":"2023-07-09T02:16:17.133091+0000","last_active":"2023-07-09T02:16:19.300148+0000","last_peered":"2023-07-09T02:16:19.300148+0000","last_clean":"2023-07-09T02:16:19.300148+0000","last_became_active":"2023-07-09T02:16:17.132705+0000","last_became_peered":"2023-07-09T02:16:17.132705+0000","last_unstale":"2023-07-09T02:16:19.300148+0000","last_undegraded":"2023-07-09T02:16:19.300148+0000","last_fullsized":"2023-07-09T02:16:19.300148+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:15.057620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.300079+0000","last_change":"2023-07-09T02:16:18.131922+0000","last_active":"2023-07-09T02:16:19.300079+0000","last_peered":"2023-07-09T02:16:19.300079+0000","last_clean":"2023-07-09T02:16:19.300079+0000","last_became_active":"2023-07-09T02:16:18.131703+0000","last_became_peered":"2023-07-09T02:16:18.131703+0000","last_unstale":"2023-07-09T02:16:19.300079+0000","last_undegraded":"2023-07-09T02:16:19.300079+0000","last_fullsized":"2023-07-09T02:16:19.300079+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:04:55.436786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127176+0000","last_change":"2023-07-09T02:16:17.131447+0000","last_active":"2023-07-09T02:16:19.127176+0000","last_peered":"2023-07-09T02:16:19.127176+0000","last_clean":"2023-07-09T02:16:19.127176+0000","last_became_active":"2023-07-09T02:16:17.131168+0000","last_became_peered":"2023-07-09T02:16:17.131168+0000","last_unstale":"2023-07-09T02:16:19.127176+0000","last_undegraded":"2023-07-09T02:16:19.127176+0000","last_fullsized":"2023-07-09T02:16:19.127176+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:22:31.441660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305335+0000","last_change":"2023-07-09T02:16:18.141060+0000","last_active":"2023-07-09T02:16:19.305335+0000","last_peered":"2023-07-09T02:16:19.305335+0000","last_clean":"2023-07-09T02:16:19.305335+0000","last_became_active":"2023-07-09T02:16:18.140842+0000","last_became_peered":"2023-07-09T02:16:18.140842+0000","last_unstale":"2023-07-09T02:16:19.305335+0000","last_undegraded":"2023-07-09T02:16:19.305335+0000","last_fullsized":"2023-07-09T02:16:19.305335+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:23:45.399633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"105'6","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130065+0000","last_change":"2023-07-09T02:16:17.132694+0000","last_active":"2023-07-09T02:16:19.130065+0000","last_peered":"2023-07-09T02:16:19.130065+0000","last_clean":"2023-07-09T02:16:19.130065+0000","last_became_active":"2023-07-09T02:16:17.132460+0000","last_became_peered":"2023-07-09T02:16:17.132460+0000","last_unstale":"2023-07-09T02:16:19.130065+0000","last_undegraded":"2023-07-09T02:16:19.130065+0000","last_fullsized":"2023-07-09T02:16:19.130065+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:22:23.771453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305811+0000","last_change":"2023-07-09T02:16:18.149007+0000","last_active":"2023-07-09T02:16:19.305811+0000","last_peered":"2023-07-09T02:16:19.305811+0000","last_clean":"2023-07-09T02:16:19.305811+0000","last_became_active":"2023-07-09T02:16:18.146265+0000","last_became_peered":"2023-07-09T02:16:18.146265+0000","last_unstale":"2023-07-09T02:16:19.305811+0000","last_undegraded":"2023-07-09T02:16:19.305811+0000","last_fullsized":"2023-07-09T02:16:19.305811+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:34:10.364678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299422+0000","last_change":"2023-07-09T02:16:17.137356+0000","last_active":"2023-07-09T02:16:19.299422+0000","last_peered":"2023-07-09T02:16:19.299422+0000","last_clean":"2023-07-09T02:16:19.299422+0000","last_became_active":"2023-07-09T02:16:17.136640+0000","last_became_peered":"2023-07-09T02:16:17.136640+0000","last_unstale":"2023-07-09T02:16:19.299422+0000","last_undegraded":"2023-07-09T02:16:19.299422+0000","last_fullsized":"2023-07-09T02:16:19.299422+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:00:43.449540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127193+0000","last_change":"2023-07-09T02:16:18.135515+0000","last_active":"2023-07-09T02:16:19.127193+0000","last_peered":"2023-07-09T02:16:19.127193+0000","last_clean":"2023-07-09T02:16:19.127193+0000","last_became_active":"2023-07-09T02:16:18.135272+0000","last_became_peered":"2023-07-09T02:16:18.135272+0000","last_unstale":"2023-07-09T02:16:19.127193+0000","last_undegraded":"2023-07-09T02:16:19.127193+0000","last_fullsized":"2023-07-09T02:16:19.127193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:40:23.957310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130498+0000","last_change":"2023-07-09T02:16:17.130224+0000","last_active":"2023-07-09T02:16:19.130498+0000","last_peered":"2023-07-09T02:16:19.130498+0000","last_clean":"2023-07-09T02:16:19.130498+0000","last_became_active":"2023-07-09T02:16:17.129865+0000","last_became_peered":"2023-07-09T02:16:17.129865+0000","last_unstale":"2023-07-09T02:16:19.130498+0000","last_undegraded":"2023-07-09T02:16:19.130498+0000","last_fullsized":"2023-07-09T02:16:19.130498+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:22:07.072392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305322+0000","last_change":"2023-07-09T02:16:18.142021+0000","last_active":"2023-07-09T02:16:19.305322+0000","last_peered":"2023-07-09T02:16:19.305322+0000","last_clean":"2023-07-09T02:16:19.305322+0000","last_became_active":"2023-07-09T02:16:18.141800+0000","last_became_peered":"2023-07-09T02:16:18.141800+0000","last_unstale":"2023-07-09T02:16:19.305322+0000","last_undegraded":"2023-07-09T02:16:19.305322+0000","last_fullsized":"2023-07-09T02:16:19.305322+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:39:47.680729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305758+0000","last_change":"2023-07-09T02:16:17.135464+0000","last_active":"2023-07-09T02:16:19.305758+0000","last_peered":"2023-07-09T02:16:19.305758+0000","last_clean":"2023-07-09T02:16:19.305758+0000","last_became_active":"2023-07-09T02:16:17.135016+0000","last_became_peered":"2023-07-09T02:16:17.135016+0000","last_unstale":"2023-07-09T02:16:19.305758+0000","last_undegraded":"2023-07-09T02:16:19.305758+0000","last_fullsized":"2023-07-09T02:16:19.305758+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:35:27.973342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305973+0000","last_change":"2023-07-09T02:16:18.142303+0000","last_active":"2023-07-09T02:16:19.305973+0000","last_peered":"2023-07-09T02:16:19.305973+0000","last_clean":"2023-07-09T02:16:19.305973+0000","last_became_active":"2023-07-09T02:16:18.141742+0000","last_became_peered":"2023-07-09T02:16:18.141742+0000","last_unstale":"2023-07-09T02:16:19.305973+0000","last_undegraded":"2023-07-09T02:16:19.305973+0000","last_fullsized":"2023-07-09T02:16:19.305973+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:38:34.570839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"105'8","reported_seq":21,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305692+0000","last_change":"2023-07-09T02:16:17.130219+0000","last_active":"2023-07-09T02:16:19.305692+0000","last_peered":"2023-07-09T02:16:19.305692+0000","last_clean":"2023-07-09T02:16:19.305692+0000","last_became_active":"2023-07-09T02:16:17.129189+0000","last_became_peered":"2023-07-09T02:16:17.129189+0000","last_unstale":"2023-07-09T02:16:19.305692+0000","last_undegraded":"2023-07-09T02:16:19.305692+0000","last_fullsized":"2023-07-09T02:16:19.305692+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:00.633093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299035+0000","last_change":"2023-07-09T02:16:18.137794+0000","last_active":"2023-07-09T02:16:19.299035+0000","last_peered":"2023-07-09T02:16:19.299035+0000","last_clean":"2023-07-09T02:16:19.299035+0000","last_became_active":"2023-07-09T02:16:18.137554+0000","last_became_peered":"2023-07-09T02:16:18.137554+0000","last_unstale":"2023-07-09T02:16:19.299035+0000","last_undegraded":"2023-07-09T02:16:19.299035+0000","last_fullsized":"2023-07-09T02:16:19.299035+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:27:47.442131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299099+0000","last_change":"2023-07-09T02:16:17.136837+0000","last_active":"2023-07-09T02:16:19.299099+0000","last_peered":"2023-07-09T02:16:19.299099+0000","last_clean":"2023-07-09T02:16:19.299099+0000","last_became_active":"2023-07-09T02:16:17.136578+0000","last_became_peered":"2023-07-09T02:16:17.136578+0000","last_unstale":"2023-07-09T02:16:19.299099+0000","last_undegraded":"2023-07-09T02:16:19.299099+0000","last_fullsized":"2023-07-09T02:16:19.299099+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:18:52.857554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.129932+0000","last_change":"2023-07-09T02:16:18.138571+0000","last_active":"2023-07-09T02:16:19.129932+0000","last_peered":"2023-07-09T02:16:19.129932+0000","last_clean":"2023-07-09T02:16:19.129932+0000","last_became_active":"2023-07-09T02:16:18.138346+0000","last_became_peered":"2023-07-09T02:16:18.138346+0000","last_unstale":"2023-07-09T02:16:19.129932+0000","last_undegraded":"2023-07-09T02:16:19.129932+0000","last_fullsized":"2023-07-09T02:16:19.129932+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:06:06.215524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127291+0000","last_change":"2023-07-09T02:16:17.128301+0000","last_active":"2023-07-09T02:16:19.127291+0000","last_peered":"2023-07-09T02:16:19.127291+0000","last_clean":"2023-07-09T02:16:19.127291+0000","last_became_active":"2023-07-09T02:16:17.128059+0000","last_became_peered":"2023-07-09T02:16:17.128059+0000","last_unstale":"2023-07-09T02:16:19.127291+0000","last_undegraded":"2023-07-09T02:16:19.127291+0000","last_fullsized":"2023-07-09T02:16:19.127291+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:45:37.934831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130439+0000","last_change":"2023-07-09T02:16:18.135593+0000","last_active":"2023-07-09T02:16:19.130439+0000","last_peered":"2023-07-09T02:16:19.130439+0000","last_clean":"2023-07-09T02:16:19.130439+0000","last_became_active":"2023-07-09T02:16:18.135046+0000","last_became_peered":"2023-07-09T02:16:18.135046+0000","last_unstale":"2023-07-09T02:16:19.130439+0000","last_undegraded":"2023-07-09T02:16:19.130439+0000","last_fullsized":"2023-07-09T02:16:19.130439+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:39:18.786406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127847+0000","last_change":"2023-07-09T02:16:17.132406+0000","last_active":"2023-07-09T02:16:19.127847+0000","last_peered":"2023-07-09T02:16:19.127847+0000","last_clean":"2023-07-09T02:16:19.127847+0000","last_became_active":"2023-07-09T02:16:17.131466+0000","last_became_peered":"2023-07-09T02:16:17.131466+0000","last_unstale":"2023-07-09T02:16:19.127847+0000","last_undegraded":"2023-07-09T02:16:19.127847+0000","last_fullsized":"2023-07-09T02:16:19.127847+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:26:44.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128320+0000","last_change":"2023-07-09T02:16:18.132919+0000","last_active":"2023-07-09T02:16:19.128320+0000","last_peered":"2023-07-09T02:16:19.128320+0000","last_clean":"2023-07-09T02:16:19.128320+0000","last_became_active":"2023-07-09T02:16:18.132684+0000","last_became_peered":"2023-07-09T02:16:18.132684+0000","last_unstale":"2023-07-09T02:16:19.128320+0000","last_undegraded":"2023-07-09T02:16:19.128320+0000","last_fullsized":"2023-07-09T02:16:19.128320+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:03:22.836532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299156+0000","last_change":"2023-07-09T02:16:17.134764+0000","last_active":"2023-07-09T02:16:19.299156+0000","last_peered":"2023-07-09T02:16:19.299156+0000","last_clean":"2023-07-09T02:16:19.299156+0000","last_became_active":"2023-07-09T02:16:17.134522+0000","last_became_peered":"2023-07-09T02:16:17.134522+0000","last_unstale":"2023-07-09T02:16:19.299156+0000","last_undegraded":"2023-07-09T02:16:19.299156+0000","last_fullsized":"2023-07-09T02:16:19.299156+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:43:15.057620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305042+0000","last_change":"2023-07-09T02:16:18.135121+0000","last_active":"2023-07-09T02:16:19.305042+0000","last_peered":"2023-07-09T02:16:19.305042+0000","last_clean":"2023-07-09T02:16:19.305042+0000","last_became_active":"2023-07-09T02:16:18.134903+0000","last_became_peered":"2023-07-09T02:16:18.134903+0000","last_unstale":"2023-07-09T02:16:19.305042+0000","last_undegraded":"2023-07-09T02:16:19.305042+0000","last_fullsized":"2023-07-09T02:16:19.305042+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:55:47.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130571+0000","last_change":"2023-07-09T02:16:17.130085+0000","last_active":"2023-07-09T02:16:19.130571+0000","last_peered":"2023-07-09T02:16:19.130571+0000","last_clean":"2023-07-09T02:16:19.130571+0000","last_became_active":"2023-07-09T02:16:17.129571+0000","last_became_peered":"2023-07-09T02:16:17.129571+0000","last_unstale":"2023-07-09T02:16:19.130571+0000","last_undegraded":"2023-07-09T02:16:19.130571+0000","last_fullsized":"2023-07-09T02:16:19.130571+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:40:44.013348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299919+0000","last_change":"2023-07-09T02:16:18.142267+0000","last_active":"2023-07-09T02:16:19.299919+0000","last_peered":"2023-07-09T02:16:19.299919+0000","last_clean":"2023-07-09T02:16:19.299919+0000","last_became_active":"2023-07-09T02:16:18.142050+0000","last_became_peered":"2023-07-09T02:16:18.142050+0000","last_unstale":"2023-07-09T02:16:19.299919+0000","last_undegraded":"2023-07-09T02:16:19.299919+0000","last_fullsized":"2023-07-09T02:16:19.299919+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:55:04.216485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128504+0000","last_change":"2023-07-09T02:16:17.129119+0000","last_active":"2023-07-09T02:16:19.128504+0000","last_peered":"2023-07-09T02:16:19.128504+0000","last_clean":"2023-07-09T02:16:19.128504+0000","last_became_active":"2023-07-09T02:16:17.128705+0000","last_became_peered":"2023-07-09T02:16:17.128705+0000","last_unstale":"2023-07-09T02:16:19.128504+0000","last_undegraded":"2023-07-09T02:16:19.128504+0000","last_fullsized":"2023-07-09T02:16:19.128504+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:14:36.957175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299075+0000","last_change":"2023-07-09T02:16:18.141994+0000","last_active":"2023-07-09T02:16:19.299075+0000","last_peered":"2023-07-09T02:16:19.299075+0000","last_clean":"2023-07-09T02:16:19.299075+0000","last_became_active":"2023-07-09T02:16:18.141731+0000","last_became_peered":"2023-07-09T02:16:18.141731+0000","last_unstale":"2023-07-09T02:16:19.299075+0000","last_undegraded":"2023-07-09T02:16:19.299075+0000","last_fullsized":"2023-07-09T02:16:19.299075+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:04:55.436786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299102+0000","last_change":"2023-07-09T02:16:17.134981+0000","last_active":"2023-07-09T02:16:19.299102+0000","last_peered":"2023-07-09T02:16:19.299102+0000","last_clean":"2023-07-09T02:16:19.299102+0000","last_became_active":"2023-07-09T02:16:17.134724+0000","last_became_peered":"2023-07-09T02:16:17.134724+0000","last_unstale":"2023-07-09T02:16:19.299102+0000","last_undegraded":"2023-07-09T02:16:19.299102+0000","last_fullsized":"2023-07-09T02:16:19.299102+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:10:16.221241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130385+0000","last_change":"2023-07-09T02:16:18.137384+0000","last_active":"2023-07-09T02:16:19.130385+0000","last_peered":"2023-07-09T02:16:19.130385+0000","last_clean":"2023-07-09T02:16:19.130385+0000","last_became_active":"2023-07-09T02:16:18.134671+0000","last_became_peered":"2023-07-09T02:16:18.134671+0000","last_unstale":"2023-07-09T02:16:19.130385+0000","last_undegraded":"2023-07-09T02:16:19.130385+0000","last_fullsized":"2023-07-09T02:16:19.130385+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:52.003565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299324+0000","last_change":"2023-07-09T02:16:17.136536+0000","last_active":"2023-07-09T02:16:19.299324+0000","last_peered":"2023-07-09T02:16:19.299324+0000","last_clean":"2023-07-09T02:16:19.299324+0000","last_became_active":"2023-07-09T02:16:17.136283+0000","last_became_peered":"2023-07-09T02:16:17.136283+0000","last_unstale":"2023-07-09T02:16:19.299324+0000","last_undegraded":"2023-07-09T02:16:19.299324+0000","last_fullsized":"2023-07-09T02:16:19.299324+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:48:02.795540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299828+0000","last_change":"2023-07-09T02:16:18.141555+0000","last_active":"2023-07-09T02:16:19.299828+0000","last_peered":"2023-07-09T02:16:19.299828+0000","last_clean":"2023-07-09T02:16:19.299828+0000","last_became_active":"2023-07-09T02:16:18.141385+0000","last_became_peered":"2023-07-09T02:16:18.141385+0000","last_unstale":"2023-07-09T02:16:19.299828+0000","last_undegraded":"2023-07-09T02:16:19.299828+0000","last_fullsized":"2023-07-09T02:16:19.299828+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:08:57.898119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305916+0000","last_change":"2023-07-09T02:16:17.127099+0000","last_active":"2023-07-09T02:16:19.305916+0000","last_peered":"2023-07-09T02:16:19.305916+0000","last_clean":"2023-07-09T02:16:19.305916+0000","last_became_active":"2023-07-09T02:16:17.126861+0000","last_became_peered":"2023-07-09T02:16:17.126861+0000","last_unstale":"2023-07-09T02:16:19.305916+0000","last_undegraded":"2023-07-09T02:16:19.305916+0000","last_fullsized":"2023-07-09T02:16:19.305916+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:29:07.726475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":317,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299911+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:16:19.299911+0000","last_peered":"2023-07-09T02:16:19.299911+0000","last_clean":"2023-07-09T02:16:19.299911+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:16:19.299911+0000","last_undegraded":"2023-07-09T02:16:19.299911+0000","last_fullsized":"2023-07-09T02:16:19.299911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:26:40.593032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":179,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128984+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:16:19.128984+0000","last_peered":"2023-07-09T02:16:19.128984+0000","last_clean":"2023-07-09T02:16:19.128984+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:16:19.128984+0000","last_undegraded":"2023-07-09T02:16:19.128984+0000","last_fullsized":"2023-07-09T02:16:19.128984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:17:02.068112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130194+0000","last_change":"2023-07-09T02:16:18.137856+0000","last_active":"2023-07-09T02:16:19.130194+0000","last_peered":"2023-07-09T02:16:19.130194+0000","last_clean":"2023-07-09T02:16:19.130194+0000","last_became_active":"2023-07-09T02:16:18.137375+0000","last_became_peered":"2023-07-09T02:16:18.137375+0000","last_unstale":"2023-07-09T02:16:19.130194+0000","last_undegraded":"2023-07-09T02:16:19.130194+0000","last_fullsized":"2023-07-09T02:16:19.130194+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:14:37.964678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299463+0000","last_change":"2023-07-09T02:16:17.135471+0000","last_active":"2023-07-09T02:16:19.299463+0000","last_peered":"2023-07-09T02:16:19.299463+0000","last_clean":"2023-07-09T02:16:19.299463+0000","last_became_active":"2023-07-09T02:16:17.134737+0000","last_became_peered":"2023-07-09T02:16:17.134737+0000","last_unstale":"2023-07-09T02:16:19.299463+0000","last_undegraded":"2023-07-09T02:16:19.299463+0000","last_fullsized":"2023-07-09T02:16:19.299463+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:35:16.852275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299672+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:16:19.299672+0000","last_peered":"2023-07-09T02:16:19.299672+0000","last_clean":"2023-07-09T02:16:19.299672+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:16:19.299672+0000","last_undegraded":"2023-07-09T02:16:19.299672+0000","last_fullsized":"2023-07-09T02:16:19.299672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:55:01.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.298860+0000","last_change":"2023-07-09T02:16:18.138138+0000","last_active":"2023-07-09T02:16:19.298860+0000","last_peered":"2023-07-09T02:16:19.298860+0000","last_clean":"2023-07-09T02:16:19.298860+0000","last_became_active":"2023-07-09T02:16:18.137939+0000","last_became_peered":"2023-07-09T02:16:18.137939+0000","last_unstale":"2023-07-09T02:16:19.298860+0000","last_undegraded":"2023-07-09T02:16:19.298860+0000","last_fullsized":"2023-07-09T02:16:19.298860+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:55:04.216485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299629+0000","last_change":"2023-07-09T02:16:17.136084+0000","last_active":"2023-07-09T02:16:19.299629+0000","last_peered":"2023-07-09T02:16:19.299629+0000","last_clean":"2023-07-09T02:16:19.299629+0000","last_became_active":"2023-07-09T02:16:17.135853+0000","last_became_peered":"2023-07-09T02:16:17.135853+0000","last_unstale":"2023-07-09T02:16:19.299629+0000","last_undegraded":"2023-07-09T02:16:19.299629+0000","last_fullsized":"2023-07-09T02:16:19.299629+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:09:19.595705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305257+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:16:19.305257+0000","last_peered":"2023-07-09T02:16:19.305257+0000","last_clean":"2023-07-09T02:16:19.305257+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:16:19.305257+0000","last_undegraded":"2023-07-09T02:16:19.305257+0000","last_fullsized":"2023-07-09T02:16:19.305257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:49:58.173986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127855+0000","last_change":"2023-07-09T02:16:18.136975+0000","last_active":"2023-07-09T02:16:19.127855+0000","last_peered":"2023-07-09T02:16:19.127855+0000","last_clean":"2023-07-09T02:16:19.127855+0000","last_became_active":"2023-07-09T02:16:18.136436+0000","last_became_peered":"2023-07-09T02:16:18.136436+0000","last_unstale":"2023-07-09T02:16:19.127855+0000","last_undegraded":"2023-07-09T02:16:19.127855+0000","last_fullsized":"2023-07-09T02:16:19.127855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:38:48.801372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.127646+0000","last_change":"2023-07-09T02:16:17.132545+0000","last_active":"2023-07-09T02:16:19.127646+0000","last_peered":"2023-07-09T02:16:19.127646+0000","last_clean":"2023-07-09T02:16:19.127646+0000","last_became_active":"2023-07-09T02:16:17.131760+0000","last_became_peered":"2023-07-09T02:16:17.131760+0000","last_unstale":"2023-07-09T02:16:19.127646+0000","last_undegraded":"2023-07-09T02:16:19.127646+0000","last_fullsized":"2023-07-09T02:16:19.127646+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:30:54.714727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":179,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128599+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:16:19.128599+0000","last_peered":"2023-07-09T02:16:19.128599+0000","last_clean":"2023-07-09T02:16:19.128599+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:16:19.128599+0000","last_undegraded":"2023-07-09T02:16:19.128599+0000","last_fullsized":"2023-07-09T02:16:19.128599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:03:51.863322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130195+0000","last_change":"2023-07-09T02:16:18.146278+0000","last_active":"2023-07-09T02:16:19.130195+0000","last_peered":"2023-07-09T02:16:19.130195+0000","last_clean":"2023-07-09T02:16:19.130195+0000","last_became_active":"2023-07-09T02:16:18.145573+0000","last_became_peered":"2023-07-09T02:16:18.145573+0000","last_unstale":"2023-07-09T02:16:19.130195+0000","last_undegraded":"2023-07-09T02:16:19.130195+0000","last_fullsized":"2023-07-09T02:16:19.130195+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:08:57.875104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128306+0000","last_change":"2023-07-09T02:16:17.129060+0000","last_active":"2023-07-09T02:16:19.128306+0000","last_peered":"2023-07-09T02:16:19.128306+0000","last_clean":"2023-07-09T02:16:19.128306+0000","last_became_active":"2023-07-09T02:16:17.128762+0000","last_became_peered":"2023-07-09T02:16:17.128762+0000","last_unstale":"2023-07-09T02:16:19.128306+0000","last_undegraded":"2023-07-09T02:16:19.128306+0000","last_fullsized":"2023-07-09T02:16:19.128306+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:32:07.978197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305533+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:16:19.305533+0000","last_peered":"2023-07-09T02:16:19.305533+0000","last_clean":"2023-07-09T02:16:19.305533+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:16:19.305533+0000","last_undegraded":"2023-07-09T02:16:19.305533+0000","last_fullsized":"2023-07-09T02:16:19.305533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:25:33.234615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128769+0000","last_change":"2023-07-09T02:16:18.128955+0000","last_active":"2023-07-09T02:16:19.128769+0000","last_peered":"2023-07-09T02:16:19.128769+0000","last_clean":"2023-07-09T02:16:19.128769+0000","last_became_active":"2023-07-09T02:16:18.128767+0000","last_became_peered":"2023-07-09T02:16:18.128767+0000","last_unstale":"2023-07-09T02:16:19.128769+0000","last_undegraded":"2023-07-09T02:16:19.128769+0000","last_fullsized":"2023-07-09T02:16:19.128769+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:09:24.114793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305165+0000","last_change":"2023-07-09T02:16:17.131065+0000","last_active":"2023-07-09T02:16:19.305165+0000","last_peered":"2023-07-09T02:16:19.305165+0000","last_clean":"2023-07-09T02:16:19.305165+0000","last_became_active":"2023-07-09T02:16:17.130818+0000","last_became_peered":"2023-07-09T02:16:17.130818+0000","last_unstale":"2023-07-09T02:16:19.305165+0000","last_undegraded":"2023-07-09T02:16:19.305165+0000","last_fullsized":"2023-07-09T02:16:19.305165+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:56:19.312740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299471+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:16:19.299471+0000","last_peered":"2023-07-09T02:16:19.299471+0000","last_clean":"2023-07-09T02:16:19.299471+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:16:19.299471+0000","last_undegraded":"2023-07-09T02:16:19.299471+0000","last_fullsized":"2023-07-09T02:16:19.299471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:39:05.250361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128230+0000","last_change":"2023-07-09T02:16:18.139819+0000","last_active":"2023-07-09T02:16:19.128230+0000","last_peered":"2023-07-09T02:16:19.128230+0000","last_clean":"2023-07-09T02:16:19.128230+0000","last_became_active":"2023-07-09T02:16:18.139551+0000","last_became_peered":"2023-07-09T02:16:18.139551+0000","last_unstale":"2023-07-09T02:16:19.128230+0000","last_undegraded":"2023-07-09T02:16:19.128230+0000","last_fullsized":"2023-07-09T02:16:19.128230+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:20:56.684376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.128836+0000","last_change":"2023-07-09T02:16:17.125676+0000","last_active":"2023-07-09T02:16:19.128836+0000","last_peered":"2023-07-09T02:16:19.128836+0000","last_clean":"2023-07-09T02:16:19.128836+0000","last_became_active":"2023-07-09T02:16:17.125408+0000","last_became_peered":"2023-07-09T02:16:17.125408+0000","last_unstale":"2023-07-09T02:16:19.128836+0000","last_undegraded":"2023-07-09T02:16:19.128836+0000","last_fullsized":"2023-07-09T02:16:19.128836+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:39:17.778903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305885+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:16:19.305885+0000","last_peered":"2023-07-09T02:16:19.305885+0000","last_clean":"2023-07-09T02:16:19.305885+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:16:19.305885+0000","last_undegraded":"2023-07-09T02:16:19.305885+0000","last_fullsized":"2023-07-09T02:16:19.305885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:12:09.937740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.130311+0000","last_change":"2023-07-09T02:16:18.136498+0000","last_active":"2023-07-09T02:16:19.130311+0000","last_peered":"2023-07-09T02:16:19.130311+0000","last_clean":"2023-07-09T02:16:19.130311+0000","last_became_active":"2023-07-09T02:16:18.135374+0000","last_became_peered":"2023-07-09T02:16:18.135374+0000","last_unstale":"2023-07-09T02:16:19.130311+0000","last_undegraded":"2023-07-09T02:16:19.130311+0000","last_fullsized":"2023-07-09T02:16:19.130311+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:17.115247+0000","last_clean_scrub_stamp":"2023-07-09T02:16:17.115247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:37:32.370659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.305487+0000","last_change":"2023-07-09T02:16:17.132887+0000","last_active":"2023-07-09T02:16:19.305487+0000","last_peered":"2023-07-09T02:16:19.305487+0000","last_clean":"2023-07-09T02:16:19.305487+0000","last_became_active":"2023-07-09T02:16:17.132527+0000","last_became_peered":"2023-07-09T02:16:17.132527+0000","last_unstale":"2023-07-09T02:16:19.305487+0000","last_undegraded":"2023-07-09T02:16:19.305487+0000","last_fullsized":"2023-07-09T02:16:19.305487+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:16:16.107744+0000","last_clean_scrub_stamp":"2023-07-09T02:16:16.107744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:06:23.524465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-07-09T02:16:19.299288+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:16:19.299288+0000","last_peered":"2023-07-09T02:16:19.299288+0000","last_clean":"2023-07-09T02:16:19.299288+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:16:19.299288+0000","last_undegraded":"2023-07-09T02:16:19.299288+0000","last_fullsized":"2023-07-09T02:16:19.299288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:20.975752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1177,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194134,"statfs":{"total":200000000,"available":198794172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.204,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":1.423,"15min":1.423},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.032,"15min":0.80000000000000004},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.117,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.028,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.755},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.97899999999999998,"15min":0.80900000000000005},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93999999999999995,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.68000000000000005}]},{"osd":3,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84199999999999997,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.242,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.77300000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78600000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.38700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.94999999999999996,"5min":1.048,"15min":1.048},"last":0.42799999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.87,"5min":1.087,"15min":1.087},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.46700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":603,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194709,"statfs":{"total":200000000,"available":199382428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70099999999999996,"15min":0.71499999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.97499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70399999999999996,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86899999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88,"5min":1.165,"15min":1.165},"last":0.82399999999999995}]},{"osd":2,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.71499999999999997,"15min":0.68899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0169999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.749}]},{"osd":3,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72699999999999998,"15min":0.70799999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88800000000000001,"5min":1.45,"15min":1.45},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69399999999999995,"15min":0.70099999999999996},"min":{"1min":0.56000000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82699999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.72699999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88900000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.48699999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96799999999999997,"5min":1.117,"15min":1.117},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61599999999999999,"15min":0.64000000000000001},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85699999999999998,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:16:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95599999999999996,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48999999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91000000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384596,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.63500000000000001},"min":{"1min":0.44700000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":1.179,"15min":1.179},"last":0.77600000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.65700000000000003},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67800000000000005,"15min":0.65200000000000002},"min":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80100000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69199999999999995}]},{"osd":2,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.92400000000000004,"5min":1.103,"15min":1.103},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69799999999999995,"15min":0.68400000000000005},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89900000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71799999999999997,"15min":0.69499999999999995},"min":{"1min":0.52200000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.875,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.56299999999999994,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59099999999999997,"15min":0.60799999999999998},"min":{"1min":0.39400000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.88700000000000001,"5min":1.008,"15min":1.008},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61899999999999999,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.81299999999999994}]},{"osd":6,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.629},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89700000000000002,"5min":1.054,"15min":1.054},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.70299999999999996},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95599999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76200000000000001,"15min":0.754},"min":{"1min":0.53100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97299999999999998,"5min":1.091,"15min":1.091},"last":0.754}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":601,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384436,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":1.2529999999999999,"15min":0.85499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.89000000000000001,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65800000000000003,"15min":0.67400000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.873,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84199999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.008,"5min":1.323,"15min":1.323},"last":0.73599999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90600000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.518,"15min":0.94399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85899999999999999,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.94699999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.64700000000000002},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41099999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68000000000000005,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80500000000000005,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.70699999999999996},"min":{"1min":0.45200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.48799999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93899999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78200000000000003,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92700000000000005,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.58799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384596,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.26400000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.198,"15min":1.198},"last":0.439}]},{"osd":1,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":1.048,"15min":1.048},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.32500000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":1.155,"15min":1.155},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0229999999999999,"5min":1.302,"15min":1.302},"last":1.27},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75600000000000001,"15min":0.70599999999999996},"min":{"1min":0.56599999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.006,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.71899999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0940000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97799999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.56000000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0569999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.228,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.748}]},{"osd":7,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.58099999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1359999999999999,"5min":1.367,"15min":1.367},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.76900000000000002},"min":{"1min":0.67400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95299999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384596,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51600000000000001,"15min":0.432},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61099999999999999,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.437,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.57199999999999995,"5min":1.127,"15min":1.127},"last":0.51900000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48199999999999998,"15min":0.46500000000000002},"min":{"1min":0.34100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60099999999999998,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.52100000000000002},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.67600000000000005,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.44700000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.5},"min":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57999999999999996,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81999999999999995,"15min":0.755},"min":{"1min":0.47199999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90100000000000002,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.627},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.71599999999999997},"min":{"1min":0.51400000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.161,"15min":1.161},"last":0.77900000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74199999999999999,"15min":0.72199999999999998},"min":{"1min":0.51100000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.004,"5min":1.319,"15min":1.319},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.83399999999999996,"15min":0.77500000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94999999999999996,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79300000000000004,"15min":0.76600000000000001},"min":{"1min":0.60299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.075,"5min":1.101,"15min":1.101},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.82899999999999996,"15min":0.80800000000000005},"min":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0580000000000001,"5min":1.452,"15min":1.452},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.754,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.056,"5min":1.208,"15min":1.208},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77400000000000002,"15min":0.77200000000000002},"min":{"1min":0.55300000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97099999999999997,"5min":1.351,"15min":1.351},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":601,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.46200000000000002},"min":{"1min":0.308,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54500000000000004}]},{"osd":2,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.501,"15min":0.496},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68600000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.621},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":1.163,"15min":1.163},"last":0.58899999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.026,"15min":1.026},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77800000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.745,"15min":0.72699999999999998},"min":{"1min":0.53400000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95999999999999996,"5min":1.034,"15min":1.034},"last":0.75800000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.80000000000000004,"15min":0.78100000000000003},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0900000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78000000000000003,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0229999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98199999999999998,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1179,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194132,"statfs":{"total":200000000,"available":198791958,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.41699999999999998},"min":{"1min":0.26300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.627,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.503,"15min":0.46700000000000003},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.36699999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59299999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47299999999999998,"15min":0.443},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.32800000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.443,"15min":0.41499999999999998},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60599999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.53900000000000003,"15min":0.502},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.626,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.145,"15min":1.145},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.153,"15min":1.153},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0669999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.504,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.238,"15min":1.238},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93899999999999995,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.53800000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0389999999999999,"5min":1.472,"15min":1.472},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54700000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98299999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.627}]}]}],"pool_statfs":[]}} 2023-07-09T02:16:22.640 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:16:22.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:16:22.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4c4a0b640 1 Processor -- start 2023-07-09T02:16:22.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4c4a0b640 1 -- start start 2023-07-09T02:16:22.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4c4a0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4c00b3f70 0x7fc4c006bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4c4a0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc4c00ce640 0x7fc4c00ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4c4a0b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c00cefe0 con 0x7fc4c01598e0 2023-07-09T02:16:22.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4c4a0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c0071170 con 0x7fc4c00b3f70 2023-07-09T02:16:22.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4c4a0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c00b4340 con 0x7fc4c00ce640 2023-07-09T02:16:22.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4be59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4c00b3f70 0x7fc4c006bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4bed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc4c01598e0 0x7fc4c0159d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55100/0 (socket says 172.21.15.45:55100) 2023-07-09T02:16:22.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4bed9d640 1 -- 172.21.15.45:0/3975694540 learned_addr learned my addr 172.21.15.45:0/3975694540 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:22.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4bdd9b640 1 --2- 172.21.15.45:0/3975694540 >> v2:172.21.15.155:3300/0 conn(0x7fc4c00ce640 0x7fc4c00ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4be59c640 1 -- 172.21.15.45:0/3975694540 >> v2:172.21.15.155:3300/0 conn(0x7fc4c00ce640 msgr2=0x7fc4c00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:22.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4be59c640 1 --2- 172.21.15.45:0/3975694540 >> v2:172.21.15.155:3300/0 conn(0x7fc4c00ce640 0x7fc4c00ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4be59c640 1 -- 172.21.15.45:0/3975694540 >> v1:172.21.15.45:6789/0 conn(0x7fc4c01598e0 legacy=0x7fc4c0159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.829+0000 7fc4be59c640 1 -- 172.21.15.45:0/3975694540 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c015a610 con 0x7fc4c00b3f70 2023-07-09T02:16:22.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4be59c640 1 --2- 172.21.15.45:0/3975694540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00b3f70 0x7fc4c006bbc0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00c2140 tx=0x7fc4b001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9481448d13ab7e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4bd59a640 1 -- 172.21.15.45:0/3975694540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00a7c00 con 0x7fc4c00b3f70 2023-07-09T02:16:22.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4bd59a640 1 -- 172.21.15.45:0/3975694540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b00a7d60 con 0x7fc4c00b3f70 2023-07-09T02:16:22.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4bd59a640 1 -- 172.21.15.45:0/3975694540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00af660 con 0x7fc4c00b3f70 2023-07-09T02:16:22.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/3975694540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00b3f70 msgr2=0x7fc4c006bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/3975694540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00b3f70 0x7fc4c006bbc0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00c2140 tx=0x7fc4b001eb30 comp rx=0 tx=0).stop 2023-07-09T02:16:22.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/3975694540 shutdown_connections 2023-07-09T02:16:22.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/3975694540 >> v2:172.21.15.155:3300/0 conn(0x7fc4c00ce640 0x7fc4c00ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/3975694540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c00b3f70 0x7fc4c006bbc0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/3975694540 >> 172.21.15.45:0/3975694540 conn(0x7fc4c00694b0 msgr2=0x7fc4c00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:22.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/3975694540 shutdown_connections 2023-07-09T02:16:22.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.833+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/3975694540 wait complete. 2023-07-09T02:16:22.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 Processor -- start 2023-07-09T02:16:22.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 -- start start 2023-07-09T02:16:22.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4c00b3f70 0x7fc4c00c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4c00ce640 0x7fc4c00c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c01598e0 0x7fc4c00aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00c4b00 con 0x7fc4c01598e0 2023-07-09T02:16:22.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00c8b60 con 0x7fc4c00ce640 2023-07-09T02:16:22.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c00c85a0 con 0x7fc4c00b3f70 2023-07-09T02:16:22.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c01598e0 0x7fc4c00aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c01598e0 0x7fc4c00aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50014/0 (socket says 172.21.15.45:50014) 2023-07-09T02:16:22.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 -- 172.21.15.45:0/1587797769 learned_addr learned my addr 172.21.15.45:0/1587797769 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:22.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4be59c640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4c00b3f70 0x7fc4c00c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bdd9b640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4c00ce640 0x7fc4c00c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 -- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4c00b3f70 msgr2=0x7fc4c00c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4c00b3f70 0x7fc4c00c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 -- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4c00ce640 msgr2=0x7fc4c00c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4c00ce640 0x7fc4c00c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 -- 172.21.15.45:0/1587797769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b000b6c0 con 0x7fc4c01598e0 2023-07-09T02:16:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bdd9b640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4c00ce640 0x7fc4c00c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4be59c640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4c00b3f70 0x7fc4c00c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4bed9d640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c01598e0 0x7fc4c00aea40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800ca80 tx=0x7fc4b800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4aeffd640 1 -- 172.21.15.45:0/1587797769 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800ac30 con 0x7fc4c01598e0 2023-07-09T02:16:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4aeffd640 1 -- 172.21.15.45:0/1587797769 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b800ad90 con 0x7fc4c01598e0 2023-07-09T02:16:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4aeffd640 1 -- 172.21.15.45:0/1587797769 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8012600 con 0x7fc4c01598e0 2023-07-09T02:16:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c00c8880 con 0x7fc4c01598e0 2023-07-09T02:16:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c0141620 con 0x7fc4c01598e0 2023-07-09T02:16:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.837+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c01411a0 con 0x7fc4c01598e0 2023-07-09T02:16:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.841+0000 7fc4aeffd640 1 -- 172.21.15.45:0/1587797769 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4b8007070 con 0x7fc4c01598e0 2023-07-09T02:16:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.841+0000 7fc4aeffd640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc4a0066280 0x7fc4a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.841+0000 7fc4aeffd640 1 -- 172.21.15.45:0/1587797769 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4b8083ac0 con 0x7fc4c01598e0 2023-07-09T02:16:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.841+0000 7fc4be59c640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc4a0066280 0x7fc4a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.841+0000 7fc4be59c640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc4a0066280 0x7fc4a0068730 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00b1000 tx=0x7fc4b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:22.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:22.845+0000 7fc4aeffd640 1 -- 172.21.15.45:0/1587797769 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4c01411a0 con 0x7fc4c01598e0 2023-07-09T02:16:23.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.053+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc4c01411a0 con 0x7fc4c01598e0 2023-07-09T02:16:23.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4aeffd640 1 -- 172.21.15.45:0/1587797769 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc4b8083e60 con 0x7fc4c01598e0 2023-07-09T02:16:23.061 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:16:23.061 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:16:23.061 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:16:23.061 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:16:23.061 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:16:23.062 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:16:23.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc4a0066280 msgr2=0x7fc4a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:23.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc4a0066280 0x7fc4a0068730 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00b1000 tx=0x7fc4b0008040 comp rx=0 tx=0).stop 2023-07-09T02:16:23.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c01598e0 msgr2=0x7fc4c00aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:23.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c01598e0 0x7fc4c00aea40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800ca80 tx=0x7fc4b800cf40 comp rx=0 tx=0).stop 2023-07-09T02:16:23.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 shutdown_connections 2023-07-09T02:16:23.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4c01598e0 0x7fc4c00aea40 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4c00ce640 0x7fc4c00c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc4a0066280 0x7fc4a0068730 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 --2- 172.21.15.45:0/1587797769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4c00b3f70 0x7fc4c00c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 >> 172.21.15.45:0/1587797769 conn(0x7fc4c00694b0 msgr2=0x7fc4c00cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:23.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 shutdown_connections 2023-07-09T02:16:23.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.061+0000 7fc4c4a0b640 1 -- 172.21.15.45:0/1587797769 wait complete. 2023-07-09T02:16:23.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:23.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f4440740640 1 Processor -- start 2023-07-09T02:16:23.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f4440740640 1 -- start start 2023-07-09T02:16:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f4440740640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f44380d2620 0x7f44380b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f4440740640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f44380cd120 0x7f44380cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:23.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f4440740640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4438160a50 con 0x7f443815c060 2023-07-09T02:16:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f4440740640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443815c430 con 0x7f44380d2620 2023-07-09T02:16:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f4440740640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443815fb60 con 0x7f44380cd120 2023-07-09T02:16:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443dcdb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f44380d2620 0x7f44380b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443dcdb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f44380d2620 0x7f44380b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50028/0 (socket says 172.21.15.45:50028) 2023-07-09T02:16:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443dcdb640 1 -- 172.21.15.45:0/2278260181 learned_addr learned my addr 172.21.15.45:0/2278260181 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443ecdd640 1 --2- 172.21.15.45:0/2278260181 >> v2:172.21.15.155:3300/0 conn(0x7f44380cd120 0x7f44380cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443dcdb640 1 -- 172.21.15.45:0/2278260181 >> v2:172.21.15.155:3300/0 conn(0x7f44380cd120 msgr2=0x7f44380cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443dcdb640 1 --2- 172.21.15.45:0/2278260181 >> v2:172.21.15.155:3300/0 conn(0x7f44380cd120 0x7f44380cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443dcdb640 1 -- 172.21.15.45:0/2278260181 >> v1:172.21.15.155:6789/0 conn(0x7f443815c060 legacy=0x7f44380d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443dcdb640 1 -- 172.21.15.45:0/2278260181 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443815fe40 con 0x7f44380d2620 2023-07-09T02:16:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.225+0000 7f443ecdd640 1 --2- 172.21.15.45:0/2278260181 >> v2:172.21.15.155:3300/0 conn(0x7f44380cd120 0x7f44380cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f443dcdb640 1 --2- 172.21.15.45:0/2278260181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44380d2620 0x7f44380b4ed0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f443806b120 tx=0x7f442801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b64b4c2939d7e20 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f443d4da640 1 -- 172.21.15.45:0/2278260181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280aa430 con 0x7f44380d2620 2023-07-09T02:16:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f443d4da640 1 -- 172.21.15.45:0/2278260181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44280aa590 con 0x7f44380d2620 2023-07-09T02:16:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f443d4da640 1 -- 172.21.15.45:0/2278260181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280aa920 con 0x7f44380d2620 2023-07-09T02:16:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f4440740640 1 -- 172.21.15.45:0/2278260181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44380d2620 msgr2=0x7f44380b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f4440740640 1 --2- 172.21.15.45:0/2278260181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44380d2620 0x7f44380b4ed0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f443806b120 tx=0x7f442801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f4440740640 1 -- 172.21.15.45:0/2278260181 shutdown_connections 2023-07-09T02:16:23.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f4440740640 1 --2- 172.21.15.45:0/2278260181 >> v2:172.21.15.155:3300/0 conn(0x7f44380cd120 0x7f44380cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f4440740640 1 --2- 172.21.15.45:0/2278260181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44380d2620 0x7f44380b4ed0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f4440740640 1 -- 172.21.15.45:0/2278260181 >> 172.21.15.45:0/2278260181 conn(0x7f44380698e0 msgr2=0x7f4438069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f4440740640 1 -- 172.21.15.45:0/2278260181 shutdown_connections 2023-07-09T02:16:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.229+0000 7f4440740640 1 -- 172.21.15.45:0/2278260181 wait complete. 2023-07-09T02:16:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 Processor -- start 2023-07-09T02:16:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 -- start start 2023-07-09T02:16:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44380cd120 0x7f44380c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44380d2620 0x7f44380b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f443815c060 0x7f4438159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44380b4800 con 0x7f443815c060 2023-07-09T02:16:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44380b4ae0 con 0x7f44380d2620 2023-07-09T02:16:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44380b4dc0 con 0x7f44380cd120 2023-07-09T02:16:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f443815c060 0x7f4438159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f443815c060 0x7f4438159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50038/0 (socket says 172.21.15.45:50038) 2023-07-09T02:16:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 -- 172.21.15.45:0/1807759803 learned_addr learned my addr 172.21.15.45:0/1807759803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443dcdb640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44380d2620 0x7f44380b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443e4dc640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44380cd120 0x7f44380c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 -- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44380cd120 msgr2=0x7f44380c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44380cd120 0x7f44380c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 -- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44380d2620 msgr2=0x7f44380b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44380d2620 0x7f44380b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 -- 172.21.15.45:0/1807759803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280094d0 con 0x7f443815c060 2023-07-09T02:16:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f443ecdd640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f443815c060 0x7f4438159e80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f4430007ef0 tx=0x7f443000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f442effd640 1 -- 172.21.15.45:0/1807759803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430003ba0 con 0x7f443815c060 2023-07-09T02:16:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f442effd640 1 -- 172.21.15.45:0/1807759803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443000f040 con 0x7f443815c060 2023-07-09T02:16:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f442effd640 1 -- 172.21.15.45:0/1807759803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000de80 con 0x7f443815c060 2023-07-09T02:16:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44380b59f0 con 0x7f443815c060 2023-07-09T02:16:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.233+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443813e880 con 0x7f443815c060 2023-07-09T02:16:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.237+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443804d7d0 con 0x7f443815c060 2023-07-09T02:16:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.237+0000 7f442effd640 1 -- 172.21.15.45:0/1807759803 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4430004030 con 0x7f443815c060 2023-07-09T02:16:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.237+0000 7f442effd640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f441c066280 0x7f441c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.237+0000 7f442effd640 1 -- 172.21.15.45:0/1807759803 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4430084070 con 0x7f443815c060 2023-07-09T02:16:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.237+0000 7f443e4dc640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f441c066280 0x7f441c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.237+0000 7f443e4dc640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f441c066280 0x7f441c068730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f44380b37d0 tx=0x7f4434009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.241+0000 7f442effd640 1 -- 172.21.15.45:0/1807759803 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44300b4700 con 0x7f443815c060 2023-07-09T02:16:23.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.425+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44380b1d70 con 0x7f443815c060 2023-07-09T02:16:23.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.425+0000 7f442effd640 1 -- 172.21.15.45:0/1807759803 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f443001a090 con 0x7f443815c060 2023-07-09T02:16:23.428 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:23.428 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:23.429 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f441c066280 msgr2=0x7f441c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f441c066280 0x7f441c068730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f44380b37d0 tx=0x7f4434009040 comp rx=0 tx=0).stop 2023-07-09T02:16:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f443815c060 msgr2=0x7f4438159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f443815c060 0x7f4438159e80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f4430007ef0 tx=0x7f443000d4a0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 shutdown_connections 2023-07-09T02:16:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f443815c060 0x7f4438159e80 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44380d2620 0x7f44380b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f441c066280 0x7f441c068730 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 --2- 172.21.15.45:0/1807759803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44380cd120 0x7f44380c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 >> 172.21.15.45:0/1807759803 conn(0x7f44380698e0 msgr2=0x7f4438154780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 shutdown_connections 2023-07-09T02:16:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.429+0000 7f4440740640 1 -- 172.21.15.45:0/1807759803 wait complete. 2023-07-09T02:16:23.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:16:17.518574+0000', 'modified': '2023-07-09T02:16:21.158853+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6939}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6939': {'gid': 6939, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/4289227998', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 4289227998}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 4289227998}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:16:23.852 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:16:23.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-09T02:16:23.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.997+0000 7fa40bf3a640 1 Processor -- start 2023-07-09T02:16:23.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.997+0000 7fa40bf3a640 1 -- start start 2023-07-09T02:16:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.997+0000 7fa40bf3a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa40415c060 0x7fa4040b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:23.997+0000 7fa40bf3a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4040cd120 0x7fa4040d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa40bf3a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa404160a50 con 0x7fa4040d2450 2023-07-09T02:16:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa40bf3a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4040d28d0 con 0x7fa40415c060 2023-07-09T02:16:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa40bf3a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4040cfe40 con 0x7fa4040cd120 2023-07-09T02:16:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa409cd6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa40415c060 0x7fa4040b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa409cd6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa40415c060 0x7fa4040b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50042/0 (socket says 172.21.15.45:50042) 2023-07-09T02:16:24.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa409cd6640 1 -- 172.21.15.45:0/42621994 learned_addr learned my addr 172.21.15.45:0/42621994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa4094d5640 1 --2- 172.21.15.45:0/42621994 >> v2:172.21.15.155:3300/0 conn(0x7fa4040cd120 0x7fa4040d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa409cd6640 1 -- 172.21.15.45:0/42621994 >> v2:172.21.15.155:3300/0 conn(0x7fa4040cd120 msgr2=0x7fa4040d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa409cd6640 1 --2- 172.21.15.45:0/42621994 >> v2:172.21.15.155:3300/0 conn(0x7fa4040cd120 0x7fa4040d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa409cd6640 1 -- 172.21.15.45:0/42621994 >> v1:172.21.15.155:6789/0 conn(0x7fa4040d2450 legacy=0x7fa4040d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa409cd6640 1 -- 172.21.15.45:0/42621994 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40415c430 con 0x7fa40415c060 2023-07-09T02:16:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa409cd6640 1 --2- 172.21.15.45:0/42621994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40415c060 0x7fa4040b4ed0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa40415fac0 tx=0x7fa40001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89337030fb49d971 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa408cd4640 1 -- 172.21.15.45:0/42621994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000ac410 con 0x7fa40415c060 2023-07-09T02:16:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa408cd4640 1 -- 172.21.15.45:0/42621994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4000ac570 con 0x7fa40415c060 2023-07-09T02:16:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.001+0000 7fa408cd4640 1 -- 172.21.15.45:0/42621994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000ac900 con 0x7fa40415c060 2023-07-09T02:16:24.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- 172.21.15.45:0/42621994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40415c060 msgr2=0x7fa4040b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/42621994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40415c060 0x7fa4040b4ed0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa40415fac0 tx=0x7fa40001c490 comp rx=0 tx=0).stop 2023-07-09T02:16:24.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- 172.21.15.45:0/42621994 shutdown_connections 2023-07-09T02:16:24.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/42621994 >> v2:172.21.15.155:3300/0 conn(0x7fa4040cd120 0x7fa4040d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/42621994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa40415c060 0x7fa4040b4ed0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- 172.21.15.45:0/42621994 >> 172.21.15.45:0/42621994 conn(0x7fa4040698e0 msgr2=0x7fa404069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:24.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- 172.21.15.45:0/42621994 shutdown_connections 2023-07-09T02:16:24.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- 172.21.15.45:0/42621994 wait complete. 2023-07-09T02:16:24.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 Processor -- start 2023-07-09T02:16:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- start start 2023-07-09T02:16:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4040cd120 0x7fa40415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4040d2450 0x7fa40415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40415c060 0x7fa4040b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040b3860 con 0x7fa4040cd120 2023-07-09T02:16:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40415cba0 con 0x7fa4040d2450 2023-07-09T02:16:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40bf3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040b29d0 con 0x7fa40415c060 2023-07-09T02:16:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa409cd6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4040cd120 0x7fa40415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa409cd6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4040cd120 0x7fa40415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50044/0 (socket says 172.21.15.45:50044) 2023-07-09T02:16:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa409cd6640 1 -- 172.21.15.45:0/3583518169 learned_addr learned my addr 172.21.15.45:0/3583518169 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa4094d5640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4040d2450 0x7fa40415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.005+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40415c060 0x7fa4040b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa409cd6640 1 -- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40415c060 msgr2=0x7fa4040b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa409cd6640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40415c060 0x7fa4040b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa409cd6640 1 -- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4040d2450 msgr2=0x7fa40415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa409cd6640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4040d2450 0x7fa40415d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa409cd6640 1 -- 172.21.15.45:0/3583518169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4000094d0 con 0x7fa4040cd120 2023-07-09T02:16:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa409cd6640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4040cd120 0x7fa40415c660 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa4000af040 tx=0x7fa400019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa3fa7fc640 1 -- 172.21.15.45:0/3583518169 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000ac410 con 0x7fa4040cd120 2023-07-09T02:16:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa3fa7fc640 1 -- 172.21.15.45:0/3583518169 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4000b5630 con 0x7fa4040cd120 2023-07-09T02:16:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa3fa7fc640 1 -- 172.21.15.45:0/3583518169 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000acea0 con 0x7fa4040cd120 2023-07-09T02:16:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa40bf3a640 1 -- 172.21.15.45:0/3583518169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4040b2cb0 con 0x7fa4040cd120 2023-07-09T02:16:24.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa40bf3a640 1 -- 172.21.15.45:0/3583518169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4040b3270 con 0x7fa4040cd120 2023-07-09T02:16:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa3fa7fc640 1 -- 172.21.15.45:0/3583518169 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4000b3070 con 0x7fa4040cd120 2023-07-09T02:16:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.009+0000 7fa3fa7fc640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3e80662b0 0x7fa3e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa3fa7fc640 1 -- 172.21.15.45:0/3583518169 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa40011e290 con 0x7fa4040cd120 2023-07-09T02:16:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa4094d5640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3e80662b0 0x7fa3e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 Processor -- start 2023-07-09T02:16:24.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- start start 2023-07-09T02:16:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa4094d5640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3e80662b0 0x7fa3e8068760 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa4041545e0 tx=0x7fa3f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739173bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739174110 0x55f739129a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739129f90 0x55f73912a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f738ff0f80 con 0x55f739129f90 2023-07-09T02:16:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f738f2ac60 con 0x55f739174110 2023-07-09T02:16:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f738f7e700 con 0x55f739173800 2023-07-09T02:16:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739129f90 0x55f73912a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739129f90 0x55f73912a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50048/0 (socket says 172.21.15.45:50048) 2023-07-09T02:16:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 -- 172.21.15.45:0/1628407548 learned_addr learned my addr 172.21.15.45:0/1628407548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa409cd6640 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739173bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa4094d5640 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739174110 0x55f739129a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 -- 172.21.15.45:0/1628407548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 msgr2=0x55f739173bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739173bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 -- 172.21.15.45:0/1628407548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739174110 msgr2=0x55f739129a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739174110 0x55f739129a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 -- 172.21.15.45:0/1628407548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f738c73890 con 0x55f739129f90 2023-07-09T02:16:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739129f90 0x55f73912a360 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc005420 tx=0x7fa3fc005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dfeca900d7a77f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1628407548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc006d70 con 0x55f739129f90 2023-07-09T02:16:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1628407548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc00e800 con 0x55f739129f90 2023-07-09T02:16:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1628407548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00ebb0 con 0x55f739129f90 2023-07-09T02:16:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- 172.21.15.45:0/1628407548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739129f90 msgr2=0x55f73912a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739129f90 0x55f73912a360 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc005420 tx=0x7fa3fc005820 comp rx=0 tx=0).stop 2023-07-09T02:16:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- 172.21.15.45:0/1628407548 shutdown_connections 2023-07-09T02:16:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739129f90 0x55f73912a360 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739174110 0x55f739129a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/1628407548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739173bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- 172.21.15.45:0/1628407548 >> 172.21.15.45:0/1628407548 conn(0x55f738feca70 msgr2=0x55f739128330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- 172.21.15.45:0/1628407548 shutdown_connections 2023-07-09T02:16:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.013+0000 7fa40f2ac000 1 -- 172.21.15.45:0/1628407548 wait complete. 2023-07-09T02:16:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 -- start start 2023-07-09T02:16:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 Processor -- start 2023-07-09T02:16:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f739134df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739173800 0x55f739135330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739174110 0x55f739135870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f738f777a0 con 0x55f739173800 2023-07-09T02:16:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f738f33f00 con 0x55f739129f90 2023-07-09T02:16:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f738f33ba0 con 0x55f739174110 2023-07-09T02:16:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 10 client.0 _ll_register_callbacks cb 0x55f739115930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:16:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739173800 0x55f739135330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739173800 0x55f739135330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50058/0 (socket says 172.21.15.45:50058) 2023-07-09T02:16:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 -- 172.21.15.45:0/3009509300 learned_addr learned my addr 172.21.15.45:0/3009509300 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa409cd6640 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f739134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739174110 0x55f739135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 -- 172.21.15.45:0/3009509300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739174110 msgr2=0x55f739135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739174110 0x55f739135870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 -- 172.21.15.45:0/3009509300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 msgr2=0x55f739134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f739134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 -- 172.21.15.45:0/3009509300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc00f040 con 0x55f739173800 2023-07-09T02:16:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa4094d5640 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739173800 0x55f739135330 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4016800 tx=0x7fa3f40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3072e9384e9008d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa3e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:16:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/3009509300 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40149b0 con 0x55f739173800 2023-07-09T02:16:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3009509300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f738f760f0 con 0x55f739173800 2023-07-09T02:16:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/3009509300 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3f4014b10 con 0x55f739173800 2023-07-09T02:16:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/3009509300 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3f4014cd0 con 0x55f739173800 2023-07-09T02:16:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 10 client.7074 fetch_fsmap learned FSMap version 51 2023-07-09T02:16:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3009509300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55f738f3c130 con 0x55f739173800 2023-07-09T02:16:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/3009509300 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f738f760f0 con 0x55f739173800 2023-07-09T02:16:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/3009509300 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa3f402b440 con 0x55f739173800 2023-07-09T02:16:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 10 client.7074 fetch_fsmap finished waiting for FSMap version 51 2023-07-09T02:16:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 10 client.7074 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T02:16:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 20 client.7074 populate_metadata read hostname 'smithi045' 2023-07-09T02:16:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] conn(0x55f739182870 0x55f739184c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 4 client.7074 mds_command: new command op to 6939 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:16:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3009509300 --> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f738f3ee40 con 0x55f739182870 2023-07-09T02:16:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.017+0000 7fa409cd6640 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] conn(0x55f739182870 0x55f739184c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa409cd6640 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] conn(0x55f739182870 0x55f739184c50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a96ca6b992c869e server_cookie=ef714f73326c97fc in_seq=0 out_seq=0 2023-07-09T02:16:24.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa3e4ff9640 10 client.7074 ms_handle_connect on v2:172.21.15.45:6833/4289227998 2023-07-09T02:16:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/3009509300 <== mds.0 v2:172.21.15.45:6833/4289227998 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f738f3ee40 con 0x55f739182870 2023-07-09T02:16:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa3e4ff9640 10 client.7074 handle_command_reply: tid=0 2023-07-09T02:16:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 client.7074 shutdown 2023-07-09T02:16:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3009509300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739173800 msgr2=0x55f739135330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739173800 0x55f739135330 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4016800 tx=0x7fa3f40046d0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3009509300 shutdown_connections 2023-07-09T02:16:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739174110 0x55f739135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739173800 0x55f739135330 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] conn(0x55f739182870 0x55f739184c50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3009509300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f739134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3009509300 >> 172.21.15.45:0/3009509300 conn(0x55f738feca70 msgr2=0x55f739128a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa3e4ff9640 0 client.7074 ms_handle_reset on v2:172.21.15.45:6833/4289227998 2023-07-09T02:16:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3009509300 shutdown_connections 2023-07-09T02:16:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3009509300 wait complete. 2023-07-09T02:16:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.021+0000 7fa40f2ac000 20 client.7074 trim_cache size 0 max 16384 2023-07-09T02:16:24.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 Processor -- start 2023-07-09T02:16:24.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- start start 2023-07-09T02:16:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f739173050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739186370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f7391868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f738c34940 con 0x55f739174110 2023-07-09T02:16:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f738f74ba0 con 0x55f739129f90 2023-07-09T02:16:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f738f76630 con 0x55f739173800 2023-07-09T02:16:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f7391868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f7391868b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50062/0 (socket says 172.21.15.45:50062) 2023-07-09T02:16:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 -- 172.21.15.45:0/3146263916 learned_addr learned my addr 172.21.15.45:0/3146263916 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa4094d5640 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739186370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa409cd6640 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f739173050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 -- 172.21.15.45:0/3146263916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 msgr2=0x55f739186370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739186370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 -- 172.21.15.45:0/3146263916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 msgr2=0x55f739173050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f739173050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 -- 172.21.15.45:0/3146263916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f738f223c0 con 0x55f739174110 2023-07-09T02:16:24.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f7391868b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc015040 tx=0x7fa3fc00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91a180dbbdd9da4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa3e7fff640 1 -- 172.21.15.45:0/3146263916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc022070 con 0x55f739174110 2023-07-09T02:16:24.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa3e7fff640 1 -- 172.21.15.45:0/3146263916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc00e800 con 0x55f739174110 2023-07-09T02:16:24.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa3e7fff640 1 -- 172.21.15.45:0/3146263916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc007ea0 con 0x55f739174110 2023-07-09T02:16:24.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3146263916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 msgr2=0x55f7391868b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f7391868b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc015040 tx=0x7fa3fc00a000 comp rx=0 tx=0).stop 2023-07-09T02:16:24.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3146263916 shutdown_connections 2023-07-09T02:16:24.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f7391868b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739186370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/3146263916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f739173050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3146263916 >> 172.21.15.45:0/3146263916 conn(0x55f738feca70 msgr2=0x55f739184c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:24.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3146263916 shutdown_connections 2023-07-09T02:16:24.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.037+0000 7fa40f2ac000 1 -- 172.21.15.45:0/3146263916 wait complete. 2023-07-09T02:16:24.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 -- start start 2023-07-09T02:16:24.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 Processor -- start 2023-07-09T02:16:24.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f7391ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739170f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f739171460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f738f46740 con 0x55f739174110 2023-07-09T02:16:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f738f43760 con 0x55f739129f90 2023-07-09T02:16:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f738f71aa0 con 0x55f739173800 2023-07-09T02:16:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 10 client.0 _ll_register_callbacks cb 0x55f7390f64d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:16:24.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f739171460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f739171460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50070/0 (socket says 172.21.15.45:50070) 2023-07-09T02:16:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 -- 172.21.15.45:0/2481285324 learned_addr learned my addr 172.21.15.45:0/2481285324 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa4094d5640 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739170f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa409cd6640 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f7391ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 -- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 msgr2=0x55f739170f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739170f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 -- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 msgr2=0x55f7391ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f7391ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 -- 172.21.15.45:0/2481285324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f738c73890 con 0x55f739174110 2023-07-09T02:16:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa409cd6640 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f7391ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40a4d7640 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f739171460 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc015040 tx=0x7fa3fc003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5f2dbb07edada6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa3e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:16:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/2481285324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc007ea0 con 0x55f739174110 2023-07-09T02:16:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 -- 172.21.15.45:0/2481285324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f73912d920 con 0x55f739174110 2023-07-09T02:16:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/2481285324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3fc027460 con 0x55f739174110 2023-07-09T02:16:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/2481285324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3fc027660 con 0x55f739174110 2023-07-09T02:16:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 10 client.7080 fetch_fsmap learned FSMap version 51 2023-07-09T02:16:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 -- 172.21.15.45:0/2481285324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55f738c73cc0 con 0x55f739174110 2023-07-09T02:16:24.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/2481285324 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f73912d920 con 0x55f739174110 2023-07-09T02:16:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/2481285324 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa3fc0277c0 con 0x55f739174110 2023-07-09T02:16:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 10 client.7080 fetch_fsmap finished waiting for FSMap version 51 2023-07-09T02:16:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 10 client.7080 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T02:16:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 20 client.7080 populate_metadata read hostname 'smithi045' 2023-07-09T02:16:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] conn(0x55f7391719a0 0x55f739171d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 4 client.7080 mds_command: new command op to 6939 tid=0[{"prefix": "status"}] 2023-07-09T02:16:24.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.041+0000 7fa40f2ac000 1 -- 172.21.15.45:0/2481285324 --> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f738f306f0 con 0x55f7391719a0 2023-07-09T02:16:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa409cd6640 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] conn(0x55f7391719a0 0x55f739171d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa409cd6640 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] conn(0x55f7391719a0 0x55f739171d70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba02fce4cc491530 server_cookie=cc81660f54a4d13e in_seq=0 out_seq=0 2023-07-09T02:16:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa3e4ff9640 10 client.7080 ms_handle_connect on v2:172.21.15.45:6833/4289227998 2023-07-09T02:16:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa3e4ff9640 1 -- 172.21.15.45:0/2481285324 <== mds.0 v2:172.21.15.45:6833/4289227998 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55f738f306f0 con 0x55f7391719a0 2023-07-09T02:16:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa3e4ff9640 10 client.7080 handle_command_reply: tid=0 2023-07-09T02:16:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 client.7080 shutdown 2023-07-09T02:16:24.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 -- 172.21.15.45:0/2481285324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 msgr2=0x55f739171460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f739171460 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc015040 tx=0x7fa3fc003a80 comp rx=0 tx=0).stop 2023-07-09T02:16:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 -- 172.21.15.45:0/2481285324 shutdown_connections 2023-07-09T02:16:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f739174110 0x55f739171460 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f739173800 0x55f739170f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.45:6833/4289227998,v1:172.21.15.45:6835/4289227998] conn(0x55f7391719a0 0x55f739171d70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 --2- 172.21.15.45:0/2481285324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f739129f90 0x55f7391ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 -- 172.21.15.45:0/2481285324 >> 172.21.15.45:0/2481285324 conn(0x55f738feca70 msgr2=0x55f7391854e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa3e4ff9640 0 client.7080 ms_handle_reset on v2:172.21.15.45:6833/4289227998 2023-07-09T02:16:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 -- 172.21.15.45:0/2481285324 shutdown_connections 2023-07-09T02:16:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 1 -- 172.21.15.45:0/2481285324 wait complete. 2023-07-09T02:16:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40f2ac000 20 client.7080 trim_cache size 0 max 16384 2023-07-09T02:16:24.055 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:24.056 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:16:24.056 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:16:24.056 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6939, 2023-07-09T02:16:24.056 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:16:24.056 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:16:24.056 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:16:24.057 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9214856899999999, 2023-07-09T02:16:24.057 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 51, 2023-07-09T02:16:24.057 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 106, 2023-07-09T02:16:24.057 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 106, 2023-07-09T02:16:24.057 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.681612351 2023-07-09T02:16:24.057 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 -- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3e80662b0 msgr2=0x7fa3e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3e80662b0 0x7fa3e8068760 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa4041545e0 tx=0x7fa3f4008040 comp rx=0 tx=0).stop 2023-07-09T02:16:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 -- 172.21.15.45:0/3583518169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4040cd120 msgr2=0x7fa40415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4040cd120 0x7fa40415c660 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa4000af040 tx=0x7fa400019230 comp rx=0 tx=0).stop 2023-07-09T02:16:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 -- 172.21.15.45:0/3583518169 shutdown_connections 2023-07-09T02:16:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3e80662b0 0x7fa3e8068760 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa40415c060 0x7fa4040b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4040d2450 0x7fa40415d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 --2- 172.21.15.45:0/3583518169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4040cd120 0x7fa40415c660 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 -- 172.21.15.45:0/3583518169 >> 172.21.15.45:0/3583518169 conn(0x7fa4040698e0 msgr2=0x7fa40415b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 -- 172.21.15.45:0/3583518169 shutdown_connections 2023-07-09T02:16:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.045+0000 7fa40bf3a640 1 -- 172.21.15.45:0/3583518169 wait complete. 2023-07-09T02:16:24.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:16:24.109 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-07-09T02:16:24.109+0000 7f1649d9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:16:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.209+0000 7fa3d74ec640 1 Processor -- start 2023-07-09T02:16:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.209+0000 7fa3d74ec640 1 -- start start 2023-07-09T02:16:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.209+0000 7fa3d74ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa3d00cd120 0x7fa3d00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.209+0000 7fa3d74ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d0160a50 con 0x7fa3d00d2620 2023-07-09T02:16:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.209+0000 7fa3d74ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d015c430 con 0x7fa3d015c060 2023-07-09T02:16:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.209+0000 7fa3d74ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d015fb60 con 0x7fa3d00cd120 2023-07-09T02:16:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d4a87640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa3d00d2620 0x7fa3d00cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55104/0 (socket says 172.21.15.45:55104) 2023-07-09T02:16:24.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d4a87640 1 -- 172.21.15.45:0/3711272470 learned_addr learned my addr 172.21.15.45:0/3711272470 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d5a89640 1 --2- 172.21.15.45:0/3711272470 >> v2:172.21.15.155:3300/0 conn(0x7fa3d00cd120 0x7fa3d00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645767238 0 0) 0x7fa3d0160a50 con 0x7fa3d00d2620 2023-07-09T02:16:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3bc003530 con 0x7fa3d00d2620 2023-07-09T02:16:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815044137 0 0) 0x7fa3d015c430 con 0x7fa3d015c060 2023-07-09T02:16:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d0160a50 con 0x7fa3d015c060 2023-07-09T02:16:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503997291 0 0) 0x7fa3bc003530 con 0x7fa3d00d2620 2023-07-09T02:16:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 >> v2:172.21.15.155:3300/0 conn(0x7fa3d00cd120 msgr2=0x7fa3d00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 --2- 172.21.15.45:0/3711272470 >> v2:172.21.15.155:3300/0 conn(0x7fa3d00cd120 0x7fa3d00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 >> v1:172.21.15.155:6789/0 conn(0x7fa3d015c060 legacy=0x7fa3d00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d015fe40 con 0x7fa3d00d2620 2023-07-09T02:16:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fa3c0001680 con 0x7fa3d00d2620 2023-07-09T02:16:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 >> v1:172.21.15.45:6789/0 conn(0x7fa3d00d2620 legacy=0x7fa3d00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3bc003b10 0x7fa3bc003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc0047d0 0x7fa3bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc005180 0x7fa3bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d015fb60 con 0x7fa3bc005180 2023-07-09T02:16:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc00bfe0 con 0x7fa3bc003b10 2023-07-09T02:16:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc00c1a0 con 0x7fa3bc0047d0 2023-07-09T02:16:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d5a89640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc005180 0x7fa3bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d4a87640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc0047d0 0x7fa3bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d5288640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3bc003b10 0x7fa3bc003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d5a89640 1 -- 172.21.15.45:0/3711272470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc0047d0 msgr2=0x7fa3bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d5a89640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc0047d0 0x7fa3bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d5a89640 1 -- 172.21.15.45:0/3711272470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3bc003b10 msgr2=0x7fa3bc003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d5a89640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3bc003b10 0x7fa3bc003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.213+0000 7fa3d5a89640 1 -- 172.21.15.45:0/3711272470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc003530 con 0x7fa3bc005180 2023-07-09T02:16:24.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d5a89640 1 -- 172.21.15.45:0/3711272470 reap_dead start 2023-07-09T02:16:24.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d5a89640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc005180 0x7fa3bc00b990 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009fc0 tx=0x7fa3c801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9e1c7d9a4a19f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8003ba0 con 0x7fa3bc005180 2023-07-09T02:16:24.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c800f040 con 0x7fa3bc005180 2023-07-09T02:16:24.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3c7fff640 1 -- 172.21.15.45:0/3711272470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80a59a0 con 0x7fa3bc005180 2023-07-09T02:16:24.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 -- 172.21.15.45:0/3711272470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc005180 msgr2=0x7fa3bc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc005180 0x7fa3bc00b990 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009fc0 tx=0x7fa3c801cca0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 -- 172.21.15.45:0/3711272470 shutdown_connections 2023-07-09T02:16:24.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 --2- 172.21.15.45:0/3711272470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc005180 0x7fa3bc00b990 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 -- 172.21.15.45:0/3711272470 >> 172.21.15.45:0/3711272470 conn(0x7fa3d00698e0 msgr2=0x7fa3d0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:24.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 -- 172.21.15.45:0/3711272470 shutdown_connections 2023-07-09T02:16:24.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 -- 172.21.15.45:0/3711272470 wait complete. 2023-07-09T02:16:24.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 Processor -- start 2023-07-09T02:16:24.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.217+0000 7fa3d74ec640 1 -- start start 2023-07-09T02:16:24.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc005180 0x7fa3d0158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d015edf0 0x7fa3d015f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d00c9b10 0x7fa3d00c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00ca4f0 con 0x7fa3d015edf0 2023-07-09T02:16:24.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d00cb280 con 0x7fa3d00c9b10 2023-07-09T02:16:24.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d0159340 con 0x7fa3bc005180 2023-07-09T02:16:24.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d015edf0 0x7fa3d015f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d015edf0 0x7fa3d015f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50078/0 (socket says 172.21.15.45:50078) 2023-07-09T02:16:24.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 -- 172.21.15.45:0/817424449 learned_addr learned my addr 172.21.15.45:0/817424449 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:24.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d5288640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc005180 0x7fa3d0158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d5a89640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d00c9b10 0x7fa3d00c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 -- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc005180 msgr2=0x7fa3d0158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc005180 0x7fa3d0158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 -- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d00c9b10 msgr2=0x7fa3d00c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d00c9b10 0x7fa3d00c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 -- 172.21.15.45:0/817424449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d01f5ba0 con 0x7fa3d015edf0 2023-07-09T02:16:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d4a87640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d015edf0 0x7fa3d015f260 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0011760 tx=0x7fa3c0011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3c5ffb640 1 -- 172.21.15.45:0/817424449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c000fb60 con 0x7fa3d015edf0 2023-07-09T02:16:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3c5ffb640 1 -- 172.21.15.45:0/817424449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c000fcc0 con 0x7fa3d015edf0 2023-07-09T02:16:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3c5ffb640 1 -- 172.21.15.45:0/817424449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0015630 con 0x7fa3d015edf0 2023-07-09T02:16:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d00cc570 con 0x7fa3d015edf0 2023-07-09T02:16:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d00cb7b0 con 0x7fa3d015edf0 2023-07-09T02:16:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d004d7d0 con 0x7fa3d015edf0 2023-07-09T02:16:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.221+0000 7fa3c5ffb640 1 -- 172.21.15.45:0/817424449 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3c0015790 con 0x7fa3d015edf0 2023-07-09T02:16:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.225+0000 7fa3c5ffb640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3b40662b0 0x7fa3b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.225+0000 7fa3c5ffb640 1 -- 172.21.15.45:0/817424449 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3c0086e20 con 0x7fa3d015edf0 2023-07-09T02:16:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.225+0000 7fa3d5288640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3b40662b0 0x7fa3b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:24.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.225+0000 7fa3d5288640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3b40662b0 0x7fa3b4068760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc007860 tx=0x7fa3cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:24.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.229+0000 7fa3c5ffb640 1 -- 172.21.15.45:0/817424449 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3c0054340 con 0x7fa3d015edf0 2023-07-09T02:16:24.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.417+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa3d01606b0 con 0x7fa3d015edf0 2023-07-09T02:16:24.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.417+0000 7fa3c5ffb640 1 -- 172.21.15.45:0/817424449 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa3c005d070 con 0x7fa3d015edf0 2023-07-09T02:16:24.419 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:16:24.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3b40662b0 msgr2=0x7fa3b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3b40662b0 0x7fa3b4068760 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc007860 tx=0x7fa3cc009040 comp rx=0 tx=0).stop 2023-07-09T02:16:24.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d015edf0 msgr2=0x7fa3d015f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:24.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d015edf0 0x7fa3d015f260 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0011760 tx=0x7fa3c0011c20 comp rx=0 tx=0).stop 2023-07-09T02:16:24.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 shutdown_connections 2023-07-09T02:16:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3d00c9b10 0x7fa3d00c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3d015edf0 0x7fa3d015f260 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa3b40662b0 0x7fa3b4068760 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 --2- 172.21.15.45:0/817424449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3bc005180 0x7fa3d0158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 >> 172.21.15.45:0/817424449 conn(0x7fa3d00698e0 msgr2=0x7fa3d00d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 shutdown_connections 2023-07-09T02:16:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:24.421+0000 7fa3d74ec640 1 -- 172.21.15.45:0/817424449 wait complete. 2023-07-09T02:16:24.439 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:16:24.440 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:16:24.440 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:16:24.440 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:16:24.441 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:16:24.441 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:16:24.441 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:16:24.442 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:16:24.442 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:16:24.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:24.443 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:16:24.489 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:16:24.489 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:16:24.489 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:16:24.490 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:24.490 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:16:24.490 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:24.490 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:16:24.490 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:24.490 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:16:24.490 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:16:24.491 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:24.491 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:16:24.491 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:16:24.491 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42142sec preferred_lft 42142sec 2023-07-09T02:16:24.491 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:16:24.491 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:24.491 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:16:24.491 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:24.492 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:16:24.492 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:16:24.492 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:24.492 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:16:24.492 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:16:24.492 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:24.492 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:16:24.492 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:24.493 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:16:24.493 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:24.493 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:16:24.493 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:24.493 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:16:24.493 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:24.493 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:16:24.494 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:16:24.494 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:16:24.494 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:24.494 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:16:24.494 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:16:24.494 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:16:24.494 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:24.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:24.496 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:16:24.555 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:16:24.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:24.557 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:16:24.613 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:16:24.613 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:16:24.614 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:16:24.614 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:16:24.614 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:16:24.614 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:16:24.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:24.615 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:16:24.615 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:16:24.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:16:24.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:16:24.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:16:24.616 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:16:24.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:24.714 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:16:24.724 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:16:24.724 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:16:24.725 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:16:24.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:24.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:16:24.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:16:24.789 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:16:24.840 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:16:24.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:16:24.841 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:16:24.896 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:16:24.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:24.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:16:24.992 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:16:24.992 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:16:25.005 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:16:25.005 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:16:25.005 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:16:25.006 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:16:25.006 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:16:25.009 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:16:25.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:16:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.032 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:16:25.094 INFO:teuthology.orchestra.run.smithi045.stdout:client6694 2023-07-09T02:16:25.094 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:25.095 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:25.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:16:25.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09fd82640 1 Processor -- start 2023-07-09T02:16:25.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09fd82640 1 -- start start 2023-07-09T02:16:25.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09fd82640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0980d2620 0x7fe0980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:25.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09fd82640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe098160a50 con 0x7fe0980cd120 2023-07-09T02:16:25.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09fd82640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09815c430 con 0x7fe09815c060 2023-07-09T02:16:25.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09fd82640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09815fb60 con 0x7fe0980d2620 2023-07-09T02:16:25.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09d31d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0980d2620 0x7fe0980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09e31f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe0980cd120 0x7fe0980cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55112/0 (socket says 172.21.15.45:55112) 2023-07-09T02:16:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09e31f640 1 -- 172.21.15.45:0/3930678511 learned_addr learned my addr 172.21.15.45:0/3930678511 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09d31d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0980d2620 0x7fe0980b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50080/0 (socket says 172.21.15.45:50080) 2023-07-09T02:16:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09d31d640 1 -- 172.21.15.45:0/3930678511 >> v1:172.21.15.155:6789/0 conn(0x7fe09815c060 legacy=0x7fe0980d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09d31d640 1 -- 172.21.15.45:0/3930678511 >> v1:172.21.15.45:6789/0 conn(0x7fe0980cd120 legacy=0x7fe0980cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09cb1c640 1 -- 172.21.15.45:0/3930678511 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367177176 0 0) 0x7fe098160a50 con 0x7fe0980cd120 2023-07-09T02:16:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.329+0000 7fe09d31d640 1 -- 172.21.15.45:0/3930678511 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09815fe40 con 0x7fe0980d2620 2023-07-09T02:16:25.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09d31d640 1 --2- 172.21.15.45:0/3930678511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980d2620 0x7fe0980b4ed0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe0880097c0 tx=0x7fe08801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c8c5e8d350cff8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:25.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09cb1c640 1 -- 172.21.15.45:0/3930678511 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880ab650 con 0x7fe0980d2620 2023-07-09T02:16:25.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09cb1c640 1 -- 172.21.15.45:0/3930678511 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0880ab7b0 con 0x7fe0980d2620 2023-07-09T02:16:25.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09cb1c640 1 -- 172.21.15.45:0/3930678511 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880abb40 con 0x7fe0980d2620 2023-07-09T02:16:25.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09fd82640 1 -- 172.21.15.45:0/3930678511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980d2620 msgr2=0x7fe0980b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:25.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09fd82640 1 --2- 172.21.15.45:0/3930678511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980d2620 0x7fe0980b4ed0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe0880097c0 tx=0x7fe08801c450 comp rx=0 tx=0).stop 2023-07-09T02:16:25.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09fd82640 1 -- 172.21.15.45:0/3930678511 shutdown_connections 2023-07-09T02:16:25.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09fd82640 1 --2- 172.21.15.45:0/3930678511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980d2620 0x7fe0980b4ed0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:25.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09fd82640 1 -- 172.21.15.45:0/3930678511 >> 172.21.15.45:0/3930678511 conn(0x7fe0980698e0 msgr2=0x7fe098069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:25.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09fd82640 1 -- 172.21.15.45:0/3930678511 shutdown_connections 2023-07-09T02:16:25.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.333+0000 7fe09fd82640 1 -- 172.21.15.45:0/3930678511 wait complete. 2023-07-09T02:16:25.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 Processor -- start 2023-07-09T02:16:25.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 -- start start 2023-07-09T02:16:25.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980cd120 0x7fe09815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:25.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0980d2620 0x7fe098157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:25.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09815c060 0x7fe09815eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:25.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09814eb40 con 0x7fe0980cd120 2023-07-09T02:16:25.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098157010 con 0x7fe0980d2620 2023-07-09T02:16:25.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09815e110 con 0x7fe09815c060 2023-07-09T02:16:25.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980cd120 0x7fe09815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:25.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980cd120 0x7fe09815c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50094/0 (socket says 172.21.15.45:50094) 2023-07-09T02:16:25.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 -- 172.21.15.45:0/3039051485 learned_addr learned my addr 172.21.15.45:0/3039051485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:25.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09d31d640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0980d2620 0x7fe098157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:25.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 -- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09815c060 msgr2=0x7fe09815eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:25.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09815c060 0x7fe09815eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:25.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 -- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0980d2620 msgr2=0x7fe098157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:25.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0980d2620 0x7fe098157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:25.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 -- 172.21.15.45:0/3039051485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088009420 con 0x7fe0980cd120 2023-07-09T02:16:25.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09d31d640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0980d2620 0x7fe098157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:25.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09db1e640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980cd120 0x7fe09815c620 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c3c0 tx=0x7fe09400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:25.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe08e7fc640 1 -- 172.21.15.45:0/3039051485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940052d0 con 0x7fe0980cd120 2023-07-09T02:16:25.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe08e7fc640 1 -- 172.21.15.45:0/3039051485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094005430 con 0x7fe0980cd120 2023-07-09T02:16:25.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe08e7fc640 1 -- 172.21.15.45:0/3039051485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094003840 con 0x7fe0980cd120 2023-07-09T02:16:25.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0980b59f0 con 0x7fe0980cd120 2023-07-09T02:16:25.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.337+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09815e6d0 con 0x7fe0980cd120 2023-07-09T02:16:25.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.341+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09804d7d0 con 0x7fe0980cd120 2023-07-09T02:16:25.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.341+0000 7fe08e7fc640 1 -- 172.21.15.45:0/3039051485 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0940039a0 con 0x7fe0980cd120 2023-07-09T02:16:25.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.341+0000 7fe08e7fc640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe07c066280 0x7fe07c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:25.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.341+0000 7fe08e7fc640 1 -- 172.21.15.45:0/3039051485 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe094083280 con 0x7fe0980cd120 2023-07-09T02:16:25.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.341+0000 7fe09d31d640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe07c066280 0x7fe07c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:25.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.341+0000 7fe09d31d640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe07c066280 0x7fe07c068730 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0880af000 tx=0x7fe088008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.345+0000 7fe08e7fc640 1 -- 172.21.15.45:0/3039051485 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0940506f0 con 0x7fe0980cd120 2023-07-09T02:16:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe09806baa0 con 0x7fe0980cd120 2023-07-09T02:16:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe08e7fc640 1 -- 172.21.15.45:0/3039051485 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe094053d10 con 0x7fe0980cd120 2023-07-09T02:16:25.546 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:16:25.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe07c066280 msgr2=0x7fe07c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:25.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe07c066280 0x7fe07c068730 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0880af000 tx=0x7fe088008040 comp rx=0 tx=0).stop 2023-07-09T02:16:25.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980cd120 msgr2=0x7fe09815c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:25.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980cd120 0x7fe09815c620 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c3c0 tx=0x7fe09400c880 comp rx=0 tx=0).stop 2023-07-09T02:16:25.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 shutdown_connections 2023-07-09T02:16:25.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe07c066280 0x7fe07c068730 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:25.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09815c060 0x7fe09815eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:25.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0980d2620 0x7fe098157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:25.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 --2- 172.21.15.45:0/3039051485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0980cd120 0x7fe09815c620 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:25.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 >> 172.21.15.45:0/3039051485 conn(0x7fe0980698e0 msgr2=0x7fe0980b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:25.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 shutdown_connections 2023-07-09T02:16:25.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:25.545+0000 7fe09fd82640 1 -- 172.21.15.45:0/3039051485 wait complete. 2023-07-09T02:16:25.566 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:16:25.566 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:16:25.566 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:16:25.567 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:16:25.567 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:16:25.567 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:16:25.567 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:16:25.568 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:16:25.568 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:16:25.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.569 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:16:25.580 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:16:25.580 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:16:25.580 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:16:25.580 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:25.581 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:16:25.581 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:25.582 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:16:25.582 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:25.582 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:16:25.582 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:16:25.583 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:25.583 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:16:25.583 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:16:25.583 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:25.583 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:16:25.583 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:25.583 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:16:25.584 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42148sec preferred_lft 42148sec 2023-07-09T02:16:25.584 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:16:25.584 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:25.584 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:16:25.584 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:25.584 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:16:25.584 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:25.584 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:16:25.585 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:16:25.585 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:16:25.585 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:25.585 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:16:25.585 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:25.585 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:16:25.585 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:16:25.586 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:16:25.586 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:25.586 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:16:25.586 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:16:25.586 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:16:25.586 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:16:25.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.587 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:16:25.645 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:16:25.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.648 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:16:25.700 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:16:25.700 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:16:25.700 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:16:25.700 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:16:25.701 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:16:25.701 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:16:25.701 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:16:25.702 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:16:25.702 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:16:25.702 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:16:25.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.704 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:16:25.705 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:16:25.705 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:16:25.706 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:16:25.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:16:25.708 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:16:25.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.795 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:16:25.805 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:16:25.805 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:16:25.806 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:16:25.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.807 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:16:25.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:16:25.873 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:16:25.924 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:16:25.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:16:25.926 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:16:25.975 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:16:25.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:25.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:16:26.072 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:16:26.072 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:16:26.083 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:16:26.083 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:16:26.083 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:16:26.083 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:16:26.083 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:16:26.086 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:16:26.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:26.087 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:16:26.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:26.108 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:16:26.163 INFO:teuthology.orchestra.run.smithi155.stdout:client6700 2023-07-09T02:16:26.163 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:16:26.164 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:26.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60394ec640 1 Processor -- start 2023-07-09T02:16:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60394ec640 1 -- start start 2023-07-09T02:16:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60394ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f60340d2620 0x7f60340b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60394ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60340cd120 0x7f60340cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60394ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6034160a50 con 0x7f603415c060 2023-07-09T02:16:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60394ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603415c430 con 0x7f60340d2620 2023-07-09T02:16:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60394ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603415fb60 con 0x7f60340cd120 2023-07-09T02:16:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60327fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f60340d2620 0x7f60340b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60327fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f60340d2620 0x7f60340b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:35746/0 (socket says 172.21.15.45:35746) 2023-07-09T02:16:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60327fc640 1 -- 172.21.15.45:0/3987834820 learned_addr learned my addr 172.21.15.45:0/3987834820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60337fe640 1 --2- 172.21.15.45:0/3987834820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60340cd120 0x7f60340cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60327fc640 1 -- 172.21.15.45:0/3987834820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60340cd120 msgr2=0x7f60340cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60327fc640 1 --2- 172.21.15.45:0/3987834820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60340cd120 0x7f60340cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60327fc640 1 -- 172.21.15.45:0/3987834820 >> v1:172.21.15.155:6789/0 conn(0x7f603415c060 legacy=0x7f60340d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.361+0000 7f60327fc640 1 -- 172.21.15.45:0/3987834820 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603415fe40 con 0x7f60340d2620 2023-07-09T02:16:26.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60327fc640 1 --2- 172.21.15.45:0/3987834820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 0x7f60340b4ed0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6028009870 tx=0x7f602801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b440c56f3fc3e6d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:26.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f6031ffb640 1 -- 172.21.15.45:0/3987834820 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60280aa670 con 0x7f60340d2620 2023-07-09T02:16:26.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f6031ffb640 1 -- 172.21.15.45:0/3987834820 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60280aa7d0 con 0x7f60340d2620 2023-07-09T02:16:26.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f6031ffb640 1 -- 172.21.15.45:0/3987834820 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60280aab60 con 0x7f60340d2620 2023-07-09T02:16:26.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60394ec640 1 -- 172.21.15.45:0/3987834820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 msgr2=0x7f60340b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:26.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60394ec640 1 --2- 172.21.15.45:0/3987834820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 0x7f60340b4ed0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6028009870 tx=0x7f602801c510 comp rx=0 tx=0).stop 2023-07-09T02:16:26.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60394ec640 1 -- 172.21.15.45:0/3987834820 shutdown_connections 2023-07-09T02:16:26.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60394ec640 1 --2- 172.21.15.45:0/3987834820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60340cd120 0x7f60340cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60394ec640 1 --2- 172.21.15.45:0/3987834820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 0x7f60340b4ed0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60394ec640 1 -- 172.21.15.45:0/3987834820 >> 172.21.15.45:0/3987834820 conn(0x7f60340698e0 msgr2=0x7f6034069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:26.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60394ec640 1 -- 172.21.15.45:0/3987834820 shutdown_connections 2023-07-09T02:16:26.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.365+0000 7f60394ec640 1 -- 172.21.15.45:0/3987834820 wait complete. 2023-07-09T02:16:26.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 Processor -- start 2023-07-09T02:16:26.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 -- start start 2023-07-09T02:16:26.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60340cd120 0x7f603415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:26.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 0x7f60340c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:26.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603415c060 0x7f6034156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:26.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603415ec00 con 0x7f60340cd120 2023-07-09T02:16:26.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603415b220 con 0x7f60340d2620 2023-07-09T02:16:26.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603415e5b0 con 0x7f603415c060 2023-07-09T02:16:26.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60340cd120 0x7f603415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:26.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60340cd120 0x7f603415ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50106/0 (socket says 172.21.15.45:50106) 2023-07-09T02:16:26.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 -- 172.21.15.45:0/3731113422 learned_addr learned my addr 172.21.15.45:0/3731113422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:26.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60327fc640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 0x7f60340c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:26.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60337fe640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603415c060 0x7f6034156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:26.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 -- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603415c060 msgr2=0x7f6034156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:26.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603415c060 0x7f6034156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 -- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 msgr2=0x7f60340c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:26.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 0x7f60340c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 -- 172.21.15.45:0/3731113422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280094d0 con 0x7f60340cd120 2023-07-09T02:16:26.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f6032ffd640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60340cd120 0x7f603415ac40 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f602400c500 tx=0x7f602400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:26.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f601b7fe640 1 -- 172.21.15.45:0/3731113422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024005220 con 0x7f60340cd120 2023-07-09T02:16:26.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f601b7fe640 1 -- 172.21.15.45:0/3731113422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024005380 con 0x7f60340cd120 2023-07-09T02:16:26.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60340b59f0 con 0x7f60340cd120 2023-07-09T02:16:26.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f601b7fe640 1 -- 172.21.15.45:0/3731113422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024007270 con 0x7f60340cd120 2023-07-09T02:16:26.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.369+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60340c9500 con 0x7f60340cd120 2023-07-09T02:16:26.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.373+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603404d7d0 con 0x7f60340cd120 2023-07-09T02:16:26.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.373+0000 7f601b7fe640 1 -- 172.21.15.45:0/3731113422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60240073d0 con 0x7f60340cd120 2023-07-09T02:16:26.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.373+0000 7f601b7fe640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6020066280 0x7f6020068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:26.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.373+0000 7f601b7fe640 1 -- 172.21.15.45:0/3731113422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60240834c0 con 0x7f60340cd120 2023-07-09T02:16:26.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.373+0000 7f60327fc640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6020066280 0x7f6020068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:26.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.373+0000 7f60327fc640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6020066280 0x7f6020068730 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f60280ae000 tx=0x7f60280b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.377+0000 7f601b7fe640 1 -- 172.21.15.45:0/3731113422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6024050a00 con 0x7f60340cd120 2023-07-09T02:16:26.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f603406baa0 con 0x7f60340cd120 2023-07-09T02:16:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f601b7fe640 1 -- 172.21.15.45:0/3731113422 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f6024054020 con 0x7f60340cd120 2023-07-09T02:16:26.565 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:26.565 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6020066280 msgr2=0x7f6020068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6020066280 0x7f6020068730 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f60280ae000 tx=0x7f60280b5040 comp rx=0 tx=0).stop 2023-07-09T02:16:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60340cd120 msgr2=0x7f603415ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60340cd120 0x7f603415ac40 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f602400c500 tx=0x7f602400c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 shutdown_connections 2023-07-09T02:16:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6020066280 0x7f6020068730 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603415c060 0x7f6034156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340d2620 0x7f60340c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 --2- 172.21.15.45:0/3731113422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60340cd120 0x7f603415ac40 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:26.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 >> 172.21.15.45:0/3731113422 conn(0x7f60340698e0 msgr2=0x7f60340d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:26.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 shutdown_connections 2023-07-09T02:16:26.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:26.565+0000 7f60394ec640 1 -- 172.21.15.45:0/3731113422 wait complete. 2023-07-09T02:16:26.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-07-09T02:16:26.751 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":6939,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.6113844050000008,"mdsmap_epoch":51,"osdmap_epoch":106,"osdmap_epoch_barrier":106,"uptime":14.371533693} 2023-07-09T02:16:26.752 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 6939, "mdsmap_epoch": 51, "osdmap_epoch": 106, "osdmap_epoch_barrier": 106, "rank_uptime": 8.611384405, "state": "up:active", "uptime": 14.371533693, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:16:26.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-07-09T02:16:26.915 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_mon_report_interval":"5"} 2023-07-09T02:16:26.916 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-07-09T02:16:26.916 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-07-09T02:16:26.916 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:26.917 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:26.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:26.926 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-07-09T02:16:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:265+0 records in 2023-07-09T02:16:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:265+0 records out 2023-07-09T02:16:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.86105 s, 149 MB/s 2023-07-09T02:16:28.845 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:28.846 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:28.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:28.855 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-07-09T02:16:30.999 INFO:teuthology.orchestra.run.smithi045.stderr:292+0 records in 2023-07-09T02:16:31.000 INFO:teuthology.orchestra.run.smithi045.stderr:292+0 records out 2023-07-09T02:16:31.000 INFO:teuthology.orchestra.run.smithi045.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.08989 s, 147 MB/s 2023-07-09T02:16:31.001 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-07-09T02:16:31.001 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:16:31.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.141+0000 7f7520056640 1 Processor -- start 2023-07-09T02:16:31.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.141+0000 7f7520056640 1 -- start start 2023-07-09T02:16:31.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f7520056640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75180c8dc0 0x7f75180cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:31.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f7520056640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75180cde40 0x7f75180caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:31.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f7520056640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751806ef30 con 0x7f75181604a0 2023-07-09T02:16:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f7520056640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751806be90 con 0x7f75180cde40 2023-07-09T02:16:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f7520056640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751806b000 con 0x7f75180c8dc0 2023-07-09T02:16:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f751e5f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75180cde40 0x7f75180caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f751e5f3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75180cde40 0x7f75180caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50120/0 (socket says 172.21.15.45:50120) 2023-07-09T02:16:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f751e5f3640 1 -- 172.21.15.45:0/739421630 learned_addr learned my addr 172.21.15.45:0/739421630 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:31.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f751e5f3640 1 -- 172.21.15.45:0/739421630 >> v2:172.21.15.155:3300/0 conn(0x7f75180c8dc0 msgr2=0x7f75180cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:31.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f751e5f3640 1 --2- 172.21.15.45:0/739421630 >> v2:172.21.15.155:3300/0 conn(0x7f75180c8dc0 0x7f75180cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f751e5f3640 1 -- 172.21.15.45:0/739421630 >> v1:172.21.15.45:6789/0 conn(0x7f75181604a0 legacy=0x7f7518164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:31.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.145+0000 7f751e5f3640 1 -- 172.21.15.45:0/739421630 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751806b210 con 0x7f75180cde40 2023-07-09T02:16:31.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f751e5f3640 1 --2- 172.21.15.45:0/739421630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75180cde40 0x7f75180caaa0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f751806e9e0 tx=0x7f751001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182a78c4b8141263 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:31.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f751cdf0640 1 -- 172.21.15.45:0/739421630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75100a5780 con 0x7f75180cde40 2023-07-09T02:16:31.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f751cdf0640 1 -- 172.21.15.45:0/739421630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75100a58e0 con 0x7f75180cde40 2023-07-09T02:16:31.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f751cdf0640 1 -- 172.21.15.45:0/739421630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75100a5c70 con 0x7f75180cde40 2023-07-09T02:16:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 -- 172.21.15.45:0/739421630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75180cde40 msgr2=0x7f75180caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 --2- 172.21.15.45:0/739421630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75180cde40 0x7f75180caaa0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f751806e9e0 tx=0x7f751001c9d0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 -- 172.21.15.45:0/739421630 shutdown_connections 2023-07-09T02:16:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 --2- 172.21.15.45:0/739421630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75180cde40 0x7f75180caaa0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 --2- 172.21.15.45:0/739421630 >> v2:172.21.15.155:3300/0 conn(0x7f75180c8dc0 0x7f75180cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 -- 172.21.15.45:0/739421630 >> 172.21.15.45:0/739421630 conn(0x7f75180694b0 msgr2=0x7f75180698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 -- 172.21.15.45:0/739421630 shutdown_connections 2023-07-09T02:16:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 -- 172.21.15.45:0/739421630 wait complete. 2023-07-09T02:16:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 Processor -- start 2023-07-09T02:16:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.149+0000 7f7520056640 1 -- start start 2023-07-09T02:16:31.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75180c8dc0 0x7f75180b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:31.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75180cde40 0x7f75180c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181604a0 0x7f751815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180c7c70 con 0x7f75181604a0 2023-07-09T02:16:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75181fa350 con 0x7f75180c8dc0 2023-07-09T02:16:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75181fa630 con 0x7f75180cde40 2023-07-09T02:16:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181604a0 0x7f751815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:31.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181604a0 0x7f751815b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50134/0 (socket says 172.21.15.45:50134) 2023-07-09T02:16:31.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 -- 172.21.15.45:0/2798166921 learned_addr learned my addr 172.21.15.45:0/2798166921 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:31.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751ddf2640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75180c8dc0 0x7f75180b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:31.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751d5f1640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75180cde40 0x7f75180c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:31.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 -- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75180cde40 msgr2=0x7f75180c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:31.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75180cde40 0x7f75180c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 -- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75180c8dc0 msgr2=0x7f75180b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75180c8dc0 0x7f75180b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 -- 172.21.15.45:0/2798166921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7510009b30 con 0x7f75181604a0 2023-07-09T02:16:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751ddf2640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75180c8dc0 0x7f75180b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f751e5f3640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181604a0 0x7f751815b3e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f75100af040 tx=0x7f7510019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f750e7fc640 1 -- 172.21.15.45:0/2798166921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75100b8670 con 0x7f75181604a0 2023-07-09T02:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f750e7fc640 1 -- 172.21.15.45:0/2798166921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75100b8810 con 0x7f75181604a0 2023-07-09T02:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75181fa910 con 0x7f75181604a0 2023-07-09T02:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f750e7fc640 1 -- 172.21.15.45:0/2798166921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75100b8bc0 con 0x7f75181604a0 2023-07-09T02:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75181faed0 con 0x7f75181604a0 2023-07-09T02:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75180b4730 con 0x7f75181604a0 2023-07-09T02:16:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.153+0000 7f750e7fc640 1 -- 172.21.15.45:0/2798166921 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75100b8d20 con 0x7f75181604a0 2023-07-09T02:16:31.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.157+0000 7f750e7fc640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74fc066280 0x7f74fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:31.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.157+0000 7f750e7fc640 1 -- 172.21.15.45:0/2798166921 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f751011f430 con 0x7f75181604a0 2023-07-09T02:16:31.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.157+0000 7f751ddf2640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74fc066280 0x7f74fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:31.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.157+0000 7f751ddf2640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74fc066280 0x7f74fc068730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7514000f70 tx=0x7f7514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:31.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.161+0000 7f750e7fc640 1 -- 172.21.15.45:0/2798166921 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75100ec9f0 con 0x7f75181604a0 2023-07-09T02:16:31.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f751804d7d0 con 0x7f75181604a0 2023-07-09T02:16:31.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f750e7fc640 1 -- 172.21.15.45:0/2798166921 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+36952 (secure 0 0 0) 0x7f75100f0010 con 0x7f75181604a0 2023-07-09T02:16:31.318 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:31.319 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:31.319 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 106, 2023-07-09T02:16:31.319 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:16:31.319 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:16:31.319 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:16:19.125030+0000", 2023-07-09T02:16:31.319 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:16:31.319 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:16:31.320 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:16:31.320 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:16:31.320 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:16:31.320 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:16:31.320 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:16:31.320 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:16:31.320 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:16:31.320 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:31.321 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:16:31.321 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:16:31.321 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:16:31.321 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:16:31.321 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:16:31.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 14, 2023-07-09T02:16:31.321 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:16:31.321 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:16:31.322 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:16:31.322 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:16:31.322 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:16:31.322 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:16:31.322 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.322 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:16:31.322 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:16:31.323 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:16:31.323 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:31.323 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:31.323 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:31.323 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:31.323 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:31.323 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:31.323 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:31.324 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:31.324 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:31.324 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:31.324 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:31.324 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:31.324 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:16:31.324 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:16:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:16:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:16:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:16:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:31.325 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:31.326 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:31.326 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:31.326 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.326 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "95", 2023-07-09T02:16:31.326 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:31.326 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:31.326 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:31.326 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:31.327 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:31.327 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:31.327 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:31.327 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:31.327 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:31.327 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:31.327 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:31.327 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:31.328 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:31.328 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:31.328 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:31.328 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:31.328 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:31.328 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:31.328 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:31.329 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:31.329 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:31.329 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:31.329 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:31.329 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:31.329 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:31.329 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:31.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.330 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:31.330 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:31.330 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:31.330 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:31.330 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:31.330 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:31.330 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:31.330 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:31.331 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:31.331 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:31.331 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:31.331 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:31.331 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:16:31.331 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:16:31.331 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.332 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:31.332 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:16:31.332 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.332 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:31.332 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:16:31.332 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:16:31.332 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:16:31.332 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:16:31.333 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:16:31.333 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:31.333 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:31.333 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:31.333 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.333 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:16:31.334 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:16:31.334 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:16:31.334 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:31.334 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:31.334 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:31.334 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:31.334 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:31.335 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:31.335 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:31.335 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:31.335 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:31.335 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:31.335 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:31.335 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:31.335 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:16:31.336 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:16:31.336 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:16:31.336 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:16:31.336 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:16:31.336 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:31.336 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:31.336 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:31.337 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:31.337 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:31.337 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:31.337 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:31.337 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.337 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "95", 2023-07-09T02:16:31.337 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:31.337 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:31.338 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:31.338 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:31.338 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:31.338 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:31.338 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:31.338 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:31.338 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:31.339 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:31.339 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:31.339 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:31.339 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:31.339 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:31.339 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:31.339 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:31.339 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:31.340 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:31.340 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:31.340 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:31.340 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:31.340 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:31.340 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:31.340 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:31.340 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:31.341 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:31.341 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.341 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:31.341 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:31.341 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:31.341 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:31.341 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:31.341 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:31.342 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:31.342 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:31.342 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:31.342 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:31.342 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:31.342 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:16:31.342 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:31.342 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:16:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:16:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:16:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:16:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:31.344 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:31.344 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:31.344 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:31.344 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.344 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.344 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 13, 2023-07-09T02:16:31.344 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:16:31.345 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:15.254129+0000", 2023-07-09T02:16:31.345 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:31.345 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:31.345 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:31.345 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:31.345 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:31.345 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:31.345 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:31.346 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:31.346 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:31.346 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:31.346 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:31.346 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:31.346 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:16:31.346 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:16:31.347 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:16:31.347 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:16:31.347 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:16:31.347 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:31.347 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:31.347 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:31.347 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:31.347 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:31.348 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:31.348 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:31.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.348 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "105", 2023-07-09T02:16:31.348 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:31.348 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:31.348 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:31.348 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:31.349 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:31.350 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:31.350 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:31.350 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:31.350 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:31.350 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:31.350 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:31.350 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:31.351 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:31.351 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:31.351 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:31.351 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:31.351 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:31.351 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:31.351 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:31.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.352 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:31.352 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:31.352 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:31.352 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:31.352 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:31.352 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:31.352 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:31.352 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:31.353 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:31.353 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:31.353 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:31.353 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:31.353 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:16:31.353 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:16:31.353 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:16:31.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:16:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:16:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:16:31.355 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:31.355 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:16:31.355 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:16:31.355 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:31.355 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:31.355 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:31.355 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.356 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.356 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 14, 2023-07-09T02:16:31.356 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:16:31.356 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:16.522380+0000", 2023-07-09T02:16:31.356 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:31.356 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:31.356 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:31.357 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:31.357 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:31.357 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:31.357 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:31.357 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:31.357 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:31.357 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:31.357 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:16:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:16:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:16:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:16:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:16:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:31.358 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.359 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "106", 2023-07-09T02:16:31.360 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:31.360 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:31.360 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:31.360 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:31.360 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:31.360 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:31.360 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:31.360 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:31.361 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:31.361 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:31.361 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:31.361 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:31.361 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:31.361 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:31.361 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:31.361 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:31.362 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:31.362 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:31.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:31.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:31.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:31.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:31.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:31.362 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:31.363 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:31.363 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:31.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.363 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:31.363 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:31.363 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:31.363 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:31.364 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:31.364 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:31.364 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:31.364 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:31.364 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:31.364 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:31.364 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:31.364 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:31.365 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:16:31.365 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:16:31.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.365 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:31.365 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:31.365 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:16:31.365 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.366 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:31.366 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:16:31.366 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:16:31.366 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:31.366 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:31.366 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:31.366 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:31.366 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:31.367 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:31.367 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.367 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.367 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:31.367 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:16:31.367 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.367 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:31.368 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:31.368 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:31.368 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:31.368 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:31.368 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:31.368 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:31.368 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:31.368 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:31.369 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:31.369 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:31.369 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:31.369 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:31.369 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.369 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.369 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.369 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:16:31.370 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:31.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.370 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.370 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.370 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:16:31.370 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:31.370 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.370 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.371 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:31.371 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.371 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.371 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.371 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:16:31.371 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:31.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.372 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.372 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.372 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:16:31.372 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:31.372 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.372 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.373 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:31.373 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.373 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.373 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.373 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:16:31.373 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:31.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.373 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.374 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.374 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:16:31.374 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:31.374 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.374 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.374 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.374 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:31.374 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.375 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.375 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.375 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:16:31.375 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:31.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.375 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.375 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.375 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:16:31.376 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:31.376 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.376 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.376 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:16:31.376 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:16:31.376 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:16:31.376 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:16:31.377 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:31.377 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:31.377 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:31.377 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.377 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.377 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:31.377 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:31.378 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:31.378 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:31.378 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:31.378 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:31.378 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:31.378 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:31.378 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:31.379 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:31.379 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:31.379 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:31.379 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:31.379 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.379 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.379 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:16:31.380 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:31.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.380 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.380 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.380 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:16:31.380 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:31.380 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:16:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:31.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.382 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.382 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.382 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:16:31.382 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:31.382 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.382 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.383 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:31.383 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.383 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.383 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.383 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:16:31.383 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:31.383 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.383 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.384 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.384 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:16:31.384 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:31.384 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.384 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.384 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:31.384 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.385 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.385 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.385 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:16:31.385 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:31.385 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.385 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.385 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.385 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:16:31.386 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:31.386 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.386 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.386 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:16:31.386 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:16:31.386 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:16:31.386 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:16:31.387 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:31.387 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:31.387 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:31.387 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.387 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.387 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:31.388 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:31.388 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:31.388 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:31.388 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:31.388 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:31.388 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:31.388 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:31.388 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:31.389 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:31.389 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:31.389 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:31.389 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:31.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.389 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:16:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:16:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.390 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.391 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:31.391 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.391 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.391 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.391 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:16:31.391 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:31.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.392 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.392 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.392 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:16:31.392 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:31.392 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.392 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.393 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:31.393 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.393 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.393 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.393 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:16:31.393 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:31.393 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.393 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.394 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.394 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:16:31.394 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:31.394 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.394 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.394 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:31.394 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:16:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:16:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:16:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:16:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:16:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:16:31.397 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:31.397 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:31.397 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:31.397 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.397 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.397 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:31.397 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:31.398 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:31.398 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:31.398 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:31.398 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:31.398 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:31.398 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:31.398 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:31.398 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:31.399 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:31.399 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:31.399 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:31.399 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.399 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.399 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.399 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:16:31.399 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:31.400 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.400 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.400 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.400 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:16:31.400 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:31.400 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.400 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.401 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:31.401 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.401 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.401 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.401 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:16:31.401 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:31.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.402 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.402 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.402 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:16:31.402 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:31.402 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.402 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.402 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:31.403 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.403 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.403 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.403 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:16:31.403 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:31.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.403 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.403 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.404 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:16:31.404 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:31.404 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.404 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.404 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.404 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:31.404 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.404 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.405 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:16:31.405 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:31.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.405 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.405 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:16:31.405 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:31.406 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.406 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.406 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.406 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:16:31.406 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:16:31.406 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:16:31.406 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:16:31.407 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:31.407 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:31.407 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:31.407 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.407 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.407 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:31.407 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:31.408 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:31.408 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:31.408 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:31.408 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:31.408 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:31.408 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:31.408 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:31.408 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:31.409 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:31.409 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:31.409 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:31.409 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.409 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.409 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.409 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:16:31.409 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:31.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.410 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:16:31.410 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:31.410 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.410 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:16:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.411 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.412 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.412 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:16:31.412 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:31.412 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.412 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.412 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:31.413 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.413 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.413 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:16:31.413 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:31.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.413 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.414 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:16:31.414 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:31.414 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.414 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.414 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:31.414 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.414 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.415 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:16:31.415 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:31.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.415 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.415 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:16:31.415 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:31.416 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.416 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.416 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:16:31.416 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:16:31.416 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:16:31.416 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:16:31.417 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:31.417 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:31.417 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:31.417 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.417 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.417 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:31.417 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:31.418 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:31.418 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:31.418 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:31.418 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:31.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:31.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:31.418 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:31.418 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:31.419 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:31.419 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:31.419 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:31.419 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.419 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.419 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.419 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:16:31.419 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:16:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.421 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:31.421 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.421 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.421 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.421 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:16:31.421 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:31.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.421 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.422 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.422 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:16:31.422 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:31.422 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.422 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.422 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.422 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:31.423 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.423 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.423 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.423 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:16:31.423 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:31.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.423 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.423 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.424 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:16:31.424 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:31.424 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.424 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.424 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:31.424 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.424 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.425 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.425 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:16:31.425 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:31.425 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.425 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:16:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.426 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:16:31.427 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:16:31.427 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:16:31.427 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:16:31.427 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:31.427 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:31.427 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:31.427 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.428 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.428 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.428 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:31.428 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:31.428 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:31.428 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:31.428 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:31.428 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:31.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:31.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:31.429 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:31.429 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:31.429 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:31.429 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:31.429 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:31.429 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.430 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.430 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.430 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:16:31.430 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:31.430 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.430 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.430 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.431 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.432 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.434 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:16:31.434 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:31.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.434 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.434 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.434 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:16:31.434 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:31.435 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.435 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.435 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.435 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:31.435 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.435 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.435 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:16:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:16:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.437 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.437 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:16:31.437 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:16:31.437 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:16:31.437 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:16:31.437 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:31.438 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:31.438 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:31.438 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.438 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.438 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.438 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:31.438 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:31.438 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:31.439 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:31.439 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:31.439 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:31.439 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:31.439 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:31.439 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:31.439 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:31.439 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:31.440 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:31.440 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:31.440 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.440 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.440 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.440 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:16:31.440 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:31.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.441 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.441 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.441 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:16:31.441 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:31.441 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.441 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.442 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:31.442 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.442 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.442 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:16:31.442 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:31.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.443 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:16:31.443 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:31.443 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.443 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.443 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:31.444 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.444 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.444 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:16:31.444 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:31.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.444 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.445 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:16:31.445 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:31.445 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.445 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.445 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:31.445 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:31.446 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.446 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:31.446 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:16:31.446 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:31.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.446 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.446 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:31.446 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:16:31.447 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:31.447 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.447 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.447 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:16:31.447 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:16:31.447 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:16:31.447 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:16:31.448 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:31.448 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:31.448 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:31.448 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:31.448 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.448 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:31.448 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:16:31.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:31.449 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:31.449 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:31.449 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:31.449 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:31.449 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:31.449 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:16:31.450 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:31.450 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.450 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.450 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:31.450 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:31.450 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:31.450 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:31.450 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:31.451 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:31.451 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:16:31.451 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:31.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.451 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.451 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:31.451 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:31.451 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:31.452 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:31.452 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:31.452 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:31.452 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:16:31.452 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:31.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.452 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.453 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:31.453 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:31.453 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:31.453 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:31.453 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:31.453 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:31.453 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:16:31.453 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:31.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.454 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.454 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:31.454 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:31.454 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:31.454 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:31.454 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:31.454 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:31.455 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:16:31.455 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:31.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.455 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.455 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:31.455 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:31.455 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:31.455 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:31.456 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:31.456 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:31.456 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:16:31.456 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:31.456 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.456 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.456 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:31.456 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:31.457 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:31.457 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:31.457 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:31.457 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:31.457 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:16:31.457 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:31.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.458 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:31.458 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:31.458 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:31.458 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:31.458 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:31.458 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:31.458 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:31.459 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:16:31.459 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:31.459 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.459 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:31.459 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:16:31.459 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:16:31.459 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:16:31.459 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:16:31.460 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:16:31.460 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:16:31.460 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:16:31.460 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:16:31.460 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:16:31.460 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:16:31.460 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:16:31.460 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:16:31.461 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:16:31.461 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:16:31.461 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.461 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:31.461 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:16:31.461 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:16:31.461 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:16:31.461 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:16:31.462 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:16:31.462 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:16:31.462 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:16:31.462 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:16:31.462 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:16:31.462 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:16:31.462 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:16:31.463 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:31.463 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74fc066280 msgr2=0x7f74fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:31.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74fc066280 0x7f74fc068730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7514000f70 tx=0x7f7514009040 comp rx=0 tx=0).stop 2023-07-09T02:16:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181604a0 msgr2=0x7f751815b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181604a0 0x7f751815b3e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f75100af040 tx=0x7f7510019770 comp rx=0 tx=0).stop 2023-07-09T02:16:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 shutdown_connections 2023-07-09T02:16:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75181604a0 0x7f751815b3e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f74fc066280 0x7f74fc068730 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75180cde40 0x7f75180c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 --2- 172.21.15.45:0/2798166921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75180c8dc0 0x7f75180b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:31.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 >> 172.21.15.45:0/2798166921 conn(0x7f75180694b0 msgr2=0x7f751815ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:31.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 shutdown_connections 2023-07-09T02:16:31.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:31.317+0000 7f7520056640 1 -- 172.21.15.45:0/2798166921 wait complete. 2023-07-09T02:16:31.466 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:16:34.382 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:16:34.381+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-07-09T02:16:36.468 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:16:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc2addb640 1 Processor -- start 2023-07-09T02:16:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc2addb640 1 -- start start 2023-07-09T02:16:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc2addb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc2415c060 0x7fdc240b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc2addb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 0x7fdc240cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc2addb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc24160a50 con 0x7fdc240cd120 2023-07-09T02:16:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc2addb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2415c430 con 0x7fdc2415c060 2023-07-09T02:16:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc2addb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2415fb60 con 0x7fdc240d2620 2023-07-09T02:16:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc28b77640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc2415c060 0x7fdc240b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc28b77640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc2415c060 0x7fdc240b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58900/0 (socket says 172.21.15.45:58900) 2023-07-09T02:16:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc28b77640 1 -- 172.21.15.45:0/2237679068 learned_addr learned my addr 172.21.15.45:0/2237679068 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc29378640 1 --2- 172.21.15.45:0/2237679068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 0x7fdc240cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc28b77640 1 -- 172.21.15.45:0/2237679068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 msgr2=0x7fdc240cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.621+0000 7fdc28b77640 1 --2- 172.21.15.45:0/2237679068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 0x7fdc240cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc28b77640 1 -- 172.21.15.45:0/2237679068 >> v1:172.21.15.155:6789/0 conn(0x7fdc240cd120 legacy=0x7fdc240d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc28b77640 1 -- 172.21.15.45:0/2237679068 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2415fe40 con 0x7fdc2415c060 2023-07-09T02:16:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc28b77640 1 --2- 172.21.15.45:0/2237679068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2415c060 0x7fdc240b4ed0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009870 tx=0x7fdc1801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a5f8add03d61c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc237fe640 1 -- 172.21.15.45:0/2237679068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180aa670 con 0x7fdc2415c060 2023-07-09T02:16:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc237fe640 1 -- 172.21.15.45:0/2237679068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180aa7d0 con 0x7fdc2415c060 2023-07-09T02:16:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc237fe640 1 -- 172.21.15.45:0/2237679068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180aab60 con 0x7fdc2415c060 2023-07-09T02:16:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc2addb640 1 -- 172.21.15.45:0/2237679068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2415c060 msgr2=0x7fdc240b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc2addb640 1 --2- 172.21.15.45:0/2237679068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2415c060 0x7fdc240b4ed0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009870 tx=0x7fdc1801c510 comp rx=0 tx=0).stop 2023-07-09T02:16:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc2addb640 1 -- 172.21.15.45:0/2237679068 shutdown_connections 2023-07-09T02:16:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc2addb640 1 --2- 172.21.15.45:0/2237679068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 0x7fdc240cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc2addb640 1 --2- 172.21.15.45:0/2237679068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2415c060 0x7fdc240b4ed0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc2addb640 1 -- 172.21.15.45:0/2237679068 >> 172.21.15.45:0/2237679068 conn(0x7fdc240698e0 msgr2=0x7fdc24069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc2addb640 1 -- 172.21.15.45:0/2237679068 shutdown_connections 2023-07-09T02:16:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.625+0000 7fdc2addb640 1 -- 172.21.15.45:0/2237679068 wait complete. 2023-07-09T02:16:36.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc2addb640 1 Processor -- start 2023-07-09T02:16:36.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc2addb640 1 -- start start 2023-07-09T02:16:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc2addb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cd120 0x7fdc240c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc2addb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 0x7fdc24153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc2addb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc2415c060 0x7fdc24151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc2addb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24152470 con 0x7fdc240cd120 2023-07-09T02:16:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc2addb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24152fe0 con 0x7fdc2415c060 2023-07-09T02:16:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc2addb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24153230 con 0x7fdc240d2620 2023-07-09T02:16:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cd120 0x7fdc240c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cd120 0x7fdc240c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58916/0 (socket says 172.21.15.45:58916) 2023-07-09T02:16:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 -- 172.21.15.45:0/3889397480 learned_addr learned my addr 172.21.15.45:0/3889397480 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc29378640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc2415c060 0x7fdc24151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc23fff640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 0x7fdc24153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 -- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 msgr2=0x7fdc24153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 0x7fdc24153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 -- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc2415c060 msgr2=0x7fdc24151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc2415c060 0x7fdc24151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 -- 172.21.15.45:0/3889397480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180094d0 con 0x7fdc240cd120 2023-07-09T02:16:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc28b77640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cd120 0x7fdc240c9420 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fdc180ac040 tx=0x7fdc1801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.629+0000 7fdc217fa640 1 -- 172.21.15.45:0/3889397480 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180b3800 con 0x7fdc240cd120 2023-07-09T02:16:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc217fa640 1 -- 172.21.15.45:0/3889397480 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180b3960 con 0x7fdc240cd120 2023-07-09T02:16:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc217fa640 1 -- 172.21.15.45:0/3889397480 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180b3d10 con 0x7fdc240cd120 2023-07-09T02:16:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240b59f0 con 0x7fdc240cd120 2023-07-09T02:16:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc241537f0 con 0x7fdc240cd120 2023-07-09T02:16:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2404d7d0 con 0x7fdc240cd120 2023-07-09T02:16:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc217fa640 1 -- 172.21.15.45:0/3889397480 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc180c73a0 con 0x7fdc240cd120 2023-07-09T02:16:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc217fa640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc217fa640 1 -- 172.21.15.45:0/3889397480 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc1811e8d0 con 0x7fdc240cd120 2023-07-09T02:16:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc217fa640 1 -- 172.21.15.45:0/3889397480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=109}) v3 -- 0x7fdc0806e3c0 con 0x7fdc240cd120 2023-07-09T02:16:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc23fff640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.633+0000 7fdc23fff640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdc240cafc0 tx=0x7fdc10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.637+0000 7fdc217fa640 1 -- 172.21.15.45:0/3889397480 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc180ebd60 con 0x7fdc240cd120 2023-07-09T02:16:36.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.793+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fdc2406baa0 con 0x7fdc240cd120 2023-07-09T02:16:36.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.793+0000 7fdc217fa640 1 -- 172.21.15.45:0/3889397480 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) v1 ==== 81+0+37070 (secure 0 0 0) 0x7fdc180c3070 con 0x7fdc240cd120 2023-07-09T02:16:36.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:36.796 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:36.796 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 108, 2023-07-09T02:16:36.796 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:16:36.796 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:16:36.796 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:16:36.398606+0000", 2023-07-09T02:16:36.796 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:16:36.796 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:16:36.797 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:16:36.797 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:16:36.797 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:16:36.797 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:16:36.797 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:16:36.797 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:16:36.797 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:16:36.798 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:36.798 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:16:36.798 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:16:36.798 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:16:36.798 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:16:36.798 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:16:36.798 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 14, 2023-07-09T02:16:36.799 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:16:36.799 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:16:36.799 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:16:36.799 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:16:36.799 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:16:36.799 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:16:36.799 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.800 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:16:36.800 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:16:36.800 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:16:36.800 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:36.800 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:36.800 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:36.800 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:36.801 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:36.801 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:36.801 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:36.801 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:36.801 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:36.801 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:36.801 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:36.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:36.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:16:36.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:16:36.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:16:36.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:16:36.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:16:36.802 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:36.803 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:36.803 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:36.803 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:36.803 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:36.803 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:36.803 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:36.803 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.804 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:36.804 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:36.804 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:36.804 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:36.804 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:36.804 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:36.804 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:36.805 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:36.805 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:36.805 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:36.805 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:36.805 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:36.805 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:36.805 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:36.806 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:36.807 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:36.807 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:36.807 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:36.807 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:36.807 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:36.807 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:36.807 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.807 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:36.808 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:16:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:16:36.809 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:16:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:16:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:16:36.810 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:16:36.811 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:16:36.811 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:16:36.811 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:36.811 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:36.811 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:36.811 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.812 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.812 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:16:36.812 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:16:36.812 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:16:36.812 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:36.812 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:36.813 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:36.813 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:36.813 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:36.813 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:36.813 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:36.813 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:36.813 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:36.814 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:36.814 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:36.814 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:36.814 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:16:36.814 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:16:36.814 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:16:36.814 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:16:36.815 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:16:36.815 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:36.815 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:36.815 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:36.815 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:36.815 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:36.815 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:36.815 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:36.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.816 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:36.816 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:36.816 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:36.816 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:36.816 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:36.817 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:36.817 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:36.817 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:36.817 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:36.817 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:36.817 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:36.817 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:36.818 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:36.818 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:36.818 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:36.818 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:36.818 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:36.818 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:36.818 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:36.819 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:36.819 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:36.819 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:36.819 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:36.819 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:36.819 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:36.819 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:36.820 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:36.820 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.820 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:36.820 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:36.820 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:36.820 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:36.820 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:36.821 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:36.821 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:36.821 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:36.821 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:36.821 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:36.821 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:36.821 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:16:36.822 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:36.822 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:16:36.822 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.822 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:36.822 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:16:36.822 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:16:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:16:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.824 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.824 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 13, 2023-07-09T02:16:36.824 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:16:36.824 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:15.254129+0000", 2023-07-09T02:16:36.824 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:36.824 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:36.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:36.825 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:36.825 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:36.825 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:36.825 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:36.825 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:36.825 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:36.825 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:36.826 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:36.826 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:36.826 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:16:36.826 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:16:36.826 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:16:36.826 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:16:36.826 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:16:36.827 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:36.827 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:36.827 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:36.827 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:36.827 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:36.827 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:36.827 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:36.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.828 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:36.828 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:36.828 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:36.828 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:36.828 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:36.828 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:36.829 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:36.829 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:36.829 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:36.829 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:36.829 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:36.829 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:36.829 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:36.830 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:36.830 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:36.830 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:36.830 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:36.830 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:36.830 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:36.830 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:36.831 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:36.831 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:36.831 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:36.831 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:36.831 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:36.831 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:36.831 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:16:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:16:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:16:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:16:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.835 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:36.835 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:16:36.835 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:16:36.835 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:36.835 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:16:36.835 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:16:36.835 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:36.836 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:36.836 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:36.836 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.836 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.836 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 14, 2023-07-09T02:16:36.836 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:16:36.837 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:16.522380+0000", 2023-07-09T02:16:36.837 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:36.837 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:36.837 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:36.837 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:36.837 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:36.837 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:36.838 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:36.838 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:36.838 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:36.838 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:36.838 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:36.838 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:36.838 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:16:36.839 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:16:36.839 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:16:36.839 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:16:36.839 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:16:36.839 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:36.839 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:36.839 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:36.839 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:36.840 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:36.840 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:36.840 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:36.840 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.840 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:36.840 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:36.840 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:36.841 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:36.841 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:36.841 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:36.841 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:36.841 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:36.841 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:36.842 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:36.842 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:36.842 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:36.842 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:36.842 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:36.842 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:36.842 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:36.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:36.843 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:36.843 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:36.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:36.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:36.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:36.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:36.844 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:36.844 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:36.844 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:36.844 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:36.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.844 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:36.844 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:36.845 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:36.845 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:36.845 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:36.845 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:36.845 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:36.845 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:36.845 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:36.846 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:36.846 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:36.846 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:36.846 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:16:36.846 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:16:36.846 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.846 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:36.847 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:36.847 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:16:36.847 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.847 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:36.847 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:16:36.847 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:16:36.848 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:36.848 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:36.848 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:36.848 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:36.848 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:36.848 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:36.848 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.849 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.849 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:36.849 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:16:36.849 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.849 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:36.849 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:36.849 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:36.850 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:36.850 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:36.850 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:36.850 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:36.850 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:36.850 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:36.850 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:36.851 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:36.851 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:36.851 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:36.851 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.851 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.851 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.851 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:16:36.851 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:36.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.852 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.852 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.852 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:16:36.852 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:36.852 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.853 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.853 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:36.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.853 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:16:36.854 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:36.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.854 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.854 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:16:36.854 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:36.854 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.855 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.855 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:36.855 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.855 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:16:36.856 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:36.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.856 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.856 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.856 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:16:36.856 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:36.856 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.857 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.857 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.857 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:36.857 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.857 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.857 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.857 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:16:36.858 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:36.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.858 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.858 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.858 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:16:36.858 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:36.858 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.859 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.859 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:16:36.859 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:16:36.859 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:16:36.859 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:16:36.859 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:36.860 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:36.860 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:36.860 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:36.860 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.860 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:36.861 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:36.861 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:36.861 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:36.861 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:36.861 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:36.861 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:36.861 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.862 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.863 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:16:36.864 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:36.864 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.864 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.864 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.864 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:36.864 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.864 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.865 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.865 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:16:36.865 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:36.865 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.865 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.865 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.865 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:16:36.866 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:36.866 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.866 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.866 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:36.866 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.866 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.867 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:16:36.867 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:36.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.867 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.867 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:16:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:16:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:16:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:36.870 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.870 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.870 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:16:36.870 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:16:36.870 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:16:36.870 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:16:36.871 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:36.871 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:36.871 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:36.871 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:36.871 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.871 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.871 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.872 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:36.872 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:36.872 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:36.872 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:36.872 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:36.872 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:36.872 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.874 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.874 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.874 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:16:36.874 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:36.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.874 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.874 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.875 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:16:36.875 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:36.875 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.875 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.875 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.875 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:36.875 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.875 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.876 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:16:36.876 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:36.876 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.876 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.877 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:16:36.877 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:36.877 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.877 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.877 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:36.877 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.877 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.878 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:16:36.878 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:36.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.878 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:16:36.879 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:36.879 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.879 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.879 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:36.879 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.879 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.880 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.880 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:16:36.880 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:36.880 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.880 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.880 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.880 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:16:36.881 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:36.881 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.881 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.881 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.881 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:16:36.881 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:16:36.881 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:16:36.882 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:16:36.882 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:36.882 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:36.882 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:36.882 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.882 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.883 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:36.883 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:36.883 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:36.883 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:36.883 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:36.883 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:36.883 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:36.884 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:36.884 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:36.884 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:36.884 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:36.884 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:36.884 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:36.884 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.884 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.885 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.885 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:16:36.885 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:36.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.885 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.885 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.885 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:16:36.886 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:36.886 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.886 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.886 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:36.886 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.886 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.887 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.887 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:16:36.887 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:36.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.887 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.887 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.887 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:16:36.888 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:36.888 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.888 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.888 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:36.888 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.888 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.889 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.889 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:16:36.889 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:36.889 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.889 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.889 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.889 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:16:36.890 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:36.890 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.890 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.890 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:36.890 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.890 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.890 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.891 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:16:36.891 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:36.891 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.891 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.891 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.891 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:16:36.891 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:36.892 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.892 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.892 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.892 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:16:36.892 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:16:36.892 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:16:36.892 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:16:36.893 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:36.893 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:36.893 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:36.893 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:36.893 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.893 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.894 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:36.894 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:36.894 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:36.894 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:36.894 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:36.894 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:36.894 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:36.895 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:36.895 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:36.895 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:36.895 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:36.895 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:36.895 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:36.895 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.896 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.896 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.896 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:16:36.896 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:36.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.896 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.896 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.897 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:16:36.897 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:36.897 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.897 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.897 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:36.897 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.898 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.898 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.898 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:16:36.898 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:36.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.898 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.898 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.899 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:16:36.899 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:36.899 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.899 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.899 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:36.899 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.900 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.900 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.900 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:16:36.900 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:36.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.900 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.900 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.901 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:16:36.901 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:36.901 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.901 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.901 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:36.901 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.901 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.902 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.902 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:16:36.902 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:36.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.902 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.902 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.902 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:16:36.903 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:36.903 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.903 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.903 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:16:36.903 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:16:36.903 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:16:36.904 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:16:36.904 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:36.904 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:36.904 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:36.904 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:36.904 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.904 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.905 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.905 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:36.905 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:36.905 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:36.905 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:36.905 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:36.905 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:36.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:36.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:36.906 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:36.906 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:36.906 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:36.906 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:36.906 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:36.907 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.907 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.907 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.907 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:16:36.907 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:36.907 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.907 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.907 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.908 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:16:36.908 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:36.908 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.908 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.908 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:36.908 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.909 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.909 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.909 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:16:36.909 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:36.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.909 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.909 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.910 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:16:36.910 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:36.910 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.910 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.910 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.910 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:36.910 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.911 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.911 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.911 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:16:36.911 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:36.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.911 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.911 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.911 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:16:36.912 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:36.912 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.912 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.912 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:36.912 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.912 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:16:36.913 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:36.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:16:36.914 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:36.914 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.914 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.914 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.914 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:16:36.914 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:16:36.915 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:16:36.915 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:16:36.915 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:36.915 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:36.915 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:36.915 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.915 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.916 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:36.916 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:36.916 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:36.916 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:36.916 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:36.916 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:36.916 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:16:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:16:36.919 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:36.919 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.919 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.919 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:36.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.920 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.920 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.920 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:16:36.920 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:36.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.920 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.920 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.921 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:16:36.921 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:36.921 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.921 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.921 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.921 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:36.921 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.922 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.922 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:16:36.922 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:36.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.922 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.923 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:16:36.923 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:36.923 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.923 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.923 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:36.923 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.924 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.924 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.924 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:16:36.924 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:36.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.924 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.925 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.925 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:16:36.925 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:36.925 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.925 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.925 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.925 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:16:36.926 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:16:36.926 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:16:36.926 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:16:36.926 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:36.926 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:36.926 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:36.926 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.927 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.927 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:36.927 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:36.927 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:36.927 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:36.927 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:36.928 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:36.928 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:36.928 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:36.928 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:36.928 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:36.928 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:36.928 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:36.929 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:36.929 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.929 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.929 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.929 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:16:36.929 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:36.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.929 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.930 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.930 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:16:36.930 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:36.930 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.930 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.930 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.930 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:36.931 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.931 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.931 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.931 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:16:36.931 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:36.931 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.931 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.932 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.932 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:16:36.932 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:36.932 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.932 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.932 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.932 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:36.933 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.933 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.933 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.933 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:16:36.933 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:36.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.933 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.934 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.934 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:16:36.934 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:36.934 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.934 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.934 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.934 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:36.935 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:36.935 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.935 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:36.935 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:16:36.935 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:36.935 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.935 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.936 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:36.936 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:16:36.936 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:36.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.936 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.936 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.936 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:16:36.937 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:16:36.937 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:16:36.937 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:16:36.937 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:36.937 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:36.937 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:36.937 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:36.938 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.938 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:36.938 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:16:36.938 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.938 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:36.938 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:36.938 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:36.938 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:36.939 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:36.939 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:36.939 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:16:36.939 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:36.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.939 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.939 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:36.940 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:36.940 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:36.940 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:36.940 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:36.940 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:36.940 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:16:36.940 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:36.941 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.941 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.941 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:36.941 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:36.941 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:36.941 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:36.941 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:36.942 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:36.942 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:16:36.942 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:36.942 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.942 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.942 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:36.942 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:36.943 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:36.943 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:36.943 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:36.943 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:36.943 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:16:36.943 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:36.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.943 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.944 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:36.944 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:36.944 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:36.944 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:36.944 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:36.944 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:36.944 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:16:36.945 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:36.945 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.945 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.945 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:36.945 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:36.945 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:36.945 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:36.946 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:36.946 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:36.946 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:16:36.946 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:36.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.946 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.946 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:36.947 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:36.947 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:36.947 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:36.947 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:36.947 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:36.947 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:16:36.947 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:36.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.948 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:36.948 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:36.948 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:36.948 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:36.948 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:36.948 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:36.948 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:36.949 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:16:36.949 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:36.949 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.949 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:36.949 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:16:36.949 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:16:36.949 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:16:36.950 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:16:36.950 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:16:36.950 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:16:36.950 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:16:36.950 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:16:36.950 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:16:36.950 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:16:36.951 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:16:36.951 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:16:36.951 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:16:36.951 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:16:36.951 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.951 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:36.951 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:16:36.952 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:16:36.952 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:16:36.952 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:16:36.952 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:16:36.952 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:16:36.952 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:16:36.952 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:16:36.953 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:16:36.953 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:16:36.953 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:16:36.953 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 msgr2=0x7fdc08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:36.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdc240cafc0 tx=0x7fdc10009040 comp rx=0 tx=0).stop 2023-07-09T02:16:36.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cd120 msgr2=0x7fdc240c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:36.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cd120 0x7fdc240c9420 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fdc180ac040 tx=0x7fdc1801ad50 comp rx=0 tx=0).stop 2023-07-09T02:16:36.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 shutdown_connections 2023-07-09T02:16:36.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc2415c060 0x7fdc24151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240d2620 0x7fdc24153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 --2- 172.21.15.45:0/3889397480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cd120 0x7fdc240c9420 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:36.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 >> 172.21.15.45:0/3889397480 conn(0x7fdc240698e0 msgr2=0x7fdc240b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:36.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 shutdown_connections 2023-07-09T02:16:36.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:36.797+0000 7fdc2addb640 1 -- 172.21.15.45:0/3889397480 wait complete. 2023-07-09T02:16:36.957 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-07-09T02:16:36.957 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:36.958 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:36.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:36.968 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-07-09T02:16:37.311 INFO:teuthology.orchestra.run.smithi045.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-07-09T02:16:37.312 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records in 2023-07-09T02:16:37.312 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records out 2023-07-09T02:16:37.312 INFO:teuthology.orchestra.run.smithi045.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.286528 s, 183 MB/s 2023-07-09T02:16:37.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:16:37.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:16:37.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156eebd640 1 Processor -- start 2023-07-09T02:16:37.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156eebd640 1 -- start start 2023-07-09T02:16:37.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156eebd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f156815c060 0x7f15680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156eebd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15680cd120 0x7f15680d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156eebd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1568160a50 con 0x7f15680d2450 2023-07-09T02:16:37.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156eebd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15680d28d0 con 0x7f156815c060 2023-07-09T02:16:37.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156eebd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15680cfe40 con 0x7f15680cd120 2023-07-09T02:16:37.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156cc59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f156815c060 0x7f15680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156d45a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f15680d2450 0x7f15680d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43068/0 (socket says 172.21.15.45:43068) 2023-07-09T02:16:37.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156d45a640 1 -- 172.21.15.45:0/1023276939 learned_addr learned my addr 172.21.15.45:0/1023276939 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:37.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f1567fff640 1 --2- 172.21.15.45:0/1023276939 >> v2:172.21.15.155:3300/0 conn(0x7f15680cd120 0x7f15680d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156cc59640 1 -- 172.21.15.45:0/1023276939 >> v2:172.21.15.155:3300/0 conn(0x7f15680cd120 msgr2=0x7f15680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:37.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156cc59640 1 --2- 172.21.15.45:0/1023276939 >> v2:172.21.15.155:3300/0 conn(0x7f15680cd120 0x7f15680d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156cc59640 1 -- 172.21.15.45:0/1023276939 >> v1:172.21.15.45:6789/0 conn(0x7f15680d2450 legacy=0x7f15680d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f156cc59640 1 -- 172.21.15.45:0/1023276939 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156815c430 con 0x7f156815c060 2023-07-09T02:16:37.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f15677fe640 1 -- 172.21.15.45:0/1023276939 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355708437 0 0) 0x7f1568160a50 con 0x7f15680d2450 2023-07-09T02:16:37.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.457+0000 7f1567fff640 1 --2- 172.21.15.45:0/1023276939 >> v2:172.21.15.155:3300/0 conn(0x7f15680cd120 0x7f15680d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:37.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156cc59640 1 --2- 172.21.15.45:0/1023276939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ed0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f156815fac0 tx=0x7f155c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2230251084e2cea3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:37.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f15677fe640 1 -- 172.21.15.45:0/1023276939 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c004230 con 0x7f156815c060 2023-07-09T02:16:37.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f15677fe640 1 -- 172.21.15.45:0/1023276939 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c0a7050 con 0x7f156815c060 2023-07-09T02:16:37.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f15677fe640 1 -- 172.21.15.45:0/1023276939 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c003620 con 0x7f156815c060 2023-07-09T02:16:37.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156eebd640 1 -- 172.21.15.45:0/1023276939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 msgr2=0x7f15680b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156eebd640 1 --2- 172.21.15.45:0/1023276939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ed0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f156815fac0 tx=0x7f155c01c430 comp rx=0 tx=0).stop 2023-07-09T02:16:37.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156eebd640 1 -- 172.21.15.45:0/1023276939 shutdown_connections 2023-07-09T02:16:37.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156eebd640 1 --2- 172.21.15.45:0/1023276939 >> v2:172.21.15.155:3300/0 conn(0x7f15680cd120 0x7f15680d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156eebd640 1 --2- 172.21.15.45:0/1023276939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ed0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156eebd640 1 -- 172.21.15.45:0/1023276939 >> 172.21.15.45:0/1023276939 conn(0x7f15680698e0 msgr2=0x7f1568069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:37.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156eebd640 1 -- 172.21.15.45:0/1023276939 shutdown_connections 2023-07-09T02:16:37.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.461+0000 7f156eebd640 1 -- 172.21.15.45:0/1023276939 wait complete. 2023-07-09T02:16:37.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 Processor -- start 2023-07-09T02:16:37.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 -- start start 2023-07-09T02:16:37.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15680cd120 0x7f1568151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15680d2450 0x7f15680b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15680ca440 con 0x7f156815c060 2023-07-09T02:16:37.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156815f4e0 con 0x7f15680d2450 2023-07-09T02:16:37.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15680c9b10 con 0x7f15680cd120 2023-07-09T02:16:37.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58932/0 (socket says 172.21.15.45:58932) 2023-07-09T02:16:37.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 -- 172.21.15.45:0/928221988 learned_addr learned my addr 172.21.15.45:0/928221988 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:37.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156cc59640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15680cd120 0x7f1568151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f1567fff640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15680d2450 0x7f15680b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 -- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15680cd120 msgr2=0x7f1568151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15680cd120 0x7f1568151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 -- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15680d2450 msgr2=0x7f15680b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15680d2450 0x7f15680b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 -- 172.21.15.45:0/928221988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c009420 con 0x7f156815c060 2023-07-09T02:16:37.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156d45a640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ca0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1560001570 tx=0x7f156000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:37.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f15657fa640 1 -- 172.21.15.45:0/928221988 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000a640 con 0x7f156815c060 2023-07-09T02:16:37.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f15657fa640 1 -- 172.21.15.45:0/928221988 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156000a7c0 con 0x7f156815c060 2023-07-09T02:16:37.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f15657fa640 1 -- 172.21.15.45:0/928221988 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000ab70 con 0x7f156815c060 2023-07-09T02:16:37.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15680c9df0 con 0x7f156815c060 2023-07-09T02:16:37.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.465+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1568151d80 con 0x7f156815c060 2023-07-09T02:16:37.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.469+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15680ca5f0 con 0x7f156815c060 2023-07-09T02:16:37.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.469+0000 7f15657fa640 1 -- 172.21.15.45:0/928221988 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f156000acd0 con 0x7f156815c060 2023-07-09T02:16:37.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.469+0000 7f15657fa640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f154c0662b0 0x7f154c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.469+0000 7f15657fa640 1 -- 172.21.15.45:0/928221988 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15600831a0 con 0x7f156815c060 2023-07-09T02:16:37.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.469+0000 7f15657fa640 1 -- 172.21.15.45:0/928221988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=109}) v3 -- 0x7f154c06e3f0 con 0x7f156815c060 2023-07-09T02:16:37.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.469+0000 7f156cc59640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f154c0662b0 0x7f154c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.469+0000 7f156cc59640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f154c0662b0 0x7f154c068760 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f155c0ad000 tx=0x7f155c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:37.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.473+0000 7f15657fa640 1 -- 172.21.15.45:0/928221988 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15680ca5f0 con 0x7f156815c060 2023-07-09T02:16:37.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.629+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f156804d7d0 con 0x7f156815c060 2023-07-09T02:16:37.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.629+0000 7f15657fa640 1 -- 172.21.15.45:0/928221988 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) v1 ==== 81+0+37070 (secure 0 0 0) 0x7f1560018070 con 0x7f156815c060 2023-07-09T02:16:37.631 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:37.632 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:37.632 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 108, 2023-07-09T02:16:37.632 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:16:37.632 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:16:37.632 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:16:36.398606+0000", 2023-07-09T02:16:37.632 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:16:37.632 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:16:37.633 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:16:37.633 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:16:37.633 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:16:37.633 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:16:37.633 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:16:37.633 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:16:37.633 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:16:37.634 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:37.634 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:16:37.634 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:16:37.634 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:16:37.635 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:16:37.635 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:16:37.635 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 14, 2023-07-09T02:16:37.635 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:16:37.635 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:16:37.635 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:16:37.636 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:16:37.636 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:16:37.636 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:16:37.636 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.636 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:16:37.636 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:16:37.637 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:16:37.637 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:37.637 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:37.637 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:37.637 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:37.637 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:37.637 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:37.637 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:37.638 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:37.638 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:37.638 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:37.638 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:37.638 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:37.638 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:16:37.638 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:16:37.639 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:16:37.639 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:16:37.639 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:16:37.639 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:37.639 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:37.639 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:37.639 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:37.639 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:37.640 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:37.640 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:37.640 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.640 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:37.640 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:37.640 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:37.640 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:37.640 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:37.641 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:37.641 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:37.641 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:37.641 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:37.641 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:37.641 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:37.641 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:37.642 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:37.642 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:37.642 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:37.642 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:37.642 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:37.642 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:37.642 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:37.642 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:37.643 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.644 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:37.644 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:37.644 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:37.644 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:37.644 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:37.644 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:37.645 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:37.645 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:37.645 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:37.645 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:37.646 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:37.646 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:37.646 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:16:37.646 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:16:37.647 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.647 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:37.647 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:16:37.647 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.647 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:37.647 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:16:37.647 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:16:37.648 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:16:37.648 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:16:37.648 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:16:37.648 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:37.648 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:37.648 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:37.648 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.649 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.649 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.649 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:16:37.649 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:16:37.649 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:16:37.649 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:37.649 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:37.649 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:37.650 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:37.650 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:37.650 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:37.650 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:37.650 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:37.650 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:37.650 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:37.650 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:37.651 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:37.651 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:16:37.651 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:16:37.651 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:16:37.651 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:16:37.651 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:16:37.651 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:37.651 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:37.652 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:37.652 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:37.652 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:37.652 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:37.652 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:37.652 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.652 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:37.653 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:37.654 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:37.655 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:37.655 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:37.655 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:37.655 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:37.655 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:37.655 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:37.655 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:37.655 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:37.656 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:37.656 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:37.656 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.656 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:37.656 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:37.656 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:37.657 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:37.657 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:37.657 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:37.657 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:37.657 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:37.657 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:37.657 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:37.658 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:37.658 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:16:37.658 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:37.658 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:16:37.658 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.658 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:37.658 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:16:37.658 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:16:37.659 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:16:37.659 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:37.659 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:37.659 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:37.659 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:37.659 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:37.659 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.660 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.660 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 13, 2023-07-09T02:16:37.660 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:16:37.660 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:15.254129+0000", 2023-07-09T02:16:37.660 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:37.660 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:37.660 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:37.661 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:37.661 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:37.661 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:37.661 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:37.661 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:37.661 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:37.661 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:37.662 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:37.662 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:37.662 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:16:37.662 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:16:37.662 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:16:37.662 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:16:37.663 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:16:37.663 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:37.663 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:37.663 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:37.663 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:37.663 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:37.663 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:37.663 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:37.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.664 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:37.664 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:37.664 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:37.664 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:37.665 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:37.665 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:37.665 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:37.665 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:37.665 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:37.665 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:37.666 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:37.666 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:37.666 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:37.666 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:37.666 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:37.666 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:37.666 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:37.666 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:37.667 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:37.667 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:37.667 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:37.667 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:37.667 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:37.667 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:37.667 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:37.668 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:37.668 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:37.668 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.668 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:37.668 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:37.668 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:37.668 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:37.668 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:37.669 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:37.669 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:37.669 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:37.669 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:37.669 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:37.669 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:37.670 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:37.670 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:16:37.670 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:16:37.670 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:16:37.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.670 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:37.670 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:37.670 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:16:37.671 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.671 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:37.671 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:16:37.671 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:16:37.671 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:37.671 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:16:37.672 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:16:37.672 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:37.672 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:37.672 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:37.672 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.672 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.672 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.672 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 14, 2023-07-09T02:16:37.673 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:16:37.673 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:16.522380+0000", 2023-07-09T02:16:37.673 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:37.673 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:37.673 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:37.673 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:37.673 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:37.674 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:37.674 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:37.674 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:37.674 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:37.674 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:37.674 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:37.674 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:37.674 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:16:37.675 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:16:37.675 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:16:37.675 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:16:37.675 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:16:37.675 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:37.675 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:37.675 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:37.676 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:37.676 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:37.676 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:37.676 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:37.676 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.676 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:37.676 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:37.676 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:37.677 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:37.677 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:37.677 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:37.677 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:37.677 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:37.677 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:37.677 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:37.678 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:37.678 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:37.678 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:37.678 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:37.678 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:37.678 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:37.678 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:37.678 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:37.679 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:37.679 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:37.679 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:37.679 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:37.679 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:37.679 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:37.679 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:37.679 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:37.680 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:37.680 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.680 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:37.680 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:37.680 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:37.680 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:37.680 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:37.680 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:37.681 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:37.681 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:37.681 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:37.681 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:37.681 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:37.681 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:37.681 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:16:37.682 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:16:37.682 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.682 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:37.682 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:37.682 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:16:37.682 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.682 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.683 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:37.683 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:16:37.683 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:16:37.683 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:37.683 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:37.683 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:37.683 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:37.684 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:37.684 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:37.684 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.684 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.684 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:37.684 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:16:37.684 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.685 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:37.685 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:37.685 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:37.685 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:37.685 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:37.685 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:37.685 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:37.685 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:37.686 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:37.686 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:37.686 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:37.686 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:37.686 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:37.686 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.686 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.686 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.687 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:16:37.687 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:37.687 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.687 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.687 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.687 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:16:37.687 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:37.688 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.688 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.688 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.688 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:37.688 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.688 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.688 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.689 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:16:37.689 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:37.689 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.689 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.689 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.689 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:16:37.689 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:37.689 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.690 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.690 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.690 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:37.690 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.690 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.690 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.690 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:16:37.690 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:37.691 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.691 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.691 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.691 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:16:37.691 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:37.691 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.691 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.692 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.692 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:37.692 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.692 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.692 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.692 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:16:37.692 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:37.693 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.693 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.693 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.693 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:16:37.693 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:37.693 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.693 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.693 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.694 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:16:37.694 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:16:37.694 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:16:37.694 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:16:37.694 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:37.694 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:37.694 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.698 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.698 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:16:37.698 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:37.698 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.699 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.699 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.699 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:16:37.699 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:37.700 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.700 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.700 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.700 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:37.701 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.701 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.701 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.701 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:16:37.702 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:37.702 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.702 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.702 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.703 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:16:37.703 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:37.703 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.703 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.704 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.704 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:37.704 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.705 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.705 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.705 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:16:37.706 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:37.706 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.706 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.706 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.707 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:16:37.707 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:37.707 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.707 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.708 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.708 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:37.708 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.709 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.709 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.709 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:16:37.709 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:37.710 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.710 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.710 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.710 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:16:37.710 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:37.711 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.711 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.711 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.712 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:16:37.712 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:16:37.712 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:16:37.712 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:16:37.712 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:37.713 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:37.713 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:37.713 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:37.713 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.713 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.713 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.713 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:37.713 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:37.714 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:37.714 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:37.714 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:37.714 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:37.714 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:37.714 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:37.715 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:37.715 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:37.715 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:37.715 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:37.715 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:37.715 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.715 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.715 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.716 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:16:37.716 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:37.716 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.716 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.716 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.716 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:16:37.716 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:37.717 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.717 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.717 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.717 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:37.717 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.717 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.717 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.717 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:16:37.718 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:37.718 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.718 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.718 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.718 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:16:37.718 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:37.718 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.719 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.719 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.719 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:37.719 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.719 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.719 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.719 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:16:37.719 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:37.720 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.720 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.720 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.720 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:16:37.720 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:37.720 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.720 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.721 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.721 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:37.721 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.721 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.721 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.721 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:16:37.721 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:37.721 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.722 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.722 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.722 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:16:37.722 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:37.722 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.722 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.722 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.722 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:16:37.723 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:16:37.723 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:16:37.723 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:16:37.723 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:37.723 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:37.723 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:37.723 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.723 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.724 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.724 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:37.724 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:37.724 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:37.724 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:37.724 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:37.725 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:37.725 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:37.725 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:37.725 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:37.725 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:37.725 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:37.725 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:37.725 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:37.726 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.726 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.726 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.726 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:16:37.726 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:37.726 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.726 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.726 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.727 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:16:37.727 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:37.727 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.727 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.727 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.727 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:37.727 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.727 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.728 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.728 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:16:37.728 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:37.728 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.728 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.728 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.729 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:16:37.729 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:37.729 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.729 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.729 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.729 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:37.729 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.729 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.730 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.730 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:16:37.730 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:37.730 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.730 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.730 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.730 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:16:37.730 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:37.731 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.731 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.731 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.731 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:37.731 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.731 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.732 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.732 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:16:37.732 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:37.732 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.732 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.732 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.732 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:16:37.733 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:37.733 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.733 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.733 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.733 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:16:37.733 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:16:37.734 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:16:37.734 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:16:37.734 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:37.734 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:37.734 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:37.734 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:37.734 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.734 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.735 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.735 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:37.735 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:37.735 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:37.735 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:37.735 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:37.735 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:37.736 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:37.736 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:37.736 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:37.736 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:37.736 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:37.736 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:37.736 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:37.736 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.737 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.737 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.737 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:16:37.737 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:37.737 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.737 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.737 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.737 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:16:37.738 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:37.738 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.738 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.738 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.738 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:37.738 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.738 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.738 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.739 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:16:37.739 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:37.739 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.739 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.739 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.739 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:16:37.740 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:37.740 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.740 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.740 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.740 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:37.740 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.740 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.741 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.741 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:16:37.741 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:37.741 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.741 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.741 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.741 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:16:37.741 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:37.742 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.742 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.742 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.742 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:37.742 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.742 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.742 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.743 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:16:37.743 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:37.743 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.743 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.743 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.743 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:16:37.743 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:37.743 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.744 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.744 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.744 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:16:37.744 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:16:37.744 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:16:37.744 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:16:37.744 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:37.744 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:37.745 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:37.745 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:37.745 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.745 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.745 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.745 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:37.746 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:37.746 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:37.746 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:37.746 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:37.746 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:37.747 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:37.747 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:37.747 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:37.747 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:37.748 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:37.748 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:37.748 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:37.748 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.749 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.749 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.749 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:16:37.750 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:37.750 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.750 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.750 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.751 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:16:37.751 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:37.751 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.751 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.752 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:37.752 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.752 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.753 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.753 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:16:37.753 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:37.753 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.754 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.754 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.754 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:16:37.754 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:37.755 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.755 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.755 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.755 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:37.755 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.755 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.756 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.756 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:16:37.756 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:37.756 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.756 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.756 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.756 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:16:37.757 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:37.757 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.757 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.757 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.757 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:37.757 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.757 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.757 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.758 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:16:37.758 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:37.758 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.758 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.758 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.758 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:16:37.758 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:37.758 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.759 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.759 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.759 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:16:37.759 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:16:37.759 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:16:37.759 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:16:37.759 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:37.759 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:37.760 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:37.760 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.760 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.760 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.760 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:37.760 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:37.760 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:37.761 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:37.761 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:37.761 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:37.761 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:37.761 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:37.761 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:37.761 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:37.761 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:37.762 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:37.762 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:37.762 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.762 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.762 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.762 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:16:37.762 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:37.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.763 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.763 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.763 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:16:37.763 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:37.763 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.763 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.763 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.763 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:37.764 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.764 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.764 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.764 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:16:37.765 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:37.765 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.765 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.765 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.765 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:16:37.766 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:37.766 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.766 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.766 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.766 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:37.766 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.766 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.767 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.767 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:16:37.767 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:37.767 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.767 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.767 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.767 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:16:37.768 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:37.768 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.768 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.768 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:37.768 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.768 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:16:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:16:37.769 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:37.770 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.770 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.770 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.770 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:16:37.770 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:16:37.770 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:16:37.770 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:16:37.771 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:37.771 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:37.771 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:37.771 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.771 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.771 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.771 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:37.772 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:37.772 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:37.772 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:37.772 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:37.772 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:37.772 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:37.772 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:37.773 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:37.773 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:37.773 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:37.773 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:37.773 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:37.773 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.773 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.773 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.774 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:16:37.774 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:37.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.774 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.774 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.774 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:16:37.774 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:37.774 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.775 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.775 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.775 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:37.775 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.775 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.775 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.775 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:16:37.776 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:37.776 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.776 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.776 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.776 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:16:37.776 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:37.776 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.777 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.777 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.777 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:37.777 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.777 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.777 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.777 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:16:37.777 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:16:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.779 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:37.779 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:37.779 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.779 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:37.779 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:16:37.779 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:37.779 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.779 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.780 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:37.780 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:16:37.780 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:37.780 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.780 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.780 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.780 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:16:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:16:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:16:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:16:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:37.781 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.782 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:37.782 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:16:37.782 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.782 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:37.782 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:37.782 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:37.782 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:37.783 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:37.783 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:37.783 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:16:37.783 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:37.783 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.783 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.783 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:37.784 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:37.784 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:37.784 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:37.784 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:37.784 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:37.785 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:16:37.785 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:37.785 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.785 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.785 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:37.785 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:37.785 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:37.786 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:37.786 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:37.786 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:37.786 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:16:37.786 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:37.786 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.786 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.787 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:37.787 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:37.787 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:37.787 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:37.787 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:37.787 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:37.787 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:16:37.787 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:37.788 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.788 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.788 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:37.788 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:37.788 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:37.788 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:37.788 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:37.789 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:37.789 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:16:37.789 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:37.789 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.789 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.789 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:37.789 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:37.789 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:37.790 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:37.790 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:37.790 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:37.790 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:16:37.790 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:37.790 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.791 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.791 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:37.791 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:37.791 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:37.791 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:37.791 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:37.792 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:37.792 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:16:37.792 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:37.792 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.792 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:37.792 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:37.792 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:37.793 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:37.793 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:37.793 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:37.793 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:37.793 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:16:37.793 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:37.793 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.793 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:37.794 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:16:37.794 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:16:37.794 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:16:37.794 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:16:37.794 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:16:37.794 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:16:37.794 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:16:37.795 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:16:37.795 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:16:37.795 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:16:37.795 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:16:37.795 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:16:37.795 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:16:37.795 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:16:37.795 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:16:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:16:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:16:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:16:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:16:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:16:37.797 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:16:37.797 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:16:37.797 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:16:37.797 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:16:37.797 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:16:37.797 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:37.797 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:37.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f154c0662b0 msgr2=0x7f154c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f154c0662b0 0x7f154c068760 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f155c0ad000 tx=0x7f155c008040 comp rx=0 tx=0).stop 2023-07-09T02:16:37.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 msgr2=0x7f15680b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ca0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1560001570 tx=0x7f156000cca0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 shutdown_connections 2023-07-09T02:16:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f156815c060 0x7f15680b4ca0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15680d2450 0x7f15680b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f154c0662b0 0x7f154c068760 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 --2- 172.21.15.45:0/928221988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15680cd120 0x7f1568151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 >> 172.21.15.45:0/928221988 conn(0x7f15680698e0 msgr2=0x7f15680d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 shutdown_connections 2023-07-09T02:16:37.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.633+0000 7f156eebd640 1 -- 172.21.15.45:0/928221988 wait complete. 2023-07-09T02:16:37.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:37.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f615227b640 1 Processor -- start 2023-07-09T02:16:37.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f615227b640 1 -- start start 2023-07-09T02:16:37.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f615227b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f615227b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f614c0cd120 0x7f614c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f615227b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c160a50 con 0x7f614c15c060 2023-07-09T02:16:37.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f615227b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c15c430 con 0x7f614c0cd120 2023-07-09T02:16:37.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f615227b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c15fb60 con 0x7f614c0d2620 2023-07-09T02:16:37.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614bfff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f614c15c060 0x7f614c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:47228/0 (socket says 172.21.15.45:47228) 2023-07-09T02:16:37.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614bfff640 1 -- 172.21.15.45:0/1345675525 learned_addr learned my addr 172.21.15.45:0/1345675525 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:37.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:40734/0 (socket says 172.21.15.45:40734) 2023-07-09T02:16:37.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f6150818640 1 --2- 172.21.15.45:0/1345675525 >> v2:172.21.15.155:3300/0 conn(0x7f614c0cd120 0x7f614c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614b7fe640 1 -- 172.21.15.45:0/1345675525 >> v2:172.21.15.155:3300/0 conn(0x7f614c0cd120 msgr2=0x7f614c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:37.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614b7fe640 1 --2- 172.21.15.45:0/1345675525 >> v2:172.21.15.155:3300/0 conn(0x7f614c0cd120 0x7f614c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614affd640 1 -- 172.21.15.45:0/1345675525 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008598345 0 0) 0x7f614c160a50 con 0x7f614c15c060 2023-07-09T02:16:37.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614b7fe640 1 -- 172.21.15.45:0/1345675525 >> v1:172.21.15.155:6789/0 conn(0x7f614c15c060 legacy=0x7f614c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f614b7fe640 1 -- 172.21.15.45:0/1345675525 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c15fe40 con 0x7f614c0d2620 2023-07-09T02:16:37.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.945+0000 7f6150818640 1 --2- 172.21.15.45:0/1345675525 >> v2:172.21.15.155:3300/0 conn(0x7f614c0cd120 0x7f614c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:37.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f614b7fe640 1 --2- 172.21.15.45:0/1345675525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c0b4ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f61400097c0 tx=0x7f614001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=552ae51e91a63446 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:37.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f614affd640 1 -- 172.21.15.45:0/1345675525 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400ab650 con 0x7f614c0d2620 2023-07-09T02:16:37.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f614affd640 1 -- 172.21.15.45:0/1345675525 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61400ab7b0 con 0x7f614c0d2620 2023-07-09T02:16:37.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f614affd640 1 -- 172.21.15.45:0/1345675525 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400abb40 con 0x7f614c0d2620 2023-07-09T02:16:37.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f615227b640 1 -- 172.21.15.45:0/1345675525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 msgr2=0x7f614c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f615227b640 1 --2- 172.21.15.45:0/1345675525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c0b4ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f61400097c0 tx=0x7f614001c450 comp rx=0 tx=0).stop 2023-07-09T02:16:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f615227b640 1 -- 172.21.15.45:0/1345675525 shutdown_connections 2023-07-09T02:16:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f615227b640 1 --2- 172.21.15.45:0/1345675525 >> v2:172.21.15.155:3300/0 conn(0x7f614c0cd120 0x7f614c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f615227b640 1 --2- 172.21.15.45:0/1345675525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c0b4ed0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f615227b640 1 -- 172.21.15.45:0/1345675525 >> 172.21.15.45:0/1345675525 conn(0x7f614c0698e0 msgr2=0x7f614c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f615227b640 1 -- 172.21.15.45:0/1345675525 shutdown_connections 2023-07-09T02:16:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.949+0000 7f615227b640 1 -- 172.21.15.45:0/1345675525 wait complete. 2023-07-09T02:16:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 Processor -- start 2023-07-09T02:16:37.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 -- start start 2023-07-09T02:16:37.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614c0cd120 0x7f614c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f614c15c060 0x7f614c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c1595e0 con 0x7f614c0cd120 2023-07-09T02:16:37.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c15ada0 con 0x7f614c15c060 2023-07-09T02:16:37.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c158cb0 con 0x7f614c0d2620 2023-07-09T02:16:37.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614c0cd120 0x7f614c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614c0cd120 0x7f614c159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58944/0 (socket says 172.21.15.45:58944) 2023-07-09T02:16:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 -- 172.21.15.45:0/3955420038 learned_addr learned my addr 172.21.15.45:0/3955420038 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614b7fe640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f6150818640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f614c15c060 0x7f614c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 -- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 msgr2=0x7f614c14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c14e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 -- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f614c15c060 msgr2=0x7f614c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f614c15c060 0x7f614c15a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 -- 172.21.15.45:0/3955420038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009a70 con 0x7f614c0cd120 2023-07-09T02:16:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f6150818640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f614c15c060 0x7f614c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f614bfff640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614c0cd120 0x7f614c159a70 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f613c00c480 tx=0x7f613c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f6148ff9640 1 -- 172.21.15.45:0/3955420038 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0074e0 con 0x7f614c0cd120 2023-07-09T02:16:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f6148ff9640 1 -- 172.21.15.45:0/3955420038 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c007660 con 0x7f614c0cd120 2023-07-09T02:16:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f6148ff9640 1 -- 172.21.15.45:0/3955420038 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c004a30 con 0x7f614c0cd120 2023-07-09T02:16:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6140009420 con 0x7f614c0cd120 2023-07-09T02:16:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.953+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c0b59f0 con 0x7f614c0cd120 2023-07-09T02:16:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.957+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c04d7d0 con 0x7f614c0cd120 2023-07-09T02:16:37.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.957+0000 7f6148ff9640 1 -- 172.21.15.45:0/3955420038 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f613c004b90 con 0x7f614c0cd120 2023-07-09T02:16:37.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.957+0000 7f6148ff9640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6138066280 0x7f6138068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:37.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.957+0000 7f6148ff9640 1 -- 172.21.15.45:0/3955420038 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f613c082eb0 con 0x7f614c0cd120 2023-07-09T02:16:37.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.957+0000 7f6148ff9640 1 -- 172.21.15.45:0/3955420038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=109}) v3 -- 0x7f613806e3c0 con 0x7f614c0cd120 2023-07-09T02:16:37.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.957+0000 7f614b7fe640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6138066280 0x7f6138068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:37.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.957+0000 7f614b7fe640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6138066280 0x7f6138068730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f61400af000 tx=0x7f61400a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:37.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:37.961+0000 7f6148ff9640 1 -- 172.21.15.45:0/3955420038 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f613c018020 con 0x7f614c0cd120 2023-07-09T02:16:38.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.149+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f614c06baa0 con 0x7f614c0cd120 2023-07-09T02:16:38.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.149+0000 7f6148ff9640 1 -- 172.21.15.45:0/3955420038 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f613c053e60 con 0x7f614c0cd120 2023-07-09T02:16:38.151 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:38.152 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:38.152 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:38.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6138066280 msgr2=0x7f6138068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:38.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6138066280 0x7f6138068730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f61400af000 tx=0x7f61400a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:38.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614c0cd120 msgr2=0x7f614c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:38.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614c0cd120 0x7f614c159a70 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f613c00c480 tx=0x7f613c00c940 comp rx=0 tx=0).stop 2023-07-09T02:16:38.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 shutdown_connections 2023-07-09T02:16:38.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f614c15c060 0x7f614c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6138066280 0x7f6138068730 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f614c0d2620 0x7f614c14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 --2- 172.21.15.45:0/3955420038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614c0cd120 0x7f614c159a70 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 >> 172.21.15.45:0/3955420038 conn(0x7f614c0698e0 msgr2=0x7f614c1583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:38.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 shutdown_connections 2023-07-09T02:16:38.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.153+0000 7f615227b640 1 -- 172.21.15.45:0/3955420038 wait complete. 2023-07-09T02:16:38.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-07-09T02:16:38.336 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":6939,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.196096989000001,"mdsmap_epoch":51,"osdmap_epoch":108,"osdmap_epoch_barrier":108,"uptime":25.956227503000001} 2023-07-09T02:16:38.337 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 6939, "mdsmap_epoch": 51, "osdmap_epoch": 108, "osdmap_epoch_barrier": 108, "rank_uptime": 20.196096989, "state": "up:active", "uptime": 25.956227503, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:16:38.337 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:16:38.338 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:38.338 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:38.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:38.348 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-07-09T02:16:38.400 INFO:teuthology.orchestra.run.smithi045.stderr:dd: failed to open 'small_file_1': Permission denied 2023-07-09T02:16:38.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:16:38.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:38.402 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-07-09T02:16:38.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:38.454 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-07-09T02:16:38.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:16:38.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b77d11640 1 Processor -- start 2023-07-09T02:16:38.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b77d11640 1 -- start start 2023-07-09T02:16:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b77d11640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1b7015c060 0x7f1b700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b77d11640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b700cd120 0x7f1b700d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b77d11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b700d2450 0x7f1b700d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b77d11640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b700d28f0 con 0x7f1b700cd120 2023-07-09T02:16:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b77d11640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b70160a50 con 0x7f1b7015c060 2023-07-09T02:16:38.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b77d11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7015c430 con 0x7f1b700d2450 2023-07-09T02:16:38.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b752ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b700cd120 0x7f1b700d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:38.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b752ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b700cd120 0x7f1b700d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58950/0 (socket says 172.21.15.45:58950) 2023-07-09T02:16:38.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b752ac640 1 -- 172.21.15.45:0/1642923500 learned_addr learned my addr 172.21.15.45:0/1642923500 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b75aad640 1 --2- 172.21.15.45:0/1642923500 >> v2:172.21.15.155:3300/0 conn(0x7f1b7015c060 0x7f1b700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b762ae640 1 --2- 172.21.15.45:0/1642923500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b700d2450 0x7f1b700d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b752ac640 1 -- 172.21.15.45:0/1642923500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b700d2450 msgr2=0x7f1b700d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b752ac640 1 --2- 172.21.15.45:0/1642923500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b700d2450 0x7f1b700d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b752ac640 1 -- 172.21.15.45:0/1642923500 >> v2:172.21.15.155:3300/0 conn(0x7f1b7015c060 msgr2=0x7f1b700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b752ac640 1 --2- 172.21.15.45:0/1642923500 >> v2:172.21.15.155:3300/0 conn(0x7f1b7015c060 0x7f1b700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.713+0000 7f1b752ac640 1 -- 172.21.15.45:0/1642923500 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7015fb60 con 0x7f1b700cd120 2023-07-09T02:16:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b752ac640 1 --2- 172.21.15.45:0/1642923500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700cd120 0x7f1b700d1f10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1b700d3ad0 tx=0x7f1b6001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0e4b2180975072 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b74aab640 1 -- 172.21.15.45:0/1642923500 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b600ab600 con 0x7f1b700cd120 2023-07-09T02:16:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b74aab640 1 -- 172.21.15.45:0/1642923500 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b600a7050 con 0x7f1b700cd120 2023-07-09T02:16:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b74aab640 1 -- 172.21.15.45:0/1642923500 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b600ab980 con 0x7f1b700cd120 2023-07-09T02:16:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 -- 172.21.15.45:0/1642923500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700cd120 msgr2=0x7f1b700d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 --2- 172.21.15.45:0/1642923500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700cd120 0x7f1b700d1f10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1b700d3ad0 tx=0x7f1b6001c210 comp rx=0 tx=0).stop 2023-07-09T02:16:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 -- 172.21.15.45:0/1642923500 shutdown_connections 2023-07-09T02:16:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 --2- 172.21.15.45:0/1642923500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b700d2450 0x7f1b700d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 --2- 172.21.15.45:0/1642923500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700cd120 0x7f1b700d1f10 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 --2- 172.21.15.45:0/1642923500 >> v2:172.21.15.155:3300/0 conn(0x7f1b7015c060 0x7f1b700b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 -- 172.21.15.45:0/1642923500 >> 172.21.15.45:0/1642923500 conn(0x7f1b700698e0 msgr2=0x7f1b70069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:38.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 -- 172.21.15.45:0/1642923500 shutdown_connections 2023-07-09T02:16:38.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.717+0000 7f1b77d11640 1 -- 172.21.15.45:0/1642923500 wait complete. 2023-07-09T02:16:38.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 Processor -- start 2023-07-09T02:16:38.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 -- start start 2023-07-09T02:16:38.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b700cd120 0x7f1b700caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:38.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700d2450 0x7f1b701f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:38.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b7015c060 0x7f1b700cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:38.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700ccb70 con 0x7f1b700d2450 2023-07-09T02:16:38.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700cb1f0 con 0x7f1b700cd120 2023-07-09T02:16:38.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7015db20 con 0x7f1b7015c060 2023-07-09T02:16:38.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700d2450 0x7f1b701f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:38.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700d2450 0x7f1b701f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58956/0 (socket says 172.21.15.45:58956) 2023-07-09T02:16:38.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 -- 172.21.15.45:0/2106288825 learned_addr learned my addr 172.21.15.45:0/2106288825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:38.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b762ae640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b7015c060 0x7f1b700cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:38.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b75aad640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b700cd120 0x7f1b700caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:38.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 -- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b7015c060 msgr2=0x7f1b700cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:38.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b7015c060 0x7f1b700cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 -- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b700cd120 msgr2=0x7f1b700caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:38.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b700cd120 0x7f1b700caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:38.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 -- 172.21.15.45:0/2106288825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600094d0 con 0x7f1b700d2450 2023-07-09T02:16:38.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b762ae640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b7015c060 0x7f1b700cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:38.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b752ac640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700d2450 0x7f1b701f4c80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1b600ae040 tx=0x7f1b60018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:38.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b667fc640 1 -- 172.21.15.45:0/2106288825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b600b4440 con 0x7f1b700d2450 2023-07-09T02:16:38.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b667fc640 1 -- 172.21.15.45:0/2106288825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b600b45a0 con 0x7f1b700d2450 2023-07-09T02:16:38.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b667fc640 1 -- 172.21.15.45:0/2106288825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b600b4930 con 0x7f1b700d2450 2023-07-09T02:16:38.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7015de00 con 0x7f1b700d2450 2023-07-09T02:16:38.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7015e3c0 con 0x7f1b700d2450 2023-07-09T02:16:38.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.721+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7015e5b0 con 0x7f1b700d2450 2023-07-09T02:16:38.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.725+0000 7f1b667fc640 1 -- 172.21.15.45:0/2106288825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b600b2070 con 0x7f1b700d2450 2023-07-09T02:16:38.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.725+0000 7f1b667fc640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b54066280 0x7f1b54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:38.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.725+0000 7f1b667fc640 1 -- 172.21.15.45:0/2106288825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b6011dc40 con 0x7f1b700d2450 2023-07-09T02:16:38.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.725+0000 7f1b75aad640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b54066280 0x7f1b54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:38.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.725+0000 7f1b667fc640 1 -- 172.21.15.45:0/2106288825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=109}) v3 -- 0x7f1b5406e3c0 con 0x7f1b700d2450 2023-07-09T02:16:38.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.725+0000 7f1b75aad640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b54066280 0x7f1b54068730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00b930 tx=0x7f1b6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:38.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.729+0000 7f1b667fc640 1 -- 172.21.15.45:0/2106288825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b600eb020 con 0x7f1b700d2450 2023-07-09T02:16:38.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.885+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1b7004d7d0 con 0x7f1b700d2450 2023-07-09T02:16:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.885+0000 7f1b667fc640 1 -- 172.21.15.45:0/2106288825 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) v1 ==== 81+0+37070 (secure 0 0 0) 0x7f1b600ee640 con 0x7f1b700d2450 2023-07-09T02:16:38.887 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:38.887 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:38.888 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 108, 2023-07-09T02:16:38.888 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:16:38.888 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:16:38.888 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:16:36.398606+0000", 2023-07-09T02:16:38.888 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:16:38.888 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:16:38.888 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:16:38.889 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:16:38.889 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:16:38.889 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:16:38.889 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:16:38.889 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:16:38.889 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:16:38.889 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:38.889 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:16:38.890 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:16:38.890 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:16:38.890 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:16:38.890 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:16:38.890 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 14, 2023-07-09T02:16:38.890 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:16:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:16:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:16:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:16:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:16:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:16:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:16:38.891 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:16:38.892 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:16:38.892 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:38.892 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:38.892 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:38.892 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:38.892 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:38.892 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:38.893 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:38.893 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:38.893 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:38.893 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:38.893 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:38.893 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:38.893 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:16:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:16:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:16:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:16:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:16:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:38.896 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:38.896 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:38.896 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:38.896 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:38.896 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:38.896 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:38.896 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:38.897 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:38.897 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:38.897 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:38.897 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:38.897 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:38.897 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:38.897 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:38.897 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:38.898 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:38.898 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:38.898 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:38.898 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:38.898 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:38.898 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:38.898 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:38.898 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:38.899 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:38.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.899 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:38.899 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:38.899 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:38.899 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:38.899 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:38.899 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:38.900 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:38.900 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:38.900 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:38.900 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:38.900 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:38.900 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:38.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:16:38.901 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:16:38.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.901 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:38.901 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:16:38.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.901 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:38.901 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:16:38.901 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:16:38.902 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:16:38.902 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:16:38.902 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:16:38.902 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:38.902 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:38.902 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:38.902 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:38.903 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:38.904 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:38.904 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:38.904 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:38.904 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:38.904 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:38.904 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:38.904 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:38.905 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:38.905 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:16:38.905 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:16:38.905 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:16:38.905 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:16:38.905 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:16:38.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:38.906 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:38.906 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:38.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:38.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:38.906 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:38.906 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:38.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:38.907 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:38.907 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:38.907 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:38.907 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:38.907 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:38.907 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:38.907 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:38.907 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:38.908 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:38.908 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:38.908 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:38.908 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:38.908 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:38.908 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:38.908 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:38.908 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:38.909 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:38.909 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:38.909 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:38.909 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:38.909 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:38.909 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:38.909 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:38.909 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:38.910 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:38.910 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:38.910 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.910 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:38.910 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:38.910 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:38.910 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:38.910 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:38.911 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:38.911 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:38.911 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:38.911 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:38.911 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:38.911 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:38.911 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:16:38.911 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:38.912 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:16:38.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.912 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:38.912 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:16:38.912 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:16:38.912 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:16:38.912 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:38.913 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:38.913 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:38.913 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:38.913 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:38.913 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.913 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 13, 2023-07-09T02:16:38.914 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:16:38.914 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:15.254129+0000", 2023-07-09T02:16:38.914 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:38.914 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:38.914 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:38.914 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:38.914 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:38.914 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:38.915 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:38.915 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:38.915 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:38.915 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:38.915 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:38.915 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:38.915 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:16:38.915 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:16:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:16:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:16:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:16:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:38.916 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:38.917 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:38.918 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:38.919 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:38.919 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:38.919 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:38.919 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:38.919 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:38.919 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:38.919 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:38.919 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:38.920 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:38.920 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:38.920 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:38.920 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:38.920 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:38.920 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:38.920 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:38.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.921 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:38.921 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:38.921 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:38.921 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:38.921 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:38.921 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:38.921 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:38.921 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:16:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:16:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:16:38.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.923 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:38.923 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:38.923 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:16:38.923 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.923 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:38.923 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:16:38.924 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:16:38.924 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:38.924 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:16:38.924 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:16:38.924 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:38.924 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:38.924 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:38.924 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.925 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.925 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.925 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 14, 2023-07-09T02:16:38.925 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:16:38.925 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:16.522380+0000", 2023-07-09T02:16:38.925 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:38.925 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:38.925 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:38.926 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:38.926 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:38.926 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:38.926 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:38.926 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:38.926 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:38.926 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:38.927 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:38.927 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:38.927 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:16:38.927 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:16:38.927 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:16:38.927 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:16:38.927 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:16:38.927 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:38.928 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:38.928 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:38.928 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:38.928 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:38.928 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:38.928 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:38.928 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.928 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:38.929 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:38.930 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:38.930 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:38.930 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:38.930 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:38.930 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:38.930 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:38.930 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:38.931 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:38.931 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:38.931 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:38.931 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:38.931 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:38.931 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:38.931 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:38.931 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:38.932 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:38.932 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:38.932 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:38.932 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.932 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:38.932 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:38.932 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:38.932 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:38.933 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:38.933 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:38.933 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:38.933 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:38.933 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:38.933 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:38.933 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:38.933 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:38.934 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:16:38.934 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:16:38.934 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.934 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:38.934 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:38.934 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:16:38.934 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.935 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.935 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:38.935 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:16:38.935 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:16:38.935 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:38.935 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:38.935 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:38.935 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:38.936 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:38.936 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:38.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.936 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:38.936 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:16:38.936 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.937 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:38.937 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:38.937 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:38.937 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:38.937 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:38.937 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:38.937 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:38.937 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:38.938 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:38.938 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:38.938 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:38.938 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:38.938 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:38.938 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.938 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.938 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.939 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:16:38.939 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:38.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.939 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.939 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.939 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:16:38.939 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:38.939 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.940 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.940 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:38.940 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.940 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.940 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.940 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:16:38.940 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:38.941 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.941 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.941 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.941 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:16:38.941 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:38.941 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.941 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.942 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.942 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:38.942 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.942 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.942 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.942 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:16:38.942 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:38.942 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.943 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.943 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.943 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:16:38.943 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:38.943 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.943 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.943 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:38.944 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.944 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.944 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.944 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:16:38.944 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:38.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.944 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.944 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:16:38.945 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:38.945 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.945 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.945 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.945 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:16:38.945 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:16:38.945 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:16:38.946 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:16:38.946 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:38.946 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:38.946 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:38.946 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:38.946 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.946 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.947 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:38.947 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:38.947 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:38.947 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:38.947 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:38.947 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:38.947 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:38.947 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:38.948 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:38.948 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:38.948 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:38.948 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:38.948 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:38.948 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.948 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.949 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:16:38.949 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:38.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.949 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.949 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:16:38.949 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.950 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:16:38.951 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:38.951 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.951 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.951 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.951 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:16:38.951 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:38.951 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.951 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.952 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.952 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:38.952 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.952 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.952 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.952 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:16:38.952 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:38.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.953 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.953 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.953 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:16:38.953 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:38.953 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.953 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.954 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:38.954 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.954 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.954 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.954 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:16:38.954 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:38.954 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.954 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.955 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.955 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:16:38.955 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:38.955 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.955 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.955 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:16:38.955 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:16:38.956 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:16:38.956 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:16:38.956 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:38.956 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:38.956 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:38.956 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:38.956 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.956 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.957 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.957 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:38.957 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:38.957 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:38.957 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:38.957 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:38.957 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:38.957 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:38.958 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:38.958 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:38.958 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:38.958 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:38.958 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:38.958 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:38.958 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.959 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.959 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.959 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:16:38.959 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:38.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.959 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.959 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.959 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:16:38.960 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:38.960 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.960 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.960 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.960 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:38.960 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.960 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.960 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.961 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:16:38.961 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:38.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.961 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.961 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.961 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:16:38.961 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:38.961 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:16:38.962 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:16:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.964 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:38.964 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.964 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.964 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.964 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:16:38.964 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:38.964 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:16:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:16:38.966 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:16:38.966 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:16:38.966 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:16:38.966 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:38.966 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:38.966 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:38.966 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.966 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.967 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.967 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:38.967 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:38.967 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:38.967 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:38.967 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:38.967 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:38.967 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:38.968 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:38.968 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:38.968 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:38.968 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:38.968 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:38.968 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:38.968 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.968 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.969 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.969 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:16:38.969 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:38.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.969 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.969 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.969 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:16:38.969 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:38.970 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.970 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.970 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.970 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:38.970 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.970 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.970 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.970 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:16:38.971 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:38.971 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.971 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.971 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.971 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:16:38.971 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:38.971 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.971 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.972 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.972 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:38.972 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.972 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.972 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.972 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:16:38.972 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:38.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.973 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.973 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.973 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:16:38.973 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:38.973 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.973 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.974 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:38.974 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.974 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.974 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.974 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:16:38.974 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:38.974 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.974 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:16:38.975 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:38.975 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.975 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.975 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:16:38.975 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:16:38.976 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:16:38.976 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:16:38.976 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:38.976 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:38.976 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:38.976 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:38.976 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.977 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.977 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:38.977 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:38.977 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:38.977 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:38.977 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:38.977 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:38.978 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:38.978 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:38.978 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:38.978 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:38.978 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:38.978 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:38.978 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:38.978 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.979 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.979 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.979 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:16:38.979 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:38.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.979 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.979 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.979 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:16:38.980 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:38.980 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.980 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.980 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:38.980 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.980 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.980 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.981 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:16:38.981 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:38.981 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.981 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.981 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.981 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:16:38.981 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:38.981 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.982 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.982 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:38.982 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.982 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.982 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.982 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:16:38.982 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:38.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.983 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.983 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.983 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:16:38.983 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:38.983 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.983 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.984 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:38.984 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.984 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.984 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.984 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:16:38.984 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:38.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:16:38.985 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:38.985 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.985 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.985 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:38.986 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:38.987 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:38.988 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:38.988 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:38.988 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:38.988 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:38.988 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:38.988 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:38.988 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:16:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:16:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:16:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:16:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:16:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:16:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:16:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:16:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:16:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:16:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:16:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:16:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:16:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:16:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:16:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:16:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:16:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:16:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:16:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:16:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:16:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:16:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:16:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:16:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:16:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:16:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:16:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:16:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:16:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:16:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:16:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:39.015 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.015 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.015 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:39.015 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:16:39.015 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:39.015 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.015 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.016 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.016 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:16:39.016 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:16:39.016 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:16:39.016 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:16:39.016 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:39.016 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:39.016 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:39.017 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:39.017 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.017 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:39.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:16:39.017 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:39.017 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:39.018 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:39.018 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:39.018 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:39.018 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:39.018 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:16:39.018 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:39.018 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.018 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.019 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:39.019 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:39.019 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:39.019 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:39.019 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:39.019 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:39.019 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:16:39.019 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:39.020 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.020 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.020 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:39.020 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:39.020 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:39.020 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:39.020 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:39.021 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:39.021 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:16:39.021 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:39.021 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.021 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.021 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:39.021 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:39.021 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:39.022 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:39.022 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:39.022 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:39.022 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:16:39.022 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:39.022 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.022 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.022 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:39.023 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:39.023 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:39.023 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:39.023 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:39.023 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:39.023 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:16:39.023 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:39.023 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.024 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.024 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:39.024 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:39.024 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:39.024 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:39.024 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:39.024 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:39.025 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:16:39.025 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:39.025 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.025 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.025 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:39.025 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:39.025 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:39.025 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:16:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:39.026 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:39.027 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:39.027 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:39.027 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:39.027 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:39.027 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:16:39.027 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:39.027 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.028 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:39.028 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:16:39.028 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:16:39.028 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:16:39.028 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:16:39.028 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:16:39.028 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:16:39.028 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:16:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:16:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:16:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:16:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:16:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:16:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:16:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:16:39.029 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:16:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:16:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:16:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:16:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:16:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:16:39.030 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:16:39.031 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:16:39.031 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:16:39.031 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:16:39.031 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:16:39.031 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:39.031 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b54066280 msgr2=0x7f1b54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b54066280 0x7f1b54068730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00b930 tx=0x7f1b6c008040 comp rx=0 tx=0).stop 2023-07-09T02:16:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700d2450 msgr2=0x7f1b701f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700d2450 0x7f1b701f4c80 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1b600ae040 tx=0x7f1b60018fb0 comp rx=0 tx=0).stop 2023-07-09T02:16:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 shutdown_connections 2023-07-09T02:16:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b54066280 0x7f1b54068730 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b7015c060 0x7f1b700cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b700d2450 0x7f1b701f4c80 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 --2- 172.21.15.45:0/2106288825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b700cd120 0x7f1b700caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 >> 172.21.15.45:0/2106288825 conn(0x7f1b700698e0 msgr2=0x7f1b700b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 shutdown_connections 2023-07-09T02:16:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:38.889+0000 7f1b77d11640 1 -- 172.21.15.45:0/2106288825 wait complete. 2023-07-09T02:16:39.035 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:16:43.427 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:16:43.429+0000 7fa1eb8d6640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-07-09T02:16:44.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:16:44.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.189+0000 7feed63d5640 1 Processor -- start 2023-07-09T02:16:44.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.189+0000 7feed63d5640 1 -- start start 2023-07-09T02:16:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feed63d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:44.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feed63d5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed0160a50 con 0x7feed015c060 2023-07-09T02:16:44.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feed63d5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed015c430 con 0x7feed00cd120 2023-07-09T02:16:44.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feed63d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed015fb60 con 0x7feed00d2620 2023-07-09T02:16:44.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feecffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feed015c060 0x7feed00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45090/0 (socket says 172.21.15.45:45090) 2023-07-09T02:16:44.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feecffff640 1 -- 172.21.15.45:0/1327268619 learned_addr learned my addr 172.21.15.45:0/1327268619 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:44.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feecf7fe640 1 --2- 172.21.15.45:0/1327268619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:44.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feeceffd640 1 -- 172.21.15.45:0/1327268619 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884144131 0 0) 0x7feed0160a50 con 0x7feed015c060 2023-07-09T02:16:44.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feeceffd640 1 -- 172.21.15.45:0/1327268619 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb8003530 con 0x7feed015c060 2023-07-09T02:16:44.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feeceffd640 1 -- 172.21.15.45:0/1327268619 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252831371 0 0) 0x7feed015c430 con 0x7feed00cd120 2023-07-09T02:16:44.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feeceffd640 1 -- 172.21.15.45:0/1327268619 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed0160a50 con 0x7feed00cd120 2023-07-09T02:16:44.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feecf7fe640 1 -- 172.21.15.45:0/1327268619 >> v1:172.21.15.155:6789/0 conn(0x7feed00cd120 legacy=0x7feed00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:44.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feecf7fe640 1 -- 172.21.15.45:0/1327268619 >> v1:172.21.15.45:6789/0 conn(0x7feed015c060 legacy=0x7feed00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:44.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.193+0000 7feecf7fe640 1 -- 172.21.15.45:0/1327268619 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed015fe40 con 0x7feed00d2620 2023-07-09T02:16:44.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feecf7fe640 1 --2- 172.21.15.45:0/1327268619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed00b4ed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feec40097f0 tx=0x7feec401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd3e3bd0ac9c5ec9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:44.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feeceffd640 1 -- 172.21.15.45:0/1327268619 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec40aa5f0 con 0x7feed00d2620 2023-07-09T02:16:44.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feeceffd640 1 -- 172.21.15.45:0/1327268619 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec40aa750 con 0x7feed00d2620 2023-07-09T02:16:44.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feeceffd640 1 -- 172.21.15.45:0/1327268619 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec40aaae0 con 0x7feed00d2620 2023-07-09T02:16:44.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 -- 172.21.15.45:0/1327268619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 msgr2=0x7feed00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:44.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 --2- 172.21.15.45:0/1327268619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed00b4ed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feec40097f0 tx=0x7feec401c490 comp rx=0 tx=0).stop 2023-07-09T02:16:44.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 -- 172.21.15.45:0/1327268619 shutdown_connections 2023-07-09T02:16:44.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 --2- 172.21.15.45:0/1327268619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed00b4ed0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:44.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 -- 172.21.15.45:0/1327268619 >> 172.21.15.45:0/1327268619 conn(0x7feed00698e0 msgr2=0x7feed0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:44.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 -- 172.21.15.45:0/1327268619 shutdown_connections 2023-07-09T02:16:44.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 -- 172.21.15.45:0/1327268619 wait complete. 2023-07-09T02:16:44.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 Processor -- start 2023-07-09T02:16:44.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.197+0000 7feed63d5640 1 -- start start 2023-07-09T02:16:44.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feed00cd120 0x7feed015d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:44.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:44.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feed015c060 0x7feed01f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:44.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01529b0 con 0x7feed00cd120 2023-07-09T02:16:44.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0156ea0 con 0x7feed015c060 2023-07-09T02:16:44.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00cab50 con 0x7feed00d2620 2023-07-09T02:16:44.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feed00cd120 0x7feed015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:44.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feed00cd120 0x7feed015d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54094/0 (socket says 172.21.15.45:54094) 2023-07-09T02:16:44.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 -- 172.21.15.45:0/2072793891 learned_addr learned my addr 172.21.15.45:0/2072793891 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:44.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecf7fe640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:44.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed4972640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feed015c060 0x7feed01f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:44.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 -- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 msgr2=0x7feed0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:44.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:44.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 -- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feed015c060 msgr2=0x7feed01f83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:44.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feed015c060 0x7feed01f83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:44.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 -- 172.21.15.45:0/2072793891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4009420 con 0x7feed00cd120 2023-07-09T02:16:44.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed4972640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feed015c060 0x7feed01f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:44.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feecffff640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feed00cd120 0x7feed015d070 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7feec000c450 tx=0x7feec000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:44.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feeccff9640 1 -- 172.21.15.45:0/2072793891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0005cf0 con 0x7feed00cd120 2023-07-09T02:16:44.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feeccff9640 1 -- 172.21.15.45:0/2072793891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0005e50 con 0x7feed00cd120 2023-07-09T02:16:44.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feeccff9640 1 -- 172.21.15.45:0/2072793891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00072b0 con 0x7feed00cd120 2023-07-09T02:16:44.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed00b59f0 con 0x7feed00cd120 2023-07-09T02:16:44.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed015d9e0 con 0x7feed00cd120 2023-07-09T02:16:44.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed004d7d0 con 0x7feed00cd120 2023-07-09T02:16:44.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.201+0000 7feeccff9640 1 -- 172.21.15.45:0/2072793891 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feec0007410 con 0x7feed00cd120 2023-07-09T02:16:44.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.205+0000 7feeccff9640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feebc066280 0x7feebc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:44.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.205+0000 7feeccff9640 1 -- 172.21.15.45:0/2072793891 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feec00831f0 con 0x7feed00cd120 2023-07-09T02:16:44.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.205+0000 7feeccff9640 1 -- 172.21.15.45:0/2072793891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=110}) v3 -- 0x7feebc06e3c0 con 0x7feed00cd120 2023-07-09T02:16:44.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.205+0000 7feecf7fe640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feebc066280 0x7feebc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:44.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.205+0000 7feecf7fe640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feebc066280 0x7feebc068730 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7feec40ae000 tx=0x7feec40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:44.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.209+0000 7feeccff9640 1 -- 172.21.15.45:0/2072793891 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feec0050710 con 0x7feed00cd120 2023-07-09T02:16:44.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.364+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7feed006baa0 con 0x7feed00cd120 2023-07-09T02:16:44.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.364+0000 7feeccff9640 1 -- 172.21.15.45:0/2072793891 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v109) v1 ==== 81+0+37046 (secure 0 0 0) 0x7feec0017020 con 0x7feed00cd120 2023-07-09T02:16:44.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:44.367 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:44.367 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 109, 2023-07-09T02:16:44.367 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:16:44.367 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:16:44.368 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:16:43.429864+0000", 2023-07-09T02:16:44.368 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:16:44.368 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:16:44.368 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:16:44.368 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:16:44.368 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:16:44.368 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:16:44.369 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:16:44.369 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:16:44.369 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:16:44.369 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:44.369 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:16:44.369 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:16:44.369 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:16:44.370 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:16:44.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:16:44.370 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 14, 2023-07-09T02:16:44.370 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:16:44.370 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:16:44.370 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:16:44.370 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:16:44.370 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:16:44.371 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:16:44.371 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.371 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:16:44.371 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:16:44.371 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:16:44.371 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:44.371 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:44.372 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:44.372 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:44.372 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:44.372 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:44.372 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:44.372 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:44.372 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:44.372 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:44.373 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:44.373 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:44.373 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:16:44.373 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:16:44.373 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:16:44.373 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:16:44.373 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:16:44.373 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:44.374 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:44.374 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:44.374 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:44.374 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:44.374 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:44.374 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:44.374 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.374 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:44.375 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:44.375 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:44.375 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:44.375 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:44.375 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:44.375 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:44.375 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:44.376 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:44.376 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:44.376 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:44.377 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:44.377 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:44.377 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:44.377 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:44.377 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:44.377 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:44.377 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:44.378 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:44.378 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:44.378 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:44.378 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:44.378 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:44.378 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:44.378 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:44.378 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:44.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:44.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.379 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:44.379 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:44.379 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:44.379 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:44.379 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:44.379 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:44.380 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:44.380 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:44.380 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:44.380 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:44.380 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:44.380 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:44.380 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:16:44.381 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:16:44.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.381 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:44.381 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:16:44.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.381 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:44.381 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:16:44.381 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:16:44.382 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:16:44.382 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:16:44.382 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:16:44.382 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:44.382 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:44.382 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:44.382 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:16:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:16:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:16:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:44.384 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:44.384 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:44.384 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:44.384 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:44.384 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:44.384 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:44.384 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:44.385 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:44.385 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:16:44.385 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:16:44.385 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:16:44.385 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:16:44.385 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:16:44.385 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:44.385 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:44.386 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:44.387 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:44.387 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:44.387 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:44.387 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:44.387 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:44.387 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:44.387 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:44.387 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:44.388 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:44.388 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:44.388 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:44.388 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:44.388 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:44.388 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:44.388 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:44.389 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:44.389 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:44.389 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:44.389 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:44.389 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:44.389 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:44.389 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:44.389 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:44.390 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:44.390 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:44.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.390 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:44.390 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:44.390 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:44.390 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:44.390 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:44.391 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:44.391 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:44.391 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:44.391 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:44.391 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:44.391 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:44.391 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:16:44.392 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:44.392 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:16:44.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.392 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:44.392 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:16:44.392 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:16:44.392 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:16:44.392 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:44.393 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:44.393 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:44.393 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:44.393 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:44.393 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.393 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.393 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 13, 2023-07-09T02:16:44.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:16:44.394 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:15.254129+0000", 2023-07-09T02:16:44.394 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:44.394 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:44.394 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:44.394 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:44.394 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:44.395 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:44.395 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:44.395 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:44.395 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:44.395 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:44.395 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:44.395 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:44.395 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:16:44.396 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:16:44.396 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:16:44.396 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:16:44.396 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:16:44.396 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:44.396 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:44.396 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:44.396 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:44.397 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:44.397 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:44.397 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:44.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.397 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:44.397 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:44.397 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:44.397 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:44.398 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:44.398 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:44.398 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:44.398 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:44.398 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:44.398 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:44.398 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:44.399 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:44.399 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:44.399 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:44.399 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:44.399 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:44.399 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:44.399 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:44.399 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:44.400 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:44.400 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:44.400 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:44.400 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:44.400 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:44.400 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:44.400 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:44.400 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:44.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.401 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:44.401 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:44.401 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:44.401 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:44.401 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:44.401 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:44.402 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:44.402 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:44.402 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:44.402 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:44.402 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:44.402 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:44.402 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:16:44.402 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:16:44.403 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:16:44.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.403 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:44.403 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:44.403 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:16:44.403 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.403 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:44.404 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:16:44.404 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:16:44.404 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:44.404 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:16:44.404 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:16:44.404 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:44.404 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:44.404 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:44.405 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.405 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.405 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 14, 2023-07-09T02:16:44.405 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:16:44.405 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:16.522380+0000", 2023-07-09T02:16:44.405 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 3, 2023-07-09T02:16:44.406 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full", 2023-07-09T02:16:44.406 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:44.406 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:44.406 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:44.406 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:44.406 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:44.406 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:44.406 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:44.407 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:44.407 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:44.407 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:44.407 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:16:44.407 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:16:44.407 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:16:44.407 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:16:44.407 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:16:44.408 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:44.408 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:44.408 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:44.408 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:44.408 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:44.408 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:44.408 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:44.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.409 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "107", 2023-07-09T02:16:44.409 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:44.409 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:44.409 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:44.409 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:44.409 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:44.410 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:44.410 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:44.410 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:44.410 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:44.410 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:44.410 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:44.410 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:44.410 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:44.411 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:44.411 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:44.411 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:44.411 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:44.411 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:44.411 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:44.411 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:44.411 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:44.412 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:44.412 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:44.412 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:44.412 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:44.412 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:44.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.412 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:44.413 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:16:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:16:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:44.414 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:16:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:16:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:16:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:44.415 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:44.416 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:16:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:44.417 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:44.418 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:16:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.419 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:16:44.420 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:44.420 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.420 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.420 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:44.420 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.420 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.420 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.421 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:16:44.421 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:44.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.421 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.421 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.421 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:16:44.421 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:44.421 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.422 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.422 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.422 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:44.422 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.422 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.422 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.422 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:16:44.422 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:44.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.423 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.423 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.423 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:16:44.423 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:44.423 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.423 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.424 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:44.424 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.424 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.424 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.424 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:16:44.424 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:44.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.425 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.425 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.425 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:16:44.425 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:44.425 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.425 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.425 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.425 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:16:44.426 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:16:44.426 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:16:44.426 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:16:44.426 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:44.426 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:44.426 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:44.426 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:44.426 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.427 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.427 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.427 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:44.427 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:44.427 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:44.427 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:44.427 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:44.427 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:44.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:44.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:44.428 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:44.428 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:44.428 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:44.428 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:44.428 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:44.428 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.429 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.429 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.429 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:16:44.429 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:44.429 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.429 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.429 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.430 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:16:44.430 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:44.430 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.430 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.430 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.430 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:44.430 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.430 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.431 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.431 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:16:44.431 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:44.431 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.431 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.431 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.431 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:16:44.431 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:44.432 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.432 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.432 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.432 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:44.432 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.432 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.432 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.432 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:16:44.433 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:44.433 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.433 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.433 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:16:44.433 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:44.433 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.433 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.434 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:44.434 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.434 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.434 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.434 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:16:44.434 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:44.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:16:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:16:44.436 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:16:44.436 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:16:44.436 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:16:44.436 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:44.436 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:44.436 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:44.436 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:44.437 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.437 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.437 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:44.437 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:44.437 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:44.437 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:44.437 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:44.438 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:44.438 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:44.438 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:44.438 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:44.438 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:44.438 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:44.438 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:44.438 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:44.439 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.439 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.439 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.439 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:16:44.439 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:44.439 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.439 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.439 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.440 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:16:44.440 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:44.440 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.440 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.440 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.440 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:44.440 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.440 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.441 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.441 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:16:44.441 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:44.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.441 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.441 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.441 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:16:44.442 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:44.442 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.442 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.442 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:44.442 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.442 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.443 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:16:44.443 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:44.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.443 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.443 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:16:44.443 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:44.443 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.444 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.444 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:44.444 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.444 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.444 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:16:44.445 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:44.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.445 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.445 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:16:44.445 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:44.445 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.445 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.446 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:16:44.446 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:16:44.446 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:16:44.446 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:16:44.446 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:44.446 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:44.446 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:44.447 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.447 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.447 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:44.447 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:44.447 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:44.447 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:44.447 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:44.448 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:44.448 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:44.448 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:44.448 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:44.448 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:44.448 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:44.448 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:44.448 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:44.449 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.449 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.449 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:16:44.449 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:44.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.449 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.450 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:16:44.450 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:44.450 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.450 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.450 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.450 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:44.450 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.450 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.451 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.451 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:16:44.451 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:44.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.451 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.451 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.451 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:16:44.451 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:44.452 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.452 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.452 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:44.452 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.452 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.452 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.453 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:16:44.453 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:44.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.453 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.453 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.453 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:16:44.453 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:44.453 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.454 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.454 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:44.454 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.454 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.454 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.454 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:16:44.454 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:44.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.455 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.455 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.455 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:16:44.455 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:44.455 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.455 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.456 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:16:44.456 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:16:44.456 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:16:44.456 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:16:44.456 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:44.456 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:44.456 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:44.456 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.457 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.457 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:44.457 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:44.457 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:44.457 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:44.457 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:44.457 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:44.458 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:44.458 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:44.458 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:44.458 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:44.458 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:44.458 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:44.458 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:44.458 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:16:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.459 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:16:44.460 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:44.460 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.460 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.460 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.460 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:44.460 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.460 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.461 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.461 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:16:44.461 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:44.461 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.461 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.461 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.461 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:16:44.461 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:44.462 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.462 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.462 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.462 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:44.462 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.462 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.462 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.462 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:16:44.463 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:44.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.463 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.463 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.463 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:16:44.463 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:44.463 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.463 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.464 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.464 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:44.464 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.464 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.464 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:16:44.464 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:44.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.465 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.465 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.465 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:16:44.465 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:44.465 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.465 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:16:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:16:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:16:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:16:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: "full", 2023-07-09T02:16:44.466 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:44.467 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.467 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.467 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.467 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:44.467 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:44.467 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:44.467 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:44.467 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:44.468 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:44.468 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:44.468 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:44.468 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:44.468 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:44.468 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:44.468 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:44.468 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:44.469 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.469 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.469 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.469 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:16:44.469 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:44.469 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.469 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.470 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.470 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:16:44.470 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:44.470 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.470 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.470 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.470 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:44.470 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.471 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.471 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.471 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:16:44.471 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:44.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.471 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.471 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.471 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:16:44.472 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:44.472 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.472 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.472 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.472 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:44.472 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.472 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.472 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.473 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:16:44.473 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:44.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.473 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.473 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.473 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:16:44.473 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:44.473 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.474 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.474 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.474 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:44.474 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.474 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.474 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.474 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:16:44.475 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:44.475 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.475 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.475 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:16:44.475 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:44.475 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.475 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.476 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:16:44.476 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:16:44.476 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:16:44.476 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:16:44.476 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:44.476 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:44.477 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:44.477 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.477 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.477 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:44.477 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:44.477 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:44.477 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:44.478 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:44.478 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:44.478 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:44.478 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:44.478 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:44.478 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:44.478 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:44.478 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:44.479 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:44.479 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.479 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.479 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.479 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:16:44.479 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:44.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.479 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.480 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.480 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:16:44.480 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:44.480 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.480 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.480 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.480 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:44.481 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.481 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.481 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.481 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:16:44.481 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:44.481 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.481 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.481 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.482 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:16:44.482 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:44.482 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.482 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.482 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.482 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:44.482 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.483 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.483 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.483 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:16:44.483 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:44.483 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.483 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.483 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.483 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:16:44.484 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:44.484 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.484 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.484 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.484 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:44.484 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.484 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.484 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.485 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:16:44.485 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:44.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.485 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.485 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.485 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:16:44.485 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:44.485 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.486 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.486 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.486 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:16:44.486 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:16:44.486 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:16:44.486 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:16:44.486 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:44.486 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:44.487 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:44.487 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.487 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.487 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.487 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:44.487 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:44.487 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:44.488 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:44.488 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:44.488 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:44.488 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:44.488 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:44.488 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:44.488 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:44.488 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:44.489 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:44.489 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:44.489 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.489 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.489 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.489 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:16:44.489 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:44.489 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.490 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.490 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.490 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:16:44.490 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:44.490 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.490 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.490 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:44.491 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.491 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.491 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.491 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:16:44.491 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:44.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.492 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.492 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.492 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:16:44.492 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:44.492 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.492 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.492 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:44.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.493 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:16:44.493 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:44.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.493 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:16:44.494 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:44.494 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.494 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.494 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:44.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:44.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.495 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:44.495 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:16:44.495 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:44.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.496 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:44.496 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:16:44.496 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:44.496 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.496 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.496 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:16:44.496 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:16:44.497 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:16:44.497 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:16:44.497 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:44.497 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:44.497 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:44.497 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:44.497 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.498 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:44.498 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:16:44.498 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.498 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:44.498 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:44.498 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:44.498 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:44.498 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:16:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:44.500 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:44.500 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:44.500 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:44.500 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:16:44.500 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:44.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.500 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.501 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:44.501 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:44.501 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:44.501 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:44.501 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:44.501 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:44.501 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:16:44.501 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:44.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.502 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:44.502 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:44.502 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:44.502 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:44.502 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:44.503 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:44.503 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:16:44.503 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:44.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.503 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.503 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:44.503 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:44.503 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:44.504 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:44.504 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:44.504 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:44.504 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:16:44.504 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:44.504 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.504 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.504 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:44.505 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:44.505 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:44.505 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:44.505 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:44.505 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:44.505 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:16:44.505 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:44.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.506 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:44.506 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:44.506 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:44.506 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:44.506 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:44.506 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:44.507 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:16:44.507 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:44.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.507 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:44.507 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:44.507 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:44.507 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:44.507 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:44.508 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:44.508 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:44.508 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:16:44.508 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:44.508 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.508 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:44.508 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:16:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:16:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:16:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:16:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:16:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:16:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:16:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:16:44.509 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:16:44.510 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:16:44.510 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:16:44.510 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:16:44.510 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:16:44.510 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:16:44.510 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:44.510 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:16:44.511 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:16:44.511 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:16:44.511 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:16:44.511 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:16:44.511 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:16:44.511 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:16:44.511 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:16:44.512 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:16:44.512 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:16:44.512 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:16:44.512 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:44.512 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feebc066280 msgr2=0x7feebc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feebc066280 0x7feebc068730 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7feec40ae000 tx=0x7feec40a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feed00cd120 msgr2=0x7feed015d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feed00cd120 0x7feed015d070 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7feec000c450 tx=0x7feec000c910 comp rx=0 tx=0).stop 2023-07-09T02:16:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 shutdown_connections 2023-07-09T02:16:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feed015c060 0x7feed01f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feebc066280 0x7feebc068730 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feed00d2620 0x7feed0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 --2- 172.21.15.45:0/2072793891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feed00cd120 0x7feed015d070 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 >> 172.21.15.45:0/2072793891 conn(0x7feed00698e0 msgr2=0x7feed00b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 shutdown_connections 2023-07-09T02:16:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:44.368+0000 7feed63d5640 1 -- 172.21.15.45:0/2072793891 wait complete. 2023-07-09T02:16:44.516 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:16:48.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:16:48.635 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:16:49.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:16:49.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c440b640 1 Processor -- start 2023-07-09T02:16:49.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c440b640 1 -- start start 2023-07-09T02:16:49.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c440b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1bc15c060 0x7fa1bc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:49.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c440b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1bc0d2620 0x7fa1bc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:49.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c440b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc160a50 con 0x7fa1bc0cd120 2023-07-09T02:16:49.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c440b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc15c430 con 0x7fa1bc15c060 2023-07-09T02:16:49.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c440b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc15fb60 con 0x7fa1bc0d2620 2023-07-09T02:16:49.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c21a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1bc15c060 0x7fa1bc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:49.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c21a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1bc15c060 0x7fa1bc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54102/0 (socket says 172.21.15.45:54102) 2023-07-09T02:16:49.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c21a7640 1 -- 172.21.15.45:0/1467462832 learned_addr learned my addr 172.21.15.45:0/1467462832 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:49.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c29a8640 1 --2- 172.21.15.45:0/1467462832 >> v2:172.21.15.155:3300/0 conn(0x7fa1bc0d2620 0x7fa1bc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:49.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c21a7640 1 -- 172.21.15.45:0/1467462832 >> v2:172.21.15.155:3300/0 conn(0x7fa1bc0d2620 msgr2=0x7fa1bc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:49.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c21a7640 1 --2- 172.21.15.45:0/1467462832 >> v2:172.21.15.155:3300/0 conn(0x7fa1bc0d2620 0x7fa1bc0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:49.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c21a7640 1 -- 172.21.15.45:0/1467462832 >> v1:172.21.15.155:6789/0 conn(0x7fa1bc0cd120 legacy=0x7fa1bc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:49.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.672+0000 7fa1c21a7640 1 -- 172.21.15.45:0/1467462832 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc15fe40 con 0x7fa1bc15c060 2023-07-09T02:16:49.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c21a7640 1 --2- 172.21.15.45:0/1467462832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc15c060 0x7fa1bc0b4ed0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc08bca0 tx=0x7fa1b801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116a1ebed668f3ba server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c11a5640 1 -- 172.21.15.45:0/1467462832 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b80aa5f0 con 0x7fa1bc15c060 2023-07-09T02:16:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c11a5640 1 -- 172.21.15.45:0/1467462832 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b80aa750 con 0x7fa1bc15c060 2023-07-09T02:16:49.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c11a5640 1 -- 172.21.15.45:0/1467462832 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b80aaae0 con 0x7fa1bc15c060 2023-07-09T02:16:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c440b640 1 -- 172.21.15.45:0/1467462832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc15c060 msgr2=0x7fa1bc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c440b640 1 --2- 172.21.15.45:0/1467462832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc15c060 0x7fa1bc0b4ed0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc08bca0 tx=0x7fa1b801c490 comp rx=0 tx=0).stop 2023-07-09T02:16:49.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c440b640 1 -- 172.21.15.45:0/1467462832 shutdown_connections 2023-07-09T02:16:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c440b640 1 --2- 172.21.15.45:0/1467462832 >> v2:172.21.15.155:3300/0 conn(0x7fa1bc0d2620 0x7fa1bc0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c440b640 1 --2- 172.21.15.45:0/1467462832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc15c060 0x7fa1bc0b4ed0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c440b640 1 -- 172.21.15.45:0/1467462832 >> 172.21.15.45:0/1467462832 conn(0x7fa1bc0698e0 msgr2=0x7fa1bc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:49.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c440b640 1 -- 172.21.15.45:0/1467462832 shutdown_connections 2023-07-09T02:16:49.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.676+0000 7fa1c440b640 1 -- 172.21.15.45:0/1467462832 wait complete. 2023-07-09T02:16:49.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 Processor -- start 2023-07-09T02:16:49.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 -- start start 2023-07-09T02:16:49.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1bc0cd120 0x7fa1bc0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:49.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc0d2620 0x7fa1bc0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:49.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1bc15c060 0x7fa1bc1f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:49.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc15b030 con 0x7fa1bc0d2620 2023-07-09T02:16:49.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc15a1a0 con 0x7fa1bc15c060 2023-07-09T02:16:49.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0c98f0 con 0x7fa1bc0cd120 2023-07-09T02:16:49.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc0d2620 0x7fa1bc0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:49.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc0d2620 0x7fa1bc0b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54108/0 (socket says 172.21.15.45:54108) 2023-07-09T02:16:49.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 -- 172.21.15.45:0/2222202535 learned_addr learned my addr 172.21.15.45:0/2222202535 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:49.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c21a7640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1bc0cd120 0x7fa1bc0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:49.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c29a8640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1bc15c060 0x7fa1bc1f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:49.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 -- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1bc0cd120 msgr2=0x7fa1bc0c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:49.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1bc0cd120 0x7fa1bc0c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:49.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 -- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1bc15c060 msgr2=0x7fa1bc1f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:49.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1bc15c060 0x7fa1bc1f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:49.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 -- 172.21.15.45:0/2222202535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80094d0 con 0x7fa1bc0d2620 2023-07-09T02:16:49.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c19a6640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc0d2620 0x7fa1bc0b5de0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00c410 tx=0x7fa1ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:49.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1b2ffd640 1 -- 172.21.15.45:0/2222202535 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac011790 con 0x7fa1bc0d2620 2023-07-09T02:16:49.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1b2ffd640 1 -- 172.21.15.45:0/2222202535 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac0118f0 con 0x7fa1bc0d2620 2023-07-09T02:16:49.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1b2ffd640 1 -- 172.21.15.45:0/2222202535 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac011ca0 con 0x7fa1bc0d2620 2023-07-09T02:16:49.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc0b59f0 con 0x7fa1bc0d2620 2023-07-09T02:16:49.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc15a690 con 0x7fa1bc0d2620 2023-07-09T02:16:49.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.680+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc1606c0 con 0x7fa1bc0d2620 2023-07-09T02:16:49.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.684+0000 7fa1b2ffd640 1 -- 172.21.15.45:0/2222202535 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1ac01c460 con 0x7fa1bc0d2620 2023-07-09T02:16:49.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.684+0000 7fa1b2ffd640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa1a0066280 0x7fa1a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:49.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.684+0000 7fa1b2ffd640 1 -- 172.21.15.45:0/2222202535 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1ac083900 con 0x7fa1bc0d2620 2023-07-09T02:16:49.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.684+0000 7fa1c21a7640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa1a0066280 0x7fa1a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:49.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.684+0000 7fa1c21a7640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa1a0066280 0x7fa1a0068730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80ae000 tx=0x7fa1b80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:49.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.688+0000 7fa1b2ffd640 1 -- 172.21.15.45:0/2222202535 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1bc1606c0 con 0x7fa1bc0d2620 2023-07-09T02:16:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa1bc1606c0 con 0x7fa1bc0d2620 2023-07-09T02:16:49.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1b2ffd640 1 -- 172.21.15.45:0/2222202535 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) v1 ==== 81+0+36954 (secure 0 0 0) 0x7fa1bc1606c0 con 0x7fa1bc0d2620 2023-07-09T02:16:49.846 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:49.847 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:49.847 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 111, 2023-07-09T02:16:49.847 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:16:49.848 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:16:49.848 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:16:47.494929+0000", 2023-07-09T02:16:49.848 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:16:49.848 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:16:49.849 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:16:49.849 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:16:49.849 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:16:49.849 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:16:49.850 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:16:49.850 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:16:49.850 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:16:49.850 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:49.851 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:16:49.851 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:16:49.851 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:16:49.851 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:16:49.852 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:16:49.852 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 14, 2023-07-09T02:16:49.852 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:16:49.852 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:16:49.853 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:16:49.853 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:16:49.853 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:16:49.853 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:16:49.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.854 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:16:49.854 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:16:49.854 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:16:49.855 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:49.855 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:49.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:49.855 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:49.856 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:49.856 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:49.856 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:49.856 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:49.857 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:49.857 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:49.857 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:49.857 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:49.858 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:16:49.858 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:16:49.858 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:16:49.858 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:16:49.859 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:16:49.859 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:49.859 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:49.860 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:49.860 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:49.860 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:49.860 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:49.861 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:49.861 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.861 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:16:49.861 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:49.862 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:49.862 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:49.862 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:49.863 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:49.863 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:49.863 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:49.863 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:49.864 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:49.864 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:49.864 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:49.864 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:49.865 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:49.865 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:49.865 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:49.865 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:49.866 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:49.866 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:49.866 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:49.866 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:49.866 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:49.866 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:49.867 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:49.868 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:49.868 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:49.868 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:49.868 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:49.868 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:49.869 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:49.869 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:49.869 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:49.869 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:49.870 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:16:49.870 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:16:49.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.870 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:49.871 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:16:49.871 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.871 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:49.871 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:16:49.872 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:16:49.872 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:16:49.872 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:16:49.872 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:16:49.873 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:49.873 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:49.873 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:49.873 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.874 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.874 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:16:49.874 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:16:49.875 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:16:49.875 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:49.875 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:49.875 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:49.876 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:49.876 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:49.876 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:49.876 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:49.877 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:49.877 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:49.877 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:49.877 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:49.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:49.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:16:49.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:16:49.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:16:49.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:16:49.879 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:16:49.879 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:49.879 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:49.879 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:49.879 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:49.880 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:49.880 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:49.880 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:49.880 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.881 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:16:49.881 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:49.881 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:49.881 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:49.881 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:49.882 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:49.882 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:49.882 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:49.882 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:49.883 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:49.883 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:49.883 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:49.883 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:49.884 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:49.884 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:49.884 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:49.884 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:49.884 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:49.885 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:49.885 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:49.885 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:49.885 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:49.885 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:49.885 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:49.885 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:49.886 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:49.886 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:49.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.886 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:49.886 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:49.886 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:49.886 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:49.887 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:49.887 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:49.887 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:49.887 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:49.887 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:49.887 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:49.887 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:49.887 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:16:49.888 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:49.888 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:16:49.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.888 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:49.888 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:16:49.888 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:16:49.888 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:16:49.889 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:49.889 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:49.889 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:49.889 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:49.889 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:49.889 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.889 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.889 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.890 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 13, 2023-07-09T02:16:49.890 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:16:49.890 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:15.254129+0000", 2023-07-09T02:16:49.890 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:49.890 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:49.890 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:49.890 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:49.890 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:49.891 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:49.891 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:49.891 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:49.891 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:49.891 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:49.891 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:49.891 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:49.891 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:16:49.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:16:49.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:16:49.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:16:49.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:16:49.892 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:49.892 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:49.892 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:49.892 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:49.893 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:49.893 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:49.893 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:49.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.893 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:16:49.893 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:49.893 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:49.894 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:49.894 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:49.894 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:49.894 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:49.894 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:49.894 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:49.894 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:49.894 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:49.895 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:49.895 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:49.895 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:49.895 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:49.895 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:49.895 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:49.895 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:49.895 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:49.896 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:49.896 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:49.896 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:49.896 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:49.896 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:49.896 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:49.896 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:49.897 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:49.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.897 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:49.897 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:49.897 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:49.897 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:49.897 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:49.897 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:16:49.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:16:49.899 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:16:49.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.899 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:49.899 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:49.899 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:16:49.899 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.899 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:49.900 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:16:49.900 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:16:49.900 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:49.900 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:16:49.900 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:16:49.900 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:49.900 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:49.900 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:49.901 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.901 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.901 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 14, 2023-07-09T02:16:49.901 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:16:49.901 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:16.522380+0000", 2023-07-09T02:16:49.901 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:49.901 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:49.902 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:49.902 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:49.902 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:49.902 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:49.902 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:49.902 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:49.903 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:49.903 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:49.903 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:49.903 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:49.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:16:49.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:16:49.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:16:49.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:16:49.904 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:16:49.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:49.905 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:49.905 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:49.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:49.905 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:49.905 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:49.905 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:49.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:16:49.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:49.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:49.906 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:49.906 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:49.906 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:49.906 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:49.906 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:49.907 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:49.907 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:49.907 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:49.907 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:49.907 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:49.907 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:49.907 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:49.907 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:49.908 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:49.908 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:49.908 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:49.908 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:49.908 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:49.908 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:49.908 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:49.909 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:49.909 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:49.909 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:49.909 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:49.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.909 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:49.909 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:49.909 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:49.910 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:49.910 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:49.910 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:49.910 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:49.910 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:49.910 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:49.910 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:49.911 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:49.911 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:49.911 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:16:49.911 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:16:49.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.911 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:49.911 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:49.911 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:16:49.912 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.912 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:49.912 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:16:49.912 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:16:49.912 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:49.912 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:49.912 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:49.913 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:49.913 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:49.913 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:49.913 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.913 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.913 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:49.913 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:16:49.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.914 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:49.914 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:49.914 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:49.914 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:49.914 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:49.914 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:49.914 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:49.914 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:49.915 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:49.915 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:49.915 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:49.915 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:49.915 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:49.915 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.915 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.915 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.916 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:16:49.916 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:49.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.916 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.916 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.916 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:16:49.916 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:49.916 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.917 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.917 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:49.917 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.917 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.917 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.917 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:16:49.918 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:49.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.918 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:16:49.918 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:49.918 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.918 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:16:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:49.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.920 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.920 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.920 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:16:49.920 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:49.920 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.920 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.920 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:49.921 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.921 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.921 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.921 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:16:49.921 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:49.921 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.921 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.921 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:16:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:16:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:16:49.922 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:16:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:16:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.923 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.924 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:49.924 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:49.924 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:49.924 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:49.924 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:49.924 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:49.924 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:49.924 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:49.925 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:49.925 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:49.925 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:49.925 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:49.925 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:49.925 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.925 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.925 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.926 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:16:49.926 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:49.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.926 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.926 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.926 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:16:49.926 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:49.927 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.927 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.927 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:49.927 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.927 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.927 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.927 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:16:49.928 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:49.928 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.928 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.928 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.928 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:16:49.928 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:49.928 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.928 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:49.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.930 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.930 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.930 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:16:49.930 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:49.930 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.930 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.930 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.930 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:49.931 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.931 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.931 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.931 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:16:49.931 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:49.931 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.931 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.931 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.932 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:16:49.932 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:49.932 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.932 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.932 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.932 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:16:49.932 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:16:49.932 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:16:49.933 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:16:49.933 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:49.933 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:49.933 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:49.933 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.933 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.934 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:49.934 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:49.934 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:49.934 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:49.934 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:49.934 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:49.934 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:49.934 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:49.935 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:49.935 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:49.935 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:49.935 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:49.935 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:49.935 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.935 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.935 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.936 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:16:49.936 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:49.936 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.936 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.936 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.936 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:16:49.936 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:49.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.937 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.937 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.937 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:49.937 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.937 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.937 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.937 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:16:49.937 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:49.938 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.938 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.938 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.938 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:16:49.938 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:49.938 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.938 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.938 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.939 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:49.939 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.939 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.939 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.939 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:16:49.939 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:49.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.939 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.940 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.940 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:16:49.940 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:49.940 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.940 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.940 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:49.941 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.941 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.941 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.941 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:16:49.941 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:49.941 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.941 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.941 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.942 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:16:49.942 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:49.942 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.942 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.942 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.942 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:16:49.942 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:16:49.942 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:16:49.943 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:16:49.943 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:49.943 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:49.943 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:49.943 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.943 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.943 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:49.944 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:49.944 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:49.944 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:49.944 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:49.944 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:49.944 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:49.944 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:49.944 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:49.945 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:49.945 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:49.945 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:49.945 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:49.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.945 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.945 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:16:49.946 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:49.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.946 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.946 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.946 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:16:49.946 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:49.946 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.946 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.947 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:49.947 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.947 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.947 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.947 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:16:49.947 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:49.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.948 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.948 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.948 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:16:49.948 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:49.948 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.948 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.948 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.948 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:49.949 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.949 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.949 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:16:49.949 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:49.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.949 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.950 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:16:49.950 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:49.950 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.950 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.950 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.950 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:49.950 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.950 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:16:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:16:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:16:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:16:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:16:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:16:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:16:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:16:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.957 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:49.957 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.957 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.957 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.957 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:16:49.957 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:49.957 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.957 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.958 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.958 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:16:49.958 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:49.958 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.958 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.958 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.958 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:49.958 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.959 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.959 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.959 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:16:49.959 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:49.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.959 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.959 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.960 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:16:49.960 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:49.960 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.960 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.960 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.960 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:49.960 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.960 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.961 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.961 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:16:49.961 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:49.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.961 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.961 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.961 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:16:49.961 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:49.962 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.962 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.962 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.962 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:16:49.962 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:16:49.962 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:16:49.962 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:16:49.962 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:49.963 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:49.963 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:49.963 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.963 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.963 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:49.963 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:49.963 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:49.964 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:49.964 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:49.964 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:49.964 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:49.964 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:49.964 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:49.964 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:49.964 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:49.965 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:49.965 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:49.965 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.965 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.965 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:16:49.965 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:49.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.966 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.966 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.966 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:16:49.966 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:49.966 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.966 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.966 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.966 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:16:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.967 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.968 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:16:49.968 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:49.968 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.968 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.968 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:49.968 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.969 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.969 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.969 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:16:49.969 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:49.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.969 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.969 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.969 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:16:49.970 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:49.970 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.970 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.970 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.970 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:49.970 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.970 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.970 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.971 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:16:49.971 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:49.971 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.971 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.971 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.971 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:16:49.971 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:49.971 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.972 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.972 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.972 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:16:49.972 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:16:49.972 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:16:49.972 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:16:49.972 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:49.972 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:49.973 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:49.973 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.973 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.973 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:49.973 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:49.973 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:49.973 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:49.974 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:49.974 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:49.974 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:49.974 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:49.974 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:49.974 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:49.974 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:49.974 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:49.975 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:49.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.975 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:16:49.975 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:49.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.975 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.976 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.976 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:16:49.976 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:49.976 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.976 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.976 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:16:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.978 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:16:49.978 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:49.978 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.978 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.978 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.978 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:49.978 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.978 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:16:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:16:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:16:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:16:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:16:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:16:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:16:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:16:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:16:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:16:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:16:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:16:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:16:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:16:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:16:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:16:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:16:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:16:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:16:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:16:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:16:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:16:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:16:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:16:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:16:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:16:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:16:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:16:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:16:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:16:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:16:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:16:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:16:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:16:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:16:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:16:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:16:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:16:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:16:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:16:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:16:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:16:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:16:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:16:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:16:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:16:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:16:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:16:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:16:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:16:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:16:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:16:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.007 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:50.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa1a0066280 msgr2=0x7fa1a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa1a0066280 0x7fa1a0068730 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80ae000 tx=0x7fa1b80b5040 comp rx=0 tx=0).stop 2023-07-09T02:16:50.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc0d2620 msgr2=0x7fa1bc0b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc0d2620 0x7fa1bc0b5de0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00c410 tx=0x7fa1ac00c8d0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 shutdown_connections 2023-07-09T02:16:50.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1bc15c060 0x7fa1bc1f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1bc0d2620 0x7fa1bc0b5de0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa1a0066280 0x7fa1a0068730 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 --2- 172.21.15.45:0/2222202535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1bc0cd120 0x7fa1bc0c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 >> 172.21.15.45:0/2222202535 conn(0x7fa1bc0698e0 msgr2=0x7fa1bc15b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 shutdown_connections 2023-07-09T02:16:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:49.844+0000 7fa1c440b640 1 -- 172.21.15.45:0/2222202535 wait complete. 2023-07-09T02:16:50.011 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-07-09T02:16:50.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:16:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe925b3a640 1 Processor -- start 2023-07-09T02:16:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe925b3a640 1 -- start start 2023-07-09T02:16:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe925b3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 0x7fe9200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe925b3a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe9200cd120 0x7fe9200d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe925b3a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9200d2450 0x7fe9200d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe925b3a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9200d28f0 con 0x7fe9200d2450 2023-07-09T02:16:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe925b3a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe920160a50 con 0x7fe9200cd120 2023-07-09T02:16:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe925b3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92015c430 con 0x7fe92015c060 2023-07-09T02:16:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9200d2450 0x7fe9200d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9200d2450 0x7fe9200d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54116/0 (socket says 172.21.15.45:54116) 2023-07-09T02:16:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91ffff640 1 -- 172.21.15.45:0/2097813236 learned_addr learned my addr 172.21.15.45:0/2097813236 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91f7fe640 1 --2- 172.21.15.45:0/2097813236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 0x7fe9200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91effd640 1 --2- 172.21.15.45:0/2097813236 >> v2:172.21.15.155:3300/0 conn(0x7fe9200cd120 0x7fe9200d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91ffff640 1 -- 172.21.15.45:0/2097813236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 msgr2=0x7fe9200b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:50.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91ffff640 1 --2- 172.21.15.45:0/2097813236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 0x7fe9200b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91ffff640 1 -- 172.21.15.45:0/2097813236 >> v2:172.21.15.155:3300/0 conn(0x7fe9200cd120 msgr2=0x7fe9200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:50.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91ffff640 1 --2- 172.21.15.45:0/2097813236 >> v2:172.21.15.155:3300/0 conn(0x7fe9200cd120 0x7fe9200d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.156+0000 7fe91ffff640 1 -- 172.21.15.45:0/2097813236 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92015fb60 con 0x7fe9200d2450 2023-07-09T02:16:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe91ffff640 1 --2- 172.21.15.45:0/2097813236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 0x7fe9200d0610 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe9200b5600 tx=0x7fe91801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cb56e6d04113d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe91e7fc640 1 -- 172.21.15.45:0/2097813236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9180a5560 con 0x7fe9200d2450 2023-07-09T02:16:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe91e7fc640 1 -- 172.21.15.45:0/2097813236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9180a56c0 con 0x7fe9200d2450 2023-07-09T02:16:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe91e7fc640 1 -- 172.21.15.45:0/2097813236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9180a5a50 con 0x7fe9200d2450 2023-07-09T02:16:50.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 -- 172.21.15.45:0/2097813236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 msgr2=0x7fe9200d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 --2- 172.21.15.45:0/2097813236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 0x7fe9200d0610 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe9200b5600 tx=0x7fe91801c6e0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 -- 172.21.15.45:0/2097813236 shutdown_connections 2023-07-09T02:16:50.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 --2- 172.21.15.45:0/2097813236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 0x7fe9200d0610 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 --2- 172.21.15.45:0/2097813236 >> v2:172.21.15.155:3300/0 conn(0x7fe9200cd120 0x7fe9200d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 --2- 172.21.15.45:0/2097813236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 0x7fe9200b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 -- 172.21.15.45:0/2097813236 >> 172.21.15.45:0/2097813236 conn(0x7fe9200698e0 msgr2=0x7fe920069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:50.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 -- 172.21.15.45:0/2097813236 shutdown_connections 2023-07-09T02:16:50.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 -- 172.21.15.45:0/2097813236 wait complete. 2023-07-09T02:16:50.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 Processor -- start 2023-07-09T02:16:50.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.160+0000 7fe925b3a640 1 -- start start 2023-07-09T02:16:50.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9200cd120 0x7fe920151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 0x7fe9200ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 0x7fe92015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201f4fe0 con 0x7fe9200d2450 2023-07-09T02:16:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920151fb0 con 0x7fe9200cd120 2023-07-09T02:16:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201f4680 con 0x7fe92015c060 2023-07-09T02:16:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 0x7fe9200ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9200cd120 0x7fe920151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9200cd120 0x7fe920151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:49108/0 (socket says 172.21.15.45:49108) 2023-07-09T02:16:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 0x7fe9200ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54132/0 (socket says 172.21.15.45:54132) 2023-07-09T02:16:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 -- 172.21.15.45:0/1248922019 learned_addr learned my addr 172.21.15.45:0/1248922019 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91ffff640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 0x7fe92015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 -- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 msgr2=0x7fe92015ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 0x7fe92015ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 -- 172.21.15.45:0/1248922019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 msgr2=0x7fe9200ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 0x7fe9200ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 -- 172.21.15.45:0/1248922019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918009b30 con 0x7fe9200cd120 2023-07-09T02:16:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe91f7fe640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9200cd120 0x7fe920151a70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe91000e870 tx=0x7fe91000ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe907fff640 1 -- 172.21.15.45:0/1248922019 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910009510 con 0x7fe9200cd120 2023-07-09T02:16:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe907fff640 1 -- 172.21.15.45:0/1248922019 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91000eec0 con 0x7fe9200cd120 2023-07-09T02:16:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe907fff640 1 -- 172.21.15.45:0/1248922019 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000cb40 con 0x7fe9200cd120 2023-07-09T02:16:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9201f4920 con 0x7fe9200cd120 2023-07-09T02:16:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9201f5400 con 0x7fe9200cd120 2023-07-09T02:16:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.164+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9201f5250 con 0x7fe9200cd120 2023-07-09T02:16:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.168+0000 7fe907fff640 1 -- 172.21.15.45:0/1248922019 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe91000cca0 con 0x7fe9200cd120 2023-07-09T02:16:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.168+0000 7fe907fff640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe90c066280 0x7fe90c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.168+0000 7fe907fff640 1 -- 172.21.15.45:0/1248922019 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe910083dd0 con 0x7fe9200cd120 2023-07-09T02:16:50.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.168+0000 7fe91effd640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe90c066280 0x7fe90c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.168+0000 7fe91effd640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe90c066280 0x7fe90c068730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe9200b4d40 tx=0x7fe914009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:50.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.172+0000 7fe907fff640 1 -- 172.21.15.45:0/1248922019 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe910051260 con 0x7fe9200cd120 2023-07-09T02:16:50.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.328+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe92004d7d0 con 0x7fe9200cd120 2023-07-09T02:16:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.328+0000 7fe907fff640 1 -- 172.21.15.45:0/1248922019 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) v1 ==== 81+0+36954 (secure 0 0 0) 0x7fe910017090 con 0x7fe9200cd120 2023-07-09T02:16:50.333 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:50.334 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:16:50.334 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 111, 2023-07-09T02:16:50.334 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:16:50.334 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:16:50.335 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:16:47.494929+0000", 2023-07-09T02:16:50.335 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:16:50.335 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:16:50.336 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:16:50.337 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:16:50.337 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:16:50.337 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:16:50.337 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:16:50.338 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:50.338 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:16:50.338 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:16:50.338 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:16:50.339 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:16:50.339 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:16:50.339 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 14, 2023-07-09T02:16:50.339 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:16:50.339 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:16:50.340 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:16:50.340 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:16:50.340 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:16:50.341 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:16:50.341 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.341 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:16:50.341 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:16:50.341 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:16:50.342 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:50.342 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:50.342 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:50.342 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:50.342 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:50.342 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:50.342 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:50.343 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:50.343 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:50.343 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:50.343 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:50.343 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:50.343 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:16:50.343 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:16:50.344 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:16:50.344 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:16:50.344 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:16:50.344 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:50.344 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:50.344 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:50.344 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:50.344 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:50.345 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:50.345 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:50.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.345 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:16:50.345 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:50.345 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:50.345 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:50.345 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:50.346 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:50.346 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:50.346 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:50.346 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:50.346 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:50.346 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:50.346 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:50.346 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:50.347 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:50.347 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:50.347 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:50.347 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:50.347 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:50.347 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:50.347 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:50.347 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:50.348 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:50.348 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:50.348 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:50.348 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:50.348 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:50.348 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:50.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.349 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:50.349 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:50.349 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:50.349 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:50.349 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:50.349 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:50.350 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:50.350 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:50.350 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:50.350 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:50.350 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:50.350 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:50.350 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:16:50.350 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:16:50.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.351 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:50.351 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:16:50.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.351 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:50.351 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:16:50.351 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:16:50.351 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:16:50.352 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:16:50.352 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:16:50.352 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:50.352 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:50.352 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:50.352 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.352 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.353 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.353 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:16:50.353 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:16:50.353 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:16:50.353 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:50.353 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:50.353 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:50.353 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:50.354 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:50.354 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:50.354 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:50.354 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:50.354 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:50.354 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:50.354 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:50.354 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:50.355 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:16:50.355 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:16:50.355 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:16:50.355 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:16:50.355 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:16:50.355 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:50.355 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:50.355 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:50.356 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:50.356 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:50.356 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:50.356 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:50.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.356 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:16:50.356 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:50.357 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:50.357 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:50.357 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:50.357 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:50.357 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:50.357 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:50.357 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:50.357 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:50.358 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:50.358 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:50.358 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:50.358 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:50.358 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:50.358 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:50.358 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:50.358 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:50.359 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:50.359 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:50.359 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:50.359 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:50.359 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:50.359 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:50.359 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:50.359 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:50.360 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:50.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.360 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:50.360 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:50.360 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:50.360 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:50.360 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:50.361 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:50.361 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:50.361 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:50.361 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:50.361 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:50.361 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:50.361 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:16:50.361 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:50.362 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:16:50.362 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.362 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:50.362 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:16:50.362 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:16:50.362 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:16:50.362 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:50.362 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:50.363 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:50.363 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:50.363 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:50.363 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.363 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.363 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 13, 2023-07-09T02:16:50.364 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:16:50.364 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:15.254129+0000", 2023-07-09T02:16:50.364 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:50.364 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:50.364 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:50.364 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:50.364 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:50.364 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:50.365 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:50.365 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:50.365 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:50.365 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:50.365 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:50.365 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:50.365 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:16:50.366 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:16:50.366 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:16:50.366 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:16:50.366 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:16:50.366 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:50.366 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:50.366 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:50.366 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:50.367 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:50.367 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:50.367 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:50.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.367 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:16:50.367 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:50.367 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:50.367 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:50.368 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:50.368 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:50.368 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:50.368 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:50.368 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:50.368 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:50.368 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:50.369 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:50.369 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:50.369 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:50.369 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:50.369 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:50.369 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:50.369 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:50.369 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:50.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:50.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:50.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:50.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:50.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:50.370 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:50.370 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:50.370 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:50.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.371 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:50.371 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:50.371 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:50.371 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:50.371 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:50.371 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:50.371 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:50.372 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:50.372 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:50.372 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:50.372 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:50.372 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:50.372 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:16:50.372 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:16:50.373 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:16:50.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.373 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:50.373 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:50.373 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:16:50.373 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.373 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:50.374 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:16:50.374 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:16:50.374 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:50.374 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:16:50.374 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:16:50.374 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:50.374 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:50.374 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:50.375 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.375 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.375 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 14, 2023-07-09T02:16:50.375 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:16:50.375 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:16:16.522380+0000", 2023-07-09T02:16:50.376 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:16:50.376 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:16:50.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:16:50.376 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:16:50.376 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:16:50.376 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:16:50.376 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:16:50.377 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:16:50.377 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:16:50.377 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:16:50.377 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:16:50.377 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:16:50.377 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:16:50.377 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:16:50.377 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:16:50.378 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:16:50.378 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:16:50.378 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:16:50.378 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:16:50.378 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:16:50.378 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:16:50.379 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:16:50.379 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:16:50.379 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:16:50.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.379 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:16:50.379 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:16:50.379 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:16:50.379 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:16:50.380 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:16:50.380 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:16:50.380 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:16:50.380 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:16:50.380 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:16:50.380 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:16:50.381 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:16:50.381 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:16:50.381 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:16:50.381 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:16:50.381 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:16:50.381 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:16:50.381 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:16:50.381 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:16:50.382 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:16:50.382 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:16:50.382 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:16:50.382 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:16:50.382 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:16:50.382 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:16:50.382 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:16:50.382 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:16:50.383 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:16:50.383 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.383 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:16:50.383 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:16:50.383 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:16:50.383 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:16:50.383 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:16:50.384 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:16:50.384 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:16:50.384 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:16:50.384 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:16:50.384 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:16:50.384 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:16:50.384 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:16:50.384 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:16:50.385 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:16:50.385 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.385 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:16:50.385 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:16:50.385 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:16:50.385 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.385 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.386 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:16:50.386 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.75, 2023-07-09T02:16:50.386 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.75, 2023-07-09T02:16:50.386 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:16:50.386 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:16:50.386 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:16:50.386 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:16:50.386 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:16:50.387 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:16:50.387 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.387 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.387 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:50.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:16:50.387 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:50.388 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:50.388 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:50.388 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:50.388 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:50.388 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:50.388 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:50.388 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:50.388 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:50.389 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:50.389 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:50.389 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:50.389 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:50.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.389 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.390 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:16:50.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:50.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.390 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.390 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.390 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:16:50.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:50.390 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.391 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.391 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:50.391 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.391 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.391 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.391 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:16:50.391 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:50.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.392 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.392 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.392 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:16:50.392 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:50.392 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.392 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.393 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:50.393 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.393 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.393 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.393 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:16:50.393 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:50.393 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.393 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.394 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.394 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:16:50.394 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:50.394 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.394 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.394 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:16:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.396 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:16:50.396 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:16:50.396 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.396 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.396 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:16:50.396 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:16:50.397 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:16:50.397 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:16:50.397 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:50.397 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:50.397 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:50.397 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.397 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.398 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:50.398 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:50.398 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:50.398 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:50.398 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:50.398 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:50.398 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:50.398 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:50.399 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:50.399 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:50.399 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:50.399 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:50.399 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:50.399 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.399 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.399 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.400 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:16:50.400 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:50.400 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.400 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.400 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.400 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:16:50.400 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:50.401 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.401 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.401 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:50.401 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.401 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.401 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.401 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:16:50.402 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:50.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.402 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.402 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.402 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:16:50.402 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:50.402 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.402 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.403 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:50.403 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.403 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.403 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.403 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:16:50.403 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:50.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.404 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.404 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.404 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:16:50.404 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:50.404 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.404 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.404 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.405 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:50.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.405 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.405 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:16:50.405 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:50.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.405 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.406 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.406 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:16:50.406 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:16:50.406 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.406 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.406 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.406 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:16:50.406 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:16:50.407 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:16:50.407 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:16:50.407 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:50.407 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:50.407 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:50.407 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.408 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.408 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:50.408 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:50.408 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:50.408 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:50.408 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:50.408 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:50.408 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:50.409 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:50.409 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:50.409 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:50.409 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:50.409 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:50.409 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:50.410 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.410 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:16:50.410 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:50.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.411 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:16:50.411 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:50.411 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.411 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.411 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:50.411 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.412 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.412 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.412 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:16:50.412 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:50.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.412 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.412 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.412 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:16:50.413 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:50.413 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.413 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.413 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:50.413 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.413 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.414 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:16:50.414 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:50.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.414 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.414 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.414 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:16:50.414 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:50.415 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.415 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.415 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:50.415 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.415 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:16:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:16:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:16:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:16:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:16:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:16:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:16:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:16:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:16:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:16:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:16:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:16:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:16:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:16:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:16:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:16:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:16:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:16:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:16:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:16:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:16:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:16:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:16:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:16:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:16:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:16:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:16:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:16:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:16:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:16:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:16:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:16:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:16:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:16:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:16:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:16:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:16:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:16:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:16:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:16:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:16:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:16:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:16:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:16:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:16:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:16:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:16:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:16:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:16:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:16:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:16:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:16:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:16:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:16:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:16:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:16:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:16:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:16:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:16:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:16:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:16:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:16:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:16:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:16:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:16:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:16:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:16:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 104, 2023-07-09T02:16:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:16:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:16:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:16:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:16:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:16:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:16:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:16:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:16:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:16:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:16:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:16:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:16:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:16:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:16:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:16:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:16:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:16:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:16:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:16:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:16:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:16:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:16:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:16:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:16:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:16:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:16:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:16:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:16:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:16:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:16:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:16:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:16:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:16:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:16:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:16:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:16:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:16:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:16:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:16:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:16:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:16:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:16:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:16:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:16:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:16:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:16:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:16:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:16:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:16:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:16:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:16:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:16:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:16:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:16:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:16:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:16:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:16:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:16:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:16:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:16:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:16:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:16:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:16:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:16:50.486 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:16:50.486 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.486 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:16:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:16:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:16:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:16:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:16:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:16:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:16:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:16:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:16:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:16:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:16:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:16:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:16:50.488 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:16:50.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe90c066280 msgr2=0x7fe90c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe90c066280 0x7fe90c068730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe9200b4d40 tx=0x7fe914009190 comp rx=0 tx=0).stop 2023-07-09T02:16:50.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9200cd120 msgr2=0x7fe920151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9200cd120 0x7fe920151a70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe91000e870 tx=0x7fe91000ec70 comp rx=0 tx=0).stop 2023-07-09T02:16:50.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 shutdown_connections 2023-07-09T02:16:50.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe90c066280 0x7fe90c068730 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe92015c060 0x7fe92015ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200d2450 0x7fe9200ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 --2- 172.21.15.45:0/1248922019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9200cd120 0x7fe920151a70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 >> 172.21.15.45:0/1248922019 conn(0x7fe9200698e0 msgr2=0x7fe9200b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:50.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 shutdown_connections 2023-07-09T02:16:50.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.332+0000 7fe925b3a640 1 -- 172.21.15.45:0/1248922019 wait complete. 2023-07-09T02:16:50.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:50.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdef17db640 1 Processor -- start 2023-07-09T02:16:50.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdef17db640 1 -- start start 2023-07-09T02:16:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdef17db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec15c060 0x7fdeec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdef17db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdeec0cd120 0x7fdeec0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdef17db640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec160a50 con 0x7fdeec0d2450 2023-07-09T02:16:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdef17db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec0d28f0 con 0x7fdeec0cd120 2023-07-09T02:16:50.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdef17db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0cfe40 con 0x7fdeec15c060 2023-07-09T02:16:50.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeeb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdeec0d2450 0x7fdeec0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45100/0 (socket says 172.21.15.45:45100) 2023-07-09T02:16:50.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeeb7fe640 1 -- 172.21.15.45:0/3419363802 learned_addr learned my addr 172.21.15.45:0/3419363802 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:50.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/3419363802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec15c060 0x7fdeec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdee3fff640 1 --2- 172.21.15.45:0/3419363802 >> v2:172.21.15.155:3300/0 conn(0x7fdeec0cd120 0x7fdeec0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeea7fc640 1 -- 172.21.15.45:0/3419363802 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506178159 0 0) 0x7fdeec160a50 con 0x7fdeec0d2450 2023-07-09T02:16:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeea7fc640 1 -- 172.21.15.45:0/3419363802 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded8003530 con 0x7fdeec0d2450 2023-07-09T02:16:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeeaffd640 1 -- 172.21.15.45:0/3419363802 >> v2:172.21.15.155:3300/0 conn(0x7fdeec0cd120 msgr2=0x7fdeec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/3419363802 >> v2:172.21.15.155:3300/0 conn(0x7fdeec0cd120 0x7fdeec0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeeaffd640 1 -- 172.21.15.45:0/3419363802 >> v1:172.21.15.45:6789/0 conn(0x7fdeec0d2450 legacy=0x7fdeec0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdeeaffd640 1 -- 172.21.15.45:0/3419363802 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec15c430 con 0x7fdeec15c060 2023-07-09T02:16:50.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.636+0000 7fdee3fff640 1 --2- 172.21.15.45:0/3419363802 >> v2:172.21.15.155:3300/0 conn(0x7fdeec0cd120 0x7fdeec0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:50.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/3419363802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec15c060 0x7fdeec0b4ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0097c0 tx=0x7fdedc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79cc25872c38f4d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdeea7fc640 1 -- 172.21.15.45:0/3419363802 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0ab600 con 0x7fdeec15c060 2023-07-09T02:16:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdeea7fc640 1 -- 172.21.15.45:0/3419363802 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc0a7050 con 0x7fdeec15c060 2023-07-09T02:16:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdeea7fc640 1 -- 172.21.15.45:0/3419363802 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0ab980 con 0x7fdeec15c060 2023-07-09T02:16:50.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdef17db640 1 -- 172.21.15.45:0/3419363802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec15c060 msgr2=0x7fdeec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdef17db640 1 --2- 172.21.15.45:0/3419363802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec15c060 0x7fdeec0b4ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0097c0 tx=0x7fdedc01c450 comp rx=0 tx=0).stop 2023-07-09T02:16:50.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdef17db640 1 -- 172.21.15.45:0/3419363802 shutdown_connections 2023-07-09T02:16:50.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdef17db640 1 --2- 172.21.15.45:0/3419363802 >> v2:172.21.15.155:3300/0 conn(0x7fdeec0cd120 0x7fdeec0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdef17db640 1 --2- 172.21.15.45:0/3419363802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec15c060 0x7fdeec0b4ed0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.640+0000 7fdef17db640 1 -- 172.21.15.45:0/3419363802 >> 172.21.15.45:0/3419363802 conn(0x7fdeec0698e0 msgr2=0x7fdeec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:50.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 -- 172.21.15.45:0/3419363802 shutdown_connections 2023-07-09T02:16:50.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 -- 172.21.15.45:0/3419363802 wait complete. 2023-07-09T02:16:50.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 Processor -- start 2023-07-09T02:16:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 -- start start 2023-07-09T02:16:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec0cd120 0x7fdeec153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeec0d2450 0x7fdeec157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec15c060 0x7fdeec158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec15d1a0 con 0x7fdeec15c060 2023-07-09T02:16:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec15d480 con 0x7fdeec0d2450 2023-07-09T02:16:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec15d760 con 0x7fdeec0cd120 2023-07-09T02:16:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec15c060 0x7fdeec158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec15c060 0x7fdeec158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54138/0 (socket says 172.21.15.45:54138) 2023-07-09T02:16:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 -- 172.21.15.45:0/2625424710 learned_addr learned my addr 172.21.15.45:0/2625424710 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec0cd120 0x7fdeec153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdee3fff640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeec0d2450 0x7fdeec157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 -- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec0cd120 msgr2=0x7fdeec153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec0cd120 0x7fdeec153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 -- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeec0d2450 msgr2=0x7fdeec157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeec0d2450 0x7fdeec157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 -- 172.21.15.45:0/2625424710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4009420 con 0x7fdeec15c060 2023-07-09T02:16:50.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec0cd120 0x7fdeec153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:50.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdee3fff640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeec0d2450 0x7fdeec157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:50.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdeeb7fe640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec15c060 0x7fdeec158400 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdee400cb40 tx=0x7fdee400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:50.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdee37fe640 1 -- 172.21.15.45:0/2625424710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee400aca0 con 0x7fdeec15c060 2023-07-09T02:16:50.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdee37fe640 1 -- 172.21.15.45:0/2625424710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee400ae00 con 0x7fdeec15c060 2023-07-09T02:16:50.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdee37fe640 1 -- 172.21.15.45:0/2625424710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4012620 con 0x7fdeec15c060 2023-07-09T02:16:50.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.644+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc009420 con 0x7fdeec15c060 2023-07-09T02:16:50.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.648+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec15dd20 con 0x7fdeec15c060 2023-07-09T02:16:50.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.648+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec15df10 con 0x7fdeec15c060 2023-07-09T02:16:50.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.648+0000 7fdee37fe640 1 -- 172.21.15.45:0/2625424710 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdee4007070 con 0x7fdeec15c060 2023-07-09T02:16:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.648+0000 7fdee37fe640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdecc066280 0x7fdecc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.648+0000 7fdee37fe640 1 -- 172.21.15.45:0/2625424710 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdee4083d40 con 0x7fdeec15c060 2023-07-09T02:16:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.648+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdecc066280 0x7fdecc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.648+0000 7fdeeaffd640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdecc066280 0x7fdecc068730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0ad000 tx=0x7fdedc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.652+0000 7fdee37fe640 1 -- 172.21.15.45:0/2625424710 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdee4051250 con 0x7fdeec15c060 2023-07-09T02:16:50.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.844+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdeec04d7d0 con 0x7fdeec15c060 2023-07-09T02:16:50.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.844+0000 7fdee37fe640 1 -- 172.21.15.45:0/2625424710 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fdee4017090 con 0x7fdeec15c060 2023-07-09T02:16:50.847 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:50.847 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:50.848 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdecc066280 msgr2=0x7fdecc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdecc066280 0x7fdecc068730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0ad000 tx=0x7fdedc008040 comp rx=0 tx=0).stop 2023-07-09T02:16:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec15c060 msgr2=0x7fdeec158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec15c060 0x7fdeec158400 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdee400cb40 tx=0x7fdee400a060 comp rx=0 tx=0).stop 2023-07-09T02:16:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 shutdown_connections 2023-07-09T02:16:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdeec15c060 0x7fdeec158400 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeec0d2450 0x7fdeec157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdecc066280 0x7fdecc068730 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 --2- 172.21.15.45:0/2625424710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdeec0cd120 0x7fdeec153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 >> 172.21.15.45:0/2625424710 conn(0x7fdeec0698e0 msgr2=0x7fdeec1575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 shutdown_connections 2023-07-09T02:16:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:50.848+0000 7fdef17db640 1 -- 172.21.15.45:0/2625424710 wait complete. 2023-07-09T02:16:50.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-07-09T02:16:51.032 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":6939,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":32.892051608999999,"mdsmap_epoch":51,"osdmap_epoch":111,"osdmap_epoch_barrier":108,"uptime":38.652182555000003} 2023-07-09T02:16:51.033 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 6939, "mdsmap_epoch": 51, "osdmap_epoch": 111, "osdmap_epoch_barrier": 108, "rank_uptime": 32.892051609, "state": "up:active", "uptime": 38.652182555, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:16:51.033 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:16:51.033 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:51.034 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:51.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:51.043 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-07-09T02:16:51.472 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records in 2023-07-09T02:16:51.473 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records out 2023-07-09T02:16:51.473 INFO:teuthology.orchestra.run.smithi045.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.379345 s, 138 MB/s 2023-07-09T02:16:51.474 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:16:51.474 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:16:51.526 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:16:51.579 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:16:51.579 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:51.580 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:51.589 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:51.589 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:51.641 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:51.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99cce34640 1 Processor -- start 2023-07-09T02:16:51.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99cce34640 1 -- start start 2023-07-09T02:16:51.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99cce34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99c80d2620 0x7f99c80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:51.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99cce34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c8160a50 con 0x7f99c80cd120 2023-07-09T02:16:51.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99cce34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c815c430 con 0x7f99c815c060 2023-07-09T02:16:51.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99cce34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c815fb60 con 0x7f99c80d2620 2023-07-09T02:16:51.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99bffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99c80d2620 0x7f99c80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:51.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99bffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99c80d2620 0x7f99c80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59586/0 (socket says 172.21.15.45:59586) 2023-07-09T02:16:51.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99bffff640 1 -- 172.21.15.45:0/1241847665 learned_addr learned my addr 172.21.15.45:0/1241847665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:51.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99c6d9d640 1 --1- 172.21.15.45:0/1241847665 >> v1:172.21.15.45:6789/0 conn(0x7f99c80cd120 0x7f99c80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48812/0 (socket says 172.21.15.45:48812) 2023-07-09T02:16:51.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99bffff640 1 -- 172.21.15.45:0/1241847665 >> v1:172.21.15.155:6789/0 conn(0x7f99c815c060 legacy=0x7f99c80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:51.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99bffff640 1 -- 172.21.15.45:0/1241847665 >> v1:172.21.15.45:6789/0 conn(0x7f99c80cd120 legacy=0x7f99c80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:51.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.828+0000 7f99bffff640 1 -- 172.21.15.45:0/1241847665 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c815fe40 con 0x7f99c80d2620 2023-07-09T02:16:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99bffff640 1 --2- 172.21.15.45:0/1241847665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b4ed0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009870 tx=0x7f99b001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582decb57d68ae03 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:51.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99c5d9b640 1 -- 172.21.15.45:0/1241847665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00aa670 con 0x7f99c80d2620 2023-07-09T02:16:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99c5d9b640 1 -- 172.21.15.45:0/1241847665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b00aa7d0 con 0x7f99c80d2620 2023-07-09T02:16:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99c5d9b640 1 -- 172.21.15.45:0/1241847665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00aab60 con 0x7f99c80d2620 2023-07-09T02:16:51.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99cce34640 1 -- 172.21.15.45:0/1241847665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 msgr2=0x7f99c80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99cce34640 1 --2- 172.21.15.45:0/1241847665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b4ed0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009870 tx=0x7f99b001c510 comp rx=0 tx=0).stop 2023-07-09T02:16:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99cce34640 1 -- 172.21.15.45:0/1241847665 shutdown_connections 2023-07-09T02:16:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99cce34640 1 --2- 172.21.15.45:0/1241847665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b4ed0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:51.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99cce34640 1 -- 172.21.15.45:0/1241847665 >> 172.21.15.45:0/1241847665 conn(0x7f99c80698e0 msgr2=0x7f99c8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99cce34640 1 -- 172.21.15.45:0/1241847665 shutdown_connections 2023-07-09T02:16:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.832+0000 7f99cce34640 1 -- 172.21.15.45:0/1241847665 wait complete. 2023-07-09T02:16:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 Processor -- start 2023-07-09T02:16:51.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 -- start start 2023-07-09T02:16:51.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99c80cd120 0x7f99c8150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99c815c060 0x7f99c80b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c81510e0 con 0x7f99c80d2620 2023-07-09T02:16:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c815e9e0 con 0x7f99c815c060 2023-07-09T02:16:51.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8154db0 con 0x7f99c80cd120 2023-07-09T02:16:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59594/0 (socket says 172.21.15.45:59594) 2023-07-09T02:16:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 -- 172.21.15.45:0/968515507 learned_addr learned my addr 172.21.15.45:0/968515507 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99c659c640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99c80cd120 0x7f99c8150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:51.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99c6d9d640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99c815c060 0x7f99c80b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:51.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 -- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99c80cd120 msgr2=0x7f99c8150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99c80cd120 0x7f99c8150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 -- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99c815c060 msgr2=0x7f99c80b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99c815c060 0x7f99c80b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 -- 172.21.15.45:0/968515507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00094d0 con 0x7f99c80d2620 2023-07-09T02:16:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99bffff640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b6fa0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f99b0019120 tx=0x7f99b001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99beffd640 1 -- 172.21.15.45:0/968515507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00b38c0 con 0x7f99c80d2620 2023-07-09T02:16:51.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99beffd640 1 -- 172.21.15.45:0/968515507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b00b3a20 con 0x7f99c80d2620 2023-07-09T02:16:51.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c80b59f0 con 0x7f99c80d2620 2023-07-09T02:16:51.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.836+0000 7f99beffd640 1 -- 172.21.15.45:0/968515507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00b3dd0 con 0x7f99c80d2620 2023-07-09T02:16:51.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.840+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c8155370 con 0x7f99c80d2620 2023-07-09T02:16:51.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.840+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c804d7d0 con 0x7f99c80d2620 2023-07-09T02:16:51.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.840+0000 7f99beffd640 1 -- 172.21.15.45:0/968515507 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99b00c6390 con 0x7f99c80d2620 2023-07-09T02:16:51.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.840+0000 7f99beffd640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99a8066280 0x7f99a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:51.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.840+0000 7f99beffd640 1 -- 172.21.15.45:0/968515507 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99b011e9f0 con 0x7f99c80d2620 2023-07-09T02:16:51.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.840+0000 7f99c659c640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99a8066280 0x7f99a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:51.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.844+0000 7f99c659c640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99a8066280 0x7f99a8068730 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99b8007fd0 tx=0x7f99b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:51.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:51.844+0000 7f99beffd640 1 -- 172.21.15.45:0/968515507 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99b00ebe80 con 0x7f99c80d2620 2023-07-09T02:16:52.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.004+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99c8154ef0 con 0x7f99c80d2620 2023-07-09T02:16:52.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.004+0000 7f99beffd640 1 -- 172.21.15.45:0/968515507 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18307 (secure 0 0 0) 0x7f99b0116e60 con 0x7f99c80d2620 2023-07-09T02:16:52.007 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:52.007 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":111,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:47.494929+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:16:15.254129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T02:16:16.522380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99a8066280 msgr2=0x7f99a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99a8066280 0x7f99a8068730 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99b8007fd0 tx=0x7f99b8009040 comp rx=0 tx=0).stop 2023-07-09T02:16:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 msgr2=0x7f99c80b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b6fa0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f99b0019120 tx=0x7f99b001ad50 comp rx=0 tx=0).stop 2023-07-09T02:16:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 shutdown_connections 2023-07-09T02:16:52.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99c815c060 0x7f99c80b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99c80d2620 0x7f99c80b6fa0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99a8066280 0x7f99a8068730 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 --2- 172.21.15.45:0/968515507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99c80cd120 0x7f99c8150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 >> 172.21.15.45:0/968515507 conn(0x7f99c80698e0 msgr2=0x7f99c80d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:52.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 shutdown_connections 2023-07-09T02:16:52.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.008+0000 7f99cce34640 1 -- 172.21.15.45:0/968515507 wait complete. 2023-07-09T02:16:52.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:16:15.254129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:16:16.522380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:16:52.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:16:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89f6b2c640 1 Processor -- start 2023-07-09T02:16:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89f6b2c640 1 -- start start 2023-07-09T02:16:52.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89f6b2c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f89f015c060 0x7f89f00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89f6b2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89f6b2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f0160a50 con 0x7f89f00cd120 2023-07-09T02:16:52.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89f6b2c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f015c430 con 0x7f89f015c060 2023-07-09T02:16:52.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89f6b2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f015fb60 con 0x7f89f00d2620 2023-07-09T02:16:52.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89effff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89f00cd120 0x7f89f00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48820/0 (socket says 172.21.15.45:48820) 2023-07-09T02:16:52.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.172+0000 7f89effff640 1 -- 172.21.15.45:0/3858921203 learned_addr learned my addr 172.21.15.45:0/3858921203 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:52.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89f48c8640 1 --2- 172.21.15.45:0/3858921203 >> v2:172.21.15.155:3300/0 conn(0x7f89f015c060 0x7f89f00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89ef7fe640 1 -- 172.21.15.45:0/3858921203 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635276603 0 0) 0x7f89f0160a50 con 0x7f89f00cd120 2023-07-09T02:16:52.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89f50c9640 1 --2- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89ef7fe640 1 -- 172.21.15.45:0/3858921203 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e0003530 con 0x7f89f00cd120 2023-07-09T02:16:52.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89f48c8640 1 -- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 msgr2=0x7f89f00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:52.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89f48c8640 1 --2- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89f48c8640 1 -- 172.21.15.45:0/3858921203 >> v1:172.21.15.45:6789/0 conn(0x7f89f00cd120 legacy=0x7f89f00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89f48c8640 1 -- 172.21.15.45:0/3858921203 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f015fe40 con 0x7f89f015c060 2023-07-09T02:16:52.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89f50c9640 1 --2- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:52.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89f48c8640 1 --2- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f015c060 0x7f89f00b4ed0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f89e40097c0 tx=0x7f89e401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f39ab487951d51ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89ef7fe640 1 -- 172.21.15.45:0/3858921203 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40ab650 con 0x7f89f015c060 2023-07-09T02:16:52.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89ef7fe640 1 -- 172.21.15.45:0/3858921203 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40ab7b0 con 0x7f89f015c060 2023-07-09T02:16:52.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.176+0000 7f89ef7fe640 1 -- 172.21.15.45:0/3858921203 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40abb40 con 0x7f89f015c060 2023-07-09T02:16:52.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f015c060 msgr2=0x7f89f00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f015c060 0x7f89f00b4ed0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f89e40097c0 tx=0x7f89e401c450 comp rx=0 tx=0).stop 2023-07-09T02:16:52.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- 172.21.15.45:0/3858921203 shutdown_connections 2023-07-09T02:16:52.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/3858921203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f015c060 0x7f89f00b4ed0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- 172.21.15.45:0/3858921203 >> 172.21.15.45:0/3858921203 conn(0x7f89f00698e0 msgr2=0x7f89f0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:52.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- 172.21.15.45:0/3858921203 shutdown_connections 2023-07-09T02:16:52.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- 172.21.15.45:0/3858921203 wait complete. 2023-07-09T02:16:52.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 Processor -- start 2023-07-09T02:16:52.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- start start 2023-07-09T02:16:52.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f00cd120 0x7f89f015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f015c060 0x7f89f0153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00cb3a0 con 0x7f89f015c060 2023-07-09T02:16:52.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00caab0 con 0x7f89f00cd120 2023-07-09T02:16:52.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f6b2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f015a900 con 0x7f89f00d2620 2023-07-09T02:16:52.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f50c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f015c060 0x7f89f0153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f50c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f015c060 0x7f89f0153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59600/0 (socket says 172.21.15.45:59600) 2023-07-09T02:16:52.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f50c9640 1 -- 172.21.15.45:0/1391612744 learned_addr learned my addr 172.21.15.45:0/1391612744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:52.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f48c8640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f00cd120 0x7f89f015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89effff640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f48c8640 1 -- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 msgr2=0x7f89f00c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f48c8640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f48c8640 1 -- 172.21.15.45:0/1391612744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f015c060 msgr2=0x7f89f0153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f48c8640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f015c060 0x7f89f0153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f48c8640 1 -- 172.21.15.45:0/1391612744 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4009420 con 0x7f89f00cd120 2023-07-09T02:16:52.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.180+0000 7f89f50c9640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f015c060 0x7f89f0153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:52.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89f48c8640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f00cd120 0x7f89f015b410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f89f00b5630 tx=0x7f89e401ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89ed7fa640 1 -- 172.21.15.45:0/1391612744 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40b5600 con 0x7f89f00cd120 2023-07-09T02:16:52.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89ed7fa640 1 -- 172.21.15.45:0/1391612744 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40b5760 con 0x7f89f00cd120 2023-07-09T02:16:52.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f00b59f0 con 0x7f89f00cd120 2023-07-09T02:16:52.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89ed7fa640 1 -- 172.21.15.45:0/1391612744 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40b5af0 con 0x7f89f00cd120 2023-07-09T02:16:52.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f015a620 con 0x7f89f00cd120 2023-07-09T02:16:52.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f00cb4e0 con 0x7f89f00cd120 2023-07-09T02:16:52.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89ed7fa640 1 -- 172.21.15.45:0/1391612744 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89e40b5c50 con 0x7f89f00cd120 2023-07-09T02:16:52.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89ed7fa640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f89d4066280 0x7f89d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89ed7fa640 1 -- 172.21.15.45:0/1391612744 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89e411e8d0 con 0x7f89f00cd120 2023-07-09T02:16:52.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.184+0000 7f89effff640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f89d4066280 0x7f89d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.188+0000 7f89effff640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f89d4066280 0x7f89d4068730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f89f015ad40 tx=0x7f89dc007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.188+0000 7f89ed7fa640 1 -- 172.21.15.45:0/1391612744 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89e40ebf90 con 0x7f89f00cd120 2023-07-09T02:16:52.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.344+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89f00cb4e0 con 0x7f89f00cd120 2023-07-09T02:16:52.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89ed7fa640 1 -- 172.21.15.45:0/1391612744 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89f00cb4e0 con 0x7f89f00cd120 2023-07-09T02:16:52.348 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:16:52.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f89d4066280 msgr2=0x7f89d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f89d4066280 0x7f89d4068730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f89f015ad40 tx=0x7f89dc007d40 comp rx=0 tx=0).stop 2023-07-09T02:16:52.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f00cd120 msgr2=0x7f89f015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f00cd120 0x7f89f015b410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f89f00b5630 tx=0x7f89e401ac90 comp rx=0 tx=0).stop 2023-07-09T02:16:52.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 shutdown_connections 2023-07-09T02:16:52.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89f015c060 0x7f89f0153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f89d4066280 0x7f89d4068730 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89f00d2620 0x7f89f00c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 --2- 172.21.15.45:0/1391612744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89f00cd120 0x7f89f015b410 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 >> 172.21.15.45:0/1391612744 conn(0x7f89f00698e0 msgr2=0x7f89f00b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:52.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 shutdown_connections 2023-07-09T02:16:52.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.348+0000 7f89f6b2c640 1 -- 172.21.15.45:0/1391612744 wait complete. 2023-07-09T02:16:52.369 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:16:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.512+0000 7f5f6ef11640 1 Processor -- start 2023-07-09T02:16:52.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.512+0000 7f5f6ef11640 1 -- start start 2023-07-09T02:16:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6ef11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6815c060 0x7f5f680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6ef11640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f680d2620 0x7f5f680cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6ef11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f68160a50 con 0x7f5f680cd120 2023-07-09T02:16:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6ef11640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6815c430 con 0x7f5f680d2620 2023-07-09T02:16:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6ef11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6815fb60 con 0x7f5f6815c060 2023-07-09T02:16:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6d4ae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f680d2620 0x7f5f680cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6ccad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6815c060 0x7f5f680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6d4ae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f680d2620 0x7f5f680cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:49342/0 (socket says 172.21.15.45:49342) 2023-07-09T02:16:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f67fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5f680cd120 0x7f5f680d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:57300/0 (socket says 172.21.15.45:57300) 2023-07-09T02:16:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6d4ae640 1 -- 172.21.15.45:0/1770636630 learned_addr learned my addr 172.21.15.45:0/1770636630 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6d4ae640 1 -- 172.21.15.45:0/1770636630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6815c060 msgr2=0x7f5f680b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6d4ae640 1 --2- 172.21.15.45:0/1770636630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6815c060 0x7f5f680b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6d4ae640 1 -- 172.21.15.45:0/1770636630 >> v1:172.21.15.155:6789/0 conn(0x7f5f680cd120 legacy=0x7f5f680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f677fe640 1 -- 172.21.15.45:0/1770636630 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318203480 0 0) 0x7f5f68160a50 con 0x7f5f680cd120 2023-07-09T02:16:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6d4ae640 1 -- 172.21.15.45:0/1770636630 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6815fe40 con 0x7f5f680d2620 2023-07-09T02:16:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.516+0000 7f5f6ccad640 1 --2- 172.21.15.45:0/1770636630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6815c060 0x7f5f680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6d4ae640 1 --2- 172.21.15.45:0/1770636630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680d2620 0x7f5f680cee30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009e80 tx=0x7f5f6001c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=328d1c4e52471158 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f677fe640 1 -- 172.21.15.45:0/1770636630 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600a5880 con 0x7f5f680d2620 2023-07-09T02:16:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f677fe640 1 -- 172.21.15.45:0/1770636630 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f600a59e0 con 0x7f5f680d2620 2023-07-09T02:16:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f677fe640 1 -- 172.21.15.45:0/1770636630 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600a5d70 con 0x7f5f680d2620 2023-07-09T02:16:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1770636630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680d2620 msgr2=0x7f5f680cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1770636630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680d2620 0x7f5f680cee30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009e80 tx=0x7f5f6001c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1770636630 shutdown_connections 2023-07-09T02:16:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1770636630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f680d2620 0x7f5f680cee30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1770636630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f6815c060 0x7f5f680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1770636630 >> 172.21.15.45:0/1770636630 conn(0x7f5f680698e0 msgr2=0x7f5f68069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1770636630 shutdown_connections 2023-07-09T02:16:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1770636630 wait complete. 2023-07-09T02:16:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 Processor -- start 2023-07-09T02:16:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- start start 2023-07-09T02:16:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f680cd120 0x7f5f681f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f680d2620 0x7f5f6814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f6815c060 0x7f5f68156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681f7bc0 con 0x7f5f680d2620 2023-07-09T02:16:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681f8b10 con 0x7f5f6815c060 2023-07-09T02:16:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.520+0000 7f5f6ef11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68156e10 con 0x7f5f680cd120 2023-07-09T02:16:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f680d2620 0x7f5f6814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f680d2620 0x7f5f6814cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59604/0 (socket says 172.21.15.45:59604) 2023-07-09T02:16:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 -- 172.21.15.45:0/1552637827 learned_addr learned my addr 172.21.15.45:0/1552637827 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f6d4ae640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f6815c060 0x7f5f68156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f6ccad640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f680cd120 0x7f5f681f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 -- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f680cd120 msgr2=0x7f5f681f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f680cd120 0x7f5f681f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 -- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f6815c060 msgr2=0x7f5f68156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f6815c060 0x7f5f68156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 -- 172.21.15.45:0/1552637827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c009420 con 0x7f5f680d2620 2023-07-09T02:16:52.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f6d4ae640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f6815c060 0x7f5f68156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:52.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f67fff640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f680d2620 0x7f5f6814cbb0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c4e0 tx=0x7f5f5400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f657fa640 1 -- 172.21.15.45:0/1552637827 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540074e0 con 0x7f5f680d2620 2023-07-09T02:16:52.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f657fa640 1 -- 172.21.15.45:0/1552637827 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54007660 con 0x7f5f680d2620 2023-07-09T02:16:52.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f657fa640 1 -- 172.21.15.45:0/1552637827 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54004a30 con 0x7f5f680d2620 2023-07-09T02:16:52.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f60009b30 con 0x7f5f680d2620 2023-07-09T02:16:52.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f680b59f0 con 0x7f5f680d2620 2023-07-09T02:16:52.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6804d7d0 con 0x7f5f680d2620 2023-07-09T02:16:52.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f657fa640 1 -- 172.21.15.45:0/1552637827 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f54004b90 con 0x7f5f680d2620 2023-07-09T02:16:52.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.524+0000 7f5f657fa640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.528+0000 7f5f657fa640 1 -- 172.21.15.45:0/1552637827 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f54082ea0 con 0x7f5f680d2620 2023-07-09T02:16:52.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.528+0000 7f5f6ccad640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.528+0000 7f5f6ccad640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009c50 tx=0x7f5f5c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.528+0000 7f5f657fa640 1 -- 172.21.15.45:0/1552637827 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f54050490 con 0x7f5f680d2620 2023-07-09T02:16:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.684+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f6806baa0 con 0x7f5f680d2620 2023-07-09T02:16:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.684+0000 7f5f657fa640 1 -- 172.21.15.45:0/1552637827 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v111) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f54018070 con 0x7f5f680d2620 2023-07-09T02:16:52.688 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:16:52.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 msgr2=0x7f5f4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009c50 tx=0x7f5f5c009190 comp rx=0 tx=0).stop 2023-07-09T02:16:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f680d2620 msgr2=0x7f5f6814cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f680d2620 0x7f5f6814cbb0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c4e0 tx=0x7f5f5400c9a0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 shutdown_connections 2023-07-09T02:16:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f6815c060 0x7f5f68156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f680d2620 0x7f5f6814cbb0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f4c066280 0x7f5f4c068730 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 --2- 172.21.15.45:0/1552637827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f680cd120 0x7f5f681f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 >> 172.21.15.45:0/1552637827 conn(0x7f5f680698e0 msgr2=0x7f5f68069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:52.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 shutdown_connections 2023-07-09T02:16:52.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.688+0000 7f5f6ef11640 1 -- 172.21.15.45:0/1552637827 wait complete. 2023-07-09T02:16:52.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:16:52.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.852+0000 7fe18bfe9640 1 Processor -- start 2023-07-09T02:16:52.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.852+0000 7fe18bfe9640 1 -- start start 2023-07-09T02:16:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.852+0000 7fe18bfe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe1840b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.852+0000 7fe18bfe9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1840d2620 0x7fe1840cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.852+0000 7fe18bfe9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe184160a50 con 0x7fe1840cd120 2023-07-09T02:16:52.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.852+0000 7fe18bfe9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18415c430 con 0x7fe1840d2620 2023-07-09T02:16:52.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.852+0000 7fe18bfe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18415fb60 con 0x7fe18415c060 2023-07-09T02:16:52.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe18a586640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1840d2620 0x7fe1840cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe18a586640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1840d2620 0x7fe1840cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59606/0 (socket says 172.21.15.45:59606) 2023-07-09T02:16:52.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe18a586640 1 -- 172.21.15.45:0/1685393423 learned_addr learned my addr 172.21.15.45:0/1685393423 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:52.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe189d85640 1 --2- 172.21.15.45:0/1685393423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe1840b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe18a586640 1 -- 172.21.15.45:0/1685393423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 msgr2=0x7fe1840b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:52.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe18a586640 1 --2- 172.21.15.45:0/1685393423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe1840b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe18a586640 1 -- 172.21.15.45:0/1685393423 >> v1:172.21.15.45:6789/0 conn(0x7fe1840cd120 legacy=0x7fe1840d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe188d83640 1 -- 172.21.15.45:0/1685393423 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808827047 0 0) 0x7fe184160a50 con 0x7fe1840cd120 2023-07-09T02:16:52.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe18a586640 1 -- 172.21.15.45:0/1685393423 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18415fe40 con 0x7fe1840d2620 2023-07-09T02:16:52.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe189d85640 1 --2- 172.21.15.45:0/1685393423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe1840b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:52.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe18a586640 1 --2- 172.21.15.45:0/1685393423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840d2620 0x7fe1840cee30 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009e80 tx=0x7fe17c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f968529a7a864ca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe188d83640 1 -- 172.21.15.45:0/1685393423 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0a5880 con 0x7fe1840d2620 2023-07-09T02:16:52.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe188d83640 1 -- 172.21.15.45:0/1685393423 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c0a59e0 con 0x7fe1840d2620 2023-07-09T02:16:52.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.856+0000 7fe188d83640 1 -- 172.21.15.45:0/1685393423 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0a5d70 con 0x7fe1840d2620 2023-07-09T02:16:52.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1685393423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840d2620 msgr2=0x7fe1840cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1685393423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840d2620 0x7fe1840cee30 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009e80 tx=0x7fe17c01c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1685393423 shutdown_connections 2023-07-09T02:16:52.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1685393423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840d2620 0x7fe1840cee30 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1685393423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe1840b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1685393423 >> 172.21.15.45:0/1685393423 conn(0x7fe1840698e0 msgr2=0x7fe184069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:52.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1685393423 shutdown_connections 2023-07-09T02:16:52.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1685393423 wait complete. 2023-07-09T02:16:52.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 Processor -- start 2023-07-09T02:16:52.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- start start 2023-07-09T02:16:52.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840cd120 0x7fe184153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1840d2620 0x7fe18414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe184155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe184153180 con 0x7fe1840cd120 2023-07-09T02:16:52.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe184154040 con 0x7fe1840d2620 2023-07-09T02:16:52.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18bfe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe184152600 con 0x7fe18415c060 2023-07-09T02:16:52.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189d85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840cd120 0x7fe184153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189d85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840cd120 0x7fe184153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59614/0 (socket says 172.21.15.45:59614) 2023-07-09T02:16:52.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189d85640 1 -- 172.21.15.45:0/1311805481 learned_addr learned my addr 172.21.15.45:0/1311805481 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:52.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189584640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1840d2620 0x7fe18414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18a586640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe184155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189d85640 1 -- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 msgr2=0x7fe184155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189d85640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe184155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189d85640 1 -- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1840d2620 msgr2=0x7fe18414e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:52.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189d85640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1840d2620 0x7fe18414e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:52.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189d85640 1 -- 172.21.15.45:0/1311805481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c009b30 con 0x7fe1840cd120 2023-07-09T02:16:52.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe189584640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1840d2620 0x7fe18414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:52.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.860+0000 7fe18a586640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe184155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:52.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe189d85640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840cd120 0x7fe184153760 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe18000d800 tx=0x7fe18000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe17a7fc640 1 -- 172.21.15.45:0/1311805481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800096c0 con 0x7fe1840cd120 2023-07-09T02:16:52.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe17a7fc640 1 -- 172.21.15.45:0/1311805481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe180009820 con 0x7fe1840cd120 2023-07-09T02:16:52.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe17a7fc640 1 -- 172.21.15.45:0/1311805481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180009bd0 con 0x7fe1840cd120 2023-07-09T02:16:52.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1840b59f0 con 0x7fe1840cd120 2023-07-09T02:16:52.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe184152bc0 con 0x7fe1840cd120 2023-07-09T02:16:52.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18404d7d0 con 0x7fe1840cd120 2023-07-09T02:16:52.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe17a7fc640 1 -- 172.21.15.45:0/1311805481 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe180009d30 con 0x7fe1840cd120 2023-07-09T02:16:52.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe17a7fc640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:52.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.864+0000 7fe17a7fc640 1 -- 172.21.15.45:0/1311805481 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe180084470 con 0x7fe1840cd120 2023-07-09T02:16:52.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.868+0000 7fe189584640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:52.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.868+0000 7fe189584640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe1840b1f40 tx=0x7fe174009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:52.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:52.868+0000 7fe17a7fc640 1 -- 172.21.15.45:0/1311805481 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1800518e0 con 0x7fe1840cd120 2023-07-09T02:16:53.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.020+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe18406baa0 con 0x7fe1840cd120 2023-07-09T02:16:53.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe17a7fc640 1 -- 172.21.15.45:0/1311805481 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe180054f00 con 0x7fe1840cd120 2023-07-09T02:16:53.025 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:16:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 msgr2=0x7fe168068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe1840b1f40 tx=0x7fe174009040 comp rx=0 tx=0).stop 2023-07-09T02:16:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840cd120 msgr2=0x7fe184153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840cd120 0x7fe184153760 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe18000d800 tx=0x7fe18000dcc0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 shutdown_connections 2023-07-09T02:16:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18415c060 0x7fe184155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1840d2620 0x7fe18414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 --2- 172.21.15.45:0/1311805481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1840cd120 0x7fe184153760 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 >> 172.21.15.45:0/1311805481 conn(0x7fe1840698e0 msgr2=0x7fe1840b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 shutdown_connections 2023-07-09T02:16:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.024+0000 7fe18bfe9640 1 -- 172.21.15.45:0/1311805481 wait complete. 2023-07-09T02:16:53.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:16:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf160bd640 1 Processor -- start 2023-07-09T02:16:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf160bd640 1 -- start start 2023-07-09T02:16:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf160bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100ca0f0 0x7faf100cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf160bd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf100cbbb0 0x7faf100c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf160bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1006bf30 con 0x7faf100c9250 2023-07-09T02:16:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf160bd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1006bc50 con 0x7faf100cbbb0 2023-07-09T02:16:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf160bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf100cab90 con 0x7faf100ca0f0 2023-07-09T02:16:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faf100c9250 0x7faf1015db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48828/0 (socket says 172.21.15.45:48828) 2023-07-09T02:16:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0ffff640 1 -- 172.21.15.45:0/1705349509 learned_addr learned my addr 172.21.15.45:0/1705349509 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0effd640 1 --2- 172.21.15.45:0/1705349509 >> v2:172.21.15.155:3300/0 conn(0x7faf100cbbb0 0x7faf100c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0f7fe640 1 --2- 172.21.15.45:0/1705349509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100ca0f0 0x7faf100cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0e7fc640 1 -- 172.21.15.45:0/1705349509 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361333151 0 0) 0x7faf1006bf30 con 0x7faf100c9250 2023-07-09T02:16:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0e7fc640 1 -- 172.21.15.45:0/1705349509 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef8003530 con 0x7faf100c9250 2023-07-09T02:16:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0f7fe640 1 -- 172.21.15.45:0/1705349509 >> v2:172.21.15.155:3300/0 conn(0x7faf100cbbb0 msgr2=0x7faf100c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0f7fe640 1 --2- 172.21.15.45:0/1705349509 >> v2:172.21.15.155:3300/0 conn(0x7faf100cbbb0 0x7faf100c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0f7fe640 1 -- 172.21.15.45:0/1705349509 >> v1:172.21.15.45:6789/0 conn(0x7faf100c9250 legacy=0x7faf1015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0f7fe640 1 -- 172.21.15.45:0/1705349509 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf100cae70 con 0x7faf100ca0f0 2023-07-09T02:16:53.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.192+0000 7faf0effd640 1 --2- 172.21.15.45:0/1705349509 >> v2:172.21.15.155:3300/0 conn(0x7faf100cbbb0 0x7faf100c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:53.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf0f7fe640 1 --2- 172.21.15.45:0/1705349509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100ca0f0 0x7faf100cb670 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf000097c0 tx=0x7faf0001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd31db41d3bbbf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf0e7fc640 1 -- 172.21.15.45:0/1705349509 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000ab600 con 0x7faf100ca0f0 2023-07-09T02:16:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf0e7fc640 1 -- 172.21.15.45:0/1705349509 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf000a7050 con 0x7faf100ca0f0 2023-07-09T02:16:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf0e7fc640 1 -- 172.21.15.45:0/1705349509 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf000ab980 con 0x7faf100ca0f0 2023-07-09T02:16:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf160bd640 1 -- 172.21.15.45:0/1705349509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100ca0f0 msgr2=0x7faf100cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf160bd640 1 --2- 172.21.15.45:0/1705349509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100ca0f0 0x7faf100cb670 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf000097c0 tx=0x7faf0001c3f0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf160bd640 1 -- 172.21.15.45:0/1705349509 shutdown_connections 2023-07-09T02:16:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf160bd640 1 --2- 172.21.15.45:0/1705349509 >> v2:172.21.15.155:3300/0 conn(0x7faf100cbbb0 0x7faf100c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf160bd640 1 --2- 172.21.15.45:0/1705349509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100ca0f0 0x7faf100cb670 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf160bd640 1 -- 172.21.15.45:0/1705349509 >> 172.21.15.45:0/1705349509 conn(0x7faf100694b0 msgr2=0x7faf100698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:53.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf160bd640 1 -- 172.21.15.45:0/1705349509 shutdown_connections 2023-07-09T02:16:53.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.196+0000 7faf160bd640 1 -- 172.21.15.45:0/1705349509 wait complete. 2023-07-09T02:16:53.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf160bd640 1 Processor -- start 2023-07-09T02:16:53.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf160bd640 1 -- start start 2023-07-09T02:16:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf160bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100c9250 0x7faf101fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf160bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf100ca0f0 0x7faf1014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf160bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf100cbbb0 0x7faf100c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf160bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10154830 con 0x7faf100cbbb0 2023-07-09T02:16:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf160bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf101fc7f0 con 0x7faf100ca0f0 2023-07-09T02:16:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf160bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf10152260 con 0x7faf100c9250 2023-07-09T02:16:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf100cbbb0 0x7faf100c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf100cbbb0 0x7faf100c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59616/0 (socket says 172.21.15.45:59616) 2023-07-09T02:16:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 -- 172.21.15.45:0/1914327429 learned_addr learned my addr 172.21.15.45:0/1914327429 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0f7fe640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100c9250 0x7faf101fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0effd640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf100ca0f0 0x7faf1014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 -- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100c9250 msgr2=0x7faf101fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100c9250 0x7faf101fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 -- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf100ca0f0 msgr2=0x7faf1014cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf100ca0f0 0x7faf1014cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 -- 172.21.15.45:0/1914327429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04009420 con 0x7faf100cbbb0 2023-07-09T02:16:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faf0ffff640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf100cbbb0 0x7faf100c4590 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7faf0800cb40 tx=0x7faf0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.200+0000 7faef7fff640 1 -- 172.21.15.45:0/1914327429 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800aca0 con 0x7faf100cbbb0 2023-07-09T02:16:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faef7fff640 1 -- 172.21.15.45:0/1914327429 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0800ae00 con 0x7faf100cbbb0 2023-07-09T02:16:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faef7fff640 1 -- 172.21.15.45:0/1914327429 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08012620 con 0x7faf100cbbb0 2023-07-09T02:16:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf00009420 con 0x7faf100cbbb0 2023-07-09T02:16:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf101fc480 con 0x7faf100cbbb0 2023-07-09T02:16:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf101fc980 con 0x7faf100cbbb0 2023-07-09T02:16:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faef7fff640 1 -- 172.21.15.45:0/1914327429 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf08007070 con 0x7faf100cbbb0 2023-07-09T02:16:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faef7fff640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faefc066280 0x7faefc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faef7fff640 1 -- 172.21.15.45:0/1914327429 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf08083d00 con 0x7faf100cbbb0 2023-07-09T02:16:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.204+0000 7faf0f7fe640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faefc066280 0x7faefc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.208+0000 7faf0f7fe640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faefc066280 0x7faefc068730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faf000ad000 tx=0x7faf000a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:53.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.208+0000 7faef7fff640 1 -- 172.21.15.45:0/1914327429 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf08051220 con 0x7faf100cbbb0 2023-07-09T02:16:53.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.360+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf1015e190 con 0x7faf100cbbb0 2023-07-09T02:16:53.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.360+0000 7faef7fff640 1 -- 172.21.15.45:0/1914327429 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf080170a0 con 0x7faf100cbbb0 2023-07-09T02:16:53.364 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:16:53.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faefc066280 msgr2=0x7faefc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faefc066280 0x7faefc068730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7faf000ad000 tx=0x7faf000a4f90 comp rx=0 tx=0).stop 2023-07-09T02:16:53.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf100cbbb0 msgr2=0x7faf100c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf100cbbb0 0x7faf100c4590 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7faf0800cb40 tx=0x7faf0800a060 comp rx=0 tx=0).stop 2023-07-09T02:16:53.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 shutdown_connections 2023-07-09T02:16:53.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf100cbbb0 0x7faf100c4590 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf100ca0f0 0x7faf1014cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faefc066280 0x7faefc068730 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 --2- 172.21.15.45:0/1914327429 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf100c9250 0x7faf101fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 >> 172.21.15.45:0/1914327429 conn(0x7faf100694b0 msgr2=0x7faf10151170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:53.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 shutdown_connections 2023-07-09T02:16:53.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.364+0000 7faf160bd640 1 -- 172.21.15.45:0/1914327429 wait complete. 2023-07-09T02:16:53.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd34a893640 1 Processor -- start 2023-07-09T02:16:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd34a893640 1 -- start start 2023-07-09T02:16:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd34a893640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3440d2620 0x7fd3440b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd34a893640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd3440cd120 0x7fd3440cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd34a893640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd344160a50 con 0x7fd34415c060 2023-07-09T02:16:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd34a893640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34415c430 con 0x7fd3440d2620 2023-07-09T02:16:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd34a893640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34415fb60 con 0x7fd3440cd120 2023-07-09T02:16:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd3437fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3440d2620 0x7fd3440b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd3437fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3440d2620 0x7fd3440b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59618/0 (socket says 172.21.15.45:59618) 2023-07-09T02:16:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd3437fe640 1 -- 172.21.15.45:0/4074315155 learned_addr learned my addr 172.21.15.45:0/4074315155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd348e30640 1 --2- 172.21.15.45:0/4074315155 >> v2:172.21.15.155:3300/0 conn(0x7fd3440cd120 0x7fd3440cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd3437fe640 1 -- 172.21.15.45:0/4074315155 >> v2:172.21.15.155:3300/0 conn(0x7fd3440cd120 msgr2=0x7fd3440cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd3437fe640 1 --2- 172.21.15.45:0/4074315155 >> v2:172.21.15.155:3300/0 conn(0x7fd3440cd120 0x7fd3440cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd3437fe640 1 -- 172.21.15.45:0/4074315155 >> v1:172.21.15.45:6789/0 conn(0x7fd34415c060 legacy=0x7fd3440d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd3437fe640 1 -- 172.21.15.45:0/4074315155 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34415fe40 con 0x7fd3440d2620 2023-07-09T02:16:53.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.528+0000 7fd342ffd640 1 -- 172.21.15.45:0/4074315155 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038290425 0 0) 0x7fd344160a50 con 0x7fd34415c060 2023-07-09T02:16:53.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd3437fe640 1 --2- 172.21.15.45:0/4074315155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd3440b4ed0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fd34406b120 tx=0x7fd33801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b77673b6a6b147 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:53.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd342ffd640 1 -- 172.21.15.45:0/4074315155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3380aa430 con 0x7fd3440d2620 2023-07-09T02:16:53.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd342ffd640 1 -- 172.21.15.45:0/4074315155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3380aa590 con 0x7fd3440d2620 2023-07-09T02:16:53.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd342ffd640 1 -- 172.21.15.45:0/4074315155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3380aa920 con 0x7fd3440d2620 2023-07-09T02:16:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd34a893640 1 -- 172.21.15.45:0/4074315155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 msgr2=0x7fd3440b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd34a893640 1 --2- 172.21.15.45:0/4074315155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd3440b4ed0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fd34406b120 tx=0x7fd33801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd34a893640 1 -- 172.21.15.45:0/4074315155 shutdown_connections 2023-07-09T02:16:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd34a893640 1 --2- 172.21.15.45:0/4074315155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd3440b4ed0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd34a893640 1 --2- 172.21.15.45:0/4074315155 >> v2:172.21.15.155:3300/0 conn(0x7fd3440cd120 0x7fd3440cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd34a893640 1 -- 172.21.15.45:0/4074315155 >> 172.21.15.45:0/4074315155 conn(0x7fd3440698e0 msgr2=0x7fd344069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:53.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd34a893640 1 -- 172.21.15.45:0/4074315155 shutdown_connections 2023-07-09T02:16:53.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.532+0000 7fd34a893640 1 -- 172.21.15.45:0/4074315155 wait complete. 2023-07-09T02:16:53.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 Processor -- start 2023-07-09T02:16:53.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 -- start start 2023-07-09T02:16:53.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3440cd120 0x7fd344154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd344156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd34415c060 0x7fd344156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3441550e0 con 0x7fd3440d2620 2023-07-09T02:16:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440cb1e0 con 0x7fd34415c060 2023-07-09T02:16:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3440cb4c0 con 0x7fd3440cd120 2023-07-09T02:16:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd344156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd344156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59620/0 (socket says 172.21.15.45:59620) 2023-07-09T02:16:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 -- 172.21.15.45:0/2327446885 learned_addr learned my addr 172.21.15.45:0/2327446885 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd348e30640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd34415c060 0x7fd344156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd343fff640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3440cd120 0x7fd344154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 -- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3440cd120 msgr2=0x7fd344154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3440cd120 0x7fd344154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 -- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd34415c060 msgr2=0x7fd344156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd34415c060 0x7fd344156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 -- 172.21.15.45:0/2327446885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380094d0 con 0x7fd3440d2620 2023-07-09T02:16:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd343fff640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3440cd120 0x7fd344154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd3437fe640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd344156640 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fd3380190e0 tx=0x7fd33801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd340ff9640 1 -- 172.21.15.45:0/2327446885 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3380aa430 con 0x7fd3440d2620 2023-07-09T02:16:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd340ff9640 1 -- 172.21.15.45:0/2327446885 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3380b3820 con 0x7fd3440d2620 2023-07-09T02:16:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd340ff9640 1 -- 172.21.15.45:0/2327446885 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3380b3bd0 con 0x7fd3440d2620 2023-07-09T02:16:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3440b59f0 con 0x7fd3440d2620 2023-07-09T02:16:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.536+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3440cba80 con 0x7fd3440d2620 2023-07-09T02:16:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.540+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34404d7d0 con 0x7fd3440d2620 2023-07-09T02:16:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.540+0000 7fd340ff9640 1 -- 172.21.15.45:0/2327446885 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3380b3d30 con 0x7fd3440d2620 2023-07-09T02:16:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.540+0000 7fd340ff9640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd330066280 0x7fd330068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.540+0000 7fd340ff9640 1 -- 172.21.15.45:0/2327446885 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd33811de60 con 0x7fd3440d2620 2023-07-09T02:16:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.540+0000 7fd343fff640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd330066280 0x7fd330068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.540+0000 7fd343fff640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd330066280 0x7fd330068730 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd334000f70 tx=0x7fd334009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.544+0000 7fd340ff9640 1 -- 172.21.15.45:0/2327446885 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3380eb2f0 con 0x7fd3440d2620 2023-07-09T02:16:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.716+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd34406baa0 con 0x7fd3440d2620 2023-07-09T02:16:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.716+0000 7fd340ff9640 1 -- 172.21.15.45:0/2327446885 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd3380c3070 con 0x7fd3440d2620 2023-07-09T02:16:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:16:53.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.716+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd330066280 msgr2=0x7fd330068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.716+0000 7fd34a893640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd330066280 0x7fd330068730 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd334000f70 tx=0x7fd334009040 comp rx=0 tx=0).stop 2023-07-09T02:16:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.716+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 msgr2=0x7fd344156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.716+0000 7fd34a893640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd344156640 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fd3380190e0 tx=0x7fd33801ad10 comp rx=0 tx=0).stop 2023-07-09T02:16:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.716+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 shutdown_connections 2023-07-09T02:16:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.716+0000 7fd34a893640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd34415c060 0x7fd344156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.720+0000 7fd34a893640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3440d2620 0x7fd344156640 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.720+0000 7fd34a893640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd330066280 0x7fd330068730 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.720+0000 7fd34a893640 1 --2- 172.21.15.45:0/2327446885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3440cd120 0x7fd344154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:53.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.720+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 >> 172.21.15.45:0/2327446885 conn(0x7fd3440698e0 msgr2=0x7fd3440b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:53.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.720+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 shutdown_connections 2023-07-09T02:16:53.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:53.720+0000 7fd34a893640 1 -- 172.21.15.45:0/2327446885 wait complete. 2023-07-09T02:16:53.739 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:16:53.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:53.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:16:53.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:16:53.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:53.841 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:16:53.851 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:16:53.851 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:53.861 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:16:53.861 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:53.916 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.056+0000 7f2cf4256640 1 Processor -- start 2023-07-09T02:16:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.056+0000 7f2cf4256640 1 -- start start 2023-07-09T02:16:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf4256640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2cec15c110 0x7f2cec1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf4256640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cec0ccc50 0x7f2cec0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf4256640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec0cb0d0 0x7f2cec0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf4256640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0cd4b0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf4256640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0cba70 con 0x7f2cec15c110 2023-07-09T02:16:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf4256640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0c98c0 con 0x7f2cec0cb0d0 2023-07-09T02:16:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf17f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cec0ccc50 0x7f2cec0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf17f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cec0ccc50 0x7f2cec0c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59622/0 (socket says 172.21.15.45:59622) 2023-07-09T02:16:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf17f1640 1 -- 172.21.15.45:0/357002446 learned_addr learned my addr 172.21.15.45:0/357002446 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf27f3640 1 --2- 172.21.15.45:0/357002446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec0cb0d0 0x7f2cec0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf1ff2640 1 --2- 172.21.15.45:0/357002446 >> v2:172.21.15.155:3300/0 conn(0x7f2cec15c110 0x7f2cec1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf17f1640 1 -- 172.21.15.45:0/357002446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec0cb0d0 msgr2=0x7f2cec0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:54.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf17f1640 1 --2- 172.21.15.45:0/357002446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec0cb0d0 0x7f2cec0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf17f1640 1 -- 172.21.15.45:0/357002446 >> v2:172.21.15.155:3300/0 conn(0x7f2cec15c110 msgr2=0x7f2cec1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:54.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf17f1640 1 --2- 172.21.15.45:0/357002446 >> v2:172.21.15.155:3300/0 conn(0x7f2cec15c110 0x7f2cec1607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.060+0000 7f2cf17f1640 1 -- 172.21.15.45:0/357002446 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec160d00 con 0x7f2cec0ccc50 2023-07-09T02:16:54.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf17f1640 1 --2- 172.21.15.45:0/357002446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0c9d50 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2cec06e9e0 tx=0x7f2cdc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06e9e397af564d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf0ff0640 1 -- 172.21.15.45:0/357002446 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0aa5f0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf0ff0640 1 -- 172.21.15.45:0/357002446 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0aa750 con 0x7f2cec0ccc50 2023-07-09T02:16:54.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf0ff0640 1 -- 172.21.15.45:0/357002446 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0aaae0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 -- 172.21.15.45:0/357002446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 msgr2=0x7f2cec0c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 --2- 172.21.15.45:0/357002446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0c9d50 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2cec06e9e0 tx=0x7f2cdc01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 -- 172.21.15.45:0/357002446 shutdown_connections 2023-07-09T02:16:54.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 --2- 172.21.15.45:0/357002446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec0cb0d0 0x7f2cec0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 --2- 172.21.15.45:0/357002446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0c9d50 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 --2- 172.21.15.45:0/357002446 >> v2:172.21.15.155:3300/0 conn(0x7f2cec15c110 0x7f2cec1607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 -- 172.21.15.45:0/357002446 >> 172.21.15.45:0/357002446 conn(0x7f2cec0694b0 msgr2=0x7f2cec0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:54.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 -- 172.21.15.45:0/357002446 shutdown_connections 2023-07-09T02:16:54.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 -- 172.21.15.45:0/357002446 wait complete. 2023-07-09T02:16:54.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 Processor -- start 2023-07-09T02:16:54.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 -- start start 2023-07-09T02:16:54.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cec0cb0d0 0x7f2cec0b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.064+0000 7f2cf4256640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf4256640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec15c110 0x7f2cec0c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf4256640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec070f50 con 0x7f2cec0ccc50 2023-07-09T02:16:54.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf4256640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0b3970 con 0x7f2cec0cb0d0 2023-07-09T02:16:54.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf4256640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0b2b30 con 0x7f2cec15c110 2023-07-09T02:16:54.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59630/0 (socket says 172.21.15.45:59630) 2023-07-09T02:16:54.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 -- 172.21.15.45:0/3700188012 learned_addr learned my addr 172.21.15.45:0/3700188012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:54.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf27f3640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec15c110 0x7f2cec0c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf1ff2640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cec0cb0d0 0x7f2cec0b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 -- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec15c110 msgr2=0x7f2cec0c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec15c110 0x7f2cec0c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 -- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cec0cb0d0 msgr2=0x7f2cec0b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cec0cb0d0 0x7f2cec0b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 -- 172.21.15.45:0/3700188012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc0094d0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf17f1640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0b0260 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc01ab80 tx=0x7f2cdc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2ce27fc640 1 -- 172.21.15.45:0/3700188012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0bd5f0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2ce27fc640 1 -- 172.21.15.45:0/3700188012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0bd750 con 0x7f2cec0ccc50 2023-07-09T02:16:54.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec0b2df0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2ce27fc640 1 -- 172.21.15.45:0/3700188012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0bdb00 con 0x7f2cec0ccc50 2023-07-09T02:16:54.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec0b33b0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec04d7d0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.068+0000 7f2ce27fc640 1 -- 172.21.15.45:0/3700188012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cdc0b33f0 con 0x7f2cec0ccc50 2023-07-09T02:16:54.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.072+0000 7f2ce27fc640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2cd0066280 0x7f2cd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.072+0000 7f2ce27fc640 1 -- 172.21.15.45:0/3700188012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cdc0a7070 con 0x7f2cec0ccc50 2023-07-09T02:16:54.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.072+0000 7f2cf1ff2640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2cd0066280 0x7f2cd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.072+0000 7f2cf1ff2640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2cd0066280 0x7f2cd0068730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009ac0 tx=0x7f2ce8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.076+0000 7f2ce27fc640 1 -- 172.21.15.45:0/3700188012 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2cdc0ec040 con 0x7f2cec0ccc50 2023-07-09T02:16:54.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.232+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cec0b0d30 con 0x7f2cec0ccc50 2023-07-09T02:16:54.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.232+0000 7f2ce27fc640 1 -- 172.21.15.45:0/3700188012 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18307 (secure 0 0 0) 0x7f2cdc0ef660 con 0x7f2cec0ccc50 2023-07-09T02:16:54.236 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:54.236 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":111,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:47.494929+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:16:15.254129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T02:16:16.522380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2cd0066280 msgr2=0x7f2cd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2cd0066280 0x7f2cd0068730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009ac0 tx=0x7f2ce8009190 comp rx=0 tx=0).stop 2023-07-09T02:16:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 msgr2=0x7f2cec0b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0b0260 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc01ab80 tx=0x7f2cdc01ad10 comp rx=0 tx=0).stop 2023-07-09T02:16:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 shutdown_connections 2023-07-09T02:16:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2cd0066280 0x7f2cd0068730 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cec15c110 0x7f2cec0c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cec0ccc50 0x7f2cec0b0260 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 --2- 172.21.15.45:0/3700188012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cec0cb0d0 0x7f2cec0b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 >> 172.21.15.45:0/3700188012 conn(0x7f2cec0694b0 msgr2=0x7f2cec166510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:54.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 shutdown_connections 2023-07-09T02:16:54.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.236+0000 7f2cf4256640 1 -- 172.21.15.45:0/3700188012 wait complete. 2023-07-09T02:16:54.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:16:15.254129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:16:16.522380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:16:54.258 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:16:54.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63f0f59640 1 Processor -- start 2023-07-09T02:16:54.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63f0f59640 1 -- start start 2023-07-09T02:16:54.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63f0f59640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f63ec158e30 0x7f63ec06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63f0f59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63ec06c820 0x7f63ec0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63f0f59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0ccf80 con 0x7f63ec06fd10 2023-07-09T02:16:54.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63f0f59640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0cd540 con 0x7f63ec06c820 2023-07-09T02:16:54.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63f0f59640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0c8fb0 con 0x7f63ec158e30 2023-07-09T02:16:54.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63ead9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63ec06c820 0x7f63ec0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63ead9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63ec06c820 0x7f63ec0caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59638/0 (socket says 172.21.15.45:59638) 2023-07-09T02:16:54.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63ead9d640 1 -- 172.21.15.45:0/1157219503 learned_addr learned my addr 172.21.15.45:0/1157219503 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:54.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63ea59c640 1 --2- 172.21.15.45:0/1157219503 >> v2:172.21.15.155:3300/0 conn(0x7f63ec158e30 0x7f63ec06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63ead9d640 1 -- 172.21.15.45:0/1157219503 >> v2:172.21.15.155:3300/0 conn(0x7f63ec158e30 msgr2=0x7f63ec06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:54.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63ead9d640 1 --2- 172.21.15.45:0/1157219503 >> v2:172.21.15.155:3300/0 conn(0x7f63ec158e30 0x7f63ec06f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63ead9d640 1 -- 172.21.15.45:0/1157219503 >> v1:172.21.15.155:6789/0 conn(0x7f63ec06fd10 legacy=0x7f63ec06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.404+0000 7f63ead9d640 1 -- 172.21.15.45:0/1157219503 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0cbad0 con 0x7f63ec06c820 2023-07-09T02:16:54.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63ead9d640 1 --2- 172.21.15.45:0/1157219503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06c820 0x7f63ec0caec0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0cc240 tx=0x7f63e401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e40366dba6b7d7c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63e959a640 1 -- 172.21.15.45:0/1157219503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40a57f0 con 0x7f63ec06c820 2023-07-09T02:16:54.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63e959a640 1 -- 172.21.15.45:0/1157219503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e40a5950 con 0x7f63ec06c820 2023-07-09T02:16:54.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63e959a640 1 -- 172.21.15.45:0/1157219503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40a5ce0 con 0x7f63ec06c820 2023-07-09T02:16:54.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63f0f59640 1 -- 172.21.15.45:0/1157219503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06c820 msgr2=0x7f63ec0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63f0f59640 1 --2- 172.21.15.45:0/1157219503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06c820 0x7f63ec0caec0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0cc240 tx=0x7f63e401c910 comp rx=0 tx=0).stop 2023-07-09T02:16:54.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63f0f59640 1 -- 172.21.15.45:0/1157219503 shutdown_connections 2023-07-09T02:16:54.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63f0f59640 1 --2- 172.21.15.45:0/1157219503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06c820 0x7f63ec0caec0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63f0f59640 1 --2- 172.21.15.45:0/1157219503 >> v2:172.21.15.155:3300/0 conn(0x7f63ec158e30 0x7f63ec06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63f0f59640 1 -- 172.21.15.45:0/1157219503 >> 172.21.15.45:0/1157219503 conn(0x7f63ec0694b0 msgr2=0x7f63ec0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:54.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63f0f59640 1 -- 172.21.15.45:0/1157219503 shutdown_connections 2023-07-09T02:16:54.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.408+0000 7f63f0f59640 1 -- 172.21.15.45:0/1157219503 wait complete. 2023-07-09T02:16:54.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 Processor -- start 2023-07-09T02:16:54.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 -- start start 2023-07-09T02:16:54.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63ec06c820 0x7f63ec164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06fd10 0x7f63ec14d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63ec158e30 0x7f63ec166690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec14dac0 con 0x7f63ec06fd10 2023-07-09T02:16:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec166200 con 0x7f63ec06c820 2023-07-09T02:16:54.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec1655f0 con 0x7f63ec158e30 2023-07-09T02:16:54.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06fd10 0x7f63ec14d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06fd10 0x7f63ec14d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59642/0 (socket says 172.21.15.45:59642) 2023-07-09T02:16:54.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 -- 172.21.15.45:0/4216418380 learned_addr learned my addr 172.21.15.45:0/4216418380 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:54.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63ea59c640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63ec06c820 0x7f63ec164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63ead9d640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63ec158e30 0x7f63ec166690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 -- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63ec158e30 msgr2=0x7f63ec166690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63ec158e30 0x7f63ec166690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 -- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63ec06c820 msgr2=0x7f63ec164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63ec06c820 0x7f63ec164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 -- 172.21.15.45:0/4216418380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009b30 con 0x7f63ec06fd10 2023-07-09T02:16:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63e9d9b640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06fd10 0x7f63ec14d580 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c500 tx=0x7f63e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63daffd640 1 -- 172.21.15.45:0/4216418380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0005220 con 0x7f63ec06fd10 2023-07-09T02:16:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63daffd640 1 -- 172.21.15.45:0/4216418380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0005380 con 0x7f63ec06fd10 2023-07-09T02:16:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec1658d0 con 0x7f63ec06fd10 2023-07-09T02:16:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63daffd640 1 -- 172.21.15.45:0/4216418380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0007270 con 0x7f63ec06fd10 2023-07-09T02:16:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.412+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec165e90 con 0x7f63ec06fd10 2023-07-09T02:16:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.416+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec04d7d0 con 0x7f63ec06fd10 2023-07-09T02:16:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.416+0000 7f63daffd640 1 -- 172.21.15.45:0/4216418380 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63e00073d0 con 0x7f63ec06fd10 2023-07-09T02:16:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.416+0000 7f63daffd640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63cc066280 0x7f63cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.416+0000 7f63daffd640 1 -- 172.21.15.45:0/4216418380 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63e0083660 con 0x7f63ec06fd10 2023-07-09T02:16:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.416+0000 7f63ea59c640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63cc066280 0x7f63cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.416+0000 7f63ea59c640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63cc066280 0x7f63cc068730 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009a50 tx=0x7f63dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.420+0000 7f63daffd640 1 -- 172.21.15.45:0/4216418380 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63e0050af0 con 0x7f63ec06fd10 2023-07-09T02:16:54.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.576+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63ec0ccb30 con 0x7f63ec06fd10 2023-07-09T02:16:54.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.576+0000 7f63daffd640 1 -- 172.21.15.45:0/4216418380 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63e0054110 con 0x7f63ec06fd10 2023-07-09T02:16:54.579 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:16:54.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63cc066280 msgr2=0x7f63cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63cc066280 0x7f63cc068730 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009a50 tx=0x7f63dc008040 comp rx=0 tx=0).stop 2023-07-09T02:16:54.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06fd10 msgr2=0x7f63ec14d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06fd10 0x7f63ec14d580 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c500 tx=0x7f63e000c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 shutdown_connections 2023-07-09T02:16:54.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63cc066280 0x7f63cc068730 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63ec158e30 0x7f63ec166690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63ec06fd10 0x7f63ec14d580 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 --2- 172.21.15.45:0/4216418380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63ec06c820 0x7f63ec164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 >> 172.21.15.45:0/4216418380 conn(0x7f63ec0694b0 msgr2=0x7f63ec0700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:54.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 shutdown_connections 2023-07-09T02:16:54.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.580+0000 7f63f0f59640 1 -- 172.21.15.45:0/4216418380 wait complete. 2023-07-09T02:16:54.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:16:54.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.744+0000 7fa122293640 1 Processor -- start 2023-07-09T02:16:54.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.744+0000 7fa122293640 1 -- start start 2023-07-09T02:16:54.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa122293640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa11c06b800 0x7fa11c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa122293640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c0ac870 0x7fa11c06c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa122293640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c06c110 con 0x7fa11c0694b0 2023-07-09T02:16:54.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa122293640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11c0acde0 con 0x7fa11c06b800 2023-07-09T02:16:54.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa122293640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c0ad0c0 con 0x7fa11c0ac870 2023-07-09T02:16:54.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa120830640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa11c0694b0 0x7fa11c0ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48842/0 (socket says 172.21.15.45:48842) 2023-07-09T02:16:54.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa120830640 1 -- 172.21.15.45:0/878073811 learned_addr learned my addr 172.21.15.45:0/878073811 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:54.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa11b7fe640 1 --2- 172.21.15.45:0/878073811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c0ac870 0x7fa11c06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa11bfff640 1 --2- 172.21.15.45:0/878073811 >> v2:172.21.15.155:3300/0 conn(0x7fa11c06b800 0x7fa11c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa11affd640 1 -- 172.21.15.45:0/878073811 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33615124 0 0) 0x7fa11c06c110 con 0x7fa11c0694b0 2023-07-09T02:16:54.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa11affd640 1 -- 172.21.15.45:0/878073811 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa104003530 con 0x7fa11c0694b0 2023-07-09T02:16:54.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa11b7fe640 1 -- 172.21.15.45:0/878073811 >> v2:172.21.15.155:3300/0 conn(0x7fa11c06b800 msgr2=0x7fa11c06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:54.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa11b7fe640 1 --2- 172.21.15.45:0/878073811 >> v2:172.21.15.155:3300/0 conn(0x7fa11c06b800 0x7fa11c06bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa11b7fe640 1 -- 172.21.15.45:0/878073811 >> v1:172.21.15.45:6789/0 conn(0x7fa11c0694b0 legacy=0x7fa11c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.748+0000 7fa11b7fe640 1 -- 172.21.15.45:0/878073811 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c0ad3a0 con 0x7fa11c0ac870 2023-07-09T02:16:54.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa11b7fe640 1 --2- 172.21.15.45:0/878073811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c0ac870 0x7fa11c06c620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa1100097c0 tx=0x7fa11001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa1c5287aa9215d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa11affd640 1 -- 172.21.15.45:0/878073811 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100ab650 con 0x7fa11c0ac870 2023-07-09T02:16:54.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa11affd640 1 -- 172.21.15.45:0/878073811 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1100ab7b0 con 0x7fa11c0ac870 2023-07-09T02:16:54.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa11affd640 1 -- 172.21.15.45:0/878073811 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100abb40 con 0x7fa11c0ac870 2023-07-09T02:16:54.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 -- 172.21.15.45:0/878073811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c0ac870 msgr2=0x7fa11c06c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 --2- 172.21.15.45:0/878073811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c0ac870 0x7fa11c06c620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa1100097c0 tx=0x7fa11001c450 comp rx=0 tx=0).stop 2023-07-09T02:16:54.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 -- 172.21.15.45:0/878073811 shutdown_connections 2023-07-09T02:16:54.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 --2- 172.21.15.45:0/878073811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c0ac870 0x7fa11c06c620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 --2- 172.21.15.45:0/878073811 >> v2:172.21.15.155:3300/0 conn(0x7fa11c06b800 0x7fa11c06bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 -- 172.21.15.45:0/878073811 >> 172.21.15.45:0/878073811 conn(0x7fa11c0cfb50 msgr2=0x7fa11c0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:54.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 -- 172.21.15.45:0/878073811 shutdown_connections 2023-07-09T02:16:54.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 -- 172.21.15.45:0/878073811 wait complete. 2023-07-09T02:16:54.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 Processor -- start 2023-07-09T02:16:54.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.752+0000 7fa122293640 1 -- start start 2023-07-09T02:16:54.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11c0694b0 0x7fa11c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06b800 0x7fa11c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa11c0ac870 0x7fa11c14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c14c460 con 0x7fa11c0ac870 2023-07-09T02:16:54.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c14b7e0 con 0x7fa11c0694b0 2023-07-09T02:16:54.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c14bac0 con 0x7fa11c06b800 2023-07-09T02:16:54.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa11c0ac870 0x7fa11c14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa11c0ac870 0x7fa11c14cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59652/0 (socket says 172.21.15.45:59652) 2023-07-09T02:16:54.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 -- 172.21.15.45:0/2197057630 learned_addr learned my addr 172.21.15.45:0/2197057630 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:54.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa11bfff640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11c0694b0 0x7fa11c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa11b7fe640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06b800 0x7fa11c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 -- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06b800 msgr2=0x7fa11c15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06b800 0x7fa11c15a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 -- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11c0694b0 msgr2=0x7fa11c14a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11c0694b0 0x7fa11c14a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 -- 172.21.15.45:0/2197057630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009420 con 0x7fa11c0ac870 2023-07-09T02:16:54.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa11b7fe640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06b800 0x7fa11c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:54.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa120830640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa11c0ac870 0x7fa11c14cfe0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa11400caa0 tx=0x7fa11400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa118ff9640 1 -- 172.21.15.45:0/2197057630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11400ac00 con 0x7fa11c0ac870 2023-07-09T02:16:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa118ff9640 1 -- 172.21.15.45:0/2197057630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11400ad60 con 0x7fa11c0ac870 2023-07-09T02:16:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa118ff9640 1 -- 172.21.15.45:0/2197057630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114012620 con 0x7fa11c0ac870 2023-07-09T02:16:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c14bda0 con 0x7fa11c0ac870 2023-07-09T02:16:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11c14a9b0 con 0x7fa11c0ac870 2023-07-09T02:16:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11c06ae60 con 0x7fa11c0ac870 2023-07-09T02:16:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.756+0000 7fa118ff9640 1 -- 172.21.15.45:0/2197057630 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa114007070 con 0x7fa11c0ac870 2023-07-09T02:16:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.760+0000 7fa118ff9640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa108066280 0x7fa108068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.760+0000 7fa118ff9640 1 -- 172.21.15.45:0/2197057630 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa114083d70 con 0x7fa11c0ac870 2023-07-09T02:16:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.760+0000 7fa11bfff640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa108066280 0x7fa108068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.760+0000 7fa11bfff640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa108066280 0x7fa108068730 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009a50 tx=0x7fa10c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.764+0000 7fa118ff9640 1 -- 172.21.15.45:0/2197057630 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa114051150 con 0x7fa11c0ac870 2023-07-09T02:16:54.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa11c14c780 con 0x7fa11c0ac870 2023-07-09T02:16:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa118ff9640 1 -- 172.21.15.45:0/2197057630 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v111) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa11c14c780 con 0x7fa11c0ac870 2023-07-09T02:16:54.918 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:16:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa108066280 msgr2=0x7fa108068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa108066280 0x7fa108068730 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009a50 tx=0x7fa10c008040 comp rx=0 tx=0).stop 2023-07-09T02:16:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa11c0ac870 msgr2=0x7fa11c14cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa11c0ac870 0x7fa11c14cfe0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa11400caa0 tx=0x7fa11400cf60 comp rx=0 tx=0).stop 2023-07-09T02:16:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 shutdown_connections 2023-07-09T02:16:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa11c0ac870 0x7fa11c14cfe0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa108066280 0x7fa108068730 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa11c06b800 0x7fa11c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 --2- 172.21.15.45:0/2197057630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa11c0694b0 0x7fa11c14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 >> 172.21.15.45:0/2197057630 conn(0x7fa11c0cfb50 msgr2=0x7fa11c070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 shutdown_connections 2023-07-09T02:16:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:54.916+0000 7fa122293640 1 -- 172.21.15.45:0/2197057630 wait complete. 2023-07-09T02:16:54.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:16:55.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca3de2640 1 Processor -- start 2023-07-09T02:16:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca3de2640 1 -- start start 2023-07-09T02:16:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca3de2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c9c0ca0f0 0x7f8c9c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca3de2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c9c0cbbb0 0x7f8c9c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca3de2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c06bf30 con 0x7f8c9c0c9250 2023-07-09T02:16:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca3de2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c06bc50 con 0x7f8c9c0cbbb0 2023-07-09T02:16:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca3de2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c0cab90 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca137d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c9c0cbbb0 0x7f8c9c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca237f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8c9c0c9250 0x7f8c9c15db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48856/0 (socket says 172.21.15.45:48856) 2023-07-09T02:16:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca237f640 1 -- 172.21.15.45:0/2727246895 learned_addr learned my addr 172.21.15.45:0/2727246895 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca137d640 1 --2- 172.21.15.45:0/2727246895 >> v2:172.21.15.45:3300/0 conn(0x7f8c9c0cbbb0 0x7f8c9c0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59656/0 (socket says 172.21.15.45:59656) 2023-07-09T02:16:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca1b7e640 1 --2- 172.21.15.45:0/2727246895 >> v2:172.21.15.155:3300/0 conn(0x7f8c9c0ca0f0 0x7f8c9c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca137d640 1 -- 172.21.15.45:0/2727246895 >> v2:172.21.15.155:3300/0 conn(0x7f8c9c0ca0f0 msgr2=0x7f8c9c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca137d640 1 --2- 172.21.15.45:0/2727246895 >> v2:172.21.15.155:3300/0 conn(0x7f8c9c0ca0f0 0x7f8c9c0cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca137d640 1 -- 172.21.15.45:0/2727246895 >> v1:172.21.15.45:6789/0 conn(0x7f8c9c0c9250 legacy=0x7f8c9c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca137d640 1 -- 172.21.15.45:0/2727246895 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0cae70 con 0x7f8c9c0cbbb0 2023-07-09T02:16:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.084+0000 7f8ca0b7c640 1 -- 172.21.15.45:0/2727246895 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638275067 0 0) 0x7f8c9c06bf30 con 0x7f8c9c0c9250 2023-07-09T02:16:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca137d640 1 --2- 172.21.15.45:0/2727246895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0cbbb0 0x7f8c9c0c8d10 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c06c0c0 tx=0x7f8c8c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6ca68cbca2a884 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca0b7c640 1 -- 172.21.15.45:0/2727246895 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0ab600 con 0x7f8c9c0cbbb0 2023-07-09T02:16:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca0b7c640 1 -- 172.21.15.45:0/2727246895 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0a7050 con 0x7f8c9c0cbbb0 2023-07-09T02:16:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca0b7c640 1 -- 172.21.15.45:0/2727246895 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0ab980 con 0x7f8c9c0cbbb0 2023-07-09T02:16:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca3de2640 1 -- 172.21.15.45:0/2727246895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0cbbb0 msgr2=0x7f8c9c0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/2727246895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0cbbb0 0x7f8c9c0c8d10 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c06c0c0 tx=0x7f8c8c01c3d0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca3de2640 1 -- 172.21.15.45:0/2727246895 shutdown_connections 2023-07-09T02:16:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/2727246895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0cbbb0 0x7f8c9c0c8d10 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/2727246895 >> v2:172.21.15.155:3300/0 conn(0x7f8c9c0ca0f0 0x7f8c9c0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca3de2640 1 -- 172.21.15.45:0/2727246895 >> 172.21.15.45:0/2727246895 conn(0x7f8c9c0694b0 msgr2=0x7f8c9c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca3de2640 1 -- 172.21.15.45:0/2727246895 shutdown_connections 2023-07-09T02:16:55.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.088+0000 7f8ca3de2640 1 -- 172.21.15.45:0/2727246895 wait complete. 2023-07-09T02:16:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 Processor -- start 2023-07-09T02:16:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 -- start start 2023-07-09T02:16:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c9c0c9250 0x7f8c9c14e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0ca0f0 0x7f8c9c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c9c0cbbb0 0x7f8c9c158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0ce1a0 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0cd590 con 0x7f8c9c0cbbb0 2023-07-09T02:16:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0cd870 con 0x7f8c9c0c9250 2023-07-09T02:16:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0ca0f0 0x7f8c9c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0ca0f0 0x7f8c9c15a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59658/0 (socket says 172.21.15.45:59658) 2023-07-09T02:16:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 -- 172.21.15.45:0/527906744 learned_addr learned my addr 172.21.15.45:0/527906744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca1b7e640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c9c0c9250 0x7f8c9c14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca237f640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c9c0cbbb0 0x7f8c9c158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 -- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c9c0c9250 msgr2=0x7f8c9c14e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c9c0c9250 0x7f8c9c14e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 -- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c9c0cbbb0 msgr2=0x7f8c9c158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c9c0cbbb0 0x7f8c9c158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 -- 172.21.15.45:0/527906744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009420 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca237f640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c9c0cbbb0 0x7f8c9c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:55.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca137d640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0ca0f0 0x7f8c9c15a550 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c01a000 tx=0x7f8c8c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8c927fc640 1 -- 172.21.15.45:0/527906744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c004230 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8c927fc640 1 -- 172.21.15.45:0/527906744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c004390 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8c927fc640 1 -- 172.21.15.45:0/527906744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c003840 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c0cdb50 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.092+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c14e750 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.096+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c04d7d0 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.096+0000 7f8c927fc640 1 -- 172.21.15.45:0/527906744 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c8c0b2040 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.096+0000 7f8c927fc640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c80066280 0x7f8c80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.096+0000 7f8c927fc640 1 -- 172.21.15.45:0/527906744 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c8c11de50 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.096+0000 7f8ca1b7e640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c80066280 0x7f8c80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.096+0000 7f8ca1b7e640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c80066280 0x7f8c80068730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c98007a60 tx=0x7f8c98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.100+0000 7f8c927fc640 1 -- 172.21.15.45:0/527906744 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c8c0eb370 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c9c06c540 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8c927fc640 1 -- 172.21.15.45:0/527906744 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c8c0c20a0 con 0x7f8c9c0ca0f0 2023-07-09T02:16:55.263 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:16:55.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c80066280 msgr2=0x7f8c80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c80066280 0x7f8c80068730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c98007a60 tx=0x7f8c98008040 comp rx=0 tx=0).stop 2023-07-09T02:16:55.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0ca0f0 msgr2=0x7f8c9c15a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0ca0f0 0x7f8c9c15a550 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c01a000 tx=0x7f8c8c019170 comp rx=0 tx=0).stop 2023-07-09T02:16:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 shutdown_connections 2023-07-09T02:16:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c9c0cbbb0 0x7f8c9c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c9c0ca0f0 0x7f8c9c15a550 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c80066280 0x7f8c80068730 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 --2- 172.21.15.45:0/527906744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c9c0c9250 0x7f8c9c14e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.260+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 >> 172.21.15.45:0/527906744 conn(0x7f8c9c0694b0 msgr2=0x7f8c9c069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:55.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.264+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 shutdown_connections 2023-07-09T02:16:55.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.264+0000 7f8ca3de2640 1 -- 172.21.15.45:0/527906744 wait complete. 2023-07-09T02:16:55.283 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:16:55.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa97ad0d640 1 Processor -- start 2023-07-09T02:16:55.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa97ad0d640 1 -- start start 2023-07-09T02:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa97ad0d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9740ccc50 0x7fa9740c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa97ad0d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740cb0d0 0x7fa9740cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa97ad0d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9740cba70 con 0x7fa97415c110 2023-07-09T02:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa97ad0d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9740cd4b0 con 0x7fa9740ccc50 2023-07-09T02:16:55.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa97ad0d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740c98c0 con 0x7fa9740cb0d0 2023-07-09T02:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa973fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9740ccc50 0x7fa9740c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa9792aa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740cb0d0 0x7fa9740cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa978aa9640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa97415c110 0x7fa9741607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:57318/0 (socket says 172.21.15.45:57318) 2023-07-09T02:16:55.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa978aa9640 1 -- 172.21.15.45:0/3309899332 learned_addr learned my addr 172.21.15.45:0/3309899332 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa9792aa640 1 -- 172.21.15.45:0/3309899332 >> v2:172.21.15.155:3300/0 conn(0x7fa9740ccc50 msgr2=0x7fa9740c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa9792aa640 1 --2- 172.21.15.45:0/3309899332 >> v2:172.21.15.155:3300/0 conn(0x7fa9740ccc50 0x7fa9740c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa9792aa640 1 -- 172.21.15.45:0/3309899332 >> v1:172.21.15.155:6789/0 conn(0x7fa97415c110 legacy=0x7fa9741607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa9792aa640 1 -- 172.21.15.45:0/3309899332 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9740cd1d0 con 0x7fa9740cb0d0 2023-07-09T02:16:55.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.428+0000 7fa9737fe640 1 -- 172.21.15.45:0/3309899332 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126450591 0 0) 0x7fa9740cba70 con 0x7fa97415c110 2023-07-09T02:16:55.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa9792aa640 1 --2- 172.21.15.45:0/3309899332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740cb0d0 0x7fa9740cb530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009d90 tx=0x7fa96c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d3287b08c470cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa9737fe640 1 -- 172.21.15.45:0/3309899332 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0a59e0 con 0x7fa9740cb0d0 2023-07-09T02:16:55.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa9737fe640 1 -- 172.21.15.45:0/3309899332 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0a5b40 con 0x7fa9740cb0d0 2023-07-09T02:16:55.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa9737fe640 1 -- 172.21.15.45:0/3309899332 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0ad440 con 0x7fa9740cb0d0 2023-07-09T02:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa97ad0d640 1 -- 172.21.15.45:0/3309899332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740cb0d0 msgr2=0x7fa9740cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/3309899332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740cb0d0 0x7fa9740cb530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009d90 tx=0x7fa96c01c920 comp rx=0 tx=0).stop 2023-07-09T02:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa97ad0d640 1 -- 172.21.15.45:0/3309899332 shutdown_connections 2023-07-09T02:16:55.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/3309899332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9740cb0d0 0x7fa9740cb530 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/3309899332 >> v2:172.21.15.155:3300/0 conn(0x7fa9740ccc50 0x7fa9740c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa97ad0d640 1 -- 172.21.15.45:0/3309899332 >> 172.21.15.45:0/3309899332 conn(0x7fa9740694b0 msgr2=0x7fa9740698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa97ad0d640 1 -- 172.21.15.45:0/3309899332 shutdown_connections 2023-07-09T02:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.432+0000 7fa97ad0d640 1 -- 172.21.15.45:0/3309899332 wait complete. 2023-07-09T02:16:55.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa97ad0d640 1 Processor -- start 2023-07-09T02:16:55.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa97ad0d640 1 -- start start 2023-07-09T02:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa97ad0d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9740cb0d0 0x7fa9741571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa97ad0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740ccc50 0x7fa974158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa97ad0d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa97415c110 0x7fa9741593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa97ad0d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa974157710 con 0x7fa9740ccc50 2023-07-09T02:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa97ad0d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740b0230 con 0x7fa9740cb0d0 2023-07-09T02:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa97ad0d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9740c5790 con 0x7fa97415c110 2023-07-09T02:16:55.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740ccc50 0x7fa974158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740ccc50 0x7fa974158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59668/0 (socket says 172.21.15.45:59668) 2023-07-09T02:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 -- 172.21.15.45:0/4127827120 learned_addr learned my addr 172.21.15.45:0/4127827120 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa978aa9640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9740cb0d0 0x7fa9741571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa9792aa640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa97415c110 0x7fa9741593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 -- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa97415c110 msgr2=0x7fa9741593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa97415c110 0x7fa9741593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 -- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9740cb0d0 msgr2=0x7fa9741571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9740cb0d0 0x7fa9741571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 -- 172.21.15.45:0/4127827120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c009a70 con 0x7fa9740ccc50 2023-07-09T02:16:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa973fff640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740ccc50 0x7fa974158e80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e930 tx=0x7fa96000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.436+0000 7fa9717fa640 1 -- 172.21.15.45:0/4127827120 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960009690 con 0x7fa9740ccc50 2023-07-09T02:16:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa9717fa640 1 -- 172.21.15.45:0/4127827120 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000ca00 con 0x7fa9740ccc50 2023-07-09T02:16:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa9717fa640 1 -- 172.21.15.45:0/4127827120 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000cd70 con 0x7fa9740ccc50 2023-07-09T02:16:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9740c5a70 con 0x7fa9740ccc50 2023-07-09T02:16:55.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9740c6030 con 0x7fa9740ccc50 2023-07-09T02:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97404d7d0 con 0x7fa9740ccc50 2023-07-09T02:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa9717fa640 1 -- 172.21.15.45:0/4127827120 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa960013470 con 0x7fa9740ccc50 2023-07-09T02:16:55.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa9717fa640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9580662b0 0x7fa958068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa9717fa640 1 -- 172.21.15.45:0/4127827120 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa960083f00 con 0x7fa9740ccc50 2023-07-09T02:16:55.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.440+0000 7fa978aa9640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9580662b0 0x7fa958068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.444+0000 7fa978aa9640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9580662b0 0x7fa958068760 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa968000f70 tx=0x7fa968007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.444+0000 7fa9717fa640 1 -- 172.21.15.45:0/4127827120 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa960051450 con 0x7fa9740ccc50 2023-07-09T02:16:55.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.600+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9740ca750 con 0x7fa9740ccc50 2023-07-09T02:16:55.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.600+0000 7fa9717fa640 1 -- 172.21.15.45:0/4127827120 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9600170a0 con 0x7fa9740ccc50 2023-07-09T02:16:55.602 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:16:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.600+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9580662b0 msgr2=0x7fa958068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.600+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9580662b0 0x7fa958068760 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa968000f70 tx=0x7fa968007df0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.600+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740ccc50 msgr2=0x7fa974158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.600+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740ccc50 0x7fa974158e80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e930 tx=0x7fa96000edf0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.604+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 shutdown_connections 2023-07-09T02:16:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.604+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9580662b0 0x7fa958068760 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.604+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa97415c110 0x7fa9741593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.604+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9740ccc50 0x7fa974158e80 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.604+0000 7fa97ad0d640 1 --2- 172.21.15.45:0/4127827120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9740cb0d0 0x7fa9741571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.604+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 >> 172.21.15.45:0/4127827120 conn(0x7fa9740694b0 msgr2=0x7fa9740702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:55.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.604+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 shutdown_connections 2023-07-09T02:16:55.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.604+0000 7fa97ad0d640 1 -- 172.21.15.45:0/4127827120 wait complete. 2023-07-09T02:16:55.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:16:55.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827d179640 1 Processor -- start 2023-07-09T02:16:55.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827d179640 1 -- start start 2023-07-09T02:16:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827d179640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 0x7f82780b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827d179640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82780b1b50 0x7f827806b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827d179640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f827806b780 0x7f82780d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827d179640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827806bbe0 con 0x7f82780b1b50 2023-07-09T02:16:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827d179640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780b2090 con 0x7f827806b780 2023-07-09T02:16:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827d179640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8278160520 con 0x7f827815c870 2023-07-09T02:16:55.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f826ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82780b1b50 0x7f827806b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f826ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82780b1b50 0x7f827806b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59684/0 (socket says 172.21.15.45:59684) 2023-07-09T02:16:55.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f826ffff640 1 -- 172.21.15.45:0/2681001803 learned_addr learned my addr 172.21.15.45:0/2681001803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:55.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f8277fff640 1 --2- 172.21.15.45:0/2681001803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 0x7f82780b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f827c978640 1 --2- 172.21.15.45:0/2681001803 >> v2:172.21.15.155:3300/0 conn(0x7f827806b780 0x7f82780d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f826ffff640 1 -- 172.21.15.45:0/2681001803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 msgr2=0x7f82780b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:55.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f826ffff640 1 --2- 172.21.15.45:0/2681001803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 0x7f82780b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f826ffff640 1 -- 172.21.15.45:0/2681001803 >> v2:172.21.15.155:3300/0 conn(0x7f827806b780 msgr2=0x7f82780d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:55.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f826ffff640 1 --2- 172.21.15.45:0/2681001803 >> v2:172.21.15.155:3300/0 conn(0x7f827806b780 0x7f82780d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.768+0000 7f826ffff640 1 -- 172.21.15.45:0/2681001803 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278160800 con 0x7f82780b1b50 2023-07-09T02:16:55.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f826ffff640 1 --2- 172.21.15.45:0/2681001803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82780b1b50 0x7f827806b240 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f82780717b0 tx=0x7f826001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4807a25ebb0c2b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f82777fe640 1 -- 172.21.15.45:0/2681001803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82600ab600 con 0x7f82780b1b50 2023-07-09T02:16:55.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f82777fe640 1 -- 172.21.15.45:0/2681001803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82600a7050 con 0x7f82780b1b50 2023-07-09T02:16:55.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f82777fe640 1 -- 172.21.15.45:0/2681001803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82600ab980 con 0x7f82780b1b50 2023-07-09T02:16:55.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 -- 172.21.15.45:0/2681001803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82780b1b50 msgr2=0x7f827806b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 --2- 172.21.15.45:0/2681001803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82780b1b50 0x7f827806b240 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f82780717b0 tx=0x7f826001c210 comp rx=0 tx=0).stop 2023-07-09T02:16:55.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 -- 172.21.15.45:0/2681001803 shutdown_connections 2023-07-09T02:16:55.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 --2- 172.21.15.45:0/2681001803 >> v2:172.21.15.155:3300/0 conn(0x7f827806b780 0x7f82780d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 --2- 172.21.15.45:0/2681001803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82780b1b50 0x7f827806b240 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 --2- 172.21.15.45:0/2681001803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 0x7f82780b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 -- 172.21.15.45:0/2681001803 >> 172.21.15.45:0/2681001803 conn(0x7f8278070be0 msgr2=0x7f8278070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:55.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 -- 172.21.15.45:0/2681001803 shutdown_connections 2023-07-09T02:16:55.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.772+0000 7f827d179640 1 -- 172.21.15.45:0/2681001803 wait complete. 2023-07-09T02:16:55.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 Processor -- start 2023-07-09T02:16:55.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 -- start start 2023-07-09T02:16:55.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f827806b780 0x7f82780d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82780b1b50 0x7f827814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 0x7f827814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780cb170 con 0x7f827806b780 2023-07-09T02:16:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780cb450 con 0x7f82780b1b50 2023-07-09T02:16:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780cb730 con 0x7f827815c870 2023-07-09T02:16:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f827806b780 0x7f82780d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f827806b780 0x7f82780d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59698/0 (socket says 172.21.15.45:59698) 2023-07-09T02:16:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 -- 172.21.15.45:0/1776398838 learned_addr learned my addr 172.21.15.45:0/1776398838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f826ffff640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82780b1b50 0x7f827814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827c978640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 0x7f827814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 -- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 msgr2=0x7f827814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 0x7f827814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 -- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82780b1b50 msgr2=0x7f827814a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82780b1b50 0x7f827814a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 -- 172.21.15.45:0/1776398838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600094d0 con 0x7f827806b780 2023-07-09T02:16:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f8277fff640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f827806b780 0x7f82780d0fd0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f826800d5f0 tx=0x7f826800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f82757fa640 1 -- 172.21.15.45:0/1776398838 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680125f0 con 0x7f827806b780 2023-07-09T02:16:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f82757fa640 1 -- 172.21.15.45:0/1776398838 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268012750 con 0x7f827806b780 2023-07-09T02:16:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780cba10 con 0x7f827806b780 2023-07-09T02:16:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f82757fa640 1 -- 172.21.15.45:0/1776398838 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268012ae0 con 0x7f827806b780 2023-07-09T02:16:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.776+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82780cc210 con 0x7f827806b780 2023-07-09T02:16:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.780+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827804e020 con 0x7f827806b780 2023-07-09T02:16:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.780+0000 7f82757fa640 1 -- 172.21.15.45:0/1776398838 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8268012c40 con 0x7f827806b780 2023-07-09T02:16:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.780+0000 7f82757fa640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8258066280 0x7f8258068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.780+0000 7f82757fa640 1 -- 172.21.15.45:0/1776398838 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8268084160 con 0x7f827806b780 2023-07-09T02:16:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.780+0000 7f826ffff640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8258066280 0x7f8258068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.780+0000 7f826ffff640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8258066280 0x7f8258068730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f82600ad000 tx=0x7f8260008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.784+0000 7f82757fa640 1 -- 172.21.15.45:0/1776398838 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82680515f0 con 0x7f827806b780 2023-07-09T02:16:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.952+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82780d0a70 con 0x7f827806b780 2023-07-09T02:16:55.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.952+0000 7f82757fa640 1 -- 172.21.15.45:0/1776398838 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8268007380 con 0x7f827806b780 2023-07-09T02:16:55.955 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:16:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8258066280 msgr2=0x7f8258068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8258066280 0x7f8258068730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f82600ad000 tx=0x7f8260008040 comp rx=0 tx=0).stop 2023-07-09T02:16:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f827806b780 msgr2=0x7f82780d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f827806b780 0x7f82780d0fd0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f826800d5f0 tx=0x7f826800dab0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 shutdown_connections 2023-07-09T02:16:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8258066280 0x7f8258068730 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f827815c870 0x7f827814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82780b1b50 0x7f827814a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 --2- 172.21.15.45:0/1776398838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f827806b780 0x7f82780d0fd0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:55.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 >> 172.21.15.45:0/1776398838 conn(0x7f8278070be0 msgr2=0x7f82780cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:55.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 shutdown_connections 2023-07-09T02:16:55.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:55.956+0000 7f827d179640 1 -- 172.21.15.45:0/1776398838 wait complete. 2023-07-09T02:16:55.975 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:16:55.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:55.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:16:56.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:16:56.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:16:56.033 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:16:56.043 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:16:56.043 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:56.052 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:16:56.052 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:16:56.053 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:16:56.096 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:16:56.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:56.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.236+0000 7fe5c2b37640 1 Processor -- start 2023-07-09T02:16:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.236+0000 7fe5c2b37640 1 -- start start 2023-07-09T02:16:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c2b37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc15c060 0x7fe5bc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c2b37640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe5bc0cd120 0x7fe5bc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c2b37640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc160a50 con 0x7fe5bc0d2450 2023-07-09T02:16:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c2b37640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5bc0d28f0 con 0x7fe5bc0cd120 2023-07-09T02:16:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c2b37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0cfe40 con 0x7fe5bc15c060 2023-07-09T02:16:56.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c08d3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc15c060 0x7fe5bc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5bbfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe5bc0cd120 0x7fe5bc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c10d4640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe5bc0d2450 0x7fe5bc0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:57332/0 (socket says 172.21.15.45:57332) 2023-07-09T02:16:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c10d4640 1 -- 172.21.15.45:0/2913586303 learned_addr learned my addr 172.21.15.45:0/2913586303 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c08d3640 1 -- 172.21.15.45:0/2913586303 >> v2:172.21.15.155:3300/0 conn(0x7fe5bc0cd120 msgr2=0x7fe5bc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c08d3640 1 --2- 172.21.15.45:0/2913586303 >> v2:172.21.15.155:3300/0 conn(0x7fe5bc0cd120 0x7fe5bc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c08d3640 1 -- 172.21.15.45:0/2913586303 >> v1:172.21.15.155:6789/0 conn(0x7fe5bc0d2450 legacy=0x7fe5bc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5c08d3640 1 -- 172.21.15.45:0/2913586303 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc15c430 con 0x7fe5bc15c060 2023-07-09T02:16:56.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5bb7fe640 1 -- 172.21.15.45:0/2913586303 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262359227 0 0) 0x7fe5bc160a50 con 0x7fe5bc0d2450 2023-07-09T02:16:56.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.240+0000 7fe5bbfff640 1 --2- 172.21.15.45:0/2913586303 >> v2:172.21.15.155:3300/0 conn(0x7fe5bc0cd120 0x7fe5bc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:56.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c08d3640 1 --2- 172.21.15.45:0/2913586303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc15c060 0x7fe5bc0b4ed0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00097c0 tx=0x7fe5b001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b05c081a12c36e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5bb7fe640 1 -- 172.21.15.45:0/2913586303 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00ab600 con 0x7fe5bc15c060 2023-07-09T02:16:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5bb7fe640 1 -- 172.21.15.45:0/2913586303 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b00a7050 con 0x7fe5bc15c060 2023-07-09T02:16:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5bb7fe640 1 -- 172.21.15.45:0/2913586303 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00ab980 con 0x7fe5bc15c060 2023-07-09T02:16:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 -- 172.21.15.45:0/2913586303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc15c060 msgr2=0x7fe5bc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/2913586303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc15c060 0x7fe5bc0b4ed0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00097c0 tx=0x7fe5b001c450 comp rx=0 tx=0).stop 2023-07-09T02:16:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 -- 172.21.15.45:0/2913586303 shutdown_connections 2023-07-09T02:16:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/2913586303 >> v2:172.21.15.155:3300/0 conn(0x7fe5bc0cd120 0x7fe5bc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/2913586303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc15c060 0x7fe5bc0b4ed0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 -- 172.21.15.45:0/2913586303 >> 172.21.15.45:0/2913586303 conn(0x7fe5bc0698e0 msgr2=0x7fe5bc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 -- 172.21.15.45:0/2913586303 shutdown_connections 2023-07-09T02:16:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 -- 172.21.15.45:0/2913586303 wait complete. 2023-07-09T02:16:56.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 Processor -- start 2023-07-09T02:16:56.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.244+0000 7fe5c2b37640 1 -- start start 2023-07-09T02:16:56.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc0cd120 0x7fe5bc153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5bc0d2450 0x7fe5bc15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5bc15c060 0x7fe5bc154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc154480 con 0x7fe5bc15c060 2023-07-09T02:16:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc15d5b0 con 0x7fe5bc0d2450 2023-07-09T02:16:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc15d7e0 con 0x7fe5bc0cd120 2023-07-09T02:16:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5bc15c060 0x7fe5bc154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5bc15c060 0x7fe5bc154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59714/0 (socket says 172.21.15.45:59714) 2023-07-09T02:16:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 -- 172.21.15.45:0/1525014183 learned_addr learned my addr 172.21.15.45:0/1525014183 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5bbfff640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5bc0d2450 0x7fe5bc15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c08d3640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc0cd120 0x7fe5bc153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 -- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc0cd120 msgr2=0x7fe5bc153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc0cd120 0x7fe5bc153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 -- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5bc0d2450 msgr2=0x7fe5bc15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5bc0d2450 0x7fe5bc15d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 -- 172.21.15.45:0/1525014183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8009420 con 0x7fe5bc15c060 2023-07-09T02:16:56.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c10d4640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5bc15c060 0x7fe5bc154c20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4001570 tx=0x7fe5b400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5b97fa640 1 -- 172.21.15.45:0/1525014183 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400a640 con 0x7fe5bc15c060 2023-07-09T02:16:56.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5b97fa640 1 -- 172.21.15.45:0/1525014183 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400a7c0 con 0x7fe5bc15c060 2023-07-09T02:16:56.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5b97fa640 1 -- 172.21.15.45:0/1525014183 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400ab70 con 0x7fe5bc15c060 2023-07-09T02:16:56.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b0009420 con 0x7fe5bc15c060 2023-07-09T02:16:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc15dda0 con 0x7fe5bc15c060 2023-07-09T02:16:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc04d7d0 con 0x7fe5bc15c060 2023-07-09T02:16:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.248+0000 7fe5b97fa640 1 -- 172.21.15.45:0/1525014183 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5b400acd0 con 0x7fe5bc15c060 2023-07-09T02:16:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.252+0000 7fe5b97fa640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5a0066280 0x7fe5a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.252+0000 7fe5b97fa640 1 -- 172.21.15.45:0/1525014183 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe5b40832e0 con 0x7fe5bc15c060 2023-07-09T02:16:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.252+0000 7fe5c08d3640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5a0066280 0x7fe5a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.252+0000 7fe5c08d3640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5a0066280 0x7fe5a0068730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00ad000 tx=0x7fe5b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.256+0000 7fe5b97fa640 1 -- 172.21.15.45:0/1525014183 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5b4050770 con 0x7fe5bc15c060 2023-07-09T02:16:56.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.444+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5bc06baa0 con 0x7fe5bc15c060 2023-07-09T02:16:56.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.444+0000 7fe5b97fa640 1 -- 172.21.15.45:0/1525014183 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fe5b4053d90 con 0x7fe5bc15c060 2023-07-09T02:16:56.448 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:56.448 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:56.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5a0066280 msgr2=0x7fe5a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5a0066280 0x7fe5a0068730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00ad000 tx=0x7fe5b00a6000 comp rx=0 tx=0).stop 2023-07-09T02:16:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5bc15c060 msgr2=0x7fe5bc154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5bc15c060 0x7fe5bc154c20 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4001570 tx=0x7fe5b400cca0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 shutdown_connections 2023-07-09T02:16:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5bc15c060 0x7fe5bc154c20 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5bc0d2450 0x7fe5bc15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5a0066280 0x7fe5a0068730 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 --2- 172.21.15.45:0/1525014183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5bc0cd120 0x7fe5bc153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 >> 172.21.15.45:0/1525014183 conn(0x7fe5bc0698e0 msgr2=0x7fe5bc0b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 shutdown_connections 2023-07-09T02:16:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.448+0000 7fe5c2b37640 1 -- 172.21.15.45:0/1525014183 wait complete. 2023-07-09T02:16:56.469 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:56.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f68a1582640 1 Processor -- start 2023-07-09T02:16:56.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f68a1582640 1 -- start start 2023-07-09T02:16:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f68a1582640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c15c060 0x7f689c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f68a1582640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f689c0cd120 0x7f689c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f68a1582640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c160a50 con 0x7f689c0d2450 2023-07-09T02:16:56.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f68a1582640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c0d28f0 con 0x7f689c0cd120 2023-07-09T02:16:56.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f68a1582640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0cfe40 con 0x7f689c15c060 2023-07-09T02:16:56.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f689affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c15c060 0x7f689c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f6893fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f689c0cd120 0x7f689c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f6893fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f689c0cd120 0x7f689c0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:49530/0 (socket says 172.21.15.45:49530) 2023-07-09T02:16:56.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f6893fff640 1 -- 172.21.15.45:0/2806908207 learned_addr learned my addr 172.21.15.45:0/2806908207 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.612+0000 7f689affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c15c060 0x7f689c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:50826/0 (socket says 172.21.15.45:50826) 2023-07-09T02:16:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f6893fff640 1 -- 172.21.15.45:0/2806908207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c15c060 msgr2=0x7f689c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f6893fff640 1 --2- 172.21.15.45:0/2806908207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c15c060 0x7f689c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f6893fff640 1 -- 172.21.15.45:0/2806908207 >> v1:172.21.15.155:6789/0 conn(0x7f689c0d2450 legacy=0x7f689c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f6893fff640 1 -- 172.21.15.45:0/2806908207 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c15c430 con 0x7f689c0cd120 2023-07-09T02:16:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f689affd640 1 --2- 172.21.15.45:0/2806908207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c15c060 0x7f689c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:16:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f6893fff640 1 --2- 172.21.15.45:0/2806908207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c0cd120 0x7f689c0d1f10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6884009870 tx=0x7f688401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b91d81799bcba657 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f689a7fc640 1 -- 172.21.15.45:0/2806908207 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840a7070 con 0x7f689c0cd120 2023-07-09T02:16:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f689a7fc640 1 -- 172.21.15.45:0/2806908207 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68840ab430 con 0x7f689c0cd120 2023-07-09T02:16:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.616+0000 7f689a7fc640 1 -- 172.21.15.45:0/2806908207 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840ab7c0 con 0x7f689c0cd120 2023-07-09T02:16:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- 172.21.15.45:0/2806908207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c0cd120 msgr2=0x7f689c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 --2- 172.21.15.45:0/2806908207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c0cd120 0x7f689c0d1f10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6884009870 tx=0x7f688401c510 comp rx=0 tx=0).stop 2023-07-09T02:16:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- 172.21.15.45:0/2806908207 shutdown_connections 2023-07-09T02:16:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 --2- 172.21.15.45:0/2806908207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c0cd120 0x7f689c0d1f10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 --2- 172.21.15.45:0/2806908207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c15c060 0x7f689c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- 172.21.15.45:0/2806908207 >> 172.21.15.45:0/2806908207 conn(0x7f689c0698e0 msgr2=0x7f689c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- 172.21.15.45:0/2806908207 shutdown_connections 2023-07-09T02:16:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- 172.21.15.45:0/2806908207 wait complete. 2023-07-09T02:16:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 Processor -- start 2023-07-09T02:16:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- start start 2023-07-09T02:16:56.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c0cd120 0x7f689c154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f689c0d2450 0x7f689c0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c15c060 0x7f689c156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c1554c0 con 0x7f689c0d2450 2023-07-09T02:16:56.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0c9ff0 con 0x7f689c15c060 2023-07-09T02:16:56.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f68a1582640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0ca2d0 con 0x7f689c0cd120 2023-07-09T02:16:56.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f6893fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f689c0d2450 0x7f689c0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f6893fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f689c0d2450 0x7f689c0b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59730/0 (socket says 172.21.15.45:59730) 2023-07-09T02:16:56.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f6893fff640 1 -- 172.21.15.45:0/3839782774 learned_addr learned my addr 172.21.15.45:0/3839782774 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:56.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f689affd640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c0cd120 0x7f689c154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f689b7fe640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c15c060 0x7f689c156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f6893fff640 1 -- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c0cd120 msgr2=0x7f689c154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f6893fff640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c0cd120 0x7f689c154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f6893fff640 1 -- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c15c060 msgr2=0x7f689c156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f6893fff640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c15c060 0x7f689c156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.620+0000 7f6893fff640 1 -- 172.21.15.45:0/3839782774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c009420 con 0x7f689c0d2450 2023-07-09T02:16:56.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f6893fff640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f689c0d2450 0x7f689c0b3ec0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f68840ad040 tx=0x7f68840192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68937fe640 1 -- 172.21.15.45:0/3839782774 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840bc070 con 0x7f689c0d2450 2023-07-09T02:16:56.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68937fe640 1 -- 172.21.15.45:0/3839782774 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68840b4420 con 0x7f689c0d2450 2023-07-09T02:16:56.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68937fe640 1 -- 172.21.15.45:0/3839782774 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840b47f0 con 0x7f689c0d2450 2023-07-09T02:16:56.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68840094d0 con 0x7f689c0d2450 2023-07-09T02:16:56.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c0ca890 con 0x7f689c0d2450 2023-07-09T02:16:56.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c04d7d0 con 0x7f689c0d2450 2023-07-09T02:16:56.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68937fe640 1 -- 172.21.15.45:0/3839782774 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68840b4950 con 0x7f689c0d2450 2023-07-09T02:16:56.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68937fe640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f687c066280 0x7f687c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f68937fe640 1 -- 172.21.15.45:0/3839782774 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f688411d5b0 con 0x7f689c0d2450 2023-07-09T02:16:56.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.624+0000 7f689affd640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f687c066280 0x7f687c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.628+0000 7f689affd640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f687c066280 0x7f687c068730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f688c009c50 tx=0x7f688c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.628+0000 7f68937fe640 1 -- 172.21.15.45:0/3839782774 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68840eaad0 con 0x7f689c0d2450 2023-07-09T02:16:56.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.788+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f689c06baa0 con 0x7f689c0d2450 2023-07-09T02:16:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.788+0000 7f68937fe640 1 -- 172.21.15.45:0/3839782774 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18307 (secure 0 0 0) 0x7f68840ee0f0 con 0x7f689c0d2450 2023-07-09T02:16:56.791 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":111,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:47.494929+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:16:15.254129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T02:16:16.522380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f687c066280 msgr2=0x7f687c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f687c066280 0x7f687c068730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f688c009c50 tx=0x7f688c009190 comp rx=0 tx=0).stop 2023-07-09T02:16:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f689c0d2450 msgr2=0x7f689c0b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f689c0d2450 0x7f689c0b3ec0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f68840ad040 tx=0x7f68840192b0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 shutdown_connections 2023-07-09T02:16:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f689c15c060 0x7f689c156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f689c0d2450 0x7f689c0b3ec0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f687c066280 0x7f687c068730 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 --2- 172.21.15.45:0/3839782774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f689c0cd120 0x7f689c154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 >> 172.21.15.45:0/3839782774 conn(0x7f689c0698e0 msgr2=0x7f689c15b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:56.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 shutdown_connections 2023-07-09T02:16:56.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.792+0000 7f68a1582640 1 -- 172.21.15.45:0/3839782774 wait complete. 2023-07-09T02:16:56.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:16:15.254129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:16:16.522380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:16:56.812 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:16:56.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f243d1fa640 1 Processor -- start 2023-07-09T02:16:56.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f243d1fa640 1 -- start start 2023-07-09T02:16:56.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f243d1fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24380d2620 0x7f24380b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f243d1fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2438160a50 con 0x7f24380cd120 2023-07-09T02:16:56.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f243d1fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243815c430 con 0x7f243815c060 2023-07-09T02:16:56.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f243d1fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243815fb60 con 0x7f24380d2620 2023-07-09T02:16:56.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f242ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24380d2620 0x7f24380b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f243759e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f24380cd120 0x7f24380cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48864/0 (socket says 172.21.15.45:48864) 2023-07-09T02:16:56.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f243759e640 1 -- 172.21.15.45:0/4065044489 learned_addr learned my addr 172.21.15.45:0/4065044489 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:56.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f242ffff640 1 -- 172.21.15.45:0/4065044489 >> v1:172.21.15.155:6789/0 conn(0x7f243815c060 legacy=0x7f24380d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f242ffff640 1 -- 172.21.15.45:0/4065044489 >> v1:172.21.15.45:6789/0 conn(0x7f24380cd120 legacy=0x7f24380cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.960+0000 7f242ffff640 1 -- 172.21.15.45:0/4065044489 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243815fe40 con 0x7f24380d2620 2023-07-09T02:16:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f242ffff640 1 --2- 172.21.15.45:0/4065044489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24380d2620 0x7f24380b4ed0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f24200097c0 tx=0x7f242001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874287e7a4c915b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243659c640 1 -- 172.21.15.45:0/4065044489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200ab650 con 0x7f24380d2620 2023-07-09T02:16:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243659c640 1 -- 172.21.15.45:0/4065044489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24200ab7b0 con 0x7f24380d2620 2023-07-09T02:16:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243659c640 1 -- 172.21.15.45:0/4065044489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24200abb40 con 0x7f24380d2620 2023-07-09T02:16:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 -- 172.21.15.45:0/4065044489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24380d2620 msgr2=0x7f24380b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 --2- 172.21.15.45:0/4065044489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24380d2620 0x7f24380b4ed0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f24200097c0 tx=0x7f242001c450 comp rx=0 tx=0).stop 2023-07-09T02:16:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 -- 172.21.15.45:0/4065044489 shutdown_connections 2023-07-09T02:16:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 --2- 172.21.15.45:0/4065044489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24380d2620 0x7f24380b4ed0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 -- 172.21.15.45:0/4065044489 >> 172.21.15.45:0/4065044489 conn(0x7f24380698e0 msgr2=0x7f2438069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 -- 172.21.15.45:0/4065044489 shutdown_connections 2023-07-09T02:16:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 -- 172.21.15.45:0/4065044489 wait complete. 2023-07-09T02:16:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 Processor -- start 2023-07-09T02:16:56.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.964+0000 7f243d1fa640 1 -- start start 2023-07-09T02:16:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24380cd120 0x7f243814d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24380d2620 0x7f24380b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f243815c060 0x7f24380b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243814da90 con 0x7f243815c060 2023-07-09T02:16:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438155770 con 0x7f24380cd120 2023-07-09T02:16:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2438154b60 con 0x7f24380d2620 2023-07-09T02:16:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f243815c060 0x7f24380b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f243815c060 0x7f24380b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59746/0 (socket says 172.21.15.45:59746) 2023-07-09T02:16:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 -- 172.21.15.45:0/2726262054 learned_addr learned my addr 172.21.15.45:0/2726262054 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:56.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f242ffff640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24380d2620 0x7f24380b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f2436d9d640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24380cd120 0x7f243814d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 -- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24380d2620 msgr2=0x7f24380b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24380d2620 0x7f24380b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 -- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24380cd120 msgr2=0x7f243814d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24380cd120 0x7f243814d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 -- 172.21.15.45:0/2726262054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420009420 con 0x7f243815c060 2023-07-09T02:16:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243759e640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f243815c060 0x7f24380b42c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f243000cbc0 tx=0x7f243000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f242f7fe640 1 -- 172.21.15.45:0/2726262054 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000ad40 con 0x7f243815c060 2023-07-09T02:16:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f242f7fe640 1 -- 172.21.15.45:0/2726262054 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430012400 con 0x7f243815c060 2023-07-09T02:16:56.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24380b59f0 con 0x7f243815c060 2023-07-09T02:16:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f242f7fe640 1 -- 172.21.15.45:0/2726262054 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000aea0 con 0x7f243815c060 2023-07-09T02:16:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2438155120 con 0x7f243815c060 2023-07-09T02:16:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.968+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243804d7d0 con 0x7f243815c060 2023-07-09T02:16:56.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.972+0000 7f242f7fe640 1 -- 172.21.15.45:0/2726262054 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2430007070 con 0x7f243815c060 2023-07-09T02:16:56.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.972+0000 7f242f7fe640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f24180662b0 0x7f2418068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:56.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.972+0000 7f242f7fe640 1 -- 172.21.15.45:0/2726262054 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2430083b70 con 0x7f243815c060 2023-07-09T02:16:56.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.972+0000 7f2436d9d640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f24180662b0 0x7f2418068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:56.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.972+0000 7f2436d9d640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f24180662b0 0x7f2418068760 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2428000f70 tx=0x7f2428009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:56.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:56.976+0000 7f242f7fe640 1 -- 172.21.15.45:0/2726262054 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24300510a0 con 0x7f243815c060 2023-07-09T02:16:57.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.132+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f243806baa0 con 0x7f243815c060 2023-07-09T02:16:57.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.132+0000 7f242f7fe640 1 -- 172.21.15.45:0/2726262054 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24300170a0 con 0x7f243815c060 2023-07-09T02:16:57.136 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:16:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f24180662b0 msgr2=0x7f2418068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f24180662b0 0x7f2418068760 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2428000f70 tx=0x7f2428009040 comp rx=0 tx=0).stop 2023-07-09T02:16:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f243815c060 msgr2=0x7f24380b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f243815c060 0x7f24380b42c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f243000cbc0 tx=0x7f243000a430 comp rx=0 tx=0).stop 2023-07-09T02:16:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 shutdown_connections 2023-07-09T02:16:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f243815c060 0x7f24380b42c0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f24180662b0 0x7f2418068760 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24380d2620 0x7f24380b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 --2- 172.21.15.45:0/2726262054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24380cd120 0x7f243814d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 >> 172.21.15.45:0/2726262054 conn(0x7f24380698e0 msgr2=0x7f24380d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 shutdown_connections 2023-07-09T02:16:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.136+0000 7f243d1fa640 1 -- 172.21.15.45:0/2726262054 wait complete. 2023-07-09T02:16:57.157 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:16:57.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.300+0000 7ffa9159f640 1 Processor -- start 2023-07-09T02:16:57.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.300+0000 7ffa9159f640 1 -- start start 2023-07-09T02:16:57.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa9159f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa8c0d2620 0x7ffa8c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa9159f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c0cd120 0x7ffa8c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa9159f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8c160a50 con 0x7ffa8c15c060 2023-07-09T02:16:57.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa9159f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8c15c430 con 0x7ffa8c0d2620 2023-07-09T02:16:57.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa9159f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c15fb60 con 0x7ffa8c0cd120 2023-07-09T02:16:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa83fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa8c0d2620 0x7ffa8c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa83fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa8c0d2620 0x7ffa8c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59758/0 (socket says 172.21.15.45:59758) 2023-07-09T02:16:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa83fff640 1 -- 172.21.15.45:0/717608193 learned_addr learned my addr 172.21.15.45:0/717608193 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:57.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa8b7fe640 1 --2- 172.21.15.45:0/717608193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c0cd120 0x7ffa8c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa83fff640 1 -- 172.21.15.45:0/717608193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c0cd120 msgr2=0x7ffa8c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:57.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa83fff640 1 --2- 172.21.15.45:0/717608193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c0cd120 0x7ffa8c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa83fff640 1 -- 172.21.15.45:0/717608193 >> v1:172.21.15.155:6789/0 conn(0x7ffa8c15c060 legacy=0x7ffa8c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa83fff640 1 -- 172.21.15.45:0/717608193 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c15fe40 con 0x7ffa8c0d2620 2023-07-09T02:16:57.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.304+0000 7ffa8b7fe640 1 --2- 172.21.15.45:0/717608193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c0cd120 0x7ffa8c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:57.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa83fff640 1 --2- 172.21.15.45:0/717608193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0d2620 0x7ffa8c0b4ed0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009870 tx=0x7ffa7401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad53a053e53a1343 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:57.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa8a7fc640 1 -- 172.21.15.45:0/717608193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa740aa670 con 0x7ffa8c0d2620 2023-07-09T02:16:57.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa8a7fc640 1 -- 172.21.15.45:0/717608193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa740aa7d0 con 0x7ffa8c0d2620 2023-07-09T02:16:57.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa8a7fc640 1 -- 172.21.15.45:0/717608193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa740aab60 con 0x7ffa8c0d2620 2023-07-09T02:16:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 -- 172.21.15.45:0/717608193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0d2620 msgr2=0x7ffa8c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 --2- 172.21.15.45:0/717608193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0d2620 0x7ffa8c0b4ed0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009870 tx=0x7ffa7401c510 comp rx=0 tx=0).stop 2023-07-09T02:16:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 -- 172.21.15.45:0/717608193 shutdown_connections 2023-07-09T02:16:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 --2- 172.21.15.45:0/717608193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c0cd120 0x7ffa8c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 --2- 172.21.15.45:0/717608193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0d2620 0x7ffa8c0b4ed0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 -- 172.21.15.45:0/717608193 >> 172.21.15.45:0/717608193 conn(0x7ffa8c0698e0 msgr2=0x7ffa8c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 -- 172.21.15.45:0/717608193 shutdown_connections 2023-07-09T02:16:57.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 -- 172.21.15.45:0/717608193 wait complete. 2023-07-09T02:16:57.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 Processor -- start 2023-07-09T02:16:57.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.308+0000 7ffa9159f640 1 -- start start 2023-07-09T02:16:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0cd120 0x7ffa8c15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8c0d2620 0x7ffa8c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c15c060 0x7ffa8c15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c14b9d0 con 0x7ffa8c0cd120 2023-07-09T02:16:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c15e210 con 0x7ffa8c0d2620 2023-07-09T02:16:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c15b7d0 con 0x7ffa8c15c060 2023-07-09T02:16:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0cd120 0x7ffa8c15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0cd120 0x7ffa8c15b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59770/0 (socket says 172.21.15.45:59770) 2023-07-09T02:16:57.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 -- 172.21.15.45:0/2942804104 learned_addr learned my addr 172.21.15.45:0/2942804104 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa83fff640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8c0d2620 0x7ffa8c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8b7fe640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c15c060 0x7ffa8c15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 -- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c15c060 msgr2=0x7ffa8c15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c15c060 0x7ffa8c15e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 -- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8c0d2620 msgr2=0x7ffa8c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8c0d2620 0x7ffa8c0b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 -- 172.21.15.45:0/2942804104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740094d0 con 0x7ffa8c0cd120 2023-07-09T02:16:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa8affd640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0cd120 0x7ffa8c15b1a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c500 tx=0x7ffa7c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa837fe640 1 -- 172.21.15.45:0/2942804104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c005220 con 0x7ffa8c0cd120 2023-07-09T02:16:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa837fe640 1 -- 172.21.15.45:0/2942804104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c005380 con 0x7ffa8c0cd120 2023-07-09T02:16:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c0b59f0 con 0x7ffa8c0cd120 2023-07-09T02:16:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa837fe640 1 -- 172.21.15.45:0/2942804104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c007270 con 0x7ffa8c0cd120 2023-07-09T02:16:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c15dbc0 con 0x7ffa8c0cd120 2023-07-09T02:16:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c04d7d0 con 0x7ffa8c0cd120 2023-07-09T02:16:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.312+0000 7ffa837fe640 1 -- 172.21.15.45:0/2942804104 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa7c0073d0 con 0x7ffa8c0cd120 2023-07-09T02:16:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.316+0000 7ffa837fe640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa6c066280 0x7ffa6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.316+0000 7ffa837fe640 1 -- 172.21.15.45:0/2942804104 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa7c083730 con 0x7ffa8c0cd120 2023-07-09T02:16:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.316+0000 7ffa83fff640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa6c066280 0x7ffa6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.316+0000 7ffa83fff640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa6c066280 0x7ffa6c068730 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa740ae000 tx=0x7ffa740a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:57.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.320+0000 7ffa837fe640 1 -- 172.21.15.45:0/2942804104 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa7c050b20 con 0x7ffa8c0cd120 2023-07-09T02:16:57.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.472+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffa8c06baa0 con 0x7ffa8c0cd120 2023-07-09T02:16:57.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.472+0000 7ffa837fe640 1 -- 172.21.15.45:0/2942804104 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v111) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffa7c054140 con 0x7ffa8c0cd120 2023-07-09T02:16:57.477 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:16:57.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa6c066280 msgr2=0x7ffa6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa6c066280 0x7ffa6c068730 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa740ae000 tx=0x7ffa740a7000 comp rx=0 tx=0).stop 2023-07-09T02:16:57.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0cd120 msgr2=0x7ffa8c15b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0cd120 0x7ffa8c15b1a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c500 tx=0x7ffa7c00c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 shutdown_connections 2023-07-09T02:16:57.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa6c066280 0x7ffa6c068730 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8c15c060 0x7ffa8c15e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8c0d2620 0x7ffa8c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 --2- 172.21.15.45:0/2942804104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa8c0cd120 0x7ffa8c15b1a0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 >> 172.21.15.45:0/2942804104 conn(0x7ffa8c0698e0 msgr2=0x7ffa8c0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 shutdown_connections 2023-07-09T02:16:57.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.476+0000 7ffa9159f640 1 -- 172.21.15.45:0/2942804104 wait complete. 2023-07-09T02:16:57.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:16:57.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.640+0000 7f2ef9bac640 1 Processor -- start 2023-07-09T02:16:57.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.640+0000 7f2ef9bac640 1 -- start start 2023-07-09T02:16:57.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef9bac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ef4158e30 0x7f2ef406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef9bac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2ef406c820 0x7f2ef40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef9bac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef40ccf80 con 0x7f2ef406fd10 2023-07-09T02:16:57.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef9bac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40cd540 con 0x7f2ef4158e30 2023-07-09T02:16:57.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef9bac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40c8fb0 con 0x7f2ef406c820 2023-07-09T02:16:57.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ef4158e30 0x7f2ef406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ef4158e30 0x7f2ef406f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59782/0 (socket says 172.21.15.45:59782) 2023-07-09T02:16:57.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef37fe640 1 -- 172.21.15.45:0/1548275375 learned_addr learned my addr 172.21.15.45:0/1548275375 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:57.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef3fff640 1 --2- 172.21.15.45:0/1548275375 >> v2:172.21.15.155:3300/0 conn(0x7f2ef406c820 0x7f2ef40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef37fe640 1 -- 172.21.15.45:0/1548275375 >> v2:172.21.15.155:3300/0 conn(0x7f2ef406c820 msgr2=0x7f2ef40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:57.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef37fe640 1 --2- 172.21.15.45:0/1548275375 >> v2:172.21.15.155:3300/0 conn(0x7f2ef406c820 0x7f2ef40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef37fe640 1 -- 172.21.15.45:0/1548275375 >> v1:172.21.15.155:6789/0 conn(0x7f2ef406fd10 legacy=0x7f2ef406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.644+0000 7f2ef37fe640 1 -- 172.21.15.45:0/1548275375 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef40cbad0 con 0x7f2ef4158e30 2023-07-09T02:16:57.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef37fe640 1 --2- 172.21.15.45:0/1548275375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef4158e30 0x7f2ef406f7d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40c9590 tx=0x7f2ee401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1e7b44ade50607 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:57.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef27fc640 1 -- 172.21.15.45:0/1548275375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40ab660 con 0x7f2ef4158e30 2023-07-09T02:16:57.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef27fc640 1 -- 172.21.15.45:0/1548275375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee40ab7c0 con 0x7f2ef4158e30 2023-07-09T02:16:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef27fc640 1 -- 172.21.15.45:0/1548275375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40abb50 con 0x7f2ef4158e30 2023-07-09T02:16:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 -- 172.21.15.45:0/1548275375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef4158e30 msgr2=0x7f2ef406f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/1548275375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef4158e30 0x7f2ef406f7d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40c9590 tx=0x7f2ee401c440 comp rx=0 tx=0).stop 2023-07-09T02:16:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 -- 172.21.15.45:0/1548275375 shutdown_connections 2023-07-09T02:16:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/1548275375 >> v2:172.21.15.155:3300/0 conn(0x7f2ef406c820 0x7f2ef40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/1548275375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef4158e30 0x7f2ef406f7d0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 -- 172.21.15.45:0/1548275375 >> 172.21.15.45:0/1548275375 conn(0x7f2ef40694b0 msgr2=0x7f2ef40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:57.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 -- 172.21.15.45:0/1548275375 shutdown_connections 2023-07-09T02:16:57.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 -- 172.21.15.45:0/1548275375 wait complete. 2023-07-09T02:16:57.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.648+0000 7f2ef9bac640 1 Processor -- start 2023-07-09T02:16:57.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 -- start start 2023-07-09T02:16:57.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ef406c820 0x7f2ef4145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef406fd10 0x7f2ef40c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4158e30 0x7f2ef40c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40c7cc0 con 0x7f2ef406fd10 2023-07-09T02:16:57.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef414c150 con 0x7f2ef4158e30 2023-07-09T02:16:57.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef414c430 con 0x7f2ef406c820 2023-07-09T02:16:57.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef406fd10 0x7f2ef40c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef406fd10 0x7f2ef40c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59790/0 (socket says 172.21.15.45:59790) 2023-07-09T02:16:57.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 -- 172.21.15.45:0/486417625 learned_addr learned my addr 172.21.15.45:0/486417625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:57.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef3fff640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4158e30 0x7f2ef40c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef37fe640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ef406c820 0x7f2ef4145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 -- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ef406c820 msgr2=0x7f2ef4145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ef406c820 0x7f2ef4145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 -- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4158e30 msgr2=0x7f2ef40c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4158e30 0x7f2ef40c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 -- 172.21.15.45:0/486417625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40094d0 con 0x7f2ef406fd10 2023-07-09T02:16:57.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef2ffd640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef406fd10 0x7f2ef40c7320 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c500 tx=0x7f2ee800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:57.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2edbfff640 1 -- 172.21.15.45:0/486417625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8005220 con 0x7f2ef406fd10 2023-07-09T02:16:57.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2edbfff640 1 -- 172.21.15.45:0/486417625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8005380 con 0x7f2ef406fd10 2023-07-09T02:16:57.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2edbfff640 1 -- 172.21.15.45:0/486417625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8007270 con 0x7f2ef406fd10 2023-07-09T02:16:57.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef414c710 con 0x7f2ef406fd10 2023-07-09T02:16:57.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef41464d0 con 0x7f2ef406fd10 2023-07-09T02:16:57.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.652+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef414cc30 con 0x7f2ef406fd10 2023-07-09T02:16:57.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.656+0000 7f2edbfff640 1 -- 172.21.15.45:0/486417625 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ee80073d0 con 0x7f2ef406fd10 2023-07-09T02:16:57.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.656+0000 7f2edbfff640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ee0066280 0x7f2ee0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.656+0000 7f2edbfff640 1 -- 172.21.15.45:0/486417625 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ee8083560 con 0x7f2ef406fd10 2023-07-09T02:16:57.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.656+0000 7f2ef37fe640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ee0066280 0x7f2ee0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.656+0000 7f2ef37fe640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ee0066280 0x7f2ee0068730 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40af000 tx=0x7f2ee40b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:57.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.660+0000 7f2edbfff640 1 -- 172.21.15.45:0/486417625 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ef414cc30 con 0x7f2ef406fd10 2023-07-09T02:16:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.812+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ef414cc30 con 0x7f2ef406fd10 2023-07-09T02:16:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.812+0000 7f2edbfff640 1 -- 172.21.15.45:0/486417625 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ef414cc30 con 0x7f2ef406fd10 2023-07-09T02:16:57.816 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:16:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ee0066280 msgr2=0x7f2ee0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ee0066280 0x7f2ee0068730 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40af000 tx=0x7f2ee40b6040 comp rx=0 tx=0).stop 2023-07-09T02:16:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef406fd10 msgr2=0x7f2ef40c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef406fd10 0x7f2ef40c7320 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c500 tx=0x7f2ee800c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 shutdown_connections 2023-07-09T02:16:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4158e30 0x7f2ef40c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ef406fd10 0x7f2ef40c7320 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ee0066280 0x7f2ee0068730 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 --2- 172.21.15.45:0/486417625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ef406c820 0x7f2ef4145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 >> 172.21.15.45:0/486417625 conn(0x7f2ef40694b0 msgr2=0x7f2ef4069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 shutdown_connections 2023-07-09T02:16:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.816+0000 7f2ef9bac640 1 -- 172.21.15.45:0/486417625 wait complete. 2023-07-09T02:16:57.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:16:57.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.980+0000 7f6e9f9ba640 1 Processor -- start 2023-07-09T02:16:57.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.980+0000 7f6e9f9ba640 1 -- start start 2023-07-09T02:16:57.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.980+0000 7f6e9f9ba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e981604a0 0x7f6e98164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.980+0000 7f6e9f9ba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e980c8dc0 0x7f6e980cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9f9ba640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9806ef30 con 0x7f6e980cde40 2023-07-09T02:16:57.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9f9ba640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9806be90 con 0x7f6e980c8dc0 2023-07-09T02:16:57.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9f9ba640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9806b000 con 0x7f6e981604a0 2023-07-09T02:16:57.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9cf55640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e980c8dc0 0x7f6e980cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9cf55640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e980c8dc0 0x7f6e980cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59794/0 (socket says 172.21.15.45:59794) 2023-07-09T02:16:57.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9cf55640 1 -- 172.21.15.45:0/3374595806 learned_addr learned my addr 172.21.15.45:0/3374595806 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:57.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9d756640 1 --2- 172.21.15.45:0/3374595806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e981604a0 0x7f6e98164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9cf55640 1 -- 172.21.15.45:0/3374595806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e981604a0 msgr2=0x7f6e98164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:57.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9cf55640 1 --2- 172.21.15.45:0/3374595806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e981604a0 0x7f6e98164b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9cf55640 1 -- 172.21.15.45:0/3374595806 >> v1:172.21.15.155:6789/0 conn(0x7f6e980cde40 legacy=0x7f6e980cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9cf55640 1 -- 172.21.15.45:0/3374595806 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e98165040 con 0x7f6e980c8dc0 2023-07-09T02:16:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e9cf55640 1 --2- 172.21.15.45:0/3374595806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980c8dc0 0x7f6e980cd900 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009870 tx=0x7f6e8801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc0643902e7ebaf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:57.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e8ffff640 1 -- 172.21.15.45:0/3374595806 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88004230 con 0x7f6e980c8dc0 2023-07-09T02:16:57.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e8ffff640 1 -- 172.21.15.45:0/3374595806 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e880a7050 con 0x7f6e980c8dc0 2023-07-09T02:16:57.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.984+0000 7f6e8ffff640 1 -- 172.21.15.45:0/3374595806 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88003620 con 0x7f6e980c8dc0 2023-07-09T02:16:57.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/3374595806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980c8dc0 msgr2=0x7f6e980cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/3374595806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980c8dc0 0x7f6e980cd900 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009870 tx=0x7f6e8801c540 comp rx=0 tx=0).stop 2023-07-09T02:16:57.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/3374595806 shutdown_connections 2023-07-09T02:16:57.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/3374595806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980c8dc0 0x7f6e980cd900 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/3374595806 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e981604a0 0x7f6e98164b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/3374595806 >> 172.21.15.45:0/3374595806 conn(0x7f6e980694b0 msgr2=0x7f6e980698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:57.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/3374595806 shutdown_connections 2023-07-09T02:16:57.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/3374595806 wait complete. 2023-07-09T02:16:57.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 Processor -- start 2023-07-09T02:16:57.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- start start 2023-07-09T02:16:57.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e980c8dc0 0x7f6e9814ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e980cde40 0x7f6e9815f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e981604a0 0x7f6e981556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:57.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980b1690 con 0x7f6e981604a0 2023-07-09T02:16:57.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9814efa0 con 0x7f6e980cde40 2023-07-09T02:16:57.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9f9ba640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98157b90 con 0x7f6e980c8dc0 2023-07-09T02:16:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9df57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e981604a0 0x7f6e981556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9d756640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e980c8dc0 0x7f6e9814ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9df57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e981604a0 0x7f6e981556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59808/0 (socket says 172.21.15.45:59808) 2023-07-09T02:16:57.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9df57640 1 -- 172.21.15.45:0/2059392364 learned_addr learned my addr 172.21.15.45:0/2059392364 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:57.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.988+0000 7f6e9cf55640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e980cde40 0x7f6e9815f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:57.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9df57640 1 -- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e980c8dc0 msgr2=0x7f6e9814ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9df57640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e980c8dc0 0x7f6e9814ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9df57640 1 -- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e980cde40 msgr2=0x7f6e9815f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:57.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9df57640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e980cde40 0x7f6e9815f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:57.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9df57640 1 -- 172.21.15.45:0/2059392364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e880094d0 con 0x7f6e981604a0 2023-07-09T02:16:57.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9df57640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e981604a0 0x7f6e981556b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000c770 tx=0x7f6e9000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:57.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e8dffb640 1 -- 172.21.15.45:0/2059392364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90003b80 con 0x7f6e981604a0 2023-07-09T02:16:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e8dffb640 1 -- 172.21.15.45:0/2059392364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e90003ce0 con 0x7f6e981604a0 2023-07-09T02:16:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e8dffb640 1 -- 172.21.15.45:0/2059392364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000aa90 con 0x7f6e981604a0 2023-07-09T02:16:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e98157e70 con 0x7f6e981604a0 2023-07-09T02:16:57.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e98158430 con 0x7f6e981604a0 2023-07-09T02:16:58.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e980b1800 con 0x7f6e981604a0 2023-07-09T02:16:58.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e8dffb640 1 -- 172.21.15.45:0/2059392364 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e9000abf0 con 0x7f6e981604a0 2023-07-09T02:16:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e8dffb640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6e7c066280 0x7f6e7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.992+0000 7f6e8dffb640 1 -- 172.21.15.45:0/2059392364 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e90083b10 con 0x7f6e981604a0 2023-07-09T02:16:58.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.996+0000 7f6e9d756640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6e7c066280 0x7f6e7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.996+0000 7f6e9d756640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6e7c066280 0x7f6e7c068730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6e980adb10 tx=0x7f6e94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:58.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:57.996+0000 7f6e8dffb640 1 -- 172.21.15.45:0/2059392364 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e90050fa0 con 0x7f6e981604a0 2023-07-09T02:16:58.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6e9804d7d0 con 0x7f6e981604a0 2023-07-09T02:16:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e8dffb640 1 -- 172.21.15.45:0/2059392364 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6e900545c0 con 0x7f6e981604a0 2023-07-09T02:16:58.158 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:16:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6e7c066280 msgr2=0x7f6e7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6e7c066280 0x7f6e7c068730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6e980adb10 tx=0x7f6e94008040 comp rx=0 tx=0).stop 2023-07-09T02:16:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e981604a0 msgr2=0x7f6e981556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e981604a0 0x7f6e981556b0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000c770 tx=0x7f6e9000cc30 comp rx=0 tx=0).stop 2023-07-09T02:16:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 shutdown_connections 2023-07-09T02:16:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e981604a0 0x7f6e981556b0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e980cde40 0x7f6e9815f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6e7c066280 0x7f6e7c068730 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 --2- 172.21.15.45:0/2059392364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e980c8dc0 0x7f6e9814ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 >> 172.21.15.45:0/2059392364 conn(0x7f6e980694b0 msgr2=0x7f6e980cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 shutdown_connections 2023-07-09T02:16:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.156+0000 7f6e9f9ba640 1 -- 172.21.15.45:0/2059392364 wait complete. 2023-07-09T02:16:58.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:58.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228f7d2640 1 Processor -- start 2023-07-09T02:16:58.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228f7d2640 1 -- start start 2023-07-09T02:16:58.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228f7d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f22880c8d10 0x7f22880c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228f7d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f228815db00 0x7f228815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228f7d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228806bf30 con 0x7f22880ca0f0 2023-07-09T02:16:58.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228f7d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228815e4c0 con 0x7f22880c8d10 2023-07-09T02:16:58.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228f7d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228806bc50 con 0x7f228815db00 2023-07-09T02:16:58.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228cd6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f22880c8d10 0x7f22880c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228dd6f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f228815db00 0x7f228815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228cd6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f22880c8d10 0x7f22880c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:49582/0 (socket says 172.21.15.45:49582) 2023-07-09T02:16:58.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228cd6d640 1 -- 172.21.15.45:0/2568829562 learned_addr learned my addr 172.21.15.45:0/2568829562 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:58.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228dd6f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f228815db00 0x7f228815df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:50894/0 (socket says 172.21.15.45:50894) 2023-07-09T02:16:58.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.320+0000 7f228d56e640 1 --1- 172.21.15.45:0/2568829562 >> v1:172.21.15.155:6789/0 conn(0x7f22880ca0f0 0x7f22880cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:57372/0 (socket says 172.21.15.45:57372) 2023-07-09T02:16:58.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228cd6d640 1 -- 172.21.15.45:0/2568829562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f228815db00 msgr2=0x7f228815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:58.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228cd6d640 1 --2- 172.21.15.45:0/2568829562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f228815db00 0x7f228815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228cd6d640 1 -- 172.21.15.45:0/2568829562 >> v1:172.21.15.155:6789/0 conn(0x7f22880ca0f0 legacy=0x7f22880cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228cd6d640 1 -- 172.21.15.45:0/2568829562 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880cab90 con 0x7f22880c8d10 2023-07-09T02:16:58.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228cd6d640 1 --2- 172.21.15.45:0/2568829562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22880c8d10 0x7f22880c9160 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2278009870 tx=0x7f227801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e53563cc9397b93 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f227ffff640 1 -- 172.21.15.45:0/2568829562 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780aa610 con 0x7f22880c8d10 2023-07-09T02:16:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f227ffff640 1 -- 172.21.15.45:0/2568829562 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22780a6040 con 0x7f22880c8d10 2023-07-09T02:16:58.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f227ffff640 1 -- 172.21.15.45:0/2568829562 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780aa990 con 0x7f22880c8d10 2023-07-09T02:16:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228f7d2640 1 -- 172.21.15.45:0/2568829562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22880c8d10 msgr2=0x7f22880c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228f7d2640 1 --2- 172.21.15.45:0/2568829562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22880c8d10 0x7f22880c9160 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2278009870 tx=0x7f227801c4b0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228f7d2640 1 -- 172.21.15.45:0/2568829562 shutdown_connections 2023-07-09T02:16:58.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228f7d2640 1 --2- 172.21.15.45:0/2568829562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f228815db00 0x7f228815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228f7d2640 1 --2- 172.21.15.45:0/2568829562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22880c8d10 0x7f22880c9160 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.324+0000 7f228f7d2640 1 -- 172.21.15.45:0/2568829562 >> 172.21.15.45:0/2568829562 conn(0x7f22880694b0 msgr2=0x7f22880698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 -- 172.21.15.45:0/2568829562 shutdown_connections 2023-07-09T02:16:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 -- 172.21.15.45:0/2568829562 wait complete. 2023-07-09T02:16:58.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 Processor -- start 2023-07-09T02:16:58.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 -- start start 2023-07-09T02:16:58.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22880c8d10 0x7f22880cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22880ca0f0 0x7f2288151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f228815db00 0x7f2288153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22881533e0 con 0x7f22880ca0f0 2023-07-09T02:16:58.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22881527d0 con 0x7f228815db00 2023-07-09T02:16:58.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228f7d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2288152ab0 con 0x7f22880c8d10 2023-07-09T02:16:58.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22880ca0f0 0x7f2288151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22880ca0f0 0x7f2288151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59812/0 (socket says 172.21.15.45:59812) 2023-07-09T02:16:58.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 -- 172.21.15.45:0/3419481428 learned_addr learned my addr 172.21.15.45:0/3419481428 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228dd6f640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f228815db00 0x7f2288153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228d56e640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22880c8d10 0x7f22880cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 -- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22880c8d10 msgr2=0x7f22880cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22880c8d10 0x7f22880cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 -- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f228815db00 msgr2=0x7f2288153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f228815db00 0x7f2288153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 -- 172.21.15.45:0/3419481428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780094d0 con 0x7f22880ca0f0 2023-07-09T02:16:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f228cd6d640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22880ca0f0 0x7f2288151fa0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f22780ac040 tx=0x7f227801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.328+0000 7f227dffb640 1 -- 172.21.15.45:0/3419481428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780bd5f0 con 0x7f22880ca0f0 2023-07-09T02:16:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f227dffb640 1 -- 172.21.15.45:0/3419481428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22780bd750 con 0x7f22880ca0f0 2023-07-09T02:16:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f227dffb640 1 -- 172.21.15.45:0/3419481428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780bdb00 con 0x7f22880ca0f0 2023-07-09T02:16:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2288152d90 con 0x7f22880ca0f0 2023-07-09T02:16:58.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22881524e0 con 0x7f22880ca0f0 2023-07-09T02:16:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2288153550 con 0x7f22880ca0f0 2023-07-09T02:16:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f227dffb640 1 -- 172.21.15.45:0/3419481428 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22780b33f0 con 0x7f22880ca0f0 2023-07-09T02:16:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f227dffb640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f226c066280 0x7f226c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f227dffb640 1 -- 172.21.15.45:0/3419481428 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f227811e800 con 0x7f22880ca0f0 2023-07-09T02:16:58.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.332+0000 7f228d56e640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f226c066280 0x7f226c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.336+0000 7f228d56e640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f226c066280 0x7f226c068730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2284000f70 tx=0x7f2284007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:58.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.336+0000 7f227dffb640 1 -- 172.21.15.45:0/3419481428 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22780ebd20 con 0x7f22880ca0f0 2023-07-09T02:16:58.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.524+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2288152bf0 con 0x7f22880ca0f0 2023-07-09T02:16:58.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f227dffb640 1 -- 172.21.15.45:0/3419481428 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f2288152bf0 con 0x7f22880ca0f0 2023-07-09T02:16:58.529 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:58.529 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:58.529 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f226c066280 msgr2=0x7f226c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f226c066280 0x7f226c068730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2284000f70 tx=0x7f2284007c90 comp rx=0 tx=0).stop 2023-07-09T02:16:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22880ca0f0 msgr2=0x7f2288151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22880ca0f0 0x7f2288151fa0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f22780ac040 tx=0x7f227801acf0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 shutdown_connections 2023-07-09T02:16:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f228815db00 0x7f2288153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22880ca0f0 0x7f2288151fa0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f226c066280 0x7f226c068730 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 --2- 172.21.15.45:0/3419481428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22880c8d10 0x7f22880cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 >> 172.21.15.45:0/3419481428 conn(0x7f22880694b0 msgr2=0x7f22880c3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:58.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 shutdown_connections 2023-07-09T02:16:58.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.528+0000 7f228f7d2640 1 -- 172.21.15.45:0/3419481428 wait complete. 2023-07-09T02:16:58.549 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:58.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce207fa640 1 Processor -- start 2023-07-09T02:16:58.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce207fa640 1 -- start start 2023-07-09T02:16:58.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce207fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce1815c060 0x7fce180b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce207fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce207fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce18160a50 con 0x7fce180cd120 2023-07-09T02:16:58.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce207fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1815c430 con 0x7fce1815c060 2023-07-09T02:16:58.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce207fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1815fb60 con 0x7fce180d2620 2023-07-09T02:16:58.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce1e596640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce1815c060 0x7fce180b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce1e596640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce1815c060 0x7fce180b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59818/0 (socket says 172.21.15.45:59818) 2023-07-09T02:16:58.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce1e596640 1 -- 172.21.15.45:0/3088838590 learned_addr learned my addr 172.21.15.45:0/3088838590 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:58.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce1ed97640 1 --2- 172.21.15.45:0/3088838590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce1e596640 1 -- 172.21.15.45:0/3088838590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 msgr2=0x7fce180cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce1e596640 1 --2- 172.21.15.45:0/3088838590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce1e596640 1 -- 172.21.15.45:0/3088838590 >> v1:172.21.15.155:6789/0 conn(0x7fce180cd120 legacy=0x7fce180d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.692+0000 7fce1e596640 1 -- 172.21.15.45:0/3088838590 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1815fe40 con 0x7fce1815c060 2023-07-09T02:16:58.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce1e596640 1 --2- 172.21.15.45:0/3088838590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b4ed0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fce14009870 tx=0x7fce1401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0352ae1c4531f54 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:58.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce1d594640 1 -- 172.21.15.45:0/3088838590 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce140aa670 con 0x7fce1815c060 2023-07-09T02:16:58.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce1d594640 1 -- 172.21.15.45:0/3088838590 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce140aa7d0 con 0x7fce1815c060 2023-07-09T02:16:58.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce1d594640 1 -- 172.21.15.45:0/3088838590 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce140aab60 con 0x7fce1815c060 2023-07-09T02:16:58.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce207fa640 1 -- 172.21.15.45:0/3088838590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 msgr2=0x7fce180b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce207fa640 1 --2- 172.21.15.45:0/3088838590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b4ed0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fce14009870 tx=0x7fce1401c510 comp rx=0 tx=0).stop 2023-07-09T02:16:58.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce207fa640 1 -- 172.21.15.45:0/3088838590 shutdown_connections 2023-07-09T02:16:58.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce207fa640 1 --2- 172.21.15.45:0/3088838590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce207fa640 1 --2- 172.21.15.45:0/3088838590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b4ed0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce207fa640 1 -- 172.21.15.45:0/3088838590 >> 172.21.15.45:0/3088838590 conn(0x7fce180698e0 msgr2=0x7fce18069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:58.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce207fa640 1 -- 172.21.15.45:0/3088838590 shutdown_connections 2023-07-09T02:16:58.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.696+0000 7fce207fa640 1 -- 172.21.15.45:0/3088838590 wait complete. 2023-07-09T02:16:58.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 Processor -- start 2023-07-09T02:16:58.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 -- start start 2023-07-09T02:16:58.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce180cd120 0x7fce18153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce180c9930 con 0x7fce1815c060 2023-07-09T02:16:58.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce180c9650 con 0x7fce180cd120 2023-07-09T02:16:58.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1815c6a0 con 0x7fce180d2620 2023-07-09T02:16:58.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59832/0 (socket says 172.21.15.45:59832) 2023-07-09T02:16:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 -- 172.21.15.45:0/3733585377 learned_addr learned my addr 172.21.15.45:0/3733585377 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1e596640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce180cd120 0x7fce18153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1dd95640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 -- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 msgr2=0x7fce180ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 -- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce180cd120 msgr2=0x7fce18153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce180cd120 0x7fce18153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 -- 172.21.15.45:0/3733585377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce140094d0 con 0x7fce1815c060 2023-07-09T02:16:58.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1e596640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce180cd120 0x7fce18153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:58.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1dd95640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:16:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce1ed97640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b44b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fce1000efc0 tx=0x7fce1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce0effd640 1 -- 172.21.15.45:0/3733585377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce10014480 con 0x7fce1815c060 2023-07-09T02:16:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce0effd640 1 -- 172.21.15.45:0/3733585377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1000f040 con 0x7fce1815c060 2023-07-09T02:16:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce0effd640 1 -- 172.21.15.45:0/3733585377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce10014820 con 0x7fce1815c060 2023-07-09T02:16:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce180b59f0 con 0x7fce1815c060 2023-07-09T02:16:58.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.700+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1815cc60 con 0x7fce1815c060 2023-07-09T02:16:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.704+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1815ce80 con 0x7fce1815c060 2023-07-09T02:16:58.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.704+0000 7fce0effd640 1 -- 172.21.15.45:0/3733585377 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce10014980 con 0x7fce1815c060 2023-07-09T02:16:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.704+0000 7fce0effd640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdfc066280 0x7fcdfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.704+0000 7fce0effd640 1 -- 172.21.15.45:0/3733585377 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce10084c40 con 0x7fce1815c060 2023-07-09T02:16:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.704+0000 7fce1e596640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdfc066280 0x7fcdfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:58.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.704+0000 7fce1e596640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdfc066280 0x7fcdfc068730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fce140ae000 tx=0x7fce14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:58.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.708+0000 7fce0effd640 1 -- 172.21.15.45:0/3733585377 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce10052150 con 0x7fce1815c060 2023-07-09T02:16:58.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.864+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce1804d7d0 con 0x7fce1815c060 2023-07-09T02:16:58.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce0effd640 1 -- 172.21.15.45:0/3733585377 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18307 (secure 0 0 0) 0x7fce10018020 con 0x7fce1815c060 2023-07-09T02:16:58.869 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":111,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:47.494929+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:16:15.254129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T02:16:16.522380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:58.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdfc066280 msgr2=0x7fcdfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdfc066280 0x7fcdfc068730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fce140ae000 tx=0x7fce14008040 comp rx=0 tx=0).stop 2023-07-09T02:16:58.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 msgr2=0x7fce180b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:58.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b44b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fce1000efc0 tx=0x7fce1000c490 comp rx=0 tx=0).stop 2023-07-09T02:16:58.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 shutdown_connections 2023-07-09T02:16:58.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce1815c060 0x7fce180b44b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcdfc066280 0x7fcdfc068730 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce180d2620 0x7fce180ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 --2- 172.21.15.45:0/3733585377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce180cd120 0x7fce18153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:58.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 >> 172.21.15.45:0/3733585377 conn(0x7fce180698e0 msgr2=0x7fce1815b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:58.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 shutdown_connections 2023-07-09T02:16:58.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:58.868+0000 7fce207fa640 1 -- 172.21.15.45:0/3733585377 wait complete. 2023-07-09T02:16:58.890 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:16:58.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:59.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096a9a640 1 Processor -- start 2023-07-09T02:16:59.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096a9a640 1 -- start start 2023-07-09T02:16:59.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096a9a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f5090160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096a9a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50900cd5d0 con 0x7f50900b4ae0 2023-07-09T02:16:59.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096a9a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50900d2050 con 0x7f50900c8d40 2023-07-09T02:16:59.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096a9a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900d27a0 con 0x7f50900ccf10 2023-07-09T02:16:59.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5095297640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f50900b4ae0 0x7f50900d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48868/0 (socket says 172.21.15.45:48868) 2023-07-09T02:16:59.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5095297640 1 -- 172.21.15.45:0/302994652 learned_addr learned my addr 172.21.15.45:0/302994652 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:59.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096299640 1 --2- 172.21.15.45:0/302994652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f5090160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5094a96640 1 -- 172.21.15.45:0/302994652 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968523183 0 0) 0x7f50900cd5d0 con 0x7f50900b4ae0 2023-07-09T02:16:59.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5094a96640 1 -- 172.21.15.45:0/302994652 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f507c003530 con 0x7f50900b4ae0 2023-07-09T02:16:59.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096299640 1 -- 172.21.15.45:0/302994652 >> v1:172.21.15.155:6789/0 conn(0x7f50900c8d40 legacy=0x7f50900b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5094a96640 1 -- 172.21.15.45:0/302994652 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55476341 0 0) 0x7f50900d2050 con 0x7f50900c8d40 2023-07-09T02:16:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096299640 1 -- 172.21.15.45:0/302994652 >> v1:172.21.15.45:6789/0 conn(0x7f50900b4ae0 legacy=0x7f50900d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.032+0000 7f5096299640 1 -- 172.21.15.45:0/302994652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900cd370 con 0x7f50900ccf10 2023-07-09T02:16:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5096299640 1 --2- 172.21.15.45:0/302994652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f5090160670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5088009dc0 tx=0x7f508801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94036218842f47f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5094a96640 1 -- 172.21.15.45:0/302994652 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50880af600 con 0x7f50900ccf10 2023-07-09T02:16:59.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5094a96640 1 -- 172.21.15.45:0/302994652 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50880ab050 con 0x7f50900ccf10 2023-07-09T02:16:59.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5094a96640 1 -- 172.21.15.45:0/302994652 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50880af960 con 0x7f50900ccf10 2023-07-09T02:16:59.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5096a9a640 1 -- 172.21.15.45:0/302994652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 msgr2=0x7f5090160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5096a9a640 1 --2- 172.21.15.45:0/302994652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f5090160670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5088009dc0 tx=0x7f508801f150 comp rx=0 tx=0).stop 2023-07-09T02:16:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5096a9a640 1 -- 172.21.15.45:0/302994652 shutdown_connections 2023-07-09T02:16:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5096a9a640 1 --2- 172.21.15.45:0/302994652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f5090160670 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5096a9a640 1 -- 172.21.15.45:0/302994652 >> 172.21.15.45:0/302994652 conn(0x7f50900d2950 msgr2=0x7f50900d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5096a9a640 1 -- 172.21.15.45:0/302994652 shutdown_connections 2023-07-09T02:16:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.036+0000 7f5096a9a640 1 -- 172.21.15.45:0/302994652 wait complete. 2023-07-09T02:16:59.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 Processor -- start 2023-07-09T02:16:59.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 -- start start 2023-07-09T02:16:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50900b4ae0 0x7f509014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50900c8d40 0x7f509015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f50900d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509015caa0 con 0x7f50900b4ae0 2023-07-09T02:16:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509015cd80 con 0x7f50900c8d40 2023-07-09T02:16:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509015d060 con 0x7f50900ccf10 2023-07-09T02:16:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50900b4ae0 0x7f509014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50900b4ae0 0x7f509014dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59842/0 (socket says 172.21.15.45:59842) 2023-07-09T02:16:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 -- 172.21.15.45:0/293392069 learned_addr learned my addr 172.21.15.45:0/293392069 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096299640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f50900d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095297640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50900c8d40 0x7f509015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 -- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 msgr2=0x7f50900d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f50900d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 -- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50900c8d40 msgr2=0x7f509015c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50900c8d40 0x7f509015c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 -- 172.21.15.45:0/293392069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5088009a70 con 0x7f50900b4ae0 2023-07-09T02:16:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5095a98640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50900b4ae0 0x7f509014dc90 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c4d0 tx=0x7f508c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f50867fc640 1 -- 172.21.15.45:0/293392069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c005480 con 0x7f50900b4ae0 2023-07-09T02:16:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f50867fc640 1 -- 172.21.15.45:0/293392069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c003600 con 0x7f50900b4ae0 2023-07-09T02:16:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f50867fc640 1 -- 172.21.15.45:0/293392069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c0039b0 con 0x7f50900b4ae0 2023-07-09T02:16:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50900b5820 con 0x7f50900b4ae0 2023-07-09T02:16:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509014e1d0 con 0x7f50900b4ae0 2023-07-09T02:16:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.040+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509004e020 con 0x7f50900b4ae0 2023-07-09T02:16:59.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.044+0000 7f50867fc640 1 -- 172.21.15.45:0/293392069 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f508c003b10 con 0x7f50900b4ae0 2023-07-09T02:16:59.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.044+0000 7f50867fc640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50740662b0 0x7f5074068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.044+0000 7f50867fc640 1 -- 172.21.15.45:0/293392069 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f508c083380 con 0x7f50900b4ae0 2023-07-09T02:16:59.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.044+0000 7f5095297640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50740662b0 0x7f5074068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.044+0000 7f5095297640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50740662b0 0x7f5074068760 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f509015dc30 tx=0x7f5080009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.048+0000 7f50867fc640 1 -- 172.21.15.45:0/293392069 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f508c0542b0 con 0x7f50900b4ae0 2023-07-09T02:16:59.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50900b5cd0 con 0x7f50900b4ae0 2023-07-09T02:16:59.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f50867fc640 1 -- 172.21.15.45:0/293392069 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f508c053e40 con 0x7f50900b4ae0 2023-07-09T02:16:59.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:59.238 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:59.238 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:59.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50740662b0 msgr2=0x7f5074068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50740662b0 0x7f5074068760 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f509015dc30 tx=0x7f5080009040 comp rx=0 tx=0).stop 2023-07-09T02:16:59.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50900b4ae0 msgr2=0x7f509014dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50900b4ae0 0x7f509014dc90 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c4d0 tx=0x7f508c00c990 comp rx=0 tx=0).stop 2023-07-09T02:16:59.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 shutdown_connections 2023-07-09T02:16:59.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50740662b0 0x7f5074068760 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50900ccf10 0x7f50900d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50900c8d40 0x7f509015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 --2- 172.21.15.45:0/293392069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50900b4ae0 0x7f509014dc90 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 >> 172.21.15.45:0/293392069 conn(0x7f50900d2950 msgr2=0x7f509015f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:59.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 shutdown_connections 2023-07-09T02:16:59.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.236+0000 7f5096a9a640 1 -- 172.21.15.45:0/293392069 wait complete. 2023-07-09T02:16:59.259 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:16:59.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10e609c640 1 Processor -- start 2023-07-09T02:16:59.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10e609c640 1 -- start start 2023-07-09T02:16:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10e609c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e00ac870 0x7f10e006c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10e609c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10e00694b0 0x7f10e00ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10e609c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00acde0 con 0x7f10e006b800 2023-07-09T02:16:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10e609c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e00ad0c0 con 0x7f10e00694b0 2023-07-09T02:16:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10e609c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00ad3a0 con 0x7f10e00ac870 2023-07-09T02:16:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10e00694b0 0x7f10e00ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f10e00694b0 0x7f10e00ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59856/0 (socket says 172.21.15.45:59856) 2023-07-09T02:16:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10dffff640 1 -- 172.21.15.45:0/2521820254 learned_addr learned my addr 172.21.15.45:0/2521820254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10deffd640 1 --2- 172.21.15.45:0/2521820254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e00ac870 0x7f10e006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10dffff640 1 -- 172.21.15.45:0/2521820254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e00ac870 msgr2=0x7f10e006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:59.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10dffff640 1 --2- 172.21.15.45:0/2521820254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e00ac870 0x7f10e006c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10dffff640 1 -- 172.21.15.45:0/2521820254 >> v1:172.21.15.155:6789/0 conn(0x7f10e006b800 legacy=0x7f10e006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.400+0000 7f10dffff640 1 -- 172.21.15.45:0/2521820254 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00cda70 con 0x7f10e00694b0 2023-07-09T02:16:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10dffff640 1 --2- 172.21.15.45:0/2521820254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e00ce270 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009e50 tx=0x7f10d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06902dd9ad5e4da server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10de7fc640 1 -- 172.21.15.45:0/2521820254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80a58d0 con 0x7f10e00694b0 2023-07-09T02:16:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10de7fc640 1 -- 172.21.15.45:0/2521820254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80a5a30 con 0x7f10e00694b0 2023-07-09T02:16:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10de7fc640 1 -- 172.21.15.45:0/2521820254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80a5dc0 con 0x7f10e00694b0 2023-07-09T02:16:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10e609c640 1 -- 172.21.15.45:0/2521820254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 msgr2=0x7f10e00ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10e609c640 1 --2- 172.21.15.45:0/2521820254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e00ce270 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009e50 tx=0x7f10d801c9e0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10e609c640 1 -- 172.21.15.45:0/2521820254 shutdown_connections 2023-07-09T02:16:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10e609c640 1 --2- 172.21.15.45:0/2521820254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e00ce270 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10e609c640 1 --2- 172.21.15.45:0/2521820254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e00ac870 0x7f10e006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10e609c640 1 -- 172.21.15.45:0/2521820254 >> 172.21.15.45:0/2521820254 conn(0x7f10e00cfb50 msgr2=0x7f10e00cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10e609c640 1 -- 172.21.15.45:0/2521820254 shutdown_connections 2023-07-09T02:16:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.404+0000 7f10e609c640 1 -- 172.21.15.45:0/2521820254 wait complete. 2023-07-09T02:16:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 Processor -- start 2023-07-09T02:16:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 -- start start 2023-07-09T02:16:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e006b800 0x7f10e0137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e00ac870 0x7f10e00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00c45b0 con 0x7f10e00694b0 2023-07-09T02:16:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0150850 con 0x7f10e00ac870 2023-07-09T02:16:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0150b30 con 0x7f10e006b800 2023-07-09T02:16:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e014c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59872/0 (socket says 172.21.15.45:59872) 2023-07-09T02:16:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 -- 172.21.15.45:0/2116511164 learned_addr learned my addr 172.21.15.45:0/2116511164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10deffd640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e006b800 0x7f10e0137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10dffff640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e00ac870 0x7f10e00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 -- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e006b800 msgr2=0x7f10e0137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e006b800 0x7f10e0137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 -- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e00ac870 msgr2=0x7f10e00c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e00ac870 0x7f10e00c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 -- 172.21.15.45:0/2116511164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8009b30 con 0x7f10e00694b0 2023-07-09T02:16:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10deffd640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e006b800 0x7f10e0137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:16:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10df7fe640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e014c6f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f10d000c500 tx=0x7f10d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10c7fff640 1 -- 172.21.15.45:0/2116511164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0005220 con 0x7f10e00694b0 2023-07-09T02:16:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10c7fff640 1 -- 172.21.15.45:0/2116511164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0005380 con 0x7f10e00694b0 2023-07-09T02:16:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e0150e10 con 0x7f10e00694b0 2023-07-09T02:16:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10c7fff640 1 -- 172.21.15.45:0/2116511164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0007270 con 0x7f10e00694b0 2023-07-09T02:16:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.408+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e01510f0 con 0x7f10e00694b0 2023-07-09T02:16:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.412+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e006ae60 con 0x7f10e00694b0 2023-07-09T02:16:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.412+0000 7f10c7fff640 1 -- 172.21.15.45:0/2116511164 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10d00073d0 con 0x7f10e00694b0 2023-07-09T02:16:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.412+0000 7f10c7fff640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.412+0000 7f10c7fff640 1 -- 172.21.15.45:0/2116511164 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10d0083650 con 0x7f10e00694b0 2023-07-09T02:16:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.412+0000 7f10deffd640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.412+0000 7f10deffd640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f10e00704c0 tx=0x7f10d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.416+0000 7f10c7fff640 1 -- 172.21.15.45:0/2116511164 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10d0050a40 con 0x7f10e00694b0 2023-07-09T02:16:59.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.608+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10e004d7d0 con 0x7f10e00694b0 2023-07-09T02:16:59.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.608+0000 7f10c7fff640 1 -- 172.21.15.45:0/2116511164 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f10d0054060 con 0x7f10e00694b0 2023-07-09T02:16:59.611 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:59.611 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:16:17.518574+0000","modified":"2023-07-09T02:16:21.158853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/4289227998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":4289227998},{"type":"v1","addr":"172.21.15.45:6835","nonce":4289227998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T02:16:59.611 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-07-09T02:16:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 msgr2=0x7f10cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f10e00704c0 tx=0x7f10d4008040 comp rx=0 tx=0).stop 2023-07-09T02:16:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 msgr2=0x7f10e014c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e014c6f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f10d000c500 tx=0x7f10d000c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 shutdown_connections 2023-07-09T02:16:59.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e00ac870 0x7f10e00c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e006b800 0x7f10e0137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 --2- 172.21.15.45:0/2116511164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e00694b0 0x7f10e014c6f0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 >> 172.21.15.45:0/2116511164 conn(0x7f10e00cfb50 msgr2=0x7f10e00aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 shutdown_connections 2023-07-09T02:16:59.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.612+0000 7f10e609c640 1 -- 172.21.15.45:0/2116511164 wait complete. 2023-07-09T02:16:59.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:16:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361e540640 1 Processor -- start 2023-07-09T02:16:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361e540640 1 -- start start 2023-07-09T02:16:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361e540640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f361815c060 0x7f36180b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361e540640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f36180cd120 0x7f36180d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361e540640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3618160a50 con 0x7f36180d2450 2023-07-09T02:16:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361e540640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180d28f0 con 0x7f36180cd120 2023-07-09T02:16:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361e540640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36180cfe40 con 0x7f361815c060 2023-07-09T02:16:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361cadd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f36180d2450 0x7f36180d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48880/0 (socket says 172.21.15.45:48880) 2023-07-09T02:16:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.772+0000 7f361cadd640 1 -- 172.21.15.45:0/3371325032 learned_addr learned my addr 172.21.15.45:0/3371325032 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:16:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3617fff640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f361815c060 0x7f36180b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f36177fe640 1 --2- 172.21.15.45:0/3371325032 >> v2:172.21.15.155:3300/0 conn(0x7f36180cd120 0x7f36180d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941935327 0 0) 0x7f3618160a50 con 0x7f36180d2450 2023-07-09T02:16:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3600003530 con 0x7f36180d2450 2023-07-09T02:16:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349939174 0 0) 0x7f3600003530 con 0x7f36180d2450 2023-07-09T02:16:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f361815c060 msgr2=0x7f36180b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f361815c060 0x7f36180b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 >> v2:172.21.15.155:3300/0 conn(0x7f36180cd120 msgr2=0x7f36180d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:59.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 --2- 172.21.15.45:0/3371325032 >> v2:172.21.15.155:3300/0 conn(0x7f36180cd120 0x7f36180d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361815c430 con 0x7f36180d2450 2023-07-09T02:16:59.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f3610001a00 con 0x7f36180d2450 2023-07-09T02:16:59.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 >> v1:172.21.15.45:6789/0 conn(0x7f36180d2450 legacy=0x7f36180d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3600003980 0x7f3600003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f361815c060 0x7f36000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3600004d10 0x7f3600005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36180cfe40 con 0x7f3600003980 2023-07-09T02:16:59.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360000b990 con 0x7f3600004d10 2023-07-09T02:16:59.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360000bad0 con 0x7f361815c060 2023-07-09T02:16:59.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3617fff640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3600003980 0x7f3600003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f36177fe640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f361815c060 0x7f36000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f361cadd640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3600004d10 0x7f3600005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3617fff640 1 -- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f361815c060 msgr2=0x7f36000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:59.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3617fff640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f361815c060 0x7f36000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3617fff640 1 -- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3600004d10 msgr2=0x7f3600005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:16:59.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3617fff640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3600004d10 0x7f3600005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.776+0000 7f3617fff640 1 -- 172.21.15.45:0/3371325032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600003530 con 0x7f3600003980 2023-07-09T02:16:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f3617fff640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3600003980 0x7f3600003d90 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3608009ae0 tx=0x7f360801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135bcee9136b5fdc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36080a5610 con 0x7f3600003980 2023-07-09T02:16:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36080a5770 con 0x7f3600003980 2023-07-09T02:16:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f3616ffd640 1 -- 172.21.15.45:0/3371325032 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36080a5b20 con 0x7f3600003980 2023-07-09T02:16:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361e540640 1 -- 172.21.15.45:0/3371325032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3600003980 msgr2=0x7f3600003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361e540640 1 --2- 172.21.15.45:0/3371325032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3600003980 0x7f3600003d90 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3608009ae0 tx=0x7f360801c9c0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361cadd640 1 -- 172.21.15.45:0/3371325032 reap_dead start 2023-07-09T02:16:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361e540640 1 -- 172.21.15.45:0/3371325032 shutdown_connections 2023-07-09T02:16:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361e540640 1 -- 172.21.15.45:0/3371325032 >> 172.21.15.45:0/3371325032 conn(0x7f36180698e0 msgr2=0x7f3618069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361e540640 1 -- 172.21.15.45:0/3371325032 shutdown_connections 2023-07-09T02:16:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361e540640 1 -- 172.21.15.45:0/3371325032 wait complete. 2023-07-09T02:16:59.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361e540640 1 Processor -- start 2023-07-09T02:16:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.780+0000 7f361e540640 1 -- start start 2023-07-09T02:16:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3600003980 0x7f36181f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36180cbb30 0x7f361814d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361815e9d0 0x7f361815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361815f3b0 con 0x7f361815e9d0 2023-07-09T02:16:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361814a670 con 0x7f36180cbb30 2023-07-09T02:16:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36181f8b30 con 0x7f3600003980 2023-07-09T02:16:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361815e9d0 0x7f361815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361815e9d0 0x7f361815ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59898/0 (socket says 172.21.15.45:59898) 2023-07-09T02:16:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 -- 172.21.15.45:0/2112475649 learned_addr learned my addr 172.21.15.45:0/2112475649 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:16:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f3617fff640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3600003980 0x7f36181f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f36177fe640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36180cbb30 0x7f361814d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 -- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3600003980 msgr2=0x7f36181f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3600003980 0x7f36181f85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 -- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36180cbb30 msgr2=0x7f361814d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36180cbb30 0x7f361814d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 -- 172.21.15.45:0/2112475649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361814d5e0 con 0x7f361815e9d0 2023-07-09T02:16:59.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361cadd640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361815e9d0 0x7f361815ee70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f36180d3a80 tx=0x7f36100076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f3614ff9640 1 -- 172.21.15.45:0/2112475649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361000a570 con 0x7f361815e9d0 2023-07-09T02:16:59.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f3614ff9640 1 -- 172.21.15.45:0/2112475649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361000a6d0 con 0x7f361815e9d0 2023-07-09T02:16:59.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f3614ff9640 1 -- 172.21.15.45:0/2112475649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361000aa80 con 0x7f361815e9d0 2023-07-09T02:16:59.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36180cc010 con 0x7f361815e9d0 2023-07-09T02:16:59.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36180cc5d0 con 0x7f361815e9d0 2023-07-09T02:16:59.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361804d7d0 con 0x7f361815e9d0 2023-07-09T02:16:59.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.784+0000 7f3614ff9640 1 -- 172.21.15.45:0/2112475649 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f361000abe0 con 0x7f361815e9d0 2023-07-09T02:16:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.788+0000 7f3614ff9640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3604066280 0x7f3604068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:16:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.788+0000 7f3614ff9640 1 -- 172.21.15.45:0/2112475649 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3610083bb0 con 0x7f361815e9d0 2023-07-09T02:16:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.788+0000 7f3617fff640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3604066280 0x7f3604068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:16:59.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.788+0000 7f3617fff640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3604066280 0x7f3604068730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f36080af000 tx=0x7f36080046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:16:59.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.792+0000 7f3614ff9640 1 -- 172.21.15.45:0/2112475649 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3610051030 con 0x7f361815e9d0 2023-07-09T02:16:59.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.944+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f361806baa0 con 0x7f361815e9d0 2023-07-09T02:16:59.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.944+0000 7f3614ff9640 1 -- 172.21.15.45:0/2112475649 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18307 (secure 0 0 0) 0x7f3610054650 con 0x7f361815e9d0 2023-07-09T02:16:59.947 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:16:59.948 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":111,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:16:47.494929+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:16:15.254129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T02:16:16.522380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:16:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3604066280 msgr2=0x7f3604068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3604066280 0x7f3604068730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f36080af000 tx=0x7f36080046d0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361815e9d0 msgr2=0x7f361815ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:16:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361815e9d0 0x7f361815ee70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f36180d3a80 tx=0x7f36100076d0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 shutdown_connections 2023-07-09T02:16:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f361815e9d0 0x7f361815ee70 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36180cbb30 0x7f361814d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3604066280 0x7f3604068730 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 --2- 172.21.15.45:0/2112475649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3600003980 0x7f36181f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:16:59.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 >> 172.21.15.45:0/2112475649 conn(0x7f36180698e0 msgr2=0x7f36180b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:16:59.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 shutdown_connections 2023-07-09T02:16:59.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:16:59.948+0000 7f361e540640 1 -- 172.21.15.45:0/2112475649 wait complete. 2023-07-09T02:16:59.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:17:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f957e47b640 1 Processor -- start 2023-07-09T02:17:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f957e47b640 1 -- start start 2023-07-09T02:17:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f957e47b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95780d2620 0x7f95780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f957e47b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9578160a50 con 0x7f95780cd120 2023-07-09T02:17:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f957e47b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957815c430 con 0x7f957815c060 2023-07-09T02:17:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f957e47b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957815fb60 con 0x7f95780d2620 2023-07-09T02:17:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f956ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95780d2620 0x7f95780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f957ca18640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95780cd120 0x7f95780cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48892/0 (socket says 172.21.15.45:48892) 2023-07-09T02:17:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f957ca18640 1 -- 172.21.15.45:0/374294951 learned_addr learned my addr 172.21.15.45:0/374294951 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:00.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f956ffff640 1 -- 172.21.15.45:0/374294951 >> v1:172.21.15.155:6789/0 conn(0x7f957815c060 legacy=0x7f95780d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f956ffff640 1 -- 172.21.15.45:0/374294951 >> v1:172.21.15.45:6789/0 conn(0x7f95780cd120 legacy=0x7f95780cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f956ffff640 1 -- 172.21.15.45:0/374294951 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957815fe40 con 0x7f95780d2620 2023-07-09T02:17:00.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.112+0000 7f95777fe640 1 -- 172.21.15.45:0/374294951 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732044918 0 0) 0x7f9578160a50 con 0x7f95780cd120 2023-07-09T02:17:00.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f956ffff640 1 --2- 172.21.15.45:0/374294951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780d2620 0x7f95780b4ed0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f95600097c0 tx=0x7f956001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf57c76bda9ae6a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:00.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f95777fe640 1 -- 172.21.15.45:0/374294951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95600ab650 con 0x7f95780d2620 2023-07-09T02:17:00.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f95777fe640 1 -- 172.21.15.45:0/374294951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95600ab7b0 con 0x7f95780d2620 2023-07-09T02:17:00.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f95777fe640 1 -- 172.21.15.45:0/374294951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95600abb40 con 0x7f95780d2620 2023-07-09T02:17:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f957e47b640 1 -- 172.21.15.45:0/374294951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780d2620 msgr2=0x7f95780b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f957e47b640 1 --2- 172.21.15.45:0/374294951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780d2620 0x7f95780b4ed0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f95600097c0 tx=0x7f956001c450 comp rx=0 tx=0).stop 2023-07-09T02:17:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f957e47b640 1 -- 172.21.15.45:0/374294951 shutdown_connections 2023-07-09T02:17:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f957e47b640 1 --2- 172.21.15.45:0/374294951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780d2620 0x7f95780b4ed0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f957e47b640 1 -- 172.21.15.45:0/374294951 >> 172.21.15.45:0/374294951 conn(0x7f95780698e0 msgr2=0x7f9578069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f957e47b640 1 -- 172.21.15.45:0/374294951 shutdown_connections 2023-07-09T02:17:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.116+0000 7f957e47b640 1 -- 172.21.15.45:0/374294951 wait complete. 2023-07-09T02:17:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 Processor -- start 2023-07-09T02:17:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 -- start start 2023-07-09T02:17:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780cd120 0x7f957814e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95780d2620 0x7f957815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f957815c060 0x7f957815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957815f6c0 con 0x7f95780cd120 2023-07-09T02:17:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957815e3c0 con 0x7f957815c060 2023-07-09T02:17:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957815e6a0 con 0x7f95780d2620 2023-07-09T02:17:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780cd120 0x7f957814e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780cd120 0x7f957814e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59906/0 (socket says 172.21.15.45:59906) 2023-07-09T02:17:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 -- 172.21.15.45:0/3152193889 learned_addr learned my addr 172.21.15.45:0/3152193889 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957ca18640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f957815c060 0x7f957815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f956ffff640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95780d2620 0x7f957815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 -- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95780d2620 msgr2=0x7f957815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95780d2620 0x7f957815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 -- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f957815c060 msgr2=0x7f957815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f957815c060 0x7f957815f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 -- 172.21.15.45:0/3152193889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560009420 con 0x7f95780cd120 2023-07-09T02:17:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f9577fff640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780cd120 0x7f957814e720 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f956800c3c0 tx=0x7f956800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f95757fa640 1 -- 172.21.15.45:0/3152193889 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680052d0 con 0x7f95780cd120 2023-07-09T02:17:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f95757fa640 1 -- 172.21.15.45:0/3152193889 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568005430 con 0x7f95780cd120 2023-07-09T02:17:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f95757fa640 1 -- 172.21.15.45:0/3152193889 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568003840 con 0x7f95780cd120 2023-07-09T02:17:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95780b59f0 con 0x7f95780cd120 2023-07-09T02:17:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.120+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957815ec60 con 0x7f95780cd120 2023-07-09T02:17:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.124+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957815ee50 con 0x7f95780cd120 2023-07-09T02:17:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.124+0000 7f95757fa640 1 -- 172.21.15.45:0/3152193889 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95680039a0 con 0x7f95780cd120 2023-07-09T02:17:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.124+0000 7f95757fa640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95580662b0 0x7f9558068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.124+0000 7f95757fa640 1 -- 172.21.15.45:0/3152193889 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95680832c0 con 0x7f95780cd120 2023-07-09T02:17:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.124+0000 7f956ffff640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95580662b0 0x7f9558068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.124+0000 7f956ffff640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95580662b0 0x7f9558068760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f95600af000 tx=0x7f95600a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.128+0000 7f95757fa640 1 -- 172.21.15.45:0/3152193889 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95680506a0 con 0x7f95780cd120 2023-07-09T02:17:00.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.316+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f957804d7d0 con 0x7f95780cd120 2023-07-09T02:17:00.318 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:17:00.316+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:17:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f95757fa640 1 -- 172.21.15.45:0/3152193889 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9568053cc0 con 0x7f95780cd120 2023-07-09T02:17:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:17:00.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95580662b0 msgr2=0x7f9558068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95580662b0 0x7f9558068760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f95600af000 tx=0x7f95600a7000 comp rx=0 tx=0).stop 2023-07-09T02:17:00.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780cd120 msgr2=0x7f957814e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780cd120 0x7f957814e720 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f956800c3c0 tx=0x7f956800c880 comp rx=0 tx=0).stop 2023-07-09T02:17:00.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 shutdown_connections 2023-07-09T02:17:00.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f957815c060 0x7f957815f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f95580662b0 0x7f9558068760 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95780d2620 0x7f957815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 --2- 172.21.15.45:0/3152193889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95780cd120 0x7f957814e720 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 >> 172.21.15.45:0/3152193889 conn(0x7f95780698e0 msgr2=0x7f95780b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 shutdown_connections 2023-07-09T02:17:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.324+0000 7f957e47b640 1 -- 172.21.15.45:0/3152193889 wait complete. 2023-07-09T02:17:00.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:17:00.392 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:17:00.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.492+0000 7ff3e608a640 1 Processor -- start 2023-07-09T02:17:00.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.492+0000 7ff3e608a640 1 -- start start 2023-07-09T02:17:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e608a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3e00b1bc0 0x7ff3e0069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e608a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff3e00b68b0 0x7ff3e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e608a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e00ceff0 con 0x7ff3e00d2400 2023-07-09T02:17:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e608a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e00cea70 con 0x7ff3e00b68b0 2023-07-09T02:17:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e608a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e00b1f90 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e5889640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff3e00b68b0 0x7ff3e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e5889640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff3e00b68b0 0x7ff3e0069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59932/0 (socket says 172.21.15.45:59932) 2023-07-09T02:17:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e5889640 1 -- 172.21.15.45:0/1899467820 learned_addr learned my addr 172.21.15.45:0/1899467820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e5088640 1 --2- 172.21.15.45:0/1899467820 >> v2:172.21.15.155:3300/0 conn(0x7ff3e00b1bc0 0x7ff3e0069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e5889640 1 -- 172.21.15.45:0/1899467820 >> v2:172.21.15.155:3300/0 conn(0x7ff3e00b1bc0 msgr2=0x7ff3e0069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e5889640 1 --2- 172.21.15.45:0/1899467820 >> v2:172.21.15.155:3300/0 conn(0x7ff3e00b1bc0 0x7ff3e0069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e5889640 1 -- 172.21.15.45:0/1899467820 >> v1:172.21.15.155:6789/0 conn(0x7ff3e00d2400 legacy=0x7ff3e0070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.496+0000 7ff3e5889640 1 -- 172.21.15.45:0/1899467820 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e00d1500 con 0x7ff3e00b68b0 2023-07-09T02:17:00.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e5889640 1 --2- 172.21.15.45:0/1899467820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b68b0 0x7ff3e0069db0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00d28b0 tx=0x7ff3d801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295f1c5820ffe72c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:00.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3d7fff640 1 -- 172.21.15.45:0/1899467820 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80a5860 con 0x7ff3e00b68b0 2023-07-09T02:17:00.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3d7fff640 1 -- 172.21.15.45:0/1899467820 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d80a59c0 con 0x7ff3e00b68b0 2023-07-09T02:17:00.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3d7fff640 1 -- 172.21.15.45:0/1899467820 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80a5d50 con 0x7ff3e00b68b0 2023-07-09T02:17:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 -- 172.21.15.45:0/1899467820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b68b0 msgr2=0x7ff3e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1899467820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b68b0 0x7ff3e0069db0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00d28b0 tx=0x7ff3d801c9a0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 -- 172.21.15.45:0/1899467820 shutdown_connections 2023-07-09T02:17:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1899467820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b68b0 0x7ff3e0069db0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1899467820 >> v2:172.21.15.155:3300/0 conn(0x7ff3e00b1bc0 0x7ff3e0069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 -- 172.21.15.45:0/1899467820 >> 172.21.15.45:0/1899467820 conn(0x7ff3e00d35b0 msgr2=0x7ff3e00cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 -- 172.21.15.45:0/1899467820 shutdown_connections 2023-07-09T02:17:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 -- 172.21.15.45:0/1899467820 wait complete. 2023-07-09T02:17:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 Processor -- start 2023-07-09T02:17:00.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.500+0000 7ff3e608a640 1 -- start start 2023-07-09T02:17:00.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b1bc0 0x7ff3e015e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e00b68b0 0x7ff3e0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3e00d2400 0x7ff3e00ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00ca2a0 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00cc870 con 0x7ff3e00d2400 2023-07-09T02:17:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e0153440 con 0x7ff3e00b68b0 2023-07-09T02:17:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b1bc0 0x7ff3e015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b1bc0 0x7ff3e015e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59948/0 (socket says 172.21.15.45:59948) 2023-07-09T02:17:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 -- 172.21.15.45:0/1756882330 learned_addr learned my addr 172.21.15.45:0/1756882330 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e4887640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e00b68b0 0x7ff3e0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5889640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3e00d2400 0x7ff3e00ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 -- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e00b68b0 msgr2=0x7ff3e0152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e00b68b0 0x7ff3e0152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 -- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3e00d2400 msgr2=0x7ff3e00ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3e00d2400 0x7ff3e00ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 -- 172.21.15.45:0/1756882330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8009b30 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e5088640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b1bc0 0x7ff3e015e930 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00e960 tx=0x7ff3dc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3d5ffb640 1 -- 172.21.15.45:0/1756882330 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc009690 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3d5ffb640 1 -- 172.21.15.45:0/1756882330 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc00ca00 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e00c9990 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3d5ffb640 1 -- 172.21.15.45:0/1756882330 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00cd70 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e0153670 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e0071f70 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.504+0000 7ff3d5ffb640 1 -- 172.21.15.45:0/1756882330 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3dc013470 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.508+0000 7ff3d5ffb640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff3c4066280 0x7ff3c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.508+0000 7ff3d5ffb640 1 -- 172.21.15.45:0/1756882330 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff3dc083fc0 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.508+0000 7ff3e4887640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff3c4066280 0x7ff3c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.508+0000 7ff3e4887640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff3c4066280 0x7ff3c4068730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0158b20 tx=0x7ff3d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:00.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.512+0000 7ff3d5ffb640 1 -- 172.21.15.45:0/1756882330 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3dc0b4700 con 0x7ff3e00b1bc0 2023-07-09T02:17:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:00.704+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff3e00ca510 con 0x7ff3e00b1bc0 2023-07-09T02:17:01.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.324+0000 7ff3d5ffb640 1 -- 172.21.15.45:0/1756882330 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff3dc0513e0 con 0x7ff3e00b1bc0 2023-07-09T02:17:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.324+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff3c4066280 msgr2=0x7ff3c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.324+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff3c4066280 0x7ff3c4068730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0158b20 tx=0x7ff3d0009040 comp rx=0 tx=0).stop 2023-07-09T02:17:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.324+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b1bc0 msgr2=0x7ff3e015e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.324+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b1bc0 0x7ff3e015e930 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00e960 tx=0x7ff3dc00ee20 comp rx=0 tx=0).stop 2023-07-09T02:17:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.328+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 shutdown_connections 2023-07-09T02:17:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.328+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3e00d2400 0x7ff3e00ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.328+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff3c4066280 0x7ff3c4068730 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.328+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3e00b68b0 0x7ff3e0152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.328+0000 7ff3e608a640 1 --2- 172.21.15.45:0/1756882330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3e00b1bc0 0x7ff3e015e930 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.328+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 >> 172.21.15.45:0/1756882330 conn(0x7ff3e00d35b0 msgr2=0x7ff3e00b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.328+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 shutdown_connections 2023-07-09T02:17:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.328+0000 7ff3e608a640 1 -- 172.21.15.45:0/1756882330 wait complete. 2023-07-09T02:17:01.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:17:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c9093640 1 Processor -- start 2023-07-09T02:17:01.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c9093640 1 -- start start 2023-07-09T02:17:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c9093640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68c415c480 0x7f68c40cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c9093640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68c40b4490 0x7f68c40b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c9093640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c40d19c0 con 0x7f68c40cecd0 2023-07-09T02:17:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c9093640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c415c850 con 0x7f68c40b4490 2023-07-09T02:17:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c9093640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40b4e50 con 0x7f68c415c480 2023-07-09T02:17:01.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68c40b4490 0x7f68c40b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c359e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68c40b4490 0x7f68c40b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59960/0 (socket says 172.21.15.45:59960) 2023-07-09T02:17:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c359e640 1 -- 172.21.15.45:0/3563454107 learned_addr learned my addr 172.21.15.45:0/3563454107 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c2d9d640 1 --2- 172.21.15.45:0/3563454107 >> v2:172.21.15.155:3300/0 conn(0x7f68c415c480 0x7f68c40cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c359e640 1 -- 172.21.15.45:0/3563454107 >> v2:172.21.15.155:3300/0 conn(0x7f68c415c480 msgr2=0x7f68c40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:01.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c359e640 1 --2- 172.21.15.45:0/3563454107 >> v2:172.21.15.155:3300/0 conn(0x7f68c415c480 0x7f68c40cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c359e640 1 -- 172.21.15.45:0/3563454107 >> v1:172.21.15.155:6789/0 conn(0x7f68c40cecd0 legacy=0x7f68c40d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:01.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.540+0000 7f68c359e640 1 -- 172.21.15.45:0/3563454107 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40d1090 con 0x7f68c40b4490 2023-07-09T02:17:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c359e640 1 --2- 172.21.15.45:0/3563454107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40b4910 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f68c4069ae0 tx=0x7f68bc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6811bc3928a7d87 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c259c640 1 -- 172.21.15.45:0/3563454107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0a57a0 con 0x7f68c40b4490 2023-07-09T02:17:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c259c640 1 -- 172.21.15.45:0/3563454107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc0a5900 con 0x7f68c40b4490 2023-07-09T02:17:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c259c640 1 -- 172.21.15.45:0/3563454107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0a5c90 con 0x7f68c40b4490 2023-07-09T02:17:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c9093640 1 -- 172.21.15.45:0/3563454107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 msgr2=0x7f68c40b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:01.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c9093640 1 --2- 172.21.15.45:0/3563454107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40b4910 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f68c4069ae0 tx=0x7f68bc01c9d0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c9093640 1 -- 172.21.15.45:0/3563454107 shutdown_connections 2023-07-09T02:17:01.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c9093640 1 --2- 172.21.15.45:0/3563454107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40b4910 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c9093640 1 --2- 172.21.15.45:0/3563454107 >> v2:172.21.15.155:3300/0 conn(0x7f68c415c480 0x7f68c40cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c9093640 1 -- 172.21.15.45:0/3563454107 >> 172.21.15.45:0/3563454107 conn(0x7f68c40cf490 msgr2=0x7f68c40cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:01.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c9093640 1 -- 172.21.15.45:0/3563454107 shutdown_connections 2023-07-09T02:17:01.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.544+0000 7f68c9093640 1 -- 172.21.15.45:0/3563454107 wait complete. 2023-07-09T02:17:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 Processor -- start 2023-07-09T02:17:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 -- start start 2023-07-09T02:17:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c40cecd0 0x7f68c40b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c415c480 0x7f68c40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40ca020 con 0x7f68c40b4490 2023-07-09T02:17:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c415ae30 con 0x7f68c40cecd0 2023-07-09T02:17:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40b8890 con 0x7f68c415c480 2023-07-09T02:17:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59970/0 (socket says 172.21.15.45:59970) 2023-07-09T02:17:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 -- 172.21.15.45:0/720031654 learned_addr learned my addr 172.21.15.45:0/720031654 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68bbfff640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c40cecd0 0x7f68c40b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c359e640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c415c480 0x7f68c40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:01.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 -- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c415c480 msgr2=0x7f68c40c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c415c480 0x7f68c40c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 -- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c40cecd0 msgr2=0x7f68c40b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c40cecd0 0x7f68c40b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 -- 172.21.15.45:0/720031654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc009b30 con 0x7f68c40b4490 2023-07-09T02:17:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c359e640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c415c480 0x7f68c40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68bbfff640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c40cecd0 0x7f68c40b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:01.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c2d9d640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40c9ae0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f68b400d5f0 tx=0x7f68b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68bb7fe640 1 -- 172.21.15.45:0/720031654 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40125f0 con 0x7f68c40b4490 2023-07-09T02:17:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68bb7fe640 1 -- 172.21.15.45:0/720031654 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4012750 con 0x7f68c40b4490 2023-07-09T02:17:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68bb7fe640 1 -- 172.21.15.45:0/720031654 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4012ae0 con 0x7f68c40b4490 2023-07-09T02:17:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c415a870 con 0x7f68c40b4490 2023-07-09T02:17:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.548+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c40c8040 con 0x7f68c40b4490 2023-07-09T02:17:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.552+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c40c8200 con 0x7f68c40b4490 2023-07-09T02:17:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.552+0000 7f68bb7fe640 1 -- 172.21.15.45:0/720031654 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68b4012c40 con 0x7f68c40b4490 2023-07-09T02:17:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.552+0000 7f68bb7fe640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68a40662b0 0x7f68a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.552+0000 7f68bb7fe640 1 -- 172.21.15.45:0/720031654 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f68b40841b0 con 0x7f68c40b4490 2023-07-09T02:17:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.552+0000 7f68bbfff640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68a40662b0 0x7f68a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.552+0000 7f68bbfff640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68a40662b0 0x7f68a4068760 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f68c40c9590 tx=0x7f68ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.556+0000 7f68bb7fe640 1 -- 172.21.15.45:0/720031654 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68b4051660 con 0x7f68c40b4490 2023-07-09T02:17:01.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:01.712+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f68c4153600 con 0x7f68c40b4490 2023-07-09T02:17:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.608+0000 7f68bb7fe640 1 -- 172.21.15.45:0/720031654 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7f68b4054c80 con 0x7f68c40b4490 2023-07-09T02:17:02.610 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:17:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68a40662b0 msgr2=0x7f68a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68a40662b0 0x7f68a4068760 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f68c40c9590 tx=0x7f68ac009040 comp rx=0 tx=0).stop 2023-07-09T02:17:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 msgr2=0x7f68c40c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40c9ae0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f68b400d5f0 tx=0x7f68b400dab0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 shutdown_connections 2023-07-09T02:17:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f68a40662b0 0x7f68a4068760 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68c415c480 0x7f68c40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68c40cecd0 0x7f68c40b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 --2- 172.21.15.45:0/720031654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68c40b4490 0x7f68c40c9ae0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 >> 172.21.15.45:0/720031654 conn(0x7f68c40cf490 msgr2=0x7f68c40d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 shutdown_connections 2023-07-09T02:17:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.612+0000 7f68c9093640 1 -- 172.21.15.45:0/720031654 wait complete. 2023-07-09T02:17:02.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:17:02.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.788+0000 7fd9c0c34640 1 Processor -- start 2023-07-09T02:17:02.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.788+0000 7fd9c0c34640 1 -- start start 2023-07-09T02:17:02.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.788+0000 7fd9c0c34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9bc0adb10 0x7fd9bc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:02.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.788+0000 7fd9c0c34640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9bc0caf10 0x7fd9bc0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:02.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.788+0000 7fd9c0c34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc0b35c0 con 0x7fd9bc15a830 2023-07-09T02:17:02.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.788+0000 7fd9c0c34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc0b15d0 con 0x7fd9bc0adb10 2023-07-09T02:17:02.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.788+0000 7fd9c0c34640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc0b1890 con 0x7fd9bc0caf10 2023-07-09T02:17:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9bc0adb10 0x7fd9bc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9bc0adb10 0x7fd9bc0ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42106/0 (socket says 172.21.15.45:42106) 2023-07-09T02:17:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b3fff640 1 -- 172.21.15.45:0/425798149 learned_addr learned my addr 172.21.15.45:0/425798149 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9ba59c640 1 --1- 172.21.15.45:0/425798149 >> v1:172.21.15.45:6789/0 conn(0x7fd9bc15a830 0x7fd9bc15ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41630/0 (socket says 172.21.15.45:41630) 2023-07-09T02:17:02.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9bad9d640 1 --2- 172.21.15.45:0/425798149 >> v2:172.21.15.155:3300/0 conn(0x7fd9bc0caf10 0x7fd9bc0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:02.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b3fff640 1 -- 172.21.15.45:0/425798149 >> v2:172.21.15.155:3300/0 conn(0x7fd9bc0caf10 msgr2=0x7fd9bc0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:02.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b3fff640 1 --2- 172.21.15.45:0/425798149 >> v2:172.21.15.155:3300/0 conn(0x7fd9bc0caf10 0x7fd9bc0b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b3fff640 1 -- 172.21.15.45:0/425798149 >> v1:172.21.15.45:6789/0 conn(0x7fd9bc15a830 legacy=0x7fd9bc15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b3fff640 1 -- 172.21.15.45:0/425798149 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc0b3250 con 0x7fd9bc0adb10 2023-07-09T02:17:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9bad9d640 1 --2- 172.21.15.45:0/425798149 >> v2:172.21.15.155:3300/0 conn(0x7fd9bc0caf10 0x7fd9bc0b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:02.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b9d9b640 1 -- 172.21.15.45:0/425798149 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201488497 0 0) 0x7fd9bc0b35c0 con 0x7fd9bc15a830 2023-07-09T02:17:02.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b3fff640 1 --2- 172.21.15.45:0/425798149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0adb10 0x7fd9bc0ca9d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0b0540 tx=0x7fd9a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e7f48dd132baca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:02.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b9d9b640 1 -- 172.21.15.45:0/425798149 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40ab600 con 0x7fd9bc0adb10 2023-07-09T02:17:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b9d9b640 1 -- 172.21.15.45:0/425798149 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a40a7050 con 0x7fd9bc0adb10 2023-07-09T02:17:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.792+0000 7fd9b9d9b640 1 -- 172.21.15.45:0/425798149 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40ab980 con 0x7fd9bc0adb10 2023-07-09T02:17:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- 172.21.15.45:0/425798149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0adb10 msgr2=0x7fd9bc0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/425798149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0adb10 0x7fd9bc0ca9d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0b0540 tx=0x7fd9a401c500 comp rx=0 tx=0).stop 2023-07-09T02:17:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- 172.21.15.45:0/425798149 shutdown_connections 2023-07-09T02:17:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/425798149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0adb10 0x7fd9bc0ca9d0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/425798149 >> v2:172.21.15.155:3300/0 conn(0x7fd9bc0caf10 0x7fd9bc0b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- 172.21.15.45:0/425798149 >> 172.21.15.45:0/425798149 conn(0x7fd9bc06ae60 msgr2=0x7fd9bc06b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- 172.21.15.45:0/425798149 shutdown_connections 2023-07-09T02:17:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- 172.21.15.45:0/425798149 wait complete. 2023-07-09T02:17:02.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 Processor -- start 2023-07-09T02:17:02.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- start start 2023-07-09T02:17:02.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9bc0adb10 0x7fd9bc0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0caf10 0x7fd9bc155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9bc15a830 0x7fd9bc156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0c5540 con 0x7fd9bc0caf10 2023-07-09T02:17:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc157900 con 0x7fd9bc15a830 2023-07-09T02:17:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9c0c34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0c7e10 con 0x7fd9bc0adb10 2023-07-09T02:17:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0caf10 0x7fd9bc155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:02.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0caf10 0x7fd9bc155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42114/0 (socket says 172.21.15.45:42114) 2023-07-09T02:17:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9b3fff640 1 -- 172.21.15.45:0/3741613539 learned_addr learned my addr 172.21.15.45:0/3741613539 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9ba59c640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9bc0adb10 0x7fd9bc0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9bad9d640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9bc15a830 0x7fd9bc156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9b3fff640 1 -- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9bc0adb10 msgr2=0x7fd9bc0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9b3fff640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9bc0adb10 0x7fd9bc0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9b3fff640 1 -- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9bc15a830 msgr2=0x7fd9bc156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9b3fff640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9bc15a830 0x7fd9bc156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:02.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9b3fff640 1 -- 172.21.15.45:0/3741613539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a40094d0 con 0x7fd9bc0caf10 2023-07-09T02:17:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.796+0000 7fd9bad9d640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9bc15a830 0x7fd9bc156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9b3fff640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0caf10 0x7fd9bc155fe0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4019110 tx=0x7fd9a40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9b2ffd640 1 -- 172.21.15.45:0/3741613539 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40b37d0 con 0x7fd9bc0caf10 2023-07-09T02:17:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9b2ffd640 1 -- 172.21.15.45:0/3741613539 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a40b3930 con 0x7fd9bc0caf10 2023-07-09T02:17:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9b2ffd640 1 -- 172.21.15.45:0/3741613539 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40b3ca0 con 0x7fd9bc0caf10 2023-07-09T02:17:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc0c80f0 con 0x7fd9bc0caf10 2023-07-09T02:17:02.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc157bc0 con 0x7fd9bc0caf10 2023-07-09T02:17:02.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc04d7d0 con 0x7fd9bc0caf10 2023-07-09T02:17:02.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9b2ffd640 1 -- 172.21.15.45:0/3741613539 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9a40b2070 con 0x7fd9bc0caf10 2023-07-09T02:17:02.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9b2ffd640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd99c0662b0 0x7fd99c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:02.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9b2ffd640 1 -- 172.21.15.45:0/3741613539 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fd9a411dee0 con 0x7fd9bc0caf10 2023-07-09T02:17:02.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.800+0000 7fd9ba59c640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd99c0662b0 0x7fd99c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:02.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.804+0000 7fd9ba59c640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd99c0662b0 0x7fd99c068760 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac000f70 tx=0x7fd9ac007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:02.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.804+0000 7fd9b2ffd640 1 -- 172.21.15.45:0/3741613539 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9a40eb4b0 con 0x7fd9bc0caf10 2023-07-09T02:17:02.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:02.960+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd9bc165c20 con 0x7fd9bc0caf10 2023-07-09T02:17:03.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.608+0000 7fd9b2ffd640 1 -- 172.21.15.45:0/3741613539 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd9a40b00d0 con 0x7fd9bc0caf10 2023-07-09T02:17:03.611 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:17:03.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd99c0662b0 msgr2=0x7fd99c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd99c0662b0 0x7fd99c068760 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac000f70 tx=0x7fd9ac007c10 comp rx=0 tx=0).stop 2023-07-09T02:17:03.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0caf10 msgr2=0x7fd9bc155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0caf10 0x7fd9bc155fe0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4019110 tx=0x7fd9a40192a0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 shutdown_connections 2023-07-09T02:17:03.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9bc15a830 0x7fd9bc156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9bc0caf10 0x7fd9bc155fe0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd99c0662b0 0x7fd99c068760 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 --2- 172.21.15.45:0/3741613539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9bc0adb10 0x7fd9bc0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 >> 172.21.15.45:0/3741613539 conn(0x7fd9bc06ae60 msgr2=0x7fd9bc15ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:03.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 shutdown_connections 2023-07-09T02:17:03.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.612+0000 7fd9c0c34640 1 -- 172.21.15.45:0/3741613539 wait complete. 2023-07-09T02:17:03.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:17:03.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.780+0000 7fa293f11640 1 Processor -- start 2023-07-09T02:17:03.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.780+0000 7fa293f11640 1 -- start start 2023-07-09T02:17:03.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.780+0000 7fa293f11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c158e30 0x7fa28c06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:03.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.780+0000 7fa293f11640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0ccf80 con 0x7fa28c06fd10 2023-07-09T02:17:03.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.780+0000 7fa293f11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0cd540 con 0x7fa28c06c820 2023-07-09T02:17:03.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.780+0000 7fa293f11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0c8fb0 con 0x7fa28c158e30 2023-07-09T02:17:03.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.780+0000 7fa2914ac640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa28c06fd10 0x7fa28c06c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41636/0 (socket says 172.21.15.45:41636) 2023-07-09T02:17:03.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.780+0000 7fa2914ac640 1 -- 172.21.15.45:0/1868187563 learned_addr learned my addr 172.21.15.45:0/1868187563 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:03.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa291cad640 1 --2- 172.21.15.45:0/1868187563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c158e30 0x7fa28c06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:03.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa290cab640 1 -- 172.21.15.45:0/1868187563 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253279071 0 0) 0x7fa28c0ccf80 con 0x7fa28c06fd10 2023-07-09T02:17:03.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa290cab640 1 -- 172.21.15.45:0/1868187563 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa278003530 con 0x7fa28c06fd10 2023-07-09T02:17:03.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa290cab640 1 -- 172.21.15.45:0/1868187563 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671594929 0 0) 0x7fa28c0cd540 con 0x7fa28c06c820 2023-07-09T02:17:03.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa290cab640 1 -- 172.21.15.45:0/1868187563 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa28c0ccf80 con 0x7fa28c06c820 2023-07-09T02:17:03.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa291cad640 1 -- 172.21.15.45:0/1868187563 >> v1:172.21.15.155:6789/0 conn(0x7fa28c06c820 legacy=0x7fa28c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa290cab640 1 -- 172.21.15.45:0/1868187563 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2573774493 0 0) 0x7fa278003530 con 0x7fa28c06fd10 2023-07-09T02:17:03.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa291cad640 1 -- 172.21.15.45:0/1868187563 >> v1:172.21.15.45:6789/0 conn(0x7fa28c06fd10 legacy=0x7fa28c06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.784+0000 7fa291cad640 1 -- 172.21.15.45:0/1868187563 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0cbad0 con 0x7fa28c158e30 2023-07-09T02:17:03.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa291cad640 1 --2- 172.21.15.45:0/1868187563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c158e30 0x7fa28c06f7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2880097f0 tx=0x7fa28801c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea9abd28ff9b9a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:03.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa290cab640 1 -- 172.21.15.45:0/1868187563 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c001680 con 0x7fa28c158e30 2023-07-09T02:17:03.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa290cab640 1 -- 172.21.15.45:0/1868187563 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2880a7050 con 0x7fa28c158e30 2023-07-09T02:17:03.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa290cab640 1 -- 172.21.15.45:0/1868187563 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2880ab620 con 0x7fa28c158e30 2023-07-09T02:17:03.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- 172.21.15.45:0/1868187563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c158e30 msgr2=0x7fa28c06f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 --2- 172.21.15.45:0/1868187563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c158e30 0x7fa28c06f7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa2880097f0 tx=0x7fa28801c320 comp rx=0 tx=0).stop 2023-07-09T02:17:03.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- 172.21.15.45:0/1868187563 shutdown_connections 2023-07-09T02:17:03.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 --2- 172.21.15.45:0/1868187563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c158e30 0x7fa28c06f7d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- 172.21.15.45:0/1868187563 >> 172.21.15.45:0/1868187563 conn(0x7fa28c0694b0 msgr2=0x7fa28c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:03.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- 172.21.15.45:0/1868187563 shutdown_connections 2023-07-09T02:17:03.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- 172.21.15.45:0/1868187563 wait complete. 2023-07-09T02:17:03.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 Processor -- start 2023-07-09T02:17:03.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- start start 2023-07-09T02:17:03.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa28c06c820 0x7fa28c144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:03.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c06fd10 0x7fa28c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:03.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa28c158e30 0x7fa28c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:03.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c14de60 con 0x7fa28c158e30 2023-07-09T02:17:03.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c1453c0 con 0x7fa28c06c820 2023-07-09T02:17:03.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.788+0000 7fa293f11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c14cfc0 con 0x7fa28c06fd10 2023-07-09T02:17:03.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa28c158e30 0x7fa28c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:03.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa28c158e30 0x7fa28c1571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42130/0 (socket says 172.21.15.45:42130) 2023-07-09T02:17:03.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 -- 172.21.15.45:0/2468984279 learned_addr learned my addr 172.21.15.45:0/2468984279 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:03.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2914ac640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c06fd10 0x7fa28c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:03.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa291cad640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa28c06c820 0x7fa28c144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:03.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 -- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c06fd10 msgr2=0x7fa28c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c06fd10 0x7fa28c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 -- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa28c06c820 msgr2=0x7fa28c144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa28c06c820 0x7fa28c144e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 -- 172.21.15.45:0/2468984279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa288009420 con 0x7fa28c158e30 2023-07-09T02:17:03.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2924ae640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa28c158e30 0x7fa28c1571c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c730 tx=0x7fa28400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:03.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2827fc640 1 -- 172.21.15.45:0/2468984279 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284003b80 con 0x7fa28c158e30 2023-07-09T02:17:03.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2827fc640 1 -- 172.21.15.45:0/2468984279 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284003ce0 con 0x7fa28c158e30 2023-07-09T02:17:03.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c14d530 con 0x7fa28c158e30 2023-07-09T02:17:03.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2827fc640 1 -- 172.21.15.45:0/2468984279 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28400aa90 con 0x7fa28c158e30 2023-07-09T02:17:03.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c14daf0 con 0x7fa28c158e30 2023-07-09T02:17:03.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c14e010 con 0x7fa28c158e30 2023-07-09T02:17:03.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.792+0000 7fa2827fc640 1 -- 172.21.15.45:0/2468984279 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa28400abf0 con 0x7fa28c158e30 2023-07-09T02:17:03.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.796+0000 7fa2827fc640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa270066280 0x7fa270068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:03.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.796+0000 7fa2827fc640 1 -- 172.21.15.45:0/2468984279 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa2840837b0 con 0x7fa28c158e30 2023-07-09T02:17:03.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.796+0000 7fa291cad640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa270066280 0x7fa270068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:03.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.796+0000 7fa291cad640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa270066280 0x7fa270068730 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa2880ad000 tx=0x7fa288008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:03.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.796+0000 7fa2827fc640 1 -- 172.21.15.45:0/2468984279 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa28c14e010 con 0x7fa28c158e30 2023-07-09T02:17:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.952+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa28c04d7d0 con 0x7fa28c158e30 2023-07-09T02:17:03.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.956+0000 7fa2827fc640 1 -- 172.21.15.45:0/2468984279 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa284050f60 con 0x7fa28c158e30 2023-07-09T02:17:03.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa270066280 msgr2=0x7fa270068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa270066280 0x7fa270068730 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa2880ad000 tx=0x7fa288008040 comp rx=0 tx=0).stop 2023-07-09T02:17:03.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa28c158e30 msgr2=0x7fa28c1571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:03.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa28c158e30 0x7fa28c1571c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c730 tx=0x7fa28400cbf0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 shutdown_connections 2023-07-09T02:17:03.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa28c158e30 0x7fa28c1571c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa270066280 0x7fa270068730 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa28c06fd10 0x7fa28c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 --2- 172.21.15.45:0/2468984279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa28c06c820 0x7fa28c144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 >> 172.21.15.45:0/2468984279 conn(0x7fa28c0694b0 msgr2=0x7fa28c152420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 shutdown_connections 2023-07-09T02:17:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:03.960+0000 7fa293f11640 1 -- 172.21.15.45:0/2468984279 wait complete. 2023-07-09T02:17:03.980 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-07-09T02:17:04.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.120+0000 7fcb37e6d640 1 Processor -- start 2023-07-09T02:17:04.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.120+0000 7fcb37e6d640 1 -- start start 2023-07-09T02:17:04.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.120+0000 7fcb37e6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb3015c060 0x7fcb300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb37e6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcb300d2620 0x7fcb300cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb37e6d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb30160a50 con 0x7fcb300cd120 2023-07-09T02:17:04.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb37e6d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3015c430 con 0x7fcb300d2620 2023-07-09T02:17:04.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb37e6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3015fb60 con 0x7fcb3015c060 2023-07-09T02:17:04.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb3640a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcb300d2620 0x7fcb300cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb35c09640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb3015c060 0x7fcb300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb3640a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcb300d2620 0x7fcb300cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:45090/0 (socket says 172.21.15.45:45090) 2023-07-09T02:17:04.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb3640a640 1 -- 172.21.15.45:0/2501635008 learned_addr learned my addr 172.21.15.45:0/2501635008 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:04.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb3640a640 1 -- 172.21.15.45:0/2501635008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb3015c060 msgr2=0x7fcb300b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:04.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb3640a640 1 --2- 172.21.15.45:0/2501635008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb3015c060 0x7fcb300b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb3640a640 1 -- 172.21.15.45:0/2501635008 >> v1:172.21.15.155:6789/0 conn(0x7fcb300cd120 legacy=0x7fcb300d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb3640a640 1 -- 172.21.15.45:0/2501635008 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3015fe40 con 0x7fcb300d2620 2023-07-09T02:17:04.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb34c07640 1 -- 172.21.15.45:0/2501635008 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713103849 0 0) 0x7fcb30160a50 con 0x7fcb300cd120 2023-07-09T02:17:04.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.124+0000 7fcb35c09640 1 --2- 172.21.15.45:0/2501635008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb3015c060 0x7fcb300b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:04.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb3640a640 1 --2- 172.21.15.45:0/2501635008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300d2620 0x7fcb300cee30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009e80 tx=0x7fcb2801c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adb5df6fc7eb641a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:04.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb34c07640 1 -- 172.21.15.45:0/2501635008 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb280a5880 con 0x7fcb300d2620 2023-07-09T02:17:04.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb34c07640 1 -- 172.21.15.45:0/2501635008 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb280a59e0 con 0x7fcb300d2620 2023-07-09T02:17:04.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb34c07640 1 -- 172.21.15.45:0/2501635008 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb280a5d70 con 0x7fcb300d2620 2023-07-09T02:17:04.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 -- 172.21.15.45:0/2501635008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300d2620 msgr2=0x7fcb300cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/2501635008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300d2620 0x7fcb300cee30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009e80 tx=0x7fcb2801c9c0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 -- 172.21.15.45:0/2501635008 shutdown_connections 2023-07-09T02:17:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/2501635008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300d2620 0x7fcb300cee30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/2501635008 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb3015c060 0x7fcb300b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 -- 172.21.15.45:0/2501635008 >> 172.21.15.45:0/2501635008 conn(0x7fcb300698e0 msgr2=0x7fcb30069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 -- 172.21.15.45:0/2501635008 shutdown_connections 2023-07-09T02:17:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 -- 172.21.15.45:0/2501635008 wait complete. 2023-07-09T02:17:04.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 Processor -- start 2023-07-09T02:17:04.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.128+0000 7fcb37e6d640 1 -- start start 2023-07-09T02:17:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300cd120 0x7fcb3014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb300d2620 0x7fcb30152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb3015c060 0x7fcb3014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30153190 con 0x7fcb3015c060 2023-07-09T02:17:04.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30153930 con 0x7fcb300cd120 2023-07-09T02:17:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30153370 con 0x7fcb300d2620 2023-07-09T02:17:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb3015c060 0x7fcb3014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb3015c060 0x7fcb3014dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42136/0 (socket says 172.21.15.45:42136) 2023-07-09T02:17:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 -- 172.21.15.45:0/3603823963 learned_addr learned my addr 172.21.15.45:0/3603823963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb35c09640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300cd120 0x7fcb3014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb35408640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb300d2620 0x7fcb30152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 -- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb300d2620 msgr2=0x7fcb30152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb300d2620 0x7fcb30152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 -- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300cd120 msgr2=0x7fcb3014d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300cd120 0x7fcb3014d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 -- 172.21.15.45:0/3603823963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c009420 con 0x7fcb3015c060 2023-07-09T02:17:04.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb3640a640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb3015c060 0x7fcb3014dbf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fcb2801a5f0 tx=0x7fcb28019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:04.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb267fc640 1 -- 172.21.15.45:0/3603823963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28003ba0 con 0x7fcb3015c060 2023-07-09T02:17:04.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb267fc640 1 -- 172.21.15.45:0/3603823963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb28003d00 con 0x7fcb3015c060 2023-07-09T02:17:04.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb267fc640 1 -- 172.21.15.45:0/3603823963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28004250 con 0x7fcb3015c060 2023-07-09T02:17:04.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28009b30 con 0x7fcb3015c060 2023-07-09T02:17:04.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb300b59f0 con 0x7fcb3015c060 2023-07-09T02:17:04.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3004d7d0 con 0x7fcb3015c060 2023-07-09T02:17:04.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.132+0000 7fcb267fc640 1 -- 172.21.15.45:0/3603823963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb280043b0 con 0x7fcb3015c060 2023-07-09T02:17:04.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.136+0000 7fcb267fc640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb14066280 0x7fcb14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.136+0000 7fcb267fc640 1 -- 172.21.15.45:0/3603823963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcb2811e960 con 0x7fcb3015c060 2023-07-09T02:17:04.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.136+0000 7fcb35c09640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb14066280 0x7fcb14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.136+0000 7fcb35c09640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb14066280 0x7fcb14068730 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009c50 tx=0x7fcb2c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.140+0000 7fcb267fc640 1 -- 172.21.15.45:0/3603823963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb280ec340 con 0x7fcb3015c060 2023-07-09T02:17:04.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.352+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fcb3006baa0 con 0x7fcb3015c060 2023-07-09T02:17:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb267fc640 1 -- 172.21.15.45:0/3603823963 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v313) v1 ==== 137+0+0 (secure 0 0 0) 0x7fcb280ef960 con 0x7fcb3015c060 2023-07-09T02:17:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb14066280 msgr2=0x7fcb14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb14066280 0x7fcb14068730 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009c50 tx=0x7fcb2c009190 comp rx=0 tx=0).stop 2023-07-09T02:17:04.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb3015c060 msgr2=0x7fcb3014dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb3015c060 0x7fcb3014dbf0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fcb2801a5f0 tx=0x7fcb28019760 comp rx=0 tx=0).stop 2023-07-09T02:17:04.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 shutdown_connections 2023-07-09T02:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb3015c060 0x7fcb3014dbf0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcb14066280 0x7fcb14068730 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcb300d2620 0x7fcb30152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 --2- 172.21.15.45:0/3603823963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcb300cd120 0x7fcb3014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 >> 172.21.15.45:0/3603823963 conn(0x7fcb300698e0 msgr2=0x7fcb300b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 shutdown_connections 2023-07-09T02:17:04.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.620+0000 7fcb37e6d640 1 -- 172.21.15.45:0/3603823963 wait complete. 2023-07-09T02:17:04.644 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-07-09T02:17:04.644 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-07-09T02:17:04.645 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-07-09T02:17:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c994a640 1 Processor -- start 2023-07-09T02:17:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c994a640 1 -- start start 2023-07-09T02:17:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c994a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2c415c870 0x7fe2c40b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c994a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2c40b1b50 0x7fe2c406b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c994a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c406bbb0 con 0x7fe2c406b780 2023-07-09T02:17:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c994a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c40d1d80 con 0x7fe2c415c870 2023-07-09T02:17:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c994a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c40b2090 con 0x7fe2c40b1b50 2023-07-09T02:17:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c8948640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2c415c870 0x7fe2c40b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c8948640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2c415c870 0x7fe2c40b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42150/0 (socket says 172.21.15.45:42150) 2023-07-09T02:17:04.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c8948640 1 -- 172.21.15.45:0/3722081524 learned_addr learned my addr 172.21.15.45:0/3722081524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:04.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c9149640 1 --1- 172.21.15.45:0/3722081524 >> v1:172.21.15.45:6789/0 conn(0x7fe2c406b780 0x7fe2c40d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41640/0 (socket says 172.21.15.45:41640) 2023-07-09T02:17:04.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c3fff640 1 --2- 172.21.15.45:0/3722081524 >> v2:172.21.15.155:3300/0 conn(0x7fe2c40b1b50 0x7fe2c406b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c8948640 1 -- 172.21.15.45:0/3722081524 >> v2:172.21.15.155:3300/0 conn(0x7fe2c40b1b50 msgr2=0x7fe2c406b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:04.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c8948640 1 --2- 172.21.15.45:0/3722081524 >> v2:172.21.15.155:3300/0 conn(0x7fe2c40b1b50 0x7fe2c406b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c8948640 1 -- 172.21.15.45:0/3722081524 >> v1:172.21.15.45:6789/0 conn(0x7fe2c406b780 legacy=0x7fe2c40d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c8948640 1 -- 172.21.15.45:0/3722081524 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4160520 con 0x7fe2c415c870 2023-07-09T02:17:04.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c3fff640 1 --2- 172.21.15.45:0/3722081524 >> v2:172.21.15.155:3300/0 conn(0x7fe2c40b1b50 0x7fe2c406b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:04.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.788+0000 7fe2c37fe640 1 -- 172.21.15.45:0/3722081524 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436505794 0 0) 0x7fe2c406bbb0 con 0x7fe2c406b780 2023-07-09T02:17:04.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c8948640 1 --2- 172.21.15.45:0/3722081524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c415c870 0x7fe2c40b1610 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40717b0 tx=0x7fe2b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301573c86073c614 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:04.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c37fe640 1 -- 172.21.15.45:0/3722081524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80ab5f0 con 0x7fe2c415c870 2023-07-09T02:17:04.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c37fe640 1 -- 172.21.15.45:0/3722081524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b80ab750 con 0x7fe2c415c870 2023-07-09T02:17:04.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c37fe640 1 -- 172.21.15.45:0/3722081524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80abae0 con 0x7fe2c415c870 2023-07-09T02:17:04.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 -- 172.21.15.45:0/3722081524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c415c870 msgr2=0x7fe2c40b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3722081524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c415c870 0x7fe2c40b1610 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40717b0 tx=0x7fe2b801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 -- 172.21.15.45:0/3722081524 shutdown_connections 2023-07-09T02:17:04.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3722081524 >> v2:172.21.15.155:3300/0 conn(0x7fe2c40b1b50 0x7fe2c406b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3722081524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c415c870 0x7fe2c40b1610 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 -- 172.21.15.45:0/3722081524 >> 172.21.15.45:0/3722081524 conn(0x7fe2c4070be0 msgr2=0x7fe2c4070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:04.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 -- 172.21.15.45:0/3722081524 shutdown_connections 2023-07-09T02:17:04.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 -- 172.21.15.45:0/3722081524 wait complete. 2023-07-09T02:17:04.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.792+0000 7fe2c994a640 1 Processor -- start 2023-07-09T02:17:04.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 -- start start 2023-07-09T02:17:04.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c406b780 0x7fe2c414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c40b1b50 0x7fe2c414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2c415c870 0x7fe2c415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40cb050 con 0x7fe2c406b780 2023-07-09T02:17:04.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40cc990 con 0x7fe2c40b1b50 2023-07-09T02:17:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c4154820 con 0x7fe2c415c870 2023-07-09T02:17:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c406b780 0x7fe2c414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c406b780 0x7fe2c414db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42158/0 (socket says 172.21.15.45:42158) 2023-07-09T02:17:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 -- 172.21.15.45:0/3960218556 learned_addr learned my addr 172.21.15.45:0/3960218556 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c3fff640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c40b1b50 0x7fe2c414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c9149640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2c415c870 0x7fe2c415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 -- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2c415c870 msgr2=0x7fe2c415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2c415c870 0x7fe2c415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 -- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c40b1b50 msgr2=0x7fe2c414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c40b1b50 0x7fe2c414e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 -- 172.21.15.45:0/3960218556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b80094d0 con 0x7fe2c406b780 2023-07-09T02:17:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c8948640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c406b780 0x7fe2c414db60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80ad040 tx=0x7fe2b801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c17fa640 1 -- 172.21.15.45:0/3960218556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80abe10 con 0x7fe2c406b780 2023-07-09T02:17:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c17fa640 1 -- 172.21.15.45:0/3960218556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b80b8070 con 0x7fe2c406b780 2023-07-09T02:17:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c4154b00 con 0x7fe2c406b780 2023-07-09T02:17:04.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c17fa640 1 -- 172.21.15.45:0/3960218556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8004240 con 0x7fe2c406b780 2023-07-09T02:17:04.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c41550c0 con 0x7fe2c406b780 2023-07-09T02:17:04.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.796+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c404e020 con 0x7fe2c406b780 2023-07-09T02:17:04.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.800+0000 7fe2c17fa640 1 -- 172.21.15.45:0/3960218556 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2b80043a0 con 0x7fe2c406b780 2023-07-09T02:17:04.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.800+0000 7fe2c17fa640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2a80662b0 0x7fe2a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:04.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.800+0000 7fe2c17fa640 1 -- 172.21.15.45:0/3960218556 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe2b80a8050 con 0x7fe2c406b780 2023-07-09T02:17:04.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.800+0000 7fe2c3fff640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2a80662b0 0x7fe2a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:04.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.800+0000 7fe2c3fff640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2a80662b0 0x7fe2a8068760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4150720 tx=0x7fe2b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:04.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:04.804+0000 7fe2c17fa640 1 -- 172.21.15.45:0/3960218556 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2b80eb1d0 con 0x7fe2c406b780 2023-07-09T02:17:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.020+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fe2c40cfef0 con 0x7fe2c406b780 2023-07-09T02:17:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.620+0000 7fe2c17fa640 1 -- 172.21.15.45:0/3960218556 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v314) v1 ==== 131+0+0 (secure 0 0 0) 0x7fe2b80ba020 con 0x7fe2c406b780 2023-07-09T02:17:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2a80662b0 msgr2=0x7fe2a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2a80662b0 0x7fe2a8068760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4150720 tx=0x7fe2b0008040 comp rx=0 tx=0).stop 2023-07-09T02:17:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c406b780 msgr2=0x7fe2c414db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c406b780 0x7fe2c414db60 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80ad040 tx=0x7fe2b801ad10 comp rx=0 tx=0).stop 2023-07-09T02:17:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 shutdown_connections 2023-07-09T02:17:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2a80662b0 0x7fe2a8068760 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2c415c870 0x7fe2c415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c40b1b50 0x7fe2c414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 --2- 172.21.15.45:0/3960218556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2c406b780 0x7fe2c414db60 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 >> 172.21.15.45:0/3960218556 conn(0x7fe2c4070be0 msgr2=0x7fe2c415d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:05.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 shutdown_connections 2023-07-09T02:17:05.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.624+0000 7fe2c994a640 1 -- 172.21.15.45:0/3960218556 wait complete. 2023-07-09T02:17:05.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:17:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.792+0000 7fc783f82640 1 Processor -- start 2023-07-09T02:17:05.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.792+0000 7fc783f82640 1 -- start start 2023-07-09T02:17:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc783f82640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc77c0d2620 0x7fc77c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc783f82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c0cd120 0x7fc77c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc783f82640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c160a50 con 0x7fc77c15c060 2023-07-09T02:17:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc783f82640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c15c430 con 0x7fc77c0d2620 2023-07-09T02:17:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc783f82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15fb60 con 0x7fc77c0cd120 2023-07-09T02:17:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78151d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc77c0d2620 0x7fc77c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78151d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc77c0d2620 0x7fc77c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42164/0 (socket says 172.21.15.45:42164) 2023-07-09T02:17:05.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc781d1e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc77c15c060 0x7fc77c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41656/0 (socket says 172.21.15.45:41656) 2023-07-09T02:17:05.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78151d640 1 -- 172.21.15.45:0/3832664817 learned_addr learned my addr 172.21.15.45:0/3832664817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:05.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78151d640 1 -- 172.21.15.45:0/3832664817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c0cd120 msgr2=0x7fc77c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:05.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78251f640 1 --2- 172.21.15.45:0/3832664817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c0cd120 0x7fc77c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:05.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc780d1c640 1 -- 172.21.15.45:0/3832664817 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257222309 0 0) 0x7fc77c160a50 con 0x7fc77c15c060 2023-07-09T02:17:05.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78151d640 1 --2- 172.21.15.45:0/3832664817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c0cd120 0x7fc77c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78151d640 1 -- 172.21.15.45:0/3832664817 >> v1:172.21.15.45:6789/0 conn(0x7fc77c15c060 legacy=0x7fc77c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:05.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78151d640 1 -- 172.21.15.45:0/3832664817 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c15fe40 con 0x7fc77c0d2620 2023-07-09T02:17:05.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.796+0000 7fc78251f640 1 --2- 172.21.15.45:0/3832664817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c0cd120 0x7fc77c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc78151d640 1 --2- 172.21.15.45:0/3832664817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c0b4ed0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009870 tx=0x7fc76c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7642d98be4a74805 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc780d1c640 1 -- 172.21.15.45:0/3832664817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0aa670 con 0x7fc77c0d2620 2023-07-09T02:17:05.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc780d1c640 1 -- 172.21.15.45:0/3832664817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c0aa7d0 con 0x7fc77c0d2620 2023-07-09T02:17:05.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc780d1c640 1 -- 172.21.15.45:0/3832664817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0aab60 con 0x7fc77c0d2620 2023-07-09T02:17:05.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 -- 172.21.15.45:0/3832664817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 msgr2=0x7fc77c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:05.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 --2- 172.21.15.45:0/3832664817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c0b4ed0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009870 tx=0x7fc76c01c510 comp rx=0 tx=0).stop 2023-07-09T02:17:05.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 -- 172.21.15.45:0/3832664817 shutdown_connections 2023-07-09T02:17:05.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 --2- 172.21.15.45:0/3832664817 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c0cd120 0x7fc77c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 --2- 172.21.15.45:0/3832664817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c0b4ed0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 -- 172.21.15.45:0/3832664817 >> 172.21.15.45:0/3832664817 conn(0x7fc77c0698e0 msgr2=0x7fc77c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:05.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 -- 172.21.15.45:0/3832664817 shutdown_connections 2023-07-09T02:17:05.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 -- 172.21.15.45:0/3832664817 wait complete. 2023-07-09T02:17:05.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 Processor -- start 2023-07-09T02:17:05.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.800+0000 7fc783f82640 1 -- start start 2023-07-09T02:17:05.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0cd120 0x7fc77c15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:05.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:05.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c15c060 0x7fc77c0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:05.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15e450 con 0x7fc77c0d2620 2023-07-09T02:17:05.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15e870 con 0x7fc77c0cd120 2023-07-09T02:17:05.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15d7d0 con 0x7fc77c15c060 2023-07-09T02:17:05.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:05.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c1540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42166/0 (socket says 172.21.15.45:42166) 2023-07-09T02:17:05.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 -- 172.21.15.45:0/2052202606 learned_addr learned my addr 172.21.15.45:0/2052202606 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:05.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78251f640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c15c060 0x7fc77c0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:05.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc781d1e640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0cd120 0x7fc77c15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:05.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 -- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c15c060 msgr2=0x7fc77c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:05.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c15c060 0x7fc77c0ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 -- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0cd120 msgr2=0x7fc77c15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0cd120 0x7fc77c15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 -- 172.21.15.45:0/2052202606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0094d0 con 0x7fc77c0d2620 2023-07-09T02:17:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc78151d640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c1540e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0ac040 tx=0x7fc76c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc7727fc640 1 -- 172.21.15.45:0/2052202606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c004020 con 0x7fc77c0d2620 2023-07-09T02:17:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc7727fc640 1 -- 172.21.15.45:0/2052202606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c0b7070 con 0x7fc77c0d2620 2023-07-09T02:17:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc7727fc640 1 -- 172.21.15.45:0/2052202606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c004380 con 0x7fc77c0d2620 2023-07-09T02:17:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c0b59f0 con 0x7fc77c0d2620 2023-07-09T02:17:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c15dd90 con 0x7fc77c0d2620 2023-07-09T02:17:05.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c15e590 con 0x7fc77c0d2620 2023-07-09T02:17:05.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.804+0000 7fc7727fc640 1 -- 172.21.15.45:0/2052202606 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc76c003620 con 0x7fc77c0d2620 2023-07-09T02:17:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.808+0000 7fc7727fc640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc760066280 0x7fc760068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.808+0000 7fc7727fc640 1 -- 172.21.15.45:0/2052202606 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc76c11dff0 con 0x7fc77c0d2620 2023-07-09T02:17:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.808+0000 7fc781d1e640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc760066280 0x7fc760068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.808+0000 7fc781d1e640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc760066280 0x7fc760068730 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f70 tx=0x7fc778007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:05.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.812+0000 7fc7727fc640 1 -- 172.21.15.45:0/2052202606 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc77c15e590 con 0x7fc77c0d2620 2023-07-09T02:17:05.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.968+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc77c15e590 con 0x7fc77c0d2620 2023-07-09T02:17:05.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.972+0000 7fc7727fc640 1 -- 172.21.15.45:0/2052202606 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc77c15e590 con 0x7fc77c0d2620 2023-07-09T02:17:05.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc760066280 msgr2=0x7fc760068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:05.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc760066280 0x7fc760068730 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f70 tx=0x7fc778007df0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 msgr2=0x7fc77c1540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:05.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c1540e0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0ac040 tx=0x7fc76c01ad50 comp rx=0 tx=0).stop 2023-07-09T02:17:05.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 shutdown_connections 2023-07-09T02:17:05.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc760066280 0x7fc760068730 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc77c15c060 0x7fc77c0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc77c0d2620 0x7fc77c1540e0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 --2- 172.21.15.45:0/2052202606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc77c0cd120 0x7fc77c15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:05.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 >> 172.21.15.45:0/2052202606 conn(0x7fc77c0698e0 msgr2=0x7fc77c0b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:05.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 shutdown_connections 2023-07-09T02:17:05.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:05.976+0000 7fc783f82640 1 -- 172.21.15.45:0/2052202606 wait complete. 2023-07-09T02:17:05.996 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:17:05.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:17:06.063 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:17:06.135 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:17:06.135 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:06.136 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:06.145 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:17:06.145 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:06.146 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:06.155 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:17:06.155 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:06.156 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:06.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:17:06.200 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:06.200 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:06.209 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:17:06.210 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:17:06.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:06.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7d1eec640 1 Processor -- start 2023-07-09T02:17:06.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7d1eec640 1 -- start start 2023-07-09T02:17:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7d1eec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7cc15c060 0x7ff7cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7d1eec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7cc0d2620 0x7ff7cc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7d1eec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc160a50 con 0x7ff7cc0cd120 2023-07-09T02:17:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7d1eec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc15c430 con 0x7ff7cc0d2620 2023-07-09T02:17:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7d1eec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc15fb60 con 0x7ff7cc15c060 2023-07-09T02:17:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7cbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7cc0d2620 0x7ff7cc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7cbfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7cc0d2620 0x7ff7cc0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42172/0 (socket says 172.21.15.45:42172) 2023-07-09T02:17:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7cbfff640 1 -- 172.21.15.45:0/58473215 learned_addr learned my addr 172.21.15.45:0/58473215 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7caffd640 1 --1- 172.21.15.45:0/58473215 >> v1:172.21.15.45:6789/0 conn(0x7ff7cc0cd120 0x7ff7cc0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41670/0 (socket says 172.21.15.45:41670) 2023-07-09T02:17:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7cb7fe640 1 --2- 172.21.15.45:0/58473215 >> v2:172.21.15.155:3300/0 conn(0x7ff7cc15c060 0x7ff7cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7cbfff640 1 -- 172.21.15.45:0/58473215 >> v2:172.21.15.155:3300/0 conn(0x7ff7cc15c060 msgr2=0x7ff7cc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7cbfff640 1 --2- 172.21.15.45:0/58473215 >> v2:172.21.15.155:3300/0 conn(0x7ff7cc15c060 0x7ff7cc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7cbfff640 1 -- 172.21.15.45:0/58473215 >> v1:172.21.15.45:6789/0 conn(0x7ff7cc0cd120 legacy=0x7ff7cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.384+0000 7ff7cbfff640 1 -- 172.21.15.45:0/58473215 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc15fe40 con 0x7ff7cc0d2620 2023-07-09T02:17:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7cbfff640 1 --2- 172.21.15.45:0/58473215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0d2620 0x7ff7cc0cee30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0d3ad0 tx=0x7ff7c401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774b05eddfba01d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7ca7fc640 1 -- 172.21.15.45:0/58473215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40a5860 con 0x7ff7cc0d2620 2023-07-09T02:17:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7ca7fc640 1 -- 172.21.15.45:0/58473215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40a59c0 con 0x7ff7cc0d2620 2023-07-09T02:17:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7ca7fc640 1 -- 172.21.15.45:0/58473215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40a5d50 con 0x7ff7cc0d2620 2023-07-09T02:17:06.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7d1eec640 1 -- 172.21.15.45:0/58473215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0d2620 msgr2=0x7ff7cc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/58473215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0d2620 0x7ff7cc0cee30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0d3ad0 tx=0x7ff7c401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7d1eec640 1 -- 172.21.15.45:0/58473215 shutdown_connections 2023-07-09T02:17:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/58473215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0d2620 0x7ff7cc0cee30 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/58473215 >> v2:172.21.15.155:3300/0 conn(0x7ff7cc15c060 0x7ff7cc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7d1eec640 1 -- 172.21.15.45:0/58473215 >> 172.21.15.45:0/58473215 conn(0x7ff7cc0698e0 msgr2=0x7ff7cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7d1eec640 1 -- 172.21.15.45:0/58473215 shutdown_connections 2023-07-09T02:17:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.388+0000 7ff7d1eec640 1 -- 172.21.15.45:0/58473215 wait complete. 2023-07-09T02:17:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 Processor -- start 2023-07-09T02:17:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 -- start start 2023-07-09T02:17:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0cd120 0x7ff7cc0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7cc0d2620 0x7ff7cc15e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7cc15c060 0x7ff7cc0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c9b10 con 0x7ff7cc0cd120 2023-07-09T02:17:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0c9df0 con 0x7ff7cc15c060 2023-07-09T02:17:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0ca0d0 con 0x7ff7cc0d2620 2023-07-09T02:17:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0cd120 0x7ff7cc0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0cd120 0x7ff7cc0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42184/0 (socket says 172.21.15.45:42184) 2023-07-09T02:17:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 -- 172.21.15.45:0/3515399091 learned_addr learned my addr 172.21.15.45:0/3515399091 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 -- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7cc0d2620 msgr2=0x7ff7cc15e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7cc0d2620 0x7ff7cc15e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 -- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7cc15c060 msgr2=0x7ff7cc0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7cc15c060 0x7ff7cc0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 -- 172.21.15.45:0/3515399091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4009b30 con 0x7ff7cc0cd120 2023-07-09T02:17:06.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7cb7fe640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0cd120 0x7ff7cc0cc2c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00d5f0 tx=0x7ff7bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:06.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7b3fff640 1 -- 172.21.15.45:0/3515399091 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0125f0 con 0x7ff7cc0cd120 2023-07-09T02:17:06.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7b3fff640 1 -- 172.21.15.45:0/3515399091 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc012750 con 0x7ff7cc0cd120 2023-07-09T02:17:06.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7b3fff640 1 -- 172.21.15.45:0/3515399091 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc012ae0 con 0x7ff7cc0cd120 2023-07-09T02:17:06.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc0b59f0 con 0x7ff7cc0cd120 2023-07-09T02:17:06.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.392+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc0ca970 con 0x7ff7cc0cd120 2023-07-09T02:17:06.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.396+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc0ca4f0 con 0x7ff7cc0cd120 2023-07-09T02:17:06.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.396+0000 7ff7b3fff640 1 -- 172.21.15.45:0/3515399091 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7bc012c40 con 0x7ff7cc0cd120 2023-07-09T02:17:06.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.396+0000 7ff7b3fff640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7b8066280 0x7ff7b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.396+0000 7ff7b3fff640 1 -- 172.21.15.45:0/3515399091 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff7bc083fd0 con 0x7ff7cc0cd120 2023-07-09T02:17:06.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.396+0000 7ff7caffd640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7b8066280 0x7ff7b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.400+0000 7ff7caffd640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7b8066280 0x7ff7b8068730 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc166e50 tx=0x7ff7c00079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:06.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.400+0000 7ff7b3fff640 1 -- 172.21.15.45:0/3515399091 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7cc0ca4f0 con 0x7ff7cc0cd120 2023-07-09T02:17:06.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.588+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7cc0ca4f0 con 0x7ff7cc0cd120 2023-07-09T02:17:06.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.588+0000 7ff7b3fff640 1 -- 172.21.15.45:0/3515399091 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3532 (secure 0 0 0) 0x7ff7cc0ca4f0 con 0x7ff7cc0cd120 2023-07-09T02:17:06.592 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:06.592 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5972,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1324004192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1324004192},{"type":"v1","addr":"172.21.15.155:6837","nonce":1324004192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6535,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2041590616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2041590616},{"type":"v1","addr":"172.21.15.155:6835","nonce":2041590616}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6936,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1210117315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1210117315},{"type":"v1","addr":"172.21.15.45:6834","nonce":1210117315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7308,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/631702578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":631702578},{"type":"v1","addr":"172.21.15.45:6835","nonce":631702578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[]} 2023-07-09T02:17:06.592 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 53 2023-07-09T02:17:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7b8066280 msgr2=0x7ff7b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7b8066280 0x7ff7b8068730 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc166e50 tx=0x7ff7c00079d0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0cd120 msgr2=0x7ff7cc0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0cd120 0x7ff7cc0cc2c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00d5f0 tx=0x7ff7bc00dab0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 shutdown_connections 2023-07-09T02:17:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7cc15c060 0x7ff7cc0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff7b8066280 0x7ff7b8068730 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7cc0d2620 0x7ff7cc15e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 --2- 172.21.15.45:0/3515399091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc0cd120 0x7ff7cc0cc2c0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 >> 172.21.15.45:0/3515399091 conn(0x7ff7cc0698e0 msgr2=0x7ff7cc158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 shutdown_connections 2023-07-09T02:17:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.592+0000 7ff7d1eec640 1 -- 172.21.15.45:0/3515399091 wait complete. 2023-07-09T02:17:06.614 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:17:06.615 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:17:06.615 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:17:06.616 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:17:06.616 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:17:06.617 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:17:06.617 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:17:06.618 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:17:06.618 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:17:06.619 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:17:06.619 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:17:06.620 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:17:06.620 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:17:06.621 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:17:06.621 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:17:06.622 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:17:06.629 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:17:06.629 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:17:06.631 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:17:06.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:17:06.637 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:17:06.637 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:17:06.639 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:17:06.639 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:17:06.678 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:17:06.679 DEBUG:teuthology.parallel:result is None 2023-07-09T02:17:06.681 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:17:06.682 DEBUG:teuthology.parallel:result is None 2023-07-09T02:17:06.687 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:17:06.687 DEBUG:teuthology.parallel:result is None 2023-07-09T02:17:06.689 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:17:06.689 DEBUG:teuthology.parallel:result is None 2023-07-09T02:17:06.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:17:06.767 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:17:06.772 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:17:06.779 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:17:06.780 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:17:06.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f7995d2c640 1 Processor -- start 2023-07-09T02:17:06.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f7995d2c640 1 -- start start 2023-07-09T02:17:06.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f7995d2c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f799015c060 0x7f79900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f7995d2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79900d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f7995d2c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79900d2450 0x7f79900d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f7995d2c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79900d28f0 con 0x7f79900d2450 2023-07-09T02:17:06.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f7995d2c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7990160a50 con 0x7f799015c060 2023-07-09T02:17:06.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f7995d2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799015c430 con 0x7f79900cd120 2023-07-09T02:17:06.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f798ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79900d2450 0x7f79900d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f798ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79900d2450 0x7f79900d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42216/0 (socket says 172.21.15.45:42216) 2023-07-09T02:17:06.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f798ffff640 1 -- 172.21.15.45:0/1662666079 learned_addr learned my addr 172.21.15.45:0/1662666079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:06.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-09T02:17:06.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.836+0000 7f798f7fe640 1 --2- 172.21.15.45:0/1662666079 >> v2:172.21.15.155:3300/0 conn(0x7f799015c060 0x7f79900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798effd640 1 --2- 172.21.15.45:0/1662666079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79900d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798ffff640 1 -- 172.21.15.45:0/1662666079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 msgr2=0x7f79900d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:06.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798ffff640 1 --2- 172.21.15.45:0/1662666079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79900d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798ffff640 1 -- 172.21.15.45:0/1662666079 >> v2:172.21.15.155:3300/0 conn(0x7f799015c060 msgr2=0x7f79900b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:06.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798ffff640 1 --2- 172.21.15.45:0/1662666079 >> v2:172.21.15.155:3300/0 conn(0x7f799015c060 0x7f79900b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798ffff640 1 -- 172.21.15.45:0/1662666079 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799015fb60 con 0x7f79900d2450 2023-07-09T02:17:06.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798effd640 1 --2- 172.21.15.45:0/1662666079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79900d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:06.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798ffff640 1 --2- 172.21.15.45:0/1662666079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79900d2450 0x7f79900d0610 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f79900d3ad0 tx=0x7f798801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf8ad6b60a3f932 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:06.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798e7fc640 1 -- 172.21.15.45:0/1662666079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79880a5560 con 0x7f79900d2450 2023-07-09T02:17:06.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798e7fc640 1 -- 172.21.15.45:0/1662666079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79880a56c0 con 0x7f79900d2450 2023-07-09T02:17:06.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f798e7fc640 1 -- 172.21.15.45:0/1662666079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79880a5a50 con 0x7f79900d2450 2023-07-09T02:17:06.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f7995d2c640 1 -- 172.21.15.45:0/1662666079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79900d2450 msgr2=0x7f79900d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f7995d2c640 1 --2- 172.21.15.45:0/1662666079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79900d2450 0x7f79900d0610 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f79900d3ad0 tx=0x7f798801c6e0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f7995d2c640 1 -- 172.21.15.45:0/1662666079 shutdown_connections 2023-07-09T02:17:06.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f7995d2c640 1 --2- 172.21.15.45:0/1662666079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79900d2450 0x7f79900d0610 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f7995d2c640 1 --2- 172.21.15.45:0/1662666079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79900d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f7995d2c640 1 --2- 172.21.15.45:0/1662666079 >> v2:172.21.15.155:3300/0 conn(0x7f799015c060 0x7f79900b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.840+0000 7f7995d2c640 1 -- 172.21.15.45:0/1662666079 >> 172.21.15.45:0/1662666079 conn(0x7f79900698e0 msgr2=0x7f7990069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:06.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 -- 172.21.15.45:0/1662666079 shutdown_connections 2023-07-09T02:17:06.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 -- 172.21.15.45:0/1662666079 wait complete. 2023-07-09T02:17:06.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 Processor -- start 2023-07-09T02:17:06.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 -- start start 2023-07-09T02:17:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79901f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79900d2450 0x7f79900caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f799015c060 0x7f79900b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79900b70f0 con 0x7f799015c060 2023-07-09T02:17:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79901f89d0 con 0x7f79900d2450 2023-07-09T02:17:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f7995d2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79900b6d30 con 0x7f79900cd120 2023-07-09T02:17:06.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f799015c060 0x7f79900b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79900d2450 0x7f79900caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f799015c060 0x7f79900b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42226/0 (socket says 172.21.15.45:42226) 2023-07-09T02:17:06.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798ffff640 1 -- 172.21.15.45:0/3751810829 learned_addr learned my addr 172.21.15.45:0/3751810829 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:06.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798f7fe640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79901f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798ffff640 1 -- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 msgr2=0x7f79901f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798ffff640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79901f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798ffff640 1 -- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79900d2450 msgr2=0x7f79900caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:06.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798ffff640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79900d2450 0x7f79900caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:06.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798ffff640 1 -- 172.21.15.45:0/3751810829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988009b30 con 0x7f799015c060 2023-07-09T02:17:06.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798effd640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79900d2450 0x7f79900caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:06.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.844+0000 7f798f7fe640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79901f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:06.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f798ffff640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f799015c060 0x7f79900b40b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f798801ad90 tx=0x7f7988019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:06.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f7977fff640 1 -- 172.21.15.45:0/3751810829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79880b8670 con 0x7f799015c060 2023-07-09T02:17:06.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f7977fff640 1 -- 172.21.15.45:0/3751810829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79880b87f0 con 0x7f799015c060 2023-07-09T02:17:06.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f7977fff640 1 -- 172.21.15.45:0/3751810829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79880b8ba0 con 0x7f799015c060 2023-07-09T02:17:06.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7990158380 con 0x7f799015c060 2023-07-09T02:17:06.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7990157fe0 con 0x7f799015c060 2023-07-09T02:17:06.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79900b7230 con 0x7f799015c060 2023-07-09T02:17:06.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f7977fff640 1 -- 172.21.15.45:0/3751810829 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79880b8d00 con 0x7f799015c060 2023-07-09T02:17:06.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.848+0000 7f7977fff640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f797c0662b0 0x7f797c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:06.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.852+0000 7f7977fff640 1 -- 172.21.15.45:0/3751810829 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f798811e690 con 0x7f799015c060 2023-07-09T02:17:06.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.852+0000 7f798f7fe640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f797c0662b0 0x7f797c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:06.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.852+0000 7f798f7fe640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f797c0662b0 0x7f797c068760 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7980007db0 tx=0x7f7980008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:06.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:06.852+0000 7f7977fff640 1 -- 172.21.15.45:0/3751810829 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79900b7230 con 0x7f799015c060 2023-07-09T02:17:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:07.028+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f79900b7230 con 0x7f799015c060 2023-07-09T02:17:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:07.996+0000 7f7977fff640 1 -- 172.21.15.45:0/3751810829 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v119) v1 ==== 97+0+0 (secure 0 0 0) 0x7f79900b7230 con 0x7f799015c060 2023-07-09T02:17:07.999 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:17:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f797c0662b0 msgr2=0x7f797c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f797c0662b0 0x7f797c068760 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7980007db0 tx=0x7f7980008040 comp rx=0 tx=0).stop 2023-07-09T02:17:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f799015c060 msgr2=0x7f79900b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f799015c060 0x7f79900b40b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f798801ad90 tx=0x7f7988019480 comp rx=0 tx=0).stop 2023-07-09T02:17:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 shutdown_connections 2023-07-09T02:17:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f799015c060 0x7f79900b40b0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79900d2450 0x7f79900caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f797c0662b0 0x7f797c068760 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 --2- 172.21.15.45:0/3751810829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79900cd120 0x7f79901f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 >> 172.21.15.45:0/3751810829 conn(0x7f79900698e0 msgr2=0x7f79900b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 shutdown_connections 2023-07-09T02:17:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.000+0000 7f7995d2c640 1 -- 172.21.15.45:0/3751810829 wait complete. 2023-07-09T02:17:08.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:17:08.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299cb11640 1 Processor -- start 2023-07-09T02:17:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299cb11640 1 -- start start 2023-07-09T02:17:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299cb11640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f299815c060 0x7f29980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299cb11640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2998160a50 con 0x7f29980cd120 2023-07-09T02:17:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299cb11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299815c430 con 0x7f29980d2620 2023-07-09T02:17:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299cb11640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299815fb60 con 0x7f299815c060 2023-07-09T02:17:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f298ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f29980cd120 0x7f29980d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41690/0 (socket says 172.21.15.45:41690) 2023-07-09T02:17:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f298ffff640 1 -- 172.21.15.45:0/753860869 learned_addr learned my addr 172.21.15.45:0/753860869 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299659c640 1 --2- 172.21.15.45:0/753860869 >> v2:172.21.15.155:3300/0 conn(0x7f299815c060 0x7f29980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121459202 0 0) 0x7f2998160a50 con 0x7f29980cd120 2023-07-09T02:17:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2984003530 con 0x7f29980cd120 2023-07-09T02:17:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 289364598 0 0) 0x7f2984003530 con 0x7f29980cd120 2023-07-09T02:17:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 >> v2:172.21.15.155:3300/0 conn(0x7f299815c060 msgr2=0x7f29980b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 --2- 172.21.15.45:0/753860869 >> v2:172.21.15.155:3300/0 conn(0x7f299815c060 0x7f29980b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 >> v1:172.21.15.155:6789/0 conn(0x7f29980d2620 legacy=0x7f29980cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299815fe40 con 0x7f29980cd120 2023-07-09T02:17:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f2980001680 con 0x7f29980cd120 2023-07-09T02:17:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 >> v1:172.21.15.45:6789/0 conn(0x7f29980cd120 legacy=0x7f29980d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2984003980 0x7f2984003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29840047d0 0x7f2984004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984005180 0x7f298400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299815fb60 con 0x7f2984003980 2023-07-09T02:17:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298400c000 con 0x7f29840047d0 2023-07-09T02:17:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298400c1c0 con 0x7f2984005180 2023-07-09T02:17:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299659c640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2984003980 0x7f2984003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f298ffff640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29840047d0 0x7f2984004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2996d9d640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984005180 0x7f298400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299659c640 1 -- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984005180 msgr2=0x7f298400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299659c640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984005180 0x7f298400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299659c640 1 -- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29840047d0 msgr2=0x7f2984004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299659c640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29840047d0 0x7f2984004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f299659c640 1 -- 172.21.15.45:0/753860869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984003530 con 0x7f2984003980 2023-07-09T02:17:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.172+0000 7f2996d9d640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984005180 0x7f298400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f2996d9d640 1 -- 172.21.15.45:0/753860869 reap_dead start 2023-07-09T02:17:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f299659c640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2984003980 0x7f2984003d90 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2988009ae0 tx=0x7f298801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8410dc874dbb2708 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880a8460 con 0x7f2984003980 2023-07-09T02:17:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29880a85c0 con 0x7f2984003980 2023-07-09T02:17:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f2995d9b640 1 -- 172.21.15.45:0/753860869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880a8970 con 0x7f2984003980 2023-07-09T02:17:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f299cb11640 1 -- 172.21.15.45:0/753860869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2984003980 msgr2=0x7f2984003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f299cb11640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2984003980 0x7f2984003d90 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2988009ae0 tx=0x7f298801ca20 comp rx=0 tx=0).stop 2023-07-09T02:17:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f299cb11640 1 -- 172.21.15.45:0/753860869 shutdown_connections 2023-07-09T02:17:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f299cb11640 1 --2- 172.21.15.45:0/753860869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2984003980 0x7f2984003d90 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f299cb11640 1 -- 172.21.15.45:0/753860869 >> 172.21.15.45:0/753860869 conn(0x7f29980698e0 msgr2=0x7f2998069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f299cb11640 1 -- 172.21.15.45:0/753860869 shutdown_connections 2023-07-09T02:17:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.176+0000 7f299cb11640 1 -- 172.21.15.45:0/753860869 wait complete. 2023-07-09T02:17:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299cb11640 1 Processor -- start 2023-07-09T02:17:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299cb11640 1 -- start start 2023-07-09T02:17:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299cb11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984003980 0x7f2998150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299cb11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29980aa4a0 0x7f299815ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299cb11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980ab4c0 0x7f29980ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299cb11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29980abe70 con 0x7f29980ab4c0 2023-07-09T02:17:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299cb11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299815dce0 con 0x7f29980aa4a0 2023-07-09T02:17:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299cb11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299815d110 con 0x7f2984003980 2023-07-09T02:17:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980ab4c0 0x7f29980ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f299659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984003980 0x7f2998150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980ab4c0 0x7f29980ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42238/0 (socket says 172.21.15.45:42238) 2023-07-09T02:17:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 -- 172.21.15.45:0/80530558 learned_addr learned my addr 172.21.15.45:0/80530558 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f298ffff640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29980aa4a0 0x7f299815ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 -- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984003980 msgr2=0x7f2998150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984003980 0x7f2998150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 -- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29980aa4a0 msgr2=0x7f299815ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29980aa4a0 0x7f299815ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 -- 172.21.15.45:0/80530558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29981512f0 con 0x7f29980ab4c0 2023-07-09T02:17:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.180+0000 7f2996d9d640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980ab4c0 0x7f29980ab930 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f299806b140 tx=0x7f299000e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f298effd640 1 -- 172.21.15.45:0/80530558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299000ec00 con 0x7f29980ab4c0 2023-07-09T02:17:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299815d3b0 con 0x7f29980ab4c0 2023-07-09T02:17:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f298effd640 1 -- 172.21.15.45:0/80530558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299000ed80 con 0x7f29980ab4c0 2023-07-09T02:17:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f298effd640 1 -- 172.21.15.45:0/80530558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990003bc0 con 0x7f29980ab4c0 2023-07-09T02:17:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299815d970 con 0x7f29980ab4c0 2023-07-09T02:17:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299804d7d0 con 0x7f29980ab4c0 2023-07-09T02:17:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f298effd640 1 -- 172.21.15.45:0/80530558 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2990003d20 con 0x7f29980ab4c0 2023-07-09T02:17:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f298effd640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2978066280 0x7f2978068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f298effd640 1 -- 172.21.15.45:0/80530558 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2990082b00 con 0x7f29980ab4c0 2023-07-09T02:17:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.184+0000 7f299659c640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2978066280 0x7f2978068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.188+0000 7f299659c640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2978066280 0x7f2978068730 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f29880af000 tx=0x7f29880b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.188+0000 7f298effd640 1 -- 172.21.15.45:0/80530558 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2990084e60 con 0x7f29980ab4c0 2023-07-09T02:17:08.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.396+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f299815de20 con 0x7f29980ab4c0 2023-07-09T02:17:08.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.396+0000 7f298effd640 1 -- 172.21.15.45:0/80530558 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2990050260 con 0x7f29980ab4c0 2023-07-09T02:17:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:08.400 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:17:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:17:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:17:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:17:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:17:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:17:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:17:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:17:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:17:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:17:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:17:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:17:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:17:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:17:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:17:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:17:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:17:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:17:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:17:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:17:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:17:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:17:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:17:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:17:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:17:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:17:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:17:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:17:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:17:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:17:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:17:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:17:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:17:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:17:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:17:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:17:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:17:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:17:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:17:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:17:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:17:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:17:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:17:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:17:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:17:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:17:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:17:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:17:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:17:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:17:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:17:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:17:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:17:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:17:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:17:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:17:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:08.423 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:17:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2978066280 msgr2=0x7f2978068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2978066280 0x7f2978068730 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f29880af000 tx=0x7f29880b2040 comp rx=0 tx=0).stop 2023-07-09T02:17:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980ab4c0 msgr2=0x7f29980ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980ab4c0 0x7f29980ab930 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f299806b140 tx=0x7f299000e700 comp rx=0 tx=0).stop 2023-07-09T02:17:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 shutdown_connections 2023-07-09T02:17:08.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29980ab4c0 0x7f29980ab930 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29980aa4a0 0x7f299815ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2978066280 0x7f2978068730 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 --2- 172.21.15.45:0/80530558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2984003980 0x7f2998150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 >> 172.21.15.45:0/80530558 conn(0x7f29980698e0 msgr2=0x7f29980cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:08.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 shutdown_connections 2023-07-09T02:17:08.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.400+0000 7f299cb11640 1 -- 172.21.15.45:0/80530558 wait complete. 2023-07-09T02:17:08.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cdab9f640 1 Processor -- start 2023-07-09T02:17:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cdab9f640 1 -- start start 2023-07-09T02:17:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cdab9f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0cd415c060 0x7f0cd40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cdab9f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0cd40cd120 0x7f0cd40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cdab9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 0x7f0cd40d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cdab9f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd40d28f0 con 0x7f0cd40cd120 2023-07-09T02:17:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cdab9f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd4160a50 con 0x7f0cd415c060 2023-07-09T02:17:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cdab9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd415c430 con 0x7f0cd40d2450 2023-07-09T02:17:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0cd40cd120 0x7f0cd40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0cd40cd120 0x7f0cd40d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42252/0 (socket says 172.21.15.45:42252) 2023-07-09T02:17:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd3fff640 1 -- 172.21.15.45:0/2086118899 learned_addr learned my addr 172.21.15.45:0/2086118899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd913c640 1 --2- 172.21.15.45:0/2086118899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 0x7f0cd40d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd893b640 1 --2- 172.21.15.45:0/2086118899 >> v2:172.21.15.155:3300/0 conn(0x7f0cd415c060 0x7f0cd40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd3fff640 1 -- 172.21.15.45:0/2086118899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 msgr2=0x7f0cd40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd3fff640 1 --2- 172.21.15.45:0/2086118899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 0x7f0cd40d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd3fff640 1 -- 172.21.15.45:0/2086118899 >> v2:172.21.15.155:3300/0 conn(0x7f0cd415c060 msgr2=0x7f0cd40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd3fff640 1 --2- 172.21.15.45:0/2086118899 >> v2:172.21.15.155:3300/0 conn(0x7f0cd415c060 0x7f0cd40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.568+0000 7f0cd3fff640 1 -- 172.21.15.45:0/2086118899 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd415fb60 con 0x7f0cd40cd120 2023-07-09T02:17:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cd3fff640 1 --2- 172.21.15.45:0/2086118899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40d1f10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40d3ad0 tx=0x7f0cc001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08d878015448af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cd37fe640 1 -- 172.21.15.45:0/2086118899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00ab600 con 0x7f0cd40cd120 2023-07-09T02:17:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cd37fe640 1 -- 172.21.15.45:0/2086118899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc00a7050 con 0x7f0cd40cd120 2023-07-09T02:17:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cd37fe640 1 -- 172.21.15.45:0/2086118899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00ab980 con 0x7f0cd40cd120 2023-07-09T02:17:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 -- 172.21.15.45:0/2086118899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 msgr2=0x7f0cd40d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/2086118899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40d1f10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40d3ad0 tx=0x7f0cc001c210 comp rx=0 tx=0).stop 2023-07-09T02:17:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 -- 172.21.15.45:0/2086118899 shutdown_connections 2023-07-09T02:17:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/2086118899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 0x7f0cd40d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/2086118899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40d1f10 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/2086118899 >> v2:172.21.15.155:3300/0 conn(0x7f0cd415c060 0x7f0cd40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 -- 172.21.15.45:0/2086118899 >> 172.21.15.45:0/2086118899 conn(0x7f0cd40698e0 msgr2=0x7f0cd4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:08.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 -- 172.21.15.45:0/2086118899 shutdown_connections 2023-07-09T02:17:08.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.572+0000 7f0cdab9f640 1 -- 172.21.15.45:0/2086118899 wait complete. 2023-07-09T02:17:08.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 Processor -- start 2023-07-09T02:17:08.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 -- start start 2023-07-09T02:17:08.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 0x7f0cd41f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd415c060 0x7f0cd40cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40ccb70 con 0x7f0cd40cd120 2023-07-09T02:17:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40cb1f0 con 0x7f0cd415c060 2023-07-09T02:17:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd415db20 con 0x7f0cd40d2450 2023-07-09T02:17:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42254/0 (socket says 172.21.15.45:42254) 2023-07-09T02:17:08.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 -- 172.21.15.45:0/606473112 learned_addr learned my addr 172.21.15.45:0/606473112 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:08.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 -- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 msgr2=0x7f0cd41f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 0x7f0cd41f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 -- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd415c060 msgr2=0x7f0cd40cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd415c060 0x7f0cd40cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 -- 172.21.15.45:0/606473112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00094d0 con 0x7f0cd40cd120 2023-07-09T02:17:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd893b640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40caaf0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800e870 tx=0x7f0cc800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd17fa640 1 -- 172.21.15.45:0/606473112 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8009510 con 0x7f0cd40cd120 2023-07-09T02:17:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd17fa640 1 -- 172.21.15.45:0/606473112 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc800eec0 con 0x7f0cd40cd120 2023-07-09T02:17:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cd17fa640 1 -- 172.21.15.45:0/606473112 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800cac0 con 0x7f0cd40cd120 2023-07-09T02:17:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd415de00 con 0x7f0cd40cd120 2023-07-09T02:17:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.576+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd415e3c0 con 0x7f0cd40cd120 2023-07-09T02:17:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.580+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd404d7d0 con 0x7f0cd40cd120 2023-07-09T02:17:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.580+0000 7f0cd17fa640 1 -- 172.21.15.45:0/606473112 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0cc800cc20 con 0x7f0cd40cd120 2023-07-09T02:17:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.580+0000 7f0cd17fa640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0cb8066280 0x7f0cb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.580+0000 7f0cd17fa640 1 -- 172.21.15.45:0/606473112 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0cc8084180 con 0x7f0cd40cd120 2023-07-09T02:17:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.580+0000 7f0cd3fff640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0cb8066280 0x7f0cb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.584+0000 7f0cd3fff640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0cb8066280 0x7f0cb8068730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00ad000 tx=0x7f0cc0004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.584+0000 7f0cd17fa640 1 -- 172.21.15.45:0/606473112 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cc8051a30 con 0x7f0cd40cd120 2023-07-09T02:17:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.740+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cd406baa0 con 0x7f0cd40cd120 2023-07-09T02:17:08.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.740+0000 7f0cd17fa640 1 -- 172.21.15.45:0/606473112 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+14651 (secure 0 0 0) 0x7f0cc8055050 con 0x7f0cd40cd120 2023-07-09T02:17:08.743 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:08.744 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":119,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:07.995420+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0cb8066280 msgr2=0x7f0cb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0cb8066280 0x7f0cb8068730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00ad000 tx=0x7f0cc0004740 comp rx=0 tx=0).stop 2023-07-09T02:17:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 msgr2=0x7f0cd40caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40caaf0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800e870 tx=0x7f0cc800ec70 comp rx=0 tx=0).stop 2023-07-09T02:17:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 shutdown_connections 2023-07-09T02:17:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd415c060 0x7f0cd40cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0cb8066280 0x7f0cb8068730 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cd40d2450 0x7f0cd41f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 --2- 172.21.15.45:0/606473112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0cd40cd120 0x7f0cd40caaf0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 >> 172.21.15.45:0/606473112 conn(0x7f0cd40698e0 msgr2=0x7f0cd40b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 shutdown_connections 2023-07-09T02:17:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.744+0000 7f0cdab9f640 1 -- 172.21.15.45:0/606473112 wait complete. 2023-07-09T02:17:08.765 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:17:08.765 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:17:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.908+0000 7f8d22418640 1 Processor -- start 2023-07-09T02:17:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.908+0000 7f8d22418640 1 -- start start 2023-07-09T02:17:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d22418640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c15c060 0x7f8d1c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d22418640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d1c0cd120 0x7f8d1c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d22418640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8d1c0d2450 0x7f8d1c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d22418640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c0d28f0 con 0x7f8d1c0d2450 2023-07-09T02:17:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d22418640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c160a50 con 0x7f8d1c0cd120 2023-07-09T02:17:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d22418640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c15c430 con 0x7f8d1c15c060 2023-07-09T02:17:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d209b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8d1c0d2450 0x7f8d1c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d209b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8d1c0d2450 0x7f8d1c0d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42270/0 (socket says 172.21.15.45:42270) 2023-07-09T02:17:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d209b5640 1 -- 172.21.15.45:0/2535782979 learned_addr learned my addr 172.21.15.45:0/2535782979 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:08.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d1bfff640 1 --2- 172.21.15.45:0/2535782979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c15c060 0x7f8d1c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d1b7fe640 1 --2- 172.21.15.45:0/2535782979 >> v2:172.21.15.155:3300/0 conn(0x7f8d1c0cd120 0x7f8d1c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d209b5640 1 -- 172.21.15.45:0/2535782979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c15c060 msgr2=0x7f8d1c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:08.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d209b5640 1 --2- 172.21.15.45:0/2535782979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c15c060 0x7f8d1c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d209b5640 1 -- 172.21.15.45:0/2535782979 >> v2:172.21.15.155:3300/0 conn(0x7f8d1c0cd120 msgr2=0x7f8d1c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:08.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d209b5640 1 --2- 172.21.15.45:0/2535782979 >> v2:172.21.15.155:3300/0 conn(0x7f8d1c0cd120 0x7f8d1c0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.912+0000 7f8d209b5640 1 -- 172.21.15.45:0/2535782979 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c15fb60 con 0x7f8d1c0d2450 2023-07-09T02:17:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d209b5640 1 --2- 172.21.15.45:0/2535782979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0d2450 0x7f8d1c0d0610 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0b5600 tx=0x7f8d1401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f713239636d4935 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d1affd640 1 -- 172.21.15.45:0/2535782979 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d140a5560 con 0x7f8d1c0d2450 2023-07-09T02:17:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d1affd640 1 -- 172.21.15.45:0/2535782979 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d140a56c0 con 0x7f8d1c0d2450 2023-07-09T02:17:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d1affd640 1 -- 172.21.15.45:0/2535782979 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d140a5a50 con 0x7f8d1c0d2450 2023-07-09T02:17:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 -- 172.21.15.45:0/2535782979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0d2450 msgr2=0x7f8d1c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 --2- 172.21.15.45:0/2535782979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0d2450 0x7f8d1c0d0610 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0b5600 tx=0x7f8d1401c6e0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 -- 172.21.15.45:0/2535782979 shutdown_connections 2023-07-09T02:17:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 --2- 172.21.15.45:0/2535782979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0d2450 0x7f8d1c0d0610 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 --2- 172.21.15.45:0/2535782979 >> v2:172.21.15.155:3300/0 conn(0x7f8d1c0cd120 0x7f8d1c0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 --2- 172.21.15.45:0/2535782979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c15c060 0x7f8d1c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 -- 172.21.15.45:0/2535782979 >> 172.21.15.45:0/2535782979 conn(0x7f8d1c0698e0 msgr2=0x7f8d1c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 -- 172.21.15.45:0/2535782979 shutdown_connections 2023-07-09T02:17:08.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 -- 172.21.15.45:0/2535782979 wait complete. 2023-07-09T02:17:08.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 Processor -- start 2023-07-09T02:17:08.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.916+0000 7f8d22418640 1 -- start start 2023-07-09T02:17:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0cd120 0x7f8d1c0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0d2450 0x7f8d1c0b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c15c060 0x7f8d1c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c0b6a50 con 0x7f8d1c0cd120 2023-07-09T02:17:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c153f80 con 0x7f8d1c15c060 2023-07-09T02:17:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c0b5b60 con 0x7f8d1c0d2450 2023-07-09T02:17:08.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0cd120 0x7f8d1c0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0cd120 0x7f8d1c0b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42272/0 (socket says 172.21.15.45:42272) 2023-07-09T02:17:08.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 -- 172.21.15.45:0/152381882 learned_addr learned my addr 172.21.15.45:0/152381882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:08.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d209b5640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c15c060 0x7f8d1c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1b7fe640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0d2450 0x7f8d1c0b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 -- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0d2450 msgr2=0x7f8d1c0b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0d2450 0x7f8d1c0b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 -- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c15c060 msgr2=0x7f8d1c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c15c060 0x7f8d1c15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 -- 172.21.15.45:0/152381882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14009b30 con 0x7f8d1c0cd120 2023-07-09T02:17:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d1bfff640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0cd120 0x7f8d1c0b6ee0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00d5f0 tx=0x7f8d0c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d18ff9640 1 -- 172.21.15.45:0/152381882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0125f0 con 0x7f8d1c0cd120 2023-07-09T02:17:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d18ff9640 1 -- 172.21.15.45:0/152381882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c012750 con 0x7f8d1c0cd120 2023-07-09T02:17:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d18ff9640 1 -- 172.21.15.45:0/152381882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c012ae0 con 0x7f8d1c0cd120 2023-07-09T02:17:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c0b5e40 con 0x7f8d1c0cd120 2023-07-09T02:17:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c0b6400 con 0x7f8d1c0cd120 2023-07-09T02:17:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c04d7d0 con 0x7f8d1c0cd120 2023-07-09T02:17:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.920+0000 7f8d18ff9640 1 -- 172.21.15.45:0/152381882 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d0c012c40 con 0x7f8d1c0cd120 2023-07-09T02:17:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.924+0000 7f8d18ff9640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8d080662b0 0x7f8d08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.924+0000 7f8d18ff9640 1 -- 172.21.15.45:0/152381882 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8d0c083df0 con 0x7f8d1c0cd120 2023-07-09T02:17:08.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.924+0000 7f8d1b7fe640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8d080662b0 0x7f8d08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.924+0000 7f8d1b7fe640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8d080662b0 0x7f8d08068760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c1f80e0 tx=0x7f8d10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:08.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:08.928+0000 7f8d18ff9640 1 -- 172.21.15.45:0/152381882 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d0c0515d0 con 0x7f8d1c0cd120 2023-07-09T02:17:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.080+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d1c0b50a0 con 0x7f8d1c0cd120 2023-07-09T02:17:09.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d18ff9640 1 -- 172.21.15.45:0/152381882 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d0c007380 con 0x7f8d1c0cd120 2023-07-09T02:17:09.085 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:17:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8d080662b0 msgr2=0x7f8d08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8d080662b0 0x7f8d08068760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c1f80e0 tx=0x7f8d10008040 comp rx=0 tx=0).stop 2023-07-09T02:17:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0cd120 msgr2=0x7f8d1c0b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0cd120 0x7f8d1c0b6ee0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00d5f0 tx=0x7f8d0c00dab0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 shutdown_connections 2023-07-09T02:17:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c15c060 0x7f8d1c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8d080662b0 0x7f8d08068760 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0d2450 0x7f8d1c0b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 --2- 172.21.15.45:0/152381882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d1c0cd120 0x7f8d1c0b6ee0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 >> 172.21.15.45:0/152381882 conn(0x7f8d1c0698e0 msgr2=0x7f8d1c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 shutdown_connections 2023-07-09T02:17:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.084+0000 7f8d22418640 1 -- 172.21.15.45:0/152381882 wait complete. 2023-07-09T02:17:09.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:17:09.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f22004ec640 1 Processor -- start 2023-07-09T02:17:09.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f22004ec640 1 -- start start 2023-07-09T02:17:09.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f22004ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21f8158e30 0x7f21f806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f22004ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806fd10 0x7f21f806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f22004ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21f806c650 0x7f21f80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f22004ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f806cad0 con 0x7f21f806c650 2023-07-09T02:17:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f22004ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80ccf80 con 0x7f21f8158e30 2023-07-09T02:17:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f22004ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80cd540 con 0x7f21f806fd10 2023-07-09T02:17:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.248+0000 7f21fea89640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21f806c650 0x7f21f80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fea89640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21f806c650 0x7f21f80caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42288/0 (socket says 172.21.15.45:42288) 2023-07-09T02:17:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fea89640 1 -- 172.21.15.45:0/1252531562 learned_addr learned my addr 172.21.15.45:0/1252531562 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fe288640 1 --2- 172.21.15.45:0/1252531562 >> v2:172.21.15.155:3300/0 conn(0x7f21f8158e30 0x7f21f806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fda87640 1 --2- 172.21.15.45:0/1252531562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806fd10 0x7f21f806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fea89640 1 -- 172.21.15.45:0/1252531562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806fd10 msgr2=0x7f21f806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fea89640 1 --2- 172.21.15.45:0/1252531562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806fd10 0x7f21f806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fea89640 1 -- 172.21.15.45:0/1252531562 >> v2:172.21.15.155:3300/0 conn(0x7f21f8158e30 msgr2=0x7f21f806f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fea89640 1 --2- 172.21.15.45:0/1252531562 >> v2:172.21.15.155:3300/0 conn(0x7f21f8158e30 0x7f21f806f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fea89640 1 -- 172.21.15.45:0/1252531562 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80c8fb0 con 0x7f21f806c650 2023-07-09T02:17:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fe288640 1 --2- 172.21.15.45:0/1252531562 >> v2:172.21.15.155:3300/0 conn(0x7f21f8158e30 0x7f21f806f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fda87640 1 --2- 172.21.15.45:0/1252531562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806fd10 0x7f21f806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fea89640 1 --2- 172.21.15.45:0/1252531562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f806c650 0x7f21f80caec0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cc240 tx=0x7f21f001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c469df14f77962 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fd286640 1 -- 172.21.15.45:0/1252531562 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a57b0 con 0x7f21f806c650 2023-07-09T02:17:09.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fd286640 1 -- 172.21.15.45:0/1252531562 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f00a5910 con 0x7f21f806c650 2023-07-09T02:17:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.252+0000 7f21fd286640 1 -- 172.21.15.45:0/1252531562 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00a5ca0 con 0x7f21f806c650 2023-07-09T02:17:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- 172.21.15.45:0/1252531562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f806c650 msgr2=0x7f21f80caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 --2- 172.21.15.45:0/1252531562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f806c650 0x7f21f80caec0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cc240 tx=0x7f21f001c910 comp rx=0 tx=0).stop 2023-07-09T02:17:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- 172.21.15.45:0/1252531562 shutdown_connections 2023-07-09T02:17:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 --2- 172.21.15.45:0/1252531562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f806c650 0x7f21f80caec0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 --2- 172.21.15.45:0/1252531562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806fd10 0x7f21f806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 --2- 172.21.15.45:0/1252531562 >> v2:172.21.15.155:3300/0 conn(0x7f21f8158e30 0x7f21f806f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- 172.21.15.45:0/1252531562 >> 172.21.15.45:0/1252531562 conn(0x7f21f80694b0 msgr2=0x7f21f80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- 172.21.15.45:0/1252531562 shutdown_connections 2023-07-09T02:17:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- 172.21.15.45:0/1252531562 wait complete. 2023-07-09T02:17:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 Processor -- start 2023-07-09T02:17:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- start start 2023-07-09T02:17:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806c650 0x7f21f8145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f806fd10 0x7f21f815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f8158e30 0x7f21f81520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8146360 con 0x7f21f8158e30 2023-07-09T02:17:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8146810 con 0x7f21f806fd10 2023-07-09T02:17:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f22004ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8155fd0 con 0x7f21f806c650 2023-07-09T02:17:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fea89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f8158e30 0x7f21f81520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fea89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f8158e30 0x7f21f81520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42296/0 (socket says 172.21.15.45:42296) 2023-07-09T02:17:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fea89640 1 -- 172.21.15.45:0/987815509 learned_addr learned my addr 172.21.15.45:0/987815509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fda87640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f806fd10 0x7f21f815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fe288640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806c650 0x7f21f8145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fea89640 1 -- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806c650 msgr2=0x7f21f8145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fea89640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806c650 0x7f21f8145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fea89640 1 -- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f806fd10 msgr2=0x7f21f815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fea89640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f806fd10 0x7f21f815a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.256+0000 7f21fea89640 1 -- 172.21.15.45:0/987815509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009b30 con 0x7f21f8158e30 2023-07-09T02:17:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f21fea89640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f8158e30 0x7f21f81520f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f21f001afc0 tx=0x7f21f00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f21eeffd640 1 -- 172.21.15.45:0/987815509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00b8880 con 0x7f21f8158e30 2023-07-09T02:17:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f21eeffd640 1 -- 172.21.15.45:0/987815509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f00b8a00 con 0x7f21f8158e30 2023-07-09T02:17:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f8159530 con 0x7f21f8158e30 2023-07-09T02:17:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f21eeffd640 1 -- 172.21.15.45:0/987815509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f00b8db0 con 0x7f21f8158e30 2023-07-09T02:17:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8159af0 con 0x7f21f8158e30 2023-07-09T02:17:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f8159ce0 con 0x7f21f8158e30 2023-07-09T02:17:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f21eeffd640 1 -- 172.21.15.45:0/987815509 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21f00b6440 con 0x7f21f8158e30 2023-07-09T02:17:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f21eeffd640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f21eeffd640 1 -- 172.21.15.45:0/987815509 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f21f011f250 con 0x7f21f8158e30 2023-07-09T02:17:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.260+0000 7f21fe288640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.264+0000 7f21fe288640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f21f40045f0 tx=0x7f21f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.264+0000 7f21eeffd640 1 -- 172.21.15.45:0/987815509 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21f00eca40 con 0x7f21f8158e30 2023-07-09T02:17:09.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.420+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21f804d7d0 con 0x7f21f8158e30 2023-07-09T02:17:09.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.420+0000 7f21eeffd640 1 -- 172.21.15.45:0/987815509 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v119) v1 ==== 92+0+10 (secure 0 0 0) 0x7f21f00f0060 con 0x7f21f8158e30 2023-07-09T02:17:09.423 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:17:09.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 msgr2=0x7f21dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f21f40045f0 tx=0x7f21f4008040 comp rx=0 tx=0).stop 2023-07-09T02:17:09.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f8158e30 msgr2=0x7f21f81520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f8158e30 0x7f21f81520f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f21f001afc0 tx=0x7f21f00196b0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 shutdown_connections 2023-07-09T02:17:09.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f8158e30 0x7f21f81520f0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21f806fd10 0x7f21f815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f21dc066280 0x7f21dc068730 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 --2- 172.21.15.45:0/987815509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21f806c650 0x7f21f8145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 >> 172.21.15.45:0/987815509 conn(0x7f21f80694b0 msgr2=0x7f21f80cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:09.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 shutdown_connections 2023-07-09T02:17:09.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.424+0000 7f22004ec640 1 -- 172.21.15.45:0/987815509 wait complete. 2023-07-09T02:17:09.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:17:09.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f769d1fa640 1 Processor -- start 2023-07-09T02:17:09.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f769d1fa640 1 -- start start 2023-07-09T02:17:09.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f769d1fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f76980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f769d1fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7698160a50 con 0x7f769815c060 2023-07-09T02:17:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f769d1fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769815c430 con 0x7f76980cd120 2023-07-09T02:17:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f769d1fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769815fb60 con 0x7f76980d2620 2023-07-09T02:17:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f7696d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f769815c060 0x7f76980d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41696/0 (socket says 172.21.15.45:41696) 2023-07-09T02:17:09.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f7696d9d640 1 -- 172.21.15.45:0/971252267 learned_addr learned my addr 172.21.15.45:0/971252267 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.584+0000 7f768ffff640 1 --2- 172.21.15.45:0/971252267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f76980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f769659c640 1 -- 172.21.15.45:0/971252267 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473652380 0 0) 0x7f7698160a50 con 0x7f769815c060 2023-07-09T02:17:09.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f769659c640 1 -- 172.21.15.45:0/971252267 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7684003530 con 0x7f769815c060 2023-07-09T02:17:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f769659c640 1 -- 172.21.15.45:0/971252267 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970842024 0 0) 0x7f769815c430 con 0x7f76980cd120 2023-07-09T02:17:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f769659c640 1 -- 172.21.15.45:0/971252267 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7698160a50 con 0x7f76980cd120 2023-07-09T02:17:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f768ffff640 1 -- 172.21.15.45:0/971252267 >> v1:172.21.15.155:6789/0 conn(0x7f76980cd120 legacy=0x7f76980cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f768ffff640 1 -- 172.21.15.45:0/971252267 >> v1:172.21.15.45:6789/0 conn(0x7f769815c060 legacy=0x7f76980d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f768ffff640 1 -- 172.21.15.45:0/971252267 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769815fe40 con 0x7f76980d2620 2023-07-09T02:17:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f768ffff640 1 --2- 172.21.15.45:0/971252267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f76980b4ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76800097f0 tx=0x7f768001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99858d28b7d931df server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f769659c640 1 -- 172.21.15.45:0/971252267 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800aa5f0 con 0x7f76980d2620 2023-07-09T02:17:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f769659c640 1 -- 172.21.15.45:0/971252267 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76800aa750 con 0x7f76980d2620 2023-07-09T02:17:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.588+0000 7f769659c640 1 -- 172.21.15.45:0/971252267 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800aaae0 con 0x7f76980d2620 2023-07-09T02:17:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- 172.21.15.45:0/971252267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 msgr2=0x7f76980b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 --2- 172.21.15.45:0/971252267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f76980b4ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76800097f0 tx=0x7f768001c490 comp rx=0 tx=0).stop 2023-07-09T02:17:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- 172.21.15.45:0/971252267 shutdown_connections 2023-07-09T02:17:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 --2- 172.21.15.45:0/971252267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f76980b4ed0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- 172.21.15.45:0/971252267 >> 172.21.15.45:0/971252267 conn(0x7f76980698e0 msgr2=0x7f7698069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:09.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- 172.21.15.45:0/971252267 shutdown_connections 2023-07-09T02:17:09.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- 172.21.15.45:0/971252267 wait complete. 2023-07-09T02:17:09.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 Processor -- start 2023-07-09T02:17:09.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- start start 2023-07-09T02:17:09.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76980cd120 0x7f7698151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f7698151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769815c060 0x7f769815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7698151cc0 con 0x7f76980cd120 2023-07-09T02:17:09.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76980cc280 con 0x7f769815c060 2023-07-09T02:17:09.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769d1fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7698151f10 con 0x7f76980d2620 2023-07-09T02:17:09.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f7696d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76980cd120 0x7f7698151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f7696d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76980cd120 0x7f7698151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42300/0 (socket says 172.21.15.45:42300) 2023-07-09T02:17:09.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f7696d9d640 1 -- 172.21.15.45:0/116770243 learned_addr learned my addr 172.21.15.45:0/116770243 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:09.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f769759e640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769815c060 0x7f769815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f768ffff640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f7698151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f7696d9d640 1 -- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 msgr2=0x7f7698151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f7696d9d640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f7698151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f7696d9d640 1 -- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769815c060 msgr2=0x7f769815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.592+0000 7f7696d9d640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769815c060 0x7f769815c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f7696d9d640 1 -- 172.21.15.45:0/116770243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680009420 con 0x7f76980cd120 2023-07-09T02:17:09.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f7696d9d640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76980cd120 0x7f7698151130 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f768800c420 tx=0x7f768800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f768f7fe640 1 -- 172.21.15.45:0/116770243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688005cf0 con 0x7f76980cd120 2023-07-09T02:17:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f768f7fe640 1 -- 172.21.15.45:0/116770243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7688005e50 con 0x7f76980cd120 2023-07-09T02:17:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f768f7fe640 1 -- 172.21.15.45:0/116770243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688007310 con 0x7f76980cd120 2023-07-09T02:17:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76980b59f0 con 0x7f76980cd120 2023-07-09T02:17:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76981524d0 con 0x7f76980cd120 2023-07-09T02:17:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76981526c0 con 0x7f76980cd120 2023-07-09T02:17:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f768f7fe640 1 -- 172.21.15.45:0/116770243 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7688007470 con 0x7f76980cd120 2023-07-09T02:17:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f768f7fe640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7678066280 0x7f7678068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.596+0000 7f768f7fe640 1 -- 172.21.15.45:0/116770243 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7688083430 con 0x7f76980cd120 2023-07-09T02:17:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.600+0000 7f768ffff640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7678066280 0x7f7678068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.600+0000 7f768ffff640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7678066280 0x7f7678068730 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f76800ae000 tx=0x7f76800a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.600+0000 7f768f7fe640 1 -- 172.21.15.45:0/116770243 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7688050c70 con 0x7f76980cd120 2023-07-09T02:17:09.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.756+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f769804d7d0 con 0x7f76980cd120 2023-07-09T02:17:09.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.756+0000 7f768f7fe640 1 -- 172.21.15.45:0/116770243 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7688017090 con 0x7f76980cd120 2023-07-09T02:17:09.759 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:09.760 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:17:09.760 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:09.760 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:17:09.761 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:17:09.761 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:09.761 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:09.761 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:17:09.762 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:17:09.762 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:09.762 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:17:09.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7678066280 msgr2=0x7f7678068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7678066280 0x7f7678068730 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f76800ae000 tx=0x7f76800a7000 comp rx=0 tx=0).stop 2023-07-09T02:17:09.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76980cd120 msgr2=0x7f7698151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76980cd120 0x7f7698151130 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f768800c420 tx=0x7f768800c8e0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 shutdown_connections 2023-07-09T02:17:09.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f769815c060 0x7f769815c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7678066280 0x7f7678068730 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76980d2620 0x7f7698151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 --2- 172.21.15.45:0/116770243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76980cd120 0x7f7698151130 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 >> 172.21.15.45:0/116770243 conn(0x7f76980698e0 msgr2=0x7f76980b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:09.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 shutdown_connections 2023-07-09T02:17:09.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.760+0000 7f769d1fa640 1 -- 172.21.15.45:0/116770243 wait complete. 2023-07-09T02:17:09.780 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:17:09.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:17:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.924+0000 7fb03209c640 1 Processor -- start 2023-07-09T02:17:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.924+0000 7fb03209c640 1 -- start start 2023-07-09T02:17:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb03209c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb02c0cd060 0x7fb02c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb03209c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c0b4490 0x7fb02c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb03209c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0d19c0 con 0x7fb02c15c480 2023-07-09T02:17:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb03209c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c15c850 con 0x7fb02c0cd060 2023-07-09T02:17:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb03209c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0b4e50 con 0x7fb02c0b4490 2023-07-09T02:17:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb02affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb02c0cd060 0x7fb02c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb02affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb02c0cd060 0x7fb02c0cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42312/0 (socket says 172.21.15.45:42312) 2023-07-09T02:17:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb02affd640 1 -- 172.21.15.45:0/3319287537 learned_addr learned my addr 172.21.15.45:0/3319287537 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb02bfff640 1 --2- 172.21.15.45:0/3319287537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c0b4490 0x7fb02c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb02affd640 1 -- 172.21.15.45:0/3319287537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c0b4490 msgr2=0x7fb02c0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb02affd640 1 --2- 172.21.15.45:0/3319287537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c0b4490 0x7fb02c0b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb02affd640 1 -- 172.21.15.45:0/3319287537 >> v1:172.21.15.155:6789/0 conn(0x7fb02c15c480 legacy=0x7fb02c0d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.928+0000 7fb02affd640 1 -- 172.21.15.45:0/3319287537 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0cf210 con 0x7fb02c0cd060 2023-07-09T02:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb02affd640 1 --2- 172.21.15.45:0/3319287537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c0cecd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb020009870 tx=0x7fb02001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74c87a4258b2c43 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb02a7fc640 1 -- 172.21.15.45:0/3319287537 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200ab600 con 0x7fb02c0cd060 2023-07-09T02:17:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb02a7fc640 1 -- 172.21.15.45:0/3319287537 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0200a7050 con 0x7fb02c0cd060 2023-07-09T02:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb02a7fc640 1 -- 172.21.15.45:0/3319287537 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200ab980 con 0x7fb02c0cd060 2023-07-09T02:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 -- 172.21.15.45:0/3319287537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 msgr2=0x7fb02c0cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 --2- 172.21.15.45:0/3319287537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c0cecd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb020009870 tx=0x7fb02001c500 comp rx=0 tx=0).stop 2023-07-09T02:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 -- 172.21.15.45:0/3319287537 shutdown_connections 2023-07-09T02:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 --2- 172.21.15.45:0/3319287537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c0b4490 0x7fb02c0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 --2- 172.21.15.45:0/3319287537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c0cecd0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 -- 172.21.15.45:0/3319287537 >> 172.21.15.45:0/3319287537 conn(0x7fb02c0cf490 msgr2=0x7fb02c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 -- 172.21.15.45:0/3319287537 shutdown_connections 2023-07-09T02:17:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 -- 172.21.15.45:0/3319287537 wait complete. 2023-07-09T02:17:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 Processor -- start 2023-07-09T02:17:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 -- start start 2023-07-09T02:17:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.932+0000 7fb03209c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c0b4490 0x7fb02c159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb03209c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb03209c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c15c480 0x7fb02c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb03209c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c15f6d0 con 0x7fb02c0cd060 2023-07-09T02:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb03209c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c159890 con 0x7fb02c0b4490 2023-07-09T02:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb03209c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c15eda0 con 0x7fb02c15c480 2023-07-09T02:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42314/0 (socket says 172.21.15.45:42314) 2023-07-09T02:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 -- 172.21.15.45:0/2736686092 learned_addr learned my addr 172.21.15.45:0/2736686092 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02b7fe640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c0b4490 0x7fb02c159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02bfff640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c15c480 0x7fb02c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 -- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c15c480 msgr2=0x7fb02c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c15c480 0x7fb02c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 -- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c0b4490 msgr2=0x7fb02c159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:09.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c0b4490 0x7fb02c159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:09.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 -- 172.21.15.45:0/2736686092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200094d0 con 0x7fb02c0cd060 2023-07-09T02:17:09.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb02affd640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c151b70 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fb0200ae040 tx=0x7fb0200192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb013fff640 1 -- 172.21.15.45:0/2736686092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200b4440 con 0x7fb02c0cd060 2023-07-09T02:17:09.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb013fff640 1 -- 172.21.15.45:0/2736686092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0200b45a0 con 0x7fb02c0cd060 2023-07-09T02:17:09.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c15f080 con 0x7fb02c0cd060 2023-07-09T02:17:09.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb013fff640 1 -- 172.21.15.45:0/2736686092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200b4910 con 0x7fb02c0cd060 2023-07-09T02:17:09.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c1520b0 con 0x7fb02c0cd060 2023-07-09T02:17:09.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c04d7d0 con 0x7fb02c0cd060 2023-07-09T02:17:09.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.936+0000 7fb013fff640 1 -- 172.21.15.45:0/2736686092 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0200b2070 con 0x7fb02c0cd060 2023-07-09T02:17:09.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.940+0000 7fb013fff640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb018066280 0x7fb018068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:09.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.940+0000 7fb013fff640 1 -- 172.21.15.45:0/2736686092 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb02011d7d0 con 0x7fb02c0cd060 2023-07-09T02:17:09.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.940+0000 7fb02b7fe640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb018066280 0x7fb018068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:09.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.940+0000 7fb02b7fe640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb018066280 0x7fb018068730 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0098e0 tx=0x7fb01c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:09.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:09.944+0000 7fb013fff640 1 -- 172.21.15.45:0/2736686092 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0200eb040 con 0x7fb02c0cd060 2023-07-09T02:17:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.100+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb02c152610 con 0x7fb02c0cd060 2023-07-09T02:17:10.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.644+0000 7fb013fff640 1 -- 172.21.15.45:0/2736686092 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb0200ee660 con 0x7fb02c0cd060 2023-07-09T02:17:10.645 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:17:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb018066280 msgr2=0x7fb018068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb018066280 0x7fb018068730 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0098e0 tx=0x7fb01c009060 comp rx=0 tx=0).stop 2023-07-09T02:17:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 msgr2=0x7fb02c151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c151b70 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fb0200ae040 tx=0x7fb0200192a0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 shutdown_connections 2023-07-09T02:17:10.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb018066280 0x7fb018068730 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb02c15c480 0x7fb02c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb02c0cd060 0x7fb02c151b70 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 --2- 172.21.15.45:0/2736686092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c0b4490 0x7fb02c159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 >> 172.21.15.45:0/2736686092 conn(0x7fb02c0cf490 msgr2=0x7fb02c0b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 shutdown_connections 2023-07-09T02:17:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.648+0000 7fb03209c640 1 -- 172.21.15.45:0/2736686092 wait complete. 2023-07-09T02:17:10.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:17:10.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.820+0000 7f7674419640 1 Processor -- start 2023-07-09T02:17:10.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.820+0000 7f7674419640 1 -- start start 2023-07-09T02:17:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f7674419640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f766c0af990 0x7f766c06a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f7674419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0b23b0 0x7f766c06ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f7674419640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c06c1c0 con 0x7f766c06b040 2023-07-09T02:17:10.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f7674419640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c0ccdd0 con 0x7f766c0af990 2023-07-09T02:17:10.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f7674419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0cd120 con 0x7f766c0b23b0 2023-07-09T02:17:10.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76721b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f766c0af990 0x7f766c06a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:10.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76729b6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f766c06b040 0x7f766c0caef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41706/0 (socket says 172.21.15.45:41706) 2023-07-09T02:17:10.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76729b6640 1 -- 172.21.15.45:0/1002175140 learned_addr learned my addr 172.21.15.45:0/1002175140 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:10.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76721b5640 1 -- 172.21.15.45:0/1002175140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0b23b0 msgr2=0x7f766c06ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:10.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76719b4640 1 --2- 172.21.15.45:0/1002175140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0b23b0 0x7f766c06ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:10.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76721b5640 1 --2- 172.21.15.45:0/1002175140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0b23b0 0x7f766c06ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76711b3640 1 -- 172.21.15.45:0/1002175140 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334628551 0 0) 0x7f766c06c1c0 con 0x7f766c06b040 2023-07-09T02:17:10.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76721b5640 1 -- 172.21.15.45:0/1002175140 >> v1:172.21.15.45:6789/0 conn(0x7f766c06b040 legacy=0x7f766c0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:10.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76721b5640 1 -- 172.21.15.45:0/1002175140 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0cc150 con 0x7f766c0af990 2023-07-09T02:17:10.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.824+0000 7f76719b4640 1 --2- 172.21.15.45:0/1002175140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0b23b0 0x7f766c06ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:10.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f76721b5640 1 --2- 172.21.15.45:0/1002175140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0af990 0x7f766c06a5c0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f76680097a0 tx=0x7f766801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931b7fe618680cec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f76711b3640 1 -- 172.21.15.45:0/1002175140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76680a7070 con 0x7f766c0af990 2023-07-09T02:17:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f76711b3640 1 -- 172.21.15.45:0/1002175140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76680ab430 con 0x7f766c0af990 2023-07-09T02:17:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f76711b3640 1 -- 172.21.15.45:0/1002175140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76680ab7c0 con 0x7f766c0af990 2023-07-09T02:17:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 -- 172.21.15.45:0/1002175140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0af990 msgr2=0x7f766c06a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 --2- 172.21.15.45:0/1002175140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0af990 0x7f766c06a5c0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f76680097a0 tx=0x7f766801c430 comp rx=0 tx=0).stop 2023-07-09T02:17:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 -- 172.21.15.45:0/1002175140 shutdown_connections 2023-07-09T02:17:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 --2- 172.21.15.45:0/1002175140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0b23b0 0x7f766c06ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 --2- 172.21.15.45:0/1002175140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0af990 0x7f766c06a5c0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 -- 172.21.15.45:0/1002175140 >> 172.21.15.45:0/1002175140 conn(0x7f766c0999f0 msgr2=0x7f766c0d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 -- 172.21.15.45:0/1002175140 shutdown_connections 2023-07-09T02:17:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 -- 172.21.15.45:0/1002175140 wait complete. 2023-07-09T02:17:10.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 Processor -- start 2023-07-09T02:17:10.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.828+0000 7f7674419640 1 -- start start 2023-07-09T02:17:10.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c06b040 0x7f766c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:10.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0af990 0x7f766c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:10.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0b23b0 0x7f766c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:10.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0b6110 con 0x7f766c0b23b0 2023-07-09T02:17:10.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0b63f0 con 0x7f766c06b040 2023-07-09T02:17:10.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0c7af0 con 0x7f766c0af990 2023-07-09T02:17:10.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0b23b0 0x7f766c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:10.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0b23b0 0x7f766c1528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42324/0 (socket says 172.21.15.45:42324) 2023-07-09T02:17:10.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 -- 172.21.15.45:0/47074129 learned_addr learned my addr 172.21.15.45:0/47074129 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:10.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76721b5640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c06b040 0x7f766c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:10.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76719b4640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0af990 0x7f766c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 -- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0af990 msgr2=0x7f766c157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0af990 0x7f766c157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 -- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c06b040 msgr2=0x7f766c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c06b040 0x7f766c15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 -- 172.21.15.45:0/47074129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680093b0 con 0x7f766c0b23b0 2023-07-09T02:17:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76721b5640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c06b040 0x7f766c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76719b4640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0af990 0x7f766c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f76729b6640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0b23b0 0x7f766c1528f0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7664001570 tx=0x7f766400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7662ffd640 1 -- 172.21.15.45:0/47074129 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400a640 con 0x7f766c0b23b0 2023-07-09T02:17:10.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7662ffd640 1 -- 172.21.15.45:0/47074129 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400a7a0 con 0x7f766c0b23b0 2023-07-09T02:17:10.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c1565f0 con 0x7f766c0b23b0 2023-07-09T02:17:10.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7662ffd640 1 -- 172.21.15.45:0/47074129 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400ab90 con 0x7f766c0b23b0 2023-07-09T02:17:10.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c156210 con 0x7f766c0b23b0 2023-07-09T02:17:10.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.832+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c0c7d10 con 0x7f766c0b23b0 2023-07-09T02:17:10.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.836+0000 7f7662ffd640 1 -- 172.21.15.45:0/47074129 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f766400acf0 con 0x7f766c0b23b0 2023-07-09T02:17:10.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.836+0000 7f7662ffd640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7650066280 0x7f7650068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:10.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.836+0000 7f7662ffd640 1 -- 172.21.15.45:0/47074129 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7664083500 con 0x7f766c0b23b0 2023-07-09T02:17:10.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.836+0000 7f76721b5640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7650066280 0x7f7650068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:10.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.836+0000 7f76721b5640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7650066280 0x7f7650068730 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f76680af000 tx=0x7f7668008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:10.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.840+0000 7f7662ffd640 1 -- 172.21.15.45:0/47074129 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7664050b50 con 0x7f766c0b23b0 2023-07-09T02:17:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:10.992+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f766c04d7d0 con 0x7f766c0b23b0 2023-07-09T02:17:11.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.652+0000 7f7662ffd640 1 -- 172.21.15.45:0/47074129 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7664054170 con 0x7f766c0b23b0 2023-07-09T02:17:11.657 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:17:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7650066280 msgr2=0x7f7650068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7650066280 0x7f7650068730 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f76680af000 tx=0x7f7668008040 comp rx=0 tx=0).stop 2023-07-09T02:17:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0b23b0 msgr2=0x7f766c1528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0b23b0 0x7f766c1528f0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7664001570 tx=0x7f766400cc70 comp rx=0 tx=0).stop 2023-07-09T02:17:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 shutdown_connections 2023-07-09T02:17:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f766c0b23b0 0x7f766c1528f0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7650066280 0x7f7650068730 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f766c0af990 0x7f766c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 --2- 172.21.15.45:0/47074129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c06b040 0x7f766c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.660+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 >> 172.21.15.45:0/47074129 conn(0x7f766c0999f0 msgr2=0x7f766c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.664+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 shutdown_connections 2023-07-09T02:17:11.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.664+0000 7f7674419640 1 -- 172.21.15.45:0/47074129 wait complete. 2023-07-09T02:17:11.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f2361b00640 1 Processor -- start 2023-07-09T02:17:11.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f2361b00640 1 -- start start 2023-07-09T02:17:11.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f2361b00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c15c060 0x7f235c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:11.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f2361b00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f235c0cd120 0x7f235c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:11.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f2361b00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f235c0d2450 0x7f235c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f2361b00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c0d28f0 con 0x7f235c0d2450 2023-07-09T02:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f2361b00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c160a50 con 0x7f235c0cd120 2023-07-09T02:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f2361b00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c15c430 con 0x7f235c15c060 2023-07-09T02:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f235c0d2450 0x7f235c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f235c0d2450 0x7f235c0d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60486/0 (socket says 172.21.15.45:60486) 2023-07-09T02:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235bfff640 1 -- 172.21.15.45:0/2672180826 learned_addr learned my addr 172.21.15.45:0/2672180826 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:11.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235affd640 1 --2- 172.21.15.45:0/2672180826 >> v2:172.21.15.155:3300/0 conn(0x7f235c0cd120 0x7f235c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235b7fe640 1 --2- 172.21.15.45:0/2672180826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c15c060 0x7f235c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235bfff640 1 -- 172.21.15.45:0/2672180826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c15c060 msgr2=0x7f235c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235bfff640 1 --2- 172.21.15.45:0/2672180826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c15c060 0x7f235c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235bfff640 1 -- 172.21.15.45:0/2672180826 >> v2:172.21.15.155:3300/0 conn(0x7f235c0cd120 msgr2=0x7f235c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:11.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235bfff640 1 --2- 172.21.15.45:0/2672180826 >> v2:172.21.15.155:3300/0 conn(0x7f235c0cd120 0x7f235c0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235bfff640 1 -- 172.21.15.45:0/2672180826 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c15fb60 con 0x7f235c0d2450 2023-07-09T02:17:11.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.836+0000 7f235affd640 1 --2- 172.21.15.45:0/2672180826 >> v2:172.21.15.155:3300/0 conn(0x7f235c0cd120 0x7f235c0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:11.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f235bfff640 1 --2- 172.21.15.45:0/2672180826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c0d2450 0x7f235c0d0610 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f235c0b5600 tx=0x7f235401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1288d9e36589ad server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:11.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f235a7fc640 1 -- 172.21.15.45:0/2672180826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540a5560 con 0x7f235c0d2450 2023-07-09T02:17:11.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f235a7fc640 1 -- 172.21.15.45:0/2672180826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540a56c0 con 0x7f235c0d2450 2023-07-09T02:17:11.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f235a7fc640 1 -- 172.21.15.45:0/2672180826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540a5a50 con 0x7f235c0d2450 2023-07-09T02:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 -- 172.21.15.45:0/2672180826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c0d2450 msgr2=0x7f235c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 --2- 172.21.15.45:0/2672180826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c0d2450 0x7f235c0d0610 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f235c0b5600 tx=0x7f235401c6e0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 -- 172.21.15.45:0/2672180826 shutdown_connections 2023-07-09T02:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 --2- 172.21.15.45:0/2672180826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c0d2450 0x7f235c0d0610 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 --2- 172.21.15.45:0/2672180826 >> v2:172.21.15.155:3300/0 conn(0x7f235c0cd120 0x7f235c0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 --2- 172.21.15.45:0/2672180826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c15c060 0x7f235c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 -- 172.21.15.45:0/2672180826 >> 172.21.15.45:0/2672180826 conn(0x7f235c0698e0 msgr2=0x7f235c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 -- 172.21.15.45:0/2672180826 shutdown_connections 2023-07-09T02:17:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.840+0000 7f2361b00640 1 -- 172.21.15.45:0/2672180826 wait complete. 2023-07-09T02:17:11.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f2361b00640 1 Processor -- start 2023-07-09T02:17:11.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f2361b00640 1 -- start start 2023-07-09T02:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f2361b00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c0cd120 0x7f235c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f2361b00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f235c0d2450 0x7f235c0c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f2361b00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c15c060 0x7f235c0b7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f2361b00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1534d0 con 0x7f235c15c060 2023-07-09T02:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f2361b00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0b87d0 con 0x7f235c0d2450 2023-07-09T02:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f2361b00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c153720 con 0x7f235c0cd120 2023-07-09T02:17:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c15c060 0x7f235c0b7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f235c0d2450 0x7f235c0c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c0cd120 0x7f235c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c15c060 0x7f235c0b7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60490/0 (socket says 172.21.15.45:60490) 2023-07-09T02:17:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 -- 172.21.15.45:0/1463427381 learned_addr learned my addr 172.21.15.45:0/1463427381 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 -- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c0cd120 msgr2=0x7f235c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c0cd120 0x7f235c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 -- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f235c0d2450 msgr2=0x7f235c0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f235c0d2450 0x7f235c0c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 -- 172.21.15.45:0/1463427381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354009b30 con 0x7f235c15c060 2023-07-09T02:17:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.844+0000 7f235bfff640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c15c060 0x7f235c0b7ce0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f235401ad90 tx=0x7f2354019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2343fff640 1 -- 172.21.15.45:0/1463427381 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540b8670 con 0x7f235c15c060 2023-07-09T02:17:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2343fff640 1 -- 172.21.15.45:0/1463427381 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540b87d0 con 0x7f235c15c060 2023-07-09T02:17:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c153a00 con 0x7f235c15c060 2023-07-09T02:17:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2343fff640 1 -- 172.21.15.45:0/1463427381 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540b8b80 con 0x7f235c15c060 2023-07-09T02:17:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c154cc0 con 0x7f235c15c060 2023-07-09T02:17:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c153f20 con 0x7f235c15c060 2023-07-09T02:17:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2343fff640 1 -- 172.21.15.45:0/1463427381 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23540b8ce0 con 0x7f235c15c060 2023-07-09T02:17:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2343fff640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2348066280 0x7f2348068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f2343fff640 1 -- 172.21.15.45:0/1463427381 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f235411f190 con 0x7f235c15c060 2023-07-09T02:17:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.848+0000 7f235b7fe640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2348066280 0x7f2348068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.852+0000 7f235b7fe640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2348066280 0x7f2348068730 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f235c158d50 tx=0x7f234c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:11.852+0000 7f2343fff640 1 -- 172.21.15.45:0/1463427381 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f235c153f20 con 0x7f235c15c060 2023-07-09T02:17:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.044+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f235c153f20 con 0x7f235c15c060 2023-07-09T02:17:12.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.672+0000 7f2343fff640 1 -- 172.21.15.45:0/1463427381 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v55) v1 ==== 174+0+0 (secure 0 0 0) 0x7f235c153f20 con 0x7f235c15c060 2023-07-09T02:17:12.674 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 15 and data pool 16 2023-07-09T02:17:12.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2348066280 msgr2=0x7f2348068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:12.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2348066280 0x7f2348068730 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f235c158d50 tx=0x7f234c008040 comp rx=0 tx=0).stop 2023-07-09T02:17:12.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c15c060 msgr2=0x7f235c0b7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:12.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c15c060 0x7f235c0b7ce0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f235401ad90 tx=0x7f2354019480 comp rx=0 tx=0).stop 2023-07-09T02:17:12.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 shutdown_connections 2023-07-09T02:17:12.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f235c15c060 0x7f235c0b7ce0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f235c0d2450 0x7f235c0c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2348066280 0x7f2348068730 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 --2- 172.21.15.45:0/1463427381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f235c0cd120 0x7f235c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 >> 172.21.15.45:0/1463427381 conn(0x7f235c0698e0 msgr2=0x7f235c069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:12.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 shutdown_connections 2023-07-09T02:17:12.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.676+0000 7f2361b00640 1 -- 172.21.15.45:0/1463427381 wait complete. 2023-07-09T02:17:12.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:12.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.844+0000 7fb477a56640 1 Processor -- start 2023-07-09T02:17:12.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb477a56640 1 -- start start 2023-07-09T02:17:12.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb477a56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb47015c060 0x7fb4700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:12.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb477a56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb4700d2620 0x7fb4700cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:12.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb477a56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb470160a50 con 0x7fb4700cd120 2023-07-09T02:17:12.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb477a56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47015c430 con 0x7fb4700d2620 2023-07-09T02:17:12.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb477a56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47015fb60 con 0x7fb47015c060 2023-07-09T02:17:12.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb475ff3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb4700d2620 0x7fb4700cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:12.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb4757f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb47015c060 0x7fb4700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:12.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb4757f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb47015c060 0x7fb4700b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38510/0 (socket says 172.21.15.45:38510) 2023-07-09T02:17:12.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb4757f2640 1 -- 172.21.15.45:0/360508893 learned_addr learned my addr 172.21.15.45:0/360508893 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:12.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb474ff1640 1 --1- 172.21.15.45:0/360508893 >> v1:172.21.15.155:6789/0 conn(0x7fb4700cd120 0x7fb4700d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:60870/0 (socket says 172.21.15.45:60870) 2023-07-09T02:17:12.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb4757f2640 1 -- 172.21.15.45:0/360508893 >> v2:172.21.15.155:3300/0 conn(0x7fb4700d2620 msgr2=0x7fb4700cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:12.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb4757f2640 1 --2- 172.21.15.45:0/360508893 >> v2:172.21.15.155:3300/0 conn(0x7fb4700d2620 0x7fb4700cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb4757f2640 1 -- 172.21.15.45:0/360508893 >> v1:172.21.15.155:6789/0 conn(0x7fb4700cd120 legacy=0x7fb4700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:12.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb4757f2640 1 -- 172.21.15.45:0/360508893 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47015fe40 con 0x7fb47015c060 2023-07-09T02:17:12.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb467fff640 1 -- 172.21.15.45:0/360508893 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433845732 0 0) 0x7fb470160a50 con 0x7fb4700cd120 2023-07-09T02:17:12.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.848+0000 7fb475ff3640 1 --2- 172.21.15.45:0/360508893 >> v2:172.21.15.155:3300/0 conn(0x7fb4700d2620 0x7fb4700cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:12.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb4757f2640 1 --2- 172.21.15.45:0/360508893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb47015c060 0x7fb4700b4ed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0098a0 tx=0x7fb46c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d98785193df53f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:12.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb467fff640 1 -- 172.21.15.45:0/360508893 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0aa650 con 0x7fb47015c060 2023-07-09T02:17:12.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb467fff640 1 -- 172.21.15.45:0/360508893 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c0aa7b0 con 0x7fb47015c060 2023-07-09T02:17:12.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb467fff640 1 -- 172.21.15.45:0/360508893 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0aab40 con 0x7fb47015c060 2023-07-09T02:17:12.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 -- 172.21.15.45:0/360508893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb47015c060 msgr2=0x7fb4700b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:12.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 --2- 172.21.15.45:0/360508893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb47015c060 0x7fb4700b4ed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0098a0 tx=0x7fb46c01c4f0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 -- 172.21.15.45:0/360508893 shutdown_connections 2023-07-09T02:17:12.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 --2- 172.21.15.45:0/360508893 >> v2:172.21.15.155:3300/0 conn(0x7fb4700d2620 0x7fb4700cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 --2- 172.21.15.45:0/360508893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb47015c060 0x7fb4700b4ed0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 -- 172.21.15.45:0/360508893 >> 172.21.15.45:0/360508893 conn(0x7fb4700698e0 msgr2=0x7fb470069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:12.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 -- 172.21.15.45:0/360508893 shutdown_connections 2023-07-09T02:17:12.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 -- 172.21.15.45:0/360508893 wait complete. 2023-07-09T02:17:12.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.852+0000 7fb477a56640 1 Processor -- start 2023-07-09T02:17:12.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 -- start start 2023-07-09T02:17:12.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4700cd120 0x7fb4700cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:12.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4700d2620 0x7fb470154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:12.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb47015c060 0x7fb47015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:12.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb470155350 con 0x7fb47015c060 2023-07-09T02:17:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb470154b40 con 0x7fb4700d2620 2023-07-09T02:17:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4701599e0 con 0x7fb4700cd120 2023-07-09T02:17:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb475ff3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb47015c060 0x7fb47015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb4757f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4700cd120 0x7fb4700cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb474ff1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4700d2620 0x7fb470154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb475ff3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb47015c060 0x7fb47015c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60500/0 (socket says 172.21.15.45:60500) 2023-07-09T02:17:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb475ff3640 1 -- 172.21.15.45:0/1537185605 learned_addr learned my addr 172.21.15.45:0/1537185605 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb4757f2640 1 -- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4700d2620 msgr2=0x7fb470154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:12.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb4757f2640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4700d2620 0x7fb470154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb4757f2640 1 -- 172.21.15.45:0/1537185605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb47015c060 msgr2=0x7fb47015c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:12.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb4757f2640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb47015c060 0x7fb47015c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:12.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb4757f2640 1 -- 172.21.15.45:0/1537185605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb468009a70 con 0x7fb4700cd120 2023-07-09T02:17:12.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb475ff3640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb47015c060 0x7fb47015c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:12.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb4757f2640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4700cd120 0x7fb4700cc970 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0ab000 tx=0x7fb46c01ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:12.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb465ffb640 1 -- 172.21.15.45:0/1537185605 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0b3800 con 0x7fb4700cd120 2023-07-09T02:17:12.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb465ffb640 1 -- 172.21.15.45:0/1537185605 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c0b3960 con 0x7fb4700cd120 2023-07-09T02:17:12.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb465ffb640 1 -- 172.21.15.45:0/1537185605 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0b3d10 con 0x7fb4700cd120 2023-07-09T02:17:12.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c0094d0 con 0x7fb4700cd120 2023-07-09T02:17:12.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4700b59f0 con 0x7fb4700cd120 2023-07-09T02:17:12.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.856+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4700d2370 con 0x7fb4700cd120 2023-07-09T02:17:12.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.860+0000 7fb465ffb640 1 -- 172.21.15.45:0/1537185605 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb46c0c8430 con 0x7fb4700cd120 2023-07-09T02:17:12.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.860+0000 7fb465ffb640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb4540662b0 0x7fb454068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:12.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.860+0000 7fb465ffb640 1 -- 172.21.15.45:0/1537185605 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb46c11e730 con 0x7fb4700cd120 2023-07-09T02:17:12.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.860+0000 7fb474ff1640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb4540662b0 0x7fb454068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:12.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.860+0000 7fb474ff1640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb4540662b0 0x7fb454068760 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb4700b5270 tx=0x7fb460007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:12.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:12.864+0000 7fb465ffb640 1 -- 172.21.15.45:0/1537185605 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb46c0ebc40 con 0x7fb4700cd120 2023-07-09T02:17:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.020+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb47004d7d0 con 0x7fb4700cd120 2023-07-09T02:17:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb465ffb640 1 -- 172.21.15.45:0/1537185605 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+18308 (secure 0 0 0) 0x7fb46c0aa610 con 0x7fb4700cd120 2023-07-09T02:17:13.025 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:13.025 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":122,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:12.050083+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:13.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb4540662b0 msgr2=0x7fb454068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb4540662b0 0x7fb454068760 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb4700b5270 tx=0x7fb460007d60 comp rx=0 tx=0).stop 2023-07-09T02:17:13.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4700cd120 msgr2=0x7fb4700cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4700cd120 0x7fb4700cc970 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0ab000 tx=0x7fb46c01ad30 comp rx=0 tx=0).stop 2023-07-09T02:17:13.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 shutdown_connections 2023-07-09T02:17:13.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb47015c060 0x7fb47015c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4700d2620 0x7fb470154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb4540662b0 0x7fb454068760 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 --2- 172.21.15.45:0/1537185605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4700cd120 0x7fb4700cc970 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 >> 172.21.15.45:0/1537185605 conn(0x7fb4700698e0 msgr2=0x7fb4700b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:13.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 shutdown_connections 2023-07-09T02:17:13.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.024+0000 7fb477a56640 1 -- 172.21.15.45:0/1537185605 wait complete. 2023-07-09T02:17:13.047 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcbb819640 1 Processor -- start 2023-07-09T02:17:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcbb819640 1 -- start start 2023-07-09T02:17:13.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcbb819640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcb415c060 0x7fbcb40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcbb819640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb40d2620 0x7fbcb40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcbb819640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb4160a50 con 0x7fbcb40cd120 2023-07-09T02:17:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcbb819640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb415c430 con 0x7fbcb415c060 2023-07-09T02:17:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcbb819640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb415fb60 con 0x7fbcb40d2620 2023-07-09T02:17:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb95b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbcb415c060 0x7fbcb40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb8db4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbcb40cd120 0x7fbcb40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37026/0 (socket says 172.21.15.45:37026) 2023-07-09T02:17:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb8db4640 1 -- 172.21.15.45:0/3522757799 learned_addr learned my addr 172.21.15.45:0/3522757799 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb9db6640 1 --2- 172.21.15.45:0/3522757799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb40d2620 0x7fbcb40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb95b5640 1 -- 172.21.15.45:0/3522757799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb40d2620 msgr2=0x7fbcb40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb95b5640 1 --2- 172.21.15.45:0/3522757799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb40d2620 0x7fbcb40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb95b5640 1 -- 172.21.15.45:0/3522757799 >> v1:172.21.15.45:6789/0 conn(0x7fbcb40cd120 legacy=0x7fbcb40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb95b5640 1 -- 172.21.15.45:0/3522757799 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb415fe40 con 0x7fbcb415c060 2023-07-09T02:17:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcabfff640 1 -- 172.21.15.45:0/3522757799 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361342033 0 0) 0x7fbcb4160a50 con 0x7fbcb40cd120 2023-07-09T02:17:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.188+0000 7fbcb9db6640 1 --2- 172.21.15.45:0/3522757799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb40d2620 0x7fbcb40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcb95b5640 1 --2- 172.21.15.45:0/3522757799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb415c060 0x7fbcb40b4ed0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00097c0 tx=0x7fbcb001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7020974a96d8964b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcabfff640 1 -- 172.21.15.45:0/3522757799 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00ab650 con 0x7fbcb415c060 2023-07-09T02:17:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcabfff640 1 -- 172.21.15.45:0/3522757799 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb00ab7b0 con 0x7fbcb415c060 2023-07-09T02:17:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcabfff640 1 -- 172.21.15.45:0/3522757799 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00abb40 con 0x7fbcb415c060 2023-07-09T02:17:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcbb819640 1 -- 172.21.15.45:0/3522757799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb415c060 msgr2=0x7fbcb40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcbb819640 1 --2- 172.21.15.45:0/3522757799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb415c060 0x7fbcb40b4ed0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00097c0 tx=0x7fbcb001c450 comp rx=0 tx=0).stop 2023-07-09T02:17:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcbb819640 1 -- 172.21.15.45:0/3522757799 shutdown_connections 2023-07-09T02:17:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcbb819640 1 --2- 172.21.15.45:0/3522757799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb40d2620 0x7fbcb40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcbb819640 1 --2- 172.21.15.45:0/3522757799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb415c060 0x7fbcb40b4ed0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcbb819640 1 -- 172.21.15.45:0/3522757799 >> 172.21.15.45:0/3522757799 conn(0x7fbcb40698e0 msgr2=0x7fbcb4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcbb819640 1 -- 172.21.15.45:0/3522757799 shutdown_connections 2023-07-09T02:17:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.192+0000 7fbcbb819640 1 -- 172.21.15.45:0/3522757799 wait complete. 2023-07-09T02:17:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 Processor -- start 2023-07-09T02:17:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 -- start start 2023-07-09T02:17:13.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcb40cd120 0x7fbcb4153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb40d2620 0x7fbcb40b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb415c060 0x7fbcb415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb415d750 con 0x7fbcb40d2620 2023-07-09T02:17:13.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb40ccec0 con 0x7fbcb40cd120 2023-07-09T02:17:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb415d140 con 0x7fbcb415c060 2023-07-09T02:17:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb40d2620 0x7fbcb40b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb40d2620 0x7fbcb40b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60522/0 (socket says 172.21.15.45:60522) 2023-07-09T02:17:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 -- 172.21.15.45:0/846927323 learned_addr learned my addr 172.21.15.45:0/846927323 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb95b5640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcb40cd120 0x7fbcb4153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb9db6640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb415c060 0x7fbcb415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 -- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb415c060 msgr2=0x7fbcb415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb415c060 0x7fbcb415dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 -- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcb40cd120 msgr2=0x7fbcb4153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcb40cd120 0x7fbcb4153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 -- 172.21.15.45:0/846927323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb0009420 con 0x7fbcb40d2620 2023-07-09T02:17:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcb8db4640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb40d2620 0x7fbcb40b3710 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fbca400c4b0 tx=0x7fbca400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbca9ffb640 1 -- 172.21.15.45:0/846927323 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40074e0 con 0x7fbcb40d2620 2023-07-09T02:17:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbca9ffb640 1 -- 172.21.15.45:0/846927323 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4007660 con 0x7fbcb40d2620 2023-07-09T02:17:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbca9ffb640 1 -- 172.21.15.45:0/846927323 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4004a30 con 0x7fbcb40d2620 2023-07-09T02:17:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.196+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb40b59f0 con 0x7fbcb40d2620 2023-07-09T02:17:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.200+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb415d3e0 con 0x7fbcb40d2620 2023-07-09T02:17:13.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.200+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb415d8c0 con 0x7fbcb40d2620 2023-07-09T02:17:13.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.200+0000 7fbca9ffb640 1 -- 172.21.15.45:0/846927323 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbca4004b90 con 0x7fbcb40d2620 2023-07-09T02:17:13.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.200+0000 7fbca9ffb640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc98066280 0x7fbc98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.200+0000 7fbca9ffb640 1 -- 172.21.15.45:0/846927323 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbca4082f10 con 0x7fbcb40d2620 2023-07-09T02:17:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.200+0000 7fbcb95b5640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc98066280 0x7fbc98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.200+0000 7fbcb95b5640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc98066280 0x7fbc98068730 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00af000 tx=0x7fbcb00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.204+0000 7fbca9ffb640 1 -- 172.21.15.45:0/846927323 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbca40504f0 con 0x7fbcb40d2620 2023-07-09T02:17:13.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.360+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcb404d7d0 con 0x7fbcb40d2620 2023-07-09T02:17:13.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.360+0000 7fbca9ffb640 1 -- 172.21.15.45:0/846927323 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+18308 (secure 0 0 0) 0x7fbca4018070 con 0x7fbcb40d2620 2023-07-09T02:17:13.363 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:13.364 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":122,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:12.050083+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc98066280 msgr2=0x7fbc98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc98066280 0x7fbc98068730 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00af000 tx=0x7fbcb00a7000 comp rx=0 tx=0).stop 2023-07-09T02:17:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb40d2620 msgr2=0x7fbcb40b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb40d2620 0x7fbcb40b3710 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fbca400c4b0 tx=0x7fbca400c970 comp rx=0 tx=0).stop 2023-07-09T02:17:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 shutdown_connections 2023-07-09T02:17:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbc98066280 0x7fbc98068730 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbcb415c060 0x7fbcb415dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb40d2620 0x7fbcb40b3710 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 --2- 172.21.15.45:0/846927323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbcb40cd120 0x7fbcb4153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 >> 172.21.15.45:0/846927323 conn(0x7fbcb40698e0 msgr2=0x7fbcb4157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 shutdown_connections 2023-07-09T02:17:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.364+0000 7fbcbb819640 1 -- 172.21.15.45:0/846927323 wait complete. 2023-07-09T02:17:13.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:17:13.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.528+0000 7f21ac71f640 1 Processor -- start 2023-07-09T02:17:13.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.528+0000 7f21ac71f640 1 -- start start 2023-07-09T02:17:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21ac71f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21a40c8d10 0x7f21a40c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21ac71f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a406bf30 con 0x7f21a40ca0f0 2023-07-09T02:17:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21ac71f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a406bc50 con 0x7f21a415db00 2023-07-09T02:17:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21ac71f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a40cab90 con 0x7f21a40c8d10 2023-07-09T02:17:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21aa4bb640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21a40ca0f0 0x7f21a40cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37038/0 (socket says 172.21.15.45:37038) 2023-07-09T02:17:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21aa4bb640 1 -- 172.21.15.45:0/2208881632 learned_addr learned my addr 172.21.15.45:0/2208881632 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21a9cba640 1 --2- 172.21.15.45:0/2208881632 >> v2:172.21.15.45:3300/0 conn(0x7f21a40c8d10 0x7f21a40c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21a9cba640 1 -- 172.21.15.45:0/2208881632 >> v1:172.21.15.155:6789/0 conn(0x7f21a415db00 legacy=0x7f21a406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21a9cba640 1 -- 172.21.15.45:0/2208881632 >> v1:172.21.15.45:6789/0 conn(0x7f21a40ca0f0 legacy=0x7f21a40cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21a9cba640 1 -- 172.21.15.45:0/2208881632 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40cae70 con 0x7f21a40c8d10 2023-07-09T02:17:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.532+0000 7f21a94b9640 1 -- 172.21.15.45:0/2208881632 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228113135 0 0) 0x7f21a406bf30 con 0x7f21a40ca0f0 2023-07-09T02:17:13.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21a9cba640 1 --2- 172.21.15.45:0/2208881632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a40c8d10 0x7f21a40c9160 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f21940097c0 tx=0x7f219401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2373c40ffccb844a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:13.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21a94b9640 1 -- 172.21.15.45:0/2208881632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940ab610 con 0x7f21a40c8d10 2023-07-09T02:17:13.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21a94b9640 1 -- 172.21.15.45:0/2208881632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21940ab770 con 0x7f21a40c8d10 2023-07-09T02:17:13.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21a94b9640 1 -- 172.21.15.45:0/2208881632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940abb00 con 0x7f21a40c8d10 2023-07-09T02:17:13.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 -- 172.21.15.45:0/2208881632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a40c8d10 msgr2=0x7f21a40c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 --2- 172.21.15.45:0/2208881632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a40c8d10 0x7f21a40c9160 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f21940097c0 tx=0x7f219401c3f0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 -- 172.21.15.45:0/2208881632 shutdown_connections 2023-07-09T02:17:13.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 --2- 172.21.15.45:0/2208881632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a40c8d10 0x7f21a40c9160 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 -- 172.21.15.45:0/2208881632 >> 172.21.15.45:0/2208881632 conn(0x7f21a40694b0 msgr2=0x7f21a40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:13.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 -- 172.21.15.45:0/2208881632 shutdown_connections 2023-07-09T02:17:13.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 -- 172.21.15.45:0/2208881632 wait complete. 2023-07-09T02:17:13.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 Processor -- start 2023-07-09T02:17:13.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.536+0000 7f21ac71f640 1 -- start start 2023-07-09T02:17:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a40c8d10 0x7f21a41461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a40ca0f0 0x7f21a41475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a415db00 0x7f21a4147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41510e0 con 0x7f21a415db00 2023-07-09T02:17:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4148160 con 0x7f21a40ca0f0 2023-07-09T02:17:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4148440 con 0x7f21a40c8d10 2023-07-09T02:17:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a415db00 0x7f21a4147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a415db00 0x7f21a4147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60540/0 (socket says 172.21.15.45:60540) 2023-07-09T02:17:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 -- 172.21.15.45:0/1173768486 learned_addr learned my addr 172.21.15.45:0/1173768486 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21a9cba640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a40ca0f0 0x7f21a41475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aa4bb640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a40c8d10 0x7f21a41461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 -- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a40c8d10 msgr2=0x7f21a41461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a40c8d10 0x7f21a41461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 -- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a40ca0f0 msgr2=0x7f21a41475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a40ca0f0 0x7f21a41475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 -- 172.21.15.45:0/1173768486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194009420 con 0x7f21a415db00 2023-07-09T02:17:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21aacbc640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a415db00 0x7f21a4147b30 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c730 tx=0x7f219c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f219affd640 1 -- 172.21.15.45:0/1173768486 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c003b80 con 0x7f21a415db00 2023-07-09T02:17:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f219affd640 1 -- 172.21.15.45:0/1173768486 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c003ce0 con 0x7f21a415db00 2023-07-09T02:17:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f219affd640 1 -- 172.21.15.45:0/1173768486 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00aa30 con 0x7f21a415db00 2023-07-09T02:17:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a4148720 con 0x7f21a415db00 2023-07-09T02:17:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a4148a00 con 0x7f21a415db00 2023-07-09T02:17:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a4150f40 con 0x7f21a415db00 2023-07-09T02:17:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.540+0000 7f219affd640 1 -- 172.21.15.45:0/1173768486 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f219c00ab90 con 0x7f21a415db00 2023-07-09T02:17:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.544+0000 7f219affd640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2188066280 0x7f2188068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.544+0000 7f219affd640 1 -- 172.21.15.45:0/1173768486 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f219c083af0 con 0x7f21a415db00 2023-07-09T02:17:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.544+0000 7f21aa4bb640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2188066280 0x7f2188068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.544+0000 7f21aa4bb640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2188066280 0x7f2188068730 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f21a0007fd0 tx=0x7f21a0007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.548+0000 7f219affd640 1 -- 172.21.15.45:0/1173768486 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21a4150f40 con 0x7f21a415db00 2023-07-09T02:17:13.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-07-09T02:17:13.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:13.736+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f21a4150f40 con 0x7f21a415db00 2023-07-09T02:17:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.684+0000 7f219affd640 1 -- 172.21.15.45:0/1173768486 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) v1 ==== 118+0+0 (secure 0 0 0) 0x7f21a4150f40 con 0x7f21a415db00 2023-07-09T02:17:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.684+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2188066280 msgr2=0x7f2188068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:14.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.684+0000 7f21ac71f640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2188066280 0x7f2188068730 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f21a0007fd0 tx=0x7f21a0007ba0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.684+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a415db00 msgr2=0x7f21a4147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:14.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.684+0000 7f21ac71f640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a415db00 0x7f21a4147b30 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c730 tx=0x7f219c00cbf0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.688+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 shutdown_connections 2023-07-09T02:17:14.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.688+0000 7f21ac71f640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21a415db00 0x7f21a4147b30 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.688+0000 7f21ac71f640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a40ca0f0 0x7f21a41475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.688+0000 7f21ac71f640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2188066280 0x7f2188068730 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.688+0000 7f21ac71f640 1 --2- 172.21.15.45:0/1173768486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a40c8d10 0x7f21a41461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.688+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 >> 172.21.15.45:0/1173768486 conn(0x7f21a40694b0 msgr2=0x7f21a40c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.688+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 shutdown_connections 2023-07-09T02:17:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.688+0000 7f21ac71f640 1 -- 172.21.15.45:0/1173768486 wait complete. 2023-07-09T02:17:14.711 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:17:14.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:17:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.860+0000 7f14cee56640 1 Processor -- start 2023-07-09T02:17:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.860+0000 7f14cee56640 1 -- start start 2023-07-09T02:17:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.860+0000 7f14cee56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f14c80ca0f0 0x7f14c80cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.860+0000 7f14cee56640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c806bf30 con 0x7f14c80cbbb0 2023-07-09T02:17:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.860+0000 7f14cee56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c806bc50 con 0x7f14c815db00 2023-07-09T02:17:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.860+0000 7f14cee56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80cab90 con 0x7f14c80ca0f0 2023-07-09T02:17:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.860+0000 7f14c7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f14c80cbbb0 0x7f14c80c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37042/0 (socket says 172.21.15.45:37042) 2023-07-09T02:17:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.860+0000 7f14c7fff640 1 -- 172.21.15.45:0/487756193 learned_addr learned my addr 172.21.15.45:0/487756193 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14ccbf2640 1 --2- 172.21.15.45:0/487756193 >> v2:172.21.15.155:3300/0 conn(0x7f14c80ca0f0 0x7f14c80cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196847654 0 0) 0x7f14c806bf30 con 0x7f14c80cbbb0 2023-07-09T02:17:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b8003530 con 0x7f14c80cbbb0 2023-07-09T02:17:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3656506556 0 0) 0x7f14b8003530 con 0x7f14c80cbbb0 2023-07-09T02:17:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 >> v2:172.21.15.155:3300/0 conn(0x7f14c80ca0f0 msgr2=0x7f14c80cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 --2- 172.21.15.45:0/487756193 >> v2:172.21.15.155:3300/0 conn(0x7f14c80ca0f0 0x7f14c80cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 >> v1:172.21.15.155:6789/0 conn(0x7f14c815db00 legacy=0x7f14c806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80cae70 con 0x7f14c80cbbb0 2023-07-09T02:17:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f14b4001680 con 0x7f14c80cbbb0 2023-07-09T02:17:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 >> v1:172.21.15.45:6789/0 conn(0x7f14c80cbbb0 legacy=0x7f14c80c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b8003980 0x7f14b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14b80047d0 0x7f14b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b8005180 0x7f14b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:14.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80cab90 con 0x7f14b80047d0 2023-07-09T02:17:14.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b800c090 con 0x7f14b8005180 2023-07-09T02:17:14.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b800c250 con 0x7f14b8003980 2023-07-09T02:17:14.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c7fff640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14b80047d0 0x7f14b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:14.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14ccbf2640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b8003980 0x7f14b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14cd3f3640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b8005180 0x7f14b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c7fff640 1 -- 172.21.15.45:0/487756193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b8003980 msgr2=0x7f14b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c7fff640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b8003980 0x7f14b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c7fff640 1 -- 172.21.15.45:0/487756193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b8005180 msgr2=0x7f14b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c7fff640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b8005180 0x7f14b800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14c7fff640 1 -- 172.21.15.45:0/487756193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b8003530 con 0x7f14b80047d0 2023-07-09T02:17:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.864+0000 7f14cd3f3640 1 -- 172.21.15.45:0/487756193 reap_dead start 2023-07-09T02:17:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14c7fff640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14b80047d0 0x7f14b8004c40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c240 tx=0x7f14b401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33402b8126d04e28 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4005ae0 con 0x7f14b80047d0 2023-07-09T02:17:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4005c40 con 0x7f14b80047d0 2023-07-09T02:17:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14c77fe640 1 -- 172.21.15.45:0/487756193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40a5a70 con 0x7f14b80047d0 2023-07-09T02:17:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 -- 172.21.15.45:0/487756193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14b80047d0 msgr2=0x7f14b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14b80047d0 0x7f14b8004c40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c240 tx=0x7f14b401cc40 comp rx=0 tx=0).stop 2023-07-09T02:17:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 -- 172.21.15.45:0/487756193 shutdown_connections 2023-07-09T02:17:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 --2- 172.21.15.45:0/487756193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14b80047d0 0x7f14b8004c40 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 -- 172.21.15.45:0/487756193 >> 172.21.15.45:0/487756193 conn(0x7f14c80694b0 msgr2=0x7f14c80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 -- 172.21.15.45:0/487756193 shutdown_connections 2023-07-09T02:17:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 -- 172.21.15.45:0/487756193 wait complete. 2023-07-09T02:17:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 Processor -- start 2023-07-09T02:17:14.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.868+0000 7f14cee56640 1 -- start start 2023-07-09T02:17:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b80047d0 0x7f14c8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8150b90 0x7f14c80b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14c814ff20 0x7f14c8150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81e71b0 con 0x7f14c8150b90 2023-07-09T02:17:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80c6ce0 con 0x7f14c814ff20 2023-07-09T02:17:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81508c0 con 0x7f14b80047d0 2023-07-09T02:17:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8150b90 0x7f14c80b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8150b90 0x7f14c80b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60552/0 (socket says 172.21.15.45:60552) 2023-07-09T02:17:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 -- 172.21.15.45:0/3310386042 learned_addr learned my addr 172.21.15.45:0/3310386042 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:14.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cd3f3640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14c814ff20 0x7f14c8150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:14.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14ccbf2640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b80047d0 0x7f14c8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:14.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 -- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b80047d0 msgr2=0x7f14c8159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:14.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b80047d0 0x7f14c8159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 -- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14c814ff20 msgr2=0x7f14c8150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:14.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14c814ff20 0x7f14c8150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:14.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 -- 172.21.15.45:0/3310386042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c81e6910 con 0x7f14c8150b90 2023-07-09T02:17:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c7fff640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8150b90 0x7f14c80b2880 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f14b401ca70 tx=0x7f14b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c57fa640 1 -- 172.21.15.45:0/3310386042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40b4070 con 0x7f14c8150b90 2023-07-09T02:17:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c57fa640 1 -- 172.21.15.45:0/3310386042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4001710 con 0x7f14c8150b90 2023-07-09T02:17:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c57fa640 1 -- 172.21.15.45:0/3310386042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40a5a30 con 0x7f14c8150b90 2023-07-09T02:17:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c81e6bf0 con 0x7f14c8150b90 2023-07-09T02:17:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c80c6ef0 con 0x7f14c8150b90 2023-07-09T02:17:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c804d7d0 con 0x7f14c8150b90 2023-07-09T02:17:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.872+0000 7f14c57fa640 1 -- 172.21.15.45:0/3310386042 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14b40a5b90 con 0x7f14c8150b90 2023-07-09T02:17:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.876+0000 7f14c57fa640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f14ac0662b0 0x7f14ac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.876+0000 7f14c57fa640 1 -- 172.21.15.45:0/3310386042 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14b411d920 con 0x7f14c8150b90 2023-07-09T02:17:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.876+0000 7f14ccbf2640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f14ac0662b0 0x7f14ac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.876+0000 7f14ccbf2640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f14ac0662b0 0x7f14ac068760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f14c80631c0 tx=0x7f14bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:14.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:14.880+0000 7f14c57fa640 1 -- 172.21.15.45:0/3310386042 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14b40ead90 con 0x7f14c8150b90 2023-07-09T02:17:15.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.064+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f14c806c540 con 0x7f14c8150b90 2023-07-09T02:17:15.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14c57fa640 1 -- 172.21.15.45:0/3310386042 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) v1 ==== 122+0+0 (secure 0 0 0) 0x7f14b40ee3b0 con 0x7f14c8150b90 2023-07-09T02:17:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f14ac0662b0 msgr2=0x7f14ac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:15.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f14ac0662b0 0x7f14ac068760 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f14c80631c0 tx=0x7f14bc009190 comp rx=0 tx=0).stop 2023-07-09T02:17:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8150b90 msgr2=0x7f14c80b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8150b90 0x7f14c80b2880 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f14b401ca70 tx=0x7f14b8005800 comp rx=0 tx=0).stop 2023-07-09T02:17:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 shutdown_connections 2023-07-09T02:17:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14c814ff20 0x7f14c8150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8150b90 0x7f14c80b2880 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f14ac0662b0 0x7f14ac068760 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 --2- 172.21.15.45:0/3310386042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14b80047d0 0x7f14c8159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 >> 172.21.15.45:0/3310386042 conn(0x7f14c80694b0 msgr2=0x7f14c815a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:15.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 shutdown_connections 2023-07-09T02:17:15.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.692+0000 7f14cee56640 1 -- 172.21.15.45:0/3310386042 wait complete. 2023-07-09T02:17:15.716 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:17:15.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:15.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05ac856640 1 Processor -- start 2023-07-09T02:17:15.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05ac856640 1 -- start start 2023-07-09T02:17:15.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05ac856640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05a80cd290 0x7f05a80cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:15.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05ac856640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05a806aa40 0x7f05a80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:15.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05ac856640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a8071140 con 0x7f05a806a5c0 2023-07-09T02:17:15.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05ac856640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a806b010 con 0x7f05a80cd290 2023-07-09T02:17:15.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05ac856640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a80cdba0 con 0x7f05a806aa40 2023-07-09T02:17:15.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05a659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05a80cd290 0x7f05a80cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:15.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05a659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05a80cd290 0x7f05a80cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60568/0 (socket says 172.21.15.45:60568) 2023-07-09T02:17:15.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.860+0000 7f05a659c640 1 -- 172.21.15.45:0/4250713319 learned_addr learned my addr 172.21.15.45:0/4250713319 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a6d9d640 1 --2- 172.21.15.45:0/4250713319 >> v2:172.21.15.155:3300/0 conn(0x7f05a806aa40 0x7f05a80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a659c640 1 -- 172.21.15.45:0/4250713319 >> v2:172.21.15.155:3300/0 conn(0x7f05a806aa40 msgr2=0x7f05a80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a659c640 1 --2- 172.21.15.45:0/4250713319 >> v2:172.21.15.155:3300/0 conn(0x7f05a806aa40 0x7f05a80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a659c640 1 -- 172.21.15.45:0/4250713319 >> v1:172.21.15.155:6789/0 conn(0x7f05a806a5c0 legacy=0x7f05a80b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a659c640 1 -- 172.21.15.45:0/4250713319 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a815c970 con 0x7f05a80cd290 2023-07-09T02:17:15.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a6d9d640 1 --2- 172.21.15.45:0/4250713319 >> v2:172.21.15.155:3300/0 conn(0x7f05a806aa40 0x7f05a80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:15.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a659c640 1 --2- 172.21.15.45:0/4250713319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a80cd290 0x7f05a80cd660 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f05a815fd10 tx=0x7f059801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d3f98f09fbfdf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:15.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a5d9b640 1 -- 172.21.15.45:0/4250713319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980ab600 con 0x7f05a80cd290 2023-07-09T02:17:15.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a5d9b640 1 -- 172.21.15.45:0/4250713319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980a7050 con 0x7f05a80cd290 2023-07-09T02:17:15.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.864+0000 7f05a5d9b640 1 -- 172.21.15.45:0/4250713319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980ab980 con 0x7f05a80cd290 2023-07-09T02:17:15.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- 172.21.15.45:0/4250713319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a80cd290 msgr2=0x7f05a80cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:15.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 --2- 172.21.15.45:0/4250713319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a80cd290 0x7f05a80cd660 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f05a815fd10 tx=0x7f059801c430 comp rx=0 tx=0).stop 2023-07-09T02:17:15.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- 172.21.15.45:0/4250713319 shutdown_connections 2023-07-09T02:17:15.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 --2- 172.21.15.45:0/4250713319 >> v2:172.21.15.155:3300/0 conn(0x7f05a806aa40 0x7f05a80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 --2- 172.21.15.45:0/4250713319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a80cd290 0x7f05a80cd660 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- 172.21.15.45:0/4250713319 >> 172.21.15.45:0/4250713319 conn(0x7f05a806d140 msgr2=0x7f05a806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:15.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- 172.21.15.45:0/4250713319 shutdown_connections 2023-07-09T02:17:15.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- 172.21.15.45:0/4250713319 wait complete. 2023-07-09T02:17:15.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 Processor -- start 2023-07-09T02:17:15.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- start start 2023-07-09T02:17:15.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a806a5c0 0x7f05a80b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:15.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a806aa40 0x7f05a815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:15.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a80cd290 0x7f05a80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:15.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80b66d0 con 0x7f05a806a5c0 2023-07-09T02:17:15.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80b1500 con 0x7f05a806aa40 2023-07-09T02:17:15.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05ac856640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80b63f0 con 0x7f05a80cd290 2023-07-09T02:17:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a806a5c0 0x7f05a80b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a806a5c0 0x7f05a80b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60570/0 (socket says 172.21.15.45:60570) 2023-07-09T02:17:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a659c640 1 -- 172.21.15.45:0/2435897548 learned_addr learned my addr 172.21.15.45:0/2435897548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a6d9d640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a80cd290 0x7f05a80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f059ffff640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a806aa40 0x7f05a815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a659c640 1 -- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a80cd290 msgr2=0x7f05a80b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a659c640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a80cd290 0x7f05a80b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a659c640 1 -- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a806aa40 msgr2=0x7f05a815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a659c640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a806aa40 0x7f05a815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.868+0000 7f05a659c640 1 -- 172.21.15.45:0/2435897548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980094d0 con 0x7f05a806a5c0 2023-07-09T02:17:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f05a659c640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a806a5c0 0x7f05a80b59f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f059801a060 tx=0x7f05980191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f059effd640 1 -- 172.21.15.45:0/2435897548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980b3890 con 0x7f05a806a5c0 2023-07-09T02:17:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f059effd640 1 -- 172.21.15.45:0/2435897548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980b39f0 con 0x7f05a806a5c0 2023-07-09T02:17:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a80b0eb0 con 0x7f05a806a5c0 2023-07-09T02:17:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f059effd640 1 -- 172.21.15.45:0/2435897548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980b3da0 con 0x7f05a806a5c0 2023-07-09T02:17:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a80b5f30 con 0x7f05a806a5c0 2023-07-09T02:17:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a80b0d10 con 0x7f05a806a5c0 2023-07-09T02:17:15.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f059effd640 1 -- 172.21.15.45:0/2435897548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05980b2070 con 0x7f05a806a5c0 2023-07-09T02:17:15.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f059effd640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0588066280 0x7f0588068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:15.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f059effd640 1 -- 172.21.15.45:0/2435897548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f059811e150 con 0x7f05a806a5c0 2023-07-09T02:17:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.872+0000 7f059ffff640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0588066280 0x7f0588068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.876+0000 7f059ffff640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0588066280 0x7f0588068730 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f05a80c75e0 tx=0x7f0590009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:15.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:15.876+0000 7f059effd640 1 -- 172.21.15.45:0/2435897548 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05a80b0d10 con 0x7f05a806a5c0 2023-07-09T02:17:16.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.064+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05a80b0d10 con 0x7f05a806a5c0 2023-07-09T02:17:16.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f059effd640 1 -- 172.21.15.45:0/2435897548 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f05a80b0d10 con 0x7f05a806a5c0 2023-07-09T02:17:16.068 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:16.069 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:12.050406+0000","modified":"2023-07-09T02:17:15.686025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7392":{"gid":7392,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3333848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3333848450},{"type":"v1","addr":"172.21.15.155:6837","nonce":3333848450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T02:17:16.069 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 59 2023-07-09T02:17:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0588066280 msgr2=0x7f0588068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0588066280 0x7f0588068730 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f05a80c75e0 tx=0x7f0590009040 comp rx=0 tx=0).stop 2023-07-09T02:17:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a806a5c0 msgr2=0x7f05a80b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a806a5c0 0x7f05a80b59f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f059801a060 tx=0x7f05980191d0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 shutdown_connections 2023-07-09T02:17:16.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0588066280 0x7f0588068730 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a80cd290 0x7f05a80b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a806aa40 0x7f05a815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 --2- 172.21.15.45:0/2435897548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a806a5c0 0x7f05a80b59f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 >> 172.21.15.45:0/2435897548 conn(0x7f05a806d140 msgr2=0x7f05a80d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:16.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 shutdown_connections 2023-07-09T02:17:16.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.068+0000 7f05ac856640 1 -- 172.21.15.45:0/2435897548 wait complete. 2023-07-09T02:17:16.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:16.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98be582640 1 Processor -- start 2023-07-09T02:17:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98be582640 1 -- start start 2023-07-09T02:17:16.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98be582640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98b815c060 0x7f98b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98be582640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80d2620 0x7f98b80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98be582640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b8160a50 con 0x7f98b80cd120 2023-07-09T02:17:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98be582640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b815c430 con 0x7f98b815c060 2023-07-09T02:17:16.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98be582640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b815fb60 con 0x7f98b80d2620 2023-07-09T02:17:16.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98b77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f98b80cd120 0x7f98b80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37048/0 (socket says 172.21.15.45:37048) 2023-07-09T02:17:16.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98b77fe640 1 -- 172.21.15.45:0/2010953324 learned_addr learned my addr 172.21.15.45:0/2010953324 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:16.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98b7fff640 1 --2- 172.21.15.45:0/2010953324 >> v2:172.21.15.45:3300/0 conn(0x7f98b815c060 0x7f98b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98bcb1f640 1 --2- 172.21.15.45:0/2010953324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80d2620 0x7f98b80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98b6ffd640 1 -- 172.21.15.45:0/2010953324 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317762882 0 0) 0x7f98b8160a50 con 0x7f98b80cd120 2023-07-09T02:17:16.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98b7fff640 1 -- 172.21.15.45:0/2010953324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80d2620 msgr2=0x7f98b80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:16.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98b7fff640 1 --2- 172.21.15.45:0/2010953324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80d2620 0x7f98b80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98b7fff640 1 -- 172.21.15.45:0/2010953324 >> v1:172.21.15.45:6789/0 conn(0x7f98b80cd120 legacy=0x7f98b80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.232+0000 7f98b7fff640 1 -- 172.21.15.45:0/2010953324 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b815fe40 con 0x7f98b815c060 2023-07-09T02:17:16.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98b7fff640 1 --2- 172.21.15.45:0/2010953324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b815c060 0x7f98b80b4ed0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f98a80097c0 tx=0x7f98a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15726fc9c27e1b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98b6ffd640 1 -- 172.21.15.45:0/2010953324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80ab650 con 0x7f98b815c060 2023-07-09T02:17:16.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98b6ffd640 1 -- 172.21.15.45:0/2010953324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a80ab7b0 con 0x7f98b815c060 2023-07-09T02:17:16.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98b6ffd640 1 -- 172.21.15.45:0/2010953324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80abb40 con 0x7f98b815c060 2023-07-09T02:17:16.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98be582640 1 -- 172.21.15.45:0/2010953324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b815c060 msgr2=0x7f98b80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98be582640 1 --2- 172.21.15.45:0/2010953324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b815c060 0x7f98b80b4ed0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f98a80097c0 tx=0x7f98a801c450 comp rx=0 tx=0).stop 2023-07-09T02:17:16.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98be582640 1 -- 172.21.15.45:0/2010953324 shutdown_connections 2023-07-09T02:17:16.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98be582640 1 --2- 172.21.15.45:0/2010953324 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b80d2620 0x7f98b80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98be582640 1 --2- 172.21.15.45:0/2010953324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b815c060 0x7f98b80b4ed0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98be582640 1 -- 172.21.15.45:0/2010953324 >> 172.21.15.45:0/2010953324 conn(0x7f98b80698e0 msgr2=0x7f98b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:16.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98be582640 1 -- 172.21.15.45:0/2010953324 shutdown_connections 2023-07-09T02:17:16.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.236+0000 7f98be582640 1 -- 172.21.15.45:0/2010953324 wait complete. 2023-07-09T02:17:16.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 Processor -- start 2023-07-09T02:17:16.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 -- start start 2023-07-09T02:17:16.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80cd120 0x7f98b80cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80d2620 0x7f98b815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c060 0x7f98b80b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b815e0f0 con 0x7f98b80d2620 2023-07-09T02:17:16.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b815d050 con 0x7f98b80cd120 2023-07-09T02:17:16.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b815d330 con 0x7f98b815c060 2023-07-09T02:17:16.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80d2620 0x7f98b815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80d2620 0x7f98b815c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60588/0 (socket says 172.21.15.45:60588) 2023-07-09T02:17:16.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 -- 172.21.15.45:0/3220678181 learned_addr learned my addr 172.21.15.45:0/3220678181 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:16.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b7fff640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80cd120 0x7f98b80cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98bcb1f640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c060 0x7f98b80b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 -- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c060 msgr2=0x7f98b80b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c060 0x7f98b80b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 -- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80cd120 msgr2=0x7f98b80cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80cd120 0x7f98b80cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 -- 172.21.15.45:0/3220678181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8009420 con 0x7f98b80d2620 2023-07-09T02:17:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b77fe640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80d2620 0x7f98b815c600 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00c4b0 tx=0x7f98ac00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b4ff9640 1 -- 172.21.15.45:0/3220678181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0074e0 con 0x7f98b80d2620 2023-07-09T02:17:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b4ff9640 1 -- 172.21.15.45:0/3220678181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac007660 con 0x7f98b80d2620 2023-07-09T02:17:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98b4ff9640 1 -- 172.21.15.45:0/3220678181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac004a30 con 0x7f98b80d2620 2023-07-09T02:17:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b80b59f0 con 0x7f98b80d2620 2023-07-09T02:17:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b815d8f0 con 0x7f98b80d2620 2023-07-09T02:17:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.240+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b804d7d0 con 0x7f98b80d2620 2023-07-09T02:17:16.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.244+0000 7f98b4ff9640 1 -- 172.21.15.45:0/3220678181 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98ac004b90 con 0x7f98b80d2620 2023-07-09T02:17:16.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.244+0000 7f98b4ff9640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066280 0x7f98a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.244+0000 7f98b4ff9640 1 -- 172.21.15.45:0/3220678181 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98ac082fa0 con 0x7f98b80d2620 2023-07-09T02:17:16.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.244+0000 7f98b7fff640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066280 0x7f98a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.244+0000 7f98b7fff640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066280 0x7f98a4068730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f98a80af000 tx=0x7f98a80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.248+0000 7f98b4ff9640 1 -- 172.21.15.45:0/3220678181 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98ac0504f0 con 0x7f98b80d2620 2023-07-09T02:17:16.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.400+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98b806baa0 con 0x7f98b80d2620 2023-07-09T02:17:16.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98b4ff9640 1 -- 172.21.15.45:0/3220678181 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+18295 (secure 0 0 0) 0x7f98ac018070 con 0x7f98b80d2620 2023-07-09T02:17:16.405 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:16.405 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":123,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:13.656065+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:16.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066280 msgr2=0x7f98a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066280 0x7f98a4068730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f98a80af000 tx=0x7f98a80a7000 comp rx=0 tx=0).stop 2023-07-09T02:17:16.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80d2620 msgr2=0x7f98b815c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80d2620 0x7f98b815c600 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00c4b0 tx=0x7f98ac00c970 comp rx=0 tx=0).stop 2023-07-09T02:17:16.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 shutdown_connections 2023-07-09T02:17:16.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f98a4066280 0x7f98a4068730 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98b815c060 0x7f98b80b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98b80d2620 0x7f98b815c600 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 --2- 172.21.15.45:0/3220678181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98b80cd120 0x7f98b80cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 >> 172.21.15.45:0/3220678181 conn(0x7f98b80698e0 msgr2=0x7f98b80b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:16.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 shutdown_connections 2023-07-09T02:17:16.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.404+0000 7f98be582640 1 -- 172.21.15.45:0/3220678181 wait complete. 2023-07-09T02:17:16.426 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:17:16.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:17:16.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcdae5db640 1 Processor -- start 2023-07-09T02:17:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcdae5db640 1 -- start start 2023-07-09T02:17:16.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcdae5db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcda815c060 0x7fcda80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcdae5db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcda80cd120 0x7fcda80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcdae5db640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda8160a50 con 0x7fcda80d2450 2023-07-09T02:17:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcdae5db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80d28d0 con 0x7fcda80cd120 2023-07-09T02:17:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcdae5db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80cfe40 con 0x7fcda815c060 2023-07-09T02:17:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcda80cd120 0x7fcda80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcda80cd120 0x7fcda80d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60590/0 (socket says 172.21.15.45:60590) 2023-07-09T02:17:16.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda77fe640 1 -- 172.21.15.45:0/1656225846 learned_addr learned my addr 172.21.15.45:0/1656225846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:16.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda7fff640 1 --2- 172.21.15.45:0/1656225846 >> v2:172.21.15.155:3300/0 conn(0x7fcda815c060 0x7fcda80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda77fe640 1 -- 172.21.15.45:0/1656225846 >> v2:172.21.15.155:3300/0 conn(0x7fcda815c060 msgr2=0x7fcda80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:16.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda77fe640 1 --2- 172.21.15.45:0/1656225846 >> v2:172.21.15.155:3300/0 conn(0x7fcda815c060 0x7fcda80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda77fe640 1 -- 172.21.15.45:0/1656225846 >> v1:172.21.15.155:6789/0 conn(0x7fcda80d2450 legacy=0x7fcda80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda77fe640 1 -- 172.21.15.45:0/1656225846 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda815c430 con 0x7fcda80cd120 2023-07-09T02:17:16.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.568+0000 7fcda6ffd640 1 -- 172.21.15.45:0/1656225846 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562839291 0 0) 0x7fcda8160a50 con 0x7fcda80d2450 2023-07-09T02:17:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcda77fe640 1 --2- 172.21.15.45:0/1656225846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80cd120 0x7fcda80d1f10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcda80d3ad0 tx=0x7fcd9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27baf926298b2309 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcda6ffd640 1 -- 172.21.15.45:0/1656225846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0ab5f0 con 0x7fcda80cd120 2023-07-09T02:17:16.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcda6ffd640 1 -- 172.21.15.45:0/1656225846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0ab750 con 0x7fcda80cd120 2023-07-09T02:17:16.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcda6ffd640 1 -- 172.21.15.45:0/1656225846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0abae0 con 0x7fcda80cd120 2023-07-09T02:17:16.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcdae5db640 1 -- 172.21.15.45:0/1656225846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80cd120 msgr2=0x7fcda80d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcdae5db640 1 --2- 172.21.15.45:0/1656225846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80cd120 0x7fcda80d1f10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcda80d3ad0 tx=0x7fcd9c01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcdae5db640 1 -- 172.21.15.45:0/1656225846 shutdown_connections 2023-07-09T02:17:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcdae5db640 1 --2- 172.21.15.45:0/1656225846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80cd120 0x7fcda80d1f10 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcdae5db640 1 --2- 172.21.15.45:0/1656225846 >> v2:172.21.15.155:3300/0 conn(0x7fcda815c060 0x7fcda80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcdae5db640 1 -- 172.21.15.45:0/1656225846 >> 172.21.15.45:0/1656225846 conn(0x7fcda80698e0 msgr2=0x7fcda8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcdae5db640 1 -- 172.21.15.45:0/1656225846 shutdown_connections 2023-07-09T02:17:16.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.572+0000 7fcdae5db640 1 -- 172.21.15.45:0/1656225846 wait complete. 2023-07-09T02:17:16.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 Processor -- start 2023-07-09T02:17:16.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 -- start start 2023-07-09T02:17:16.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda80cd120 0x7fcda80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80d2450 0x7fcda80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda815c060 0x7fcda8151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda815a5a0 con 0x7fcda80d2450 2023-07-09T02:17:16.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda815a880 con 0x7fcda80cd120 2023-07-09T02:17:16.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda815ab60 con 0x7fcda815c060 2023-07-09T02:17:16.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80d2450 0x7fcda80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80d2450 0x7fcda80cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60606/0 (socket says 172.21.15.45:60606) 2023-07-09T02:17:16.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 -- 172.21.15.45:0/3185493153 learned_addr learned my addr 172.21.15.45:0/3185493153 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:16.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda7fff640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda80cd120 0x7fcda80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdacb78640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda815c060 0x7fcda8151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 -- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda815c060 msgr2=0x7fcda8151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda815c060 0x7fcda8151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 -- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda80cd120 msgr2=0x7fcda80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda80cd120 0x7fcda80b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 -- 172.21.15.45:0/3185493153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0094d0 con 0x7fcda80d2450 2023-07-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdacb78640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda815c060 0x7fcda8151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda77fe640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80d2450 0x7fcda80cb5b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0190e0 tx=0x7fcd9c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda4ff9640 1 -- 172.21.15.45:0/3185493153 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0be5f0 con 0x7fcda80d2450 2023-07-09T02:17:16.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda4ff9640 1 -- 172.21.15.45:0/3185493153 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0be750 con 0x7fcda80d2450 2023-07-09T02:17:16.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcda4ff9640 1 -- 172.21.15.45:0/3185493153 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0beae0 con 0x7fcda80d2450 2023-07-09T02:17:16.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda815ae40 con 0x7fcda80d2450 2023-07-09T02:17:16.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.576+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda815a1c0 con 0x7fcda80d2450 2023-07-09T02:17:16.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.580+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda804d7d0 con 0x7fcda80d2450 2023-07-09T02:17:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.580+0000 7fcda4ff9640 1 -- 172.21.15.45:0/3185493153 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd9c0b43f0 con 0x7fcda80d2450 2023-07-09T02:17:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.580+0000 7fcda4ff9640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd94066280 0x7fcd94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.580+0000 7fcda4ff9640 1 -- 172.21.15.45:0/3185493153 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd9c0a8050 con 0x7fcda80d2450 2023-07-09T02:17:16.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.580+0000 7fcda7fff640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd94066280 0x7fcd94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.584+0000 7fcda7fff640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd94066280 0x7fcd94068730 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009ac0 tx=0x7fcd98009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.584+0000 7fcda4ff9640 1 -- 172.21.15.45:0/3185493153 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd9c0ebd30 con 0x7fcda80d2450 2023-07-09T02:17:16.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.740+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcda8160400 con 0x7fcd94066280 2023-07-09T02:17:16.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.748+0000 7fcda4ff9640 1 -- 172.21.15.45:0/3185493153 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305972 (secure 0 0 0) 0x7fcd980119e0 con 0x7fcd94066280 2023-07-09T02:17:16.751 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:16.754 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:17:16.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd94066280 msgr2=0x7fcd94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd94066280 0x7fcd94068730 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009ac0 tx=0x7fcd98009190 comp rx=0 tx=0).stop 2023-07-09T02:17:16.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80d2450 msgr2=0x7fcda80cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80d2450 0x7fcda80cb5b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0190e0 tx=0x7fcd9c01ad10 comp rx=0 tx=0).stop 2023-07-09T02:17:16.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 shutdown_connections 2023-07-09T02:17:16.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd94066280 0x7fcd94068730 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcda815c060 0x7fcda8151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda80d2450 0x7fcda80cb5b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 --2- 172.21.15.45:0/3185493153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcda80cd120 0x7fcda80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 >> 172.21.15.45:0/3185493153 conn(0x7fcda80698e0 msgr2=0x7fcda8154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:16.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 shutdown_connections 2023-07-09T02:17:16.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.752+0000 7fcdae5db640 1 -- 172.21.15.45:0/3185493153 wait complete. 2023-07-09T02:17:16.774 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2023-07-09T02:17:16.614605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555697,"statfs":{"total":1600000000,"available":1593034148,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.969148"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660525+0000","last_change":"2023-07-09T02:17:12.664800+0000","last_active":"2023-07-09T02:17:13.660525+0000","last_peered":"2023-07-09T02:17:13.660525+0000","last_clean":"2023-07-09T02:17:13.660525+0000","last_became_active":"2023-07-09T02:17:12.664576+0000","last_became_peered":"2023-07-09T02:17:12.664576+0000","last_unstale":"2023-07-09T02:17:13.660525+0000","last_undegraded":"2023-07-09T02:17:13.660525+0000","last_fullsized":"2023-07-09T02:17:13.660525+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:17:11.800974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516600+0000","last_change":"2023-07-09T02:17:12.678621+0000","last_active":"2023-07-09T02:17:14.516600+0000","last_peered":"2023-07-09T02:17:14.516600+0000","last_clean":"2023-07-09T02:17:14.516600+0000","last_became_active":"2023-07-09T02:17:12.678238+0000","last_became_peered":"2023-07-09T02:17:12.678238+0000","last_unstale":"2023-07-09T02:17:14.516600+0000","last_undegraded":"2023-07-09T02:17:14.516600+0000","last_fullsized":"2023-07-09T02:17:14.516600+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:15:44.293837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660979+0000","last_change":"2023-07-09T02:17:12.662159+0000","last_active":"2023-07-09T02:17:13.660979+0000","last_peered":"2023-07-09T02:17:13.660979+0000","last_clean":"2023-07-09T02:17:13.660979+0000","last_became_active":"2023-07-09T02:17:12.661635+0000","last_became_peered":"2023-07-09T02:17:12.661635+0000","last_unstale":"2023-07-09T02:17:13.660979+0000","last_undegraded":"2023-07-09T02:17:13.660979+0000","last_fullsized":"2023-07-09T02:17:13.660979+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:40:37.017610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595520+0000","last_change":"2023-07-09T02:17:12.674578+0000","last_active":"2023-07-09T02:17:14.595520+0000","last_peered":"2023-07-09T02:17:14.595520+0000","last_clean":"2023-07-09T02:17:14.595520+0000","last_became_active":"2023-07-09T02:17:12.674224+0000","last_became_peered":"2023-07-09T02:17:12.674224+0000","last_unstale":"2023-07-09T02:17:14.595520+0000","last_undegraded":"2023-07-09T02:17:14.595520+0000","last_fullsized":"2023-07-09T02:17:14.595520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:34:37.020811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659922+0000","last_change":"2023-07-09T02:17:12.677975+0000","last_active":"2023-07-09T02:17:13.659922+0000","last_peered":"2023-07-09T02:17:13.659922+0000","last_clean":"2023-07-09T02:17:13.659922+0000","last_became_active":"2023-07-09T02:17:12.677686+0000","last_became_peered":"2023-07-09T02:17:12.677686+0000","last_unstale":"2023-07-09T02:17:13.659922+0000","last_undegraded":"2023-07-09T02:17:13.659922+0000","last_fullsized":"2023-07-09T02:17:13.659922+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:14:25.730103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517412+0000","last_change":"2023-07-09T02:17:12.675943+0000","last_active":"2023-07-09T02:17:14.517412+0000","last_peered":"2023-07-09T02:17:14.517412+0000","last_clean":"2023-07-09T02:17:14.517412+0000","last_became_active":"2023-07-09T02:17:12.674979+0000","last_became_peered":"2023-07-09T02:17:12.674979+0000","last_unstale":"2023-07-09T02:17:14.517412+0000","last_undegraded":"2023-07-09T02:17:14.517412+0000","last_fullsized":"2023-07-09T02:17:14.517412+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:21:33.760288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516344+0000","last_change":"2023-07-09T02:17:12.676045+0000","last_active":"2023-07-09T02:17:14.516344+0000","last_peered":"2023-07-09T02:17:14.516344+0000","last_clean":"2023-07-09T02:17:14.516344+0000","last_became_active":"2023-07-09T02:17:12.672295+0000","last_became_peered":"2023-07-09T02:17:12.672295+0000","last_unstale":"2023-07-09T02:17:14.516344+0000","last_undegraded":"2023-07-09T02:17:14.516344+0000","last_fullsized":"2023-07-09T02:17:14.516344+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:37:47.764618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516515+0000","last_change":"2023-07-09T02:17:12.668445+0000","last_active":"2023-07-09T02:17:14.516515+0000","last_peered":"2023-07-09T02:17:14.516515+0000","last_clean":"2023-07-09T02:17:14.516515+0000","last_became_active":"2023-07-09T02:17:12.668074+0000","last_became_peered":"2023-07-09T02:17:12.668074+0000","last_unstale":"2023-07-09T02:17:14.516515+0000","last_undegraded":"2023-07-09T02:17:14.516515+0000","last_fullsized":"2023-07-09T02:17:14.516515+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:55:58.746125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516384+0000","last_change":"2023-07-09T02:17:12.675712+0000","last_active":"2023-07-09T02:17:14.516384+0000","last_peered":"2023-07-09T02:17:14.516384+0000","last_clean":"2023-07-09T02:17:14.516384+0000","last_became_active":"2023-07-09T02:17:12.675332+0000","last_became_peered":"2023-07-09T02:17:12.675332+0000","last_unstale":"2023-07-09T02:17:14.516384+0000","last_undegraded":"2023-07-09T02:17:14.516384+0000","last_fullsized":"2023-07-09T02:17:14.516384+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:13:26.659294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660158+0000","last_change":"2023-07-09T02:17:12.670971+0000","last_active":"2023-07-09T02:17:13.660158+0000","last_peered":"2023-07-09T02:17:13.660158+0000","last_clean":"2023-07-09T02:17:13.660158+0000","last_became_active":"2023-07-09T02:17:12.670550+0000","last_became_peered":"2023-07-09T02:17:12.670550+0000","last_unstale":"2023-07-09T02:17:13.660158+0000","last_undegraded":"2023-07-09T02:17:13.660158+0000","last_fullsized":"2023-07-09T02:17:13.660158+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:32:57.924849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659710+0000","last_change":"2023-07-09T02:17:12.678024+0000","last_active":"2023-07-09T02:17:13.659710+0000","last_peered":"2023-07-09T02:17:13.659710+0000","last_clean":"2023-07-09T02:17:13.659710+0000","last_became_active":"2023-07-09T02:17:12.677803+0000","last_became_peered":"2023-07-09T02:17:12.677803+0000","last_unstale":"2023-07-09T02:17:13.659710+0000","last_undegraded":"2023-07-09T02:17:13.659710+0000","last_fullsized":"2023-07-09T02:17:13.659710+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:20:00.950943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516081+0000","last_change":"2023-07-09T02:17:12.671243+0000","last_active":"2023-07-09T02:17:14.516081+0000","last_peered":"2023-07-09T02:17:14.516081+0000","last_clean":"2023-07-09T02:17:14.516081+0000","last_became_active":"2023-07-09T02:17:12.670773+0000","last_became_peered":"2023-07-09T02:17:12.670773+0000","last_unstale":"2023-07-09T02:17:14.516081+0000","last_undegraded":"2023-07-09T02:17:14.516081+0000","last_fullsized":"2023-07-09T02:17:14.516081+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:27.721217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595283+0000","last_change":"2023-07-09T02:17:12.665996+0000","last_active":"2023-07-09T02:17:14.595283+0000","last_peered":"2023-07-09T02:17:14.595283+0000","last_clean":"2023-07-09T02:17:14.595283+0000","last_became_active":"2023-07-09T02:17:12.665737+0000","last_became_peered":"2023-07-09T02:17:12.665737+0000","last_unstale":"2023-07-09T02:17:14.595283+0000","last_undegraded":"2023-07-09T02:17:14.595283+0000","last_fullsized":"2023-07-09T02:17:14.595283+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:13:30.900911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515627+0000","last_change":"2023-07-09T02:17:12.671767+0000","last_active":"2023-07-09T02:17:14.515627+0000","last_peered":"2023-07-09T02:17:14.515627+0000","last_clean":"2023-07-09T02:17:14.515627+0000","last_became_active":"2023-07-09T02:17:12.671201+0000","last_became_peered":"2023-07-09T02:17:12.671201+0000","last_unstale":"2023-07-09T02:17:14.515627+0000","last_undegraded":"2023-07-09T02:17:14.515627+0000","last_fullsized":"2023-07-09T02:17:14.515627+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:49:16.158486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515798+0000","last_change":"2023-07-09T02:17:12.669674+0000","last_active":"2023-07-09T02:17:14.515798+0000","last_peered":"2023-07-09T02:17:14.515798+0000","last_clean":"2023-07-09T02:17:14.515798+0000","last_became_active":"2023-07-09T02:17:12.669013+0000","last_became_peered":"2023-07-09T02:17:12.669013+0000","last_unstale":"2023-07-09T02:17:14.515798+0000","last_undegraded":"2023-07-09T02:17:14.515798+0000","last_fullsized":"2023-07-09T02:17:14.515798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:17:58.120648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516015+0000","last_change":"2023-07-09T02:17:12.670464+0000","last_active":"2023-07-09T02:17:14.516015+0000","last_peered":"2023-07-09T02:17:14.516015+0000","last_clean":"2023-07-09T02:17:14.516015+0000","last_became_active":"2023-07-09T02:17:12.670229+0000","last_became_peered":"2023-07-09T02:17:12.670229+0000","last_unstale":"2023-07-09T02:17:14.516015+0000","last_undegraded":"2023-07-09T02:17:14.516015+0000","last_fullsized":"2023-07-09T02:17:14.516015+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:05:21.197690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660604+0000","last_change":"2023-07-09T02:17:12.663598+0000","last_active":"2023-07-09T02:17:13.660604+0000","last_peered":"2023-07-09T02:17:13.660604+0000","last_clean":"2023-07-09T02:17:13.660604+0000","last_became_active":"2023-07-09T02:17:12.663318+0000","last_became_peered":"2023-07-09T02:17:12.663318+0000","last_unstale":"2023-07-09T02:17:13.660604+0000","last_undegraded":"2023-07-09T02:17:13.660604+0000","last_fullsized":"2023-07-09T02:17:13.660604+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:28:55.143090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517475+0000","last_change":"2023-07-09T02:17:12.671609+0000","last_active":"2023-07-09T02:17:14.517475+0000","last_peered":"2023-07-09T02:17:14.517475+0000","last_clean":"2023-07-09T02:17:14.517475+0000","last_became_active":"2023-07-09T02:17:12.671337+0000","last_became_peered":"2023-07-09T02:17:12.671337+0000","last_unstale":"2023-07-09T02:17:14.517475+0000","last_undegraded":"2023-07-09T02:17:14.517475+0000","last_fullsized":"2023-07-09T02:17:14.517475+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:25:47.791032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660259+0000","last_change":"2023-07-09T02:17:12.680815+0000","last_active":"2023-07-09T02:17:13.660259+0000","last_peered":"2023-07-09T02:17:13.660259+0000","last_clean":"2023-07-09T02:17:13.660259+0000","last_became_active":"2023-07-09T02:17:12.680684+0000","last_became_peered":"2023-07-09T02:17:12.680684+0000","last_unstale":"2023-07-09T02:17:13.660259+0000","last_undegraded":"2023-07-09T02:17:13.660259+0000","last_fullsized":"2023-07-09T02:17:13.660259+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:37:28.341888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516682+0000","last_change":"2023-07-09T02:17:12.679026+0000","last_active":"2023-07-09T02:17:14.516682+0000","last_peered":"2023-07-09T02:17:14.516682+0000","last_clean":"2023-07-09T02:17:14.516682+0000","last_became_active":"2023-07-09T02:17:12.676233+0000","last_became_peered":"2023-07-09T02:17:12.676233+0000","last_unstale":"2023-07-09T02:17:14.516682+0000","last_undegraded":"2023-07-09T02:17:14.516682+0000","last_fullsized":"2023-07-09T02:17:14.516682+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:25:37.860244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516799+0000","last_change":"2023-07-09T02:17:12.662238+0000","last_active":"2023-07-09T02:17:14.516799+0000","last_peered":"2023-07-09T02:17:14.516799+0000","last_clean":"2023-07-09T02:17:14.516799+0000","last_became_active":"2023-07-09T02:17:12.661974+0000","last_became_peered":"2023-07-09T02:17:12.661974+0000","last_unstale":"2023-07-09T02:17:14.516799+0000","last_undegraded":"2023-07-09T02:17:14.516799+0000","last_fullsized":"2023-07-09T02:17:14.516799+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:10:21.517175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659860+0000","last_change":"2023-07-09T02:17:12.667852+0000","last_active":"2023-07-09T02:17:13.659860+0000","last_peered":"2023-07-09T02:17:13.659860+0000","last_clean":"2023-07-09T02:17:13.659860+0000","last_became_active":"2023-07-09T02:17:12.667564+0000","last_became_peered":"2023-07-09T02:17:12.667564+0000","last_unstale":"2023-07-09T02:17:13.659860+0000","last_undegraded":"2023-07-09T02:17:13.659860+0000","last_fullsized":"2023-07-09T02:17:13.659860+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:23:48.842195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.661043+0000","last_change":"2023-07-09T02:17:12.662301+0000","last_active":"2023-07-09T02:17:13.661043+0000","last_peered":"2023-07-09T02:17:13.661043+0000","last_clean":"2023-07-09T02:17:13.661043+0000","last_became_active":"2023-07-09T02:17:12.661945+0000","last_became_peered":"2023-07-09T02:17:12.661945+0000","last_unstale":"2023-07-09T02:17:13.661043+0000","last_undegraded":"2023-07-09T02:17:13.661043+0000","last_fullsized":"2023-07-09T02:17:13.661043+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:39:00.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659610+0000","last_change":"2023-07-09T02:17:12.669616+0000","last_active":"2023-07-09T02:17:13.659610+0000","last_peered":"2023-07-09T02:17:13.659610+0000","last_clean":"2023-07-09T02:17:13.659610+0000","last_became_active":"2023-07-09T02:17:12.669355+0000","last_became_peered":"2023-07-09T02:17:12.669355+0000","last_unstale":"2023-07-09T02:17:13.659610+0000","last_undegraded":"2023-07-09T02:17:13.659610+0000","last_fullsized":"2023-07-09T02:17:13.659610+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:46:47.963217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516798+0000","last_change":"2023-07-09T02:17:12.677268+0000","last_active":"2023-07-09T02:17:14.516798+0000","last_peered":"2023-07-09T02:17:14.516798+0000","last_clean":"2023-07-09T02:17:14.516798+0000","last_became_active":"2023-07-09T02:17:12.673864+0000","last_became_peered":"2023-07-09T02:17:12.673864+0000","last_unstale":"2023-07-09T02:17:14.516798+0000","last_undegraded":"2023-07-09T02:17:14.516798+0000","last_fullsized":"2023-07-09T02:17:14.516798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:55:29.253497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516746+0000","last_change":"2023-07-09T02:17:12.681350+0000","last_active":"2023-07-09T02:17:14.516746+0000","last_peered":"2023-07-09T02:17:14.516746+0000","last_clean":"2023-07-09T02:17:14.516746+0000","last_became_active":"2023-07-09T02:17:12.681072+0000","last_became_peered":"2023-07-09T02:17:12.681072+0000","last_unstale":"2023-07-09T02:17:14.516746+0000","last_undegraded":"2023-07-09T02:17:14.516746+0000","last_fullsized":"2023-07-09T02:17:14.516746+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:05:02.925042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659453+0000","last_change":"2023-07-09T02:17:12.668600+0000","last_active":"2023-07-09T02:17:13.659453+0000","last_peered":"2023-07-09T02:17:13.659453+0000","last_clean":"2023-07-09T02:17:13.659453+0000","last_became_active":"2023-07-09T02:17:12.668338+0000","last_became_peered":"2023-07-09T02:17:12.668338+0000","last_unstale":"2023-07-09T02:17:13.659453+0000","last_undegraded":"2023-07-09T02:17:13.659453+0000","last_fullsized":"2023-07-09T02:17:13.659453+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:39.301020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517552+0000","last_change":"2023-07-09T02:17:12.678615+0000","last_active":"2023-07-09T02:17:14.517552+0000","last_peered":"2023-07-09T02:17:14.517552+0000","last_clean":"2023-07-09T02:17:14.517552+0000","last_became_active":"2023-07-09T02:17:12.678204+0000","last_became_peered":"2023-07-09T02:17:12.678204+0000","last_unstale":"2023-07-09T02:17:14.517552+0000","last_undegraded":"2023-07-09T02:17:14.517552+0000","last_fullsized":"2023-07-09T02:17:14.517552+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:02:36.902331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516352+0000","last_change":"2023-07-09T02:17:12.672868+0000","last_active":"2023-07-09T02:17:14.516352+0000","last_peered":"2023-07-09T02:17:14.516352+0000","last_clean":"2023-07-09T02:17:14.516352+0000","last_became_active":"2023-07-09T02:17:12.672628+0000","last_became_peered":"2023-07-09T02:17:12.672628+0000","last_unstale":"2023-07-09T02:17:14.516352+0000","last_undegraded":"2023-07-09T02:17:14.516352+0000","last_fullsized":"2023-07-09T02:17:14.516352+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:47:23.904521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516917+0000","last_change":"2023-07-09T02:17:12.676454+0000","last_active":"2023-07-09T02:17:14.516917+0000","last_peered":"2023-07-09T02:17:14.516917+0000","last_clean":"2023-07-09T02:17:14.516917+0000","last_became_active":"2023-07-09T02:17:12.673577+0000","last_became_peered":"2023-07-09T02:17:12.673577+0000","last_unstale":"2023-07-09T02:17:14.516917+0000","last_undegraded":"2023-07-09T02:17:14.516917+0000","last_fullsized":"2023-07-09T02:17:14.516917+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:47.450371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517055+0000","last_change":"2023-07-09T02:17:12.679775+0000","last_active":"2023-07-09T02:17:14.517055+0000","last_peered":"2023-07-09T02:17:14.517055+0000","last_clean":"2023-07-09T02:17:14.517055+0000","last_became_active":"2023-07-09T02:17:12.675541+0000","last_became_peered":"2023-07-09T02:17:12.675541+0000","last_unstale":"2023-07-09T02:17:14.517055+0000","last_undegraded":"2023-07-09T02:17:14.517055+0000","last_fullsized":"2023-07-09T02:17:14.517055+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:59:14.547889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516520+0000","last_change":"2023-07-09T02:17:12.673373+0000","last_active":"2023-07-09T02:17:14.516520+0000","last_peered":"2023-07-09T02:17:14.516520+0000","last_clean":"2023-07-09T02:17:14.516520+0000","last_became_active":"2023-07-09T02:17:12.673105+0000","last_became_peered":"2023-07-09T02:17:12.673105+0000","last_unstale":"2023-07-09T02:17:14.516520+0000","last_undegraded":"2023-07-09T02:17:14.516520+0000","last_fullsized":"2023-07-09T02:17:14.516520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:55:37.557252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660846+0000","last_change":"2023-07-09T02:17:12.678874+0000","last_active":"2023-07-09T02:17:13.660846+0000","last_peered":"2023-07-09T02:17:13.660846+0000","last_clean":"2023-07-09T02:17:13.660846+0000","last_became_active":"2023-07-09T02:17:12.678206+0000","last_became_peered":"2023-07-09T02:17:12.678206+0000","last_unstale":"2023-07-09T02:17:13.660846+0000","last_undegraded":"2023-07-09T02:17:13.660846+0000","last_fullsized":"2023-07-09T02:17:13.660846+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:12.710368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"122'4","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595625+0000","last_change":"2023-07-09T02:17:11.664812+0000","last_active":"2023-07-09T02:17:14.595625+0000","last_peered":"2023-07-09T02:17:14.595625+0000","last_clean":"2023-07-09T02:17:14.595625+0000","last_became_active":"2023-07-09T02:17:11.664583+0000","last_became_peered":"2023-07-09T02:17:11.664583+0000","last_unstale":"2023-07-09T02:17:14.595625+0000","last_undegraded":"2023-07-09T02:17:14.595625+0000","last_fullsized":"2023-07-09T02:17:14.595625+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:22:35.734763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516893+0000","last_change":"2023-07-09T02:17:12.668298+0000","last_active":"2023-07-09T02:17:14.516893+0000","last_peered":"2023-07-09T02:17:14.516893+0000","last_clean":"2023-07-09T02:17:14.516893+0000","last_became_active":"2023-07-09T02:17:12.667743+0000","last_became_peered":"2023-07-09T02:17:12.667743+0000","last_unstale":"2023-07-09T02:17:14.516893+0000","last_undegraded":"2023-07-09T02:17:14.516893+0000","last_fullsized":"2023-07-09T02:17:14.516893+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:35:36.921626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516609+0000","last_change":"2023-07-09T02:17:11.666981+0000","last_active":"2023-07-09T02:17:14.516609+0000","last_peered":"2023-07-09T02:17:14.516609+0000","last_clean":"2023-07-09T02:17:14.516609+0000","last_became_active":"2023-07-09T02:17:11.666351+0000","last_became_peered":"2023-07-09T02:17:11.666351+0000","last_unstale":"2023-07-09T02:17:14.516609+0000","last_undegraded":"2023-07-09T02:17:14.516609+0000","last_fullsized":"2023-07-09T02:17:14.516609+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:28:40.964428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516224+0000","last_change":"2023-07-09T02:17:12.669531+0000","last_active":"2023-07-09T02:17:14.516224+0000","last_peered":"2023-07-09T02:17:14.516224+0000","last_clean":"2023-07-09T02:17:14.516224+0000","last_became_active":"2023-07-09T02:17:12.669191+0000","last_became_peered":"2023-07-09T02:17:12.669191+0000","last_unstale":"2023-07-09T02:17:14.516224+0000","last_undegraded":"2023-07-09T02:17:14.516224+0000","last_fullsized":"2023-07-09T02:17:14.516224+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:37.879332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517024+0000","last_change":"2023-07-09T02:17:11.663374+0000","last_active":"2023-07-09T02:17:14.517024+0000","last_peered":"2023-07-09T02:17:14.517024+0000","last_clean":"2023-07-09T02:17:14.517024+0000","last_became_active":"2023-07-09T02:17:11.663016+0000","last_became_peered":"2023-07-09T02:17:11.663016+0000","last_unstale":"2023-07-09T02:17:14.517024+0000","last_undegraded":"2023-07-09T02:17:14.517024+0000","last_fullsized":"2023-07-09T02:17:14.517024+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:58:29.022039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659546+0000","last_change":"2023-07-09T02:17:12.672404+0000","last_active":"2023-07-09T02:17:13.659546+0000","last_peered":"2023-07-09T02:17:13.659546+0000","last_clean":"2023-07-09T02:17:13.659546+0000","last_became_active":"2023-07-09T02:17:12.672184+0000","last_became_peered":"2023-07-09T02:17:12.672184+0000","last_unstale":"2023-07-09T02:17:13.659546+0000","last_undegraded":"2023-07-09T02:17:13.659546+0000","last_fullsized":"2023-07-09T02:17:13.659546+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:03:23.472165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659848+0000","last_change":"2023-07-09T02:17:11.663319+0000","last_active":"2023-07-09T02:17:13.659848+0000","last_peered":"2023-07-09T02:17:13.659848+0000","last_clean":"2023-07-09T02:17:13.659848+0000","last_became_active":"2023-07-09T02:17:11.663061+0000","last_became_peered":"2023-07-09T02:17:11.663061+0000","last_unstale":"2023-07-09T02:17:13.659848+0000","last_undegraded":"2023-07-09T02:17:13.659848+0000","last_fullsized":"2023-07-09T02:17:13.659848+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:19.609229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595322+0000","last_change":"2023-07-09T02:17:12.669343+0000","last_active":"2023-07-09T02:17:14.595322+0000","last_peered":"2023-07-09T02:17:14.595322+0000","last_clean":"2023-07-09T02:17:14.595322+0000","last_became_active":"2023-07-09T02:17:12.669082+0000","last_became_peered":"2023-07-09T02:17:12.669082+0000","last_unstale":"2023-07-09T02:17:14.595322+0000","last_undegraded":"2023-07-09T02:17:14.595322+0000","last_fullsized":"2023-07-09T02:17:14.595322+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:46:09.596616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515715+0000","last_change":"2023-07-09T02:17:11.665786+0000","last_active":"2023-07-09T02:17:14.515715+0000","last_peered":"2023-07-09T02:17:14.515715+0000","last_clean":"2023-07-09T02:17:14.515715+0000","last_became_active":"2023-07-09T02:17:11.665561+0000","last_became_peered":"2023-07-09T02:17:11.665561+0000","last_unstale":"2023-07-09T02:17:14.515715+0000","last_undegraded":"2023-07-09T02:17:14.515715+0000","last_fullsized":"2023-07-09T02:17:14.515715+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:32:38.308317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660717+0000","last_change":"2023-07-09T02:17:12.679022+0000","last_active":"2023-07-09T02:17:13.660717+0000","last_peered":"2023-07-09T02:17:13.660717+0000","last_clean":"2023-07-09T02:17:13.660717+0000","last_became_active":"2023-07-09T02:17:12.678641+0000","last_became_peered":"2023-07-09T02:17:12.678641+0000","last_unstale":"2023-07-09T02:17:13.660717+0000","last_undegraded":"2023-07-09T02:17:13.660717+0000","last_fullsized":"2023-07-09T02:17:13.660717+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:06:36.486199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660285+0000","last_change":"2023-07-09T02:17:11.665363+0000","last_active":"2023-07-09T02:17:13.660285+0000","last_peered":"2023-07-09T02:17:13.660285+0000","last_clean":"2023-07-09T02:17:13.660285+0000","last_became_active":"2023-07-09T02:17:11.664691+0000","last_became_peered":"2023-07-09T02:17:11.664691+0000","last_unstale":"2023-07-09T02:17:13.660285+0000","last_undegraded":"2023-07-09T02:17:13.660285+0000","last_fullsized":"2023-07-09T02:17:13.660285+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:37:49.821157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517616+0000","last_change":"2023-07-09T02:17:12.678450+0000","last_active":"2023-07-09T02:17:14.517616+0000","last_peered":"2023-07-09T02:17:14.517616+0000","last_clean":"2023-07-09T02:17:14.517616+0000","last_became_active":"2023-07-09T02:17:12.677866+0000","last_became_peered":"2023-07-09T02:17:12.677866+0000","last_unstale":"2023-07-09T02:17:14.517616+0000","last_undegraded":"2023-07-09T02:17:14.517616+0000","last_fullsized":"2023-07-09T02:17:14.517616+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:16:48.939799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516361+0000","last_change":"2023-07-09T02:17:11.663126+0000","last_active":"2023-07-09T02:17:14.516361+0000","last_peered":"2023-07-09T02:17:14.516361+0000","last_clean":"2023-07-09T02:17:14.516361+0000","last_became_active":"2023-07-09T02:17:11.662905+0000","last_became_peered":"2023-07-09T02:17:11.662905+0000","last_unstale":"2023-07-09T02:17:14.516361+0000","last_undegraded":"2023-07-09T02:17:14.516361+0000","last_fullsized":"2023-07-09T02:17:14.516361+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:41:06.115003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595418+0000","last_change":"2023-07-09T02:17:12.668893+0000","last_active":"2023-07-09T02:17:14.595418+0000","last_peered":"2023-07-09T02:17:14.595418+0000","last_clean":"2023-07-09T02:17:14.595418+0000","last_became_active":"2023-07-09T02:17:12.668668+0000","last_became_peered":"2023-07-09T02:17:12.668668+0000","last_unstale":"2023-07-09T02:17:14.595418+0000","last_undegraded":"2023-07-09T02:17:14.595418+0000","last_fullsized":"2023-07-09T02:17:14.595418+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:22:45.169810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595666+0000","last_change":"2023-07-09T02:17:11.664569+0000","last_active":"2023-07-09T02:17:14.595666+0000","last_peered":"2023-07-09T02:17:14.595666+0000","last_clean":"2023-07-09T02:17:14.595666+0000","last_became_active":"2023-07-09T02:17:11.664189+0000","last_became_peered":"2023-07-09T02:17:11.664189+0000","last_unstale":"2023-07-09T02:17:14.595666+0000","last_undegraded":"2023-07-09T02:17:14.595666+0000","last_fullsized":"2023-07-09T02:17:14.595666+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:33:39.570011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660772+0000","last_change":"2023-07-09T02:17:12.678567+0000","last_active":"2023-07-09T02:17:13.660772+0000","last_peered":"2023-07-09T02:17:13.660772+0000","last_clean":"2023-07-09T02:17:13.660772+0000","last_became_active":"2023-07-09T02:17:12.678212+0000","last_became_peered":"2023-07-09T02:17:12.678212+0000","last_unstale":"2023-07-09T02:17:13.660772+0000","last_undegraded":"2023-07-09T02:17:13.660772+0000","last_fullsized":"2023-07-09T02:17:13.660772+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:15:06.970368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516855+0000","last_change":"2023-07-09T02:17:11.662575+0000","last_active":"2023-07-09T02:17:14.516855+0000","last_peered":"2023-07-09T02:17:14.516855+0000","last_clean":"2023-07-09T02:17:14.516855+0000","last_became_active":"2023-07-09T02:17:11.662357+0000","last_became_peered":"2023-07-09T02:17:11.662357+0000","last_unstale":"2023-07-09T02:17:14.516855+0000","last_undegraded":"2023-07-09T02:17:14.516855+0000","last_fullsized":"2023-07-09T02:17:14.516855+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:40:35.772607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660275+0000","last_change":"2023-07-09T02:17:12.670791+0000","last_active":"2023-07-09T02:17:13.660275+0000","last_peered":"2023-07-09T02:17:13.660275+0000","last_clean":"2023-07-09T02:17:13.660275+0000","last_became_active":"2023-07-09T02:17:12.670216+0000","last_became_peered":"2023-07-09T02:17:12.670216+0000","last_unstale":"2023-07-09T02:17:13.660275+0000","last_undegraded":"2023-07-09T02:17:13.660275+0000","last_fullsized":"2023-07-09T02:17:13.660275+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:23:34.274385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660716+0000","last_change":"2023-07-09T02:17:11.662340+0000","last_active":"2023-07-09T02:17:13.660716+0000","last_peered":"2023-07-09T02:17:13.660716+0000","last_clean":"2023-07-09T02:17:13.660716+0000","last_became_active":"2023-07-09T02:17:11.662127+0000","last_became_peered":"2023-07-09T02:17:11.662127+0000","last_unstale":"2023-07-09T02:17:13.660716+0000","last_undegraded":"2023-07-09T02:17:13.660716+0000","last_fullsized":"2023-07-09T02:17:13.660716+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:20:14.810474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516476+0000","last_change":"2023-07-09T02:17:12.667134+0000","last_active":"2023-07-09T02:17:14.516476+0000","last_peered":"2023-07-09T02:17:14.516476+0000","last_clean":"2023-07-09T02:17:14.516476+0000","last_became_active":"2023-07-09T02:17:12.666914+0000","last_became_peered":"2023-07-09T02:17:12.666914+0000","last_unstale":"2023-07-09T02:17:14.516476+0000","last_undegraded":"2023-07-09T02:17:14.516476+0000","last_fullsized":"2023-07-09T02:17:14.516476+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:51:38.844983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"122'3","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515682+0000","last_change":"2023-07-09T02:17:11.666230+0000","last_active":"2023-07-09T02:17:14.515682+0000","last_peered":"2023-07-09T02:17:14.515682+0000","last_clean":"2023-07-09T02:17:14.515682+0000","last_became_active":"2023-07-09T02:17:11.665992+0000","last_became_peered":"2023-07-09T02:17:11.665992+0000","last_unstale":"2023-07-09T02:17:14.515682+0000","last_undegraded":"2023-07-09T02:17:14.515682+0000","last_fullsized":"2023-07-09T02:17:14.515682+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:33:58.914274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659675+0000","last_change":"2023-07-09T02:17:12.670794+0000","last_active":"2023-07-09T02:17:13.659675+0000","last_peered":"2023-07-09T02:17:13.659675+0000","last_clean":"2023-07-09T02:17:13.659675+0000","last_became_active":"2023-07-09T02:17:12.670281+0000","last_became_peered":"2023-07-09T02:17:12.670281+0000","last_unstale":"2023-07-09T02:17:13.659675+0000","last_undegraded":"2023-07-09T02:17:13.659675+0000","last_fullsized":"2023-07-09T02:17:13.659675+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:37:33.229833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"122'6","reported_seq":19,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516238+0000","last_change":"2023-07-09T02:17:11.665381+0000","last_active":"2023-07-09T02:17:14.516238+0000","last_peered":"2023-07-09T02:17:14.516238+0000","last_clean":"2023-07-09T02:17:14.516238+0000","last_became_active":"2023-07-09T02:17:11.663537+0000","last_became_peered":"2023-07-09T02:17:11.663537+0000","last_unstale":"2023-07-09T02:17:14.516238+0000","last_undegraded":"2023-07-09T02:17:14.516238+0000","last_fullsized":"2023-07-09T02:17:14.516238+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:23:21.142253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659727+0000","last_change":"2023-07-09T02:17:12.661506+0000","last_active":"2023-07-09T02:17:13.659727+0000","last_peered":"2023-07-09T02:17:13.659727+0000","last_clean":"2023-07-09T02:17:13.659727+0000","last_became_active":"2023-07-09T02:17:12.661127+0000","last_became_peered":"2023-07-09T02:17:12.661127+0000","last_unstale":"2023-07-09T02:17:13.659727+0000","last_undegraded":"2023-07-09T02:17:13.659727+0000","last_fullsized":"2023-07-09T02:17:13.659727+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:42:41.692130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660451+0000","last_change":"2023-07-09T02:17:11.669001+0000","last_active":"2023-07-09T02:17:13.660451+0000","last_peered":"2023-07-09T02:17:13.660451+0000","last_clean":"2023-07-09T02:17:13.660451+0000","last_became_active":"2023-07-09T02:17:11.667711+0000","last_became_peered":"2023-07-09T02:17:11.667711+0000","last_unstale":"2023-07-09T02:17:13.660451+0000","last_undegraded":"2023-07-09T02:17:13.660451+0000","last_fullsized":"2023-07-09T02:17:13.660451+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:18:05.326953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517498+0000","last_change":"2023-07-09T02:17:12.674791+0000","last_active":"2023-07-09T02:17:14.517498+0000","last_peered":"2023-07-09T02:17:14.517498+0000","last_clean":"2023-07-09T02:17:14.517498+0000","last_became_active":"2023-07-09T02:17:12.674130+0000","last_became_peered":"2023-07-09T02:17:12.674130+0000","last_unstale":"2023-07-09T02:17:14.517498+0000","last_undegraded":"2023-07-09T02:17:14.517498+0000","last_fullsized":"2023-07-09T02:17:14.517498+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:33:07.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595571+0000","last_change":"2023-07-09T02:17:11.665057+0000","last_active":"2023-07-09T02:17:14.595571+0000","last_peered":"2023-07-09T02:17:14.595571+0000","last_clean":"2023-07-09T02:17:14.595571+0000","last_became_active":"2023-07-09T02:17:11.664828+0000","last_became_peered":"2023-07-09T02:17:11.664828+0000","last_unstale":"2023-07-09T02:17:14.595571+0000","last_undegraded":"2023-07-09T02:17:14.595571+0000","last_fullsized":"2023-07-09T02:17:14.595571+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:21:12.470949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516730+0000","last_change":"2023-07-09T02:17:12.677519+0000","last_active":"2023-07-09T02:17:14.516730+0000","last_peered":"2023-07-09T02:17:14.516730+0000","last_clean":"2023-07-09T02:17:14.516730+0000","last_became_active":"2023-07-09T02:17:12.677309+0000","last_became_peered":"2023-07-09T02:17:12.677309+0000","last_unstale":"2023-07-09T02:17:14.516730+0000","last_undegraded":"2023-07-09T02:17:14.516730+0000","last_fullsized":"2023-07-09T02:17:14.516730+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:14:49.176933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516832+0000","last_change":"2023-07-09T02:17:11.667663+0000","last_active":"2023-07-09T02:17:14.516832+0000","last_peered":"2023-07-09T02:17:14.516832+0000","last_clean":"2023-07-09T02:17:14.516832+0000","last_became_active":"2023-07-09T02:17:11.667293+0000","last_became_peered":"2023-07-09T02:17:11.667293+0000","last_unstale":"2023-07-09T02:17:14.516832+0000","last_undegraded":"2023-07-09T02:17:14.516832+0000","last_fullsized":"2023-07-09T02:17:14.516832+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:27.862682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660595+0000","last_change":"2023-07-09T02:17:12.666173+0000","last_active":"2023-07-09T02:17:13.660595+0000","last_peered":"2023-07-09T02:17:13.660595+0000","last_clean":"2023-07-09T02:17:13.660595+0000","last_became_active":"2023-07-09T02:17:12.665907+0000","last_became_peered":"2023-07-09T02:17:12.665907+0000","last_unstale":"2023-07-09T02:17:13.660595+0000","last_undegraded":"2023-07-09T02:17:13.660595+0000","last_fullsized":"2023-07-09T02:17:13.660595+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:29:08.830066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"122'8","reported_seq":21,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515991+0000","last_change":"2023-07-09T02:17:11.662089+0000","last_active":"2023-07-09T02:17:14.515991+0000","last_peered":"2023-07-09T02:17:14.515991+0000","last_clean":"2023-07-09T02:17:14.515991+0000","last_became_active":"2023-07-09T02:17:11.661857+0000","last_became_peered":"2023-07-09T02:17:11.661857+0000","last_unstale":"2023-07-09T02:17:14.515991+0000","last_undegraded":"2023-07-09T02:17:14.515991+0000","last_fullsized":"2023-07-09T02:17:14.515991+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:19:38.428634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660862+0000","last_change":"2023-07-09T02:17:12.667157+0000","last_active":"2023-07-09T02:17:13.660862+0000","last_peered":"2023-07-09T02:17:13.660862+0000","last_clean":"2023-07-09T02:17:13.660862+0000","last_became_active":"2023-07-09T02:17:12.666934+0000","last_became_peered":"2023-07-09T02:17:12.666934+0000","last_unstale":"2023-07-09T02:17:13.660862+0000","last_undegraded":"2023-07-09T02:17:13.660862+0000","last_fullsized":"2023-07-09T02:17:13.660862+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:09:25.792254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659996+0000","last_change":"2023-07-09T02:17:11.663187+0000","last_active":"2023-07-09T02:17:13.659996+0000","last_peered":"2023-07-09T02:17:13.659996+0000","last_clean":"2023-07-09T02:17:13.659996+0000","last_became_active":"2023-07-09T02:17:11.662885+0000","last_became_peered":"2023-07-09T02:17:11.662885+0000","last_unstale":"2023-07-09T02:17:13.659996+0000","last_undegraded":"2023-07-09T02:17:13.659996+0000","last_fullsized":"2023-07-09T02:17:13.659996+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:11:09.469291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516231+0000","last_change":"2023-07-09T02:17:12.670749+0000","last_active":"2023-07-09T02:17:14.516231+0000","last_peered":"2023-07-09T02:17:14.516231+0000","last_clean":"2023-07-09T02:17:14.516231+0000","last_became_active":"2023-07-09T02:17:12.670451+0000","last_became_peered":"2023-07-09T02:17:12.670451+0000","last_unstale":"2023-07-09T02:17:14.516231+0000","last_undegraded":"2023-07-09T02:17:14.516231+0000","last_fullsized":"2023-07-09T02:17:14.516231+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:27:07.720383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.661187+0000","last_change":"2023-07-09T02:17:11.659441+0000","last_active":"2023-07-09T02:17:13.661187+0000","last_peered":"2023-07-09T02:17:13.661187+0000","last_clean":"2023-07-09T02:17:13.661187+0000","last_became_active":"2023-07-09T02:17:11.659220+0000","last_became_peered":"2023-07-09T02:17:11.659220+0000","last_unstale":"2023-07-09T02:17:13.661187+0000","last_undegraded":"2023-07-09T02:17:13.661187+0000","last_fullsized":"2023-07-09T02:17:13.661187+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:31:38.875529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595471+0000","last_change":"2023-07-09T02:17:12.676293+0000","last_active":"2023-07-09T02:17:14.595471+0000","last_peered":"2023-07-09T02:17:14.595471+0000","last_clean":"2023-07-09T02:17:14.595471+0000","last_became_active":"2023-07-09T02:17:12.676055+0000","last_became_peered":"2023-07-09T02:17:12.676055+0000","last_unstale":"2023-07-09T02:17:14.595471+0000","last_undegraded":"2023-07-09T02:17:14.595471+0000","last_fullsized":"2023-07-09T02:17:14.595471+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:54:49.285406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516628+0000","last_change":"2023-07-09T02:17:11.666247+0000","last_active":"2023-07-09T02:17:14.516628+0000","last_peered":"2023-07-09T02:17:14.516628+0000","last_clean":"2023-07-09T02:17:14.516628+0000","last_became_active":"2023-07-09T02:17:11.665644+0000","last_became_peered":"2023-07-09T02:17:11.665644+0000","last_unstale":"2023-07-09T02:17:14.516628+0000","last_undegraded":"2023-07-09T02:17:14.516628+0000","last_fullsized":"2023-07-09T02:17:14.516628+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:55:41.968542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659937+0000","last_change":"2023-07-09T02:17:12.665320+0000","last_active":"2023-07-09T02:17:13.659937+0000","last_peered":"2023-07-09T02:17:13.659937+0000","last_clean":"2023-07-09T02:17:13.659937+0000","last_became_active":"2023-07-09T02:17:12.665028+0000","last_became_peered":"2023-07-09T02:17:12.665028+0000","last_unstale":"2023-07-09T02:17:13.659937+0000","last_undegraded":"2023-07-09T02:17:13.659937+0000","last_fullsized":"2023-07-09T02:17:13.659937+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:08:14.510151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660559+0000","last_change":"2023-07-09T02:17:11.664024+0000","last_active":"2023-07-09T02:17:13.660559+0000","last_peered":"2023-07-09T02:17:13.660559+0000","last_clean":"2023-07-09T02:17:13.660559+0000","last_became_active":"2023-07-09T02:17:11.663769+0000","last_became_peered":"2023-07-09T02:17:11.663769+0000","last_unstale":"2023-07-09T02:17:13.660559+0000","last_undegraded":"2023-07-09T02:17:13.660559+0000","last_fullsized":"2023-07-09T02:17:13.660559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:49:16.227526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516569+0000","last_change":"2023-07-09T02:17:12.665079+0000","last_active":"2023-07-09T02:17:14.516569+0000","last_peered":"2023-07-09T02:17:14.516569+0000","last_clean":"2023-07-09T02:17:14.516569+0000","last_became_active":"2023-07-09T02:17:12.664724+0000","last_became_peered":"2023-07-09T02:17:12.664724+0000","last_unstale":"2023-07-09T02:17:14.516569+0000","last_undegraded":"2023-07-09T02:17:14.516569+0000","last_fullsized":"2023-07-09T02:17:14.516569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:02:12.329281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516959+0000","last_change":"2023-07-09T02:17:11.666458+0000","last_active":"2023-07-09T02:17:14.516959+0000","last_peered":"2023-07-09T02:17:14.516959+0000","last_clean":"2023-07-09T02:17:14.516959+0000","last_became_active":"2023-07-09T02:17:11.666245+0000","last_became_peered":"2023-07-09T02:17:11.666245+0000","last_unstale":"2023-07-09T02:17:14.516959+0000","last_undegraded":"2023-07-09T02:17:14.516959+0000","last_fullsized":"2023-07-09T02:17:14.516959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:14:40.111751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516625+0000","last_change":"2023-07-09T02:17:12.670415+0000","last_active":"2023-07-09T02:17:14.516625+0000","last_peered":"2023-07-09T02:17:14.516625+0000","last_clean":"2023-07-09T02:17:14.516625+0000","last_became_active":"2023-07-09T02:17:12.670196+0000","last_became_peered":"2023-07-09T02:17:12.670196+0000","last_unstale":"2023-07-09T02:17:14.516625+0000","last_undegraded":"2023-07-09T02:17:14.516625+0000","last_fullsized":"2023-07-09T02:17:14.516625+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:05:49.966426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516978+0000","last_change":"2023-07-09T02:17:11.667516+0000","last_active":"2023-07-09T02:17:14.516978+0000","last_peered":"2023-07-09T02:17:14.516978+0000","last_clean":"2023-07-09T02:17:14.516978+0000","last_became_active":"2023-07-09T02:17:11.666989+0000","last_became_peered":"2023-07-09T02:17:11.666989+0000","last_unstale":"2023-07-09T02:17:14.516978+0000","last_undegraded":"2023-07-09T02:17:14.516978+0000","last_fullsized":"2023-07-09T02:17:14.516978+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:56:33.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516089+0000","last_change":"2023-07-09T02:17:12.671911+0000","last_active":"2023-07-09T02:17:14.516089+0000","last_peered":"2023-07-09T02:17:14.516089+0000","last_clean":"2023-07-09T02:17:14.516089+0000","last_became_active":"2023-07-09T02:17:12.671552+0000","last_became_peered":"2023-07-09T02:17:12.671552+0000","last_unstale":"2023-07-09T02:17:14.516089+0000","last_undegraded":"2023-07-09T02:17:14.516089+0000","last_fullsized":"2023-07-09T02:17:14.516089+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:01:00.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517681+0000","last_change":"2023-07-09T02:17:11.667656+0000","last_active":"2023-07-09T02:17:14.517681+0000","last_peered":"2023-07-09T02:17:14.517681+0000","last_clean":"2023-07-09T02:17:14.517681+0000","last_became_active":"2023-07-09T02:17:11.667122+0000","last_became_peered":"2023-07-09T02:17:11.667122+0000","last_unstale":"2023-07-09T02:17:14.517681+0000","last_undegraded":"2023-07-09T02:17:14.517681+0000","last_fullsized":"2023-07-09T02:17:14.517681+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:48:53.862944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659798+0000","last_change":"2023-07-09T02:17:12.668663+0000","last_active":"2023-07-09T02:17:13.659798+0000","last_peered":"2023-07-09T02:17:13.659798+0000","last_clean":"2023-07-09T02:17:13.659798+0000","last_became_active":"2023-07-09T02:17:12.668064+0000","last_became_peered":"2023-07-09T02:17:12.668064+0000","last_unstale":"2023-07-09T02:17:13.659798+0000","last_undegraded":"2023-07-09T02:17:13.659798+0000","last_fullsized":"2023-07-09T02:17:13.659798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:37:59.345133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516812+0000","last_change":"2023-07-09T02:17:11.667139+0000","last_active":"2023-07-09T02:17:14.516812+0000","last_peered":"2023-07-09T02:17:14.516812+0000","last_clean":"2023-07-09T02:17:14.516812+0000","last_became_active":"2023-07-09T02:17:11.666690+0000","last_became_peered":"2023-07-09T02:17:11.666690+0000","last_unstale":"2023-07-09T02:17:14.516812+0000","last_undegraded":"2023-07-09T02:17:14.516812+0000","last_fullsized":"2023-07-09T02:17:14.516812+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:36:11.382075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659584+0000","last_change":"2023-07-09T02:17:12.661356+0000","last_active":"2023-07-09T02:17:13.659584+0000","last_peered":"2023-07-09T02:17:13.659584+0000","last_clean":"2023-07-09T02:17:13.659584+0000","last_became_active":"2023-07-09T02:17:12.660884+0000","last_became_peered":"2023-07-09T02:17:12.660884+0000","last_unstale":"2023-07-09T02:17:13.659584+0000","last_undegraded":"2023-07-09T02:17:13.659584+0000","last_fullsized":"2023-07-09T02:17:13.659584+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:15:08.537418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516887+0000","last_change":"2023-07-09T02:17:11.661122+0000","last_active":"2023-07-09T02:17:14.516887+0000","last_peered":"2023-07-09T02:17:14.516887+0000","last_clean":"2023-07-09T02:17:14.516887+0000","last_became_active":"2023-07-09T02:17:11.660851+0000","last_became_peered":"2023-07-09T02:17:11.660851+0000","last_unstale":"2023-07-09T02:17:14.516887+0000","last_undegraded":"2023-07-09T02:17:14.516887+0000","last_fullsized":"2023-07-09T02:17:14.516887+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:47:50.914387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":346,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516176+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:17:14.516176+0000","last_peered":"2023-07-09T02:17:14.516176+0000","last_clean":"2023-07-09T02:17:14.516176+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:17:14.516176+0000","last_undegraded":"2023-07-09T02:17:14.516176+0000","last_fullsized":"2023-07-09T02:17:14.516176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:21:49.491179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":213,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659869+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:17:13.659869+0000","last_peered":"2023-07-09T02:17:13.659869+0000","last_clean":"2023-07-09T02:17:13.659869+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:17:13.659869+0000","last_undegraded":"2023-07-09T02:17:13.659869+0000","last_fullsized":"2023-07-09T02:17:13.659869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:02:46.832591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517252+0000","last_change":"2023-07-09T02:17:12.676098+0000","last_active":"2023-07-09T02:17:14.517252+0000","last_peered":"2023-07-09T02:17:14.517252+0000","last_clean":"2023-07-09T02:17:14.517252+0000","last_became_active":"2023-07-09T02:17:12.675273+0000","last_became_peered":"2023-07-09T02:17:12.675273+0000","last_unstale":"2023-07-09T02:17:14.517252+0000","last_undegraded":"2023-07-09T02:17:14.517252+0000","last_fullsized":"2023-07-09T02:17:14.517252+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:22:51.574164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516230+0000","last_change":"2023-07-09T02:17:11.666704+0000","last_active":"2023-07-09T02:17:14.516230+0000","last_peered":"2023-07-09T02:17:14.516230+0000","last_clean":"2023-07-09T02:17:14.516230+0000","last_became_active":"2023-07-09T02:17:11.666490+0000","last_became_peered":"2023-07-09T02:17:11.666490+0000","last_unstale":"2023-07-09T02:17:14.516230+0000","last_undegraded":"2023-07-09T02:17:14.516230+0000","last_fullsized":"2023-07-09T02:17:14.516230+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:23:21.567466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515956+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:17:14.515956+0000","last_peered":"2023-07-09T02:17:14.515956+0000","last_clean":"2023-07-09T02:17:14.515956+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:17:14.515956+0000","last_undegraded":"2023-07-09T02:17:14.515956+0000","last_fullsized":"2023-07-09T02:17:14.515956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:37:27.274144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660040+0000","last_change":"2023-07-09T02:17:12.669866+0000","last_active":"2023-07-09T02:17:13.660040+0000","last_peered":"2023-07-09T02:17:13.660040+0000","last_clean":"2023-07-09T02:17:13.660040+0000","last_became_active":"2023-07-09T02:17:12.669579+0000","last_became_peered":"2023-07-09T02:17:12.669579+0000","last_unstale":"2023-07-09T02:17:13.660040+0000","last_undegraded":"2023-07-09T02:17:13.660040+0000","last_fullsized":"2023-07-09T02:17:13.660040+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:13:22.736126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660045+0000","last_change":"2023-07-09T02:17:11.664681+0000","last_active":"2023-07-09T02:17:13.660045+0000","last_peered":"2023-07-09T02:17:13.660045+0000","last_clean":"2023-07-09T02:17:13.660045+0000","last_became_active":"2023-07-09T02:17:11.663214+0000","last_became_peered":"2023-07-09T02:17:11.663214+0000","last_unstale":"2023-07-09T02:17:13.660045+0000","last_undegraded":"2023-07-09T02:17:13.660045+0000","last_fullsized":"2023-07-09T02:17:13.660045+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:21:27.860364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":191,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517112+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:17:14.517112+0000","last_peered":"2023-07-09T02:17:14.517112+0000","last_clean":"2023-07-09T02:17:14.517112+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:17:14.517112+0000","last_undegraded":"2023-07-09T02:17:14.517112+0000","last_fullsized":"2023-07-09T02:17:14.517112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:28.876156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516712+0000","last_change":"2023-07-09T02:17:12.664650+0000","last_active":"2023-07-09T02:17:14.516712+0000","last_peered":"2023-07-09T02:17:14.516712+0000","last_clean":"2023-07-09T02:17:14.516712+0000","last_became_active":"2023-07-09T02:17:12.663982+0000","last_became_peered":"2023-07-09T02:17:12.663982+0000","last_unstale":"2023-07-09T02:17:14.516712+0000","last_undegraded":"2023-07-09T02:17:14.516712+0000","last_fullsized":"2023-07-09T02:17:14.516712+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:44:10.594764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516508+0000","last_change":"2023-07-09T02:17:11.666048+0000","last_active":"2023-07-09T02:17:14.516508+0000","last_peered":"2023-07-09T02:17:14.516508+0000","last_clean":"2023-07-09T02:17:14.516508+0000","last_became_active":"2023-07-09T02:17:11.663868+0000","last_became_peered":"2023-07-09T02:17:11.663868+0000","last_unstale":"2023-07-09T02:17:14.516508+0000","last_undegraded":"2023-07-09T02:17:14.516508+0000","last_fullsized":"2023-07-09T02:17:14.516508+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:46:34.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":213,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660120+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:17:13.660120+0000","last_peered":"2023-07-09T02:17:13.660120+0000","last_clean":"2023-07-09T02:17:13.660120+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:17:13.660120+0000","last_undegraded":"2023-07-09T02:17:13.660120+0000","last_fullsized":"2023-07-09T02:17:13.660120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:30:31.545329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595221+0000","last_change":"2023-07-09T02:17:12.676401+0000","last_active":"2023-07-09T02:17:14.595221+0000","last_peered":"2023-07-09T02:17:14.595221+0000","last_clean":"2023-07-09T02:17:14.595221+0000","last_became_active":"2023-07-09T02:17:12.676159+0000","last_became_peered":"2023-07-09T02:17:12.676159+0000","last_unstale":"2023-07-09T02:17:14.595221+0000","last_undegraded":"2023-07-09T02:17:14.595221+0000","last_fullsized":"2023-07-09T02:17:14.595221+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:25:15.695623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516836+0000","last_change":"2023-07-09T02:17:11.664964+0000","last_active":"2023-07-09T02:17:14.516836+0000","last_peered":"2023-07-09T02:17:14.516836+0000","last_clean":"2023-07-09T02:17:14.516836+0000","last_became_active":"2023-07-09T02:17:11.664735+0000","last_became_peered":"2023-07-09T02:17:11.664735+0000","last_unstale":"2023-07-09T02:17:14.516836+0000","last_undegraded":"2023-07-09T02:17:14.516836+0000","last_fullsized":"2023-07-09T02:17:14.516836+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:46:20.575550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660686+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:17:13.660686+0000","last_peered":"2023-07-09T02:17:13.660686+0000","last_clean":"2023-07-09T02:17:13.660686+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:17:13.660686+0000","last_undegraded":"2023-07-09T02:17:13.660686+0000","last_fullsized":"2023-07-09T02:17:13.660686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:04.043472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516972+0000","last_change":"2023-07-09T02:17:12.664942+0000","last_active":"2023-07-09T02:17:14.516972+0000","last_peered":"2023-07-09T02:17:14.516972+0000","last_clean":"2023-07-09T02:17:14.516972+0000","last_became_active":"2023-07-09T02:17:12.664418+0000","last_became_peered":"2023-07-09T02:17:12.664418+0000","last_unstale":"2023-07-09T02:17:14.516972+0000","last_undegraded":"2023-07-09T02:17:14.516972+0000","last_fullsized":"2023-07-09T02:17:14.516972+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:17:50.421469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517096+0000","last_change":"2023-07-09T02:17:11.660979+0000","last_active":"2023-07-09T02:17:14.517096+0000","last_peered":"2023-07-09T02:17:14.517096+0000","last_clean":"2023-07-09T02:17:14.517096+0000","last_became_active":"2023-07-09T02:17:11.660744+0000","last_became_peered":"2023-07-09T02:17:11.660744+0000","last_unstale":"2023-07-09T02:17:14.517096+0000","last_undegraded":"2023-07-09T02:17:14.517096+0000","last_fullsized":"2023-07-09T02:17:14.517096+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:12:06.028472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515816+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:17:14.515816+0000","last_peered":"2023-07-09T02:17:14.515816+0000","last_clean":"2023-07-09T02:17:14.515816+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:17:14.515816+0000","last_undegraded":"2023-07-09T02:17:14.515816+0000","last_fullsized":"2023-07-09T02:17:14.515816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:19:39.070474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660462+0000","last_change":"2023-07-09T02:17:12.667521+0000","last_active":"2023-07-09T02:17:13.660462+0000","last_peered":"2023-07-09T02:17:13.660462+0000","last_clean":"2023-07-09T02:17:13.660462+0000","last_became_active":"2023-07-09T02:17:12.666919+0000","last_became_peered":"2023-07-09T02:17:12.666919+0000","last_unstale":"2023-07-09T02:17:13.660462+0000","last_undegraded":"2023-07-09T02:17:13.660462+0000","last_fullsized":"2023-07-09T02:17:13.660462+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:57:20.998323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517028+0000","last_change":"2023-07-09T02:17:11.657908+0000","last_active":"2023-07-09T02:17:14.517028+0000","last_peered":"2023-07-09T02:17:14.517028+0000","last_clean":"2023-07-09T02:17:14.517028+0000","last_became_active":"2023-07-09T02:17:11.657678+0000","last_became_peered":"2023-07-09T02:17:11.657678+0000","last_unstale":"2023-07-09T02:17:14.517028+0000","last_undegraded":"2023-07-09T02:17:14.517028+0000","last_fullsized":"2023-07-09T02:17:14.517028+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:30:17.641971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660161+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:17:13.660161+0000","last_peered":"2023-07-09T02:17:13.660161+0000","last_clean":"2023-07-09T02:17:13.660161+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:17:13.660161+0000","last_undegraded":"2023-07-09T02:17:13.660161+0000","last_fullsized":"2023-07-09T02:17:13.660161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:25:57.583194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.661100+0000","last_change":"2023-07-09T02:17:12.667030+0000","last_active":"2023-07-09T02:17:13.661100+0000","last_peered":"2023-07-09T02:17:13.661100+0000","last_clean":"2023-07-09T02:17:13.661100+0000","last_became_active":"2023-07-09T02:17:12.666719+0000","last_became_peered":"2023-07-09T02:17:12.666719+0000","last_unstale":"2023-07-09T02:17:13.661100+0000","last_undegraded":"2023-07-09T02:17:13.661100+0000","last_fullsized":"2023-07-09T02:17:13.661100+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:01:01.521381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516705+0000","last_change":"2023-07-09T02:17:11.659289+0000","last_active":"2023-07-09T02:17:14.516705+0000","last_peered":"2023-07-09T02:17:14.516705+0000","last_clean":"2023-07-09T02:17:14.516705+0000","last_became_active":"2023-07-09T02:17:11.659049+0000","last_became_peered":"2023-07-09T02:17:11.659049+0000","last_unstale":"2023-07-09T02:17:14.516705+0000","last_undegraded":"2023-07-09T02:17:14.516705+0000","last_fullsized":"2023-07-09T02:17:14.516705+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:11:10.751041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516751+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:17:14.516751+0000","last_peered":"2023-07-09T02:17:14.516751+0000","last_clean":"2023-07-09T02:17:14.516751+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:17:14.516751+0000","last_undegraded":"2023-07-09T02:17:14.516751+0000","last_fullsized":"2023-07-09T02:17:14.516751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:02:09.608391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1282,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194030,"statfs":{"total":200000000,"available":198686923,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.204,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":1.423,"15min":1.423},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.032,"15min":0.80000000000000004},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.117,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.89000000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.028,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.97899999999999998,"15min":0.80900000000000005},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93999999999999995,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84199999999999997,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.242,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.68000000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78600000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.622},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.38700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.94999999999999996,"5min":1.048,"15min":1.048},"last":0.85099999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.87,"5min":1.087,"15min":1.087},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.87}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194604,"statfs":{"total":200000000,"available":199275283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.55200000000000005,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.78300000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.92200000000000004,"15min":1.4379999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90700000000000003,"15min":1.165},"last":0.76800000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.59499999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.90400000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.70999999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.5,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.88400000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.998,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":1.117,"15min":1.117},"last":0.86099999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89900000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.752}]}]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.63900000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86899999999999999,"5min":1.179,"15min":1.179},"last":0.58999999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.65700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68899999999999995,"15min":0.65600000000000003},"min":{"1min":0.58099999999999996,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65700000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":0.81000000000000005,"5min":1.103,"15min":1.103},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.56799999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.77800000000000002,"15min":0.71499999999999997},"min":{"1min":0.54400000000000004,"5min":0.50600000000000001,"15min":0.47399999999999998},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.49399999999999999,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":1.008,"15min":1.008},"last":0.751},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63,"15min":0.61399999999999999},"min":{"1min":0.51900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91900000000000004,"5min":1.054,"15min":1.054},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.85399999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.755},"min":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.48599999999999999},"max":{"1min":0.95099999999999996,"5min":1.091,"15min":1.091},"last":0.95099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277359,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":1.2529999999999999,"15min":0.85499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.89000000000000001,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65800000000000003,"15min":0.67400000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.873,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84199999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.66000000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.008,"5min":1.323,"15min":1.323},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90600000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.518,"15min":0.94399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85899999999999999,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.62}]},{"osd":5,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.94699999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.64700000000000002},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68000000000000005,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80500000000000005,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.70699999999999996},"min":{"1min":0.45200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93899999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78200000000000003,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92700000000000005,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199276869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.26400000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.198,"15min":1.198},"last":0.55000000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":1.048,"15min":1.048},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52800000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":1.155,"15min":1.155},"last":0.5},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0229999999999999,"5min":1.302,"15min":1.302},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75600000000000001,"15min":0.70599999999999996},"min":{"1min":0.56599999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.006,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.71899999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0940000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.748},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97799999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.56000000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0569999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.228,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.58099999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1359999999999999,"5min":1.367,"15min":1.367},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.76900000000000002},"min":{"1min":0.67400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95299999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.52200000000000002,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69399999999999995,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.43099999999999999},"min":{"1min":0.35399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":1.127,"15min":1.127},"last":0.66400000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47599999999999998,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58299999999999996,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.52400000000000002},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71199999999999997,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.5},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.57899999999999996,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58099999999999996,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.54900000000000004}]},{"osd":4,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.81499999999999995,"15min":0.753},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.46500000000000002},"max":{"1min":0.998,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77000000000000002,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.089}]},{"osd":5,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.52500000000000002,"5min":0.499,"15min":0.496},"max":{"1min":1.052,"5min":1.1799999999999999,"15min":1.319},"last":1.052},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.99,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.92400000000000004}]},{"osd":6,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80700000000000005,"15min":0.77100000000000002},"min":{"1min":0.56599999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0329999999999999,"5min":1.452,"15min":1.452},"last":0.95099999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.72399999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":1.206,"15min":1.351},"last":0.90500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.379},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.46200000000000002},"min":{"1min":0.308,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.307}]},{"osd":2,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.501,"15min":0.496},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68600000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.495}]},{"osd":3,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":1.163,"15min":1.163},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.026,"15min":1.026},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.745,"15min":0.72699999999999998},"min":{"1min":0.53400000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95999999999999996,"5min":1.034,"15min":1.034},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.80000000000000004,"15min":0.78100000000000003},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0900000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78000000000000003,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0229999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98199999999999998,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1283,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194028,"statfs":{"total":200000000,"available":198685429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.41699999999999998},"min":{"1min":0.26300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.627,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.501,"5min":0.503,"15min":0.46700000000000003},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0169999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59299999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47299999999999998,"15min":0.443},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.443,"15min":0.41499999999999998},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60599999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.53900000000000003,"15min":0.502},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.626,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.89200000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.145,"15min":1.145},"last":1.038},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.153,"15min":1.153},"last":0.85399999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0669999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.504,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.238,"15min":1.238},"last":1.0680000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93899999999999995,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.53800000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0389999999999999,"5min":1.472,"15min":1.472},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54700000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98299999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.97699999999999998}]}]}],"pool_statfs":[]}} 2023-07-09T02:17:16.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:17:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3dbd51f640 1 Processor -- start 2023-07-09T02:17:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3dbd51f640 1 -- start start 2023-07-09T02:17:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3dbd51f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3dbd51f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db8160a50 con 0x7f3db80d2620 2023-07-09T02:17:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3dbd51f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db815c430 con 0x7f3db815c060 2023-07-09T02:17:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3dbd51f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db815fb60 con 0x7f3db80cd120 2023-07-09T02:17:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3daffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3db80d2620 0x7f3db80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37054/0 (socket says 172.21.15.45:37054) 2023-07-09T02:17:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3daffff640 1 -- 172.21.15.45:0/3801618285 learned_addr learned my addr 172.21.15.45:0/3801618285 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3db77fe640 1 --2- 172.21.15.45:0/3801618285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3db67fc640 1 -- 172.21.15.45:0/3801618285 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712637372 0 0) 0x7f3db8160a50 con 0x7f3db80d2620 2023-07-09T02:17:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3db67fc640 1 -- 172.21.15.45:0/3801618285 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da4003530 con 0x7f3db80d2620 2023-07-09T02:17:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3db67fc640 1 -- 172.21.15.45:0/3801618285 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921703329 0 0) 0x7f3db815c430 con 0x7f3db815c060 2023-07-09T02:17:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3db67fc640 1 -- 172.21.15.45:0/3801618285 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3db8160a50 con 0x7f3db815c060 2023-07-09T02:17:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3db77fe640 1 -- 172.21.15.45:0/3801618285 >> v1:172.21.15.155:6789/0 conn(0x7f3db815c060 legacy=0x7f3db80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3db77fe640 1 -- 172.21.15.45:0/3801618285 >> v1:172.21.15.45:6789/0 conn(0x7f3db80d2620 legacy=0x7f3db80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.956+0000 7f3db77fe640 1 -- 172.21.15.45:0/3801618285 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db815fe40 con 0x7f3db80cd120 2023-07-09T02:17:16.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3db77fe640 1 --2- 172.21.15.45:0/3801618285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db80b4ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009dc0 tx=0x7f3db001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16516c6f9e06bf46 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3db67fc640 1 -- 172.21.15.45:0/3801618285 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db00a5a00 con 0x7f3db80cd120 2023-07-09T02:17:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3db67fc640 1 -- 172.21.15.45:0/3801618285 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db00a5b60 con 0x7f3db80cd120 2023-07-09T02:17:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3db67fc640 1 -- 172.21.15.45:0/3801618285 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db00ad440 con 0x7f3db80cd120 2023-07-09T02:17:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3dbd51f640 1 -- 172.21.15.45:0/3801618285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 msgr2=0x7f3db80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3dbd51f640 1 --2- 172.21.15.45:0/3801618285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db80b4ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009dc0 tx=0x7f3db001c940 comp rx=0 tx=0).stop 2023-07-09T02:17:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3dbd51f640 1 -- 172.21.15.45:0/3801618285 shutdown_connections 2023-07-09T02:17:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3dbd51f640 1 --2- 172.21.15.45:0/3801618285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db80b4ed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3dbd51f640 1 -- 172.21.15.45:0/3801618285 >> 172.21.15.45:0/3801618285 conn(0x7f3db80698e0 msgr2=0x7f3db8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3dbd51f640 1 -- 172.21.15.45:0/3801618285 shutdown_connections 2023-07-09T02:17:16.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.960+0000 7f3dbd51f640 1 -- 172.21.15.45:0/3801618285 wait complete. 2023-07-09T02:17:16.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 Processor -- start 2023-07-09T02:17:16.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 -- start start 2023-07-09T02:17:16.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db815d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80d2620 0x7f3db8161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c060 0x7f3db81f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db815d9c0 con 0x7f3db80d2620 2023-07-09T02:17:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8161ec0 con 0x7f3db815c060 2023-07-09T02:17:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db815dbd0 con 0x7f3db80cd120 2023-07-09T02:17:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db815d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3daffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80d2620 0x7f3db8161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c060 0x7f3db81f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db815d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38608/0 (socket says 172.21.15.45:38608) 2023-07-09T02:17:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c060 0x7f3db81f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:37106/0 (socket says 172.21.15.45:37106) 2023-07-09T02:17:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 -- 172.21.15.45:0/1741002356 learned_addr learned my addr 172.21.15.45:0/1741002356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:16.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 -- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c060 msgr2=0x7f3db81f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c060 0x7f3db81f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 -- 172.21.15.45:0/1741002356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80d2620 msgr2=0x7f3db8161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80d2620 0x7f3db8161980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 -- 172.21.15.45:0/1741002356 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db0009a70 con 0x7f3db80cd120 2023-07-09T02:17:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3daffff640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80d2620 0x7f3db8161980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3db6ffd640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db815d480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c460 tx=0x7f3da800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3daf7fe640 1 -- 172.21.15.45:0/1741002356 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da80052d0 con 0x7f3db80cd120 2023-07-09T02:17:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3daf7fe640 1 -- 172.21.15.45:0/1741002356 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8005450 con 0x7f3db80cd120 2023-07-09T02:17:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3daf7fe640 1 -- 172.21.15.45:0/1741002356 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8012870 con 0x7f3db80cd120 2023-07-09T02:17:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db80b59f0 con 0x7f3db80cd120 2023-07-09T02:17:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.964+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db815e190 con 0x7f3db80cd120 2023-07-09T02:17:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.968+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db80ccee0 con 0x7f3db80cd120 2023-07-09T02:17:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.968+0000 7f3daf7fe640 1 -- 172.21.15.45:0/1741002356 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3da80129d0 con 0x7f3db80cd120 2023-07-09T02:17:16.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.968+0000 7f3daf7fe640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:16.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.968+0000 7f3daf7fe640 1 -- 172.21.15.45:0/1741002356 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3da8083720 con 0x7f3db80cd120 2023-07-09T02:17:16.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.968+0000 7f3daffff640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:16.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.968+0000 7f3daffff640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3db8161220 tx=0x7f3da0007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:16.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:16.972+0000 7f3daf7fe640 1 -- 172.21.15.45:0/1741002356 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3da8050c40 con 0x7f3db80cd120 2023-07-09T02:17:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.124+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3db80b5870 con 0x7f3d98066280 2023-07-09T02:17:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.132+0000 7f3daf7fe640 1 -- 172.21.15.45:0/1741002356 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305972 (secure 0 0 0) 0x7f3da0007690 con 0x7f3d98066280 2023-07-09T02:17:17.135 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:17:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 msgr2=0x7f3d98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3db8161220 tx=0x7f3da0007d60 comp rx=0 tx=0).stop 2023-07-09T02:17:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 msgr2=0x7f3db815d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db815d480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c460 tx=0x7f3da800c920 comp rx=0 tx=0).stop 2023-07-09T02:17:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 shutdown_connections 2023-07-09T02:17:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db815c060 0x7f3db81f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db80d2620 0x7f3db8161980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3d98066280 0x7f3d98068730 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 --2- 172.21.15.45:0/1741002356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db80cd120 0x7f3db815d480 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 >> 172.21.15.45:0/1741002356 conn(0x7f3db80698e0 msgr2=0x7f3db80b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 shutdown_connections 2023-07-09T02:17:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.136+0000 7f3dbd51f640 1 -- 172.21.15.45:0/1741002356 wait complete. 2023-07-09T02:17:17.155 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2023-07-09T02:17:16.614605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555697,"statfs":{"total":1600000000,"available":1593034148,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.969148"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660525+0000","last_change":"2023-07-09T02:17:12.664800+0000","last_active":"2023-07-09T02:17:13.660525+0000","last_peered":"2023-07-09T02:17:13.660525+0000","last_clean":"2023-07-09T02:17:13.660525+0000","last_became_active":"2023-07-09T02:17:12.664576+0000","last_became_peered":"2023-07-09T02:17:12.664576+0000","last_unstale":"2023-07-09T02:17:13.660525+0000","last_undegraded":"2023-07-09T02:17:13.660525+0000","last_fullsized":"2023-07-09T02:17:13.660525+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:17:11.800974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516600+0000","last_change":"2023-07-09T02:17:12.678621+0000","last_active":"2023-07-09T02:17:14.516600+0000","last_peered":"2023-07-09T02:17:14.516600+0000","last_clean":"2023-07-09T02:17:14.516600+0000","last_became_active":"2023-07-09T02:17:12.678238+0000","last_became_peered":"2023-07-09T02:17:12.678238+0000","last_unstale":"2023-07-09T02:17:14.516600+0000","last_undegraded":"2023-07-09T02:17:14.516600+0000","last_fullsized":"2023-07-09T02:17:14.516600+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:15:44.293837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660979+0000","last_change":"2023-07-09T02:17:12.662159+0000","last_active":"2023-07-09T02:17:13.660979+0000","last_peered":"2023-07-09T02:17:13.660979+0000","last_clean":"2023-07-09T02:17:13.660979+0000","last_became_active":"2023-07-09T02:17:12.661635+0000","last_became_peered":"2023-07-09T02:17:12.661635+0000","last_unstale":"2023-07-09T02:17:13.660979+0000","last_undegraded":"2023-07-09T02:17:13.660979+0000","last_fullsized":"2023-07-09T02:17:13.660979+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:40:37.017610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595520+0000","last_change":"2023-07-09T02:17:12.674578+0000","last_active":"2023-07-09T02:17:14.595520+0000","last_peered":"2023-07-09T02:17:14.595520+0000","last_clean":"2023-07-09T02:17:14.595520+0000","last_became_active":"2023-07-09T02:17:12.674224+0000","last_became_peered":"2023-07-09T02:17:12.674224+0000","last_unstale":"2023-07-09T02:17:14.595520+0000","last_undegraded":"2023-07-09T02:17:14.595520+0000","last_fullsized":"2023-07-09T02:17:14.595520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:34:37.020811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659922+0000","last_change":"2023-07-09T02:17:12.677975+0000","last_active":"2023-07-09T02:17:13.659922+0000","last_peered":"2023-07-09T02:17:13.659922+0000","last_clean":"2023-07-09T02:17:13.659922+0000","last_became_active":"2023-07-09T02:17:12.677686+0000","last_became_peered":"2023-07-09T02:17:12.677686+0000","last_unstale":"2023-07-09T02:17:13.659922+0000","last_undegraded":"2023-07-09T02:17:13.659922+0000","last_fullsized":"2023-07-09T02:17:13.659922+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:14:25.730103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517412+0000","last_change":"2023-07-09T02:17:12.675943+0000","last_active":"2023-07-09T02:17:14.517412+0000","last_peered":"2023-07-09T02:17:14.517412+0000","last_clean":"2023-07-09T02:17:14.517412+0000","last_became_active":"2023-07-09T02:17:12.674979+0000","last_became_peered":"2023-07-09T02:17:12.674979+0000","last_unstale":"2023-07-09T02:17:14.517412+0000","last_undegraded":"2023-07-09T02:17:14.517412+0000","last_fullsized":"2023-07-09T02:17:14.517412+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:21:33.760288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516344+0000","last_change":"2023-07-09T02:17:12.676045+0000","last_active":"2023-07-09T02:17:14.516344+0000","last_peered":"2023-07-09T02:17:14.516344+0000","last_clean":"2023-07-09T02:17:14.516344+0000","last_became_active":"2023-07-09T02:17:12.672295+0000","last_became_peered":"2023-07-09T02:17:12.672295+0000","last_unstale":"2023-07-09T02:17:14.516344+0000","last_undegraded":"2023-07-09T02:17:14.516344+0000","last_fullsized":"2023-07-09T02:17:14.516344+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:37:47.764618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516515+0000","last_change":"2023-07-09T02:17:12.668445+0000","last_active":"2023-07-09T02:17:14.516515+0000","last_peered":"2023-07-09T02:17:14.516515+0000","last_clean":"2023-07-09T02:17:14.516515+0000","last_became_active":"2023-07-09T02:17:12.668074+0000","last_became_peered":"2023-07-09T02:17:12.668074+0000","last_unstale":"2023-07-09T02:17:14.516515+0000","last_undegraded":"2023-07-09T02:17:14.516515+0000","last_fullsized":"2023-07-09T02:17:14.516515+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:55:58.746125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516384+0000","last_change":"2023-07-09T02:17:12.675712+0000","last_active":"2023-07-09T02:17:14.516384+0000","last_peered":"2023-07-09T02:17:14.516384+0000","last_clean":"2023-07-09T02:17:14.516384+0000","last_became_active":"2023-07-09T02:17:12.675332+0000","last_became_peered":"2023-07-09T02:17:12.675332+0000","last_unstale":"2023-07-09T02:17:14.516384+0000","last_undegraded":"2023-07-09T02:17:14.516384+0000","last_fullsized":"2023-07-09T02:17:14.516384+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:13:26.659294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660158+0000","last_change":"2023-07-09T02:17:12.670971+0000","last_active":"2023-07-09T02:17:13.660158+0000","last_peered":"2023-07-09T02:17:13.660158+0000","last_clean":"2023-07-09T02:17:13.660158+0000","last_became_active":"2023-07-09T02:17:12.670550+0000","last_became_peered":"2023-07-09T02:17:12.670550+0000","last_unstale":"2023-07-09T02:17:13.660158+0000","last_undegraded":"2023-07-09T02:17:13.660158+0000","last_fullsized":"2023-07-09T02:17:13.660158+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:32:57.924849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659710+0000","last_change":"2023-07-09T02:17:12.678024+0000","last_active":"2023-07-09T02:17:13.659710+0000","last_peered":"2023-07-09T02:17:13.659710+0000","last_clean":"2023-07-09T02:17:13.659710+0000","last_became_active":"2023-07-09T02:17:12.677803+0000","last_became_peered":"2023-07-09T02:17:12.677803+0000","last_unstale":"2023-07-09T02:17:13.659710+0000","last_undegraded":"2023-07-09T02:17:13.659710+0000","last_fullsized":"2023-07-09T02:17:13.659710+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:20:00.950943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516081+0000","last_change":"2023-07-09T02:17:12.671243+0000","last_active":"2023-07-09T02:17:14.516081+0000","last_peered":"2023-07-09T02:17:14.516081+0000","last_clean":"2023-07-09T02:17:14.516081+0000","last_became_active":"2023-07-09T02:17:12.670773+0000","last_became_peered":"2023-07-09T02:17:12.670773+0000","last_unstale":"2023-07-09T02:17:14.516081+0000","last_undegraded":"2023-07-09T02:17:14.516081+0000","last_fullsized":"2023-07-09T02:17:14.516081+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:18:27.721217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595283+0000","last_change":"2023-07-09T02:17:12.665996+0000","last_active":"2023-07-09T02:17:14.595283+0000","last_peered":"2023-07-09T02:17:14.595283+0000","last_clean":"2023-07-09T02:17:14.595283+0000","last_became_active":"2023-07-09T02:17:12.665737+0000","last_became_peered":"2023-07-09T02:17:12.665737+0000","last_unstale":"2023-07-09T02:17:14.595283+0000","last_undegraded":"2023-07-09T02:17:14.595283+0000","last_fullsized":"2023-07-09T02:17:14.595283+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:13:30.900911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515627+0000","last_change":"2023-07-09T02:17:12.671767+0000","last_active":"2023-07-09T02:17:14.515627+0000","last_peered":"2023-07-09T02:17:14.515627+0000","last_clean":"2023-07-09T02:17:14.515627+0000","last_became_active":"2023-07-09T02:17:12.671201+0000","last_became_peered":"2023-07-09T02:17:12.671201+0000","last_unstale":"2023-07-09T02:17:14.515627+0000","last_undegraded":"2023-07-09T02:17:14.515627+0000","last_fullsized":"2023-07-09T02:17:14.515627+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:49:16.158486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515798+0000","last_change":"2023-07-09T02:17:12.669674+0000","last_active":"2023-07-09T02:17:14.515798+0000","last_peered":"2023-07-09T02:17:14.515798+0000","last_clean":"2023-07-09T02:17:14.515798+0000","last_became_active":"2023-07-09T02:17:12.669013+0000","last_became_peered":"2023-07-09T02:17:12.669013+0000","last_unstale":"2023-07-09T02:17:14.515798+0000","last_undegraded":"2023-07-09T02:17:14.515798+0000","last_fullsized":"2023-07-09T02:17:14.515798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:17:58.120648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516015+0000","last_change":"2023-07-09T02:17:12.670464+0000","last_active":"2023-07-09T02:17:14.516015+0000","last_peered":"2023-07-09T02:17:14.516015+0000","last_clean":"2023-07-09T02:17:14.516015+0000","last_became_active":"2023-07-09T02:17:12.670229+0000","last_became_peered":"2023-07-09T02:17:12.670229+0000","last_unstale":"2023-07-09T02:17:14.516015+0000","last_undegraded":"2023-07-09T02:17:14.516015+0000","last_fullsized":"2023-07-09T02:17:14.516015+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:05:21.197690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660604+0000","last_change":"2023-07-09T02:17:12.663598+0000","last_active":"2023-07-09T02:17:13.660604+0000","last_peered":"2023-07-09T02:17:13.660604+0000","last_clean":"2023-07-09T02:17:13.660604+0000","last_became_active":"2023-07-09T02:17:12.663318+0000","last_became_peered":"2023-07-09T02:17:12.663318+0000","last_unstale":"2023-07-09T02:17:13.660604+0000","last_undegraded":"2023-07-09T02:17:13.660604+0000","last_fullsized":"2023-07-09T02:17:13.660604+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:28:55.143090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517475+0000","last_change":"2023-07-09T02:17:12.671609+0000","last_active":"2023-07-09T02:17:14.517475+0000","last_peered":"2023-07-09T02:17:14.517475+0000","last_clean":"2023-07-09T02:17:14.517475+0000","last_became_active":"2023-07-09T02:17:12.671337+0000","last_became_peered":"2023-07-09T02:17:12.671337+0000","last_unstale":"2023-07-09T02:17:14.517475+0000","last_undegraded":"2023-07-09T02:17:14.517475+0000","last_fullsized":"2023-07-09T02:17:14.517475+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:25:47.791032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660259+0000","last_change":"2023-07-09T02:17:12.680815+0000","last_active":"2023-07-09T02:17:13.660259+0000","last_peered":"2023-07-09T02:17:13.660259+0000","last_clean":"2023-07-09T02:17:13.660259+0000","last_became_active":"2023-07-09T02:17:12.680684+0000","last_became_peered":"2023-07-09T02:17:12.680684+0000","last_unstale":"2023-07-09T02:17:13.660259+0000","last_undegraded":"2023-07-09T02:17:13.660259+0000","last_fullsized":"2023-07-09T02:17:13.660259+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:37:28.341888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516682+0000","last_change":"2023-07-09T02:17:12.679026+0000","last_active":"2023-07-09T02:17:14.516682+0000","last_peered":"2023-07-09T02:17:14.516682+0000","last_clean":"2023-07-09T02:17:14.516682+0000","last_became_active":"2023-07-09T02:17:12.676233+0000","last_became_peered":"2023-07-09T02:17:12.676233+0000","last_unstale":"2023-07-09T02:17:14.516682+0000","last_undegraded":"2023-07-09T02:17:14.516682+0000","last_fullsized":"2023-07-09T02:17:14.516682+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:25:37.860244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516799+0000","last_change":"2023-07-09T02:17:12.662238+0000","last_active":"2023-07-09T02:17:14.516799+0000","last_peered":"2023-07-09T02:17:14.516799+0000","last_clean":"2023-07-09T02:17:14.516799+0000","last_became_active":"2023-07-09T02:17:12.661974+0000","last_became_peered":"2023-07-09T02:17:12.661974+0000","last_unstale":"2023-07-09T02:17:14.516799+0000","last_undegraded":"2023-07-09T02:17:14.516799+0000","last_fullsized":"2023-07-09T02:17:14.516799+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:10:21.517175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659860+0000","last_change":"2023-07-09T02:17:12.667852+0000","last_active":"2023-07-09T02:17:13.659860+0000","last_peered":"2023-07-09T02:17:13.659860+0000","last_clean":"2023-07-09T02:17:13.659860+0000","last_became_active":"2023-07-09T02:17:12.667564+0000","last_became_peered":"2023-07-09T02:17:12.667564+0000","last_unstale":"2023-07-09T02:17:13.659860+0000","last_undegraded":"2023-07-09T02:17:13.659860+0000","last_fullsized":"2023-07-09T02:17:13.659860+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:23:48.842195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.661043+0000","last_change":"2023-07-09T02:17:12.662301+0000","last_active":"2023-07-09T02:17:13.661043+0000","last_peered":"2023-07-09T02:17:13.661043+0000","last_clean":"2023-07-09T02:17:13.661043+0000","last_became_active":"2023-07-09T02:17:12.661945+0000","last_became_peered":"2023-07-09T02:17:12.661945+0000","last_unstale":"2023-07-09T02:17:13.661043+0000","last_undegraded":"2023-07-09T02:17:13.661043+0000","last_fullsized":"2023-07-09T02:17:13.661043+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:39:00.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659610+0000","last_change":"2023-07-09T02:17:12.669616+0000","last_active":"2023-07-09T02:17:13.659610+0000","last_peered":"2023-07-09T02:17:13.659610+0000","last_clean":"2023-07-09T02:17:13.659610+0000","last_became_active":"2023-07-09T02:17:12.669355+0000","last_became_peered":"2023-07-09T02:17:12.669355+0000","last_unstale":"2023-07-09T02:17:13.659610+0000","last_undegraded":"2023-07-09T02:17:13.659610+0000","last_fullsized":"2023-07-09T02:17:13.659610+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:46:47.963217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516798+0000","last_change":"2023-07-09T02:17:12.677268+0000","last_active":"2023-07-09T02:17:14.516798+0000","last_peered":"2023-07-09T02:17:14.516798+0000","last_clean":"2023-07-09T02:17:14.516798+0000","last_became_active":"2023-07-09T02:17:12.673864+0000","last_became_peered":"2023-07-09T02:17:12.673864+0000","last_unstale":"2023-07-09T02:17:14.516798+0000","last_undegraded":"2023-07-09T02:17:14.516798+0000","last_fullsized":"2023-07-09T02:17:14.516798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:55:29.253497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516746+0000","last_change":"2023-07-09T02:17:12.681350+0000","last_active":"2023-07-09T02:17:14.516746+0000","last_peered":"2023-07-09T02:17:14.516746+0000","last_clean":"2023-07-09T02:17:14.516746+0000","last_became_active":"2023-07-09T02:17:12.681072+0000","last_became_peered":"2023-07-09T02:17:12.681072+0000","last_unstale":"2023-07-09T02:17:14.516746+0000","last_undegraded":"2023-07-09T02:17:14.516746+0000","last_fullsized":"2023-07-09T02:17:14.516746+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:05:02.925042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659453+0000","last_change":"2023-07-09T02:17:12.668600+0000","last_active":"2023-07-09T02:17:13.659453+0000","last_peered":"2023-07-09T02:17:13.659453+0000","last_clean":"2023-07-09T02:17:13.659453+0000","last_became_active":"2023-07-09T02:17:12.668338+0000","last_became_peered":"2023-07-09T02:17:12.668338+0000","last_unstale":"2023-07-09T02:17:13.659453+0000","last_undegraded":"2023-07-09T02:17:13.659453+0000","last_fullsized":"2023-07-09T02:17:13.659453+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:39.301020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517552+0000","last_change":"2023-07-09T02:17:12.678615+0000","last_active":"2023-07-09T02:17:14.517552+0000","last_peered":"2023-07-09T02:17:14.517552+0000","last_clean":"2023-07-09T02:17:14.517552+0000","last_became_active":"2023-07-09T02:17:12.678204+0000","last_became_peered":"2023-07-09T02:17:12.678204+0000","last_unstale":"2023-07-09T02:17:14.517552+0000","last_undegraded":"2023-07-09T02:17:14.517552+0000","last_fullsized":"2023-07-09T02:17:14.517552+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:02:36.902331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516352+0000","last_change":"2023-07-09T02:17:12.672868+0000","last_active":"2023-07-09T02:17:14.516352+0000","last_peered":"2023-07-09T02:17:14.516352+0000","last_clean":"2023-07-09T02:17:14.516352+0000","last_became_active":"2023-07-09T02:17:12.672628+0000","last_became_peered":"2023-07-09T02:17:12.672628+0000","last_unstale":"2023-07-09T02:17:14.516352+0000","last_undegraded":"2023-07-09T02:17:14.516352+0000","last_fullsized":"2023-07-09T02:17:14.516352+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:47:23.904521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516917+0000","last_change":"2023-07-09T02:17:12.676454+0000","last_active":"2023-07-09T02:17:14.516917+0000","last_peered":"2023-07-09T02:17:14.516917+0000","last_clean":"2023-07-09T02:17:14.516917+0000","last_became_active":"2023-07-09T02:17:12.673577+0000","last_became_peered":"2023-07-09T02:17:12.673577+0000","last_unstale":"2023-07-09T02:17:14.516917+0000","last_undegraded":"2023-07-09T02:17:14.516917+0000","last_fullsized":"2023-07-09T02:17:14.516917+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:47.450371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517055+0000","last_change":"2023-07-09T02:17:12.679775+0000","last_active":"2023-07-09T02:17:14.517055+0000","last_peered":"2023-07-09T02:17:14.517055+0000","last_clean":"2023-07-09T02:17:14.517055+0000","last_became_active":"2023-07-09T02:17:12.675541+0000","last_became_peered":"2023-07-09T02:17:12.675541+0000","last_unstale":"2023-07-09T02:17:14.517055+0000","last_undegraded":"2023-07-09T02:17:14.517055+0000","last_fullsized":"2023-07-09T02:17:14.517055+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:59:14.547889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516520+0000","last_change":"2023-07-09T02:17:12.673373+0000","last_active":"2023-07-09T02:17:14.516520+0000","last_peered":"2023-07-09T02:17:14.516520+0000","last_clean":"2023-07-09T02:17:14.516520+0000","last_became_active":"2023-07-09T02:17:12.673105+0000","last_became_peered":"2023-07-09T02:17:12.673105+0000","last_unstale":"2023-07-09T02:17:14.516520+0000","last_undegraded":"2023-07-09T02:17:14.516520+0000","last_fullsized":"2023-07-09T02:17:14.516520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:55:37.557252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660846+0000","last_change":"2023-07-09T02:17:12.678874+0000","last_active":"2023-07-09T02:17:13.660846+0000","last_peered":"2023-07-09T02:17:13.660846+0000","last_clean":"2023-07-09T02:17:13.660846+0000","last_became_active":"2023-07-09T02:17:12.678206+0000","last_became_peered":"2023-07-09T02:17:12.678206+0000","last_unstale":"2023-07-09T02:17:13.660846+0000","last_undegraded":"2023-07-09T02:17:13.660846+0000","last_fullsized":"2023-07-09T02:17:13.660846+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:12.710368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"122'4","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595625+0000","last_change":"2023-07-09T02:17:11.664812+0000","last_active":"2023-07-09T02:17:14.595625+0000","last_peered":"2023-07-09T02:17:14.595625+0000","last_clean":"2023-07-09T02:17:14.595625+0000","last_became_active":"2023-07-09T02:17:11.664583+0000","last_became_peered":"2023-07-09T02:17:11.664583+0000","last_unstale":"2023-07-09T02:17:14.595625+0000","last_undegraded":"2023-07-09T02:17:14.595625+0000","last_fullsized":"2023-07-09T02:17:14.595625+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:22:35.734763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516893+0000","last_change":"2023-07-09T02:17:12.668298+0000","last_active":"2023-07-09T02:17:14.516893+0000","last_peered":"2023-07-09T02:17:14.516893+0000","last_clean":"2023-07-09T02:17:14.516893+0000","last_became_active":"2023-07-09T02:17:12.667743+0000","last_became_peered":"2023-07-09T02:17:12.667743+0000","last_unstale":"2023-07-09T02:17:14.516893+0000","last_undegraded":"2023-07-09T02:17:14.516893+0000","last_fullsized":"2023-07-09T02:17:14.516893+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:35:36.921626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516609+0000","last_change":"2023-07-09T02:17:11.666981+0000","last_active":"2023-07-09T02:17:14.516609+0000","last_peered":"2023-07-09T02:17:14.516609+0000","last_clean":"2023-07-09T02:17:14.516609+0000","last_became_active":"2023-07-09T02:17:11.666351+0000","last_became_peered":"2023-07-09T02:17:11.666351+0000","last_unstale":"2023-07-09T02:17:14.516609+0000","last_undegraded":"2023-07-09T02:17:14.516609+0000","last_fullsized":"2023-07-09T02:17:14.516609+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:28:40.964428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516224+0000","last_change":"2023-07-09T02:17:12.669531+0000","last_active":"2023-07-09T02:17:14.516224+0000","last_peered":"2023-07-09T02:17:14.516224+0000","last_clean":"2023-07-09T02:17:14.516224+0000","last_became_active":"2023-07-09T02:17:12.669191+0000","last_became_peered":"2023-07-09T02:17:12.669191+0000","last_unstale":"2023-07-09T02:17:14.516224+0000","last_undegraded":"2023-07-09T02:17:14.516224+0000","last_fullsized":"2023-07-09T02:17:14.516224+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:18:37.879332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517024+0000","last_change":"2023-07-09T02:17:11.663374+0000","last_active":"2023-07-09T02:17:14.517024+0000","last_peered":"2023-07-09T02:17:14.517024+0000","last_clean":"2023-07-09T02:17:14.517024+0000","last_became_active":"2023-07-09T02:17:11.663016+0000","last_became_peered":"2023-07-09T02:17:11.663016+0000","last_unstale":"2023-07-09T02:17:14.517024+0000","last_undegraded":"2023-07-09T02:17:14.517024+0000","last_fullsized":"2023-07-09T02:17:14.517024+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:58:29.022039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659546+0000","last_change":"2023-07-09T02:17:12.672404+0000","last_active":"2023-07-09T02:17:13.659546+0000","last_peered":"2023-07-09T02:17:13.659546+0000","last_clean":"2023-07-09T02:17:13.659546+0000","last_became_active":"2023-07-09T02:17:12.672184+0000","last_became_peered":"2023-07-09T02:17:12.672184+0000","last_unstale":"2023-07-09T02:17:13.659546+0000","last_undegraded":"2023-07-09T02:17:13.659546+0000","last_fullsized":"2023-07-09T02:17:13.659546+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:03:23.472165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659848+0000","last_change":"2023-07-09T02:17:11.663319+0000","last_active":"2023-07-09T02:17:13.659848+0000","last_peered":"2023-07-09T02:17:13.659848+0000","last_clean":"2023-07-09T02:17:13.659848+0000","last_became_active":"2023-07-09T02:17:11.663061+0000","last_became_peered":"2023-07-09T02:17:11.663061+0000","last_unstale":"2023-07-09T02:17:13.659848+0000","last_undegraded":"2023-07-09T02:17:13.659848+0000","last_fullsized":"2023-07-09T02:17:13.659848+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:19.609229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595322+0000","last_change":"2023-07-09T02:17:12.669343+0000","last_active":"2023-07-09T02:17:14.595322+0000","last_peered":"2023-07-09T02:17:14.595322+0000","last_clean":"2023-07-09T02:17:14.595322+0000","last_became_active":"2023-07-09T02:17:12.669082+0000","last_became_peered":"2023-07-09T02:17:12.669082+0000","last_unstale":"2023-07-09T02:17:14.595322+0000","last_undegraded":"2023-07-09T02:17:14.595322+0000","last_fullsized":"2023-07-09T02:17:14.595322+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:46:09.596616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515715+0000","last_change":"2023-07-09T02:17:11.665786+0000","last_active":"2023-07-09T02:17:14.515715+0000","last_peered":"2023-07-09T02:17:14.515715+0000","last_clean":"2023-07-09T02:17:14.515715+0000","last_became_active":"2023-07-09T02:17:11.665561+0000","last_became_peered":"2023-07-09T02:17:11.665561+0000","last_unstale":"2023-07-09T02:17:14.515715+0000","last_undegraded":"2023-07-09T02:17:14.515715+0000","last_fullsized":"2023-07-09T02:17:14.515715+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:32:38.308317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660717+0000","last_change":"2023-07-09T02:17:12.679022+0000","last_active":"2023-07-09T02:17:13.660717+0000","last_peered":"2023-07-09T02:17:13.660717+0000","last_clean":"2023-07-09T02:17:13.660717+0000","last_became_active":"2023-07-09T02:17:12.678641+0000","last_became_peered":"2023-07-09T02:17:12.678641+0000","last_unstale":"2023-07-09T02:17:13.660717+0000","last_undegraded":"2023-07-09T02:17:13.660717+0000","last_fullsized":"2023-07-09T02:17:13.660717+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:06:36.486199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660285+0000","last_change":"2023-07-09T02:17:11.665363+0000","last_active":"2023-07-09T02:17:13.660285+0000","last_peered":"2023-07-09T02:17:13.660285+0000","last_clean":"2023-07-09T02:17:13.660285+0000","last_became_active":"2023-07-09T02:17:11.664691+0000","last_became_peered":"2023-07-09T02:17:11.664691+0000","last_unstale":"2023-07-09T02:17:13.660285+0000","last_undegraded":"2023-07-09T02:17:13.660285+0000","last_fullsized":"2023-07-09T02:17:13.660285+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:37:49.821157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517616+0000","last_change":"2023-07-09T02:17:12.678450+0000","last_active":"2023-07-09T02:17:14.517616+0000","last_peered":"2023-07-09T02:17:14.517616+0000","last_clean":"2023-07-09T02:17:14.517616+0000","last_became_active":"2023-07-09T02:17:12.677866+0000","last_became_peered":"2023-07-09T02:17:12.677866+0000","last_unstale":"2023-07-09T02:17:14.517616+0000","last_undegraded":"2023-07-09T02:17:14.517616+0000","last_fullsized":"2023-07-09T02:17:14.517616+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:16:48.939799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516361+0000","last_change":"2023-07-09T02:17:11.663126+0000","last_active":"2023-07-09T02:17:14.516361+0000","last_peered":"2023-07-09T02:17:14.516361+0000","last_clean":"2023-07-09T02:17:14.516361+0000","last_became_active":"2023-07-09T02:17:11.662905+0000","last_became_peered":"2023-07-09T02:17:11.662905+0000","last_unstale":"2023-07-09T02:17:14.516361+0000","last_undegraded":"2023-07-09T02:17:14.516361+0000","last_fullsized":"2023-07-09T02:17:14.516361+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:41:06.115003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595418+0000","last_change":"2023-07-09T02:17:12.668893+0000","last_active":"2023-07-09T02:17:14.595418+0000","last_peered":"2023-07-09T02:17:14.595418+0000","last_clean":"2023-07-09T02:17:14.595418+0000","last_became_active":"2023-07-09T02:17:12.668668+0000","last_became_peered":"2023-07-09T02:17:12.668668+0000","last_unstale":"2023-07-09T02:17:14.595418+0000","last_undegraded":"2023-07-09T02:17:14.595418+0000","last_fullsized":"2023-07-09T02:17:14.595418+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:22:45.169810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595666+0000","last_change":"2023-07-09T02:17:11.664569+0000","last_active":"2023-07-09T02:17:14.595666+0000","last_peered":"2023-07-09T02:17:14.595666+0000","last_clean":"2023-07-09T02:17:14.595666+0000","last_became_active":"2023-07-09T02:17:11.664189+0000","last_became_peered":"2023-07-09T02:17:11.664189+0000","last_unstale":"2023-07-09T02:17:14.595666+0000","last_undegraded":"2023-07-09T02:17:14.595666+0000","last_fullsized":"2023-07-09T02:17:14.595666+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:33:39.570011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660772+0000","last_change":"2023-07-09T02:17:12.678567+0000","last_active":"2023-07-09T02:17:13.660772+0000","last_peered":"2023-07-09T02:17:13.660772+0000","last_clean":"2023-07-09T02:17:13.660772+0000","last_became_active":"2023-07-09T02:17:12.678212+0000","last_became_peered":"2023-07-09T02:17:12.678212+0000","last_unstale":"2023-07-09T02:17:13.660772+0000","last_undegraded":"2023-07-09T02:17:13.660772+0000","last_fullsized":"2023-07-09T02:17:13.660772+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:15:06.970368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516855+0000","last_change":"2023-07-09T02:17:11.662575+0000","last_active":"2023-07-09T02:17:14.516855+0000","last_peered":"2023-07-09T02:17:14.516855+0000","last_clean":"2023-07-09T02:17:14.516855+0000","last_became_active":"2023-07-09T02:17:11.662357+0000","last_became_peered":"2023-07-09T02:17:11.662357+0000","last_unstale":"2023-07-09T02:17:14.516855+0000","last_undegraded":"2023-07-09T02:17:14.516855+0000","last_fullsized":"2023-07-09T02:17:14.516855+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:40:35.772607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660275+0000","last_change":"2023-07-09T02:17:12.670791+0000","last_active":"2023-07-09T02:17:13.660275+0000","last_peered":"2023-07-09T02:17:13.660275+0000","last_clean":"2023-07-09T02:17:13.660275+0000","last_became_active":"2023-07-09T02:17:12.670216+0000","last_became_peered":"2023-07-09T02:17:12.670216+0000","last_unstale":"2023-07-09T02:17:13.660275+0000","last_undegraded":"2023-07-09T02:17:13.660275+0000","last_fullsized":"2023-07-09T02:17:13.660275+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:23:34.274385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660716+0000","last_change":"2023-07-09T02:17:11.662340+0000","last_active":"2023-07-09T02:17:13.660716+0000","last_peered":"2023-07-09T02:17:13.660716+0000","last_clean":"2023-07-09T02:17:13.660716+0000","last_became_active":"2023-07-09T02:17:11.662127+0000","last_became_peered":"2023-07-09T02:17:11.662127+0000","last_unstale":"2023-07-09T02:17:13.660716+0000","last_undegraded":"2023-07-09T02:17:13.660716+0000","last_fullsized":"2023-07-09T02:17:13.660716+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:20:14.810474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516476+0000","last_change":"2023-07-09T02:17:12.667134+0000","last_active":"2023-07-09T02:17:14.516476+0000","last_peered":"2023-07-09T02:17:14.516476+0000","last_clean":"2023-07-09T02:17:14.516476+0000","last_became_active":"2023-07-09T02:17:12.666914+0000","last_became_peered":"2023-07-09T02:17:12.666914+0000","last_unstale":"2023-07-09T02:17:14.516476+0000","last_undegraded":"2023-07-09T02:17:14.516476+0000","last_fullsized":"2023-07-09T02:17:14.516476+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:51:38.844983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"122'3","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515682+0000","last_change":"2023-07-09T02:17:11.666230+0000","last_active":"2023-07-09T02:17:14.515682+0000","last_peered":"2023-07-09T02:17:14.515682+0000","last_clean":"2023-07-09T02:17:14.515682+0000","last_became_active":"2023-07-09T02:17:11.665992+0000","last_became_peered":"2023-07-09T02:17:11.665992+0000","last_unstale":"2023-07-09T02:17:14.515682+0000","last_undegraded":"2023-07-09T02:17:14.515682+0000","last_fullsized":"2023-07-09T02:17:14.515682+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:33:58.914274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659675+0000","last_change":"2023-07-09T02:17:12.670794+0000","last_active":"2023-07-09T02:17:13.659675+0000","last_peered":"2023-07-09T02:17:13.659675+0000","last_clean":"2023-07-09T02:17:13.659675+0000","last_became_active":"2023-07-09T02:17:12.670281+0000","last_became_peered":"2023-07-09T02:17:12.670281+0000","last_unstale":"2023-07-09T02:17:13.659675+0000","last_undegraded":"2023-07-09T02:17:13.659675+0000","last_fullsized":"2023-07-09T02:17:13.659675+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:37:33.229833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"122'6","reported_seq":19,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516238+0000","last_change":"2023-07-09T02:17:11.665381+0000","last_active":"2023-07-09T02:17:14.516238+0000","last_peered":"2023-07-09T02:17:14.516238+0000","last_clean":"2023-07-09T02:17:14.516238+0000","last_became_active":"2023-07-09T02:17:11.663537+0000","last_became_peered":"2023-07-09T02:17:11.663537+0000","last_unstale":"2023-07-09T02:17:14.516238+0000","last_undegraded":"2023-07-09T02:17:14.516238+0000","last_fullsized":"2023-07-09T02:17:14.516238+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:23:21.142253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659727+0000","last_change":"2023-07-09T02:17:12.661506+0000","last_active":"2023-07-09T02:17:13.659727+0000","last_peered":"2023-07-09T02:17:13.659727+0000","last_clean":"2023-07-09T02:17:13.659727+0000","last_became_active":"2023-07-09T02:17:12.661127+0000","last_became_peered":"2023-07-09T02:17:12.661127+0000","last_unstale":"2023-07-09T02:17:13.659727+0000","last_undegraded":"2023-07-09T02:17:13.659727+0000","last_fullsized":"2023-07-09T02:17:13.659727+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:42:41.692130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660451+0000","last_change":"2023-07-09T02:17:11.669001+0000","last_active":"2023-07-09T02:17:13.660451+0000","last_peered":"2023-07-09T02:17:13.660451+0000","last_clean":"2023-07-09T02:17:13.660451+0000","last_became_active":"2023-07-09T02:17:11.667711+0000","last_became_peered":"2023-07-09T02:17:11.667711+0000","last_unstale":"2023-07-09T02:17:13.660451+0000","last_undegraded":"2023-07-09T02:17:13.660451+0000","last_fullsized":"2023-07-09T02:17:13.660451+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:18:05.326953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517498+0000","last_change":"2023-07-09T02:17:12.674791+0000","last_active":"2023-07-09T02:17:14.517498+0000","last_peered":"2023-07-09T02:17:14.517498+0000","last_clean":"2023-07-09T02:17:14.517498+0000","last_became_active":"2023-07-09T02:17:12.674130+0000","last_became_peered":"2023-07-09T02:17:12.674130+0000","last_unstale":"2023-07-09T02:17:14.517498+0000","last_undegraded":"2023-07-09T02:17:14.517498+0000","last_fullsized":"2023-07-09T02:17:14.517498+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:33:07.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595571+0000","last_change":"2023-07-09T02:17:11.665057+0000","last_active":"2023-07-09T02:17:14.595571+0000","last_peered":"2023-07-09T02:17:14.595571+0000","last_clean":"2023-07-09T02:17:14.595571+0000","last_became_active":"2023-07-09T02:17:11.664828+0000","last_became_peered":"2023-07-09T02:17:11.664828+0000","last_unstale":"2023-07-09T02:17:14.595571+0000","last_undegraded":"2023-07-09T02:17:14.595571+0000","last_fullsized":"2023-07-09T02:17:14.595571+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:21:12.470949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516730+0000","last_change":"2023-07-09T02:17:12.677519+0000","last_active":"2023-07-09T02:17:14.516730+0000","last_peered":"2023-07-09T02:17:14.516730+0000","last_clean":"2023-07-09T02:17:14.516730+0000","last_became_active":"2023-07-09T02:17:12.677309+0000","last_became_peered":"2023-07-09T02:17:12.677309+0000","last_unstale":"2023-07-09T02:17:14.516730+0000","last_undegraded":"2023-07-09T02:17:14.516730+0000","last_fullsized":"2023-07-09T02:17:14.516730+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:14:49.176933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516832+0000","last_change":"2023-07-09T02:17:11.667663+0000","last_active":"2023-07-09T02:17:14.516832+0000","last_peered":"2023-07-09T02:17:14.516832+0000","last_clean":"2023-07-09T02:17:14.516832+0000","last_became_active":"2023-07-09T02:17:11.667293+0000","last_became_peered":"2023-07-09T02:17:11.667293+0000","last_unstale":"2023-07-09T02:17:14.516832+0000","last_undegraded":"2023-07-09T02:17:14.516832+0000","last_fullsized":"2023-07-09T02:17:14.516832+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:52:27.862682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660595+0000","last_change":"2023-07-09T02:17:12.666173+0000","last_active":"2023-07-09T02:17:13.660595+0000","last_peered":"2023-07-09T02:17:13.660595+0000","last_clean":"2023-07-09T02:17:13.660595+0000","last_became_active":"2023-07-09T02:17:12.665907+0000","last_became_peered":"2023-07-09T02:17:12.665907+0000","last_unstale":"2023-07-09T02:17:13.660595+0000","last_undegraded":"2023-07-09T02:17:13.660595+0000","last_fullsized":"2023-07-09T02:17:13.660595+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:29:08.830066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"122'8","reported_seq":21,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515991+0000","last_change":"2023-07-09T02:17:11.662089+0000","last_active":"2023-07-09T02:17:14.515991+0000","last_peered":"2023-07-09T02:17:14.515991+0000","last_clean":"2023-07-09T02:17:14.515991+0000","last_became_active":"2023-07-09T02:17:11.661857+0000","last_became_peered":"2023-07-09T02:17:11.661857+0000","last_unstale":"2023-07-09T02:17:14.515991+0000","last_undegraded":"2023-07-09T02:17:14.515991+0000","last_fullsized":"2023-07-09T02:17:14.515991+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:19:38.428634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660862+0000","last_change":"2023-07-09T02:17:12.667157+0000","last_active":"2023-07-09T02:17:13.660862+0000","last_peered":"2023-07-09T02:17:13.660862+0000","last_clean":"2023-07-09T02:17:13.660862+0000","last_became_active":"2023-07-09T02:17:12.666934+0000","last_became_peered":"2023-07-09T02:17:12.666934+0000","last_unstale":"2023-07-09T02:17:13.660862+0000","last_undegraded":"2023-07-09T02:17:13.660862+0000","last_fullsized":"2023-07-09T02:17:13.660862+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:09:25.792254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659996+0000","last_change":"2023-07-09T02:17:11.663187+0000","last_active":"2023-07-09T02:17:13.659996+0000","last_peered":"2023-07-09T02:17:13.659996+0000","last_clean":"2023-07-09T02:17:13.659996+0000","last_became_active":"2023-07-09T02:17:11.662885+0000","last_became_peered":"2023-07-09T02:17:11.662885+0000","last_unstale":"2023-07-09T02:17:13.659996+0000","last_undegraded":"2023-07-09T02:17:13.659996+0000","last_fullsized":"2023-07-09T02:17:13.659996+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:11:09.469291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516231+0000","last_change":"2023-07-09T02:17:12.670749+0000","last_active":"2023-07-09T02:17:14.516231+0000","last_peered":"2023-07-09T02:17:14.516231+0000","last_clean":"2023-07-09T02:17:14.516231+0000","last_became_active":"2023-07-09T02:17:12.670451+0000","last_became_peered":"2023-07-09T02:17:12.670451+0000","last_unstale":"2023-07-09T02:17:14.516231+0000","last_undegraded":"2023-07-09T02:17:14.516231+0000","last_fullsized":"2023-07-09T02:17:14.516231+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:27:07.720383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.661187+0000","last_change":"2023-07-09T02:17:11.659441+0000","last_active":"2023-07-09T02:17:13.661187+0000","last_peered":"2023-07-09T02:17:13.661187+0000","last_clean":"2023-07-09T02:17:13.661187+0000","last_became_active":"2023-07-09T02:17:11.659220+0000","last_became_peered":"2023-07-09T02:17:11.659220+0000","last_unstale":"2023-07-09T02:17:13.661187+0000","last_undegraded":"2023-07-09T02:17:13.661187+0000","last_fullsized":"2023-07-09T02:17:13.661187+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:31:38.875529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595471+0000","last_change":"2023-07-09T02:17:12.676293+0000","last_active":"2023-07-09T02:17:14.595471+0000","last_peered":"2023-07-09T02:17:14.595471+0000","last_clean":"2023-07-09T02:17:14.595471+0000","last_became_active":"2023-07-09T02:17:12.676055+0000","last_became_peered":"2023-07-09T02:17:12.676055+0000","last_unstale":"2023-07-09T02:17:14.595471+0000","last_undegraded":"2023-07-09T02:17:14.595471+0000","last_fullsized":"2023-07-09T02:17:14.595471+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:54:49.285406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516628+0000","last_change":"2023-07-09T02:17:11.666247+0000","last_active":"2023-07-09T02:17:14.516628+0000","last_peered":"2023-07-09T02:17:14.516628+0000","last_clean":"2023-07-09T02:17:14.516628+0000","last_became_active":"2023-07-09T02:17:11.665644+0000","last_became_peered":"2023-07-09T02:17:11.665644+0000","last_unstale":"2023-07-09T02:17:14.516628+0000","last_undegraded":"2023-07-09T02:17:14.516628+0000","last_fullsized":"2023-07-09T02:17:14.516628+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:55:41.968542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659937+0000","last_change":"2023-07-09T02:17:12.665320+0000","last_active":"2023-07-09T02:17:13.659937+0000","last_peered":"2023-07-09T02:17:13.659937+0000","last_clean":"2023-07-09T02:17:13.659937+0000","last_became_active":"2023-07-09T02:17:12.665028+0000","last_became_peered":"2023-07-09T02:17:12.665028+0000","last_unstale":"2023-07-09T02:17:13.659937+0000","last_undegraded":"2023-07-09T02:17:13.659937+0000","last_fullsized":"2023-07-09T02:17:13.659937+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:08:14.510151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660559+0000","last_change":"2023-07-09T02:17:11.664024+0000","last_active":"2023-07-09T02:17:13.660559+0000","last_peered":"2023-07-09T02:17:13.660559+0000","last_clean":"2023-07-09T02:17:13.660559+0000","last_became_active":"2023-07-09T02:17:11.663769+0000","last_became_peered":"2023-07-09T02:17:11.663769+0000","last_unstale":"2023-07-09T02:17:13.660559+0000","last_undegraded":"2023-07-09T02:17:13.660559+0000","last_fullsized":"2023-07-09T02:17:13.660559+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:49:16.227526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516569+0000","last_change":"2023-07-09T02:17:12.665079+0000","last_active":"2023-07-09T02:17:14.516569+0000","last_peered":"2023-07-09T02:17:14.516569+0000","last_clean":"2023-07-09T02:17:14.516569+0000","last_became_active":"2023-07-09T02:17:12.664724+0000","last_became_peered":"2023-07-09T02:17:12.664724+0000","last_unstale":"2023-07-09T02:17:14.516569+0000","last_undegraded":"2023-07-09T02:17:14.516569+0000","last_fullsized":"2023-07-09T02:17:14.516569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:02:12.329281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516959+0000","last_change":"2023-07-09T02:17:11.666458+0000","last_active":"2023-07-09T02:17:14.516959+0000","last_peered":"2023-07-09T02:17:14.516959+0000","last_clean":"2023-07-09T02:17:14.516959+0000","last_became_active":"2023-07-09T02:17:11.666245+0000","last_became_peered":"2023-07-09T02:17:11.666245+0000","last_unstale":"2023-07-09T02:17:14.516959+0000","last_undegraded":"2023-07-09T02:17:14.516959+0000","last_fullsized":"2023-07-09T02:17:14.516959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:14:40.111751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516625+0000","last_change":"2023-07-09T02:17:12.670415+0000","last_active":"2023-07-09T02:17:14.516625+0000","last_peered":"2023-07-09T02:17:14.516625+0000","last_clean":"2023-07-09T02:17:14.516625+0000","last_became_active":"2023-07-09T02:17:12.670196+0000","last_became_peered":"2023-07-09T02:17:12.670196+0000","last_unstale":"2023-07-09T02:17:14.516625+0000","last_undegraded":"2023-07-09T02:17:14.516625+0000","last_fullsized":"2023-07-09T02:17:14.516625+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:05:49.966426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516978+0000","last_change":"2023-07-09T02:17:11.667516+0000","last_active":"2023-07-09T02:17:14.516978+0000","last_peered":"2023-07-09T02:17:14.516978+0000","last_clean":"2023-07-09T02:17:14.516978+0000","last_became_active":"2023-07-09T02:17:11.666989+0000","last_became_peered":"2023-07-09T02:17:11.666989+0000","last_unstale":"2023-07-09T02:17:14.516978+0000","last_undegraded":"2023-07-09T02:17:14.516978+0000","last_fullsized":"2023-07-09T02:17:14.516978+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:56:33.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516089+0000","last_change":"2023-07-09T02:17:12.671911+0000","last_active":"2023-07-09T02:17:14.516089+0000","last_peered":"2023-07-09T02:17:14.516089+0000","last_clean":"2023-07-09T02:17:14.516089+0000","last_became_active":"2023-07-09T02:17:12.671552+0000","last_became_peered":"2023-07-09T02:17:12.671552+0000","last_unstale":"2023-07-09T02:17:14.516089+0000","last_undegraded":"2023-07-09T02:17:14.516089+0000","last_fullsized":"2023-07-09T02:17:14.516089+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:01:00.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517681+0000","last_change":"2023-07-09T02:17:11.667656+0000","last_active":"2023-07-09T02:17:14.517681+0000","last_peered":"2023-07-09T02:17:14.517681+0000","last_clean":"2023-07-09T02:17:14.517681+0000","last_became_active":"2023-07-09T02:17:11.667122+0000","last_became_peered":"2023-07-09T02:17:11.667122+0000","last_unstale":"2023-07-09T02:17:14.517681+0000","last_undegraded":"2023-07-09T02:17:14.517681+0000","last_fullsized":"2023-07-09T02:17:14.517681+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:48:53.862944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659798+0000","last_change":"2023-07-09T02:17:12.668663+0000","last_active":"2023-07-09T02:17:13.659798+0000","last_peered":"2023-07-09T02:17:13.659798+0000","last_clean":"2023-07-09T02:17:13.659798+0000","last_became_active":"2023-07-09T02:17:12.668064+0000","last_became_peered":"2023-07-09T02:17:12.668064+0000","last_unstale":"2023-07-09T02:17:13.659798+0000","last_undegraded":"2023-07-09T02:17:13.659798+0000","last_fullsized":"2023-07-09T02:17:13.659798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:37:59.345133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516812+0000","last_change":"2023-07-09T02:17:11.667139+0000","last_active":"2023-07-09T02:17:14.516812+0000","last_peered":"2023-07-09T02:17:14.516812+0000","last_clean":"2023-07-09T02:17:14.516812+0000","last_became_active":"2023-07-09T02:17:11.666690+0000","last_became_peered":"2023-07-09T02:17:11.666690+0000","last_unstale":"2023-07-09T02:17:14.516812+0000","last_undegraded":"2023-07-09T02:17:14.516812+0000","last_fullsized":"2023-07-09T02:17:14.516812+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:36:11.382075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659584+0000","last_change":"2023-07-09T02:17:12.661356+0000","last_active":"2023-07-09T02:17:13.659584+0000","last_peered":"2023-07-09T02:17:13.659584+0000","last_clean":"2023-07-09T02:17:13.659584+0000","last_became_active":"2023-07-09T02:17:12.660884+0000","last_became_peered":"2023-07-09T02:17:12.660884+0000","last_unstale":"2023-07-09T02:17:13.659584+0000","last_undegraded":"2023-07-09T02:17:13.659584+0000","last_fullsized":"2023-07-09T02:17:13.659584+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:15:08.537418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516887+0000","last_change":"2023-07-09T02:17:11.661122+0000","last_active":"2023-07-09T02:17:14.516887+0000","last_peered":"2023-07-09T02:17:14.516887+0000","last_clean":"2023-07-09T02:17:14.516887+0000","last_became_active":"2023-07-09T02:17:11.660851+0000","last_became_peered":"2023-07-09T02:17:11.660851+0000","last_unstale":"2023-07-09T02:17:14.516887+0000","last_undegraded":"2023-07-09T02:17:14.516887+0000","last_fullsized":"2023-07-09T02:17:14.516887+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:47:50.914387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":346,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516176+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:17:14.516176+0000","last_peered":"2023-07-09T02:17:14.516176+0000","last_clean":"2023-07-09T02:17:14.516176+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:17:14.516176+0000","last_undegraded":"2023-07-09T02:17:14.516176+0000","last_fullsized":"2023-07-09T02:17:14.516176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:21:49.491179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":213,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.659869+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:17:13.659869+0000","last_peered":"2023-07-09T02:17:13.659869+0000","last_clean":"2023-07-09T02:17:13.659869+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:17:13.659869+0000","last_undegraded":"2023-07-09T02:17:13.659869+0000","last_fullsized":"2023-07-09T02:17:13.659869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:02:46.832591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517252+0000","last_change":"2023-07-09T02:17:12.676098+0000","last_active":"2023-07-09T02:17:14.517252+0000","last_peered":"2023-07-09T02:17:14.517252+0000","last_clean":"2023-07-09T02:17:14.517252+0000","last_became_active":"2023-07-09T02:17:12.675273+0000","last_became_peered":"2023-07-09T02:17:12.675273+0000","last_unstale":"2023-07-09T02:17:14.517252+0000","last_undegraded":"2023-07-09T02:17:14.517252+0000","last_fullsized":"2023-07-09T02:17:14.517252+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:22:51.574164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516230+0000","last_change":"2023-07-09T02:17:11.666704+0000","last_active":"2023-07-09T02:17:14.516230+0000","last_peered":"2023-07-09T02:17:14.516230+0000","last_clean":"2023-07-09T02:17:14.516230+0000","last_became_active":"2023-07-09T02:17:11.666490+0000","last_became_peered":"2023-07-09T02:17:11.666490+0000","last_unstale":"2023-07-09T02:17:14.516230+0000","last_undegraded":"2023-07-09T02:17:14.516230+0000","last_fullsized":"2023-07-09T02:17:14.516230+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:23:21.567466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515956+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:17:14.515956+0000","last_peered":"2023-07-09T02:17:14.515956+0000","last_clean":"2023-07-09T02:17:14.515956+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:17:14.515956+0000","last_undegraded":"2023-07-09T02:17:14.515956+0000","last_fullsized":"2023-07-09T02:17:14.515956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:37:27.274144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660040+0000","last_change":"2023-07-09T02:17:12.669866+0000","last_active":"2023-07-09T02:17:13.660040+0000","last_peered":"2023-07-09T02:17:13.660040+0000","last_clean":"2023-07-09T02:17:13.660040+0000","last_became_active":"2023-07-09T02:17:12.669579+0000","last_became_peered":"2023-07-09T02:17:12.669579+0000","last_unstale":"2023-07-09T02:17:13.660040+0000","last_undegraded":"2023-07-09T02:17:13.660040+0000","last_fullsized":"2023-07-09T02:17:13.660040+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:13:22.736126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660045+0000","last_change":"2023-07-09T02:17:11.664681+0000","last_active":"2023-07-09T02:17:13.660045+0000","last_peered":"2023-07-09T02:17:13.660045+0000","last_clean":"2023-07-09T02:17:13.660045+0000","last_became_active":"2023-07-09T02:17:11.663214+0000","last_became_peered":"2023-07-09T02:17:11.663214+0000","last_unstale":"2023-07-09T02:17:13.660045+0000","last_undegraded":"2023-07-09T02:17:13.660045+0000","last_fullsized":"2023-07-09T02:17:13.660045+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:21:27.860364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":191,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517112+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:17:14.517112+0000","last_peered":"2023-07-09T02:17:14.517112+0000","last_clean":"2023-07-09T02:17:14.517112+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:17:14.517112+0000","last_undegraded":"2023-07-09T02:17:14.517112+0000","last_fullsized":"2023-07-09T02:17:14.517112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:26:28.876156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516712+0000","last_change":"2023-07-09T02:17:12.664650+0000","last_active":"2023-07-09T02:17:14.516712+0000","last_peered":"2023-07-09T02:17:14.516712+0000","last_clean":"2023-07-09T02:17:14.516712+0000","last_became_active":"2023-07-09T02:17:12.663982+0000","last_became_peered":"2023-07-09T02:17:12.663982+0000","last_unstale":"2023-07-09T02:17:14.516712+0000","last_undegraded":"2023-07-09T02:17:14.516712+0000","last_fullsized":"2023-07-09T02:17:14.516712+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:44:10.594764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516508+0000","last_change":"2023-07-09T02:17:11.666048+0000","last_active":"2023-07-09T02:17:14.516508+0000","last_peered":"2023-07-09T02:17:14.516508+0000","last_clean":"2023-07-09T02:17:14.516508+0000","last_became_active":"2023-07-09T02:17:11.663868+0000","last_became_peered":"2023-07-09T02:17:11.663868+0000","last_unstale":"2023-07-09T02:17:14.516508+0000","last_undegraded":"2023-07-09T02:17:14.516508+0000","last_fullsized":"2023-07-09T02:17:14.516508+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:46:34.717646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":213,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660120+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:17:13.660120+0000","last_peered":"2023-07-09T02:17:13.660120+0000","last_clean":"2023-07-09T02:17:13.660120+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:17:13.660120+0000","last_undegraded":"2023-07-09T02:17:13.660120+0000","last_fullsized":"2023-07-09T02:17:13.660120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:30:31.545329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.595221+0000","last_change":"2023-07-09T02:17:12.676401+0000","last_active":"2023-07-09T02:17:14.595221+0000","last_peered":"2023-07-09T02:17:14.595221+0000","last_clean":"2023-07-09T02:17:14.595221+0000","last_became_active":"2023-07-09T02:17:12.676159+0000","last_became_peered":"2023-07-09T02:17:12.676159+0000","last_unstale":"2023-07-09T02:17:14.595221+0000","last_undegraded":"2023-07-09T02:17:14.595221+0000","last_fullsized":"2023-07-09T02:17:14.595221+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:25:15.695623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516836+0000","last_change":"2023-07-09T02:17:11.664964+0000","last_active":"2023-07-09T02:17:14.516836+0000","last_peered":"2023-07-09T02:17:14.516836+0000","last_clean":"2023-07-09T02:17:14.516836+0000","last_became_active":"2023-07-09T02:17:11.664735+0000","last_became_peered":"2023-07-09T02:17:11.664735+0000","last_unstale":"2023-07-09T02:17:14.516836+0000","last_undegraded":"2023-07-09T02:17:14.516836+0000","last_fullsized":"2023-07-09T02:17:14.516836+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:46:20.575550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660686+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:17:13.660686+0000","last_peered":"2023-07-09T02:17:13.660686+0000","last_clean":"2023-07-09T02:17:13.660686+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:17:13.660686+0000","last_undegraded":"2023-07-09T02:17:13.660686+0000","last_fullsized":"2023-07-09T02:17:13.660686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:04.043472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516972+0000","last_change":"2023-07-09T02:17:12.664942+0000","last_active":"2023-07-09T02:17:14.516972+0000","last_peered":"2023-07-09T02:17:14.516972+0000","last_clean":"2023-07-09T02:17:14.516972+0000","last_became_active":"2023-07-09T02:17:12.664418+0000","last_became_peered":"2023-07-09T02:17:12.664418+0000","last_unstale":"2023-07-09T02:17:14.516972+0000","last_undegraded":"2023-07-09T02:17:14.516972+0000","last_fullsized":"2023-07-09T02:17:14.516972+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:17:50.421469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517096+0000","last_change":"2023-07-09T02:17:11.660979+0000","last_active":"2023-07-09T02:17:14.517096+0000","last_peered":"2023-07-09T02:17:14.517096+0000","last_clean":"2023-07-09T02:17:14.517096+0000","last_became_active":"2023-07-09T02:17:11.660744+0000","last_became_peered":"2023-07-09T02:17:11.660744+0000","last_unstale":"2023-07-09T02:17:14.517096+0000","last_undegraded":"2023-07-09T02:17:14.517096+0000","last_fullsized":"2023-07-09T02:17:14.517096+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:12:06.028472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.515816+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:17:14.515816+0000","last_peered":"2023-07-09T02:17:14.515816+0000","last_clean":"2023-07-09T02:17:14.515816+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:17:14.515816+0000","last_undegraded":"2023-07-09T02:17:14.515816+0000","last_fullsized":"2023-07-09T02:17:14.515816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:19:39.070474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660462+0000","last_change":"2023-07-09T02:17:12.667521+0000","last_active":"2023-07-09T02:17:13.660462+0000","last_peered":"2023-07-09T02:17:13.660462+0000","last_clean":"2023-07-09T02:17:13.660462+0000","last_became_active":"2023-07-09T02:17:12.666919+0000","last_became_peered":"2023-07-09T02:17:12.666919+0000","last_unstale":"2023-07-09T02:17:13.660462+0000","last_undegraded":"2023-07-09T02:17:13.660462+0000","last_fullsized":"2023-07-09T02:17:13.660462+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:57:20.998323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.517028+0000","last_change":"2023-07-09T02:17:11.657908+0000","last_active":"2023-07-09T02:17:14.517028+0000","last_peered":"2023-07-09T02:17:14.517028+0000","last_clean":"2023-07-09T02:17:14.517028+0000","last_became_active":"2023-07-09T02:17:11.657678+0000","last_became_peered":"2023-07-09T02:17:11.657678+0000","last_unstale":"2023-07-09T02:17:14.517028+0000","last_undegraded":"2023-07-09T02:17:14.517028+0000","last_fullsized":"2023-07-09T02:17:14.517028+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:30:17.641971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.660161+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:17:13.660161+0000","last_peered":"2023-07-09T02:17:13.660161+0000","last_clean":"2023-07-09T02:17:13.660161+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:17:13.660161+0000","last_undegraded":"2023-07-09T02:17:13.660161+0000","last_fullsized":"2023-07-09T02:17:13.660161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:25:57.583194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:13.661100+0000","last_change":"2023-07-09T02:17:12.667030+0000","last_active":"2023-07-09T02:17:13.661100+0000","last_peered":"2023-07-09T02:17:13.661100+0000","last_clean":"2023-07-09T02:17:13.661100+0000","last_became_active":"2023-07-09T02:17:12.666719+0000","last_became_peered":"2023-07-09T02:17:12.666719+0000","last_unstale":"2023-07-09T02:17:13.661100+0000","last_undegraded":"2023-07-09T02:17:13.661100+0000","last_fullsized":"2023-07-09T02:17:13.661100+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:11.644888+0000","last_clean_scrub_stamp":"2023-07-09T02:17:11.644888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:01:01.521381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516705+0000","last_change":"2023-07-09T02:17:11.659289+0000","last_active":"2023-07-09T02:17:14.516705+0000","last_peered":"2023-07-09T02:17:14.516705+0000","last_clean":"2023-07-09T02:17:14.516705+0000","last_became_active":"2023-07-09T02:17:11.659049+0000","last_became_peered":"2023-07-09T02:17:11.659049+0000","last_unstale":"2023-07-09T02:17:14.516705+0000","last_undegraded":"2023-07-09T02:17:14.516705+0000","last_fullsized":"2023-07-09T02:17:14.516705+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:10.637544+0000","last_clean_scrub_stamp":"2023-07-09T02:17:10.637544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:11:10.751041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-09T02:17:14.516751+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:17:14.516751+0000","last_peered":"2023-07-09T02:17:14.516751+0000","last_clean":"2023-07-09T02:17:14.516751+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:17:14.516751+0000","last_undegraded":"2023-07-09T02:17:14.516751+0000","last_fullsized":"2023-07-09T02:17:14.516751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:02:09.608391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1282,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194030,"statfs":{"total":200000000,"available":198686923,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72599999999999998,"15min":0.746},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.204,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.004,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":1.423,"15min":1.423},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.032,"15min":0.80000000000000004},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.117,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.89000000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.028,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.97899999999999998,"15min":0.80900000000000005},"min":{"1min":0.437,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93999999999999995,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.67900000000000005},"min":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94799999999999995,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84199999999999997,"15min":0.77800000000000002},"min":{"1min":0.54100000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.242,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.68000000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.60699999999999998,"15min":0.60799999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91100000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.47199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78600000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.622},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.38700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.94999999999999996,"5min":1.048,"15min":1.048},"last":0.85099999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.87,"5min":1.087,"15min":1.087},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.87}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194604,"statfs":{"total":200000000,"available":199275283,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.55200000000000005,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.78300000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.92200000000000004,"15min":1.4379999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90700000000000003,"15min":1.165},"last":0.76800000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.59499999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.90400000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.70999999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.5,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.88400000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.998,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":1.117,"15min":1.117},"last":0.86099999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89900000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.752}]}]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.63900000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86899999999999999,"5min":1.179,"15min":1.179},"last":0.58999999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.65700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68899999999999995,"15min":0.65600000000000003},"min":{"1min":0.58099999999999996,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65700000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":0.81000000000000005,"5min":1.103,"15min":1.103},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.56799999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.77800000000000002,"15min":0.71499999999999997},"min":{"1min":0.54400000000000004,"5min":0.50600000000000001,"15min":0.47399999999999998},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.49399999999999999,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":1.008,"15min":1.008},"last":0.751},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63,"15min":0.61399999999999999},"min":{"1min":0.51900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91900000000000004,"5min":1.054,"15min":1.054},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.85399999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.755},"min":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.48599999999999999},"max":{"1min":0.95099999999999996,"5min":1.091,"15min":1.091},"last":0.95099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277359,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":1.2529999999999999,"15min":0.85499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.89000000000000001,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65800000000000003,"15min":0.67400000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.873,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84199999999999997,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.66000000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90000000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.008,"5min":1.323,"15min":1.323},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90600000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":1.518,"15min":0.94399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85899999999999999,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.62}]},{"osd":5,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.94699999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61499999999999999,"15min":0.64700000000000002},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.85599999999999998,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.68000000000000005,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80500000000000005,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.70699999999999996},"min":{"1min":0.45200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93899999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78200000000000003,"15min":0.71599999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92700000000000005,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199276869,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42199999999999999},"min":{"1min":0.26400000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.65900000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.198,"15min":1.198},"last":0.55000000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.311,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57399999999999995,"5min":1.048,"15min":1.048},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.38700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52800000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68600000000000005,"5min":1.155,"15min":1.155},"last":0.5},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.56499999999999995},"min":{"1min":0.46800000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0229999999999999,"5min":1.302,"15min":1.302},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75600000000000001,"15min":0.70599999999999996},"min":{"1min":0.56599999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.006,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.71899999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0940000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.748},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97799999999999998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.56000000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0569999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80900000000000005,"15min":0.81299999999999994},"min":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.228,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.58099999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1359999999999999,"5min":1.367,"15min":1.367},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.76900000000000002},"min":{"1min":0.67400000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95299999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.52200000000000002,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69399999999999995,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.43099999999999999},"min":{"1min":0.35399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":1.127,"15min":1.127},"last":0.66400000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47599999999999998,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58299999999999996,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.52400000000000002},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71199999999999997,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.5},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.57899999999999996,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58099999999999996,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.54900000000000004}]},{"osd":4,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.81499999999999995,"15min":0.753},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.46500000000000002},"max":{"1min":0.998,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77000000000000002,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":1.089}]},{"osd":5,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.52500000000000002,"5min":0.499,"15min":0.496},"max":{"1min":1.052,"5min":1.1799999999999999,"15min":1.319},"last":1.052},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.99,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.92400000000000004}]},{"osd":6,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80700000000000005,"15min":0.77100000000000002},"min":{"1min":0.56599999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0329999999999999,"5min":1.452,"15min":1.452},"last":0.95099999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.72399999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":1.206,"15min":1.351},"last":0.90500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":705,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194606,"statfs":{"total":200000000,"available":199277417,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.72499999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.379},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.46200000000000002},"min":{"1min":0.308,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.307}]},{"osd":2,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.501,"15min":0.496},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68600000000000005,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.495}]},{"osd":3,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73099999999999998,"5min":1.163,"15min":1.163},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96399999999999997,"5min":1.026,"15min":1.026},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.74299999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.745,"15min":0.72699999999999998},"min":{"1min":0.53400000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.51900000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95999999999999996,"5min":1.034,"15min":1.034},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.80000000000000004,"15min":0.78100000000000003},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0900000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78000000000000003,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0229999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98199999999999998,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1283,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194028,"statfs":{"total":200000000,"available":198685429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.436,"15min":0.41699999999999998},"min":{"1min":0.26300000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.627,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.501,"5min":0.503,"15min":0.46700000000000003},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0169999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.59299999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47299999999999998,"15min":0.443},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.443,"15min":0.41499999999999998},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.60599999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.53900000000000003,"15min":0.502},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.626,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.89200000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.145,"15min":1.145},"last":1.038},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.153,"15min":1.153},"last":0.85399999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0669999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.504,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.238,"15min":1.238},"last":1.0680000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.70799999999999996},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93899999999999995,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.53800000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0389999999999999,"5min":1.472,"15min":1.472},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54700000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98299999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.97699999999999998}]}]}],"pool_statfs":[]}} 2023-07-09T02:17:17.162 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:17:17.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:17:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f30557ac640 1 Processor -- start 2023-07-09T02:17:17.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f30557ac640 1 -- start start 2023-07-09T02:17:17.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f30557ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f305015c410 0x7f30501608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f30557ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f30500b59b0 0x7f30500b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f30557ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500ced10 con 0x7f30500d2340 2023-07-09T02:17:17.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f30557ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305015c7e0 con 0x7f305015c410 2023-07-09T02:17:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f30557ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30500cd1b0 con 0x7f30500b59b0 2023-07-09T02:17:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f304effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f305015c410 0x7f30501608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f304f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f30500d2340 0x7f30500d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37060/0 (socket says 172.21.15.45:37060) 2023-07-09T02:17:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f304f7fe640 1 -- 172.21.15.45:0/3057363950 learned_addr learned my addr 172.21.15.45:0/3057363950 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f3047fff640 1 --2- 172.21.15.45:0/3057363950 >> v2:172.21.15.155:3300/0 conn(0x7f30500b59b0 0x7f30500b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f304effd640 1 -- 172.21.15.45:0/3057363950 >> v2:172.21.15.155:3300/0 conn(0x7f30500b59b0 msgr2=0x7f30500b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f304effd640 1 --2- 172.21.15.45:0/3057363950 >> v2:172.21.15.155:3300/0 conn(0x7f30500b59b0 0x7f30500b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f304effd640 1 -- 172.21.15.45:0/3057363950 >> v1:172.21.15.45:6789/0 conn(0x7f30500d2340 legacy=0x7f30500d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f304effd640 1 -- 172.21.15.45:0/3057363950 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050160de0 con 0x7f305015c410 2023-07-09T02:17:17.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.348+0000 7f304e7fc640 1 -- 172.21.15.45:0/3057363950 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742447468 0 0) 0x7f30500ced10 con 0x7f30500d2340 2023-07-09T02:17:17.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f304effd640 1 --2- 172.21.15.45:0/3057363950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30501608a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f30400097c0 tx=0x7f304001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae323b9c0f45540 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:17.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f304e7fc640 1 -- 172.21.15.45:0/3057363950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30400ab600 con 0x7f305015c410 2023-07-09T02:17:17.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f304e7fc640 1 -- 172.21.15.45:0/3057363950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30400a7050 con 0x7f305015c410 2023-07-09T02:17:17.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f304e7fc640 1 -- 172.21.15.45:0/3057363950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30400ab980 con 0x7f305015c410 2023-07-09T02:17:17.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 -- 172.21.15.45:0/3057363950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 msgr2=0x7f30501608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 --2- 172.21.15.45:0/3057363950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30501608a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f30400097c0 tx=0x7f304001c410 comp rx=0 tx=0).stop 2023-07-09T02:17:17.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 -- 172.21.15.45:0/3057363950 shutdown_connections 2023-07-09T02:17:17.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 --2- 172.21.15.45:0/3057363950 >> v2:172.21.15.155:3300/0 conn(0x7f30500b59b0 0x7f30500b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 --2- 172.21.15.45:0/3057363950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30501608a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 -- 172.21.15.45:0/3057363950 >> 172.21.15.45:0/3057363950 conn(0x7f305006a590 msgr2=0x7f30500cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:17.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 -- 172.21.15.45:0/3057363950 shutdown_connections 2023-07-09T02:17:17.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 -- 172.21.15.45:0/3057363950 wait complete. 2023-07-09T02:17:17.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 Processor -- start 2023-07-09T02:17:17.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.352+0000 7f30557ac640 1 -- start start 2023-07-09T02:17:17.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30500b59b0 0x7f30500cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30500d2340 0x7f3050148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30500b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050148580 con 0x7f305015c410 2023-07-09T02:17:17.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30500cbd70 con 0x7f30500d2340 2023-07-09T02:17:17.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305015b950 con 0x7f30500b59b0 2023-07-09T02:17:17.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30500b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30500b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60642/0 (socket says 172.21.15.45:60642) 2023-07-09T02:17:17.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 -- 172.21.15.45:0/2138934121 learned_addr learned my addr 172.21.15.45:0/2138934121 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:17.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f3047fff640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30500d2340 0x7f3050148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304effd640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30500b59b0 0x7f30500cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 -- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30500b59b0 msgr2=0x7f30500cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30500b59b0 0x7f30500cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 -- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30500d2340 msgr2=0x7f3050148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30500d2340 0x7f3050148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 -- 172.21.15.45:0/2138934121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040009420 con 0x7f305015c410 2023-07-09T02:17:17.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f3047fff640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30500d2340 0x7f3050148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:17.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f304f7fe640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30500b6430 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f304800c700 tx=0x7f304800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30477fe640 1 -- 172.21.15.45:0/2138934121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800ce10 con 0x7f305015c410 2023-07-09T02:17:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30477fe640 1 -- 172.21.15.45:0/2138934121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800a640 con 0x7f305015c410 2023-07-09T02:17:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30477fe640 1 -- 172.21.15.45:0/2138934121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800aa70 con 0x7f305015c410 2023-07-09T02:17:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30500cb440 con 0x7f305015c410 2023-07-09T02:17:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500cba00 con 0x7f305015c410 2023-07-09T02:17:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.356+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305004d7d0 con 0x7f305015c410 2023-07-09T02:17:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.360+0000 7f30477fe640 1 -- 172.21.15.45:0/2138934121 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f304800abd0 con 0x7f305015c410 2023-07-09T02:17:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.360+0000 7f30477fe640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3030066280 0x7f3030068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.360+0000 7f30477fe640 1 -- 172.21.15.45:0/2138934121 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3048083260 con 0x7f305015c410 2023-07-09T02:17:17.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.360+0000 7f304effd640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3030066280 0x7f3030068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.360+0000 7f304effd640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3030066280 0x7f3030068730 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f30400ad000 tx=0x7f30400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:17.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.364+0000 7f30477fe640 1 -- 172.21.15.45:0/2138934121 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30480506d0 con 0x7f305015c410 2023-07-09T02:17:17.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.568+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f30500cbeb0 con 0x7f305015c410 2023-07-09T02:17:17.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30477fe640 1 -- 172.21.15.45:0/2138934121 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f30480180b0 con 0x7f305015c410 2023-07-09T02:17:17.578 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:17:17.578 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:17:17.579 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:17:17.579 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:17:17.579 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:17:17.581 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:17:17.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3030066280 msgr2=0x7f3030068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3030066280 0x7f3030068730 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f30400ad000 tx=0x7f30400a6000 comp rx=0 tx=0).stop 2023-07-09T02:17:17.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 msgr2=0x7f30500b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30500b6430 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f304800c700 tx=0x7f304800cbc0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 shutdown_connections 2023-07-09T02:17:17.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f305015c410 0x7f30500b6430 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30500d2340 0x7f3050148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3030066280 0x7f3030068730 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 --2- 172.21.15.45:0/2138934121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30500b59b0 0x7f30500cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 >> 172.21.15.45:0/2138934121 conn(0x7f305006a590 msgr2=0x7f3050160120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:17.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 shutdown_connections 2023-07-09T02:17:17.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.576+0000 7f30557ac640 1 -- 172.21.15.45:0/2138934121 wait complete. 2023-07-09T02:17:17.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:17.639 INFO:tasks.ceph.mds.d.smithi155.stderr:2023-07-09T02:17:17.634+0000 7f8b28f03640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:17:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.740+0000 7f8f3f1ac640 1 Processor -- start 2023-07-09T02:17:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f3f1ac640 1 -- start start 2023-07-09T02:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f3f1ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8f3815c060 0x7f8f380b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f3f1ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f380cd120 0x7f8f380d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f3f1ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 0x7f8f380d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f3f1ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f380d28f0 con 0x7f8f380cd120 2023-07-09T02:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f3f1ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f38160a50 con 0x7f8f3815c060 2023-07-09T02:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f3f1ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3815c430 con 0x7f8f380d2450 2023-07-09T02:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f380cd120 0x7f8f380d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f380cd120 0x7f8f380d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60646/0 (socket says 172.21.15.45:60646) 2023-07-09T02:17:17.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f37fff640 1 -- 172.21.15.45:0/2083299293 learned_addr learned my addr 172.21.15.45:0/2083299293 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f37fff640 1 -- 172.21.15.45:0/2083299293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 msgr2=0x7f8f380d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f37fff640 1 --2- 172.21.15.45:0/2083299293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 0x7f8f380d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f37fff640 1 -- 172.21.15.45:0/2083299293 >> v2:172.21.15.155:3300/0 conn(0x7f8f3815c060 msgr2=0x7f8f380b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f37fff640 1 --2- 172.21.15.45:0/2083299293 >> v2:172.21.15.155:3300/0 conn(0x7f8f3815c060 0x7f8f380b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.744+0000 7f8f37fff640 1 -- 172.21.15.45:0/2083299293 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3815fb60 con 0x7f8f380cd120 2023-07-09T02:17:17.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f37fff640 1 --2- 172.21.15.45:0/2083299293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f380cd120 0x7f8f380d1f10 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f8f380d3ad0 tx=0x7f8f2401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02ab71ce80fd957 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:17.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f377fe640 1 -- 172.21.15.45:0/2083299293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240ab600 con 0x7f8f380cd120 2023-07-09T02:17:17.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f377fe640 1 -- 172.21.15.45:0/2083299293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f240a7050 con 0x7f8f380cd120 2023-07-09T02:17:17.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f377fe640 1 -- 172.21.15.45:0/2083299293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240ab980 con 0x7f8f380cd120 2023-07-09T02:17:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2083299293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f380cd120 msgr2=0x7f8f380d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2083299293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f380cd120 0x7f8f380d1f10 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f8f380d3ad0 tx=0x7f8f2401c210 comp rx=0 tx=0).stop 2023-07-09T02:17:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2083299293 shutdown_connections 2023-07-09T02:17:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2083299293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 0x7f8f380d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2083299293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f380cd120 0x7f8f380d1f10 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2083299293 >> v2:172.21.15.155:3300/0 conn(0x7f8f3815c060 0x7f8f380b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2083299293 >> 172.21.15.45:0/2083299293 conn(0x7f8f380698e0 msgr2=0x7f8f38069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2083299293 shutdown_connections 2023-07-09T02:17:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2083299293 wait complete. 2023-07-09T02:17:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 Processor -- start 2023-07-09T02:17:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.748+0000 7f8f3f1ac640 1 -- start start 2023-07-09T02:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f380cd120 0x7f8f380cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 0x7f8f380cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3815c060 0x7f8f3814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380cb4c0 con 0x7f8f3815c060 2023-07-09T02:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380cbe90 con 0x7f8f380cd120 2023-07-09T02:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380b7b40 con 0x7f8f380d2450 2023-07-09T02:17:17.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3815c060 0x7f8f3814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3815c060 0x7f8f3814fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60658/0 (socket says 172.21.15.45:60658) 2023-07-09T02:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 -- 172.21.15.45:0/2061362498 learned_addr learned my addr 172.21.15.45:0/2061362498 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f37fff640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 0x7f8f380cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3cf48640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f380cd120 0x7f8f380cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 -- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 msgr2=0x7f8f380cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 0x7f8f380cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 -- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f380cd120 msgr2=0x7f8f380cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f380cd120 0x7f8f380cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 -- 172.21.15.45:0/2061362498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240094d0 con 0x7f8f3815c060 2023-07-09T02:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3cf48640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f380cd120 0x7f8f380cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3d749640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3815c060 0x7f8f3814fbd0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000b970 tx=0x7f8f3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f357fa640 1 -- 172.21.15.45:0/2061362498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3000cb40 con 0x7f8f3815c060 2023-07-09T02:17:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f357fa640 1 -- 172.21.15.45:0/2061362498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3000ccc0 con 0x7f8f3815c060 2023-07-09T02:17:17.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f357fa640 1 -- 172.21.15.45:0/2061362498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f30014680 con 0x7f8f3815c060 2023-07-09T02:17:17.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f380cae70 con 0x7f8f3815c060 2023-07-09T02:17:17.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f380caab0 con 0x7f8f3815c060 2023-07-09T02:17:17.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f380cb630 con 0x7f8f3815c060 2023-07-09T02:17:17.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.752+0000 7f8f357fa640 1 -- 172.21.15.45:0/2061362498 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f3001d3b0 con 0x7f8f3815c060 2023-07-09T02:17:17.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.756+0000 7f8f357fa640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f1c066280 0x7f8f1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:17.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.756+0000 7f8f357fa640 1 -- 172.21.15.45:0/2061362498 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f30083c60 con 0x7f8f3815c060 2023-07-09T02:17:17.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.756+0000 7f8f3cf48640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f1c066280 0x7f8f1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:17.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.756+0000 7f8f3cf48640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f1c066280 0x7f8f1c068730 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c006fd0 tx=0x7f8f2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:17.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.760+0000 7f8f357fa640 1 -- 172.21.15.45:0/2061362498 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f30051190 con 0x7f8f3815c060 2023-07-09T02:17:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f3804d7d0 con 0x7f8f3815c060 2023-07-09T02:17:17.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f357fa640 1 -- 172.21.15.45:0/2061362498 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f8f30019090 con 0x7f8f3815c060 2023-07-09T02:17:17.949 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:17.949 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:12.050406+0000","modified":"2023-07-09T02:17:15.686025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7392":{"gid":7392,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3333848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3333848450},{"type":"v1","addr":"172.21.15.155:6837","nonce":3333848450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T02:17:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 59 2023-07-09T02:17:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f1c066280 msgr2=0x7f8f1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f1c066280 0x7f8f1c068730 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c006fd0 tx=0x7f8f2c008040 comp rx=0 tx=0).stop 2023-07-09T02:17:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3815c060 msgr2=0x7f8f3814fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3815c060 0x7f8f3814fbd0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000b970 tx=0x7f8f3000be30 comp rx=0 tx=0).stop 2023-07-09T02:17:17.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 shutdown_connections 2023-07-09T02:17:17.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f3815c060 0x7f8f3814fbd0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8f1c066280 0x7f8f1c068730 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f380d2450 0x7f8f380cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 --2- 172.21.15.45:0/2061362498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f380cd120 0x7f8f380cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:17.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 >> 172.21.15.45:0/2061362498 conn(0x7f8f380698e0 msgr2=0x7f8f380cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:17.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 shutdown_connections 2023-07-09T02:17:17.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:17.948+0000 7f8f3f1ac640 1 -- 172.21.15.45:0/2061362498 wait complete. 2023-07-09T02:17:18.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:17:12.050406+0000', 'modified': '2023-07-09T02:17:15.686025+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7392}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7392': {'gid': 7392, 'name': 'd', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6837/3333848450', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6835', 'nonce': 3333848450}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 3333848450}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:17:18.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:17:18.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-09T02:17:18.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.516+0000 7f16581db640 1 Processor -- start 2023-07-09T02:17:18.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.516+0000 7f16581db640 1 -- start start 2023-07-09T02:17:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f16581db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f165015c060 0x7f16500b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f16581db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16500d2620 0x7f16500cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f16581db640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1650160a50 con 0x7f16500cd120 2023-07-09T02:17:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f16581db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165015c430 con 0x7f16500d2620 2023-07-09T02:17:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f16581db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165015fb60 con 0x7f165015c060 2023-07-09T02:17:18.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1656778640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f16500d2620 0x7f16500cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1655f77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f165015c060 0x7f16500b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1655776640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f16500cd120 0x7f16500d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:60906/0 (socket says 172.21.15.45:60906) 2023-07-09T02:17:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1655776640 1 -- 172.21.15.45:0/846465322 learned_addr learned my addr 172.21.15.45:0/846465322 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1656778640 1 -- 172.21.15.45:0/846465322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f165015c060 msgr2=0x7f16500b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1656778640 1 --2- 172.21.15.45:0/846465322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f165015c060 0x7f16500b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1656778640 1 -- 172.21.15.45:0/846465322 >> v1:172.21.15.155:6789/0 conn(0x7f16500cd120 legacy=0x7f16500d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1656778640 1 -- 172.21.15.45:0/846465322 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165015fe40 con 0x7f16500d2620 2023-07-09T02:17:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1655f77640 1 --2- 172.21.15.45:0/846465322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f165015c060 0x7f16500b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.520+0000 7f1654f75640 1 -- 172.21.15.45:0/846465322 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001139475 0 0) 0x7f1650160a50 con 0x7f16500cd120 2023-07-09T02:17:18.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f1656778640 1 --2- 172.21.15.45:0/846465322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16500d2620 0x7f16500cee30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1648009dc0 tx=0x7f164801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=943b6753bf0e3de0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f1654f75640 1 -- 172.21.15.45:0/846465322 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480a59c0 con 0x7f16500d2620 2023-07-09T02:17:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f1654f75640 1 -- 172.21.15.45:0/846465322 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16480a5b20 con 0x7f16500d2620 2023-07-09T02:17:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f1654f75640 1 -- 172.21.15.45:0/846465322 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480ad440 con 0x7f16500d2620 2023-07-09T02:17:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 -- 172.21.15.45:0/846465322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16500d2620 msgr2=0x7f16500cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 --2- 172.21.15.45:0/846465322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16500d2620 0x7f16500cee30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1648009dc0 tx=0x7f164801c900 comp rx=0 tx=0).stop 2023-07-09T02:17:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 -- 172.21.15.45:0/846465322 shutdown_connections 2023-07-09T02:17:18.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 --2- 172.21.15.45:0/846465322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16500d2620 0x7f16500cee30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 --2- 172.21.15.45:0/846465322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f165015c060 0x7f16500b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 -- 172.21.15.45:0/846465322 >> 172.21.15.45:0/846465322 conn(0x7f16500698e0 msgr2=0x7f1650069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:18.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 -- 172.21.15.45:0/846465322 shutdown_connections 2023-07-09T02:17:18.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 -- 172.21.15.45:0/846465322 wait complete. 2023-07-09T02:17:18.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.524+0000 7f16581db640 1 Processor -- start 2023-07-09T02:17:18.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 -- start start 2023-07-09T02:17:18.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16500cd120 0x7f16500cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16500d2620 0x7f16500b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f165015c060 0x7f16500c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500b29a0 con 0x7f16500d2620 2023-07-09T02:17:18.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16500b37a0 con 0x7f165015c060 2023-07-09T02:17:18.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16500c8fb0 con 0x7f16500cd120 2023-07-09T02:17:18.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16500d2620 0x7f16500b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16500d2620 0x7f16500b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60674/0 (socket says 172.21.15.45:60674) 2023-07-09T02:17:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 -- 172.21.15.45:0/3228325224 learned_addr learned my addr 172.21.15.45:0/3228325224 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655f77640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16500cd120 0x7f16500cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1656778640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f165015c060 0x7f16500c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 -- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16500cd120 msgr2=0x7f16500cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16500cd120 0x7f16500cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 -- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f165015c060 msgr2=0x7f16500c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f165015c060 0x7f16500c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 -- 172.21.15.45:0/3228325224 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009420 con 0x7f16500d2620 2023-07-09T02:17:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1656778640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f165015c060 0x7f16500c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f1655776640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16500d2620 0x7f16500b2460 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f164000c4e0 tx=0x7f164000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16467fc640 1 -- 172.21.15.45:0/3228325224 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400074e0 con 0x7f16500d2620 2023-07-09T02:17:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16467fc640 1 -- 172.21.15.45:0/3228325224 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640007660 con 0x7f16500d2620 2023-07-09T02:17:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16467fc640 1 -- 172.21.15.45:0/3228325224 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640004a30 con 0x7f16500d2620 2023-07-09T02:17:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 -- 172.21.15.45:0/3228325224 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1648009a70 con 0x7f16500d2620 2023-07-09T02:17:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.528+0000 7f16581db640 1 -- 172.21.15.45:0/3228325224 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16500b59f0 con 0x7f16500d2620 2023-07-09T02:17:18.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f16467fc640 1 -- 172.21.15.45:0/3228325224 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1640004b90 con 0x7f16500d2620 2023-07-09T02:17:18.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f16467fc640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1634066280 0x7f1634068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f16467fc640 1 -- 172.21.15.45:0/3228325224 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1640082f20 con 0x7f16500d2620 2023-07-09T02:17:18.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f1655f77640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1634066280 0x7f1634068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f165b554000 1 Processor -- start 2023-07-09T02:17:18.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f165b554000 1 -- start start 2023-07-09T02:17:18.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f1655f77640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1634066280 0x7f1634068730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f164c009c50 tx=0x7f164c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f165b554000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 0x558165b27bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f165b554000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165adda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f165b554000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165ade360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f165b554000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581659a4f80 con 0x558165b28110 2023-07-09T02:17:18.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f165b554000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581658dec60 con 0x558165addf90 2023-07-09T02:17:18.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.532+0000 7f165b554000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x558165932700 con 0x558165b27800 2023-07-09T02:17:18.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165adda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165adda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60678/0 (socket says 172.21.15.45:60678) 2023-07-09T02:17:18.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 -- 172.21.15.45:0/1048228392 learned_addr learned my addr 172.21.15.45:0/1048228392 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:18.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 -- 172.21.15.45:0/1048228392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 msgr2=0x558165b27bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 0x558165b27bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 -- 172.21.15.45:0/1048228392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 msgr2=0x558165ade360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1656778640 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165ade360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165ade360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 -- 172.21.15.45:0/1048228392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558165627890 con 0x558165b28110 2023-07-09T02:17:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1656778640 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165ade360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655776640 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165adda50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f16400540c0 tx=0x7f1640058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f2fbc64714116a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f16337fe640 1 -- 172.21.15.45:0/1048228392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640050840 con 0x558165b28110 2023-07-09T02:17:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f16337fe640 1 -- 172.21.15.45:0/1048228392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16400509a0 con 0x558165b28110 2023-07-09T02:17:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f16337fe640 1 -- 172.21.15.45:0/1048228392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640050120 con 0x558165b28110 2023-07-09T02:17:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- 172.21.15.45:0/1048228392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 msgr2=0x558165adda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165adda50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f16400540c0 tx=0x7f1640058040 comp rx=0 tx=0).stop 2023-07-09T02:17:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- 172.21.15.45:0/1048228392 shutdown_connections 2023-07-09T02:17:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165ade360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165adda50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 --2- 172.21.15.45:0/1048228392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 0x558165b27bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- 172.21.15.45:0/1048228392 >> 172.21.15.45:0/1048228392 conn(0x5581659a0a70 msgr2=0x558165adc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- 172.21.15.45:0/1048228392 shutdown_connections 2023-07-09T02:17:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- 172.21.15.45:0/1048228392 wait complete. 2023-07-09T02:17:18.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- start start 2023-07-09T02:17:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 Processor -- start 2023-07-09T02:17:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165addf90 0x558165ae8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b27800 0x558165ae9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b28110 0x558165ae9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816592b7a0 con 0x558165addf90 2023-07-09T02:17:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581658e7f00 con 0x558165b27800 2023-07-09T02:17:18.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581658e7ba0 con 0x558165b28110 2023-07-09T02:17:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f165b554000 10 client.0 _ll_register_callbacks cb 0x558165ac9930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:17:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.536+0000 7f1655f77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165addf90 0x558165ae8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655f77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165addf90 0x558165ae8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60694/0 (socket says 172.21.15.45:60694) 2023-07-09T02:17:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655f77640 1 -- 172.21.15.45:0/628497769 learned_addr learned my addr 172.21.15.45:0/628497769 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1656778640 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b28110 0x558165ae9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655776640 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b27800 0x558165ae9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655f77640 1 -- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b28110 msgr2=0x558165ae9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655f77640 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b28110 0x558165ae9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655f77640 1 -- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b27800 msgr2=0x558165ae9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655f77640 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b27800 0x558165ae9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655f77640 1 -- 172.21.15.45:0/628497769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16500b59f0 con 0x558165addf90 2023-07-09T02:17:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655f77640 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165addf90 0x558165ae8fd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f164c014a80 tx=0x7f164c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b7f2430824fa5b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:17:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 1 -- 172.21.15.45:0/628497769 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0134e0 con 0x558165addf90 2023-07-09T02:17:18.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 -- 172.21.15.45:0/628497769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55816592a0f0 con 0x558165addf90 2023-07-09T02:17:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 1 -- 172.21.15.45:0/628497769 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f164c0178e0 con 0x558165addf90 2023-07-09T02:17:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 1 -- 172.21.15.45:0/628497769 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f164c017aa0 con 0x558165addf90 2023-07-09T02:17:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 10 client.7527 fetch_fsmap learned FSMap version 59 2023-07-09T02:17:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 -- 172.21.15.45:0/628497769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x5581658f0130 con 0x558165addf90 2023-07-09T02:17:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 1 -- 172.21.15.45:0/628497769 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55816592a0f0 con 0x558165addf90 2023-07-09T02:17:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 1 -- 172.21.15.45:0/628497769 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 59) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f164c017c00 con 0x558165addf90 2023-07-09T02:17:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 10 client.7527 fetch_fsmap finished waiting for FSMap version 59 2023-07-09T02:17:18.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 10 client.7527 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T02:17:18.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 20 client.7527 populate_metadata read hostname 'smithi045' 2023-07-09T02:17:18.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] conn(0x558165aea320 0x558165b38d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 4 client.7527 mds_command: new command op to 7392 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:17:18.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 -- 172.21.15.45:0/628497769 --> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581658f2e40 con 0x558165aea320 2023-07-09T02:17:18.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655776640 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] conn(0x558165aea320 0x558165b38d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1655776640 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] conn(0x558165aea320 0x558165b38d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73d96aafbe72a5f4 server_cookie=16247cb3125bfd1b in_seq=0 out_seq=0 2023-07-09T02:17:18.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 10 client.7527 ms_handle_connect on v2:172.21.15.155:6835/3333848450 2023-07-09T02:17:18.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 1 -- 172.21.15.45:0/628497769 <== mds.0 v2:172.21.15.155:6835/3333848450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5581658f2e40 con 0x558165aea320 2023-07-09T02:17:18.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 10 client.7527 handle_command_reply: tid=0 2023-07-09T02:17:18.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 client.7527 shutdown 2023-07-09T02:17:18.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 -- 172.21.15.45:0/628497769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165addf90 msgr2=0x558165ae8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165addf90 0x558165ae8fd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f164c014a80 tx=0x7f164c009f90 comp rx=0 tx=0).stop 2023-07-09T02:17:18.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 -- 172.21.15.45:0/628497769 shutdown_connections 2023-07-09T02:17:18.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b28110 0x558165ae9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b27800 0x558165ae9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] conn(0x558165aea320 0x558165b38d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 --2- 172.21.15.45:0/628497769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165addf90 0x558165ae8fd0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f1630ff9640 0 client.7527 ms_handle_reset on v2:172.21.15.155:6835/3333848450 2023-07-09T02:17:18.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.540+0000 7f165b554000 1 -- 172.21.15.45:0/628497769 >> 172.21.15.45:0/628497769 conn(0x5581659a0a70 msgr2=0x558165adca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:18.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.544+0000 7f165b554000 1 -- 172.21.15.45:0/628497769 shutdown_connections 2023-07-09T02:17:18.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.544+0000 7f165b554000 1 -- 172.21.15.45:0/628497769 wait complete. 2023-07-09T02:17:18.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.544+0000 7f165b554000 20 client.7527 trim_cache size 0 max 16384 2023-07-09T02:17:18.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.556+0000 7f165b554000 1 Processor -- start 2023-07-09T02:17:18.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.556+0000 7f165b554000 1 -- start start 2023-07-09T02:17:18.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165b27130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 0x558165b3a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165b3a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581655e8940 con 0x558165b28110 2023-07-09T02:17:18.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816592a630 con 0x558165addf90 2023-07-09T02:17:18.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x558165933990 con 0x558165b27800 2023-07-09T02:17:18.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165b3a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165b3a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60708/0 (socket says 172.21.15.45:60708) 2023-07-09T02:17:18.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 -- 172.21.15.45:0/95149030 learned_addr learned my addr 172.21.15.45:0/95149030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:18.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1655f77640 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165b27130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1655776640 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 0x558165b3a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 -- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 msgr2=0x558165b3a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 0x558165b3a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 -- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 msgr2=0x558165b27130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165b27130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 -- 172.21.15.45:0/95149030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581658d63c0 con 0x558165b28110 2023-07-09T02:17:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1655776640 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 0x558165b3a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1656778640 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165b3a9b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f164800c090 tx=0x7f1648004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954525530818a7a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1633fff640 1 -- 172.21.15.45:0/95149030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480b8510 con 0x558165b28110 2023-07-09T02:17:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1633fff640 1 -- 172.21.15.45:0/95149030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16480b8670 con 0x558165b28110 2023-07-09T02:17:18.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f1633fff640 1 -- 172.21.15.45:0/95149030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480b89e0 con 0x558165b28110 2023-07-09T02:17:18.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- 172.21.15.45:0/95149030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 msgr2=0x558165b3a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165b3a9b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f164800c090 tx=0x7f1648004ac0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- 172.21.15.45:0/95149030 shutdown_connections 2023-07-09T02:17:18.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b28110 0x558165b3a9b0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165b27800 0x558165b3a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 --2- 172.21.15.45:0/95149030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165addf90 0x558165b27130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- 172.21.15.45:0/95149030 >> 172.21.15.45:0/95149030 conn(0x5581659a0a70 msgr2=0x558165b38d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:18.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- 172.21.15.45:0/95149030 shutdown_connections 2023-07-09T02:17:18.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- 172.21.15.45:0/95149030 wait complete. 2023-07-09T02:17:18.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 -- start start 2023-07-09T02:17:18.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.560+0000 7f165b554000 1 Processor -- start 2023-07-09T02:17:18.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165addf90 0x558165b84de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b27800 0x558165b85320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b28110 0x558165b250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558165928ba0 con 0x558165b27800 2023-07-09T02:17:18.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581658da730 con 0x558165b28110 2023-07-09T02:17:18.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581658eac20 con 0x558165addf90 2023-07-09T02:17:18.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 10 client.0 _ll_register_callbacks cb 0x558165aaa4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:17:18.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655776640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b27800 0x558165b85320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655f77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165addf90 0x558165b84de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655f77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165addf90 0x558165b84de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:38692/0 (socket says 172.21.15.45:38692) 2023-07-09T02:17:18.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655f77640 1 -- 172.21.15.45:0/4143727594 learned_addr learned my addr 172.21.15.45:0/4143727594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:18.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1656778640 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b28110 0x558165b250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655776640 1 -- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165addf90 msgr2=0x558165b84de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655776640 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165addf90 0x558165b84de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655776640 1 -- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b28110 msgr2=0x558165b250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655776640 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b28110 0x558165b250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655776640 1 -- 172.21.15.45:0/4143727594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165015fe40 con 0x558165b27800 2023-07-09T02:17:18.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655776640 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b27800 0x558165b85320 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f164000c4b0 tx=0x7f164001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dca034adc16b1aa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:17:18.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 1 -- 172.21.15.45:0/4143727594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640070040 con 0x558165b27800 2023-07-09T02:17:18.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 1 -- 172.21.15.45:0/4143727594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f164004ff20 con 0x558165b27800 2023-07-09T02:17:18.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- 172.21.15.45:0/4143727594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558165ae1920 con 0x558165b27800 2023-07-09T02:17:18.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 1 -- 172.21.15.45:0/4143727594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1640053f00 con 0x558165b27800 2023-07-09T02:17:18.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 10 client.7533 fetch_fsmap learned FSMap version 59 2023-07-09T02:17:18.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- 172.21.15.45:0/4143727594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x558165627cc0 con 0x558165b27800 2023-07-09T02:17:18.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 1 -- 172.21.15.45:0/4143727594 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558165ae1920 con 0x558165b27800 2023-07-09T02:17:18.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 1 -- 172.21.15.45:0/4143727594 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 59) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f16400500e0 con 0x558165b27800 2023-07-09T02:17:18.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 10 client.7533 fetch_fsmap finished waiting for FSMap version 59 2023-07-09T02:17:18.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 10 client.7533 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T02:17:18.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 20 client.7533 populate_metadata read hostname 'smithi045' 2023-07-09T02:17:18.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] conn(0x558165b25a70 0x558165b25e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 4 client.7533 mds_command: new command op to 7392 tid=0[{"prefix": "status"}] 2023-07-09T02:17:18.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- 172.21.15.45:0/4143727594 --> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5581658e46f0 con 0x558165b25a70 2023-07-09T02:17:18.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655f77640 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] conn(0x558165b25a70 0x558165b25e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1655f77640 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] conn(0x558165b25a70 0x558165b25e40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc75d84067bce65c server_cookie=4dc1f1bcb8c4ac58 in_seq=0 out_seq=0 2023-07-09T02:17:18.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 10 client.7533 ms_handle_connect on v2:172.21.15.155:6835/3333848450 2023-07-09T02:17:18.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 1 -- 172.21.15.45:0/4143727594 <== mds.0 v2:172.21.15.155:6835/3333848450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5581658e46f0 con 0x558165b25a70 2023-07-09T02:17:18.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 10 client.7533 handle_command_reply: tid=0 2023-07-09T02:17:18.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 client.7533 shutdown 2023-07-09T02:17:18.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- 172.21.15.45:0/4143727594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b27800 msgr2=0x558165b85320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b27800 0x558165b85320 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f164000c4b0 tx=0x7f164001e000 comp rx=0 tx=0).stop 2023-07-09T02:17:18.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- 172.21.15.45:0/4143727594 shutdown_connections 2023-07-09T02:17:18.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558165b28110 0x558165b250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:6835/3333848450,v1:172.21.15.155:6837/3333848450] conn(0x558165b25a70 0x558165b25e40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558165b27800 0x558165b85320 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 --2- 172.21.15.45:0/4143727594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x558165addf90 0x558165b84de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f1630ff9640 0 client.7533 ms_handle_reset on v2:172.21.15.155:6835/3333848450 2023-07-09T02:17:18.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.564+0000 7f165b554000 1 -- 172.21.15.45:0/4143727594 >> 172.21.15.45:0/4143727594 conn(0x5581659a0a70 msgr2=0x558165b395e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:18.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f165b554000 1 -- 172.21.15.45:0/4143727594 shutdown_connections 2023-07-09T02:17:18.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f165b554000 1 -- 172.21.15.45:0/4143727594 wait complete. 2023-07-09T02:17:18.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f165b554000 20 client.7533 trim_cache size 0 max 16384 2023-07-09T02:17:18.578 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:17:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:17:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:17:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 7392, 2023-07-09T02:17:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:17:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:17:18.578 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:17:18.579 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.8965351769999996, 2023-07-09T02:17:18.579 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 59, 2023-07-09T02:17:18.579 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 123, 2023-07-09T02:17:18.579 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 123, 2023-07-09T02:17:18.579 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.78430987 2023-07-09T02:17:18.579 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:17:18.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 -- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1634066280 msgr2=0x7f1634068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1634066280 0x7f1634068730 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f164c009c50 tx=0x7f164c009190 comp rx=0 tx=0).stop 2023-07-09T02:17:18.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 -- 172.21.15.45:0/3228325224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16500d2620 msgr2=0x7f16500b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16500d2620 0x7f16500b2460 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f164000c4e0 tx=0x7f164000c9a0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 -- 172.21.15.45:0/3228325224 shutdown_connections 2023-07-09T02:17:18.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f165015c060 0x7f16500c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16500d2620 0x7f16500b2460 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1634066280 0x7f1634068730 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 --2- 172.21.15.45:0/3228325224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16500cd120 0x7f16500cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 -- 172.21.15.45:0/3228325224 >> 172.21.15.45:0/3228325224 conn(0x7f16500698e0 msgr2=0x7f16500b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:18.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 -- 172.21.15.45:0/3228325224 shutdown_connections 2023-07-09T02:17:18.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.568+0000 7f16581db640 1 -- 172.21.15.45:0/3228325224 wait complete. 2023-07-09T02:17:18.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:17:18.682 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:17:18.687 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:17:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1dcc0b640 1 Processor -- start 2023-07-09T02:17:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1dcc0b640 1 -- start start 2023-07-09T02:17:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1dcc0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc1d8168b50 0x7fc1d806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1dcc0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc1d8168f20 0x7fc1d806b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1dcc0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d816c910 0x7fc1d816cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1dcc0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80cc570 con 0x7fc1d8168b50 2023-07-09T02:17:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1dcc0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80cc850 con 0x7fc1d8168f20 2023-07-09T02:17:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1dcc0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80ccb30 con 0x7fc1d816c910 2023-07-09T02:17:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1d659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc1d8168b50 0x7fc1d806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1d659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc1d8168b50 0x7fc1d806b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60716/0 (socket says 172.21.15.45:60716) 2023-07-09T02:17:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.732+0000 7fc1d659c640 1 -- 172.21.15.45:0/3698510991 learned_addr learned my addr 172.21.15.45:0/3698510991 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d5d9b640 1 --2- 172.21.15.45:0/3698510991 >> v2:172.21.15.155:3300/0 conn(0x7fc1d8168f20 0x7fc1d806b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d6d9d640 1 --2- 172.21.15.45:0/3698510991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d816c910 0x7fc1d816cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d659c640 1 -- 172.21.15.45:0/3698510991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d816c910 msgr2=0x7fc1d816cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d659c640 1 --2- 172.21.15.45:0/3698510991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d816c910 0x7fc1d816cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d659c640 1 -- 172.21.15.45:0/3698510991 >> v2:172.21.15.155:3300/0 conn(0x7fc1d8168f20 msgr2=0x7fc1d806b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d659c640 1 --2- 172.21.15.45:0/3698510991 >> v2:172.21.15.155:3300/0 conn(0x7fc1d8168f20 0x7fc1d806b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d659c640 1 -- 172.21.15.45:0/3698510991 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80cce10 con 0x7fc1d8168b50 2023-07-09T02:17:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d659c640 1 --2- 172.21.15.45:0/3698510991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d806b000 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc1d816d9b0 tx=0x7fc1c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9985d07eda61aabb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d559a640 1 -- 172.21.15.45:0/3698510991 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80aa410 con 0x7fc1d8168b50 2023-07-09T02:17:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d559a640 1 -- 172.21.15.45:0/3698510991 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c80a6040 con 0x7fc1d8168b50 2023-07-09T02:17:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.736+0000 7fc1d559a640 1 -- 172.21.15.45:0/3698510991 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80aa790 con 0x7fc1d8168b50 2023-07-09T02:17:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/3698510991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 msgr2=0x7fc1d806b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/3698510991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d806b000 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc1d816d9b0 tx=0x7fc1c801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/3698510991 shutdown_connections 2023-07-09T02:17:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/3698510991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d816c910 0x7fc1d816cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/3698510991 >> v2:172.21.15.155:3300/0 conn(0x7fc1d8168f20 0x7fc1d806b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/3698510991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d806b000 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/3698510991 >> 172.21.15.45:0/3698510991 conn(0x7fc1d80694b0 msgr2=0x7fc1d80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/3698510991 shutdown_connections 2023-07-09T02:17:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/3698510991 wait complete. 2023-07-09T02:17:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 Processor -- start 2023-07-09T02:17:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- start start 2023-07-09T02:17:18.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d816b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d8168f20 0x7fc1d80c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1d816c910 0x7fc1d8154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80c8720 con 0x7fc1d8168b50 2023-07-09T02:17:18.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80c7b10 con 0x7fc1d816c910 2023-07-09T02:17:18.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1dcc0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80c7df0 con 0x7fc1d8168f20 2023-07-09T02:17:18.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d816b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d816b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60726/0 (socket says 172.21.15.45:60726) 2023-07-09T02:17:18.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d659c640 1 -- 172.21.15.45:0/177264709 learned_addr learned my addr 172.21.15.45:0/177264709 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:18.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d6d9d640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1d816c910 0x7fc1d8154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d5d9b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d8168f20 0x7fc1d80c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d659c640 1 -- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d8168f20 msgr2=0x7fc1d80c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d659c640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d8168f20 0x7fc1d80c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d659c640 1 -- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1d816c910 msgr2=0x7fc1d8154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d659c640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1d816c910 0x7fc1d8154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d659c640 1 -- 172.21.15.45:0/177264709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80094d0 con 0x7fc1d8168b50 2023-07-09T02:17:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.740+0000 7fc1d6d9d640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1d816c910 0x7fc1d8154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:18.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1d659c640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d816b840 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fc1c801ab80 tx=0x7fc1c801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1c6ffd640 1 -- 172.21.15.45:0/177264709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80bd5f0 con 0x7fc1d8168b50 2023-07-09T02:17:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1c6ffd640 1 -- 172.21.15.45:0/177264709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c80bd750 con 0x7fc1d8168b50 2023-07-09T02:17:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1c6ffd640 1 -- 172.21.15.45:0/177264709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80bdb00 con 0x7fc1d8168b50 2023-07-09T02:17:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d80c80d0 con 0x7fc1d8168b50 2023-07-09T02:17:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d816bd80 con 0x7fc1d8168b50 2023-07-09T02:17:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d80c7f30 con 0x7fc1d8168b50 2023-07-09T02:17:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1c6ffd640 1 -- 172.21.15.45:0/177264709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1c80b33f0 con 0x7fc1d8168b50 2023-07-09T02:17:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1c6ffd640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc1b80662b0 0x7fc1b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1c6ffd640 1 -- 172.21.15.45:0/177264709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1c811e8b0 con 0x7fc1d8168b50 2023-07-09T02:17:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.744+0000 7fc1d5d9b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc1b80662b0 0x7fc1b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.748+0000 7fc1d5d9b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc1b80662b0 0x7fc1b8068760 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00ba30 tx=0x7fc1cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:18.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.748+0000 7fc1c6ffd640 1 -- 172.21.15.45:0/177264709 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1d80c7f30 con 0x7fc1d8168b50 2023-07-09T02:17:18.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.936+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1d80c7f30 con 0x7fc1d8168b50 2023-07-09T02:17:18.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.936+0000 7fc1c6ffd640 1 -- 172.21.15.45:0/177264709 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc1d80c7f30 con 0x7fc1d8168b50 2023-07-09T02:17:18.940 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:17:18.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc1b80662b0 msgr2=0x7fc1b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc1b80662b0 0x7fc1b8068760 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00ba30 tx=0x7fc1cc008040 comp rx=0 tx=0).stop 2023-07-09T02:17:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 msgr2=0x7fc1d816b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d816b840 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fc1c801ab80 tx=0x7fc1c801ad10 comp rx=0 tx=0).stop 2023-07-09T02:17:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 shutdown_connections 2023-07-09T02:17:18.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1d816c910 0x7fc1d8154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc1b80662b0 0x7fc1b8068760 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d8168f20 0x7fc1d80c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 --2- 172.21.15.45:0/177264709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1d8168b50 0x7fc1d816b840 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:18.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 >> 172.21.15.45:0/177264709 conn(0x7fc1d80694b0 msgr2=0x7fc1d806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:18.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 shutdown_connections 2023-07-09T02:17:18.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:18.940+0000 7fc1dcc0b640 1 -- 172.21.15.45:0/177264709 wait complete. 2023-07-09T02:17:18.959 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:17:18.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:17:18.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:17:18.960 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:17:18.961 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:18.961 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:17:18.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:17:18.962 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:17:18.962 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:17:18.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:18.962 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:17:18.973 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:17:18.973 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:17:18.973 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:17:18.973 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:18.973 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:17:18.974 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:18.974 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:18.974 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:18.974 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:17:18.974 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:17:18.974 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:18.974 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:17:18.975 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:17:18.975 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42088sec preferred_lft 42088sec 2023-07-09T02:17:18.975 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:17:18.975 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:18.975 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:18.975 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:18.975 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:17:18.975 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:18.976 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:18.976 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:17:18.976 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:17:18.976 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:18.976 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:17:18.976 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:18.977 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:17:18.977 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:18.977 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:17:18.977 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:18.977 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:17:18.977 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:18.977 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:17:18.978 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:17:18.978 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:17:18.978 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:18.978 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:17:18.978 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:17:18.978 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:17:18.979 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:18.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:18.979 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:17:19.039 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:17:19.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:19.041 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:17:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:17:19.093 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:17:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:17:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:17:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:17:19.094 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:17:19.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:19.095 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:17:19.095 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:17:19.095 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:17:19.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:17:19.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:17:19.096 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:17:19.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:19.192 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:17:19.202 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:17:19.203 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:17:19.203 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:17:19.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:19.204 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:17:19.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:17:19.266 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:19.317 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:17:19.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:17:19.318 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:19.367 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:17:19.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:19.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:19.463 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:19.463 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:17:19.476 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:19.476 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:17:19.476 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:17:19.477 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:17:19.477 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:17:19.480 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:17:19.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:19.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:19.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:19.502 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:17:19.562 INFO:teuthology.orchestra.run.smithi045.stdout:client7129 2023-07-09T02:17:19.563 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:19.563 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:19.612 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:17:19.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.800+0000 7f8023740640 1 Processor -- start 2023-07-09T02:17:19.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.800+0000 7f8023740640 1 -- start start 2023-07-09T02:17:19.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8023740640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f801c1604a0 0x7f801c164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8023740640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ce010 0x7f801c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8023740640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c06ef30 con 0x7f801c0c8dc0 2023-07-09T02:17:19.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8023740640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c06be90 con 0x7f801c1604a0 2023-07-09T02:17:19.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8023740640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c06b000 con 0x7f801c0ce010 2023-07-09T02:17:19.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8020cdb640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f801c0c8dc0 0x7f801c0cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37070/0 (socket says 172.21.15.45:37070) 2023-07-09T02:17:19.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8020cdb640 1 -- 172.21.15.45:0/3330320611 learned_addr learned my addr 172.21.15.45:0/3330320611 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:19.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f80214dc640 1 --2- 172.21.15.45:0/3330320611 >> v2:172.21.15.155:3300/0 conn(0x7f801c1604a0 0x7f801c164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8021cdd640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ce010 0x7f801c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722176386 0 0) 0x7f801c06ef30 con 0x7f801c0c8dc0 2023-07-09T02:17:19.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8008003530 con 0x7f801c0c8dc0 2023-07-09T02:17:19.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2927757614 0 0) 0x7f8008003530 con 0x7f801c0c8dc0 2023-07-09T02:17:19.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ce010 msgr2=0x7f801c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:19.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ce010 0x7f801c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:19.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 >> v2:172.21.15.155:3300/0 conn(0x7f801c1604a0 msgr2=0x7f801c164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:19.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 --2- 172.21.15.45:0/3330320611 >> v2:172.21.15.155:3300/0 conn(0x7f801c1604a0 0x7f801c164b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:19.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c165040 con 0x7f801c0c8dc0 2023-07-09T02:17:19.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f800c0016a0 con 0x7f801c0c8dc0 2023-07-09T02:17:19.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 >> v1:172.21.15.45:6789/0 conn(0x7f801c0c8dc0 legacy=0x7f801c0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:19.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8008003980 0x7f8008003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80080043b0 0x7f8008004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ce010 0x7f8008004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c06be90 con 0x7f80080043b0 2023-07-09T02:17:19.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c06b000 con 0x7f8008003980 2023-07-09T02:17:19.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800800b990 con 0x7f801c0ce010 2023-07-09T02:17:19.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f80214dc640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8008003980 0x7f8008003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8020cdb640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80080043b0 0x7f8008004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8021cdd640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ce010 0x7f8008004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8020cdb640 1 -- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ce010 msgr2=0x7f8008004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:19.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8020cdb640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ce010 0x7f8008004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:19.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8020cdb640 1 -- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8008003980 msgr2=0x7f8008003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:19.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8020cdb640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8008003980 0x7f8008003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:19.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f8020cdb640 1 -- 172.21.15.45:0/3330320611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008003530 con 0x7f80080043b0 2023-07-09T02:17:19.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.804+0000 7f80214dc640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8008003980 0x7f8008003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:19.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8020cdb640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80080043b0 0x7f8008004870 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f801c0b1390 tx=0x7f800c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9d037cf42eb65b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:19.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c005ae0 con 0x7f80080043b0 2023-07-09T02:17:19.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c0ab070 con 0x7f80080043b0 2023-07-09T02:17:19.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8013fff640 1 -- 172.21.15.45:0/3330320611 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c005e80 con 0x7f80080043b0 2023-07-09T02:17:19.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8023740640 1 -- 172.21.15.45:0/3330320611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80080043b0 msgr2=0x7f8008004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:19.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8023740640 1 --2- 172.21.15.45:0/3330320611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80080043b0 0x7f8008004870 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f801c0b1390 tx=0x7f800c01f390 comp rx=0 tx=0).stop 2023-07-09T02:17:19.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8021cdd640 1 -- 172.21.15.45:0/3330320611 reap_dead start 2023-07-09T02:17:19.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8023740640 1 -- 172.21.15.45:0/3330320611 shutdown_connections 2023-07-09T02:17:19.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8023740640 1 -- 172.21.15.45:0/3330320611 >> 172.21.15.45:0/3330320611 conn(0x7f801c0694b0 msgr2=0x7f801c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:19.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8023740640 1 -- 172.21.15.45:0/3330320611 shutdown_connections 2023-07-09T02:17:19.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.808+0000 7f8023740640 1 -- 172.21.15.45:0/3330320611 wait complete. 2023-07-09T02:17:19.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 Processor -- start 2023-07-09T02:17:19.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 -- start start 2023-07-09T02:17:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80080043b0 0x7f801c163370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ae5b0 0x7f801c1f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f801c0b04a0 0x7f801c0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c161c10 con 0x7f801c0b04a0 2023-07-09T02:17:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1f5e80 con 0x7f80080043b0 2023-07-09T02:17:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c0aea90 con 0x7f801c0ae5b0 2023-07-09T02:17:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f801c0b04a0 0x7f801c0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f801c0b04a0 0x7f801c0b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60740/0 (socket says 172.21.15.45:60740) 2023-07-09T02:17:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 -- 172.21.15.45:0/2143570223 learned_addr learned my addr 172.21.15.45:0/2143570223 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f80214dc640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80080043b0 0x7f801c163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8020cdb640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ae5b0 0x7f801c1f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 -- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ae5b0 msgr2=0x7f801c1f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ae5b0 0x7f801c1f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 -- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80080043b0 msgr2=0x7f801c163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:19.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80080043b0 0x7f801c163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 -- 172.21.15.45:0/2143570223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c0aed70 con 0x7f801c0b04a0 2023-07-09T02:17:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8021cdd640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f801c0b04a0 0x7f801c0b0910 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f801c0ce400 tx=0x7f8014007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8011ffb640 1 -- 172.21.15.45:0/2143570223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801400e070 con 0x7f801c0b04a0 2023-07-09T02:17:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8011ffb640 1 -- 172.21.15.45:0/2143570223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014003c70 con 0x7f801c0b04a0 2023-07-09T02:17:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8011ffb640 1 -- 172.21.15.45:0/2143570223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014003e60 con 0x7f801c0b04a0 2023-07-09T02:17:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c1615c0 con 0x7f801c0b04a0 2023-07-09T02:17:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c0b0e50 con 0x7f801c0b04a0 2023-07-09T02:17:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.812+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c161420 con 0x7f801c0b04a0 2023-07-09T02:17:19.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.816+0000 7f8011ffb640 1 -- 172.21.15.45:0/2143570223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8014004030 con 0x7f801c0b04a0 2023-07-09T02:17:19.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.816+0000 7f8011ffb640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f80000662b0 0x7f8000068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:19.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.816+0000 7f8011ffb640 1 -- 172.21.15.45:0/2143570223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8014083a00 con 0x7f801c0b04a0 2023-07-09T02:17:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.816+0000 7f80214dc640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f80000662b0 0x7f8000068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.816+0000 7f80214dc640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f80000662b0 0x7f8000068760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8018009b20 tx=0x7f8018008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:19.820+0000 7f8011ffb640 1 -- 172.21.15.45:0/2143570223 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f801c161420 con 0x7f801c0b04a0 2023-07-09T02:17:20.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.008+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f801c161420 con 0x7f801c0b04a0 2023-07-09T02:17:20.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.008+0000 7f8011ffb640 1 -- 172.21.15.45:0/2143570223 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) v1 ==== 53+0+73 (secure 0 0 0) 0x7f801c161420 con 0x7f801c0b04a0 2023-07-09T02:17:20.010 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:17:20.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f80000662b0 msgr2=0x7f8000068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:20.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f80000662b0 0x7f8000068760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8018009b20 tx=0x7f8018008040 comp rx=0 tx=0).stop 2023-07-09T02:17:20.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f801c0b04a0 msgr2=0x7f801c0b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:20.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f801c0b04a0 0x7f801c0b0910 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f801c0ce400 tx=0x7f8014007dd0 comp rx=0 tx=0).stop 2023-07-09T02:17:20.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 shutdown_connections 2023-07-09T02:17:20.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f801c0b04a0 0x7f801c0b0910 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:20.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f80000662b0 0x7f8000068760 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:20.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f801c0ae5b0 0x7f801c1f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:20.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 --2- 172.21.15.45:0/2143570223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80080043b0 0x7f801c163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:20.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 >> 172.21.15.45:0/2143570223 conn(0x7f801c0694b0 msgr2=0x7f801c164800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:20.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 shutdown_connections 2023-07-09T02:17:20.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.012+0000 7f8023740640 1 -- 172.21.15.45:0/2143570223 wait complete. 2023-07-09T02:17:20.033 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:17:20.034 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:17:20.034 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:17:20.035 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:17:20.036 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:20.036 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:17:20.037 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:17:20.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:17:20.038 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:17:20.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.040 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:17:20.052 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:17:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:17:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:17:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:20.053 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:17:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:20.054 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:17:20.054 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:20.054 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:17:20.055 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:20.055 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:17:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:17:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42094sec preferred_lft 42094sec 2023-07-09T02:17:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:17:20.055 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:20.056 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:17:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:17:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:20.056 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:17:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:20.056 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:17:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:17:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:20.057 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:17:20.057 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:17:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:17:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:20.058 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:17:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:17:20.058 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:17:20.059 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:20.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.060 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:17:20.117 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:17:20.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.119 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:17:20.175 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:17:20.175 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:17:20.175 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:17:20.176 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:17:20.176 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:17:20.176 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:17:20.177 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:17:20.177 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:17:20.177 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:17:20.177 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:17:20.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.178 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:17:20.179 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:17:20.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:17:20.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:17:20.180 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:17:20.180 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:17:20.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.277 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:17:20.286 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:17:20.286 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:17:20.287 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:17:20.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.288 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:17:20.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:17:20.353 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:20.408 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:17:20.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:17:20.409 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:20.459 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:17:20.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.460 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:20.551 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:20.552 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:17:20.565 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:20.565 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:17:20.565 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:17:20.565 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:17:20.566 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:17:20.569 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:17:20.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.570 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:20.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:20.591 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:17:20.642 INFO:teuthology.orchestra.run.smithi155.stdout:client7548 2023-07-09T02:17:20.642 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:20.643 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:20.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.840+0000 7f765791f640 1 Processor -- start 2023-07-09T02:17:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.840+0000 7f765791f640 1 -- start start 2023-07-09T02:17:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.840+0000 7f765791f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f76500b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f765791f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7650160a50 con 0x7f76500cd120 2023-07-09T02:17:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f765791f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765015c430 con 0x7f76500d2620 2023-07-09T02:17:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f765791f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765015fb60 con 0x7f765015c060 2023-07-09T02:17:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f7654eba640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f76500cd120 0x7f76500d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37080/0 (socket says 172.21.15.45:37080) 2023-07-09T02:17:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f7654eba640 1 -- 172.21.15.45:0/945514259 learned_addr learned my addr 172.21.15.45:0/945514259 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f76556bb640 1 --2- 172.21.15.45:0/945514259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f76500b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f7647fff640 1 -- 172.21.15.45:0/945514259 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149505624 0 0) 0x7f7650160a50 con 0x7f76500cd120 2023-07-09T02:17:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f7647fff640 1 -- 172.21.15.45:0/945514259 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f763c003530 con 0x7f76500cd120 2023-07-09T02:17:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f7647fff640 1 -- 172.21.15.45:0/945514259 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220903673 0 0) 0x7f765015c430 con 0x7f76500d2620 2023-07-09T02:17:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f7647fff640 1 -- 172.21.15.45:0/945514259 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7650160a50 con 0x7f76500d2620 2023-07-09T02:17:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f76556bb640 1 -- 172.21.15.45:0/945514259 >> v1:172.21.15.155:6789/0 conn(0x7f76500d2620 legacy=0x7f76500cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f76556bb640 1 -- 172.21.15.45:0/945514259 >> v1:172.21.15.45:6789/0 conn(0x7f76500cd120 legacy=0x7f76500d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f76556bb640 1 -- 172.21.15.45:0/945514259 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765015fe40 con 0x7f765015c060 2023-07-09T02:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f7647fff640 1 -- 172.21.15.45:0/945514259 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918557532 0 0) 0x7f763c003530 con 0x7f76500cd120 2023-07-09T02:17:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.844+0000 7f76556bb640 1 --2- 172.21.15.45:0/945514259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f76500b4ed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f764c009820 tx=0x7f764c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e345710e3b13b53 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:20.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f7647fff640 1 -- 172.21.15.45:0/945514259 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0ab670 con 0x7f765015c060 2023-07-09T02:17:20.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f7647fff640 1 -- 172.21.15.45:0/945514259 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c0ab7d0 con 0x7f765015c060 2023-07-09T02:17:20.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f7647fff640 1 -- 172.21.15.45:0/945514259 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0abb60 con 0x7f765015c060 2023-07-09T02:17:20.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- 172.21.15.45:0/945514259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 msgr2=0x7f76500b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:20.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 --2- 172.21.15.45:0/945514259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f76500b4ed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f764c009820 tx=0x7f764c01c470 comp rx=0 tx=0).stop 2023-07-09T02:17:20.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- 172.21.15.45:0/945514259 shutdown_connections 2023-07-09T02:17:20.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 --2- 172.21.15.45:0/945514259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f76500b4ed0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:20.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- 172.21.15.45:0/945514259 >> 172.21.15.45:0/945514259 conn(0x7f76500698e0 msgr2=0x7f7650069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:20.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- 172.21.15.45:0/945514259 shutdown_connections 2023-07-09T02:17:20.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- 172.21.15.45:0/945514259 wait complete. 2023-07-09T02:17:20.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 Processor -- start 2023-07-09T02:17:20.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- start start 2023-07-09T02:17:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76500cd120 0x7f76501535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76500d2620 0x7f76501542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f765015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765015cb60 con 0x7f76500d2620 2023-07-09T02:17:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7650153130 con 0x7f76500cd120 2023-07-09T02:17:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f765791f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7650154920 con 0x7f765015c060 2023-07-09T02:17:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.848+0000 7f7654eba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76500d2620 0x7f76501542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7654eba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76500d2620 0x7f76501542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60756/0 (socket says 172.21.15.45:60756) 2023-07-09T02:17:20.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7654eba640 1 -- 172.21.15.45:0/1194189405 learned_addr learned my addr 172.21.15.45:0/1194189405 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:20.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f76556bb640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76500cd120 0x7f76501535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7655ebc640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f765015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7654eba640 1 -- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 msgr2=0x7f765015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7654eba640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f765015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7654eba640 1 -- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76500cd120 msgr2=0x7f76501535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7654eba640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76500cd120 0x7f76501535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7654eba640 1 -- 172.21.15.45:0/1194189405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c009420 con 0x7f76500d2620 2023-07-09T02:17:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7655ebc640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f765015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7654eba640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76500d2620 0x7f76501542b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f7640005890 tx=0x7f764000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7645ffb640 1 -- 172.21.15.45:0/1194189405 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640005ac0 con 0x7f76500d2620 2023-07-09T02:17:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7645ffb640 1 -- 172.21.15.45:0/1194189405 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7640005c20 con 0x7f76500d2620 2023-07-09T02:17:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500b59f0 con 0x7f76500d2620 2023-07-09T02:17:20.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7645ffb640 1 -- 172.21.15.45:0/1194189405 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400072b0 con 0x7f76500d2620 2023-07-09T02:17:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7650152ae0 con 0x7f76500d2620 2023-07-09T02:17:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765004d7d0 con 0x7f76500d2620 2023-07-09T02:17:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7645ffb640 1 -- 172.21.15.45:0/1194189405 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7640007410 con 0x7f76500d2620 2023-07-09T02:17:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.852+0000 7f7645ffb640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7634066280 0x7f7634068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.856+0000 7f7645ffb640 1 -- 172.21.15.45:0/1194189405 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7640083390 con 0x7f76500d2620 2023-07-09T02:17:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.856+0000 7f76556bb640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7634066280 0x7f7634068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.856+0000 7f76556bb640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7634066280 0x7f7634068730 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f764c0af000 tx=0x7f764c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:20.856+0000 7f7645ffb640 1 -- 172.21.15.45:0/1194189405 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7640050800 con 0x7f76500d2620 2023-07-09T02:17:21.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.048+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7650153270 con 0x7f76500d2620 2023-07-09T02:17:21.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.048+0000 7f7645ffb640 1 -- 172.21.15.45:0/1194189405 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f7640053e20 con 0x7f76500d2620 2023-07-09T02:17:21.050 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:21.050 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:12.050406+0000","modified":"2023-07-09T02:17:15.686025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7392":{"gid":7392,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3333848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3333848450},{"type":"v1","addr":"172.21.15.155:6837","nonce":3333848450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T02:17:21.051 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 59 2023-07-09T02:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7634066280 msgr2=0x7f7634068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7634066280 0x7f7634068730 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f764c0af000 tx=0x7f764c0a7000 comp rx=0 tx=0).stop 2023-07-09T02:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76500d2620 msgr2=0x7f76501542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76500d2620 0x7f76501542b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f7640005890 tx=0x7f764000cbe0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 shutdown_connections 2023-07-09T02:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7634066280 0x7f7634068730 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f765015c060 0x7f765015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76500d2620 0x7f76501542b0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 --2- 172.21.15.45:0/1194189405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76500cd120 0x7f76501535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 >> 172.21.15.45:0/1194189405 conn(0x7f76500698e0 msgr2=0x7f76500b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:21.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 shutdown_connections 2023-07-09T02:17:21.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.052+0000 7f765791f640 1 -- 172.21.15.45:0/1194189405 wait complete. 2023-07-09T02:17:21.071 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-07-09T02:17:21.228 INFO:teuthology.orchestra.run.smithi155.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":7392,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5423638059999991,"mdsmap_epoch":59,"osdmap_epoch":123,"osdmap_epoch_barrier":123,"uptime":14.430124849} 2023-07-09T02:17:21.229 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 7392, "mdsmap_epoch": 59, "osdmap_epoch": 123, "osdmap_epoch_barrier": 123, "rank_uptime": 8.542363806, "state": "up:active", "uptime": 14.430124849, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:17:21.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-07-09T02:17:21.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1df6140640 1 Processor -- start 2023-07-09T02:17:21.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1df6140640 1 -- start start 2023-07-09T02:17:21.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1df6140640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1df0069bc0 0x7f1df00ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:21.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1df6140640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df0159320 con 0x7f1df0158f50 2023-07-09T02:17:21.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1df6140640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df015d860 con 0x7f1df00c52a0 2023-07-09T02:17:21.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1df6140640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df00b16f0 con 0x7f1df0069bc0 2023-07-09T02:17:21.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1def7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1df0158f50 0x7f1df015d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37090/0 (socket says 172.21.15.45:37090) 2023-07-09T02:17:21.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1def7fe640 1 -- 172.21.15.45:0/2939162134 learned_addr learned my addr 172.21.15.45:0/2939162134 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:21.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1deffff640 1 --2- 172.21.15.45:0/2939162134 >> v2:172.21.15.155:3300/0 conn(0x7f1df0069bc0 0x7f1df00ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:21.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1dee7fc640 1 -- 172.21.15.45:0/2939162134 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790642886 0 0) 0x7f1df0159320 con 0x7f1df0158f50 2023-07-09T02:17:21.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1dee7fc640 1 -- 172.21.15.45:0/2939162134 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd8003530 con 0x7f1df0158f50 2023-07-09T02:17:21.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1dee7fc640 1 -- 172.21.15.45:0/2939162134 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506907399 0 0) 0x7f1df015d860 con 0x7f1df00c52a0 2023-07-09T02:17:21.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1dee7fc640 1 -- 172.21.15.45:0/2939162134 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df0159320 con 0x7f1df00c52a0 2023-07-09T02:17:21.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1deffff640 1 -- 172.21.15.45:0/2939162134 >> v1:172.21.15.155:6789/0 conn(0x7f1df00c52a0 legacy=0x7f1df00694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1deffff640 1 -- 172.21.15.45:0/2939162134 >> v1:172.21.15.45:6789/0 conn(0x7f1df0158f50 legacy=0x7f1df015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.376+0000 7f1deffff640 1 -- 172.21.15.45:0/2939162134 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df00c8fd0 con 0x7f1df0069bc0 2023-07-09T02:17:21.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1deffff640 1 --2- 172.21.15.45:0/2939162134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0069bc0 0x7f1df00ccd60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009d90 tx=0x7f1de801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2feae4ae0cebd8bf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:21.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1dee7fc640 1 -- 172.21.15.45:0/2939162134 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80a5900 con 0x7f1df0069bc0 2023-07-09T02:17:21.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1dee7fc640 1 -- 172.21.15.45:0/2939162134 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de80a5a60 con 0x7f1df0069bc0 2023-07-09T02:17:21.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1dee7fc640 1 -- 172.21.15.45:0/2939162134 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80a5df0 con 0x7f1df0069bc0 2023-07-09T02:17:21.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1df6140640 1 -- 172.21.15.45:0/2939162134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0069bc0 msgr2=0x7f1df00ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1df6140640 1 --2- 172.21.15.45:0/2939162134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0069bc0 0x7f1df00ccd60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009d90 tx=0x7f1de801c950 comp rx=0 tx=0).stop 2023-07-09T02:17:21.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1df6140640 1 -- 172.21.15.45:0/2939162134 shutdown_connections 2023-07-09T02:17:21.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1df6140640 1 --2- 172.21.15.45:0/2939162134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0069bc0 0x7f1df00ccd60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1df6140640 1 -- 172.21.15.45:0/2939162134 >> 172.21.15.45:0/2939162134 conn(0x7f1df006ae60 msgr2=0x7f1df006b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:21.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1df6140640 1 -- 172.21.15.45:0/2939162134 shutdown_connections 2023-07-09T02:17:21.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.380+0000 7f1df6140640 1 -- 172.21.15.45:0/2939162134 wait complete. 2023-07-09T02:17:21.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 Processor -- start 2023-07-09T02:17:21.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 -- start start 2023-07-09T02:17:21.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1df0069bc0 0x7f1df014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:21.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df00c52a0 0x7f1df006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:21.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0158f50 0x7f1df01531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:21.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df006ff20 con 0x7f1df00c52a0 2023-07-09T02:17:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df015b4e0 con 0x7f1df0158f50 2023-07-09T02:17:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df015b7c0 con 0x7f1df0069bc0 2023-07-09T02:17:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df00c52a0 0x7f1df006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df00c52a0 0x7f1df006f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60764/0 (socket says 172.21.15.45:60764) 2023-07-09T02:17:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 -- 172.21.15.45:0/2479970530 learned_addr learned my addr 172.21.15.45:0/2479970530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1def7fe640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1df0069bc0 0x7f1df014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:21.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deffff640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0158f50 0x7f1df01531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:21.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 -- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1df0069bc0 msgr2=0x7f1df014f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1df0069bc0 0x7f1df014f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 -- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0158f50 msgr2=0x7f1df01531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0158f50 0x7f1df01531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 -- 172.21.15.45:0/2479970530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009a70 con 0x7f1df00c52a0 2023-07-09T02:17:21.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1deeffd640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df00c52a0 0x7f1df006f9e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f1de400c490 tx=0x7f1de400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:21.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1dd7fff640 1 -- 172.21.15.45:0/2479970530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de40052d0 con 0x7f1df00c52a0 2023-07-09T02:17:21.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1dd7fff640 1 -- 172.21.15.45:0/2479970530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de4005430 con 0x7f1df00c52a0 2023-07-09T02:17:21.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1dd7fff640 1 -- 172.21.15.45:0/2479970530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4012870 con 0x7f1df00c52a0 2023-07-09T02:17:21.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df015baa0 con 0x7f1df00c52a0 2023-07-09T02:17:21.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.384+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df0153700 con 0x7f1df00c52a0 2023-07-09T02:17:21.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.388+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df00cad90 con 0x7f1df00c52a0 2023-07-09T02:17:21.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.388+0000 7f1dd7fff640 1 -- 172.21.15.45:0/2479970530 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1de40129d0 con 0x7f1df00c52a0 2023-07-09T02:17:21.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.388+0000 7f1dd7fff640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1ddc066280 0x7f1ddc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:21.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.388+0000 7f1dd7fff640 1 -- 172.21.15.45:0/2479970530 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1de4083830 con 0x7f1df00c52a0 2023-07-09T02:17:21.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.388+0000 7f1def7fe640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1ddc066280 0x7f1ddc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:21.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.388+0000 7f1def7fe640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1ddc066280 0x7f1ddc068730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1de00011f0 tx=0x7f1de0007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:21.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.392+0000 7f1dd7fff640 1 -- 172.21.15.45:0/2479970530 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1de4050cc0 con 0x7f1df00c52a0 2023-07-09T02:17:21.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.548+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f1df0159520 con 0x7f1df00c52a0 2023-07-09T02:17:21.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1dd7fff640 1 -- 172.21.15.45:0/2479970530 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v124) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1df0159520 con 0x7f1df00c52a0 2023-07-09T02:17:21.730 INFO:teuthology.orchestra.run.smithi045.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-07-09T02:17:21.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1ddc066280 msgr2=0x7f1ddc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1ddc066280 0x7f1ddc068730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1de00011f0 tx=0x7f1de0007d40 comp rx=0 tx=0).stop 2023-07-09T02:17:21.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df00c52a0 msgr2=0x7f1df006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:21.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df00c52a0 0x7f1df006f9e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f1de400c490 tx=0x7f1de400c950 comp rx=0 tx=0).stop 2023-07-09T02:17:21.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 shutdown_connections 2023-07-09T02:17:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1df0158f50 0x7f1df01531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df00c52a0 0x7f1df006f9e0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1ddc066280 0x7f1ddc068730 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 --2- 172.21.15.45:0/2479970530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1df0069bc0 0x7f1df014f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.728+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 >> 172.21.15.45:0/2479970530 conn(0x7f1df006ae60 msgr2=0x7f1df0154c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.732+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 shutdown_connections 2023-07-09T02:17:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:21.732+0000 7f1df6140640 1 -- 172.21.15.45:0/2479970530 wait complete. 2023-07-09T02:17:21.752 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:17:21.753 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:17:21.753 DEBUG:teuthology.orchestra.run.smithi045:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-07-09T02:17:21.754 DEBUG:teuthology.orchestra.run.smithi045:> os.fchmod(fd, 0O666) 2023-07-09T02:17:21.754 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(fd) 2023-07-09T02:17:21.755 DEBUG:teuthology.orchestra.run.smithi045:> os.close(fd) 2023-07-09T02:17:21.755 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:17:22.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:22.011 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:17:22.065 INFO:teuthology.orchestra.run.smithi045.stdout:client7129 2023-07-09T02:17:22.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:22.066 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client7129/osdmap') 2023-07-09T02:17:22.129 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 123 barrier 123 flags 0x588000 2023-07-09T02:17:22.129 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:22.129 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:22.130 INFO:teuthology.orchestra.run.smithi045.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:22.130 INFO:teuthology.orchestra.run.smithi045.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:22.130 INFO:teuthology.orchestra.run.smithi045.stdout:osd0 (2)172.21.15.45:6808 100% (exists, up) 100% -1 2023-07-09T02:17:22.130 INFO:teuthology.orchestra.run.smithi045.stdout:osd1 (2)172.21.15.45:6800 100% (exists, up) 100% -1 2023-07-09T02:17:22.131 INFO:teuthology.orchestra.run.smithi045.stdout:osd2 (2)172.21.15.45:6821 100% (exists, up) 100% -1 2023-07-09T02:17:22.131 INFO:teuthology.orchestra.run.smithi045.stdout:osd3 (2)172.21.15.45:6814 100% (exists, up) 100% -1 2023-07-09T02:17:22.131 INFO:teuthology.orchestra.run.smithi045.stdout:osd4 (2)172.21.15.155:6808 100% (exists, up) 100% -1 2023-07-09T02:17:22.131 INFO:teuthology.orchestra.run.smithi045.stdout:osd5 (2)172.21.15.155:6819 100% (exists, up) 100% -1 2023-07-09T02:17:22.131 INFO:teuthology.orchestra.run.smithi045.stdout:osd6 (2)172.21.15.155:6800 100% (exists, up) 100% -1 2023-07-09T02:17:22.131 INFO:teuthology.orchestra.run.smithi045.stdout:osd7 (2)172.21.15.155:6816 100% (exists, up) 100% -1 2023-07-09T02:17:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records in 2023-07-09T02:17:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records out 2023-07-09T02:17:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:904 bytes copied, 7.179e-05 s, 12.6 MB/s 2023-07-09T02:17:22.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-07-09T02:17:22.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.316+0000 7f4f02dfa640 1 Processor -- start 2023-07-09T02:17:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.316+0000 7f4f02dfa640 1 -- start start 2023-07-09T02:17:22.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f02dfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc0c8d10 0x7f4efc0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f02dfa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4efc15db00 0x7f4efc15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f02dfa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4efc06bf30 con 0x7f4efc0ca0f0 2023-07-09T02:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f02dfa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4efc15e4c0 con 0x7f4efc15db00 2023-07-09T02:17:22.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f02dfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc06bc50 con 0x7f4efc0c8d10 2023-07-09T02:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4efbfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc0c8d10 0x7f4efc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f01397640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4efc15db00 0x7f4efc15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4efbfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc0c8d10 0x7f4efc0c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:43532/0 (socket says 172.21.15.45:43532) 2023-07-09T02:17:22.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4efbfff640 1 -- 172.21.15.45:0/2151468789 learned_addr learned my addr 172.21.15.45:0/2151468789 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:22.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f01397640 1 -- 172.21.15.45:0/2151468789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc0c8d10 msgr2=0x7f4efc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:22.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f01397640 1 --2- 172.21.15.45:0/2151468789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc0c8d10 0x7f4efc0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f01397640 1 -- 172.21.15.45:0/2151468789 >> v1:172.21.15.155:6789/0 conn(0x7f4efc0ca0f0 legacy=0x7f4efc0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4f01397640 1 -- 172.21.15.45:0/2151468789 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc0cab90 con 0x7f4efc15db00 2023-07-09T02:17:22.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4efb7fe640 1 -- 172.21.15.45:0/2151468789 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217615898 0 0) 0x7f4efc06bf30 con 0x7f4efc0ca0f0 2023-07-09T02:17:22.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.320+0000 7f4efbfff640 1 --2- 172.21.15.45:0/2151468789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc0c8d10 0x7f4efc0c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:22.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f01397640 1 --2- 172.21.15.45:0/2151468789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc15db00 0x7f4efc15df80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009d90 tx=0x7f4ef401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=662faa6bedfe3848 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4efb7fe640 1 -- 172.21.15.45:0/2151468789 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40a5980 con 0x7f4efc15db00 2023-07-09T02:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4efb7fe640 1 -- 172.21.15.45:0/2151468789 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef40a5ae0 con 0x7f4efc15db00 2023-07-09T02:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4efb7fe640 1 -- 172.21.15.45:0/2151468789 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40a5e70 con 0x7f4efc15db00 2023-07-09T02:17:22.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2151468789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc15db00 msgr2=0x7f4efc15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2151468789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc15db00 0x7f4efc15df80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009d90 tx=0x7f4ef401c8c0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2151468789 shutdown_connections 2023-07-09T02:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2151468789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc15db00 0x7f4efc15df80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2151468789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc0c8d10 0x7f4efc0c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2151468789 >> 172.21.15.45:0/2151468789 conn(0x7f4efc0694b0 msgr2=0x7f4efc0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2151468789 shutdown_connections 2023-07-09T02:17:22.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.324+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2151468789 wait complete. 2023-07-09T02:17:22.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 Processor -- start 2023-07-09T02:17:22.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 -- start start 2023-07-09T02:17:22.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0c8d10 0x7f4efc0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0ca0f0 0x7f4efc0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15db00 0x7f4efc0c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0c59a0 con 0x7f4efc0c8d10 2023-07-09T02:17:22.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0b32f0 con 0x7f4efc0ca0f0 2023-07-09T02:17:22.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc0cd5d0 con 0x7f4efc15db00 2023-07-09T02:17:22.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0c8d10 0x7f4efc0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0c8d10 0x7f4efc0b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55590/0 (socket says 172.21.15.45:55590) 2023-07-09T02:17:22.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 -- 172.21.15.45:0/2658771577 learned_addr learned my addr 172.21.15.45:0/2658771577 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:22.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4efbfff640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0ca0f0 0x7f4efc0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f01397640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15db00 0x7f4efc0c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 -- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15db00 msgr2=0x7f4efc0c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15db00 0x7f4efc0c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 -- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0ca0f0 msgr2=0x7f4efc0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0ca0f0 0x7f4efc0cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 -- 172.21.15.45:0/2658771577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80094d0 con 0x7f4efc0c8d10 2023-07-09T02:17:22.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f01397640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15db00 0x7f4efc0c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:22.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4efbfff640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0ca0f0 0x7f4efc0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:22.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f00b96640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0c8d10 0x7f4efc0b1fe0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000c4d0 tx=0x7f4ef000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:22.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4ef97fa640 1 -- 172.21.15.45:0/2658771577 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0005480 con 0x7f4efc0c8d10 2023-07-09T02:17:22.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4ef97fa640 1 -- 172.21.15.45:0/2658771577 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0003600 con 0x7f4efc0c8d10 2023-07-09T02:17:22.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef4009a70 con 0x7f4efc0c8d10 2023-07-09T02:17:22.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4ef97fa640 1 -- 172.21.15.45:0/2658771577 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00039b0 con 0x7f4efc0c8d10 2023-07-09T02:17:22.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.328+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc0b29c0 con 0x7f4efc0c8d10 2023-07-09T02:17:22.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.332+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc04d7d0 con 0x7f4efc0c8d10 2023-07-09T02:17:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.332+0000 7f4ef97fa640 1 -- 172.21.15.45:0/2658771577 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ef0003b10 con 0x7f4efc0c8d10 2023-07-09T02:17:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.332+0000 7f4ef97fa640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ee0066280 0x7f4ee0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.332+0000 7f4ef97fa640 1 -- 172.21.15.45:0/2658771577 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ef00834e0 con 0x7f4efc0c8d10 2023-07-09T02:17:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.332+0000 7f4efbfff640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ee0066280 0x7f4ee0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.332+0000 7f4efbfff640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ee0066280 0x7f4ee0068730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0cc340 tx=0x7f4ee8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:22.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.336+0000 7f4ef97fa640 1 -- 172.21.15.45:0/2658771577 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ef0054380 con 0x7f4efc0c8d10 2023-07-09T02:17:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.500+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f4efc164c70 con 0x7f4efc0c8d10 2023-07-09T02:17:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4ef97fa640 1 -- 172.21.15.45:0/2658771577 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v125) v1 ==== 93+0+0 (secure 0 0 0) 0x7f4ef0017020 con 0x7f4efc0c8d10 2023-07-09T02:17:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:pauserd,pausewr is set 2023-07-09T02:17:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ee0066280 msgr2=0x7f4ee0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ee0066280 0x7f4ee0068730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0cc340 tx=0x7f4ee8008040 comp rx=0 tx=0).stop 2023-07-09T02:17:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0c8d10 msgr2=0x7f4efc0b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0c8d10 0x7f4efc0b1fe0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000c4d0 tx=0x7f4ef000c990 comp rx=0 tx=0).stop 2023-07-09T02:17:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 shutdown_connections 2023-07-09T02:17:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ee0066280 0x7f4ee0068730 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4efc15db00 0x7f4efc0c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc0ca0f0 0x7f4efc0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 --2- 172.21.15.45:0/2658771577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4efc0c8d10 0x7f4efc0b1fe0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 >> 172.21.15.45:0/2658771577 conn(0x7f4efc0694b0 msgr2=0x7f4efc0c4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 shutdown_connections 2023-07-09T02:17:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.740+0000 7f4f02dfa640 1 -- 172.21.15.45:0/2658771577 wait complete. 2023-07-09T02:17:22.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-07-09T02:17:22.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7313fac640 1 Processor -- start 2023-07-09T02:17:22.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7313fac640 1 -- start start 2023-07-09T02:17:22.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7313fac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f730c0ca0f0 0x7f730c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7313fac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f730c0cbbb0 0x7f730c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7313fac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730c06bf30 con 0x7f730c0c9250 2023-07-09T02:17:22.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7313fac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730c06bc50 con 0x7f730c0cbbb0 2023-07-09T02:17:22.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7313fac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730c0cab90 con 0x7f730c0ca0f0 2023-07-09T02:17:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7311547640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f730c0cbbb0 0x7f730c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7311547640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f730c0cbbb0 0x7f730c0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55592/0 (socket says 172.21.15.45:55592) 2023-07-09T02:17:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7311547640 1 -- 172.21.15.45:0/3572399358 learned_addr learned my addr 172.21.15.45:0/3572399358 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7311547640 1 -- 172.21.15.45:0/3572399358 >> v2:172.21.15.155:3300/0 conn(0x7f730c0ca0f0 msgr2=0x7f730c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7311547640 1 --2- 172.21.15.45:0/3572399358 >> v2:172.21.15.155:3300/0 conn(0x7f730c0ca0f0 0x7f730c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7311547640 1 -- 172.21.15.45:0/3572399358 >> v1:172.21.15.155:6789/0 conn(0x7f730c0c9250 legacy=0x7f730c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:22.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.908+0000 7f7311547640 1 -- 172.21.15.45:0/3572399358 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0cae70 con 0x7f730c0cbbb0 2023-07-09T02:17:22.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7311547640 1 --2- 172.21.15.45:0/3572399358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c0c8d10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f730c06c0c0 tx=0x7f72fc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237de240ad2b0fd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:22.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7310d46640 1 -- 172.21.15.45:0/3572399358 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0ab650 con 0x7f730c0cbbb0 2023-07-09T02:17:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7310d46640 1 -- 172.21.15.45:0/3572399358 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc0ab7b0 con 0x7f730c0cbbb0 2023-07-09T02:17:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7310d46640 1 -- 172.21.15.45:0/3572399358 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0abb40 con 0x7f730c0cbbb0 2023-07-09T02:17:22.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7313fac640 1 -- 172.21.15.45:0/3572399358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 msgr2=0x7f730c0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7313fac640 1 --2- 172.21.15.45:0/3572399358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c0c8d10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f730c06c0c0 tx=0x7f72fc01c430 comp rx=0 tx=0).stop 2023-07-09T02:17:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7313fac640 1 -- 172.21.15.45:0/3572399358 shutdown_connections 2023-07-09T02:17:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7313fac640 1 --2- 172.21.15.45:0/3572399358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c0c8d10 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7313fac640 1 --2- 172.21.15.45:0/3572399358 >> v2:172.21.15.155:3300/0 conn(0x7f730c0ca0f0 0x7f730c0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7313fac640 1 -- 172.21.15.45:0/3572399358 >> 172.21.15.45:0/3572399358 conn(0x7f730c0694b0 msgr2=0x7f730c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7313fac640 1 -- 172.21.15.45:0/3572399358 shutdown_connections 2023-07-09T02:17:22.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.912+0000 7f7313fac640 1 -- 172.21.15.45:0/3572399358 wait complete. 2023-07-09T02:17:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 Processor -- start 2023-07-09T02:17:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 -- start start 2023-07-09T02:17:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730c0c9250 0x7f730c1f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730c0ca0f0 0x7f730c1f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c1f9240 con 0x7f730c0cbbb0 2023-07-09T02:17:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0b10f0 con 0x7f730c0ca0f0 2023-07-09T02:17:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730c0b0b30 con 0x7f730c0c9250 2023-07-09T02:17:22.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c1591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55594/0 (socket says 172.21.15.45:55594) 2023-07-09T02:17:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 -- 172.21.15.45:0/1908036137 learned_addr learned my addr 172.21.15.45:0/1908036137 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7311547640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730c0ca0f0 0x7f730c1f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7311d48640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730c0c9250 0x7f730c1f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 -- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730c0c9250 msgr2=0x7f730c1f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730c0c9250 0x7f730c1f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 -- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730c0ca0f0 msgr2=0x7f730c1f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730c0ca0f0 0x7f730c1f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 -- 172.21.15.45:0/1908036137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0094d0 con 0x7f730c0cbbb0 2023-07-09T02:17:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7312549640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c1591b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f730400c780 tx=0x7f730400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304003d90 con 0x7f730c0cbbb0 2023-07-09T02:17:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730400ce90 con 0x7f730c0cbbb0 2023-07-09T02:17:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040052b0 con 0x7f730c0cbbb0 2023-07-09T02:17:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c0b0e10 con 0x7f730c0cbbb0 2023-07-09T02:17:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730c1f50f0 con 0x7f730c0cbbb0 2023-07-09T02:17:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.916+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c04d7d0 con 0x7f730c0cbbb0 2023-07-09T02:17:22.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.920+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7304005410 con 0x7f730c0cbbb0 2023-07-09T02:17:22.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.920+0000 7f73027fc640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f72f0066280 0x7f72f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:22.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.920+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7304083220 con 0x7f730c0cbbb0 2023-07-09T02:17:22.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.920+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=126+}) v3 -- 0x7f72f006e3c0 con 0x7f730c0cbbb0 2023-07-09T02:17:22.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.920+0000 7f7311d48640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f72f0066280 0x7f72f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:22.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.920+0000 7f7311d48640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f72f0066280 0x7f72f0068730 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7308009990 tx=0x7f7308009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:22.924+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73040506b0 con 0x7f730c0cbbb0 2023-07-09T02:17:23.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.084+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f730c0c5550 con 0x7f730c0cbbb0 2023-07-09T02:17:23.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.744+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(126..126 src has 1..126) v4 ==== 288+0+0 (secure 0 0 0) 0x7f7304058280 con 0x7f730c0cbbb0 2023-07-09T02:17:23.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.744+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=127}) v3 -- 0x7f72f006ec00 con 0x7f730c0cbbb0 2023-07-09T02:17:23.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f73027fc640 1 -- 172.21.15.45:0/1908036137 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7304017020 con 0x7f730c0cbbb0 2023-07-09T02:17:23.748 INFO:teuthology.orchestra.run.smithi045.stderr:pauserd,pausewr is unset 2023-07-09T02:17:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f72f0066280 msgr2=0x7f72f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f72f0066280 0x7f72f0068730 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7308009990 tx=0x7f7308009110 comp rx=0 tx=0).stop 2023-07-09T02:17:23.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 msgr2=0x7f730c1591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c1591b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f730400c780 tx=0x7f730400cc40 comp rx=0 tx=0).stop 2023-07-09T02:17:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 shutdown_connections 2023-07-09T02:17:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730c0cbbb0 0x7f730c1591b0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730c0ca0f0 0x7f730c1f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f72f0066280 0x7f72f0068730 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 --2- 172.21.15.45:0/1908036137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730c0c9250 0x7f730c1f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 >> 172.21.15.45:0/1908036137 conn(0x7f730c0694b0 msgr2=0x7f730c15b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:23.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 shutdown_connections 2023-07-09T02:17:23.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.748+0000 7f7313fac640 1 -- 172.21.15.45:0/1908036137 wait complete. 2023-07-09T02:17:23.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:23.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45e4bd2640 1 Processor -- start 2023-07-09T02:17:23.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45e4bd2640 1 -- start start 2023-07-09T02:17:23.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45e4bd2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45e006b240 0x7f45e006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:23.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45e4bd2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45e00d0d70 0x7f45e00d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:23.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45e4bd2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00b2090 con 0x7f45e015c870 2023-07-09T02:17:23.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45e4bd2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e006bc00 con 0x7f45e006b240 2023-07-09T02:17:23.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45e4bd2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e0160520 con 0x7f45e00d0d70 2023-07-09T02:17:23.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45deffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45e006b240 0x7f45e006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:23.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45deffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45e006b240 0x7f45e006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55608/0 (socket says 172.21.15.45:55608) 2023-07-09T02:17:23.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45deffd640 1 -- 172.21.15.45:0/2920227749 learned_addr learned my addr 172.21.15.45:0/2920227749 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:23.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45df7fe640 1 --1- 172.21.15.45:0/2920227749 >> v1:172.21.15.45:6789/0 conn(0x7f45e015c870 0x7f45e00b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57870/0 (socket says 172.21.15.45:57870) 2023-07-09T02:17:23.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45dffff640 1 --2- 172.21.15.45:0/2920227749 >> v2:172.21.15.155:3300/0 conn(0x7f45e00d0d70 0x7f45e00d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:23.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45deffd640 1 -- 172.21.15.45:0/2920227749 >> v2:172.21.15.155:3300/0 conn(0x7f45e00d0d70 msgr2=0x7f45e00d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:23.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45deffd640 1 --2- 172.21.15.45:0/2920227749 >> v2:172.21.15.155:3300/0 conn(0x7f45e00d0d70 0x7f45e00d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45deffd640 1 -- 172.21.15.45:0/2920227749 >> v1:172.21.15.45:6789/0 conn(0x7f45e015c870 legacy=0x7f45e00b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:23.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.920+0000 7f45deffd640 1 -- 172.21.15.45:0/2920227749 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0160800 con 0x7f45e006b240 2023-07-09T02:17:23.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45deffd640 1 --2- 172.21.15.45:0/2920227749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e006b240 0x7f45e006b6c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f45e00cfec0 tx=0x7f45d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5620a7149af1285e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:23.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45de7fc640 1 -- 172.21.15.45:0/2920227749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40aa430 con 0x7f45e006b240 2023-07-09T02:17:23.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45de7fc640 1 -- 172.21.15.45:0/2920227749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d40aa590 con 0x7f45e006b240 2023-07-09T02:17:23.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45de7fc640 1 -- 172.21.15.45:0/2920227749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40aa920 con 0x7f45e006b240 2023-07-09T02:17:23.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 -- 172.21.15.45:0/2920227749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e006b240 msgr2=0x7f45e006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:23.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/2920227749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e006b240 0x7f45e006b6c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f45e00cfec0 tx=0x7f45d401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 -- 172.21.15.45:0/2920227749 shutdown_connections 2023-07-09T02:17:23.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/2920227749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e006b240 0x7f45e006b6c0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/2920227749 >> v2:172.21.15.155:3300/0 conn(0x7f45e00d0d70 0x7f45e00d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 -- 172.21.15.45:0/2920227749 >> 172.21.15.45:0/2920227749 conn(0x7f45e0070be0 msgr2=0x7f45e0070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:23.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 -- 172.21.15.45:0/2920227749 shutdown_connections 2023-07-09T02:17:23.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 -- 172.21.15.45:0/2920227749 wait complete. 2023-07-09T02:17:23.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 Processor -- start 2023-07-09T02:17:23.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.924+0000 7f45e4bd2640 1 -- start start 2023-07-09T02:17:23.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45e006b240 0x7f45e01f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00d0d70 0x7f45e01f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45e015c870 0x7f45e014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e01568f0 con 0x7f45e00d0d70 2023-07-09T02:17:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0158340 con 0x7f45e015c870 2023-07-09T02:17:23.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0158620 con 0x7f45e006b240 2023-07-09T02:17:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00d0d70 0x7f45e01f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00d0d70 0x7f45e01f7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55624/0 (socket says 172.21.15.45:55624) 2023-07-09T02:17:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 -- 172.21.15.45:0/3505530161 learned_addr learned my addr 172.21.15.45:0/3505530161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45df7fe640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45e006b240 0x7f45e01f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:23.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45dffff640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45e015c870 0x7f45e014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:23.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 -- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45e006b240 msgr2=0x7f45e01f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:23.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45e006b240 0x7f45e01f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 -- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45e015c870 msgr2=0x7f45e014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:23.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45e015c870 0x7f45e014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:23.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 -- 172.21.15.45:0/3505530161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40094d0 con 0x7f45e00d0d70 2023-07-09T02:17:23.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45dffff640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45e015c870 0x7f45e014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:23.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45deffd640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00d0d70 0x7f45e01f7c90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f45d40190e0 tx=0x7f45d401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:23.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45c7fff640 1 -- 172.21.15.45:0/3505530161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40aa430 con 0x7f45e00d0d70 2023-07-09T02:17:23.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45c7fff640 1 -- 172.21.15.45:0/3505530161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d40b3800 con 0x7f45e00d0d70 2023-07-09T02:17:23.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45c7fff640 1 -- 172.21.15.45:0/3505530161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40b3bb0 con 0x7f45e00d0d70 2023-07-09T02:17:23.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e0158900 con 0x7f45e00d0d70 2023-07-09T02:17:23.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e01f81d0 con 0x7f45e00d0d70 2023-07-09T02:17:23.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.928+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e004e020 con 0x7f45e00d0d70 2023-07-09T02:17:23.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.932+0000 7f45c7fff640 1 -- 172.21.15.45:0/3505530161 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45d40b3d10 con 0x7f45e00d0d70 2023-07-09T02:17:23.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.932+0000 7f45c7fff640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45cc066280 0x7f45cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:23.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.932+0000 7f45c7fff640 1 -- 172.21.15.45:0/3505530161 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45d411e0d0 con 0x7f45e00d0d70 2023-07-09T02:17:23.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.932+0000 7f45df7fe640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45cc066280 0x7f45cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:23.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.932+0000 7f45df7fe640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45cc066280 0x7f45cc068730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f45d0000f70 tx=0x7f45d0007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:23.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:23.936+0000 7f45c7fff640 1 -- 172.21.15.45:0/3505530161 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45d40eb600 con 0x7f45e00d0d70 2023-07-09T02:17:24.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.092+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45e0156d10 con 0x7f45e00d0d70 2023-07-09T02:17:24.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.092+0000 7f45c7fff640 1 -- 172.21.15.45:0/3505530161 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f45d40eec20 con 0x7f45e00d0d70 2023-07-09T02:17:24.095 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:24.095 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":126,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:23.740952+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45cc066280 msgr2=0x7f45cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45cc066280 0x7f45cc068730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f45d0000f70 tx=0x7f45d0007cb0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00d0d70 msgr2=0x7f45e01f7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00d0d70 0x7f45e01f7c90 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f45d40190e0 tx=0x7f45d401ad10 comp rx=0 tx=0).stop 2023-07-09T02:17:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 shutdown_connections 2023-07-09T02:17:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45e015c870 0x7f45e014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00d0d70 0x7f45e01f7c90 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45cc066280 0x7f45cc068730 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 --2- 172.21.15.45:0/3505530161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45e006b240 0x7f45e01f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 >> 172.21.15.45:0/3505530161 conn(0x7f45e0070be0 msgr2=0x7f45e00d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 shutdown_connections 2023-07-09T02:17:24.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.096+0000 7f45e4bd2640 1 -- 172.21.15.45:0/3505530161 wait complete. 2023-07-09T02:17:24.117 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:17:24.117 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:17:24.119 DEBUG:teuthology.orchestra.run.smithi045:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-07-09T02:17:24.119 DEBUG:teuthology.orchestra.run.smithi045:> os.fchmod(fd, 0O666) 2023-07-09T02:17:24.119 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(fd) 2023-07-09T02:17:24.120 DEBUG:teuthology.orchestra.run.smithi045:> os.close(fd) 2023-07-09T02:17:24.120 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:17:24.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:24.375 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:17:24.428 INFO:teuthology.orchestra.run.smithi045.stdout:client7129 2023-07-09T02:17:24.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:24.429 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client7129/osdmap') 2023-07-09T02:17:24.493 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 123 barrier 123 flags 0x588000 2023-07-09T02:17:24.493 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:24.493 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:24.493 INFO:teuthology.orchestra.run.smithi045.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:24.494 INFO:teuthology.orchestra.run.smithi045.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:24.494 INFO:teuthology.orchestra.run.smithi045.stdout:osd0 (2)172.21.15.45:6808 100% (exists, up) 100% -1 2023-07-09T02:17:24.494 INFO:teuthology.orchestra.run.smithi045.stdout:osd1 (2)172.21.15.45:6800 100% (exists, up) 100% -1 2023-07-09T02:17:24.494 INFO:teuthology.orchestra.run.smithi045.stdout:osd2 (2)172.21.15.45:6821 100% (exists, up) 100% -1 2023-07-09T02:17:24.494 INFO:teuthology.orchestra.run.smithi045.stdout:osd3 (2)172.21.15.45:6814 100% (exists, up) 100% -1 2023-07-09T02:17:24.494 INFO:teuthology.orchestra.run.smithi045.stdout:osd4 (2)172.21.15.155:6808 100% (exists, up) 100% -1 2023-07-09T02:17:24.495 INFO:teuthology.orchestra.run.smithi045.stdout:osd5 (2)172.21.15.155:6819 100% (exists, up) 100% -1 2023-07-09T02:17:24.495 INFO:teuthology.orchestra.run.smithi045.stdout:osd6 (2)172.21.15.155:6800 100% (exists, up) 100% -1 2023-07-09T02:17:24.495 INFO:teuthology.orchestra.run.smithi045.stdout:osd7 (2)172.21.15.155:6816 100% (exists, up) 100% -1 2023-07-09T02:17:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records in 2023-07-09T02:17:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records out 2023-07-09T02:17:24.496 INFO:teuthology.orchestra.run.smithi045.stderr:904 bytes copied, 7.2997e-05 s, 12.4 MB/s 2023-07-09T02:17:24.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:24.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.680+0000 7f1ff8ffa640 1 Processor -- start 2023-07-09T02:17:24.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.680+0000 7f1ff8ffa640 1 -- start start 2023-07-09T02:17:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff8ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff415e210 0x7f1ff40c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff8ffa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff406bf30 con 0x7f1ff40c8d10 2023-07-09T02:17:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff8ffa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff406bc50 con 0x7f1ff40ca0f0 2023-07-09T02:17:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff8ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40cab90 con 0x7f1ff415e210 2023-07-09T02:17:24.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1febfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1ff40c8d10 0x7f1ff415db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57876/0 (socket says 172.21.15.45:57876) 2023-07-09T02:17:24.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1febfff640 1 -- 172.21.15.45:0/17154717 learned_addr learned my addr 172.21.15.45:0/17154717 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:24.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff2d9d640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff415e210 0x7f1ff40c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:24.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140166407 0 0) 0x7f1ff406bf30 con 0x7f1ff40c8d10 2023-07-09T02:17:24.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe0003530 con 0x7f1ff40c8d10 2023-07-09T02:17:24.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2128773539 0 0) 0x7f1fe0003530 con 0x7f1ff40c8d10 2023-07-09T02:17:24.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff415e210 msgr2=0x7f1ff40c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:24.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff415e210 0x7f1ff40c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 >> v1:172.21.15.155:6789/0 conn(0x7f1ff40ca0f0 legacy=0x7f1ff40cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff40cae70 con 0x7f1ff40c8d10 2023-07-09T02:17:24.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f1fdc001680 con 0x7f1ff40c8d10 2023-07-09T02:17:24.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 >> v1:172.21.15.45:6789/0 conn(0x7f1ff40c8d10 legacy=0x7f1ff415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff415e210 0x7f1fe00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:24.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1fe00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:24.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe0004d10 0x7f1fe0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:24.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40cab90 con 0x7f1fe0003f30 2023-07-09T02:17:24.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe000ff30 con 0x7f1fe0004d10 2023-07-09T02:17:24.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe00100f0 con 0x7f1ff415e210 2023-07-09T02:17:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1febfff640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1fe00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff259c640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff415e210 0x7f1fe00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff2d9d640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe0004d10 0x7f1fe0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1febfff640 1 -- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff415e210 msgr2=0x7f1fe00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1febfff640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff415e210 0x7f1fe00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1febfff640 1 -- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe0004d10 msgr2=0x7f1fe0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:24.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1febfff640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe0004d10 0x7f1fe0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1febfff640 1 -- 172.21.15.45:0/17154717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0003530 con 0x7f1fe0003f30 2023-07-09T02:17:24.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.684+0000 7f1ff2d9d640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fe0004d10 0x7f1fe0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:24.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1febfff640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1fe00047d0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00c210 tx=0x7f1fdc01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beea69b3a3dc7b0e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:24.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0058e0 con 0x7f1fe0003f30 2023-07-09T02:17:24.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc005a40 con 0x7f1fe0003f30 2023-07-09T02:17:24.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff1d9b640 1 -- 172.21.15.45:0/17154717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc005e70 con 0x7f1fe0003f30 2023-07-09T02:17:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/17154717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 msgr2=0x7f1fe00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff8ffa640 1 --2- 172.21.15.45:0/17154717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1fe00047d0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00c210 tx=0x7f1fdc01cc20 comp rx=0 tx=0).stop 2023-07-09T02:17:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff2d9d640 1 -- 172.21.15.45:0/17154717 reap_dead start 2023-07-09T02:17:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/17154717 shutdown_connections 2023-07-09T02:17:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/17154717 >> 172.21.15.45:0/17154717 conn(0x7f1ff40694b0 msgr2=0x7f1ff40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/17154717 shutdown_connections 2023-07-09T02:17:24.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/17154717 wait complete. 2023-07-09T02:17:24.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff8ffa640 1 Processor -- start 2023-07-09T02:17:24.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.688+0000 7f1ff8ffa640 1 -- start start 2023-07-09T02:17:24.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1ff414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:24.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff414e240 0x7f1ff414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:24.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40c61a0 0x7f1ff40c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40b2e00 con 0x7f1fe0003f30 2023-07-09T02:17:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4154850 con 0x7f1ff40c61a0 2023-07-09T02:17:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40c6b50 con 0x7f1ff414e240 2023-07-09T02:17:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1ff414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1ff414dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55648/0 (socket says 172.21.15.45:55648) 2023-07-09T02:17:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 -- 172.21.15.45:0/1905838282 learned_addr learned my addr 172.21.15.45:0/1905838282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff2d9d640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40c61a0 0x7f1ff40c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1febfff640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff414e240 0x7f1ff414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 -- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff414e240 msgr2=0x7f1ff414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff414e240 0x7f1ff414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 -- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40c61a0 msgr2=0x7f1ff40c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40c61a0 0x7f1ff40c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 -- 172.21.15.45:0/1905838282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff40b2780 con 0x7f1fe0003f30 2023-07-09T02:17:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff259c640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1ff414dc80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400f850 tx=0x7f1fe400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1feaffd640 1 -- 172.21.15.45:0/1905838282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400fe40 con 0x7f1fe0003f30 2023-07-09T02:17:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1feaffd640 1 -- 172.21.15.45:0/1905838282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe40052e0 con 0x7f1fe0003f30 2023-07-09T02:17:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff4154570 con 0x7f1fe0003f30 2023-07-09T02:17:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1feaffd640 1 -- 172.21.15.45:0/1905838282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400d8f0 con 0x7f1fe0003f30 2023-07-09T02:17:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff4154190 con 0x7f1fe0003f30 2023-07-09T02:17:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff404d7d0 con 0x7f1fe0003f30 2023-07-09T02:17:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.692+0000 7f1feaffd640 1 -- 172.21.15.45:0/1905838282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1fe400da50 con 0x7f1fe0003f30 2023-07-09T02:17:24.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.696+0000 7f1feaffd640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd4066280 0x7f1fd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:24.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.696+0000 7f1feaffd640 1 -- 172.21.15.45:0/1905838282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1fe4083ba0 con 0x7f1fe0003f30 2023-07-09T02:17:24.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.696+0000 7f1febfff640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd4066280 0x7f1fd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:24.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.696+0000 7f1febfff640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd4066280 0x7f1fd4068730 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0ab000 tx=0x7f1fdc0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.700+0000 7f1feaffd640 1 -- 172.21.15.45:0/1905838282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fe4051010 con 0x7f1fe0003f30 2023-07-09T02:17:24.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ff4073ca0 con 0x7f1fe0003f30 2023-07-09T02:17:24.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1feaffd640 1 -- 172.21.15.45:0/1905838282 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f1fe4054630 con 0x7f1fe0003f30 2023-07-09T02:17:24.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:24.891 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:12.050406+0000","modified":"2023-07-09T02:17:15.686025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7392":{"gid":7392,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3333848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3333848450},{"type":"v1","addr":"172.21.15.155:6837","nonce":3333848450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T02:17:24.892 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 59 2023-07-09T02:17:24.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd4066280 msgr2=0x7f1fd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd4066280 0x7f1fd4068730 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0ab000 tx=0x7f1fdc0a7070 comp rx=0 tx=0).stop 2023-07-09T02:17:24.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 msgr2=0x7f1ff414dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:24.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1ff414dc80 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400f850 tx=0x7f1fe400fd10 comp rx=0 tx=0).stop 2023-07-09T02:17:24.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 shutdown_connections 2023-07-09T02:17:24.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40c61a0 0x7f1ff40c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1fd4066280 0x7f1fd4068730 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff414e240 0x7f1ff414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 --2- 172.21.15.45:0/1905838282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fe0003f30 0x7f1ff414dc80 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:24.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.888+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 >> 172.21.15.45:0/1905838282 conn(0x7f1ff40694b0 msgr2=0x7f1ff415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:24.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.892+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 shutdown_connections 2023-07-09T02:17:24.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:24.892+0000 7f1ff8ffa640 1 -- 172.21.15.45:0/1905838282 wait complete. 2023-07-09T02:17:24.911 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json osdmap barrier 126 2023-07-09T02:17:25.075 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-07-09T02:17:25.076 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:17:25.076 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:17:25.077 DEBUG:teuthology.orchestra.run.smithi045:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-07-09T02:17:25.077 DEBUG:teuthology.orchestra.run.smithi045:> os.fchmod(fd, 0O666) 2023-07-09T02:17:25.077 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(fd) 2023-07-09T02:17:25.078 DEBUG:teuthology.orchestra.run.smithi045:> os.close(fd) 2023-07-09T02:17:25.078 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:17:25.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:25.333 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:17:25.393 INFO:teuthology.orchestra.run.smithi045.stdout:client7129 2023-07-09T02:17:25.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:25.394 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client7129/osdmap') 2023-07-09T02:17:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 126 barrier 126 flags 0x588000 2023-07-09T02:17:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:osd0 (2)172.21.15.45:6808 100% (exists, up) 100% -1 2023-07-09T02:17:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:osd1 (2)172.21.15.45:6800 100% (exists, up) 100% -1 2023-07-09T02:17:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:osd2 (2)172.21.15.45:6821 100% (exists, up) 100% -1 2023-07-09T02:17:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:osd3 (2)172.21.15.45:6814 100% (exists, up) 100% -1 2023-07-09T02:17:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:osd4 (2)172.21.15.155:6808 100% (exists, up) 100% -1 2023-07-09T02:17:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:osd5 (2)172.21.15.155:6819 100% (exists, up) 100% -1 2023-07-09T02:17:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:osd6 (2)172.21.15.155:6800 100% (exists, up) 100% -1 2023-07-09T02:17:25.458 INFO:teuthology.orchestra.run.smithi045.stdout:osd7 (2)172.21.15.155:6816 100% (exists, up) 100% -1 2023-07-09T02:17:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records in 2023-07-09T02:17:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records out 2023-07-09T02:17:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:904 bytes copied, 6.746e-05 s, 13.4 MB/s 2023-07-09T02:17:25.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:25.460 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:17:25.518 INFO:teuthology.orchestra.run.smithi045.stdout:client7129 2023-07-09T02:17:25.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:25.519 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.client7129/osdmap') 2023-07-09T02:17:25.581 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 126 barrier 126 flags 0x588000 2023-07-09T02:17:25.581 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:25.581 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'rbd' type 1 size 2 min_size 1 pg_num 8 pg_num_mask 7 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:25.581 INFO:teuthology.orchestra.run.smithi045.stdout:pool 15 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:25.581 INFO:teuthology.orchestra.run.smithi045.stdout:pool 16 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-07-09T02:17:25.582 INFO:teuthology.orchestra.run.smithi045.stdout:osd0 (2)172.21.15.45:6808 100% (exists, up) 100% -1 2023-07-09T02:17:25.582 INFO:teuthology.orchestra.run.smithi045.stdout:osd1 (2)172.21.15.45:6800 100% (exists, up) 100% -1 2023-07-09T02:17:25.582 INFO:teuthology.orchestra.run.smithi045.stdout:osd2 (2)172.21.15.45:6821 100% (exists, up) 100% -1 2023-07-09T02:17:25.582 INFO:teuthology.orchestra.run.smithi045.stdout:osd3 (2)172.21.15.45:6814 100% (exists, up) 100% -1 2023-07-09T02:17:25.582 INFO:teuthology.orchestra.run.smithi045.stdout:osd4 (2)172.21.15.155:6808 100% (exists, up) 100% -1 2023-07-09T02:17:25.582 INFO:teuthology.orchestra.run.smithi045.stdout:osd5 (2)172.21.15.155:6819 100% (exists, up) 100% -1 2023-07-09T02:17:25.582 INFO:teuthology.orchestra.run.smithi045.stdout:osd6 (2)172.21.15.155:6800 100% (exists, up) 100% -1 2023-07-09T02:17:25.583 INFO:teuthology.orchestra.run.smithi045.stdout:osd7 (2)172.21.15.155:6816 100% (exists, up) 100% -1 2023-07-09T02:17:25.583 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records in 2023-07-09T02:17:25.583 INFO:teuthology.orchestra.run.smithi045.stderr:1+1 records out 2023-07-09T02:17:25.584 INFO:teuthology.orchestra.run.smithi045.stderr:904 bytes copied, 7.3227e-05 s, 12.3 MB/s 2023-07-09T02:17:25.584 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:17:25.584 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:17:25.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:17:25.686 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:17:25.738 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:17:25.739 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:25.739 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:25.749 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:25.749 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:25.800 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:25.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fef1e9640 1 Processor -- start 2023-07-09T02:17:25.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fef1e9640 1 -- start start 2023-07-09T02:17:25.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fef1e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:25.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fef1e9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fe80cd120 0x7f6fe80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:25.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fef1e9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6fe80d2450 0x7f6fe80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:25.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fef1e9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe80d28f0 con 0x7f6fe80cd120 2023-07-09T02:17:25.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fef1e9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe8160a50 con 0x7f6fe80d2450 2023-07-09T02:17:25.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fef1e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe815c430 con 0x7f6fe815c060 2023-07-09T02:17:25.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fe7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fe80cd120 0x7f6fe80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:25.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fe7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fe80cd120 0x7f6fe80d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55652/0 (socket says 172.21.15.45:55652) 2023-07-09T02:17:25.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fe7fff640 1 -- 172.21.15.45:0/2220532 learned_addr learned my addr 172.21.15.45:0/2220532 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:25.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fecf85640 1 --2- 172.21.15.45:0/2220532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:25.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fe7fff640 1 -- 172.21.15.45:0/2220532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 msgr2=0x7f6fe80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:25.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fe7fff640 1 --2- 172.21.15.45:0/2220532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:25.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fed786640 1 --2- 172.21.15.45:0/2220532 >> v2:172.21.15.155:3300/0 conn(0x7f6fe80d2450 0x7f6fe80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:25.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fe7fff640 1 -- 172.21.15.45:0/2220532 >> v2:172.21.15.155:3300/0 conn(0x7f6fe80d2450 msgr2=0x7f6fe80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:25.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fe7fff640 1 --2- 172.21.15.45:0/2220532 >> v2:172.21.15.155:3300/0 conn(0x7f6fe80d2450 0x7f6fe80d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:25.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fe7fff640 1 -- 172.21.15.45:0/2220532 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe815fb60 con 0x7f6fe80cd120 2023-07-09T02:17:25.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fecf85640 1 --2- 172.21.15.45:0/2220532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:25.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.984+0000 7f6fed786640 1 --2- 172.21.15.45:0/2220532 >> v2:172.21.15.155:3300/0 conn(0x7f6fe80d2450 0x7f6fe80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:25.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fe7fff640 1 --2- 172.21.15.45:0/2220532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe80d1f10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6fe806b120 tx=0x7f6fd401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639483d34864c261 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:25.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fe77fe640 1 -- 172.21.15.45:0/2220532 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40ab600 con 0x7f6fe80cd120 2023-07-09T02:17:25.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fe77fe640 1 -- 172.21.15.45:0/2220532 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd40a7050 con 0x7f6fe80cd120 2023-07-09T02:17:25.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fe77fe640 1 -- 172.21.15.45:0/2220532 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40ab980 con 0x7f6fe80cd120 2023-07-09T02:17:25.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2220532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 msgr2=0x7f6fe80d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:25.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2220532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe80d1f10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6fe806b120 tx=0x7f6fd401c210 comp rx=0 tx=0).stop 2023-07-09T02:17:25.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2220532 shutdown_connections 2023-07-09T02:17:25.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2220532 >> v2:172.21.15.155:3300/0 conn(0x7f6fe80d2450 0x7f6fe80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:25.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2220532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe80d1f10 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:25.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2220532 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:25.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2220532 >> 172.21.15.45:0/2220532 conn(0x7f6fe80698e0 msgr2=0x7f6fe8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:25.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2220532 shutdown_connections 2023-07-09T02:17:25.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.988+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2220532 wait complete. 2023-07-09T02:17:25.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 Processor -- start 2023-07-09T02:17:25.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 -- start start 2023-07-09T02:17:25.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe8152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:25.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80d2450 0x7f6fe81512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:25.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:25.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80c99b0 con 0x7f6fe80cd120 2023-07-09T02:17:25.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe81523f0 con 0x7f6fe80d2450 2023-07-09T02:17:25.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe8152970 con 0x7f6fe815c060 2023-07-09T02:17:25.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe8152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:25.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe8152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55656/0 (socket says 172.21.15.45:55656) 2023-07-09T02:17:25.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 -- 172.21.15.45:0/2092583649 learned_addr learned my addr 172.21.15.45:0/2092583649 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:25.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fed786640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:25.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fe7fff640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80d2450 0x7f6fe81512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:25.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 -- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 msgr2=0x7f6fe80ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:25.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:25.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 -- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80d2450 msgr2=0x7f6fe81512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:25.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80d2450 0x7f6fe81512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:25.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 -- 172.21.15.45:0/2092583649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40094d0 con 0x7f6fe80cd120 2023-07-09T02:17:25.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fecf85640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe8152e00 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c7f0 tx=0x7f6fdc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:25.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fe57fa640 1 -- 172.21.15.45:0/2092583649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007820 con 0x7f6fe80cd120 2023-07-09T02:17:25.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe8151810 con 0x7f6fe80cd120 2023-07-09T02:17:25.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fe57fa640 1 -- 172.21.15.45:0/2092583649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc007980 con 0x7f6fe80cd120 2023-07-09T02:17:25.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fe57fa640 1 -- 172.21.15.45:0/2092583649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007d30 con 0x7f6fe80cd120 2023-07-09T02:17:25.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.992+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe80ca140 con 0x7f6fe80cd120 2023-07-09T02:17:25.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.996+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe804d7d0 con 0x7f6fe80cd120 2023-07-09T02:17:25.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.996+0000 7f6fe57fa640 1 -- 172.21.15.45:0/2092583649 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fdc0113f0 con 0x7f6fe80cd120 2023-07-09T02:17:25.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.996+0000 7f6fe57fa640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fcc066280 0x7f6fcc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:25.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.996+0000 7f6fe57fa640 1 -- 172.21.15.45:0/2092583649 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fdc084080 con 0x7f6fe80cd120 2023-07-09T02:17:25.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.996+0000 7f6fe7fff640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fcc066280 0x7f6fcc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:25.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:25.996+0000 7f6fe7fff640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fcc066280 0x7f6fcc068730 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40ad000 tx=0x7f6fd40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:26.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.000+0000 7f6fe57fa640 1 -- 172.21.15.45:0/2092583649 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6fdc051530 con 0x7f6fe80cd120 2023-07-09T02:17:26.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fe80ce3f0 con 0x7f6fe80cd120 2023-07-09T02:17:26.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fe57fa640 1 -- 172.21.15.45:0/2092583649 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f6fdc054b50 con 0x7f6fe80cd120 2023-07-09T02:17:26.161 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:26.162 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":126,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:23.740952+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:26.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fcc066280 msgr2=0x7f6fcc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fcc066280 0x7f6fcc068730 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40ad000 tx=0x7f6fd40a6000 comp rx=0 tx=0).stop 2023-07-09T02:17:26.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 msgr2=0x7f6fe8152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe8152e00 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c7f0 tx=0x7f6fdc00ccb0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 shutdown_connections 2023-07-09T02:17:26.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fcc066280 0x7f6fcc068730 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe815c060 0x7f6fe80ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80d2450 0x7f6fe81512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 --2- 172.21.15.45:0/2092583649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fe80cd120 0x7f6fe8152e00 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 >> 172.21.15.45:0/2092583649 conn(0x7f6fe80698e0 msgr2=0x7f6fe80b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:26.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 shutdown_connections 2023-07-09T02:17:26.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.160+0000 7f6fef1e9640 1 -- 172.21.15.45:0/2092583649 wait complete. 2023-07-09T02:17:26.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:17:10.149383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:17:11.041822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:17:26.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:17:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe18cccb640 1 Processor -- start 2023-07-09T02:17:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe18cccb640 1 -- start start 2023-07-09T02:17:26.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe18cccb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe1880cd120 0x7fe1880b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe18cccb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe188160a50 con 0x7fe18815c060 2023-07-09T02:17:26.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe18cccb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18815c430 con 0x7fe1880d2620 2023-07-09T02:17:26.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe18cccb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18815fb60 con 0x7fe1880cd120 2023-07-09T02:17:26.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe18659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe18815c060 0x7fe1880d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57878/0 (socket says 172.21.15.45:57878) 2023-07-09T02:17:26.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe18659c640 1 -- 172.21.15.45:0/1069505975 learned_addr learned my addr 172.21.15.45:0/1069505975 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:26.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe186d9d640 1 --2- 172.21.15.45:0/1069505975 >> v2:172.21.15.155:3300/0 conn(0x7fe1880cd120 0x7fe1880b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe185d9b640 1 -- 172.21.15.45:0/1069505975 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345042675 0 0) 0x7fe188160a50 con 0x7fe18815c060 2023-07-09T02:17:26.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe185d9b640 1 -- 172.21.15.45:0/1069505975 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe174003530 con 0x7fe18815c060 2023-07-09T02:17:26.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe185d9b640 1 -- 172.21.15.45:0/1069505975 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41429733 0 0) 0x7fe18815c430 con 0x7fe1880d2620 2023-07-09T02:17:26.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe185d9b640 1 -- 172.21.15.45:0/1069505975 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe188160a50 con 0x7fe1880d2620 2023-07-09T02:17:26.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe186d9d640 1 -- 172.21.15.45:0/1069505975 >> v1:172.21.15.155:6789/0 conn(0x7fe1880d2620 legacy=0x7fe1880cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe186d9d640 1 -- 172.21.15.45:0/1069505975 >> v1:172.21.15.45:6789/0 conn(0x7fe18815c060 legacy=0x7fe1880d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.328+0000 7fe186d9d640 1 -- 172.21.15.45:0/1069505975 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18815fe40 con 0x7fe1880cd120 2023-07-09T02:17:26.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe186d9d640 1 --2- 172.21.15.45:0/1069505975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 0x7fe1880b4ed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe180009d90 tx=0x7fe18001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b581219e0b8a590a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:26.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe185d9b640 1 -- 172.21.15.45:0/1069505975 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800a59e0 con 0x7fe1880cd120 2023-07-09T02:17:26.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe185d9b640 1 -- 172.21.15.45:0/1069505975 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1800a5b40 con 0x7fe1880cd120 2023-07-09T02:17:26.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe185d9b640 1 -- 172.21.15.45:0/1069505975 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800ad440 con 0x7fe1880cd120 2023-07-09T02:17:26.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe18cccb640 1 -- 172.21.15.45:0/1069505975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 msgr2=0x7fe1880b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe18cccb640 1 --2- 172.21.15.45:0/1069505975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 0x7fe1880b4ed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe180009d90 tx=0x7fe18001c920 comp rx=0 tx=0).stop 2023-07-09T02:17:26.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe18cccb640 1 -- 172.21.15.45:0/1069505975 shutdown_connections 2023-07-09T02:17:26.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe18cccb640 1 --2- 172.21.15.45:0/1069505975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 0x7fe1880b4ed0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe18cccb640 1 -- 172.21.15.45:0/1069505975 >> 172.21.15.45:0/1069505975 conn(0x7fe1880698e0 msgr2=0x7fe188069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:26.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe18cccb640 1 -- 172.21.15.45:0/1069505975 shutdown_connections 2023-07-09T02:17:26.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.332+0000 7fe18cccb640 1 -- 172.21.15.45:0/1069505975 wait complete. 2023-07-09T02:17:26.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 Processor -- start 2023-07-09T02:17:26.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 -- start start 2023-07-09T02:17:26.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 0x7fe1880cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1880d2620 0x7fe18814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18815c060 0x7fe1880b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe188152d60 con 0x7fe1880d2620 2023-07-09T02:17:26.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880cc220 con 0x7fe1880cd120 2023-07-09T02:17:26.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880cc500 con 0x7fe18815c060 2023-07-09T02:17:26.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1880d2620 0x7fe18814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1880d2620 0x7fe18814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55658/0 (socket says 172.21.15.45:55658) 2023-07-09T02:17:26.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 -- 172.21.15.45:0/2658192200 learned_addr learned my addr 172.21.15.45:0/2658192200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:26.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe186d9d640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18815c060 0x7fe1880b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18659c640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 0x7fe1880cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 -- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18815c060 msgr2=0x7fe1880b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18815c060 0x7fe1880b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 -- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 msgr2=0x7fe1880cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 0x7fe1880cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 -- 172.21.15.45:0/2658192200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180009a70 con 0x7fe1880d2620 2023-07-09T02:17:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe186d9d640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18815c060 0x7fe1880b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18659c640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 0x7fe1880cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17ffff640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1880d2620 0x7fe18814ee00 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe17000c500 tx=0x7fe17000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17effd640 1 -- 172.21.15.45:0/2658192200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1700052d0 con 0x7fe1880d2620 2023-07-09T02:17:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17effd640 1 -- 172.21.15.45:0/2658192200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170005430 con 0x7fe1880d2620 2023-07-09T02:17:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1880b59f0 con 0x7fe1880d2620 2023-07-09T02:17:26.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe17effd640 1 -- 172.21.15.45:0/2658192200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170012870 con 0x7fe1880d2620 2023-07-09T02:17:26.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.336+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe188152fb0 con 0x7fe1880d2620 2023-07-09T02:17:26.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.340+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1881531d0 con 0x7fe1880d2620 2023-07-09T02:17:26.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.340+0000 7fe17effd640 1 -- 172.21.15.45:0/2658192200 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1700129d0 con 0x7fe1880d2620 2023-07-09T02:17:26.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.340+0000 7fe17effd640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.340+0000 7fe17effd640 1 -- 172.21.15.45:0/2658192200 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe170083a30 con 0x7fe1880d2620 2023-07-09T02:17:26.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.340+0000 7fe18659c640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.340+0000 7fe18659c640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe1780011f0 tx=0x7fe178009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:26.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.344+0000 7fe17effd640 1 -- 172.21.15.45:0/2658192200 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe170050e20 con 0x7fe1880d2620 2023-07-09T02:17:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe18804d7d0 con 0x7fe1880d2620 2023-07-09T02:17:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe17effd640 1 -- 172.21.15.45:0/2658192200 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe170054440 con 0x7fe1880d2620 2023-07-09T02:17:26.501 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:17:26.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 msgr2=0x7fe168068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe1780011f0 tx=0x7fe178009040 comp rx=0 tx=0).stop 2023-07-09T02:17:26.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1880d2620 msgr2=0x7fe18814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1880d2620 0x7fe18814ee00 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe17000c500 tx=0x7fe17000c9c0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 shutdown_connections 2023-07-09T02:17:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe168066280 0x7fe168068730 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe18815c060 0x7fe1880b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1880d2620 0x7fe18814ee00 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 --2- 172.21.15.45:0/2658192200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1880cd120 0x7fe1880cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 >> 172.21.15.45:0/2658192200 conn(0x7fe1880698e0 msgr2=0x7fe1880b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 shutdown_connections 2023-07-09T02:17:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.500+0000 7fe18cccb640 1 -- 172.21.15.45:0/2658192200 wait complete. 2023-07-09T02:17:26.522 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:17:26.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b7f2c640 1 Processor -- start 2023-07-09T02:17:26.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b7f2c640 1 -- start start 2023-07-09T02:17:26.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b7f2c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f84b00ccc50 0x7f84b00c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b7f2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00c98c0 con 0x7f84b015c110 2023-07-09T02:17:26.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b7f2c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00cd1d0 con 0x7f84b00cb0d0 2023-07-09T02:17:26.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b7f2c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b00cd4b0 con 0x7f84b00ccc50 2023-07-09T02:17:26.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b5cc8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84b015c110 0x7f84b01607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57882/0 (socket says 172.21.15.45:57882) 2023-07-09T02:17:26.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b5cc8640 1 -- 172.21.15.45:0/2008474226 learned_addr learned my addr 172.21.15.45:0/2008474226 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:26.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b54c7640 1 --2- 172.21.15.45:0/2008474226 >> v2:172.21.15.155:3300/0 conn(0x7f84b00ccc50 0x7f84b00c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199223344 0 0) 0x7f84b00c98c0 con 0x7f84b015c110 2023-07-09T02:17:26.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f849c003530 con 0x7f84b015c110 2023-07-09T02:17:26.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3963915079 0 0) 0x7f849c003530 con 0x7f84b015c110 2023-07-09T02:17:26.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 >> v2:172.21.15.155:3300/0 conn(0x7f84b00ccc50 msgr2=0x7f84b00c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:26.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 --2- 172.21.15.45:0/2008474226 >> v2:172.21.15.155:3300/0 conn(0x7f84b00ccc50 0x7f84b00c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 >> v1:172.21.15.155:6789/0 conn(0x7f84b00cb0d0 legacy=0x7f84b006b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00c9270 con 0x7f84b015c110 2023-07-09T02:17:26.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f84ac001680 con 0x7f84b015c110 2023-07-09T02:17:26.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 >> v1:172.21.15.45:6789/0 conn(0x7f84b015c110 legacy=0x7f84b01607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f849c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f849c0047d0 0x7f849c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f849c005180 0x7f849c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00cd4b0 con 0x7f849c003980 2023-07-09T02:17:26.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c00c000 con 0x7f849c005180 2023-07-09T02:17:26.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c00c1c0 con 0x7f849c0047d0 2023-07-09T02:17:26.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b5cc8640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f849c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b54c7640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f849c0047d0 0x7f849c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b64c9640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f849c005180 0x7f849c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b5cc8640 1 -- 172.21.15.45:0/2008474226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f849c0047d0 msgr2=0x7f849c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:26.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b5cc8640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f849c0047d0 0x7f849c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b5cc8640 1 -- 172.21.15.45:0/2008474226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f849c005180 msgr2=0x7f849c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:26.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b5cc8640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f849c005180 0x7f849c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b5cc8640 1 -- 172.21.15.45:0/2008474226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c003530 con 0x7f849c003980 2023-07-09T02:17:26.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.668+0000 7f84b64c9640 1 -- 172.21.15.45:0/2008474226 reap_dead start 2023-07-09T02:17:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b5cc8640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f849c003d90 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c240 tx=0x7f84ac01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b190bb8263e30e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac005ae0 con 0x7f849c003980 2023-07-09T02:17:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac005c40 con 0x7f849c003980 2023-07-09T02:17:26.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b4cc6640 1 -- 172.21.15.45:0/2008474226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0a59f0 con 0x7f849c003980 2023-07-09T02:17:26.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b7f2c640 1 -- 172.21.15.45:0/2008474226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 msgr2=0x7f849c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b7f2c640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f849c003d90 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c240 tx=0x7f84ac01cc10 comp rx=0 tx=0).stop 2023-07-09T02:17:26.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b7f2c640 1 -- 172.21.15.45:0/2008474226 shutdown_connections 2023-07-09T02:17:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b7f2c640 1 --2- 172.21.15.45:0/2008474226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f849c003d90 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b7f2c640 1 -- 172.21.15.45:0/2008474226 >> 172.21.15.45:0/2008474226 conn(0x7f84b00694b0 msgr2=0x7f84b00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b7f2c640 1 -- 172.21.15.45:0/2008474226 shutdown_connections 2023-07-09T02:17:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.672+0000 7f84b7f2c640 1 -- 172.21.15.45:0/2008474226 wait complete. 2023-07-09T02:17:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 Processor -- start 2023-07-09T02:17:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 -- start start 2023-07-09T02:17:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f84b00b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b01584b0 0x7f84b014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b00c7e60 0x7f84b00ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00c6b70 con 0x7f849c003980 2023-07-09T02:17:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00c79d0 con 0x7f84b01584b0 2023-07-09T02:17:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00b1b10 con 0x7f84b00c7e60 2023-07-09T02:17:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f84b00b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f84b00b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55676/0 (socket says 172.21.15.45:55676) 2023-07-09T02:17:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 -- 172.21.15.45:0/313402355 learned_addr learned my addr 172.21.15.45:0/313402355 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b54c7640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b01584b0 0x7f84b014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 -- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b00c7e60 msgr2=0x7f84b00ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b64c9640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b00c7e60 0x7f84b00ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b00c7e60 0x7f84b00ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 -- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b01584b0 msgr2=0x7f84b014b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b01584b0 0x7f84b014b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 -- 172.21.15.45:0/313402355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00c6dc0 con 0x7f849c003980 2023-07-09T02:17:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b54c7640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b01584b0 0x7f84b014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b64c9640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b00c7e60 0x7f84b00ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b5cc8640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f84b00b15d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f84ac001940 tx=0x7f849c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84a67fc640 1 -- 172.21.15.45:0/313402355 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0b4070 con 0x7f849c003980 2023-07-09T02:17:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84a67fc640 1 -- 172.21.15.45:0/313402355 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac0015c0 con 0x7f849c003980 2023-07-09T02:17:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b00c70a0 con 0x7f849c003980 2023-07-09T02:17:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84a67fc640 1 -- 172.21.15.45:0/313402355 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0a59b0 con 0x7f849c003980 2023-07-09T02:17:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.676+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b00c7660 con 0x7f849c003980 2023-07-09T02:17:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.680+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b004d7d0 con 0x7f849c003980 2023-07-09T02:17:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.680+0000 7f84a67fc640 1 -- 172.21.15.45:0/313402355 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84ac0a5b10 con 0x7f849c003980 2023-07-09T02:17:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.680+0000 7f84a67fc640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.680+0000 7f84a67fc640 1 -- 172.21.15.45:0/313402355 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84ac11d7e0 con 0x7f849c003980 2023-07-09T02:17:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.680+0000 7f84b54c7640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.680+0000 7f84b54c7640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f84b00cf6e0 tx=0x7f84a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.684+0000 7f84a67fc640 1 -- 172.21.15.45:0/313402355 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84ac0eabc0 con 0x7f849c003980 2023-07-09T02:17:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.840+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f84b0071050 con 0x7f849c003980 2023-07-09T02:17:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.840+0000 7f84a67fc640 1 -- 172.21.15.45:0/313402355 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7f84ac0ee1e0 con 0x7f849c003980 2023-07-09T02:17:26.842 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:17:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 msgr2=0x7f8494068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f84b00cf6e0 tx=0x7f84a0008040 comp rx=0 tx=0).stop 2023-07-09T02:17:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 msgr2=0x7f84b00b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f84b00b15d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f84ac001940 tx=0x7f849c005800 comp rx=0 tx=0).stop 2023-07-09T02:17:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 shutdown_connections 2023-07-09T02:17:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84b00c7e60 0x7f84b00ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84b01584b0 0x7f84b014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 --2- 172.21.15.45:0/313402355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f849c003980 0x7f84b00b15d0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 >> 172.21.15.45:0/313402355 conn(0x7f84b00694b0 msgr2=0x7f84b00c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 shutdown_connections 2023-07-09T02:17:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:26.844+0000 7f84b7f2c640 1 -- 172.21.15.45:0/313402355 wait complete. 2023-07-09T02:17:26.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:17:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd7340640 1 Processor -- start 2023-07-09T02:17:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd7340640 1 -- start start 2023-07-09T02:17:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd7340640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfd00c8dc0 0x7fbfd00cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd7340640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd006ef30 con 0x7fbfd00cde40 2023-07-09T02:17:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd7340640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd006b210 con 0x7fbfd01604a0 2023-07-09T02:17:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd7340640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd006be90 con 0x7fbfd00c8dc0 2023-07-09T02:17:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd48db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfd00c8dc0 0x7fbfd00cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd58dd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbfd00cde40 0x7fbfd00caaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57892/0 (socket says 172.21.15.45:57892) 2023-07-09T02:17:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd58dd640 1 -- 172.21.15.45:0/2638639498 learned_addr learned my addr 172.21.15.45:0/2638639498 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:27.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd48db640 1 -- 172.21.15.45:0/2638639498 >> v1:172.21.15.155:6789/0 conn(0x7fbfd01604a0 legacy=0x7fbfd0164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd48db640 1 -- 172.21.15.45:0/2638639498 >> v1:172.21.15.45:6789/0 conn(0x7fbfd00cde40 legacy=0x7fbfd00caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfc7fff640 1 -- 172.21.15.45:0/2638639498 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88521148 0 0) 0x7fbfd006ef30 con 0x7fbfd00cde40 2023-07-09T02:17:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.008+0000 7fbfd48db640 1 -- 172.21.15.45:0/2638639498 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd006b4f0 con 0x7fbfd00c8dc0 2023-07-09T02:17:27.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfd48db640 1 --2- 172.21.15.45:0/2638639498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00c8dc0 0x7fbfd00cd900 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00097c0 tx=0x7fbfc001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb08fe624aceb36 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfc7fff640 1 -- 172.21.15.45:0/2638639498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00ab600 con 0x7fbfd00c8dc0 2023-07-09T02:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfc7fff640 1 -- 172.21.15.45:0/2638639498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00a7050 con 0x7fbfd00c8dc0 2023-07-09T02:17:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfc7fff640 1 -- 172.21.15.45:0/2638639498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00ab980 con 0x7fbfd00c8dc0 2023-07-09T02:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfd7340640 1 -- 172.21.15.45:0/2638639498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00c8dc0 msgr2=0x7fbfd00cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfd7340640 1 --2- 172.21.15.45:0/2638639498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00c8dc0 0x7fbfd00cd900 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00097c0 tx=0x7fbfc001c440 comp rx=0 tx=0).stop 2023-07-09T02:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfd7340640 1 -- 172.21.15.45:0/2638639498 shutdown_connections 2023-07-09T02:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfd7340640 1 --2- 172.21.15.45:0/2638639498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00c8dc0 0x7fbfd00cd900 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfd7340640 1 -- 172.21.15.45:0/2638639498 >> 172.21.15.45:0/2638639498 conn(0x7fbfd00694b0 msgr2=0x7fbfd00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfd7340640 1 -- 172.21.15.45:0/2638639498 shutdown_connections 2023-07-09T02:17:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.012+0000 7fbfd7340640 1 -- 172.21.15.45:0/2638639498 wait complete. 2023-07-09T02:17:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 Processor -- start 2023-07-09T02:17:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 -- start start 2023-07-09T02:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd00c8dc0 0x7fbfd0156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00cde40 0x7fbfd0155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd01604a0 0x7fbfd0161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00b1670 con 0x7fbfd00cde40 2023-07-09T02:17:27.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00b1950 con 0x7fbfd01604a0 2023-07-09T02:17:27.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00b1c30 con 0x7fbfd00c8dc0 2023-07-09T02:17:27.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00cde40 0x7fbfd0155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00cde40 0x7fbfd0155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55690/0 (socket says 172.21.15.45:55690) 2023-07-09T02:17:27.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 -- 172.21.15.45:0/3669514629 learned_addr learned my addr 172.21.15.45:0/3669514629 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:27.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd50dc640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd00c8dc0 0x7fbfd0156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd58dd640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd01604a0 0x7fbfd0161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 -- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd00c8dc0 msgr2=0x7fbfd0156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd00c8dc0 0x7fbfd0156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 -- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd01604a0 msgr2=0x7fbfd0161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd01604a0 0x7fbfd0161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 -- 172.21.15.45:0/3669514629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc0009420 con 0x7fbfd00cde40 2023-07-09T02:17:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd48db640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00cde40 0x7fbfd0155880 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00ae040 tx=0x7fbfc001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfc5ffb640 1 -- 172.21.15.45:0/3669514629 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00b7650 con 0x7fbfd00cde40 2023-07-09T02:17:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfc5ffb640 1 -- 172.21.15.45:0/3669514629 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc00b77d0 con 0x7fbfd00cde40 2023-07-09T02:17:27.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfc5ffb640 1 -- 172.21.15.45:0/3669514629 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc00b7b80 con 0x7fbfd00cde40 2023-07-09T02:17:27.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd00b1f10 con 0x7fbfd00cde40 2023-07-09T02:17:27.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.016+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd0155dc0 con 0x7fbfd00cde40 2023-07-09T02:17:27.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.020+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd004d7d0 con 0x7fbfd00cde40 2023-07-09T02:17:27.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.020+0000 7fbfc5ffb640 1 -- 172.21.15.45:0/3669514629 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbfc00b7ce0 con 0x7fbfd00cde40 2023-07-09T02:17:27.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.020+0000 7fbfc5ffb640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbfb4066280 0x7fbfb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.020+0000 7fbfc5ffb640 1 -- 172.21.15.45:0/3669514629 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfc011ea90 con 0x7fbfd00cde40 2023-07-09T02:17:27.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.020+0000 7fbfd50dc640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbfb4066280 0x7fbfb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.020+0000 7fbfd50dc640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbfb4066280 0x7fbfb4068730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00b810 tx=0x7fbfcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.024+0000 7fbfc5ffb640 1 -- 172.21.15.45:0/3669514629 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfc00ec020 con 0x7fbfd00cde40 2023-07-09T02:17:27.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.176+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfd006c740 con 0x7fbfd00cde40 2023-07-09T02:17:27.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.176+0000 7fbfc5ffb640 1 -- 172.21.15.45:0/3669514629 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbfc00ef640 con 0x7fbfd00cde40 2023-07-09T02:17:27.180 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:17:27.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbfb4066280 msgr2=0x7fbfb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbfb4066280 0x7fbfb4068730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00b810 tx=0x7fbfcc008040 comp rx=0 tx=0).stop 2023-07-09T02:17:27.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00cde40 msgr2=0x7fbfd0155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00cde40 0x7fbfd0155880 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00ae040 tx=0x7fbfc001ac80 comp rx=0 tx=0).stop 2023-07-09T02:17:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 shutdown_connections 2023-07-09T02:17:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfd01604a0 0x7fbfd0161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd00cde40 0x7fbfd0155880 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbfb4066280 0x7fbfb4068730 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 --2- 172.21.15.45:0/3669514629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfd00c8dc0 0x7fbfd0156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 >> 172.21.15.45:0/3669514629 conn(0x7fbfd00694b0 msgr2=0x7fbfd00b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 shutdown_connections 2023-07-09T02:17:27.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.180+0000 7fbfd7340640 1 -- 172.21.15.45:0/3669514629 wait complete. 2023-07-09T02:17:27.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:17:27.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c2d0d8640 1 Processor -- start 2023-07-09T02:17:27.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c2d0d8640 1 -- start start 2023-07-09T02:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c2d0d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c2815c060 0x7f0c280b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c2d0d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c280cd120 0x7f0c280d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c2d0d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0c280d2450 0x7f0c280d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c2d0d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c280d28f0 con 0x7f0c2815c060 2023-07-09T02:17:27.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c2d0d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c28160a50 con 0x7f0c280d2450 2023-07-09T02:17:27.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c2d0d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2815c430 con 0x7f0c280cd120 2023-07-09T02:17:27.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c26d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c2815c060 0x7f0c280b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c26d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0c2815c060 0x7f0c280b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55696/0 (socket says 172.21.15.45:55696) 2023-07-09T02:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c26d9d640 1 -- 172.21.15.45:0/3362790863 learned_addr learned my addr 172.21.15.45:0/3362790863 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.344+0000 7f0c1ffff640 1 --2- 172.21.15.45:0/3362790863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c280cd120 0x7f0c280d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c2759e640 1 --2- 172.21.15.45:0/3362790863 >> v2:172.21.15.155:3300/0 conn(0x7f0c280d2450 0x7f0c280d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c26d9d640 1 -- 172.21.15.45:0/3362790863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c280cd120 msgr2=0x7f0c280d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c26d9d640 1 --2- 172.21.15.45:0/3362790863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c280cd120 0x7f0c280d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c26d9d640 1 -- 172.21.15.45:0/3362790863 >> v2:172.21.15.155:3300/0 conn(0x7f0c280d2450 msgr2=0x7f0c280d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:27.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c26d9d640 1 --2- 172.21.15.45:0/3362790863 >> v2:172.21.15.155:3300/0 conn(0x7f0c280d2450 0x7f0c280d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c26d9d640 1 -- 172.21.15.45:0/3362790863 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2815fb60 con 0x7f0c2815c060 2023-07-09T02:17:27.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c2759e640 1 --2- 172.21.15.45:0/3362790863 >> v2:172.21.15.155:3300/0 conn(0x7f0c280d2450 0x7f0c280d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:27.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c26d9d640 1 --2- 172.21.15.45:0/3362790863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2815c060 0x7f0c280b4ed0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0c2806b120 tx=0x7f0c1801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a7a7be2b50c9c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c2659c640 1 -- 172.21.15.45:0/3362790863 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180ab600 con 0x7f0c2815c060 2023-07-09T02:17:27.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c2659c640 1 -- 172.21.15.45:0/3362790863 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c180a7050 con 0x7f0c2815c060 2023-07-09T02:17:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.348+0000 7f0c2659c640 1 -- 172.21.15.45:0/3362790863 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180ab980 con 0x7f0c2815c060 2023-07-09T02:17:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/3362790863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2815c060 msgr2=0x7f0c280b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/3362790863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2815c060 0x7f0c280b4ed0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0c2806b120 tx=0x7f0c1801c210 comp rx=0 tx=0).stop 2023-07-09T02:17:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/3362790863 shutdown_connections 2023-07-09T02:17:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/3362790863 >> v2:172.21.15.155:3300/0 conn(0x7f0c280d2450 0x7f0c280d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/3362790863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c280cd120 0x7f0c280d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/3362790863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c2815c060 0x7f0c280b4ed0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/3362790863 >> 172.21.15.45:0/3362790863 conn(0x7f0c280698e0 msgr2=0x7f0c28069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:27.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/3362790863 shutdown_connections 2023-07-09T02:17:27.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/3362790863 wait complete. 2023-07-09T02:17:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 Processor -- start 2023-07-09T02:17:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- start start 2023-07-09T02:17:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c280cd120 0x7f0c280c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c280d2450 0x7f0c2815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2815c060 0x7f0c2815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280ca460 con 0x7f0c280d2450 2023-07-09T02:17:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2815d570 con 0x7f0c280cd120 2023-07-09T02:17:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2d0d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2815d850 con 0x7f0c2815c060 2023-07-09T02:17:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c280d2450 0x7f0c2815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c280d2450 0x7f0c2815ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55704/0 (socket says 172.21.15.45:55704) 2023-07-09T02:17:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c1ffff640 1 -- 172.21.15.45:0/2338544058 learned_addr learned my addr 172.21.15.45:0/2338544058 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c26d9d640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c280cd120 0x7f0c280c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c2759e640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2815c060 0x7f0c2815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c1ffff640 1 -- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2815c060 msgr2=0x7f0c2815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c1ffff640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2815c060 0x7f0c2815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c1ffff640 1 -- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c280cd120 msgr2=0x7f0c280c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c1ffff640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c280cd120 0x7f0c280c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.352+0000 7f0c1ffff640 1 -- 172.21.15.45:0/2338544058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180094d0 con 0x7f0c280d2450 2023-07-09T02:17:27.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c1ffff640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c280d2450 0x7f0c2815ec50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009fd0 tx=0x7f0c1000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c1f7fe640 1 -- 172.21.15.45:0/2338544058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000c940 con 0x7f0c280d2450 2023-07-09T02:17:27.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c1f7fe640 1 -- 172.21.15.45:0/2338544058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000caa0 con 0x7f0c280d2450 2023-07-09T02:17:27.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2815db30 con 0x7f0c280d2450 2023-07-09T02:17:27.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c1f7fe640 1 -- 172.21.15.45:0/2338544058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000ce30 con 0x7f0c280d2450 2023-07-09T02:17:27.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c280c8c70 con 0x7f0c280d2450 2023-07-09T02:17:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c280ce440 con 0x7f0c280d2450 2023-07-09T02:17:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c1f7fe640 1 -- 172.21.15.45:0/2338544058 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c10013470 con 0x7f0c280d2450 2023-07-09T02:17:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c1f7fe640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c08066280 0x7f0c08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c1f7fe640 1 -- 172.21.15.45:0/2338544058 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c10083e90 con 0x7f0c280d2450 2023-07-09T02:17:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.356+0000 7f0c26d9d640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c08066280 0x7f0c08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.360+0000 7f0c26d9d640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c08066280 0x7f0c08068730 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0c180ad000 tx=0x7f0c180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.360+0000 7f0c1f7fe640 1 -- 172.21.15.45:0/2338544058 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c100513c0 con 0x7f0c280d2450 2023-07-09T02:17:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.512+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c2804d7d0 con 0x7f0c280d2450 2023-07-09T02:17:27.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c1f7fe640 1 -- 172.21.15.45:0/2338544058 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c100549e0 con 0x7f0c280d2450 2023-07-09T02:17:27.517 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:17:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c08066280 msgr2=0x7f0c08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c08066280 0x7f0c08068730 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0c180ad000 tx=0x7f0c180a6000 comp rx=0 tx=0).stop 2023-07-09T02:17:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c280d2450 msgr2=0x7f0c2815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c280d2450 0x7f0c2815ec50 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009fd0 tx=0x7f0c1000ed40 comp rx=0 tx=0).stop 2023-07-09T02:17:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 shutdown_connections 2023-07-09T02:17:27.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c08066280 0x7f0c08068730 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2815c060 0x7f0c2815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c280d2450 0x7f0c2815ec50 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 --2- 172.21.15.45:0/2338544058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c280cd120 0x7f0c280c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 >> 172.21.15.45:0/2338544058 conn(0x7f0c280698e0 msgr2=0x7f0c280b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 shutdown_connections 2023-07-09T02:17:27.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.516+0000 7f0c2d0d8640 1 -- 172.21.15.45:0/2338544058 wait complete. 2023-07-09T02:17:27.538 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:17:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f63689fa640 1 Processor -- start 2023-07-09T02:17:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f63689fa640 1 -- start start 2023-07-09T02:17:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f63689fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63640d2620 0x7f63640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f63689fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6364160a50 con 0x7f63640cd120 2023-07-09T02:17:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f63689fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636415c430 con 0x7f636415c060 2023-07-09T02:17:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f63689fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636415fb60 con 0x7f63640d2620 2023-07-09T02:17:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f6362d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f63640cd120 0x7f63640cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57898/0 (socket says 172.21.15.45:57898) 2023-07-09T02:17:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f6362d9d640 1 -- 172.21.15.45:0/2713533805 learned_addr learned my addr 172.21.15.45:0/2713533805 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f6361d9b640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63640d2620 0x7f63640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763037630 0 0) 0x7f6364160a50 con 0x7f63640cd120 2023-07-09T02:17:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f634c003530 con 0x7f63640cd120 2023-07-09T02:17:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716866637 0 0) 0x7f636415c430 con 0x7f636415c060 2023-07-09T02:17:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6364160a50 con 0x7f636415c060 2023-07-09T02:17:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 693300462 0 0) 0x7f634c003530 con 0x7f63640cd120 2023-07-09T02:17:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63640d2620 msgr2=0x7f63640b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63640d2620 0x7f63640b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 >> v1:172.21.15.155:6789/0 conn(0x7f636415c060 legacy=0x7f63640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636415fe40 con 0x7f63640cd120 2023-07-09T02:17:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f635c001a00 con 0x7f63640cd120 2023-07-09T02:17:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f6361d9b640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63640d2620 0x7f63640b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 >> v1:172.21.15.45:6789/0 conn(0x7f63640cd120 legacy=0x7f63640cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c003b40 0x7f634c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c0047d0 0x7f634c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c005180 0x7f634c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636415fb60 con 0x7f634c0047d0 2023-07-09T02:17:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c00bf50 con 0x7f634c005180 2023-07-09T02:17:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c00c110 con 0x7f634c003b40 2023-07-09T02:17:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f6361d9b640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c0047d0 0x7f634c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f636259c640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c003b40 0x7f634c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.684+0000 7f6362d9d640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c005180 0x7f634c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f6361d9b640 1 -- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c003b40 msgr2=0x7f634c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:27.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f6361d9b640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c003b40 0x7f634c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f6361d9b640 1 -- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c005180 msgr2=0x7f634c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:27.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f6361d9b640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c005180 0x7f634c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f6361d9b640 1 -- 172.21.15.45:0/2713533805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c003530 con 0x7f634c0047d0 2023-07-09T02:17:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f6361d9b640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c0047d0 0x7f634c004c40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f63640cdfc0 tx=0x7f635801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902f618e6ca07e22 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358004030 con 0x7f634c0047d0 2023-07-09T02:17:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63580a7070 con 0x7f634c0047d0 2023-07-09T02:17:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f636159a640 1 -- 172.21.15.45:0/2713533805 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358004390 con 0x7f634c0047d0 2023-07-09T02:17:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f63689fa640 1 -- 172.21.15.45:0/2713533805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c0047d0 msgr2=0x7f634c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f63689fa640 1 --2- 172.21.15.45:0/2713533805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f634c0047d0 0x7f634c004c40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f63640cdfc0 tx=0x7f635801c9d0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f6362d9d640 1 -- 172.21.15.45:0/2713533805 reap_dead start 2023-07-09T02:17:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f63689fa640 1 -- 172.21.15.45:0/2713533805 shutdown_connections 2023-07-09T02:17:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f63689fa640 1 -- 172.21.15.45:0/2713533805 >> 172.21.15.45:0/2713533805 conn(0x7f63640698e0 msgr2=0x7f6364069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f63689fa640 1 -- 172.21.15.45:0/2713533805 shutdown_connections 2023-07-09T02:17:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.688+0000 7f63689fa640 1 -- 172.21.15.45:0/2713533805 wait complete. 2023-07-09T02:17:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 Processor -- start 2023-07-09T02:17:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 -- start start 2023-07-09T02:17:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c0047d0 0x7f636415f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63640b15d0 0x7f63640ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63640b6f60 0x7f63640b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640b7920 con 0x7f63640b6f60 2023-07-09T02:17:27.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63641f2360 con 0x7f63640b15d0 2023-07-09T02:17:27.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63641f1a30 con 0x7f634c0047d0 2023-07-09T02:17:27.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63640b6f60 0x7f63640b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63640b6f60 0x7f63640b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55710/0 (socket says 172.21.15.45:55710) 2023-07-09T02:17:27.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 -- 172.21.15.45:0/978480697 learned_addr learned my addr 172.21.15.45:0/978480697 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f636259c640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c0047d0 0x7f636415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6361d9b640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63640b15d0 0x7f63640ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 -- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c0047d0 msgr2=0x7f636415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c0047d0 0x7f636415f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 -- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63640b15d0 msgr2=0x7f63640ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63640b15d0 0x7f63640ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 -- 172.21.15.45:0/978480697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63641f1d10 con 0x7f63640b6f60 2023-07-09T02:17:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6361d9b640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63640b15d0 0x7f63640ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6362d9d640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63640b6f60 0x7f63640b73e0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f636406b120 tx=0x7f635c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6352ffd640 1 -- 172.21.15.45:0/978480697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c001260 con 0x7f63640b6f60 2023-07-09T02:17:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6352ffd640 1 -- 172.21.15.45:0/978480697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c012560 con 0x7f63640b6f60 2023-07-09T02:17:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63641f1ff0 con 0x7f63640b6f60 2023-07-09T02:17:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f6352ffd640 1 -- 172.21.15.45:0/978480697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c012910 con 0x7f63640b6f60 2023-07-09T02:17:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.692+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63640cae50 con 0x7f63640b6f60 2023-07-09T02:17:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.696+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63641f2180 con 0x7f63640b6f60 2023-07-09T02:17:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.696+0000 7f6352ffd640 1 -- 172.21.15.45:0/978480697 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f635c012a70 con 0x7f63640b6f60 2023-07-09T02:17:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.696+0000 7f6352ffd640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63440662b0 0x7f6344068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.696+0000 7f6352ffd640 1 -- 172.21.15.45:0/978480697 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f635c083c10 con 0x7f63640b6f60 2023-07-09T02:17:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.696+0000 7f636259c640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63440662b0 0x7f6344068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.696+0000 7f636259c640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63440662b0 0x7f6344068760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6354005630 tx=0x7f6354009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.700+0000 7f6352ffd640 1 -- 172.21.15.45:0/978480697 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f635c050ff0 con 0x7f63640b6f60 2023-07-09T02:17:27.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f636404d7d0 con 0x7f63640b6f60 2023-07-09T02:17:27.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f6352ffd640 1 -- 172.21.15.45:0/978480697 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v126) v1 ==== 80+0+0 (secure 0 0 0) 0x7f635c054610 con 0x7f63640b6f60 2023-07-09T02:17:27.870 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:17:27.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63440662b0 msgr2=0x7f6344068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63440662b0 0x7f6344068760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6354005630 tx=0x7f6354009040 comp rx=0 tx=0).stop 2023-07-09T02:17:27.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63640b6f60 msgr2=0x7f63640b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63640b6f60 0x7f63640b73e0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f636406b120 tx=0x7f635c007800 comp rx=0 tx=0).stop 2023-07-09T02:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 shutdown_connections 2023-07-09T02:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63640b6f60 0x7f63640b73e0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63640b15d0 0x7f63640ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63440662b0 0x7f6344068760 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 --2- 172.21.15.45:0/978480697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f634c0047d0 0x7f636415f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:27.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 >> 172.21.15.45:0/978480697 conn(0x7f63640698e0 msgr2=0x7f63640b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:27.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 shutdown_connections 2023-07-09T02:17:27.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:27.868+0000 7f63689fa640 1 -- 172.21.15.45:0/978480697 wait complete. 2023-07-09T02:17:27.891 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:17:27.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:27.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:27.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:17:27.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:27.982 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:17:27.992 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:27.993 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:28.002 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:28.003 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:28.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.192+0000 7f2bfa29e640 1 Processor -- start 2023-07-09T02:17:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.192+0000 7f2bfa29e640 1 -- start start 2023-07-09T02:17:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.192+0000 7f2bfa29e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2bf406c110 0x7f2bf406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.192+0000 7f2bfa29e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bf40caec0 0x7f2bf40cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bfa29e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf406caa0 con 0x7f2bf4158e30 2023-07-09T02:17:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bfa29e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf40ccf80 con 0x7f2bf40caec0 2023-07-09T02:17:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bfa29e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf40cd540 con 0x7f2bf406c110 2023-07-09T02:17:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf883b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bf40caec0 0x7f2bf40cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf883b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bf40caec0 0x7f2bf40cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55712/0 (socket says 172.21.15.45:55712) 2023-07-09T02:17:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf883b640 1 -- 172.21.15.45:0/1738652558 learned_addr learned my addr 172.21.15.45:0/1738652558 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf37fe640 1 --2- 172.21.15.45:0/1738652558 >> v2:172.21.15.155:3300/0 conn(0x7f2bf406c110 0x7f2bf406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf883b640 1 -- 172.21.15.45:0/1738652558 >> v2:172.21.15.155:3300/0 conn(0x7f2bf406c110 msgr2=0x7f2bf406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf883b640 1 --2- 172.21.15.45:0/1738652558 >> v2:172.21.15.155:3300/0 conn(0x7f2bf406c110 0x7f2bf406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf883b640 1 -- 172.21.15.45:0/1738652558 >> v1:172.21.15.155:6789/0 conn(0x7f2bf4158e30 legacy=0x7f2bf406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf883b640 1 -- 172.21.15.45:0/1738652558 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40cb840 con 0x7f2bf40caec0 2023-07-09T02:17:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf883b640 1 --2- 172.21.15.45:0/1738652558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf40caec0 0x7f2bf40cb300 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2bf406f260 tx=0x7f2bec01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfbcd367acd38d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf2ffd640 1 -- 172.21.15.45:0/1738652558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0a57d0 con 0x7f2bf40caec0 2023-07-09T02:17:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf2ffd640 1 -- 172.21.15.45:0/1738652558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec0a5930 con 0x7f2bf40caec0 2023-07-09T02:17:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.196+0000 7f2bf2ffd640 1 -- 172.21.15.45:0/1738652558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0a5cc0 con 0x7f2bf40caec0 2023-07-09T02:17:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- 172.21.15.45:0/1738652558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf40caec0 msgr2=0x7f2bf40cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/1738652558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf40caec0 0x7f2bf40cb300 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2bf406f260 tx=0x7f2bec01c910 comp rx=0 tx=0).stop 2023-07-09T02:17:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- 172.21.15.45:0/1738652558 shutdown_connections 2023-07-09T02:17:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/1738652558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf40caec0 0x7f2bf40cb300 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/1738652558 >> v2:172.21.15.155:3300/0 conn(0x7f2bf406c110 0x7f2bf406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- 172.21.15.45:0/1738652558 >> 172.21.15.45:0/1738652558 conn(0x7f2bf40694b0 msgr2=0x7f2bf40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- 172.21.15.45:0/1738652558 shutdown_connections 2023-07-09T02:17:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- 172.21.15.45:0/1738652558 wait complete. 2023-07-09T02:17:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 Processor -- start 2023-07-09T02:17:28.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- start start 2023-07-09T02:17:28.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf406c110 0x7f2bf414aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf40caec0 0x7f2bf4156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf4158e30 0x7f2bf4156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf414b780 con 0x7f2bf4158e30 2023-07-09T02:17:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40b0650 con 0x7f2bf406c110 2023-07-09T02:17:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bfa29e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf41599b0 con 0x7f2bf40caec0 2023-07-09T02:17:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bf883b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf4158e30 0x7f2bf4156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bf883b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf4158e30 0x7f2bf4156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55724/0 (socket says 172.21.15.45:55724) 2023-07-09T02:17:28.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bf883b640 1 -- 172.21.15.45:0/12869289 learned_addr learned my addr 172.21.15.45:0/12869289 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:28.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bf3fff640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf406c110 0x7f2bf414aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.200+0000 7f2bf37fe640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf40caec0 0x7f2bf4156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf883b640 1 -- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf40caec0 msgr2=0x7f2bf4156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf883b640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf40caec0 0x7f2bf4156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf883b640 1 -- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf406c110 msgr2=0x7f2bf414aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf883b640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf406c110 0x7f2bf414aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf883b640 1 -- 172.21.15.45:0/12869289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009b30 con 0x7f2bf4158e30 2023-07-09T02:17:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf883b640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf4158e30 0x7f2bf4156ca0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2bec019520 tx=0x7f2bec0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf0ff9640 1 -- 172.21.15.45:0/12869289 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0b8670 con 0x7f2bf4158e30 2023-07-09T02:17:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf0ff9640 1 -- 172.21.15.45:0/12869289 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec0b87d0 con 0x7f2bf4158e30 2023-07-09T02:17:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf0ff9640 1 -- 172.21.15.45:0/12869289 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0b8b60 con 0x7f2bf4158e30 2023-07-09T02:17:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf4159c90 con 0x7f2bf4158e30 2023-07-09T02:17:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf415a250 con 0x7f2bf4158e30 2023-07-09T02:17:28.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf415a440 con 0x7f2bf4158e30 2023-07-09T02:17:28.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf0ff9640 1 -- 172.21.15.45:0/12869289 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2bec0b8cc0 con 0x7f2bf4158e30 2023-07-09T02:17:28.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf0ff9640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2be0066280 0x7f2be0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.204+0000 7f2bf0ff9640 1 -- 172.21.15.45:0/12869289 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bec11f330 con 0x7f2bf4158e30 2023-07-09T02:17:28.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.208+0000 7f2bf3fff640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2be0066280 0x7f2be0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.208+0000 7f2bf3fff640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2be0066280 0x7f2be0068730 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2bf41f86a0 tx=0x7f2be4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.208+0000 7f2bf0ff9640 1 -- 172.21.15.45:0/12869289 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2bec0ec7c0 con 0x7f2bf4158e30 2023-07-09T02:17:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.364+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bf404d7d0 con 0x7f2bf4158e30 2023-07-09T02:17:28.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.364+0000 7f2bf0ff9640 1 -- 172.21.15.45:0/12869289 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f2bec0efde0 con 0x7f2bf4158e30 2023-07-09T02:17:28.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:28.368 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":126,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:23.740952+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:28.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2be0066280 msgr2=0x7f2be0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2be0066280 0x7f2be0068730 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2bf41f86a0 tx=0x7f2be4009040 comp rx=0 tx=0).stop 2023-07-09T02:17:28.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf4158e30 msgr2=0x7f2bf4156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf4158e30 0x7f2bf4156ca0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2bec019520 tx=0x7f2bec0196b0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 shutdown_connections 2023-07-09T02:17:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf4158e30 0x7f2bf4156ca0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2be0066280 0x7f2be0068730 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bf40caec0 0x7f2bf4156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 --2- 172.21.15.45:0/12869289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bf406c110 0x7f2bf414aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 >> 172.21.15.45:0/12869289 conn(0x7f2bf40694b0 msgr2=0x7f2bf4070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 shutdown_connections 2023-07-09T02:17:28.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.368+0000 7f2bfa29e640 1 -- 172.21.15.45:0/12869289 wait complete. 2023-07-09T02:17:28.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:17:10.149383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:17:11.041822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:17:28.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:17:28.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e461c5640 1 Processor -- start 2023-07-09T02:17:28.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e461c5640 1 -- start start 2023-07-09T02:17:28.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e461c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c8f70 0x7f1e4006b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e461c5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1e40156340 0x7f1e40159660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e461c5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4006b690 con 0x7f1e400c9340 2023-07-09T02:17:28.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e461c5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4006b970 con 0x7f1e40156340 2023-07-09T02:17:28.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e461c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4006bc50 con 0x7f1e400c8f70 2023-07-09T02:17:28.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e3ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1e40156340 0x7f1e40159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e3ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1e40156340 0x7f1e40159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55728/0 (socket says 172.21.15.45:55728) 2023-07-09T02:17:28.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e3ffff640 1 -- 172.21.15.45:0/73420768 learned_addr learned my addr 172.21.15.45:0/73420768 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:28.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e3f7fe640 1 --2- 172.21.15.45:0/73420768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c8f70 0x7f1e4006b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e3ffff640 1 -- 172.21.15.45:0/73420768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c8f70 msgr2=0x7f1e4006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:28.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e3ffff640 1 --2- 172.21.15.45:0/73420768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c8f70 0x7f1e4006b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e3ffff640 1 -- 172.21.15.45:0/73420768 >> v1:172.21.15.155:6789/0 conn(0x7f1e400c9340 legacy=0x7f1e40155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.536+0000 7f1e3ffff640 1 -- 172.21.15.45:0/73420768 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4006bf30 con 0x7f1e40156340 2023-07-09T02:17:28.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e3ffff640 1 --2- 172.21.15.45:0/73420768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e40156340 0x7f1e40159660 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800d150 tx=0x7f1e38021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b9cabcb073b8f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e3effd640 1 -- 172.21.15.45:0/73420768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380b3410 con 0x7f1e40156340 2023-07-09T02:17:28.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e3effd640 1 -- 172.21.15.45:0/73420768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e380ad030 con 0x7f1e40156340 2023-07-09T02:17:28.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e3effd640 1 -- 172.21.15.45:0/73420768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380b3790 con 0x7f1e40156340 2023-07-09T02:17:28.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 -- 172.21.15.45:0/73420768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e40156340 msgr2=0x7f1e40159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 --2- 172.21.15.45:0/73420768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e40156340 0x7f1e40159660 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800d150 tx=0x7f1e38021400 comp rx=0 tx=0).stop 2023-07-09T02:17:28.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 -- 172.21.15.45:0/73420768 shutdown_connections 2023-07-09T02:17:28.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 --2- 172.21.15.45:0/73420768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e40156340 0x7f1e40159660 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 --2- 172.21.15.45:0/73420768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c8f70 0x7f1e4006b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 -- 172.21.15.45:0/73420768 >> 172.21.15.45:0/73420768 conn(0x7f1e400694b0 msgr2=0x7f1e400698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:28.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 -- 172.21.15.45:0/73420768 shutdown_connections 2023-07-09T02:17:28.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 -- 172.21.15.45:0/73420768 wait complete. 2023-07-09T02:17:28.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 Processor -- start 2023-07-09T02:17:28.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.540+0000 7f1e461c5640 1 -- start start 2023-07-09T02:17:28.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e400c8f70 0x7f1e400b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c9340 0x7f1e400b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e40156340 0x7f1e400c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400b30b0 con 0x7f1e400c8f70 2023-07-09T02:17:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400b0b80 con 0x7f1e40156340 2023-07-09T02:17:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400b2a80 con 0x7f1e400c9340 2023-07-09T02:17:28.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e400c8f70 0x7f1e400b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e400c8f70 0x7f1e400b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55742/0 (socket says 172.21.15.45:55742) 2023-07-09T02:17:28.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 -- 172.21.15.45:0/1179475645 learned_addr learned my addr 172.21.15.45:0/1179475645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:28.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3ffff640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e40156340 0x7f1e400c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e37fff640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c9340 0x7f1e400b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 -- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c9340 msgr2=0x7f1e400b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c9340 0x7f1e400b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 -- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e40156340 msgr2=0x7f1e400c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e40156340 0x7f1e400c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 -- 172.21.15.45:0/1179475645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3800bd40 con 0x7f1e400c8f70 2023-07-09T02:17:28.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3f7fe640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e400c8f70 0x7f1e400b0070 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000d830 tx=0x7f1e3000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3cff9640 1 -- 172.21.15.45:0/1179475645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000b6c0 con 0x7f1e400c8f70 2023-07-09T02:17:28.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3cff9640 1 -- 172.21.15.45:0/1179475645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3000b820 con 0x7f1e400c8f70 2023-07-09T02:17:28.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e3cff9640 1 -- 172.21.15.45:0/1179475645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000bb90 con 0x7f1e400c8f70 2023-07-09T02:17:28.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e401520c0 con 0x7f1e400c8f70 2023-07-09T02:17:28.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e400b2cd0 con 0x7f1e400c8f70 2023-07-09T02:17:28.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.544+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e400b3320 con 0x7f1e400c8f70 2023-07-09T02:17:28.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.548+0000 7f1e3cff9640 1 -- 172.21.15.45:0/1179475645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e3001e460 con 0x7f1e400c8f70 2023-07-09T02:17:28.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.548+0000 7f1e3cff9640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1e20066280 0x7f1e20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.548+0000 7f1e3cff9640 1 -- 172.21.15.45:0/1179475645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e300842e0 con 0x7f1e400c8f70 2023-07-09T02:17:28.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.548+0000 7f1e37fff640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1e20066280 0x7f1e20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.548+0000 7f1e37fff640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1e20066280 0x7f1e20068730 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1e400c5250 tx=0x7f1e28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.552+0000 7f1e3cff9640 1 -- 172.21.15.45:0/1179475645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e300518a0 con 0x7f1e400c8f70 2023-07-09T02:17:28.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.708+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e4004d7d0 con 0x7f1e400c8f70 2023-07-09T02:17:28.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.708+0000 7f1e3cff9640 1 -- 172.21.15.45:0/1179475645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e30054ec0 con 0x7f1e400c8f70 2023-07-09T02:17:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:17:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1e20066280 msgr2=0x7f1e20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1e20066280 0x7f1e20068730 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1e400c5250 tx=0x7f1e28009040 comp rx=0 tx=0).stop 2023-07-09T02:17:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e400c8f70 msgr2=0x7f1e400b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e400c8f70 0x7f1e400b0070 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000d830 tx=0x7f1e3000dcf0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 shutdown_connections 2023-07-09T02:17:28.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e40156340 0x7f1e400c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1e20066280 0x7f1e20068730 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e400c9340 0x7f1e400b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 --2- 172.21.15.45:0/1179475645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e400c8f70 0x7f1e400b0070 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 >> 172.21.15.45:0/1179475645 conn(0x7f1e400694b0 msgr2=0x7f1e40154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 shutdown_connections 2023-07-09T02:17:28.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.712+0000 7f1e461c5640 1 -- 172.21.15.45:0/1179475645 wait complete. 2023-07-09T02:17:28.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:17:28.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afbc19640 1 Processor -- start 2023-07-09T02:17:28.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afbc19640 1 -- start start 2023-07-09T02:17:28.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afbc19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8af40cd120 0x7f8af40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afbc19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af4160a50 con 0x7f8af40d2620 2023-07-09T02:17:28.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afbc19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af415c430 con 0x7f8af415c060 2023-07-09T02:17:28.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afbc19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af415fb60 con 0x7f8af40cd120 2023-07-09T02:17:28.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8af91b4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8af40d2620 0x7f8af40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57900/0 (socket says 172.21.15.45:57900) 2023-07-09T02:17:28.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8af91b4640 1 -- 172.21.15.45:0/377488927 learned_addr learned my addr 172.21.15.45:0/377488927 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:28.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afa1b6640 1 --2- 172.21.15.45:0/377488927 >> v2:172.21.15.155:3300/0 conn(0x7f8af40cd120 0x7f8af40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8af89b3640 1 -- 172.21.15.45:0/377488927 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355424532 0 0) 0x7f8af4160a50 con 0x7f8af40d2620 2023-07-09T02:17:28.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8af89b3640 1 -- 172.21.15.45:0/377488927 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae0003530 con 0x7f8af40d2620 2023-07-09T02:17:28.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8af89b3640 1 -- 172.21.15.45:0/377488927 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 542698779 0 0) 0x7f8ae0003530 con 0x7f8af40d2620 2023-07-09T02:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afa1b6640 1 -- 172.21.15.45:0/377488927 >> v1:172.21.15.155:6789/0 conn(0x7f8af415c060 legacy=0x7f8af40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afa1b6640 1 -- 172.21.15.45:0/377488927 >> v1:172.21.15.45:6789/0 conn(0x7f8af40d2620 legacy=0x7f8af40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.880+0000 7f8afa1b6640 1 -- 172.21.15.45:0/377488927 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af415fe40 con 0x7f8af40cd120 2023-07-09T02:17:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8afa1b6640 1 --2- 172.21.15.45:0/377488927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af40cd120 0x7f8af40b4ed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009d90 tx=0x7f8aec01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e2d73a65b8643 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8af89b3640 1 -- 172.21.15.45:0/377488927 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4001680 con 0x7f8af40cd120 2023-07-09T02:17:28.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8af89b3640 1 -- 172.21.15.45:0/377488927 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec0a5680 con 0x7f8af40cd120 2023-07-09T02:17:28.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8af89b3640 1 -- 172.21.15.45:0/377488927 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0a5a10 con 0x7f8af40cd120 2023-07-09T02:17:28.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8afbc19640 1 -- 172.21.15.45:0/377488927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af40cd120 msgr2=0x7f8af40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8afbc19640 1 --2- 172.21.15.45:0/377488927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af40cd120 0x7f8af40b4ed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009d90 tx=0x7f8aec01c840 comp rx=0 tx=0).stop 2023-07-09T02:17:28.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8afbc19640 1 -- 172.21.15.45:0/377488927 shutdown_connections 2023-07-09T02:17:28.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8afbc19640 1 --2- 172.21.15.45:0/377488927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af40cd120 0x7f8af40b4ed0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8afbc19640 1 -- 172.21.15.45:0/377488927 >> 172.21.15.45:0/377488927 conn(0x7f8af40698e0 msgr2=0x7f8af4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:28.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8afbc19640 1 -- 172.21.15.45:0/377488927 shutdown_connections 2023-07-09T02:17:28.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.884+0000 7f8afbc19640 1 -- 172.21.15.45:0/377488927 wait complete. 2023-07-09T02:17:28.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 Processor -- start 2023-07-09T02:17:28.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 -- start start 2023-07-09T02:17:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8af40cd120 0x7f8af4152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40d2620 0x7f8af4153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af415c060 0x7f8af415e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4153a30 con 0x7f8af40d2620 2023-07-09T02:17:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af41527b0 con 0x7f8af415c060 2023-07-09T02:17:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4152e20 con 0x7f8af40cd120 2023-07-09T02:17:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40d2620 0x7f8af4153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40d2620 0x7f8af4153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55744/0 (socket says 172.21.15.45:55744) 2023-07-09T02:17:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 -- 172.21.15.45:0/1717303452 learned_addr learned my addr 172.21.15.45:0/1717303452 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afa1b6640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af415c060 0x7f8af415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af99b5640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8af40cd120 0x7f8af4152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 -- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8af40cd120 msgr2=0x7f8af4152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8af40cd120 0x7f8af4152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 -- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af415c060 msgr2=0x7f8af415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af415c060 0x7f8af415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 -- 172.21.15.45:0/1717303452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec009a70 con 0x7f8af40d2620 2023-07-09T02:17:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8af91b4640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40d2620 0x7f8af4153ec0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c750 tx=0x7f8ae400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8aea7fc640 1 -- 172.21.15.45:0/1717303452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4005ae0 con 0x7f8af40d2620 2023-07-09T02:17:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8aea7fc640 1 -- 172.21.15.45:0/1717303452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4005c40 con 0x7f8af40d2620 2023-07-09T02:17:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af40b59f0 con 0x7f8af40d2620 2023-07-09T02:17:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8aea7fc640 1 -- 172.21.15.45:0/1717303452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4007290 con 0x7f8af40d2620 2023-07-09T02:17:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.888+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af41533e0 con 0x7f8af40d2620 2023-07-09T02:17:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.892+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af404d7d0 con 0x7f8af40d2620 2023-07-09T02:17:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.892+0000 7f8aea7fc640 1 -- 172.21.15.45:0/1717303452 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ae40073f0 con 0x7f8af40d2620 2023-07-09T02:17:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.892+0000 7f8aea7fc640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ad8066280 0x7f8ad8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.892+0000 7f8aea7fc640 1 -- 172.21.15.45:0/1717303452 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ae4083390 con 0x7f8af40d2620 2023-07-09T02:17:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.892+0000 7f8af99b5640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ad8066280 0x7f8ad8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.892+0000 7f8af99b5640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ad8066280 0x7f8ad8068730 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8af40b1ad0 tx=0x7f8af0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:28.896+0000 7f8aea7fc640 1 -- 172.21.15.45:0/1717303452 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ae4050950 con 0x7f8af40d2620 2023-07-09T02:17:29.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.052+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8af406baa0 con 0x7f8af40d2620 2023-07-09T02:17:29.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8aea7fc640 1 -- 172.21.15.45:0/1717303452 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ae4053f70 con 0x7f8af40d2620 2023-07-09T02:17:29.057 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:17:29.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ad8066280 msgr2=0x7f8ad8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ad8066280 0x7f8ad8068730 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8af40b1ad0 tx=0x7f8af0009040 comp rx=0 tx=0).stop 2023-07-09T02:17:29.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40d2620 msgr2=0x7f8af4153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40d2620 0x7f8af4153ec0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c750 tx=0x7f8ae400cc10 comp rx=0 tx=0).stop 2023-07-09T02:17:29.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 shutdown_connections 2023-07-09T02:17:29.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8af415c060 0x7f8af415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8af40d2620 0x7f8af4153ec0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ad8066280 0x7f8ad8068730 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 --2- 172.21.15.45:0/1717303452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8af40cd120 0x7f8af4152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 >> 172.21.15.45:0/1717303452 conn(0x7f8af40698e0 msgr2=0x7f8af40b6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:29.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 shutdown_connections 2023-07-09T02:17:29.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.056+0000 7f8afbc19640 1 -- 172.21.15.45:0/1717303452 wait complete. 2023-07-09T02:17:29.077 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:17:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.220+0000 7fd32ddc5640 1 Processor -- start 2023-07-09T02:17:29.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.220+0000 7fd32ddc5640 1 -- start start 2023-07-09T02:17:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd32ddc5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3280cd120 0x7fd3280b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd32ddc5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd328160a50 con 0x7fd3280d2620 2023-07-09T02:17:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd32ddc5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32815c430 con 0x7fd32815c060 2023-07-09T02:17:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd32ddc5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32815fb60 con 0x7fd3280cd120 2023-07-09T02:17:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd327fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3280cd120 0x7fd3280b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd31ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd3280d2620 0x7fd3280cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57916/0 (socket says 172.21.15.45:57916) 2023-07-09T02:17:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd31ffff640 1 -- 172.21.15.45:0/4031654595 learned_addr learned my addr 172.21.15.45:0/4031654595 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:29.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd327fff640 1 -- 172.21.15.45:0/4031654595 >> v1:172.21.15.155:6789/0 conn(0x7fd32815c060 legacy=0x7fd3280d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd327fff640 1 -- 172.21.15.45:0/4031654595 >> v1:172.21.15.45:6789/0 conn(0x7fd3280d2620 legacy=0x7fd3280cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd327fff640 1 -- 172.21.15.45:0/4031654595 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32815fe40 con 0x7fd3280cd120 2023-07-09T02:17:29.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.224+0000 7fd326ffd640 1 -- 172.21.15.45:0/4031654595 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923949714 0 0) 0x7fd328160a50 con 0x7fd3280d2620 2023-07-09T02:17:29.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd327fff640 1 --2- 172.21.15.45:0/4031654595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280cd120 0x7fd3280b4ed0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd320009d90 tx=0x7fd32001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc0084f69c3c5a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd326ffd640 1 -- 172.21.15.45:0/4031654595 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3200a59e0 con 0x7fd3280cd120 2023-07-09T02:17:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd326ffd640 1 -- 172.21.15.45:0/4031654595 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3200a5b40 con 0x7fd3280cd120 2023-07-09T02:17:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd326ffd640 1 -- 172.21.15.45:0/4031654595 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3200ad440 con 0x7fd3280cd120 2023-07-09T02:17:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 -- 172.21.15.45:0/4031654595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280cd120 msgr2=0x7fd3280b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 --2- 172.21.15.45:0/4031654595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280cd120 0x7fd3280b4ed0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd320009d90 tx=0x7fd32001c920 comp rx=0 tx=0).stop 2023-07-09T02:17:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 -- 172.21.15.45:0/4031654595 shutdown_connections 2023-07-09T02:17:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 --2- 172.21.15.45:0/4031654595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280cd120 0x7fd3280b4ed0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 -- 172.21.15.45:0/4031654595 >> 172.21.15.45:0/4031654595 conn(0x7fd3280698e0 msgr2=0x7fd328069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 -- 172.21.15.45:0/4031654595 shutdown_connections 2023-07-09T02:17:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 -- 172.21.15.45:0/4031654595 wait complete. 2023-07-09T02:17:29.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 Processor -- start 2023-07-09T02:17:29.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.228+0000 7fd32ddc5640 1 -- start start 2023-07-09T02:17:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3280cd120 0x7fd32815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280d2620 0x7fd328154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32815c060 0x7fd3280cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32815aac0 con 0x7fd3280d2620 2023-07-09T02:17:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32815d670 con 0x7fd3280cd120 2023-07-09T02:17:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32815b590 con 0x7fd32815c060 2023-07-09T02:17:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280d2620 0x7fd328154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280d2620 0x7fd328154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55762/0 (socket says 172.21.15.45:55762) 2023-07-09T02:17:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 -- 172.21.15.45:0/2505678202 learned_addr learned my addr 172.21.15.45:0/2505678202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 -- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32815c060 msgr2=0x7fd3280cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32815c060 0x7fd3280cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 -- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3280cd120 msgr2=0x7fd32815a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3280cd120 0x7fd32815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 -- 172.21.15.45:0/2505678202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320009a70 con 0x7fd3280d2620 2023-07-09T02:17:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd31ffff640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280d2620 0x7fd328154fd0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fd31000c480 tx=0x7fd31000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd324ff9640 1 -- 172.21.15.45:0/2505678202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3100074e0 con 0x7fd3280d2620 2023-07-09T02:17:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd324ff9640 1 -- 172.21.15.45:0/2505678202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310007640 con 0x7fd3280d2620 2023-07-09T02:17:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd324ff9640 1 -- 172.21.15.45:0/2505678202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310004a30 con 0x7fd3280d2620 2023-07-09T02:17:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280b59f0 con 0x7fd3280d2620 2023-07-09T02:17:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32815afd0 con 0x7fd3280d2620 2023-07-09T02:17:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32804d7d0 con 0x7fd3280d2620 2023-07-09T02:17:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.232+0000 7fd324ff9640 1 -- 172.21.15.45:0/2505678202 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd310004b90 con 0x7fd3280d2620 2023-07-09T02:17:29.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.236+0000 7fd324ff9640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd308066280 0x7fd308068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.236+0000 7fd324ff9640 1 -- 172.21.15.45:0/2505678202 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd310082ed0 con 0x7fd3280d2620 2023-07-09T02:17:29.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.236+0000 7fd3277fe640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd308066280 0x7fd308068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.236+0000 7fd3277fe640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd308066280 0x7fd308068730 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd318000f70 tx=0x7fd3180079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.240+0000 7fd324ff9640 1 -- 172.21.15.45:0/2505678202 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3100503f0 con 0x7fd3280d2620 2023-07-09T02:17:29.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.392+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd32815d7e0 con 0x7fd3280d2620 2023-07-09T02:17:29.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.392+0000 7fd324ff9640 1 -- 172.21.15.45:0/2505678202 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd310018020 con 0x7fd3280d2620 2023-07-09T02:17:29.395 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:17:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd308066280 msgr2=0x7fd308068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd308066280 0x7fd308068730 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd318000f70 tx=0x7fd3180079c0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280d2620 msgr2=0x7fd328154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280d2620 0x7fd328154fd0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fd31000c480 tx=0x7fd31000c940 comp rx=0 tx=0).stop 2023-07-09T02:17:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 shutdown_connections 2023-07-09T02:17:29.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd308066280 0x7fd308068730 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd32815c060 0x7fd3280cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3280d2620 0x7fd328154fd0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 --2- 172.21.15.45:0/2505678202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3280cd120 0x7fd32815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 >> 172.21.15.45:0/2505678202 conn(0x7fd3280698e0 msgr2=0x7fd3280b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:29.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 shutdown_connections 2023-07-09T02:17:29.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.396+0000 7fd32ddc5640 1 -- 172.21.15.45:0/2505678202 wait complete. 2023-07-09T02:17:29.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:17:29.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.560+0000 7fd63a5fa640 1 Processor -- start 2023-07-09T02:17:29.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.560+0000 7fd63a5fa640 1 -- start start 2023-07-09T02:17:29.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.560+0000 7fd63a5fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63406b800 0x7fd63406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.560+0000 7fd63a5fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6340694b0 0x7fd6340ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.560+0000 7fd63a5fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63406c110 con 0x7fd6340ac870 2023-07-09T02:17:29.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.560+0000 7fd63a5fa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6340acde0 con 0x7fd6340694b0 2023-07-09T02:17:29.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.560+0000 7fd63a5fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340ad0c0 con 0x7fd63406b800 2023-07-09T02:17:29.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd633fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63406b800 0x7fd63406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd633fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63406b800 0x7fd63406bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:43720/0 (socket says 172.21.15.45:43720) 2023-07-09T02:17:29.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd633fff640 1 -- 172.21.15.45:0/2465543836 learned_addr learned my addr 172.21.15.45:0/2465543836 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:29.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd638b97640 1 --2- 172.21.15.45:0/2465543836 >> v2:172.21.15.155:3300/0 conn(0x7fd6340694b0 0x7fd6340ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd633fff640 1 -- 172.21.15.45:0/2465543836 >> v2:172.21.15.155:3300/0 conn(0x7fd6340694b0 msgr2=0x7fd6340ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:29.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd633fff640 1 --2- 172.21.15.45:0/2465543836 >> v2:172.21.15.155:3300/0 conn(0x7fd6340694b0 0x7fd6340ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd633fff640 1 -- 172.21.15.45:0/2465543836 >> v1:172.21.15.155:6789/0 conn(0x7fd6340ac870 legacy=0x7fd63406c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd633fff640 1 -- 172.21.15.45:0/2465543836 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6340ad3a0 con 0x7fd63406b800 2023-07-09T02:17:29.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.564+0000 7fd633fff640 1 --2- 172.21.15.45:0/2465543836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63406b800 0x7fd63406bbd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd624009870 tx=0x7fd62401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a323f4aa91d843 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd632ffd640 1 -- 172.21.15.45:0/2465543836 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6240a9400 con 0x7fd63406b800 2023-07-09T02:17:29.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd632ffd640 1 -- 172.21.15.45:0/2465543836 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6240a9560 con 0x7fd63406b800 2023-07-09T02:17:29.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd632ffd640 1 -- 172.21.15.45:0/2465543836 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6240a98f0 con 0x7fd63406b800 2023-07-09T02:17:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- 172.21.15.45:0/2465543836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63406b800 msgr2=0x7fd63406bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/2465543836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63406b800 0x7fd63406bbd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd624009870 tx=0x7fd62401c540 comp rx=0 tx=0).stop 2023-07-09T02:17:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- 172.21.15.45:0/2465543836 shutdown_connections 2023-07-09T02:17:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/2465543836 >> v2:172.21.15.155:3300/0 conn(0x7fd6340694b0 0x7fd6340ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/2465543836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd63406b800 0x7fd63406bbd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- 172.21.15.45:0/2465543836 >> 172.21.15.45:0/2465543836 conn(0x7fd6340cfb50 msgr2=0x7fd6340cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:29.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- 172.21.15.45:0/2465543836 shutdown_connections 2023-07-09T02:17:29.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- 172.21.15.45:0/2465543836 wait complete. 2023-07-09T02:17:29.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 Processor -- start 2023-07-09T02:17:29.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- start start 2023-07-09T02:17:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6340694b0 0x7fd6340b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63406b800 0x7fd6340af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6340ac870 0x7fd6340c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340b08c0 con 0x7fd6340ac870 2023-07-09T02:17:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340afa50 con 0x7fd63406b800 2023-07-09T02:17:29.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.568+0000 7fd63a5fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340ca3f0 con 0x7fd6340694b0 2023-07-09T02:17:29.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6340ac870 0x7fd6340c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6340ac870 0x7fd6340c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55772/0 (socket says 172.21.15.45:55772) 2023-07-09T02:17:29.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 -- 172.21.15.45:0/638921298 learned_addr learned my addr 172.21.15.45:0/638921298 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:29.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd633fff640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6340694b0 0x7fd6340b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd6337fe640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63406b800 0x7fd6340af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 -- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6340694b0 msgr2=0x7fd6340b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6340694b0 0x7fd6340b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 -- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63406b800 msgr2=0x7fd6340af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63406b800 0x7fd6340af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 -- 172.21.15.45:0/638921298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240094d0 con 0x7fd6340ac870 2023-07-09T02:17:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd6337fe640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63406b800 0x7fd6340af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd638b97640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6340ac870 0x7fd6340c9eb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00efc0 tx=0x7fd62c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd630ff9640 1 -- 172.21.15.45:0/638921298 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c014480 con 0x7fd6340ac870 2023-07-09T02:17:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd630ff9640 1 -- 172.21.15.45:0/638921298 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00f040 con 0x7fd6340ac870 2023-07-09T02:17:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6340afc40 con 0x7fd6340ac870 2023-07-09T02:17:29.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd630ff9640 1 -- 172.21.15.45:0/638921298 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c014820 con 0x7fd6340ac870 2023-07-09T02:17:29.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6340b0200 con 0x7fd6340ac870 2023-07-09T02:17:29.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63406ae60 con 0x7fd6340ac870 2023-07-09T02:17:29.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.572+0000 7fd630ff9640 1 -- 172.21.15.45:0/638921298 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd62c014980 con 0x7fd6340ac870 2023-07-09T02:17:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.576+0000 7fd630ff9640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6200662b0 0x7fd620068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.576+0000 7fd630ff9640 1 -- 172.21.15.45:0/638921298 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd62c084b60 con 0x7fd6340ac870 2023-07-09T02:17:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.576+0000 7fd633fff640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6200662b0 0x7fd620068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.576+0000 7fd633fff640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6200662b0 0x7fd620068760 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd6240ae000 tx=0x7fd6240b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.580+0000 7fd630ff9640 1 -- 172.21.15.45:0/638921298 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd62c051f40 con 0x7fd6340ac870 2023-07-09T02:17:29.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.732+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6340b0a00 con 0x7fd6340ac870 2023-07-09T02:17:29.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.732+0000 7fd630ff9640 1 -- 172.21.15.45:0/638921298 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd62c018020 con 0x7fd6340ac870 2023-07-09T02:17:29.735 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:17:29.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6200662b0 msgr2=0x7fd620068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6200662b0 0x7fd620068760 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd6240ae000 tx=0x7fd6240b3040 comp rx=0 tx=0).stop 2023-07-09T02:17:29.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6340ac870 msgr2=0x7fd6340c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6340ac870 0x7fd6340c9eb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00efc0 tx=0x7fd62c00c490 comp rx=0 tx=0).stop 2023-07-09T02:17:29.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 shutdown_connections 2023-07-09T02:17:29.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6340ac870 0x7fd6340c9eb0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd63406b800 0x7fd6340af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6200662b0 0x7fd620068760 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 --2- 172.21.15.45:0/638921298 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6340694b0 0x7fd6340b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 >> 172.21.15.45:0/638921298 conn(0x7fd6340cfb50 msgr2=0x7fd6340c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:29.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 shutdown_connections 2023-07-09T02:17:29.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.736+0000 7fd63a5fa640 1 -- 172.21.15.45:0/638921298 wait complete. 2023-07-09T02:17:29.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:17:29.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.900+0000 7f7ac6f82640 1 Processor -- start 2023-07-09T02:17:29.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.900+0000 7f7ac6f82640 1 -- start start 2023-07-09T02:17:29.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.900+0000 7f7ac6f82640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7ac0158e30 0x7f7ac006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.900+0000 7f7ac6f82640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ac006fd10 0x7f7ac006c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.900+0000 7f7ac6f82640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac00ccf80 con 0x7f7ac006c650 2023-07-09T02:17:29.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.900+0000 7f7ac6f82640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac00cd540 con 0x7f7ac006fd10 2023-07-09T02:17:29.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.900+0000 7f7ac6f82640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac006ca90 con 0x7f7ac0158e30 2023-07-09T02:17:29.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ac006fd10 0x7f7ac006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ac006fd10 0x7f7ac006c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55774/0 (socket says 172.21.15.45:55774) 2023-07-09T02:17:29.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abffff640 1 -- 172.21.15.45:0/1900309254 learned_addr learned my addr 172.21.15.45:0/1900309254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:29.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7ac4d1e640 1 --2- 172.21.15.45:0/1900309254 >> v2:172.21.15.155:3300/0 conn(0x7f7ac0158e30 0x7f7ac006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abffff640 1 -- 172.21.15.45:0/1900309254 >> v2:172.21.15.155:3300/0 conn(0x7f7ac0158e30 msgr2=0x7f7ac006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:29.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abffff640 1 --2- 172.21.15.45:0/1900309254 >> v2:172.21.15.155:3300/0 conn(0x7f7ac0158e30 0x7f7ac006f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abffff640 1 -- 172.21.15.45:0/1900309254 >> v1:172.21.15.155:6789/0 conn(0x7f7ac006c650 legacy=0x7f7ac00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:29.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abffff640 1 -- 172.21.15.45:0/1900309254 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac00c8fb0 con 0x7f7ac006fd10 2023-07-09T02:17:29.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abffff640 1 --2- 172.21.15.45:0/1900309254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac006c110 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00cc240 tx=0x7f7aac01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba426d76d53a55a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abf7fe640 1 -- 172.21.15.45:0/1900309254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0ab600 con 0x7f7ac006fd10 2023-07-09T02:17:29.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abf7fe640 1 -- 172.21.15.45:0/1900309254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac0ab760 con 0x7f7ac006fd10 2023-07-09T02:17:29.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.904+0000 7f7abf7fe640 1 -- 172.21.15.45:0/1900309254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0abaf0 con 0x7f7ac006fd10 2023-07-09T02:17:29.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- 172.21.15.45:0/1900309254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 msgr2=0x7f7ac006c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/1900309254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac006c110 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00cc240 tx=0x7f7aac01c400 comp rx=0 tx=0).stop 2023-07-09T02:17:29.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- 172.21.15.45:0/1900309254 shutdown_connections 2023-07-09T02:17:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/1900309254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac006c110 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/1900309254 >> v2:172.21.15.155:3300/0 conn(0x7f7ac0158e30 0x7f7ac006f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- 172.21.15.45:0/1900309254 >> 172.21.15.45:0/1900309254 conn(0x7f7ac00694b0 msgr2=0x7f7ac00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- 172.21.15.45:0/1900309254 shutdown_connections 2023-07-09T02:17:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- 172.21.15.45:0/1900309254 wait complete. 2023-07-09T02:17:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 Processor -- start 2023-07-09T02:17:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- start start 2023-07-09T02:17:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ac006c650 0x7f7ac0167810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac0143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ac0158e30 0x7f7ac0142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac014c710 con 0x7f7ac006fd10 2023-07-09T02:17:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac014d530 con 0x7f7ac0158e30 2023-07-09T02:17:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac6f82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac014c920 con 0x7f7ac006c650 2023-07-09T02:17:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7abffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac0143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7abffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac0143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55790/0 (socket says 172.21.15.45:55790) 2023-07-09T02:17:29.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7abffff640 1 -- 172.21.15.45:0/3875764319 learned_addr learned my addr 172.21.15.45:0/3875764319 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:29.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac4d1e640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ac006c650 0x7f7ac0167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.908+0000 7f7ac551f640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ac0158e30 0x7f7ac0142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abffff640 1 -- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ac006c650 msgr2=0x7f7ac0167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abffff640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ac006c650 0x7f7ac0167810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abffff640 1 -- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ac0158e30 msgr2=0x7f7ac0142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abffff640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ac0158e30 0x7f7ac0142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abffff640 1 -- 172.21.15.45:0/3875764319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0094d0 con 0x7f7ac006fd10 2023-07-09T02:17:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abffff640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac0143e90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0ad040 tx=0x7f7aac01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abd7fa640 1 -- 172.21.15.45:0/3875764319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0ab600 con 0x7f7ac006fd10 2023-07-09T02:17:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abd7fa640 1 -- 172.21.15.45:0/3875764319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac0b4800 con 0x7f7ac006fd10 2023-07-09T02:17:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abd7fa640 1 -- 172.21.15.45:0/3875764319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0b4b70 con 0x7f7ac006fd10 2023-07-09T02:17:29.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac014cc00 con 0x7f7ac006fd10 2023-07-09T02:17:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac014d1c0 con 0x7f7ac006fd10 2023-07-09T02:17:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac004d7d0 con 0x7f7ac006fd10 2023-07-09T02:17:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abd7fa640 1 -- 172.21.15.45:0/3875764319 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7aac0b4cd0 con 0x7f7ac006fd10 2023-07-09T02:17:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.912+0000 7f7abd7fa640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7aa4066280 0x7f7aa4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.916+0000 7f7abd7fa640 1 -- 172.21.15.45:0/3875764319 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7aac11e740 con 0x7f7ac006fd10 2023-07-09T02:17:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.916+0000 7f7ac4d1e640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7aa4066280 0x7f7aa4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:29.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.916+0000 7f7ac4d1e640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7aa4066280 0x7f7aa4068730 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40079c0 tx=0x7f7ab4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:29.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:29.920+0000 7f7abd7fa640 1 -- 172.21.15.45:0/3875764319 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7aac0ebc60 con 0x7f7ac006fd10 2023-07-09T02:17:30.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ac014e830 con 0x7f7ac006fd10 2023-07-09T02:17:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7abd7fa640 1 -- 172.21.15.45:0/3875764319 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v126) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7aac0ef280 con 0x7f7ac006fd10 2023-07-09T02:17:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:17:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7aa4066280 msgr2=0x7f7aa4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7aa4066280 0x7f7aa4068730 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40079c0 tx=0x7f7ab4008040 comp rx=0 tx=0).stop 2023-07-09T02:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 msgr2=0x7f7ac0143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac0143e90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0ad040 tx=0x7f7aac01ac40 comp rx=0 tx=0).stop 2023-07-09T02:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 shutdown_connections 2023-07-09T02:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ac0158e30 0x7f7ac0142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac006fd10 0x7f7ac0143e90 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7aa4066280 0x7f7aa4068730 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 --2- 172.21.15.45:0/3875764319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ac006c650 0x7f7ac0167810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 >> 172.21.15.45:0/3875764319 conn(0x7f7ac00694b0 msgr2=0x7f7ac00c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 shutdown_connections 2023-07-09T02:17:30.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.088+0000 7f7ac6f82640 1 -- 172.21.15.45:0/3875764319 wait complete. 2023-07-09T02:17:30.110 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:17:30.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:30.111 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:30.168 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:17:30.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:30.169 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:17:30.179 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:30.179 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:30.188 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:17:30.188 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:30.189 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:30.231 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:17:30.232 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.372+0000 7fbbf47db640 1 Processor -- start 2023-07-09T02:17:30.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.372+0000 7fbbf47db640 1 -- start start 2023-07-09T02:17:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.372+0000 7fbbf47db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec06b800 0x7fbbec06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.372+0000 7fbbf47db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbbec0694b0 0x7fbbec0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf47db640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec06c110 con 0x7fbbec0ac870 2023-07-09T02:17:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf47db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec0acde0 con 0x7fbbec0694b0 2023-07-09T02:17:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf47db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0ad0c0 con 0x7fbbec06b800 2023-07-09T02:17:30.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1d76640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbbec0ac870 0x7fbbec06c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57922/0 (socket says 172.21.15.45:57922) 2023-07-09T02:17:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1d76640 1 -- 172.21.15.45:0/435489163 learned_addr learned my addr 172.21.15.45:0/435489163 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/435489163 >> v2:172.21.15.155:3300/0 conn(0x7fbbec0694b0 0x7fbbec0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2577640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec06b800 0x7fbbec06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270639517 0 0) 0x7fbbec06c110 con 0x7fbbec0ac870 2023-07-09T02:17:30.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd8003530 con 0x7fbbec0ac870 2023-07-09T02:17:30.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2848009235 0 0) 0x7fbbd8003530 con 0x7fbbec0ac870 2023-07-09T02:17:30.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec06b800 msgr2=0x7fbbec06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:30.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec06b800 0x7fbbec06bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 >> v2:172.21.15.155:3300/0 conn(0x7fbbec0694b0 msgr2=0x7fbbec0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:30.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 --2- 172.21.15.45:0/435489163 >> v2:172.21.15.155:3300/0 conn(0x7fbbec0694b0 0x7fbbec0ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0ad3a0 con 0x7fbbec0ac870 2023-07-09T02:17:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fbbdc001680 con 0x7fbbec0ac870 2023-07-09T02:17:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 >> v1:172.21.15.45:6789/0 conn(0x7fbbec0ac870 legacy=0x7fbbec06c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8003980 0x7fbbd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec06b800 0x7fbbd80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd8004d10 0x7fbbd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0acde0 con 0x7fbbd8004d10 2023-07-09T02:17:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0ad0c0 con 0x7fbbd8003980 2023-07-09T02:17:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd800b990 con 0x7fbbec06b800 2023-07-09T02:17:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/435489163 >> v2:172.21.15.155:3300/0 conn(0x7fbbec0694b0 0x7fbbec0ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd8004d10 0x7fbbd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf1d76640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec06b800 0x7fbbd80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2577640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8003980 0x7fbbd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2d78640 1 -- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec06b800 msgr2=0x7fbbd80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec06b800 0x7fbbd80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2d78640 1 -- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8003980 msgr2=0x7fbbd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8003980 0x7fbbd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.376+0000 7fbbf2d78640 1 -- 172.21.15.45:0/435489163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8003530 con 0x7fbbd8004d10 2023-07-09T02:17:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd8004d10 0x7fbbd8005180 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400e350 tx=0x7fbbe401cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2361bc513dc8986 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40a5e50 con 0x7fbbd8004d10 2023-07-09T02:17:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe400f040 con 0x7fbbd8004d10 2023-07-09T02:17:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf1575640 1 -- 172.21.15.45:0/435489163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4003ba0 con 0x7fbbd8004d10 2023-07-09T02:17:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf47db640 1 -- 172.21.15.45:0/435489163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd8004d10 msgr2=0x7fbbd8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf47db640 1 --2- 172.21.15.45:0/435489163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbd8004d10 0x7fbbd8005180 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400e350 tx=0x7fbbe401cde0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf2d78640 1 -- 172.21.15.45:0/435489163 reap_dead start 2023-07-09T02:17:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf47db640 1 -- 172.21.15.45:0/435489163 shutdown_connections 2023-07-09T02:17:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf47db640 1 -- 172.21.15.45:0/435489163 >> 172.21.15.45:0/435489163 conn(0x7fbbec0cfb50 msgr2=0x7fbbec0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:30.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf47db640 1 -- 172.21.15.45:0/435489163 shutdown_connections 2023-07-09T02:17:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf47db640 1 -- 172.21.15.45:0/435489163 wait complete. 2023-07-09T02:17:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf47db640 1 Processor -- start 2023-07-09T02:17:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.380+0000 7fbbf47db640 1 -- start start 2023-07-09T02:17:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8004d10 0x7fbbec0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec150460 0x7fbbec0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbec0b0340 0x7fbbec1f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0b07b0 con 0x7fbbec0b0340 2023-07-09T02:17:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec15b6e0 con 0x7fbbd8004d10 2023-07-09T02:17:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec160610 con 0x7fbbec150460 2023-07-09T02:17:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbec0b0340 0x7fbbec1f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbec0b0340 0x7fbbec1f1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55804/0 (socket says 172.21.15.45:55804) 2023-07-09T02:17:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 -- 172.21.15.45:0/2119524512 learned_addr learned my addr 172.21.15.45:0/2119524512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2577640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8004d10 0x7fbbec0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 -- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec150460 msgr2=0x7fbbec0afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec150460 0x7fbbec0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 -- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8004d10 msgr2=0x7fbbec0c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8004d10 0x7fbbec0c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 -- 172.21.15.45:0/2119524512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec15f850 con 0x7fbbec0b0340 2023-07-09T02:17:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf2d78640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbec0b0340 0x7fbbec1f1760 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fbbe401c850 tx=0x7fbbe4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbe2ffd640 1 -- 172.21.15.45:0/2119524512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40bd070 con 0x7fbbec0b0340 2023-07-09T02:17:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbe2ffd640 1 -- 172.21.15.45:0/2119524512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe40adde0 con 0x7fbbec0b0340 2023-07-09T02:17:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbe2ffd640 1 -- 172.21.15.45:0/2119524512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4003ba0 con 0x7fbbec0b0340 2023-07-09T02:17:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec15fb30 con 0x7fbbec0b0340 2023-07-09T02:17:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec1600f0 con 0x7fbbec0b0340 2023-07-09T02:17:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.384+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec06ae60 con 0x7fbbec0b0340 2023-07-09T02:17:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.388+0000 7fbbe2ffd640 1 -- 172.21.15.45:0/2119524512 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbe40b8470 con 0x7fbbec0b0340 2023-07-09T02:17:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.388+0000 7fbbe2ffd640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbd0066280 0x7fbbd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.388+0000 7fbbe2ffd640 1 -- 172.21.15.45:0/2119524512 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbe411f350 con 0x7fbbec0b0340 2023-07-09T02:17:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.388+0000 7fbbf2577640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbd0066280 0x7fbbd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.388+0000 7fbbf2577640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbd0066280 0x7fbbd0068730 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80099a0 tx=0x7fbbe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.392+0000 7fbbe2ffd640 1 -- 172.21.15.45:0/2119524512 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbe40ec7c0 con 0x7fbbec0b0340 2023-07-09T02:17:30.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.576+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbec160310 con 0x7fbbec0b0340 2023-07-09T02:17:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.576+0000 7fbbe2ffd640 1 -- 172.21.15.45:0/2119524512 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fbbe4009dc0 con 0x7fbbec0b0340 2023-07-09T02:17:30.580 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:30.580 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:12.050406+0000","modified":"2023-07-09T02:17:15.686025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7392":{"gid":7392,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3333848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3333848450},{"type":"v1","addr":"172.21.15.155:6837","nonce":3333848450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T02:17:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 59 2023-07-09T02:17:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbd0066280 msgr2=0x7fbbd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbd0066280 0x7fbbd0068730 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80099a0 tx=0x7fbbe8008040 comp rx=0 tx=0).stop 2023-07-09T02:17:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbec0b0340 msgr2=0x7fbbec1f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbec0b0340 0x7fbbec1f1760 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fbbe401c850 tx=0x7fbbe4009750 comp rx=0 tx=0).stop 2023-07-09T02:17:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 shutdown_connections 2023-07-09T02:17:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbec0b0340 0x7fbbec1f1760 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbbd0066280 0x7fbbd0068730 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbec150460 0x7fbbec0afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 --2- 172.21.15.45:0/2119524512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbd8004d10 0x7fbbec0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 >> 172.21.15.45:0/2119524512 conn(0x7fbbec0cfb50 msgr2=0x7fbbec06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 shutdown_connections 2023-07-09T02:17:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.580+0000 7fbbf47db640 1 -- 172.21.15.45:0/2119524512 wait complete. 2023-07-09T02:17:30.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1166834640 1 Processor -- start 2023-07-09T02:17:30.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1166834640 1 -- start start 2023-07-09T02:17:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1166834640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f116015c060 0x7f11600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1166834640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11600d2620 0x7f11600cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1166834640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1160160a50 con 0x7f11600cd120 2023-07-09T02:17:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1166834640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116015c430 con 0x7f11600d2620 2023-07-09T02:17:30.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1166834640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116015fb60 con 0x7f116015c060 2023-07-09T02:17:30.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1164dd1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11600d2620 0x7f11600cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f115f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f11600cd120 0x7f11600d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57924/0 (socket says 172.21.15.45:57924) 2023-07-09T02:17:30.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f115f7fe640 1 -- 172.21.15.45:0/3553707671 learned_addr learned my addr 172.21.15.45:0/3553707671 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:30.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f115ffff640 1 --2- 172.21.15.45:0/3553707671 >> v2:172.21.15.155:3300/0 conn(0x7f116015c060 0x7f11600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1164dd1640 1 -- 172.21.15.45:0/3553707671 >> v2:172.21.15.155:3300/0 conn(0x7f116015c060 msgr2=0x7f11600b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1164dd1640 1 --2- 172.21.15.45:0/3553707671 >> v2:172.21.15.155:3300/0 conn(0x7f116015c060 0x7f11600b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1164dd1640 1 -- 172.21.15.45:0/3553707671 >> v1:172.21.15.45:6789/0 conn(0x7f11600cd120 legacy=0x7f11600d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f1164dd1640 1 -- 172.21.15.45:0/3553707671 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116015fe40 con 0x7f11600d2620 2023-07-09T02:17:30.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.744+0000 7f115effd640 1 -- 172.21.15.45:0/3553707671 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544816770 0 0) 0x7f1160160a50 con 0x7f11600cd120 2023-07-09T02:17:30.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1164dd1640 1 --2- 172.21.15.45:0/3553707671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600d2620 0x7f11600cee30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f11600d3ad0 tx=0x7f115801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41544b6d052fc58 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:30.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f115effd640 1 -- 172.21.15.45:0/3553707671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580a59a0 con 0x7f11600d2620 2023-07-09T02:17:30.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f115effd640 1 -- 172.21.15.45:0/3553707671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11580a5b00 con 0x7f11600d2620 2023-07-09T02:17:30.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f115effd640 1 -- 172.21.15.45:0/3553707671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580a5e90 con 0x7f11600d2620 2023-07-09T02:17:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1166834640 1 -- 172.21.15.45:0/3553707671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600d2620 msgr2=0x7f11600cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1166834640 1 --2- 172.21.15.45:0/3553707671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600d2620 0x7f11600cee30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f11600d3ad0 tx=0x7f115801c8e0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1166834640 1 -- 172.21.15.45:0/3553707671 shutdown_connections 2023-07-09T02:17:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1166834640 1 --2- 172.21.15.45:0/3553707671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600d2620 0x7f11600cee30 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1166834640 1 --2- 172.21.15.45:0/3553707671 >> v2:172.21.15.155:3300/0 conn(0x7f116015c060 0x7f11600b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1166834640 1 -- 172.21.15.45:0/3553707671 >> 172.21.15.45:0/3553707671 conn(0x7f11600698e0 msgr2=0x7f1160069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1166834640 1 -- 172.21.15.45:0/3553707671 shutdown_connections 2023-07-09T02:17:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.748+0000 7f1166834640 1 -- 172.21.15.45:0/3553707671 wait complete. 2023-07-09T02:17:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 Processor -- start 2023-07-09T02:17:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 -- start start 2023-07-09T02:17:30.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600cd120 0x7f1160151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600d2620 0x7f1160159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f116015c060 0x7f11601519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1160153a90 con 0x7f11600cd120 2023-07-09T02:17:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1160153d70 con 0x7f116015c060 2023-07-09T02:17:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1160154050 con 0x7f11600d2620 2023-07-09T02:17:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600cd120 0x7f1160151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600cd120 0x7f1160151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55820/0 (socket says 172.21.15.45:55820) 2023-07-09T02:17:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 -- 172.21.15.45:0/856494443 learned_addr learned my addr 172.21.15.45:0/856494443 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115f7fe640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600d2620 0x7f1160159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1164dd1640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f116015c060 0x7f11601519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 -- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600d2620 msgr2=0x7f1160159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600d2620 0x7f1160159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 -- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f116015c060 msgr2=0x7f11601519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f116015c060 0x7f11601519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 -- 172.21.15.45:0/856494443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158009a70 con 0x7f11600cd120 2023-07-09T02:17:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1164dd1640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f116015c060 0x7f11601519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115f7fe640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600d2620 0x7f1160159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115ffff640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600cd120 0x7f1160151400 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f115000d5f0 tx=0x7f115000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115cff9640 1 -- 172.21.15.45:0/856494443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11500125f0 con 0x7f11600cd120 2023-07-09T02:17:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115cff9640 1 -- 172.21.15.45:0/856494443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150012750 con 0x7f11600cd120 2023-07-09T02:17:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f115cff9640 1 -- 172.21.15.45:0/856494443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150012ae0 con 0x7f11600cd120 2023-07-09T02:17:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11600b59f0 con 0x7f11600cd120 2023-07-09T02:17:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1160154610 con 0x7f11600cd120 2023-07-09T02:17:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.752+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116004d7d0 con 0x7f11600cd120 2023-07-09T02:17:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.756+0000 7f115cff9640 1 -- 172.21.15.45:0/856494443 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1150012c40 con 0x7f11600cd120 2023-07-09T02:17:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.756+0000 7f115cff9640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f114c066280 0x7f114c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.756+0000 7f115cff9640 1 -- 172.21.15.45:0/856494443 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1150084260 con 0x7f11600cd120 2023-07-09T02:17:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.756+0000 7f115f7fe640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f114c066280 0x7f114c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.756+0000 7f115f7fe640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f114c066280 0x7f114c068730 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1160152740 tx=0x7f1154009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.760+0000 7f115cff9640 1 -- 172.21.15.45:0/856494443 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11500516d0 con 0x7f11600cd120 2023-07-09T02:17:30.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.916+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f116006baa0 con 0x7f11600cd120 2023-07-09T02:17:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.916+0000 7f115cff9640 1 -- 172.21.15.45:0/856494443 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f1150007380 con 0x7f11600cd120 2023-07-09T02:17:30.919 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:30.920 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":126,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:23.740952+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f114c066280 msgr2=0x7f114c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f114c066280 0x7f114c068730 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1160152740 tx=0x7f1154009040 comp rx=0 tx=0).stop 2023-07-09T02:17:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600cd120 msgr2=0x7f1160151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600cd120 0x7f1160151400 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f115000d5f0 tx=0x7f115000dab0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 shutdown_connections 2023-07-09T02:17:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f116015c060 0x7f11601519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f114c066280 0x7f114c068730 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11600d2620 0x7f1160159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 --2- 172.21.15.45:0/856494443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11600cd120 0x7f1160151400 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 >> 172.21.15.45:0/856494443 conn(0x7f11600698e0 msgr2=0x7f11600b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 shutdown_connections 2023-07-09T02:17:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:30.920+0000 7f1166834640 1 -- 172.21.15.45:0/856494443 wait complete. 2023-07-09T02:17:30.941 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:17:10.149383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:17:11.041822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:17:30.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:17:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10eee9c640 1 Processor -- start 2023-07-09T02:17:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10eee9c640 1 -- start start 2023-07-09T02:17:31.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10eee9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e815c060 0x7f10e80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10eee9c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10e80cd120 0x7f10e80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10eee9c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e8160a50 con 0x7f10e80d2450 2023-07-09T02:17:31.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10eee9c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80d28f0 con 0x7f10e80cd120 2023-07-09T02:17:31.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10eee9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80cfe40 con 0x7f10e815c060 2023-07-09T02:17:31.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10ecc38640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e815c060 0x7f10e80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10e7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10e80cd120 0x7f10e80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10e7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10e80cd120 0x7f10e80d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:57394/0 (socket says 172.21.15.45:57394) 2023-07-09T02:17:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10ecc38640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e815c060 0x7f10e80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:43788/0 (socket says 172.21.15.45:43788) 2023-07-09T02:17:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10e7fff640 1 -- 172.21.15.45:0/3102920528 learned_addr learned my addr 172.21.15.45:0/3102920528 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.088+0000 7f10ed439640 1 --1- 172.21.15.45:0/3102920528 >> v1:172.21.15.155:6789/0 conn(0x7f10e80d2450 0x7f10e80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:33402/0 (socket says 172.21.15.45:33402) 2023-07-09T02:17:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10ecc38640 1 -- 172.21.15.45:0/3102920528 >> v2:172.21.15.155:3300/0 conn(0x7f10e80cd120 msgr2=0x7f10e80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10ecc38640 1 --2- 172.21.15.45:0/3102920528 >> v2:172.21.15.155:3300/0 conn(0x7f10e80cd120 0x7f10e80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10ecc38640 1 -- 172.21.15.45:0/3102920528 >> v1:172.21.15.155:6789/0 conn(0x7f10e80d2450 legacy=0x7f10e80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10ecc38640 1 -- 172.21.15.45:0/3102920528 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e815c430 con 0x7f10e815c060 2023-07-09T02:17:31.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10e7fff640 1 --2- 172.21.15.45:0/3102920528 >> v2:172.21.15.155:3300/0 conn(0x7f10e80cd120 0x7f10e80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:31.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10e77fe640 1 -- 172.21.15.45:0/3102920528 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607100380 0 0) 0x7f10e8160a50 con 0x7f10e80d2450 2023-07-09T02:17:31.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10ecc38640 1 --2- 172.21.15.45:0/3102920528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e815c060 0x7f10e80b4ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0097c0 tx=0x7f10dc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4eebd7577f9b1d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10e77fe640 1 -- 172.21.15.45:0/3102920528 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0ab600 con 0x7f10e815c060 2023-07-09T02:17:31.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10e77fe640 1 -- 172.21.15.45:0/3102920528 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc0a7050 con 0x7f10e815c060 2023-07-09T02:17:31.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10e77fe640 1 -- 172.21.15.45:0/3102920528 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0ab980 con 0x7f10e815c060 2023-07-09T02:17:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10eee9c640 1 -- 172.21.15.45:0/3102920528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e815c060 msgr2=0x7f10e80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10eee9c640 1 --2- 172.21.15.45:0/3102920528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e815c060 0x7f10e80b4ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0097c0 tx=0x7f10dc01c450 comp rx=0 tx=0).stop 2023-07-09T02:17:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10eee9c640 1 -- 172.21.15.45:0/3102920528 shutdown_connections 2023-07-09T02:17:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10eee9c640 1 --2- 172.21.15.45:0/3102920528 >> v2:172.21.15.155:3300/0 conn(0x7f10e80cd120 0x7f10e80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10eee9c640 1 --2- 172.21.15.45:0/3102920528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e815c060 0x7f10e80b4ed0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10eee9c640 1 -- 172.21.15.45:0/3102920528 >> 172.21.15.45:0/3102920528 conn(0x7f10e80698e0 msgr2=0x7f10e8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10eee9c640 1 -- 172.21.15.45:0/3102920528 shutdown_connections 2023-07-09T02:17:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.092+0000 7f10eee9c640 1 -- 172.21.15.45:0/3102920528 wait complete. 2023-07-09T02:17:31.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 Processor -- start 2023-07-09T02:17:31.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 -- start start 2023-07-09T02:17:31.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e80cd120 0x7f10e815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e80d2450 0x7f10e81f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e815c060 0x7f10e8151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8158840 con 0x7f10e815c060 2023-07-09T02:17:31.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e81f8ae0 con 0x7f10e80d2450 2023-07-09T02:17:31.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e815cd20 con 0x7f10e80cd120 2023-07-09T02:17:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e815c060 0x7f10e8151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e815c060 0x7f10e8151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55832/0 (socket says 172.21.15.45:55832) 2023-07-09T02:17:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 -- 172.21.15.45:0/1704698248 learned_addr learned my addr 172.21.15.45:0/1704698248 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10e7fff640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e80d2450 0x7f10e81f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ecc38640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e80cd120 0x7f10e815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 -- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e80cd120 msgr2=0x7f10e815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e80cd120 0x7f10e815c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 -- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e80d2450 msgr2=0x7f10e81f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e80d2450 0x7f10e81f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 -- 172.21.15.45:0/1704698248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40094d0 con 0x7f10e815c060 2023-07-09T02:17:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10ed439640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e815c060 0x7f10e8151a70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c7a0 tx=0x7f10e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10e57fa640 1 -- 172.21.15.45:0/1704698248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000a640 con 0x7f10e815c060 2023-07-09T02:17:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10e57fa640 1 -- 172.21.15.45:0/1704698248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e000a7a0 con 0x7f10e815c060 2023-07-09T02:17:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10e57fa640 1 -- 172.21.15.45:0/1704698248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000abd0 con 0x7f10e815c060 2023-07-09T02:17:31.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.096+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc009420 con 0x7f10e815c060 2023-07-09T02:17:31.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.100+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e815d2e0 con 0x7f10e815c060 2023-07-09T02:17:31.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.100+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e804d7d0 con 0x7f10e815c060 2023-07-09T02:17:31.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.100+0000 7f10e57fa640 1 -- 172.21.15.45:0/1704698248 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10e000ad30 con 0x7f10e815c060 2023-07-09T02:17:31.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.100+0000 7f10e57fa640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.100+0000 7f10e57fa640 1 -- 172.21.15.45:0/1704698248 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10e00832d0 con 0x7f10e815c060 2023-07-09T02:17:31.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.100+0000 7f10ecc38640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.104+0000 7f10ecc38640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0ad000 tx=0x7f10dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.104+0000 7f10e57fa640 1 -- 172.21.15.45:0/1704698248 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10e0050760 con 0x7f10e815c060 2023-07-09T02:17:31.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.260+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10e806baa0 con 0x7f10e815c060 2023-07-09T02:17:31.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.260+0000 7f10e57fa640 1 -- 172.21.15.45:0/1704698248 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10e0018020 con 0x7f10e815c060 2023-07-09T02:17:31.262 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:17:31.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.260+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 msgr2=0x7f10cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.260+0000 7f10eee9c640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0ad000 tx=0x7f10dc0a6000 comp rx=0 tx=0).stop 2023-07-09T02:17:31.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.260+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e815c060 msgr2=0x7f10e8151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.260+0000 7f10eee9c640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e815c060 0x7f10e8151a70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c7a0 tx=0x7f10e000cc60 comp rx=0 tx=0).stop 2023-07-09T02:17:31.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.264+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 shutdown_connections 2023-07-09T02:17:31.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.264+0000 7f10eee9c640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10e815c060 0x7f10e8151a70 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.264+0000 7f10eee9c640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10e80d2450 0x7f10e81f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.264+0000 7f10eee9c640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f10cc066280 0x7f10cc068730 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.264+0000 7f10eee9c640 1 --2- 172.21.15.45:0/1704698248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10e80cd120 0x7f10e815c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.264+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 >> 172.21.15.45:0/1704698248 conn(0x7f10e80698e0 msgr2=0x7f10e80b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:31.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.264+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 shutdown_connections 2023-07-09T02:17:31.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.264+0000 7f10eee9c640 1 -- 172.21.15.45:0/1704698248 wait complete. 2023-07-09T02:17:31.284 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:17:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2ee834640 1 Processor -- start 2023-07-09T02:17:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2ee834640 1 -- start start 2023-07-09T02:17:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2ee834640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2e80d2620 0x7fc2e80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2ee834640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc2e80cd120 0x7fc2e80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2ee834640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e8160a50 con 0x7fc2e815c060 2023-07-09T02:17:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2ee834640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e815c430 con 0x7fc2e80d2620 2023-07-09T02:17:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2ee834640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e815fb60 con 0x7fc2e80cd120 2023-07-09T02:17:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2e77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2e80d2620 0x7fc2e80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2e77fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2e80d2620 0x7fc2e80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55844/0 (socket says 172.21.15.45:55844) 2023-07-09T02:17:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2e77fe640 1 -- 172.21.15.45:0/2958059835 learned_addr learned my addr 172.21.15.45:0/2958059835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2ecdd1640 1 --2- 172.21.15.45:0/2958059835 >> v2:172.21.15.155:3300/0 conn(0x7fc2e80cd120 0x7fc2e80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2e77fe640 1 -- 172.21.15.45:0/2958059835 >> v2:172.21.15.155:3300/0 conn(0x7fc2e80cd120 msgr2=0x7fc2e80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2e77fe640 1 --2- 172.21.15.45:0/2958059835 >> v2:172.21.15.155:3300/0 conn(0x7fc2e80cd120 0x7fc2e80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2e77fe640 1 -- 172.21.15.45:0/2958059835 >> v1:172.21.15.155:6789/0 conn(0x7fc2e815c060 legacy=0x7fc2e80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.428+0000 7fc2e77fe640 1 -- 172.21.15.45:0/2958059835 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e815fe40 con 0x7fc2e80d2620 2023-07-09T02:17:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2e77fe640 1 --2- 172.21.15.45:0/2958059835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80d2620 0x7fc2e80b4ed0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc2e806b120 tx=0x7fc2dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a380404be42222e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2e6ffd640 1 -- 172.21.15.45:0/2958059835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0aa430 con 0x7fc2e80d2620 2023-07-09T02:17:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2e6ffd640 1 -- 172.21.15.45:0/2958059835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0aa590 con 0x7fc2e80d2620 2023-07-09T02:17:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2e6ffd640 1 -- 172.21.15.45:0/2958059835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0aa920 con 0x7fc2e80d2620 2023-07-09T02:17:31.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2ee834640 1 -- 172.21.15.45:0/2958059835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80d2620 msgr2=0x7fc2e80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2958059835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80d2620 0x7fc2e80b4ed0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc2e806b120 tx=0x7fc2dc01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2ee834640 1 -- 172.21.15.45:0/2958059835 shutdown_connections 2023-07-09T02:17:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2958059835 >> v2:172.21.15.155:3300/0 conn(0x7fc2e80cd120 0x7fc2e80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2958059835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80d2620 0x7fc2e80b4ed0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2ee834640 1 -- 172.21.15.45:0/2958059835 >> 172.21.15.45:0/2958059835 conn(0x7fc2e80698e0 msgr2=0x7fc2e8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2ee834640 1 -- 172.21.15.45:0/2958059835 shutdown_connections 2023-07-09T02:17:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.432+0000 7fc2ee834640 1 -- 172.21.15.45:0/2958059835 wait complete. 2023-07-09T02:17:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 Processor -- start 2023-07-09T02:17:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 -- start start 2023-07-09T02:17:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80cd120 0x7fc2e80cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e80d2620 0x7fc2e81530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e815c060 0x7fc2e80d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8153b50 con 0x7fc2e80cd120 2023-07-09T02:17:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80ccd50 con 0x7fc2e80d2620 2023-07-09T02:17:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e815c600 con 0x7fc2e815c060 2023-07-09T02:17:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80cd120 0x7fc2e80cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80cd120 0x7fc2e80cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55846/0 (socket says 172.21.15.45:55846) 2023-07-09T02:17:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 -- 172.21.15.45:0/2450941569 learned_addr learned my addr 172.21.15.45:0/2450941569 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e77fe640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e80d2620 0x7fc2e81530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ecdd1640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e815c060 0x7fc2e80d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 -- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e815c060 msgr2=0x7fc2e80d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e815c060 0x7fc2e80d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 -- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e80d2620 msgr2=0x7fc2e81530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e80d2620 0x7fc2e81530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 -- 172.21.15.45:0/2450941569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc0094d0 con 0x7fc2e80cd120 2023-07-09T02:17:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e7fff640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80cd120 0x7fc2e80cc6c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800c3c0 tx=0x7fc2d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e4ff9640 1 -- 172.21.15.45:0/2450941569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80052d0 con 0x7fc2e80cd120 2023-07-09T02:17:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e4ff9640 1 -- 172.21.15.45:0/2450941569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8005430 con 0x7fc2e80cd120 2023-07-09T02:17:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2e4ff9640 1 -- 172.21.15.45:0/2450941569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8003840 con 0x7fc2e80cd120 2023-07-09T02:17:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e80b59f0 con 0x7fc2e80cd120 2023-07-09T02:17:31.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.436+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e815cbc0 con 0x7fc2e80cd120 2023-07-09T02:17:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.440+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e804d7d0 con 0x7fc2e80cd120 2023-07-09T02:17:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.440+0000 7fc2e4ff9640 1 -- 172.21.15.45:0/2450941569 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2d80039a0 con 0x7fc2e80cd120 2023-07-09T02:17:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.440+0000 7fc2e4ff9640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc2d4066280 0x7fc2d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.440+0000 7fc2e4ff9640 1 -- 172.21.15.45:0/2450941569 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2d8083260 con 0x7fc2e80cd120 2023-07-09T02:17:31.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.440+0000 7fc2e77fe640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc2d4066280 0x7fc2d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.440+0000 7fc2e77fe640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc2d4066280 0x7fc2d4068730 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0ae000 tx=0x7fc2dc0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.444+0000 7fc2e4ff9640 1 -- 172.21.15.45:0/2450941569 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2d80506f0 con 0x7fc2e80cd120 2023-07-09T02:17:31.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.600+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2e806baa0 con 0x7fc2e80cd120 2023-07-09T02:17:31.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.600+0000 7fc2e4ff9640 1 -- 172.21.15.45:0/2450941569 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2d8053d10 con 0x7fc2e80cd120 2023-07-09T02:17:31.603 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:17:31.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc2d4066280 msgr2=0x7fc2d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc2d4066280 0x7fc2d4068730 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0ae000 tx=0x7fc2dc0b5040 comp rx=0 tx=0).stop 2023-07-09T02:17:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80cd120 msgr2=0x7fc2e80cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80cd120 0x7fc2e80cc6c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800c3c0 tx=0x7fc2d800c880 comp rx=0 tx=0).stop 2023-07-09T02:17:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 shutdown_connections 2023-07-09T02:17:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc2d4066280 0x7fc2d4068730 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2e815c060 0x7fc2e80d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2e80d2620 0x7fc2e81530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 --2- 172.21.15.45:0/2450941569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e80cd120 0x7fc2e80cc6c0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 >> 172.21.15.45:0/2450941569 conn(0x7fc2e80698e0 msgr2=0x7fc2e80b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:31.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 shutdown_connections 2023-07-09T02:17:31.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.604+0000 7fc2ee834640 1 -- 172.21.15.45:0/2450941569 wait complete. 2023-07-09T02:17:31.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:17:31.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c5b656640 1 Processor -- start 2023-07-09T02:17:31.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c5b656640 1 -- start start 2023-07-09T02:17:31.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c5b656640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540d2620 0x7f4c540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c5b656640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c54160a50 con 0x7f4c540cd120 2023-07-09T02:17:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c5b656640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5415c430 con 0x7f4c5415c060 2023-07-09T02:17:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c5b656640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415fb60 con 0x7f4c540d2620 2023-07-09T02:17:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c59bf3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4c540cd120 0x7f4c540cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49502/0 (socket says 172.21.15.45:49502) 2023-07-09T02:17:31.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c59bf3640 1 -- 172.21.15.45:0/3489286414 learned_addr learned my addr 172.21.15.45:0/3489286414 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:31.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c58bf1640 1 --2- 172.21.15.45:0/3489286414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540d2620 0x7f4c540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c4bfff640 1 -- 172.21.15.45:0/3489286414 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580171513 0 0) 0x7f4c54160a50 con 0x7f4c540cd120 2023-07-09T02:17:31.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c4bfff640 1 -- 172.21.15.45:0/3489286414 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c40003530 con 0x7f4c540cd120 2023-07-09T02:17:31.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c4bfff640 1 -- 172.21.15.45:0/3489286414 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520780418 0 0) 0x7f4c5415c430 con 0x7f4c5415c060 2023-07-09T02:17:31.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c58bf1640 1 -- 172.21.15.45:0/3489286414 >> v1:172.21.15.155:6789/0 conn(0x7f4c5415c060 legacy=0x7f4c540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c58bf1640 1 -- 172.21.15.45:0/3489286414 >> v1:172.21.15.45:6789/0 conn(0x7f4c540cd120 legacy=0x7f4c540cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.768+0000 7f4c58bf1640 1 -- 172.21.15.45:0/3489286414 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5415fe40 con 0x7f4c540d2620 2023-07-09T02:17:31.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.772+0000 7f4c58bf1640 1 --2- 172.21.15.45:0/3489286414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540d2620 0x7f4c540b4ed0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c440097f0 tx=0x7f4c4401c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71523c4ad6a18b2a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c4bfff640 1 -- 172.21.15.45:0/3489286414 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c001980 con 0x7f4c540d2620 2023-07-09T02:17:31.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c4bfff640 1 -- 172.21.15.45:0/3489286414 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c440a7050 con 0x7f4c540d2620 2023-07-09T02:17:31.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c4bfff640 1 -- 172.21.15.45:0/3489286414 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c440ab620 con 0x7f4c540d2620 2023-07-09T02:17:31.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c5b656640 1 -- 172.21.15.45:0/3489286414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540d2620 msgr2=0x7f4c540b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c5b656640 1 --2- 172.21.15.45:0/3489286414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540d2620 0x7f4c540b4ed0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c440097f0 tx=0x7f4c4401c2d0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c5b656640 1 -- 172.21.15.45:0/3489286414 shutdown_connections 2023-07-09T02:17:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c5b656640 1 --2- 172.21.15.45:0/3489286414 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540d2620 0x7f4c540b4ed0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c5b656640 1 -- 172.21.15.45:0/3489286414 >> 172.21.15.45:0/3489286414 conn(0x7f4c540698e0 msgr2=0x7f4c54069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c5b656640 1 -- 172.21.15.45:0/3489286414 shutdown_connections 2023-07-09T02:17:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.776+0000 7f4c5b656640 1 -- 172.21.15.45:0/3489286414 wait complete. 2023-07-09T02:17:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 Processor -- start 2023-07-09T02:17:31.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 -- start start 2023-07-09T02:17:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540cd120 0x7f4c5415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c540d2620 0x7f4c540d0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c5415c060 0x7f4c5415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415b110 con 0x7f4c5415c060 2023-07-09T02:17:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415b3f0 con 0x7f4c540d2620 2023-07-09T02:17:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415b6d0 con 0x7f4c540cd120 2023-07-09T02:17:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c5415c060 0x7f4c5415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c5415c060 0x7f4c5415dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40500/0 (socket says 172.21.15.45:40500) 2023-07-09T02:17:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 -- 172.21.15.45:0/1722966476 learned_addr learned my addr 172.21.15.45:0/1722966476 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:31.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c58bf1640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c540d2620 0x7f4c540d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c593f2640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540cd120 0x7f4c5415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 -- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540cd120 msgr2=0x7f4c5415aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540cd120 0x7f4c5415aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 -- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c540d2620 msgr2=0x7f4c540d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c540d2620 0x7f4c540d0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 -- 172.21.15.45:0/1722966476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44009420 con 0x7f4c5415c060 2023-07-09T02:17:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c59bf3640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c5415c060 0x7f4c5415dee0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00ca70 tx=0x7f4c4c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c49ffb640 1 -- 172.21.15.45:0/1722966476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00a9c0 con 0x7f4c5415c060 2023-07-09T02:17:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c49ffb640 1 -- 172.21.15.45:0/1722966476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c00ab20 con 0x7f4c5415c060 2023-07-09T02:17:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c540b59f0 con 0x7f4c5415c060 2023-07-09T02:17:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.780+0000 7f4c49ffb640 1 -- 172.21.15.45:0/1722966476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c004e40 con 0x7f4c5415c060 2023-07-09T02:17:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.784+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5415c860 con 0x7f4c5415c060 2023-07-09T02:17:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.784+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5415b8f0 con 0x7f4c5415c060 2023-07-09T02:17:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.784+0000 7f4c49ffb640 1 -- 172.21.15.45:0/1722966476 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c4c0070d0 con 0x7f4c5415c060 2023-07-09T02:17:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.784+0000 7f4c49ffb640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4c38066280 0x7f4c38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.784+0000 7f4c49ffb640 1 -- 172.21.15.45:0/1722966476 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c4c083820 con 0x7f4c5415c060 2023-07-09T02:17:31.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.784+0000 7f4c593f2640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4c38066280 0x7f4c38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:31.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.788+0000 7f4c593f2640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4c38066280 0x7f4c38068730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4c50007fd0 tx=0x7f4c50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:31.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.788+0000 7f4c49ffb640 1 -- 172.21.15.45:0/1722966476 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c4c050d40 con 0x7f4c5415c060 2023-07-09T02:17:31.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c5404d7d0 con 0x7f4c5415c060 2023-07-09T02:17:31.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c49ffb640 1 -- 172.21.15.45:0/1722966476 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c4c054360 con 0x7f4c5415c060 2023-07-09T02:17:31.947 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:17:31.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4c38066280 msgr2=0x7f4c38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4c38066280 0x7f4c38068730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4c50007fd0 tx=0x7f4c50009040 comp rx=0 tx=0).stop 2023-07-09T02:17:31.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c5415c060 msgr2=0x7f4c5415dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:31.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c5415c060 0x7f4c5415dee0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00ca70 tx=0x7f4c4c00cf30 comp rx=0 tx=0).stop 2023-07-09T02:17:31.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 shutdown_connections 2023-07-09T02:17:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c5415c060 0x7f4c5415dee0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c540d2620 0x7f4c540d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4c38066280 0x7f4c38068730 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 --2- 172.21.15.45:0/1722966476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c540cd120 0x7f4c5415aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.944+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 >> 172.21.15.45:0/1722966476 conn(0x7f4c540698e0 msgr2=0x7f4c540b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.948+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 shutdown_connections 2023-07-09T02:17:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:31.948+0000 7f4c5b656640 1 -- 172.21.15.45:0/1722966476 wait complete. 2023-07-09T02:17:31.967 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:17:32.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e973ac640 1 Processor -- start 2023-07-09T02:17:32.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e973ac640 1 -- start start 2023-07-09T02:17:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e973ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e900cd120 0x7f0e900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e973ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e90160a50 con 0x7f0e9015c060 2023-07-09T02:17:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e973ac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9015c430 con 0x7f0e900d2620 2023-07-09T02:17:32.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e973ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9015fb60 con 0x7f0e900cd120 2023-07-09T02:17:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e95148640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0e9015c060 0x7f0e900d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49504/0 (socket says 172.21.15.45:49504) 2023-07-09T02:17:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e95949640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e900cd120 0x7f0e900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e95148640 1 -- 172.21.15.45:0/3562318465 learned_addr learned my addr 172.21.15.45:0/3562318465 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e95949640 1 -- 172.21.15.45:0/3562318465 >> v1:172.21.15.155:6789/0 conn(0x7f0e900d2620 legacy=0x7f0e900cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:32.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e95949640 1 -- 172.21.15.45:0/3562318465 >> v1:172.21.15.45:6789/0 conn(0x7f0e9015c060 legacy=0x7f0e900d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e95949640 1 -- 172.21.15.45:0/3562318465 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9015fe40 con 0x7f0e900cd120 2023-07-09T02:17:32.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.112+0000 7f0e87fff640 1 -- 172.21.15.45:0/3562318465 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390298138 0 0) 0x7f0e90160a50 con 0x7f0e9015c060 2023-07-09T02:17:32.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e95949640 1 --2- 172.21.15.45:0/3562318465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e900b4ed0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009d90 tx=0x7f0e8801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e47e8d30ceeeef2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e87fff640 1 -- 172.21.15.45:0/3562318465 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880a59e0 con 0x7f0e900cd120 2023-07-09T02:17:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e87fff640 1 -- 172.21.15.45:0/3562318465 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e880a5b40 con 0x7f0e900cd120 2023-07-09T02:17:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e87fff640 1 -- 172.21.15.45:0/3562318465 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880ad440 con 0x7f0e900cd120 2023-07-09T02:17:32.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e973ac640 1 -- 172.21.15.45:0/3562318465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 msgr2=0x7f0e900b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e973ac640 1 --2- 172.21.15.45:0/3562318465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e900b4ed0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009d90 tx=0x7f0e8801c920 comp rx=0 tx=0).stop 2023-07-09T02:17:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e973ac640 1 -- 172.21.15.45:0/3562318465 shutdown_connections 2023-07-09T02:17:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e973ac640 1 --2- 172.21.15.45:0/3562318465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e900b4ed0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e973ac640 1 -- 172.21.15.45:0/3562318465 >> 172.21.15.45:0/3562318465 conn(0x7f0e900698e0 msgr2=0x7f0e90069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e973ac640 1 -- 172.21.15.45:0/3562318465 shutdown_connections 2023-07-09T02:17:32.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.116+0000 7f0e973ac640 1 -- 172.21.15.45:0/3562318465 wait complete. 2023-07-09T02:17:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 Processor -- start 2023-07-09T02:17:32.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 -- start start 2023-07-09T02:17:32.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e90147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e900d2620 0x7f0e90155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e9015c060 0x7f0e90144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90157310 con 0x7f0e900cd120 2023-07-09T02:17:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90156690 con 0x7f0e9015c060 2023-07-09T02:17:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90156970 con 0x7f0e900d2620 2023-07-09T02:17:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e90147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e90147080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40520/0 (socket says 172.21.15.45:40520) 2023-07-09T02:17:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 -- 172.21.15.45:0/4287301974 learned_addr learned my addr 172.21.15.45:0/4287301974 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95949640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e9015c060 0x7f0e90144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e94947640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e900d2620 0x7f0e90155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 -- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e900d2620 msgr2=0x7f0e90155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e900d2620 0x7f0e90155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 -- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e9015c060 msgr2=0x7f0e90144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e9015c060 0x7f0e90144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 -- 172.21.15.45:0/4287301974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88009a70 con 0x7f0e900cd120 2023-07-09T02:17:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e95148640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e90147080 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00c410 tx=0x7f0e8c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e85ffb640 1 -- 172.21.15.45:0/4287301974 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0074e0 con 0x7f0e900cd120 2023-07-09T02:17:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e85ffb640 1 -- 172.21.15.45:0/4287301974 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c007640 con 0x7f0e900cd120 2023-07-09T02:17:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e85ffb640 1 -- 172.21.15.45:0/4287301974 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c004a30 con 0x7f0e900cd120 2023-07-09T02:17:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e900b59f0 con 0x7f0e900cd120 2023-07-09T02:17:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.120+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e90156f30 con 0x7f0e900cd120 2023-07-09T02:17:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.124+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9004d7d0 con 0x7f0e900cd120 2023-07-09T02:17:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.124+0000 7f0e85ffb640 1 -- 172.21.15.45:0/4287301974 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e8c004b90 con 0x7f0e900cd120 2023-07-09T02:17:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.124+0000 7f0e85ffb640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e74066280 0x7f0e74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.124+0000 7f0e85ffb640 1 -- 172.21.15.45:0/4287301974 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e8c083bf0 con 0x7f0e900cd120 2023-07-09T02:17:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.124+0000 7f0e94947640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e74066280 0x7f0e74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.124+0000 7f0e94947640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e74066280 0x7f0e74068730 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0e9015ef20 tx=0x7f0e80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.128+0000 7f0e85ffb640 1 -- 172.21.15.45:0/4287301974 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e8c050fd0 con 0x7f0e900cd120 2023-07-09T02:17:32.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.284+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e9006baa0 con 0x7f0e900cd120 2023-07-09T02:17:32.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.284+0000 7f0e85ffb640 1 -- 172.21.15.45:0/4287301974 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e8c0545f0 con 0x7f0e900cd120 2023-07-09T02:17:32.287 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:17:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e74066280 msgr2=0x7f0e74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e74066280 0x7f0e74068730 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0e9015ef20 tx=0x7f0e80009040 comp rx=0 tx=0).stop 2023-07-09T02:17:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 msgr2=0x7f0e90147080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e90147080 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00c410 tx=0x7f0e8c00c8d0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 shutdown_connections 2023-07-09T02:17:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e9015c060 0x7f0e90144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e74066280 0x7f0e74068730 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e900d2620 0x7f0e90155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 --2- 172.21.15.45:0/4287301974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e900cd120 0x7f0e90147080 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 >> 172.21.15.45:0/4287301974 conn(0x7f0e900698e0 msgr2=0x7f0e900b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:32.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 shutdown_connections 2023-07-09T02:17:32.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.288+0000 7f0e973ac640 1 -- 172.21.15.45:0/4287301974 wait complete. 2023-07-09T02:17:32.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:32.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.448+0000 7f9a8390d640 1 Processor -- start 2023-07-09T02:17:32.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.448+0000 7f9a8390d640 1 -- start start 2023-07-09T02:17:32.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a8390d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a7c158e30 0x7f9a7c06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a8390d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 0x7f9a7c06c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a8390d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a7c06c650 0x7f9a7c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a8390d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c06cad0 con 0x7f9a7c158e30 2023-07-09T02:17:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a8390d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c0ccf80 con 0x7f9a7c06c650 2023-07-09T02:17:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a8390d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0cd540 con 0x7f9a7c06fd10 2023-07-09T02:17:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a816a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a7c158e30 0x7f9a7c06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a816a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9a7c158e30 0x7f9a7c06f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40524/0 (socket says 172.21.15.45:40524) 2023-07-09T02:17:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a816a9640 1 -- 172.21.15.45:0/3848288105 learned_addr learned my addr 172.21.15.45:0/3848288105 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:32.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a80ea8640 1 --2- 172.21.15.45:0/3848288105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 0x7f9a7c06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a81eaa640 1 --2- 172.21.15.45:0/3848288105 >> v2:172.21.15.155:3300/0 conn(0x7f9a7c06c650 0x7f9a7c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a816a9640 1 -- 172.21.15.45:0/3848288105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 msgr2=0x7f9a7c06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a816a9640 1 --2- 172.21.15.45:0/3848288105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 0x7f9a7c06c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a816a9640 1 -- 172.21.15.45:0/3848288105 >> v2:172.21.15.155:3300/0 conn(0x7f9a7c06c650 msgr2=0x7f9a7c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a816a9640 1 --2- 172.21.15.45:0/3848288105 >> v2:172.21.15.155:3300/0 conn(0x7f9a7c06c650 0x7f9a7c0caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.452+0000 7f9a816a9640 1 -- 172.21.15.45:0/3848288105 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c0c8fb0 con 0x7f9a7c158e30 2023-07-09T02:17:32.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a816a9640 1 --2- 172.21.15.45:0/3848288105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c06f7d0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0adf40 tx=0x7f9a7801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b9333d6ac3b07a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a73fff640 1 -- 172.21.15.45:0/3848288105 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780ab620 con 0x7f9a7c158e30 2023-07-09T02:17:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a73fff640 1 -- 172.21.15.45:0/3848288105 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a780ab780 con 0x7f9a7c158e30 2023-07-09T02:17:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a73fff640 1 -- 172.21.15.45:0/3848288105 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780abb10 con 0x7f9a7c158e30 2023-07-09T02:17:32.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 -- 172.21.15.45:0/3848288105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 msgr2=0x7f9a7c06f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 --2- 172.21.15.45:0/3848288105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c06f7d0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0adf40 tx=0x7f9a7801c440 comp rx=0 tx=0).stop 2023-07-09T02:17:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 -- 172.21.15.45:0/3848288105 shutdown_connections 2023-07-09T02:17:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 --2- 172.21.15.45:0/3848288105 >> v2:172.21.15.155:3300/0 conn(0x7f9a7c06c650 0x7f9a7c0caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 --2- 172.21.15.45:0/3848288105 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 0x7f9a7c06c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 --2- 172.21.15.45:0/3848288105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c06f7d0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 -- 172.21.15.45:0/3848288105 >> 172.21.15.45:0/3848288105 conn(0x7f9a7c0694b0 msgr2=0x7f9a7c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:32.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 -- 172.21.15.45:0/3848288105 shutdown_connections 2023-07-09T02:17:32.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 -- 172.21.15.45:0/3848288105 wait complete. 2023-07-09T02:17:32.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 Processor -- start 2023-07-09T02:17:32.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 -- start start 2023-07-09T02:17:32.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.456+0000 7f9a8390d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a7c06c650 0x7f9a7c14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a8390d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 0x7f9a7c1f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a8390d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a8390d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b2730 con 0x7f9a7c158e30 2023-07-09T02:17:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a8390d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c14f0a0 con 0x7f9a7c06c650 2023-07-09T02:17:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a8390d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b1ab0 con 0x7f9a7c06fd10 2023-07-09T02:17:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c1577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40526/0 (socket says 172.21.15.45:40526) 2023-07-09T02:17:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 -- 172.21.15.45:0/2981037392 learned_addr learned my addr 172.21.15.45:0/2981037392 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a80ea8640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 0x7f9a7c1f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a816a9640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a7c06c650 0x7f9a7c14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 -- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 msgr2=0x7f9a7c1f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 0x7f9a7c1f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 -- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a7c06c650 msgr2=0x7f9a7c14eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a7c06c650 0x7f9a7c14eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 -- 172.21.15.45:0/2981037392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780094d0 con 0x7f9a7c158e30 2023-07-09T02:17:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a81eaa640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c1577b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007e60 tx=0x7f9a7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a71ffb640 1 -- 172.21.15.45:0/2981037392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74014620 con 0x7f9a7c158e30 2023-07-09T02:17:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a71ffb640 1 -- 172.21.15.45:0/2981037392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7400ee90 con 0x7f9a7c158e30 2023-07-09T02:17:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c0b1d90 con 0x7f9a7c158e30 2023-07-09T02:17:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a71ffb640 1 -- 172.21.15.45:0/2981037392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740149e0 con 0x7f9a7c158e30 2023-07-09T02:17:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c0b2350 con 0x7f9a7c158e30 2023-07-09T02:17:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c0caf00 con 0x7f9a7c158e30 2023-07-09T02:17:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.460+0000 7f9a71ffb640 1 -- 172.21.15.45:0/2981037392 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a74014b40 con 0x7f9a7c158e30 2023-07-09T02:17:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.464+0000 7f9a71ffb640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.464+0000 7f9a71ffb640 1 -- 172.21.15.45:0/2981037392 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a74084490 con 0x7f9a7c158e30 2023-07-09T02:17:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.464+0000 7f9a816a9640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.464+0000 7f9a816a9640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9a60066280 0x7f9a60068730 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9a780af000 tx=0x7f9a780b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.468+0000 7f9a71ffb640 1 -- 172.21.15.45:0/2981037392 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a74051a50 con 0x7f9a7c158e30 2023-07-09T02:17:32.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.652+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a7c04d7d0 con 0x7f9a7c158e30 2023-07-09T02:17:32.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.652+0000 7f9a71ffb640 1 -- 172.21.15.45:0/2981037392 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f9a74055070 con 0x7f9a7c158e30 2023-07-09T02:17:32.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:32.655 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:12.050406+0000","modified":"2023-07-09T02:17:15.686025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7392":{"gid":7392,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3333848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3333848450},{"type":"v1","addr":"172.21.15.155:6837","nonce":3333848450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T02:17:32.655 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 59 2023-07-09T02:17:32.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9a60066280 msgr2=0x7f9a60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9a60066280 0x7f9a60068730 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9a780af000 tx=0x7f9a780b6040 comp rx=0 tx=0).stop 2023-07-09T02:17:32.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 msgr2=0x7f9a7c1577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c1577b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007e60 tx=0x7f9a7400e4b0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 shutdown_connections 2023-07-09T02:17:32.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a7c158e30 0x7f9a7c1577b0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7c06fd10 0x7f9a7c1f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 --2- 172.21.15.45:0/2981037392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a7c06c650 0x7f9a7c14eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 >> 172.21.15.45:0/2981037392 conn(0x7f9a7c0694b0 msgr2=0x7f9a7c0c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 shutdown_connections 2023-07-09T02:17:32.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.656+0000 7f9a8390d640 1 -- 172.21.15.45:0/2981037392 wait complete. 2023-07-09T02:17:32.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f50789da640 1 Processor -- start 2023-07-09T02:17:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f50789da640 1 -- start start 2023-07-09T02:17:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f50789da640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50740c8d40 0x7f50740ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f50789da640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740b4ae0 0x7f50740d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f50789da640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740cd5d0 con 0x7f5074160670 2023-07-09T02:17:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f50789da640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50740d2050 con 0x7f50740c8d40 2023-07-09T02:17:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f50789da640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740d27a0 con 0x7f50740b4ae0 2023-07-09T02:17:32.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f507359e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740b4ae0 0x7f50740d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f5072d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50740c8d40 0x7f50740ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f507359e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740b4ae0 0x7f50740d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:42080/0 (socket says 172.21.15.45:42080) 2023-07-09T02:17:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f507359e640 1 -- 172.21.15.45:0/986523736 learned_addr learned my addr 172.21.15.45:0/986523736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.820+0000 7f5072d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50740c8d40 0x7f50740ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:59082/0 (socket says 172.21.15.45:59082) 2023-07-09T02:17:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507359e640 1 -- 172.21.15.45:0/986523736 >> v2:172.21.15.155:3300/0 conn(0x7f50740c8d40 msgr2=0x7f50740ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507359e640 1 --2- 172.21.15.45:0/986523736 >> v2:172.21.15.155:3300/0 conn(0x7f50740c8d40 0x7f50740ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507359e640 1 -- 172.21.15.45:0/986523736 >> v1:172.21.15.155:6789/0 conn(0x7f5074160670 legacy=0x7f50740b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507359e640 1 -- 172.21.15.45:0/986523736 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074160ad0 con 0x7f50740b4ae0 2023-07-09T02:17:32.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507259c640 1 -- 172.21.15.45:0/986523736 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731701215 0 0) 0x7f50740cd5d0 con 0x7f5074160670 2023-07-09T02:17:32.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f5072d9d640 1 --2- 172.21.15.45:0/986523736 >> v2:172.21.15.155:3300/0 conn(0x7f50740c8d40 0x7f50740ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:32.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507359e640 1 --2- 172.21.15.45:0/986523736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740b4ae0 0x7f50740d0490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f506c009e50 tx=0x7f506c01f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d5af2a8a68193a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507259c640 1 -- 172.21.15.45:0/986523736 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0af400 con 0x7f50740b4ae0 2023-07-09T02:17:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507259c640 1 -- 172.21.15.45:0/986523736 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c0ab050 con 0x7f50740b4ae0 2023-07-09T02:17:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f507259c640 1 -- 172.21.15.45:0/986523736 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0af780 con 0x7f50740b4ae0 2023-07-09T02:17:32.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f50789da640 1 -- 172.21.15.45:0/986523736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740b4ae0 msgr2=0x7f50740d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.824+0000 7f50789da640 1 --2- 172.21.15.45:0/986523736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740b4ae0 0x7f50740d0490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f506c009e50 tx=0x7f506c01f1f0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 -- 172.21.15.45:0/986523736 shutdown_connections 2023-07-09T02:17:32.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 --2- 172.21.15.45:0/986523736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740b4ae0 0x7f50740d0490 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 --2- 172.21.15.45:0/986523736 >> v2:172.21.15.155:3300/0 conn(0x7f50740c8d40 0x7f50740ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 -- 172.21.15.45:0/986523736 >> 172.21.15.45:0/986523736 conn(0x7f50740d2950 msgr2=0x7f50740d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:32.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 -- 172.21.15.45:0/986523736 shutdown_connections 2023-07-09T02:17:32.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 -- 172.21.15.45:0/986523736 wait complete. 2023-07-09T02:17:32.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 Processor -- start 2023-07-09T02:17:32.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 -- start start 2023-07-09T02:17:32.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740b4ae0 0x7f5074158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740c8d40 0x7f50740c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5074160670 0x7f50740c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740b5920 con 0x7f50740b4ae0 2023-07-09T02:17:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740b7900 con 0x7f5074160670 2023-07-09T02:17:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f50789da640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740ca5a0 con 0x7f50740c8d40 2023-07-09T02:17:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f5072d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740b4ae0 0x7f5074158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f507359e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5074160670 0x7f50740c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f506bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740c8d40 0x7f50740c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f5072d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740b4ae0 0x7f5074158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40538/0 (socket says 172.21.15.45:40538) 2023-07-09T02:17:32.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.828+0000 7f5072d9d640 1 -- 172.21.15.45:0/4041816043 learned_addr learned my addr 172.21.15.45:0/4041816043 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:32.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f507359e640 1 -- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740c8d40 msgr2=0x7f50740c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f507359e640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740c8d40 0x7f50740c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f507359e640 1 -- 172.21.15.45:0/4041816043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740b4ae0 msgr2=0x7f5074158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:32.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f507359e640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740b4ae0 0x7f5074158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:32.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f507359e640 1 -- 172.21.15.45:0/4041816043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009420 con 0x7f5074160670 2023-07-09T02:17:32.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f5072d9d640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740b4ae0 0x7f5074158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f507359e640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5074160670 0x7f50740c9ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f506c0ae000 tx=0x7f506c01bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f506b7fe640 1 -- 172.21.15.45:0/4041816043 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0c0070 con 0x7f5074160670 2023-07-09T02:17:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f506b7fe640 1 -- 172.21.15.45:0/4041816043 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c009510 con 0x7f5074160670 2023-07-09T02:17:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c009b30 con 0x7f5074160670 2023-07-09T02:17:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f506b7fe640 1 -- 172.21.15.45:0/4041816043 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0afd90 con 0x7f5074160670 2023-07-09T02:17:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50740cab60 con 0x7f5074160670 2023-07-09T02:17:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50740b5a60 con 0x7f5074160670 2023-07-09T02:17:32.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.832+0000 7f506b7fe640 1 -- 172.21.15.45:0/4041816043 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f506c0b6040 con 0x7f5074160670 2023-07-09T02:17:32.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.836+0000 7f506b7fe640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5054066280 0x7f5054068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:32.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.836+0000 7f506b7fe640 1 -- 172.21.15.45:0/4041816043 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f506c121fe0 con 0x7f5074160670 2023-07-09T02:17:32.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.836+0000 7f5072d9d640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5054066280 0x7f5054068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:32.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.836+0000 7f5072d9d640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5054066280 0x7f5054068730 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5064009fd0 tx=0x7f5064009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:32.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:32.836+0000 7f506b7fe640 1 -- 172.21.15.45:0/4041816043 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f506c0ef5a0 con 0x7f5074160670 2023-07-09T02:17:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.000+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50740b5a60 con 0x7f5074160670 2023-07-09T02:17:33.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.000+0000 7f506b7fe640 1 -- 172.21.15.45:0/4041816043 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f50740b5a60 con 0x7f5074160670 2023-07-09T02:17:33.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:33.002 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":126,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:23.740952+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:33.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5054066280 msgr2=0x7f5054068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5054066280 0x7f5054068730 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5064009fd0 tx=0x7f5064009190 comp rx=0 tx=0).stop 2023-07-09T02:17:33.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5074160670 msgr2=0x7f50740c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5074160670 0x7f50740c9ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f506c0ae000 tx=0x7f506c01bf90 comp rx=0 tx=0).stop 2023-07-09T02:17:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 shutdown_connections 2023-07-09T02:17:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5074160670 0x7f50740c9ed0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5054066280 0x7f5054068730 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50740c8d40 0x7f50740c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 --2- 172.21.15.45:0/4041816043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740b4ae0 0x7f5074158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 >> 172.21.15.45:0/4041816043 conn(0x7f50740d2950 msgr2=0x7f50740cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:33.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 shutdown_connections 2023-07-09T02:17:33.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.004+0000 7f50789da640 1 -- 172.21.15.45:0/4041816043 wait complete. 2023-07-09T02:17:33.024 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:17:33.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:33.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f08316fc640 1 Processor -- start 2023-07-09T02:17:33.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f08316fc640 1 -- start start 2023-07-09T02:17:33.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f08316fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f082c15c060 0x7f082c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f08316fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f082c0cd120 0x7f082c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f08316fc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c160a50 con 0x7f082c0d2450 2023-07-09T02:17:33.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f08316fc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082c0d28d0 con 0x7f082c0cd120 2023-07-09T02:17:33.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f08316fc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082c0cfe40 con 0x7f082c15c060 2023-07-09T02:17:33.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f0823fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f082c0cd120 0x7f082c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f0823fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f082c0cd120 0x7f082c0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40552/0 (socket says 172.21.15.45:40552) 2023-07-09T02:17:33.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f0823fff640 1 -- 172.21.15.45:0/3157085259 learned_addr learned my addr 172.21.15.45:0/3157085259 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:33.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f082affd640 1 --2- 172.21.15.45:0/3157085259 >> v2:172.21.15.155:3300/0 conn(0x7f082c15c060 0x7f082c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f0823fff640 1 -- 172.21.15.45:0/3157085259 >> v2:172.21.15.155:3300/0 conn(0x7f082c15c060 msgr2=0x7f082c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f0823fff640 1 --2- 172.21.15.45:0/3157085259 >> v2:172.21.15.155:3300/0 conn(0x7f082c15c060 0x7f082c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f0823fff640 1 -- 172.21.15.45:0/3157085259 >> v1:172.21.15.155:6789/0 conn(0x7f082c0d2450 legacy=0x7f082c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.168+0000 7f0823fff640 1 -- 172.21.15.45:0/3157085259 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c15c430 con 0x7f082c0cd120 2023-07-09T02:17:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f0823fff640 1 --2- 172.21.15.45:0/3157085259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0d1f10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f082c0d3ad0 tx=0x7f081401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2babf74b1f418cc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f082a7fc640 1 -- 172.21.15.45:0/3157085259 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08140ac410 con 0x7f082c0cd120 2023-07-09T02:17:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f082a7fc640 1 -- 172.21.15.45:0/3157085259 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08140ac570 con 0x7f082c0cd120 2023-07-09T02:17:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f082a7fc640 1 -- 172.21.15.45:0/3157085259 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08140ac900 con 0x7f082c0cd120 2023-07-09T02:17:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f08316fc640 1 -- 172.21.15.45:0/3157085259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 msgr2=0x7f082c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f08316fc640 1 --2- 172.21.15.45:0/3157085259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0d1f10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f082c0d3ad0 tx=0x7f081401c490 comp rx=0 tx=0).stop 2023-07-09T02:17:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f08316fc640 1 -- 172.21.15.45:0/3157085259 shutdown_connections 2023-07-09T02:17:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f08316fc640 1 --2- 172.21.15.45:0/3157085259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0d1f10 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f08316fc640 1 --2- 172.21.15.45:0/3157085259 >> v2:172.21.15.155:3300/0 conn(0x7f082c15c060 0x7f082c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f08316fc640 1 -- 172.21.15.45:0/3157085259 >> 172.21.15.45:0/3157085259 conn(0x7f082c0698e0 msgr2=0x7f082c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f08316fc640 1 -- 172.21.15.45:0/3157085259 shutdown_connections 2023-07-09T02:17:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.172+0000 7f08316fc640 1 -- 172.21.15.45:0/3157085259 wait complete. 2023-07-09T02:17:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 Processor -- start 2023-07-09T02:17:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 -- start start 2023-07-09T02:17:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c0d2450 0x7f082c0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f082c15c060 0x7f082c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0b3850 con 0x7f082c0cd120 2023-07-09T02:17:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0b29a0 con 0x7f082c0d2450 2023-07-09T02:17:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0b2bd0 con 0x7f082c15c060 2023-07-09T02:17:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40564/0 (socket says 172.21.15.45:40564) 2023-07-09T02:17:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 -- 172.21.15.45:0/599238883 learned_addr learned my addr 172.21.15.45:0/599238883 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f0823fff640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c0d2450 0x7f082c0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082b7fe640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f082c15c060 0x7f082c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 -- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f082c15c060 msgr2=0x7f082c153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f082c15c060 0x7f082c153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 -- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c0d2450 msgr2=0x7f082c0b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c0d2450 0x7f082c0b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 -- 172.21.15.45:0/599238883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140094d0 con 0x7f082c0cd120 2023-07-09T02:17:33.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f082affd640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0cbfc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f081c00d5f0 tx=0x7f081c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08237fe640 1 -- 172.21.15.45:0/599238883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c0125f0 con 0x7f082c0cd120 2023-07-09T02:17:33.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08237fe640 1 -- 172.21.15.45:0/599238883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c012750 con 0x7f082c0cd120 2023-07-09T02:17:33.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08237fe640 1 -- 172.21.15.45:0/599238883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c012ae0 con 0x7f082c0cd120 2023-07-09T02:17:33.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c0b2eb0 con 0x7f082c0cd120 2023-07-09T02:17:33.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c0b3470 con 0x7f082c0cd120 2023-07-09T02:17:33.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.176+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c04d7d0 con 0x7f082c0cd120 2023-07-09T02:17:33.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.180+0000 7f08237fe640 1 -- 172.21.15.45:0/599238883 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f081c012c40 con 0x7f082c0cd120 2023-07-09T02:17:33.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.180+0000 7f08237fe640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f080c066280 0x7f080c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.180+0000 7f08237fe640 1 -- 172.21.15.45:0/599238883 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f081c084180 con 0x7f082c0cd120 2023-07-09T02:17:33.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.180+0000 7f0823fff640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f080c066280 0x7f080c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.180+0000 7f0823fff640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f080c066280 0x7f080c068730 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f08140ae000 tx=0x7f0814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.184+0000 7f08237fe640 1 -- 172.21.15.45:0/599238883 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f081c0515f0 con 0x7f082c0cd120 2023-07-09T02:17:33.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.368+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f082c0ccf00 con 0x7f082c0cd120 2023-07-09T02:17:33.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.368+0000 7f08237fe640 1 -- 172.21.15.45:0/599238883 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f081c007380 con 0x7f082c0cd120 2023-07-09T02:17:33.370 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:33.371 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:12.050406+0000","modified":"2023-07-09T02:17:15.686025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7392":{"gid":7392,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3333848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3333848450},{"type":"v1","addr":"172.21.15.155:6837","nonce":3333848450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T02:17:33.371 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 59 2023-07-09T02:17:33.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.368+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f080c066280 msgr2=0x7f080c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.368+0000 7f08316fc640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f080c066280 0x7f080c068730 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f08140ae000 tx=0x7f0814009040 comp rx=0 tx=0).stop 2023-07-09T02:17:33.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.368+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 msgr2=0x7f082c0cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.368+0000 7f08316fc640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0cbfc0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f081c00d5f0 tx=0x7f081c00dab0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.372+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 shutdown_connections 2023-07-09T02:17:33.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.372+0000 7f08316fc640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f080c066280 0x7f080c068730 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.372+0000 7f08316fc640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f082c15c060 0x7f082c153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.372+0000 7f08316fc640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c0d2450 0x7f082c0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.372+0000 7f08316fc640 1 --2- 172.21.15.45:0/599238883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f082c0cd120 0x7f082c0cbfc0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.372+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 >> 172.21.15.45:0/599238883 conn(0x7f082c0698e0 msgr2=0x7f082c0b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:33.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.372+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 shutdown_connections 2023-07-09T02:17:33.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.372+0000 7f08316fc640 1 -- 172.21.15.45:0/599238883 wait complete. 2023-07-09T02:17:33.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf4337640 1 Processor -- start 2023-07-09T02:17:33.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf4337640 1 -- start start 2023-07-09T02:17:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf4337640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0d2620 0x7f4bec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf4337640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bec0cd120 0x7f4bec0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf4337640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec160a50 con 0x7f4bec15c060 2023-07-09T02:17:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf4337640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec15c430 con 0x7f4bec0cd120 2023-07-09T02:17:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf4337640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec15fb60 con 0x7f4bec0d2620 2023-07-09T02:17:33.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf20d3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4bec15c060 0x7f4bec0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49516/0 (socket says 172.21.15.45:49516) 2023-07-09T02:17:33.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf20d3640 1 -- 172.21.15.45:0/4008962471 learned_addr learned my addr 172.21.15.45:0/4008962471 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:33.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf28d4640 1 --2- 172.21.15.45:0/4008962471 >> v2:172.21.15.45:3300/0 conn(0x7f4bec0cd120 0x7f4bec0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.532+0000 7f4bf18d2640 1 --2- 172.21.15.45:0/4008962471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0d2620 0x7f4bec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf10d1640 1 -- 172.21.15.45:0/4008962471 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190303219 0 0) 0x7f4bec160a50 con 0x7f4bec15c060 2023-07-09T02:17:33.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf10d1640 1 -- 172.21.15.45:0/4008962471 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bd8003530 con 0x7f4bec15c060 2023-07-09T02:17:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf28d4640 1 -- 172.21.15.45:0/4008962471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0d2620 msgr2=0x7f4bec0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf28d4640 1 --2- 172.21.15.45:0/4008962471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0d2620 0x7f4bec0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf28d4640 1 -- 172.21.15.45:0/4008962471 >> v1:172.21.15.45:6789/0 conn(0x7f4bec15c060 legacy=0x7f4bec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf28d4640 1 -- 172.21.15.45:0/4008962471 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec15fe40 con 0x7f4bec0cd120 2023-07-09T02:17:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf28d4640 1 --2- 172.21.15.45:0/4008962471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0cd120 0x7f4bec0cee30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009d90 tx=0x7f4be401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878c698a089a7679 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf10d1640 1 -- 172.21.15.45:0/4008962471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40a59e0 con 0x7f4bec0cd120 2023-07-09T02:17:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf10d1640 1 -- 172.21.15.45:0/4008962471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be40a5b40 con 0x7f4bec0cd120 2023-07-09T02:17:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf10d1640 1 -- 172.21.15.45:0/4008962471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40ad440 con 0x7f4bec0cd120 2023-07-09T02:17:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf4337640 1 -- 172.21.15.45:0/4008962471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0cd120 msgr2=0x7f4bec0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf4337640 1 --2- 172.21.15.45:0/4008962471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0cd120 0x7f4bec0cee30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009d90 tx=0x7f4be401c920 comp rx=0 tx=0).stop 2023-07-09T02:17:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf4337640 1 -- 172.21.15.45:0/4008962471 shutdown_connections 2023-07-09T02:17:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf4337640 1 --2- 172.21.15.45:0/4008962471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec0cd120 0x7f4bec0cee30 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf4337640 1 --2- 172.21.15.45:0/4008962471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0d2620 0x7f4bec0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf4337640 1 -- 172.21.15.45:0/4008962471 >> 172.21.15.45:0/4008962471 conn(0x7f4bec0698e0 msgr2=0x7f4bec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.536+0000 7f4bf4337640 1 -- 172.21.15.45:0/4008962471 shutdown_connections 2023-07-09T02:17:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 -- 172.21.15.45:0/4008962471 wait complete. 2023-07-09T02:17:33.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 Processor -- start 2023-07-09T02:17:33.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 -- start start 2023-07-09T02:17:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0cd120 0x7f4bec14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bec0d2620 0x7f4bec151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec15c060 0x7f4bec153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec1504e0 con 0x7f4bec15c060 2023-07-09T02:17:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec1f7a60 con 0x7f4bec0d2620 2023-07-09T02:17:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf4337640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec1f7d00 con 0x7f4bec0cd120 2023-07-09T02:17:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec15c060 0x7f4bec153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec15c060 0x7f4bec153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40584/0 (socket says 172.21.15.45:40584) 2023-07-09T02:17:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 -- 172.21.15.45:0/1171087834 learned_addr learned my addr 172.21.15.45:0/1171087834 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf20d3640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0cd120 0x7f4bec14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf18d2640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bec0d2620 0x7f4bec151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 -- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0cd120 msgr2=0x7f4bec14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0cd120 0x7f4bec14ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 -- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bec0d2620 msgr2=0x7f4bec151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bec0d2620 0x7f4bec151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 -- 172.21.15.45:0/1171087834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4009a70 con 0x7f4bec15c060 2023-07-09T02:17:33.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.540+0000 7f4bf28d4640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec15c060 0x7f4bec153c50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f4be40b0040 tx=0x7f4be40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4be2ffd640 1 -- 172.21.15.45:0/1171087834 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40add90 con 0x7f4bec15c060 2023-07-09T02:17:33.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4be2ffd640 1 -- 172.21.15.45:0/1171087834 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be4009450 con 0x7f4bec15c060 2023-07-09T02:17:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec0b59f0 con 0x7f4bec15c060 2023-07-09T02:17:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4be2ffd640 1 -- 172.21.15.45:0/1171087834 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40b9690 con 0x7f4bec15c060 2023-07-09T02:17:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec1f82c0 con 0x7f4bec15c060 2023-07-09T02:17:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec1f84b0 con 0x7f4bec15c060 2023-07-09T02:17:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4be2ffd640 1 -- 172.21.15.45:0/1171087834 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4be40039a0 con 0x7f4bec15c060 2023-07-09T02:17:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4be2ffd640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bd00662b0 0x7f4bd0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4be2ffd640 1 -- 172.21.15.45:0/1171087834 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4be411f2e0 con 0x7f4bec15c060 2023-07-09T02:17:33.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.544+0000 7f4bf20d3640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bd00662b0 0x7f4bd0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.548+0000 7f4bf20d3640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bd00662b0 0x7f4bd0068760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4be80011f0 tx=0x7f4be8007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.548+0000 7f4be2ffd640 1 -- 172.21.15.45:0/1171087834 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4be40ec920 con 0x7f4bec15c060 2023-07-09T02:17:33.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bec04d7d0 con 0x7f4bec15c060 2023-07-09T02:17:33.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4be2ffd640 1 -- 172.21.15.45:0/1171087834 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f4be40eff40 con 0x7f4bec15c060 2023-07-09T02:17:33.737 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:33.737 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:12.050406+0000","modified":"2023-07-09T02:17:15.686025+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7392":{"gid":7392,"name":"d","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3333848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3333848450},{"type":"v1","addr":"172.21.15.155:6837","nonce":3333848450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T02:17:33.738 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 59 2023-07-09T02:17:33.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bd00662b0 msgr2=0x7f4bd0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bd00662b0 0x7f4bd0068760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4be80011f0 tx=0x7f4be8007d40 comp rx=0 tx=0).stop 2023-07-09T02:17:33.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec15c060 msgr2=0x7f4bec153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec15c060 0x7f4bec153c50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f4be40b0040 tx=0x7f4be40196c0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 shutdown_connections 2023-07-09T02:17:33.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bec15c060 0x7f4bec153c50 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bec0d2620 0x7f4bec151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bd00662b0 0x7f4bd0068760 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 --2- 172.21.15.45:0/1171087834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bec0cd120 0x7f4bec14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 >> 172.21.15.45:0/1171087834 conn(0x7f4bec0698e0 msgr2=0x7f4bec0b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:33.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 shutdown_connections 2023-07-09T02:17:33.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.736+0000 7f4bf4337640 1 -- 172.21.15.45:0/1171087834 wait complete. 2023-07-09T02:17:33.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f97327ac640 1 Processor -- start 2023-07-09T02:17:33.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f97327ac640 1 -- start start 2023-07-09T02:17:33.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f97327ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f972c0d2620 0x7f972c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f97327ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f972c0cd120 0x7f972c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f97327ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c160a50 con 0x7f972c15c060 2023-07-09T02:17:33.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f97327ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972c15c430 con 0x7f972c0d2620 2023-07-09T02:17:33.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f97327ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972c15fb60 con 0x7f972c0cd120 2023-07-09T02:17:33.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f972c15c060 0x7f972c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49518/0 (socket says 172.21.15.45:49518) 2023-07-09T02:17:33.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972bfff640 1 -- 172.21.15.45:0/1799146704 learned_addr learned my addr 172.21.15.45:0/1799146704 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:33.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972b7fe640 1 --2- 172.21.15.45:0/1799146704 >> v2:172.21.15.45:3300/0 conn(0x7f972c0d2620 0x7f972c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f9730d49640 1 --2- 172.21.15.45:0/1799146704 >> v2:172.21.15.155:3300/0 conn(0x7f972c0cd120 0x7f972c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972affd640 1 -- 172.21.15.45:0/1799146704 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729417697 0 0) 0x7f972c160a50 con 0x7f972c15c060 2023-07-09T02:17:33.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972affd640 1 -- 172.21.15.45:0/1799146704 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9714003530 con 0x7f972c15c060 2023-07-09T02:17:33.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972b7fe640 1 -- 172.21.15.45:0/1799146704 >> v2:172.21.15.155:3300/0 conn(0x7f972c0cd120 msgr2=0x7f972c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:33.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972b7fe640 1 --2- 172.21.15.45:0/1799146704 >> v2:172.21.15.155:3300/0 conn(0x7f972c0cd120 0x7f972c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972b7fe640 1 -- 172.21.15.45:0/1799146704 >> v1:172.21.15.45:6789/0 conn(0x7f972c15c060 legacy=0x7f972c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.900+0000 7f972b7fe640 1 -- 172.21.15.45:0/1799146704 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c15fe40 con 0x7f972c0d2620 2023-07-09T02:17:33.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f972b7fe640 1 --2- 172.21.15.45:0/1799146704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c0b4ed0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f972c06b120 tx=0x7f972001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88659b946bfe4de1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f972affd640 1 -- 172.21.15.45:0/1799146704 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200a7070 con 0x7f972c0d2620 2023-07-09T02:17:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f972affd640 1 -- 172.21.15.45:0/1799146704 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200ab430 con 0x7f972c0d2620 2023-07-09T02:17:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f972affd640 1 -- 172.21.15.45:0/1799146704 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200ab7c0 con 0x7f972c0d2620 2023-07-09T02:17:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f97327ac640 1 -- 172.21.15.45:0/1799146704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 msgr2=0x7f972c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f97327ac640 1 --2- 172.21.15.45:0/1799146704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c0b4ed0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f972c06b120 tx=0x7f972001c430 comp rx=0 tx=0).stop 2023-07-09T02:17:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f97327ac640 1 -- 172.21.15.45:0/1799146704 shutdown_connections 2023-07-09T02:17:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f97327ac640 1 --2- 172.21.15.45:0/1799146704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c0b4ed0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f97327ac640 1 --2- 172.21.15.45:0/1799146704 >> v2:172.21.15.155:3300/0 conn(0x7f972c0cd120 0x7f972c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f97327ac640 1 -- 172.21.15.45:0/1799146704 >> 172.21.15.45:0/1799146704 conn(0x7f972c0698e0 msgr2=0x7f972c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:33.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f97327ac640 1 -- 172.21.15.45:0/1799146704 shutdown_connections 2023-07-09T02:17:33.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.904+0000 7f97327ac640 1 -- 172.21.15.45:0/1799146704 wait complete. 2023-07-09T02:17:33.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f97327ac640 1 Processor -- start 2023-07-09T02:17:33.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f97327ac640 1 -- start start 2023-07-09T02:17:33.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f97327ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f972c0cd120 0x7f972c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f97327ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f97327ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f972c15c060 0x7f972c14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f97327ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c152f90 con 0x7f972c0d2620 2023-07-09T02:17:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f97327ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c1511e0 con 0x7f972c15c060 2023-07-09T02:17:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f97327ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c152c40 con 0x7f972c0cd120 2023-07-09T02:17:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40598/0 (socket says 172.21.15.45:40598) 2023-07-09T02:17:33.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 -- 172.21.15.45:0/3046034064 learned_addr learned my addr 172.21.15.45:0/3046034064 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:33.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972bfff640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f972c0cd120 0x7f972c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f9730d49640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f972c15c060 0x7f972c14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 -- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f972c0cd120 msgr2=0x7f972c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f972c0cd120 0x7f972c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 -- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f972c15c060 msgr2=0x7f972c14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f972c15c060 0x7f972c14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 -- 172.21.15.45:0/3046034064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720009420 con 0x7f972c0d2620 2023-07-09T02:17:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f9730d49640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f972c15c060 0x7f972c14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972bfff640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f972c0cd120 0x7f972c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f972b7fe640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c152210 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f9720019040 tx=0x7f972001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f9728ff9640 1 -- 172.21.15.45:0/3046034064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200bf610 con 0x7f972c0d2620 2023-07-09T02:17:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.908+0000 7f9728ff9640 1 -- 172.21.15.45:0/3046034064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200bf790 con 0x7f972c0d2620 2023-07-09T02:17:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f9728ff9640 1 -- 172.21.15.45:0/3046034064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200bfb40 con 0x7f972c0d2620 2023-07-09T02:17:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c0b59f0 con 0x7f972c0d2620 2023-07-09T02:17:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972c151710 con 0x7f972c0d2620 2023-07-09T02:17:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972c1530d0 con 0x7f972c0d2620 2023-07-09T02:17:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f9728ff9640 1 -- 172.21.15.45:0/3046034064 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97200b5400 con 0x7f972c0d2620 2023-07-09T02:17:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f9728ff9640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9718066280 0x7f9718068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:33.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f9728ff9640 1 -- 172.21.15.45:0/3046034064 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f972011e410 con 0x7f972c0d2620 2023-07-09T02:17:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f972bfff640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9718066280 0x7f9718068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.912+0000 7f972bfff640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9718066280 0x7f9718068730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f971c0011f0 tx=0x7f971c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:33.916+0000 7f9728ff9640 1 -- 172.21.15.45:0/3046034064 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f972c1530d0 con 0x7f972c0d2620 2023-07-09T02:17:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.072+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f972c1530d0 con 0x7f972c0d2620 2023-07-09T02:17:34.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.072+0000 7f9728ff9640 1 -- 172.21.15.45:0/3046034064 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f972c1530d0 con 0x7f972c0d2620 2023-07-09T02:17:34.076 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:34.076 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":126,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:23.740952+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:10.149383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:11.041822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:34.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9718066280 msgr2=0x7f9718068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9718066280 0x7f9718068730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f971c0011f0 tx=0x7f971c009040 comp rx=0 tx=0).stop 2023-07-09T02:17:34.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 msgr2=0x7f972c152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c152210 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f9720019040 tx=0x7f972001ac70 comp rx=0 tx=0).stop 2023-07-09T02:17:34.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 shutdown_connections 2023-07-09T02:17:34.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f972c15c060 0x7f972c14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f972c0d2620 0x7f972c152210 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9718066280 0x7f9718068730 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 --2- 172.21.15.45:0/3046034064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f972c0cd120 0x7f972c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 >> 172.21.15.45:0/3046034064 conn(0x7f972c0698e0 msgr2=0x7f972c069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 shutdown_connections 2023-07-09T02:17:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.076+0000 7f97327ac640 1 -- 172.21.15.45:0/3046034064 wait complete. 2023-07-09T02:17:34.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:17:34.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.240+0000 7f830487b640 1 Processor -- start 2023-07-09T02:17:34.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.240+0000 7f830487b640 1 -- start start 2023-07-09T02:17:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f830487b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000cd290 0x7f83000cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f830487b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f830006a5c0 0x7f830006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f830487b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8300071140 con 0x7f83000b2340 2023-07-09T02:17:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f830487b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830006b010 con 0x7f830006a5c0 2023-07-09T02:17:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f830487b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83000cdba0 con 0x7f83000cd290 2023-07-09T02:17:34.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f82fe59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000cd290 0x7f83000cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f82f7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f830006a5c0 0x7f830006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f82fe59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000cd290 0x7f83000cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:42146/0 (socket says 172.21.15.45:42146) 2023-07-09T02:17:34.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f82fe59c640 1 -- 172.21.15.45:0/3227276594 learned_addr learned my addr 172.21.15.45:0/3227276594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:34.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f82f7fff640 1 -- 172.21.15.45:0/3227276594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000cd290 msgr2=0x7f83000cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f82f7fff640 1 --2- 172.21.15.45:0/3227276594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000cd290 0x7f83000cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f82f7fff640 1 -- 172.21.15.45:0/3227276594 >> v1:172.21.15.155:6789/0 conn(0x7f83000b2340 legacy=0x7f83000b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.244+0000 7f82f7fff640 1 -- 172.21.15.45:0/3227276594 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830015c970 con 0x7f830006a5c0 2023-07-09T02:17:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f82f7fff640 1 --2- 172.21.15.45:0/3227276594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f830006a5c0 0x7f830006aa10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f82e80097c0 tx=0x7f82e801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=616abba546e158dd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f82fdd9b640 1 -- 172.21.15.45:0/3227276594 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e80ab600 con 0x7f830006a5c0 2023-07-09T02:17:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f82fdd9b640 1 -- 172.21.15.45:0/3227276594 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e80a7050 con 0x7f830006a5c0 2023-07-09T02:17:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f82fdd9b640 1 -- 172.21.15.45:0/3227276594 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e80ab980 con 0x7f830006a5c0 2023-07-09T02:17:34.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 -- 172.21.15.45:0/3227276594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f830006a5c0 msgr2=0x7f830006aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 --2- 172.21.15.45:0/3227276594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f830006a5c0 0x7f830006aa10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f82e80097c0 tx=0x7f82e801c480 comp rx=0 tx=0).stop 2023-07-09T02:17:34.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 -- 172.21.15.45:0/3227276594 shutdown_connections 2023-07-09T02:17:34.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 --2- 172.21.15.45:0/3227276594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f830006a5c0 0x7f830006aa10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 --2- 172.21.15.45:0/3227276594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000cd290 0x7f83000cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 -- 172.21.15.45:0/3227276594 >> 172.21.15.45:0/3227276594 conn(0x7f830006d140 msgr2=0x7f830006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:34.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 -- 172.21.15.45:0/3227276594 shutdown_connections 2023-07-09T02:17:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 -- 172.21.15.45:0/3227276594 wait complete. 2023-07-09T02:17:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 Processor -- start 2023-07-09T02:17:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.248+0000 7f830487b640 1 -- start start 2023-07-09T02:17:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830006a5c0 0x7f83000c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000b2340 0x7f83000b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83000cd290 0x7f83000b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83000c6d80 con 0x7f830006a5c0 2023-07-09T02:17:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83001f5210 con 0x7f83000cd290 2023-07-09T02:17:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83001f54f0 con 0x7f83000b2340 2023-07-09T02:17:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830006a5c0 0x7f83000c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830006a5c0 0x7f83000c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40600/0 (socket says 172.21.15.45:40600) 2023-07-09T02:17:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 -- 172.21.15.45:0/2336950771 learned_addr learned my addr 172.21.15.45:0/2336950771 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82f7fff640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000b2340 0x7f83000b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fed9d640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83000cd290 0x7f83000b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 -- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000b2340 msgr2=0x7f83000b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000b2340 0x7f83000b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 -- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83000cd290 msgr2=0x7f83000b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83000cd290 0x7f83000b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 -- 172.21.15.45:0/2336950771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8009420 con 0x7f830006a5c0 2023-07-09T02:17:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82f7fff640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000b2340 0x7f83000b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82fe59c640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830006a5c0 0x7f83000c6840 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f82f000e7f0 tx=0x7f82f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82f6ffd640 1 -- 172.21.15.45:0/2336950771 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0009580 con 0x7f830006a5c0 2023-07-09T02:17:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82f6ffd640 1 -- 172.21.15.45:0/2336950771 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000c940 con 0x7f830006a5c0 2023-07-09T02:17:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83001f57d0 con 0x7f830006a5c0 2023-07-09T02:17:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82f6ffd640 1 -- 172.21.15.45:0/2336950771 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000ccf0 con 0x7f830006a5c0 2023-07-09T02:17:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83000b3c30 con 0x7f830006a5c0 2023-07-09T02:17:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83000c77a0 con 0x7f830006a5c0 2023-07-09T02:17:34.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.252+0000 7f82f6ffd640 1 -- 172.21.15.45:0/2336950771 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82f0013470 con 0x7f830006a5c0 2023-07-09T02:17:34.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.256+0000 7f82f6ffd640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82e00662b0 0x7f82e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.256+0000 7f82f6ffd640 1 -- 172.21.15.45:0/2336950771 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82f0083e80 con 0x7f830006a5c0 2023-07-09T02:17:34.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.256+0000 7f82f7fff640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82e00662b0 0x7f82e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.256+0000 7f82f7fff640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82e00662b0 0x7f82e0068760 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f82e80ad000 tx=0x7f82e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:34.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.260+0000 7f82f6ffd640 1 -- 172.21.15.45:0/2336950771 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82f0051260 con 0x7f830006a5c0 2023-07-09T02:17:34.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.452+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f830004d7d0 con 0x7f830006a5c0 2023-07-09T02:17:34.453 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:17:34.452+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:17:34.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.456+0000 7f82f6ffd640 1 -- 172.21.15.45:0/2336950771 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7f82f0017090 con 0x7f830006a5c0 2023-07-09T02:17:34.459 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:17:34.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82e00662b0 msgr2=0x7f82e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82e00662b0 0x7f82e0068760 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f82e80ad000 tx=0x7f82e8008040 comp rx=0 tx=0).stop 2023-07-09T02:17:34.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830006a5c0 msgr2=0x7f83000c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830006a5c0 0x7f83000c6840 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f82f000e7f0 tx=0x7f82f000ecb0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 shutdown_connections 2023-07-09T02:17:34.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83000cd290 0x7f83000b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f82e00662b0 0x7f82e0068760 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83000b2340 0x7f83000b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 --2- 172.21.15.45:0/2336950771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830006a5c0 0x7f83000c6840 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 >> 172.21.15.45:0/2336950771 conn(0x7f830006d140 msgr2=0x7f83000b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:34.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 shutdown_connections 2023-07-09T02:17:34.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.460+0000 7f830487b640 1 -- 172.21.15.45:0/2336950771 wait complete. 2023-07-09T02:17:34.468 INFO:tasks.ceph.mds.d.smithi155.stderr: -4669> 2023-07-09T02:17:17.634+0000 7f8b28f03640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:17:34.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:17:34.519 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:17:34.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.624+0000 7f603d4cb640 1 Processor -- start 2023-07-09T02:17:34.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.624+0000 7f603d4cb640 1 -- start start 2023-07-09T02:17:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f603d4cb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f603806b120 0x7f603806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f603d4cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60380d2400 0x7f60380cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f603d4cb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6038069980 0x7f6038069df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f603d4cb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6038071850 con 0x7f603806b120 2023-07-09T02:17:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f603d4cb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60380cd320 con 0x7f6038069980 2023-07-09T02:17:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f603d4cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603806ba30 con 0x7f60380d2400 2023-07-09T02:17:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f6036ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f603806b120 0x7f603806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f6036ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f603806b120 0x7f603806b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40602/0 (socket says 172.21.15.45:40602) 2023-07-09T02:17:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f6036ffd640 1 -- 172.21.15.45:0/2670995612 learned_addr learned my addr 172.21.15.45:0/2670995612 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f602ffff640 1 --2- 172.21.15.45:0/2670995612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60380d2400 0x7f60380cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f60377fe640 1 --2- 172.21.15.45:0/2670995612 >> v2:172.21.15.155:3300/0 conn(0x7f6038069980 0x7f6038069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f6036ffd640 1 -- 172.21.15.45:0/2670995612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60380d2400 msgr2=0x7f60380cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:34.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f6036ffd640 1 --2- 172.21.15.45:0/2670995612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60380d2400 0x7f60380cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f6036ffd640 1 -- 172.21.15.45:0/2670995612 >> v2:172.21.15.155:3300/0 conn(0x7f6038069980 msgr2=0x7f6038069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:34.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f6036ffd640 1 --2- 172.21.15.45:0/2670995612 >> v2:172.21.15.155:3300/0 conn(0x7f6038069980 0x7f6038069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.628+0000 7f6036ffd640 1 -- 172.21.15.45:0/2670995612 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60380d0ea0 con 0x7f603806b120 2023-07-09T02:17:34.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f6036ffd640 1 --2- 172.21.15.45:0/2670995612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f603806b120 0x7f603806b4f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f603806abc0 tx=0x7f602801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1e34bbd3b8ca19 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:34.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f60367fc640 1 -- 172.21.15.45:0/2670995612 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60280aa5f0 con 0x7f603806b120 2023-07-09T02:17:34.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f60367fc640 1 -- 172.21.15.45:0/2670995612 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60280aa750 con 0x7f603806b120 2023-07-09T02:17:34.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f60367fc640 1 -- 172.21.15.45:0/2670995612 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60280aaae0 con 0x7f603806b120 2023-07-09T02:17:34.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 -- 172.21.15.45:0/2670995612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f603806b120 msgr2=0x7f603806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 --2- 172.21.15.45:0/2670995612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f603806b120 0x7f603806b4f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f603806abc0 tx=0x7f602801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 -- 172.21.15.45:0/2670995612 shutdown_connections 2023-07-09T02:17:34.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 --2- 172.21.15.45:0/2670995612 >> v2:172.21.15.155:3300/0 conn(0x7f6038069980 0x7f6038069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 --2- 172.21.15.45:0/2670995612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60380d2400 0x7f60380cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 --2- 172.21.15.45:0/2670995612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f603806b120 0x7f603806b4f0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 -- 172.21.15.45:0/2670995612 >> 172.21.15.45:0/2670995612 conn(0x7f60380cf3d0 msgr2=0x7f60380cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:34.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 -- 172.21.15.45:0/2670995612 shutdown_connections 2023-07-09T02:17:34.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 -- 172.21.15.45:0/2670995612 wait complete. 2023-07-09T02:17:34.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 Processor -- start 2023-07-09T02:17:34.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.632+0000 7f603d4cb640 1 -- start start 2023-07-09T02:17:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038069980 0x7f60380cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603806b120 0x7f60380b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60380d2400 0x7f6038154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380c9f80 con 0x7f60380d2400 2023-07-09T02:17:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380c9ca0 con 0x7f603806b120 2023-07-09T02:17:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6038153960 con 0x7f6038069980 2023-07-09T02:17:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60380d2400 0x7f6038154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60380d2400 0x7f6038154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40612/0 (socket says 172.21.15.45:40612) 2023-07-09T02:17:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 -- 172.21.15.45:0/3645445201 learned_addr learned my addr 172.21.15.45:0/3645445201 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f6036ffd640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038069980 0x7f60380cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f602ffff640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603806b120 0x7f60380b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 -- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038069980 msgr2=0x7f60380cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038069980 0x7f60380cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 -- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603806b120 msgr2=0x7f60380b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603806b120 0x7f60380b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 -- 172.21.15.45:0/3645445201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280094d0 con 0x7f60380d2400 2023-07-09T02:17:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f60377fe640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60380d2400 0x7f6038154440 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6030007d20 tx=0x7f603000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:34.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f602f7fe640 1 -- 172.21.15.45:0/3645445201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030014420 con 0x7f60380d2400 2023-07-09T02:17:34.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f602f7fe640 1 -- 172.21.15.45:0/3645445201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60300145a0 con 0x7f60380d2400 2023-07-09T02:17:34.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f602f7fe640 1 -- 172.21.15.45:0/3645445201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030014950 con 0x7f60380d2400 2023-07-09T02:17:34.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6038153c40 con 0x7f60380d2400 2023-07-09T02:17:34.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60380c9990 con 0x7f60380d2400 2023-07-09T02:17:34.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603804e020 con 0x7f60380d2400 2023-07-09T02:17:34.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.636+0000 7f602f7fe640 1 -- 172.21.15.45:0/3645445201 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6030014ab0 con 0x7f60380d2400 2023-07-09T02:17:34.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.640+0000 7f602f7fe640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6018066280 0x7f6018068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.640+0000 7f602f7fe640 1 -- 172.21.15.45:0/3645445201 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f60300844f0 con 0x7f60380d2400 2023-07-09T02:17:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.640+0000 7f6036ffd640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6018066280 0x7f6018068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.640+0000 7f6036ffd640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6018066280 0x7f6018068730 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f60280ae000 tx=0x7f60280b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:34.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.644+0000 7f602f7fe640 1 -- 172.21.15.45:0/3645445201 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60300519b0 con 0x7f60380d2400 2023-07-09T02:17:34.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:34.832+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f60380b3910 con 0x7f60380d2400 2023-07-09T02:17:35.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.460+0000 7f602f7fe640 1 -- 172.21.15.45:0/3645445201 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6030054fd0 con 0x7f60380d2400 2023-07-09T02:17:35.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6018066280 msgr2=0x7f6018068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:35.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6018066280 0x7f6018068730 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f60280ae000 tx=0x7f60280b5040 comp rx=0 tx=0).stop 2023-07-09T02:17:35.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60380d2400 msgr2=0x7f6038154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:35.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60380d2400 0x7f6038154440 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6030007d20 tx=0x7f603000e4b0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 shutdown_connections 2023-07-09T02:17:35.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60380d2400 0x7f6038154440 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f603806b120 0x7f60380b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6018066280 0x7f6018068730 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 --2- 172.21.15.45:0/3645445201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6038069980 0x7f60380cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 >> 172.21.15.45:0/3645445201 conn(0x7f60380cf3d0 msgr2=0x7f60380d16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 shutdown_connections 2023-07-09T02:17:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.464+0000 7f603d4cb640 1 -- 172.21.15.45:0/3645445201 wait complete. 2023-07-09T02:17:35.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:17:35.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1f5293640 1 Processor -- start 2023-07-09T02:17:35.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1f5293640 1 -- start start 2023-07-09T02:17:35.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1f5293640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1f015c480 0x7ff1f00cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:35.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1f5293640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1f00b4490 0x7ff1f00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:35.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1f5293640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f00d19c0 con 0x7ff1f00cecd0 2023-07-09T02:17:35.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1f5293640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f015c850 con 0x7ff1f015c480 2023-07-09T02:17:35.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1f5293640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f00b4e50 con 0x7ff1f00b4490 2023-07-09T02:17:35.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1eeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1f015c480 0x7ff1f00cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:35.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1eeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1f015c480 0x7ff1f00cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40622/0 (socket says 172.21.15.45:40622) 2023-07-09T02:17:35.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1eeffd640 1 -- 172.21.15.45:0/3116445732 learned_addr learned my addr 172.21.15.45:0/3116445732 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:35.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1ef7fe640 1 --2- 172.21.15.45:0/3116445732 >> v2:172.21.15.155:3300/0 conn(0x7ff1f00b4490 0x7ff1f00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:35.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1eeffd640 1 -- 172.21.15.45:0/3116445732 >> v2:172.21.15.155:3300/0 conn(0x7ff1f00b4490 msgr2=0x7ff1f00b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:35.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/3116445732 >> v2:172.21.15.155:3300/0 conn(0x7ff1f00b4490 0x7ff1f00b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1eeffd640 1 -- 172.21.15.45:0/3116445732 >> v1:172.21.15.155:6789/0 conn(0x7ff1f00cecd0 legacy=0x7ff1f00d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:35.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.640+0000 7ff1eeffd640 1 -- 172.21.15.45:0/3116445732 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00d1090 con 0x7ff1f015c480 2023-07-09T02:17:35.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/3116445732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f00cd060 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00b8b60 tx=0x7ff1e001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba018a6e0e4b19c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1ee7fc640 1 -- 172.21.15.45:0/3116445732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00ac630 con 0x7ff1f015c480 2023-07-09T02:17:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1ee7fc640 1 -- 172.21.15.45:0/3116445732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e00ac790 con 0x7ff1f015c480 2023-07-09T02:17:35.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1ee7fc640 1 -- 172.21.15.45:0/3116445732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00acb20 con 0x7ff1f015c480 2023-07-09T02:17:35.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1f5293640 1 -- 172.21.15.45:0/3116445732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 msgr2=0x7ff1f00cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:35.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1f5293640 1 --2- 172.21.15.45:0/3116445732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f00cd060 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00b8b60 tx=0x7ff1e001c4c0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1f5293640 1 -- 172.21.15.45:0/3116445732 shutdown_connections 2023-07-09T02:17:35.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1f5293640 1 --2- 172.21.15.45:0/3116445732 >> v2:172.21.15.155:3300/0 conn(0x7ff1f00b4490 0x7ff1f00b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1f5293640 1 --2- 172.21.15.45:0/3116445732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f00cd060 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1f5293640 1 -- 172.21.15.45:0/3116445732 >> 172.21.15.45:0/3116445732 conn(0x7ff1f00cf490 msgr2=0x7ff1f00cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:35.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1f5293640 1 -- 172.21.15.45:0/3116445732 shutdown_connections 2023-07-09T02:17:35.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.644+0000 7ff1f5293640 1 -- 172.21.15.45:0/3116445732 wait complete. 2023-07-09T02:17:35.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 Processor -- start 2023-07-09T02:17:35.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 -- start start 2023-07-09T02:17:35.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f00b4490 0x7ff1f014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:35.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f00cecd0 0x7ff1f00c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:35.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:35.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00c6ca0 con 0x7ff1f015c480 2023-07-09T02:17:35.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0155620 con 0x7ff1f00cecd0 2023-07-09T02:17:35.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0154cf0 con 0x7ff1f00b4490 2023-07-09T02:17:35.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:35.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f014b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40632/0 (socket says 172.21.15.45:40632) 2023-07-09T02:17:35.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 -- 172.21.15.45:0/2356039404 learned_addr learned my addr 172.21.15.45:0/2356039404 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:35.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1e7fff640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f00cecd0 0x7ff1f00c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:35.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f00b4490 0x7ff1f014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:35.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 -- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f00b4490 msgr2=0x7ff1f014bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:35.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f00b4490 0x7ff1f014bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 -- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f00cecd0 msgr2=0x7ff1f00c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:35.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f00cecd0 0x7ff1f00c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:35.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 -- 172.21.15.45:0/2356039404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e00094d0 con 0x7ff1f015c480 2023-07-09T02:17:35.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f00b4490 0x7ff1f014bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:35.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1e7fff640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f00cecd0 0x7ff1f00c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:35.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1ef7fe640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f014b590 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8007e40 tx=0x7ff1e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:35.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1e77fe640 1 -- 172.21.15.45:0/2356039404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8014620 con 0x7ff1f015c480 2023-07-09T02:17:35.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1e77fe640 1 -- 172.21.15.45:0/2356039404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e800ee90 con 0x7ff1f015c480 2023-07-09T02:17:35.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1e77fe640 1 -- 172.21.15.45:0/2356039404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80149e0 con 0x7ff1f015c480 2023-07-09T02:17:35.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f0154fd0 con 0x7ff1f015c480 2023-07-09T02:17:35.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f014c4a0 con 0x7ff1f015c480 2023-07-09T02:17:35.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.648+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f00cf120 con 0x7ff1f015c480 2023-07-09T02:17:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.652+0000 7ff1e77fe640 1 -- 172.21.15.45:0/2356039404 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1e8014b40 con 0x7ff1f015c480 2023-07-09T02:17:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.652+0000 7ff1e77fe640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d0066280 0x7ff1d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.652+0000 7ff1e77fe640 1 -- 172.21.15.45:0/2356039404 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff1e8084760 con 0x7ff1f015c480 2023-07-09T02:17:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.652+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d0066280 0x7ff1d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:35.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.652+0000 7ff1eeffd640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d0066280 0x7ff1d0068730 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00ae000 tx=0x7ff1e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:35.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.656+0000 7ff1e77fe640 1 -- 172.21.15.45:0/2356039404 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1f00cf120 con 0x7ff1f015c480 2023-07-09T02:17:35.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:35.812+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1f00cf120 con 0x7ff1f015c480 2023-07-09T02:17:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.796+0000 7ff1e77fe640 1 -- 172.21.15.45:0/2356039404 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff1f00cf120 con 0x7ff1f015c480 2023-07-09T02:17:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:17:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d0066280 msgr2=0x7ff1d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d0066280 0x7ff1d0068730 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00ae000 tx=0x7ff1e0008040 comp rx=0 tx=0).stop 2023-07-09T02:17:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 msgr2=0x7ff1f014b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f014b590 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8007e40 tx=0x7ff1e800e4b0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 shutdown_connections 2023-07-09T02:17:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f015c480 0x7ff1f014b590 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1f00cecd0 0x7ff1f00c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d0066280 0x7ff1d0068730 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 --2- 172.21.15.45:0/2356039404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f00b4490 0x7ff1f014bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 >> 172.21.15.45:0/2356039404 conn(0x7ff1f00cf490 msgr2=0x7ff1f00b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 shutdown_connections 2023-07-09T02:17:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.800+0000 7ff1f5293640 1 -- 172.21.15.45:0/2356039404 wait complete. 2023-07-09T02:17:36.827 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:17:36.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.976+0000 7f5c4658f640 1 Processor -- start 2023-07-09T02:17:36.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.976+0000 7f5c4658f640 1 -- start start 2023-07-09T02:17:36.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c4658f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c400c9660 0x7f5c400b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:36.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c4658f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5c400b3e90 0x7f5c400b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:36.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c4658f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c400cd540 con 0x7f5c400cafc0 2023-07-09T02:17:36.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c4658f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c400cd350 con 0x7f5c400c9660 2023-07-09T02:17:36.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c4658f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c400c9bd0 con 0x7f5c400b3e90 2023-07-09T02:17:36.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c3f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c400c9660 0x7f5c400b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:36.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c3f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c400c9660 0x7f5c400b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40644/0 (socket says 172.21.15.45:40644) 2023-07-09T02:17:36.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c3f7fe640 1 -- 172.21.15.45:0/3276248692 learned_addr learned my addr 172.21.15.45:0/3276248692 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:36.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c44b2c640 1 --2- 172.21.15.45:0/3276248692 >> v2:172.21.15.155:3300/0 conn(0x7f5c400b3e90 0x7f5c400b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:36.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c3f7fe640 1 -- 172.21.15.45:0/3276248692 >> v2:172.21.15.155:3300/0 conn(0x7f5c400b3e90 msgr2=0x7f5c400b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:36.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c3f7fe640 1 --2- 172.21.15.45:0/3276248692 >> v2:172.21.15.155:3300/0 conn(0x7f5c400b3e90 0x7f5c400b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c3f7fe640 1 -- 172.21.15.45:0/3276248692 >> v1:172.21.15.155:6789/0 conn(0x7f5c400cafc0 legacy=0x7f5c400cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:36.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.980+0000 7f5c3f7fe640 1 -- 172.21.15.45:0/3276248692 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400cd7e0 con 0x7f5c400c9660 2023-07-09T02:17:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c3f7fe640 1 --2- 172.21.15.45:0/3276248692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400c9660 0x7f5c400b1600 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5c4006edf0 tx=0x7f5c3401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dada77a58e63b751 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c3effd640 1 -- 172.21.15.45:0/3276248692 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340a89b0 con 0x7f5c400c9660 2023-07-09T02:17:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c3effd640 1 -- 172.21.15.45:0/3276248692 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c340a8b10 con 0x7f5c400c9660 2023-07-09T02:17:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c3effd640 1 -- 172.21.15.45:0/3276248692 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340a8ea0 con 0x7f5c400c9660 2023-07-09T02:17:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 -- 172.21.15.45:0/3276248692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400c9660 msgr2=0x7f5c400b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 --2- 172.21.15.45:0/3276248692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400c9660 0x7f5c400b1600 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5c4006edf0 tx=0x7f5c3401ecb0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 -- 172.21.15.45:0/3276248692 shutdown_connections 2023-07-09T02:17:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 --2- 172.21.15.45:0/3276248692 >> v2:172.21.15.155:3300/0 conn(0x7f5c400b3e90 0x7f5c400b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 --2- 172.21.15.45:0/3276248692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400c9660 0x7f5c400b1600 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 -- 172.21.15.45:0/3276248692 >> 172.21.15.45:0/3276248692 conn(0x7f5c4006ae60 msgr2=0x7f5c4006b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 -- 172.21.15.45:0/3276248692 shutdown_connections 2023-07-09T02:17:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 -- 172.21.15.45:0/3276248692 wait complete. 2023-07-09T02:17:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 Processor -- start 2023-07-09T02:17:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.984+0000 7f5c4658f640 1 -- start start 2023-07-09T02:17:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c400b3e90 0x7f5c40159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c400c9660 0x7f5c4015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400cafc0 0x7f5c401f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015a9b0 con 0x7f5c400cafc0 2023-07-09T02:17:36.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40158e90 con 0x7f5c400c9660 2023-07-09T02:17:36.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40159170 con 0x7f5c400b3e90 2023-07-09T02:17:36.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400cafc0 0x7f5c401f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:36.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400cafc0 0x7f5c401f95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40654/0 (socket says 172.21.15.45:40654) 2023-07-09T02:17:36.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 -- 172.21.15.45:0/4257820592 learned_addr learned my addr 172.21.15.45:0/4257820592 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:36.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c3f7fe640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c400c9660 0x7f5c4015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:36.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c3ffff640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c400b3e90 0x7f5c40159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:36.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 -- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c400b3e90 msgr2=0x7f5c40159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:36.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c400b3e90 0x7f5c40159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 -- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c400c9660 msgr2=0x7f5c4015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c400c9660 0x7f5c4015a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 -- 172.21.15.45:0/4257820592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340094d0 con 0x7f5c400cafc0 2023-07-09T02:17:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c3ffff640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c400b3e90 0x7f5c40159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c44b2c640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400cafc0 0x7f5c401f95f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5c38007e40 tx=0x7f5c3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c3cff9640 1 -- 172.21.15.45:0/4257820592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38014620 con 0x7f5c400cafc0 2023-07-09T02:17:36.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c3cff9640 1 -- 172.21.15.45:0/4257820592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800ee90 con 0x7f5c400cafc0 2023-07-09T02:17:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c3cff9640 1 -- 172.21.15.45:0/4257820592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c380149e0 con 0x7f5c400cafc0 2023-07-09T02:17:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c40159450 con 0x7f5c400cafc0 2023-07-09T02:17:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c40159a10 con 0x7f5c400cafc0 2023-07-09T02:17:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c400cda80 con 0x7f5c400cafc0 2023-07-09T02:17:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.988+0000 7f5c3cff9640 1 -- 172.21.15.45:0/4257820592 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c38014b40 con 0x7f5c400cafc0 2023-07-09T02:17:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.992+0000 7f5c3cff9640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c2c066280 0x7f5c2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:36.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.992+0000 7f5c3cff9640 1 -- 172.21.15.45:0/4257820592 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f5c380845e0 con 0x7f5c400cafc0 2023-07-09T02:17:36.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.992+0000 7f5c3ffff640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c2c066280 0x7f5c2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:36.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.992+0000 7f5c3ffff640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c2c066280 0x7f5c2c068730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5c400b0ce0 tx=0x7f5c30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:36.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:36.996+0000 7f5c3cff9640 1 -- 172.21.15.45:0/4257820592 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c380555b0 con 0x7f5c400cafc0 2023-07-09T02:17:37.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.148+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5c40159c30 con 0x7f5c400cafc0 2023-07-09T02:17:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.800+0000 7f5c3cff9640 1 -- 172.21.15.45:0/4257820592 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5c38055140 con 0x7f5c400cafc0 2023-07-09T02:17:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:17:37.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c2c066280 msgr2=0x7f5c2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:37.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c2c066280 0x7f5c2c068730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5c400b0ce0 tx=0x7f5c30008040 comp rx=0 tx=0).stop 2023-07-09T02:17:37.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400cafc0 msgr2=0x7f5c401f95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:37.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400cafc0 0x7f5c401f95f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5c38007e40 tx=0x7f5c3800e4b0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 shutdown_connections 2023-07-09T02:17:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c400cafc0 0x7f5c401f95f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c400c9660 0x7f5c4015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c2c066280 0x7f5c2c068730 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 --2- 172.21.15.45:0/4257820592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c400b3e90 0x7f5c40159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 >> 172.21.15.45:0/4257820592 conn(0x7f5c4006ae60 msgr2=0x7f5c4006ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 shutdown_connections 2023-07-09T02:17:37.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.804+0000 7f5c4658f640 1 -- 172.21.15.45:0/4257820592 wait complete. 2023-07-09T02:17:37.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:17:37.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.976+0000 7fb74d8cb640 1 Processor -- start 2023-07-09T02:17:37.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.976+0000 7fb74d8cb640 1 -- start start 2023-07-09T02:17:37.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb74d8cb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb74815c060 0x7fb7480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:37.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb74d8cb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7480d2620 0x7fb7480cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:37.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb74d8cb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb748160a50 con 0x7fb7480cd120 2023-07-09T02:17:37.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb74d8cb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74815c430 con 0x7fb7480d2620 2023-07-09T02:17:37.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb74d8cb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74815fb60 con 0x7fb74815c060 2023-07-09T02:17:37.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb73ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb7480cd120 0x7fb7480d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49528/0 (socket says 172.21.15.45:49528) 2023-07-09T02:17:37.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb73ffff640 1 -- 172.21.15.45:0/3629184739 learned_addr learned my addr 172.21.15.45:0/3629184739 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:37.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb7477fe640 1 --2- 172.21.15.45:0/3629184739 >> v2:172.21.15.45:3300/0 conn(0x7fb7480d2620 0x7fb7480cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:37.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb746ffd640 1 --2- 172.21.15.45:0/3629184739 >> v2:172.21.15.155:3300/0 conn(0x7fb74815c060 0x7fb7480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:37.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb7467fc640 1 -- 172.21.15.45:0/3629184739 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691476549 0 0) 0x7fb748160a50 con 0x7fb7480cd120 2023-07-09T02:17:37.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb7467fc640 1 -- 172.21.15.45:0/3629184739 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb734003530 con 0x7fb7480cd120 2023-07-09T02:17:37.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb7477fe640 1 -- 172.21.15.45:0/3629184739 >> v2:172.21.15.155:3300/0 conn(0x7fb74815c060 msgr2=0x7fb7480b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:37.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb7477fe640 1 --2- 172.21.15.45:0/3629184739 >> v2:172.21.15.155:3300/0 conn(0x7fb74815c060 0x7fb7480b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb7477fe640 1 -- 172.21.15.45:0/3629184739 >> v1:172.21.15.45:6789/0 conn(0x7fb7480cd120 legacy=0x7fb7480d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:37.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.980+0000 7fb7477fe640 1 -- 172.21.15.45:0/3629184739 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74815fe40 con 0x7fb7480d2620 2023-07-09T02:17:37.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb7477fe640 1 --2- 172.21.15.45:0/3629184739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb7480cee30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb7480d3ad0 tx=0x7fb74001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8476a3cb801ecebe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:37.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb7467fc640 1 -- 172.21.15.45:0/3629184739 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7400a59a0 con 0x7fb7480d2620 2023-07-09T02:17:37.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb7467fc640 1 -- 172.21.15.45:0/3629184739 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7400a5b00 con 0x7fb7480d2620 2023-07-09T02:17:37.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb7467fc640 1 -- 172.21.15.45:0/3629184739 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7400a5e90 con 0x7fb7480d2620 2023-07-09T02:17:37.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 -- 172.21.15.45:0/3629184739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 msgr2=0x7fb7480cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:37.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/3629184739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb7480cee30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb7480d3ad0 tx=0x7fb74001c8e0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 -- 172.21.15.45:0/3629184739 shutdown_connections 2023-07-09T02:17:37.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/3629184739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb7480cee30 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/3629184739 >> v2:172.21.15.155:3300/0 conn(0x7fb74815c060 0x7fb7480b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 -- 172.21.15.45:0/3629184739 >> 172.21.15.45:0/3629184739 conn(0x7fb7480698e0 msgr2=0x7fb748069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:37.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 -- 172.21.15.45:0/3629184739 shutdown_connections 2023-07-09T02:17:37.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 -- 172.21.15.45:0/3629184739 wait complete. 2023-07-09T02:17:37.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 Processor -- start 2023-07-09T02:17:37.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.984+0000 7fb74d8cb640 1 -- start start 2023-07-09T02:17:37.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7480cd120 0x7fb748154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:37.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb74815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:37.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb74815c060 0x7fb748156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:37.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815e010 con 0x7fb7480d2620 2023-07-09T02:17:37.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815cbf0 con 0x7fb74815c060 2023-07-09T02:17:37.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74815c610 con 0x7fb7480cd120 2023-07-09T02:17:37.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb74815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:37.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb74815dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40682/0 (socket says 172.21.15.45:40682) 2023-07-09T02:17:37.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 -- 172.21.15.45:0/4187869507 learned_addr learned my addr 172.21.15.45:0/4187869507 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb746ffd640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7480cd120 0x7fb748154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb7477fe640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb74815c060 0x7fb748156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 -- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7480cd120 msgr2=0x7fb748154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7480cd120 0x7fb748154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 -- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb74815c060 msgr2=0x7fb748156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb74815c060 0x7fb748156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:37.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 -- 172.21.15.45:0/4187869507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740009a70 con 0x7fb7480d2620 2023-07-09T02:17:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb73ffff640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb74815dad0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb73000c4d0 tx=0x7fb73000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb744ff9640 1 -- 172.21.15.45:0/4187869507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730005cf0 con 0x7fb7480d2620 2023-07-09T02:17:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb744ff9640 1 -- 172.21.15.45:0/4187869507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb730005e50 con 0x7fb7480d2620 2023-07-09T02:17:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7480b59f0 con 0x7fb7480d2620 2023-07-09T02:17:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb744ff9640 1 -- 172.21.15.45:0/4187869507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730007270 con 0x7fb7480d2620 2023-07-09T02:17:37.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74815c880 con 0x7fb7480d2620 2023-07-09T02:17:37.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.988+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74804d7d0 con 0x7fb7480d2620 2023-07-09T02:17:37.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.992+0000 7fb744ff9640 1 -- 172.21.15.45:0/4187869507 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7300073d0 con 0x7fb7480d2620 2023-07-09T02:17:37.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.992+0000 7fb744ff9640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb728066280 0x7fb728068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:37.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.992+0000 7fb744ff9640 1 -- 172.21.15.45:0/4187869507 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb730083010 con 0x7fb7480d2620 2023-07-09T02:17:37.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.992+0000 7fb746ffd640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb728066280 0x7fb728068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:37.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.992+0000 7fb746ffd640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb728066280 0x7fb728068730 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb73800b930 tx=0x7fb738008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:37.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:37.996+0000 7fb744ff9640 1 -- 172.21.15.45:0/4187869507 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb730050850 con 0x7fb7480d2620 2023-07-09T02:17:38.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.152+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb74806baa0 con 0x7fb7480d2620 2023-07-09T02:17:38.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.156+0000 7fb744ff9640 1 -- 172.21.15.45:0/4187869507 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb730053e70 con 0x7fb7480d2620 2023-07-09T02:17:38.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb728066280 msgr2=0x7fb728068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb728066280 0x7fb728068730 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb73800b930 tx=0x7fb738008040 comp rx=0 tx=0).stop 2023-07-09T02:17:38.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 msgr2=0x7fb74815dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb74815dad0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb73000c4d0 tx=0x7fb73000c990 comp rx=0 tx=0).stop 2023-07-09T02:17:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 shutdown_connections 2023-07-09T02:17:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb74815c060 0x7fb748156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7480d2620 0x7fb74815dad0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb728066280 0x7fb728068730 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 --2- 172.21.15.45:0/4187869507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7480cd120 0x7fb748154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 >> 172.21.15.45:0/4187869507 conn(0x7fb7480698e0 msgr2=0x7fb748069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 shutdown_connections 2023-07-09T02:17:38.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.160+0000 7fb74d8cb640 1 -- 172.21.15.45:0/4187869507 wait complete. 2023-07-09T02:17:38.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-07-09T02:17:38.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f6a26d640 1 Processor -- start 2023-07-09T02:17:38.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f6a26d640 1 -- start start 2023-07-09T02:17:38.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f6a26d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f6415c060 0x7f9f640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f6a26d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 0x7f9f640cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f6a26d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f64160a50 con 0x7f9f640cd120 2023-07-09T02:17:38.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f6a26d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6415c430 con 0x7f9f6415c060 2023-07-09T02:17:38.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f6a26d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6415fb60 con 0x7f9f640d2620 2023-07-09T02:17:38.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f63fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f6415c060 0x7f9f640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f637fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9f640cd120 0x7f9f640d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49544/0 (socket says 172.21.15.45:49544) 2023-07-09T02:17:38.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.320+0000 7f9f637fe640 1 -- 172.21.15.45:0/1609690518 learned_addr learned my addr 172.21.15.45:0/1609690518 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:38.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f6880a640 1 --2- 172.21.15.45:0/1609690518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 0x7f9f640cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f63fff640 1 -- 172.21.15.45:0/1609690518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 msgr2=0x7f9f640cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:38.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f63fff640 1 --2- 172.21.15.45:0/1609690518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 0x7f9f640cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f63fff640 1 -- 172.21.15.45:0/1609690518 >> v1:172.21.15.45:6789/0 conn(0x7f9f640cd120 legacy=0x7f9f640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f63fff640 1 -- 172.21.15.45:0/1609690518 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6415fe40 con 0x7f9f6415c060 2023-07-09T02:17:38.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f62ffd640 1 -- 172.21.15.45:0/1609690518 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577504997 0 0) 0x7f9f64160a50 con 0x7f9f640cd120 2023-07-09T02:17:38.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f63fff640 1 --2- 172.21.15.45:0/1609690518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b4ed0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f9f540097c0 tx=0x7f9f5401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3b3d7839973c9a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:38.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f62ffd640 1 -- 172.21.15.45:0/1609690518 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540ab650 con 0x7f9f6415c060 2023-07-09T02:17:38.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f62ffd640 1 -- 172.21.15.45:0/1609690518 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f540ab7b0 con 0x7f9f6415c060 2023-07-09T02:17:38.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.324+0000 7f9f62ffd640 1 -- 172.21.15.45:0/1609690518 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540abb40 con 0x7f9f6415c060 2023-07-09T02:17:38.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- 172.21.15.45:0/1609690518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 msgr2=0x7f9f640b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/1609690518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b4ed0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f9f540097c0 tx=0x7f9f5401c450 comp rx=0 tx=0).stop 2023-07-09T02:17:38.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- 172.21.15.45:0/1609690518 shutdown_connections 2023-07-09T02:17:38.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/1609690518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 0x7f9f640cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/1609690518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b4ed0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- 172.21.15.45:0/1609690518 >> 172.21.15.45:0/1609690518 conn(0x7f9f640698e0 msgr2=0x7f9f64069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:38.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- 172.21.15.45:0/1609690518 shutdown_connections 2023-07-09T02:17:38.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- 172.21.15.45:0/1609690518 wait complete. 2023-07-09T02:17:38.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 Processor -- start 2023-07-09T02:17:38.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- start start 2023-07-09T02:17:38.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f640cd120 0x7f9f6415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 0x7f9f641f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641f5be0 con 0x7f9f6415c060 2023-07-09T02:17:38.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641f5540 con 0x7f9f640cd120 2023-07-09T02:17:38.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6a26d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641f84c0 con 0x7f9f640d2620 2023-07-09T02:17:38.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6880a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6880a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40710/0 (socket says 172.21.15.45:40710) 2023-07-09T02:17:38.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f6880a640 1 -- 172.21.15.45:0/2000653133 learned_addr learned my addr 172.21.15.45:0/2000653133 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:38.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f637fe640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 0x7f9f641f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.328+0000 7f9f63fff640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f640cd120 0x7f9f6415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6880a640 1 -- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 msgr2=0x7f9f641f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6880a640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 0x7f9f641f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6880a640 1 -- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f640cd120 msgr2=0x7f9f6415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6880a640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f640cd120 0x7f9f6415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6880a640 1 -- 172.21.15.45:0/2000653133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54009420 con 0x7f9f6415c060 2023-07-09T02:17:38.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6880a640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b34b0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c007e30 tx=0x7f9f5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:38.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f60ff9640 1 -- 172.21.15.45:0/2000653133 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c014420 con 0x7f9f6415c060 2023-07-09T02:17:38.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f60ff9640 1 -- 172.21.15.45:0/2000653133 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c0145a0 con 0x7f9f6415c060 2023-07-09T02:17:38.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f640b59f0 con 0x7f9f6415c060 2023-07-09T02:17:38.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f60ff9640 1 -- 172.21.15.45:0/2000653133 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c014950 con 0x7f9f6415c060 2023-07-09T02:17:38.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f641f5800 con 0x7f9f6415c060 2023-07-09T02:17:38.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f641f5d20 con 0x7f9f6415c060 2023-07-09T02:17:38.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f60ff9640 1 -- 172.21.15.45:0/2000653133 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f5c014ab0 con 0x7f9f6415c060 2023-07-09T02:17:38.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f60ff9640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9f50066280 0x7f9f50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.332+0000 7f9f60ff9640 1 -- 172.21.15.45:0/2000653133 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9f5c084220 con 0x7f9f6415c060 2023-07-09T02:17:38.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.336+0000 7f9f63fff640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9f50066280 0x7f9f50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.336+0000 7f9f63fff640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9f50066280 0x7f9f50068730 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9f540af000 tx=0x7f9f540a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:38.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.336+0000 7f9f60ff9640 1 -- 172.21.15.45:0/2000653133 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f641f5d20 con 0x7f9f6415c060 2023-07-09T02:17:38.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.548+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f9f641f5d20 con 0x7f9f6415c060 2023-07-09T02:17:38.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.808+0000 7f9f60ff9640 1 -- 172.21.15.45:0/2000653133 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v347) v1 ==== 128+0+0 (secure 0 0 0) 0x7f9f641f5d20 con 0x7f9f6415c060 2023-07-09T02:17:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9f50066280 msgr2=0x7f9f50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9f50066280 0x7f9f50068730 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9f540af000 tx=0x7f9f540a7000 comp rx=0 tx=0).stop 2023-07-09T02:17:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 msgr2=0x7f9f640b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b34b0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c007e30 tx=0x7f9f5c00e4b0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 shutdown_connections 2023-07-09T02:17:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f6415c060 0x7f9f640b34b0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9f50066280 0x7f9f50068730 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f640d2620 0x7f9f641f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 --2- 172.21.15.45:0/2000653133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f640cd120 0x7f9f6415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 >> 172.21.15.45:0/2000653133 conn(0x7f9f640698e0 msgr2=0x7f9f641550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 shutdown_connections 2023-07-09T02:17:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.812+0000 7f9f6a26d640 1 -- 172.21.15.45:0/2000653133 wait complete. 2023-07-09T02:17:38.833 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-07-09T02:17:38.834 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-07-09T02:17:38.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-07-09T02:17:38.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.980+0000 7f36d451f640 1 Processor -- start 2023-07-09T02:17:38.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.980+0000 7f36d451f640 1 -- start start 2023-07-09T02:17:38.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.980+0000 7f36d451f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f36cc06c110 0x7f36cc06c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.980+0000 7f36d451f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0caec0 0x7f36cc0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.980+0000 7f36d451f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36cc06caa0 con 0x7f36cc158e30 2023-07-09T02:17:38.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.980+0000 7f36d451f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36cc0ccf80 con 0x7f36cc06c110 2023-07-09T02:17:38.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.980+0000 7f36d451f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc0cd540 con 0x7f36cc0caec0 2023-07-09T02:17:38.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.980+0000 7f36d1aba640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f36cc06c110 0x7f36cc06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d22bb640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f36cc158e30 0x7f36cc06f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:60448/0 (socket says 172.21.15.45:60448) 2023-07-09T02:17:38.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d22bb640 1 -- 172.21.15.45:0/428722518 learned_addr learned my addr 172.21.15.45:0/428722518 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:38.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d2abc640 1 --2- 172.21.15.45:0/428722518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0caec0 0x7f36cc0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d1aba640 1 -- 172.21.15.45:0/428722518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0caec0 msgr2=0x7f36cc0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:38.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d1aba640 1 --2- 172.21.15.45:0/428722518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0caec0 0x7f36cc0cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d1aba640 1 -- 172.21.15.45:0/428722518 >> v1:172.21.15.155:6789/0 conn(0x7f36cc158e30 legacy=0x7f36cc06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d1aba640 1 -- 172.21.15.45:0/428722518 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc0cb880 con 0x7f36cc06c110 2023-07-09T02:17:38.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d1aba640 1 --2- 172.21.15.45:0/428722518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc06c110 0x7f36cc06c560 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0097c0 tx=0x7f36bc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54f81a908550fd06 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:38.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d12b9640 1 -- 172.21.15.45:0/428722518 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0ac620 con 0x7f36cc06c110 2023-07-09T02:17:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d12b9640 1 -- 172.21.15.45:0/428722518 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc0ac780 con 0x7f36cc06c110 2023-07-09T02:17:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.984+0000 7f36d12b9640 1 -- 172.21.15.45:0/428722518 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc0acb10 con 0x7f36cc06c110 2023-07-09T02:17:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- 172.21.15.45:0/428722518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc06c110 msgr2=0x7f36cc06c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 --2- 172.21.15.45:0/428722518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc06c110 0x7f36cc06c560 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0097c0 tx=0x7f36bc01c3c0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- 172.21.15.45:0/428722518 shutdown_connections 2023-07-09T02:17:38.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 --2- 172.21.15.45:0/428722518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0caec0 0x7f36cc0cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 --2- 172.21.15.45:0/428722518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc06c110 0x7f36cc06c560 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- 172.21.15.45:0/428722518 >> 172.21.15.45:0/428722518 conn(0x7f36cc0694b0 msgr2=0x7f36cc0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:38.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- 172.21.15.45:0/428722518 shutdown_connections 2023-07-09T02:17:38.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- 172.21.15.45:0/428722518 wait complete. 2023-07-09T02:17:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 Processor -- start 2023-07-09T02:17:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- start start 2023-07-09T02:17:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc06c110 0x7f36cc147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0caec0 0x7f36cc14ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc158e30 0x7f36cc0ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc1661c0 con 0x7f36cc158e30 2023-07-09T02:17:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc147760 con 0x7f36cc0caec0 2023-07-09T02:17:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d451f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc15bdd0 con 0x7f36cc06c110 2023-07-09T02:17:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d2abc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc158e30 0x7f36cc0ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d22bb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc06c110 0x7f36cc147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d2abc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc158e30 0x7f36cc0ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40722/0 (socket says 172.21.15.45:40722) 2023-07-09T02:17:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d22bb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc06c110 0x7f36cc147220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:42240/0 (socket says 172.21.15.45:42240) 2023-07-09T02:17:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d2abc640 1 -- 172.21.15.45:0/1743808269 learned_addr learned my addr 172.21.15.45:0/1743808269 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:38.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.988+0000 7f36d1aba640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0caec0 0x7f36cc14ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d2abc640 1 -- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc06c110 msgr2=0x7f36cc147220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d2abc640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc06c110 0x7f36cc147220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d2abc640 1 -- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0caec0 msgr2=0x7f36cc14ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:38.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d2abc640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0caec0 0x7f36cc14ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:38.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d2abc640 1 -- 172.21.15.45:0/1743808269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc009420 con 0x7f36cc158e30 2023-07-09T02:17:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d2abc640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc158e30 0x7f36cc0ce650 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f36c400efc0 tx=0x7f36c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36c2ffd640 1 -- 172.21.15.45:0/1743808269 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4014480 con 0x7f36cc158e30 2023-07-09T02:17:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36c2ffd640 1 -- 172.21.15.45:0/1743808269 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c400f040 con 0x7f36cc158e30 2023-07-09T02:17:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36c2ffd640 1 -- 172.21.15.45:0/1743808269 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4014820 con 0x7f36cc158e30 2023-07-09T02:17:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc15b810 con 0x7f36cc158e30 2023-07-09T02:17:38.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc165e50 con 0x7f36cc158e30 2023-07-09T02:17:38.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36cc166330 con 0x7f36cc158e30 2023-07-09T02:17:38.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.992+0000 7f36c2ffd640 1 -- 172.21.15.45:0/1743808269 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36c4014980 con 0x7f36cc158e30 2023-07-09T02:17:38.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.996+0000 7f36c2ffd640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36b00662b0 0x7f36b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:38.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.996+0000 7f36c2ffd640 1 -- 172.21.15.45:0/1743808269 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f36c40844b0 con 0x7f36cc158e30 2023-07-09T02:17:38.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.996+0000 7f36d22bb640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36b00662b0 0x7f36b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:38.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:38.996+0000 7f36d22bb640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36b00662b0 0x7f36b0068760 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f36c8005890 tx=0x7f36c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:39.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.000+0000 7f36c2ffd640 1 -- 172.21.15.45:0/1743808269 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36c4051c60 con 0x7f36cc158e30 2023-07-09T02:17:39.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.208+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f36cc04d7d0 con 0x7f36cc158e30 2023-07-09T02:17:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.812+0000 7f36c2ffd640 1 -- 172.21.15.45:0/1743808269 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v348) v1 ==== 143+0+0 (secure 0 0 0) 0x7f36c4055280 con 0x7f36cc158e30 2023-07-09T02:17:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.812+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36b00662b0 msgr2=0x7f36b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.812+0000 7f36d451f640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36b00662b0 0x7f36b0068760 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f36c8005890 tx=0x7f36c8009040 comp rx=0 tx=0).stop 2023-07-09T02:17:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.812+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc158e30 msgr2=0x7f36cc0ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.812+0000 7f36d451f640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc158e30 0x7f36cc0ce650 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f36c400efc0 tx=0x7f36c400c490 comp rx=0 tx=0).stop 2023-07-09T02:17:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.816+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 shutdown_connections 2023-07-09T02:17:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.816+0000 7f36d451f640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc158e30 0x7f36cc0ce650 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.816+0000 7f36d451f640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc0caec0 0x7f36cc14ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.816+0000 7f36d451f640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36b00662b0 0x7f36b0068760 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.816+0000 7f36d451f640 1 --2- 172.21.15.45:0/1743808269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc06c110 0x7f36cc147220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.816+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 >> 172.21.15.45:0/1743808269 conn(0x7f36cc0694b0 msgr2=0x7f36cc0c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.816+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 shutdown_connections 2023-07-09T02:17:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.816+0000 7f36d451f640 1 -- 172.21.15.45:0/1743808269 wait complete. 2023-07-09T02:17:39.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:17:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f1995140640 1 Processor -- start 2023-07-09T02:17:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f1995140640 1 -- start start 2023-07-09T02:17:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f1995140640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19900cd120 0x7f19900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:39.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f1995140640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1990160a50 con 0x7f19900d2620 2023-07-09T02:17:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f1995140640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199015c430 con 0x7f199015c060 2023-07-09T02:17:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f1995140640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199015fb60 con 0x7f19900cd120 2023-07-09T02:17:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f198f59e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19900cd120 0x7f19900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f198e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f19900d2620 0x7f19900cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49554/0 (socket says 172.21.15.45:49554) 2023-07-09T02:17:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f198e59c640 1 -- 172.21.15.45:0/3791393622 learned_addr learned my addr 172.21.15.45:0/3791393622 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:39.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f198f59e640 1 -- 172.21.15.45:0/3791393622 >> v1:172.21.15.155:6789/0 conn(0x7f199015c060 legacy=0x7f19900d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:39.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f198f59e640 1 -- 172.21.15.45:0/3791393622 >> v1:172.21.15.45:6789/0 conn(0x7f19900d2620 legacy=0x7f19900cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:39.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f198f59e640 1 -- 172.21.15.45:0/3791393622 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199015fe40 con 0x7f19900cd120 2023-07-09T02:17:39.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.988+0000 7f198dd9b640 1 -- 172.21.15.45:0/3791393622 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274826232 0 0) 0x7f1990160a50 con 0x7f19900d2620 2023-07-09T02:17:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f198f59e640 1 --2- 172.21.15.45:0/3791393622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19900b4ed0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1988009d90 tx=0x7f198801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b919ca3db418e1d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f198dd9b640 1 -- 172.21.15.45:0/3791393622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880a59e0 con 0x7f19900cd120 2023-07-09T02:17:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f198dd9b640 1 -- 172.21.15.45:0/3791393622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19880a5b40 con 0x7f19900cd120 2023-07-09T02:17:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f198dd9b640 1 -- 172.21.15.45:0/3791393622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880ad440 con 0x7f19900cd120 2023-07-09T02:17:39.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f1995140640 1 -- 172.21.15.45:0/3791393622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 msgr2=0x7f19900b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:39.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f1995140640 1 --2- 172.21.15.45:0/3791393622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19900b4ed0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1988009d90 tx=0x7f198801c920 comp rx=0 tx=0).stop 2023-07-09T02:17:39.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f1995140640 1 -- 172.21.15.45:0/3791393622 shutdown_connections 2023-07-09T02:17:39.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f1995140640 1 --2- 172.21.15.45:0/3791393622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19900b4ed0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:39.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f1995140640 1 -- 172.21.15.45:0/3791393622 >> 172.21.15.45:0/3791393622 conn(0x7f19900698e0 msgr2=0x7f1990069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:39.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f1995140640 1 -- 172.21.15.45:0/3791393622 shutdown_connections 2023-07-09T02:17:39.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.992+0000 7f1995140640 1 -- 172.21.15.45:0/3791393622 wait complete. 2023-07-09T02:17:39.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 Processor -- start 2023-07-09T02:17:39.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 -- start start 2023-07-09T02:17:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19901f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19900d2620 0x7f19900cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f199015c060 0x7f19900b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19900b4040 con 0x7f19900cd120 2023-07-09T02:17:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19901f7fc0 con 0x7f199015c060 2023-07-09T02:17:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19900b4250 con 0x7f19900d2620 2023-07-09T02:17:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19901f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19901f8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40746/0 (socket says 172.21.15.45:40746) 2023-07-09T02:17:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 -- 172.21.15.45:0/2737314610 learned_addr learned my addr 172.21.15.45:0/2737314610 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:39.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198f59e640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f199015c060 0x7f19900b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:39.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198e59c640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19900d2620 0x7f19900cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:39.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 -- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19900d2620 msgr2=0x7f19900cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:39.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19900d2620 0x7f19900cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:39.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 -- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f199015c060 msgr2=0x7f19900b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f199015c060 0x7f19900b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 -- 172.21.15.45:0/2737314610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988009a70 con 0x7f19900cd120 2023-07-09T02:17:40.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198f59e640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f199015c060 0x7f19900b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:40.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198e59c640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19900d2620 0x7f19900cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:40.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f198ed9d640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19901f8450 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f198000c3c0 tx=0x7f198000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:40.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f19777fe640 1 -- 172.21.15.45:0/2737314610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800052d0 con 0x7f19900cd120 2023-07-09T02:17:40.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f19777fe640 1 -- 172.21.15.45:0/2737314610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980005430 con 0x7f19900cd120 2023-07-09T02:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19900b59f0 con 0x7f19900cd120 2023-07-09T02:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f19777fe640 1 -- 172.21.15.45:0/2737314610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980003840 con 0x7f19900cd120 2023-07-09T02:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19901f7970 con 0x7f19900cd120 2023-07-09T02:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:39.996+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199004d7d0 con 0x7f19900cd120 2023-07-09T02:17:40.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.000+0000 7f19777fe640 1 -- 172.21.15.45:0/2737314610 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19800039a0 con 0x7f19900cd120 2023-07-09T02:17:40.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.000+0000 7f19777fe640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f197c066280 0x7f197c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:40.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.000+0000 7f19777fe640 1 -- 172.21.15.45:0/2737314610 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1980082f60 con 0x7f19900cd120 2023-07-09T02:17:40.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.000+0000 7f198e59c640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f197c066280 0x7f197c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:40.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.000+0000 7f198e59c640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f197c066280 0x7f197c068730 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f19900c9760 tx=0x7f1984009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:40.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.004+0000 7f19777fe640 1 -- 172.21.15.45:0/2737314610 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19800506f0 con 0x7f19900cd120 2023-07-09T02:17:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.156+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f19900cee30 con 0x7f19900cd120 2023-07-09T02:17:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.160+0000 7f19777fe640 1 -- 172.21.15.45:0/2737314610 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1980053d10 con 0x7f19900cd120 2023-07-09T02:17:40.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f197c066280 msgr2=0x7f197c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f197c066280 0x7f197c068730 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f19900c9760 tx=0x7f1984009040 comp rx=0 tx=0).stop 2023-07-09T02:17:40.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 msgr2=0x7f19901f8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19901f8450 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f198000c3c0 tx=0x7f198000c880 comp rx=0 tx=0).stop 2023-07-09T02:17:40.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 shutdown_connections 2023-07-09T02:17:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f199015c060 0x7f19900b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f197c066280 0x7f197c068730 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19900d2620 0x7f19900cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 --2- 172.21.15.45:0/2737314610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19900cd120 0x7f19901f8450 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 >> 172.21.15.45:0/2737314610 conn(0x7f19900698e0 msgr2=0x7f19900b5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 shutdown_connections 2023-07-09T02:17:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.164+0000 7f1995140640 1 -- 172.21.15.45:0/2737314610 wait complete. 2023-07-09T02:17:40.185 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:17:40.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:17:40.262 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:17:40.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:17:40.327 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:40.327 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:40.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:17:40.338 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:40.339 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:40.349 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:17:40.350 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:40.350 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:40.387 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:17:40.388 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:40.388 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:40.403 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:17:40.403 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:17:40.404 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:40.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c9b834640 1 Processor -- start 2023-07-09T02:17:40.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c9b834640 1 -- start start 2023-07-09T02:17:40.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c9b834640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0c94158e30 0x7f0c9406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c9b834640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c940ccf80 con 0x7f0c9406c820 2023-07-09T02:17:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c9b834640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c940cd540 con 0x7f0c9406fd10 2023-07-09T02:17:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c9b834640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c940c8fb0 con 0x7f0c94158e30 2023-07-09T02:17:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c99dd1640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c9406c820 0x7f0c940caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49566/0 (socket says 172.21.15.45:49566) 2023-07-09T02:17:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c99dd1640 1 -- 172.21.15.45:0/2555495373 learned_addr learned my addr 172.21.15.45:0/2555495373 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.572+0000 7f0c995d0640 1 --2- 172.21.15.45:0/2555495373 >> v2:172.21.15.155:3300/0 conn(0x7f0c94158e30 0x7f0c9406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:40.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c8bfff640 1 -- 172.21.15.45:0/2555495373 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974022643 0 0) 0x7f0c940ccf80 con 0x7f0c9406c820 2023-07-09T02:17:40.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c8bfff640 1 -- 172.21.15.45:0/2555495373 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c80003530 con 0x7f0c9406c820 2023-07-09T02:17:40.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c995d0640 1 -- 172.21.15.45:0/2555495373 >> v1:172.21.15.155:6789/0 conn(0x7f0c9406fd10 legacy=0x7f0c9406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c8bfff640 1 -- 172.21.15.45:0/2555495373 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1935244325 0 0) 0x7f0c80003530 con 0x7f0c9406c820 2023-07-09T02:17:40.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c995d0640 1 -- 172.21.15.45:0/2555495373 >> v1:172.21.15.45:6789/0 conn(0x7f0c9406c820 legacy=0x7f0c940caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c995d0640 1 -- 172.21.15.45:0/2555495373 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940cbad0 con 0x7f0c94158e30 2023-07-09T02:17:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c995d0640 1 --2- 172.21.15.45:0/2555495373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c94158e30 0x7f0c9406f7d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0c900097c0 tx=0x7f0c9001c190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8632cbb6cc318d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:40.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c8bfff640 1 -- 172.21.15.45:0/2555495373 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c001a00 con 0x7f0c94158e30 2023-07-09T02:17:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c8bfff640 1 -- 172.21.15.45:0/2555495373 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c900a7050 con 0x7f0c94158e30 2023-07-09T02:17:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.576+0000 7f0c8bfff640 1 -- 172.21.15.45:0/2555495373 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900ab620 con 0x7f0c94158e30 2023-07-09T02:17:40.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- 172.21.15.45:0/2555495373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c94158e30 msgr2=0x7f0c9406f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 --2- 172.21.15.45:0/2555495373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c94158e30 0x7f0c9406f7d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0c900097c0 tx=0x7f0c9001c190 comp rx=0 tx=0).stop 2023-07-09T02:17:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- 172.21.15.45:0/2555495373 shutdown_connections 2023-07-09T02:17:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 --2- 172.21.15.45:0/2555495373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c94158e30 0x7f0c9406f7d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- 172.21.15.45:0/2555495373 >> 172.21.15.45:0/2555495373 conn(0x7f0c940694b0 msgr2=0x7f0c940698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:40.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- 172.21.15.45:0/2555495373 shutdown_connections 2023-07-09T02:17:40.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- 172.21.15.45:0/2555495373 wait complete. 2023-07-09T02:17:40.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 Processor -- start 2023-07-09T02:17:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- start start 2023-07-09T02:17:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9406c820 0x7f0c941555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c9406fd10 0x7f0c94168580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:40.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c94158e30 0x7f0c9414a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94167120 con 0x7f0c94158e30 2023-07-09T02:17:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94167400 con 0x7f0c9406fd10 2023-07-09T02:17:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c9b834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941676e0 con 0x7f0c9406c820 2023-07-09T02:17:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c94158e30 0x7f0c9414a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c94158e30 0x7f0c9414a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40754/0 (socket says 172.21.15.45:40754) 2023-07-09T02:17:40.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 -- 172.21.15.45:0/3042481074 learned_addr learned my addr 172.21.15.45:0/3042481074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c995d0640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9406c820 0x7f0c941555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c98dcf640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c9406fd10 0x7f0c94168580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 -- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9406c820 msgr2=0x7f0c941555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9406c820 0x7f0c941555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 -- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c9406fd10 msgr2=0x7f0c94168580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c9406fd10 0x7f0c94168580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 -- 172.21.15.45:0/3042481074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90009420 con 0x7f0c94158e30 2023-07-09T02:17:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c98dcf640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c9406fd10 0x7f0c94168580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.580+0000 7f0c99dd1640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c94158e30 0x7f0c9414a350 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c001570 tx=0x7f0c8c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:40.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c89ffb640 1 -- 172.21.15.45:0/3042481074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c00a700 con 0x7f0c94158e30 2023-07-09T02:17:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c89ffb640 1 -- 172.21.15.45:0/3042481074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c00a880 con 0x7f0c94158e30 2023-07-09T02:17:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c89ffb640 1 -- 172.21.15.45:0/3042481074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c00ac70 con 0x7f0c94158e30 2023-07-09T02:17:40.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c941679c0 con 0x7f0c94158e30 2023-07-09T02:17:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c94167ca0 con 0x7f0c94158e30 2023-07-09T02:17:40.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9404d7d0 con 0x7f0c94158e30 2023-07-09T02:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c89ffb640 1 -- 172.21.15.45:0/3042481074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c8c0070d0 con 0x7f0c94158e30 2023-07-09T02:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c89ffb640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c78066280 0x7f0c78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c89ffb640 1 -- 172.21.15.45:0/3042481074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0c8c083040 con 0x7f0c94158e30 2023-07-09T02:17:40.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.584+0000 7f0c995d0640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c78066280 0x7f0c78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.588+0000 7f0c995d0640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c78066280 0x7f0c78068730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ad000 tx=0x7f0c900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:40.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.588+0000 7f0c89ffb640 1 -- 172.21.15.45:0/3042481074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c8c050870 con 0x7f0c94158e30 2023-07-09T02:17:40.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.776+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c9414af30 con 0x7f0c94158e30 2023-07-09T02:17:40.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.776+0000 7f0c89ffb640 1 -- 172.21.15.45:0/3042481074 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f0c8c018de0 con 0x7f0c94158e30 2023-07-09T02:17:40.779 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:40.779 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":61,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/73151326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":73151326},{"type":"v1","addr":"172.21.15.155:6836","nonce":73151326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6509,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2358272272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2358272272},{"type":"v1","addr":"172.21.15.155:6837","nonce":2358272272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":7374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1152011322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1152011322},{"type":"v1","addr":"172.21.15.45:6833","nonce":1152011322}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":7386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2416182280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2416182280},{"type":"v1","addr":"172.21.15.45:6835","nonce":2416182280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[]} 2023-07-09T02:17:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 61 2023-07-09T02:17:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c78066280 msgr2=0x7f0c78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c78066280 0x7f0c78068730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ad000 tx=0x7f0c900a6000 comp rx=0 tx=0).stop 2023-07-09T02:17:40.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c94158e30 msgr2=0x7f0c9414a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:40.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c94158e30 0x7f0c9414a350 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c001570 tx=0x7f0c8c00cf50 comp rx=0 tx=0).stop 2023-07-09T02:17:40.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 shutdown_connections 2023-07-09T02:17:40.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c94158e30 0x7f0c9414a350 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c9406fd10 0x7f0c94168580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0c78066280 0x7f0c78068730 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 --2- 172.21.15.45:0/3042481074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c9406c820 0x7f0c941555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 >> 172.21.15.45:0/3042481074 conn(0x7f0c940694b0 msgr2=0x7f0c940ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:40.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 shutdown_connections 2023-07-09T02:17:40.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:40.780+0000 7f0c9b834640 1 -- 172.21.15.45:0/3042481074 wait complete. 2023-07-09T02:17:40.799 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:17:40.800 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:17:40.800 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:17:40.800 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:17:40.800 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:17:40.801 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:17:40.801 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:17:40.801 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:17:40.801 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:17:40.801 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:17:40.802 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:17:40.802 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:17:40.802 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:17:40.802 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:17:40.803 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:17:40.803 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:17:40.813 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:17:40.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:17:40.814 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:17:40.815 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:17:40.818 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:17:40.818 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:17:40.819 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:17:40.820 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:17:40.863 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:17:40.863 DEBUG:teuthology.parallel:result is None 2023-07-09T02:17:40.865 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:17:40.865 DEBUG:teuthology.parallel:result is None 2023-07-09T02:17:40.866 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:17:40.867 DEBUG:teuthology.parallel:result is None 2023-07-09T02:17:40.869 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:17:40.870 DEBUG:teuthology.parallel:result is None 2023-07-09T02:17:40.871 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:17:40.952 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:17:40.952 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:17:40.960 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:17:40.961 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:17:41.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.016+0000 7fbeba759640 1 Processor -- start 2023-07-09T02:17:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeba759640 1 -- start start 2023-07-09T02:17:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeba759640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb415c060 0x7fbeb40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeba759640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbeb40cd120 0x7fbeb40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeba759640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb4160a50 con 0x7fbeb40d2450 2023-07-09T02:17:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeba759640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb40d28f0 con 0x7fbeb40cd120 2023-07-09T02:17:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeba759640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40cfe40 con 0x7fbeb415c060 2023-07-09T02:17:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbeb40cd120 0x7fbeb40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbeb40cd120 0x7fbeb40d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40790/0 (socket says 172.21.15.45:40790) 2023-07-09T02:17:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb37fe640 1 -- 172.21.15.45:0/638112640 learned_addr learned my addr 172.21.15.45:0/638112640 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb3fff640 1 --2- 172.21.15.45:0/638112640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb415c060 0x7fbeb40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb37fe640 1 -- 172.21.15.45:0/638112640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb415c060 msgr2=0x7fbeb40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb37fe640 1 --2- 172.21.15.45:0/638112640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb415c060 0x7fbeb40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb37fe640 1 -- 172.21.15.45:0/638112640 >> v1:172.21.15.45:6789/0 conn(0x7fbeb40d2450 legacy=0x7fbeb40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb37fe640 1 -- 172.21.15.45:0/638112640 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb415c430 con 0x7fbeb40cd120 2023-07-09T02:17:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.020+0000 7fbeb2ffd640 1 -- 172.21.15.45:0/638112640 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833975948 0 0) 0x7fbeb4160a50 con 0x7fbeb40d2450 2023-07-09T02:17:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeb37fe640 1 --2- 172.21.15.45:0/638112640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb40d1f10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009870 tx=0x7fbea801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4873c40aaec95b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeb2ffd640 1 -- 172.21.15.45:0/638112640 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea80a7070 con 0x7fbeb40cd120 2023-07-09T02:17:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeb2ffd640 1 -- 172.21.15.45:0/638112640 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea80ab430 con 0x7fbeb40cd120 2023-07-09T02:17:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeb2ffd640 1 -- 172.21.15.45:0/638112640 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea80ab7c0 con 0x7fbeb40cd120 2023-07-09T02:17:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 -- 172.21.15.45:0/638112640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 msgr2=0x7fbeb40d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 --2- 172.21.15.45:0/638112640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb40d1f10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009870 tx=0x7fbea801c510 comp rx=0 tx=0).stop 2023-07-09T02:17:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 -- 172.21.15.45:0/638112640 shutdown_connections 2023-07-09T02:17:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 --2- 172.21.15.45:0/638112640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb40d1f10 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 --2- 172.21.15.45:0/638112640 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb415c060 0x7fbeb40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 -- 172.21.15.45:0/638112640 >> 172.21.15.45:0/638112640 conn(0x7fbeb40698e0 msgr2=0x7fbeb4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 -- 172.21.15.45:0/638112640 shutdown_connections 2023-07-09T02:17:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 -- 172.21.15.45:0/638112640 wait complete. 2023-07-09T02:17:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 Processor -- start 2023-07-09T02:17:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.024+0000 7fbeba759640 1 -- start start 2023-07-09T02:17:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb415b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb40d2450 0x7fbeb40b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb415c060 0x7fbeb40b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb415f6c0 con 0x7fbeb40cd120 2023-07-09T02:17:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40cb510 con 0x7fbeb415c060 2023-07-09T02:17:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40ca900 con 0x7fbeb40d2450 2023-07-09T02:17:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb415b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb415b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40804/0 (socket says 172.21.15.45:40804) 2023-07-09T02:17:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 -- 172.21.15.45:0/2455594621 learned_addr learned my addr 172.21.15.45:0/2455594621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb8cf6640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb415c060 0x7fbeb40b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb37fe640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb40d2450 0x7fbeb40b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 -- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb40d2450 msgr2=0x7fbeb40b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:41.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb40d2450 0x7fbeb40b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 -- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb415c060 msgr2=0x7fbeb40b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb415c060 0x7fbeb40b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 -- 172.21.15.45:0/2455594621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80094d0 con 0x7fbeb40cd120 2023-07-09T02:17:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb8cf6640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb415c060 0x7fbeb40b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb37fe640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb40d2450 0x7fbeb40b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb3fff640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb415b0b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fbea400e870 tx=0x7fbea400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb0ff9640 1 -- 172.21.15.45:0/2455594621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4009510 con 0x7fbeb40cd120 2023-07-09T02:17:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb0ff9640 1 -- 172.21.15.45:0/2455594621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea400eec0 con 0x7fbeb40cd120 2023-07-09T02:17:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb40cabe0 con 0x7fbeb40cd120 2023-07-09T02:17:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb0ff9640 1 -- 172.21.15.45:0/2455594621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400cb40 con 0x7fbeb40cd120 2023-07-09T02:17:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb40cb1a0 con 0x7fbeb40cd120 2023-07-09T02:17:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb404d7d0 con 0x7fbeb40cd120 2023-07-09T02:17:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.028+0000 7fbeb0ff9640 1 -- 172.21.15.45:0/2455594621 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbea400cca0 con 0x7fbeb40cd120 2023-07-09T02:17:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.032+0000 7fbeb0ff9640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbea0066280 0x7fbea0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:41.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.032+0000 7fbeb0ff9640 1 -- 172.21.15.45:0/2455594621 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbea4083bc0 con 0x7fbeb40cd120 2023-07-09T02:17:41.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.032+0000 7fbeb37fe640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbea0066280 0x7fbea0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:41.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.032+0000 7fbeb37fe640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbea0066280 0x7fbea0068730 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbea80af000 tx=0x7fbea8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:41.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.036+0000 7fbeb0ff9640 1 -- 172.21.15.45:0/2455594621 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbea40512c0 con 0x7fbeb40cd120 2023-07-09T02:17:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:41.216+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbeb41600f0 con 0x7fbeb40cd120 2023-07-09T02:17:42.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.184+0000 7fbeb0ff9640 1 -- 172.21.15.45:0/2455594621 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbea4017080 con 0x7fbeb40cd120 2023-07-09T02:17:42.187 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:17:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbea0066280 msgr2=0x7fbea0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbea0066280 0x7fbea0068730 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbea80af000 tx=0x7fbea8008040 comp rx=0 tx=0).stop 2023-07-09T02:17:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 msgr2=0x7fbeb415b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb415b0b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fbea400e870 tx=0x7fbea400ec70 comp rx=0 tx=0).stop 2023-07-09T02:17:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 shutdown_connections 2023-07-09T02:17:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbeb415c060 0x7fbeb40b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbea0066280 0x7fbea0068730 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbeb40d2450 0x7fbeb40b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 --2- 172.21.15.45:0/2455594621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbeb40cd120 0x7fbeb415b0b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 >> 172.21.15.45:0/2455594621 conn(0x7fbeb40698e0 msgr2=0x7fbeb40b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:42.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 shutdown_connections 2023-07-09T02:17:42.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.188+0000 7fbeba759640 1 -- 172.21.15.45:0/2455594621 wait complete. 2023-07-09T02:17:42.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:17:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f858067b640 1 Processor -- start 2023-07-09T02:17:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f858067b640 1 -- start start 2023-07-09T02:17:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f858067b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85780d2620 0x7f85780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f858067b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8578160a50 con 0x7f85780cd120 2023-07-09T02:17:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f858067b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857815c430 con 0x7f857815c060 2023-07-09T02:17:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f858067b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857815fb60 con 0x7f85780d2620 2023-07-09T02:17:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857ec18640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f85780cd120 0x7f85780cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57258/0 (socket says 172.21.15.45:57258) 2023-07-09T02:17:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857ec18640 1 -- 172.21.15.45:0/1871406018 learned_addr learned my addr 172.21.15.45:0/1871406018 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857dc16640 1 --2- 172.21.15.45:0/1871406018 >> v2:172.21.15.155:3300/0 conn(0x7f85780d2620 0x7f85780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857d415640 1 -- 172.21.15.45:0/1871406018 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692040290 0 0) 0x7f8578160a50 con 0x7f85780cd120 2023-07-09T02:17:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857d415640 1 -- 172.21.15.45:0/1871406018 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8564003530 con 0x7f85780cd120 2023-07-09T02:17:42.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857d415640 1 -- 172.21.15.45:0/1871406018 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582100499 0 0) 0x7f857815c430 con 0x7f857815c060 2023-07-09T02:17:42.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857d415640 1 -- 172.21.15.45:0/1871406018 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8578160a50 con 0x7f857815c060 2023-07-09T02:17:42.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857dc16640 1 -- 172.21.15.45:0/1871406018 >> v1:172.21.15.155:6789/0 conn(0x7f857815c060 legacy=0x7f85780d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857dc16640 1 -- 172.21.15.45:0/1871406018 >> v1:172.21.15.45:6789/0 conn(0x7f85780cd120 legacy=0x7f85780cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857d415640 1 -- 172.21.15.45:0/1871406018 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794559161 0 0) 0x7f8564003530 con 0x7f85780cd120 2023-07-09T02:17:42.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.360+0000 7f857dc16640 1 -- 172.21.15.45:0/1871406018 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857815fe40 con 0x7f85780d2620 2023-07-09T02:17:42.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f857dc16640 1 --2- 172.21.15.45:0/1871406018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85780d2620 0x7f85780b4ed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f85680097c0 tx=0x7f856801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7146cf087a6aee65 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f857d415640 1 -- 172.21.15.45:0/1871406018 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570001a00 con 0x7f85780d2620 2023-07-09T02:17:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f857d415640 1 -- 172.21.15.45:0/1871406018 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85680a7050 con 0x7f85780d2620 2023-07-09T02:17:42.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f857d415640 1 -- 172.21.15.45:0/1871406018 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680ab620 con 0x7f85780d2620 2023-07-09T02:17:42.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f858067b640 1 -- 172.21.15.45:0/1871406018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85780d2620 msgr2=0x7f85780b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f858067b640 1 --2- 172.21.15.45:0/1871406018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85780d2620 0x7f85780b4ed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f85680097c0 tx=0x7f856801c370 comp rx=0 tx=0).stop 2023-07-09T02:17:42.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f858067b640 1 -- 172.21.15.45:0/1871406018 shutdown_connections 2023-07-09T02:17:42.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f858067b640 1 --2- 172.21.15.45:0/1871406018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85780d2620 0x7f85780b4ed0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f858067b640 1 -- 172.21.15.45:0/1871406018 >> 172.21.15.45:0/1871406018 conn(0x7f85780698e0 msgr2=0x7f8578069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:42.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f858067b640 1 -- 172.21.15.45:0/1871406018 shutdown_connections 2023-07-09T02:17:42.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.364+0000 7f858067b640 1 -- 172.21.15.45:0/1871406018 wait complete. 2023-07-09T02:17:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 Processor -- start 2023-07-09T02:17:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 -- start start 2023-07-09T02:17:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85780cd120 0x7f857815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85780d2620 0x7f8578144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f857815c060 0x7f8578145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780c90f0 con 0x7f85780d2620 2023-07-09T02:17:42.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578144f00 con 0x7f857815c060 2023-07-09T02:17:42.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85781451e0 con 0x7f85780cd120 2023-07-09T02:17:42.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85780d2620 0x7f8578144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85780d2620 0x7f8578144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40626/0 (socket says 172.21.15.45:40626) 2023-07-09T02:17:42.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 -- 172.21.15.45:0/1979546534 learned_addr learned my addr 172.21.15.45:0/1979546534 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:42.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857ec18640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f857815c060 0x7f8578145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857e417640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85780cd120 0x7f857815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 -- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85780cd120 msgr2=0x7f857815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85780cd120 0x7f857815a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 -- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f857815c060 msgr2=0x7f8578145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f857815c060 0x7f8578145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 -- 172.21.15.45:0/1979546534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009420 con 0x7f85780d2620 2023-07-09T02:17:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f857dc16640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85780d2620 0x7f8578144840 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f85680ae040 tx=0x7f8568019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f856effd640 1 -- 172.21.15.45:0/1979546534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85680abe70 con 0x7f85780d2620 2023-07-09T02:17:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f856effd640 1 -- 172.21.15.45:0/1979546534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568004020 con 0x7f85780d2620 2023-07-09T02:17:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85780b59f0 con 0x7f85780d2620 2023-07-09T02:17:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f856effd640 1 -- 172.21.15.45:0/1979546534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568004390 con 0x7f85780d2620 2023-07-09T02:17:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.368+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85781457a0 con 0x7f85780d2620 2023-07-09T02:17:42.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.372+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857804d7d0 con 0x7f85780d2620 2023-07-09T02:17:42.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.372+0000 7f856effd640 1 -- 172.21.15.45:0/1979546534 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85680b2040 con 0x7f85780d2620 2023-07-09T02:17:42.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.372+0000 7f856effd640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f855c066280 0x7f855c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.372+0000 7f856effd640 1 -- 172.21.15.45:0/1979546534 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f856811dc20 con 0x7f85780d2620 2023-07-09T02:17:42.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.372+0000 7f857e417640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f855c066280 0x7f855c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.372+0000 7f857e417640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f855c066280 0x7f855c068730 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f85740011f0 tx=0x7f8574009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:42.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.376+0000 7f856effd640 1 -- 172.21.15.45:0/1979546534 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85680eb360 con 0x7f85780d2620 2023-07-09T02:17:42.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f857806baa0 con 0x7f85780d2620 2023-07-09T02:17:42.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f856effd640 1 -- 172.21.15.45:0/1979546534 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f85680ee980 con 0x7f85780d2620 2023-07-09T02:17:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:42.587 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:17:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:17:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:17:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:17:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:17:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:17:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:17:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:17:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:17:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:17:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:17:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:17:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:17:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:17:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:17:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:17:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:17:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:17:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:17:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:17:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:17:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:17:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:17:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:17:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:17:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:17:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:17:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:17:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:17:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:17:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:17:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:17:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:17:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:17:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:17:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:17:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:17:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:17:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:17:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:17:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:17:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:17:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:17:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:17:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:17:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:17:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:17:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:17:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:17:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:17:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:17:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:17:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:17:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:17:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:17:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:17:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:17:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:17:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:17:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:17:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:17:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:17:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:17:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:42.634 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:17:42.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f855c066280 msgr2=0x7f855c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f855c066280 0x7f855c068730 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f85740011f0 tx=0x7f8574009040 comp rx=0 tx=0).stop 2023-07-09T02:17:42.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85780d2620 msgr2=0x7f8578144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85780d2620 0x7f8578144840 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f85680ae040 tx=0x7f8568019110 comp rx=0 tx=0).stop 2023-07-09T02:17:42.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 shutdown_connections 2023-07-09T02:17:42.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f857815c060 0x7f8578145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85780d2620 0x7f8578144840 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f855c066280 0x7f855c068730 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 --2- 172.21.15.45:0/1979546534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85780cd120 0x7f857815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 >> 172.21.15.45:0/1979546534 conn(0x7f85780698e0 msgr2=0x7f857815e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:42.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 shutdown_connections 2023-07-09T02:17:42.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.584+0000 7f858067b640 1 -- 172.21.15.45:0/1979546534 wait complete. 2023-07-09T02:17:42.638 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:42.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb86bd5640 1 Processor -- start 2023-07-09T02:17:42.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb86bd5640 1 -- start start 2023-07-09T02:17:42.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb86bd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb86bd5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbb800cd120 0x7fbb800d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb86bd5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb80160a50 con 0x7fbb800d2450 2023-07-09T02:17:42.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb86bd5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800d28f0 con 0x7fbb800cd120 2023-07-09T02:17:42.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb86bd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800cfe40 con 0x7fbb8015c060 2023-07-09T02:17:42.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb85172640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb800d2450 0x7fbb800d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57262/0 (socket says 172.21.15.45:57262) 2023-07-09T02:17:42.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb85172640 1 -- 172.21.15.45:0/3694425293 learned_addr learned my addr 172.21.15.45:0/3694425293 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:42.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb84971640 1 --2- 172.21.15.45:0/3694425293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb7ffff640 1 --2- 172.21.15.45:0/3694425293 >> v2:172.21.15.155:3300/0 conn(0x7fbb800cd120 0x7fbb800d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb7f7fe640 1 -- 172.21.15.45:0/3694425293 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927907392 0 0) 0x7fbb80160a50 con 0x7fbb800d2450 2023-07-09T02:17:42.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb7f7fe640 1 -- 172.21.15.45:0/3694425293 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb70003530 con 0x7fbb800d2450 2023-07-09T02:17:42.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb84971640 1 -- 172.21.15.45:0/3694425293 >> v2:172.21.15.155:3300/0 conn(0x7fbb800cd120 msgr2=0x7fbb800d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:42.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb84971640 1 --2- 172.21.15.45:0/3694425293 >> v2:172.21.15.155:3300/0 conn(0x7fbb800cd120 0x7fbb800d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb84971640 1 -- 172.21.15.45:0/3694425293 >> v1:172.21.15.45:6789/0 conn(0x7fbb800d2450 legacy=0x7fbb800d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.780+0000 7fbb84971640 1 -- 172.21.15.45:0/3694425293 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8015c430 con 0x7fbb8015c060 2023-07-09T02:17:42.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb84971640 1 --2- 172.21.15.45:0/3694425293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b4ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097c0 tx=0x7fbb7401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2646b2ee3e002d5b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:42.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb7f7fe640 1 -- 172.21.15.45:0/3694425293 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740ab600 con 0x7fbb8015c060 2023-07-09T02:17:42.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb7f7fe640 1 -- 172.21.15.45:0/3694425293 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb740a7050 con 0x7fbb8015c060 2023-07-09T02:17:42.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb7f7fe640 1 -- 172.21.15.45:0/3694425293 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740ab960 con 0x7fbb8015c060 2023-07-09T02:17:42.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb86bd5640 1 -- 172.21.15.45:0/3694425293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 msgr2=0x7fbb800b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/3694425293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b4ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097c0 tx=0x7fbb7401c450 comp rx=0 tx=0).stop 2023-07-09T02:17:42.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb86bd5640 1 -- 172.21.15.45:0/3694425293 shutdown_connections 2023-07-09T02:17:42.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/3694425293 >> v2:172.21.15.155:3300/0 conn(0x7fbb800cd120 0x7fbb800d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/3694425293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b4ed0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb86bd5640 1 -- 172.21.15.45:0/3694425293 >> 172.21.15.45:0/3694425293 conn(0x7fbb800698e0 msgr2=0x7fbb80069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:42.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb86bd5640 1 -- 172.21.15.45:0/3694425293 shutdown_connections 2023-07-09T02:17:42.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.784+0000 7fbb86bd5640 1 -- 172.21.15.45:0/3694425293 wait complete. 2023-07-09T02:17:42.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 Processor -- start 2023-07-09T02:17:42.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 -- start start 2023-07-09T02:17:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800cd120 0x7fbb8015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800d2450 0x7fbb801538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800c9b10 con 0x7fbb800d2450 2023-07-09T02:17:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800c9d20 con 0x7fbb800cd120 2023-07-09T02:17:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800ca000 con 0x7fbb8015c060 2023-07-09T02:17:42.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800d2450 0x7fbb801538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800d2450 0x7fbb801538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40628/0 (socket says 172.21.15.45:40628) 2023-07-09T02:17:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 -- 172.21.15.45:0/615665991 learned_addr learned my addr 172.21.15.45:0/615665991 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb84971640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800cd120 0x7fbb8015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb85172640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 -- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 msgr2=0x7fbb800b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 -- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800cd120 msgr2=0x7fbb8015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800cd120 0x7fbb8015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 -- 172.21.15.45:0/615665991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74009420 con 0x7fbb800d2450 2023-07-09T02:17:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7ffff640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800d2450 0x7fbb801538e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00e900 tx=0x7fbb6c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7d7fa640 1 -- 172.21.15.45:0/615665991 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c009690 con 0x7fbb800d2450 2023-07-09T02:17:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7d7fa640 1 -- 172.21.15.45:0/615665991 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c00ca00 con 0x7fbb800d2450 2023-07-09T02:17:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb7d7fa640 1 -- 172.21.15.45:0/615665991 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00cd90 con 0x7fbb800d2450 2023-07-09T02:17:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800ca2e0 con 0x7fbb800d2450 2023-07-09T02:17:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.788+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800ca8a0 con 0x7fbb800d2450 2023-07-09T02:17:42.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.792+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8004d7d0 con 0x7fbb800d2450 2023-07-09T02:17:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.792+0000 7fbb7d7fa640 1 -- 172.21.15.45:0/615665991 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb6c013470 con 0x7fbb800d2450 2023-07-09T02:17:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.792+0000 7fbb7d7fa640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbb64066280 0x7fbb64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:42.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.792+0000 7fbb7d7fa640 1 -- 172.21.15.45:0/615665991 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbb6c083d00 con 0x7fbb800d2450 2023-07-09T02:17:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.792+0000 7fbb84971640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbb64066280 0x7fbb64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.792+0000 7fbb84971640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbb64066280 0x7fbb64068730 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbb740ad000 tx=0x7fbb74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.796+0000 7fbb7d7fa640 1 -- 172.21.15.45:0/615665991 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb6c051430 con 0x7fbb800d2450 2023-07-09T02:17:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.952+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb8006baa0 con 0x7fbb800d2450 2023-07-09T02:17:42.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb7d7fa640 1 -- 172.21.15.45:0/615665991 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+14651 (secure 0 0 0) 0x7fbb6c017090 con 0x7fbb800d2450 2023-07-09T02:17:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:42.957 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":134,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:42.183347+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbb64066280 msgr2=0x7fbb64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbb64066280 0x7fbb64068730 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbb740ad000 tx=0x7fbb74008040 comp rx=0 tx=0).stop 2023-07-09T02:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800d2450 msgr2=0x7fbb801538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800d2450 0x7fbb801538e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00e900 tx=0x7fbb6c00edc0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 shutdown_connections 2023-07-09T02:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbb64066280 0x7fbb64068730 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8015c060 0x7fbb800b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb800d2450 0x7fbb801538e0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 --2- 172.21.15.45:0/615665991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb800cd120 0x7fbb8015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 >> 172.21.15.45:0/615665991 conn(0x7fbb800698e0 msgr2=0x7fbb800b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 shutdown_connections 2023-07-09T02:17:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:42.956+0000 7fbb86bd5640 1 -- 172.21.15.45:0/615665991 wait complete. 2023-07-09T02:17:42.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:17:42.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:17:43.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15fabfa640 1 Processor -- start 2023-07-09T02:17:43.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15fabfa640 1 -- start start 2023-07-09T02:17:43.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15fabfa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15f415c060 0x7f15f40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15fabfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40d2620 0x7f15f40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15fabfa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f4160a50 con 0x7f15f40cd120 2023-07-09T02:17:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15fabfa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f415c430 con 0x7f15f415c060 2023-07-09T02:17:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15fabfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f415fb60 con 0x7f15f40d2620 2023-07-09T02:17:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f8996640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15f415c060 0x7f15f40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f8996640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15f415c060 0x7f15f40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40640/0 (socket says 172.21.15.45:40640) 2023-07-09T02:17:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f8996640 1 -- 172.21.15.45:0/3902994064 learned_addr learned my addr 172.21.15.45:0/3902994064 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f9197640 1 --2- 172.21.15.45:0/3902994064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40d2620 0x7f15f40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f8996640 1 -- 172.21.15.45:0/3902994064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40d2620 msgr2=0x7f15f40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f8996640 1 --2- 172.21.15.45:0/3902994064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40d2620 0x7f15f40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f8996640 1 -- 172.21.15.45:0/3902994064 >> v1:172.21.15.155:6789/0 conn(0x7f15f40cd120 legacy=0x7f15f40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:43.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f8996640 1 -- 172.21.15.45:0/3902994064 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f415fe40 con 0x7f15f415c060 2023-07-09T02:17:43.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.124+0000 7f15f9197640 1 --2- 172.21.15.45:0/3902994064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40d2620 0x7f15f40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15f8996640 1 --2- 172.21.15.45:0/3902994064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f415c060 0x7f15f40b4ed0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009870 tx=0x7f15e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f65be1563d5700 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15f37fe640 1 -- 172.21.15.45:0/3902994064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80aa5f0 con 0x7f15f415c060 2023-07-09T02:17:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15f37fe640 1 -- 172.21.15.45:0/3902994064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e80aa750 con 0x7f15f415c060 2023-07-09T02:17:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15f37fe640 1 -- 172.21.15.45:0/3902994064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80aaae0 con 0x7f15f415c060 2023-07-09T02:17:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15fabfa640 1 -- 172.21.15.45:0/3902994064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f415c060 msgr2=0x7f15f40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3902994064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f415c060 0x7f15f40b4ed0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009870 tx=0x7f15e801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15fabfa640 1 -- 172.21.15.45:0/3902994064 shutdown_connections 2023-07-09T02:17:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3902994064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f40d2620 0x7f15f40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3902994064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f415c060 0x7f15f40b4ed0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15fabfa640 1 -- 172.21.15.45:0/3902994064 >> 172.21.15.45:0/3902994064 conn(0x7f15f40698e0 msgr2=0x7f15f4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:43.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15fabfa640 1 -- 172.21.15.45:0/3902994064 shutdown_connections 2023-07-09T02:17:43.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.128+0000 7f15fabfa640 1 -- 172.21.15.45:0/3902994064 wait complete. 2023-07-09T02:17:43.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 Processor -- start 2023-07-09T02:17:43.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 -- start start 2023-07-09T02:17:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f40cd120 0x7f15f4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40d2620 0x7f15f41523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f415c060 0x7f15f40c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f415a380 con 0x7f15f40cd120 2023-07-09T02:17:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40cca60 con 0x7f15f40d2620 2023-07-09T02:17:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40ca230 con 0x7f15f415c060 2023-07-09T02:17:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f40cd120 0x7f15f4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f40cd120 0x7f15f4159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40656/0 (socket says 172.21.15.45:40656) 2023-07-09T02:17:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 -- 172.21.15.45:0/3694033384 learned_addr learned my addr 172.21.15.45:0/3694033384 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f9197640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f415c060 0x7f15f40c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f3fff640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40d2620 0x7f15f41523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 -- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f415c060 msgr2=0x7f15f40c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f415c060 0x7f15f40c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 -- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40d2620 msgr2=0x7f15f41523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40d2620 0x7f15f41523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 -- 172.21.15.45:0/3694033384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80094d0 con 0x7f15f40cd120 2023-07-09T02:17:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f3fff640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40d2620 0x7f15f41523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f8996640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f40cd120 0x7f15f4159c80 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f15e80ac040 tx=0x7f15e801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f17fa640 1 -- 172.21.15.45:0/3694033384 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80b3800 con 0x7f15f40cd120 2023-07-09T02:17:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f17fa640 1 -- 172.21.15.45:0/3694033384 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e80b3980 con 0x7f15f40cd120 2023-07-09T02:17:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15f17fa640 1 -- 172.21.15.45:0/3694033384 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80b3d30 con 0x7f15f40cd120 2023-07-09T02:17:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f40b59f0 con 0x7f15f40cd120 2023-07-09T02:17:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.132+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f4152900 con 0x7f15f40cd120 2023-07-09T02:17:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.136+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f404d7d0 con 0x7f15f40cd120 2023-07-09T02:17:43.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.136+0000 7f15f17fa640 1 -- 172.21.15.45:0/3694033384 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15e80b2380 con 0x7f15f40cd120 2023-07-09T02:17:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.136+0000 7f15f17fa640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15d8066280 0x7f15d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.136+0000 7f15f17fa640 1 -- 172.21.15.45:0/3694033384 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f15e80a7070 con 0x7f15f40cd120 2023-07-09T02:17:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.136+0000 7f15f3fff640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15d8066280 0x7f15d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.136+0000 7f15f3fff640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15d8066280 0x7f15d8068730 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f15f40b6820 tx=0x7f15e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.140+0000 7f15f17fa640 1 -- 172.21.15.45:0/3694033384 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15e80eb830 con 0x7f15f40cd120 2023-07-09T02:17:43.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15f406baa0 con 0x7f15f40cd120 2023-07-09T02:17:43.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15f17fa640 1 -- 172.21.15.45:0/3694033384 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15e80eee50 con 0x7f15f40cd120 2023-07-09T02:17:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:17:43.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15d8066280 msgr2=0x7f15d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15d8066280 0x7f15d8068730 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f15f40b6820 tx=0x7f15e0009040 comp rx=0 tx=0).stop 2023-07-09T02:17:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f40cd120 msgr2=0x7f15f4159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f40cd120 0x7f15f4159c80 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f15e80ac040 tx=0x7f15e801ad10 comp rx=0 tx=0).stop 2023-07-09T02:17:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 shutdown_connections 2023-07-09T02:17:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15d8066280 0x7f15d8068730 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15f415c060 0x7f15f40c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15f40d2620 0x7f15f41523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 --2- 172.21.15.45:0/3694033384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f40cd120 0x7f15f4159c80 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 >> 172.21.15.45:0/3694033384 conn(0x7f15f40698e0 msgr2=0x7f15f4069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 shutdown_connections 2023-07-09T02:17:43.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.296+0000 7f15fabfa640 1 -- 172.21.15.45:0/3694033384 wait complete. 2023-07-09T02:17:43.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:17:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.460+0000 7fb077f00640 1 Processor -- start 2023-07-09T02:17:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.460+0000 7fb077f00640 1 -- start start 2023-07-09T02:17:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb077f00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0700d2620 0x7fb0700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb077f00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0700cd120 0x7fb0700cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb077f00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb070160a50 con 0x7fb07015c060 2023-07-09T02:17:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb077f00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07015c430 con 0x7fb0700cd120 2023-07-09T02:17:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb077f00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07015fb60 con 0x7fb0700d2620 2023-07-09T02:17:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb07649d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0700cd120 0x7fb0700cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb07649d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0700cd120 0x7fb0700cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40670/0 (socket says 172.21.15.45:40670) 2023-07-09T02:17:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb07649d640 1 -- 172.21.15.45:0/3714766331 learned_addr learned my addr 172.21.15.45:0/3714766331 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb07549b640 1 --2- 172.21.15.45:0/3714766331 >> v2:172.21.15.155:3300/0 conn(0x7fb0700d2620 0x7fb0700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb07649d640 1 -- 172.21.15.45:0/3714766331 >> v2:172.21.15.155:3300/0 conn(0x7fb0700d2620 msgr2=0x7fb0700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb07649d640 1 --2- 172.21.15.45:0/3714766331 >> v2:172.21.15.155:3300/0 conn(0x7fb0700d2620 0x7fb0700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb07649d640 1 -- 172.21.15.45:0/3714766331 >> v1:172.21.15.45:6789/0 conn(0x7fb07015c060 legacy=0x7fb0700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.464+0000 7fb07649d640 1 -- 172.21.15.45:0/3714766331 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07015fe40 con 0x7fb0700cd120 2023-07-09T02:17:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb07649d640 1 --2- 172.21.15.45:0/3714766331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700cee30 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fb07015fac0 tx=0x7fb06801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b393d1628ce8995 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb074c9a640 1 -- 172.21.15.45:0/3714766331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680a5860 con 0x7fb0700cd120 2023-07-09T02:17:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb074c9a640 1 -- 172.21.15.45:0/3714766331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0680a59c0 con 0x7fb0700cd120 2023-07-09T02:17:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb074c9a640 1 -- 172.21.15.45:0/3714766331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680a5d50 con 0x7fb0700cd120 2023-07-09T02:17:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 -- 172.21.15.45:0/3714766331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 msgr2=0x7fb0700cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 --2- 172.21.15.45:0/3714766331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700cee30 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fb07015fac0 tx=0x7fb06801c9a0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 -- 172.21.15.45:0/3714766331 shutdown_connections 2023-07-09T02:17:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 --2- 172.21.15.45:0/3714766331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700cee30 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 --2- 172.21.15.45:0/3714766331 >> v2:172.21.15.155:3300/0 conn(0x7fb0700d2620 0x7fb0700b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 -- 172.21.15.45:0/3714766331 >> 172.21.15.45:0/3714766331 conn(0x7fb0700698e0 msgr2=0x7fb070069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 -- 172.21.15.45:0/3714766331 shutdown_connections 2023-07-09T02:17:43.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 -- 172.21.15.45:0/3714766331 wait complete. 2023-07-09T02:17:43.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 Processor -- start 2023-07-09T02:17:43.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.468+0000 7fb077f00640 1 -- start start 2023-07-09T02:17:43.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0700d2620 0x7fb070151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb07015c060 0x7fb0700b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0701526f0 con 0x7fb0700cd120 2023-07-09T02:17:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb070152900 con 0x7fb0700d2620 2023-07-09T02:17:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb070152be0 con 0x7fb07015c060 2023-07-09T02:17:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40684/0 (socket says 172.21.15.45:40684) 2023-07-09T02:17:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 -- 172.21.15.45:0/220885680 learned_addr learned my addr 172.21.15.45:0/220885680 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb07549b640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0700d2620 0x7fb070151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb07649d640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb07015c060 0x7fb0700b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 -- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb07015c060 msgr2=0x7fb0700b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb07015c060 0x7fb0700b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 -- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0700d2620 msgr2=0x7fb070151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0700d2620 0x7fb070151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 -- 172.21.15.45:0/220885680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068009b30 con 0x7fb0700cd120 2023-07-09T02:17:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb075c9c640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700ccae0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c3c0 tx=0x7fb06c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb0667fc640 1 -- 172.21.15.45:0/220885680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0052d0 con 0x7fb0700cd120 2023-07-09T02:17:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb0667fc640 1 -- 172.21.15.45:0/220885680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c005430 con 0x7fb0700cd120 2023-07-09T02:17:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0700b59f0 con 0x7fb0700cd120 2023-07-09T02:17:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb0667fc640 1 -- 172.21.15.45:0/220885680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c003840 con 0x7fb0700cd120 2023-07-09T02:17:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0701531a0 con 0x7fb0700cd120 2023-07-09T02:17:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07004d7d0 con 0x7fb0700cd120 2023-07-09T02:17:43.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.472+0000 7fb0667fc640 1 -- 172.21.15.45:0/220885680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb06c0039a0 con 0x7fb0700cd120 2023-07-09T02:17:43.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.476+0000 7fb0667fc640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb054066280 0x7fb054068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.476+0000 7fb0667fc640 1 -- 172.21.15.45:0/220885680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb06c082dd0 con 0x7fb0700cd120 2023-07-09T02:17:43.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.476+0000 7fb07549b640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb054066280 0x7fb054068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.476+0000 7fb07549b640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb054066280 0x7fb054068730 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb0700b4810 tx=0x7fb060008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.480+0000 7fb0667fc640 1 -- 172.21.15.45:0/220885680 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb06c0506e0 con 0x7fb0700cd120 2023-07-09T02:17:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.632+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb0700b18d0 con 0x7fb0700cd120 2023-07-09T02:17:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.632+0000 7fb0667fc640 1 -- 172.21.15.45:0/220885680 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v134) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb06c017020 con 0x7fb0700cd120 2023-07-09T02:17:43.635 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:17:43.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb054066280 msgr2=0x7fb054068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb054066280 0x7fb054068730 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb0700b4810 tx=0x7fb060008040 comp rx=0 tx=0).stop 2023-07-09T02:17:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 msgr2=0x7fb0700ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700ccae0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c3c0 tx=0x7fb06c00c880 comp rx=0 tx=0).stop 2023-07-09T02:17:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 shutdown_connections 2023-07-09T02:17:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb054066280 0x7fb054068730 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb07015c060 0x7fb0700b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0700d2620 0x7fb070151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 --2- 172.21.15.45:0/220885680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0700cd120 0x7fb0700ccae0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 >> 172.21.15.45:0/220885680 conn(0x7fb0700698e0 msgr2=0x7fb070154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 shutdown_connections 2023-07-09T02:17:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.636+0000 7fb077f00640 1 -- 172.21.15.45:0/220885680 wait complete. 2023-07-09T02:17:43.656 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:17:43.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.796+0000 7f99dc4d8640 1 Processor -- start 2023-07-09T02:17:43.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.796+0000 7f99dc4d8640 1 -- start start 2023-07-09T02:17:43.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.796+0000 7f99dc4d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f99d40cb2a0 0x7f99d40c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.796+0000 7f99dc4d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d415db60 0x7f99d40c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.796+0000 7f99dc4d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40ce760 con 0x7f99d40cb670 2023-07-09T02:17:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.796+0000 7f99dc4d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40cea40 con 0x7f99d40cb2a0 2023-07-09T02:17:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.796+0000 7f99dc4d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40ced20 con 0x7f99d415db60 2023-07-09T02:17:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99daa75640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99d40cb670 0x7f99d4150890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57278/0 (socket says 172.21.15.45:57278) 2023-07-09T02:17:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99daa75640 1 -- 172.21.15.45:0/753375049 learned_addr learned my addr 172.21.15.45:0/753375049 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:43.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99da274640 1 --2- 172.21.15.45:0/753375049 >> v2:172.21.15.155:3300/0 conn(0x7f99d40cb2a0 0x7f99d40c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9a73640 1 --2- 172.21.15.45:0/753375049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d415db60 0x7f99d40c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9272640 1 -- 172.21.15.45:0/753375049 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986423209 0 0) 0x7f99d40ce760 con 0x7f99d40cb670 2023-07-09T02:17:43.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9272640 1 -- 172.21.15.45:0/753375049 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c0003530 con 0x7f99d40cb670 2023-07-09T02:17:43.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9a73640 1 -- 172.21.15.45:0/753375049 >> v2:172.21.15.155:3300/0 conn(0x7f99d40cb2a0 msgr2=0x7f99d40c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:43.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9a73640 1 --2- 172.21.15.45:0/753375049 >> v2:172.21.15.155:3300/0 conn(0x7f99d40cb2a0 0x7f99d40c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9a73640 1 -- 172.21.15.45:0/753375049 >> v1:172.21.15.45:6789/0 conn(0x7f99d40cb670 legacy=0x7f99d4150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9a73640 1 -- 172.21.15.45:0/753375049 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40cf000 con 0x7f99d415db60 2023-07-09T02:17:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99da274640 1 --2- 172.21.15.45:0/753375049 >> v2:172.21.15.155:3300/0 conn(0x7f99d40cb2a0 0x7f99d40c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9a73640 1 --2- 172.21.15.45:0/753375049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d415db60 0x7f99d40c9ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99c40097c0 tx=0x7f99c401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef86b63c2c35292c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9272640 1 -- 172.21.15.45:0/753375049 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40ab650 con 0x7f99d415db60 2023-07-09T02:17:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.800+0000 7f99d9272640 1 -- 172.21.15.45:0/753375049 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c40ab7b0 con 0x7f99d415db60 2023-07-09T02:17:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99d9272640 1 -- 172.21.15.45:0/753375049 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40abb40 con 0x7f99d415db60 2023-07-09T02:17:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- 172.21.15.45:0/753375049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d415db60 msgr2=0x7f99d40c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/753375049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d415db60 0x7f99d40c9ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99c40097c0 tx=0x7f99c401c410 comp rx=0 tx=0).stop 2023-07-09T02:17:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- 172.21.15.45:0/753375049 shutdown_connections 2023-07-09T02:17:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/753375049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d415db60 0x7f99d40c9ae0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/753375049 >> v2:172.21.15.155:3300/0 conn(0x7f99d40cb2a0 0x7f99d40c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- 172.21.15.45:0/753375049 >> 172.21.15.45:0/753375049 conn(0x7f99d40694b0 msgr2=0x7f99d40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- 172.21.15.45:0/753375049 shutdown_connections 2023-07-09T02:17:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- 172.21.15.45:0/753375049 wait complete. 2023-07-09T02:17:43.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 Processor -- start 2023-07-09T02:17:43.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- start start 2023-07-09T02:17:43.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d40cb2a0 0x7f99d414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d40cb670 0x7f99d40c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99d415db60 0x7f99d40c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40ccd40 con 0x7f99d40cb2a0 2023-07-09T02:17:43.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d414dcb0 con 0x7f99d415db60 2023-07-09T02:17:43.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99dc4d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40cc3a0 con 0x7f99d40cb670 2023-07-09T02:17:43.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99da274640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d40cb2a0 0x7f99d414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99da274640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d40cb2a0 0x7f99d414b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40698/0 (socket says 172.21.15.45:40698) 2023-07-09T02:17:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99da274640 1 -- 172.21.15.45:0/514789467 learned_addr learned my addr 172.21.15.45:0/514789467 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.804+0000 7f99d9a73640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d40cb670 0x7f99d40c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99daa75640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99d415db60 0x7f99d40c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99da274640 1 -- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d40cb670 msgr2=0x7f99d40c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99da274640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d40cb670 0x7f99d40c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99da274640 1 -- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99d415db60 msgr2=0x7f99d40c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99da274640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99d415db60 0x7f99d40c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99da274640 1 -- 172.21.15.45:0/514789467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d0009420 con 0x7f99d40cb2a0 2023-07-09T02:17:43.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99daa75640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99d415db60 0x7f99d40c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:43.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99da274640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d40cb2a0 0x7f99d414b530 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f99d000e980 tx=0x7f99d000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99caffd640 1 -- 172.21.15.45:0/514789467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d000ca00 con 0x7f99d40cb2a0 2023-07-09T02:17:43.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99caffd640 1 -- 172.21.15.45:0/514789467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d000cb60 con 0x7f99d40cb2a0 2023-07-09T02:17:43.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c4009420 con 0x7f99d40cb2a0 2023-07-09T02:17:43.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99caffd640 1 -- 172.21.15.45:0/514789467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0013470 con 0x7f99d40cb2a0 2023-07-09T02:17:43.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d40cc960 con 0x7f99d40cb2a0 2023-07-09T02:17:43.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d40ccfb0 con 0x7f99d40cb2a0 2023-07-09T02:17:43.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99caffd640 1 -- 172.21.15.45:0/514789467 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99d00135d0 con 0x7f99d40cb2a0 2023-07-09T02:17:43.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99caffd640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99b8066280 0x7f99b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:43.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.808+0000 7f99caffd640 1 -- 172.21.15.45:0/514789467 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f99d0083b90 con 0x7f99d40cb2a0 2023-07-09T02:17:43.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.812+0000 7f99d9a73640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99b8066280 0x7f99b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:43.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.812+0000 7f99d9a73640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99b8066280 0x7f99b8068730 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f99c40af000 tx=0x7f99c40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:43.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.812+0000 7f99caffd640 1 -- 172.21.15.45:0/514789467 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99d0051400 con 0x7f99d40cb2a0 2023-07-09T02:17:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f99d404d7d0 con 0x7f99d40cb2a0 2023-07-09T02:17:43.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99caffd640 1 -- 172.21.15.45:0/514789467 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+126 (secure 0 0 0) 0x7f99d0017090 con 0x7f99d40cb2a0 2023-07-09T02:17:43.977 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:43.978 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:17:43.978 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:43.978 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:17:43.979 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:17:43.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:43.979 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:43.979 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:17:43.980 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:17:43.980 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:43.980 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:17:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99b8066280 msgr2=0x7f99b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99b8066280 0x7f99b8068730 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f99c40af000 tx=0x7f99c40a7000 comp rx=0 tx=0).stop 2023-07-09T02:17:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d40cb2a0 msgr2=0x7f99d414b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d40cb2a0 0x7f99d414b530 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f99d000e980 tx=0x7f99d000ee40 comp rx=0 tx=0).stop 2023-07-09T02:17:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 shutdown_connections 2023-07-09T02:17:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99d415db60 0x7f99d40c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f99b8066280 0x7f99b8068730 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99d40cb670 0x7f99d40c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 --2- 172.21.15.45:0/514789467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99d40cb2a0 0x7f99d414b530 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 >> 172.21.15.45:0/514789467 conn(0x7f99d40694b0 msgr2=0x7f99d40700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 shutdown_connections 2023-07-09T02:17:43.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:43.976+0000 7f99dc4d8640 1 -- 172.21.15.45:0/514789467 wait complete. 2023-07-09T02:17:43.997 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:17:43.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:17:44.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2ab58640 1 Processor -- start 2023-07-09T02:17:44.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2ab58640 1 -- start start 2023-07-09T02:17:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2ab58640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2ab58640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdc240cead0 0x7fdc24160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2ab58640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc24069980 0x7fdc24069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2ab58640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc240cd6e0 con 0x7fdc24069980 2023-07-09T02:17:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2ab58640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc240d0450 con 0x7fdc240cead0 2023-07-09T02:17:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2ab58640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2406a340 con 0x7fdc2415c280 2023-07-09T02:17:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2a357640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc24069980 0x7fdc24069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2a357640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc24069980 0x7fdc24069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40712/0 (socket says 172.21.15.45:40712) 2023-07-09T02:17:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2a357640 1 -- 172.21.15.45:0/2698301797 learned_addr learned my addr 172.21.15.45:0/2698301797 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc29b56640 1 --2- 172.21.15.45:0/2698301797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc29355640 1 --2- 172.21.15.45:0/2698301797 >> v2:172.21.15.155:3300/0 conn(0x7fdc240cead0 0x7fdc24160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2a357640 1 -- 172.21.15.45:0/2698301797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 msgr2=0x7fdc240b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2a357640 1 --2- 172.21.15.45:0/2698301797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2a357640 1 -- 172.21.15.45:0/2698301797 >> v2:172.21.15.155:3300/0 conn(0x7fdc240cead0 msgr2=0x7fdc24160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2a357640 1 --2- 172.21.15.45:0/2698301797 >> v2:172.21.15.155:3300/0 conn(0x7fdc240cead0 0x7fdc24160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc2a357640 1 -- 172.21.15.45:0/2698301797 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240cced0 con 0x7fdc24069980 2023-07-09T02:17:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc29b56640 1 --2- 172.21.15.45:0/2698301797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.144+0000 7fdc29355640 1 --2- 172.21.15.45:0/2698301797 >> v2:172.21.15.155:3300/0 conn(0x7fdc240cead0 0x7fdc24160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2a357640 1 --2- 172.21.15.45:0/2698301797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc24069980 0x7fdc24069e00 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fdc24069530 tx=0x7fdc1c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403cbfab27a530eb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc28b54640 1 -- 172.21.15.45:0/2698301797 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0a5760 con 0x7fdc24069980 2023-07-09T02:17:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc28b54640 1 -- 172.21.15.45:0/2698301797 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0a58c0 con 0x7fdc24069980 2023-07-09T02:17:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc28b54640 1 -- 172.21.15.45:0/2698301797 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0a5c50 con 0x7fdc24069980 2023-07-09T02:17:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 -- 172.21.15.45:0/2698301797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc24069980 msgr2=0x7fdc24069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/2698301797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc24069980 0x7fdc24069e00 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fdc24069530 tx=0x7fdc1c01c9d0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 -- 172.21.15.45:0/2698301797 shutdown_connections 2023-07-09T02:17:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/2698301797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc24069980 0x7fdc24069e00 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/2698301797 >> v2:172.21.15.155:3300/0 conn(0x7fdc240cead0 0x7fdc24160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/2698301797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 -- 172.21.15.45:0/2698301797 >> 172.21.15.45:0/2698301797 conn(0x7fdc240cff90 msgr2=0x7fdc240d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 -- 172.21.15.45:0/2698301797 shutdown_connections 2023-07-09T02:17:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.148+0000 7fdc2ab58640 1 -- 172.21.15.45:0/2698301797 wait complete. 2023-07-09T02:17:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 Processor -- start 2023-07-09T02:17:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 -- start start 2023-07-09T02:17:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc24069980 0x7fdc24148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cead0 0x7fdc24150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240cbc80 con 0x7fdc240cead0 2023-07-09T02:17:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240cb3d0 con 0x7fdc24069980 2023-07-09T02:17:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2414fcd0 con 0x7fdc2415c280 2023-07-09T02:17:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cead0 0x7fdc24150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cead0 0x7fdc24150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40714/0 (socket says 172.21.15.45:40714) 2023-07-09T02:17:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 -- 172.21.15.45:0/497233150 learned_addr learned my addr 172.21.15.45:0/497233150 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2a357640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29b56640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc24069980 0x7fdc24148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 -- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 msgr2=0x7fdc240cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 -- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc24069980 msgr2=0x7fdc24148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc24069980 0x7fdc24148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 -- 172.21.15.45:0/497233150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c009b30 con 0x7fdc240cead0 2023-07-09T02:17:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc29355640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cead0 0x7fdc24150950 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400e810 tx=0x7fdc1400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc1a7fc640 1 -- 172.21.15.45:0/497233150 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14004030 con 0x7fdc240cead0 2023-07-09T02:17:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc1a7fc640 1 -- 172.21.15.45:0/497233150 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14004190 con 0x7fdc240cead0 2023-07-09T02:17:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc1a7fc640 1 -- 172.21.15.45:0/497233150 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14004520 con 0x7fdc240cead0 2023-07-09T02:17:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240cb630 con 0x7fdc240cead0 2023-07-09T02:17:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.152+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc24150e90 con 0x7fdc240cead0 2023-07-09T02:17:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.156+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2404e020 con 0x7fdc240cead0 2023-07-09T02:17:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.156+0000 7fdc1a7fc640 1 -- 172.21.15.45:0/497233150 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc1400c6d0 con 0x7fdc240cead0 2023-07-09T02:17:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.156+0000 7fdc1a7fc640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.156+0000 7fdc1a7fc640 1 -- 172.21.15.45:0/497233150 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdc14083630 con 0x7fdc240cead0 2023-07-09T02:17:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.156+0000 7fdc29b56640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.156+0000 7fdc29b56640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c900 tx=0x7fdc20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.160+0000 7fdc1a7fc640 1 -- 172.21.15.45:0/497233150 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc14050d60 con 0x7fdc240cead0 2023-07-09T02:17:44.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.320+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdc240cbdc0 con 0x7fdc240cead0 2023-07-09T02:17:44.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.836+0000 7fdc1a7fc640 1 -- 172.21.15.45:0/497233150 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdc14054380 con 0x7fdc240cead0 2023-07-09T02:17:44.838 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:17:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 msgr2=0x7fdc08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000c900 tx=0x7fdc20008040 comp rx=0 tx=0).stop 2023-07-09T02:17:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cead0 msgr2=0x7fdc24150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:44.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cead0 0x7fdc24150950 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400e810 tx=0x7fdc1400ecd0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 shutdown_connections 2023-07-09T02:17:44.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc2415c280 0x7fdc240cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc240cead0 0x7fdc24150950 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 --2- 172.21.15.45:0/497233150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc24069980 0x7fdc24148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:44.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 >> 172.21.15.45:0/497233150 conn(0x7fdc240cff90 msgr2=0x7fdc241546f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:44.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 shutdown_connections 2023-07-09T02:17:44.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:44.840+0000 7fdc2ab58640 1 -- 172.21.15.45:0/497233150 wait complete. 2023-07-09T02:17:44.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:17:45.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.012+0000 7f9ff2311640 1 Processor -- start 2023-07-09T02:17:45.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.012+0000 7f9ff2311640 1 -- start start 2023-07-09T02:17:45.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9ff2311640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9fec0af990 0x7f9fec06a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9ff2311640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec06c1c0 con 0x7f9fec0afd60 2023-07-09T02:17:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9ff2311640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec0cbf00 con 0x7f9fec0b23b0 2023-07-09T02:17:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9ff2311640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0ccdd0 con 0x7f9fec0af990 2023-07-09T02:17:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9ff08ae640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9fec0afd60 0x7f9fec06cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57284/0 (socket says 172.21.15.45:57284) 2023-07-09T02:17:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9ff08ae640 1 -- 172.21.15.45:0/3695754579 learned_addr learned my addr 172.21.15.45:0/3695754579 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9febfff640 1 --2- 172.21.15.45:0/3695754579 >> v2:172.21.15.155:3300/0 conn(0x7f9fec0af990 0x7f9fec06a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9feaffd640 1 -- 172.21.15.45:0/3695754579 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182783917 0 0) 0x7f9fec06c1c0 con 0x7f9fec0afd60 2023-07-09T02:17:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9feaffd640 1 -- 172.21.15.45:0/3695754579 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd4003530 con 0x7f9fec0afd60 2023-07-09T02:17:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9feaffd640 1 -- 172.21.15.45:0/3695754579 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460841035 0 0) 0x7f9fec0cbf00 con 0x7f9fec0b23b0 2023-07-09T02:17:45.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9feaffd640 1 -- 172.21.15.45:0/3695754579 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fec06c1c0 con 0x7f9fec0b23b0 2023-07-09T02:17:45.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9febfff640 1 -- 172.21.15.45:0/3695754579 >> v1:172.21.15.155:6789/0 conn(0x7f9fec0b23b0 legacy=0x7f9fec06ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:45.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9febfff640 1 -- 172.21.15.45:0/3695754579 >> v1:172.21.15.45:6789/0 conn(0x7f9fec0afd60 legacy=0x7f9fec06cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:45.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.016+0000 7f9febfff640 1 -- 172.21.15.45:0/3695754579 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0cd120 con 0x7f9fec0af990 2023-07-09T02:17:45.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9febfff640 1 --2- 172.21.15.45:0/3695754579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0af990 0x7f9fec06a5c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0097a0 tx=0x7f9fdc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c22ade1e10147d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:45.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9feaffd640 1 -- 172.21.15.45:0/3695754579 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0a7070 con 0x7f9fec0af990 2023-07-09T02:17:45.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9feaffd640 1 -- 172.21.15.45:0/3695754579 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0ab430 con 0x7f9fec0af990 2023-07-09T02:17:45.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9feaffd640 1 -- 172.21.15.45:0/3695754579 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0ab7c0 con 0x7f9fec0af990 2023-07-09T02:17:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 -- 172.21.15.45:0/3695754579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0af990 msgr2=0x7f9fec06a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 --2- 172.21.15.45:0/3695754579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0af990 0x7f9fec06a5c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0097a0 tx=0x7f9fdc01c430 comp rx=0 tx=0).stop 2023-07-09T02:17:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 -- 172.21.15.45:0/3695754579 shutdown_connections 2023-07-09T02:17:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 --2- 172.21.15.45:0/3695754579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0af990 0x7f9fec06a5c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 -- 172.21.15.45:0/3695754579 >> 172.21.15.45:0/3695754579 conn(0x7f9fec0999f0 msgr2=0x7f9fec0d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:45.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 -- 172.21.15.45:0/3695754579 shutdown_connections 2023-07-09T02:17:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 -- 172.21.15.45:0/3695754579 wait complete. 2023-07-09T02:17:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 Processor -- start 2023-07-09T02:17:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.020+0000 7f9ff2311640 1 -- start start 2023-07-09T02:17:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0af990 0x7f9fec155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0afd60 0x7f9fec14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fec0b23b0 0x7f9fec0b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0b59a0 con 0x7f9fec0afd60 2023-07-09T02:17:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec0b43a0 con 0x7f9fec0af990 2023-07-09T02:17:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec155550 con 0x7f9fec0b23b0 2023-07-09T02:17:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0afd60 0x7f9fec14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0afd60 0x7f9fec14a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40724/0 (socket says 172.21.15.45:40724) 2023-07-09T02:17:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 -- 172.21.15.45:0/2029515092 learned_addr learned my addr 172.21.15.45:0/2029515092 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:45.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 -- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fec0b23b0 msgr2=0x7f9fec0b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:45.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fec0b23b0 0x7f9fec0b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:45.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 -- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0af990 msgr2=0x7f9fec155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:45.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0af990 0x7f9fec155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:45.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 -- 172.21.15.45:0/2029515092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc0093b0 con 0x7f9fec0afd60 2023-07-09T02:17:45.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9feb7fe640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0afd60 0x7f9fec14a170 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000c460 tx=0x7f9fe000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:45.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/2029515092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00052d0 con 0x7f9fec0afd60 2023-07-09T02:17:45.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/2029515092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0005450 con 0x7f9fec0afd60 2023-07-09T02:17:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/2029515092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0003840 con 0x7f9fec0afd60 2023-07-09T02:17:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec14a6b0 con 0x7f9fec0afd60 2023-07-09T02:17:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec0b3d50 con 0x7f9fec0afd60 2023-07-09T02:17:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.024+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec0b3bb0 con 0x7f9fec0afd60 2023-07-09T02:17:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.028+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/2029515092 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fe00039a0 con 0x7f9fec0afd60 2023-07-09T02:17:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.028+0000 7f9fe8ff9640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9fd80662b0 0x7f9fd8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.028+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/2029515092 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f9fe00833e0 con 0x7f9fec0afd60 2023-07-09T02:17:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.028+0000 7f9febfff640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9fd80662b0 0x7f9fd8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.028+0000 7f9febfff640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9fd80662b0 0x7f9fd8068760 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0af000 tx=0x7f9fdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.032+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/2029515092 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9fe0050a20 con 0x7f9fec0afd60 2023-07-09T02:17:45.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.184+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9fec0b3bb0 con 0x7f9fec0afd60 2023-07-09T02:17:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.840+0000 7f9fe8ff9640 1 -- 172.21.15.45:0/2029515092 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9fec0b3bb0 con 0x7f9fec0afd60 2023-07-09T02:17:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:17:45.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.848+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9fd80662b0 msgr2=0x7f9fd8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:45.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.848+0000 7f9ff2311640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9fd80662b0 0x7f9fd8068760 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0af000 tx=0x7f9fdc008040 comp rx=0 tx=0).stop 2023-07-09T02:17:45.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.848+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0afd60 msgr2=0x7f9fec14a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:45.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.848+0000 7f9ff2311640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0afd60 0x7f9fec14a170 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000c460 tx=0x7f9fe000c920 comp rx=0 tx=0).stop 2023-07-09T02:17:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.848+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 shutdown_connections 2023-07-09T02:17:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.848+0000 7f9ff2311640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9fd80662b0 0x7f9fd8068760 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.852+0000 7f9ff2311640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fec0b23b0 0x7f9fec0b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.852+0000 7f9ff2311640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9fec0afd60 0x7f9fec14a170 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.852+0000 7f9ff2311640 1 --2- 172.21.15.45:0/2029515092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fec0af990 0x7f9fec155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.852+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 >> 172.21.15.45:0/2029515092 conn(0x7f9fec0999f0 msgr2=0x7f9fec0add90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:45.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.852+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 shutdown_connections 2023-07-09T02:17:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:45.852+0000 7f9ff2311640 1 -- 172.21.15.45:0/2029515092 wait complete. 2023-07-09T02:17:45.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:17:46.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.024+0000 7fcc8826d640 1 Processor -- start 2023-07-09T02:17:46.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.024+0000 7fcc8826d640 1 -- start start 2023-07-09T02:17:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.024+0000 7fcc8826d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8015c060 0x7fcc800b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:46.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.024+0000 7fcc8826d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc800cd120 0x7fcc800d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:46.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.024+0000 7fcc8826d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc80160a50 con 0x7fcc800d2450 2023-07-09T02:17:46.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.024+0000 7fcc8826d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800d28f0 con 0x7fcc800cd120 2023-07-09T02:17:46.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.024+0000 7fcc8826d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800cfe40 con 0x7fcc8015c060 2023-07-09T02:17:46.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc86009640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8015c060 0x7fcc800b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:46.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc85808640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc800cd120 0x7fcc800d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:46.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc86009640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8015c060 0x7fcc800b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:37706/0 (socket says 172.21.15.45:37706) 2023-07-09T02:17:46.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc86009640 1 -- 172.21.15.45:0/422777209 learned_addr learned my addr 172.21.15.45:0/422777209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:46.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc86009640 1 -- 172.21.15.45:0/422777209 >> v2:172.21.15.155:3300/0 conn(0x7fcc800cd120 msgr2=0x7fcc800d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:46.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc86009640 1 --2- 172.21.15.45:0/422777209 >> v2:172.21.15.155:3300/0 conn(0x7fcc800cd120 0x7fcc800d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:46.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc86009640 1 -- 172.21.15.45:0/422777209 >> v1:172.21.15.155:6789/0 conn(0x7fcc800d2450 legacy=0x7fcc800d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:46.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc86009640 1 -- 172.21.15.45:0/422777209 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8015c430 con 0x7fcc8015c060 2023-07-09T02:17:46.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.028+0000 7fcc86009640 1 --2- 172.21.15.45:0/422777209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8015c060 0x7fcc800b4ed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009870 tx=0x7fcc7c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a125b81d6220c1de server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:46.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc85007640 1 -- 172.21.15.45:0/422777209 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0a7070 con 0x7fcc8015c060 2023-07-09T02:17:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc85007640 1 -- 172.21.15.45:0/422777209 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0ab430 con 0x7fcc8015c060 2023-07-09T02:17:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc85007640 1 -- 172.21.15.45:0/422777209 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0ab7c0 con 0x7fcc8015c060 2023-07-09T02:17:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- 172.21.15.45:0/422777209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8015c060 msgr2=0x7fcc800b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 --2- 172.21.15.45:0/422777209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8015c060 0x7fcc800b4ed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009870 tx=0x7fcc7c01c510 comp rx=0 tx=0).stop 2023-07-09T02:17:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- 172.21.15.45:0/422777209 shutdown_connections 2023-07-09T02:17:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 --2- 172.21.15.45:0/422777209 >> v2:172.21.15.155:3300/0 conn(0x7fcc800cd120 0x7fcc800d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 --2- 172.21.15.45:0/422777209 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8015c060 0x7fcc800b4ed0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- 172.21.15.45:0/422777209 >> 172.21.15.45:0/422777209 conn(0x7fcc800698e0 msgr2=0x7fcc80069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- 172.21.15.45:0/422777209 shutdown_connections 2023-07-09T02:17:46.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- 172.21.15.45:0/422777209 wait complete. 2023-07-09T02:17:46.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 Processor -- start 2023-07-09T02:17:46.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- start start 2023-07-09T02:17:46.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd120 0x7fcc801536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:46.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc800d2450 0x7fcc800b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:46.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc8015c060 0x7fcc800b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:46.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801548b0 con 0x7fcc8015c060 2023-07-09T02:17:46.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80155110 con 0x7fcc800d2450 2023-07-09T02:17:46.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8826d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800ca7b0 con 0x7fcc800cd120 2023-07-09T02:17:46.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8680a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc8015c060 0x7fcc800b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:46.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc86009640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd120 0x7fcc801536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:46.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc85808640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc800d2450 0x7fcc800b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:46.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8680a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc8015c060 0x7fcc800b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40736/0 (socket says 172.21.15.45:40736) 2023-07-09T02:17:46.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.032+0000 7fcc8680a640 1 -- 172.21.15.45:0/3676387344 learned_addr learned my addr 172.21.15.45:0/3676387344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8680a640 1 -- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd120 msgr2=0x7fcc801536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8680a640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd120 0x7fcc801536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8680a640 1 -- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc800d2450 msgr2=0x7fcc800b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8680a640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc800d2450 0x7fcc800b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8680a640 1 -- 172.21.15.45:0/3676387344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c0094d0 con 0x7fcc8015c060 2023-07-09T02:17:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8680a640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc8015c060 0x7fcc800b5fc0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c770 tx=0x7fcc7800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:46.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3676387344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78003b80 con 0x7fcc8015c060 2023-07-09T02:17:46.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3676387344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc78003ce0 con 0x7fcc8015c060 2023-07-09T02:17:46.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3676387344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800aa90 con 0x7fcc8015c060 2023-07-09T02:17:46.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc80154ac0 con 0x7fcc8015c060 2023-07-09T02:17:46.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc80153bf0 con 0x7fcc8015c060 2023-07-09T02:17:46.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.036+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc801552a0 con 0x7fcc8015c060 2023-07-09T02:17:46.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.040+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3676387344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc7800abf0 con 0x7fcc8015c060 2023-07-09T02:17:46.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.040+0000 7fcc76ffd640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc64066280 0x7fcc64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:46.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.040+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3676387344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fcc78084500 con 0x7fcc8015c060 2023-07-09T02:17:46.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.040+0000 7fcc86009640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc64066280 0x7fcc64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:46.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.040+0000 7fcc86009640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc64066280 0x7fcc64068730 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0af000 tx=0x7fcc7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:46.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.044+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3676387344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc78051a70 con 0x7fcc8015c060 2023-07-09T02:17:46.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.228+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcc8004d7d0 con 0x7fcc8015c060 2023-07-09T02:17:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.868+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3676387344 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v63) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcc78055090 con 0x7fcc8015c060 2023-07-09T02:17:46.869 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 17 and data pool 18 2023-07-09T02:17:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc64066280 msgr2=0x7fcc64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc64066280 0x7fcc64068730 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0af000 tx=0x7fcc7c008040 comp rx=0 tx=0).stop 2023-07-09T02:17:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc8015c060 msgr2=0x7fcc800b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:46.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc8015c060 0x7fcc800b5fc0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c770 tx=0x7fcc7800cc30 comp rx=0 tx=0).stop 2023-07-09T02:17:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 shutdown_connections 2023-07-09T02:17:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc8015c060 0x7fcc800b5fc0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc800d2450 0x7fcc800b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc64066280 0x7fcc64068730 secure :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0af000 tx=0x7fcc7c008040 comp rx=0 tx=0).stop 2023-07-09T02:17:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 --2- 172.21.15.45:0/3676387344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd120 0x7fcc801536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:46.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 >> 172.21.15.45:0/3676387344 conn(0x7fcc800698e0 msgr2=0x7fcc800d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:46.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 shutdown_connections 2023-07-09T02:17:46.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:46.876+0000 7fcc8826d640 1 -- 172.21.15.45:0/3676387344 wait complete. 2023-07-09T02:17:46.906 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:47.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.048+0000 7fe73e007640 1 Processor -- start 2023-07-09T02:17:47.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.048+0000 7fe73e007640 1 -- start start 2023-07-09T02:17:47.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe73e007640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe7380cd290 0x7fe7380cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe73e007640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe73806a5c0 0x7fe7380b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe73e007640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe738071140 con 0x7fe73806aa40 2023-07-09T02:17:47.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe73e007640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73806b010 con 0x7fe73806a5c0 2023-07-09T02:17:47.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe73e007640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7380cdba0 con 0x7fe7380cd290 2023-07-09T02:17:47.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe736ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe73806a5c0 0x7fe7380b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe736ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe73806a5c0 0x7fe7380b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40750/0 (socket says 172.21.15.45:40750) 2023-07-09T02:17:47.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe736ffd640 1 -- 172.21.15.45:0/640591384 learned_addr learned my addr 172.21.15.45:0/640591384 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:47.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe7377fe640 1 --2- 172.21.15.45:0/640591384 >> v2:172.21.15.155:3300/0 conn(0x7fe7380cd290 0x7fe7380cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe736ffd640 1 -- 172.21.15.45:0/640591384 >> v2:172.21.15.155:3300/0 conn(0x7fe7380cd290 msgr2=0x7fe7380cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe736ffd640 1 --2- 172.21.15.45:0/640591384 >> v2:172.21.15.155:3300/0 conn(0x7fe7380cd290 0x7fe7380cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe736ffd640 1 -- 172.21.15.45:0/640591384 >> v1:172.21.15.155:6789/0 conn(0x7fe73806aa40 legacy=0x7fe7380b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.052+0000 7fe736ffd640 1 -- 172.21.15.45:0/640591384 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73815c970 con 0x7fe73806a5c0 2023-07-09T02:17:47.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe736ffd640 1 --2- 172.21.15.45:0/640591384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806a5c0 0x7fe7380b2340 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe738070f40 tx=0x7fe72c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edff488fedf06fe3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe7367fc640 1 -- 172.21.15.45:0/640591384 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0ab600 con 0x7fe73806a5c0 2023-07-09T02:17:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe7367fc640 1 -- 172.21.15.45:0/640591384 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0a7050 con 0x7fe73806a5c0 2023-07-09T02:17:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe7367fc640 1 -- 172.21.15.45:0/640591384 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0ab980 con 0x7fe73806a5c0 2023-07-09T02:17:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 -- 172.21.15.45:0/640591384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806a5c0 msgr2=0x7fe7380b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 --2- 172.21.15.45:0/640591384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806a5c0 0x7fe7380b2340 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe738070f40 tx=0x7fe72c01c470 comp rx=0 tx=0).stop 2023-07-09T02:17:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 -- 172.21.15.45:0/640591384 shutdown_connections 2023-07-09T02:17:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 --2- 172.21.15.45:0/640591384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806a5c0 0x7fe7380b2340 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 --2- 172.21.15.45:0/640591384 >> v2:172.21.15.155:3300/0 conn(0x7fe7380cd290 0x7fe7380cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 -- 172.21.15.45:0/640591384 >> 172.21.15.45:0/640591384 conn(0x7fe73806d140 msgr2=0x7fe73806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 -- 172.21.15.45:0/640591384 shutdown_connections 2023-07-09T02:17:47.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 -- 172.21.15.45:0/640591384 wait complete. 2023-07-09T02:17:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 Processor -- start 2023-07-09T02:17:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.056+0000 7fe73e007640 1 -- start start 2023-07-09T02:17:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe73806a5c0 0x7fe7381f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806aa40 0x7fe7380b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7380cd290 0x7fe73814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7381f9550 con 0x7fe73806aa40 2023-07-09T02:17:47.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7381f85c0 con 0x7fe73806a5c0 2023-07-09T02:17:47.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380b6610 con 0x7fe7380cd290 2023-07-09T02:17:47.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806aa40 0x7fe7380b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806aa40 0x7fe7380b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40762/0 (socket says 172.21.15.45:40762) 2023-07-09T02:17:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 -- 172.21.15.45:0/4235287648 learned_addr learned my addr 172.21.15.45:0/4235287648 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe7377fe640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe73806a5c0 0x7fe7381f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe737fff640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7380cd290 0x7fe73814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 -- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7380cd290 msgr2=0x7fe73814d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7380cd290 0x7fe73814d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 -- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe73806a5c0 msgr2=0x7fe7381f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe73806a5c0 0x7fe7381f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 -- 172.21.15.45:0/4235287648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c0094d0 con 0x7fe73806aa40 2023-07-09T02:17:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe736ffd640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806aa40 0x7fe7380b36f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe72c019080 tx=0x7fe72c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe71ffff640 1 -- 172.21.15.45:0/4235287648 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0b37d0 con 0x7fe73806aa40 2023-07-09T02:17:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe71ffff640 1 -- 172.21.15.45:0/4235287648 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0b3930 con 0x7fe73806aa40 2023-07-09T02:17:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe71ffff640 1 -- 172.21.15.45:0/4235287648 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0b3ca0 con 0x7fe73806aa40 2023-07-09T02:17:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7380b3c30 con 0x7fe73806aa40 2023-07-09T02:17:47.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7380b41e0 con 0x7fe73806aa40 2023-07-09T02:17:47.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.060+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73804d7d0 con 0x7fe73806aa40 2023-07-09T02:17:47.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.064+0000 7fe71ffff640 1 -- 172.21.15.45:0/4235287648 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe72c0b2070 con 0x7fe73806aa40 2023-07-09T02:17:47.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.064+0000 7fe71ffff640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe724066280 0x7fe724068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.064+0000 7fe71ffff640 1 -- 172.21.15.45:0/4235287648 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe72c11dfd0 con 0x7fe73806aa40 2023-07-09T02:17:47.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.064+0000 7fe7377fe640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe724066280 0x7fe724068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.064+0000 7fe7377fe640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe724066280 0x7fe724068730 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe7381586c0 tx=0x7fe728008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.068+0000 7fe71ffff640 1 -- 172.21.15.45:0/4235287648 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe72c0eb440 con 0x7fe73806aa40 2023-07-09T02:17:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.220+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe73806f3a0 con 0x7fe73806aa40 2023-07-09T02:17:47.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe71ffff640 1 -- 172.21.15.45:0/4235287648 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+18376 (secure 0 0 0) 0x7fe72c0b0020 con 0x7fe73806aa40 2023-07-09T02:17:47.225 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:47.225 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":137,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:46.233475+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:44.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:45.234988+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:47.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe724066280 msgr2=0x7fe724068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe724066280 0x7fe724068730 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe7381586c0 tx=0x7fe728008040 comp rx=0 tx=0).stop 2023-07-09T02:17:47.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806aa40 msgr2=0x7fe7380b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806aa40 0x7fe7380b36f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe72c019080 tx=0x7fe72c019210 comp rx=0 tx=0).stop 2023-07-09T02:17:47.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 shutdown_connections 2023-07-09T02:17:47.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe724066280 0x7fe724068730 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe7380cd290 0x7fe73814d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe73806aa40 0x7fe7380b36f0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 --2- 172.21.15.45:0/4235287648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe73806a5c0 0x7fe7381f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 >> 172.21.15.45:0/4235287648 conn(0x7fe73806d140 msgr2=0x7fe73815d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:47.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 shutdown_connections 2023-07-09T02:17:47.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.224+0000 7fe73e007640 1 -- 172.21.15.45:0/4235287648 wait complete. 2023-07-09T02:17:47.247 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:47.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.388+0000 7f6a978ec640 1 Processor -- start 2023-07-09T02:17:47.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.388+0000 7f6a978ec640 1 -- start start 2023-07-09T02:17:47.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.388+0000 7f6a978ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a900d2620 0x7f6a900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.388+0000 7f6a978ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6a900cd120 0x7f6a900cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.388+0000 7f6a978ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a90160a50 con 0x7f6a9015c060 2023-07-09T02:17:47.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.388+0000 7f6a978ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9015c430 con 0x7f6a900d2620 2023-07-09T02:17:47.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.388+0000 7f6a978ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9015fb60 con 0x7f6a900cd120 2023-07-09T02:17:47.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.388+0000 7f6a94e87640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a900d2620 0x7f6a900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a94e87640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a900d2620 0x7f6a900b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40764/0 (socket says 172.21.15.45:40764) 2023-07-09T02:17:47.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a94e87640 1 -- 172.21.15.45:0/2231557170 learned_addr learned my addr 172.21.15.45:0/2231557170 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:47.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a95e89640 1 --2- 172.21.15.45:0/2231557170 >> v2:172.21.15.155:3300/0 conn(0x7f6a900cd120 0x7f6a900cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a94e87640 1 -- 172.21.15.45:0/2231557170 >> v2:172.21.15.155:3300/0 conn(0x7f6a900cd120 msgr2=0x7f6a900cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:47.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a94e87640 1 --2- 172.21.15.45:0/2231557170 >> v2:172.21.15.155:3300/0 conn(0x7f6a900cd120 0x7f6a900cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a94e87640 1 -- 172.21.15.45:0/2231557170 >> v1:172.21.15.155:6789/0 conn(0x7f6a9015c060 legacy=0x7f6a900d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a94e87640 1 -- 172.21.15.45:0/2231557170 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9015fe40 con 0x7f6a900d2620 2023-07-09T02:17:47.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a94e87640 1 --2- 172.21.15.45:0/2231557170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a900b4ed0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f6a9006b120 tx=0x7f6a8001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ae6582aa5ed0a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a87fff640 1 -- 172.21.15.45:0/2231557170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800aa430 con 0x7f6a900d2620 2023-07-09T02:17:47.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a87fff640 1 -- 172.21.15.45:0/2231557170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a800aa590 con 0x7f6a900d2620 2023-07-09T02:17:47.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.392+0000 7f6a87fff640 1 -- 172.21.15.45:0/2231557170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800aa920 con 0x7f6a900d2620 2023-07-09T02:17:47.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- 172.21.15.45:0/2231557170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 msgr2=0x7f6a900b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 --2- 172.21.15.45:0/2231557170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a900b4ed0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f6a9006b120 tx=0x7f6a8001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- 172.21.15.45:0/2231557170 shutdown_connections 2023-07-09T02:17:47.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 --2- 172.21.15.45:0/2231557170 >> v2:172.21.15.155:3300/0 conn(0x7f6a900cd120 0x7f6a900cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 --2- 172.21.15.45:0/2231557170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a900b4ed0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- 172.21.15.45:0/2231557170 >> 172.21.15.45:0/2231557170 conn(0x7f6a900698e0 msgr2=0x7f6a90069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:47.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- 172.21.15.45:0/2231557170 shutdown_connections 2023-07-09T02:17:47.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- 172.21.15.45:0/2231557170 wait complete. 2023-07-09T02:17:47.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 Processor -- start 2023-07-09T02:17:47.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- start start 2023-07-09T02:17:47.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a900cd120 0x7f6a9015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a90143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9015c060 0x7f6a9015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015a1f0 con 0x7f6a900d2620 2023-07-09T02:17:47.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015e070 con 0x7f6a9015c060 2023-07-09T02:17:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a978ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015dd90 con 0x7f6a900cd120 2023-07-09T02:17:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a94e87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a90143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a94e87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a90143bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40774/0 (socket says 172.21.15.45:40774) 2023-07-09T02:17:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a94e87640 1 -- 172.21.15.45:0/3991845285 learned_addr learned my addr 172.21.15.45:0/3991845285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a95e89640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9015c060 0x7f6a9015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a95688640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a900cd120 0x7f6a9015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a94e87640 1 -- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a900cd120 msgr2=0x7f6a9015ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a94e87640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a900cd120 0x7f6a9015ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a94e87640 1 -- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9015c060 msgr2=0x7f6a9015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a94e87640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9015c060 0x7f6a9015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.396+0000 7f6a94e87640 1 -- 172.21.15.45:0/3991845285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800094d0 con 0x7f6a900d2620 2023-07-09T02:17:47.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a94e87640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a90143bb0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f6a800190e0 tx=0x7f6a8001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a85ffb640 1 -- 172.21.15.45:0/3991845285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800aa430 con 0x7f6a900d2620 2023-07-09T02:17:47.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a85ffb640 1 -- 172.21.15.45:0/3991845285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a800b3820 con 0x7f6a900d2620 2023-07-09T02:17:47.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a85ffb640 1 -- 172.21.15.45:0/3991845285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800b3bd0 con 0x7f6a900d2620 2023-07-09T02:17:47.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a900b59f0 con 0x7f6a900d2620 2023-07-09T02:17:47.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9015a770 con 0x7f6a900d2620 2023-07-09T02:17:47.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9004d7d0 con 0x7f6a900d2620 2023-07-09T02:17:47.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a85ffb640 1 -- 172.21.15.45:0/3991845285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a800b3d30 con 0x7f6a900d2620 2023-07-09T02:17:47.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a85ffb640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a74066280 0x7f6a74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.400+0000 7f6a85ffb640 1 -- 172.21.15.45:0/3991845285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a8011df80 con 0x7f6a900d2620 2023-07-09T02:17:47.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.404+0000 7f6a95688640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a74066280 0x7f6a74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.404+0000 7f6a95688640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a74066280 0x7f6a74068730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007fd0 tx=0x7f6a8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.404+0000 7f6a85ffb640 1 -- 172.21.15.45:0/3991845285 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a800eb300 con 0x7f6a900d2620 2023-07-09T02:17:47.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.564+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a9006baa0 con 0x7f6a900d2620 2023-07-09T02:17:47.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.564+0000 7f6a85ffb640 1 -- 172.21.15.45:0/3991845285 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f6a800c3090 con 0x7f6a900d2620 2023-07-09T02:17:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:47.566 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":137,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:46.233475+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:44.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:45.234988+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:47.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a74066280 msgr2=0x7f6a74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a74066280 0x7f6a74068730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007fd0 tx=0x7f6a8c009040 comp rx=0 tx=0).stop 2023-07-09T02:17:47.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 msgr2=0x7f6a90143bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a90143bb0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f6a800190e0 tx=0x7f6a8001ad10 comp rx=0 tx=0).stop 2023-07-09T02:17:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 shutdown_connections 2023-07-09T02:17:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a9015c060 0x7f6a9015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a900d2620 0x7f6a90143bb0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6a74066280 0x7f6a74068730 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 --2- 172.21.15.45:0/3991845285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a900cd120 0x7f6a9015ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 >> 172.21.15.45:0/3991845285 conn(0x7f6a900698e0 msgr2=0x7f6a9015b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:47.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 shutdown_connections 2023-07-09T02:17:47.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.568+0000 7f6a978ec640 1 -- 172.21.15.45:0/3991845285 wait complete. 2023-07-09T02:17:47.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:17:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cba8ec640 1 Processor -- start 2023-07-09T02:17:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cba8ec640 1 -- start start 2023-07-09T02:17:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cba8ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2cb40d2620 0x7f2cb40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cba8ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40cd120 0x7f2cb40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cba8ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb4160a50 con 0x7f2cb415c060 2023-07-09T02:17:47.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cba8ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb415c430 con 0x7f2cb40d2620 2023-07-09T02:17:47.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cba8ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb415fb60 con 0x7f2cb40cd120 2023-07-09T02:17:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cb37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2cb40d2620 0x7f2cb40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cb8e89640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40cd120 0x7f2cb40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cb37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2cb40d2620 0x7f2cb40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:52774/0 (socket says 172.21.15.45:52774) 2023-07-09T02:17:47.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cb37fe640 1 -- 172.21.15.45:0/270396258 learned_addr learned my addr 172.21.15.45:0/270396258 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cb37fe640 1 -- 172.21.15.45:0/270396258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40cd120 msgr2=0x7f2cb40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cb37fe640 1 --2- 172.21.15.45:0/270396258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40cd120 0x7f2cb40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cb37fe640 1 -- 172.21.15.45:0/270396258 >> v1:172.21.15.155:6789/0 conn(0x7f2cb415c060 legacy=0x7f2cb40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.732+0000 7f2cb37fe640 1 -- 172.21.15.45:0/270396258 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb415fe40 con 0x7f2cb40d2620 2023-07-09T02:17:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cb37fe640 1 --2- 172.21.15.45:0/270396258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb40d2620 0x7f2cb40b4ed0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009870 tx=0x7f2ca801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae88bef56d4193af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cb2ffd640 1 -- 172.21.15.45:0/270396258 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80aa670 con 0x7f2cb40d2620 2023-07-09T02:17:47.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cb2ffd640 1 -- 172.21.15.45:0/270396258 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca80aa7d0 con 0x7f2cb40d2620 2023-07-09T02:17:47.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cb2ffd640 1 -- 172.21.15.45:0/270396258 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80aab60 con 0x7f2cb40d2620 2023-07-09T02:17:47.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cba8ec640 1 -- 172.21.15.45:0/270396258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb40d2620 msgr2=0x7f2cb40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/270396258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb40d2620 0x7f2cb40b4ed0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009870 tx=0x7f2ca801c510 comp rx=0 tx=0).stop 2023-07-09T02:17:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cba8ec640 1 -- 172.21.15.45:0/270396258 shutdown_connections 2023-07-09T02:17:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/270396258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40cd120 0x7f2cb40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/270396258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb40d2620 0x7f2cb40b4ed0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cba8ec640 1 -- 172.21.15.45:0/270396258 >> 172.21.15.45:0/270396258 conn(0x7f2cb40698e0 msgr2=0x7f2cb4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cba8ec640 1 -- 172.21.15.45:0/270396258 shutdown_connections 2023-07-09T02:17:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.736+0000 7f2cba8ec640 1 -- 172.21.15.45:0/270396258 wait complete. 2023-07-09T02:17:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 Processor -- start 2023-07-09T02:17:47.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 -- start start 2023-07-09T02:17:47.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb40cd120 0x7f2cb414fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40d2620 0x7f2cb415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb415c060 0x7f2cb415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4159180 con 0x7f2cb40cd120 2023-07-09T02:17:47.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4159d00 con 0x7f2cb415c060 2023-07-09T02:17:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4159360 con 0x7f2cb40d2620 2023-07-09T02:17:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb40cd120 0x7f2cb414fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb40cd120 0x7f2cb414fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40784/0 (socket says 172.21.15.45:40784) 2023-07-09T02:17:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 -- 172.21.15.45:0/2866381263 learned_addr learned my addr 172.21.15.45:0/2866381263 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb8e89640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb415c060 0x7f2cb415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb37fe640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40d2620 0x7f2cb415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 -- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40d2620 msgr2=0x7f2cb415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40d2620 0x7f2cb415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 -- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb415c060 msgr2=0x7f2cb415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb415c060 0x7f2cb415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 -- 172.21.15.45:0/2866381263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80094d0 con 0x7f2cb40cd120 2023-07-09T02:17:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb3fff640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb40cd120 0x7f2cb414fc00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c500 tx=0x7f2ca400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb0ff9640 1 -- 172.21.15.45:0/2866381263 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4005220 con 0x7f2cb40cd120 2023-07-09T02:17:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb0ff9640 1 -- 172.21.15.45:0/2866381263 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4005380 con 0x7f2cb40cd120 2023-07-09T02:17:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cb0ff9640 1 -- 172.21.15.45:0/2866381263 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4007270 con 0x7f2cb40cd120 2023-07-09T02:17:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40b59f0 con 0x7f2cb40cd120 2023-07-09T02:17:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.740+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb4159920 con 0x7f2cb40cd120 2023-07-09T02:17:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.744+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb404d7d0 con 0x7f2cb40cd120 2023-07-09T02:17:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.744+0000 7f2cb0ff9640 1 -- 172.21.15.45:0/2866381263 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ca40073d0 con 0x7f2cb40cd120 2023-07-09T02:17:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.744+0000 7f2cb0ff9640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ca0066280 0x7f2ca0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.744+0000 7f2cb0ff9640 1 -- 172.21.15.45:0/2866381263 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ca4083560 con 0x7f2cb40cd120 2023-07-09T02:17:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.744+0000 7f2cb37fe640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ca0066280 0x7f2ca0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.744+0000 7f2cb37fe640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ca0066280 0x7f2ca0068730 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ae000 tx=0x7f2ca80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:47.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.748+0000 7f2cb0ff9640 1 -- 172.21.15.45:0/2866381263 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ca4050a00 con 0x7f2cb40cd120 2023-07-09T02:17:47.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:47.940+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2cb406baa0 con 0x7f2cb40cd120 2023-07-09T02:17:48.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.896+0000 7f2cb0ff9640 1 -- 172.21.15.45:0/2866381263 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2ca4054020 con 0x7f2cb40cd120 2023-07-09T02:17:48.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ca0066280 msgr2=0x7f2ca0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:48.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ca0066280 0x7f2ca0068730 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ae000 tx=0x7f2ca80b5040 comp rx=0 tx=0).stop 2023-07-09T02:17:48.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb40cd120 msgr2=0x7f2cb414fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:48.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb40cd120 0x7f2cb414fc00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c500 tx=0x7f2ca400c9c0 comp rx=0 tx=0).stop 2023-07-09T02:17:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 shutdown_connections 2023-07-09T02:17:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cb415c060 0x7f2cb415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2ca0066280 0x7f2ca0068730 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cb40d2620 0x7f2cb415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 --2- 172.21.15.45:0/2866381263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb40cd120 0x7f2cb414fc00 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 >> 172.21.15.45:0/2866381263 conn(0x7f2cb40698e0 msgr2=0x7f2cb40c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 shutdown_connections 2023-07-09T02:17:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:48.900+0000 7f2cba8ec640 1 -- 172.21.15.45:0/2866381263 wait complete. 2023-07-09T02:17:48.923 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:17:48.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:17:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b3d91e640 1 Processor -- start 2023-07-09T02:17:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b3d91e640 1 -- start start 2023-07-09T02:17:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b3d91e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380d2620 0x7f7b380b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b3d91e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b380cd120 0x7f7b380cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b3d91e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b38160a50 con 0x7f7b3815c060 2023-07-09T02:17:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b3d91e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3815c430 con 0x7f7b380cd120 2023-07-09T02:17:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b3d91e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3815fb60 con 0x7f7b380d2620 2023-07-09T02:17:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b377fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b380cd120 0x7f7b380cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b377fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b380cd120 0x7f7b380cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40792/0 (socket says 172.21.15.45:40792) 2023-07-09T02:17:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b377fe640 1 -- 172.21.15.45:0/660442808 learned_addr learned my addr 172.21.15.45:0/660442808 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b2ffff640 1 --2- 172.21.15.45:0/660442808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380d2620 0x7f7b380b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b377fe640 1 -- 172.21.15.45:0/660442808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380d2620 msgr2=0x7f7b380b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b377fe640 1 --2- 172.21.15.45:0/660442808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380d2620 0x7f7b380b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b377fe640 1 -- 172.21.15.45:0/660442808 >> v1:172.21.15.155:6789/0 conn(0x7f7b3815c060 legacy=0x7f7b380d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b377fe640 1 -- 172.21.15.45:0/660442808 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3815fe40 con 0x7f7b380cd120 2023-07-09T02:17:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.076+0000 7f7b2ffff640 1 --2- 172.21.15.45:0/660442808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380d2620 0x7f7b380b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b377fe640 1 --2- 172.21.15.45:0/660442808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b380cd120 0x7f7b380cee30 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009e50 tx=0x7f7b3001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c041b47f352559 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b367fc640 1 -- 172.21.15.45:0/660442808 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300a5820 con 0x7f7b380cd120 2023-07-09T02:17:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b367fc640 1 -- 172.21.15.45:0/660442808 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300a5980 con 0x7f7b380cd120 2023-07-09T02:17:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b367fc640 1 -- 172.21.15.45:0/660442808 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300a5d10 con 0x7f7b380cd120 2023-07-09T02:17:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b3d91e640 1 -- 172.21.15.45:0/660442808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b380cd120 msgr2=0x7f7b380cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/660442808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b380cd120 0x7f7b380cee30 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009e50 tx=0x7f7b3001c9a0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b3d91e640 1 -- 172.21.15.45:0/660442808 shutdown_connections 2023-07-09T02:17:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/660442808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b380cd120 0x7f7b380cee30 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/660442808 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380d2620 0x7f7b380b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b3d91e640 1 -- 172.21.15.45:0/660442808 >> 172.21.15.45:0/660442808 conn(0x7f7b380698e0 msgr2=0x7f7b38069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b3d91e640 1 -- 172.21.15.45:0/660442808 shutdown_connections 2023-07-09T02:17:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.080+0000 7f7b3d91e640 1 -- 172.21.15.45:0/660442808 wait complete. 2023-07-09T02:17:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 Processor -- start 2023-07-09T02:17:49.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 -- start start 2023-07-09T02:17:49.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380cd120 0x7f7b381f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:49.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b380d2620 0x7f7b381f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b3815c060 0x7f7b3815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b381f7790 con 0x7f7b3815c060 2023-07-09T02:17:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3815e0c0 con 0x7f7b380d2620 2023-07-09T02:17:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3815e3a0 con 0x7f7b380cd120 2023-07-09T02:17:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b3815c060 0x7f7b3815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b3815c060 0x7f7b3815d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40808/0 (socket says 172.21.15.45:40808) 2023-07-09T02:17:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 -- 172.21.15.45:0/2473381387 learned_addr learned my addr 172.21.15.45:0/2473381387 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b36ffd640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380cd120 0x7f7b381f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b2ffff640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b380d2620 0x7f7b381f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 -- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380cd120 msgr2=0x7f7b381f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380cd120 0x7f7b381f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 -- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b380d2620 msgr2=0x7f7b381f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b380d2620 0x7f7b381f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 -- 172.21.15.45:0/2473381387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30009b30 con 0x7f7b3815c060 2023-07-09T02:17:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b377fe640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b3815c060 0x7f7b3815d890 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f7b300af040 tx=0x7f7b30019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b34ff9640 1 -- 172.21.15.45:0/2473381387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300b8670 con 0x7f7b3815c060 2023-07-09T02:17:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b34ff9640 1 -- 172.21.15.45:0/2473381387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300b87f0 con 0x7f7b3815c060 2023-07-09T02:17:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b34ff9640 1 -- 172.21.15.45:0/2473381387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300b8ba0 con 0x7f7b3815c060 2023-07-09T02:17:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b380b59f0 con 0x7f7b3815c060 2023-07-09T02:17:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.084+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3815e960 con 0x7f7b3815c060 2023-07-09T02:17:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.088+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b38158d30 con 0x7f7b3815c060 2023-07-09T02:17:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.088+0000 7f7b34ff9640 1 -- 172.21.15.45:0/2473381387 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b300b8d00 con 0x7f7b3815c060 2023-07-09T02:17:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.088+0000 7f7b34ff9640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b18066280 0x7f7b18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.088+0000 7f7b34ff9640 1 -- 172.21.15.45:0/2473381387 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b3011f550 con 0x7f7b3815c060 2023-07-09T02:17:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.088+0000 7f7b36ffd640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b18066280 0x7f7b18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.088+0000 7f7b36ffd640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b18066280 0x7f7b18068730 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800b810 tx=0x7f7b28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.092+0000 7f7b34ff9640 1 -- 172.21.15.45:0/2473381387 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b38158d30 con 0x7f7b3815c060 2023-07-09T02:17:49.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:17:49.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:17:49.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.288+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7b38158d30 con 0x7f7b3815c060 2023-07-09T02:17:49.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b34ff9640 1 -- 172.21.15.45:0/2473381387 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7b38158d30 con 0x7f7b3815c060 2023-07-09T02:17:49.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b18066280 msgr2=0x7f7b18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b18066280 0x7f7b18068730 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800b810 tx=0x7f7b28008040 comp rx=0 tx=0).stop 2023-07-09T02:17:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b3815c060 msgr2=0x7f7b3815d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b3815c060 0x7f7b3815d890 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f7b300af040 tx=0x7f7b30019740 comp rx=0 tx=0).stop 2023-07-09T02:17:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 shutdown_connections 2023-07-09T02:17:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b3815c060 0x7f7b3815d890 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b380d2620 0x7f7b381f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7b18066280 0x7f7b18068730 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 --2- 172.21.15.45:0/2473381387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7b380cd120 0x7f7b381f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 >> 172.21.15.45:0/2473381387 conn(0x7f7b380698e0 msgr2=0x7f7b38069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 shutdown_connections 2023-07-09T02:17:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:49.900+0000 7f7b3d91e640 1 -- 172.21.15.45:0/2473381387 wait complete. 2023-07-09T02:17:49.926 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:17:49.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:50.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.072+0000 7f8e18e56640 1 Processor -- start 2023-07-09T02:17:50.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.072+0000 7f8e18e56640 1 -- start start 2023-07-09T02:17:50.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e18e56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8e140cd120 0x7f8e140b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e18e56640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e14160a50 con 0x7f8e1415c060 2023-07-09T02:17:50.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e18e56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1415c430 con 0x7f8e140d2620 2023-07-09T02:17:50.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e18e56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1415fb60 con 0x7f8e140cd120 2023-07-09T02:17:50.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e1259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8e1415c060 0x7f8e140d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57296/0 (socket says 172.21.15.45:57296) 2023-07-09T02:17:50.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e1259c640 1 -- 172.21.15.45:0/1192422236 learned_addr learned my addr 172.21.15.45:0/1192422236 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:50.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e12d9d640 1 --2- 172.21.15.45:0/1192422236 >> v2:172.21.15.155:3300/0 conn(0x7f8e140cd120 0x7f8e140b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e11d9b640 1 -- 172.21.15.45:0/1192422236 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809544879 0 0) 0x7f8e14160a50 con 0x7f8e1415c060 2023-07-09T02:17:50.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e11d9b640 1 -- 172.21.15.45:0/1192422236 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e00003530 con 0x7f8e1415c060 2023-07-09T02:17:50.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e11d9b640 1 -- 172.21.15.45:0/1192422236 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486720896 0 0) 0x7f8e1415c430 con 0x7f8e140d2620 2023-07-09T02:17:50.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e12d9d640 1 -- 172.21.15.45:0/1192422236 >> v1:172.21.15.155:6789/0 conn(0x7f8e140d2620 legacy=0x7f8e140cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e12d9d640 1 -- 172.21.15.45:0/1192422236 >> v1:172.21.15.45:6789/0 conn(0x7f8e1415c060 legacy=0x7f8e140d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.076+0000 7f8e12d9d640 1 -- 172.21.15.45:0/1192422236 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1415fe40 con 0x7f8e140cd120 2023-07-09T02:17:50.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e12d9d640 1 --2- 172.21.15.45:0/1192422236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e140cd120 0x7f8e140b4ed0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009d90 tx=0x7f8e0c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=532bd8f47ab33016 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e11d9b640 1 -- 172.21.15.45:0/1192422236 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0a59e0 con 0x7f8e140cd120 2023-07-09T02:17:50.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e11d9b640 1 -- 172.21.15.45:0/1192422236 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c0a5b40 con 0x7f8e140cd120 2023-07-09T02:17:50.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e11d9b640 1 -- 172.21.15.45:0/1192422236 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0ad440 con 0x7f8e140cd120 2023-07-09T02:17:50.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 -- 172.21.15.45:0/1192422236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e140cd120 msgr2=0x7f8e140b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 --2- 172.21.15.45:0/1192422236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e140cd120 0x7f8e140b4ed0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009d90 tx=0x7f8e0c01c920 comp rx=0 tx=0).stop 2023-07-09T02:17:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 -- 172.21.15.45:0/1192422236 shutdown_connections 2023-07-09T02:17:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 --2- 172.21.15.45:0/1192422236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e140cd120 0x7f8e140b4ed0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 -- 172.21.15.45:0/1192422236 >> 172.21.15.45:0/1192422236 conn(0x7f8e140698e0 msgr2=0x7f8e14069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 -- 172.21.15.45:0/1192422236 shutdown_connections 2023-07-09T02:17:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 -- 172.21.15.45:0/1192422236 wait complete. 2023-07-09T02:17:50.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 Processor -- start 2023-07-09T02:17:50.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.080+0000 7f8e18e56640 1 -- start start 2023-07-09T02:17:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e140cd120 0x7f8e14154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e140d2620 0x7f8e140c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e1415c060 0x7f8e140cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140ca050 con 0x7f8e140cd120 2023-07-09T02:17:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140cae90 con 0x7f8e1415c060 2023-07-09T02:17:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e14154970 con 0x7f8e140d2620 2023-07-09T02:17:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e140cd120 0x7f8e14154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e12d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e1415c060 0x7f8e140cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e140cd120 0x7f8e14154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40824/0 (socket says 172.21.15.45:40824) 2023-07-09T02:17:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 -- 172.21.15.45:0/626356591 learned_addr learned my addr 172.21.15.45:0/626356591 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e0bfff640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e140d2620 0x7f8e140c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 -- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e140d2620 msgr2=0x7f8e140c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e140d2620 0x7f8e140c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 -- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e1415c060 msgr2=0x7f8e140cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e1415c060 0x7f8e140cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 -- 172.21.15.45:0/626356591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c009a70 con 0x7f8e140cd120 2023-07-09T02:17:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e1259c640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e140cd120 0x7f8e14154150 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400c3c0 tx=0x7f8e0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e0affd640 1 -- 172.21.15.45:0/626356591 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04005cf0 con 0x7f8e140cd120 2023-07-09T02:17:50.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e0affd640 1 -- 172.21.15.45:0/626356591 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04005e50 con 0x7f8e140cd120 2023-07-09T02:17:50.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e140b59f0 con 0x7f8e140cd120 2023-07-09T02:17:50.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e0affd640 1 -- 172.21.15.45:0/626356591 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040072f0 con 0x7f8e140cd120 2023-07-09T02:17:50.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e140ca560 con 0x7f8e140cd120 2023-07-09T02:17:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1404d7d0 con 0x7f8e140cd120 2023-07-09T02:17:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.084+0000 7f8e0affd640 1 -- 172.21.15.45:0/626356591 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e04007450 con 0x7f8e140cd120 2023-07-09T02:17:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.088+0000 7f8e0affd640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8df4066280 0x7f8df4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.088+0000 7f8e0affd640 1 -- 172.21.15.45:0/626356591 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e04083310 con 0x7f8e140cd120 2023-07-09T02:17:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.088+0000 7f8e0bfff640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8df4066280 0x7f8df4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.088+0000 7f8e0bfff640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8df4066280 0x7f8df4068730 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8e140b8bb0 tx=0x7f8dfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.092+0000 7f8e0affd640 1 -- 172.21.15.45:0/626356591 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e040507a0 con 0x7f8e140cd120 2023-07-09T02:17:50.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e1406baa0 con 0x7f8e140cd120 2023-07-09T02:17:50.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e0affd640 1 -- 172.21.15.45:0/626356591 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f8e04053dc0 con 0x7f8e140cd120 2023-07-09T02:17:50.285 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:50.285 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:17:50.285 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:17:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8df4066280 msgr2=0x7f8df4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8df4066280 0x7f8df4068730 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8e140b8bb0 tx=0x7f8dfc009040 comp rx=0 tx=0).stop 2023-07-09T02:17:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e140cd120 msgr2=0x7f8e14154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e140cd120 0x7f8e14154150 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400c3c0 tx=0x7f8e0400c880 comp rx=0 tx=0).stop 2023-07-09T02:17:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 shutdown_connections 2023-07-09T02:17:50.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e1415c060 0x7f8e140cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8df4066280 0x7f8df4068730 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e140d2620 0x7f8e140c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 --2- 172.21.15.45:0/626356591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e140cd120 0x7f8e14154150 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 >> 172.21.15.45:0/626356591 conn(0x7f8e140698e0 msgr2=0x7f8e140b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 shutdown_connections 2023-07-09T02:17:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.284+0000 7f8e18e56640 1 -- 172.21.15.45:0/626356591 wait complete. 2023-07-09T02:17:50.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:17:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f9970d1f640 1 Processor -- start 2023-07-09T02:17:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f9970d1f640 1 -- start start 2023-07-09T02:17:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f9970d1f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c15c060 0x7f996c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f9970d1f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f996c0d2620 0x7f996c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f9970d1f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c160a50 con 0x7f996c0cd120 2023-07-09T02:17:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f9970d1f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996c15c430 con 0x7f996c0d2620 2023-07-09T02:17:50.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f9970d1f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c15fb60 con 0x7f996c15c060 2023-07-09T02:17:50.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f996ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f996c0d2620 0x7f996c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f996ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f996c0d2620 0x7f996c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40836/0 (socket says 172.21.15.45:40836) 2023-07-09T02:17:50.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f996ad9d640 1 -- 172.21.15.45:0/708181925 learned_addr learned my addr 172.21.15.45:0/708181925 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:50.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f996a59c640 1 --2- 172.21.15.45:0/708181925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c15c060 0x7f996c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f996ad9d640 1 -- 172.21.15.45:0/708181925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c15c060 msgr2=0x7f996c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:50.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f996ad9d640 1 --2- 172.21.15.45:0/708181925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c15c060 0x7f996c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f996ad9d640 1 -- 172.21.15.45:0/708181925 >> v1:172.21.15.155:6789/0 conn(0x7f996c0cd120 legacy=0x7f996c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.448+0000 7f996ad9d640 1 -- 172.21.15.45:0/708181925 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c15fe40 con 0x7f996c0d2620 2023-07-09T02:17:50.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f996ad9d640 1 --2- 172.21.15.45:0/708181925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cee30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f9964009e80 tx=0x7f996401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43358e16d531e18a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9969d9b640 1 -- 172.21.15.45:0/708181925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640a5880 con 0x7f996c0d2620 2023-07-09T02:17:50.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9969d9b640 1 -- 172.21.15.45:0/708181925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99640a59e0 con 0x7f996c0d2620 2023-07-09T02:17:50.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9969d9b640 1 -- 172.21.15.45:0/708181925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640a5d70 con 0x7f996c0d2620 2023-07-09T02:17:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9970d1f640 1 -- 172.21.15.45:0/708181925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 msgr2=0x7f996c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9970d1f640 1 --2- 172.21.15.45:0/708181925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cee30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f9964009e80 tx=0x7f996401c9c0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9970d1f640 1 -- 172.21.15.45:0/708181925 shutdown_connections 2023-07-09T02:17:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9970d1f640 1 --2- 172.21.15.45:0/708181925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cee30 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9970d1f640 1 --2- 172.21.15.45:0/708181925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c15c060 0x7f996c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9970d1f640 1 -- 172.21.15.45:0/708181925 >> 172.21.15.45:0/708181925 conn(0x7f996c0698e0 msgr2=0x7f996c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9970d1f640 1 -- 172.21.15.45:0/708181925 shutdown_connections 2023-07-09T02:17:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.452+0000 7f9970d1f640 1 -- 172.21.15.45:0/708181925 wait complete. 2023-07-09T02:17:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 Processor -- start 2023-07-09T02:17:50.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 -- start start 2023-07-09T02:17:50.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c0cd120 0x7f996c151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996c15c060 0x7f996c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c153d50 con 0x7f996c0d2620 2023-07-09T02:17:50.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c1528e0 con 0x7f996c15c060 2023-07-09T02:17:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c152bc0 con 0x7f996c0cd120 2023-07-09T02:17:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40846/0 (socket says 172.21.15.45:40846) 2023-07-09T02:17:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 -- 172.21.15.45:0/2604975779 learned_addr learned my addr 172.21.15.45:0/2604975779 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f996ad9d640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996c15c060 0x7f996c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f996a59c640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c0cd120 0x7f996c151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 -- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c0cd120 msgr2=0x7f996c151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c0cd120 0x7f996c151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 -- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996c15c060 msgr2=0x7f996c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996c15c060 0x7f996c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 -- 172.21.15.45:0/2604975779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9964009b30 con 0x7f996c0d2620 2023-07-09T02:17:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f996a59c640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c0cd120 0x7f996c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9963fff640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cc8e0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f995400c4d0 tx=0x7f995400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9962ffd640 1 -- 172.21.15.45:0/2604975779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99540052d0 con 0x7f996c0d2620 2023-07-09T02:17:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9962ffd640 1 -- 172.21.15.45:0/2604975779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9954005430 con 0x7f996c0d2620 2023-07-09T02:17:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9962ffd640 1 -- 172.21.15.45:0/2604975779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954012830 con 0x7f996c0d2620 2023-07-09T02:17:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996c0b59f0 con 0x7f996c0d2620 2023-07-09T02:17:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.456+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996c153180 con 0x7f996c0d2620 2023-07-09T02:17:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.460+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996c0cf170 con 0x7f996c0d2620 2023-07-09T02:17:50.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.460+0000 7f9962ffd640 1 -- 172.21.15.45:0/2604975779 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9954012990 con 0x7f996c0d2620 2023-07-09T02:17:50.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.460+0000 7f9962ffd640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f994c066280 0x7f994c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.460+0000 7f9962ffd640 1 -- 172.21.15.45:0/2604975779 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9954083900 con 0x7f996c0d2620 2023-07-09T02:17:50.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.460+0000 7f996a59c640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f994c066280 0x7f994c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.460+0000 7f996a59c640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f994c066280 0x7f994c068730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f995c009a40 tx=0x7f995c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.464+0000 7f9962ffd640 1 -- 172.21.15.45:0/2604975779 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9954050ce0 con 0x7f996c0d2620 2023-07-09T02:17:50.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.620+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f996c04d7d0 con 0x7f996c0d2620 2023-07-09T02:17:50.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.620+0000 7f9962ffd640 1 -- 172.21.15.45:0/2604975779 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f9954054300 con 0x7f996c0d2620 2023-07-09T02:17:50.623 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:50.623 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":138,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:17:47.861086+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:44.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:45.234988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:17:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f994c066280 msgr2=0x7f994c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f994c066280 0x7f994c068730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f995c009a40 tx=0x7f995c008040 comp rx=0 tx=0).stop 2023-07-09T02:17:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 msgr2=0x7f996c0cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cc8e0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f995400c4d0 tx=0x7f995400c990 comp rx=0 tx=0).stop 2023-07-09T02:17:50.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 shutdown_connections 2023-07-09T02:17:50.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f996c15c060 0x7f996c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996c0d2620 0x7f996c0cc8e0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f994c066280 0x7f994c068730 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 --2- 172.21.15.45:0/2604975779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f996c0cd120 0x7f996c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 >> 172.21.15.45:0/2604975779 conn(0x7f996c0698e0 msgr2=0x7f996c0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:50.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 shutdown_connections 2023-07-09T02:17:50.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.624+0000 7f9970d1f640 1 -- 172.21.15.45:0/2604975779 wait complete. 2023-07-09T02:17:50.644 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:17:50.645 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:17:50.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f255bc19640 1 Processor -- start 2023-07-09T02:17:50.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f255bc19640 1 -- start start 2023-07-09T02:17:50.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f255bc19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f255415c060 0x7f25540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f255bc19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f25540cd120 0x7f25540d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f255bc19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2554160a50 con 0x7f25540d2450 2023-07-09T02:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f255bc19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540d28d0 con 0x7f255415c060 2023-07-09T02:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f255bc19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540cfe40 con 0x7f25540cd120 2023-07-09T02:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f25599b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f255415c060 0x7f25540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f25599b5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f255415c060 0x7f25540b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40852/0 (socket says 172.21.15.45:40852) 2023-07-09T02:17:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f25599b5640 1 -- 172.21.15.45:0/1674778606 learned_addr learned my addr 172.21.15.45:0/1674778606 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f255a1b6640 1 --1- 172.21.15.45:0/1674778606 >> v1:172.21.15.45:6789/0 conn(0x7f25540d2450 0x7f25540d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57300/0 (socket says 172.21.15.45:57300) 2023-07-09T02:17:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f25591b4640 1 --2- 172.21.15.45:0/1674778606 >> v2:172.21.15.155:3300/0 conn(0x7f25540cd120 0x7f25540d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f25599b5640 1 -- 172.21.15.45:0/1674778606 >> v2:172.21.15.155:3300/0 conn(0x7f25540cd120 msgr2=0x7f25540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f25599b5640 1 --2- 172.21.15.45:0/1674778606 >> v2:172.21.15.155:3300/0 conn(0x7f25540cd120 0x7f25540d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f25599b5640 1 -- 172.21.15.45:0/1674778606 >> v1:172.21.15.45:6789/0 conn(0x7f25540d2450 legacy=0x7f25540d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.788+0000 7f25599b5640 1 -- 172.21.15.45:0/1674778606 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255415c430 con 0x7f255415c060 2023-07-09T02:17:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f25599b5640 1 --2- 172.21.15.45:0/1674778606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f255415c060 0x7f25540b4ed0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f255415fac0 tx=0x7f255001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b4afd0a6332ec5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f25589b3640 1 -- 172.21.15.45:0/1674778606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500ab5f0 con 0x7f255415c060 2023-07-09T02:17:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f25589b3640 1 -- 172.21.15.45:0/1674778606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25500ab750 con 0x7f255415c060 2023-07-09T02:17:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f25589b3640 1 -- 172.21.15.45:0/1674778606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500abae0 con 0x7f255415c060 2023-07-09T02:17:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f255bc19640 1 -- 172.21.15.45:0/1674778606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f255415c060 msgr2=0x7f25540b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f255bc19640 1 --2- 172.21.15.45:0/1674778606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f255415c060 0x7f25540b4ed0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f255415fac0 tx=0x7f255001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f255bc19640 1 -- 172.21.15.45:0/1674778606 shutdown_connections 2023-07-09T02:17:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f255bc19640 1 --2- 172.21.15.45:0/1674778606 >> v2:172.21.15.155:3300/0 conn(0x7f25540cd120 0x7f25540d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f255bc19640 1 --2- 172.21.15.45:0/1674778606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f255415c060 0x7f25540b4ed0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f255bc19640 1 -- 172.21.15.45:0/1674778606 >> 172.21.15.45:0/1674778606 conn(0x7f25540698e0 msgr2=0x7f2554069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f255bc19640 1 -- 172.21.15.45:0/1674778606 shutdown_connections 2023-07-09T02:17:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.792+0000 7f255bc19640 1 -- 172.21.15.45:0/1674778606 wait complete. 2023-07-09T02:17:50.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 Processor -- start 2023-07-09T02:17:50.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 -- start start 2023-07-09T02:17:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25540cd120 0x7f2554153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25540d2450 0x7f25540c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f255415c060 0x7f25540b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540ca440 con 0x7f25540cd120 2023-07-09T02:17:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540ca720 con 0x7f25540d2450 2023-07-09T02:17:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540caa00 con 0x7f255415c060 2023-07-09T02:17:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25540cd120 0x7f2554153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25540cd120 0x7f2554153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40868/0 (socket says 172.21.15.45:40868) 2023-07-09T02:17:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 -- 172.21.15.45:0/4037956592 learned_addr learned my addr 172.21.15.45:0/4037956592 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 -- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f255415c060 msgr2=0x7f25540b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f255415c060 0x7f25540b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 -- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25540d2450 msgr2=0x7f25540c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25540d2450 0x7f25540c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 -- 172.21.15.45:0/4037956592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25500094d0 con 0x7f25540cd120 2023-07-09T02:17:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f25599b5640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25540cd120 0x7f2554153d20 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f25500190e0 tx=0x7f255001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f254a7fc640 1 -- 172.21.15.45:0/4037956592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500be5f0 con 0x7f25540cd120 2023-07-09T02:17:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f254a7fc640 1 -- 172.21.15.45:0/4037956592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25500be770 con 0x7f25540cd120 2023-07-09T02:17:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f254a7fc640 1 -- 172.21.15.45:0/4037956592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500beb20 con 0x7f25540cd120 2023-07-09T02:17:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25540cace0 con 0x7f25540cd120 2023-07-09T02:17:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2554154260 con 0x7f25540cd120 2023-07-09T02:17:50.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.796+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255404d7d0 con 0x7f25540cd120 2023-07-09T02:17:50.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.800+0000 7f254a7fc640 1 -- 172.21.15.45:0/4037956592 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25500b4600 con 0x7f25540cd120 2023-07-09T02:17:50.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.800+0000 7f254a7fc640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2538066280 0x7f2538068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:50.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.800+0000 7f254a7fc640 1 -- 172.21.15.45:0/4037956592 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f25500a8050 con 0x7f25540cd120 2023-07-09T02:17:50.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.800+0000 7f25591b4640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2538066280 0x7f2538068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:50.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.800+0000 7f25591b4640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2538066280 0x7f2538068730 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2554159930 tx=0x7f2544008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.804+0000 7f254a7fc640 1 -- 172.21.15.45:0/4037956592 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25500ec080 con 0x7f25540cd120 2023-07-09T02:17:50.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.956+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2554160400 con 0x7f2538066280 2023-07-09T02:17:50.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.964+0000 7f254a7fc640 1 -- 172.21.15.45:0/4037956592 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306031 (secure 0 0 0) 0x7f2544009120 con 0x7f2538066280 2023-07-09T02:17:50.970 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:17:50.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2538066280 msgr2=0x7f2538068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2538066280 0x7f2538068730 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2554159930 tx=0x7f2544008040 comp rx=0 tx=0).stop 2023-07-09T02:17:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25540cd120 msgr2=0x7f2554153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25540cd120 0x7f2554153d20 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f25500190e0 tx=0x7f255001ad10 comp rx=0 tx=0).stop 2023-07-09T02:17:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 shutdown_connections 2023-07-09T02:17:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2538066280 0x7f2538068730 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f255415c060 0x7f25540b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25540d2450 0x7f25540c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 --2- 172.21.15.45:0/4037956592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25540cd120 0x7f2554153d20 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 >> 172.21.15.45:0/4037956592 conn(0x7f25540698e0 msgr2=0x7f25540b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 shutdown_connections 2023-07-09T02:17:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:50.968+0000 7f255bc19640 1 -- 172.21.15.45:0/4037956592 wait complete. 2023-07-09T02:17:50.990 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2023-07-09T02:17:50.622880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7520,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554979,"statfs":{"total":1600000000,"available":1592298724,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.779296"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029928+0000","last_change":"2023-07-09T02:17:46.871630+0000","last_active":"2023-07-09T02:17:49.029928+0000","last_peered":"2023-07-09T02:17:49.029928+0000","last_clean":"2023-07-09T02:17:49.029928+0000","last_became_active":"2023-07-09T02:17:46.871395+0000","last_became_peered":"2023-07-09T02:17:46.871395+0000","last_unstale":"2023-07-09T02:17:49.029928+0000","last_undegraded":"2023-07-09T02:17:49.029928+0000","last_fullsized":"2023-07-09T02:17:49.029928+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:10.276873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031032+0000","last_change":"2023-07-09T02:17:46.880570+0000","last_active":"2023-07-09T02:17:49.031032+0000","last_peered":"2023-07-09T02:17:49.031032+0000","last_clean":"2023-07-09T02:17:49.031032+0000","last_became_active":"2023-07-09T02:17:46.880338+0000","last_became_peered":"2023-07-09T02:17:46.880338+0000","last_unstale":"2023-07-09T02:17:49.031032+0000","last_undegraded":"2023-07-09T02:17:49.031032+0000","last_fullsized":"2023-07-09T02:17:49.031032+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:10.097026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031228+0000","last_change":"2023-07-09T02:17:46.888433+0000","last_active":"2023-07-09T02:17:49.031228+0000","last_peered":"2023-07-09T02:17:49.031228+0000","last_clean":"2023-07-09T02:17:49.031228+0000","last_became_active":"2023-07-09T02:17:46.887916+0000","last_became_peered":"2023-07-09T02:17:46.887916+0000","last_unstale":"2023-07-09T02:17:49.031228+0000","last_undegraded":"2023-07-09T02:17:49.031228+0000","last_fullsized":"2023-07-09T02:17:49.031228+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:07:19.731989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488087+0000","last_change":"2023-07-09T02:17:46.885243+0000","last_active":"2023-07-09T02:17:48.488087+0000","last_peered":"2023-07-09T02:17:48.488087+0000","last_clean":"2023-07-09T02:17:48.488087+0000","last_became_active":"2023-07-09T02:17:46.884082+0000","last_became_peered":"2023-07-09T02:17:46.884082+0000","last_unstale":"2023-07-09T02:17:48.488087+0000","last_undegraded":"2023-07-09T02:17:48.488087+0000","last_fullsized":"2023-07-09T02:17:48.488087+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:56:32.284084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030111+0000","last_change":"2023-07-09T02:17:46.878970+0000","last_active":"2023-07-09T02:17:49.030111+0000","last_peered":"2023-07-09T02:17:49.030111+0000","last_clean":"2023-07-09T02:17:49.030111+0000","last_became_active":"2023-07-09T02:17:46.878746+0000","last_became_peered":"2023-07-09T02:17:46.878746+0000","last_unstale":"2023-07-09T02:17:49.030111+0000","last_undegraded":"2023-07-09T02:17:49.030111+0000","last_fullsized":"2023-07-09T02:17:49.030111+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:40:00.055698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868307+0000","last_change":"2023-07-09T02:17:46.876932+0000","last_active":"2023-07-09T02:17:47.868307+0000","last_peered":"2023-07-09T02:17:47.868307+0000","last_clean":"2023-07-09T02:17:47.868307+0000","last_became_active":"2023-07-09T02:17:46.876675+0000","last_became_peered":"2023-07-09T02:17:46.876675+0000","last_unstale":"2023-07-09T02:17:47.868307+0000","last_undegraded":"2023-07-09T02:17:47.868307+0000","last_fullsized":"2023-07-09T02:17:47.868307+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:42:15.068085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868351+0000","last_change":"2023-07-09T02:17:46.880618+0000","last_active":"2023-07-09T02:17:47.868351+0000","last_peered":"2023-07-09T02:17:47.868351+0000","last_clean":"2023-07-09T02:17:47.868351+0000","last_became_active":"2023-07-09T02:17:46.880384+0000","last_became_peered":"2023-07-09T02:17:46.880384+0000","last_unstale":"2023-07-09T02:17:47.868351+0000","last_undegraded":"2023-07-09T02:17:47.868351+0000","last_fullsized":"2023-07-09T02:17:47.868351+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:58:07.848370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031901+0000","last_change":"2023-07-09T02:17:46.888313+0000","last_active":"2023-07-09T02:17:49.031901+0000","last_peered":"2023-07-09T02:17:49.031901+0000","last_clean":"2023-07-09T02:17:49.031901+0000","last_became_active":"2023-07-09T02:17:46.887620+0000","last_became_peered":"2023-07-09T02:17:46.887620+0000","last_unstale":"2023-07-09T02:17:49.031901+0000","last_undegraded":"2023-07-09T02:17:49.031901+0000","last_fullsized":"2023-07-09T02:17:49.031901+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:35:04.948331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487851+0000","last_change":"2023-07-09T02:17:46.885090+0000","last_active":"2023-07-09T02:17:48.487851+0000","last_peered":"2023-07-09T02:17:48.487851+0000","last_clean":"2023-07-09T02:17:48.487851+0000","last_became_active":"2023-07-09T02:17:46.883794+0000","last_became_peered":"2023-07-09T02:17:46.883794+0000","last_unstale":"2023-07-09T02:17:48.487851+0000","last_undegraded":"2023-07-09T02:17:48.487851+0000","last_fullsized":"2023-07-09T02:17:48.487851+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:14:10.192590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865318+0000","last_change":"2023-07-09T02:17:46.875831+0000","last_active":"2023-07-09T02:17:47.865318+0000","last_peered":"2023-07-09T02:17:47.865318+0000","last_clean":"2023-07-09T02:17:47.865318+0000","last_became_active":"2023-07-09T02:17:46.875472+0000","last_became_peered":"2023-07-09T02:17:46.875472+0000","last_unstale":"2023-07-09T02:17:47.865318+0000","last_undegraded":"2023-07-09T02:17:47.865318+0000","last_fullsized":"2023-07-09T02:17:47.865318+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:07:47.978709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030206+0000","last_change":"2023-07-09T02:17:46.871142+0000","last_active":"2023-07-09T02:17:49.030206+0000","last_peered":"2023-07-09T02:17:49.030206+0000","last_clean":"2023-07-09T02:17:49.030206+0000","last_became_active":"2023-07-09T02:17:46.870908+0000","last_became_peered":"2023-07-09T02:17:46.870908+0000","last_unstale":"2023-07-09T02:17:49.030206+0000","last_undegraded":"2023-07-09T02:17:49.030206+0000","last_fullsized":"2023-07-09T02:17:49.030206+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:02:13.179875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868508+0000","last_change":"2023-07-09T02:17:46.875426+0000","last_active":"2023-07-09T02:17:47.868508+0000","last_peered":"2023-07-09T02:17:47.868508+0000","last_clean":"2023-07-09T02:17:47.868508+0000","last_became_active":"2023-07-09T02:17:46.875113+0000","last_became_peered":"2023-07-09T02:17:46.875113+0000","last_unstale":"2023-07-09T02:17:47.868508+0000","last_undegraded":"2023-07-09T02:17:47.868508+0000","last_fullsized":"2023-07-09T02:17:47.868508+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:14:55.435619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865075+0000","last_change":"2023-07-09T02:17:46.871345+0000","last_active":"2023-07-09T02:17:47.865075+0000","last_peered":"2023-07-09T02:17:47.865075+0000","last_clean":"2023-07-09T02:17:47.865075+0000","last_became_active":"2023-07-09T02:17:46.871075+0000","last_became_peered":"2023-07-09T02:17:46.871075+0000","last_unstale":"2023-07-09T02:17:47.865075+0000","last_undegraded":"2023-07-09T02:17:47.865075+0000","last_fullsized":"2023-07-09T02:17:47.865075+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:37:17.253342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030661+0000","last_change":"2023-07-09T02:17:46.889597+0000","last_active":"2023-07-09T02:17:49.030661+0000","last_peered":"2023-07-09T02:17:49.030661+0000","last_clean":"2023-07-09T02:17:49.030661+0000","last_became_active":"2023-07-09T02:17:46.889140+0000","last_became_peered":"2023-07-09T02:17:46.889140+0000","last_unstale":"2023-07-09T02:17:49.030661+0000","last_undegraded":"2023-07-09T02:17:49.030661+0000","last_fullsized":"2023-07-09T02:17:49.030661+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:41:10.611226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030301+0000","last_change":"2023-07-09T02:17:46.871458+0000","last_active":"2023-07-09T02:17:49.030301+0000","last_peered":"2023-07-09T02:17:49.030301+0000","last_clean":"2023-07-09T02:17:49.030301+0000","last_became_active":"2023-07-09T02:17:46.871232+0000","last_became_peered":"2023-07-09T02:17:46.871232+0000","last_unstale":"2023-07-09T02:17:49.030301+0000","last_undegraded":"2023-07-09T02:17:49.030301+0000","last_fullsized":"2023-07-09T02:17:49.030301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:53:54.641276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868452+0000","last_change":"2023-07-09T02:17:46.875355+0000","last_active":"2023-07-09T02:17:47.868452+0000","last_peered":"2023-07-09T02:17:47.868452+0000","last_clean":"2023-07-09T02:17:47.868452+0000","last_became_active":"2023-07-09T02:17:46.875117+0000","last_became_peered":"2023-07-09T02:17:46.875117+0000","last_unstale":"2023-07-09T02:17:47.868452+0000","last_undegraded":"2023-07-09T02:17:47.868452+0000","last_fullsized":"2023-07-09T02:17:47.868452+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:14.906001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865036+0000","last_change":"2023-07-09T02:17:46.872834+0000","last_active":"2023-07-09T02:17:47.865036+0000","last_peered":"2023-07-09T02:17:47.865036+0000","last_clean":"2023-07-09T02:17:47.865036+0000","last_became_active":"2023-07-09T02:17:46.872552+0000","last_became_peered":"2023-07-09T02:17:46.872552+0000","last_unstale":"2023-07-09T02:17:47.865036+0000","last_undegraded":"2023-07-09T02:17:47.865036+0000","last_fullsized":"2023-07-09T02:17:47.865036+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:26.105285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031349+0000","last_change":"2023-07-09T02:17:46.881903+0000","last_active":"2023-07-09T02:17:49.031349+0000","last_peered":"2023-07-09T02:17:49.031349+0000","last_clean":"2023-07-09T02:17:49.031349+0000","last_became_active":"2023-07-09T02:17:46.881536+0000","last_became_peered":"2023-07-09T02:17:46.881536+0000","last_unstale":"2023-07-09T02:17:49.031349+0000","last_undegraded":"2023-07-09T02:17:49.031349+0000","last_fullsized":"2023-07-09T02:17:49.031349+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:36:18.032844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029911+0000","last_change":"2023-07-09T02:17:46.887396+0000","last_active":"2023-07-09T02:17:49.029911+0000","last_peered":"2023-07-09T02:17:49.029911+0000","last_clean":"2023-07-09T02:17:49.029911+0000","last_became_active":"2023-07-09T02:17:46.886993+0000","last_became_peered":"2023-07-09T02:17:46.886993+0000","last_unstale":"2023-07-09T02:17:49.029911+0000","last_undegraded":"2023-07-09T02:17:49.029911+0000","last_fullsized":"2023-07-09T02:17:49.029911+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:47:35.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030706+0000","last_change":"2023-07-09T02:17:46.873577+0000","last_active":"2023-07-09T02:17:49.030706+0000","last_peered":"2023-07-09T02:17:49.030706+0000","last_clean":"2023-07-09T02:17:49.030706+0000","last_became_active":"2023-07-09T02:17:46.873344+0000","last_became_peered":"2023-07-09T02:17:46.873344+0000","last_unstale":"2023-07-09T02:17:49.030706+0000","last_undegraded":"2023-07-09T02:17:49.030706+0000","last_fullsized":"2023-07-09T02:17:49.030706+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:28:02.053084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487559+0000","last_change":"2023-07-09T02:17:46.879717+0000","last_active":"2023-07-09T02:17:48.487559+0000","last_peered":"2023-07-09T02:17:48.487559+0000","last_clean":"2023-07-09T02:17:48.487559+0000","last_became_active":"2023-07-09T02:17:46.879452+0000","last_became_peered":"2023-07-09T02:17:46.879452+0000","last_unstale":"2023-07-09T02:17:48.487559+0000","last_undegraded":"2023-07-09T02:17:48.487559+0000","last_fullsized":"2023-07-09T02:17:48.487559+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:57:07.697854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030141+0000","last_change":"2023-07-09T02:17:46.870227+0000","last_active":"2023-07-09T02:17:49.030141+0000","last_peered":"2023-07-09T02:17:49.030141+0000","last_clean":"2023-07-09T02:17:49.030141+0000","last_became_active":"2023-07-09T02:17:46.869991+0000","last_became_peered":"2023-07-09T02:17:46.869991+0000","last_unstale":"2023-07-09T02:17:49.030141+0000","last_undegraded":"2023-07-09T02:17:49.030141+0000","last_fullsized":"2023-07-09T02:17:49.030141+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:49:32.525875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487519+0000","last_change":"2023-07-09T02:17:46.880305+0000","last_active":"2023-07-09T02:17:48.487519+0000","last_peered":"2023-07-09T02:17:48.487519+0000","last_clean":"2023-07-09T02:17:48.487519+0000","last_became_active":"2023-07-09T02:17:46.879575+0000","last_became_peered":"2023-07-09T02:17:46.879575+0000","last_unstale":"2023-07-09T02:17:48.487519+0000","last_undegraded":"2023-07-09T02:17:48.487519+0000","last_fullsized":"2023-07-09T02:17:48.487519+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:55:02.877523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867394+0000","last_change":"2023-07-09T02:17:46.889505+0000","last_active":"2023-07-09T02:17:47.867394+0000","last_peered":"2023-07-09T02:17:47.867394+0000","last_clean":"2023-07-09T02:17:47.867394+0000","last_became_active":"2023-07-09T02:17:46.889199+0000","last_became_peered":"2023-07-09T02:17:46.889199+0000","last_unstale":"2023-07-09T02:17:47.867394+0000","last_undegraded":"2023-07-09T02:17:47.867394+0000","last_fullsized":"2023-07-09T02:17:47.867394+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:31:27.816581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867752+0000","last_change":"2023-07-09T02:17:46.872644+0000","last_active":"2023-07-09T02:17:47.867752+0000","last_peered":"2023-07-09T02:17:47.867752+0000","last_clean":"2023-07-09T02:17:47.867752+0000","last_became_active":"2023-07-09T02:17:46.872417+0000","last_became_peered":"2023-07-09T02:17:46.872417+0000","last_unstale":"2023-07-09T02:17:47.867752+0000","last_undegraded":"2023-07-09T02:17:47.867752+0000","last_fullsized":"2023-07-09T02:17:47.867752+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:13:11.658054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030626+0000","last_change":"2023-07-09T02:17:46.871561+0000","last_active":"2023-07-09T02:17:49.030626+0000","last_peered":"2023-07-09T02:17:49.030626+0000","last_clean":"2023-07-09T02:17:49.030626+0000","last_became_active":"2023-07-09T02:17:46.870628+0000","last_became_peered":"2023-07-09T02:17:46.870628+0000","last_unstale":"2023-07-09T02:17:49.030626+0000","last_undegraded":"2023-07-09T02:17:49.030626+0000","last_fullsized":"2023-07-09T02:17:49.030626+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:44:19.081241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029778+0000","last_change":"2023-07-09T02:17:46.883308+0000","last_active":"2023-07-09T02:17:49.029778+0000","last_peered":"2023-07-09T02:17:49.029778+0000","last_clean":"2023-07-09T02:17:49.029778+0000","last_became_active":"2023-07-09T02:17:46.883080+0000","last_became_peered":"2023-07-09T02:17:46.883080+0000","last_unstale":"2023-07-09T02:17:49.029778+0000","last_undegraded":"2023-07-09T02:17:49.029778+0000","last_fullsized":"2023-07-09T02:17:49.029778+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:41:13.310217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868184+0000","last_change":"2023-07-09T02:17:46.874885+0000","last_active":"2023-07-09T02:17:47.868184+0000","last_peered":"2023-07-09T02:17:47.868184+0000","last_clean":"2023-07-09T02:17:47.868184+0000","last_became_active":"2023-07-09T02:17:46.874643+0000","last_became_peered":"2023-07-09T02:17:46.874643+0000","last_unstale":"2023-07-09T02:17:47.868184+0000","last_undegraded":"2023-07-09T02:17:47.868184+0000","last_fullsized":"2023-07-09T02:17:47.868184+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:22:07.860973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030326+0000","last_change":"2023-07-09T02:17:46.870420+0000","last_active":"2023-07-09T02:17:49.030326+0000","last_peered":"2023-07-09T02:17:49.030326+0000","last_clean":"2023-07-09T02:17:49.030326+0000","last_became_active":"2023-07-09T02:17:46.870163+0000","last_became_peered":"2023-07-09T02:17:46.870163+0000","last_unstale":"2023-07-09T02:17:49.030326+0000","last_undegraded":"2023-07-09T02:17:49.030326+0000","last_fullsized":"2023-07-09T02:17:49.030326+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:32:27.262448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030594+0000","last_change":"2023-07-09T02:17:46.870392+0000","last_active":"2023-07-09T02:17:49.030594+0000","last_peered":"2023-07-09T02:17:49.030594+0000","last_clean":"2023-07-09T02:17:49.030594+0000","last_became_active":"2023-07-09T02:17:46.869701+0000","last_became_peered":"2023-07-09T02:17:46.869701+0000","last_unstale":"2023-07-09T02:17:49.030594+0000","last_undegraded":"2023-07-09T02:17:49.030594+0000","last_fullsized":"2023-07-09T02:17:49.030594+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:45:43.770106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867737+0000","last_change":"2023-07-09T02:17:46.873937+0000","last_active":"2023-07-09T02:17:47.867737+0000","last_peered":"2023-07-09T02:17:47.867737+0000","last_clean":"2023-07-09T02:17:47.867737+0000","last_became_active":"2023-07-09T02:17:46.873714+0000","last_became_peered":"2023-07-09T02:17:46.873714+0000","last_unstale":"2023-07-09T02:17:47.867737+0000","last_undegraded":"2023-07-09T02:17:47.867737+0000","last_fullsized":"2023-07-09T02:17:47.867737+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:54:34.333976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867977+0000","last_change":"2023-07-09T02:17:46.885992+0000","last_active":"2023-07-09T02:17:47.867977+0000","last_peered":"2023-07-09T02:17:47.867977+0000","last_clean":"2023-07-09T02:17:47.867977+0000","last_became_active":"2023-07-09T02:17:46.885703+0000","last_became_peered":"2023-07-09T02:17:46.885703+0000","last_unstale":"2023-07-09T02:17:47.867977+0000","last_undegraded":"2023-07-09T02:17:47.867977+0000","last_fullsized":"2023-07-09T02:17:47.867977+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:03:57.221535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865072+0000","last_change":"2023-07-09T02:17:46.877269+0000","last_active":"2023-07-09T02:17:47.865072+0000","last_peered":"2023-07-09T02:17:47.865072+0000","last_clean":"2023-07-09T02:17:47.865072+0000","last_became_active":"2023-07-09T02:17:46.876881+0000","last_became_peered":"2023-07-09T02:17:46.876881+0000","last_unstale":"2023-07-09T02:17:47.865072+0000","last_undegraded":"2023-07-09T02:17:47.865072+0000","last_fullsized":"2023-07-09T02:17:47.865072+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:23.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"137'4","reported_seq":17,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030055+0000","last_change":"2023-07-09T02:17:45.857553+0000","last_active":"2023-07-09T02:17:49.030055+0000","last_peered":"2023-07-09T02:17:49.030055+0000","last_clean":"2023-07-09T02:17:49.030055+0000","last_became_active":"2023-07-09T02:17:45.857205+0000","last_became_peered":"2023-07-09T02:17:45.857205+0000","last_unstale":"2023-07-09T02:17:49.030055+0000","last_undegraded":"2023-07-09T02:17:49.030055+0000","last_fullsized":"2023-07-09T02:17:49.030055+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:21:05.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868383+0000","last_change":"2023-07-09T02:17:46.875823+0000","last_active":"2023-07-09T02:17:47.868383+0000","last_peered":"2023-07-09T02:17:47.868383+0000","last_clean":"2023-07-09T02:17:47.868383+0000","last_became_active":"2023-07-09T02:17:46.875590+0000","last_became_peered":"2023-07-09T02:17:46.875590+0000","last_unstale":"2023-07-09T02:17:47.868383+0000","last_undegraded":"2023-07-09T02:17:47.868383+0000","last_fullsized":"2023-07-09T02:17:47.868383+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:17:27.006570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865137+0000","last_change":"2023-07-09T02:17:45.852775+0000","last_active":"2023-07-09T02:17:47.865137+0000","last_peered":"2023-07-09T02:17:47.865137+0000","last_clean":"2023-07-09T02:17:47.865137+0000","last_became_active":"2023-07-09T02:17:45.852555+0000","last_became_peered":"2023-07-09T02:17:45.852555+0000","last_unstale":"2023-07-09T02:17:47.865137+0000","last_undegraded":"2023-07-09T02:17:47.865137+0000","last_fullsized":"2023-07-09T02:17:47.865137+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:38:51.055273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867541+0000","last_change":"2023-07-09T02:17:46.879753+0000","last_active":"2023-07-09T02:17:47.867541+0000","last_peered":"2023-07-09T02:17:47.867541+0000","last_clean":"2023-07-09T02:17:47.867541+0000","last_became_active":"2023-07-09T02:17:46.879509+0000","last_became_peered":"2023-07-09T02:17:46.879509+0000","last_unstale":"2023-07-09T02:17:47.867541+0000","last_undegraded":"2023-07-09T02:17:47.867541+0000","last_fullsized":"2023-07-09T02:17:47.867541+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:50.263091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487708+0000","last_change":"2023-07-09T02:17:45.857403+0000","last_active":"2023-07-09T02:17:48.487708+0000","last_peered":"2023-07-09T02:17:48.487708+0000","last_clean":"2023-07-09T02:17:48.487708+0000","last_became_active":"2023-07-09T02:17:45.857127+0000","last_became_peered":"2023-07-09T02:17:45.857127+0000","last_unstale":"2023-07-09T02:17:48.487708+0000","last_undegraded":"2023-07-09T02:17:48.487708+0000","last_fullsized":"2023-07-09T02:17:48.487708+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:00:53.574039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488078+0000","last_change":"2023-07-09T02:17:46.882051+0000","last_active":"2023-07-09T02:17:48.488078+0000","last_peered":"2023-07-09T02:17:48.488078+0000","last_clean":"2023-07-09T02:17:48.488078+0000","last_became_active":"2023-07-09T02:17:46.881228+0000","last_became_peered":"2023-07-09T02:17:46.881228+0000","last_unstale":"2023-07-09T02:17:48.488078+0000","last_undegraded":"2023-07-09T02:17:48.488078+0000","last_fullsized":"2023-07-09T02:17:48.488078+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:15:53.927098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865356+0000","last_change":"2023-07-09T02:17:45.856549+0000","last_active":"2023-07-09T02:17:47.865356+0000","last_peered":"2023-07-09T02:17:47.865356+0000","last_clean":"2023-07-09T02:17:47.865356+0000","last_became_active":"2023-07-09T02:17:45.856110+0000","last_became_peered":"2023-07-09T02:17:45.856110+0000","last_unstale":"2023-07-09T02:17:47.865356+0000","last_undegraded":"2023-07-09T02:17:47.865356+0000","last_fullsized":"2023-07-09T02:17:47.865356+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:51:13.227894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865447+0000","last_change":"2023-07-09T02:17:46.879826+0000","last_active":"2023-07-09T02:17:47.865447+0000","last_peered":"2023-07-09T02:17:47.865447+0000","last_clean":"2023-07-09T02:17:47.865447+0000","last_became_active":"2023-07-09T02:17:46.879581+0000","last_became_peered":"2023-07-09T02:17:46.879581+0000","last_unstale":"2023-07-09T02:17:47.865447+0000","last_undegraded":"2023-07-09T02:17:47.865447+0000","last_fullsized":"2023-07-09T02:17:47.865447+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:35:22.193696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030385+0000","last_change":"2023-07-09T02:17:45.854063+0000","last_active":"2023-07-09T02:17:49.030385+0000","last_peered":"2023-07-09T02:17:49.030385+0000","last_clean":"2023-07-09T02:17:49.030385+0000","last_became_active":"2023-07-09T02:17:45.853658+0000","last_became_peered":"2023-07-09T02:17:45.853658+0000","last_unstale":"2023-07-09T02:17:49.030385+0000","last_undegraded":"2023-07-09T02:17:49.030385+0000","last_fullsized":"2023-07-09T02:17:49.030385+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:01:35.118304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029857+0000","last_change":"2023-07-09T02:17:46.884218+0000","last_active":"2023-07-09T02:17:49.029857+0000","last_peered":"2023-07-09T02:17:49.029857+0000","last_clean":"2023-07-09T02:17:49.029857+0000","last_became_active":"2023-07-09T02:17:46.883996+0000","last_became_peered":"2023-07-09T02:17:46.883996+0000","last_unstale":"2023-07-09T02:17:49.029857+0000","last_undegraded":"2023-07-09T02:17:49.029857+0000","last_fullsized":"2023-07-09T02:17:49.029857+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:20:22.587889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868279+0000","last_change":"2023-07-09T02:17:45.855486+0000","last_active":"2023-07-09T02:17:47.868279+0000","last_peered":"2023-07-09T02:17:47.868279+0000","last_clean":"2023-07-09T02:17:47.868279+0000","last_became_active":"2023-07-09T02:17:45.855076+0000","last_became_peered":"2023-07-09T02:17:45.855076+0000","last_unstale":"2023-07-09T02:17:47.868279+0000","last_undegraded":"2023-07-09T02:17:47.868279+0000","last_fullsized":"2023-07-09T02:17:47.868279+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:28:15.084681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031468+0000","last_change":"2023-07-09T02:17:46.870068+0000","last_active":"2023-07-09T02:17:49.031468+0000","last_peered":"2023-07-09T02:17:49.031468+0000","last_clean":"2023-07-09T02:17:49.031468+0000","last_became_active":"2023-07-09T02:17:46.869823+0000","last_became_peered":"2023-07-09T02:17:46.869823+0000","last_unstale":"2023-07-09T02:17:49.031468+0000","last_undegraded":"2023-07-09T02:17:49.031468+0000","last_fullsized":"2023-07-09T02:17:49.031468+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:38:33.486081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867802+0000","last_change":"2023-07-09T02:17:45.853123+0000","last_active":"2023-07-09T02:17:47.867802+0000","last_peered":"2023-07-09T02:17:47.867802+0000","last_clean":"2023-07-09T02:17:47.867802+0000","last_became_active":"2023-07-09T02:17:45.852882+0000","last_became_peered":"2023-07-09T02:17:45.852882+0000","last_unstale":"2023-07-09T02:17:47.867802+0000","last_undegraded":"2023-07-09T02:17:47.867802+0000","last_fullsized":"2023-07-09T02:17:47.867802+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:57:45.280680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865165+0000","last_change":"2023-07-09T02:17:46.870611+0000","last_active":"2023-07-09T02:17:47.865165+0000","last_peered":"2023-07-09T02:17:47.865165+0000","last_clean":"2023-07-09T02:17:47.865165+0000","last_became_active":"2023-07-09T02:17:46.870375+0000","last_became_peered":"2023-07-09T02:17:46.870375+0000","last_unstale":"2023-07-09T02:17:47.865165+0000","last_undegraded":"2023-07-09T02:17:47.865165+0000","last_fullsized":"2023-07-09T02:17:47.865165+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:46:50.449036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868598+0000","last_change":"2023-07-09T02:17:45.857084+0000","last_active":"2023-07-09T02:17:47.868598+0000","last_peered":"2023-07-09T02:17:47.868598+0000","last_clean":"2023-07-09T02:17:47.868598+0000","last_became_active":"2023-07-09T02:17:45.856580+0000","last_became_peered":"2023-07-09T02:17:45.856580+0000","last_unstale":"2023-07-09T02:17:47.868598+0000","last_undegraded":"2023-07-09T02:17:47.868598+0000","last_fullsized":"2023-07-09T02:17:47.868598+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:09:41.675834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868103+0000","last_change":"2023-07-09T02:17:46.874338+0000","last_active":"2023-07-09T02:17:47.868103+0000","last_peered":"2023-07-09T02:17:47.868103+0000","last_clean":"2023-07-09T02:17:47.868103+0000","last_became_active":"2023-07-09T02:17:46.874080+0000","last_became_peered":"2023-07-09T02:17:46.874080+0000","last_unstale":"2023-07-09T02:17:47.868103+0000","last_undegraded":"2023-07-09T02:17:47.868103+0000","last_fullsized":"2023-07-09T02:17:47.868103+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:55:44.648464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.864995+0000","last_change":"2023-07-09T02:17:45.854337+0000","last_active":"2023-07-09T02:17:47.864995+0000","last_peered":"2023-07-09T02:17:47.864995+0000","last_clean":"2023-07-09T02:17:47.864995+0000","last_became_active":"2023-07-09T02:17:45.854113+0000","last_became_peered":"2023-07-09T02:17:45.854113+0000","last_unstale":"2023-07-09T02:17:47.864995+0000","last_undegraded":"2023-07-09T02:17:47.864995+0000","last_fullsized":"2023-07-09T02:17:47.864995+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:48:26.546397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030352+0000","last_change":"2023-07-09T02:17:46.875893+0000","last_active":"2023-07-09T02:17:49.030352+0000","last_peered":"2023-07-09T02:17:49.030352+0000","last_clean":"2023-07-09T02:17:49.030352+0000","last_became_active":"2023-07-09T02:17:46.875672+0000","last_became_peered":"2023-07-09T02:17:46.875672+0000","last_unstale":"2023-07-09T02:17:49.030352+0000","last_undegraded":"2023-07-09T02:17:49.030352+0000","last_fullsized":"2023-07-09T02:17:49.030352+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:10:49.326039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030798+0000","last_change":"2023-07-09T02:17:45.851038+0000","last_active":"2023-07-09T02:17:49.030798+0000","last_peered":"2023-07-09T02:17:49.030798+0000","last_clean":"2023-07-09T02:17:49.030798+0000","last_became_active":"2023-07-09T02:17:45.850793+0000","last_became_peered":"2023-07-09T02:17:45.850793+0000","last_unstale":"2023-07-09T02:17:49.030798+0000","last_undegraded":"2023-07-09T02:17:49.030798+0000","last_fullsized":"2023-07-09T02:17:49.030798+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:08:45.975911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868468+0000","last_change":"2023-07-09T02:17:46.880482+0000","last_active":"2023-07-09T02:17:47.868468+0000","last_peered":"2023-07-09T02:17:47.868468+0000","last_clean":"2023-07-09T02:17:47.868468+0000","last_became_active":"2023-07-09T02:17:46.880213+0000","last_became_peered":"2023-07-09T02:17:46.880213+0000","last_unstale":"2023-07-09T02:17:47.868468+0000","last_undegraded":"2023-07-09T02:17:47.868468+0000","last_fullsized":"2023-07-09T02:17:47.868468+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:28:34.680258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487662+0000","last_change":"2023-07-09T02:17:45.855571+0000","last_active":"2023-07-09T02:17:48.487662+0000","last_peered":"2023-07-09T02:17:48.487662+0000","last_clean":"2023-07-09T02:17:48.487662+0000","last_became_active":"2023-07-09T02:17:45.855241+0000","last_became_peered":"2023-07-09T02:17:45.855241+0000","last_unstale":"2023-07-09T02:17:48.487662+0000","last_undegraded":"2023-07-09T02:17:48.487662+0000","last_fullsized":"2023-07-09T02:17:48.487662+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:18:10.565250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867686+0000","last_change":"2023-07-09T02:17:46.884674+0000","last_active":"2023-07-09T02:17:47.867686+0000","last_peered":"2023-07-09T02:17:47.867686+0000","last_clean":"2023-07-09T02:17:47.867686+0000","last_became_active":"2023-07-09T02:17:46.884114+0000","last_became_peered":"2023-07-09T02:17:46.884114+0000","last_unstale":"2023-07-09T02:17:47.867686+0000","last_undegraded":"2023-07-09T02:17:47.867686+0000","last_fullsized":"2023-07-09T02:17:47.867686+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:09:36.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487776+0000","last_change":"2023-07-09T02:17:45.858680+0000","last_active":"2023-07-09T02:17:48.487776+0000","last_peered":"2023-07-09T02:17:48.487776+0000","last_clean":"2023-07-09T02:17:48.487776+0000","last_became_active":"2023-07-09T02:17:45.858347+0000","last_became_peered":"2023-07-09T02:17:45.858347+0000","last_unstale":"2023-07-09T02:17:48.487776+0000","last_undegraded":"2023-07-09T02:17:48.487776+0000","last_fullsized":"2023-07-09T02:17:48.487776+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:51:11.344712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868589+0000","last_change":"2023-07-09T02:17:46.875982+0000","last_active":"2023-07-09T02:17:47.868589+0000","last_peered":"2023-07-09T02:17:47.868589+0000","last_clean":"2023-07-09T02:17:47.868589+0000","last_became_active":"2023-07-09T02:17:46.875743+0000","last_became_peered":"2023-07-09T02:17:46.875743+0000","last_unstale":"2023-07-09T02:17:47.868589+0000","last_undegraded":"2023-07-09T02:17:47.868589+0000","last_fullsized":"2023-07-09T02:17:47.868589+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:04:42.833279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868440+0000","last_change":"2023-07-09T02:17:45.858364+0000","last_active":"2023-07-09T02:17:47.868440+0000","last_peered":"2023-07-09T02:17:47.868440+0000","last_clean":"2023-07-09T02:17:47.868440+0000","last_became_active":"2023-07-09T02:17:45.858111+0000","last_became_peered":"2023-07-09T02:17:45.858111+0000","last_unstale":"2023-07-09T02:17:47.868440+0000","last_undegraded":"2023-07-09T02:17:47.868440+0000","last_fullsized":"2023-07-09T02:17:47.868440+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:31:18.201349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030729+0000","last_change":"2023-07-09T02:17:46.875082+0000","last_active":"2023-07-09T02:17:49.030729+0000","last_peered":"2023-07-09T02:17:49.030729+0000","last_clean":"2023-07-09T02:17:49.030729+0000","last_became_active":"2023-07-09T02:17:46.874863+0000","last_became_peered":"2023-07-09T02:17:46.874863+0000","last_unstale":"2023-07-09T02:17:49.030729+0000","last_undegraded":"2023-07-09T02:17:49.030729+0000","last_fullsized":"2023-07-09T02:17:49.030729+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:00.436154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488240+0000","last_change":"2023-07-09T02:17:45.856708+0000","last_active":"2023-07-09T02:17:48.488240+0000","last_peered":"2023-07-09T02:17:48.488240+0000","last_clean":"2023-07-09T02:17:48.488240+0000","last_became_active":"2023-07-09T02:17:45.856481+0000","last_became_peered":"2023-07-09T02:17:45.856481+0000","last_unstale":"2023-07-09T02:17:48.488240+0000","last_undegraded":"2023-07-09T02:17:48.488240+0000","last_fullsized":"2023-07-09T02:17:48.488240+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:07:38.846146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030849+0000","last_change":"2023-07-09T02:17:46.889723+0000","last_active":"2023-07-09T02:17:49.030849+0000","last_peered":"2023-07-09T02:17:49.030849+0000","last_clean":"2023-07-09T02:17:49.030849+0000","last_became_active":"2023-07-09T02:17:46.889426+0000","last_became_peered":"2023-07-09T02:17:46.889426+0000","last_unstale":"2023-07-09T02:17:49.030849+0000","last_undegraded":"2023-07-09T02:17:49.030849+0000","last_fullsized":"2023-07-09T02:17:49.030849+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:44.127765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031028+0000","last_change":"2023-07-09T02:17:45.851893+0000","last_active":"2023-07-09T02:17:49.031028+0000","last_peered":"2023-07-09T02:17:49.031028+0000","last_clean":"2023-07-09T02:17:49.031028+0000","last_became_active":"2023-07-09T02:17:45.851676+0000","last_became_peered":"2023-07-09T02:17:45.851676+0000","last_unstale":"2023-07-09T02:17:49.031028+0000","last_undegraded":"2023-07-09T02:17:49.031028+0000","last_fullsized":"2023-07-09T02:17:49.031028+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:54:45.706142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867677+0000","last_change":"2023-07-09T02:17:46.880414+0000","last_active":"2023-07-09T02:17:47.867677+0000","last_peered":"2023-07-09T02:17:47.867677+0000","last_clean":"2023-07-09T02:17:47.867677+0000","last_became_active":"2023-07-09T02:17:46.879095+0000","last_became_peered":"2023-07-09T02:17:46.879095+0000","last_unstale":"2023-07-09T02:17:47.867677+0000","last_undegraded":"2023-07-09T02:17:47.867677+0000","last_fullsized":"2023-07-09T02:17:47.867677+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:46:55.487355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487834+0000","last_change":"2023-07-09T02:17:45.858625+0000","last_active":"2023-07-09T02:17:48.487834+0000","last_peered":"2023-07-09T02:17:48.487834+0000","last_clean":"2023-07-09T02:17:48.487834+0000","last_became_active":"2023-07-09T02:17:45.858396+0000","last_became_peered":"2023-07-09T02:17:45.858396+0000","last_unstale":"2023-07-09T02:17:48.487834+0000","last_undegraded":"2023-07-09T02:17:48.487834+0000","last_fullsized":"2023-07-09T02:17:48.487834+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:51:09.300948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868542+0000","last_change":"2023-07-09T02:17:46.872717+0000","last_active":"2023-07-09T02:17:47.868542+0000","last_peered":"2023-07-09T02:17:47.868542+0000","last_clean":"2023-07-09T02:17:47.868542+0000","last_became_active":"2023-07-09T02:17:46.872333+0000","last_became_peered":"2023-07-09T02:17:46.872333+0000","last_unstale":"2023-07-09T02:17:47.868542+0000","last_undegraded":"2023-07-09T02:17:47.868542+0000","last_fullsized":"2023-07-09T02:17:47.868542+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:33:38.767841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868568+0000","last_change":"2023-07-09T02:17:45.854082+0000","last_active":"2023-07-09T02:17:47.868568+0000","last_peered":"2023-07-09T02:17:47.868568+0000","last_clean":"2023-07-09T02:17:47.868568+0000","last_became_active":"2023-07-09T02:17:45.853851+0000","last_became_peered":"2023-07-09T02:17:45.853851+0000","last_unstale":"2023-07-09T02:17:47.868568+0000","last_undegraded":"2023-07-09T02:17:47.868568+0000","last_fullsized":"2023-07-09T02:17:47.868568+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:52:39.565282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.864898+0000","last_change":"2023-07-09T02:17:46.890347+0000","last_active":"2023-07-09T02:17:47.864898+0000","last_peered":"2023-07-09T02:17:47.864898+0000","last_clean":"2023-07-09T02:17:47.864898+0000","last_became_active":"2023-07-09T02:17:46.890106+0000","last_became_peered":"2023-07-09T02:17:46.890106+0000","last_unstale":"2023-07-09T02:17:47.864898+0000","last_undegraded":"2023-07-09T02:17:47.864898+0000","last_fullsized":"2023-07-09T02:17:47.864898+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:02:01.286509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029905+0000","last_change":"2023-07-09T02:17:45.855071+0000","last_active":"2023-07-09T02:17:49.029905+0000","last_peered":"2023-07-09T02:17:49.029905+0000","last_clean":"2023-07-09T02:17:49.029905+0000","last_became_active":"2023-07-09T02:17:45.854824+0000","last_became_peered":"2023-07-09T02:17:45.854824+0000","last_unstale":"2023-07-09T02:17:49.029905+0000","last_undegraded":"2023-07-09T02:17:49.029905+0000","last_fullsized":"2023-07-09T02:17:49.029905+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:56:18.689496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487709+0000","last_change":"2023-07-09T02:17:46.880443+0000","last_active":"2023-07-09T02:17:48.487709+0000","last_peered":"2023-07-09T02:17:48.487709+0000","last_clean":"2023-07-09T02:17:48.487709+0000","last_became_active":"2023-07-09T02:17:46.879914+0000","last_became_peered":"2023-07-09T02:17:46.879914+0000","last_unstale":"2023-07-09T02:17:48.487709+0000","last_undegraded":"2023-07-09T02:17:48.487709+0000","last_fullsized":"2023-07-09T02:17:48.487709+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:59:39.118984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030194+0000","last_change":"2023-07-09T02:17:45.854907+0000","last_active":"2023-07-09T02:17:49.030194+0000","last_peered":"2023-07-09T02:17:49.030194+0000","last_clean":"2023-07-09T02:17:49.030194+0000","last_became_active":"2023-07-09T02:17:45.854661+0000","last_became_peered":"2023-07-09T02:17:45.854661+0000","last_unstale":"2023-07-09T02:17:49.030194+0000","last_undegraded":"2023-07-09T02:17:49.030194+0000","last_fullsized":"2023-07-09T02:17:49.030194+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:52:25.984103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030325+0000","last_change":"2023-07-09T02:17:46.874063+0000","last_active":"2023-07-09T02:17:49.030325+0000","last_peered":"2023-07-09T02:17:49.030325+0000","last_clean":"2023-07-09T02:17:49.030325+0000","last_became_active":"2023-07-09T02:17:46.873812+0000","last_became_peered":"2023-07-09T02:17:46.873812+0000","last_unstale":"2023-07-09T02:17:49.030325+0000","last_undegraded":"2023-07-09T02:17:49.030325+0000","last_fullsized":"2023-07-09T02:17:49.030325+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:21:17.410082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868658+0000","last_change":"2023-07-09T02:17:45.857219+0000","last_active":"2023-07-09T02:17:47.868658+0000","last_peered":"2023-07-09T02:17:47.868658+0000","last_clean":"2023-07-09T02:17:47.868658+0000","last_became_active":"2023-07-09T02:17:45.856864+0000","last_became_peered":"2023-07-09T02:17:45.856864+0000","last_unstale":"2023-07-09T02:17:47.868658+0000","last_undegraded":"2023-07-09T02:17:47.868658+0000","last_fullsized":"2023-07-09T02:17:47.868658+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:23:29.945205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868221+0000","last_change":"2023-07-09T02:17:46.873025+0000","last_active":"2023-07-09T02:17:47.868221+0000","last_peered":"2023-07-09T02:17:47.868221+0000","last_clean":"2023-07-09T02:17:47.868221+0000","last_became_active":"2023-07-09T02:17:46.872412+0000","last_became_peered":"2023-07-09T02:17:46.872412+0000","last_unstale":"2023-07-09T02:17:47.868221+0000","last_undegraded":"2023-07-09T02:17:47.868221+0000","last_fullsized":"2023-07-09T02:17:47.868221+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:11:56.464913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030444+0000","last_change":"2023-07-09T02:17:45.853248+0000","last_active":"2023-07-09T02:17:49.030444+0000","last_peered":"2023-07-09T02:17:49.030444+0000","last_clean":"2023-07-09T02:17:49.030444+0000","last_became_active":"2023-07-09T02:17:45.853011+0000","last_became_peered":"2023-07-09T02:17:45.853011+0000","last_unstale":"2023-07-09T02:17:49.030444+0000","last_undegraded":"2023-07-09T02:17:49.030444+0000","last_fullsized":"2023-07-09T02:17:49.030444+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:39:18.887785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031590+0000","last_change":"2023-07-09T02:17:46.888181+0000","last_active":"2023-07-09T02:17:49.031590+0000","last_peered":"2023-07-09T02:17:49.031590+0000","last_clean":"2023-07-09T02:17:49.031590+0000","last_became_active":"2023-07-09T02:17:46.887366+0000","last_became_peered":"2023-07-09T02:17:46.887366+0000","last_unstale":"2023-07-09T02:17:49.031590+0000","last_undegraded":"2023-07-09T02:17:49.031590+0000","last_fullsized":"2023-07-09T02:17:49.031590+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:27:57.376358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030234+0000","last_change":"2023-07-09T02:17:45.853906+0000","last_active":"2023-07-09T02:17:49.030234+0000","last_peered":"2023-07-09T02:17:49.030234+0000","last_clean":"2023-07-09T02:17:49.030234+0000","last_became_active":"2023-07-09T02:17:45.853292+0000","last_became_peered":"2023-07-09T02:17:45.853292+0000","last_unstale":"2023-07-09T02:17:49.030234+0000","last_undegraded":"2023-07-09T02:17:49.030234+0000","last_fullsized":"2023-07-09T02:17:49.030234+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:45:38.974041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487659+0000","last_change":"2023-07-09T02:17:46.882403+0000","last_active":"2023-07-09T02:17:48.487659+0000","last_peered":"2023-07-09T02:17:48.487659+0000","last_clean":"2023-07-09T02:17:48.487659+0000","last_became_active":"2023-07-09T02:17:46.881335+0000","last_became_peered":"2023-07-09T02:17:46.881335+0000","last_unstale":"2023-07-09T02:17:48.487659+0000","last_undegraded":"2023-07-09T02:17:48.487659+0000","last_fullsized":"2023-07-09T02:17:48.487659+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:52:42.103560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868578+0000","last_change":"2023-07-09T02:17:45.855309+0000","last_active":"2023-07-09T02:17:47.868578+0000","last_peered":"2023-07-09T02:17:47.868578+0000","last_clean":"2023-07-09T02:17:47.868578+0000","last_became_active":"2023-07-09T02:17:45.854753+0000","last_became_peered":"2023-07-09T02:17:45.854753+0000","last_unstale":"2023-07-09T02:17:47.868578+0000","last_undegraded":"2023-07-09T02:17:47.868578+0000","last_fullsized":"2023-07-09T02:17:47.868578+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:59:48.072619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865200+0000","last_change":"2023-07-09T02:17:46.879443+0000","last_active":"2023-07-09T02:17:47.865200+0000","last_peered":"2023-07-09T02:17:47.865200+0000","last_clean":"2023-07-09T02:17:47.865200+0000","last_became_active":"2023-07-09T02:17:46.879204+0000","last_became_peered":"2023-07-09T02:17:46.879204+0000","last_unstale":"2023-07-09T02:17:47.865200+0000","last_undegraded":"2023-07-09T02:17:47.865200+0000","last_fullsized":"2023-07-09T02:17:47.865200+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:51.077445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487940+0000","last_change":"2023-07-09T02:17:45.857663+0000","last_active":"2023-07-09T02:17:48.487940+0000","last_peered":"2023-07-09T02:17:48.487940+0000","last_clean":"2023-07-09T02:17:48.487940+0000","last_became_active":"2023-07-09T02:17:45.857425+0000","last_became_peered":"2023-07-09T02:17:45.857425+0000","last_unstale":"2023-07-09T02:17:48.487940+0000","last_undegraded":"2023-07-09T02:17:48.487940+0000","last_fullsized":"2023-07-09T02:17:48.487940+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:34:41.430083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487471+0000","last_change":"2023-07-09T02:17:46.879884+0000","last_active":"2023-07-09T02:17:48.487471+0000","last_peered":"2023-07-09T02:17:48.487471+0000","last_clean":"2023-07-09T02:17:48.487471+0000","last_became_active":"2023-07-09T02:17:46.879606+0000","last_became_peered":"2023-07-09T02:17:46.879606+0000","last_unstale":"2023-07-09T02:17:48.487471+0000","last_undegraded":"2023-07-09T02:17:48.487471+0000","last_fullsized":"2023-07-09T02:17:48.487471+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:00:22.551889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"137'8","reported_seq":21,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031742+0000","last_change":"2023-07-09T02:17:45.859068+0000","last_active":"2023-07-09T02:17:49.031742+0000","last_peered":"2023-07-09T02:17:49.031742+0000","last_clean":"2023-07-09T02:17:49.031742+0000","last_became_active":"2023-07-09T02:17:45.858705+0000","last_became_peered":"2023-07-09T02:17:45.858705+0000","last_unstale":"2023-07-09T02:17:49.031742+0000","last_undegraded":"2023-07-09T02:17:49.031742+0000","last_fullsized":"2023-07-09T02:17:49.031742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:02:53.236572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":368,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487176+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:17:48.487176+0000","last_peered":"2023-07-09T02:17:48.487176+0000","last_clean":"2023-07-09T02:17:48.487176+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:17:48.487176+0000","last_undegraded":"2023-07-09T02:17:48.487176+0000","last_fullsized":"2023-07-09T02:17:48.487176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:26:34.655521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867963+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:17:47.867963+0000","last_peered":"2023-07-09T02:17:47.867963+0000","last_clean":"2023-07-09T02:17:47.867963+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:17:47.867963+0000","last_undegraded":"2023-07-09T02:17:47.867963+0000","last_fullsized":"2023-07-09T02:17:47.867963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:46:23.041970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029806+0000","last_change":"2023-07-09T02:17:46.884819+0000","last_active":"2023-07-09T02:17:49.029806+0000","last_peered":"2023-07-09T02:17:49.029806+0000","last_clean":"2023-07-09T02:17:49.029806+0000","last_became_active":"2023-07-09T02:17:46.884603+0000","last_became_peered":"2023-07-09T02:17:46.884603+0000","last_unstale":"2023-07-09T02:17:49.029806+0000","last_undegraded":"2023-07-09T02:17:49.029806+0000","last_fullsized":"2023-07-09T02:17:49.029806+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:55:25.011021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030900+0000","last_change":"2023-07-09T02:17:45.858061+0000","last_active":"2023-07-09T02:17:49.030900+0000","last_peered":"2023-07-09T02:17:49.030900+0000","last_clean":"2023-07-09T02:17:49.030900+0000","last_became_active":"2023-07-09T02:17:45.857796+0000","last_became_peered":"2023-07-09T02:17:45.857796+0000","last_unstale":"2023-07-09T02:17:49.030900+0000","last_undegraded":"2023-07-09T02:17:49.030900+0000","last_fullsized":"2023-07-09T02:17:49.030900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:21:48.327433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":214,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488184+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:17:48.488184+0000","last_peered":"2023-07-09T02:17:48.488184+0000","last_clean":"2023-07-09T02:17:48.488184+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:17:48.488184+0000","last_undegraded":"2023-07-09T02:17:48.488184+0000","last_fullsized":"2023-07-09T02:17:48.488184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:21:06.825725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865281+0000","last_change":"2023-07-09T02:17:46.880985+0000","last_active":"2023-07-09T02:17:47.865281+0000","last_peered":"2023-07-09T02:17:47.865281+0000","last_clean":"2023-07-09T02:17:47.865281+0000","last_became_active":"2023-07-09T02:17:46.880707+0000","last_became_peered":"2023-07-09T02:17:46.880707+0000","last_unstale":"2023-07-09T02:17:47.865281+0000","last_undegraded":"2023-07-09T02:17:47.865281+0000","last_fullsized":"2023-07-09T02:17:47.865281+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:24:38.522226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030770+0000","last_change":"2023-07-09T02:17:45.853031+0000","last_active":"2023-07-09T02:17:49.030770+0000","last_peered":"2023-07-09T02:17:49.030770+0000","last_clean":"2023-07-09T02:17:49.030770+0000","last_became_active":"2023-07-09T02:17:45.852821+0000","last_became_peered":"2023-07-09T02:17:45.852821+0000","last_unstale":"2023-07-09T02:17:49.030770+0000","last_undegraded":"2023-07-09T02:17:49.030770+0000","last_fullsized":"2023-07-09T02:17:49.030770+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:38:23.542025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":216,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030407+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:17:49.030407+0000","last_peered":"2023-07-09T02:17:49.030407+0000","last_clean":"2023-07-09T02:17:49.030407+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:17:49.030407+0000","last_undegraded":"2023-07-09T02:17:49.030407+0000","last_fullsized":"2023-07-09T02:17:49.030407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:46:23.280859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030746+0000","last_change":"2023-07-09T02:17:46.872056+0000","last_active":"2023-07-09T02:17:49.030746+0000","last_peered":"2023-07-09T02:17:49.030746+0000","last_clean":"2023-07-09T02:17:49.030746+0000","last_became_active":"2023-07-09T02:17:46.871344+0000","last_became_peered":"2023-07-09T02:17:46.871344+0000","last_unstale":"2023-07-09T02:17:49.030746+0000","last_undegraded":"2023-07-09T02:17:49.030746+0000","last_fullsized":"2023-07-09T02:17:49.030746+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:58:48.980120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031182+0000","last_change":"2023-07-09T02:17:45.852293+0000","last_active":"2023-07-09T02:17:49.031182+0000","last_peered":"2023-07-09T02:17:49.031182+0000","last_clean":"2023-07-09T02:17:49.031182+0000","last_became_active":"2023-07-09T02:17:45.852026+0000","last_became_peered":"2023-07-09T02:17:45.852026+0000","last_unstale":"2023-07-09T02:17:49.031182+0000","last_undegraded":"2023-07-09T02:17:49.031182+0000","last_fullsized":"2023-07-09T02:17:49.031182+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:08:34.687206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868287+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:17:47.868287+0000","last_peered":"2023-07-09T02:17:47.868287+0000","last_clean":"2023-07-09T02:17:47.868287+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:17:47.868287+0000","last_undegraded":"2023-07-09T02:17:47.868287+0000","last_fullsized":"2023-07-09T02:17:47.868287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:25:03.309197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030108+0000","last_change":"2023-07-09T02:17:46.887243+0000","last_active":"2023-07-09T02:17:49.030108+0000","last_peered":"2023-07-09T02:17:49.030108+0000","last_clean":"2023-07-09T02:17:49.030108+0000","last_became_active":"2023-07-09T02:17:46.886679+0000","last_became_peered":"2023-07-09T02:17:46.886679+0000","last_unstale":"2023-07-09T02:17:49.030108+0000","last_undegraded":"2023-07-09T02:17:49.030108+0000","last_fullsized":"2023-07-09T02:17:49.030108+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:20:28.879722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029639+0000","last_change":"2023-07-09T02:17:45.854498+0000","last_active":"2023-07-09T02:17:49.029639+0000","last_peered":"2023-07-09T02:17:49.029639+0000","last_clean":"2023-07-09T02:17:49.029639+0000","last_became_active":"2023-07-09T02:17:45.854251+0000","last_became_peered":"2023-07-09T02:17:45.854251+0000","last_unstale":"2023-07-09T02:17:49.029639+0000","last_undegraded":"2023-07-09T02:17:49.029639+0000","last_fullsized":"2023-07-09T02:17:49.029639+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:34:13.072420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865519+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:17:47.865519+0000","last_peered":"2023-07-09T02:17:47.865519+0000","last_clean":"2023-07-09T02:17:47.865519+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:17:47.865519+0000","last_undegraded":"2023-07-09T02:17:47.865519+0000","last_fullsized":"2023-07-09T02:17:47.865519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:28:24.045504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867564+0000","last_change":"2023-07-09T02:17:46.880590+0000","last_active":"2023-07-09T02:17:47.867564+0000","last_peered":"2023-07-09T02:17:47.867564+0000","last_clean":"2023-07-09T02:17:47.867564+0000","last_became_active":"2023-07-09T02:17:46.879980+0000","last_became_peered":"2023-07-09T02:17:46.879980+0000","last_unstale":"2023-07-09T02:17:47.867564+0000","last_undegraded":"2023-07-09T02:17:47.867564+0000","last_fullsized":"2023-07-09T02:17:47.867564+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:46:06.366966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868181+0000","last_change":"2023-07-09T02:17:45.850918+0000","last_active":"2023-07-09T02:17:47.868181+0000","last_peered":"2023-07-09T02:17:47.868181+0000","last_clean":"2023-07-09T02:17:47.868181+0000","last_became_active":"2023-07-09T02:17:45.850678+0000","last_became_peered":"2023-07-09T02:17:45.850678+0000","last_unstale":"2023-07-09T02:17:47.868181+0000","last_undegraded":"2023-07-09T02:17:47.868181+0000","last_fullsized":"2023-07-09T02:17:47.868181+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:48:11.659052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":216,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488132+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:17:48.488132+0000","last_peered":"2023-07-09T02:17:48.488132+0000","last_clean":"2023-07-09T02:17:48.488132+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:17:48.488132+0000","last_undegraded":"2023-07-09T02:17:48.488132+0000","last_fullsized":"2023-07-09T02:17:48.488132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:58:36.634563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031140+0000","last_change":"2023-07-09T02:17:46.884457+0000","last_active":"2023-07-09T02:17:49.031140+0000","last_peered":"2023-07-09T02:17:49.031140+0000","last_clean":"2023-07-09T02:17:49.031140+0000","last_became_active":"2023-07-09T02:17:46.884221+0000","last_became_peered":"2023-07-09T02:17:46.884221+0000","last_unstale":"2023-07-09T02:17:49.031140+0000","last_undegraded":"2023-07-09T02:17:49.031140+0000","last_fullsized":"2023-07-09T02:17:49.031140+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:54:38.338328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"137'3","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867846+0000","last_change":"2023-07-09T02:17:45.852920+0000","last_active":"2023-07-09T02:17:47.867846+0000","last_peered":"2023-07-09T02:17:47.867846+0000","last_clean":"2023-07-09T02:17:47.867846+0000","last_became_active":"2023-07-09T02:17:45.852689+0000","last_became_peered":"2023-07-09T02:17:45.852689+0000","last_unstale":"2023-07-09T02:17:47.867846+0000","last_undegraded":"2023-07-09T02:17:47.867846+0000","last_fullsized":"2023-07-09T02:17:47.867846+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:38:22.215233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865156+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:17:47.865156+0000","last_peered":"2023-07-09T02:17:47.865156+0000","last_clean":"2023-07-09T02:17:47.865156+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:17:47.865156+0000","last_undegraded":"2023-07-09T02:17:47.865156+0000","last_fullsized":"2023-07-09T02:17:47.865156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:42:47.335997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867909+0000","last_change":"2023-07-09T02:17:46.875682+0000","last_active":"2023-07-09T02:17:47.867909+0000","last_peered":"2023-07-09T02:17:47.867909+0000","last_clean":"2023-07-09T02:17:47.867909+0000","last_became_active":"2023-07-09T02:17:46.875458+0000","last_became_peered":"2023-07-09T02:17:46.875458+0000","last_unstale":"2023-07-09T02:17:47.867909+0000","last_undegraded":"2023-07-09T02:17:47.867909+0000","last_fullsized":"2023-07-09T02:17:47.867909+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:23:54.072740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"137'6","reported_seq":19,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030938+0000","last_change":"2023-07-09T02:17:45.854415+0000","last_active":"2023-07-09T02:17:49.030938+0000","last_peered":"2023-07-09T02:17:49.030938+0000","last_clean":"2023-07-09T02:17:49.030938+0000","last_became_active":"2023-07-09T02:17:45.854148+0000","last_became_peered":"2023-07-09T02:17:45.854148+0000","last_unstale":"2023-07-09T02:17:49.030938+0000","last_undegraded":"2023-07-09T02:17:49.030938+0000","last_fullsized":"2023-07-09T02:17:49.030938+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:54:36.889515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":214,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029876+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:17:49.029876+0000","last_peered":"2023-07-09T02:17:49.029876+0000","last_clean":"2023-07-09T02:17:49.029876+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:17:49.029876+0000","last_undegraded":"2023-07-09T02:17:49.029876+0000","last_fullsized":"2023-07-09T02:17:49.029876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:42:25.828469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193939,"statfs":{"total":200000000,"available":198594379,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.46600000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.2330000000000001,"15min":1.4950000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88600000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.621}]},{"osd":1,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.41599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":1.423,"15min":1.423},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":1.0269999999999999,"15min":0.79800000000000004},"min":{"1min":0.46800000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92300000000000004,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.74399999999999999,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.89600000000000002,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.97499999999999998,"15min":0.80700000000000005},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.01,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.68000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.93799999999999994,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.83699999999999997,"15min":0.77600000000000002},"min":{"1min":0.55600000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.96899999999999997,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72899999999999998,"5min":0.91100000000000003,"15min":0.91500000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94399999999999995,"5min":1.032,"15min":1.032},"last":0.59899999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.65800000000000003},"min":{"1min":0.504,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78400000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.88900000000000001,"5min":1.048,"15min":1.048},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.73899999999999999},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.087,"15min":1.087},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.87,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199184941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.55200000000000005,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66400000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.92200000000000004,"15min":1.4379999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90700000000000003,"15min":1.165},"last":0.73399999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.59499999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.70999999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":0.625},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.5,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68999999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.998,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":1.117,"15min":1.117},"last":0.755}]},{"osd":5,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88200000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89900000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199185363,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.63900000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86899999999999999,"5min":1.179,"15min":1.179},"last":0.70799999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.65700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68899999999999995,"15min":0.65600000000000003},"min":{"1min":0.58099999999999996,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":0.81000000000000005,"5min":1.103,"15min":1.103},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.56799999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.751}]},{"osd":3,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.77800000000000002,"15min":0.71499999999999997},"min":{"1min":0.54400000000000004,"5min":0.50600000000000001,"15min":0.47399999999999998},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.49399999999999999,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":1.008,"15min":1.008},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63,"15min":0.61399999999999999},"min":{"1min":0.51900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91900000000000004,"5min":1.054,"15min":1.054},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.85399999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51700000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.755},"min":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.48599999999999999},"max":{"1min":0.95099999999999996,"5min":1.091,"15min":1.091},"last":0.67200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199183959,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":1.248,"15min":0.85399999999999998},"min":{"1min":0.38800000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.91400000000000003,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.98999999999999999},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.749,"15min":0.65300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.34100000000000003},"max":{"1min":0.97199999999999998,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.38},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.746},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.0189999999999999,"15min":1.4550000000000001},"last":0.496}]},{"osd":2,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.53800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":1.008,"15min":1.323},"last":0.67000000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.0369999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.5329999999999999,"15min":0.94899999999999995},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.61599999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.86799999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.64500000000000002},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.47299999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68899999999999995,"15min":0.628},"min":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93700000000000006,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70299999999999996,"15min":0.73099999999999998},"min":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.79600000000000004,"15min":0.72099999999999997},"min":{"1min":0.58799999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95599999999999996,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199183925,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.42499999999999999},"min":{"1min":0.32300000000000001,"5min":0.26300000000000001,"15min":0.216},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":1.198},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.27300000000000002,"15min":0.27100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":1.048},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.83999999999999997,"15min":0.85299999999999998},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":0.624,"5min":0.76700000000000002,"15min":1.155},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.1040000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78100000000000003,"15min":0.751},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77300000000000002,"15min":0.71199999999999997},"min":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":1.1899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78300000000000003,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.097,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77600000000000002,"15min":0.76000000000000001},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.49399999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.746},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53600000000000003},"max":{"1min":1.395,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78900000000000003,"15min":0.77700000000000002},"min":{"1min":0.58699999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3149999999999999,"5min":1.367,"15min":1.367},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.77200000000000002},"min":{"1min":0.60899999999999999,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.88}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194517,"statfs":{"total":200000000,"available":199185523,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.52200000000000002,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69399999999999995,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.43099999999999999},"min":{"1min":0.35399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":1.127,"15min":1.127},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47599999999999998,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58299999999999996,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.52400000000000002},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71199999999999997,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.46899999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.5},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.433},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.57899999999999996,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58099999999999996,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.441}]},{"osd":4,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.81499999999999995,"15min":0.753},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.46500000000000002},"max":{"1min":0.998,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77000000000000002,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.67000000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.52500000000000002,"5min":0.499,"15min":0.496},"max":{"1min":1.052,"5min":1.1799999999999999,"15min":1.319},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.99,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80700000000000005,"15min":0.77100000000000002},"min":{"1min":0.56599999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0329999999999999,"5min":1.452,"15min":1.452},"last":0.69099999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.72399999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":1.206,"15min":1.351},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194517,"statfs":{"total":200000000,"available":199185501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.34599999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.57399999999999995,"5min":0.72499999999999998,"15min":0.80300000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48199999999999998,"15min":0.46400000000000002},"min":{"1min":0.307,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.495},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66400000000000003,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.40300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.1080000000000001},"last":0.38700000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.79100000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68999999999999995,"5min":0.85699999999999998,"15min":1.163},"last":0.44900000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.72499999999999998},"min":{"1min":0.53600000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90900000000000003,"5min":0.97499999999999998,"15min":1.026},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.746},"min":{"1min":0.624,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0169999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77300000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.72899999999999998},"min":{"1min":0.56999999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.751},{"interface":"front","average":{"1min":0.748,"5min":0.76300000000000001,"15min":0.72899999999999998},"min":{"1min":0.56000000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88900000000000001,"5min":1.034,"15min":1.034},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.77900000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97599999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.61899999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96199999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78600000000000003,"15min":0.76800000000000002},"min":{"1min":0.55100000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.92500000000000004,"5min":1.129,"15min":1.3600000000000001},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1371,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193940,"statfs":{"total":200000000,"available":198595133,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45400000000000001,"15min":0.42299999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52600000000000002,"15min":0.47499999999999998},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.35199999999999998},"max":{"1min":1.1180000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.45700000000000002},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.88900000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.161,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.46300000000000002,"15min":0.42099999999999999},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.50800000000000001},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.89200000000000002,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.038,"5min":1.0660000000000001,"15min":1.145},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90700000000000003,"5min":1.153,"15min":1.153},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.77400000000000002,"15min":0.79200000000000004},"min":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.47199999999999998},"max":{"1min":1.401,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0680000000000001,"5min":1.238,"15min":1.238},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73299999999999998,"15min":0.74099999999999999},"min":{"1min":0.55200000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98799999999999999,"5min":1.0389999999999999,"15min":1.1040000000000001},"last":0.75},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.748,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53200000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97699999999999998,"5min":1.1180000000000001,"15min":1.1819999999999999},"last":0.78900000000000003}]}]}],"pool_statfs":[]}} 2023-07-09T02:17:50.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:17:51.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd2bfa640 1 Processor -- start 2023-07-09T02:17:51.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd2bfa640 1 -- start start 2023-07-09T02:17:51.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd2bfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc15c060 0x7f8ccc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd2bfa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ccc0cd120 0x7f8ccc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd2bfa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc160a50 con 0x7f8ccc0d2450 2023-07-09T02:17:51.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd2bfa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0d28f0 con 0x7f8ccc0cd120 2023-07-09T02:17:51.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd2bfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0cfe40 con 0x7f8ccc15c060 2023-07-09T02:17:51.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd1197640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8ccc0d2450 0x7f8ccc0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57312/0 (socket says 172.21.15.45:57312) 2023-07-09T02:17:51.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd1197640 1 -- 172.21.15.45:0/1261784983 learned_addr learned my addr 172.21.15.45:0/1261784983 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:51.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd0996640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc15c060 0x7f8ccc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccbfff640 1 --2- 172.21.15.45:0/1261784983 >> v2:172.21.15.155:3300/0 conn(0x7f8ccc0cd120 0x7f8ccc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961602333 0 0) 0x7f8ccc160a50 con 0x7f8ccc0d2450 2023-07-09T02:17:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cbc003530 con 0x7f8ccc0d2450 2023-07-09T02:17:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 627509979 0 0) 0x7f8cbc003530 con 0x7f8ccc0d2450 2023-07-09T02:17:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc15c060 msgr2=0x7f8ccc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc15c060 0x7f8ccc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 >> v2:172.21.15.155:3300/0 conn(0x7f8ccc0cd120 msgr2=0x7f8ccc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 --2- 172.21.15.45:0/1261784983 >> v2:172.21.15.155:3300/0 conn(0x7f8ccc0cd120 0x7f8ccc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc15c430 con 0x7f8ccc0d2450 2023-07-09T02:17:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f8cc4001a00 con 0x7f8ccc0d2450 2023-07-09T02:17:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccbfff640 1 --2- 172.21.15.45:0/1261784983 >> v2:172.21.15.155:3300/0 conn(0x7f8ccc0cd120 0x7f8ccc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 >> v1:172.21.15.45:6789/0 conn(0x7f8ccc0d2450 legacy=0x7f8ccc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc15c060 0x7f8cbc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cbc003f00 0x7f8cbc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8cbc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0cfe40 con 0x7f8cbc004d10 2023-07-09T02:17:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc00b990 con 0x7f8cbc003f00 2023-07-09T02:17:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc00bad0 con 0x7f8ccc15c060 2023-07-09T02:17:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd1197640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8cbc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8cd0996640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc15c060 0x7f8cbc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.172+0000 7f8ccbfff640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cbc003f00 0x7f8cbc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd1197640 1 -- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc15c060 msgr2=0x7f8cbc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd1197640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc15c060 0x7f8cbc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd1197640 1 -- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cbc003f00 msgr2=0x7f8cbc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd1197640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cbc003f00 0x7f8cbc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd1197640 1 -- 172.21.15.45:0/1261784983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc003530 con 0x7f8cbc004d10 2023-07-09T02:17:51.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd1197640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8cbc005180 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400a860 tx=0x7f8cc401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8064a4189d45919 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40ad630 con 0x7f8cbc004d10 2023-07-09T02:17:51.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40a8070 con 0x7f8cbc004d10 2023-07-09T02:17:51.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8ccb7fe640 1 -- 172.21.15.45:0/1261784983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40ada30 con 0x7f8cbc004d10 2023-07-09T02:17:51.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/1261784983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 msgr2=0x7f8cbc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd2bfa640 1 --2- 172.21.15.45:0/1261784983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8cbc005180 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400a860 tx=0x7f8cc401d360 comp rx=0 tx=0).stop 2023-07-09T02:17:51.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd1197640 1 -- 172.21.15.45:0/1261784983 reap_dead start 2023-07-09T02:17:51.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/1261784983 shutdown_connections 2023-07-09T02:17:51.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.176+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/1261784983 >> 172.21.15.45:0/1261784983 conn(0x7f8ccc0698e0 msgr2=0x7f8ccc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:51.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/1261784983 shutdown_connections 2023-07-09T02:17:51.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/1261784983 wait complete. 2023-07-09T02:17:51.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 Processor -- start 2023-07-09T02:17:51.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 -- start start 2023-07-09T02:17:51.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8ccc14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc0ca4d0 0x7f8ccc0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ccc0cb4c0 0x7f8ccc0cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b6180 con 0x7f8cbc004d10 2023-07-09T02:17:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0cbe50 con 0x7f8ccc0cb4c0 2023-07-09T02:17:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b5870 con 0x7f8ccc0ca4d0 2023-07-09T02:17:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8ccc14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8ccc14e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40900/0 (socket says 172.21.15.45:40900) 2023-07-09T02:17:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 -- 172.21.15.45:0/186697066 learned_addr learned my addr 172.21.15.45:0/186697066 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:51.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8ccbfff640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc0ca4d0 0x7f8ccc0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd1197640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ccc0cb4c0 0x7f8ccc0cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 -- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc0ca4d0 msgr2=0x7f8ccc0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc0ca4d0 0x7f8ccc0ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 -- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ccc0cb4c0 msgr2=0x7f8ccc0cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ccc0cb4c0 0x7f8ccc0cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 -- 172.21.15.45:0/186697066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0cafe0 con 0x7f8cbc004d10 2023-07-09T02:17:51.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8ccbfff640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc0ca4d0 0x7f8ccc0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:51.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd0996640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8ccc14e2b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0011a00 tx=0x7f8cc0011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cc97fa640 1 -- 172.21.15.45:0/186697066 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000faf0 con 0x7f8cbc004d10 2023-07-09T02:17:51.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc0b5ac0 con 0x7f8cbc004d10 2023-07-09T02:17:51.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cc97fa640 1 -- 172.21.15.45:0/186697066 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000fc50 con 0x7f8cbc004d10 2023-07-09T02:17:51.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.180+0000 7f8cc97fa640 1 -- 172.21.15.45:0/186697066 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0014440 con 0x7f8cbc004d10 2023-07-09T02:17:51.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.184+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc14e7f0 con 0x7f8cbc004d10 2023-07-09T02:17:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.184+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc04d7d0 con 0x7f8cbc004d10 2023-07-09T02:17:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.184+0000 7f8cc97fa640 1 -- 172.21.15.45:0/186697066 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8cc00145a0 con 0x7f8cbc004d10 2023-07-09T02:17:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.184+0000 7f8cc97fa640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb00662b0 0x7f8cb0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.184+0000 7f8cc97fa640 1 -- 172.21.15.45:0/186697066 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8cc0084590 con 0x7f8cbc004d10 2023-07-09T02:17:51.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.184+0000 7f8ccbfff640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb00662b0 0x7f8cb0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.188+0000 7f8ccbfff640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb00662b0 0x7f8cb0068760 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0b1880 tx=0x7f8cb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.188+0000 7f8cc97fa640 1 -- 172.21.15.45:0/186697066 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8cc0051ac0 con 0x7f8cbc004d10 2023-07-09T02:17:51.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.340+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ccc15fe40 con 0x7f8cb00662b0 2023-07-09T02:17:51.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.348+0000 7f8cc97fa640 1 -- 172.21.15.45:0/186697066 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306031 (secure 0 0 0) 0x7f8cb80099c0 con 0x7f8cb00662b0 2023-07-09T02:17:51.352 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:51.353 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:17:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb00662b0 msgr2=0x7f8cb0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb00662b0 0x7f8cb0068760 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0b1880 tx=0x7f8cb8008040 comp rx=0 tx=0).stop 2023-07-09T02:17:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 msgr2=0x7f8ccc14e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8ccc14e2b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0011a00 tx=0x7f8cc0011ec0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 shutdown_connections 2023-07-09T02:17:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ccc0cb4c0 0x7f8ccc0cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cb00662b0 0x7f8cb0068760 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ccc0ca4d0 0x7f8ccc0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 --2- 172.21.15.45:0/186697066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cbc004d10 0x7f8ccc14e2b0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 >> 172.21.15.45:0/186697066 conn(0x7f8ccc0698e0 msgr2=0x7f8ccc0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 shutdown_connections 2023-07-09T02:17:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.352+0000 7f8cd2bfa640 1 -- 172.21.15.45:0/186697066 wait complete. 2023-07-09T02:17:51.372 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2023-07-09T02:17:50.622880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7520,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554979,"statfs":{"total":1600000000,"available":1592298724,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.779296"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029928+0000","last_change":"2023-07-09T02:17:46.871630+0000","last_active":"2023-07-09T02:17:49.029928+0000","last_peered":"2023-07-09T02:17:49.029928+0000","last_clean":"2023-07-09T02:17:49.029928+0000","last_became_active":"2023-07-09T02:17:46.871395+0000","last_became_peered":"2023-07-09T02:17:46.871395+0000","last_unstale":"2023-07-09T02:17:49.029928+0000","last_undegraded":"2023-07-09T02:17:49.029928+0000","last_fullsized":"2023-07-09T02:17:49.029928+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:20:10.276873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031032+0000","last_change":"2023-07-09T02:17:46.880570+0000","last_active":"2023-07-09T02:17:49.031032+0000","last_peered":"2023-07-09T02:17:49.031032+0000","last_clean":"2023-07-09T02:17:49.031032+0000","last_became_active":"2023-07-09T02:17:46.880338+0000","last_became_peered":"2023-07-09T02:17:46.880338+0000","last_unstale":"2023-07-09T02:17:49.031032+0000","last_undegraded":"2023-07-09T02:17:49.031032+0000","last_fullsized":"2023-07-09T02:17:49.031032+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:53:10.097026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031228+0000","last_change":"2023-07-09T02:17:46.888433+0000","last_active":"2023-07-09T02:17:49.031228+0000","last_peered":"2023-07-09T02:17:49.031228+0000","last_clean":"2023-07-09T02:17:49.031228+0000","last_became_active":"2023-07-09T02:17:46.887916+0000","last_became_peered":"2023-07-09T02:17:46.887916+0000","last_unstale":"2023-07-09T02:17:49.031228+0000","last_undegraded":"2023-07-09T02:17:49.031228+0000","last_fullsized":"2023-07-09T02:17:49.031228+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:07:19.731989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488087+0000","last_change":"2023-07-09T02:17:46.885243+0000","last_active":"2023-07-09T02:17:48.488087+0000","last_peered":"2023-07-09T02:17:48.488087+0000","last_clean":"2023-07-09T02:17:48.488087+0000","last_became_active":"2023-07-09T02:17:46.884082+0000","last_became_peered":"2023-07-09T02:17:46.884082+0000","last_unstale":"2023-07-09T02:17:48.488087+0000","last_undegraded":"2023-07-09T02:17:48.488087+0000","last_fullsized":"2023-07-09T02:17:48.488087+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:56:32.284084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030111+0000","last_change":"2023-07-09T02:17:46.878970+0000","last_active":"2023-07-09T02:17:49.030111+0000","last_peered":"2023-07-09T02:17:49.030111+0000","last_clean":"2023-07-09T02:17:49.030111+0000","last_became_active":"2023-07-09T02:17:46.878746+0000","last_became_peered":"2023-07-09T02:17:46.878746+0000","last_unstale":"2023-07-09T02:17:49.030111+0000","last_undegraded":"2023-07-09T02:17:49.030111+0000","last_fullsized":"2023-07-09T02:17:49.030111+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:40:00.055698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868307+0000","last_change":"2023-07-09T02:17:46.876932+0000","last_active":"2023-07-09T02:17:47.868307+0000","last_peered":"2023-07-09T02:17:47.868307+0000","last_clean":"2023-07-09T02:17:47.868307+0000","last_became_active":"2023-07-09T02:17:46.876675+0000","last_became_peered":"2023-07-09T02:17:46.876675+0000","last_unstale":"2023-07-09T02:17:47.868307+0000","last_undegraded":"2023-07-09T02:17:47.868307+0000","last_fullsized":"2023-07-09T02:17:47.868307+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:42:15.068085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868351+0000","last_change":"2023-07-09T02:17:46.880618+0000","last_active":"2023-07-09T02:17:47.868351+0000","last_peered":"2023-07-09T02:17:47.868351+0000","last_clean":"2023-07-09T02:17:47.868351+0000","last_became_active":"2023-07-09T02:17:46.880384+0000","last_became_peered":"2023-07-09T02:17:46.880384+0000","last_unstale":"2023-07-09T02:17:47.868351+0000","last_undegraded":"2023-07-09T02:17:47.868351+0000","last_fullsized":"2023-07-09T02:17:47.868351+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:58:07.848370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031901+0000","last_change":"2023-07-09T02:17:46.888313+0000","last_active":"2023-07-09T02:17:49.031901+0000","last_peered":"2023-07-09T02:17:49.031901+0000","last_clean":"2023-07-09T02:17:49.031901+0000","last_became_active":"2023-07-09T02:17:46.887620+0000","last_became_peered":"2023-07-09T02:17:46.887620+0000","last_unstale":"2023-07-09T02:17:49.031901+0000","last_undegraded":"2023-07-09T02:17:49.031901+0000","last_fullsized":"2023-07-09T02:17:49.031901+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:35:04.948331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487851+0000","last_change":"2023-07-09T02:17:46.885090+0000","last_active":"2023-07-09T02:17:48.487851+0000","last_peered":"2023-07-09T02:17:48.487851+0000","last_clean":"2023-07-09T02:17:48.487851+0000","last_became_active":"2023-07-09T02:17:46.883794+0000","last_became_peered":"2023-07-09T02:17:46.883794+0000","last_unstale":"2023-07-09T02:17:48.487851+0000","last_undegraded":"2023-07-09T02:17:48.487851+0000","last_fullsized":"2023-07-09T02:17:48.487851+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:14:10.192590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865318+0000","last_change":"2023-07-09T02:17:46.875831+0000","last_active":"2023-07-09T02:17:47.865318+0000","last_peered":"2023-07-09T02:17:47.865318+0000","last_clean":"2023-07-09T02:17:47.865318+0000","last_became_active":"2023-07-09T02:17:46.875472+0000","last_became_peered":"2023-07-09T02:17:46.875472+0000","last_unstale":"2023-07-09T02:17:47.865318+0000","last_undegraded":"2023-07-09T02:17:47.865318+0000","last_fullsized":"2023-07-09T02:17:47.865318+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:07:47.978709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030206+0000","last_change":"2023-07-09T02:17:46.871142+0000","last_active":"2023-07-09T02:17:49.030206+0000","last_peered":"2023-07-09T02:17:49.030206+0000","last_clean":"2023-07-09T02:17:49.030206+0000","last_became_active":"2023-07-09T02:17:46.870908+0000","last_became_peered":"2023-07-09T02:17:46.870908+0000","last_unstale":"2023-07-09T02:17:49.030206+0000","last_undegraded":"2023-07-09T02:17:49.030206+0000","last_fullsized":"2023-07-09T02:17:49.030206+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:02:13.179875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868508+0000","last_change":"2023-07-09T02:17:46.875426+0000","last_active":"2023-07-09T02:17:47.868508+0000","last_peered":"2023-07-09T02:17:47.868508+0000","last_clean":"2023-07-09T02:17:47.868508+0000","last_became_active":"2023-07-09T02:17:46.875113+0000","last_became_peered":"2023-07-09T02:17:46.875113+0000","last_unstale":"2023-07-09T02:17:47.868508+0000","last_undegraded":"2023-07-09T02:17:47.868508+0000","last_fullsized":"2023-07-09T02:17:47.868508+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:14:55.435619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865075+0000","last_change":"2023-07-09T02:17:46.871345+0000","last_active":"2023-07-09T02:17:47.865075+0000","last_peered":"2023-07-09T02:17:47.865075+0000","last_clean":"2023-07-09T02:17:47.865075+0000","last_became_active":"2023-07-09T02:17:46.871075+0000","last_became_peered":"2023-07-09T02:17:46.871075+0000","last_unstale":"2023-07-09T02:17:47.865075+0000","last_undegraded":"2023-07-09T02:17:47.865075+0000","last_fullsized":"2023-07-09T02:17:47.865075+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:37:17.253342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030661+0000","last_change":"2023-07-09T02:17:46.889597+0000","last_active":"2023-07-09T02:17:49.030661+0000","last_peered":"2023-07-09T02:17:49.030661+0000","last_clean":"2023-07-09T02:17:49.030661+0000","last_became_active":"2023-07-09T02:17:46.889140+0000","last_became_peered":"2023-07-09T02:17:46.889140+0000","last_unstale":"2023-07-09T02:17:49.030661+0000","last_undegraded":"2023-07-09T02:17:49.030661+0000","last_fullsized":"2023-07-09T02:17:49.030661+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:41:10.611226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030301+0000","last_change":"2023-07-09T02:17:46.871458+0000","last_active":"2023-07-09T02:17:49.030301+0000","last_peered":"2023-07-09T02:17:49.030301+0000","last_clean":"2023-07-09T02:17:49.030301+0000","last_became_active":"2023-07-09T02:17:46.871232+0000","last_became_peered":"2023-07-09T02:17:46.871232+0000","last_unstale":"2023-07-09T02:17:49.030301+0000","last_undegraded":"2023-07-09T02:17:49.030301+0000","last_fullsized":"2023-07-09T02:17:49.030301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:53:54.641276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868452+0000","last_change":"2023-07-09T02:17:46.875355+0000","last_active":"2023-07-09T02:17:47.868452+0000","last_peered":"2023-07-09T02:17:47.868452+0000","last_clean":"2023-07-09T02:17:47.868452+0000","last_became_active":"2023-07-09T02:17:46.875117+0000","last_became_peered":"2023-07-09T02:17:46.875117+0000","last_unstale":"2023-07-09T02:17:47.868452+0000","last_undegraded":"2023-07-09T02:17:47.868452+0000","last_fullsized":"2023-07-09T02:17:47.868452+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:06:14.906001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865036+0000","last_change":"2023-07-09T02:17:46.872834+0000","last_active":"2023-07-09T02:17:47.865036+0000","last_peered":"2023-07-09T02:17:47.865036+0000","last_clean":"2023-07-09T02:17:47.865036+0000","last_became_active":"2023-07-09T02:17:46.872552+0000","last_became_peered":"2023-07-09T02:17:46.872552+0000","last_unstale":"2023-07-09T02:17:47.865036+0000","last_undegraded":"2023-07-09T02:17:47.865036+0000","last_fullsized":"2023-07-09T02:17:47.865036+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:56:26.105285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031349+0000","last_change":"2023-07-09T02:17:46.881903+0000","last_active":"2023-07-09T02:17:49.031349+0000","last_peered":"2023-07-09T02:17:49.031349+0000","last_clean":"2023-07-09T02:17:49.031349+0000","last_became_active":"2023-07-09T02:17:46.881536+0000","last_became_peered":"2023-07-09T02:17:46.881536+0000","last_unstale":"2023-07-09T02:17:49.031349+0000","last_undegraded":"2023-07-09T02:17:49.031349+0000","last_fullsized":"2023-07-09T02:17:49.031349+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:36:18.032844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029911+0000","last_change":"2023-07-09T02:17:46.887396+0000","last_active":"2023-07-09T02:17:49.029911+0000","last_peered":"2023-07-09T02:17:49.029911+0000","last_clean":"2023-07-09T02:17:49.029911+0000","last_became_active":"2023-07-09T02:17:46.886993+0000","last_became_peered":"2023-07-09T02:17:46.886993+0000","last_unstale":"2023-07-09T02:17:49.029911+0000","last_undegraded":"2023-07-09T02:17:49.029911+0000","last_fullsized":"2023-07-09T02:17:49.029911+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:47:35.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030706+0000","last_change":"2023-07-09T02:17:46.873577+0000","last_active":"2023-07-09T02:17:49.030706+0000","last_peered":"2023-07-09T02:17:49.030706+0000","last_clean":"2023-07-09T02:17:49.030706+0000","last_became_active":"2023-07-09T02:17:46.873344+0000","last_became_peered":"2023-07-09T02:17:46.873344+0000","last_unstale":"2023-07-09T02:17:49.030706+0000","last_undegraded":"2023-07-09T02:17:49.030706+0000","last_fullsized":"2023-07-09T02:17:49.030706+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:28:02.053084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487559+0000","last_change":"2023-07-09T02:17:46.879717+0000","last_active":"2023-07-09T02:17:48.487559+0000","last_peered":"2023-07-09T02:17:48.487559+0000","last_clean":"2023-07-09T02:17:48.487559+0000","last_became_active":"2023-07-09T02:17:46.879452+0000","last_became_peered":"2023-07-09T02:17:46.879452+0000","last_unstale":"2023-07-09T02:17:48.487559+0000","last_undegraded":"2023-07-09T02:17:48.487559+0000","last_fullsized":"2023-07-09T02:17:48.487559+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:57:07.697854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030141+0000","last_change":"2023-07-09T02:17:46.870227+0000","last_active":"2023-07-09T02:17:49.030141+0000","last_peered":"2023-07-09T02:17:49.030141+0000","last_clean":"2023-07-09T02:17:49.030141+0000","last_became_active":"2023-07-09T02:17:46.869991+0000","last_became_peered":"2023-07-09T02:17:46.869991+0000","last_unstale":"2023-07-09T02:17:49.030141+0000","last_undegraded":"2023-07-09T02:17:49.030141+0000","last_fullsized":"2023-07-09T02:17:49.030141+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:49:32.525875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487519+0000","last_change":"2023-07-09T02:17:46.880305+0000","last_active":"2023-07-09T02:17:48.487519+0000","last_peered":"2023-07-09T02:17:48.487519+0000","last_clean":"2023-07-09T02:17:48.487519+0000","last_became_active":"2023-07-09T02:17:46.879575+0000","last_became_peered":"2023-07-09T02:17:46.879575+0000","last_unstale":"2023-07-09T02:17:48.487519+0000","last_undegraded":"2023-07-09T02:17:48.487519+0000","last_fullsized":"2023-07-09T02:17:48.487519+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:55:02.877523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867394+0000","last_change":"2023-07-09T02:17:46.889505+0000","last_active":"2023-07-09T02:17:47.867394+0000","last_peered":"2023-07-09T02:17:47.867394+0000","last_clean":"2023-07-09T02:17:47.867394+0000","last_became_active":"2023-07-09T02:17:46.889199+0000","last_became_peered":"2023-07-09T02:17:46.889199+0000","last_unstale":"2023-07-09T02:17:47.867394+0000","last_undegraded":"2023-07-09T02:17:47.867394+0000","last_fullsized":"2023-07-09T02:17:47.867394+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:31:27.816581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867752+0000","last_change":"2023-07-09T02:17:46.872644+0000","last_active":"2023-07-09T02:17:47.867752+0000","last_peered":"2023-07-09T02:17:47.867752+0000","last_clean":"2023-07-09T02:17:47.867752+0000","last_became_active":"2023-07-09T02:17:46.872417+0000","last_became_peered":"2023-07-09T02:17:46.872417+0000","last_unstale":"2023-07-09T02:17:47.867752+0000","last_undegraded":"2023-07-09T02:17:47.867752+0000","last_fullsized":"2023-07-09T02:17:47.867752+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:13:11.658054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030626+0000","last_change":"2023-07-09T02:17:46.871561+0000","last_active":"2023-07-09T02:17:49.030626+0000","last_peered":"2023-07-09T02:17:49.030626+0000","last_clean":"2023-07-09T02:17:49.030626+0000","last_became_active":"2023-07-09T02:17:46.870628+0000","last_became_peered":"2023-07-09T02:17:46.870628+0000","last_unstale":"2023-07-09T02:17:49.030626+0000","last_undegraded":"2023-07-09T02:17:49.030626+0000","last_fullsized":"2023-07-09T02:17:49.030626+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:44:19.081241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029778+0000","last_change":"2023-07-09T02:17:46.883308+0000","last_active":"2023-07-09T02:17:49.029778+0000","last_peered":"2023-07-09T02:17:49.029778+0000","last_clean":"2023-07-09T02:17:49.029778+0000","last_became_active":"2023-07-09T02:17:46.883080+0000","last_became_peered":"2023-07-09T02:17:46.883080+0000","last_unstale":"2023-07-09T02:17:49.029778+0000","last_undegraded":"2023-07-09T02:17:49.029778+0000","last_fullsized":"2023-07-09T02:17:49.029778+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:41:13.310217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868184+0000","last_change":"2023-07-09T02:17:46.874885+0000","last_active":"2023-07-09T02:17:47.868184+0000","last_peered":"2023-07-09T02:17:47.868184+0000","last_clean":"2023-07-09T02:17:47.868184+0000","last_became_active":"2023-07-09T02:17:46.874643+0000","last_became_peered":"2023-07-09T02:17:46.874643+0000","last_unstale":"2023-07-09T02:17:47.868184+0000","last_undegraded":"2023-07-09T02:17:47.868184+0000","last_fullsized":"2023-07-09T02:17:47.868184+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:22:07.860973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030326+0000","last_change":"2023-07-09T02:17:46.870420+0000","last_active":"2023-07-09T02:17:49.030326+0000","last_peered":"2023-07-09T02:17:49.030326+0000","last_clean":"2023-07-09T02:17:49.030326+0000","last_became_active":"2023-07-09T02:17:46.870163+0000","last_became_peered":"2023-07-09T02:17:46.870163+0000","last_unstale":"2023-07-09T02:17:49.030326+0000","last_undegraded":"2023-07-09T02:17:49.030326+0000","last_fullsized":"2023-07-09T02:17:49.030326+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:32:27.262448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030594+0000","last_change":"2023-07-09T02:17:46.870392+0000","last_active":"2023-07-09T02:17:49.030594+0000","last_peered":"2023-07-09T02:17:49.030594+0000","last_clean":"2023-07-09T02:17:49.030594+0000","last_became_active":"2023-07-09T02:17:46.869701+0000","last_became_peered":"2023-07-09T02:17:46.869701+0000","last_unstale":"2023-07-09T02:17:49.030594+0000","last_undegraded":"2023-07-09T02:17:49.030594+0000","last_fullsized":"2023-07-09T02:17:49.030594+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:45:43.770106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867737+0000","last_change":"2023-07-09T02:17:46.873937+0000","last_active":"2023-07-09T02:17:47.867737+0000","last_peered":"2023-07-09T02:17:47.867737+0000","last_clean":"2023-07-09T02:17:47.867737+0000","last_became_active":"2023-07-09T02:17:46.873714+0000","last_became_peered":"2023-07-09T02:17:46.873714+0000","last_unstale":"2023-07-09T02:17:47.867737+0000","last_undegraded":"2023-07-09T02:17:47.867737+0000","last_fullsized":"2023-07-09T02:17:47.867737+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:54:34.333976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867977+0000","last_change":"2023-07-09T02:17:46.885992+0000","last_active":"2023-07-09T02:17:47.867977+0000","last_peered":"2023-07-09T02:17:47.867977+0000","last_clean":"2023-07-09T02:17:47.867977+0000","last_became_active":"2023-07-09T02:17:46.885703+0000","last_became_peered":"2023-07-09T02:17:46.885703+0000","last_unstale":"2023-07-09T02:17:47.867977+0000","last_undegraded":"2023-07-09T02:17:47.867977+0000","last_fullsized":"2023-07-09T02:17:47.867977+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:03:57.221535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865072+0000","last_change":"2023-07-09T02:17:46.877269+0000","last_active":"2023-07-09T02:17:47.865072+0000","last_peered":"2023-07-09T02:17:47.865072+0000","last_clean":"2023-07-09T02:17:47.865072+0000","last_became_active":"2023-07-09T02:17:46.876881+0000","last_became_peered":"2023-07-09T02:17:46.876881+0000","last_unstale":"2023-07-09T02:17:47.865072+0000","last_undegraded":"2023-07-09T02:17:47.865072+0000","last_fullsized":"2023-07-09T02:17:47.865072+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:23.093754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"137'4","reported_seq":17,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030055+0000","last_change":"2023-07-09T02:17:45.857553+0000","last_active":"2023-07-09T02:17:49.030055+0000","last_peered":"2023-07-09T02:17:49.030055+0000","last_clean":"2023-07-09T02:17:49.030055+0000","last_became_active":"2023-07-09T02:17:45.857205+0000","last_became_peered":"2023-07-09T02:17:45.857205+0000","last_unstale":"2023-07-09T02:17:49.030055+0000","last_undegraded":"2023-07-09T02:17:49.030055+0000","last_fullsized":"2023-07-09T02:17:49.030055+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:21:05.142111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868383+0000","last_change":"2023-07-09T02:17:46.875823+0000","last_active":"2023-07-09T02:17:47.868383+0000","last_peered":"2023-07-09T02:17:47.868383+0000","last_clean":"2023-07-09T02:17:47.868383+0000","last_became_active":"2023-07-09T02:17:46.875590+0000","last_became_peered":"2023-07-09T02:17:46.875590+0000","last_unstale":"2023-07-09T02:17:47.868383+0000","last_undegraded":"2023-07-09T02:17:47.868383+0000","last_fullsized":"2023-07-09T02:17:47.868383+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:17:27.006570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865137+0000","last_change":"2023-07-09T02:17:45.852775+0000","last_active":"2023-07-09T02:17:47.865137+0000","last_peered":"2023-07-09T02:17:47.865137+0000","last_clean":"2023-07-09T02:17:47.865137+0000","last_became_active":"2023-07-09T02:17:45.852555+0000","last_became_peered":"2023-07-09T02:17:45.852555+0000","last_unstale":"2023-07-09T02:17:47.865137+0000","last_undegraded":"2023-07-09T02:17:47.865137+0000","last_fullsized":"2023-07-09T02:17:47.865137+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:38:51.055273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867541+0000","last_change":"2023-07-09T02:17:46.879753+0000","last_active":"2023-07-09T02:17:47.867541+0000","last_peered":"2023-07-09T02:17:47.867541+0000","last_clean":"2023-07-09T02:17:47.867541+0000","last_became_active":"2023-07-09T02:17:46.879509+0000","last_became_peered":"2023-07-09T02:17:46.879509+0000","last_unstale":"2023-07-09T02:17:47.867541+0000","last_undegraded":"2023-07-09T02:17:47.867541+0000","last_fullsized":"2023-07-09T02:17:47.867541+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:50.263091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487708+0000","last_change":"2023-07-09T02:17:45.857403+0000","last_active":"2023-07-09T02:17:48.487708+0000","last_peered":"2023-07-09T02:17:48.487708+0000","last_clean":"2023-07-09T02:17:48.487708+0000","last_became_active":"2023-07-09T02:17:45.857127+0000","last_became_peered":"2023-07-09T02:17:45.857127+0000","last_unstale":"2023-07-09T02:17:48.487708+0000","last_undegraded":"2023-07-09T02:17:48.487708+0000","last_fullsized":"2023-07-09T02:17:48.487708+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:00:53.574039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488078+0000","last_change":"2023-07-09T02:17:46.882051+0000","last_active":"2023-07-09T02:17:48.488078+0000","last_peered":"2023-07-09T02:17:48.488078+0000","last_clean":"2023-07-09T02:17:48.488078+0000","last_became_active":"2023-07-09T02:17:46.881228+0000","last_became_peered":"2023-07-09T02:17:46.881228+0000","last_unstale":"2023-07-09T02:17:48.488078+0000","last_undegraded":"2023-07-09T02:17:48.488078+0000","last_fullsized":"2023-07-09T02:17:48.488078+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:15:53.927098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865356+0000","last_change":"2023-07-09T02:17:45.856549+0000","last_active":"2023-07-09T02:17:47.865356+0000","last_peered":"2023-07-09T02:17:47.865356+0000","last_clean":"2023-07-09T02:17:47.865356+0000","last_became_active":"2023-07-09T02:17:45.856110+0000","last_became_peered":"2023-07-09T02:17:45.856110+0000","last_unstale":"2023-07-09T02:17:47.865356+0000","last_undegraded":"2023-07-09T02:17:47.865356+0000","last_fullsized":"2023-07-09T02:17:47.865356+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:51:13.227894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865447+0000","last_change":"2023-07-09T02:17:46.879826+0000","last_active":"2023-07-09T02:17:47.865447+0000","last_peered":"2023-07-09T02:17:47.865447+0000","last_clean":"2023-07-09T02:17:47.865447+0000","last_became_active":"2023-07-09T02:17:46.879581+0000","last_became_peered":"2023-07-09T02:17:46.879581+0000","last_unstale":"2023-07-09T02:17:47.865447+0000","last_undegraded":"2023-07-09T02:17:47.865447+0000","last_fullsized":"2023-07-09T02:17:47.865447+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:35:22.193696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030385+0000","last_change":"2023-07-09T02:17:45.854063+0000","last_active":"2023-07-09T02:17:49.030385+0000","last_peered":"2023-07-09T02:17:49.030385+0000","last_clean":"2023-07-09T02:17:49.030385+0000","last_became_active":"2023-07-09T02:17:45.853658+0000","last_became_peered":"2023-07-09T02:17:45.853658+0000","last_unstale":"2023-07-09T02:17:49.030385+0000","last_undegraded":"2023-07-09T02:17:49.030385+0000","last_fullsized":"2023-07-09T02:17:49.030385+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:01:35.118304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029857+0000","last_change":"2023-07-09T02:17:46.884218+0000","last_active":"2023-07-09T02:17:49.029857+0000","last_peered":"2023-07-09T02:17:49.029857+0000","last_clean":"2023-07-09T02:17:49.029857+0000","last_became_active":"2023-07-09T02:17:46.883996+0000","last_became_peered":"2023-07-09T02:17:46.883996+0000","last_unstale":"2023-07-09T02:17:49.029857+0000","last_undegraded":"2023-07-09T02:17:49.029857+0000","last_fullsized":"2023-07-09T02:17:49.029857+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:20:22.587889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868279+0000","last_change":"2023-07-09T02:17:45.855486+0000","last_active":"2023-07-09T02:17:47.868279+0000","last_peered":"2023-07-09T02:17:47.868279+0000","last_clean":"2023-07-09T02:17:47.868279+0000","last_became_active":"2023-07-09T02:17:45.855076+0000","last_became_peered":"2023-07-09T02:17:45.855076+0000","last_unstale":"2023-07-09T02:17:47.868279+0000","last_undegraded":"2023-07-09T02:17:47.868279+0000","last_fullsized":"2023-07-09T02:17:47.868279+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:28:15.084681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031468+0000","last_change":"2023-07-09T02:17:46.870068+0000","last_active":"2023-07-09T02:17:49.031468+0000","last_peered":"2023-07-09T02:17:49.031468+0000","last_clean":"2023-07-09T02:17:49.031468+0000","last_became_active":"2023-07-09T02:17:46.869823+0000","last_became_peered":"2023-07-09T02:17:46.869823+0000","last_unstale":"2023-07-09T02:17:49.031468+0000","last_undegraded":"2023-07-09T02:17:49.031468+0000","last_fullsized":"2023-07-09T02:17:49.031468+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:38:33.486081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867802+0000","last_change":"2023-07-09T02:17:45.853123+0000","last_active":"2023-07-09T02:17:47.867802+0000","last_peered":"2023-07-09T02:17:47.867802+0000","last_clean":"2023-07-09T02:17:47.867802+0000","last_became_active":"2023-07-09T02:17:45.852882+0000","last_became_peered":"2023-07-09T02:17:45.852882+0000","last_unstale":"2023-07-09T02:17:47.867802+0000","last_undegraded":"2023-07-09T02:17:47.867802+0000","last_fullsized":"2023-07-09T02:17:47.867802+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:57:45.280680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865165+0000","last_change":"2023-07-09T02:17:46.870611+0000","last_active":"2023-07-09T02:17:47.865165+0000","last_peered":"2023-07-09T02:17:47.865165+0000","last_clean":"2023-07-09T02:17:47.865165+0000","last_became_active":"2023-07-09T02:17:46.870375+0000","last_became_peered":"2023-07-09T02:17:46.870375+0000","last_unstale":"2023-07-09T02:17:47.865165+0000","last_undegraded":"2023-07-09T02:17:47.865165+0000","last_fullsized":"2023-07-09T02:17:47.865165+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:46:50.449036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868598+0000","last_change":"2023-07-09T02:17:45.857084+0000","last_active":"2023-07-09T02:17:47.868598+0000","last_peered":"2023-07-09T02:17:47.868598+0000","last_clean":"2023-07-09T02:17:47.868598+0000","last_became_active":"2023-07-09T02:17:45.856580+0000","last_became_peered":"2023-07-09T02:17:45.856580+0000","last_unstale":"2023-07-09T02:17:47.868598+0000","last_undegraded":"2023-07-09T02:17:47.868598+0000","last_fullsized":"2023-07-09T02:17:47.868598+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:09:41.675834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868103+0000","last_change":"2023-07-09T02:17:46.874338+0000","last_active":"2023-07-09T02:17:47.868103+0000","last_peered":"2023-07-09T02:17:47.868103+0000","last_clean":"2023-07-09T02:17:47.868103+0000","last_became_active":"2023-07-09T02:17:46.874080+0000","last_became_peered":"2023-07-09T02:17:46.874080+0000","last_unstale":"2023-07-09T02:17:47.868103+0000","last_undegraded":"2023-07-09T02:17:47.868103+0000","last_fullsized":"2023-07-09T02:17:47.868103+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:55:44.648464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.864995+0000","last_change":"2023-07-09T02:17:45.854337+0000","last_active":"2023-07-09T02:17:47.864995+0000","last_peered":"2023-07-09T02:17:47.864995+0000","last_clean":"2023-07-09T02:17:47.864995+0000","last_became_active":"2023-07-09T02:17:45.854113+0000","last_became_peered":"2023-07-09T02:17:45.854113+0000","last_unstale":"2023-07-09T02:17:47.864995+0000","last_undegraded":"2023-07-09T02:17:47.864995+0000","last_fullsized":"2023-07-09T02:17:47.864995+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:48:26.546397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030352+0000","last_change":"2023-07-09T02:17:46.875893+0000","last_active":"2023-07-09T02:17:49.030352+0000","last_peered":"2023-07-09T02:17:49.030352+0000","last_clean":"2023-07-09T02:17:49.030352+0000","last_became_active":"2023-07-09T02:17:46.875672+0000","last_became_peered":"2023-07-09T02:17:46.875672+0000","last_unstale":"2023-07-09T02:17:49.030352+0000","last_undegraded":"2023-07-09T02:17:49.030352+0000","last_fullsized":"2023-07-09T02:17:49.030352+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:10:49.326039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030798+0000","last_change":"2023-07-09T02:17:45.851038+0000","last_active":"2023-07-09T02:17:49.030798+0000","last_peered":"2023-07-09T02:17:49.030798+0000","last_clean":"2023-07-09T02:17:49.030798+0000","last_became_active":"2023-07-09T02:17:45.850793+0000","last_became_peered":"2023-07-09T02:17:45.850793+0000","last_unstale":"2023-07-09T02:17:49.030798+0000","last_undegraded":"2023-07-09T02:17:49.030798+0000","last_fullsized":"2023-07-09T02:17:49.030798+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:08:45.975911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868468+0000","last_change":"2023-07-09T02:17:46.880482+0000","last_active":"2023-07-09T02:17:47.868468+0000","last_peered":"2023-07-09T02:17:47.868468+0000","last_clean":"2023-07-09T02:17:47.868468+0000","last_became_active":"2023-07-09T02:17:46.880213+0000","last_became_peered":"2023-07-09T02:17:46.880213+0000","last_unstale":"2023-07-09T02:17:47.868468+0000","last_undegraded":"2023-07-09T02:17:47.868468+0000","last_fullsized":"2023-07-09T02:17:47.868468+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:28:34.680258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487662+0000","last_change":"2023-07-09T02:17:45.855571+0000","last_active":"2023-07-09T02:17:48.487662+0000","last_peered":"2023-07-09T02:17:48.487662+0000","last_clean":"2023-07-09T02:17:48.487662+0000","last_became_active":"2023-07-09T02:17:45.855241+0000","last_became_peered":"2023-07-09T02:17:45.855241+0000","last_unstale":"2023-07-09T02:17:48.487662+0000","last_undegraded":"2023-07-09T02:17:48.487662+0000","last_fullsized":"2023-07-09T02:17:48.487662+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:18:10.565250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867686+0000","last_change":"2023-07-09T02:17:46.884674+0000","last_active":"2023-07-09T02:17:47.867686+0000","last_peered":"2023-07-09T02:17:47.867686+0000","last_clean":"2023-07-09T02:17:47.867686+0000","last_became_active":"2023-07-09T02:17:46.884114+0000","last_became_peered":"2023-07-09T02:17:46.884114+0000","last_unstale":"2023-07-09T02:17:47.867686+0000","last_undegraded":"2023-07-09T02:17:47.867686+0000","last_fullsized":"2023-07-09T02:17:47.867686+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:09:36.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487776+0000","last_change":"2023-07-09T02:17:45.858680+0000","last_active":"2023-07-09T02:17:48.487776+0000","last_peered":"2023-07-09T02:17:48.487776+0000","last_clean":"2023-07-09T02:17:48.487776+0000","last_became_active":"2023-07-09T02:17:45.858347+0000","last_became_peered":"2023-07-09T02:17:45.858347+0000","last_unstale":"2023-07-09T02:17:48.487776+0000","last_undegraded":"2023-07-09T02:17:48.487776+0000","last_fullsized":"2023-07-09T02:17:48.487776+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:51:11.344712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868589+0000","last_change":"2023-07-09T02:17:46.875982+0000","last_active":"2023-07-09T02:17:47.868589+0000","last_peered":"2023-07-09T02:17:47.868589+0000","last_clean":"2023-07-09T02:17:47.868589+0000","last_became_active":"2023-07-09T02:17:46.875743+0000","last_became_peered":"2023-07-09T02:17:46.875743+0000","last_unstale":"2023-07-09T02:17:47.868589+0000","last_undegraded":"2023-07-09T02:17:47.868589+0000","last_fullsized":"2023-07-09T02:17:47.868589+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:04:42.833279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868440+0000","last_change":"2023-07-09T02:17:45.858364+0000","last_active":"2023-07-09T02:17:47.868440+0000","last_peered":"2023-07-09T02:17:47.868440+0000","last_clean":"2023-07-09T02:17:47.868440+0000","last_became_active":"2023-07-09T02:17:45.858111+0000","last_became_peered":"2023-07-09T02:17:45.858111+0000","last_unstale":"2023-07-09T02:17:47.868440+0000","last_undegraded":"2023-07-09T02:17:47.868440+0000","last_fullsized":"2023-07-09T02:17:47.868440+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:31:18.201349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030729+0000","last_change":"2023-07-09T02:17:46.875082+0000","last_active":"2023-07-09T02:17:49.030729+0000","last_peered":"2023-07-09T02:17:49.030729+0000","last_clean":"2023-07-09T02:17:49.030729+0000","last_became_active":"2023-07-09T02:17:46.874863+0000","last_became_peered":"2023-07-09T02:17:46.874863+0000","last_unstale":"2023-07-09T02:17:49.030729+0000","last_undegraded":"2023-07-09T02:17:49.030729+0000","last_fullsized":"2023-07-09T02:17:49.030729+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:04:00.436154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488240+0000","last_change":"2023-07-09T02:17:45.856708+0000","last_active":"2023-07-09T02:17:48.488240+0000","last_peered":"2023-07-09T02:17:48.488240+0000","last_clean":"2023-07-09T02:17:48.488240+0000","last_became_active":"2023-07-09T02:17:45.856481+0000","last_became_peered":"2023-07-09T02:17:45.856481+0000","last_unstale":"2023-07-09T02:17:48.488240+0000","last_undegraded":"2023-07-09T02:17:48.488240+0000","last_fullsized":"2023-07-09T02:17:48.488240+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:07:38.846146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030849+0000","last_change":"2023-07-09T02:17:46.889723+0000","last_active":"2023-07-09T02:17:49.030849+0000","last_peered":"2023-07-09T02:17:49.030849+0000","last_clean":"2023-07-09T02:17:49.030849+0000","last_became_active":"2023-07-09T02:17:46.889426+0000","last_became_peered":"2023-07-09T02:17:46.889426+0000","last_unstale":"2023-07-09T02:17:49.030849+0000","last_undegraded":"2023-07-09T02:17:49.030849+0000","last_fullsized":"2023-07-09T02:17:49.030849+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:44.127765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031028+0000","last_change":"2023-07-09T02:17:45.851893+0000","last_active":"2023-07-09T02:17:49.031028+0000","last_peered":"2023-07-09T02:17:49.031028+0000","last_clean":"2023-07-09T02:17:49.031028+0000","last_became_active":"2023-07-09T02:17:45.851676+0000","last_became_peered":"2023-07-09T02:17:45.851676+0000","last_unstale":"2023-07-09T02:17:49.031028+0000","last_undegraded":"2023-07-09T02:17:49.031028+0000","last_fullsized":"2023-07-09T02:17:49.031028+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:54:45.706142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867677+0000","last_change":"2023-07-09T02:17:46.880414+0000","last_active":"2023-07-09T02:17:47.867677+0000","last_peered":"2023-07-09T02:17:47.867677+0000","last_clean":"2023-07-09T02:17:47.867677+0000","last_became_active":"2023-07-09T02:17:46.879095+0000","last_became_peered":"2023-07-09T02:17:46.879095+0000","last_unstale":"2023-07-09T02:17:47.867677+0000","last_undegraded":"2023-07-09T02:17:47.867677+0000","last_fullsized":"2023-07-09T02:17:47.867677+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:46:55.487355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487834+0000","last_change":"2023-07-09T02:17:45.858625+0000","last_active":"2023-07-09T02:17:48.487834+0000","last_peered":"2023-07-09T02:17:48.487834+0000","last_clean":"2023-07-09T02:17:48.487834+0000","last_became_active":"2023-07-09T02:17:45.858396+0000","last_became_peered":"2023-07-09T02:17:45.858396+0000","last_unstale":"2023-07-09T02:17:48.487834+0000","last_undegraded":"2023-07-09T02:17:48.487834+0000","last_fullsized":"2023-07-09T02:17:48.487834+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:51:09.300948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868542+0000","last_change":"2023-07-09T02:17:46.872717+0000","last_active":"2023-07-09T02:17:47.868542+0000","last_peered":"2023-07-09T02:17:47.868542+0000","last_clean":"2023-07-09T02:17:47.868542+0000","last_became_active":"2023-07-09T02:17:46.872333+0000","last_became_peered":"2023-07-09T02:17:46.872333+0000","last_unstale":"2023-07-09T02:17:47.868542+0000","last_undegraded":"2023-07-09T02:17:47.868542+0000","last_fullsized":"2023-07-09T02:17:47.868542+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:33:38.767841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868568+0000","last_change":"2023-07-09T02:17:45.854082+0000","last_active":"2023-07-09T02:17:47.868568+0000","last_peered":"2023-07-09T02:17:47.868568+0000","last_clean":"2023-07-09T02:17:47.868568+0000","last_became_active":"2023-07-09T02:17:45.853851+0000","last_became_peered":"2023-07-09T02:17:45.853851+0000","last_unstale":"2023-07-09T02:17:47.868568+0000","last_undegraded":"2023-07-09T02:17:47.868568+0000","last_fullsized":"2023-07-09T02:17:47.868568+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:52:39.565282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.864898+0000","last_change":"2023-07-09T02:17:46.890347+0000","last_active":"2023-07-09T02:17:47.864898+0000","last_peered":"2023-07-09T02:17:47.864898+0000","last_clean":"2023-07-09T02:17:47.864898+0000","last_became_active":"2023-07-09T02:17:46.890106+0000","last_became_peered":"2023-07-09T02:17:46.890106+0000","last_unstale":"2023-07-09T02:17:47.864898+0000","last_undegraded":"2023-07-09T02:17:47.864898+0000","last_fullsized":"2023-07-09T02:17:47.864898+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:02:01.286509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029905+0000","last_change":"2023-07-09T02:17:45.855071+0000","last_active":"2023-07-09T02:17:49.029905+0000","last_peered":"2023-07-09T02:17:49.029905+0000","last_clean":"2023-07-09T02:17:49.029905+0000","last_became_active":"2023-07-09T02:17:45.854824+0000","last_became_peered":"2023-07-09T02:17:45.854824+0000","last_unstale":"2023-07-09T02:17:49.029905+0000","last_undegraded":"2023-07-09T02:17:49.029905+0000","last_fullsized":"2023-07-09T02:17:49.029905+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:56:18.689496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487709+0000","last_change":"2023-07-09T02:17:46.880443+0000","last_active":"2023-07-09T02:17:48.487709+0000","last_peered":"2023-07-09T02:17:48.487709+0000","last_clean":"2023-07-09T02:17:48.487709+0000","last_became_active":"2023-07-09T02:17:46.879914+0000","last_became_peered":"2023-07-09T02:17:46.879914+0000","last_unstale":"2023-07-09T02:17:48.487709+0000","last_undegraded":"2023-07-09T02:17:48.487709+0000","last_fullsized":"2023-07-09T02:17:48.487709+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:59:39.118984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030194+0000","last_change":"2023-07-09T02:17:45.854907+0000","last_active":"2023-07-09T02:17:49.030194+0000","last_peered":"2023-07-09T02:17:49.030194+0000","last_clean":"2023-07-09T02:17:49.030194+0000","last_became_active":"2023-07-09T02:17:45.854661+0000","last_became_peered":"2023-07-09T02:17:45.854661+0000","last_unstale":"2023-07-09T02:17:49.030194+0000","last_undegraded":"2023-07-09T02:17:49.030194+0000","last_fullsized":"2023-07-09T02:17:49.030194+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:52:25.984103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030325+0000","last_change":"2023-07-09T02:17:46.874063+0000","last_active":"2023-07-09T02:17:49.030325+0000","last_peered":"2023-07-09T02:17:49.030325+0000","last_clean":"2023-07-09T02:17:49.030325+0000","last_became_active":"2023-07-09T02:17:46.873812+0000","last_became_peered":"2023-07-09T02:17:46.873812+0000","last_unstale":"2023-07-09T02:17:49.030325+0000","last_undegraded":"2023-07-09T02:17:49.030325+0000","last_fullsized":"2023-07-09T02:17:49.030325+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:21:17.410082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868658+0000","last_change":"2023-07-09T02:17:45.857219+0000","last_active":"2023-07-09T02:17:47.868658+0000","last_peered":"2023-07-09T02:17:47.868658+0000","last_clean":"2023-07-09T02:17:47.868658+0000","last_became_active":"2023-07-09T02:17:45.856864+0000","last_became_peered":"2023-07-09T02:17:45.856864+0000","last_unstale":"2023-07-09T02:17:47.868658+0000","last_undegraded":"2023-07-09T02:17:47.868658+0000","last_fullsized":"2023-07-09T02:17:47.868658+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:23:29.945205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868221+0000","last_change":"2023-07-09T02:17:46.873025+0000","last_active":"2023-07-09T02:17:47.868221+0000","last_peered":"2023-07-09T02:17:47.868221+0000","last_clean":"2023-07-09T02:17:47.868221+0000","last_became_active":"2023-07-09T02:17:46.872412+0000","last_became_peered":"2023-07-09T02:17:46.872412+0000","last_unstale":"2023-07-09T02:17:47.868221+0000","last_undegraded":"2023-07-09T02:17:47.868221+0000","last_fullsized":"2023-07-09T02:17:47.868221+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:11:56.464913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030444+0000","last_change":"2023-07-09T02:17:45.853248+0000","last_active":"2023-07-09T02:17:49.030444+0000","last_peered":"2023-07-09T02:17:49.030444+0000","last_clean":"2023-07-09T02:17:49.030444+0000","last_became_active":"2023-07-09T02:17:45.853011+0000","last_became_peered":"2023-07-09T02:17:45.853011+0000","last_unstale":"2023-07-09T02:17:49.030444+0000","last_undegraded":"2023-07-09T02:17:49.030444+0000","last_fullsized":"2023-07-09T02:17:49.030444+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:39:18.887785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031590+0000","last_change":"2023-07-09T02:17:46.888181+0000","last_active":"2023-07-09T02:17:49.031590+0000","last_peered":"2023-07-09T02:17:49.031590+0000","last_clean":"2023-07-09T02:17:49.031590+0000","last_became_active":"2023-07-09T02:17:46.887366+0000","last_became_peered":"2023-07-09T02:17:46.887366+0000","last_unstale":"2023-07-09T02:17:49.031590+0000","last_undegraded":"2023-07-09T02:17:49.031590+0000","last_fullsized":"2023-07-09T02:17:49.031590+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:27:57.376358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030234+0000","last_change":"2023-07-09T02:17:45.853906+0000","last_active":"2023-07-09T02:17:49.030234+0000","last_peered":"2023-07-09T02:17:49.030234+0000","last_clean":"2023-07-09T02:17:49.030234+0000","last_became_active":"2023-07-09T02:17:45.853292+0000","last_became_peered":"2023-07-09T02:17:45.853292+0000","last_unstale":"2023-07-09T02:17:49.030234+0000","last_undegraded":"2023-07-09T02:17:49.030234+0000","last_fullsized":"2023-07-09T02:17:49.030234+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:45:38.974041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487659+0000","last_change":"2023-07-09T02:17:46.882403+0000","last_active":"2023-07-09T02:17:48.487659+0000","last_peered":"2023-07-09T02:17:48.487659+0000","last_clean":"2023-07-09T02:17:48.487659+0000","last_became_active":"2023-07-09T02:17:46.881335+0000","last_became_peered":"2023-07-09T02:17:46.881335+0000","last_unstale":"2023-07-09T02:17:48.487659+0000","last_undegraded":"2023-07-09T02:17:48.487659+0000","last_fullsized":"2023-07-09T02:17:48.487659+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:52:42.103560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868578+0000","last_change":"2023-07-09T02:17:45.855309+0000","last_active":"2023-07-09T02:17:47.868578+0000","last_peered":"2023-07-09T02:17:47.868578+0000","last_clean":"2023-07-09T02:17:47.868578+0000","last_became_active":"2023-07-09T02:17:45.854753+0000","last_became_peered":"2023-07-09T02:17:45.854753+0000","last_unstale":"2023-07-09T02:17:47.868578+0000","last_undegraded":"2023-07-09T02:17:47.868578+0000","last_fullsized":"2023-07-09T02:17:47.868578+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:59:48.072619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865200+0000","last_change":"2023-07-09T02:17:46.879443+0000","last_active":"2023-07-09T02:17:47.865200+0000","last_peered":"2023-07-09T02:17:47.865200+0000","last_clean":"2023-07-09T02:17:47.865200+0000","last_became_active":"2023-07-09T02:17:46.879204+0000","last_became_peered":"2023-07-09T02:17:46.879204+0000","last_unstale":"2023-07-09T02:17:47.865200+0000","last_undegraded":"2023-07-09T02:17:47.865200+0000","last_fullsized":"2023-07-09T02:17:47.865200+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:51.077445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487940+0000","last_change":"2023-07-09T02:17:45.857663+0000","last_active":"2023-07-09T02:17:48.487940+0000","last_peered":"2023-07-09T02:17:48.487940+0000","last_clean":"2023-07-09T02:17:48.487940+0000","last_became_active":"2023-07-09T02:17:45.857425+0000","last_became_peered":"2023-07-09T02:17:45.857425+0000","last_unstale":"2023-07-09T02:17:48.487940+0000","last_undegraded":"2023-07-09T02:17:48.487940+0000","last_fullsized":"2023-07-09T02:17:48.487940+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:34:41.430083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487471+0000","last_change":"2023-07-09T02:17:46.879884+0000","last_active":"2023-07-09T02:17:48.487471+0000","last_peered":"2023-07-09T02:17:48.487471+0000","last_clean":"2023-07-09T02:17:48.487471+0000","last_became_active":"2023-07-09T02:17:46.879606+0000","last_became_peered":"2023-07-09T02:17:46.879606+0000","last_unstale":"2023-07-09T02:17:48.487471+0000","last_undegraded":"2023-07-09T02:17:48.487471+0000","last_fullsized":"2023-07-09T02:17:48.487471+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:00:22.551889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"137'8","reported_seq":21,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031742+0000","last_change":"2023-07-09T02:17:45.859068+0000","last_active":"2023-07-09T02:17:49.031742+0000","last_peered":"2023-07-09T02:17:49.031742+0000","last_clean":"2023-07-09T02:17:49.031742+0000","last_became_active":"2023-07-09T02:17:45.858705+0000","last_became_peered":"2023-07-09T02:17:45.858705+0000","last_unstale":"2023-07-09T02:17:49.031742+0000","last_undegraded":"2023-07-09T02:17:49.031742+0000","last_fullsized":"2023-07-09T02:17:49.031742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:02:53.236572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":368,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.487176+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:17:48.487176+0000","last_peered":"2023-07-09T02:17:48.487176+0000","last_clean":"2023-07-09T02:17:48.487176+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:17:48.487176+0000","last_undegraded":"2023-07-09T02:17:48.487176+0000","last_fullsized":"2023-07-09T02:17:48.487176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:26:34.655521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867963+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:17:47.867963+0000","last_peered":"2023-07-09T02:17:47.867963+0000","last_clean":"2023-07-09T02:17:47.867963+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:17:47.867963+0000","last_undegraded":"2023-07-09T02:17:47.867963+0000","last_fullsized":"2023-07-09T02:17:47.867963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:46:23.041970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029806+0000","last_change":"2023-07-09T02:17:46.884819+0000","last_active":"2023-07-09T02:17:49.029806+0000","last_peered":"2023-07-09T02:17:49.029806+0000","last_clean":"2023-07-09T02:17:49.029806+0000","last_became_active":"2023-07-09T02:17:46.884603+0000","last_became_peered":"2023-07-09T02:17:46.884603+0000","last_unstale":"2023-07-09T02:17:49.029806+0000","last_undegraded":"2023-07-09T02:17:49.029806+0000","last_fullsized":"2023-07-09T02:17:49.029806+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:55:25.011021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030900+0000","last_change":"2023-07-09T02:17:45.858061+0000","last_active":"2023-07-09T02:17:49.030900+0000","last_peered":"2023-07-09T02:17:49.030900+0000","last_clean":"2023-07-09T02:17:49.030900+0000","last_became_active":"2023-07-09T02:17:45.857796+0000","last_became_peered":"2023-07-09T02:17:45.857796+0000","last_unstale":"2023-07-09T02:17:49.030900+0000","last_undegraded":"2023-07-09T02:17:49.030900+0000","last_fullsized":"2023-07-09T02:17:49.030900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:21:48.327433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":214,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488184+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:17:48.488184+0000","last_peered":"2023-07-09T02:17:48.488184+0000","last_clean":"2023-07-09T02:17:48.488184+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:17:48.488184+0000","last_undegraded":"2023-07-09T02:17:48.488184+0000","last_fullsized":"2023-07-09T02:17:48.488184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:21:06.825725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865281+0000","last_change":"2023-07-09T02:17:46.880985+0000","last_active":"2023-07-09T02:17:47.865281+0000","last_peered":"2023-07-09T02:17:47.865281+0000","last_clean":"2023-07-09T02:17:47.865281+0000","last_became_active":"2023-07-09T02:17:46.880707+0000","last_became_peered":"2023-07-09T02:17:46.880707+0000","last_unstale":"2023-07-09T02:17:47.865281+0000","last_undegraded":"2023-07-09T02:17:47.865281+0000","last_fullsized":"2023-07-09T02:17:47.865281+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:24:38.522226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030770+0000","last_change":"2023-07-09T02:17:45.853031+0000","last_active":"2023-07-09T02:17:49.030770+0000","last_peered":"2023-07-09T02:17:49.030770+0000","last_clean":"2023-07-09T02:17:49.030770+0000","last_became_active":"2023-07-09T02:17:45.852821+0000","last_became_peered":"2023-07-09T02:17:45.852821+0000","last_unstale":"2023-07-09T02:17:49.030770+0000","last_undegraded":"2023-07-09T02:17:49.030770+0000","last_fullsized":"2023-07-09T02:17:49.030770+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:38:23.542025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":216,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030407+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:17:49.030407+0000","last_peered":"2023-07-09T02:17:49.030407+0000","last_clean":"2023-07-09T02:17:49.030407+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:17:49.030407+0000","last_undegraded":"2023-07-09T02:17:49.030407+0000","last_fullsized":"2023-07-09T02:17:49.030407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:46:23.280859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030746+0000","last_change":"2023-07-09T02:17:46.872056+0000","last_active":"2023-07-09T02:17:49.030746+0000","last_peered":"2023-07-09T02:17:49.030746+0000","last_clean":"2023-07-09T02:17:49.030746+0000","last_became_active":"2023-07-09T02:17:46.871344+0000","last_became_peered":"2023-07-09T02:17:46.871344+0000","last_unstale":"2023-07-09T02:17:49.030746+0000","last_undegraded":"2023-07-09T02:17:49.030746+0000","last_fullsized":"2023-07-09T02:17:49.030746+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:58:48.980120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031182+0000","last_change":"2023-07-09T02:17:45.852293+0000","last_active":"2023-07-09T02:17:49.031182+0000","last_peered":"2023-07-09T02:17:49.031182+0000","last_clean":"2023-07-09T02:17:49.031182+0000","last_became_active":"2023-07-09T02:17:45.852026+0000","last_became_peered":"2023-07-09T02:17:45.852026+0000","last_unstale":"2023-07-09T02:17:49.031182+0000","last_undegraded":"2023-07-09T02:17:49.031182+0000","last_fullsized":"2023-07-09T02:17:49.031182+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:08:34.687206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":244,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868287+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:17:47.868287+0000","last_peered":"2023-07-09T02:17:47.868287+0000","last_clean":"2023-07-09T02:17:47.868287+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:17:47.868287+0000","last_undegraded":"2023-07-09T02:17:47.868287+0000","last_fullsized":"2023-07-09T02:17:47.868287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:25:03.309197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030108+0000","last_change":"2023-07-09T02:17:46.887243+0000","last_active":"2023-07-09T02:17:49.030108+0000","last_peered":"2023-07-09T02:17:49.030108+0000","last_clean":"2023-07-09T02:17:49.030108+0000","last_became_active":"2023-07-09T02:17:46.886679+0000","last_became_peered":"2023-07-09T02:17:46.886679+0000","last_unstale":"2023-07-09T02:17:49.030108+0000","last_undegraded":"2023-07-09T02:17:49.030108+0000","last_fullsized":"2023-07-09T02:17:49.030108+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:20:28.879722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029639+0000","last_change":"2023-07-09T02:17:45.854498+0000","last_active":"2023-07-09T02:17:49.029639+0000","last_peered":"2023-07-09T02:17:49.029639+0000","last_clean":"2023-07-09T02:17:49.029639+0000","last_became_active":"2023-07-09T02:17:45.854251+0000","last_became_peered":"2023-07-09T02:17:45.854251+0000","last_unstale":"2023-07-09T02:17:49.029639+0000","last_undegraded":"2023-07-09T02:17:49.029639+0000","last_fullsized":"2023-07-09T02:17:49.029639+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:34:13.072420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865519+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:17:47.865519+0000","last_peered":"2023-07-09T02:17:47.865519+0000","last_clean":"2023-07-09T02:17:47.865519+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:17:47.865519+0000","last_undegraded":"2023-07-09T02:17:47.865519+0000","last_fullsized":"2023-07-09T02:17:47.865519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:28:24.045504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867564+0000","last_change":"2023-07-09T02:17:46.880590+0000","last_active":"2023-07-09T02:17:47.867564+0000","last_peered":"2023-07-09T02:17:47.867564+0000","last_clean":"2023-07-09T02:17:47.867564+0000","last_became_active":"2023-07-09T02:17:46.879980+0000","last_became_peered":"2023-07-09T02:17:46.879980+0000","last_unstale":"2023-07-09T02:17:47.867564+0000","last_undegraded":"2023-07-09T02:17:47.867564+0000","last_fullsized":"2023-07-09T02:17:47.867564+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:46:06.366966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.868181+0000","last_change":"2023-07-09T02:17:45.850918+0000","last_active":"2023-07-09T02:17:47.868181+0000","last_peered":"2023-07-09T02:17:47.868181+0000","last_clean":"2023-07-09T02:17:47.868181+0000","last_became_active":"2023-07-09T02:17:45.850678+0000","last_became_peered":"2023-07-09T02:17:45.850678+0000","last_unstale":"2023-07-09T02:17:47.868181+0000","last_undegraded":"2023-07-09T02:17:47.868181+0000","last_fullsized":"2023-07-09T02:17:47.868181+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:48:11.659052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":216,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:48.488132+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:17:48.488132+0000","last_peered":"2023-07-09T02:17:48.488132+0000","last_clean":"2023-07-09T02:17:48.488132+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:17:48.488132+0000","last_undegraded":"2023-07-09T02:17:48.488132+0000","last_fullsized":"2023-07-09T02:17:48.488132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:58:36.634563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.031140+0000","last_change":"2023-07-09T02:17:46.884457+0000","last_active":"2023-07-09T02:17:49.031140+0000","last_peered":"2023-07-09T02:17:49.031140+0000","last_clean":"2023-07-09T02:17:49.031140+0000","last_became_active":"2023-07-09T02:17:46.884221+0000","last_became_peered":"2023-07-09T02:17:46.884221+0000","last_unstale":"2023-07-09T02:17:49.031140+0000","last_undegraded":"2023-07-09T02:17:49.031140+0000","last_fullsized":"2023-07-09T02:17:49.031140+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:54:38.338328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"137'3","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867846+0000","last_change":"2023-07-09T02:17:45.852920+0000","last_active":"2023-07-09T02:17:47.867846+0000","last_peered":"2023-07-09T02:17:47.867846+0000","last_clean":"2023-07-09T02:17:47.867846+0000","last_became_active":"2023-07-09T02:17:45.852689+0000","last_became_peered":"2023-07-09T02:17:45.852689+0000","last_unstale":"2023-07-09T02:17:47.867846+0000","last_undegraded":"2023-07-09T02:17:47.867846+0000","last_fullsized":"2023-07-09T02:17:47.867846+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:38:22.215233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.865156+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:17:47.865156+0000","last_peered":"2023-07-09T02:17:47.865156+0000","last_clean":"2023-07-09T02:17:47.865156+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:17:47.865156+0000","last_undegraded":"2023-07-09T02:17:47.865156+0000","last_fullsized":"2023-07-09T02:17:47.865156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:42:47.335997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:47.867909+0000","last_change":"2023-07-09T02:17:46.875682+0000","last_active":"2023-07-09T02:17:47.867909+0000","last_peered":"2023-07-09T02:17:47.867909+0000","last_clean":"2023-07-09T02:17:47.867909+0000","last_became_active":"2023-07-09T02:17:46.875458+0000","last_became_peered":"2023-07-09T02:17:46.875458+0000","last_unstale":"2023-07-09T02:17:47.867909+0000","last_undegraded":"2023-07-09T02:17:47.867909+0000","last_fullsized":"2023-07-09T02:17:47.867909+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:45.838078+0000","last_clean_scrub_stamp":"2023-07-09T02:17:45.838078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:23:54.072740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"137'6","reported_seq":19,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.030938+0000","last_change":"2023-07-09T02:17:45.854415+0000","last_active":"2023-07-09T02:17:49.030938+0000","last_peered":"2023-07-09T02:17:49.030938+0000","last_clean":"2023-07-09T02:17:49.030938+0000","last_became_active":"2023-07-09T02:17:45.854148+0000","last_became_peered":"2023-07-09T02:17:45.854148+0000","last_unstale":"2023-07-09T02:17:49.030938+0000","last_undegraded":"2023-07-09T02:17:49.030938+0000","last_fullsized":"2023-07-09T02:17:49.030938+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:17:44.827145+0000","last_clean_scrub_stamp":"2023-07-09T02:17:44.827145+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:54:36.889515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":214,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-07-09T02:17:49.029876+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:17:49.029876+0000","last_peered":"2023-07-09T02:17:49.029876+0000","last_clean":"2023-07-09T02:17:49.029876+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:17:49.029876+0000","last_undegraded":"2023-07-09T02:17:49.029876+0000","last_fullsized":"2023-07-09T02:17:49.029876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:42:25.828469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1372,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193939,"statfs":{"total":200000000,"available":198594379,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.46600000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.998,"5min":1.2330000000000001,"15min":1.4950000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88600000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.621}]},{"osd":1,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.41599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":1.423,"15min":1.423},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":1.0269999999999999,"15min":0.79800000000000004},"min":{"1min":0.46800000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92300000000000004,"5min":29.498999999999999,"15min":29.498999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.74399999999999999,"15min":0.70399999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.89600000000000002,"5min":5.0460000000000003,"15min":5.0460000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.97499999999999998,"15min":0.80700000000000005},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.01,"5min":26.524000000000001,"15min":26.524000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73699999999999999,"15min":0.68000000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.93799999999999994,"5min":4.3789999999999996,"15min":4.3789999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.83699999999999997,"15min":0.77600000000000002},"min":{"1min":0.55600000000000005,"5min":0.432,"15min":0.432},"max":{"1min":0.96899999999999997,"5min":10.609999999999999,"15min":10.609999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59199999999999997,"15min":0.60299999999999998},"min":{"1min":0.34899999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72899999999999998,"5min":0.91100000000000003,"15min":0.91500000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69399999999999995,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94399999999999995,"5min":1.032,"15min":1.032},"last":0.59899999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.65800000000000003},"min":{"1min":0.504,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78400000000000003,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.88900000000000001,"5min":1.048,"15min":1.048},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69899999999999995,"15min":0.73899999999999999},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.087,"15min":1.087},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.87,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199184941,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.55200000000000005,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66400000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90400000000000003,"5min":0.92200000000000004,"15min":1.4379999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90700000000000003,"15min":1.165},"last":0.73399999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72599999999999998,"15min":0.69199999999999995},"min":{"1min":0.47799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.59499999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.70999999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98399999999999999,"5min":1.45,"15min":1.45},"last":0.625},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.5,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68999999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.998,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.38800000000000001},"max":{"1min":0.91700000000000004,"5min":1.117,"15min":1.117},"last":0.755}]},{"osd":5,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.63700000000000001},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.88200000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.65700000000000003},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89900000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93799999999999994,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199185363,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66400000000000003,"15min":0.63900000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86899999999999999,"5min":1.179,"15min":1.179},"last":0.70799999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67700000000000005,"15min":0.65700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68899999999999995,"15min":0.65600000000000003},"min":{"1min":0.58099999999999996,"5min":0.46700000000000003,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71099999999999997,"15min":0.69899999999999995},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":0.81000000000000005,"5min":1.103,"15min":1.103},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.56799999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85399999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.751}]},{"osd":3,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.77800000000000002,"15min":0.71499999999999997},"min":{"1min":0.54400000000000004,"5min":0.50600000000000001,"15min":0.47399999999999998},"max":{"1min":5.1989999999999998,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85399999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.60699999999999998},"min":{"1min":0.49399999999999999,"5min":0.34399999999999997,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":1.008,"15min":1.008},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63,"15min":0.61399999999999999},"min":{"1min":0.51900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91900000000000004,"5min":1.054,"15min":1.054},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.66900000000000004},"min":{"1min":0.53800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.85399999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.51700000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.52000000000000002,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":0.93700000000000006,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.755},"min":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.48599999999999999},"max":{"1min":0.95099999999999996,"5min":1.091,"15min":1.091},"last":0.67200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199183959,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":1.248,"15min":0.85399999999999998},"min":{"1min":0.38800000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.91400000000000003,"5min":50.508000000000003,"15min":50.508000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.66800000000000004,"15min":0.67800000000000005},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.98999999999999999},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.749,"15min":0.65300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.34100000000000003},"max":{"1min":0.97199999999999998,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.38},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.746},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":1.0189999999999999,"15min":1.4550000000000001},"last":0.496}]},{"osd":2,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.53800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":1.008,"15min":1.323},"last":0.67000000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.0369999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.5329999999999999,"15min":0.94899999999999995},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":71.909000000000006,"15min":71.909000000000006},"last":0.61599999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.86799999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.64500000000000002},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.47299999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68899999999999995,"15min":0.628},"min":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67000000000000004,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93700000000000006,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70299999999999996,"15min":0.73099999999999998},"min":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.79600000000000004,"15min":0.72099999999999997},"min":{"1min":0.58799999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95599999999999996,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199183925,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.42499999999999999},"min":{"1min":0.32300000000000001,"5min":0.26300000000000001,"15min":0.216},"max":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.87,"15min":1.198},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.27300000000000002,"15min":0.27100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":1.048},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.27800000000000002},"max":{"1min":0.71599999999999997,"5min":0.83999999999999997,"15min":0.85299999999999998},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.501,"15min":0.52700000000000002},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.32900000000000001},"max":{"1min":0.624,"5min":0.76700000000000002,"15min":1.155},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.1040000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78100000000000003,"15min":0.751},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77300000000000002,"15min":0.71199999999999997},"min":{"1min":0.53600000000000003,"5min":0.48399999999999999,"15min":0.443},"max":{"1min":1.1899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78300000000000003,"15min":0.72699999999999998},"min":{"1min":0.56299999999999994,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.097,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77600000000000002,"15min":0.76000000000000001},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.49399999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.624,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.746},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53600000000000003},"max":{"1min":1.395,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78900000000000003,"15min":0.77700000000000002},"min":{"1min":0.58699999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3149999999999999,"5min":1.367,"15min":1.367},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.77200000000000002},"min":{"1min":0.60899999999999999,"5min":0.55700000000000005,"15min":0.50700000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.88}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194517,"statfs":{"total":200000000,"available":199185523,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.52200000000000002,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69399999999999995,"5min":7.7450000000000001,"15min":7.7450000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.43099999999999999},"min":{"1min":0.35399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.66400000000000003,"5min":1.127,"15min":1.127},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47599999999999998,"15min":0.46300000000000002},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58299999999999996,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.52400000000000002},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71199999999999997,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.46899999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.5},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.433},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.57899999999999996,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.58099999999999996,"5min":7.8710000000000004,"15min":7.8710000000000004},"last":0.441}]},{"osd":4,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.81499999999999995,"15min":0.753},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.46500000000000002},"max":{"1min":0.998,"5min":7.7990000000000004,"15min":7.7990000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.77000000000000002,"15min":0.72199999999999998},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.67000000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.52500000000000002,"5min":0.499,"15min":0.496},"max":{"1min":1.052,"5min":1.1799999999999999,"15min":1.319},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.99,"5min":7.8369999999999997,"15min":7.8369999999999997},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80700000000000005,"15min":0.77100000000000002},"min":{"1min":0.56599999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0329999999999999,"5min":1.452,"15min":1.452},"last":0.69099999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.77000000000000002,"15min":0.72399999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":1.206,"15min":1.351},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":795,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194517,"statfs":{"total":200000000,"available":199185501,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.441,"15min":0.45200000000000001},"min":{"1min":0.34599999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.57399999999999995,"5min":0.72499999999999998,"15min":0.80300000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48199999999999998,"15min":0.46400000000000002},"min":{"1min":0.307,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.495},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.66400000000000003,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.40300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.1080000000000001},"last":0.38700000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.79100000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68999999999999995,"5min":0.85699999999999998,"15min":1.163},"last":0.44900000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.72499999999999998},"min":{"1min":0.53600000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90900000000000003,"5min":0.97499999999999998,"15min":1.026},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.746},"min":{"1min":0.624,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0169999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77300000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.72899999999999998},"min":{"1min":0.56999999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.751},{"interface":"front","average":{"1min":0.748,"5min":0.76300000000000001,"15min":0.72899999999999998},"min":{"1min":0.56000000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88900000000000001,"5min":1.034,"15min":1.034},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.77900000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97599999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.61899999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96199999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78600000000000003,"15min":0.76800000000000002},"min":{"1min":0.55100000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.92500000000000004,"5min":1.129,"15min":1.3600000000000001},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1371,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193940,"statfs":{"total":200000000,"available":198595133,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45400000000000001,"15min":0.42299999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52600000000000002,"15min":0.47499999999999998},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.35199999999999998},"max":{"1min":1.1180000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.45700000000000002},"min":{"1min":0.33300000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67500000000000004,"5min":0.71599999999999997,"15min":0.88900000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.161,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.46300000000000002,"15min":0.42099999999999999},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.50800000000000001},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.89200000000000002,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.59999999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.038,"5min":1.0660000000000001,"15min":1.145},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90700000000000003,"5min":1.153,"15min":1.153},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.77400000000000002,"15min":0.79200000000000004},"min":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.47199999999999998},"max":{"1min":1.401,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0680000000000001,"5min":1.238,"15min":1.238},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73299999999999998,"15min":0.74099999999999999},"min":{"1min":0.55200000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98799999999999999,"5min":1.0389999999999999,"15min":1.1040000000000001},"last":0.75},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.748,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:17:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78100000000000003,"15min":0.77300000000000002},"min":{"1min":0.60199999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53200000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97699999999999998,"5min":1.1180000000000001,"15min":1.1819999999999999},"last":0.78900000000000003}]}]}],"pool_statfs":[]}} 2023-07-09T02:17:51.379 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:17:51.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:17:51.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b3d40640 1 Processor -- start 2023-07-09T02:17:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b3d40640 1 -- start start 2023-07-09T02:17:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b3d40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89ac15c410 0x7f89ac1608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b3d40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f89ac0b59b0 0x7f89ac0b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b3d40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0d2340 0x7f89ac0b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b3d40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac0ced10 con 0x7f89ac15c410 2023-07-09T02:17:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b3d40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac15c7e0 con 0x7f89ac0b59b0 2023-07-09T02:17:51.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b3d40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0cd1b0 con 0x7f89ac0d2340 2023-07-09T02:17:51.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b1adc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89ac15c410 0x7f89ac1608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b1adc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89ac15c410 0x7f89ac1608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40912/0 (socket says 172.21.15.45:40912) 2023-07-09T02:17:51.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b1adc640 1 -- 172.21.15.45:0/3001959344 learned_addr learned my addr 172.21.15.45:0/3001959344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:51.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b1adc640 1 -- 172.21.15.45:0/3001959344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0d2340 msgr2=0x7f89ac0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:51.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b1adc640 1 --2- 172.21.15.45:0/3001959344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0d2340 0x7f89ac0b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b1adc640 1 -- 172.21.15.45:0/3001959344 >> v2:172.21.15.155:3300/0 conn(0x7f89ac0b59b0 msgr2=0x7f89ac0b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:51.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b1adc640 1 --2- 172.21.15.45:0/3001959344 >> v2:172.21.15.155:3300/0 conn(0x7f89ac0b59b0 0x7f89ac0b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.564+0000 7f89b1adc640 1 -- 172.21.15.45:0/3001959344 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac160de0 con 0x7f89ac15c410 2023-07-09T02:17:51.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b1adc640 1 --2- 172.21.15.45:0/3001959344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac1608a0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009870 tx=0x7f89a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5e7b292c574c41 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b0ada640 1 -- 172.21.15.45:0/3001959344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80aa5f0 con 0x7f89ac15c410 2023-07-09T02:17:51.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b0ada640 1 -- 172.21.15.45:0/3001959344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80aa750 con 0x7f89ac15c410 2023-07-09T02:17:51.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b0ada640 1 -- 172.21.15.45:0/3001959344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80aaae0 con 0x7f89ac15c410 2023-07-09T02:17:51.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 -- 172.21.15.45:0/3001959344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 msgr2=0x7f89ac1608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 --2- 172.21.15.45:0/3001959344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac1608a0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009870 tx=0x7f89a801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 -- 172.21.15.45:0/3001959344 shutdown_connections 2023-07-09T02:17:51.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 --2- 172.21.15.45:0/3001959344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0d2340 0x7f89ac0b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 --2- 172.21.15.45:0/3001959344 >> v2:172.21.15.155:3300/0 conn(0x7f89ac0b59b0 0x7f89ac0b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 --2- 172.21.15.45:0/3001959344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac1608a0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 -- 172.21.15.45:0/3001959344 >> 172.21.15.45:0/3001959344 conn(0x7f89ac06a590 msgr2=0x7f89ac0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:51.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 -- 172.21.15.45:0/3001959344 shutdown_connections 2023-07-09T02:17:51.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.568+0000 7f89b3d40640 1 -- 172.21.15.45:0/3001959344 wait complete. 2023-07-09T02:17:51.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 Processor -- start 2023-07-09T02:17:51.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 -- start start 2023-07-09T02:17:51.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0b59b0 0x7f89ac0b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89ac0d2340 0x7f89ac14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac0b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac14d830 con 0x7f89ac15c410 2023-07-09T02:17:51.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac14db10 con 0x7f89ac0d2340 2023-07-09T02:17:51.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac15ca30 con 0x7f89ac0b59b0 2023-07-09T02:17:51.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac0b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac0b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40924/0 (socket says 172.21.15.45:40924) 2023-07-09T02:17:51.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 -- 172.21.15.45:0/4836087 learned_addr learned my addr 172.21.15.45:0/4836087 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:51.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b1adc640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0b59b0 0x7f89ac0b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b12db640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89ac0d2340 0x7f89ac14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 -- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0b59b0 msgr2=0x7f89ac0b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0b59b0 0x7f89ac0b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 -- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89ac0d2340 msgr2=0x7f89ac14bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89ac0d2340 0x7f89ac14bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 -- 172.21.15.45:0/4836087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80094d0 con 0x7f89ac15c410 2023-07-09T02:17:51.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b12db640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89ac0d2340 0x7f89ac14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b22dd640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac0b5e90 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f89a400b970 tx=0x7f89a400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89a27fc640 1 -- 172.21.15.45:0/4836087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400cb40 con 0x7f89ac15c410 2023-07-09T02:17:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89a27fc640 1 -- 172.21.15.45:0/4836087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a400ccc0 con 0x7f89ac15c410 2023-07-09T02:17:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89a27fc640 1 -- 172.21.15.45:0/4836087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4014680 con 0x7f89ac15c410 2023-07-09T02:17:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac15cd10 con 0x7f89ac15c410 2023-07-09T02:17:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac14e060 con 0x7f89ac15c410 2023-07-09T02:17:51.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.572+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac15d230 con 0x7f89ac15c410 2023-07-09T02:17:51.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.576+0000 7f89a27fc640 1 -- 172.21.15.45:0/4836087 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89a401d3b0 con 0x7f89ac15c410 2023-07-09T02:17:51.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.576+0000 7f89a27fc640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8990066280 0x7f8990068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.576+0000 7f89a27fc640 1 -- 172.21.15.45:0/4836087 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89a4083bf0 con 0x7f89ac15c410 2023-07-09T02:17:51.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.576+0000 7f89b1adc640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8990066280 0x7f8990068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.576+0000 7f89b1adc640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8990066280 0x7f8990068730 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f89a80ae000 tx=0x7f89a80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.580+0000 7f89a27fc640 1 -- 172.21.15.45:0/4836087 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89ac15d230 con 0x7f89ac15c410 2023-07-09T02:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.792+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f89ac15d230 con 0x7f89ac15c410 2023-07-09T02:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.796+0000 7f89a27fc640 1 -- 172.21.15.45:0/4836087 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f89ac15d230 con 0x7f89ac15c410 2023-07-09T02:17:51.800 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:17:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:17:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:17:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:17:51.800 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:17:51.801 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:17:51.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8990066280 msgr2=0x7f8990068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8990066280 0x7f8990068730 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f89a80ae000 tx=0x7f89a80b5040 comp rx=0 tx=0).stop 2023-07-09T02:17:51.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 msgr2=0x7f89ac0b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac0b5e90 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f89a400b970 tx=0x7f89a400be30 comp rx=0 tx=0).stop 2023-07-09T02:17:51.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 shutdown_connections 2023-07-09T02:17:51.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac15c410 0x7f89ac0b5e90 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89ac0d2340 0x7f89ac14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8990066280 0x7f8990068730 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 --2- 172.21.15.45:0/4836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89ac0b59b0 0x7f89ac0b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 >> 172.21.15.45:0/4836087 conn(0x7f89ac06a590 msgr2=0x7f89ac0c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 shutdown_connections 2023-07-09T02:17:51.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.800+0000 7f89b3d40640 1 -- 172.21.15.45:0/4836087 wait complete. 2023-07-09T02:17:51.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:51.828 INFO:tasks.ceph.mds.b.smithi155.stderr:2023-07-09T02:17:51.825+0000 7f730bf77640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:17:51.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb996787640 1 Processor -- start 2023-07-09T02:17:51.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb996787640 1 -- start start 2023-07-09T02:17:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb996787640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb99015c870 0x7fb9900b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb996787640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9900b1b50 0x7fb99006b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb996787640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99006b780 0x7fb9900d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb996787640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99006bc00 con 0x7fb99015c870 2023-07-09T02:17:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb996787640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9900b2090 con 0x7fb9900b1b50 2023-07-09T02:17:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb996787640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb990160520 con 0x7fb99006b780 2023-07-09T02:17:51.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995785640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb99015c870 0x7fb9900b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995785640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb99015c870 0x7fb9900b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32934/0 (socket says 172.21.15.45:32934) 2023-07-09T02:17:51.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995785640 1 -- 172.21.15.45:0/3618248268 learned_addr learned my addr 172.21.15.45:0/3618248268 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:51.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995f86640 1 --2- 172.21.15.45:0/3618248268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99006b780 0x7fb9900d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb994f84640 1 --2- 172.21.15.45:0/3618248268 >> v2:172.21.15.155:3300/0 conn(0x7fb9900b1b50 0x7fb99006b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995785640 1 -- 172.21.15.45:0/3618248268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99006b780 msgr2=0x7fb9900d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:51.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995785640 1 --2- 172.21.15.45:0/3618248268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99006b780 0x7fb9900d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995785640 1 -- 172.21.15.45:0/3618248268 >> v2:172.21.15.155:3300/0 conn(0x7fb9900b1b50 msgr2=0x7fb99006b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:51.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995785640 1 --2- 172.21.15.45:0/3618248268 >> v2:172.21.15.155:3300/0 conn(0x7fb9900b1b50 0x7fb99006b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.964+0000 7fb995785640 1 -- 172.21.15.45:0/3618248268 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990160800 con 0x7fb99015c870 2023-07-09T02:17:51.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb995785640 1 --2- 172.21.15.45:0/3618248268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99015c870 0x7fb9900b1610 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb9900717b0 tx=0x7fb98c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d55a8608fed1141 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb987fff640 1 -- 172.21.15.45:0/3618248268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0ab600 con 0x7fb99015c870 2023-07-09T02:17:51.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb987fff640 1 -- 172.21.15.45:0/3618248268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c0a7050 con 0x7fb99015c870 2023-07-09T02:17:51.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb987fff640 1 -- 172.21.15.45:0/3618248268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0ab980 con 0x7fb99015c870 2023-07-09T02:17:51.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 -- 172.21.15.45:0/3618248268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99015c870 msgr2=0x7fb9900b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 --2- 172.21.15.45:0/3618248268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99015c870 0x7fb9900b1610 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb9900717b0 tx=0x7fb98c01c210 comp rx=0 tx=0).stop 2023-07-09T02:17:51.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 -- 172.21.15.45:0/3618248268 shutdown_connections 2023-07-09T02:17:51.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 --2- 172.21.15.45:0/3618248268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99006b780 0x7fb9900d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 --2- 172.21.15.45:0/3618248268 >> v2:172.21.15.155:3300/0 conn(0x7fb9900b1b50 0x7fb99006b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 --2- 172.21.15.45:0/3618248268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb99015c870 0x7fb9900b1610 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 -- 172.21.15.45:0/3618248268 >> 172.21.15.45:0/3618248268 conn(0x7fb990070be0 msgr2=0x7fb990070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:51.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 -- 172.21.15.45:0/3618248268 shutdown_connections 2023-07-09T02:17:51.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.968+0000 7fb996787640 1 -- 172.21.15.45:0/3618248268 wait complete. 2023-07-09T02:17:51.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 Processor -- start 2023-07-09T02:17:51.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 -- start start 2023-07-09T02:17:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb99006b780 0x7fb9900ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9900b1b50 0x7fb990154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99015c870 0x7fb990156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990154bb0 con 0x7fb9900b1b50 2023-07-09T02:17:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990154e90 con 0x7fb99006b780 2023-07-09T02:17:51.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb990155170 con 0x7fb99015c870 2023-07-09T02:17:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9900b1b50 0x7fb990154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9900b1b50 0x7fb990154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32946/0 (socket says 172.21.15.45:32946) 2023-07-09T02:17:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 -- 172.21.15.45:0/647121967 learned_addr learned my addr 172.21.15.45:0/647121967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb995785640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb99006b780 0x7fb9900ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb995f86640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99015c870 0x7fb990156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 -- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99015c870 msgr2=0x7fb990156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99015c870 0x7fb990156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 -- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb99006b780 msgr2=0x7fb9900ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb99006b780 0x7fb9900ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 -- 172.21.15.45:0/647121967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c0094d0 con 0x7fb9900b1b50 2023-07-09T02:17:51.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb994f84640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9900b1b50 0x7fb990154360 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb98000d800 tx=0x7fb98000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb985ffb640 1 -- 172.21.15.45:0/647121967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000b6c0 con 0x7fb9900b1b50 2023-07-09T02:17:51.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb985ffb640 1 -- 172.21.15.45:0/647121967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98000b820 con 0x7fb9900b1b50 2023-07-09T02:17:51.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb985ffb640 1 -- 172.21.15.45:0/647121967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000bb90 con 0x7fb9900b1b50 2023-07-09T02:17:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.972+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb990155450 con 0x7fb9900b1b50 2023-07-09T02:17:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.976+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9901548a0 con 0x7fb9900b1b50 2023-07-09T02:17:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.976+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99004e020 con 0x7fb9900b1b50 2023-07-09T02:17:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.976+0000 7fb985ffb640 1 -- 172.21.15.45:0/647121967 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb98000bcf0 con 0x7fb9900b1b50 2023-07-09T02:17:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.976+0000 7fb985ffb640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb974066280 0x7fb974068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:51.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.976+0000 7fb985ffb640 1 -- 172.21.15.45:0/647121967 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb980084160 con 0x7fb9900b1b50 2023-07-09T02:17:51.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.976+0000 7fb995785640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb974066280 0x7fb974068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:51.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.976+0000 7fb995785640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb974066280 0x7fb974068730 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0ad000 tx=0x7fb98c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:51.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:51.980+0000 7fb985ffb640 1 -- 172.21.15.45:0/647121967 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb980055110 con 0x7fb9900b1b50 2023-07-09T02:17:52.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9900cfef0 con 0x7fb9900b1b50 2023-07-09T02:17:52.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb985ffb640 1 -- 172.21.15.45:0/647121967 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fb980054ca0 con 0x7fb9900b1b50 2023-07-09T02:17:52.170 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:52.170 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:17:52.170 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:17:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb974066280 msgr2=0x7fb974068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb974066280 0x7fb974068730 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0ad000 tx=0x7fb98c0a6000 comp rx=0 tx=0).stop 2023-07-09T02:17:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9900b1b50 msgr2=0x7fb990154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9900b1b50 0x7fb990154360 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb98000d800 tx=0x7fb98000dcc0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 shutdown_connections 2023-07-09T02:17:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb974066280 0x7fb974068730 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb99015c870 0x7fb990156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9900b1b50 0x7fb990154360 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.168+0000 7fb996787640 1 --2- 172.21.15.45:0/647121967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb99006b780 0x7fb9900ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.172+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 >> 172.21.15.45:0/647121967 conn(0x7fb990070be0 msgr2=0x7fb990070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.172+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 shutdown_connections 2023-07-09T02:17:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.172+0000 7fb996787640 1 -- 172.21.15.45:0/647121967 wait complete. 2023-07-09T02:17:52.593 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:17:46.233793+0000', 'modified': '2023-07-09T02:17:49.897938+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7809}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7809': {'gid': 7809, 'name': 'b', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6837/1298123765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6835', 'nonce': 1298123765}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 1298123765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:17:52.594 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:17:52.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-09T02:17:52.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.740+0000 7fa0dff59640 1 Processor -- start 2023-07-09T02:17:52.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.740+0000 7fa0dff59640 1 -- start start 2023-07-09T02:17:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.740+0000 7fa0dff59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d80cd120 0x7fa0d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.740+0000 7fa0dff59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d8160a50 con 0x7fa0d80d2620 2023-07-09T02:17:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dff59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d815c430 con 0x7fa0d815c060 2023-07-09T02:17:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dff59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d815fb60 con 0x7fa0d80cd120 2023-07-09T02:17:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dd4f4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa0d80d2620 0x7fa0d80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51420/0 (socket says 172.21.15.45:51420) 2023-07-09T02:17:52.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dd4f4640 1 -- 172.21.15.45:0/4053175338 learned_addr learned my addr 172.21.15.45:0/4053175338 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d80cd120 0x7fa0d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194882981 0 0) 0x7fa0d8160a50 con 0x7fa0d80d2620 2023-07-09T02:17:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c4003530 con 0x7fa0d80d2620 2023-07-09T02:17:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161319883 0 0) 0x7fa0d815c430 con 0x7fa0d815c060 2023-07-09T02:17:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d8160a50 con 0x7fa0d815c060 2023-07-09T02:17:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1527481089 0 0) 0x7fa0c4003530 con 0x7fa0d80d2620 2023-07-09T02:17:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d80cd120 msgr2=0x7fa0d80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d80cd120 0x7fa0d80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 >> v1:172.21.15.155:6789/0 conn(0x7fa0d815c060 legacy=0x7fa0d80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d815fe40 con 0x7fa0d80d2620 2023-07-09T02:17:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fa0c8001680 con 0x7fa0d80d2620 2023-07-09T02:17:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 >> v1:172.21.15.45:6789/0 conn(0x7fa0d80d2620 legacy=0x7fa0d80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0c4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c40047d0 0x7fa0c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c4005180 0x7fa0c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d815fb60 con 0x7fa0c4003b40 2023-07-09T02:17:52.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c400bfb0 con 0x7fa0c40047d0 2023-07-09T02:17:52.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c400c170 con 0x7fa0c4005180 2023-07-09T02:17:52.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d80cd120 0x7fa0d80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:52.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0c4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c40047d0 0x7fa0c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c4005180 0x7fa0c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0ddcf5640 1 -- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c4005180 msgr2=0x7fa0c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0c4005180 0x7fa0c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0ddcf5640 1 -- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c40047d0 msgr2=0x7fa0c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c40047d0 0x7fa0c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.744+0000 7fa0ddcf5640 1 -- 172.21.15.45:0/4053175338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c4003530 con 0x7fa0c4003b40 2023-07-09T02:17:52.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0c4003f30 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40018c0 tx=0x7fa0d401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc30877d7b5fd520 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40052d0 con 0x7fa0c4003b40 2023-07-09T02:17:52.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d4005430 con 0x7fa0c4003b40 2023-07-09T02:17:52.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dccf3640 1 -- 172.21.15.45:0/4053175338 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4003820 con 0x7fa0c4003b40 2023-07-09T02:17:52.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dff59640 1 -- 172.21.15.45:0/4053175338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 msgr2=0x7fa0c4003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dff59640 1 --2- 172.21.15.45:0/4053175338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0c4003f30 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40018c0 tx=0x7fa0d401c530 comp rx=0 tx=0).stop 2023-07-09T02:17:52.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0de4f6640 1 -- 172.21.15.45:0/4053175338 reap_dead start 2023-07-09T02:17:52.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dff59640 1 -- 172.21.15.45:0/4053175338 shutdown_connections 2023-07-09T02:17:52.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dff59640 1 -- 172.21.15.45:0/4053175338 >> 172.21.15.45:0/4053175338 conn(0x7fa0d80698e0 msgr2=0x7fa0d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:52.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dff59640 1 -- 172.21.15.45:0/4053175338 shutdown_connections 2023-07-09T02:17:52.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dff59640 1 -- 172.21.15.45:0/4053175338 wait complete. 2023-07-09T02:17:52.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dff59640 1 Processor -- start 2023-07-09T02:17:52.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.748+0000 7fa0dff59640 1 -- start start 2023-07-09T02:17:52.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dff59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0d80c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dff59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8155660 0x7fa0d8151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dff59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d81524d0 0x7fa0d8159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dff59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8154990 con 0x7fa0c4003b40 2023-07-09T02:17:52.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dff59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8155bd0 con 0x7fa0d8155660 2023-07-09T02:17:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dff59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d81543d0 con 0x7fa0d81524d0 2023-07-09T02:17:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0d80c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0d80c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32956/0 (socket says 172.21.15.45:32956) 2023-07-09T02:17:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 -- 172.21.15.45:0/1918165580 learned_addr learned my addr 172.21.15.45:0/1918165580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8155660 0x7fa0d8151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d81524d0 0x7fa0d8159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 -- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d81524d0 msgr2=0x7fa0d8159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d81524d0 0x7fa0d8159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 -- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8155660 msgr2=0x7fa0d8151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8155660 0x7fa0d8151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 -- 172.21.15.45:0/1918165580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d81546b0 con 0x7fa0c4003b40 2023-07-09T02:17:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8155660 0x7fa0d8151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0d80c9b10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40018c0 tx=0x7fa0c4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ce7fc640 1 -- 172.21.15.45:0/1918165580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40052d0 con 0x7fa0c4003b40 2023-07-09T02:17:52.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ce7fc640 1 -- 172.21.15.45:0/1918165580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d4007a60 con 0x7fa0c4003b40 2023-07-09T02:17:52.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0ce7fc640 1 -- 172.21.15.45:0/1918165580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4007030 con 0x7fa0c4003b40 2023-07-09T02:17:52.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dff59640 1 -- 172.21.15.45:0/1918165580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d815ce50 con 0x7fa0c4003b40 2023-07-09T02:17:52.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.752+0000 7fa0dff59640 1 -- 172.21.15.45:0/1918165580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d8152da0 con 0x7fa0c4003b40 2023-07-09T02:17:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0ce7fc640 1 -- 172.21.15.45:0/1918165580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa0d40b2040 con 0x7fa0c4003b40 2023-07-09T02:17:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0ce7fc640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0bc066280 0x7fa0bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0ce7fc640 1 -- 172.21.15.45:0/1918165580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0d411e300 con 0x7fa0c4003b40 2023-07-09T02:17:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0e32d7000 1 Processor -- start 2023-07-09T02:17:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0e32d7000 1 -- start start 2023-07-09T02:17:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0bc066280 0x7fa0bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 0x55998287ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0bc066280 0x7fa0bc068730 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80b1f60 tx=0x7fa0c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287f110 0x559982834a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559982834f90 0x559982835360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599826fbf80 con 0x559982834f90 2023-07-09T02:17:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x559982635c60 con 0x55998287e800 2023-07-09T02:17:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x559982689700 con 0x55998287f110 2023-07-09T02:17:52.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0de4f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559982834f90 0x559982835360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0de4f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559982834f90 0x559982835360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32968/0 (socket says 172.21.15.45:32968) 2023-07-09T02:17:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0de4f6640 1 -- 172.21.15.45:0/1293392987 learned_addr learned my addr 172.21.15.45:0/1293392987 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287f110 0x559982834a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.756+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 0x55998287ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0de4f6640 1 -- 172.21.15.45:0/1293392987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287f110 msgr2=0x559982834a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287f110 0x559982834a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0de4f6640 1 -- 172.21.15.45:0/1293392987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 msgr2=0x55998287ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 0x55998287ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0de4f6640 1 -- 172.21.15.45:0/1293392987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55998237e890 con 0x559982834f90 2023-07-09T02:17:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559982834f90 0x559982835360 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80d1760 tx=0x7fa0d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fe050b30026a49 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0bb7fe640 1 -- 172.21.15.45:0/1293392987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000e040 con 0x559982834f90 2023-07-09T02:17:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0bb7fe640 1 -- 172.21.15.45:0/1293392987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0003db0 con 0x559982834f90 2023-07-09T02:17:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0bb7fe640 1 -- 172.21.15.45:0/1293392987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0004270 con 0x559982834f90 2023-07-09T02:17:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1293392987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559982834f90 msgr2=0x559982835360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559982834f90 0x559982835360 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80d1760 tx=0x7fa0d0009750 comp rx=0 tx=0).stop 2023-07-09T02:17:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1293392987 shutdown_connections 2023-07-09T02:17:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559982834f90 0x559982835360 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287f110 0x559982834a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/1293392987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 0x55998287ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1293392987 >> 172.21.15.45:0/1293392987 conn(0x5599826f7a70 msgr2=0x559982833330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1293392987 shutdown_connections 2023-07-09T02:17:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1293392987 wait complete. 2023-07-09T02:17:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- start start 2023-07-09T02:17:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 Processor -- start 2023-07-09T02:17:52.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 0x55998283fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 0x559982840330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x559982840870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599826827a0 con 0x55998287f110 2023-07-09T02:17:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55998263ef00 con 0x55998287e800 2023-07-09T02:17:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55998263eba0 con 0x559982834f90 2023-07-09T02:17:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0e32d7000 10 client.0 _ll_register_callbacks cb 0x559982820930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:17:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0de4f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x559982840870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.760+0000 7fa0ddcf5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 0x55998283fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0de4f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x559982840870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32984/0 (socket says 172.21.15.45:32984) 2023-07-09T02:17:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0de4f6640 1 -- 172.21.15.45:0/2910426346 learned_addr learned my addr 172.21.15.45:0/2910426346 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 0x559982840330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0de4f6640 1 -- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 msgr2=0x55998283fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 0x55998283fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0de4f6640 1 -- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 msgr2=0x559982840330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 0x559982840330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0de4f6640 1 -- 172.21.15.45:0/2910426346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d0009a70 con 0x55998287f110 2023-07-09T02:17:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x559982840870 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x5599826741d0 tx=0x7fa0d0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f543bf5c9096e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:17:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/2910426346 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000e040 con 0x55998287f110 2023-07-09T02:17:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 1 -- 172.21.15.45:0/2910426346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599826810f0 con 0x55998287f110 2023-07-09T02:17:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/2910426346 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0d002ac40 con 0x55998287f110 2023-07-09T02:17:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/2910426346 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0d0007eb0 con 0x55998287f110 2023-07-09T02:17:52.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 10 client.7941 fetch_fsmap learned FSMap version 67 2023-07-09T02:17:52.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 1 -- 172.21.15.45:0/2910426346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x559982647130 con 0x55998287f110 2023-07-09T02:17:52.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/2910426346 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5599826810f0 con 0x55998287f110 2023-07-09T02:17:52.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/2910426346 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa0d0014040 con 0x55998287f110 2023-07-09T02:17:52.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 10 client.7941 fetch_fsmap finished waiting for FSMap version 67 2023-07-09T02:17:52.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 10 client.7941 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T02:17:52.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 20 client.7941 populate_metadata read hostname 'smithi045' 2023-07-09T02:17:52.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] conn(0x55998288d870 0x55998288fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 4 client.7941 mds_command: new command op to 7809 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:17:52.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 1 -- 172.21.15.45:0/2910426346 --> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559982649e40 con 0x55998288d870 2023-07-09T02:17:52.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] conn(0x55998288d870 0x55998288fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 10 client.7941 ms_handle_connect on v2:172.21.15.155:6835/1298123765 2023-07-09T02:17:52.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] conn(0x55998288d870 0x55998288fc50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=367450ff4312e383 server_cookie=63f017a8bf864f8 in_seq=0 out_seq=0 2023-07-09T02:17:52.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/2910426346 <== mds.0 v2:172.21.15.155:6835/1298123765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559982649e40 con 0x55998288d870 2023-07-09T02:17:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0b8ff9640 10 client.7941 handle_command_reply: tid=0 2023-07-09T02:17:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 1 client.7941 shutdown 2023-07-09T02:17:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 1 -- 172.21.15.45:0/2910426346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 msgr2=0x559982840870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.764+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x559982840870 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x5599826741d0 tx=0x7fa0d0004a50 comp rx=0 tx=0).stop 2023-07-09T02:17:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 1 -- 172.21.15.45:0/2910426346 shutdown_connections 2023-07-09T02:17:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] conn(0x55998288d870 0x55998288fc50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x559982840870 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287e800 0x559982840330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/2910426346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 0x55998283fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 1 -- 172.21.15.45:0/2910426346 >> 172.21.15.45:0/2910426346 conn(0x5599826f7a70 msgr2=0x559982833a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:52.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0b8ff9640 0 client.7941 ms_handle_reset on v2:172.21.15.155:6835/1298123765 2023-07-09T02:17:52.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 1 -- 172.21.15.45:0/2910426346 shutdown_connections 2023-07-09T02:17:52.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 1 -- 172.21.15.45:0/2910426346 wait complete. 2023-07-09T02:17:52.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.768+0000 7fa0e32d7000 20 client.7941 trim_cache size 0 max 16384 2023-07-09T02:17:52.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.780+0000 7fa0e32d7000 1 Processor -- start 2023-07-09T02:17:52.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.780+0000 7fa0e32d7000 1 -- start start 2023-07-09T02:17:52.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 0x5599828d9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287e800 0x5599828d9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287f110 0x5599828d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55998233f940 con 0x55998287e800 2023-07-09T02:17:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55998268a990 con 0x55998287f110 2023-07-09T02:17:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55998267ffb0 con 0x559982834f90 2023-07-09T02:17:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287e800 0x5599828d9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287e800 0x5599828d9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32998/0 (socket says 172.21.15.45:32998) 2023-07-09T02:17:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 -- 172.21.15.45:0/1347389846 learned_addr learned my addr 172.21.15.45:0/1347389846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287f110 0x5599828d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 0x5599828d9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 -- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 msgr2=0x5599828d9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 0x5599828d9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 -- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287f110 msgr2=0x5599828d9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287f110 0x5599828d9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 -- 172.21.15.45:0/1347389846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55998262d3c0 con 0x55998287e800 2023-07-09T02:17:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287f110 0x5599828d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:17:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287e800 0x5599828d9640 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8007f50 tx=0x7fa0c8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65eccbda22c52bcf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0bbfff640 1 -- 172.21.15.45:0/1347389846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8024450 con 0x55998287e800 2023-07-09T02:17:52.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0bbfff640 1 -- 172.21.15.45:0/1347389846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80245b0 con 0x55998287e800 2023-07-09T02:17:52.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0bbfff640 1 -- 172.21.15.45:0/1347389846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8024920 con 0x55998287e800 2023-07-09T02:17:52.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1347389846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287e800 msgr2=0x5599828d9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287e800 0x5599828d9640 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8007f50 tx=0x7fa0c8013000 comp rx=0 tx=0).stop 2023-07-09T02:17:52.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1347389846 shutdown_connections 2023-07-09T02:17:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55998287f110 0x5599828d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287e800 0x5599828d9640 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/1347389846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559982834f90 0x5599828d9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1347389846 >> 172.21.15.45:0/1347389846 conn(0x5599826f7a70 msgr2=0x559982890b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:52.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1347389846 shutdown_connections 2023-07-09T02:17:52.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- 172.21.15.45:0/1347389846 wait complete. 2023-07-09T02:17:52.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 -- start start 2023-07-09T02:17:52.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.784+0000 7fa0e32d7000 1 Processor -- start 2023-07-09T02:17:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559982834f90 0x55998287d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287e800 0x5599828990b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x5599828995f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55998267e110 con 0x55998287f110 2023-07-09T02:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x559982839a00 con 0x559982834f90 2023-07-09T02:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x559982685300 con 0x55998287e800 2023-07-09T02:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 10 client.0 _ll_register_callbacks cb 0x5599828014d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x5599828995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x5599828995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33000/0 (socket says 172.21.15.45:33000) 2023-07-09T02:17:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 -- 172.21.15.45:0/4147047746 learned_addr learned my addr 172.21.15.45:0/4147047746 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559982834f90 0x55998287d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0dd4f4640 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287e800 0x5599828990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 -- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287e800 msgr2=0x5599828990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287e800 0x5599828990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 -- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559982834f90 msgr2=0x55998287d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559982834f90 0x55998287d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 -- 172.21.15.45:0/4147047746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c800f040 con 0x55998287f110 2023-07-09T02:17:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559982834f90 0x55998287d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0de4f6640 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x5599828995f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009e50 tx=0x7fa0d0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800a8807e6a9778c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:17:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/4147047746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d000e040 con 0x55998287f110 2023-07-09T02:17:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 -- 172.21.15.45:0/4147047746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599828388c0 con 0x55998287f110 2023-07-09T02:17:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/4147047746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0d00338a0 con 0x55998287f110 2023-07-09T02:17:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/4147047746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0d0033a60 con 0x55998287f110 2023-07-09T02:17:52.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 10 client.7947 fetch_fsmap learned FSMap version 67 2023-07-09T02:17:52.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 -- 172.21.15.45:0/4147047746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55998237ecc0 con 0x55998287f110 2023-07-09T02:17:52.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/4147047746 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5599828388c0 con 0x55998287f110 2023-07-09T02:17:52.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/4147047746 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa0d0014070 con 0x55998287f110 2023-07-09T02:17:52.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 10 client.7947 fetch_fsmap finished waiting for FSMap version 67 2023-07-09T02:17:52.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 10 client.7947 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T02:17:52.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 20 client.7947 populate_metadata read hostname 'smithi045' 2023-07-09T02:17:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] conn(0x559982899b30 0x5599828e5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 4 client.7947 mds_command: new command op to 7809 tid=0[{"prefix": "status"}] 2023-07-09T02:17:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 -- 172.21.15.45:0/4147047746 --> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55998263b6f0 con 0x559982899b30 2023-07-09T02:17:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] conn(0x559982899b30 0x5599828e5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0ddcf5640 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] conn(0x559982899b30 0x5599828e5390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57c911a044259a8a server_cookie=540c1cdffe48558f in_seq=0 out_seq=0 2023-07-09T02:17:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 10 client.7947 ms_handle_connect on v2:172.21.15.155:6835/1298123765 2023-07-09T02:17:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 1 -- 172.21.15.45:0/4147047746 <== mds.0 v2:172.21.15.155:6835/1298123765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55998263b6f0 con 0x559982899b30 2023-07-09T02:17:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0b8ff9640 10 client.7947 handle_command_reply: tid=0 2023-07-09T02:17:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.788+0000 7fa0e32d7000 1 client.7947 shutdown 2023-07-09T02:17:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 -- 172.21.15.45:0/4147047746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 msgr2=0x5599828995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x5599828995f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009e50 tx=0x7fa0d0010000 comp rx=0 tx=0).stop 2023-07-09T02:17:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 -- 172.21.15.45:0/4147047746 shutdown_connections 2023-07-09T02:17:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:6835/1298123765,v1:172.21.15.155:6837/1298123765] conn(0x559982899b30 0x5599828e5390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55998287f110 0x5599828995f0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55998287e800 0x5599828990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0b8ff9640 0 client.7947 ms_handle_reset on v2:172.21.15.155:6835/1298123765 2023-07-09T02:17:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 --2- 172.21.15.45:0/4147047746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559982834f90 0x55998287d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 -- 172.21.15.45:0/4147047746 >> 172.21.15.45:0/4147047746 conn(0x5599826f7a70 msgr2=0x559982891260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 -- 172.21.15.45:0/4147047746 shutdown_connections 2023-07-09T02:17:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 1 -- 172.21.15.45:0/4147047746 wait complete. 2023-07-09T02:17:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0e32d7000 20 client.7947 trim_cache size 0 max 16384 2023-07-09T02:17:52.802 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:17:52.802 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:17:52.802 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:17:52.802 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 7809, 2023-07-09T02:17:52.802 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:17:52.803 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:17:52.803 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:17:52.803 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9320691390000002, 2023-07-09T02:17:52.803 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 67, 2023-07-09T02:17:52.804 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 138, 2023-07-09T02:17:52.804 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 138, 2023-07-09T02:17:52.804 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.827778908999999 2023-07-09T02:17:52.804 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:17:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 -- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0bc066280 msgr2=0x7fa0bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0bc066280 0x7fa0bc068730 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80b1f60 tx=0x7fa0c8009040 comp rx=0 tx=0).stop 2023-07-09T02:17:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 -- 172.21.15.45:0/1918165580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 msgr2=0x7fa0d80c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0d80c9b10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40018c0 tx=0x7fa0c4005800 comp rx=0 tx=0).stop 2023-07-09T02:17:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 -- 172.21.15.45:0/1918165580 shutdown_connections 2023-07-09T02:17:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa0bc066280 0x7fa0bc068730 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d81524d0 0x7fa0d8159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8155660 0x7fa0d8151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 --2- 172.21.15.45:0/1918165580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0c4003b40 0x7fa0d80c9b10 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 -- 172.21.15.45:0/1918165580 >> 172.21.15.45:0/1918165580 conn(0x7fa0d80698e0 msgr2=0x7fa0d80b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 -- 172.21.15.45:0/1918165580 shutdown_connections 2023-07-09T02:17:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.792+0000 7fa0dff59640 1 -- 172.21.15.45:0/1918165580 wait complete. 2023-07-09T02:17:52.811 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:17:52.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.952+0000 7f2c84256640 1 Processor -- start 2023-07-09T02:17:52.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.952+0000 7f2c84256640 1 -- start start 2023-07-09T02:17:52.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c84256640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2c7c15c060 0x7f2c7c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c84256640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c7c0cd120 0x7f2c7c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c84256640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c160a50 con 0x7f2c7c0d2450 2023-07-09T02:17:52.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c84256640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0d28d0 con 0x7f2c7c0cd120 2023-07-09T02:17:52.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c84256640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0cfe40 con 0x7f2c7c15c060 2023-07-09T02:17:52.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c817f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c7c0cd120 0x7f2c7c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c817f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c7c0cd120 0x7f2c7c0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33010/0 (socket says 172.21.15.45:33010) 2023-07-09T02:17:52.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c817f1640 1 -- 172.21.15.45:0/2174128775 learned_addr learned my addr 172.21.15.45:0/2174128775 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c81ff2640 1 --2- 172.21.15.45:0/2174128775 >> v2:172.21.15.155:3300/0 conn(0x7f2c7c15c060 0x7f2c7c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c817f1640 1 -- 172.21.15.45:0/2174128775 >> v2:172.21.15.155:3300/0 conn(0x7f2c7c15c060 msgr2=0x7f2c7c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c817f1640 1 --2- 172.21.15.45:0/2174128775 >> v2:172.21.15.155:3300/0 conn(0x7f2c7c15c060 0x7f2c7c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c817f1640 1 -- 172.21.15.45:0/2174128775 >> v1:172.21.15.155:6789/0 conn(0x7f2c7c0d2450 legacy=0x7f2c7c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c817f1640 1 -- 172.21.15.45:0/2174128775 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c15c430 con 0x7f2c7c0cd120 2023-07-09T02:17:52.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.956+0000 7f2c81ff2640 1 --2- 172.21.15.45:0/2174128775 >> v2:172.21.15.155:3300/0 conn(0x7f2c7c15c060 0x7f2c7c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c817f1640 1 --2- 172.21.15.45:0/2174128775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0cd120 0x7f2c7c0d1f10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0d3ad0 tx=0x7f2c6c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661fcc1a4aa3fe83 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c80ff0640 1 -- 172.21.15.45:0/2174128775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0ac410 con 0x7f2c7c0cd120 2023-07-09T02:17:52.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c80ff0640 1 -- 172.21.15.45:0/2174128775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0ac570 con 0x7f2c7c0cd120 2023-07-09T02:17:52.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c80ff0640 1 -- 172.21.15.45:0/2174128775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0ac900 con 0x7f2c7c0cd120 2023-07-09T02:17:52.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 -- 172.21.15.45:0/2174128775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0cd120 msgr2=0x7f2c7c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 --2- 172.21.15.45:0/2174128775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0cd120 0x7f2c7c0d1f10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0d3ad0 tx=0x7f2c6c01c490 comp rx=0 tx=0).stop 2023-07-09T02:17:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 -- 172.21.15.45:0/2174128775 shutdown_connections 2023-07-09T02:17:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 --2- 172.21.15.45:0/2174128775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0cd120 0x7f2c7c0d1f10 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 --2- 172.21.15.45:0/2174128775 >> v2:172.21.15.155:3300/0 conn(0x7f2c7c15c060 0x7f2c7c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 -- 172.21.15.45:0/2174128775 >> 172.21.15.45:0/2174128775 conn(0x7f2c7c0698e0 msgr2=0x7f2c7c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:52.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 -- 172.21.15.45:0/2174128775 shutdown_connections 2023-07-09T02:17:52.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 -- 172.21.15.45:0/2174128775 wait complete. 2023-07-09T02:17:52.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 Processor -- start 2023-07-09T02:17:52.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.960+0000 7f2c84256640 1 -- start start 2023-07-09T02:17:52.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c7c0cd120 0x7f2c7c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0d2450 0x7f2c7c151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c7c15c060 0x7f2c7c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0ccca0 con 0x7f2c7c0d2450 2023-07-09T02:17:52.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c15d210 con 0x7f2c7c15c060 2023-07-09T02:17:52.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c15d4f0 con 0x7f2c7c0cd120 2023-07-09T02:17:52.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0d2450 0x7f2c7c151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0d2450 0x7f2c7c151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33014/0 (socket says 172.21.15.45:33014) 2023-07-09T02:17:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 -- 172.21.15.45:0/4281515395 learned_addr learned my addr 172.21.15.45:0/4281515395 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 -- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c7c0cd120 msgr2=0x7f2c7c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c7c0cd120 0x7f2c7c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 -- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c7c15c060 msgr2=0x7f2c7c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c7c15c060 0x7f2c7c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 -- 172.21.15.45:0/4281515395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0094d0 con 0x7f2c7c0d2450 2023-07-09T02:17:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c817f1640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0d2450 0x7f2c7c151d70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0af040 tx=0x7f2c6c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c727fc640 1 -- 172.21.15.45:0/4281515395 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0ac410 con 0x7f2c7c0d2450 2023-07-09T02:17:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c727fc640 1 -- 172.21.15.45:0/4281515395 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0b65f0 con 0x7f2c7c0d2450 2023-07-09T02:17:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c727fc640 1 -- 172.21.15.45:0/4281515395 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0b69a0 con 0x7f2c7c0d2450 2023-07-09T02:17:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c15d7d0 con 0x7f2c7c0d2450 2023-07-09T02:17:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c0cc8c0 con 0x7f2c7c0d2450 2023-07-09T02:17:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c15d070 con 0x7f2c7c0d2450 2023-07-09T02:17:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.964+0000 7f2c727fc640 1 -- 172.21.15.45:0/4281515395 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c6c0b6b00 con 0x7f2c7c0d2450 2023-07-09T02:17:52.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.968+0000 7f2c727fc640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c60066280 0x7f2c60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:52.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.968+0000 7f2c727fc640 1 -- 172.21.15.45:0/4281515395 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c6c11e9e0 con 0x7f2c7c0d2450 2023-07-09T02:17:52.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.968+0000 7f2c81ff2640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c60066280 0x7f2c60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:52.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.968+0000 7f2c81ff2640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c60066280 0x7f2c60068730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c1544d0 tx=0x7f2c78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:52.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:52.972+0000 7f2c727fc640 1 -- 172.21.15.45:0/4281515395 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2c7c15d070 con 0x7f2c7c0d2450 2023-07-09T02:17:53.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.156+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2c7c15d070 con 0x7f2c7c0d2450 2023-07-09T02:17:53.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.156+0000 7f2c727fc640 1 -- 172.21.15.45:0/4281515395 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2c7c15d070 con 0x7f2c7c0d2450 2023-07-09T02:17:53.160 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:17:53.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c60066280 msgr2=0x7f2c60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:53.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c60066280 0x7f2c60068730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c1544d0 tx=0x7f2c78008040 comp rx=0 tx=0).stop 2023-07-09T02:17:53.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0d2450 msgr2=0x7f2c7c151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:53.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0d2450 0x7f2c7c151d70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0af040 tx=0x7f2c6c019230 comp rx=0 tx=0).stop 2023-07-09T02:17:53.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 shutdown_connections 2023-07-09T02:17:53.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c7c15c060 0x7f2c7c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:53.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7c0d2450 0x7f2c7c151d70 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:53.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2c60066280 0x7f2c60068730 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:53.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 --2- 172.21.15.45:0/4281515395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c7c0cd120 0x7f2c7c15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:53.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 >> 172.21.15.45:0/4281515395 conn(0x7f2c7c0698e0 msgr2=0x7f2c7c0b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:53.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 shutdown_connections 2023-07-09T02:17:53.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:53.160+0000 7f2c84256640 1 -- 172.21.15.45:0/4281515395 wait complete. 2023-07-09T02:17:53.180 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:17:53.180 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:17:53.181 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:17:53.181 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:17:53.181 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:53.181 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:17:53.182 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:17:53.182 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:17:53.182 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:17:53.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.183 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:17:53.192 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:17:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:17:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:17:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:17:53.193 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:53.193 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:53.194 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:53.194 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:17:53.194 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:17:53.194 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:53.194 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:17:53.194 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:17:53.194 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42053sec preferred_lft 42053sec 2023-07-09T02:17:53.194 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:17:53.195 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:53.195 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:53.195 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:53.195 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:17:53.195 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:53.195 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:53.195 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:17:53.195 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:17:53.196 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:53.196 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:17:53.196 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:53.196 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:17:53.196 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:53.196 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:17:53.196 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:53.197 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:17:53.197 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:53.197 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:17:53.197 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:17:53.197 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:17:53.197 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:53.197 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:17:53.197 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:17:53.198 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:17:53.198 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:53.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.199 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:17:53.258 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:17:53.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.261 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:17:53.312 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:17:53.313 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:17:53.313 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:17:53.313 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:17:53.313 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:17:53.313 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:17:53.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.314 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:17:53.314 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:17:53.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:17:53.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:17:53.316 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:17:53.316 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:17:53.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.409 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:17:53.418 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:17:53.418 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:17:53.419 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:17:53.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:17:53.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:17:53.481 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:53.532 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:17:53.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:17:53.533 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:53.583 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:17:53.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:53.679 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:53.679 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:17:53.691 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:53.691 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:17:53.692 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:17:53.692 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:17:53.692 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:17:53.696 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:17:53.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.697 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:17:53.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:53.719 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:17:53.780 INFO:teuthology.orchestra.run.smithi045.stdout:client6650 2023-07-09T02:17:53.780 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:53.781 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:53.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:17:54.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f8066b9f640 1 Processor -- start 2023-07-09T02:17:54.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f8066b9f640 1 -- start start 2023-07-09T02:17:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f8066b9f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80600d2620 0x7f80600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f8066b9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600cd120 0x7f80600cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f8066b9f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8060160a50 con 0x7f806015c060 2023-07-09T02:17:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f8066b9f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806015c430 con 0x7f80600d2620 2023-07-09T02:17:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f8066b9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806015fb60 con 0x7f80600cd120 2023-07-09T02:17:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f805ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80600d2620 0x7f80600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f805ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80600d2620 0x7f80600b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33028/0 (socket says 172.21.15.45:33028) 2023-07-09T02:17:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f805ffff640 1 -- 172.21.15.45:0/2659452369 learned_addr learned my addr 172.21.15.45:0/2659452369 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f806513c640 1 --2- 172.21.15.45:0/2659452369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600cd120 0x7f80600cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f805ffff640 1 -- 172.21.15.45:0/2659452369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600cd120 msgr2=0x7f80600cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f805ffff640 1 --2- 172.21.15.45:0/2659452369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600cd120 0x7f80600cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f805ffff640 1 -- 172.21.15.45:0/2659452369 >> v1:172.21.15.155:6789/0 conn(0x7f806015c060 legacy=0x7f80600d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.024+0000 7f805ffff640 1 -- 172.21.15.45:0/2659452369 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806015fe40 con 0x7f80600d2620 2023-07-09T02:17:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f805ffff640 1 --2- 172.21.15.45:0/2659452369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600d2620 0x7f80600b4ed0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f804c009870 tx=0x7f804c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ee062903f6112e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f805f7fe640 1 -- 172.21.15.45:0/2659452369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c0aa670 con 0x7f80600d2620 2023-07-09T02:17:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f805f7fe640 1 -- 172.21.15.45:0/2659452369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c0aa7d0 con 0x7f80600d2620 2023-07-09T02:17:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f805f7fe640 1 -- 172.21.15.45:0/2659452369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c0aab60 con 0x7f80600d2620 2023-07-09T02:17:54.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f8066b9f640 1 -- 172.21.15.45:0/2659452369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600d2620 msgr2=0x7f80600b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:54.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f8066b9f640 1 --2- 172.21.15.45:0/2659452369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600d2620 0x7f80600b4ed0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f804c009870 tx=0x7f804c01c510 comp rx=0 tx=0).stop 2023-07-09T02:17:54.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f8066b9f640 1 -- 172.21.15.45:0/2659452369 shutdown_connections 2023-07-09T02:17:54.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f8066b9f640 1 --2- 172.21.15.45:0/2659452369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600cd120 0x7f80600cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f8066b9f640 1 --2- 172.21.15.45:0/2659452369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600d2620 0x7f80600b4ed0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f8066b9f640 1 -- 172.21.15.45:0/2659452369 >> 172.21.15.45:0/2659452369 conn(0x7f80600698e0 msgr2=0x7f8060069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f8066b9f640 1 -- 172.21.15.45:0/2659452369 shutdown_connections 2023-07-09T02:17:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.028+0000 7f8066b9f640 1 -- 172.21.15.45:0/2659452369 wait complete. 2023-07-09T02:17:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 Processor -- start 2023-07-09T02:17:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 -- start start 2023-07-09T02:17:54.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600cd120 0x7f806015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:54.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600d2620 0x7f80600c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:54.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806015c060 0x7f8060156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:54.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806015ec00 con 0x7f80600cd120 2023-07-09T02:17:54.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806015b220 con 0x7f806015c060 2023-07-09T02:17:54.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806015e5b0 con 0x7f80600d2620 2023-07-09T02:17:54.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600cd120 0x7f806015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:54.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600cd120 0x7f806015ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33042/0 (socket says 172.21.15.45:33042) 2023-07-09T02:17:54.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 -- 172.21.15.45:0/3867487596 learned_addr learned my addr 172.21.15.45:0/3867487596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:54.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f805ffff640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600d2620 0x7f80600c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:54.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806513c640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806015c060 0x7f8060156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:54.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 -- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600d2620 msgr2=0x7f80600c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:54.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600d2620 0x7f80600c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 -- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806015c060 msgr2=0x7f8060156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:54.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806015c060 0x7f8060156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 -- 172.21.15.45:0/3867487596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0094d0 con 0x7f80600cd120 2023-07-09T02:17:54.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f806493b640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600cd120 0x7f806015ac40 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f805400c500 tx=0x7f805400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:54.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f805d7fa640 1 -- 172.21.15.45:0/3867487596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054005220 con 0x7f80600cd120 2023-07-09T02:17:54.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f805d7fa640 1 -- 172.21.15.45:0/3867487596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8054005380 con 0x7f80600cd120 2023-07-09T02:17:54.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80600b59f0 con 0x7f80600cd120 2023-07-09T02:17:54.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f805d7fa640 1 -- 172.21.15.45:0/3867487596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054007270 con 0x7f80600cd120 2023-07-09T02:17:54.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80600c9500 con 0x7f80600cd120 2023-07-09T02:17:54.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.032+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806004d7d0 con 0x7f80600cd120 2023-07-09T02:17:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.036+0000 7f805d7fa640 1 -- 172.21.15.45:0/3867487596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80540073d0 con 0x7f80600cd120 2023-07-09T02:17:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.036+0000 7f805d7fa640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8044066280 0x7f8044068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.036+0000 7f805d7fa640 1 -- 172.21.15.45:0/3867487596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80540836c0 con 0x7f80600cd120 2023-07-09T02:17:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.036+0000 7f805ffff640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8044066280 0x7f8044068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.036+0000 7f805ffff640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8044066280 0x7f8044068730 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f804c0ae000 tx=0x7f804c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.040+0000 7f805d7fa640 1 -- 172.21.15.45:0/3867487596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8054050ab0 con 0x7f80600cd120 2023-07-09T02:17:54.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.224+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f806006baa0 con 0x7f80600cd120 2023-07-09T02:17:54.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.224+0000 7f805d7fa640 1 -- 172.21.15.45:0/3867487596 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f80540540d0 con 0x7f80600cd120 2023-07-09T02:17:54.229 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:17:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8044066280 msgr2=0x7f8044068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8044066280 0x7f8044068730 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f804c0ae000 tx=0x7f804c0a7000 comp rx=0 tx=0).stop 2023-07-09T02:17:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600cd120 msgr2=0x7f806015ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600cd120 0x7f806015ac40 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f805400c500 tx=0x7f805400c9c0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 shutdown_connections 2023-07-09T02:17:54.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806015c060 0x7f8060156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8044066280 0x7f8044068730 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80600d2620 0x7f80600c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 --2- 172.21.15.45:0/3867487596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80600cd120 0x7f806015ac40 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 >> 172.21.15.45:0/3867487596 conn(0x7f80600698e0 msgr2=0x7f80600d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 shutdown_connections 2023-07-09T02:17:54.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:54.228+0000 7f8066b9f640 1 -- 172.21.15.45:0/3867487596 wait complete. 2023-07-09T02:17:54.248 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:17:54.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:17:54.249 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:17:54.249 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:17:54.249 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:54.249 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:17:54.250 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:17:54.250 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:17:54.250 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:17:54.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.251 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:17:54.261 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:17:54.262 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:17:54.262 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:17:54.262 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:54.262 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:17:54.262 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:54.262 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:54.263 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:54.263 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:17:54.263 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:54.263 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:54.263 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:17:54.263 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:17:54.263 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:54.264 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:17:54.264 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:54.264 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:17:54.264 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42059sec preferred_lft 42059sec 2023-07-09T02:17:54.264 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:17:54.264 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:54.264 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:17:54.264 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:54.265 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:17:54.265 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:54.265 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:17:54.265 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:17:54.265 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:17:54.265 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:54.265 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:17:54.266 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:54.266 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:17:54.266 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:17:54.266 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:17:54.266 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:54.266 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:17:54.266 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:17:54.266 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:17:54.267 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:17:54.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.268 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:17:54.332 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:17:54.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.334 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:17:54.387 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:17:54.387 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:17:54.387 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:17:54.387 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:17:54.388 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:17:54.388 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:17:54.388 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:17:54.388 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:17:54.388 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:17:54.388 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:17:54.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.389 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:17:54.389 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:17:54.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:17:54.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:17:54.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:17:54.390 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:17:54.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.487 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:17:54.496 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:17:54.496 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:17:54.497 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:17:54.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.498 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:17:54.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:17:54.560 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:54.611 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:17:54.612 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:17:54.612 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:54.663 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:17:54.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.665 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:54.759 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:54.759 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:17:54.770 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:17:54.770 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:17:54.771 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:17:54.771 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:17:54.771 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:17:54.774 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:17:54.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:17:54.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:54.795 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:17:54.850 INFO:teuthology.orchestra.run.smithi155.stdout:client7537 2023-07-09T02:17:54.850 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:17:54.851 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:54.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:17:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93d4ee5640 1 Processor -- start 2023-07-09T02:17:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93d4ee5640 1 -- start start 2023-07-09T02:17:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93d4ee5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d00cd120 0x7f93d00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93d4ee5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d0160a50 con 0x7f93d015c060 2023-07-09T02:17:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93d4ee5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d015c430 con 0x7f93d00d2620 2023-07-09T02:17:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93d4ee5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d015fb60 con 0x7f93d00cd120 2023-07-09T02:17:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93ce59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f93d015c060 0x7f93d00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51434/0 (socket says 172.21.15.45:51434) 2023-07-09T02:17:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93ce59c640 1 -- 172.21.15.45:0/2462849621 learned_addr learned my addr 172.21.15.45:0/2462849621 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93ced9d640 1 --2- 172.21.15.45:0/2462849621 >> v2:172.21.15.45:3300/0 conn(0x7f93d00cd120 0x7f93d00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93cdd9b640 1 -- 172.21.15.45:0/2462849621 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501937214 0 0) 0x7f93d0160a50 con 0x7f93d015c060 2023-07-09T02:17:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93cdd9b640 1 -- 172.21.15.45:0/2462849621 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93bc003530 con 0x7f93d015c060 2023-07-09T02:17:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93ced9d640 1 -- 172.21.15.45:0/2462849621 >> v1:172.21.15.155:6789/0 conn(0x7f93d00d2620 legacy=0x7f93d00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93ced9d640 1 -- 172.21.15.45:0/2462849621 >> v1:172.21.15.45:6789/0 conn(0x7f93d015c060 legacy=0x7f93d00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.048+0000 7f93ced9d640 1 -- 172.21.15.45:0/2462849621 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d015fe40 con 0x7f93d00cd120 2023-07-09T02:17:55.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93ced9d640 1 --2- 172.21.15.45:0/2462849621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00cd120 0x7f93d00b4ed0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009d90 tx=0x7f93c801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf027d9ebd376bf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:55.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93cdd9b640 1 -- 172.21.15.45:0/2462849621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80a59e0 con 0x7f93d00cd120 2023-07-09T02:17:55.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93cdd9b640 1 -- 172.21.15.45:0/2462849621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c80a5b40 con 0x7f93d00cd120 2023-07-09T02:17:55.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93cdd9b640 1 -- 172.21.15.45:0/2462849621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80ad440 con 0x7f93d00cd120 2023-07-09T02:17:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93d4ee5640 1 -- 172.21.15.45:0/2462849621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00cd120 msgr2=0x7f93d00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93d4ee5640 1 --2- 172.21.15.45:0/2462849621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00cd120 0x7f93d00b4ed0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009d90 tx=0x7f93c801c920 comp rx=0 tx=0).stop 2023-07-09T02:17:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93d4ee5640 1 -- 172.21.15.45:0/2462849621 shutdown_connections 2023-07-09T02:17:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93d4ee5640 1 --2- 172.21.15.45:0/2462849621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00cd120 0x7f93d00b4ed0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93d4ee5640 1 -- 172.21.15.45:0/2462849621 >> 172.21.15.45:0/2462849621 conn(0x7f93d00698e0 msgr2=0x7f93d0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93d4ee5640 1 -- 172.21.15.45:0/2462849621 shutdown_connections 2023-07-09T02:17:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.052+0000 7f93d4ee5640 1 -- 172.21.15.45:0/2462849621 wait complete. 2023-07-09T02:17:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 Processor -- start 2023-07-09T02:17:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 -- start start 2023-07-09T02:17:55.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00cd120 0x7f93d015f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00d2620 0x7f93d015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015c060 0x7f93d013a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d015a2b0 con 0x7f93d00d2620 2023-07-09T02:17:55.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0155570 con 0x7f93d00cd120 2023-07-09T02:17:55.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d0154cd0 con 0x7f93d015c060 2023-07-09T02:17:55.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00d2620 0x7f93d015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00d2620 0x7f93d015a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33064/0 (socket says 172.21.15.45:33064) 2023-07-09T02:17:55.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 -- 172.21.15.45:0/1798661982 learned_addr learned my addr 172.21.15.45:0/1798661982 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:55.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93ced9d640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015c060 0x7f93d013a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93ce59c640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00cd120 0x7f93d015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 -- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015c060 msgr2=0x7f93d013a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015c060 0x7f93d013a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 -- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00cd120 msgr2=0x7f93d015f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00cd120 0x7f93d015f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 -- 172.21.15.45:0/1798661982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8009a70 con 0x7f93d00d2620 2023-07-09T02:17:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c7fff640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00d2620 0x7f93d015a740 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f93b800c430 tx=0x7f93b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c6ffd640 1 -- 172.21.15.45:0/1798661982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b80052d0 con 0x7f93d00d2620 2023-07-09T02:17:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c6ffd640 1 -- 172.21.15.45:0/1798661982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b8005430 con 0x7f93d00d2620 2023-07-09T02:17:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93c6ffd640 1 -- 172.21.15.45:0/1798661982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8007260 con 0x7f93d00d2620 2023-07-09T02:17:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d00b59f0 con 0x7f93d00d2620 2023-07-09T02:17:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d0155290 con 0x7f93d00d2620 2023-07-09T02:17:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.056+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d004d7d0 con 0x7f93d00d2620 2023-07-09T02:17:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.060+0000 7f93c6ffd640 1 -- 172.21.15.45:0/1798661982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93b80073c0 con 0x7f93d00d2620 2023-07-09T02:17:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.060+0000 7f93c6ffd640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93b00662b0 0x7f93b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.060+0000 7f93c6ffd640 1 -- 172.21.15.45:0/1798661982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93b8082fc0 con 0x7f93d00d2620 2023-07-09T02:17:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.060+0000 7f93ce59c640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93b00662b0 0x7f93b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.060+0000 7f93ce59c640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93b00662b0 0x7f93b0068760 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f93c00011f0 tx=0x7f93c0007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:55.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.064+0000 7f93c6ffd640 1 -- 172.21.15.45:0/1798661982 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93b80b3700 con 0x7f93d00d2620 2023-07-09T02:17:55.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.252+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93d006baa0 con 0x7f93d00d2620 2023-07-09T02:17:55.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93c6ffd640 1 -- 172.21.15.45:0/1798661982 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f93b8050560 con 0x7f93d00d2620 2023-07-09T02:17:55.256 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:55.257 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:17:55.257 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:17:55.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93b00662b0 msgr2=0x7f93b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93b00662b0 0x7f93b0068760 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f93c00011f0 tx=0x7f93c0007d40 comp rx=0 tx=0).stop 2023-07-09T02:17:55.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00d2620 msgr2=0x7f93d015a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00d2620 0x7f93d015a740 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f93b800c430 tx=0x7f93b800c8f0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 shutdown_connections 2023-07-09T02:17:55.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f93b00662b0 0x7f93b0068760 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015c060 0x7f93d013a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d00d2620 0x7f93d015a740 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 --2- 172.21.15.45:0/1798661982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00cd120 0x7f93d015f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 >> 172.21.15.45:0/1798661982 conn(0x7f93d00698e0 msgr2=0x7f93d00b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 shutdown_connections 2023-07-09T02:17:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.256+0000 7f93d4ee5640 1 -- 172.21.15.45:0/1798661982 wait complete. 2023-07-09T02:17:55.277 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-07-09T02:17:55.436 INFO:teuthology.orchestra.run.smithi155.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":7809,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5618905349999999,"mdsmap_epoch":67,"osdmap_epoch":138,"osdmap_epoch_barrier":138,"uptime":14.457568172} 2023-07-09T02:17:55.437 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 7809, "mdsmap_epoch": 67, "osdmap_epoch": 138, "osdmap_epoch_barrier": 138, "rank_uptime": 8.561890535, "state": "up:active", "uptime": 14.457568172, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:17:55.437 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-07-09T02:17:55.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e9219640 1 Processor -- start 2023-07-09T02:17:55.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e9219640 1 -- start start 2023-07-09T02:17:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e9219640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05e40cd060 0x7f05e40cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e9219640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05e40b4490 0x7f05e40b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e9219640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e40d19c0 con 0x7f05e415c480 2023-07-09T02:17:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e9219640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e415c850 con 0x7f05e40cd060 2023-07-09T02:17:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e9219640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e40b4e50 con 0x7f05e40b4490 2023-07-09T02:17:55.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05e40cd060 0x7f05e40cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05e40cd060 0x7f05e40cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33074/0 (socket says 172.21.15.45:33074) 2023-07-09T02:17:55.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e259c640 1 -- 172.21.15.45:0/2638894509 learned_addr learned my addr 172.21.15.45:0/2638894509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:55.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e359e640 1 --2- 172.21.15.45:0/2638894509 >> v2:172.21.15.155:3300/0 conn(0x7f05e40b4490 0x7f05e40b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e259c640 1 -- 172.21.15.45:0/2638894509 >> v2:172.21.15.155:3300/0 conn(0x7f05e40b4490 msgr2=0x7f05e40b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e259c640 1 --2- 172.21.15.45:0/2638894509 >> v2:172.21.15.155:3300/0 conn(0x7f05e40b4490 0x7f05e40b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e259c640 1 -- 172.21.15.45:0/2638894509 >> v1:172.21.15.155:6789/0 conn(0x7f05e415c480 legacy=0x7f05e40d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:55.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.584+0000 7f05e259c640 1 -- 172.21.15.45:0/2638894509 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e40cf210 con 0x7f05e40cd060 2023-07-09T02:17:55.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e259c640 1 --2- 172.21.15.45:0/2638894509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40cd060 0x7f05e40cecd0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f05e40b8b60 tx=0x7f05d801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1102ccd6d9a18e40 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:55.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e1d9b640 1 -- 172.21.15.45:0/2638894509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80ab600 con 0x7f05e40cd060 2023-07-09T02:17:55.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e1d9b640 1 -- 172.21.15.45:0/2638894509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d80a7050 con 0x7f05e40cd060 2023-07-09T02:17:55.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e1d9b640 1 -- 172.21.15.45:0/2638894509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80ab980 con 0x7f05e40cd060 2023-07-09T02:17:55.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e9219640 1 -- 172.21.15.45:0/2638894509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40cd060 msgr2=0x7f05e40cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e9219640 1 --2- 172.21.15.45:0/2638894509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40cd060 0x7f05e40cecd0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f05e40b8b60 tx=0x7f05d801c500 comp rx=0 tx=0).stop 2023-07-09T02:17:55.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e9219640 1 -- 172.21.15.45:0/2638894509 shutdown_connections 2023-07-09T02:17:55.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e9219640 1 --2- 172.21.15.45:0/2638894509 >> v2:172.21.15.155:3300/0 conn(0x7f05e40b4490 0x7f05e40b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e9219640 1 --2- 172.21.15.45:0/2638894509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40cd060 0x7f05e40cecd0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e9219640 1 -- 172.21.15.45:0/2638894509 >> 172.21.15.45:0/2638894509 conn(0x7f05e40cf490 msgr2=0x7f05e40cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:55.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e9219640 1 -- 172.21.15.45:0/2638894509 shutdown_connections 2023-07-09T02:17:55.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.588+0000 7f05e9219640 1 -- 172.21.15.45:0/2638894509 wait complete. 2023-07-09T02:17:55.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 Processor -- start 2023-07-09T02:17:55.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 -- start start 2023-07-09T02:17:55.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40b4490 0x7f05e40c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e40cd060 0x7f05e40cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05e415c480 0x7f05e40cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e415de40 con 0x7f05e40b4490 2023-07-09T02:17:55.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e41517d0 con 0x7f05e40cd060 2023-07-09T02:17:55.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e415d4f0 con 0x7f05e415c480 2023-07-09T02:17:55.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40b4490 0x7f05e40c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40b4490 0x7f05e40c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33078/0 (socket says 172.21.15.45:33078) 2023-07-09T02:17:55.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 -- 172.21.15.45:0/2958307291 learned_addr learned my addr 172.21.15.45:0/2958307291 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:55.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e359e640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05e415c480 0x7f05e40cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e259c640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e40cd060 0x7f05e40cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 -- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05e415c480 msgr2=0x7f05e40cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05e415c480 0x7f05e40cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 -- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e40cd060 msgr2=0x7f05e40cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:55.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e40cd060 0x7f05e40cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:55.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 -- 172.21.15.45:0/2958307291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d80094d0 con 0x7f05e40b4490 2023-07-09T02:17:55.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e259c640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e40cd060 0x7f05e40cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:17:55.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e2d9d640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40b4490 0x7f05e40c90d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c3c0 tx=0x7f05d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:55.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05cb7fe640 1 -- 172.21.15.45:0/2958307291 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40052d0 con 0x7f05e40b4490 2023-07-09T02:17:55.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05cb7fe640 1 -- 172.21.15.45:0/2958307291 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4005430 con 0x7f05e40b4490 2023-07-09T02:17:55.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e40c9fc0 con 0x7f05e40b4490 2023-07-09T02:17:55.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05cb7fe640 1 -- 172.21.15.45:0/2958307291 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4003840 con 0x7f05e40b4490 2023-07-09T02:17:55.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e415da60 con 0x7f05e40b4490 2023-07-09T02:17:55.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.592+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e404d7d0 con 0x7f05e40b4490 2023-07-09T02:17:55.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.596+0000 7f05cb7fe640 1 -- 172.21.15.45:0/2958307291 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05d40039a0 con 0x7f05e40b4490 2023-07-09T02:17:55.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.596+0000 7f05cb7fe640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05d0066280 0x7f05d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:55.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.596+0000 7f05cb7fe640 1 -- 172.21.15.45:0/2958307291 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05d4083270 con 0x7f05e40b4490 2023-07-09T02:17:55.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.596+0000 7f05e259c640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05d0066280 0x7f05d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:55.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.596+0000 7f05e259c640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05d0066280 0x7f05d0068730 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f05d80ad000 tx=0x7f05d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:55.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.600+0000 7f05cb7fe640 1 -- 172.21.15.45:0/2958307291 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05d4050720 con 0x7f05e40b4490 2023-07-09T02:17:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:55.752+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f05e4155870 con 0x7f05e40b4490 2023-07-09T02:17:56.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.380+0000 7f05cb7fe640 1 -- 172.21.15.45:0/2958307291 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v139) v1 ==== 181+0+0 (secure 0 0 0) 0x7f05d4053d40 con 0x7f05e40b4490 2023-07-09T02:17:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-07-09T02:17:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05d0066280 msgr2=0x7f05d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05d0066280 0x7f05d0068730 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f05d80ad000 tx=0x7f05d8008040 comp rx=0 tx=0).stop 2023-07-09T02:17:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40b4490 msgr2=0x7f05e40c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40b4490 0x7f05e40c90d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c3c0 tx=0x7f05d400c880 comp rx=0 tx=0).stop 2023-07-09T02:17:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 shutdown_connections 2023-07-09T02:17:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05d0066280 0x7f05d0068730 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05e415c480 0x7f05e40cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:56.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e40cd060 0x7f05e40cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:56.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 --2- 172.21.15.45:0/2958307291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05e40b4490 0x7f05e40c90d0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:56.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 >> 172.21.15.45:0/2958307291 conn(0x7f05e40cf490 msgr2=0x7f05e40b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:56.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 shutdown_connections 2023-07-09T02:17:56.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:56.384+0000 7f05e9219640 1 -- 172.21.15.45:0/2958307291 wait complete. 2023-07-09T02:17:56.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-07-09T02:17:56.570 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_mon_report_interval":"5"} 2023-07-09T02:17:56.571 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-07-09T02:17:56.572 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-07-09T02:17:56.572 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:56.573 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:56.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:56.582 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-07-09T02:17:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:16+0 records in 2023-07-09T02:17:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:16+0 records out 2023-07-09T02:17:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.116557 s, 144 MB/s 2023-07-09T02:17:56.757 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:17:56.758 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:17:56.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:17:56.767 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-07-09T02:17:56.944 INFO:teuthology.orchestra.run.smithi045.stderr:17+0 records in 2023-07-09T02:17:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:17+0 records out 2023-07-09T02:17:56.945 INFO:teuthology.orchestra.run.smithi045.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.125743 s, 142 MB/s 2023-07-09T02:17:56.947 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-07-09T02:17:56.947 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:17:57.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.088+0000 7f6ef340b640 1 Processor -- start 2023-07-09T02:17:57.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.088+0000 7f6ef340b640 1 -- start start 2023-07-09T02:17:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef340b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6eec0ca0f0 0x7f6eec0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef340b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0cbbb0 0x7f6eec0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef340b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec06bf30 con 0x7f6eec0c9250 2023-07-09T02:17:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef340b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eec06bc50 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef340b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec0cab90 con 0x7f6eec0cbbb0 2023-07-09T02:17:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef11a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6eec0ca0f0 0x7f6eec0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef19a8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6eec0c9250 0x7f6eec15db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51444/0 (socket says 172.21.15.45:51444) 2023-07-09T02:17:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef19a8640 1 -- 172.21.15.45:0/111832119 learned_addr learned my addr 172.21.15.45:0/111832119 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:17:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef09a6640 1 --2- 172.21.15.45:0/111832119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0cbbb0 0x7f6eec0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef11a7640 1 -- 172.21.15.45:0/111832119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0cbbb0 msgr2=0x7f6eec0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:17:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef11a7640 1 --2- 172.21.15.45:0/111832119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0cbbb0 0x7f6eec0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef11a7640 1 -- 172.21.15.45:0/111832119 >> v1:172.21.15.45:6789/0 conn(0x7f6eec0c9250 legacy=0x7f6eec15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef11a7640 1 -- 172.21.15.45:0/111832119 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0cae70 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.092+0000 7f6ef11a7640 1 --2- 172.21.15.45:0/111832119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec0cb670 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80097c0 tx=0x7f6ee801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc6e7bb9a17a34c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ee3fff640 1 -- 172.21.15.45:0/111832119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80ab600 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ee3fff640 1 -- 172.21.15.45:0/111832119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee80a7050 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ee3fff640 1 -- 172.21.15.45:0/111832119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80ab980 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- 172.21.15.45:0/111832119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 msgr2=0x7f6eec0cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 --2- 172.21.15.45:0/111832119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec0cb670 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80097c0 tx=0x7f6ee801c3f0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- 172.21.15.45:0/111832119 shutdown_connections 2023-07-09T02:17:57.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 --2- 172.21.15.45:0/111832119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0cbbb0 0x7f6eec0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 --2- 172.21.15.45:0/111832119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec0cb670 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- 172.21.15.45:0/111832119 >> 172.21.15.45:0/111832119 conn(0x7f6eec0694b0 msgr2=0x7f6eec0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- 172.21.15.45:0/111832119 shutdown_connections 2023-07-09T02:17:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- 172.21.15.45:0/111832119 wait complete. 2023-07-09T02:17:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 Processor -- start 2023-07-09T02:17:57.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- start start 2023-07-09T02:17:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0c9250 0x7f6eec147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6eec0cbbb0 0x7f6eec0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec1477c0 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec159b80 con 0x7f6eec0cbbb0 2023-07-09T02:17:57.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef340b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec153a10 con 0x7f6eec0c9250 2023-07-09T02:17:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef09a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef09a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33106/0 (socket says 172.21.15.45:33106) 2023-07-09T02:17:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.096+0000 7f6ef09a6640 1 -- 172.21.15.45:0/2507412388 learned_addr learned my addr 172.21.15.45:0/2507412388 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:17:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef11a7640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0c9250 0x7f6eec147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef19a8640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6eec0cbbb0 0x7f6eec0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef09a6640 1 -- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0c9250 msgr2=0x7f6eec147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef09a6640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0c9250 0x7f6eec147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef09a6640 1 -- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6eec0cbbb0 msgr2=0x7f6eec0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef09a6640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6eec0cbbb0 0x7f6eec0cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef09a6640 1 -- 172.21.15.45:0/2507412388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8009420 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef19a8640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6eec0cbbb0 0x7f6eec0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:17:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef09a6640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec153ea0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00d5f0 tx=0x7f6edc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ee1ffb640 1 -- 172.21.15.45:0/2507412388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0125f0 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ee1ffb640 1 -- 172.21.15.45:0/2507412388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc012750 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ee1ffb640 1 -- 172.21.15.45:0/2507412388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc012ae0 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec152e00 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec1533c0 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eec04d7d0 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ee1ffb640 1 -- 172.21.15.45:0/2507412388 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6edc012c40 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ee1ffb640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ed0066280 0x7f6ed0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:17:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ee1ffb640 1 -- 172.21.15.45:0/2507412388 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6edc084350 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.100+0000 7f6ef11a7640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ed0066280 0x7f6ed0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:17:57.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.104+0000 7f6ef11a7640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ed0066280 0x7f6ed0068730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80ad000 tx=0x7f6ee80a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:17:57.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.104+0000 7f6ee1ffb640 1 -- 172.21.15.45:0/2507412388 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6edc051730 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6eec0b1090 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ee1ffb640 1 -- 172.21.15.45:0/2507412388 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+37017 (secure 0 0 0) 0x7f6edc007380 con 0x7f6eec0ca0f0 2023-07-09T02:17:57.266 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:17:57.266 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:17:57.267 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 139, 2023-07-09T02:17:57.267 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:17:57.267 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:17:57.268 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:17:56.379903+0000", 2023-07-09T02:17:57.268 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:17:57.268 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:17:57.268 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:17:57.269 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:17:57.269 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:17:57.269 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:17:57.269 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:17:57.270 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:17:57.270 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:17:57.270 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:17:57.270 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:17:57.271 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:17:57.271 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:17:57.271 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:17:57.272 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:17:57.272 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 18, 2023-07-09T02:17:57.272 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:17:57.272 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:17:57.273 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:17:57.273 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:17:57.273 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:17:57.273 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:17:57.274 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.274 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:17:57.274 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:17:57.274 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:17:57.275 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:17:57.275 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:17:57.276 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:17:57.276 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:17:57.276 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:17:57.277 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:17:57.277 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:17:57.277 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:17:57.277 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:17:57.278 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:17:57.278 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:17:57.278 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:17:57.278 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:17:57.279 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:17:57.279 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:17:57.279 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:17:57.279 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:17:57.280 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:17:57.280 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:17:57.280 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:17:57.281 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:17:57.281 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:17:57.281 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:17:57.281 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:17:57.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.282 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:17:57.282 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:17:57.282 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:17:57.283 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:17:57.283 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:17:57.283 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:17:57.283 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:17:57.284 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:17:57.284 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:17:57.284 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:17:57.285 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:17:57.285 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:17:57.285 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:17:57.286 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:17:57.286 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:17:57.286 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:17:57.287 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:17:57.287 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:17:57.287 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:17:57.287 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:17:57.287 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:17:57.287 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:17:57.288 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:17:57.288 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:17:57.288 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:17:57.288 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:17:57.288 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:17:57.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.288 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:17:57.289 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:17:57.289 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:17:57.289 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:17:57.289 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:17:57.289 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:17:57.289 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:17:57.290 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:17:57.290 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:17:57.290 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:17:57.290 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:17:57.290 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:17:57.290 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:17:57.290 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:17:57.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.291 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:17:57.291 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:17:57.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.291 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:17:57.291 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:17:57.291 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:17:57.292 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:17:57.292 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:17:57.292 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:17:57.292 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:17:57.292 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:17:57.292 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:17:57.292 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:17:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:17:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:17:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:17:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:17:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:17:57.294 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:17:57.294 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:17:57.294 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:17:57.294 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:17:57.294 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:17:57.294 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:17:57.294 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:17:57.295 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:17:57.295 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:17:57.295 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:17:57.295 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:17:57.295 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:17:57.295 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:17:57.295 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:17:57.296 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:17:57.296 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:17:57.296 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:17:57.296 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:17:57.296 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:17:57.296 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:17:57.297 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:17:57.297 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.297 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:17:57.297 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:17:57.297 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:17:57.297 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:17:57.297 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:17:57.298 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:17:57.298 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:17:57.298 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:17:57.298 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:17:57.298 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:17:57.298 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:17:57.298 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:17:57.298 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:17:57.299 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:17:57.299 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:17:57.299 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:17:57.299 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:17:57.299 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:17:57.299 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:17:57.299 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:17:57.300 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:17:57.300 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:17:57.300 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:17:57.300 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:17:57.300 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:17:57.300 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:17:57.300 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:17:57.301 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.301 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:17:57.301 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:17:57.301 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:17:57.301 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:17:57.302 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:17:57.302 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:17:57.302 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:17:57.302 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:17:57.302 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:17:57.303 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:17:57.303 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:17:57.303 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:17:57.303 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:17:57.303 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:17:57.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.303 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:17:57.303 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:17:57.304 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:17:57.304 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:17:57.304 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:17:57.304 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:17:57.304 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:17:57.304 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:17:57.304 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:17:57.305 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.305 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.305 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.305 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 17, 2023-07-09T02:17:57.305 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:17:57.305 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:44.368934+0000", 2023-07-09T02:17:57.305 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:17:57.305 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:17:57.306 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:17:57.306 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:17:57.306 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:17:57.306 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:17:57.306 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:17:57.306 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:17:57.306 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:17:57.306 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:17:57.307 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:17:57.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:17:57.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:17:57.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:17:57.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:17:57.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:17:57.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:17:57.307 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:17:57.308 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:17:57.308 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:17:57.308 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:17:57.308 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:17:57.308 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:17:57.308 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:17:57.309 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.309 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "137", 2023-07-09T02:17:57.309 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:17:57.309 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:17:57.309 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:17:57.309 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:17:57.309 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:17:57.310 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:17:57.310 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:17:57.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:17:57.310 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:17:57.310 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:17:57.310 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:17:57.310 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:17:57.310 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:17:57.311 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:17:57.311 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:17:57.311 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:17:57.311 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:17:57.311 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:17:57.311 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:17:57.311 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:17:57.311 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:17:57.312 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:17:57.312 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:17:57.312 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:17:57.312 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:17:57.312 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:17:57.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.312 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:17:57.312 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:17:57.313 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:17:57.313 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:17:57.313 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:17:57.313 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:17:57.313 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:17:57.313 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:17:57.313 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:17:57.313 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:17:57.314 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:17:57.314 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:17:57.314 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:17:57.314 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:17:57.314 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:17:57.314 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.314 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:17:57.314 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:17:57.315 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:17:57.315 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.315 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:17:57.315 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:17:57.315 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:17:57.315 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:17:57.316 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:17:57.316 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:17:57.316 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:17:57.316 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:17:57.316 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:17:57.316 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.317 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.317 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 18, 2023-07-09T02:17:57.317 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:17:57.317 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:45.234988+0000", 2023-07-09T02:17:57.317 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:17:57.317 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:17:57.317 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:17:57.318 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:17:57.318 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:17:57.318 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:17:57.319 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:17:57.319 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:17:57.319 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:17:57.320 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:17:57.320 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:17:57.320 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:17:57.320 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:17:57.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:17:57.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:17:57.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:17:57.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:17:57.321 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:17:57.322 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:17:57.322 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:17:57.322 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:17:57.322 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:17:57.322 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:17:57.323 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:17:57.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "139", 2023-07-09T02:17:57.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:17:57.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:17:57.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:17:57.323 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:17:57.323 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:17:57.324 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:17:57.324 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:17:57.324 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:17:57.324 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:17:57.324 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:17:57.324 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:17:57.324 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:17:57.325 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:17:57.325 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:17:57.325 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:17:57.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:17:57.325 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:17:57.325 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:17:57.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:17:57.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:17:57.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:17:57.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:17:57.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:17:57.326 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:17:57.326 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:17:57.326 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:17:57.326 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:17:57.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:17:57.327 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:17:57.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:17:57.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:17:57.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:17:57.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:17:57.327 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:17:57.328 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:17:57.328 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:17:57.328 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:17:57.328 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:17:57.328 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:17:57.328 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:17:57.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.329 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:17:57.329 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:17:57.329 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:17:57.329 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.329 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:17:57.329 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.3799999952316284, 2023-07-09T02:17:57.329 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.3799999952316284, 2023-07-09T02:17:57.330 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:17:57.330 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.3799999952316284, 2023-07-09T02:17:57.330 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.3799999952316284, 2023-07-09T02:17:57.330 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:17:57.330 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:17:57.330 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:17:57.330 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.331 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.331 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:17:57.331 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:17:57.331 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.331 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:17:57.331 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:17:57.331 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:17:57.332 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:17:57.332 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:17:57.332 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:17:57.332 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:17:57.333 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:17:57.333 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:17:57.333 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:17:57.333 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:17:57.333 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:17:57.333 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:17:57.333 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.334 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.334 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:17:57.334 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:17:57.334 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.334 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.334 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.334 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:17:57.335 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:17:57.335 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.335 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.335 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.335 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:17:57.335 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.336 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.336 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.336 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:17:57.336 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:17:57.336 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.336 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.336 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.336 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:17:57.337 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:17:57.337 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.337 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.337 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.337 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:17:57.337 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.337 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.338 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.338 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:17:57.338 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:17:57.338 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.338 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.338 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.338 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:17:57.338 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:17:57.339 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.339 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.339 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.339 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:17:57.339 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.339 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.339 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.339 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:17:57.340 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:17:57.340 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.340 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.340 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.340 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:17:57.340 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:17:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:17:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:17:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:17:57.341 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:17:57.342 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:17:57.342 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:17:57.342 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:17:57.342 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.342 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.342 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.342 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:17:57.343 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:17:57.343 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:17:57.343 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:17:57.343 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:17:57.343 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:17:57.343 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:17:57.343 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:17:57.343 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:17:57.344 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:17:57.344 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:17:57.344 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:17:57.344 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:17:57.344 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.344 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.344 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.345 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:17:57.345 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:17:57.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.345 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.345 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.345 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:17:57.345 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:17:57.346 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.346 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.346 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.346 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:17:57.346 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.346 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.346 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:17:57.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:17:57.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.347 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:17:57.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:17:57.348 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.348 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.348 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:17:57.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.348 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.348 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:17:57.349 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:17:57.349 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.349 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.349 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.349 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:17:57.349 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:17:57.349 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.350 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.350 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:17:57.350 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.350 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.350 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.350 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:17:57.351 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:17:57.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.351 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.351 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.351 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:17:57.351 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:17:57.351 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.352 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.352 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.352 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:17:57.352 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:17:57.352 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:17:57.352 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:17:57.352 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:17:57.353 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:17:57.353 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:17:57.353 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.353 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.353 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:17:57.353 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:17:57.353 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:17:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:17:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:17:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:17:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:17:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:17:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:17:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:17:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:17:57.355 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:17:57.355 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:17:57.355 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.355 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.355 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.355 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:17:57.355 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:17:57.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.356 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.356 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.356 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:17:57.356 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:17:57.356 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.356 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.357 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:17:57.357 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.357 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.357 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:17:57.357 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:17:57.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.358 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.358 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:17:57.358 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:17:57.358 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.358 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.358 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:17:57.358 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.359 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.359 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.359 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:17:57.359 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:17:57.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.359 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.360 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.360 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:17:57.360 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:17:57.360 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.360 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.360 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:17:57.361 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.361 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.361 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.361 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:17:57.361 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:17:57.361 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.361 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.361 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.362 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:17:57.362 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:17:57.362 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.362 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.362 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.362 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:17:57.362 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:17:57.362 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:17:57.363 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:17:57.363 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:17:57.363 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:17:57.363 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:17:57.363 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.363 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.363 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:17:57.364 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:17:57.364 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:17:57.364 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:17:57.364 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:17:57.364 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:17:57.364 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:17:57.364 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:17:57.365 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:17:57.365 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:17:57.365 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:17:57.365 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:17:57.365 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:17:57.365 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.365 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.365 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.366 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:17:57.366 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:17:57.366 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.366 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.366 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.366 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:17:57.366 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:17:57.366 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.367 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.367 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:17:57.367 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.367 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.367 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.367 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:17:57.368 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:17:57.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.368 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.368 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.368 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:17:57.368 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:17:57.368 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:17:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:17:57.369 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:17:57.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.370 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.370 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.370 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:17:57.370 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:17:57.370 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.370 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.371 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:17:57.371 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.371 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.371 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.371 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:17:57.371 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:17:57.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.371 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.372 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.372 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:17:57.372 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:17:57.372 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.372 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.372 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:17:57.373 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:17:57.373 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:17:57.373 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:17:57.373 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:17:57.373 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:17:57.373 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:17:57.373 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.374 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.374 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:17:57.374 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:17:57.374 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:17:57.374 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:17:57.374 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:17:57.374 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:17:57.375 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:17:57.375 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:17:57.375 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:17:57.375 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:17:57.375 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:17:57.375 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:17:57.375 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:17:57.375 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.376 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.376 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:17:57.376 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:17:57.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.376 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.376 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:17:57.377 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:17:57.377 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.377 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.377 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:17:57.377 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.377 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.378 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.378 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:17:57.378 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:17:57.378 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.378 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.378 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.378 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:17:57.378 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:17:57.379 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.379 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.379 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:17:57.379 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.379 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.380 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:17:57.380 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:17:57.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.380 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.380 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.380 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:17:57.380 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:17:57.380 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.381 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.381 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:17:57.381 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.381 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.381 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.381 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:17:57.382 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:17:57.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.382 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.382 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.382 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:17:57.382 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:17:57.382 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.383 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.383 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.383 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:17:57.383 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:17:57.383 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:17:57.383 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:17:57.383 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:17:57.383 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:17:57.384 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:17:57.384 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.384 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.384 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:17:57.384 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:17:57.384 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:17:57.385 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:17:57.385 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:17:57.385 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:17:57.385 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:17:57.385 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:17:57.385 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:17:57.385 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:17:57.385 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:17:57.386 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:17:57.386 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:17:57.386 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.386 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.386 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.387 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:17:57.387 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:17:57.387 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.387 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.388 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.388 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:17:57.388 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:17:57.388 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.388 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.388 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.388 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:17:57.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.389 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:17:57.389 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:17:57.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.390 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.390 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.390 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:17:57.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:17:57.390 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.390 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.391 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:17:57.391 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.391 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.391 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.391 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:17:57.391 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:17:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:17:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:17:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.393 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:17:57.393 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.393 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.393 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.393 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:17:57.393 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:17:57.393 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.394 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.394 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.394 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:17:57.394 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:17:57.394 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.394 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.394 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:17:57.395 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:17:57.395 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:17:57.395 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:17:57.395 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:17:57.395 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:17:57.395 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:17:57.395 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.396 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.396 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:17:57.396 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:17:57.396 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:17:57.397 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:17:57.397 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:17:57.397 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:17:57.398 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:17:57.398 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:17:57.398 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:17:57.398 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:17:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:17:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:17:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:17:57.399 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.400 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.400 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.400 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:17:57.401 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:17:57.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.401 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:17:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:17:57.402 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.403 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.403 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:17:57.404 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.404 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.404 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.404 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:17:57.404 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:17:57.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.405 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.405 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:17:57.406 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:17:57.406 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.406 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:17:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:17:57.407 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:17:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:17:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:17:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.408 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:17:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:17:57.409 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:17:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:17:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:17:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:17:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:17:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:17:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:17:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:17:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:17:57.411 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:17:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:17:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:17:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:17:57.412 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:17:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:17:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:17:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:17:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:17:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:17:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:17:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:17:57.413 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:17:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:17:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:17:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:17:57.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:17:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:17:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:17:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:17:57.416 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:17:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:17:57.417 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:17:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:17:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.418 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:17:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:17:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.419 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:17:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:17:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:17:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:17:57.420 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:17:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:17:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:17:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:17:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:17:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:17:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.422 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:17:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:17:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:17:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:17:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:17:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:17:57.423 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:17:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:17:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:17:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:17:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:17:57.424 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:17:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:17:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:17:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:17:57.425 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:17:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:17:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:17:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.426 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:17:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:17:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:17:57.427 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:17:57.428 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:17:57.428 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:17:57.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:17:57.429 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:17:57.429 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.429 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.429 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:17:57.430 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:17:57.430 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:17:57.430 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:17:57.430 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:17:57.431 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:17:57.431 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:17:57.431 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:17:57.431 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.432 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.432 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:17:57.432 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:17:57.432 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:17:57.432 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:17:57.433 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:17:57.433 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:17:57.433 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:17:57.433 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:17:57.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.434 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.434 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:17:57.434 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:17:57.435 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:17:57.435 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:17:57.435 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:17:57.435 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:17:57.435 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:17:57.436 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:17:57.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.436 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.436 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:17:57.437 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:17:57.437 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:17:57.437 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:17:57.437 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:17:57.438 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:17:57.438 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:17:57.438 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:17:57.438 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.439 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.439 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:17:57.439 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:17:57.439 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:17:57.440 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:17:57.440 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:17:57.440 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:17:57.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:17:57.441 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:17:57.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.441 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:17:57.441 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:17:57.441 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:17:57.442 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:17:57.442 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:17:57.442 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:17:57.442 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:17:57.442 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:17:57.443 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:17:57.443 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.443 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:17:57.443 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:17:57.443 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:17:57.443 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:17:57.444 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:17:57.444 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:17:57.444 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:17:57.444 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:17:57.445 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:17:57.445 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:17:57.445 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:17:57.445 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:17:57.446 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:17:57.446 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:17:57.446 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:17:57.446 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:17:57.446 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:17:57.447 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:17:57.447 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:17:57.447 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:17:57.447 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:17:57.447 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:17:57.447 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:17:57.447 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:17:57.448 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:17:57.448 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:17:57.448 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:17:57.448 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:17:57.448 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:17:57.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ed0066280 msgr2=0x7f6ed0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:57.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ed0066280 0x7f6ed0068730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80ad000 tx=0x7f6ee80a4f90 comp rx=0 tx=0).stop 2023-07-09T02:17:57.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 msgr2=0x7f6eec153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:17:57.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec153ea0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00d5f0 tx=0x7f6edc00dab0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 shutdown_connections 2023-07-09T02:17:57.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6eec0cbbb0 0x7f6eec0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eec0ca0f0 0x7f6eec153ea0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6ed0066280 0x7f6ed0068730 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 --2- 172.21.15.45:0/2507412388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6eec0c9250 0x7f6eec147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:17:57.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.264+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 >> 172.21.15.45:0/2507412388 conn(0x7f6eec0694b0 msgr2=0x7f6eec0c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:17:57.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.268+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 shutdown_connections 2023-07-09T02:17:57.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:17:57.268+0000 7f6ef340b640 1 -- 172.21.15.45:0/2507412388 wait complete. 2023-07-09T02:17:57.452 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:18:02.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:18:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dff59640 1 Processor -- start 2023-07-09T02:18:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dff59640 1 -- start start 2023-07-09T02:18:02.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dff59640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49d815c060 0x7f49d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:02.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dff59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d80cd120 0x7f49d80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:02.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dff59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d8160a50 con 0x7f49d80d2450 2023-07-09T02:18:02.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dff59640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d80d28f0 con 0x7f49d815c060 2023-07-09T02:18:02.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dff59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80cfe40 con 0x7f49d80cd120 2023-07-09T02:18:02.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dd4f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d80cd120 0x7f49d80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:02.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49ddcf5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49d815c060 0x7f49d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:02.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dd4f4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d80cd120 0x7f49d80d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:40990/0 (socket says 172.21.15.45:40990) 2023-07-09T02:18:02.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49dd4f4640 1 -- 172.21.15.45:0/722304549 learned_addr learned my addr 172.21.15.45:0/722304549 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:02.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49de4f6640 1 --1- 172.21.15.45:0/722304549 >> v1:172.21.15.155:6789/0 conn(0x7f49d80d2450 0x7f49d80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:33904/0 (socket says 172.21.15.45:33904) 2023-07-09T02:18:02.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49ddcf5640 1 -- 172.21.15.45:0/722304549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d80cd120 msgr2=0x7f49d80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:02.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49ddcf5640 1 --2- 172.21.15.45:0/722304549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d80cd120 0x7f49d80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49ddcf5640 1 -- 172.21.15.45:0/722304549 >> v1:172.21.15.155:6789/0 conn(0x7f49d80d2450 legacy=0x7f49d80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:02.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.608+0000 7f49ddcf5640 1 -- 172.21.15.45:0/722304549 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d815c430 con 0x7f49d815c060 2023-07-09T02:18:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49ddcf5640 1 --2- 172.21.15.45:0/722304549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d815c060 0x7f49d80b4ed0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f49d40097c0 tx=0x7f49d401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3527eec8cce7afe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dccf3640 1 -- 172.21.15.45:0/722304549 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40ab600 con 0x7f49d815c060 2023-07-09T02:18:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dccf3640 1 -- 172.21.15.45:0/722304549 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d40a7050 con 0x7f49d815c060 2023-07-09T02:18:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dccf3640 1 -- 172.21.15.45:0/722304549 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40ab980 con 0x7f49d815c060 2023-07-09T02:18:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dff59640 1 -- 172.21.15.45:0/722304549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d815c060 msgr2=0x7f49d80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dff59640 1 --2- 172.21.15.45:0/722304549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d815c060 0x7f49d80b4ed0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f49d40097c0 tx=0x7f49d401c450 comp rx=0 tx=0).stop 2023-07-09T02:18:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dff59640 1 -- 172.21.15.45:0/722304549 shutdown_connections 2023-07-09T02:18:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dff59640 1 --2- 172.21.15.45:0/722304549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d80cd120 0x7f49d80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dff59640 1 --2- 172.21.15.45:0/722304549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d815c060 0x7f49d80b4ed0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dff59640 1 -- 172.21.15.45:0/722304549 >> 172.21.15.45:0/722304549 conn(0x7f49d80698e0 msgr2=0x7f49d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dff59640 1 -- 172.21.15.45:0/722304549 shutdown_connections 2023-07-09T02:18:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.612+0000 7f49dff59640 1 -- 172.21.15.45:0/722304549 wait complete. 2023-07-09T02:18:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 Processor -- start 2023-07-09T02:18:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 -- start start 2023-07-09T02:18:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d80cd120 0x7f49d8156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d80d2450 0x7f49d8156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d815c060 0x7f49d81f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d815e590 con 0x7f49d80cd120 2023-07-09T02:18:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8156c40 con 0x7f49d80d2450 2023-07-09T02:18:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80c9e80 con 0x7f49d815c060 2023-07-09T02:18:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d80cd120 0x7f49d8156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d80cd120 0x7f49d8156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48566/0 (socket says 172.21.15.45:48566) 2023-07-09T02:18:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 -- 172.21.15.45:0/340214297 learned_addr learned my addr 172.21.15.45:0/340214297 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:02.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dd4f4640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d80d2450 0x7f49d8156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:02.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 -- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d815c060 msgr2=0x7f49d81f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d815c060 0x7f49d81f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 -- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d80d2450 msgr2=0x7f49d8156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d80d2450 0x7f49d8156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 -- 172.21.15.45:0/340214297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d4009420 con 0x7f49d80cd120 2023-07-09T02:18:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dd4f4640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d80d2450 0x7f49d8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ddcf5640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d80cd120 0x7f49d8156700 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f49d40ae040 tx=0x7f49d401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ce7fc640 1 -- 172.21.15.45:0/340214297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40b7450 con 0x7f49d80cd120 2023-07-09T02:18:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ce7fc640 1 -- 172.21.15.45:0/340214297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d40b75b0 con 0x7f49d80cd120 2023-07-09T02:18:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49ce7fc640 1 -- 172.21.15.45:0/340214297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40b7960 con 0x7f49d80cd120 2023-07-09T02:18:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.616+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d80ca160 con 0x7f49d80cd120 2023-07-09T02:18:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.620+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d80ca720 con 0x7f49d80cd120 2023-07-09T02:18:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.620+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d8160c00 con 0x7f49d80cd120 2023-07-09T02:18:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.620+0000 7f49ce7fc640 1 -- 172.21.15.45:0/340214297 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f49d40b7ac0 con 0x7f49d80cd120 2023-07-09T02:18:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.620+0000 7f49ce7fc640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49bc066280 0x7f49bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.620+0000 7f49ce7fc640 1 -- 172.21.15.45:0/340214297 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49d411e630 con 0x7f49d80cd120 2023-07-09T02:18:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.620+0000 7f49dd4f4640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49bc066280 0x7f49bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.624+0000 7f49dd4f4640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49bc066280 0x7f49bc068730 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f49d80d3590 tx=0x7f49c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.624+0000 7f49ce7fc640 1 -- 172.21.15.45:0/340214297 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49d40eba10 con 0x7f49d80cd120 2023-07-09T02:18:02.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.780+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f49d804d7d0 con 0x7f49d80cd120 2023-07-09T02:18:02.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.780+0000 7f49ce7fc640 1 -- 172.21.15.45:0/340214297 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+37017 (secure 0 0 0) 0x7f49d40ef030 con 0x7f49d80cd120 2023-07-09T02:18:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:02.784 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 139, 2023-07-09T02:18:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:18:02.784 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:18:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:17:56.379903+0000", 2023-07-09T02:18:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:18:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:18:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:18:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:18:02.785 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:18:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:18:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:18:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:18:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:18:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:18:02.786 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:18:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:18:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:18:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:18:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 18, 2023-07-09T02:18:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:18:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:18:02.787 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:18:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:18:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:18:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:18:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:18:02.788 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:18:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:18:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:02.789 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:02.790 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:18:02.791 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:18:02.791 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:18:02.791 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:18:02.791 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:18:02.791 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:02.791 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:02.792 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:02.792 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:02.792 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:02.792 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:02.792 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:02.792 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.793 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:02.793 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:02.793 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:02.793 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:02.793 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:02.793 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:02.793 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:02.794 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:02.794 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:02.794 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:02.794 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:02.794 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:02.794 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:02.794 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:02.795 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:02.795 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:02.795 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:02.795 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:02.795 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:02.795 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:02.795 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:02.796 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:02.796 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:02.796 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:02.796 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:02.796 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:02.797 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:02.798 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:18:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:18:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:18:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:18:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:18:02.800 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:18:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:18:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:18:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.801 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:18:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:18:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:18:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:02.802 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:02.803 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:02.803 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:02.803 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:02.803 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:02.803 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:02.803 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:02.803 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:02.804 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:02.804 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:02.804 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:18:02.804 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:18:02.804 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:18:02.804 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:18:02.805 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:18:02.805 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:02.805 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:02.805 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:02.805 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:02.806 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:02.806 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:02.806 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:02.806 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.807 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:02.807 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:02.807 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:02.807 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:02.807 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:02.807 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:02.808 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:02.808 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:02.808 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:02.808 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:02.808 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:02.808 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:02.809 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:02.809 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:02.809 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:02.809 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:02.809 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:02.810 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:02.810 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:02.810 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:02.810 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:02.811 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:02.811 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:02.811 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:02.811 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:02.812 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:02.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:02.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.812 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:02.813 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:02.813 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:02.813 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:02.813 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:02.814 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:02.814 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:02.814 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:02.814 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:02.815 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:02.815 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:02.815 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:18:02.815 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:02.815 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:18:02.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.816 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:02.816 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:18:02.816 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:18:02.817 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:18:02.817 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:18:02.817 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:18:02.817 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:02.818 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:02.818 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:02.818 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.819 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.819 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 17, 2023-07-09T02:18:02.819 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:18:02.819 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:44.368934+0000", 2023-07-09T02:18:02.820 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:02.820 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:02.820 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:02.820 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:02.821 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:02.821 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:02.821 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:02.821 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:02.821 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:02.821 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:02.821 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:02.822 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:02.822 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:18:02.822 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:18:02.822 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:18:02.822 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:18:02.822 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:18:02.822 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:02.823 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:02.823 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:02.823 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:02.823 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:02.823 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:02.823 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:02.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.823 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "137", 2023-07-09T02:18:02.824 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:02.824 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:02.824 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:02.824 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:02.824 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:02.824 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:02.825 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:02.825 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:02.825 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:02.825 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:02.825 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:02.825 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:02.825 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:02.826 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:02.826 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:02.826 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:02.826 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:02.826 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:02.826 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:02.827 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:02.827 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:02.827 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:02.827 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:02.827 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:02.827 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:02.827 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:02.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.828 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:02.828 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:02.828 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:02.828 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:02.828 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:02.828 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:02.829 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:02.829 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:02.829 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:02.829 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:02.829 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:02.829 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:02.829 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:18:02.830 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:18:02.830 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:18:02.830 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.830 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:02.830 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:02.830 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:18:02.830 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.831 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:02.831 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:18:02.831 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:18:02.831 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:02.831 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:18:02.831 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:18:02.832 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:02.832 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:02.832 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:02.832 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.832 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.832 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 18, 2023-07-09T02:18:02.833 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:18:02.833 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:45.234988+0000", 2023-07-09T02:18:02.833 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:02.833 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:02.833 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:02.833 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:02.833 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:02.834 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:02.834 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:02.834 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:02.834 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:02.834 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:02.834 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:02.835 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:02.835 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:18:02.835 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:18:02.835 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:18:02.835 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:18:02.835 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:18:02.835 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:02.836 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:02.836 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:02.836 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:02.836 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:02.836 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:02.836 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:02.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.837 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "139", 2023-07-09T02:18:02.837 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:02.837 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:02.837 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:02.837 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:02.837 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:02.838 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:02.838 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:02.838 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:02.838 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:02.838 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:18:02.838 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:02.839 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:02.839 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:02.839 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:02.839 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:02.839 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:02.840 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:02.840 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:02.840 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:02.840 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:02.840 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:02.840 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:02.841 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:02.841 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:02.841 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:02.841 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:02.841 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.841 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:02.841 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:02.842 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:02.842 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:02.842 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:02.842 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:02.842 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:02.842 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:02.842 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:02.842 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:02.843 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:02.843 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:02.843 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:18:02.843 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:18:02.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.843 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:02.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:02.844 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:18:02.844 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.844 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:02.844 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.3799999952316284, 2023-07-09T02:18:02.844 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.3799999952316284, 2023-07-09T02:18:02.844 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:02.844 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.3799999952316284, 2023-07-09T02:18:02.845 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.3799999952316284, 2023-07-09T02:18:02.845 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:02.845 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:02.845 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:02.845 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.845 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.845 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:02.846 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:18:02.846 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.846 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:02.846 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:02.846 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:02.846 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:02.846 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:02.846 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:02.847 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:02.847 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:02.847 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:02.847 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:02.847 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:02.847 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:02.847 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:02.847 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.848 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.848 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.848 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:18:02.848 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:02.848 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.848 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.848 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.848 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:18:02.849 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:02.849 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.849 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.849 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.849 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:02.849 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.849 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.849 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:18:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:18:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:02.851 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.851 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.851 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.851 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:02.851 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.851 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.851 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.851 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.852 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:18:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:02.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:18:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.854 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:18:02.855 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:18:02.855 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:18:02.855 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:18:02.855 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:02.855 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:02.855 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:02.855 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.856 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.856 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:02.856 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:02.856 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:02.856 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:02.856 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:02.856 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.858 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.858 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.858 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:18:02.858 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:02.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.858 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.858 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.859 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:18:02.859 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:02.859 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.859 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.859 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:02.859 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.859 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.860 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.860 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:18:02.860 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:02.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.860 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.860 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.860 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:18:02.860 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.861 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:18:02.862 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:02.862 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.862 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.862 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.862 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:18:02.862 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:02.862 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.862 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:18:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:02.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.864 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.864 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.864 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:18:02.864 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:02.864 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.864 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.864 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.865 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:18:02.865 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:18:02.865 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:18:02.865 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:18:02.865 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:02.865 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:02.865 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:02.865 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.866 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.866 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:02.866 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:02.866 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:02.866 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:02.866 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:02.866 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:02.867 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:02.867 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:02.867 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:02.867 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:02.867 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:02.867 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:02.867 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:02.867 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.868 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.868 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.868 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:18:02.868 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:02.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.868 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.868 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:18:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.870 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.870 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:18:02.870 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:02.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.870 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.870 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.870 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:18:02.870 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:02.871 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.871 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.871 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.871 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:02.871 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.871 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.871 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.871 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:18:02.872 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:02.872 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.872 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.872 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.872 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:18:02.872 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:02.872 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.873 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.873 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.873 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:02.873 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.873 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.873 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.873 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:18:02.873 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:02.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.874 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.874 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.874 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:18:02.874 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:02.874 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.874 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:18:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:18:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:18:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:18:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:02.875 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:02.876 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:02.877 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:02.877 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:02.877 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:02.877 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:02.877 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:02.877 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:02.877 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:02.878 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.878 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:18:02.878 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:02.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.879 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:18:02.879 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:02.879 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.879 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.879 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:02.879 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.879 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.880 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.880 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:18:02.880 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:02.880 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.880 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.880 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.880 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:18:02.880 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:02.881 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.881 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.881 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.881 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:02.881 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.881 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.881 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.882 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:18:02.882 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:02.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.882 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.882 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:18:02.882 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:02.882 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.883 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.883 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:02.883 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.883 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.883 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:18:02.883 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:02.884 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.884 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.884 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.884 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:18:02.884 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:02.884 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.884 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.885 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:18:02.885 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:18:02.885 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:18:02.885 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:18:02.885 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:02.885 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:02.885 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:02.886 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.886 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.886 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:02.886 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:02.886 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:02.886 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:02.886 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:02.887 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:02.888 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.888 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.888 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.888 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:18:02.888 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:02.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.888 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.889 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.889 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:18:02.889 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:02.889 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.889 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.889 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.889 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:02.889 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.890 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.890 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.890 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:18:02.890 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:02.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.890 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.890 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.890 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:18:02.891 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:02.891 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.891 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.891 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.891 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:02.891 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.891 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.891 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.892 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:18:02.892 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:02.892 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.892 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.892 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.892 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:18:02.892 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:02.892 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.893 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.893 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:02.893 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.893 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.893 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.893 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:18:02.894 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:02.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.894 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.894 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.894 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:18:02.894 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:02.894 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.894 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.895 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:18:02.895 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:18:02.895 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:18:02.895 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:18:02.895 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:02.895 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:02.895 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:02.896 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.896 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.896 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:02.896 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:02.896 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:02.896 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:02.896 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:02.897 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:02.897 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:02.897 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:02.897 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:02.897 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:02.897 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:02.897 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:02.898 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:02.898 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.898 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.898 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.898 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:18:02.898 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:02.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.898 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.899 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.899 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:18:02.899 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:02.899 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.899 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.899 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:02.899 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.900 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.900 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.900 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:18:02.900 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:02.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.900 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.900 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.901 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:18:02.901 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:02.901 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.901 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.901 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:02.901 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.901 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.902 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.902 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:18:02.902 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:02.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.902 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.902 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.902 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:18:02.902 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:02.903 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.903 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.903 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:02.903 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.903 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.903 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.903 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:18:02.904 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:02.904 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.904 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.904 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.904 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:18:02.904 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:02.904 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.904 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.905 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:18:02.905 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:18:02.905 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:18:02.905 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:18:02.905 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:02.905 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:02.905 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:02.906 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:02.907 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:02.907 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:02.907 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:02.907 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:02.907 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:02.907 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:02.907 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:02.908 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:02.908 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.908 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.908 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.908 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:18:02.908 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:02.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.908 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.909 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.909 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:18:02.909 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:02.909 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.909 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.909 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:02.909 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.910 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:18:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.911 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:18:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:18:02.912 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:18:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:18:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:02.914 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:18:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:18:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:18:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:18:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:02.915 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:02.916 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:02.917 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:02.918 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:02.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.918 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:18:02.918 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:02.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.919 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.919 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:18:02.919 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:02.919 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.919 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.919 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:02.920 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.920 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.920 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.920 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:18:02.920 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:02.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.920 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.920 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.921 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:18:02.921 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:02.921 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.921 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.921 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.921 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:02.921 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.921 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:18:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:18:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:02.923 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.923 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.923 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:02.923 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:02.923 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.923 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:02.924 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:18:02.924 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:02.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.924 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.924 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:02.924 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:18:02.924 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:18:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:18:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:18:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:18:02.925 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:18:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.926 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:18:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:02.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:02.928 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:18:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:02.929 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:18:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:02.930 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:18:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.931 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:18:02.932 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:02.933 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:18:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:02.934 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:18:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:02.935 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:18:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:02.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:18:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:18:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:18:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:18:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:18:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:18:02.937 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:18:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:18:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:18:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:18:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:18:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:18:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:18:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:18:02.938 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:18:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:18:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:18:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:18:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:18:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:18:02.939 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:18:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:18:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:18:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:18:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:18:02.940 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:02.940 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49bc066280 msgr2=0x7f49bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49bc066280 0x7f49bc068730 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f49d80d3590 tx=0x7f49c8008040 comp rx=0 tx=0).stop 2023-07-09T02:18:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d80cd120 msgr2=0x7f49d8156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d80cd120 0x7f49d8156700 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f49d40ae040 tx=0x7f49d401ac90 comp rx=0 tx=0).stop 2023-07-09T02:18:02.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 shutdown_connections 2023-07-09T02:18:02.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f49bc066280 0x7f49bc068730 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d815c060 0x7f49d81f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d80d2450 0x7f49d8156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 --2- 172.21.15.45:0/340214297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49d80cd120 0x7f49d8156700 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:02.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 >> 172.21.15.45:0/340214297 conn(0x7f49d80698e0 msgr2=0x7f49d80d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:02.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 shutdown_connections 2023-07-09T02:18:02.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:02.784+0000 7f49dff59640 1 -- 172.21.15.45:0/340214297 wait complete. 2023-07-09T02:18:02.944 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:18:07.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:18:08.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.100+0000 7fe4a1bd5640 1 Processor -- start 2023-07-09T02:18:08.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.100+0000 7fe4a1bd5640 1 -- start start 2023-07-09T02:18:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.100+0000 7fe4a1bd5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe49c15c060 0x7fe49c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.100+0000 7fe4a1bd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c0d2620 0x7fe49c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.100+0000 7fe4a1bd5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c160a50 con 0x7fe49c0cd120 2023-07-09T02:18:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe4a1bd5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c15c430 con 0x7fe49c15c060 2023-07-09T02:18:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe4a1bd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15fb60 con 0x7fe49c0d2620 2023-07-09T02:18:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe49c15c060 0x7fe49c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe49c15c060 0x7fe49c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48578/0 (socket says 172.21.15.45:48578) 2023-07-09T02:18:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe49c0cd120 0x7fe49c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52726/0 (socket says 172.21.15.45:52726) 2023-07-09T02:18:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49b7fe640 1 -- 172.21.15.45:0/2834449090 learned_addr learned my addr 172.21.15.45:0/2834449090 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49bfff640 1 --2- 172.21.15.45:0/2834449090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c0d2620 0x7fe49c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49b7fe640 1 -- 172.21.15.45:0/2834449090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c0d2620 msgr2=0x7fe49c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49b7fe640 1 --2- 172.21.15.45:0/2834449090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c0d2620 0x7fe49c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49b7fe640 1 -- 172.21.15.45:0/2834449090 >> v1:172.21.15.45:6789/0 conn(0x7fe49c0cd120 legacy=0x7fe49c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49b7fe640 1 -- 172.21.15.45:0/2834449090 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c15fe40 con 0x7fe49c15c060 2023-07-09T02:18:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49bfff640 1 --2- 172.21.15.45:0/2834449090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c0d2620 0x7fe49c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49a7fc640 1 -- 172.21.15.45:0/2834449090 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64618257 0 0) 0x7fe49c160a50 con 0x7fe49c0cd120 2023-07-09T02:18:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49b7fe640 1 --2- 172.21.15.45:0/2834449090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c15c060 0x7fe49c0b4ed0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009870 tx=0x7fe48c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c10195c39c9b7d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49a7fc640 1 -- 172.21.15.45:0/2834449090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0aa670 con 0x7fe49c15c060 2023-07-09T02:18:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49a7fc640 1 -- 172.21.15.45:0/2834449090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c0aa7d0 con 0x7fe49c15c060 2023-07-09T02:18:08.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.104+0000 7fe49a7fc640 1 -- 172.21.15.45:0/2834449090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0aab60 con 0x7fe49c15c060 2023-07-09T02:18:08.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/2834449090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c15c060 msgr2=0x7fe49c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/2834449090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c15c060 0x7fe49c0b4ed0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009870 tx=0x7fe48c01c510 comp rx=0 tx=0).stop 2023-07-09T02:18:08.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/2834449090 shutdown_connections 2023-07-09T02:18:08.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/2834449090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c0d2620 0x7fe49c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/2834449090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c15c060 0x7fe49c0b4ed0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/2834449090 >> 172.21.15.45:0/2834449090 conn(0x7fe49c0698e0 msgr2=0x7fe49c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:08.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/2834449090 shutdown_connections 2023-07-09T02:18:08.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/2834449090 wait complete. 2023-07-09T02:18:08.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 Processor -- start 2023-07-09T02:18:08.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- start start 2023-07-09T02:18:08.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd120 0x7fe49c159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe49c0d2620 0x7fe49c0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c15c060 0x7fe49c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0cc9c0 con 0x7fe49c0cd120 2023-07-09T02:18:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0c9110 con 0x7fe49c0d2620 2023-07-09T02:18:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe4a1bd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15ab00 con 0x7fe49c15c060 2023-07-09T02:18:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd120 0x7fe49c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd120 0x7fe49c159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48594/0 (socket says 172.21.15.45:48594) 2023-07-09T02:18:08.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.108+0000 7fe49b7fe640 1 -- 172.21.15.45:0/1252434351 learned_addr learned my addr 172.21.15.45:0/1252434351 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:08.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe49affd640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe49c0d2620 0x7fe49c0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe49bfff640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c15c060 0x7fe49c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe49b7fe640 1 -- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c15c060 msgr2=0x7fe49c15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe49b7fe640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c15c060 0x7fe49c15dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe49b7fe640 1 -- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe49c0d2620 msgr2=0x7fe49c0cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe49b7fe640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe49c0d2620 0x7fe49c0cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe49b7fe640 1 -- 172.21.15.45:0/1252434351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0094d0 con 0x7fe49c0cd120 2023-07-09T02:18:08.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe49b7fe640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd120 0x7fe49c159860 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0ac040 tx=0x7fe48c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe483fff640 1 -- 172.21.15.45:0/1252434351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0b3800 con 0x7fe49c0cd120 2023-07-09T02:18:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe483fff640 1 -- 172.21.15.45:0/1252434351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c0b3980 con 0x7fe49c0cd120 2023-07-09T02:18:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c0b59f0 con 0x7fe49c0cd120 2023-07-09T02:18:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe483fff640 1 -- 172.21.15.45:0/1252434351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0b3d30 con 0x7fe49c0cd120 2023-07-09T02:18:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c159ef0 con 0x7fe49c0cd120 2023-07-09T02:18:08.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c04d7d0 con 0x7fe49c0cd120 2023-07-09T02:18:08.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.112+0000 7fe483fff640 1 -- 172.21.15.45:0/1252434351 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe48c0c6390 con 0x7fe49c0cd120 2023-07-09T02:18:08.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.116+0000 7fe483fff640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe488066280 0x7fe488068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.116+0000 7fe483fff640 1 -- 172.21.15.45:0/1252434351 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe48c11eaf0 con 0x7fe49c0cd120 2023-07-09T02:18:08.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.116+0000 7fe49affd640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe488066280 0x7fe488068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.116+0000 7fe483fff640 1 -- 172.21.15.45:0/1252434351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7fe48806e3c0 con 0x7fe49c0cd120 2023-07-09T02:18:08.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.116+0000 7fe49affd640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe488066280 0x7fe488068730 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe49c15f400 tx=0x7fe490007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:08.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.120+0000 7fe483fff640 1 -- 172.21.15.45:0/1252434351 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe48c0ebf60 con 0x7fe49c0cd120 2023-07-09T02:18:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.276+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe49c06baa0 con 0x7fe49c0cd120 2023-07-09T02:18:08.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.276+0000 7fe483fff640 1 -- 172.21.15.45:0/1252434351 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+37036 (secure 0 0 0) 0x7fe48c0ef580 con 0x7fe49c0cd120 2023-07-09T02:18:08.279 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:08.279 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:08.280 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 140, 2023-07-09T02:18:08.280 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:18:08.280 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:18:08.280 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:18:04.377968+0000", 2023-07-09T02:18:08.280 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:18:08.280 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:18:08.280 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:18:08.281 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:18:08.281 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:18:08.281 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:18:08.281 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:18:08.281 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:18:08.281 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:18:08.281 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:18:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:18:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:18:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:18:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:18:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 18, 2023-07-09T02:18:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:18:08.282 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:18:08.283 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:18:08.283 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:18:08.283 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:18:08.283 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:18:08.283 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.283 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:18:08.283 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:18:08.283 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:18:08.284 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:08.284 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:08.284 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:08.284 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:08.284 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:08.284 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:08.284 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:08.285 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:08.285 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:08.285 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:08.285 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:08.285 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:08.285 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:18:08.285 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:18:08.286 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:18:08.286 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:18:08.286 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:18:08.286 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:08.286 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:08.286 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:08.286 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:08.287 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:08.287 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:08.287 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:08.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.287 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:08.287 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:08.287 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:08.287 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:08.288 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:08.288 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:08.288 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:08.288 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:08.288 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:08.288 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:08.288 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:08.289 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:08.289 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:08.289 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:08.289 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:08.289 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:08.289 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:08.290 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:08.290 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:08.290 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:08.290 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:08.290 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:08.290 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:08.290 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:08.291 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:08.291 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:08.291 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:08.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.291 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:08.291 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:08.291 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:08.291 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:08.292 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:08.292 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:08.292 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:08.292 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:08.292 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:08.292 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:08.292 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:08.293 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:08.293 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:18:08.293 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:18:08.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.293 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:08.293 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:18:08.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.293 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:08.294 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:18:08.294 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:18:08.294 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:18:08.294 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:18:08.294 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:18:08.294 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:08.294 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:08.295 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:08.295 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.295 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.295 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.295 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:18:08.295 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:18:08.295 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:18:08.295 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:08.296 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:08.296 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:08.296 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:08.296 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:08.296 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:08.296 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:08.296 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:08.297 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:08.297 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:08.297 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:08.297 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:08.297 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:18:08.297 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:18:08.297 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:18:08.297 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:18:08.298 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:18:08.298 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:08.298 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:08.298 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:08.298 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:08.298 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:08.298 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:08.298 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:08.299 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.299 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:08.299 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:08.299 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:08.299 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:08.299 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:08.299 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:08.299 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:08.300 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:08.300 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:08.300 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:08.300 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:08.300 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:08.300 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:08.300 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:08.301 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:08.301 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:08.301 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:08.301 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:08.301 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:08.302 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:08.302 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:08.302 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:08.302 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:08.302 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:08.302 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:08.302 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:08.303 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:08.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.303 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:08.303 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:08.303 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:08.303 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:08.303 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:08.304 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:08.304 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:08.304 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:08.304 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:08.304 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:08.304 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:08.304 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:18:08.305 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:08.305 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:18:08.305 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.305 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:08.305 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:18:08.305 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:18:08.305 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:18:08.306 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:18:08.306 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:18:08.306 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:08.306 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:08.306 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:08.306 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.306 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.306 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 17, 2023-07-09T02:18:08.308 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:18:08.308 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:44.368934+0000", 2023-07-09T02:18:08.308 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:08.308 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:08.308 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:08.308 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:08.309 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:08.309 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:08.309 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:08.309 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:08.309 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:08.309 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:08.309 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:08.309 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:08.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:18:08.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:18:08.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:18:08.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:18:08.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:18:08.310 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:08.310 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:08.310 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:08.311 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:08.311 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:08.311 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:08.311 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:08.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.311 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "137", 2023-07-09T02:18:08.311 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:08.311 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:08.312 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:08.312 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:08.312 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:08.312 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:08.312 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:08.312 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:08.312 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:08.313 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:08.314 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:08.315 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:08.316 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:18:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:18:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:18:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:18:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:18:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:18:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:18:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:18:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:08.318 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 18, 2023-07-09T02:18:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:18:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:45.234988+0000", 2023-07-09T02:18:08.319 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:18:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:18:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:08.320 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:18:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:18:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:18:08.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:18:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:18:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:08.322 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "140", 2023-07-09T02:18:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:08.323 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:18:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:08.324 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:08.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:08.326 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:08.327 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:18:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:18:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:08.328 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:18:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.3799999952316284, 2023-07-09T02:18:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.3799999952316284, 2023-07-09T02:18:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:08.329 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.3799999952316284, 2023-07-09T02:18:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.3799999952316284, 2023-07-09T02:18:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:08.330 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:18:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:08.331 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.332 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:18:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:18:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.334 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:18:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:18:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.335 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:18:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:08.336 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:18:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.337 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:18:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.338 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:18:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:18:08.339 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:18:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:18:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:18:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.340 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:08.341 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.342 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:18:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.343 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:18:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.344 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:18:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:18:08.345 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.346 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:18:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:18:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.347 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:18:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:08.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:18:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:18:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:18:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:18:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:18:08.350 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:08.351 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:08.352 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:18:08.353 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:18:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:18:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.355 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:18:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.356 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:18:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.357 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:18:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.358 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:18:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:18:08.359 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:18:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:18:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:18:08.360 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:18:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:08.361 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:08.362 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:08.362 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:08.362 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:08.362 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:08.362 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:08.362 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:08.362 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:08.362 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:18:08.363 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:18:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.365 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:08.365 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.365 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.365 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.365 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:18:08.365 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:08.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.366 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.366 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.366 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:18:08.366 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:08.366 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.366 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.366 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.366 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:08.367 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.367 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.367 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.367 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:18:08.367 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:08.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.367 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.367 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.368 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:18:08.368 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:08.368 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.368 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.368 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:08.368 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.368 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.369 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.369 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:18:08.369 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:08.369 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.369 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.369 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.369 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:18:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:18:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:18:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:18:08.370 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:18:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:08.371 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:08.372 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.373 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:18:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:18:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.374 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:18:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:08.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:18:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.377 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:08.377 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.377 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.377 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.377 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:18:08.377 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:08.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.377 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.378 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.378 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:18:08.378 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:08.378 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.378 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.378 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.378 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:08.378 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.379 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.379 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:18:08.379 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:08.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.379 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.379 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:18:08.380 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:08.380 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.380 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.380 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:18:08.380 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:18:08.380 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.381 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:08.382 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:08.383 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:08.383 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:08.383 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:08.383 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:08.383 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.383 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.383 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.383 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:08.384 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:18:08.385 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:08.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.386 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.386 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.386 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:18:08.386 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:08.386 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.386 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.387 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:08.387 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.387 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.387 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.387 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:18:08.387 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:08.387 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.387 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:18:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.388 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:08.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.389 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:18:08.389 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:08.389 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.389 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.390 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:18:08.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:08.390 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.390 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.390 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:18:08.390 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:18:08.390 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:18:08.391 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:18:08.391 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:08.391 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:08.391 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:08.391 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.391 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:08.392 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:08.393 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:08.393 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:08.393 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:08.393 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:08.393 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.393 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.393 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.393 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:18:08.394 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:08.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.394 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.394 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.394 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:18:08.394 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:08.394 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.394 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.395 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:08.395 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.395 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.395 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:18:08.395 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:08.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.396 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.396 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.396 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:18:08.396 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:08.396 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.396 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.397 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:08.397 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.397 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.397 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.397 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:18:08.397 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:08.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.397 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:18:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:08.398 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.399 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.399 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.399 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:18:08.399 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:08.399 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.399 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.399 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.399 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:18:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:18:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:18:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:18:08.400 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:18:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.401 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:08.402 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.403 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:18:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:18:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.404 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:18:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:08.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:18:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.406 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:18:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.407 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:18:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:08.408 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:18:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:08.409 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:18:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:18:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:18:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:18:08.410 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:18:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:18:08.411 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:08.412 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:18:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:08.413 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:18:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:08.414 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:18:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.415 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:18:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:08.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:08.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:18:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:08.418 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:18:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:08.419 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:18:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:08.420 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:18:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:08.421 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:18:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:18:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:18:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:18:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:18:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:18:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:18:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:18:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:18:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:18:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:18:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:18:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:18:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:18:08.423 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:08.424 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:18:08.424 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:18:08.424 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:18:08.424 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:18:08.424 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:18:08.424 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:18:08.425 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:18:08.425 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:18:08.425 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:18:08.425 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:18:08.425 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:18:08.425 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:08.425 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:08.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe488066280 msgr2=0x7fe488068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe488066280 0x7fe488068730 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe49c15f400 tx=0x7fe490007b60 comp rx=0 tx=0).stop 2023-07-09T02:18:08.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd120 msgr2=0x7fe49c159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd120 0x7fe49c159860 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0ac040 tx=0x7fe48c01ad50 comp rx=0 tx=0).stop 2023-07-09T02:18:08.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 shutdown_connections 2023-07-09T02:18:08.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe488066280 0x7fe488068730 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe49c15c060 0x7fe49c15dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe49c0d2620 0x7fe49c0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 --2- 172.21.15.45:0/1252434351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd120 0x7fe49c159860 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 >> 172.21.15.45:0/1252434351 conn(0x7fe49c0698e0 msgr2=0x7fe49c1550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:08.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 shutdown_connections 2023-07-09T02:18:08.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.280+0000 7fe4a1bd5640 1 -- 172.21.15.45:0/1252434351 wait complete. 2023-07-09T02:18:08.429 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-07-09T02:18:08.430 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:18:08.430 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:08.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:08.440 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-07-09T02:18:08.802 INFO:teuthology.orchestra.run.smithi045.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-07-09T02:18:08.802 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records in 2023-07-09T02:18:08.802 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records out 2023-07-09T02:18:08.802 INFO:teuthology.orchestra.run.smithi045.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.300934 s, 174 MB/s 2023-07-09T02:18:08.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:18:08.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:18:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.944+0000 7f098ac9c640 1 Processor -- start 2023-07-09T02:18:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.944+0000 7f098ac9c640 1 -- start start 2023-07-09T02:18:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f098ac9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f098406c110 0x7f098406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f098ac9c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09840caec0 0x7f09840cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f098ac9c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098406caa0 con 0x7f0984158e30 2023-07-09T02:18:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f098ac9c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840ccf80 con 0x7f09840caec0 2023-07-09T02:18:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f098ac9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09840cd540 con 0x7f098406c110 2023-07-09T02:18:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0989239640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09840caec0 0x7f09840cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0989239640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09840caec0 0x7f09840cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48600/0 (socket says 172.21.15.45:48600) 2023-07-09T02:18:08.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0989239640 1 -- 172.21.15.45:0/1490506224 learned_addr learned my addr 172.21.15.45:0/1490506224 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:08.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0983fff640 1 --2- 172.21.15.45:0/1490506224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f098406c110 0x7f098406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0989239640 1 -- 172.21.15.45:0/1490506224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f098406c110 msgr2=0x7f098406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:08.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0989239640 1 --2- 172.21.15.45:0/1490506224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f098406c110 0x7f098406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0989239640 1 -- 172.21.15.45:0/1490506224 >> v1:172.21.15.155:6789/0 conn(0x7f0984158e30 legacy=0x7f098406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:08.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0989239640 1 -- 172.21.15.45:0/1490506224 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840cb880 con 0x7f09840caec0 2023-07-09T02:18:08.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0983fff640 1 --2- 172.21.15.45:0/1490506224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f098406c110 0x7f098406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:08.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f0989239640 1 --2- 172.21.15.45:0/1490506224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09840caec0 0x7f09840cb340 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f097c009e50 tx=0x7f097c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0761ce0b300528 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:08.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f09837fe640 1 -- 172.21.15.45:0/1490506224 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0a5790 con 0x7f09840caec0 2023-07-09T02:18:08.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f09837fe640 1 -- 172.21.15.45:0/1490506224 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c0a58f0 con 0x7f09840caec0 2023-07-09T02:18:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.948+0000 7f09837fe640 1 -- 172.21.15.45:0/1490506224 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0a5c80 con 0x7f09840caec0 2023-07-09T02:18:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- 172.21.15.45:0/1490506224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09840caec0 msgr2=0x7f09840cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 --2- 172.21.15.45:0/1490506224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09840caec0 0x7f09840cb340 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f097c009e50 tx=0x7f097c01c910 comp rx=0 tx=0).stop 2023-07-09T02:18:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- 172.21.15.45:0/1490506224 shutdown_connections 2023-07-09T02:18:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 --2- 172.21.15.45:0/1490506224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09840caec0 0x7f09840cb340 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 --2- 172.21.15.45:0/1490506224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f098406c110 0x7f098406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- 172.21.15.45:0/1490506224 >> 172.21.15.45:0/1490506224 conn(0x7f09840694b0 msgr2=0x7f09840698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- 172.21.15.45:0/1490506224 shutdown_connections 2023-07-09T02:18:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- 172.21.15.45:0/1490506224 wait complete. 2023-07-09T02:18:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 Processor -- start 2023-07-09T02:18:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- start start 2023-07-09T02:18:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098406c110 0x7f098415be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09840caec0 0x7f09841422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0984158e30 0x7f09840ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09841427e0 con 0x7f098406c110 2023-07-09T02:18:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098415ad80 con 0x7f09840caec0 2023-07-09T02:18:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f098ac9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098415b060 con 0x7f0984158e30 2023-07-09T02:18:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f0988a38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098406c110 0x7f098415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f0988a38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098406c110 0x7f098415be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48616/0 (socket says 172.21.15.45:48616) 2023-07-09T02:18:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f0988a38640 1 -- 172.21.15.45:0/235193394 learned_addr learned my addr 172.21.15.45:0/235193394 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f0983fff640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09840caec0 0x7f09841422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.952+0000 7f0989239640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0984158e30 0x7f09840ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f0988a38640 1 -- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0984158e30 msgr2=0x7f09840ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f0988a38640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0984158e30 0x7f09840ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f0988a38640 1 -- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09840caec0 msgr2=0x7f09841422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f0988a38640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09840caec0 0x7f09841422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f0988a38640 1 -- 172.21.15.45:0/235193394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c009b30 con 0x7f098406c110 2023-07-09T02:18:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f0988a38640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098406c110 0x7f098415be20 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f097800b410 tx=0x7f097800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:08.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f09817fa640 1 -- 172.21.15.45:0/235193394 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978004020 con 0x7f098406c110 2023-07-09T02:18:08.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f09817fa640 1 -- 172.21.15.45:0/235193394 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978004180 con 0x7f098406c110 2023-07-09T02:18:08.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f09817fa640 1 -- 172.21.15.45:0/235193394 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978011630 con 0x7f098406c110 2023-07-09T02:18:08.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098415b340 con 0x7f098406c110 2023-07-09T02:18:08.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098415b900 con 0x7f098406c110 2023-07-09T02:18:08.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09840c89d0 con 0x7f098406c110 2023-07-09T02:18:08.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f09817fa640 1 -- 172.21.15.45:0/235193394 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0978011790 con 0x7f098406c110 2023-07-09T02:18:08.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f09817fa640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0968066280 0x7f0968068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:08.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f09817fa640 1 -- 172.21.15.45:0/235193394 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0978083870 con 0x7f098406c110 2023-07-09T02:18:08.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.956+0000 7f09817fa640 1 -- 172.21.15.45:0/235193394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f096806e3c0 con 0x7f098406c110 2023-07-09T02:18:08.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.960+0000 7f0983fff640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0968066280 0x7f0968068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:08.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.960+0000 7f0983fff640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0968066280 0x7f0968068730 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0984158850 tx=0x7f0970008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:08.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:08.960+0000 7f09817fa640 1 -- 172.21.15.45:0/235193394 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0978015060 con 0x7f098406c110 2023-07-09T02:18:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.116+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f098415bb20 con 0x7f098406c110 2023-07-09T02:18:09.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.116+0000 7f09817fa640 1 -- 172.21.15.45:0/235193394 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+37036 (secure 0 0 0) 0x7f0978050e30 con 0x7f098406c110 2023-07-09T02:18:09.119 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:09.119 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:09.119 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 140, 2023-07-09T02:18:09.119 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:18:09.120 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:18:09.120 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:18:04.377968+0000", 2023-07-09T02:18:09.120 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:18:09.120 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:18:09.120 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:18:09.120 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:18:09.120 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:18:09.121 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:18:09.121 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:18:09.121 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:18:09.121 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:18:09.121 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:09.121 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:18:09.121 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:18:09.122 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:18:09.122 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:18:09.122 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:18:09.122 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 18, 2023-07-09T02:18:09.122 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:18:09.122 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:18:09.122 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:18:09.122 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:09.124 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:09.124 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:09.124 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:09.124 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:09.124 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:09.124 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:09.124 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:09.125 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:09.125 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:09.125 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:09.125 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:18:09.125 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:18:09.125 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:18:09.125 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:18:09.125 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:18:09.126 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:09.126 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:09.126 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:09.126 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:09.126 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:09.126 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:09.126 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:09.126 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.127 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:09.127 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:09.127 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:09.127 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:09.127 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:09.127 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:09.127 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:09.127 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:09.128 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:09.128 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:09.128 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:09.128 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:09.128 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:09.128 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:09.129 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:09.129 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:09.129 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:09.129 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:09.129 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:09.129 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:09.129 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:09.129 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:09.130 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:09.130 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:09.130 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:09.130 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:09.130 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:09.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.130 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:09.131 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:09.131 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:09.131 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:09.131 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:09.131 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:09.131 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:09.131 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:09.132 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:09.132 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:09.132 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:09.132 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:09.132 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:18:09.132 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:18:09.132 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.133 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:09.133 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:18:09.133 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.133 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:09.133 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:18:09.133 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:18:09.133 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:18:09.133 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:18:09.134 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:18:09.134 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:09.134 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:09.134 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:09.134 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.134 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.134 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.134 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:18:09.135 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:18:09.135 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:18:09.135 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:09.135 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:09.135 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:09.135 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:09.135 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:09.136 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:09.136 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:09.136 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:09.136 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:09.136 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:09.136 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:09.136 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:09.136 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:18:09.137 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:18:09.137 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:18:09.137 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:18:09.137 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:18:09.137 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:09.137 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:09.137 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:09.137 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:09.138 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:09.138 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:09.138 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:09.138 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.138 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:09.138 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:09.138 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:09.139 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:09.139 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:09.139 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:09.139 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:09.139 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:09.139 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:09.139 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:09.139 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:09.140 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:09.140 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:09.140 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:09.140 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:09.140 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:09.176 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:09.176 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:09.176 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:09.176 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:09.177 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:09.177 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:09.177 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:09.177 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:09.177 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:09.177 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:09.177 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:09.178 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.178 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:09.178 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:09.178 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:09.178 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:09.178 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:09.178 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:09.178 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:09.179 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:09.179 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:09.179 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:09.179 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:09.179 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:18:09.179 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:09.179 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:18:09.180 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.180 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:09.180 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:18:09.180 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:18:09.180 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:18:09.180 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:18:09.180 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:18:09.180 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:09.181 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:09.181 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:09.181 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.181 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.181 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.181 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 17, 2023-07-09T02:18:09.181 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:18:09.181 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:44.368934+0000", 2023-07-09T02:18:09.182 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:09.182 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:09.182 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:09.182 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:09.182 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:09.182 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:09.182 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:09.183 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:09.183 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:09.183 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:09.183 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:09.183 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:09.183 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:18:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:18:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:18:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:18:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:18:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:09.184 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "137", 2023-07-09T02:18:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:09.185 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:09.186 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:09.188 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:09.189 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:09.191 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:18:09.191 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:18:09.191 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:18:09.191 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.191 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:09.191 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:09.191 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:18:09.191 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.192 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.192 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:09.192 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:18:09.192 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:18:09.192 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:09.192 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:18:09.192 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:18:09.193 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:09.193 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:09.193 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:09.193 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.193 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.193 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.193 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 18, 2023-07-09T02:18:09.194 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:18:09.194 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:45.234988+0000", 2023-07-09T02:18:09.194 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:18:09.194 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:18:09.194 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:09.194 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:09.194 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:09.194 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:09.195 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:09.195 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:09.195 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:09.195 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:09.195 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:09.195 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:09.195 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:18:09.195 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:18:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:18:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:18:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:18:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:09.196 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "140", 2023-07-09T02:18:09.197 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:09.198 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:09.198 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:09.198 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:09.198 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:09.198 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:09.198 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:09.199 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:09.199 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:09.199 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:18:09.199 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:09.199 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:09.199 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:09.199 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:09.199 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:09.200 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:09.200 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:09.200 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:09.200 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:09.200 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:09.200 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:09.200 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:09.201 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:09.201 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:09.201 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:09.201 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:09.201 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.201 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:09.201 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:09.202 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:09.202 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:09.202 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:09.202 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:09.202 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:09.202 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:09.202 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:09.203 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:09.203 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:09.203 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:09.203 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:18:09.203 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:18:09.203 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.203 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:09.203 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:09.204 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:18:09.204 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.204 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.204 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:09.204 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.3799999952316284, 2023-07-09T02:18:09.204 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.3799999952316284, 2023-07-09T02:18:09.204 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:09.205 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.3799999952316284, 2023-07-09T02:18:09.205 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.3799999952316284, 2023-07-09T02:18:09.205 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:09.205 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:09.205 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:09.205 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.205 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.205 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:09.206 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:18:09.206 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.206 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:09.206 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:09.206 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:09.206 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:09.206 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:09.206 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:09.207 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:09.207 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:09.207 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:09.207 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:09.207 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:09.207 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:09.207 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:09.207 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.208 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.208 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.208 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:18:09.208 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:09.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.208 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.208 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.209 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:18:09.209 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:09.209 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.209 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.209 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:09.209 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.209 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.210 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.210 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:18:09.210 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:09.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.210 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.210 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.210 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:18:09.211 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:09.211 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.211 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.211 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:09.211 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.211 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.211 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.212 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:18:09.212 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:09.212 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.212 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.212 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.212 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:18:09.212 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:09.212 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.213 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.213 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.213 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:09.213 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.213 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.213 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.213 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:18:09.213 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:09.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.214 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.214 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.214 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:18:09.214 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:09.214 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.214 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.215 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.215 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:18:09.215 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:18:09.215 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:18:09.215 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:18:09.215 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:09.215 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:09.215 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:09.216 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.216 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.216 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.216 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:09.216 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:09.216 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:09.217 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:09.217 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:09.217 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:09.217 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:09.217 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:09.217 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:09.217 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:09.218 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:09.218 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:09.218 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:09.218 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.218 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.218 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.218 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:18:09.218 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:09.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.219 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.219 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.219 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:18:09.219 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:09.219 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.219 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.220 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:09.220 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.220 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.220 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.220 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:18:09.220 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:09.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.221 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.221 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.221 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:18:09.221 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:09.221 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.221 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.221 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.222 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:09.222 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.222 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.222 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.222 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:18:09.222 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:09.222 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.222 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.223 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.223 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:18:09.223 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:09.223 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.223 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.223 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.223 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:09.223 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.224 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.224 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.224 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:18:09.224 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:09.224 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.224 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.224 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.224 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:18:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:18:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:18:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:18:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:18:09.226 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:09.226 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:09.226 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:09.226 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.226 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.226 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.226 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:09.226 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:09.227 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:09.227 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:09.227 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:09.227 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:09.227 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:09.227 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:09.227 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:09.228 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:09.228 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:09.228 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:09.228 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:09.228 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.228 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.228 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.228 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:18:09.229 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:09.229 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.229 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.229 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.229 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:18:09.229 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:09.229 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.229 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.230 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.230 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:09.230 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.230 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.230 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.230 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:18:09.230 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:09.230 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:18:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.231 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:18:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.232 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:18:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:09.233 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:18:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.234 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:18:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:18:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:18:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:18:09.235 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:18:09.236 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:09.236 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:09.236 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:09.236 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.236 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.236 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.236 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:09.237 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:09.238 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:09.238 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:09.238 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:09.238 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:09.238 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.238 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.238 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.238 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:18:09.239 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:09.239 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.239 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.239 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.239 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:18:09.239 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:09.239 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.239 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.240 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:09.240 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.240 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.240 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.240 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:18:09.240 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:09.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.241 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.241 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.241 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:18:09.241 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:09.241 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.241 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.241 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.241 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:18:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:18:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:09.243 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:18:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.244 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:18:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:18:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:18:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:18:09.245 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:18:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:09.246 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:09.247 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.248 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:18:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:18:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.249 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:18:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:09.250 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:18:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.251 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:18:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.252 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:18:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:18:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:18:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:18:09.255 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:18:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:18:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:18:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.256 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:09.257 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.258 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:18:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.259 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:18:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.260 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:18:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:18:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:09.261 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:18:09.262 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:09.263 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.263 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.263 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.263 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:18:09.263 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:09.263 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.264 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.264 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.264 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:09.264 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.264 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.264 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.264 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:18:09.264 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:09.265 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.265 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.265 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.265 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:18:09.265 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:09.265 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.265 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.265 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.266 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:18:09.266 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:18:09.266 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:18:09.266 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:18:09.266 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:09.266 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:09.266 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:09.267 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.267 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.267 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.267 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:09.267 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:09.267 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:09.267 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:09.267 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:09.268 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:09.268 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:09.268 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:09.268 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:09.268 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:09.268 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:09.269 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:09.269 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:09.269 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.269 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.269 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.269 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:18:09.269 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:09.269 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.270 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.270 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.270 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:18:09.270 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:09.270 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.270 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.270 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.271 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:09.271 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.271 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.271 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.271 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:18:09.271 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:09.271 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.271 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.272 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.272 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:18:09.272 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:09.272 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.272 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.272 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.272 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:09.272 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.273 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.273 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.273 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:18:09.273 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:09.273 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.273 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.273 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.274 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:18:09.274 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:09.274 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.274 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.274 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.274 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:09.274 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.274 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.275 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.275 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:18:09.275 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:09.275 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.275 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.275 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.275 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:18:09.276 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:09.276 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.276 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.276 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.276 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:18:09.276 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:18:09.276 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:18:09.276 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:18:09.277 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:09.277 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:09.277 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:09.277 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.277 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.277 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:09.278 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:09.278 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:09.278 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:09.278 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:09.278 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:09.278 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:09.278 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:09.279 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:09.279 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:09.279 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:09.279 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:09.279 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:09.279 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.279 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.280 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.280 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:18:09.280 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:09.280 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.280 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.280 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.280 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:18:09.281 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:09.281 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.281 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.281 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.281 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:09.281 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.281 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.282 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:18:09.282 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:09.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.282 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.282 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:18:09.282 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:09.283 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.283 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.283 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.283 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:09.283 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.283 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.283 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.283 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:18:09.284 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:09.284 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.284 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.284 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.284 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:18:09.284 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:09.284 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.285 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.285 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:09.285 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:09.285 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.285 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:09.285 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:18:09.285 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:09.286 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.286 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.286 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:09.286 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:18:09.286 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:09.286 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.286 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:18:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:18:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:18:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:18:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:09.288 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:09.288 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.288 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:09.288 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:18:09.288 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.288 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:09.288 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:18:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.289 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.290 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:09.290 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:09.290 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:09.290 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:09.290 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:09.290 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:09.290 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:18:09.290 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:09.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.291 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.291 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:09.291 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:09.291 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:09.291 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:09.291 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:09.291 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:09.292 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:18:09.292 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:09.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.292 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.292 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:09.292 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:09.292 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:09.293 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:09.293 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:09.293 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:09.293 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:18:09.293 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:09.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.293 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.293 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:09.294 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:09.294 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:09.294 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:09.294 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:09.294 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:09.294 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:18:09.294 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:09.295 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.295 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.295 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:09.295 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:09.295 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:09.295 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:09.295 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:09.295 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:09.296 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:18:09.296 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:09.296 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.296 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.296 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:09.296 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:09.296 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:09.296 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:18:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:18:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.298 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:09.299 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:18:09.299 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:18:09.299 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:18:09.299 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:18:09.299 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:18:09.299 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:18:09.299 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:18:09.299 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:18:09.300 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:18:09.300 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:18:09.300 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:18:09.300 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:18:09.300 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:18:09.300 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:18:09.300 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.301 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:09.301 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:18:09.301 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:18:09.301 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:18:09.301 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:18:09.301 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:18:09.301 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:18:09.301 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:18:09.302 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:18:09.302 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:18:09.302 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:18:09.302 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:18:09.302 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:09.302 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:09.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0968066280 msgr2=0x7f0968068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:09.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0968066280 0x7f0968068730 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0984158850 tx=0x7f0970008040 comp rx=0 tx=0).stop 2023-07-09T02:18:09.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098406c110 msgr2=0x7f098415be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:09.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098406c110 0x7f098415be20 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f097800b410 tx=0x7f097800b8d0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 shutdown_connections 2023-07-09T02:18:09.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0968066280 0x7f0968068730 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0984158e30 0x7f09840ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09840caec0 0x7f09841422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 --2- 172.21.15.45:0/235193394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098406c110 0x7f098415be20 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 >> 172.21.15.45:0/235193394 conn(0x7f09840694b0 msgr2=0x7f0984155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:09.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 shutdown_connections 2023-07-09T02:18:09.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.120+0000 7f098ac9c640 1 -- 172.21.15.45:0/235193394 wait complete. 2023-07-09T02:18:09.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.448+0000 7faa45218640 1 Processor -- start 2023-07-09T02:18:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.448+0000 7faa45218640 1 -- start start 2023-07-09T02:18:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.448+0000 7faa45218640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa4015c060 0x7faa400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.448+0000 7faa45218640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa40160a50 con 0x7faa400cd120 2023-07-09T02:18:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.448+0000 7faa45218640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4015c430 con 0x7faa400d2620 2023-07-09T02:18:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.448+0000 7faa45218640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4015fb60 con 0x7faa4015c060 2023-07-09T02:18:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa4015c060 0x7faa400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa4015c060 0x7faa400b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48618/0 (socket says 172.21.15.45:48618) 2023-07-09T02:18:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3ed9d640 1 -- 172.21.15.45:0/1177447735 learned_addr learned my addr 172.21.15.45:0/1177447735 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa37fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faa400cd120 0x7faa400d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52732/0 (socket says 172.21.15.45:52732) 2023-07-09T02:18:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3ed9d640 1 -- 172.21.15.45:0/1177447735 >> v1:172.21.15.155:6789/0 conn(0x7faa400d2620 legacy=0x7faa400cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3ed9d640 1 -- 172.21.15.45:0/1177447735 >> v1:172.21.15.45:6789/0 conn(0x7faa400cd120 legacy=0x7faa400d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3e59c640 1 -- 172.21.15.45:0/1177447735 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060864511 0 0) 0x7faa40160a50 con 0x7faa400cd120 2023-07-09T02:18:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3ed9d640 1 -- 172.21.15.45:0/1177447735 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4015fe40 con 0x7faa4015c060 2023-07-09T02:18:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3ed9d640 1 --2- 172.21.15.45:0/1177447735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa400b4ed0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7faa30009870 tx=0x7faa3001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df04b7626137df39 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3e59c640 1 -- 172.21.15.45:0/1177447735 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa300aa670 con 0x7faa4015c060 2023-07-09T02:18:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3e59c640 1 -- 172.21.15.45:0/1177447735 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa300aa7d0 con 0x7faa4015c060 2023-07-09T02:18:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.452+0000 7faa3e59c640 1 -- 172.21.15.45:0/1177447735 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa300aab60 con 0x7faa4015c060 2023-07-09T02:18:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- 172.21.15.45:0/1177447735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 msgr2=0x7faa400b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 --2- 172.21.15.45:0/1177447735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa400b4ed0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7faa30009870 tx=0x7faa3001c510 comp rx=0 tx=0).stop 2023-07-09T02:18:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- 172.21.15.45:0/1177447735 shutdown_connections 2023-07-09T02:18:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 --2- 172.21.15.45:0/1177447735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa400b4ed0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- 172.21.15.45:0/1177447735 >> 172.21.15.45:0/1177447735 conn(0x7faa400698e0 msgr2=0x7faa40069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- 172.21.15.45:0/1177447735 shutdown_connections 2023-07-09T02:18:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- 172.21.15.45:0/1177447735 wait complete. 2023-07-09T02:18:09.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 Processor -- start 2023-07-09T02:18:09.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- start start 2023-07-09T02:18:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400cd120 0x7faa40157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa400d2620 0x7faa4015e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa401587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa401612e0 con 0x7faa4015c060 2023-07-09T02:18:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4015eef0 con 0x7faa400cd120 2023-07-09T02:18:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa45218640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40160cb0 con 0x7faa400d2620 2023-07-09T02:18:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa3f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa401587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa3f59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa401587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48626/0 (socket says 172.21.15.45:48626) 2023-07-09T02:18:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa3f59e640 1 -- 172.21.15.45:0/3519414678 learned_addr learned my addr 172.21.15.45:0/3519414678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa37fff640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa400d2620 0x7faa4015e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.456+0000 7faa3ed9d640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400cd120 0x7faa40157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa3f59e640 1 -- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa400d2620 msgr2=0x7faa4015e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa3f59e640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa400d2620 0x7faa4015e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa3f59e640 1 -- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400cd120 msgr2=0x7faa40157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa3f59e640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400cd120 0x7faa40157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa3f59e640 1 -- 172.21.15.45:0/3519414678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300094d0 con 0x7faa4015c060 2023-07-09T02:18:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa3f59e640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa401587c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c700 tx=0x7faa3800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa377fe640 1 -- 172.21.15.45:0/3519414678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38003b80 con 0x7faa4015c060 2023-07-09T02:18:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa377fe640 1 -- 172.21.15.45:0/3519414678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa38003ce0 con 0x7faa4015c060 2023-07-09T02:18:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa377fe640 1 -- 172.21.15.45:0/3519414678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3800aa90 con 0x7faa4015c060 2023-07-09T02:18:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa400b59f0 con 0x7faa4015c060 2023-07-09T02:18:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4015f420 con 0x7faa4015c060 2023-07-09T02:18:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4004d7d0 con 0x7faa4015c060 2023-07-09T02:18:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa377fe640 1 -- 172.21.15.45:0/3519414678 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa3800abf0 con 0x7faa4015c060 2023-07-09T02:18:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa377fe640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faa20066280 0x7faa20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa377fe640 1 -- 172.21.15.45:0/3519414678 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa380839d0 con 0x7faa4015c060 2023-07-09T02:18:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa377fe640 1 -- 172.21.15.45:0/3519414678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7faa2006e3c0 con 0x7faa4015c060 2023-07-09T02:18:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.460+0000 7faa3ed9d640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faa20066280 0x7faa20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.464+0000 7faa3ed9d640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faa20066280 0x7faa20068730 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faa300ae000 tx=0x7faa300b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:09.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.464+0000 7faa377fe640 1 -- 172.21.15.45:0/3519414678 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa38050ef0 con 0x7faa4015c060 2023-07-09T02:18:09.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.652+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa4006baa0 con 0x7faa4015c060 2023-07-09T02:18:09.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.652+0000 7faa377fe640 1 -- 172.21.15.45:0/3519414678 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7faa38054510 con 0x7faa4015c060 2023-07-09T02:18:09.656 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:09.656 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:18:09.656 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:18:09.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faa20066280 msgr2=0x7faa20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:09.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faa20066280 0x7faa20068730 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faa300ae000 tx=0x7faa300b5040 comp rx=0 tx=0).stop 2023-07-09T02:18:09.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 msgr2=0x7faa401587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa401587c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c700 tx=0x7faa3800cbc0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 shutdown_connections 2023-07-09T02:18:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa4015c060 0x7faa401587c0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faa20066280 0x7faa20068730 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa400d2620 0x7faa4015e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 --2- 172.21.15.45:0/3519414678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400cd120 0x7faa40157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 >> 172.21.15.45:0/3519414678 conn(0x7faa400698e0 msgr2=0x7faa400b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 shutdown_connections 2023-07-09T02:18:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:09.656+0000 7faa45218640 1 -- 172.21.15.45:0/3519414678 wait complete. 2023-07-09T02:18:09.676 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-07-09T02:18:09.845 INFO:teuthology.orchestra.run.smithi155.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":7809,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":22.970993342,"mdsmap_epoch":67,"osdmap_epoch":140,"osdmap_epoch_barrier":140,"uptime":28.866668538999999} 2023-07-09T02:18:09.846 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 7809, "mdsmap_epoch": 67, "osdmap_epoch": 140, "osdmap_epoch_barrier": 140, "rank_uptime": 22.970993342, "state": "up:active", "uptime": 28.866668539, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:18:09.846 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:18:09.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:09.847 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-07-09T02:18:09.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:09.859 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-07-09T02:18:09.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:18:10.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.096+0000 7f1770aca640 1 Processor -- start 2023-07-09T02:18:10.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.096+0000 7f1770aca640 1 -- start start 2023-07-09T02:18:10.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.096+0000 7f1770aca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c15c060 0x7f176c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1770aca640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c160a50 con 0x7f176c0cd120 2023-07-09T02:18:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1770aca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c15c430 con 0x7f176c0d2620 2023-07-09T02:18:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1770aca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c15fb60 con 0x7f176c15c060 2023-07-09T02:18:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1763fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f176c0cd120 0x7f176c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52734/0 (socket says 172.21.15.45:52734) 2023-07-09T02:18:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1763fff640 1 -- 172.21.15.45:0/1116084910 learned_addr learned my addr 172.21.15.45:0/1116084910 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f176a59c640 1 --2- 172.21.15.45:0/1116084910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c15c060 0x7f176c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1769d9b640 1 -- 172.21.15.45:0/1116084910 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004880931 0 0) 0x7f176c160a50 con 0x7f176c0cd120 2023-07-09T02:18:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1769d9b640 1 -- 172.21.15.45:0/1116084910 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1758003530 con 0x7f176c0cd120 2023-07-09T02:18:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1769d9b640 1 -- 172.21.15.45:0/1116084910 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249228186 0 0) 0x7f176c15c430 con 0x7f176c0d2620 2023-07-09T02:18:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f1769d9b640 1 -- 172.21.15.45:0/1116084910 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f176c160a50 con 0x7f176c0d2620 2023-07-09T02:18:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f176a59c640 1 -- 172.21.15.45:0/1116084910 >> v1:172.21.15.155:6789/0 conn(0x7f176c0d2620 legacy=0x7f176c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f176a59c640 1 -- 172.21.15.45:0/1116084910 >> v1:172.21.15.45:6789/0 conn(0x7f176c0cd120 legacy=0x7f176c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f176a59c640 1 -- 172.21.15.45:0/1116084910 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c15fe40 con 0x7f176c15c060 2023-07-09T02:18:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.100+0000 7f176a59c640 1 --2- 172.21.15.45:0/1116084910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c15c060 0x7f176c0b4ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f175c009820 tx=0x7f175c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7dfbbfaa3e0915b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1769d9b640 1 -- 172.21.15.45:0/1116084910 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0ab670 con 0x7f176c15c060 2023-07-09T02:18:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1769d9b640 1 -- 172.21.15.45:0/1116084910 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0ab7d0 con 0x7f176c15c060 2023-07-09T02:18:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1769d9b640 1 -- 172.21.15.45:0/1116084910 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0abb40 con 0x7f176c15c060 2023-07-09T02:18:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- 172.21.15.45:0/1116084910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c15c060 msgr2=0x7f176c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 --2- 172.21.15.45:0/1116084910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c15c060 0x7f176c0b4ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f175c009820 tx=0x7f175c01c470 comp rx=0 tx=0).stop 2023-07-09T02:18:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- 172.21.15.45:0/1116084910 shutdown_connections 2023-07-09T02:18:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 --2- 172.21.15.45:0/1116084910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c15c060 0x7f176c0b4ed0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- 172.21.15.45:0/1116084910 >> 172.21.15.45:0/1116084910 conn(0x7f176c0698e0 msgr2=0x7f176c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- 172.21.15.45:0/1116084910 shutdown_connections 2023-07-09T02:18:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- 172.21.15.45:0/1116084910 wait complete. 2023-07-09T02:18:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 Processor -- start 2023-07-09T02:18:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- start start 2023-07-09T02:18:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f176c0cd120 0x7f176c1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c0d2620 0x7f176c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f176c15c060 0x7f176c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c15e770 con 0x7f176c0cd120 2023-07-09T02:18:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0cafb0 con 0x7f176c15c060 2023-07-09T02:18:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f1770aca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c153640 con 0x7f176c0d2620 2023-07-09T02:18:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.104+0000 7f176a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f176c0cd120 0x7f176c1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f176c0cd120 0x7f176c1503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48630/0 (socket says 172.21.15.45:48630) 2023-07-09T02:18:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176a59c640 1 -- 172.21.15.45:0/466254702 learned_addr learned my addr 172.21.15.45:0/466254702 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1763fff640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c0d2620 0x7f176c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176ad9d640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f176c15c060 0x7f176c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176a59c640 1 -- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c0d2620 msgr2=0x7f176c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176a59c640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c0d2620 0x7f176c0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176a59c640 1 -- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f176c15c060 msgr2=0x7f176c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176a59c640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f176c15c060 0x7f176c15e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176a59c640 1 -- 172.21.15.45:0/466254702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009420 con 0x7f176c0cd120 2023-07-09T02:18:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1763fff640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c0d2620 0x7f176c0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176ad9d640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f176c15c060 0x7f176c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f176a59c640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f176c0cd120 0x7f176c1503f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f175c019080 tx=0x7f175c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1762ffd640 1 -- 172.21.15.45:0/466254702 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0bf610 con 0x7f176c0cd120 2023-07-09T02:18:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1762ffd640 1 -- 172.21.15.45:0/466254702 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0bf770 con 0x7f176c0cd120 2023-07-09T02:18:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0b59f0 con 0x7f176c0cd120 2023-07-09T02:18:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1762ffd640 1 -- 172.21.15.45:0/466254702 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0bfb20 con 0x7f176c0cd120 2023-07-09T02:18:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0ca960 con 0x7f176c0cd120 2023-07-09T02:18:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c04d7d0 con 0x7f176c0cd120 2023-07-09T02:18:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.108+0000 7f1762ffd640 1 -- 172.21.15.45:0/466254702 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f175c0bfc80 con 0x7f176c0cd120 2023-07-09T02:18:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.112+0000 7f1762ffd640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f174c066280 0x7f174c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.112+0000 7f1762ffd640 1 -- 172.21.15.45:0/466254702 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f175c11e590 con 0x7f176c0cd120 2023-07-09T02:18:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.112+0000 7f1762ffd640 1 -- 172.21.15.45:0/466254702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f174c06e3c0 con 0x7f176c0cd120 2023-07-09T02:18:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.112+0000 7f1763fff640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f174c066280 0x7f174c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.112+0000 7f1763fff640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f174c066280 0x7f174c068730 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f176c0c91c0 tx=0x7f1754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.112+0000 7f1762ffd640 1 -- 172.21.15.45:0/466254702 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f175c0eba20 con 0x7f176c0cd120 2023-07-09T02:18:10.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.268+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f176c069f60 con 0x7f176c0cd120 2023-07-09T02:18:10.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.268+0000 7f1762ffd640 1 -- 172.21.15.45:0/466254702 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+37036 (secure 0 0 0) 0x7f175c0ef040 con 0x7f176c0cd120 2023-07-09T02:18:10.271 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:10.271 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:10.271 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 140, 2023-07-09T02:18:10.271 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:18:10.272 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:18:10.272 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:18:04.377968+0000", 2023-07-09T02:18:10.272 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:18:10.272 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:18:10.272 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:18:10.273 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:18:10.273 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:18:10.273 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:18:10.273 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:18:10.273 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:18:10.273 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:18:10.274 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:10.274 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:18:10.274 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:18:10.274 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:18:10.274 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:18:10.274 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:18:10.274 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 18, 2023-07-09T02:18:10.275 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:18:10.275 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:18:10.275 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:18:10.275 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:18:10.275 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:18:10.275 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:18:10.275 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.275 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:18:10.276 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:18:10.276 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:18:10.276 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:10.276 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:10.276 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:10.276 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:10.276 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:10.277 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:10.277 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:10.277 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:10.277 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:10.277 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:10.277 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:10.277 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:10.277 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:18:10.278 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:18:10.278 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:18:10.278 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:18:10.278 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:18:10.278 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:10.278 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:10.278 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:10.278 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:10.279 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:10.279 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:10.279 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:10.279 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.279 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:10.279 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:10.279 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:10.280 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:10.280 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:10.280 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:10.280 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:10.280 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:10.280 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:10.280 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:10.281 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:10.281 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:10.281 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:10.281 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:10.281 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:10.281 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:10.281 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:10.282 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:10.282 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:10.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:10.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:10.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:10.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:10.282 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:10.283 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:10.283 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:10.283 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:10.283 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.283 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:10.283 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:10.283 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:10.283 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:10.284 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:10.284 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:10.284 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:10.284 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:10.284 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:10.284 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:10.284 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:10.285 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:10.285 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:18:10.285 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:18:10.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.285 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:10.285 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:18:10.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.285 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:10.286 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:18:10.286 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:18:10.286 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:18:10.286 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:18:10.286 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:18:10.286 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:10.286 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:10.287 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:10.287 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.287 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.287 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:18:10.287 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:18:10.287 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:18:10.288 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:10.288 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:10.288 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:10.288 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:10.288 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:10.288 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:10.288 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:10.289 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:10.289 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:10.289 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:10.289 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:10.289 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:10.289 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:18:10.289 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:18:10.290 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:18:10.290 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:18:10.290 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:18:10.290 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:10.290 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:10.290 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:10.290 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:10.291 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:10.291 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:10.291 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:10.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.291 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:10.291 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:10.291 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:10.291 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:10.292 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:10.292 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:10.292 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:10.292 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:10.292 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:10.293 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:10.293 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:10.293 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:10.293 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:10.294 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:10.294 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:10.294 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:10.294 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:10.295 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:10.295 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:10.295 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:10.296 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:10.296 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:10.296 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:10.296 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:10.297 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:10.297 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:10.297 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:10.298 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.298 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:10.298 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:10.299 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:10.299 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:10.299 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:10.299 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:10.300 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:10.300 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:10.300 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:10.300 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:10.301 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:10.301 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:18:10.301 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:10.301 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:18:10.302 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.302 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:10.302 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:18:10.302 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:18:10.303 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:18:10.303 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:18:10.303 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:18:10.303 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:10.304 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:10.304 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:10.304 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.304 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.304 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.304 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 17, 2023-07-09T02:18:10.304 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:18:10.305 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:44.368934+0000", 2023-07-09T02:18:10.305 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:10.305 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:10.305 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:10.305 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:10.305 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:10.305 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:10.305 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:10.306 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:10.306 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:10.306 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:10.306 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:10.306 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:10.306 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:18:10.306 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:18:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:18:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:18:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:18:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:10.307 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "137", 2023-07-09T02:18:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:10.308 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:10.309 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:10.310 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:10.311 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:10.312 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:10.313 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.313 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:10.313 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:10.313 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:10.314 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:10.314 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:10.314 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:10.314 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:10.315 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:10.315 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:10.315 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:10.315 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:10.315 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:10.316 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:18:10.316 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:18:10.316 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:18:10.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.317 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:10.317 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:10.317 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:18:10.317 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.318 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:10.318 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:18:10.318 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:18:10.318 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:10.318 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:18:10.318 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:18:10.318 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:10.318 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:10.319 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:10.319 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.319 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.319 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 18, 2023-07-09T02:18:10.319 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:18:10.319 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:45.234988+0000", 2023-07-09T02:18:10.319 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:18:10.320 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:18:10.320 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:10.320 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:10.320 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:10.320 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:10.320 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:10.320 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:10.321 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:10.321 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:10.321 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:10.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:10.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:18:10.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:18:10.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:18:10.321 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:18:10.322 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:18:10.322 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:10.322 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:10.322 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:10.322 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:10.322 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:10.322 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:10.322 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:10.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "140", 2023-07-09T02:18:10.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:10.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:10.323 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:10.323 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:10.323 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:10.324 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:10.324 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:10.324 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:10.324 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:10.324 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:18:10.324 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:10.324 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:10.325 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:10.325 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:10.325 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:10.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:10.325 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:10.325 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:10.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:10.325 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:10.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:10.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:10.326 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:10.326 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:10.326 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:10.326 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:10.326 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.326 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:10.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:10.327 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:10.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:10.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:10.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:10.327 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:10.327 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:10.327 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:18:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:18:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:18:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.3799999952316284, 2023-07-09T02:18:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.3799999952316284, 2023-07-09T02:18:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.3799999952316284, 2023-07-09T02:18:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.3799999952316284, 2023-07-09T02:18:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:18:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:18:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.334 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:18:10.334 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:10.334 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.334 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.334 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.334 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:10.334 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.334 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.335 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.335 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:18:10.335 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:10.335 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.335 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.335 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.335 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:18:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.336 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:18:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:18:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:10.337 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:18:10.338 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:18:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.339 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:18:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:18:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:18:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:18:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:10.340 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:10.341 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:10.342 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:10.343 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.343 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.343 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.343 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:18:10.343 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:10.343 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.343 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.344 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.344 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:18:10.344 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:10.344 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.344 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.344 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:10.345 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.345 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.345 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.345 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:18:10.345 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:10.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.345 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.345 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.346 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:18:10.346 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:10.346 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.346 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.346 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.346 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:10.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.347 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:18:10.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:10.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.347 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:18:10.348 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:10.348 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.348 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.348 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:10.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.349 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.349 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.349 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:18:10.349 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:10.349 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.349 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.349 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:18:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:18:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:18:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:18:10.351 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:18:10.351 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:10.351 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:10.351 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:10.351 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.351 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.351 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:10.352 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:10.352 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:10.352 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:10.352 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:10.352 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:10.352 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:10.352 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:10.352 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:10.353 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:10.353 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:10.353 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:10.353 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:10.353 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.353 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.353 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.353 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:18:10.354 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:10.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.354 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.354 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.354 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:18:10.354 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:10.354 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.354 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.355 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:10.355 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.355 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.355 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.355 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:18:10.355 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:10.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.356 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.356 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.356 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:18:10.356 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:10.356 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.356 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:18:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.358 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.358 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:18:10.358 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:10.358 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.358 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.358 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:10.358 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:18:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.359 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:18:10.360 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:10.360 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.360 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.360 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:18:10.360 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:18:10.361 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:18:10.361 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:18:10.361 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:10.361 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:10.361 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:10.361 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.361 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.361 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.362 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:10.362 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:10.362 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:10.362 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:10.362 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:10.362 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:10.362 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:10.363 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:10.363 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:10.363 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:10.363 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:10.363 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:10.363 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:10.364 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.364 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.364 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.364 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:18:10.364 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:10.364 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.365 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.365 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.365 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:18:10.365 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:10.365 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.365 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.365 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:10.366 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.366 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.366 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.366 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:18:10.366 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:10.366 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.366 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.366 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.367 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:18:10.367 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:10.367 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.367 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.367 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:10.367 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.367 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.368 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.368 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:18:10.368 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:10.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.368 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.368 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.368 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:18:10.368 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:10.369 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.369 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.369 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.369 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:10.369 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.369 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.369 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:18:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:18:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.371 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.371 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:18:10.371 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:18:10.371 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:18:10.371 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:18:10.371 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:10.371 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:10.372 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:10.372 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.372 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.372 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:10.372 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:10.372 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:10.372 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:10.373 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:10.373 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:10.373 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:10.373 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:10.373 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:10.373 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:10.373 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:10.373 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:10.374 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:10.374 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.374 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.374 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.374 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:18:10.374 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:10.374 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.374 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.375 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.375 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:18:10.375 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:10.375 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.375 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.375 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:10.375 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.376 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.376 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:18:10.376 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:10.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.376 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:18:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.377 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.378 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.378 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:18:10.378 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:10.378 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.378 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.378 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.378 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:18:10.378 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:10.379 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.379 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.379 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:10.379 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.379 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.379 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:18:10.380 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:10.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.380 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.380 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.380 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:18:10.380 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:10.380 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.381 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.381 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:18:10.381 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:18:10.381 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:18:10.381 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:18:10.381 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:10.381 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:10.382 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:10.382 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.382 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.382 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:10.382 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:10.382 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:10.382 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:10.383 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:10.383 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:10.383 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:10.383 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:10.383 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:10.383 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:10.383 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:10.383 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:10.384 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:10.384 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.384 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.384 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.384 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:18:10.384 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:10.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.385 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.385 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.385 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:18:10.385 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:10.385 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.385 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.385 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.385 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:10.386 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.386 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.386 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.386 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:18:10.386 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:10.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.386 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.386 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.387 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:18:10.387 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:10.387 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.387 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.387 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.387 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:10.387 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.387 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.388 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.388 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:18:10.388 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:10.388 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.388 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.388 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.388 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:18:10.388 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:10.389 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.389 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.389 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.389 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:10.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.389 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.389 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:18:10.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:10.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.390 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.390 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.390 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:18:10.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:10.390 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.390 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.391 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:18:10.391 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:18:10.391 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:18:10.391 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:18:10.391 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:10.391 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:10.391 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:10.392 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.392 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.392 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:10.392 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:10.392 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:10.392 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:10.393 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:10.393 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:10.393 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:10.393 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:10.393 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:10.393 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:10.393 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:10.393 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:10.394 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:10.394 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.394 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.394 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.394 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:18:10.394 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:10.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.394 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.395 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:18:10.395 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:10.395 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.395 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.395 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:10.395 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.396 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.396 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.396 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:18:10.396 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:10.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.396 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.396 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.396 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:18:10.397 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:10.397 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.397 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.397 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:10.397 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.397 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.398 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.398 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:18:10.398 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:10.398 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.398 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.398 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.398 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:18:10.398 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:10.399 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.399 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.399 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.399 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:10.399 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.399 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.399 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.399 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:18:10.400 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:10.400 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.400 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.400 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.400 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:18:10.400 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:10.400 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.400 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.401 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:18:10.401 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:18:10.401 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:18:10.401 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:18:10.401 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:10.401 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:10.401 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:10.402 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:10.403 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:10.403 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:10.403 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:10.403 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:10.403 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:10.403 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:10.403 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:10.403 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:10.404 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.404 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.404 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.404 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:18:10.404 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:10.404 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.404 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.404 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:18:10.405 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:10.405 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.405 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.405 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:10.405 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.405 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.406 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.406 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:18:10.406 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:10.406 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.406 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.406 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.406 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:18:10.407 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:10.407 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.407 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.407 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:10.407 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.407 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.407 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.408 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:18:10.408 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:10.408 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.408 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.408 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.408 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:18:10.408 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:10.408 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:18:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:18:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.411 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:18:10.411 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:18:10.411 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:18:10.411 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:18:10.411 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:10.411 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:10.411 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:10.412 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:10.412 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.412 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:10.412 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:18:10.412 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.412 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:10.412 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:10.412 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:10.413 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:10.413 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:10.413 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:10.413 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:18:10.413 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:10.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.413 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:10.414 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:10.414 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:10.414 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:10.414 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:10.414 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:10.414 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:18:10.414 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:10.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:10.415 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:18:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:10.416 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:18:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:18:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.418 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:18:10.419 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:10.420 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:10.421 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:18:10.421 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:10.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.421 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:10.421 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:10.421 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:10.421 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:10.421 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:10.422 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:10.422 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:10.422 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:18:10.422 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:10.422 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.422 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:10.422 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:18:10.422 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:18:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:18:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:18:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:18:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:18:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:18:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:18:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:18:10.423 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:18:10.424 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:18:10.424 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:18:10.424 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:18:10.424 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:18:10.424 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:10.424 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:18:10.424 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:18:10.425 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:18:10.425 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:18:10.425 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:18:10.425 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:18:10.425 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:18:10.425 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:18:10.425 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:18:10.425 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:18:10.426 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:18:10.426 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:10.426 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:10.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.268+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f174c066280 msgr2=0x7f174c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:10.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.268+0000 7f1770aca640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f174c066280 0x7f174c068730 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f176c0c91c0 tx=0x7f1754009040 comp rx=0 tx=0).stop 2023-07-09T02:18:10.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.268+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f176c0cd120 msgr2=0x7f176c1503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:10.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.268+0000 7f1770aca640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f176c0cd120 0x7f176c1503f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f175c019080 tx=0x7f175c01acb0 comp rx=0 tx=0).stop 2023-07-09T02:18:10.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.272+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 shutdown_connections 2023-07-09T02:18:10.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.272+0000 7f1770aca640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f176c15c060 0x7f176c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:10.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.272+0000 7f1770aca640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f174c066280 0x7f174c068730 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:10.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.272+0000 7f1770aca640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f176c0d2620 0x7f176c0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:10.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.272+0000 7f1770aca640 1 --2- 172.21.15.45:0/466254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f176c0cd120 0x7f176c1503f0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:10.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.272+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 >> 172.21.15.45:0/466254702 conn(0x7f176c0698e0 msgr2=0x7f176c0d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:10.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.272+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 shutdown_connections 2023-07-09T02:18:10.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:10.272+0000 7f1770aca640 1 -- 172.21.15.45:0/466254702 wait complete. 2023-07-09T02:18:10.431 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:18:15.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:18:15.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.583+0000 7fd825d40640 1 Processor -- start 2023-07-09T02:18:15.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.583+0000 7fd825d40640 1 -- start start 2023-07-09T02:18:15.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd825d40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd82015e210 0x7fd8200c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:15.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd825d40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82006bf30 con 0x7fd8200c8d10 2023-07-09T02:18:15.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd825d40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82006bc50 con 0x7fd8200ca0f0 2023-07-09T02:18:15.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd825d40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8200cab90 con 0x7fd82015e210 2023-07-09T02:18:15.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd81ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd82015e210 0x7fd8200c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:15.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd81effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd8200c8d10 0x7fd82015db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56690/0 (socket says 172.21.15.45:56690) 2023-07-09T02:18:15.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd81effd640 1 -- 172.21.15.45:0/1911219112 learned_addr learned my addr 172.21.15.45:0/1911219112 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:15.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd81ffff640 1 -- 172.21.15.45:0/1911219112 >> v1:172.21.15.155:6789/0 conn(0x7fd8200ca0f0 legacy=0x7fd8200cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:15.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd81ffff640 1 -- 172.21.15.45:0/1911219112 >> v1:172.21.15.45:6789/0 conn(0x7fd8200c8d10 legacy=0x7fd82015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:15.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd81e7fc640 1 -- 172.21.15.45:0/1911219112 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702512200 0 0) 0x7fd82006bf30 con 0x7fd8200c8d10 2023-07-09T02:18:15.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.587+0000 7fd81ffff640 1 -- 172.21.15.45:0/1911219112 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8200cae70 con 0x7fd82015e210 2023-07-09T02:18:15.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd81ffff640 1 --2- 172.21.15.45:0/1911219112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd8200c9160 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd818009d90 tx=0x7fd81801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a3af10abea410 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:15.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd81e7fc640 1 -- 172.21.15.45:0/1911219112 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180a5960 con 0x7fd82015e210 2023-07-09T02:18:15.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd81e7fc640 1 -- 172.21.15.45:0/1911219112 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8180a5ac0 con 0x7fd82015e210 2023-07-09T02:18:15.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd81e7fc640 1 -- 172.21.15.45:0/1911219112 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180a5e50 con 0x7fd82015e210 2023-07-09T02:18:15.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 -- 172.21.15.45:0/1911219112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 msgr2=0x7fd8200c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:15.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 --2- 172.21.15.45:0/1911219112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd8200c9160 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd818009d90 tx=0x7fd81801c880 comp rx=0 tx=0).stop 2023-07-09T02:18:15.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 -- 172.21.15.45:0/1911219112 shutdown_connections 2023-07-09T02:18:15.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 --2- 172.21.15.45:0/1911219112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd8200c9160 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:15.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 -- 172.21.15.45:0/1911219112 >> 172.21.15.45:0/1911219112 conn(0x7fd8200694b0 msgr2=0x7fd8200698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:15.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 -- 172.21.15.45:0/1911219112 shutdown_connections 2023-07-09T02:18:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 -- 172.21.15.45:0/1911219112 wait complete. 2023-07-09T02:18:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 Processor -- start 2023-07-09T02:18:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.591+0000 7fd825d40640 1 -- start start 2023-07-09T02:18:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200c8d10 0x7fd82014cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200ca0f0 0x7fd8201530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd820148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82014f3a0 con 0x7fd82015e210 2023-07-09T02:18:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd820148960 con 0x7fd8200ca0f0 2023-07-09T02:18:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd820153b40 con 0x7fd8200c8d10 2023-07-09T02:18:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd820148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd820148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51578/0 (socket says 172.21.15.45:51578) 2023-07-09T02:18:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 -- 172.21.15.45:0/1377072461 learned_addr learned my addr 172.21.15.45:0/1377072461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81f7fe640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200c8d10 0x7fd82014cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81effd640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200ca0f0 0x7fd8201530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 -- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200c8d10 msgr2=0x7fd82014cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200c8d10 0x7fd82014cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 -- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200ca0f0 msgr2=0x7fd8201530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200ca0f0 0x7fd8201530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 -- 172.21.15.45:0/1377072461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818009a70 con 0x7fd82015e210 2023-07-09T02:18:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd81ffff640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd820148420 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd818019490 tx=0x7fd818019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd807fff640 1 -- 172.21.15.45:0/1377072461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180adb80 con 0x7fd82015e210 2023-07-09T02:18:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd807fff640 1 -- 172.21.15.45:0/1377072461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8180adce0 con 0x7fd82015e210 2023-07-09T02:18:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd807fff640 1 -- 172.21.15.45:0/1377072461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180b8660 con 0x7fd82015e210 2023-07-09T02:18:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82014ea00 con 0x7fd82015e210 2023-07-09T02:18:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82014efc0 con 0x7fd82015e210 2023-07-09T02:18:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.595+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82014f4e0 con 0x7fd82015e210 2023-07-09T02:18:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.599+0000 7fd807fff640 1 -- 172.21.15.45:0/1377072461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8180b87c0 con 0x7fd82015e210 2023-07-09T02:18:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.599+0000 7fd807fff640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd80c066280 0x7fd80c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.599+0000 7fd807fff640 1 -- 172.21.15.45:0/1377072461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd81811f230 con 0x7fd82015e210 2023-07-09T02:18:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.599+0000 7fd807fff640 1 -- 172.21.15.45:0/1377072461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7fd80c06e3c0 con 0x7fd82015e210 2023-07-09T02:18:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.599+0000 7fd81f7fe640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd80c066280 0x7fd80c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.599+0000 7fd81f7fe640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd80c066280 0x7fd80c068730 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd810004e30 tx=0x7fd810009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.603+0000 7fd807fff640 1 -- 172.21.15.45:0/1377072461 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd82014f4e0 con 0x7fd82015e210 2023-07-09T02:18:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.755+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd82014f4e0 con 0x7fd82015e210 2023-07-09T02:18:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd807fff640 1 -- 172.21.15.45:0/1377072461 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+37036 (secure 0 0 0) 0x7fd82014f4e0 con 0x7fd82015e210 2023-07-09T02:18:15.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:15.761 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:15.761 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 140, 2023-07-09T02:18:15.761 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:18:15.761 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:18:15.761 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:18:04.377968+0000", 2023-07-09T02:18:15.762 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:18:15.762 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:18:15.762 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:18:15.762 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:18:15.762 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:18:15.762 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:18:15.762 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:18:15.763 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:18:15.763 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:18:15.763 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:15.763 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:18:15.763 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:18:15.763 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:18:15.763 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:18:15.763 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:18:15.764 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 18, 2023-07-09T02:18:15.764 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:18:15.764 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:18:15.764 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:18:15.764 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:18:15.764 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:18:15.764 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:18:15.765 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.765 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:18:15.765 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:18:15.765 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:18:15.765 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:15.765 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:15.765 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:15.765 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:15.766 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:15.767 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:18:15.767 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:18:15.767 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:18:15.767 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:18:15.767 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:18:15.767 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:15.767 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:15.768 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:15.768 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:15.768 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:15.768 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:15.768 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:15.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.768 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:15.768 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:15.769 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:15.769 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:15.769 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:15.769 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:15.769 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:15.769 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:15.769 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:15.769 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:15.770 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:15.770 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:15.770 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:15.770 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:15.770 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:15.770 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:15.770 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:15.770 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:15.771 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:15.771 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:15.771 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:15.771 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:15.771 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:15.771 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:15.771 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:15.771 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:15.772 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:15.772 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.772 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:15.772 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:15.772 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:15.772 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:15.772 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:15.773 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:15.773 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:15.773 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:15.773 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:15.773 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:15.773 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:15.773 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:15.773 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:18:15.774 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:18:15.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.774 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:15.774 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:18:15.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.774 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:15.774 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:18:15.774 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:18:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:18:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:18:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:18:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.776 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.776 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:18:15.776 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:18:15.776 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:18:15.776 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:15.776 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:15.776 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:15.776 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:15.777 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:15.777 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:15.777 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:15.777 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:15.777 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:15.777 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:15.777 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:15.777 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:15.778 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:18:15.778 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:18:15.778 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:18:15.778 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:18:15.778 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:18:15.778 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:15.778 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:15.779 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:15.779 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:15.779 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:15.779 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:15.779 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:15.779 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.779 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:15.779 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:15.780 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:15.781 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:15.782 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:15.783 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:15.784 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:18:15.785 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:15.785 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:18:15.785 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.785 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:15.785 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:18:15.785 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:18:15.785 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:18:15.785 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:18:15.786 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:18:15.786 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:15.786 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:15.786 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:15.786 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.786 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.786 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.786 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 17, 2023-07-09T02:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:44.368934+0000", 2023-07-09T02:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:15.787 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:15.788 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:15.788 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:15.788 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:15.788 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:15.788 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:15.788 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:15.788 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:18:15.788 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:18:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:18:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:18:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:18:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:15.789 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:15.790 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:15.790 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:15.790 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.790 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "137", 2023-07-09T02:18:15.790 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:15.790 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:15.790 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:15.790 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:15.791 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:15.791 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:15.791 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:15.791 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:15.791 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:15.791 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:15.791 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:15.792 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:15.792 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:15.792 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:15.792 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:15.792 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:15.792 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:15.792 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:15.792 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:15.793 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:15.793 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:15.793 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:15.793 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:15.793 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:15.793 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:15.793 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:15.793 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:15.795 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:15.795 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:15.795 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:15.795 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:15.795 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:18:15.795 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:18:15.795 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:18:15.795 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:18:15.797 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:18:15.797 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:15.797 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:18:15.797 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:18:15.797 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:15.797 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:15.797 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:15.797 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.798 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.798 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.798 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 18, 2023-07-09T02:18:15.798 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:18:15.798 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:45.234988+0000", 2023-07-09T02:18:15.798 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:18:15.798 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:18:15.798 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:15.799 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:15.799 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:15.799 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:15.799 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:15.799 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:15.799 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:15.799 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:15.799 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:15.800 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:15.800 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:18:15.800 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:18:15.800 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:18:15.800 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:18:15.800 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:18:15.800 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:15.800 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:15.801 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:15.801 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:15.801 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:15.801 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:15.801 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:15.801 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.801 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "140", 2023-07-09T02:18:15.801 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:15.802 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:15.802 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:15.802 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:15.802 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:15.802 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:15.802 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:15.802 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:15.802 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:15.803 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:18:15.803 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:15.803 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:15.803 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:15.803 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:15.803 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:15.803 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:15.803 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:15.804 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:15.804 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:15.804 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:15.804 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:15.804 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:15.804 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:15.804 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:15.805 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:15.805 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:15.805 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.805 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:15.805 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:15.805 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:15.805 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:15.806 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:15.806 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:15.806 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:15.806 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:15.806 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:15.806 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:15.806 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:15.806 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:15.807 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:18:15.807 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:18:15.807 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.807 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:15.807 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:15.807 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:18:15.807 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.807 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.808 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:15.808 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.3799999952316284, 2023-07-09T02:18:15.808 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.3799999952316284, 2023-07-09T02:18:15.808 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:15.808 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.3799999952316284, 2023-07-09T02:18:15.808 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.3799999952316284, 2023-07-09T02:18:15.808 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:15.809 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:15.809 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:15.809 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.809 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.809 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:15.809 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:18:15.809 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.809 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:15.810 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:15.810 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:15.810 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:15.810 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:15.810 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:15.810 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:15.810 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:15.810 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:15.811 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:15.811 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:15.811 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:15.811 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:15.811 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.811 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.811 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.811 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:18:15.812 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:15.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.812 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.812 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:18:15.812 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:15.812 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.812 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.813 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:15.813 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.813 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.813 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.813 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:18:15.813 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:15.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.814 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.814 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.814 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:18:15.814 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:15.814 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.814 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:18:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.815 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.816 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.816 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:18:15.816 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:15.816 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.816 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.816 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:15.816 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.817 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.817 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.817 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:18:15.817 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:15.817 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.817 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.817 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.817 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:18:15.818 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:15.818 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.818 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.818 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:18:15.818 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:18:15.818 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:18:15.818 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:18:15.819 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:15.819 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:15.819 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:15.819 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.819 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.819 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:15.819 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:15.820 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:15.820 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:15.820 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:15.820 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:15.820 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:15.820 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:15.820 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:15.820 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:15.821 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:15.821 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:15.821 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:15.821 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.821 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.821 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.821 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:18:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:18:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.823 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:15.823 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.823 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.823 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.823 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:18:15.823 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:15.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.824 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.824 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:18:15.824 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:15.824 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.824 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.824 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.824 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:15.825 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.825 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.825 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.825 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:18:15.825 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:15.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.825 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.825 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.826 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:18:15.826 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:15.826 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.826 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.826 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:15.826 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.826 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.827 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.827 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:18:15.827 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:15.827 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.827 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.827 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.827 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:18:15.827 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:15.828 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.828 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.828 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:18:15.828 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:18:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:18:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:18:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.829 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:15.830 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.831 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:18:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:18:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:15.832 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.833 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.833 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.833 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:15.833 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.833 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.833 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.833 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:18:15.833 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:15.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.834 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.834 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.834 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:18:15.834 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:15.834 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.834 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.835 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:15.835 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.835 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.835 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.835 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:18:15.835 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:15.835 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.835 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.836 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.836 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:18:15.836 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:15.836 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.836 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.836 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:15.837 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.837 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.837 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.837 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:18:15.837 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:15.837 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.837 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.837 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.838 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:18:15.838 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:15.838 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.838 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.838 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:18:15.838 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:18:15.838 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:18:15.839 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:18:15.839 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:15.839 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:15.839 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:15.839 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.839 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.839 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.839 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:15.840 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:15.840 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:15.840 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:15.840 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:15.840 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:15.840 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:15.840 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:15.840 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:15.841 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:15.841 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:15.841 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:15.841 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:15.841 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.841 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.841 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.841 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:18:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:18:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.842 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:15.843 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.843 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.843 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.843 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:18:15.843 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:15.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.844 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.844 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.844 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:18:15.844 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:15.844 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.844 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.844 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:15.845 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.845 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.845 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.845 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:18:15.845 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:15.845 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.845 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.845 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.846 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:18:15.846 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:15.846 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.846 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.846 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.846 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:15.846 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.847 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.847 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.847 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:18:15.847 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:15.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.847 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.847 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.847 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:18:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:18:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:18:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:18:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:18:15.849 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:15.849 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:15.849 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:15.849 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.849 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.849 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.849 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:15.849 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:15.850 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:15.850 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:15.850 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:15.850 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:15.850 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:15.850 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:15.850 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:18:15.852 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:15.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.852 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.852 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.852 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:18:15.852 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:15.852 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.852 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.853 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:15.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.853 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:18:15.853 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:15.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.854 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.854 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:18:15.854 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:15.854 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.854 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.855 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:15.855 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.855 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:18:15.855 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:15.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.856 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.856 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:18:15.856 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:15.856 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.856 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.856 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:15.856 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.857 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.857 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.857 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:18:15.857 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:15.857 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.857 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.857 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.857 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:18:15.858 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:15.858 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.858 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.858 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:18:15.858 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:18:15.858 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:18:15.858 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:18:15.859 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:15.859 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:15.859 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:15.859 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.859 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.859 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:15.861 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:15.861 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:15.861 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:15.861 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:15.861 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.861 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.861 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.861 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:18:15.862 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:15.862 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.862 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.862 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.862 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:18:15.862 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:15.862 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.862 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.863 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:15.863 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.863 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.863 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.863 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:18:15.863 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:15.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.864 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.864 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.864 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:18:15.864 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:15.864 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.864 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.864 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.865 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:15.865 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.865 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.865 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.865 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:18:15.865 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:15.865 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.865 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.866 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.866 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:18:15.866 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:15.866 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.866 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.866 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:18:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.868 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:18:15.868 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:15.868 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.868 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.868 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:18:15.868 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:18:15.868 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:18:15.869 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:18:15.869 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:15.869 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:15.869 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:15.869 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.869 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:15.871 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:15.871 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:15.871 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:15.871 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:15.871 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:15.871 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.871 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.871 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.872 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:18:15.872 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:15.872 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.872 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.872 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.872 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:18:15.872 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:15.873 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.873 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.873 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.873 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:15.873 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.873 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.873 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.873 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:18:15.874 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:15.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.874 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.874 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.874 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:18:15.874 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:15.874 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.875 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.875 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.875 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:15.875 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.875 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.875 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.875 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:18:15.875 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:15.876 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.876 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.876 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:18:15.876 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:15.876 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.876 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.877 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:15.877 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.877 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.877 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.877 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:18:15.877 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:15.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.878 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:18:15.878 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:15.878 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.878 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.878 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:18:15.879 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:18:15.879 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:18:15.879 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:18:15.879 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:15.879 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:15.879 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:15.879 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:15.880 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:18:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:18:15.882 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:18:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:18:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:15.884 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:18:15.885 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:15.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.886 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.886 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.886 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:18:15.886 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:15.886 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.886 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.887 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:15.887 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:15.887 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.887 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:15.887 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:18:15.887 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:15.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.887 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.888 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:15.888 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:18:15.888 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:15.888 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.888 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.888 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:18:15.889 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:18:15.889 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:18:15.889 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:18:15.889 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:15.889 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:15.889 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:15.889 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:15.889 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.890 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:15.890 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:18:15.890 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.890 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:15.890 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:15.890 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:15.890 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:15.890 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:18:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:15.891 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:15.892 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:15.892 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:15.892 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:15.892 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:18:15.892 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:15.892 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.892 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.892 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:15.893 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:15.893 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:15.893 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:15.893 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:15.893 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:15.893 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:18:15.893 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:15.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.894 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.894 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:15.894 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:15.894 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:15.894 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:15.894 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:15.894 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:15.895 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:18:15.895 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:15.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.895 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.895 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:15.895 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:15.895 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:15.895 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:15.896 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:15.896 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:15.896 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:18:15.896 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:15.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.896 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.896 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:15.896 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:15.897 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:15.897 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:15.897 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:15.897 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:15.897 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:18:15.897 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:15.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.897 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.898 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:15.898 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:15.898 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:15.898 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:15.898 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:15.898 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:15.898 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:18:15.898 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:15.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.899 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:15.899 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:15.899 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:15.899 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:15.899 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:15.899 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:15.899 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:15.900 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:18:15.900 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:15.900 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.900 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:15.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:18:15.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:18:15.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:18:15.901 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:18:15.901 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:18:15.901 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:18:15.901 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:18:15.901 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:18:15.901 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:18:15.901 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:18:15.901 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:18:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:18:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:18:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:18:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:18:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:18:15.902 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:18:15.903 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:18:15.903 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:18:15.903 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:18:15.903 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:18:15.903 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:18:15.903 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:18:15.903 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:18:15.903 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:18:15.904 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:15.904 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:15.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd80c066280 msgr2=0x7fd80c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:15.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd80c066280 0x7fd80c068730 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd810004e30 tx=0x7fd810009040 comp rx=0 tx=0).stop 2023-07-09T02:18:15.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 msgr2=0x7fd820148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:15.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd820148420 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd818019490 tx=0x7fd818019620 comp rx=0 tx=0).stop 2023-07-09T02:18:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 shutdown_connections 2023-07-09T02:18:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82015e210 0x7fd820148420 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8200ca0f0 0x7fd8201530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd80c066280 0x7fd80c068730 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 --2- 172.21.15.45:0/1377072461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8200c8d10 0x7fd82014cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 >> 172.21.15.45:0/1377072461 conn(0x7fd8200694b0 msgr2=0x7fd82014fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:15.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 shutdown_connections 2023-07-09T02:18:15.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:15.759+0000 7fd825d40640 1 -- 172.21.15.45:0/1377072461 wait complete. 2023-07-09T02:18:15.907 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:18:19.151 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:18:19.155 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:18:20.908 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:18:21.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.059+0000 7f6f7b6ec640 1 Processor -- start 2023-07-09T02:18:21.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.059+0000 7f6f7b6ec640 1 -- start start 2023-07-09T02:18:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f7b6ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740c8dc0 0x7f6f740cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f7b6ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6f740cde40 0x7f6f740caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f7b6ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7406ef30 con 0x7f6f741604a0 2023-07-09T02:18:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f7b6ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7406be90 con 0x7f6f740cde40 2023-07-09T02:18:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f7b6ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7406b000 con 0x7f6f740c8dc0 2023-07-09T02:18:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79488640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f741604a0 0x7f6f74164b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56700/0 (socket says 172.21.15.45:56700) 2023-07-09T02:18:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79488640 1 -- 172.21.15.45:0/2761573977 learned_addr learned my addr 172.21.15.45:0/2761573977 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79c89640 1 --2- 172.21.15.45:0/2761573977 >> v2:172.21.15.155:3300/0 conn(0x7f6f740cde40 0x7f6f740caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f78c87640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740c8dc0 0x7f6f740cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922165461 0 0) 0x7f6f7406ef30 con 0x7f6f741604a0 2023-07-09T02:18:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f60003530 con 0x7f6f741604a0 2023-07-09T02:18:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2469200361 0 0) 0x7f6f60003530 con 0x7f6f741604a0 2023-07-09T02:18:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740c8dc0 msgr2=0x7f6f740cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740c8dc0 0x7f6f740cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 >> v2:172.21.15.155:3300/0 conn(0x7f6f740cde40 msgr2=0x7f6f740caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/2761573977 >> v2:172.21.15.155:3300/0 conn(0x7f6f740cde40 0x7f6f740caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7406b210 con 0x7f6f741604a0 2023-07-09T02:18:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f6f70001680 con 0x7f6f741604a0 2023-07-09T02:18:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 >> v1:172.21.15.45:6789/0 conn(0x7f6f741604a0 legacy=0x7f6f74164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60003980 0x7f6f60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740c8dc0 0x7f6f600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60004d10 0x7f6f60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7406be90 con 0x7f6f60003980 2023-07-09T02:18:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7406b000 con 0x7f6f60004d10 2023-07-09T02:18:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6000b990 con 0x7f6f740c8dc0 2023-07-09T02:18:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79488640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60003980 0x7f6f60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f78c87640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740c8dc0 0x7f6f600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79c89640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60004d10 0x7f6f60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79488640 1 -- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740c8dc0 msgr2=0x7f6f600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:21.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79488640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740c8dc0 0x7f6f600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79488640 1 -- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60004d10 msgr2=0x7f6f60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:21.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79488640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60004d10 0x7f6f60005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.063+0000 7f6f79488640 1 -- 172.21.15.45:0/2761573977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60003530 con 0x7f6f60003980 2023-07-09T02:18:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f79488640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60003980 0x7f6f60003d90 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000c210 tx=0x7f6f7001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4296fe1e84f43e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700058e0 con 0x7f6f60003980 2023-07-09T02:18:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f70005a60 con 0x7f6f60003980 2023-07-09T02:18:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f6bfff640 1 -- 172.21.15.45:0/2761573977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70005e10 con 0x7f6f60003980 2023-07-09T02:18:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/2761573977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60003980 msgr2=0x7f6f60003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f7b6ec640 1 --2- 172.21.15.45:0/2761573977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f60003980 0x7f6f60003d90 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000c210 tx=0x7f6f7001cc00 comp rx=0 tx=0).stop 2023-07-09T02:18:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f79c89640 1 -- 172.21.15.45:0/2761573977 reap_dead start 2023-07-09T02:18:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/2761573977 shutdown_connections 2023-07-09T02:18:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/2761573977 >> 172.21.15.45:0/2761573977 conn(0x7f6f740694b0 msgr2=0x7f6f740698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/2761573977 shutdown_connections 2023-07-09T02:18:21.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/2761573977 wait complete. 2023-07-09T02:18:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.067+0000 7f6f7b6ec640 1 Processor -- start 2023-07-09T02:18:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 -- start start 2023-07-09T02:18:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60003980 0x7f6f740b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74165f30 0x7f6f7415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740b1950 0x7f6f740b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740ae080 con 0x7f6f74165f30 2023-07-09T02:18:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740b2300 con 0x7f6f60003980 2023-07-09T02:18:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74161ff0 con 0x7f6f740b1950 2023-07-09T02:18:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74165f30 0x7f6f7415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74165f30 0x7f6f7415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51600/0 (socket says 172.21.15.45:51600) 2023-07-09T02:18:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 -- 172.21.15.45:0/1361682859 learned_addr learned my addr 172.21.15.45:0/1361682859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f79488640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60003980 0x7f6f740b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f79c89640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740b1950 0x7f6f740b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 -- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740b1950 msgr2=0x7f6f740b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740b1950 0x7f6f740b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 -- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60003980 msgr2=0x7f6f740b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60003980 0x7f6f740b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 -- 172.21.15.45:0/1361682859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f74161cc0 con 0x7f6f74165f30 2023-07-09T02:18:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f78c87640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74165f30 0x7f6f7415d690 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6f640119c0 tx=0x7f6f64011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f69ffb640 1 -- 172.21.15.45:0/1361682859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400fb50 con 0x7f6f74165f30 2023-07-09T02:18:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f69ffb640 1 -- 172.21.15.45:0/1361682859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400fcb0 con 0x7f6f74165f30 2023-07-09T02:18:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f69ffb640 1 -- 172.21.15.45:0/1361682859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64014440 con 0x7f6f74165f30 2023-07-09T02:18:21.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f740b4000 con 0x7f6f74165f30 2023-07-09T02:18:21.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f740b45c0 con 0x7f6f74165f30 2023-07-09T02:18:21.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.071+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f74162180 con 0x7f6f74165f30 2023-07-09T02:18:21.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.075+0000 7f6f69ffb640 1 -- 172.21.15.45:0/1361682859 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f640145a0 con 0x7f6f74165f30 2023-07-09T02:18:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.075+0000 7f6f69ffb640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f580662b0 0x7f6f58068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.075+0000 7f6f69ffb640 1 -- 172.21.15.45:0/1361682859 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f640845b0 con 0x7f6f74165f30 2023-07-09T02:18:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.075+0000 7f6f79488640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f580662b0 0x7f6f58068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.075+0000 7f6f79488640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f580662b0 0x7f6f58068760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6f700aa000 tx=0x7f6f70001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:21.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.079+0000 7f6f69ffb640 1 -- 172.21.15.45:0/1361682859 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f64051ad0 con 0x7f6f74165f30 2023-07-09T02:18:21.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.235+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6f7404d7d0 con 0x7f6f74165f30 2023-07-09T02:18:21.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.235+0000 7f6f69ffb640 1 -- 172.21.15.45:0/1361682859 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+37017 (secure 0 0 0) 0x7f6f640550f0 con 0x7f6f74165f30 2023-07-09T02:18:21.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:21.239 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:21.239 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 141, 2023-07-09T02:18:21.239 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:18:21.239 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:18:21.239 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:18:19.382142+0000", 2023-07-09T02:18:21.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:18:21.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:18:21.240 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:18:21.240 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:18:21.240 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:18:21.240 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:18:21.240 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:18:21.240 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:18:21.240 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:18:21.241 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:21.241 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:18:21.241 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:18:21.241 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:18:21.241 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:18:21.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:18:21.241 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 18, 2023-07-09T02:18:21.241 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:18:21.242 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:18:21.242 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:18:21.242 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:18:21.242 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:18:21.242 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:18:21.242 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.242 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:18:21.242 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:18:21.243 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:18:21.243 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:21.243 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:21.243 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:21.243 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:21.243 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:21.243 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:21.244 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:21.244 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:21.244 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:21.244 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:21.244 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:21.244 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:21.244 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:18:21.244 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:18:21.245 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:18:21.245 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:18:21.245 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:18:21.245 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:21.245 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:21.245 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:21.245 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:21.245 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:21.246 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:21.246 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:21.246 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.246 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:21.246 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:21.246 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:21.246 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:21.246 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:21.247 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:21.247 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:21.247 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:21.247 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:21.247 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:21.247 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:21.247 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:21.247 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:21.248 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:21.248 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:21.248 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:21.248 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:21.248 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:21.248 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:21.248 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:21.249 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:21.249 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:21.249 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:21.249 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:21.249 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:21.249 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:21.249 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:21.249 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:21.250 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:21.251 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:21.251 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:21.251 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:21.251 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:21.251 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:18:21.251 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:18:21.251 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.252 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:21.252 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:18:21.252 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.252 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:21.252 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:18:21.252 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:18:21.252 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:18:21.252 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:18:21.253 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:18:21.253 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:21.253 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:21.253 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:21.253 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.253 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:18:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:18:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:18:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:21.254 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:21.255 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:18:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:18:21.256 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:18:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:18:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:18:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:21.257 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:21.259 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:21.260 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:21.261 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:21.262 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:21.263 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:21.264 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:18:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:18:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:18:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:18:21.265 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:18:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:18:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:18:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.266 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 17, 2023-07-09T02:18:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:18:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:44.368934+0000", 2023-07-09T02:18:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:21.267 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:21.268 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:18:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:18:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:18:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:18:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:18:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:21.269 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "137", 2023-07-09T02:18:21.270 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:21.271 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:21.272 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:21.274 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:21.275 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:18:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:18:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:18:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:18:21.276 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:18:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:18:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:18:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:18:21.277 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 18, 2023-07-09T02:18:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:18:21.278 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:45.234988+0000", 2023-07-09T02:18:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:21.279 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:18:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:18:21.280 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:18:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:18:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:18:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:21.281 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "141", 2023-07-09T02:18:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:21.282 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:18:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:21.283 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:21.284 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.285 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:21.286 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:18:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:18:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.287 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:18:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.3799999952316284, 2023-07-09T02:18:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.3799999952316284, 2023-07-09T02:18:21.288 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.3799999952316284, 2023-07-09T02:18:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.3799999952316284, 2023-07-09T02:18:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.289 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:18:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.290 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:18:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.292 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:18:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.293 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:18:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:18:21.294 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.295 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:18:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:18:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.296 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:18:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.297 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:18:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.298 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:18:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:18:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:18:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:18:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.299 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.300 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.301 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:18:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.302 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:18:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.303 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:18:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:18:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.305 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:18:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:18:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.306 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:18:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.307 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:18:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.308 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:18:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:18:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:18:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:18:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.309 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.311 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:18:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.312 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:18:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.313 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:18:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:18:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.314 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:18:21.315 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:18:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:18:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.317 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:18:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.318 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.320 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.321 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:18:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:18:21.322 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.323 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:18:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:18:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.324 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:18:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:18:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.326 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.327 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:18:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:18:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.329 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.330 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.331 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.332 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:18:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:18:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.334 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.335 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.336 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.337 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:18:21.338 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:18:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:18:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.339 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.340 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:18:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:18:21.342 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.343 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:18:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:18:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:18:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.346 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:18:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:18:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:18:21.348 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:18:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:18:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:18:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:18:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.350 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.351 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:18:21.352 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:18:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:18:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.354 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:18:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.355 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:18:21.356 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:18:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:18:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.358 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.359 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.359 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:18:21.359 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.359 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.359 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.359 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:18:21.359 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:18:21.360 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:18:21.360 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:18:21.360 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.360 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.360 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.360 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.361 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.361 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:21.361 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.361 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.361 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.361 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.361 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.361 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.362 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.362 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.362 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.362 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.362 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.362 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.362 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.362 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.363 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.363 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:18:21.363 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.363 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.363 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.363 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:18:21.363 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.364 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.364 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.364 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.364 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.364 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.364 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.364 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.365 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:18:21.365 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.365 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.365 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.365 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:18:21.365 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.365 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.366 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.366 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.366 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.366 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.366 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.366 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.366 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:18:21.366 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:18:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.368 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.368 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.368 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.368 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.368 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:18:21.368 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.369 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.369 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.369 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:18:21.369 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.369 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.369 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.369 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.369 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:18:21.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:18:21.370 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:18:21.370 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:18:21.370 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.370 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.370 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.370 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.370 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:18:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.372 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.372 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:18:21.372 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.372 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.372 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:21.372 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.373 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.373 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.373 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.373 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.373 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:18:21.373 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.373 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.374 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:21.374 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.374 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.374 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.374 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.374 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.374 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:18:21.374 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.375 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:18:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.376 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.377 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.377 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.377 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:18:21.377 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.377 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.377 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:18:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:18:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:18:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:18:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:18:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:18:21.382 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:18:21.382 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:18:21.382 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:18:21.382 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:18:21.382 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:18:21.382 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:18:21.382 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:18:21.382 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:18:21.383 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:18:21.383 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:18:21.383 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:18:21.383 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.383 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.383 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:18:21.383 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:18:21.383 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:18:21.384 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:18:21.384 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:18:21.384 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:18:21.384 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:18:21.384 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:18:21.384 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:18:21.384 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:18:21.384 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:18:21.385 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.385 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:21.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f580662b0 msgr2=0x7f6f58068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f580662b0 0x7f6f58068760 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f6f700aa000 tx=0x7f6f70001a10 comp rx=0 tx=0).stop 2023-07-09T02:18:21.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74165f30 msgr2=0x7f6f7415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74165f30 0x7f6f7415d690 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6f640119c0 tx=0x7f6f64011e80 comp rx=0 tx=0).stop 2023-07-09T02:18:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 shutdown_connections 2023-07-09T02:18:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6f580662b0 0x7f6f58068760 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f740b1950 0x7f6f740b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74165f30 0x7f6f7415d690 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 --2- 172.21.15.45:0/1361682859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f60003980 0x7f6f740b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 >> 172.21.15.45:0/1361682859 conn(0x7f6f740694b0 msgr2=0x7f6f7406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:21.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 shutdown_connections 2023-07-09T02:18:21.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.239+0000 7f6f7b6ec640 1 -- 172.21.15.45:0/1361682859 wait complete. 2023-07-09T02:18:21.388 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-07-09T02:18:21.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:18:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35fd8f640 1 Processor -- start 2023-07-09T02:18:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35fd8f640 1 -- start start 2023-07-09T02:18:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35fd8f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd3580d2620 0x7fd3580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35fd8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd3580cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35fd8f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd358160a50 con 0x7fd35815c060 2023-07-09T02:18:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35fd8f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35815c430 con 0x7fd3580d2620 2023-07-09T02:18:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35fd8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35815fb60 con 0x7fd3580cd120 2023-07-09T02:18:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35e32c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd3580cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35d32a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd3580d2620 0x7fd3580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35db2b640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd35815c060 0x7fd3580d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:57298/0 (socket says 172.21.15.45:57298) 2023-07-09T02:18:21.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35db2b640 1 -- 172.21.15.45:0/2514097519 learned_addr learned my addr 172.21.15.45:0/2514097519 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:21.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35d32a640 1 -- 172.21.15.45:0/2514097519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 msgr2=0x7fd3580cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:21.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35d32a640 1 --2- 172.21.15.45:0/2514097519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd3580cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35d32a640 1 -- 172.21.15.45:0/2514097519 >> v1:172.21.15.155:6789/0 conn(0x7fd35815c060 legacy=0x7fd3580d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.531+0000 7fd35d32a640 1 -- 172.21.15.45:0/2514097519 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35815fe40 con 0x7fd3580d2620 2023-07-09T02:18:21.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35e32c640 1 --2- 172.21.15.45:0/2514097519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd3580cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:21.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35d32a640 1 --2- 172.21.15.45:0/2514097519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580d2620 0x7fd3580b4ed0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd3480097c0 tx=0x7fd34801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c88efaf7268e3c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:21.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35cb29640 1 -- 172.21.15.45:0/2514097519 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480ab650 con 0x7fd3580d2620 2023-07-09T02:18:21.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35cb29640 1 -- 172.21.15.45:0/2514097519 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3480ab7b0 con 0x7fd3580d2620 2023-07-09T02:18:21.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35cb29640 1 -- 172.21.15.45:0/2514097519 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480abb40 con 0x7fd3580d2620 2023-07-09T02:18:21.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35fd8f640 1 -- 172.21.15.45:0/2514097519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580d2620 msgr2=0x7fd3580b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/2514097519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580d2620 0x7fd3580b4ed0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd3480097c0 tx=0x7fd34801c450 comp rx=0 tx=0).stop 2023-07-09T02:18:21.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35fd8f640 1 -- 172.21.15.45:0/2514097519 shutdown_connections 2023-07-09T02:18:21.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/2514097519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd3580cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/2514097519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580d2620 0x7fd3580b4ed0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35fd8f640 1 -- 172.21.15.45:0/2514097519 >> 172.21.15.45:0/2514097519 conn(0x7fd3580698e0 msgr2=0x7fd358069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:21.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35fd8f640 1 -- 172.21.15.45:0/2514097519 shutdown_connections 2023-07-09T02:18:21.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.535+0000 7fd35fd8f640 1 -- 172.21.15.45:0/2514097519 wait complete. 2023-07-09T02:18:21.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 Processor -- start 2023-07-09T02:18:21.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 -- start start 2023-07-09T02:18:21.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd358152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3580d2620 0x7fd3580c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35815c060 0x7fd35815eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580ca050 con 0x7fd3580d2620 2023-07-09T02:18:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580cc250 con 0x7fd35815c060 2023-07-09T02:18:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580cc530 con 0x7fd3580cd120 2023-07-09T02:18:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3580d2620 0x7fd3580c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35db2b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd358152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3580d2620 0x7fd3580c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51614/0 (socket says 172.21.15.45:51614) 2023-07-09T02:18:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35e32c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35815c060 0x7fd35815eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 -- 172.21.15.45:0/3879353634 learned_addr learned my addr 172.21.15.45:0/3879353634 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:21.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 -- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 msgr2=0x7fd358152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd358152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 -- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35815c060 msgr2=0x7fd35815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35815c060 0x7fd35815eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 -- 172.21.15.45:0/3879353634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009a70 con 0x7fd3580d2620 2023-07-09T02:18:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35e32c640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35815c060 0x7fd35815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35d32a640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3580d2620 0x7fd3580c9b10 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd3480ad040 tx=0x7fd34801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:21.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd34e7fc640 1 -- 172.21.15.45:0/3879353634 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480bf610 con 0x7fd3580d2620 2023-07-09T02:18:21.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd34e7fc640 1 -- 172.21.15.45:0/3879353634 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3480bf790 con 0x7fd3580d2620 2023-07-09T02:18:21.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd34e7fc640 1 -- 172.21.15.45:0/3879353634 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480bfb40 con 0x7fd3580d2620 2023-07-09T02:18:21.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.539+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd348009420 con 0x7fd3580d2620 2023-07-09T02:18:21.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.543+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3580b59f0 con 0x7fd3580d2620 2023-07-09T02:18:21.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.543+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35815c8d0 con 0x7fd3580d2620 2023-07-09T02:18:21.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.543+0000 7fd34e7fc640 1 -- 172.21.15.45:0/3879353634 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3480b5400 con 0x7fd3580d2620 2023-07-09T02:18:21.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.543+0000 7fd34e7fc640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd33c0662b0 0x7fd33c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:21.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.543+0000 7fd34e7fc640 1 -- 172.21.15.45:0/3879353634 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd34811e930 con 0x7fd3580d2620 2023-07-09T02:18:21.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.543+0000 7fd35db2b640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd33c0662b0 0x7fd33c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:21.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.547+0000 7fd35db2b640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd33c0662b0 0x7fd33c068760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd354005890 tx=0x7fd354009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:21.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.547+0000 7fd34e7fc640 1 -- 172.21.15.45:0/3879353634 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3480ebf70 con 0x7fd3580d2620 2023-07-09T02:18:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.703+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd35804d7d0 con 0x7fd3580d2620 2023-07-09T02:18:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd34e7fc640 1 -- 172.21.15.45:0/3879353634 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+37017 (secure 0 0 0) 0x7fd3480ef590 con 0x7fd3580d2620 2023-07-09T02:18:21.710 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:21.710 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:21.710 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 141, 2023-07-09T02:18:21.711 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:18:21.711 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:18:21.711 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:18:19.382142+0000", 2023-07-09T02:18:21.712 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:18:21.712 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:18:21.712 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:18:21.712 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:18:21.712 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:18:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:18:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:18:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:18:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:18:21.714 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:21.714 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:18:21.714 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:18:21.714 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:18:21.715 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:18:21.715 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:18:21.715 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 18, 2023-07-09T02:18:21.715 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:18:21.715 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:18:21.716 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:18:21.716 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:18:21.716 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:18:21.716 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:18:21.716 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.716 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:18:21.716 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:18:21.717 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:18:21.717 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:21.717 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:21.717 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:21.717 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:21.717 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:21.717 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:21.717 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:21.718 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:21.718 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:21.718 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:21.718 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:21.718 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:21.718 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:18:21.718 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:18:21.718 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:18:21.719 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:18:21.719 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:18:21.719 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:21.719 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:21.719 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:21.719 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:21.719 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:21.720 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:21.720 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:21.720 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.720 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:21.720 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:21.720 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:21.720 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:21.721 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:21.721 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:21.721 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:21.721 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:21.721 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:21.721 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:21.721 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:21.721 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:21.722 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:21.722 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:21.722 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:21.722 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:21.722 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:21.722 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:21.722 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:21.722 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:21.723 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:21.723 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:21.723 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:21.723 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:21.723 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:21.723 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:21.723 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:21.725 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:21.725 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:21.725 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:21.725 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:21.725 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:21.725 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:18:21.725 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:18:21.726 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.726 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:21.726 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:18:21.726 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.726 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:21.726 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:18:21.726 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:18:21.726 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:18:21.727 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:18:21.727 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:18:21.727 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:21.727 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:21.727 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:21.727 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.727 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.727 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.728 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:18:21.728 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:18:21.728 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:18:21.728 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:21.728 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:21.728 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:21.728 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:21.728 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:21.729 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:21.729 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:21.729 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:21.729 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:21.729 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:21.729 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:21.729 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:18:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:18:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:18:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:18:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:18:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:21.730 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:21.731 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:21.731 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:21.731 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:21.731 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:21.731 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.731 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:18:21.731 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:21.731 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:21.732 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:21.732 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:21.732 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:21.732 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:21.732 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:21.732 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:21.732 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:21.733 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:21.733 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:21.733 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:21.733 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:21.733 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:21.733 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:21.733 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:21.734 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:21.734 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:21.734 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:21.734 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:21.734 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:21.735 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:21.735 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:21.735 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:21.735 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:21.735 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:21.736 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.736 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:21.736 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:21.736 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:21.736 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:21.737 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:21.737 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:21.737 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:21.737 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:21.738 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:21.738 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:21.738 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:21.738 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:18:21.738 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:21.738 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:18:21.739 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.739 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:21.739 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:18:21.739 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:18:21.739 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:18:21.739 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:18:21.740 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:18:21.740 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:21.740 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:21.740 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:21.741 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.741 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.741 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.741 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 17, 2023-07-09T02:18:21.742 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:18:21.742 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:44.368934+0000", 2023-07-09T02:18:21.742 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:21.742 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:21.743 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:21.743 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:21.743 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:21.743 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:21.743 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:21.744 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:21.744 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:21.744 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:21.744 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:21.745 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:21.745 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:18:21.745 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:18:21.745 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:18:21.745 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:18:21.746 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:18:21.746 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:21.746 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:21.746 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:21.747 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:21.747 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:21.747 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:21.747 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:21.747 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.748 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "137", 2023-07-09T02:18:21.748 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:21.748 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:21.748 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:21.748 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:21.748 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:21.749 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:21.749 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:21.749 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:21.749 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:21.749 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:18:21.750 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:21.750 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:21.750 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:21.750 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:21.750 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:21.750 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:21.751 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:21.751 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:21.751 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:21.751 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:21.752 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:21.752 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:21.752 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:21.752 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:21.752 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:21.752 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:21.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.753 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:21.753 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:21.753 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:21.753 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:21.753 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:21.753 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:21.753 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:21.753 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:21.754 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:21.754 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:21.754 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:21.754 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:21.754 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:18:21.754 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:18:21.754 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:18:21.755 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.755 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:21.755 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:21.755 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:18:21.755 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.755 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.755 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:21.755 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:18:21.756 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:18:21.756 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:21.756 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:18:21.756 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:18:21.756 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:21.756 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:21.756 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:21.757 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.757 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.757 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.757 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 18, 2023-07-09T02:18:21.757 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:18:21.757 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:17:45.234988+0000", 2023-07-09T02:18:21.758 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:18:21.758 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:18:21.758 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:18:21.758 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:18:21.758 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:18:21.758 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:18:21.758 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:18:21.759 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:18:21.759 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:18:21.759 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:18:21.759 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:18:21.759 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:18:21.759 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:18:21.759 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:18:21.760 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:18:21.760 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:18:21.760 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:18:21.760 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:18:21.760 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:18:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:18:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:18:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:18:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:18:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:18:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "141", 2023-07-09T02:18:21.761 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:18:21.762 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:18:21.762 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:18:21.762 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:18:21.762 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:18:21.762 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:18:21.762 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:18:21.762 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:18:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:18:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:18:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:18:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:18:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:18:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:18:21.763 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:18:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:18:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:18:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:18:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:18:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:18:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:18:21.764 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:18:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:18:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:18:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:18:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:18:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:18:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:18:21.765 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:18:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:18:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:18:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:18:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:18:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:18:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:18:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:18:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:18:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:18:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:18:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:18:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:18:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:18:21.767 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:18:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:18:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.3799999952316284, 2023-07-09T02:18:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.3799999952316284, 2023-07-09T02:18:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:18:21.768 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.3799999952316284, 2023-07-09T02:18:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.3799999952316284, 2023-07-09T02:18:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:18:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:18:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:18:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:21.769 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:18:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.771 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:18:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.772 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:18:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.773 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:18:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:18:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.774 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.775 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:18:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.776 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:18:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.777 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.778 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:18:21.779 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.780 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.780 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.780 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.781 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:18:21.781 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:18:21.781 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.782 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.782 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.782 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:18:21.782 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:18:21.783 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:18:21.783 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:18:21.783 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.783 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.784 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.784 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.784 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.784 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.784 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:21.785 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.785 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.785 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.786 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.786 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.786 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.786 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.787 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.787 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.787 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.787 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.787 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.787 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.787 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.788 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.788 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:18:21.788 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.788 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.788 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.788 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.788 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:18:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.789 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:18:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:18:21.790 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.791 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:18:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:18:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.792 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:18:21.793 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:18:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:18:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.794 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:18:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:18:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:18:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:18:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.795 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.796 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.797 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.798 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.798 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.798 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.798 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.798 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:18:21.798 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.798 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.798 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.799 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.799 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:18:21.799 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.799 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.799 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.799 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.799 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.800 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.800 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.800 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.800 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:18:21.800 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.800 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.800 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.800 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.801 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:18:21.801 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.801 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.801 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.801 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.801 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.801 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.801 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.802 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.802 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:18:21.802 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.802 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.802 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.802 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.802 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:18:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.803 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:18:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:18:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:18:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.805 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.805 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.805 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:18:21.805 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:18:21.805 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:18:21.805 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:18:21.805 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.805 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.806 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.806 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.806 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.806 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.806 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:21.806 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.806 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.807 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.807 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.807 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.807 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.807 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.807 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.807 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.807 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.808 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.808 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.808 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.808 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.808 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.808 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:18:21.808 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.808 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.809 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.809 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.809 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:18:21.809 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.809 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.809 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.809 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.809 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.810 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.810 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.810 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.810 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:18:21.810 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.810 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.810 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.811 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:18:21.811 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.811 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.811 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.811 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.811 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.811 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.811 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:18:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.812 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:18:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.813 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:18:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:18:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:18:21.814 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:18:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:18:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:18:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:18:21.815 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.816 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.817 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:18:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:18:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.819 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:18:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.820 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.821 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.821 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:18:21.821 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.821 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.821 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.821 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.821 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.821 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.822 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.822 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.822 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:18:21.822 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.822 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.822 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.822 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.823 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:18:21.823 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.823 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.823 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.823 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.823 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.823 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:18:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:18:21.824 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:18:21.825 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.825 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.825 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:18:21.825 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:18:21.825 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:18:21.825 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:18:21.826 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.826 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.826 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.826 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.826 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.826 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:21.826 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.827 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.827 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.827 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.827 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.827 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.827 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.827 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.827 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.828 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.828 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.828 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.828 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.828 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.828 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.828 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:18:21.829 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.829 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.829 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.829 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:18:21.829 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.829 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.829 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.830 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.830 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.830 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.830 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.830 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.830 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:18:21.830 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:18:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.832 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.832 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.832 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.832 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.832 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:18:21.832 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.833 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.833 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.833 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:18:21.833 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.833 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.833 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.833 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.833 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.834 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.834 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.834 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.834 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:18:21.834 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.834 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.834 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.835 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:18:21.835 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:18:21.835 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.835 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.835 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.835 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:18:21.835 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:18:21.835 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:18:21.836 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:18:21.836 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.836 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.836 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.836 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.837 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.837 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:21.837 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.837 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.837 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.837 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.837 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.837 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.838 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.838 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.838 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.838 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.838 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.838 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.838 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:18:21.840 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.840 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.840 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.840 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.840 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.840 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.840 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.841 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.841 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:18:21.841 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.841 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.841 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.841 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.841 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:18:21.842 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.842 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.842 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.842 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.842 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.842 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.842 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.842 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.843 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:18:21.843 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.843 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.843 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.843 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:18:21.843 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:18:21.845 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.845 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.845 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.845 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.845 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:18:21.845 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:18:21.845 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.846 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.846 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.846 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:18:21.846 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:18:21.846 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:18:21.846 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:18:21.846 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.846 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 136, 2023-07-09T02:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:18:21.849 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:18:21.849 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:18:21.849 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.849 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.849 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.849 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:18:21.849 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.849 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.850 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.850 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.850 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:18:21.850 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.850 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.850 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.850 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.850 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:18:21.851 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.851 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.851 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.851 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:18:21.851 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.851 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.851 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.851 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.852 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:18:21.852 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.852 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.852 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.852 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:18:21.852 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.853 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:18:21.853 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.853 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:18:21.854 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.854 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.854 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.854 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:18:21.854 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:18:21.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:18:21.855 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:18:21.855 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:18:21.855 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:18:21.855 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:18:21.856 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.856 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.856 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:18:21.856 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:18:21.856 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:18:21.857 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:18:21.857 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:18:21.857 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:18:21.857 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:18:21.857 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:21.857 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.857 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:21.857 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:18:21.858 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.858 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:18:21.858 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.858 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.858 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.858 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.859 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.859 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:18:21.859 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.859 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.859 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:18:21.859 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.859 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.860 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.860 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.860 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.860 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:18:21.860 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.860 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:18:21.861 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.861 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.861 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.861 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.861 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.861 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:18:21.861 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.862 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.862 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.862 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:18:21.862 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.862 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.862 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.862 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.862 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.863 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:18:21.863 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.863 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.863 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:18:21.863 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.863 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.863 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.864 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.864 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.864 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:18:21.864 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.864 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.864 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.865 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:18:21.865 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.865 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.865 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.865 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.865 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.865 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:18:21.865 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.866 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.866 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:18:21.866 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.866 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.866 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.866 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.867 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.867 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:18:21.867 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.867 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:21.867 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:18:21.867 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:18:21.867 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:18:21.868 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:18:21.868 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:18:21.868 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:18:21.868 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:18:21.868 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:18:21.868 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.868 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:18:21.869 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:18:21.869 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:18:21.869 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:18:21.869 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:18:21.869 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:18:21.869 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:18:21.869 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:18:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:18:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:18:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:18:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:18:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:18:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:18:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:18:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.871 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:21.871 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:18:21.871 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:18:21.871 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:18:21.871 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:18:21.871 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:18:21.871 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:18:21.871 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:18:21.872 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:18:21.872 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:18:21.872 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:18:21.872 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:18:21.872 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:21.872 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd33c0662b0 msgr2=0x7fd33c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd33c0662b0 0x7fd33c068760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd354005890 tx=0x7fd354009040 comp rx=0 tx=0).stop 2023-07-09T02:18:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3580d2620 msgr2=0x7fd3580c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3580d2620 0x7fd3580c9b10 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd3480ad040 tx=0x7fd34801ac90 comp rx=0 tx=0).stop 2023-07-09T02:18:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 shutdown_connections 2023-07-09T02:18:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd35815c060 0x7fd35815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3580d2620 0x7fd3580c9b10 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd33c0662b0 0x7fd33c068760 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 --2- 172.21.15.45:0/3879353634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3580cd120 0x7fd358152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 >> 172.21.15.45:0/3879353634 conn(0x7fd3580698e0 msgr2=0x7fd3580b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 shutdown_connections 2023-07-09T02:18:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:21.707+0000 7fd35fd8f640 1 -- 172.21.15.45:0/3879353634 wait complete. 2023-07-09T02:18:21.876 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f813ccec640 1 Processor -- start 2023-07-09T02:18:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f813ccec640 1 -- start start 2023-07-09T02:18:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f813ccec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f81380d2620 0x7f81380b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f813ccec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81380cd120 0x7f81380cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f813ccec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8138160a50 con 0x7f813815c060 2023-07-09T02:18:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f813ccec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813815c430 con 0x7f81380d2620 2023-07-09T02:18:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f813ccec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813815fb60 con 0x7f81380cd120 2023-07-09T02:18:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f8136d9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81380cd120 0x7f81380cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f8136d9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81380cd120 0x7f81380cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:59320/0 (socket says 172.21.15.45:59320) 2023-07-09T02:18:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f8136d9d640 1 -- 172.21.15.45:0/3209736905 learned_addr learned my addr 172.21.15.45:0/3209736905 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f8135d9b640 1 --2- 172.21.15.45:0/3209736905 >> v2:172.21.15.155:3300/0 conn(0x7f81380d2620 0x7f81380b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f8136d9d640 1 -- 172.21.15.45:0/3209736905 >> v2:172.21.15.155:3300/0 conn(0x7f81380d2620 msgr2=0x7f81380b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f8136d9d640 1 --2- 172.21.15.45:0/3209736905 >> v2:172.21.15.155:3300/0 conn(0x7f81380d2620 0x7f81380b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f8136d9d640 1 -- 172.21.15.45:0/3209736905 >> v1:172.21.15.155:6789/0 conn(0x7f813815c060 legacy=0x7f81380d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f8136d9d640 1 -- 172.21.15.45:0/3209736905 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813815fe40 con 0x7f81380cd120 2023-07-09T02:18:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.019+0000 7f813559a640 1 -- 172.21.15.45:0/3209736905 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479123629 0 0) 0x7f8138160a50 con 0x7f813815c060 2023-07-09T02:18:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f8136d9d640 1 --2- 172.21.15.45:0/3209736905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81380cd120 0x7f81380cee30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8130009e50 tx=0x7f813001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9994fa5e213123e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813559a640 1 -- 172.21.15.45:0/3209736905 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300a58a0 con 0x7f81380cd120 2023-07-09T02:18:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813559a640 1 -- 172.21.15.45:0/3209736905 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81300a5a00 con 0x7f81380cd120 2023-07-09T02:18:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813559a640 1 -- 172.21.15.45:0/3209736905 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300a5d90 con 0x7f81380cd120 2023-07-09T02:18:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813ccec640 1 -- 172.21.15.45:0/3209736905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81380cd120 msgr2=0x7f81380cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813ccec640 1 --2- 172.21.15.45:0/3209736905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81380cd120 0x7f81380cee30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8130009e50 tx=0x7f813001c9e0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813ccec640 1 -- 172.21.15.45:0/3209736905 shutdown_connections 2023-07-09T02:18:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813ccec640 1 --2- 172.21.15.45:0/3209736905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81380cd120 0x7f81380cee30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813ccec640 1 --2- 172.21.15.45:0/3209736905 >> v2:172.21.15.155:3300/0 conn(0x7f81380d2620 0x7f81380b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813ccec640 1 -- 172.21.15.45:0/3209736905 >> 172.21.15.45:0/3209736905 conn(0x7f81380698e0 msgr2=0x7f8138069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813ccec640 1 -- 172.21.15.45:0/3209736905 shutdown_connections 2023-07-09T02:18:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.023+0000 7f813ccec640 1 -- 172.21.15.45:0/3209736905 wait complete. 2023-07-09T02:18:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 Processor -- start 2023-07-09T02:18:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 -- start start 2023-07-09T02:18:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81380cd120 0x7f8138156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81380d2620 0x7f8138159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813815c060 0x7f813815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81380caa20 con 0x7f81380d2620 2023-07-09T02:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81380cad00 con 0x7f81380cd120 2023-07-09T02:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81380cafe0 con 0x7f813815c060 2023-07-09T02:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81380d2620 0x7f8138159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81380d2620 0x7f8138159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43054/0 (socket says 172.21.15.45:43054) 2023-07-09T02:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 -- 172.21.15.45:0/3763686536 learned_addr learned my addr 172.21.15.45:0/3763686536 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813659c640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81380cd120 0x7f8138156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8136d9d640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813815c060 0x7f813815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 -- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813815c060 msgr2=0x7f813815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813815c060 0x7f813815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 -- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81380cd120 msgr2=0x7f8138156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81380cd120 0x7f8138156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 -- 172.21.15.45:0/3763686536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130009b30 con 0x7f81380d2620 2023-07-09T02:18:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813659c640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81380cd120 0x7f8138156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8136d9d640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813815c060 0x7f813815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8135d9b640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81380d2620 0x7f8138159c60 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f812c00e900 tx=0x7f812c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8126ffd640 1 -- 172.21.15.45:0/3763686536 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c009690 con 0x7f81380d2620 2023-07-09T02:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8126ffd640 1 -- 172.21.15.45:0/3763686536 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00ca00 con 0x7f81380d2620 2023-07-09T02:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81380b59f0 con 0x7f81380d2620 2023-07-09T02:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f8126ffd640 1 -- 172.21.15.45:0/3763686536 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00cdb0 con 0x7f81380d2620 2023-07-09T02:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.027+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8138157450 con 0x7f81380d2620 2023-07-09T02:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.031+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813804d7d0 con 0x7f81380d2620 2023-07-09T02:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.031+0000 7f8126ffd640 1 -- 172.21.15.45:0/3763686536 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f812c013470 con 0x7f81380d2620 2023-07-09T02:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.031+0000 7f8126ffd640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8118066280 0x7f8118068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.031+0000 7f8126ffd640 1 -- 172.21.15.45:0/3763686536 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f812c083fc0 con 0x7f81380d2620 2023-07-09T02:18:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.031+0000 7f813659c640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8118066280 0x7f8118068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.031+0000 7f813659c640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8118066280 0x7f8118068730 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8128000f70 tx=0x7f8128009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.035+0000 7f8126ffd640 1 -- 172.21.15.45:0/3763686536 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f812c051430 con 0x7f81380d2620 2023-07-09T02:18:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.227+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f813806c7d0 con 0x7f81380d2620 2023-07-09T02:18:22.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.227+0000 7f8126ffd640 1 -- 172.21.15.45:0/3763686536 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f812c017090 con 0x7f81380d2620 2023-07-09T02:18:22.231 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:22.231 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:18:22.232 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:18:22.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8118066280 msgr2=0x7f8118068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:22.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8118066280 0x7f8118068730 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8128000f70 tx=0x7f8128009040 comp rx=0 tx=0).stop 2023-07-09T02:18:22.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81380d2620 msgr2=0x7f8138159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:22.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81380d2620 0x7f8138159c60 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f812c00e900 tx=0x7f812c00edc0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 shutdown_connections 2023-07-09T02:18:22.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8118066280 0x7f8118068730 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f813815c060 0x7f813815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81380d2620 0x7f8138159c60 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 --2- 172.21.15.45:0/3763686536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81380cd120 0x7f8138156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 >> 172.21.15.45:0/3763686536 conn(0x7f81380698e0 msgr2=0x7f8138158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 shutdown_connections 2023-07-09T02:18:22.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:22.231+0000 7f813ccec640 1 -- 172.21.15.45:0/3763686536 wait complete. 2023-07-09T02:18:22.252 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-07-09T02:18:22.420 INFO:teuthology.orchestra.run.smithi155.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":7809,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.544894763999999,"mdsmap_epoch":67,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":41.440569901000003} 2023-07-09T02:18:22.420 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 7809, "mdsmap_epoch": 67, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 35.544894764, "state": "up:active", "uptime": 41.440569901, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:18:22.421 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:18:22.421 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:18:22.421 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:22.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:22.431 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-07-09T02:18:22.911 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records in 2023-07-09T02:18:22.912 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records out 2023-07-09T02:18:22.912 INFO:teuthology.orchestra.run.smithi045.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.425905 s, 123 MB/s 2023-07-09T02:18:22.913 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:18:22.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:18:22.987 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:18:23.030 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:18:23.030 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:18:23.031 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:23.040 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:18:23.040 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:23.095 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:23.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f39119c5640 1 Processor -- start 2023-07-09T02:18:23.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f39119c5640 1 -- start start 2023-07-09T02:18:23.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f39119c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c158e30 0x7f390c06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f39119c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f390c06fd10 0x7f390c06c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f39119c5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0ccf80 con 0x7f390c06c650 2023-07-09T02:18:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f39119c5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c06cad0 con 0x7f390c06fd10 2023-07-09T02:18:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f39119c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0cd540 con 0x7f390c158e30 2023-07-09T02:18:23.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f390affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c158e30 0x7f390c06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f390b7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f390c06c650 0x7f390c0caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:49660/0 (socket says 172.21.15.45:49660) 2023-07-09T02:18:23.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f3903fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f390c06fd10 0x7f390c06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f390b7fe640 1 -- 172.21.15.45:0/825456631 learned_addr learned my addr 172.21.15.45:0/825456631 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f390a7fc640 1 -- 172.21.15.45:0/825456631 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368933205 0 0) 0x7f390c0ccf80 con 0x7f390c06c650 2023-07-09T02:18:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.279+0000 7f390a7fc640 1 -- 172.21.15.45:0/825456631 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f8003530 con 0x7f390c06c650 2023-07-09T02:18:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f3903fff640 1 -- 172.21.15.45:0/825456631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c158e30 msgr2=0x7f390c06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f3903fff640 1 --2- 172.21.15.45:0/825456631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c158e30 0x7f390c06f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f3903fff640 1 -- 172.21.15.45:0/825456631 >> v1:172.21.15.155:6789/0 conn(0x7f390c06c650 legacy=0x7f390c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f3903fff640 1 -- 172.21.15.45:0/825456631 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0c8fb0 con 0x7f390c06fd10 2023-07-09T02:18:23.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f390affd640 1 --2- 172.21.15.45:0/825456631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c158e30 0x7f390c06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:23.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f3903fff640 1 --2- 172.21.15.45:0/825456631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 0x7f390c06c110 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097c0 tx=0x7f38f401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=728f7e408b173de6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f390a7fc640 1 -- 172.21.15.45:0/825456631 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40ac620 con 0x7f390c06fd10 2023-07-09T02:18:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f390a7fc640 1 -- 172.21.15.45:0/825456631 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f40ac780 con 0x7f390c06fd10 2023-07-09T02:18:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f390a7fc640 1 -- 172.21.15.45:0/825456631 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40acb10 con 0x7f390c06fd10 2023-07-09T02:18:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f39119c5640 1 -- 172.21.15.45:0/825456631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 msgr2=0x7f390c06c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f39119c5640 1 --2- 172.21.15.45:0/825456631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 0x7f390c06c110 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097c0 tx=0x7f38f401c3c0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f39119c5640 1 -- 172.21.15.45:0/825456631 shutdown_connections 2023-07-09T02:18:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f39119c5640 1 --2- 172.21.15.45:0/825456631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 0x7f390c06c110 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f39119c5640 1 --2- 172.21.15.45:0/825456631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c158e30 0x7f390c06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.283+0000 7f39119c5640 1 -- 172.21.15.45:0/825456631 >> 172.21.15.45:0/825456631 conn(0x7f390c0694b0 msgr2=0x7f390c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 -- 172.21.15.45:0/825456631 shutdown_connections 2023-07-09T02:18:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 -- 172.21.15.45:0/825456631 wait complete. 2023-07-09T02:18:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 Processor -- start 2023-07-09T02:18:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 -- start start 2023-07-09T02:18:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c06c650 0x7f390c14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 0x7f390c0b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f390c158e30 0x7f390c14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0af0a0 con 0x7f390c158e30 2023-07-09T02:18:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0b0be0 con 0x7f390c06fd10 2023-07-09T02:18:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f39119c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c150500 con 0x7f390c06c650 2023-07-09T02:18:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f390b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f390c158e30 0x7f390c14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f390b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f390c158e30 0x7f390c14f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43056/0 (socket says 172.21.15.45:43056) 2023-07-09T02:18:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f390b7fe640 1 -- 172.21.15.45:0/950658885 learned_addr learned my addr 172.21.15.45:0/950658885 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f3903fff640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 0x7f390c0b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f390affd640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c06c650 0x7f390c14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f3903fff640 1 -- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c06c650 msgr2=0x7f390c14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f3903fff640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c06c650 0x7f390c14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f3903fff640 1 -- 172.21.15.45:0/950658885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f390c158e30 msgr2=0x7f390c14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f3903fff640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f390c158e30 0x7f390c14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f3903fff640 1 -- 172.21.15.45:0/950658885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009420 con 0x7f390c06fd10 2023-07-09T02:18:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.287+0000 7f3903fff640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 0x7f390c0b06a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ac000 tx=0x7f38f401ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f3908ff9640 1 -- 172.21.15.45:0/950658885 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40ac620 con 0x7f390c06fd10 2023-07-09T02:18:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f3908ff9640 1 -- 172.21.15.45:0/950658885 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f40b8450 con 0x7f390c06fd10 2023-07-09T02:18:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f3908ff9640 1 -- 172.21.15.45:0/950658885 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b8800 con 0x7f390c06fd10 2023-07-09T02:18:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f4009420 con 0x7f390c06fd10 2023-07-09T02:18:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0ae9e0 con 0x7f390c06fd10 2023-07-09T02:18:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c0af1e0 con 0x7f390c06fd10 2023-07-09T02:18:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f3908ff9640 1 -- 172.21.15.45:0/950658885 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38f40aa070 con 0x7f390c06fd10 2023-07-09T02:18:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f3908ff9640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38ec066280 0x7f38ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f3908ff9640 1 -- 172.21.15.45:0/950658885 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38f411ea90 con 0x7f390c06fd10 2023-07-09T02:18:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.291+0000 7f390affd640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38ec066280 0x7f38ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.295+0000 7f390affd640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38ec066280 0x7f38ec068730 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009c50 tx=0x7f38fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.295+0000 7f3908ff9640 1 -- 172.21.15.45:0/950658885 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38f40ec0d0 con 0x7f390c06fd10 2023-07-09T02:18:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.451+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f390c04d7d0 con 0x7f390c06fd10 2023-07-09T02:18:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f3908ff9640 1 -- 172.21.15.45:0/950658885 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f38f40ef6f0 con 0x7f390c06fd10 2023-07-09T02:18:23.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:23.457 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":141,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:19.382142+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:44.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:45.234988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:23.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38ec066280 msgr2=0x7f38ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38ec066280 0x7f38ec068730 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009c50 tx=0x7f38fc009190 comp rx=0 tx=0).stop 2023-07-09T02:18:23.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 msgr2=0x7f390c0b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 0x7f390c0b06a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ac000 tx=0x7f38f401ac00 comp rx=0 tx=0).stop 2023-07-09T02:18:23.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 shutdown_connections 2023-07-09T02:18:23.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f390c158e30 0x7f390c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c06fd10 0x7f390c0b06a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38ec066280 0x7f38ec068730 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 --2- 172.21.15.45:0/950658885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c06c650 0x7f390c14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 >> 172.21.15.45:0/950658885 conn(0x7f390c0694b0 msgr2=0x7f390c0c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:23.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 shutdown_connections 2023-07-09T02:18:23.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.455+0000 7f39119c5640 1 -- 172.21.15.45:0/950658885 wait complete. 2023-07-09T02:18:23.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:17:44.368934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:17:45.234988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:18:23.479 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:18:23.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f020de93640 1 Processor -- start 2023-07-09T02:18:23.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f020de93640 1 -- start start 2023-07-09T02:18:23.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f020de93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080d2620 0x7f02080b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f020de93640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0208160a50 con 0x7f02080cd120 2023-07-09T02:18:23.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f020de93640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020815c430 con 0x7f020815c060 2023-07-09T02:18:23.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f020de93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020815fb60 con 0x7f02080d2620 2023-07-09T02:18:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f0207fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f02080cd120 0x7f02080cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33382/0 (socket says 172.21.15.45:33382) 2023-07-09T02:18:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f0207fff640 1 -- 172.21.15.45:0/241442564 learned_addr learned my addr 172.21.15.45:0/241442564 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f0206ffd640 1 --2- 172.21.15.45:0/241442564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080d2620 0x7f02080b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f02067fc640 1 -- 172.21.15.45:0/241442564 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118361370 0 0) 0x7f0208160a50 con 0x7f02080cd120 2023-07-09T02:18:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f02067fc640 1 -- 172.21.15.45:0/241442564 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f0003530 con 0x7f02080cd120 2023-07-09T02:18:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f02067fc640 1 -- 172.21.15.45:0/241442564 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119262203 0 0) 0x7f020815c430 con 0x7f020815c060 2023-07-09T02:18:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f02067fc640 1 -- 172.21.15.45:0/241442564 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0208160a50 con 0x7f020815c060 2023-07-09T02:18:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f0206ffd640 1 -- 172.21.15.45:0/241442564 >> v1:172.21.15.155:6789/0 conn(0x7f020815c060 legacy=0x7f02080d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f0206ffd640 1 -- 172.21.15.45:0/241442564 >> v1:172.21.15.45:6789/0 conn(0x7f02080cd120 legacy=0x7f02080cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.623+0000 7f0206ffd640 1 -- 172.21.15.45:0/241442564 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020815fe40 con 0x7f02080d2620 2023-07-09T02:18:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f0206ffd640 1 --2- 172.21.15.45:0/241442564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080d2620 0x7f02080b4ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0097f0 tx=0x7f01fc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a63fcdfab4dc36a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f02067fc640 1 -- 172.21.15.45:0/241442564 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0aa5f0 con 0x7f02080d2620 2023-07-09T02:18:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f02067fc640 1 -- 172.21.15.45:0/241442564 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0aa750 con 0x7f02080d2620 2023-07-09T02:18:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f02067fc640 1 -- 172.21.15.45:0/241442564 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0aaae0 con 0x7f02080d2620 2023-07-09T02:18:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f020de93640 1 -- 172.21.15.45:0/241442564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080d2620 msgr2=0x7f02080b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f020de93640 1 --2- 172.21.15.45:0/241442564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080d2620 0x7f02080b4ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0097f0 tx=0x7f01fc01c490 comp rx=0 tx=0).stop 2023-07-09T02:18:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f020de93640 1 -- 172.21.15.45:0/241442564 shutdown_connections 2023-07-09T02:18:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f020de93640 1 --2- 172.21.15.45:0/241442564 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080d2620 0x7f02080b4ed0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f020de93640 1 -- 172.21.15.45:0/241442564 >> 172.21.15.45:0/241442564 conn(0x7f02080698e0 msgr2=0x7f0208069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f020de93640 1 -- 172.21.15.45:0/241442564 shutdown_connections 2023-07-09T02:18:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.627+0000 7f020de93640 1 -- 172.21.15.45:0/241442564 wait complete. 2023-07-09T02:18:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 Processor -- start 2023-07-09T02:18:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 -- start start 2023-07-09T02:18:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080cd120 0x7f0208153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02080d2620 0x7f02080ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020815c060 0x7f02080cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080cc060 con 0x7f02080d2620 2023-07-09T02:18:23.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080cae20 con 0x7f020815c060 2023-07-09T02:18:23.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02080cb730 con 0x7f02080cd120 2023-07-09T02:18:23.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02080d2620 0x7f02080ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02080d2620 0x7f02080ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43060/0 (socket says 172.21.15.45:43060) 2023-07-09T02:18:23.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 -- 172.21.15.45:0/1255823360 learned_addr learned my addr 172.21.15.45:0/1255823360 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:23.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f02077fe640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080cd120 0x7f0208153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0207fff640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020815c060 0x7f02080cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 -- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080cd120 msgr2=0x7f0208153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080cd120 0x7f0208153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 -- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020815c060 msgr2=0x7f02080cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020815c060 0x7f02080cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 -- 172.21.15.45:0/1255823360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc009420 con 0x7f02080d2620 2023-07-09T02:18:23.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0207fff640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020815c060 0x7f02080cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:23.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f02077fe640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080cd120 0x7f0208153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:23.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f0206ffd640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02080d2620 0x7f02080ca520 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ac040 tx=0x7f01fc01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f01effff640 1 -- 172.21.15.45:0/1255823360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0be610 con 0x7f02080d2620 2023-07-09T02:18:23.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f01effff640 1 -- 172.21.15.45:0/1255823360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0be7b0 con 0x7f02080d2620 2023-07-09T02:18:23.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f01effff640 1 -- 172.21.15.45:0/1255823360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0beb60 con 0x7f02080d2620 2023-07-09T02:18:23.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02080b59f0 con 0x7f02080d2620 2023-07-09T02:18:23.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.631+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02080cbcf0 con 0x7f02080d2620 2023-07-09T02:18:23.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.635+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020804d7d0 con 0x7f02080d2620 2023-07-09T02:18:23.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.635+0000 7f01effff640 1 -- 172.21.15.45:0/1255823360 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01fc0b4400 con 0x7f02080d2620 2023-07-09T02:18:23.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.635+0000 7f01effff640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f4066280 0x7f01f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.635+0000 7f01effff640 1 -- 172.21.15.45:0/1255823360 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01fc0a7070 con 0x7f02080d2620 2023-07-09T02:18:23.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.635+0000 7f02077fe640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f4066280 0x7f01f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.635+0000 7f02077fe640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f4066280 0x7f01f4068730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f01f80011f0 tx=0x7f01f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.639+0000 7f01effff640 1 -- 172.21.15.45:0/1255823360 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01fc0eb8e0 con 0x7f02080d2620 2023-07-09T02:18:23.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.795+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02080cc1a0 con 0x7f02080d2620 2023-07-09T02:18:23.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.795+0000 7f01effff640 1 -- 172.21.15.45:0/1255823360 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01fc0eef00 con 0x7f02080d2620 2023-07-09T02:18:23.799 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:18:23.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f4066280 msgr2=0x7f01f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f4066280 0x7f01f4068730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f01f80011f0 tx=0x7f01f8009040 comp rx=0 tx=0).stop 2023-07-09T02:18:23.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02080d2620 msgr2=0x7f02080ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02080d2620 0x7f02080ca520 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ac040 tx=0x7f01fc01acd0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 shutdown_connections 2023-07-09T02:18:23.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f020815c060 0x7f02080cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02080d2620 0x7f02080ca520 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f01f4066280 0x7f01f4068730 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 --2- 172.21.15.45:0/1255823360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02080cd120 0x7f0208153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 >> 172.21.15.45:0/1255823360 conn(0x7f02080698e0 msgr2=0x7f02080b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:23.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 shutdown_connections 2023-07-09T02:18:23.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.799+0000 7f020de93640 1 -- 172.21.15.45:0/1255823360 wait complete. 2023-07-09T02:18:23.820 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:18:23.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.963+0000 7f5f329ac640 1 Processor -- start 2023-07-09T02:18:23.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.963+0000 7f5f329ac640 1 -- start start 2023-07-09T02:18:23.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.963+0000 7f5f329ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f2c15c060 0x7f5f2c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.963+0000 7f5f329ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5f2c0d2620 0x7f5f2c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.963+0000 7f5f329ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c160a50 con 0x7f5f2c0cd120 2023-07-09T02:18:23.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.963+0000 7f5f329ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c15c430 con 0x7f5f2c15c060 2023-07-09T02:18:23.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.963+0000 7f5f329ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c15fb60 con 0x7f5f2c0d2620 2023-07-09T02:18:23.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f2c15c060 0x7f5f2c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f2c15c060 0x7f5f2c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43070/0 (socket says 172.21.15.45:43070) 2023-07-09T02:18:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2bfff640 1 -- 172.21.15.45:0/3178594686 learned_addr learned my addr 172.21.15.45:0/3178594686 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2b7fe640 1 --1- 172.21.15.45:0/3178594686 >> v1:172.21.15.45:6789/0 conn(0x7f5f2c0cd120 0x7f5f2c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33394/0 (socket says 172.21.15.45:33394) 2023-07-09T02:18:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f30f49640 1 --2- 172.21.15.45:0/3178594686 >> v2:172.21.15.155:3300/0 conn(0x7f5f2c0d2620 0x7f5f2c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2bfff640 1 -- 172.21.15.45:0/3178594686 >> v2:172.21.15.155:3300/0 conn(0x7f5f2c0d2620 msgr2=0x7f5f2c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2bfff640 1 --2- 172.21.15.45:0/3178594686 >> v2:172.21.15.155:3300/0 conn(0x7f5f2c0d2620 0x7f5f2c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2bfff640 1 -- 172.21.15.45:0/3178594686 >> v1:172.21.15.45:6789/0 conn(0x7f5f2c0cd120 legacy=0x7f5f2c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2affd640 1 -- 172.21.15.45:0/3178594686 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076013429 0 0) 0x7f5f2c160a50 con 0x7f5f2c0cd120 2023-07-09T02:18:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2bfff640 1 -- 172.21.15.45:0/3178594686 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c15fe40 con 0x7f5f2c15c060 2023-07-09T02:18:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2bfff640 1 --2- 172.21.15.45:0/3178594686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 0x7f5f2c0b4ed0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c08bca0 tx=0x7f5f1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a1c97e56e10464 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2affd640 1 -- 172.21.15.45:0/3178594686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0aa430 con 0x7f5f2c15c060 2023-07-09T02:18:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2affd640 1 -- 172.21.15.45:0/3178594686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0aa590 con 0x7f5f2c15c060 2023-07-09T02:18:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.967+0000 7f5f2affd640 1 -- 172.21.15.45:0/3178594686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0aa920 con 0x7f5f2c15c060 2023-07-09T02:18:23.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- 172.21.15.45:0/3178594686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 msgr2=0x7f5f2c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 --2- 172.21.15.45:0/3178594686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 0x7f5f2c0b4ed0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c08bca0 tx=0x7f5f1c01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- 172.21.15.45:0/3178594686 shutdown_connections 2023-07-09T02:18:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 --2- 172.21.15.45:0/3178594686 >> v2:172.21.15.155:3300/0 conn(0x7f5f2c0d2620 0x7f5f2c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 --2- 172.21.15.45:0/3178594686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 0x7f5f2c0b4ed0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- 172.21.15.45:0/3178594686 >> 172.21.15.45:0/3178594686 conn(0x7f5f2c0698e0 msgr2=0x7f5f2c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- 172.21.15.45:0/3178594686 shutdown_connections 2023-07-09T02:18:23.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- 172.21.15.45:0/3178594686 wait complete. 2023-07-09T02:18:23.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 Processor -- start 2023-07-09T02:18:23.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- start start 2023-07-09T02:18:23.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c0cd120 0x7f5f2c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f2c0d2620 0x7f5f2c0b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 0x7f5f2c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c15a020 con 0x7f5f2c15c060 2023-07-09T02:18:23.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c159d40 con 0x7f5f2c0cd120 2023-07-09T02:18:23.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f329ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c152690 con 0x7f5f2c0d2620 2023-07-09T02:18:23.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c0cd120 0x7f5f2c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f30f49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 0x7f5f2c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c0cd120 0x7f5f2c0cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:33258/0 (socket says 172.21.15.45:33258) 2023-07-09T02:18:23.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f2bfff640 1 -- 172.21.15.45:0/1664700569 learned_addr learned my addr 172.21.15.45:0/1664700569 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:23.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.971+0000 7f5f2b7fe640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f2c0d2620 0x7f5f2c0b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f30f49640 1 -- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f2c0d2620 msgr2=0x7f5f2c0b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f30f49640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f2c0d2620 0x7f5f2c0b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f30f49640 1 -- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c0cd120 msgr2=0x7f5f2c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:23.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f30f49640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c0cd120 0x7f5f2c0cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:23.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f30f49640 1 -- 172.21.15.45:0/1664700569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0094d0 con 0x7f5f2c15c060 2023-07-09T02:18:23.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f30f49640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 0x7f5f2c153170 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0d2a10 tx=0x7f5f2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f28ff9640 1 -- 172.21.15.45:0/1664700569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24018070 con 0x7f5f2c15c060 2023-07-09T02:18:23.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f28ff9640 1 -- 172.21.15.45:0/1664700569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2400edd0 con 0x7f5f2c15c060 2023-07-09T02:18:23.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f28ff9640 1 -- 172.21.15.45:0/1664700569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24003bc0 con 0x7f5f2c15c060 2023-07-09T02:18:23.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c0b59f0 con 0x7f5f2c15c060 2023-07-09T02:18:23.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c152c50 con 0x7f5f2c15c060 2023-07-09T02:18:23.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c04d7d0 con 0x7f5f2c15c060 2023-07-09T02:18:23.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f28ff9640 1 -- 172.21.15.45:0/1664700569 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f24014420 con 0x7f5f2c15c060 2023-07-09T02:18:23.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f28ff9640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f18066280 0x7f5f18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:23.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.975+0000 7f5f28ff9640 1 -- 172.21.15.45:0/1664700569 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f24083df0 con 0x7f5f2c15c060 2023-07-09T02:18:23.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.979+0000 7f5f2bfff640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f18066280 0x7f5f18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:23.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.979+0000 7f5f2bfff640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f18066280 0x7f5f18068730 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c01c510 tx=0x7f5f1c0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:23.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:23.979+0000 7f5f28ff9640 1 -- 172.21.15.45:0/1664700569 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f24051310 con 0x7f5f2c15c060 2023-07-09T02:18:24.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f2c0b4d10 con 0x7f5f2c15c060 2023-07-09T02:18:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f28ff9640 1 -- 172.21.15.45:0/1664700569 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f24054930 con 0x7f5f2c15c060 2023-07-09T02:18:24.137 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:18:24.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f18066280 msgr2=0x7f5f18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f18066280 0x7f5f18068730 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c01c510 tx=0x7f5f1c0b5040 comp rx=0 tx=0).stop 2023-07-09T02:18:24.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 msgr2=0x7f5f2c153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 0x7f5f2c153170 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0d2a10 tx=0x7f5f2400e4b0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 shutdown_connections 2023-07-09T02:18:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f2c15c060 0x7f5f2c153170 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5f18066280 0x7f5f18068730 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f2c0d2620 0x7f5f2c0b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 --2- 172.21.15.45:0/1664700569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f2c0cd120 0x7f5f2c0cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 >> 172.21.15.45:0/1664700569 conn(0x7f5f2c0698e0 msgr2=0x7f5f2c0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 shutdown_connections 2023-07-09T02:18:24.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.135+0000 7f5f329ac640 1 -- 172.21.15.45:0/1664700569 wait complete. 2023-07-09T02:18:24.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:18:24.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f5051c34640 1 Processor -- start 2023-07-09T02:18:24.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f5051c34640 1 -- start start 2023-07-09T02:18:24.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f5051c34640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f504c0d2620 0x7f504c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f5051c34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f504c0cd120 0x7f504c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f5051c34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c160a50 con 0x7f504c15c060 2023-07-09T02:18:24.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f5051c34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c15c430 con 0x7f504c0cd120 2023-07-09T02:18:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f5051c34640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c15fb60 con 0x7f504c0d2620 2023-07-09T02:18:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f504bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f504c0cd120 0x7f504c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f504bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f504c0cd120 0x7f504c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43082/0 (socket says 172.21.15.45:43082) 2023-07-09T02:18:24.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f504bfff640 1 -- 172.21.15.45:0/2956467141 learned_addr learned my addr 172.21.15.45:0/2956467141 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:24.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f504affd640 1 --2- 172.21.15.45:0/2956467141 >> v2:172.21.15.155:3300/0 conn(0x7f504c0d2620 0x7f504c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f504bfff640 1 -- 172.21.15.45:0/2956467141 >> v2:172.21.15.155:3300/0 conn(0x7f504c0d2620 msgr2=0x7f504c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:24.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f504bfff640 1 --2- 172.21.15.45:0/2956467141 >> v2:172.21.15.155:3300/0 conn(0x7f504c0d2620 0x7f504c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f504bfff640 1 -- 172.21.15.45:0/2956467141 >> v1:172.21.15.155:6789/0 conn(0x7f504c15c060 legacy=0x7f504c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.303+0000 7f504bfff640 1 -- 172.21.15.45:0/2956467141 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c15fe40 con 0x7f504c0cd120 2023-07-09T02:18:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f504bfff640 1 --2- 172.21.15.45:0/2956467141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c0cd120 0x7f504c0cee30 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f504c15fac0 tx=0x7f504401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d3f1d37803cdca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f504a7fc640 1 -- 172.21.15.45:0/2956467141 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440a5860 con 0x7f504c0cd120 2023-07-09T02:18:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f504a7fc640 1 -- 172.21.15.45:0/2956467141 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50440a59c0 con 0x7f504c0cd120 2023-07-09T02:18:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f504a7fc640 1 -- 172.21.15.45:0/2956467141 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440a5d50 con 0x7f504c0cd120 2023-07-09T02:18:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f5051c34640 1 -- 172.21.15.45:0/2956467141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c0cd120 msgr2=0x7f504c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f5051c34640 1 --2- 172.21.15.45:0/2956467141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c0cd120 0x7f504c0cee30 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f504c15fac0 tx=0x7f504401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f5051c34640 1 -- 172.21.15.45:0/2956467141 shutdown_connections 2023-07-09T02:18:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f5051c34640 1 --2- 172.21.15.45:0/2956467141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c0cd120 0x7f504c0cee30 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f5051c34640 1 --2- 172.21.15.45:0/2956467141 >> v2:172.21.15.155:3300/0 conn(0x7f504c0d2620 0x7f504c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f5051c34640 1 -- 172.21.15.45:0/2956467141 >> 172.21.15.45:0/2956467141 conn(0x7f504c0698e0 msgr2=0x7f504c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f5051c34640 1 -- 172.21.15.45:0/2956467141 shutdown_connections 2023-07-09T02:18:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.307+0000 7f5051c34640 1 -- 172.21.15.45:0/2956467141 wait complete. 2023-07-09T02:18:24.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 Processor -- start 2023-07-09T02:18:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 -- start start 2023-07-09T02:18:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f504c0cd120 0x7f504c0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f504c0d2620 0x7f504c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c15c060 0x7f504c0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c1526f0 con 0x7f504c15c060 2023-07-09T02:18:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c152900 con 0x7f504c0d2620 2023-07-09T02:18:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c152be0 con 0x7f504c0cd120 2023-07-09T02:18:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c15c060 0x7f504c0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c15c060 0x7f504c0b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43090/0 (socket says 172.21.15.45:43090) 2023-07-09T02:18:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 -- 172.21.15.45:0/2792273991 learned_addr learned my addr 172.21.15.45:0/2792273991 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504affd640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f504c0d2620 0x7f504c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504b7fe640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f504c0cd120 0x7f504c0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 -- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f504c0cd120 msgr2=0x7f504c0ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f504c0cd120 0x7f504c0ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 -- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f504c0d2620 msgr2=0x7f504c151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f504c0d2620 0x7f504c151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 -- 172.21.15.45:0/2792273991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044009b30 con 0x7f504c15c060 2023-07-09T02:18:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f504bfff640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c15c060 0x7f504c0b34d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f50440af040 tx=0x7f5044019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5033fff640 1 -- 172.21.15.45:0/2792273991 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440b8670 con 0x7f504c15c060 2023-07-09T02:18:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5033fff640 1 -- 172.21.15.45:0/2792273991 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50440b87d0 con 0x7f504c15c060 2023-07-09T02:18:24.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c0b59f0 con 0x7f504c15c060 2023-07-09T02:18:24.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5033fff640 1 -- 172.21.15.45:0/2792273991 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440b8b60 con 0x7f504c15c060 2023-07-09T02:18:24.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.311+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c1531a0 con 0x7f504c15c060 2023-07-09T02:18:24.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.315+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c04d7d0 con 0x7f504c15c060 2023-07-09T02:18:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.315+0000 7f5033fff640 1 -- 172.21.15.45:0/2792273991 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50440b8cc0 con 0x7f504c15c060 2023-07-09T02:18:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.315+0000 7f5033fff640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5038066280 0x7f5038068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.315+0000 7f5033fff640 1 -- 172.21.15.45:0/2792273991 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f504411f310 con 0x7f504c15c060 2023-07-09T02:18:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.315+0000 7f504b7fe640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5038066280 0x7f5038068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.315+0000 7f504b7fe640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5038066280 0x7f5038068730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f503c000f70 tx=0x7f503c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.319+0000 7f5033fff640 1 -- 172.21.15.45:0/2792273991 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50440ec840 con 0x7f504c15c060 2023-07-09T02:18:24.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.471+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f504c0b18d0 con 0x7f504c15c060 2023-07-09T02:18:24.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.471+0000 7f5033fff640 1 -- 172.21.15.45:0/2792273991 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50440efe60 con 0x7f504c15c060 2023-07-09T02:18:24.475 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:18:24.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5038066280 msgr2=0x7f5038068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5038066280 0x7f5038068730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f503c000f70 tx=0x7f503c009040 comp rx=0 tx=0).stop 2023-07-09T02:18:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c15c060 msgr2=0x7f504c0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c15c060 0x7f504c0b34d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f50440af040 tx=0x7f5044019740 comp rx=0 tx=0).stop 2023-07-09T02:18:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 shutdown_connections 2023-07-09T02:18:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f504c15c060 0x7f504c0b34d0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f504c0d2620 0x7f504c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5038066280 0x7f5038068730 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 --2- 172.21.15.45:0/2792273991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f504c0cd120 0x7f504c0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 >> 172.21.15.45:0/2792273991 conn(0x7f504c0698e0 msgr2=0x7f504c154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 shutdown_connections 2023-07-09T02:18:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.475+0000 7f5051c34640 1 -- 172.21.15.45:0/2792273991 wait complete. 2023-07-09T02:18:24.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:18:24.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.639+0000 7f04b41e9640 1 Processor -- start 2023-07-09T02:18:24.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.639+0000 7f04b41e9640 1 -- start start 2023-07-09T02:18:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b41e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac158e30 0x7f04ac06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b41e9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04ac06fd10 0x7f04ac06c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b41e9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04ac06c650 0x7f04ac0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b41e9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac06cad0 con 0x7f04ac06c650 2023-07-09T02:18:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b41e9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac0ccf80 con 0x7f04ac06fd10 2023-07-09T02:18:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b41e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0cd540 con 0x7f04ac158e30 2023-07-09T02:18:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b2786640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04ac06c650 0x7f04ac0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b2786640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04ac06c650 0x7f04ac0caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43100/0 (socket says 172.21.15.45:43100) 2023-07-09T02:18:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b2786640 1 -- 172.21.15.45:0/2999530083 learned_addr learned my addr 172.21.15.45:0/2999530083 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b1784640 1 --2- 172.21.15.45:0/2999530083 >> v2:172.21.15.155:3300/0 conn(0x7f04ac06fd10 0x7f04ac06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b1f85640 1 --2- 172.21.15.45:0/2999530083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac158e30 0x7f04ac06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b2786640 1 -- 172.21.15.45:0/2999530083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac158e30 msgr2=0x7f04ac06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b2786640 1 --2- 172.21.15.45:0/2999530083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac158e30 0x7f04ac06f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b2786640 1 -- 172.21.15.45:0/2999530083 >> v2:172.21.15.155:3300/0 conn(0x7f04ac06fd10 msgr2=0x7f04ac06c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b2786640 1 --2- 172.21.15.45:0/2999530083 >> v2:172.21.15.155:3300/0 conn(0x7f04ac06fd10 0x7f04ac06c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.643+0000 7f04b2786640 1 -- 172.21.15.45:0/2999530083 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0c8fb0 con 0x7f04ac06c650 2023-07-09T02:18:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b2786640 1 --2- 172.21.15.45:0/2999530083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac06c650 0x7f04ac0caec0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0cc150 tx=0x7f04a401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849807b39fe567f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b0f83640 1 -- 172.21.15.45:0/2999530083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a400b2d0 con 0x7f04ac06c650 2023-07-09T02:18:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b0f83640 1 -- 172.21.15.45:0/2999530083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a400b430 con 0x7f04ac06c650 2023-07-09T02:18:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b0f83640 1 -- 172.21.15.45:0/2999530083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a40a7be0 con 0x7f04ac06c650 2023-07-09T02:18:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 -- 172.21.15.45:0/2999530083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac06c650 msgr2=0x7f04ac0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 --2- 172.21.15.45:0/2999530083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac06c650 0x7f04ac0caec0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0cc150 tx=0x7f04a401eb10 comp rx=0 tx=0).stop 2023-07-09T02:18:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 -- 172.21.15.45:0/2999530083 shutdown_connections 2023-07-09T02:18:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 --2- 172.21.15.45:0/2999530083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac06c650 0x7f04ac0caec0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 --2- 172.21.15.45:0/2999530083 >> v2:172.21.15.155:3300/0 conn(0x7f04ac06fd10 0x7f04ac06c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 --2- 172.21.15.45:0/2999530083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac158e30 0x7f04ac06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 -- 172.21.15.45:0/2999530083 >> 172.21.15.45:0/2999530083 conn(0x7f04ac0694b0 msgr2=0x7f04ac0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 -- 172.21.15.45:0/2999530083 shutdown_connections 2023-07-09T02:18:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 -- 172.21.15.45:0/2999530083 wait complete. 2023-07-09T02:18:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 Processor -- start 2023-07-09T02:18:24.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.647+0000 7f04b41e9640 1 -- start start 2023-07-09T02:18:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac06c650 0x7f04ac14a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac06fd10 0x7f04ac14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac158e30 0x7f04ac15b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0c7ad0 con 0x7f04ac158e30 2023-07-09T02:18:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac15c290 con 0x7f04ac06c650 2023-07-09T02:18:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac15bcd0 con 0x7f04ac06fd10 2023-07-09T02:18:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac158e30 0x7f04ac15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac158e30 0x7f04ac15b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43104/0 (socket says 172.21.15.45:43104) 2023-07-09T02:18:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 -- 172.21.15.45:0/473381099 learned_addr learned my addr 172.21.15.45:0/473381099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b1f85640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac06c650 0x7f04ac14a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b1784640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac06fd10 0x7f04ac14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 -- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac06fd10 msgr2=0x7f04ac14dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac06fd10 0x7f04ac14dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 -- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac06c650 msgr2=0x7f04ac14a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac06c650 0x7f04ac14a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 -- 172.21.15.45:0/473381099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a400bd40 con 0x7f04ac158e30 2023-07-09T02:18:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b1784640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac06fd10 0x7f04ac14dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b2786640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac158e30 0x7f04ac15b230 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f04a40b1040 tx=0x7f04a401b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04a27fc640 1 -- 172.21.15.45:0/473381099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a4009a10 con 0x7f04ac158e30 2023-07-09T02:18:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04a27fc640 1 -- 172.21.15.45:0/473381099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a4009bb0 con 0x7f04ac158e30 2023-07-09T02:18:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac15bfb0 con 0x7f04ac158e30 2023-07-09T02:18:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04a27fc640 1 -- 172.21.15.45:0/473381099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a40b9430 con 0x7f04ac158e30 2023-07-09T02:18:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac0c5b10 con 0x7f04ac158e30 2023-07-09T02:18:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac0c5d00 con 0x7f04ac158e30 2023-07-09T02:18:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.651+0000 7f04a27fc640 1 -- 172.21.15.45:0/473381099 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04a40b9590 con 0x7f04ac158e30 2023-07-09T02:18:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.655+0000 7f04a27fc640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0490066280 0x7f0490068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.655+0000 7f04a27fc640 1 -- 172.21.15.45:0/473381099 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04a411f7b0 con 0x7f04ac158e30 2023-07-09T02:18:24.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.655+0000 7f04b1f85640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0490066280 0x7f0490068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.655+0000 7f04b1f85640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0490066280 0x7f0490068730 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f04a800b930 tx=0x7f04a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.659+0000 7f04a27fc640 1 -- 172.21.15.45:0/473381099 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04a40ecc50 con 0x7f04ac158e30 2023-07-09T02:18:24.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04ac04d7d0 con 0x7f04ac158e30 2023-07-09T02:18:24.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04a27fc640 1 -- 172.21.15.45:0/473381099 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v141) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04a40f0270 con 0x7f04ac158e30 2023-07-09T02:18:24.817 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:18:24.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0490066280 msgr2=0x7f0490068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0490066280 0x7f0490068730 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f04a800b930 tx=0x7f04a8008040 comp rx=0 tx=0).stop 2023-07-09T02:18:24.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac158e30 msgr2=0x7f04ac15b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac158e30 0x7f04ac15b230 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f04a40b1040 tx=0x7f04a401b8b0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 shutdown_connections 2023-07-09T02:18:24.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04ac158e30 0x7f04ac15b230 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0490066280 0x7f0490068730 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04ac06fd10 0x7f04ac14dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 --2- 172.21.15.45:0/473381099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac06c650 0x7f04ac14a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 >> 172.21.15.45:0/473381099 conn(0x7f04ac0694b0 msgr2=0x7f04ac06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:24.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 shutdown_connections 2023-07-09T02:18:24.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.815+0000 7f04b41e9640 1 -- 172.21.15.45:0/473381099 wait complete. 2023-07-09T02:18:24.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:18:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.979+0000 7f532abe2640 1 Processor -- start 2023-07-09T02:18:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.979+0000 7f532abe2640 1 -- start start 2023-07-09T02:18:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532abe2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f532415c060 0x7f53240b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532abe2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53240d2620 0x7f53240cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532abe2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5324160a50 con 0x7f53240cd120 2023-07-09T02:18:24.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532abe2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532415c430 con 0x7f53240d2620 2023-07-09T02:18:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532abe2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532415fb60 con 0x7f532415c060 2023-07-09T02:18:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532917f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53240d2620 0x7f53240cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532917f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53240d2620 0x7f53240cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43108/0 (socket says 172.21.15.45:43108) 2023-07-09T02:18:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532917f640 1 -- 172.21.15.45:0/3338871642 learned_addr learned my addr 172.21.15.45:0/3338871642 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:24.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532897e640 1 --2- 172.21.15.45:0/3338871642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f532415c060 0x7f53240b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532917f640 1 -- 172.21.15.45:0/3338871642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f532415c060 msgr2=0x7f53240b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532917f640 1 --2- 172.21.15.45:0/3338871642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f532415c060 0x7f53240b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532917f640 1 -- 172.21.15.45:0/3338871642 >> v1:172.21.15.155:6789/0 conn(0x7f53240cd120 legacy=0x7f53240d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532917f640 1 -- 172.21.15.45:0/3338871642 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532415fe40 con 0x7f53240d2620 2023-07-09T02:18:24.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532897e640 1 --2- 172.21.15.45:0/3338871642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f532415c060 0x7f53240b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:24.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.983+0000 7f532917f640 1 --2- 172.21.15.45:0/3338871642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53240d2620 0x7f53240cee30 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f531c009e80 tx=0x7f531c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d52578b9c9a5233 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f53237fe640 1 -- 172.21.15.45:0/3338871642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0a5880 con 0x7f53240d2620 2023-07-09T02:18:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f53237fe640 1 -- 172.21.15.45:0/3338871642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c0a59e0 con 0x7f53240d2620 2023-07-09T02:18:24.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f53237fe640 1 -- 172.21.15.45:0/3338871642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0a5d70 con 0x7f53240d2620 2023-07-09T02:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- 172.21.15.45:0/3338871642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53240d2620 msgr2=0x7f53240cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 --2- 172.21.15.45:0/3338871642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53240d2620 0x7f53240cee30 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f531c009e80 tx=0x7f531c01c9c0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- 172.21.15.45:0/3338871642 shutdown_connections 2023-07-09T02:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 --2- 172.21.15.45:0/3338871642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53240d2620 0x7f53240cee30 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 --2- 172.21.15.45:0/3338871642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f532415c060 0x7f53240b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- 172.21.15.45:0/3338871642 >> 172.21.15.45:0/3338871642 conn(0x7f53240698e0 msgr2=0x7f5324069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- 172.21.15.45:0/3338871642 shutdown_connections 2023-07-09T02:18:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- 172.21.15.45:0/3338871642 wait complete. 2023-07-09T02:18:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 Processor -- start 2023-07-09T02:18:24.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- start start 2023-07-09T02:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd120 0x7f5324151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240d2620 0x7f53240cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532415c060 0x7f53240b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5324153d50 con 0x7f532415c060 2023-07-09T02:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53241528e0 con 0x7f53240cd120 2023-07-09T02:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532abe2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5324152bc0 con 0x7f53240d2620 2023-07-09T02:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532917f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532415c060 0x7f53240b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532917f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532415c060 0x7f53240b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43118/0 (socket says 172.21.15.45:43118) 2023-07-09T02:18:24.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.987+0000 7f532917f640 1 -- 172.21.15.45:0/1571065723 learned_addr learned my addr 172.21.15.45:0/1571065723 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532897e640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd120 0x7f5324151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f5323fff640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240d2620 0x7f53240cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532917f640 1 -- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240d2620 msgr2=0x7f53240cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532917f640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240d2620 0x7f53240cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532917f640 1 -- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd120 msgr2=0x7f5324151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532917f640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd120 0x7f5324151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532917f640 1 -- 172.21.15.45:0/1571065723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c009b30 con 0x7f532415c060 2023-07-09T02:18:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532917f640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532415c060 0x7f53240b34b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f531c0af040 tx=0x7f531c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f53217fa640 1 -- 172.21.15.45:0/1571065723 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0b8670 con 0x7f532415c060 2023-07-09T02:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f53217fa640 1 -- 172.21.15.45:0/1571065723 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c0b8830 con 0x7f532415c060 2023-07-09T02:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f53217fa640 1 -- 172.21.15.45:0/1571065723 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0b8be0 con 0x7f532415c060 2023-07-09T02:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53240b59f0 con 0x7f532415c060 2023-07-09T02:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5324153180 con 0x7f532415c060 2023-07-09T02:18:24.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53240cf170 con 0x7f532415c060 2023-07-09T02:18:24.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f53217fa640 1 -- 172.21.15.45:0/1571065723 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f531c0b8d40 con 0x7f532415c060 2023-07-09T02:18:24.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f53217fa640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5308066280 0x7f5308068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:24.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.991+0000 7f53217fa640 1 -- 172.21.15.45:0/1571065723 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f531c11f3f0 con 0x7f532415c060 2023-07-09T02:18:24.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.995+0000 7f532897e640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5308066280 0x7f5308068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.995+0000 7f532897e640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5308066280 0x7f5308068730 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f53180045f0 tx=0x7f5318008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:24.999+0000 7f53217fa640 1 -- 172.21.15.45:0/1571065723 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f531c0ec9a0 con 0x7f532415c060 2023-07-09T02:18:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.167+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f532404d7d0 con 0x7f532415c060 2023-07-09T02:18:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.167+0000 7f53217fa640 1 -- 172.21.15.45:0/1571065723 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) v1 ==== 80+0+0 (secure 0 0 0) 0x7f531c0effc0 con 0x7f532415c060 2023-07-09T02:18:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:18:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5308066280 msgr2=0x7f5308068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5308066280 0x7f5308068730 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f53180045f0 tx=0x7f5318008040 comp rx=0 tx=0).stop 2023-07-09T02:18:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532415c060 msgr2=0x7f53240b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532415c060 0x7f53240b34b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f531c0af040 tx=0x7f531c019760 comp rx=0 tx=0).stop 2023-07-09T02:18:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 shutdown_connections 2023-07-09T02:18:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532415c060 0x7f53240b34b0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5308066280 0x7f5308068730 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53240d2620 0x7f53240cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 --2- 172.21.15.45:0/1571065723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53240cd120 0x7f5324151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 >> 172.21.15.45:0/1571065723 conn(0x7f53240698e0 msgr2=0x7f53240b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 shutdown_connections 2023-07-09T02:18:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.171+0000 7f532abe2640 1 -- 172.21.15.45:0/1571065723 wait complete. 2023-07-09T02:18:25.191 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:18:25.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:25.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:18:25.304 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:18:25.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:25.305 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:18:25.315 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:18:25.315 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:25.325 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:18:25.326 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:25.376 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:25.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.515+0000 7fb63f27b640 1 Processor -- start 2023-07-09T02:18:25.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63f27b640 1 -- start start 2023-07-09T02:18:25.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63f27b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb6380d2620 0x7fb6380b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63f27b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb638160a50 con 0x7fb63815c060 2023-07-09T02:18:25.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63f27b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63815c430 con 0x7fb6380cd120 2023-07-09T02:18:25.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63f27b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63815fb60 con 0x7fb6380d2620 2023-07-09T02:18:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63c816640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb6380d2620 0x7fb6380b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63c816640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb6380d2620 0x7fb6380b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43128/0 (socket says 172.21.15.45:43128) 2023-07-09T02:18:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63c816640 1 -- 172.21.15.45:0/3645908447 learned_addr learned my addr 172.21.15.45:0/3645908447 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63c816640 1 -- 172.21.15.45:0/3645908447 >> v1:172.21.15.155:6789/0 conn(0x7fb6380cd120 legacy=0x7fb6380cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63c816640 1 -- 172.21.15.45:0/3645908447 >> v1:172.21.15.45:6789/0 conn(0x7fb63815c060 legacy=0x7fb6380d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.519+0000 7fb63c816640 1 -- 172.21.15.45:0/3645908447 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63815fe40 con 0x7fb6380d2620 2023-07-09T02:18:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63c816640 1 --2- 172.21.15.45:0/3645908447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6380b4ed0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb62801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e8f19ff0fc7d8b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb62ffff640 1 -- 172.21.15.45:0/3645908447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280aa430 con 0x7fb6380d2620 2023-07-09T02:18:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb62ffff640 1 -- 172.21.15.45:0/3645908447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6280aa590 con 0x7fb6380d2620 2023-07-09T02:18:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb62ffff640 1 -- 172.21.15.45:0/3645908447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280aa920 con 0x7fb6380d2620 2023-07-09T02:18:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 -- 172.21.15.45:0/3645908447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 msgr2=0x7fb6380b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 --2- 172.21.15.45:0/3645908447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6380b4ed0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb62801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 -- 172.21.15.45:0/3645908447 shutdown_connections 2023-07-09T02:18:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 --2- 172.21.15.45:0/3645908447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6380b4ed0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 -- 172.21.15.45:0/3645908447 >> 172.21.15.45:0/3645908447 conn(0x7fb6380698e0 msgr2=0x7fb638069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 -- 172.21.15.45:0/3645908447 shutdown_connections 2023-07-09T02:18:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 -- 172.21.15.45:0/3645908447 wait complete. 2023-07-09T02:18:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 Processor -- start 2023-07-09T02:18:25.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.523+0000 7fb63f27b640 1 -- start start 2023-07-09T02:18:25.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6380cd120 0x7fb638158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6381596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63815c060 0x7fb6380b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638159c10 con 0x7fb6380d2620 2023-07-09T02:18:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63815ea40 con 0x7fb63815c060 2023-07-09T02:18:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63815ed20 con 0x7fb6380cd120 2023-07-09T02:18:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6381596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6381596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43144/0 (socket says 172.21.15.45:43144) 2023-07-09T02:18:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 -- 172.21.15.45:0/374464513 learned_addr learned my addr 172.21.15.45:0/374464513 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:25.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63d017640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6380cd120 0x7fb638158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63d818640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63815c060 0x7fb6380b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 -- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6380cd120 msgr2=0x7fb638158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6380cd120 0x7fb638158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 -- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63815c060 msgr2=0x7fb6380b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63815c060 0x7fb6380b7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 -- 172.21.15.45:0/374464513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280094d0 con 0x7fb6380d2620 2023-07-09T02:18:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63d017640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6380cd120 0x7fb638158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63c816640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6381596d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb6280ac040 tx=0x7fb62801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb62dffb640 1 -- 172.21.15.45:0/374464513 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280b38c0 con 0x7fb6380d2620 2023-07-09T02:18:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb62dffb640 1 -- 172.21.15.45:0/374464513 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6280b3a40 con 0x7fb6380d2620 2023-07-09T02:18:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb62dffb640 1 -- 172.21.15.45:0/374464513 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280b3df0 con 0x7fb6380d2620 2023-07-09T02:18:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6380b59f0 con 0x7fb6380d2620 2023-07-09T02:18:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63815f2e0 con 0x7fb6380d2620 2023-07-09T02:18:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.527+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63804d7d0 con 0x7fb6380d2620 2023-07-09T02:18:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.531+0000 7fb62dffb640 1 -- 172.21.15.45:0/374464513 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6280b2380 con 0x7fb6380d2620 2023-07-09T02:18:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.531+0000 7fb62dffb640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb61c066280 0x7fb61c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.531+0000 7fb62dffb640 1 -- 172.21.15.45:0/374464513 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb62811e3b0 con 0x7fb6380d2620 2023-07-09T02:18:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.531+0000 7fb63d017640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb61c066280 0x7fb61c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.531+0000 7fb63d017640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb61c066280 0x7fb61c068730 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb6380b8920 tx=0x7fb634009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:25.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.535+0000 7fb62dffb640 1 -- 172.21.15.45:0/374464513 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6280eb8d0 con 0x7fb6380d2620 2023-07-09T02:18:25.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb638156150 con 0x7fb6380d2620 2023-07-09T02:18:25.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb62dffb640 1 -- 172.21.15.45:0/374464513 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+18370 (secure 0 0 0) 0x7fb6280eeef0 con 0x7fb6380d2620 2023-07-09T02:18:25.693 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:25.694 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":141,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:19.382142+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:44.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:45.234988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:25.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb61c066280 msgr2=0x7fb61c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb61c066280 0x7fb61c068730 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb6380b8920 tx=0x7fb634009040 comp rx=0 tx=0).stop 2023-07-09T02:18:25.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 msgr2=0x7fb6381596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6381596d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb6280ac040 tx=0x7fb62801ad10 comp rx=0 tx=0).stop 2023-07-09T02:18:25.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 shutdown_connections 2023-07-09T02:18:25.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb63815c060 0x7fb6380b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6380d2620 0x7fb6381596d0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb61c066280 0x7fb61c068730 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 --2- 172.21.15.45:0/374464513 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6380cd120 0x7fb638158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 >> 172.21.15.45:0/374464513 conn(0x7fb6380698e0 msgr2=0x7fb6380d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:25.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 shutdown_connections 2023-07-09T02:18:25.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.691+0000 7fb63f27b640 1 -- 172.21.15.45:0/374464513 wait complete. 2023-07-09T02:18:25.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:17:44.368934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:17:45.234988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:18:25.717 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:18:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd754b640 1 Processor -- start 2023-07-09T02:18:25.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd754b640 1 -- start start 2023-07-09T02:18:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd754b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabd006b120 0x7fabd006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd754b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd00d23e0 0x7fabd00cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd754b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00cd300 con 0x7fabd0069980 2023-07-09T02:18:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd754b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd0071850 con 0x7fabd006b120 2023-07-09T02:18:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd754b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd006ba30 con 0x7fabd00d23e0 2023-07-09T02:18:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd5d48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd00d23e0 0x7fabd00cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd6549640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fabd006b120 0x7fabd006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd6d4a640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fabd0069980 0x7fabd0069df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:49720/0 (socket says 172.21.15.45:49720) 2023-07-09T02:18:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd5d48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd00d23e0 0x7fabd00cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:59438/0 (socket says 172.21.15.45:59438) 2023-07-09T02:18:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd6d4a640 1 -- 172.21.15.45:0/1039312151 learned_addr learned my addr 172.21.15.45:0/1039312151 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd5547640 1 -- 172.21.15.45:0/1039312151 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122062893 0 0) 0x7fabd00cd300 con 0x7fabd0069980 2023-07-09T02:18:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd5547640 1 -- 172.21.15.45:0/1039312151 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabbc003530 con 0x7fabd0069980 2023-07-09T02:18:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd5d48640 1 -- 172.21.15.45:0/1039312151 >> v2:172.21.15.155:3300/0 conn(0x7fabd006b120 msgr2=0x7fabd006b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd5d48640 1 --2- 172.21.15.45:0/1039312151 >> v2:172.21.15.155:3300/0 conn(0x7fabd006b120 0x7fabd006b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd5d48640 1 -- 172.21.15.45:0/1039312151 >> v1:172.21.15.155:6789/0 conn(0x7fabd0069980 legacy=0x7fabd0069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd5d48640 1 -- 172.21.15.45:0/1039312151 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00d0e80 con 0x7fabd00d23e0 2023-07-09T02:18:25.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.863+0000 7fabd6549640 1 --2- 172.21.15.45:0/1039312151 >> v2:172.21.15.155:3300/0 conn(0x7fabd006b120 0x7fabd006b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd5d48640 1 --2- 172.21.15.45:0/1039312151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd00d23e0 0x7fabd00cea50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabc00097c0 tx=0x7fabc001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd725c9c487b903 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd5547640 1 -- 172.21.15.45:0/1039312151 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00ab650 con 0x7fabd00d23e0 2023-07-09T02:18:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd5547640 1 -- 172.21.15.45:0/1039312151 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc00ab7b0 con 0x7fabd00d23e0 2023-07-09T02:18:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd5547640 1 -- 172.21.15.45:0/1039312151 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00abb40 con 0x7fabd00d23e0 2023-07-09T02:18:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd754b640 1 -- 172.21.15.45:0/1039312151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd00d23e0 msgr2=0x7fabd00cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd754b640 1 --2- 172.21.15.45:0/1039312151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd00d23e0 0x7fabd00cea50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabc00097c0 tx=0x7fabc001c450 comp rx=0 tx=0).stop 2023-07-09T02:18:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd754b640 1 -- 172.21.15.45:0/1039312151 shutdown_connections 2023-07-09T02:18:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd754b640 1 --2- 172.21.15.45:0/1039312151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd00d23e0 0x7fabd00cea50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd754b640 1 --2- 172.21.15.45:0/1039312151 >> v2:172.21.15.155:3300/0 conn(0x7fabd006b120 0x7fabd006b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd754b640 1 -- 172.21.15.45:0/1039312151 >> 172.21.15.45:0/1039312151 conn(0x7fabd00cf3b0 msgr2=0x7fabd00cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd754b640 1 -- 172.21.15.45:0/1039312151 shutdown_connections 2023-07-09T02:18:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.867+0000 7fabd754b640 1 -- 172.21.15.45:0/1039312151 wait complete. 2023-07-09T02:18:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd754b640 1 Processor -- start 2023-07-09T02:18:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd754b640 1 -- start start 2023-07-09T02:18:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd754b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd0069980 0x7fabd0147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd754b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd006b120 0x7fabd01f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd754b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd00d23e0 0x7fabd01f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd754b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0148410 con 0x7fabd00d23e0 2023-07-09T02:18:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd754b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0156da0 con 0x7fabd0069980 2023-07-09T02:18:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd754b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd01561d0 con 0x7fabd006b120 2023-07-09T02:18:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd00d23e0 0x7fabd01f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd5d48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd006b120 0x7fabd01f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd00d23e0 0x7fabd01f8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43160/0 (socket says 172.21.15.45:43160) 2023-07-09T02:18:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 -- 172.21.15.45:0/1969500486 learned_addr learned my addr 172.21.15.45:0/1969500486 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6549640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd0069980 0x7fabd0147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 -- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd006b120 msgr2=0x7fabd01f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd006b120 0x7fabd01f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 -- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd0069980 msgr2=0x7fabd0147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd0069980 0x7fabd0147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 -- 172.21.15.45:0/1969500486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc009420 con 0x7fabd00d23e0 2023-07-09T02:18:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd5d48640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd006b120 0x7fabd01f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabd6d4a640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd00d23e0 0x7fabd01f8670 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fabc800cb40 tx=0x7fabc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabc6ffd640 1 -- 172.21.15.45:0/1969500486 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800aca0 con 0x7fabd00d23e0 2023-07-09T02:18:25.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.871+0000 7fabc6ffd640 1 -- 172.21.15.45:0/1969500486 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800ae00 con 0x7fabd00d23e0 2023-07-09T02:18:25.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.875+0000 7fabc6ffd640 1 -- 172.21.15.45:0/1969500486 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8012620 con 0x7fabd00d23e0 2023-07-09T02:18:25.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.875+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc0009420 con 0x7fabd00d23e0 2023-07-09T02:18:25.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.875+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd0156470 con 0x7fabd00d23e0 2023-07-09T02:18:25.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.875+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd004e020 con 0x7fabd00d23e0 2023-07-09T02:18:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.875+0000 7fabc6ffd640 1 -- 172.21.15.45:0/1969500486 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fabc8007070 con 0x7fabd00d23e0 2023-07-09T02:18:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.875+0000 7fabc6ffd640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fabb4066280 0x7fabb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.875+0000 7fabc6ffd640 1 -- 172.21.15.45:0/1969500486 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabc8083d00 con 0x7fabd00d23e0 2023-07-09T02:18:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.875+0000 7fabd6549640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fabb4066280 0x7fabb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.879+0000 7fabd6549640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fabb4066280 0x7fabb4068730 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009cd0 tx=0x7fabcc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:25.879+0000 7fabc6ffd640 1 -- 172.21.15.45:0/1969500486 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fabc8051220 con 0x7fabd00d23e0 2023-07-09T02:18:26.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.035+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabd0071ef0 con 0x7fabd00d23e0 2023-07-09T02:18:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.035+0000 7fabc6ffd640 1 -- 172.21.15.45:0/1969500486 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabc80170a0 con 0x7fabd00d23e0 2023-07-09T02:18:26.038 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:18:26.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.035+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fabb4066280 msgr2=0x7fabb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.035+0000 7fabd754b640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fabb4066280 0x7fabb4068730 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009cd0 tx=0x7fabcc009190 comp rx=0 tx=0).stop 2023-07-09T02:18:26.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd00d23e0 msgr2=0x7fabd01f8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd00d23e0 0x7fabd01f8670 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fabc800cb40 tx=0x7fabc800a060 comp rx=0 tx=0).stop 2023-07-09T02:18:26.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 shutdown_connections 2023-07-09T02:18:26.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd00d23e0 0x7fabd01f8670 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fabb4066280 0x7fabb4068730 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fabd006b120 0x7fabd01f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 --2- 172.21.15.45:0/1969500486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fabd0069980 0x7fabd0147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 >> 172.21.15.45:0/1969500486 conn(0x7fabd00cf3b0 msgr2=0x7fabd00b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:26.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 shutdown_connections 2023-07-09T02:18:26.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.039+0000 7fabd754b640 1 -- 172.21.15.45:0/1969500486 wait complete. 2023-07-09T02:18:26.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:18:26.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78afcec640 1 Processor -- start 2023-07-09T02:18:26.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78afcec640 1 -- start start 2023-07-09T02:18:26.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78afcec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78a80cd120 0x7f78a80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78afcec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a8160a50 con 0x7f78a80d2620 2023-07-09T02:18:26.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78afcec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a815c430 con 0x7f78a815c060 2023-07-09T02:18:26.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78afcec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a815fb60 con 0x7f78a80cd120 2023-07-09T02:18:26.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78ad287640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f78a80d2620 0x7f78a80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33402/0 (socket says 172.21.15.45:33402) 2023-07-09T02:18:26.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78ad287640 1 -- 172.21.15.45:0/555750203 learned_addr learned my addr 172.21.15.45:0/555750203 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:26.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78ae289640 1 --2- 172.21.15.45:0/555750203 >> v2:172.21.15.155:3300/0 conn(0x7f78a80cd120 0x7f78a80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78aca86640 1 -- 172.21.15.45:0/555750203 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677125045 0 0) 0x7f78a8160a50 con 0x7f78a80d2620 2023-07-09T02:18:26.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78aca86640 1 -- 172.21.15.45:0/555750203 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7894003530 con 0x7f78a80d2620 2023-07-09T02:18:26.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78ae289640 1 -- 172.21.15.45:0/555750203 >> v1:172.21.15.155:6789/0 conn(0x7f78a815c060 legacy=0x7f78a80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78aca86640 1 -- 172.21.15.45:0/555750203 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690494684 0 0) 0x7f78a815c430 con 0x7f78a815c060 2023-07-09T02:18:26.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78ae289640 1 -- 172.21.15.45:0/555750203 >> v1:172.21.15.45:6789/0 conn(0x7f78a80d2620 legacy=0x7f78a80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.203+0000 7f78ae289640 1 -- 172.21.15.45:0/555750203 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a815fe40 con 0x7f78a80cd120 2023-07-09T02:18:26.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78ae289640 1 --2- 172.21.15.45:0/555750203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a80cd120 0x7f78a80b4ed0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009d90 tx=0x7f78a001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78716508d77c9364 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78aca86640 1 -- 172.21.15.45:0/555750203 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a00a59e0 con 0x7f78a80cd120 2023-07-09T02:18:26.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78aca86640 1 -- 172.21.15.45:0/555750203 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a00a5b40 con 0x7f78a80cd120 2023-07-09T02:18:26.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78aca86640 1 -- 172.21.15.45:0/555750203 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a00ad440 con 0x7f78a80cd120 2023-07-09T02:18:26.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78afcec640 1 -- 172.21.15.45:0/555750203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a80cd120 msgr2=0x7f78a80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78afcec640 1 --2- 172.21.15.45:0/555750203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a80cd120 0x7f78a80b4ed0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009d90 tx=0x7f78a001c920 comp rx=0 tx=0).stop 2023-07-09T02:18:26.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78afcec640 1 -- 172.21.15.45:0/555750203 shutdown_connections 2023-07-09T02:18:26.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78afcec640 1 --2- 172.21.15.45:0/555750203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a80cd120 0x7f78a80b4ed0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78afcec640 1 -- 172.21.15.45:0/555750203 >> 172.21.15.45:0/555750203 conn(0x7f78a80698e0 msgr2=0x7f78a8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:26.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78afcec640 1 -- 172.21.15.45:0/555750203 shutdown_connections 2023-07-09T02:18:26.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.207+0000 7f78afcec640 1 -- 172.21.15.45:0/555750203 wait complete. 2023-07-09T02:18:26.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 Processor -- start 2023-07-09T02:18:26.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 -- start start 2023-07-09T02:18:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78a80cd120 0x7f78a8153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a80d2620 0x7f78a8151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a815c060 0x7f78a815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a815b6d0 con 0x7f78a80d2620 2023-07-09T02:18:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8152ab0 con 0x7f78a815c060 2023-07-09T02:18:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8152d90 con 0x7f78a80cd120 2023-07-09T02:18:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a80d2620 0x7f78a8151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a80d2620 0x7f78a8151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43166/0 (socket says 172.21.15.45:43166) 2023-07-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 -- 172.21.15.45:0/3573709557 learned_addr learned my addr 172.21.15.45:0/3573709557 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ae289640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a815c060 0x7f78a815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ada88640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78a80cd120 0x7f78a8153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 -- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78a80cd120 msgr2=0x7f78a8153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78a80cd120 0x7f78a8153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 -- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a815c060 msgr2=0x7f78a815ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a815c060 0x7f78a815ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 -- 172.21.15.45:0/3573709557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0009a70 con 0x7f78a80d2620 2023-07-09T02:18:26.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ae289640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a815c060 0x7f78a815ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:26.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ada88640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78a80cd120 0x7f78a8153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:26.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78ad287640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a80d2620 0x7f78a8151590 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f789800c420 tx=0x7f789800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f789e7fc640 1 -- 172.21.15.45:0/3573709557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898005cf0 con 0x7f78a80d2620 2023-07-09T02:18:26.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f789e7fc640 1 -- 172.21.15.45:0/3573709557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7898005e70 con 0x7f78a80d2620 2023-07-09T02:18:26.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f789e7fc640 1 -- 172.21.15.45:0/3573709557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980072f0 con 0x7f78a80d2620 2023-07-09T02:18:26.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a80b59f0 con 0x7f78a80d2620 2023-07-09T02:18:26.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a8153ad0 con 0x7f78a80d2620 2023-07-09T02:18:26.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.211+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a8152910 con 0x7f78a80d2620 2023-07-09T02:18:26.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.215+0000 7f789e7fc640 1 -- 172.21.15.45:0/3573709557 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7898007450 con 0x7f78a80d2620 2023-07-09T02:18:26.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.215+0000 7f789e7fc640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f788c0662b0 0x7f788c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.215+0000 7f789e7fc640 1 -- 172.21.15.45:0/3573709557 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78980833c0 con 0x7f78a80d2620 2023-07-09T02:18:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.215+0000 7f78ada88640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f788c0662b0 0x7f788c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.215+0000 7f78ada88640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f788c0662b0 0x7f788c068760 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f78a4000f70 tx=0x7f78a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.219+0000 7f789e7fc640 1 -- 172.21.15.45:0/3573709557 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78a8152910 con 0x7f78a80d2620 2023-07-09T02:18:26.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.371+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78a8152910 con 0x7f78a80d2620 2023-07-09T02:18:26.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.371+0000 7f789e7fc640 1 -- 172.21.15.45:0/3573709557 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78a8152910 con 0x7f78a80d2620 2023-07-09T02:18:26.375 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:18:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f788c0662b0 msgr2=0x7f788c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f788c0662b0 0x7f788c068760 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f78a4000f70 tx=0x7f78a4009040 comp rx=0 tx=0).stop 2023-07-09T02:18:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a80d2620 msgr2=0x7f78a8151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a80d2620 0x7f78a8151590 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f789800c420 tx=0x7f789800c8e0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 shutdown_connections 2023-07-09T02:18:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78a815c060 0x7f78a815ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a80d2620 0x7f78a8151590 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f788c0662b0 0x7f788c068760 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 --2- 172.21.15.45:0/3573709557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78a80cd120 0x7f78a8153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 >> 172.21.15.45:0/3573709557 conn(0x7f78a80698e0 msgr2=0x7f78a80b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 shutdown_connections 2023-07-09T02:18:26.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.375+0000 7f78afcec640 1 -- 172.21.15.45:0/3573709557 wait complete. 2023-07-09T02:18:26.396 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:18:26.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.539+0000 7ff622f40640 1 Processor -- start 2023-07-09T02:18:26.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.539+0000 7ff622f40640 1 -- start start 2023-07-09T02:18:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff622f40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff622f40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff61c0cd120 0x7ff61c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff622f40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c160a50 con 0x7ff61c15c060 2023-07-09T02:18:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff622f40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61c15c430 con 0x7ff61c0cd120 2023-07-09T02:18:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff622f40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15fb60 con 0x7ff61c0d2620 2023-07-09T02:18:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff620cdc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff61c15c060 0x7ff61c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33404/0 (socket says 172.21.15.45:33404) 2023-07-09T02:18:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff620cdc640 1 -- 172.21.15.45:0/1772644951 learned_addr learned my addr 172.21.15.45:0/1772644951 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff61bfff640 1 --2- 172.21.15.45:0/1772644951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff6214dd640 1 --2- 172.21.15.45:0/1772644951 >> v2:172.21.15.155:3300/0 conn(0x7ff61c0cd120 0x7ff61c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff61b7fe640 1 -- 172.21.15.45:0/1772644951 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457856893 0 0) 0x7ff61c160a50 con 0x7ff61c15c060 2023-07-09T02:18:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff61b7fe640 1 -- 172.21.15.45:0/1772644951 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff60c003530 con 0x7ff61c15c060 2023-07-09T02:18:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff61bfff640 1 -- 172.21.15.45:0/1772644951 >> v2:172.21.15.155:3300/0 conn(0x7ff61c0cd120 msgr2=0x7ff61c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff61bfff640 1 --2- 172.21.15.45:0/1772644951 >> v2:172.21.15.155:3300/0 conn(0x7ff61c0cd120 0x7ff61c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff61bfff640 1 -- 172.21.15.45:0/1772644951 >> v1:172.21.15.45:6789/0 conn(0x7ff61c15c060 legacy=0x7ff61c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.543+0000 7ff61bfff640 1 -- 172.21.15.45:0/1772644951 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c15fe40 con 0x7ff61c0d2620 2023-07-09T02:18:26.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff61bfff640 1 --2- 172.21.15.45:0/1772644951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c0b4ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6080097c0 tx=0x7ff60801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a6f6c6668ea8a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff61b7fe640 1 -- 172.21.15.45:0/1772644951 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080ab650 con 0x7ff61c0d2620 2023-07-09T02:18:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff61b7fe640 1 -- 172.21.15.45:0/1772644951 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6080ab7b0 con 0x7ff61c0d2620 2023-07-09T02:18:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff61b7fe640 1 -- 172.21.15.45:0/1772644951 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080abb40 con 0x7ff61c0d2620 2023-07-09T02:18:26.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 -- 172.21.15.45:0/1772644951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 msgr2=0x7ff61c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 --2- 172.21.15.45:0/1772644951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c0b4ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6080097c0 tx=0x7ff60801c450 comp rx=0 tx=0).stop 2023-07-09T02:18:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 -- 172.21.15.45:0/1772644951 shutdown_connections 2023-07-09T02:18:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 --2- 172.21.15.45:0/1772644951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c0b4ed0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 --2- 172.21.15.45:0/1772644951 >> v2:172.21.15.155:3300/0 conn(0x7ff61c0cd120 0x7ff61c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 -- 172.21.15.45:0/1772644951 >> 172.21.15.45:0/1772644951 conn(0x7ff61c0698e0 msgr2=0x7ff61c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 -- 172.21.15.45:0/1772644951 shutdown_connections 2023-07-09T02:18:26.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 -- 172.21.15.45:0/1772644951 wait complete. 2023-07-09T02:18:26.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 Processor -- start 2023-07-09T02:18:26.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.547+0000 7ff622f40640 1 -- start start 2023-07-09T02:18:26.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0cd120 0x7ff61c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff61c15c060 0x7ff61c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c159080 con 0x7ff61c15c060 2023-07-09T02:18:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c153db0 con 0x7ff61c0cd120 2023-07-09T02:18:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c1523e0 con 0x7ff61c0d2620 2023-07-09T02:18:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff61c15c060 0x7ff61c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff61c15c060 0x7ff61c15e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43180/0 (socket says 172.21.15.45:43180) 2023-07-09T02:18:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 -- 172.21.15.45:0/1678689402 learned_addr learned my addr 172.21.15.45:0/1678689402 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff620cdc640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0cd120 0x7ff61c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff61bfff640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 -- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 msgr2=0x7ff61c151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 -- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0cd120 msgr2=0x7ff61c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0cd120 0x7ff61c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 -- 172.21.15.45:0/1678689402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608009420 con 0x7ff61c15c060 2023-07-09T02:18:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6214dd640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff61c15c060 0x7ff61c15e4b0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7ff61400efc0 tx=0x7ff61400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6197fa640 1 -- 172.21.15.45:0/1678689402 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614014480 con 0x7ff61c15c060 2023-07-09T02:18:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6197fa640 1 -- 172.21.15.45:0/1678689402 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61400f040 con 0x7ff61c15c060 2023-07-09T02:18:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff6197fa640 1 -- 172.21.15.45:0/1678689402 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614014820 con 0x7ff61c15c060 2023-07-09T02:18:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c0b59f0 con 0x7ff61c15c060 2023-07-09T02:18:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c15e9f0 con 0x7ff61c15c060 2023-07-09T02:18:26.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.551+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c1591c0 con 0x7ff61c15c060 2023-07-09T02:18:26.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.555+0000 7ff6197fa640 1 -- 172.21.15.45:0/1678689402 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff614014980 con 0x7ff61c15c060 2023-07-09T02:18:26.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.555+0000 7ff6197fa640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff600066280 0x7ff600068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.555+0000 7ff6197fa640 1 -- 172.21.15.45:0/1678689402 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6140847d0 con 0x7ff61c15c060 2023-07-09T02:18:26.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.555+0000 7ff620cdc640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff600066280 0x7ff600068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.555+0000 7ff620cdc640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff600066280 0x7ff600068730 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff6100011f0 tx=0x7ff610007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.559+0000 7ff6197fa640 1 -- 172.21.15.45:0/1678689402 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff61c1591c0 con 0x7ff61c15c060 2023-07-09T02:18:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.715+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff61c1591c0 con 0x7ff61c15c060 2023-07-09T02:18:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.715+0000 7ff6197fa640 1 -- 172.21.15.45:0/1678689402 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff61c1591c0 con 0x7ff61c15c060 2023-07-09T02:18:26.719 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:18:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff600066280 msgr2=0x7ff600068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff600066280 0x7ff600068730 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff6100011f0 tx=0x7ff610007d40 comp rx=0 tx=0).stop 2023-07-09T02:18:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff61c15c060 msgr2=0x7ff61c15e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff61c15c060 0x7ff61c15e4b0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7ff61400efc0 tx=0x7ff61400c490 comp rx=0 tx=0).stop 2023-07-09T02:18:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 shutdown_connections 2023-07-09T02:18:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff61c15c060 0x7ff61c15e4b0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff600066280 0x7ff600068730 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0d2620 0x7ff61c151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 --2- 172.21.15.45:0/1678689402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0cd120 0x7ff61c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 >> 172.21.15.45:0/1678689402 conn(0x7ff61c0698e0 msgr2=0x7ff61c0b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 shutdown_connections 2023-07-09T02:18:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.719+0000 7ff622f40640 1 -- 172.21.15.45:0/1678689402 wait complete. 2023-07-09T02:18:26.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:18:26.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9759e640 1 Processor -- start 2023-07-09T02:18:26.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9759e640 1 -- start start 2023-07-09T02:18:26.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980d2400 0x7eff980b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff980ceff0 con 0x7eff98069f80 2023-07-09T02:18:26.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9759e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff980d1500 con 0x7eff980b1bc0 2023-07-09T02:18:26.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff980cea70 con 0x7eff980d2400 2023-07-09T02:18:26.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff95d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff98069f80 0x7eff980b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33412/0 (socket says 172.21.15.45:33412) 2023-07-09T02:18:26.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff95d9b640 1 -- 172.21.15.45:0/269470944 learned_addr learned my addr 172.21.15.45:0/269470944 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:26.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff96d9d640 1 --2- 172.21.15.45:0/269470944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980d2400 0x7eff980b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9559a640 1 -- 172.21.15.45:0/269470944 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117757449 0 0) 0x7eff980ceff0 con 0x7eff98069f80 2023-07-09T02:18:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9559a640 1 -- 172.21.15.45:0/269470944 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff80003530 con 0x7eff98069f80 2023-07-09T02:18:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9559a640 1 -- 172.21.15.45:0/269470944 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663509839 0 0) 0x7eff980d1500 con 0x7eff980b1bc0 2023-07-09T02:18:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff9559a640 1 -- 172.21.15.45:0/269470944 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff980ceff0 con 0x7eff980b1bc0 2023-07-09T02:18:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff96d9d640 1 -- 172.21.15.45:0/269470944 >> v1:172.21.15.155:6789/0 conn(0x7eff980b1bc0 legacy=0x7eff98069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff96d9d640 1 -- 172.21.15.45:0/269470944 >> v1:172.21.15.45:6789/0 conn(0x7eff98069f80 legacy=0x7eff980b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.887+0000 7eff96d9d640 1 -- 172.21.15.45:0/269470944 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980d0f40 con 0x7eff980d2400 2023-07-09T02:18:26.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff96d9d640 1 --2- 172.21.15.45:0/269470944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980d2400 0x7eff980b5fb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7eff90009dc0 tx=0x7eff980b6d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6888a51823fcb468 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9559a640 1 -- 172.21.15.45:0/269470944 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900a5920 con 0x7eff980d2400 2023-07-09T02:18:26.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9559a640 1 -- 172.21.15.45:0/269470944 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff900a5a80 con 0x7eff980d2400 2023-07-09T02:18:26.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9559a640 1 -- 172.21.15.45:0/269470944 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900a5e10 con 0x7eff980d2400 2023-07-09T02:18:26.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9759e640 1 -- 172.21.15.45:0/269470944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980d2400 msgr2=0x7eff980b5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9759e640 1 --2- 172.21.15.45:0/269470944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980d2400 0x7eff980b5fb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7eff90009dc0 tx=0x7eff980b6d00 comp rx=0 tx=0).stop 2023-07-09T02:18:26.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9759e640 1 -- 172.21.15.45:0/269470944 shutdown_connections 2023-07-09T02:18:26.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9759e640 1 --2- 172.21.15.45:0/269470944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980d2400 0x7eff980b5fb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9759e640 1 -- 172.21.15.45:0/269470944 >> 172.21.15.45:0/269470944 conn(0x7eff980d35b0 msgr2=0x7eff980cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:26.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9759e640 1 -- 172.21.15.45:0/269470944 shutdown_connections 2023-07-09T02:18:26.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.891+0000 7eff9759e640 1 -- 172.21.15.45:0/269470944 wait complete. 2023-07-09T02:18:26.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 Processor -- start 2023-07-09T02:18:26.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 -- start start 2023-07-09T02:18:26.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff98069f80 0x7eff9815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980b1bc0 0x7eff980c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff980d2400 0x7eff980c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff980cb3c0 con 0x7eff980d2400 2023-07-09T02:18:26.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff98155070 con 0x7eff98069f80 2023-07-09T02:18:26.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff980ca500 con 0x7eff980b1bc0 2023-07-09T02:18:26.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff980d2400 0x7eff980c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff980d2400 0x7eff980c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43190/0 (socket says 172.21.15.45:43190) 2023-07-09T02:18:26.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 -- 172.21.15.45:0/1375357127 learned_addr learned my addr 172.21.15.45:0/1375357127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:26.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff95d9b640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980b1bc0 0x7eff980c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9659c640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff98069f80 0x7eff9815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 -- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980b1bc0 msgr2=0x7eff980c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980b1bc0 0x7eff980c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 -- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff98069f80 msgr2=0x7eff9815d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:26.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff98069f80 0x7eff9815d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:26.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 -- 172.21.15.45:0/1375357127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90009a70 con 0x7eff980d2400 2023-07-09T02:18:26.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9659c640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff98069f80 0x7eff9815d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:26.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff96d9d640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff980d2400 0x7eff980c9ed0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7eff900b0040 tx=0x7eff90019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff86ffd640 1 -- 172.21.15.45:0/1375357127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900adc40 con 0x7eff980d2400 2023-07-09T02:18:26.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff86ffd640 1 -- 172.21.15.45:0/1375357127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff900adda0 con 0x7eff980d2400 2023-07-09T02:18:26.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff86ffd640 1 -- 172.21.15.45:0/1375357127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900b6620 con 0x7eff980d2400 2023-07-09T02:18:26.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff980ca7e0 con 0x7eff980d2400 2023-07-09T02:18:26.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.895+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff980cb050 con 0x7eff980d2400 2023-07-09T02:18:26.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.899+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff980cb530 con 0x7eff980d2400 2023-07-09T02:18:26.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.899+0000 7eff86ffd640 1 -- 172.21.15.45:0/1375357127 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff900b4040 con 0x7eff980d2400 2023-07-09T02:18:26.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.899+0000 7eff86ffd640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff78066280 0x7eff78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:26.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.899+0000 7eff86ffd640 1 -- 172.21.15.45:0/1375357127 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff9011ebc0 con 0x7eff980d2400 2023-07-09T02:18:26.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.899+0000 7eff9659c640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff78066280 0x7eff78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:26.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.903+0000 7eff9659c640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff78066280 0x7eff78068730 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7eff880011f0 tx=0x7eff88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:26.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:26.903+0000 7eff86ffd640 1 -- 172.21.15.45:0/1375357127 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff900ec0c0 con 0x7eff980d2400 2023-07-09T02:18:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.059+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff9804e020 con 0x7eff980d2400 2023-07-09T02:18:27.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.059+0000 7eff86ffd640 1 -- 172.21.15.45:0/1375357127 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v141) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff90009450 con 0x7eff980d2400 2023-07-09T02:18:27.062 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:18:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff78066280 msgr2=0x7eff78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff78066280 0x7eff78068730 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7eff880011f0 tx=0x7eff88009040 comp rx=0 tx=0).stop 2023-07-09T02:18:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff980d2400 msgr2=0x7eff980c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff980d2400 0x7eff980c9ed0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7eff900b0040 tx=0x7eff90019710 comp rx=0 tx=0).stop 2023-07-09T02:18:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 shutdown_connections 2023-07-09T02:18:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff980d2400 0x7eff980c9ed0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7eff78066280 0x7eff78068730 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff980b1bc0 0x7eff980c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 --2- 172.21.15.45:0/1375357127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff98069f80 0x7eff9815d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 >> 172.21.15.45:0/1375357127 conn(0x7eff980d35b0 msgr2=0x7eff980b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 shutdown_connections 2023-07-09T02:18:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.063+0000 7eff9759e640 1 -- 172.21.15.45:0/1375357127 wait complete. 2023-07-09T02:18:27.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:18:27.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0d09e640 1 Processor -- start 2023-07-09T02:18:27.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0d09e640 1 -- start start 2023-07-09T02:18:27.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0d09e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5e080d2620 0x7f5e080b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0d09e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e080cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0d09e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e08160a50 con 0x7f5e0815c060 2023-07-09T02:18:27.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0d09e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0815c430 con 0x7f5e080d2620 2023-07-09T02:18:27.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0d09e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0815fb60 con 0x7f5e080cd120 2023-07-09T02:18:27.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e080cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e080cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:59498/0 (socket says 172.21.15.45:59498) 2023-07-09T02:18:27.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0759e640 1 -- 172.21.15.45:0/2478028110 learned_addr learned my addr 172.21.15.45:0/2478028110 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:27.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5dfffff640 1 --2- 172.21.15.45:0/2478028110 >> v2:172.21.15.155:3300/0 conn(0x7f5e080d2620 0x7f5e080b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0759e640 1 -- 172.21.15.45:0/2478028110 >> v2:172.21.15.155:3300/0 conn(0x7f5e080d2620 msgr2=0x7f5e080b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:27.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0759e640 1 --2- 172.21.15.45:0/2478028110 >> v2:172.21.15.155:3300/0 conn(0x7f5e080d2620 0x7f5e080b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0759e640 1 -- 172.21.15.45:0/2478028110 >> v1:172.21.15.155:6789/0 conn(0x7f5e0815c060 legacy=0x7f5e080d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5e0759e640 1 -- 172.21.15.45:0/2478028110 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0815fe40 con 0x7f5e080cd120 2023-07-09T02:18:27.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.227+0000 7f5dfffff640 1 --2- 172.21.15.45:0/2478028110 >> v2:172.21.15.155:3300/0 conn(0x7f5e080d2620 0x7f5e080b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:27.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0759e640 1 --2- 172.21.15.45:0/2478028110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e080cee30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009e50 tx=0x7f5e0001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d48f2a43b4066e2e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:27.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0659c640 1 -- 172.21.15.45:0/2478028110 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000a58a0 con 0x7f5e080cd120 2023-07-09T02:18:27.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0659c640 1 -- 172.21.15.45:0/2478028110 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e000a5a00 con 0x7f5e080cd120 2023-07-09T02:18:27.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0659c640 1 -- 172.21.15.45:0/2478028110 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000a5d90 con 0x7f5e080cd120 2023-07-09T02:18:27.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0d09e640 1 -- 172.21.15.45:0/2478028110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 msgr2=0x7f5e080cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/2478028110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e080cee30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009e50 tx=0x7f5e0001c9e0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0d09e640 1 -- 172.21.15.45:0/2478028110 shutdown_connections 2023-07-09T02:18:27.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/2478028110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e080cee30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/2478028110 >> v2:172.21.15.155:3300/0 conn(0x7f5e080d2620 0x7f5e080b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0d09e640 1 -- 172.21.15.45:0/2478028110 >> 172.21.15.45:0/2478028110 conn(0x7f5e080698e0 msgr2=0x7f5e08069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0d09e640 1 -- 172.21.15.45:0/2478028110 shutdown_connections 2023-07-09T02:18:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.231+0000 7f5e0d09e640 1 -- 172.21.15.45:0/2478028110 wait complete. 2023-07-09T02:18:27.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 Processor -- start 2023-07-09T02:18:27.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 -- start start 2023-07-09T02:18:27.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e081530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e080d2620 0x7f5e0815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0815c060 0x7f5e0815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08153bb0 con 0x7f5e0815c060 2023-07-09T02:18:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08153610 con 0x7f5e080d2620 2023-07-09T02:18:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080c9c40 con 0x7f5e080cd120 2023-07-09T02:18:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0815c060 0x7f5e0815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0815c060 0x7f5e0815a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43198/0 (socket says 172.21.15.45:43198) 2023-07-09T02:18:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 -- 172.21.15.45:0/329081896 learned_addr learned my addr 172.21.15.45:0/329081896 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:27.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5dfffff640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e080d2620 0x7f5e0815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e06d9d640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e081530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 -- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 msgr2=0x7f5e081530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e081530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 -- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e080d2620 msgr2=0x7f5e0815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e080d2620 0x7f5e0815c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 -- 172.21.15.45:0/329081896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009420 con 0x7f5e0815c060 2023-07-09T02:18:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0759e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0815c060 0x7f5e0815a350 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5e0001a610 tx=0x7f5e00019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5dff7fe640 1 -- 172.21.15.45:0/329081896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000b8670 con 0x7f5e0815c060 2023-07-09T02:18:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5dff7fe640 1 -- 172.21.15.45:0/329081896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e000b87d0 con 0x7f5e0815c060 2023-07-09T02:18:27.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5dff7fe640 1 -- 172.21.15.45:0/329081896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000b8b60 con 0x7f5e0815c060 2023-07-09T02:18:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e00009b30 con 0x7f5e0815c060 2023-07-09T02:18:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e080b59f0 con 0x7f5e0815c060 2023-07-09T02:18:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.235+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0804d7d0 con 0x7f5e0815c060 2023-07-09T02:18:27.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.239+0000 7f5dff7fe640 1 -- 172.21.15.45:0/329081896 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e000b8cc0 con 0x7f5e0815c060 2023-07-09T02:18:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.239+0000 7f5dff7fe640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5de80662b0 0x7f5de8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.239+0000 7f5dff7fe640 1 -- 172.21.15.45:0/329081896 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e0011f320 con 0x7f5e0815c060 2023-07-09T02:18:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.239+0000 7f5e06d9d640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5de80662b0 0x7f5de8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.239+0000 7f5e06d9d640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5de80662b0 0x7f5de8068760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5e080c9820 tx=0x7f5df8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:27.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.243+0000 7f5dff7fe640 1 -- 172.21.15.45:0/329081896 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e000eca10 con 0x7f5e0815c060 2023-07-09T02:18:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.407+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5e0806baa0 con 0x7f5e0815c060 2023-07-09T02:18:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.407+0000 7f5dff7fe640 1 -- 172.21.15.45:0/329081896 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5e000f0030 con 0x7f5e0815c060 2023-07-09T02:18:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:18:27.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5de80662b0 msgr2=0x7f5de8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5de80662b0 0x7f5de8068760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5e080c9820 tx=0x7f5df8009040 comp rx=0 tx=0).stop 2023-07-09T02:18:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0815c060 msgr2=0x7f5e0815a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0815c060 0x7f5e0815a350 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5e0001a610 tx=0x7f5e00019780 comp rx=0 tx=0).stop 2023-07-09T02:18:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 shutdown_connections 2023-07-09T02:18:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0815c060 0x7f5e0815a350 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e080d2620 0x7f5e0815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5de80662b0 0x7f5de8068760 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 --2- 172.21.15.45:0/329081896 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5e080cd120 0x7f5e081530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 >> 172.21.15.45:0/329081896 conn(0x7f5e080698e0 msgr2=0x7f5e080b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 shutdown_connections 2023-07-09T02:18:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.411+0000 7f5e0d09e640 1 -- 172.21.15.45:0/329081896 wait complete. 2023-07-09T02:18:27.431 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:18:27.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:27.432 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:18:27.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:18:27.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:27.488 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:18:27.498 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:18:27.498 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:27.507 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:18:27.507 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:18:27.508 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:27.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:18:27.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.691+0000 7f1c0a256640 1 Processor -- start 2023-07-09T02:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.691+0000 7f1c0a256640 1 -- start start 2023-07-09T02:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.691+0000 7f1c0a256640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c040cd120 0x7f1c040b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.691+0000 7f1c0a256640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c04160a50 con 0x7f1c0415c060 2023-07-09T02:18:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.691+0000 7f1c0a256640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0415c430 con 0x7f1c040d2620 2023-07-09T02:18:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.691+0000 7f1c0a256640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415fb60 con 0x7f1c040cd120 2023-07-09T02:18:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c037fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1c0415c060 0x7f1c040d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33424/0 (socket says 172.21.15.45:33424) 2023-07-09T02:18:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c037fe640 1 -- 172.21.15.45:0/3628357908 learned_addr learned my addr 172.21.15.45:0/3628357908 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:27.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c03fff640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c040cd120 0x7f1c040b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189538730 0 0) 0x7f1c04160a50 con 0x7f1c0415c060 2023-07-09T02:18:27.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bec003530 con 0x7f1c0415c060 2023-07-09T02:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955886061 0 0) 0x7f1c0415c430 con 0x7f1c040d2620 2023-07-09T02:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c04160a50 con 0x7f1c040d2620 2023-07-09T02:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982295948 0 0) 0x7f1bec003530 con 0x7f1c0415c060 2023-07-09T02:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c040cd120 msgr2=0x7f1c040b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c040cd120 0x7f1c040b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 >> v1:172.21.15.155:6789/0 conn(0x7f1c040d2620 legacy=0x7f1c040cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0415fe40 con 0x7f1c0415c060 2023-07-09T02:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f1bf4001680 con 0x7f1c0415c060 2023-07-09T02:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 >> v1:172.21.15.45:6789/0 conn(0x7f1c0415c060 legacy=0x7f1c040d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c040cd120 0x7f1bec003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bec0040f0 0x7f1bec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bec004d10 0x7f1bec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415fb60 con 0x7f1bec0040f0 2023-07-09T02:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec00baa0 con 0x7f1bec004d10 2023-07-09T02:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec00bc60 con 0x7f1c040cd120 2023-07-09T02:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c02ffd640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bec0040f0 0x7f1bec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c03fff640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bec004d10 0x7f1bec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c037fe640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c040cd120 0x7f1bec003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c02ffd640 1 -- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c040cd120 msgr2=0x7f1bec003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c02ffd640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c040cd120 0x7f1bec003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c02ffd640 1 -- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bec004d10 msgr2=0x7f1bec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c02ffd640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bec004d10 0x7f1bec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.695+0000 7f1c02ffd640 1 -- 172.21.15.45:0/3628357908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec003530 con 0x7f1bec0040f0 2023-07-09T02:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c02ffd640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bec0040f0 0x7f1bec0047d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f1c040d2a10 tx=0x7f1bf801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750e1f088ff81245 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80052d0 con 0x7f1bec0040f0 2023-07-09T02:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf8005450 con 0x7f1bec0040f0 2023-07-09T02:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c027fc640 1 -- 172.21.15.45:0/3628357908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80a8910 con 0x7f1bec0040f0 2023-07-09T02:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c0a256640 1 -- 172.21.15.45:0/3628357908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bec0040f0 msgr2=0x7f1bec0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c0a256640 1 --2- 172.21.15.45:0/3628357908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bec0040f0 0x7f1bec0047d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f1c040d2a10 tx=0x7f1bf801ecb0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c03fff640 1 -- 172.21.15.45:0/3628357908 reap_dead start 2023-07-09T02:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c0a256640 1 -- 172.21.15.45:0/3628357908 shutdown_connections 2023-07-09T02:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c0a256640 1 -- 172.21.15.45:0/3628357908 >> 172.21.15.45:0/3628357908 conn(0x7f1c040698e0 msgr2=0x7f1c04069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c0a256640 1 -- 172.21.15.45:0/3628357908 shutdown_connections 2023-07-09T02:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c0a256640 1 -- 172.21.15.45:0/3628357908 wait complete. 2023-07-09T02:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c0a256640 1 Processor -- start 2023-07-09T02:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.699+0000 7f1c0a256640 1 -- start start 2023-07-09T02:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1bec0040f0 0x7f1c041f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c040b7090 0x7f1c0415e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c040cc760 0x7f1c040c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040cc2d0 con 0x7f1c040cc760 2023-07-09T02:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c041f5860 con 0x7f1c040b7090 2023-07-09T02:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040b7600 con 0x7f1bec0040f0 2023-07-09T02:18:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c040cc760 0x7f1c040c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c040cc760 0x7f1c040c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43214/0 (socket says 172.21.15.45:43214) 2023-07-09T02:18:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 -- 172.21.15.45:0/1292841180 learned_addr learned my addr 172.21.15.45:0/1292841180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c037fe640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1bec0040f0 0x7f1c041f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c02ffd640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c040b7090 0x7f1c0415e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 -- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1bec0040f0 msgr2=0x7f1c041f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1bec0040f0 0x7f1c041f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 -- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c040b7090 msgr2=0x7f1c0415e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c040b7090 0x7f1c0415e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 -- 172.21.15.45:0/1292841180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040b78e0 con 0x7f1c040cc760 2023-07-09T02:18:27.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c03fff640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c040cc760 0x7f1c040c9e50 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f1c0406ba70 tx=0x7f1bfc011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:27.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1bebfff640 1 -- 172.21.15.45:0/1292841180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00e040 con 0x7f1c040cc760 2023-07-09T02:18:27.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1bebfff640 1 -- 172.21.15.45:0/1292841180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00f040 con 0x7f1c040cc760 2023-07-09T02:18:27.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1bebfff640 1 -- 172.21.15.45:0/1292841180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc015a80 con 0x7f1c040cc760 2023-07-09T02:18:27.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c040b7bc0 con 0x7f1c040cc760 2023-07-09T02:18:27.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c040cbe80 con 0x7f1c040cc760 2023-07-09T02:18:27.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0404d7d0 con 0x7f1c040cc760 2023-07-09T02:18:27.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.703+0000 7f1bebfff640 1 -- 172.21.15.45:0/1292841180 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1bfc015be0 con 0x7f1c040cc760 2023-07-09T02:18:27.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.707+0000 7f1bebfff640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1bf0066280 0x7f1bf0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:27.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.707+0000 7f1bebfff640 1 -- 172.21.15.45:0/1292841180 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bfc083b80 con 0x7f1c040cc760 2023-07-09T02:18:27.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.707+0000 7f1c037fe640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1bf0066280 0x7f1bf0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:27.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.707+0000 7f1c037fe640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1bf0066280 0x7f1bf0068730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4001ec0 tx=0x7f1bf4007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:27.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.711+0000 7f1bebfff640 1 -- 172.21.15.45:0/1292841180 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bfc054b40 con 0x7f1c040cc760 2023-07-09T02:18:27.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.895+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c040cc0a0 con 0x7f1c040cc760 2023-07-09T02:18:27.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.895+0000 7f1bebfff640 1 -- 172.21.15.45:0/1292841180 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f1bfc0546d0 con 0x7f1c040cc760 2023-07-09T02:18:27.898 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:27.898 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:18:27.899 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:18:27.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1bf0066280 msgr2=0x7f1bf0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1bf0066280 0x7f1bf0068730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4001ec0 tx=0x7f1bf4007040 comp rx=0 tx=0).stop 2023-07-09T02:18:27.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c040cc760 msgr2=0x7f1c040c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:27.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c040cc760 0x7f1c040c9e50 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f1c0406ba70 tx=0x7f1bfc011cb0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 shutdown_connections 2023-07-09T02:18:27.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c040cc760 0x7f1c040c9e50 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c040b7090 0x7f1c0415e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1bf0066280 0x7f1bf0068730 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 --2- 172.21.15.45:0/1292841180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1bec0040f0 0x7f1c041f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:27.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 >> 172.21.15.45:0/1292841180 conn(0x7f1c040698e0 msgr2=0x7f1c04159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:27.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 shutdown_connections 2023-07-09T02:18:27.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:27.899+0000 7f1c0a256640 1 -- 172.21.15.45:0/1292841180 wait complete. 2023-07-09T02:18:27.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.059+0000 7f7525ecb640 1 Processor -- start 2023-07-09T02:18:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.059+0000 7f7525ecb640 1 -- start start 2023-07-09T02:18:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f7525ecb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75200d2620 0x7f75200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f7525ecb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75200cd120 0x7f75200cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f7525ecb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7520160a50 con 0x7f752015c060 2023-07-09T02:18:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f7525ecb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752015c430 con 0x7f75200d2620 2023-07-09T02:18:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f7525ecb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752015fb60 con 0x7f75200cd120 2023-07-09T02:18:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75200d2620 0x7f75200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75200d2620 0x7f75200b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43220/0 (socket says 172.21.15.45:43220) 2023-07-09T02:18:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751effd640 1 -- 172.21.15.45:0/2596958533 learned_addr learned my addr 172.21.15.45:0/2596958533 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751ffff640 1 --2- 172.21.15.45:0/2596958533 >> v2:172.21.15.155:3300/0 conn(0x7f75200cd120 0x7f75200cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751effd640 1 -- 172.21.15.45:0/2596958533 >> v2:172.21.15.155:3300/0 conn(0x7f75200cd120 msgr2=0x7f75200cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751effd640 1 --2- 172.21.15.45:0/2596958533 >> v2:172.21.15.155:3300/0 conn(0x7f75200cd120 0x7f75200cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751effd640 1 -- 172.21.15.45:0/2596958533 >> v1:172.21.15.155:6789/0 conn(0x7f752015c060 legacy=0x7f75200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751effd640 1 -- 172.21.15.45:0/2596958533 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752015fe40 con 0x7f75200d2620 2023-07-09T02:18:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.063+0000 7f751effd640 1 --2- 172.21.15.45:0/2596958533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200d2620 0x7f75200b4ed0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f752006b120 tx=0x7f751401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6155c99b08f843e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f751e7fc640 1 -- 172.21.15.45:0/2596958533 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140aa430 con 0x7f75200d2620 2023-07-09T02:18:28.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f751e7fc640 1 -- 172.21.15.45:0/2596958533 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75140aa590 con 0x7f75200d2620 2023-07-09T02:18:28.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f751e7fc640 1 -- 172.21.15.45:0/2596958533 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140aa920 con 0x7f75200d2620 2023-07-09T02:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- 172.21.15.45:0/2596958533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200d2620 msgr2=0x7f75200b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 --2- 172.21.15.45:0/2596958533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200d2620 0x7f75200b4ed0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f752006b120 tx=0x7f751401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- 172.21.15.45:0/2596958533 shutdown_connections 2023-07-09T02:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 --2- 172.21.15.45:0/2596958533 >> v2:172.21.15.155:3300/0 conn(0x7f75200cd120 0x7f75200cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 --2- 172.21.15.45:0/2596958533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200d2620 0x7f75200b4ed0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- 172.21.15.45:0/2596958533 >> 172.21.15.45:0/2596958533 conn(0x7f75200698e0 msgr2=0x7f7520069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:28.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- 172.21.15.45:0/2596958533 shutdown_connections 2023-07-09T02:18:28.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- 172.21.15.45:0/2596958533 wait complete. 2023-07-09T02:18:28.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 Processor -- start 2023-07-09T02:18:28.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- start start 2023-07-09T02:18:28.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200cd120 0x7f752015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75200d2620 0x7f7520143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f752015c060 0x7f752015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752015a1f0 con 0x7f75200cd120 2023-07-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752015e070 con 0x7f75200d2620 2023-07-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f7525ecb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752015dd90 con 0x7f752015c060 2023-07-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.067+0000 7f751f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200cd120 0x7f752015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200cd120 0x7f752015ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43226/0 (socket says 172.21.15.45:43226) 2023-07-09T02:18:28.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751f7fe640 1 -- 172.21.15.45:0/1118782929 learned_addr learned my addr 172.21.15.45:0/1118782929 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:28.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751effd640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75200d2620 0x7f7520143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751ffff640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f752015c060 0x7f752015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751f7fe640 1 -- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f752015c060 msgr2=0x7f752015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751f7fe640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f752015c060 0x7f752015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751f7fe640 1 -- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75200d2620 msgr2=0x7f7520143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751f7fe640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75200d2620 0x7f7520143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751f7fe640 1 -- 172.21.15.45:0/1118782929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75140094d0 con 0x7f75200cd120 2023-07-09T02:18:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751effd640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75200d2620 0x7f7520143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:28.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751ffff640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f752015c060 0x7f752015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:28.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f751f7fe640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200cd120 0x7f752015ac90 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f751000c3c0 tx=0x7f751000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f7507fff640 1 -- 172.21.15.45:0/1118782929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75100052d0 con 0x7f75200cd120 2023-07-09T02:18:28.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f7507fff640 1 -- 172.21.15.45:0/1118782929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7510005430 con 0x7f75200cd120 2023-07-09T02:18:28.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f7507fff640 1 -- 172.21.15.45:0/1118782929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510003840 con 0x7f75200cd120 2023-07-09T02:18:28.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75200b59f0 con 0x7f75200cd120 2023-07-09T02:18:28.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752015a770 con 0x7f75200cd120 2023-07-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752015a9b0 con 0x7f75200cd120 2023-07-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.071+0000 7f7507fff640 1 -- 172.21.15.45:0/1118782929 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75100039a0 con 0x7f75200cd120 2023-07-09T02:18:28.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.075+0000 7f7507fff640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f750c066280 0x7f750c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.075+0000 7f7507fff640 1 -- 172.21.15.45:0/1118782929 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75100832f0 con 0x7f75200cd120 2023-07-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.075+0000 7f751effd640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f750c066280 0x7f750c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.075+0000 7f751effd640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f750c066280 0x7f750c068730 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f75140ae000 tx=0x7f7514008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.075+0000 7f7507fff640 1 -- 172.21.15.45:0/1118782929 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f752015a9b0 con 0x7f75200cd120 2023-07-09T02:18:28.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.235+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f752004d7d0 con 0x7f75200cd120 2023-07-09T02:18:28.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7507fff640 1 -- 172.21.15.45:0/1118782929 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f75100506e0 con 0x7f75200cd120 2023-07-09T02:18:28.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:28.240 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":141,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:19.382142+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:44.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:45.234988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f750c066280 msgr2=0x7f750c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f750c066280 0x7f750c068730 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f75140ae000 tx=0x7f7514008040 comp rx=0 tx=0).stop 2023-07-09T02:18:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200cd120 msgr2=0x7f752015ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200cd120 0x7f752015ac90 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f751000c3c0 tx=0x7f751000c880 comp rx=0 tx=0).stop 2023-07-09T02:18:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 shutdown_connections 2023-07-09T02:18:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f750c066280 0x7f750c068730 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f752015c060 0x7f752015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75200d2620 0x7f7520143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 --2- 172.21.15.45:0/1118782929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75200cd120 0x7f752015ac90 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 >> 172.21.15.45:0/1118782929 conn(0x7f75200698e0 msgr2=0x7f752015b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 shutdown_connections 2023-07-09T02:18:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.239+0000 7f7525ecb640 1 -- 172.21.15.45:0/1118782929 wait complete. 2023-07-09T02:18:28.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:17:44.368934+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:17:45.234988+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:18:28.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:18:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b897ac640 1 Processor -- start 2023-07-09T02:18:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b897ac640 1 -- start start 2023-07-09T02:18:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b897ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6b840d2620 0x7f6b840b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b897ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b840cd120 0x7f6b840cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b897ac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b84160a50 con 0x7f6b8415c060 2023-07-09T02:18:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b897ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8415c430 con 0x7f6b840cd120 2023-07-09T02:18:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b897ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8415fb60 con 0x7f6b840d2620 2023-07-09T02:18:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b837fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b840cd120 0x7f6b840cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b837fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b840cd120 0x7f6b840cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43236/0 (socket says 172.21.15.45:43236) 2023-07-09T02:18:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b837fe640 1 -- 172.21.15.45:0/1036972340 learned_addr learned my addr 172.21.15.45:0/1036972340 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b7bfff640 1 --2- 172.21.15.45:0/1036972340 >> v2:172.21.15.155:3300/0 conn(0x7f6b840d2620 0x7f6b840b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b837fe640 1 -- 172.21.15.45:0/1036972340 >> v2:172.21.15.155:3300/0 conn(0x7f6b840d2620 msgr2=0x7f6b840b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b837fe640 1 --2- 172.21.15.45:0/1036972340 >> v2:172.21.15.155:3300/0 conn(0x7f6b840d2620 0x7f6b840b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b837fe640 1 -- 172.21.15.45:0/1036972340 >> v1:172.21.15.155:6789/0 conn(0x7f6b8415c060 legacy=0x7f6b840d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.407+0000 7f6b837fe640 1 -- 172.21.15.45:0/1036972340 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8415fe40 con 0x7f6b840cd120 2023-07-09T02:18:28.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b837fe640 1 --2- 172.21.15.45:0/1036972340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840cee30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f6b8415fac0 tx=0x7f6b7c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8ce58a6631ef13 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b827fc640 1 -- 172.21.15.45:0/1036972340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0a5860 con 0x7f6b840cd120 2023-07-09T02:18:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b827fc640 1 -- 172.21.15.45:0/1036972340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c0a59c0 con 0x7f6b840cd120 2023-07-09T02:18:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b827fc640 1 -- 172.21.15.45:0/1036972340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0a5d50 con 0x7f6b840cd120 2023-07-09T02:18:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b897ac640 1 -- 172.21.15.45:0/1036972340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 msgr2=0x7f6b840cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1036972340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840cee30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f6b8415fac0 tx=0x7f6b7c01c9a0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b897ac640 1 -- 172.21.15.45:0/1036972340 shutdown_connections 2023-07-09T02:18:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1036972340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840cee30 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1036972340 >> v2:172.21.15.155:3300/0 conn(0x7f6b840d2620 0x7f6b840b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b897ac640 1 -- 172.21.15.45:0/1036972340 >> 172.21.15.45:0/1036972340 conn(0x7f6b840698e0 msgr2=0x7f6b84069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b897ac640 1 -- 172.21.15.45:0/1036972340 shutdown_connections 2023-07-09T02:18:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.411+0000 7f6b897ac640 1 -- 172.21.15.45:0/1036972340 wait complete. 2023-07-09T02:18:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 Processor -- start 2023-07-09T02:18:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 -- start start 2023-07-09T02:18:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b840d2620 0x7f6b84151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b8415c060 0x7f6b840b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841526f0 con 0x7f6b840cd120 2023-07-09T02:18:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b84152900 con 0x7f6b840d2620 2023-07-09T02:18:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b84152be0 con 0x7f6b8415c060 2023-07-09T02:18:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43238/0 (socket says 172.21.15.45:43238) 2023-07-09T02:18:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 -- 172.21.15.45:0/1062066028 learned_addr learned my addr 172.21.15.45:0/1062066028 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b7bfff640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b840d2620 0x7f6b84151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b837fe640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b8415c060 0x7f6b840b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 -- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b8415c060 msgr2=0x7f6b840b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b8415c060 0x7f6b840b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 -- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b840d2620 msgr2=0x7f6b84151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b840d2620 0x7f6b84151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 -- 172.21.15.45:0/1062066028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c009b30 con 0x7f6b840cd120 2023-07-09T02:18:28.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b7bfff640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b840d2620 0x7f6b84151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:28.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b82ffd640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840ccae0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400c3c0 tx=0x7f6b7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b7b7fe640 1 -- 172.21.15.45:0/1062066028 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740052d0 con 0x7f6b840cd120 2023-07-09T02:18:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b7b7fe640 1 -- 172.21.15.45:0/1062066028 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b74005430 con 0x7f6b840cd120 2023-07-09T02:18:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b7b7fe640 1 -- 172.21.15.45:0/1062066028 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74003840 con 0x7f6b840cd120 2023-07-09T02:18:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b840b59f0 con 0x7f6b840cd120 2023-07-09T02:18:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b841531a0 con 0x7f6b840cd120 2023-07-09T02:18:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.415+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8404d7d0 con 0x7f6b840cd120 2023-07-09T02:18:28.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.419+0000 7f6b7b7fe640 1 -- 172.21.15.45:0/1062066028 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b740039a0 con 0x7f6b840cd120 2023-07-09T02:18:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.419+0000 7f6b7b7fe640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b64066280 0x7f6b64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.419+0000 7f6b7b7fe640 1 -- 172.21.15.45:0/1062066028 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b74083270 con 0x7f6b840cd120 2023-07-09T02:18:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.419+0000 7f6b7bfff640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b64066280 0x7f6b64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.419+0000 7f6b7bfff640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b64066280 0x7f6b64068730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6b840b4810 tx=0x7f6b6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.423+0000 7f6b7b7fe640 1 -- 172.21.15.45:0/1062066028 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b740506e0 con 0x7f6b840cd120 2023-07-09T02:18:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.575+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b840b18d0 con 0x7f6b840cd120 2023-07-09T02:18:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b7b7fe640 1 -- 172.21.15.45:0/1062066028 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b74053d00 con 0x7f6b840cd120 2023-07-09T02:18:28.580 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:18:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b64066280 msgr2=0x7f6b64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b64066280 0x7f6b64068730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6b840b4810 tx=0x7f6b6c008040 comp rx=0 tx=0).stop 2023-07-09T02:18:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 msgr2=0x7f6b840ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840ccae0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400c3c0 tx=0x7f6b7400c880 comp rx=0 tx=0).stop 2023-07-09T02:18:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 shutdown_connections 2023-07-09T02:18:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6b64066280 0x7f6b64068730 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b8415c060 0x7f6b840b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b840d2620 0x7f6b84151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 --2- 172.21.15.45:0/1062066028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b840cd120 0x7f6b840ccae0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 >> 172.21.15.45:0/1062066028 conn(0x7f6b840698e0 msgr2=0x7f6b84154710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 shutdown_connections 2023-07-09T02:18:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.579+0000 7f6b897ac640 1 -- 172.21.15.45:0/1062066028 wait complete. 2023-07-09T02:18:28.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:18:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.743+0000 7f131e25c640 1 Processor -- start 2023-07-09T02:18:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.743+0000 7f131e25c640 1 -- start start 2023-07-09T02:18:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f131e25c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13180d2620 0x7f13180b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f131e25c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1318160a50 con 0x7f13180cd120 2023-07-09T02:18:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f131e25c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131815c430 con 0x7f131815c060 2023-07-09T02:18:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f131e25c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131815fb60 con 0x7f13180d2620 2023-07-09T02:18:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f1317fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f13180cd120 0x7f13180cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33430/0 (socket says 172.21.15.45:33430) 2023-07-09T02:18:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f1317fff640 1 -- 172.21.15.45:0/3219851372 learned_addr learned my addr 172.21.15.45:0/3219851372 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f1316ffd640 1 --2- 172.21.15.45:0/3219851372 >> v2:172.21.15.155:3300/0 conn(0x7f13180d2620 0x7f13180b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177580617 0 0) 0x7f1318160a50 con 0x7f13180cd120 2023-07-09T02:18:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1300003530 con 0x7f13180cd120 2023-07-09T02:18:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3432664995 0 0) 0x7f1300003530 con 0x7f13180cd120 2023-07-09T02:18:28.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 >> v2:172.21.15.155:3300/0 conn(0x7f13180d2620 msgr2=0x7f13180b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 --2- 172.21.15.45:0/3219851372 >> v2:172.21.15.155:3300/0 conn(0x7f13180d2620 0x7f13180b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 >> v1:172.21.15.155:6789/0 conn(0x7f131815c060 legacy=0x7f13180d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131815fe40 con 0x7f13180cd120 2023-07-09T02:18:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f1310001a00 con 0x7f13180cd120 2023-07-09T02:18:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 >> v1:172.21.15.45:6789/0 conn(0x7f13180cd120 legacy=0x7f13180cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1300003980 0x7f1300003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13000047d0 0x7f1300004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300005180 0x7f130000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131815fb60 con 0x7f1300003980 2023-07-09T02:18:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130000c000 con 0x7f13000047d0 2023-07-09T02:18:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130000c1c0 con 0x7f1300005180 2023-07-09T02:18:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13177fe640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1300003980 0x7f1300003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f1316ffd640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13000047d0 0x7f1300004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f1317fff640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300005180 0x7f130000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13177fe640 1 -- 172.21.15.45:0/3219851372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300005180 msgr2=0x7f130000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13177fe640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300005180 0x7f130000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13177fe640 1 -- 172.21.15.45:0/3219851372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13000047d0 msgr2=0x7f1300004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13177fe640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13000047d0 0x7f1300004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f13177fe640 1 -- 172.21.15.45:0/3219851372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300003530 con 0x7f1300003980 2023-07-09T02:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.747+0000 7f1317fff640 1 -- 172.21.15.45:0/3219851372 reap_dead start 2023-07-09T02:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f13177fe640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1300003980 0x7f1300003d90 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f1308001780 tx=0x7f130801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2c74430259af0f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080052d0 con 0x7f1300003980 2023-07-09T02:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080a7050 con 0x7f1300003980 2023-07-09T02:18:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f13167fc640 1 -- 172.21.15.45:0/3219851372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308003600 con 0x7f1300003980 2023-07-09T02:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f131e25c640 1 -- 172.21.15.45:0/3219851372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1300003980 msgr2=0x7f1300003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f131e25c640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1300003980 0x7f1300003d90 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f1308001780 tx=0x7f130801c3d0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f131e25c640 1 -- 172.21.15.45:0/3219851372 shutdown_connections 2023-07-09T02:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f131e25c640 1 --2- 172.21.15.45:0/3219851372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1300003980 0x7f1300003d90 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f131e25c640 1 -- 172.21.15.45:0/3219851372 >> 172.21.15.45:0/3219851372 conn(0x7f13180698e0 msgr2=0x7f1318069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f131e25c640 1 -- 172.21.15.45:0/3219851372 shutdown_connections 2023-07-09T02:18:28.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.751+0000 7f131e25c640 1 -- 172.21.15.45:0/3219851372 wait complete. 2023-07-09T02:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 Processor -- start 2023-07-09T02:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 -- start start 2023-07-09T02:18:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300003980 0x7f13180c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13181583d0 0x7f13180cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13180cc2e0 0x7f13181557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180c98c0 con 0x7f13180cc2e0 2023-07-09T02:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180cad00 con 0x7f13181583d0 2023-07-09T02:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180cafe0 con 0x7f1300003980 2023-07-09T02:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13180cc2e0 0x7f13181557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13180cc2e0 0x7f13181557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43258/0 (socket says 172.21.15.45:43258) 2023-07-09T02:18:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 -- 172.21.15.45:0/2769814332 learned_addr learned my addr 172.21.15.45:0/2769814332 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f13177fe640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300003980 0x7f13180c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1316ffd640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13181583d0 0x7f13180cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 -- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300003980 msgr2=0x7f13180c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300003980 0x7f13180c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 -- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13181583d0 msgr2=0x7f13180cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13181583d0 0x7f13180cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 -- 172.21.15.45:0/2769814332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180cb2c0 con 0x7f13180cc2e0 2023-07-09T02:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f1317fff640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13180cc2e0 0x7f13181557b0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f131806ba70 tx=0x7f1310007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f12fffff640 1 -- 172.21.15.45:0/2769814332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13100114f0 con 0x7f13180cc2e0 2023-07-09T02:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f12fffff640 1 -- 172.21.15.45:0/2769814332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1310011650 con 0x7f13180cc2e0 2023-07-09T02:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13180cb5a0 con 0x7f13180cc2e0 2023-07-09T02:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f12fffff640 1 -- 172.21.15.45:0/2769814332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310011a00 con 0x7f13180cc2e0 2023-07-09T02:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1318155020 con 0x7f13180cc2e0 2023-07-09T02:18:28.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.755+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131804d7d0 con 0x7f13180cc2e0 2023-07-09T02:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.759+0000 7f12fffff640 1 -- 172.21.15.45:0/2769814332 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1310011b60 con 0x7f13180cc2e0 2023-07-09T02:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.759+0000 7f12fffff640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f13040662b0 0x7f1304068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:28.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.759+0000 7f12fffff640 1 -- 172.21.15.45:0/2769814332 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13100835e0 con 0x7f13180cc2e0 2023-07-09T02:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.759+0000 7f13177fe640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f13040662b0 0x7f1304068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.759+0000 7f13177fe640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f13040662b0 0x7f1304068760 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1308001750 tx=0x7f13080011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:28.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.763+0000 7f12fffff640 1 -- 172.21.15.45:0/2769814332 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13100509c0 con 0x7f13180cc2e0 2023-07-09T02:18:28.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.915+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13180cba50 con 0x7f13180cc2e0 2023-07-09T02:18:28.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.915+0000 7f12fffff640 1 -- 172.21.15.45:0/2769814332 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v141) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1310053fe0 con 0x7f13180cc2e0 2023-07-09T02:18:28.919 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:18:28.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f13040662b0 msgr2=0x7f1304068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f13040662b0 0x7f1304068760 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1308001750 tx=0x7f13080011a0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13180cc2e0 msgr2=0x7f13181557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13180cc2e0 0x7f13181557b0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f131806ba70 tx=0x7f1310007a20 comp rx=0 tx=0).stop 2023-07-09T02:18:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 shutdown_connections 2023-07-09T02:18:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13180cc2e0 0x7f13181557b0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13181583d0 0x7f13180cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f13040662b0 0x7f1304068760 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 --2- 172.21.15.45:0/2769814332 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1300003980 0x7f13180c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 >> 172.21.15.45:0/2769814332 conn(0x7f13180698e0 msgr2=0x7f13180b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 shutdown_connections 2023-07-09T02:18:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:28.919+0000 7f131e25c640 1 -- 172.21.15.45:0/2769814332 wait complete. 2023-07-09T02:18:28.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:18:29.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa696056640 1 Processor -- start 2023-07-09T02:18:29.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa696056640 1 -- start start 2023-07-09T02:18:29.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa696056640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa6900b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa696056640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa690160a50 con 0x7fa6900d2620 2023-07-09T02:18:29.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa696056640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69015c430 con 0x7fa6900cd120 2023-07-09T02:18:29.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa696056640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69015fb60 con 0x7fa69015c060 2023-07-09T02:18:29.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa6900d2620 0x7fa6900cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33434/0 (socket says 172.21.15.45:33434) 2023-07-09T02:18:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68ffff640 1 -- 172.21.15.45:0/1022730481 learned_addr learned my addr 172.21.15.45:0/1022730481 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68f7fe640 1 --2- 172.21.15.45:0/1022730481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa6900b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68e7fc640 1 -- 172.21.15.45:0/1022730481 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712302947 0 0) 0x7fa690160a50 con 0x7fa6900d2620 2023-07-09T02:18:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68e7fc640 1 -- 172.21.15.45:0/1022730481 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa678003530 con 0x7fa6900d2620 2023-07-09T02:18:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68e7fc640 1 -- 172.21.15.45:0/1022730481 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106563631 0 0) 0x7fa69015c430 con 0x7fa6900cd120 2023-07-09T02:18:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68e7fc640 1 -- 172.21.15.45:0/1022730481 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa690160a50 con 0x7fa6900cd120 2023-07-09T02:18:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68e7fc640 1 -- 172.21.15.45:0/1022730481 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2874658234 0 0) 0x7fa678003530 con 0x7fa6900d2620 2023-07-09T02:18:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68f7fe640 1 -- 172.21.15.45:0/1022730481 >> v1:172.21.15.155:6789/0 conn(0x7fa6900cd120 legacy=0x7fa6900d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68f7fe640 1 -- 172.21.15.45:0/1022730481 >> v1:172.21.15.45:6789/0 conn(0x7fa6900d2620 legacy=0x7fa6900cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.083+0000 7fa68f7fe640 1 -- 172.21.15.45:0/1022730481 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69015fe40 con 0x7fa69015c060 2023-07-09T02:18:29.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.087+0000 7fa68f7fe640 1 --2- 172.21.15.45:0/1022730481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa6900b4ed0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa680009820 tx=0x7fa68001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31f026e7d354ad96 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.087+0000 7fa68e7fc640 1 -- 172.21.15.45:0/1022730481 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688001a00 con 0x7fa69015c060 2023-07-09T02:18:29.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.087+0000 7fa68e7fc640 1 -- 172.21.15.45:0/1022730481 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6800a7050 con 0x7fa69015c060 2023-07-09T02:18:29.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.087+0000 7fa68e7fc640 1 -- 172.21.15.45:0/1022730481 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680004250 con 0x7fa69015c060 2023-07-09T02:18:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.087+0000 7fa696056640 1 -- 172.21.15.45:0/1022730481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 msgr2=0x7fa6900b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.087+0000 7fa696056640 1 --2- 172.21.15.45:0/1022730481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa6900b4ed0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa680009820 tx=0x7fa68001c390 comp rx=0 tx=0).stop 2023-07-09T02:18:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 -- 172.21.15.45:0/1022730481 shutdown_connections 2023-07-09T02:18:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 --2- 172.21.15.45:0/1022730481 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa6900b4ed0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 -- 172.21.15.45:0/1022730481 >> 172.21.15.45:0/1022730481 conn(0x7fa6900698e0 msgr2=0x7fa690069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 -- 172.21.15.45:0/1022730481 shutdown_connections 2023-07-09T02:18:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 -- 172.21.15.45:0/1022730481 wait complete. 2023-07-09T02:18:29.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 Processor -- start 2023-07-09T02:18:29.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 -- start start 2023-07-09T02:18:29.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6900cd120 0x7fa690158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6900d2620 0x7fa6900b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa690161840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa690162c00 con 0x7fa6900cd120 2023-07-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900b1d60 con 0x7fa6900d2620 2023-07-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa696056640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa690157630 con 0x7fa69015c060 2023-07-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6900cd120 0x7fa690158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6900cd120 0x7fa690158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43266/0 (socket says 172.21.15.45:43266) 2023-07-09T02:18:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 -- 172.21.15.45:0/77764245 learned_addr learned my addr 172.21.15.45:0/77764245 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68ffff640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa690161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68effd640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6900d2620 0x7fa6900b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 -- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 msgr2=0x7fa690161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa690161840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 -- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6900d2620 msgr2=0x7fa6900b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6900d2620 0x7fa6900b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 -- 172.21.15.45:0/77764245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680009420 con 0x7fa6900cd120 2023-07-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.091+0000 7fa68f7fe640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6900cd120 0x7fa690158aa0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fa6800ae040 tx=0x7fa680019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa677fff640 1 -- 172.21.15.45:0/77764245 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680003af0 con 0x7fa6900cd120 2023-07-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa677fff640 1 -- 172.21.15.45:0/77764245 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa680003c50 con 0x7fa6900cd120 2023-07-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6900b59f0 con 0x7fa6900cd120 2023-07-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa677fff640 1 -- 172.21.15.45:0/77764245 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6800ab440 con 0x7fa6900cd120 2023-07-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa690157bf0 con 0x7fa6900cd120 2023-07-09T02:18:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69004d7d0 con 0x7fa6900cd120 2023-07-09T02:18:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa677fff640 1 -- 172.21.15.45:0/77764245 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6800b2040 con 0x7fa6900cd120 2023-07-09T02:18:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa677fff640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa67c0662b0 0x7fa67c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa677fff640 1 -- 172.21.15.45:0/77764245 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa68011dce0 con 0x7fa6900cd120 2023-07-09T02:18:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.095+0000 7fa68effd640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa67c0662b0 0x7fa67c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.099+0000 7fa68effd640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa67c0662b0 0x7fa67c068760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa6900d1460 tx=0x7fa684009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.099+0000 7fa677fff640 1 -- 172.21.15.45:0/77764245 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6800eb280 con 0x7fa6900cd120 2023-07-09T02:18:29.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.251+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa69006baa0 con 0x7fa6900cd120 2023-07-09T02:18:29.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.251+0000 7fa677fff640 1 -- 172.21.15.45:0/77764245 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6800b0020 con 0x7fa6900cd120 2023-07-09T02:18:29.256 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:18:29.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa67c0662b0 msgr2=0x7fa67c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa67c0662b0 0x7fa67c068760 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa6900d1460 tx=0x7fa684009040 comp rx=0 tx=0).stop 2023-07-09T02:18:29.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6900cd120 msgr2=0x7fa690158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6900cd120 0x7fa690158aa0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fa6800ae040 tx=0x7fa680019130 comp rx=0 tx=0).stop 2023-07-09T02:18:29.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 shutdown_connections 2023-07-09T02:18:29.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa67c0662b0 0x7fa67c068760 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69015c060 0x7fa690161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6900d2620 0x7fa6900b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 --2- 172.21.15.45:0/77764245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6900cd120 0x7fa690158aa0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 >> 172.21.15.45:0/77764245 conn(0x7fa6900698e0 msgr2=0x7fa6900b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:29.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 shutdown_connections 2023-07-09T02:18:29.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.255+0000 7fa696056640 1 -- 172.21.15.45:0/77764245 wait complete. 2023-07-09T02:18:29.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:18:29.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd4511640 1 Processor -- start 2023-07-09T02:18:29.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd4511640 1 -- start start 2023-07-09T02:18:29.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd4511640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefcc0cd120 0x7fefcc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd4511640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc160a50 con 0x7fefcc0d2620 2023-07-09T02:18:29.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd4511640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefcc15c430 con 0x7fefcc15c060 2023-07-09T02:18:29.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd4511640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefcc15fb60 con 0x7fefcc0cd120 2023-07-09T02:18:29.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd1aac640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fefcc0d2620 0x7fefcc0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33446/0 (socket says 172.21.15.45:33446) 2023-07-09T02:18:29.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd1aac640 1 -- 172.21.15.45:0/4028050828 learned_addr learned my addr 172.21.15.45:0/4028050828 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:29.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.423+0000 7fefd2aae640 1 --2- 172.21.15.45:0/4028050828 >> v2:172.21.15.45:3300/0 conn(0x7fefcc0cd120 0x7fefcc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.427+0000 7fefd12ab640 1 -- 172.21.15.45:0/4028050828 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818600973 0 0) 0x7fefcc15c430 con 0x7fefcc15c060 2023-07-09T02:18:29.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.427+0000 7fefd2aae640 1 -- 172.21.15.45:0/4028050828 >> v1:172.21.15.155:6789/0 conn(0x7fefcc15c060 legacy=0x7fefcc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.427+0000 7fefd2aae640 1 -- 172.21.15.45:0/4028050828 >> v1:172.21.15.45:6789/0 conn(0x7fefcc0d2620 legacy=0x7fefcc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.427+0000 7fefd2aae640 1 -- 172.21.15.45:0/4028050828 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc15fe40 con 0x7fefcc0cd120 2023-07-09T02:18:29.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.427+0000 7fefd2aae640 1 --2- 172.21.15.45:0/4028050828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b4ed0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009d90 tx=0x7fefc401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210d93438048c137 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.427+0000 7fefd12ab640 1 -- 172.21.15.45:0/4028050828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40a5840 con 0x7fefcc0cd120 2023-07-09T02:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.427+0000 7fefd12ab640 1 -- 172.21.15.45:0/4028050828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc40a59a0 con 0x7fefcc0cd120 2023-07-09T02:18:29.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.427+0000 7fefd12ab640 1 -- 172.21.15.45:0/4028050828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40a5d30 con 0x7fefcc0cd120 2023-07-09T02:18:29.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- 172.21.15.45:0/4028050828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 msgr2=0x7fefcc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 --2- 172.21.15.45:0/4028050828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b4ed0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009d90 tx=0x7fefc401c7e0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- 172.21.15.45:0/4028050828 shutdown_connections 2023-07-09T02:18:29.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 --2- 172.21.15.45:0/4028050828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b4ed0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- 172.21.15.45:0/4028050828 >> 172.21.15.45:0/4028050828 conn(0x7fefcc0698e0 msgr2=0x7fefcc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:29.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- 172.21.15.45:0/4028050828 shutdown_connections 2023-07-09T02:18:29.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- 172.21.15.45:0/4028050828 wait complete. 2023-07-09T02:18:29.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 Processor -- start 2023-07-09T02:18:29.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- start start 2023-07-09T02:18:29.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc0d2620 0x7fefcc1f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefcc15c060 0x7fefcc0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0b6d50 con 0x7fefcc0cd120 2023-07-09T02:18:29.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0b5e60 con 0x7fefcc0d2620 2023-07-09T02:18:29.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd4511640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc0b6140 con 0x7fefcc15c060 2023-07-09T02:18:29.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43272/0 (socket says 172.21.15.45:43272) 2023-07-09T02:18:29.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 -- 172.21.15.45:0/804942459 learned_addr learned my addr 172.21.15.45:0/804942459 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:29.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd1aac640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc0d2620 0x7fefcc1f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd2aae640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefcc15c060 0x7fefcc0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 -- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefcc15c060 msgr2=0x7fefcc0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefcc15c060 0x7fefcc0cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 -- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc0d2620 msgr2=0x7fefcc1f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc0d2620 0x7fefcc1f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 -- 172.21.15.45:0/804942459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc4009a70 con 0x7fefcc0cd120 2023-07-09T02:18:29.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd1aac640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc0d2620 0x7fefcc1f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:29.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.431+0000 7fefd22ad640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b71e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fefc8001ec0 tx=0x7fefc800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefc2ffd640 1 -- 172.21.15.45:0/804942459 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80054e0 con 0x7fefcc0cd120 2023-07-09T02:18:29.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefc2ffd640 1 -- 172.21.15.45:0/804942459 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8003600 con 0x7fefcc0cd120 2023-07-09T02:18:29.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefc2ffd640 1 -- 172.21.15.45:0/804942459 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80039b0 con 0x7fefcc0cd120 2023-07-09T02:18:29.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc0b6420 con 0x7fefcc0cd120 2023-07-09T02:18:29.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefcc0b69e0 con 0x7fefcc0cd120 2023-07-09T02:18:29.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefcc04d7d0 con 0x7fefcc0cd120 2023-07-09T02:18:29.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefc2ffd640 1 -- 172.21.15.45:0/804942459 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fefc8003b10 con 0x7fefcc0cd120 2023-07-09T02:18:29.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefc2ffd640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fefb0066280 0x7fefb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefc2ffd640 1 -- 172.21.15.45:0/804942459 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fefc8083350 con 0x7fefcc0cd120 2023-07-09T02:18:29.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefc2ffd640 1 -- 172.21.15.45:0/804942459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7fefb006e3c0 con 0x7fefcc0cd120 2023-07-09T02:18:29.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.435+0000 7fefd1aac640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fefb0066280 0x7fefb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.439+0000 7fefd1aac640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fefb0066280 0x7fefb0068730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fefbc001ec0 tx=0x7fefbc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.439+0000 7fefc2ffd640 1 -- 172.21.15.45:0/804942459 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fefc8017060 con 0x7fefcc0cd120 2023-07-09T02:18:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefcc06baa0 con 0x7fefcc0cd120 2023-07-09T02:18:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefc2ffd640 1 -- 172.21.15.45:0/804942459 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+11 (secure 0 0 0) 0x7fefc8054250 con 0x7fefcc0cd120 2023-07-09T02:18:29.597 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:18:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fefb0066280 msgr2=0x7fefb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fefb0066280 0x7fefb0068730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fefbc001ec0 tx=0x7fefbc00b040 comp rx=0 tx=0).stop 2023-07-09T02:18:29.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 msgr2=0x7fefcc0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b71e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fefc8001ec0 tx=0x7fefc800c8e0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 shutdown_connections 2023-07-09T02:18:29.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fefb0066280 0x7fefb0068730 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefcc15c060 0x7fefcc0cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefcc0d2620 0x7fefcc1f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 --2- 172.21.15.45:0/804942459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefcc0cd120 0x7fefcc0b71e0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 >> 172.21.15.45:0/804942459 conn(0x7fefcc0698e0 msgr2=0x7fefcc0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 shutdown_connections 2023-07-09T02:18:29.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.595+0000 7fefd4511640 1 -- 172.21.15.45:0/804942459 wait complete. 2023-07-09T02:18:29.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:29.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6fc056640 1 Processor -- start 2023-07-09T02:18:29.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6fc056640 1 -- start start 2023-07-09T02:18:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6fc056640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6f40d2620 0x7fa6f40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6fc056640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa6f40cd120 0x7fa6f40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6fc056640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f4160a50 con 0x7fa6f415c060 2023-07-09T02:18:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6fc056640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f415c430 con 0x7fa6f40d2620 2023-07-09T02:18:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6fc056640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f415fb60 con 0x7fa6f40cd120 2023-07-09T02:18:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6f95f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6f40d2620 0x7fa6f40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6f95f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6f40d2620 0x7fa6f40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43286/0 (socket says 172.21.15.45:43286) 2023-07-09T02:18:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6f95f1640 1 -- 172.21.15.45:0/3425496679 learned_addr learned my addr 172.21.15.45:0/3425496679 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6fa5f3640 1 --2- 172.21.15.45:0/3425496679 >> v2:172.21.15.155:3300/0 conn(0x7fa6f40cd120 0x7fa6f40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6f95f1640 1 -- 172.21.15.45:0/3425496679 >> v2:172.21.15.155:3300/0 conn(0x7fa6f40cd120 msgr2=0x7fa6f40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6f95f1640 1 --2- 172.21.15.45:0/3425496679 >> v2:172.21.15.155:3300/0 conn(0x7fa6f40cd120 0x7fa6f40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6f95f1640 1 -- 172.21.15.45:0/3425496679 >> v1:172.21.15.155:6789/0 conn(0x7fa6f415c060 legacy=0x7fa6f40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.759+0000 7fa6f95f1640 1 -- 172.21.15.45:0/3425496679 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f415fe40 con 0x7fa6f40d2620 2023-07-09T02:18:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6f95f1640 1 --2- 172.21.15.45:0/3425496679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f40b4ed0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fa6f406b120 tx=0x7fa6e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ebd4186fb53543 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6f8df0640 1 -- 172.21.15.45:0/3425496679 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40aa430 con 0x7fa6f40d2620 2023-07-09T02:18:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6f8df0640 1 -- 172.21.15.45:0/3425496679 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e40aa590 con 0x7fa6f40d2620 2023-07-09T02:18:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6f8df0640 1 -- 172.21.15.45:0/3425496679 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40aa920 con 0x7fa6f40d2620 2023-07-09T02:18:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6fc056640 1 -- 172.21.15.45:0/3425496679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 msgr2=0x7fa6f40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3425496679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f40b4ed0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fa6f406b120 tx=0x7fa6e401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6fc056640 1 -- 172.21.15.45:0/3425496679 shutdown_connections 2023-07-09T02:18:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3425496679 >> v2:172.21.15.155:3300/0 conn(0x7fa6f40cd120 0x7fa6f40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3425496679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f40b4ed0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6fc056640 1 -- 172.21.15.45:0/3425496679 >> 172.21.15.45:0/3425496679 conn(0x7fa6f40698e0 msgr2=0x7fa6f4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6fc056640 1 -- 172.21.15.45:0/3425496679 shutdown_connections 2023-07-09T02:18:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.763+0000 7fa6fc056640 1 -- 172.21.15.45:0/3425496679 wait complete. 2023-07-09T02:18:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 Processor -- start 2023-07-09T02:18:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 -- start start 2023-07-09T02:18:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6f40cd120 0x7fa6f4143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f415c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f415c060 0x7fa6f415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40b3fc0 con 0x7fa6f40d2620 2023-07-09T02:18:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40b42a0 con 0x7fa6f415c060 2023-07-09T02:18:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40b4580 con 0x7fa6f40cd120 2023-07-09T02:18:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f415c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f415c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43300/0 (socket says 172.21.15.45:43300) 2023-07-09T02:18:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 -- 172.21.15.45:0/3846980783 learned_addr learned my addr 172.21.15.45:0/3846980783 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fa5f3640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f415c060 0x7fa6f415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f9df2640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6f40cd120 0x7fa6f4143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 -- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6f40cd120 msgr2=0x7fa6f4143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6f40cd120 0x7fa6f4143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 -- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f415c060 msgr2=0x7fa6f415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f415c060 0x7fa6f415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 -- 172.21.15.45:0/3846980783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e40094d0 con 0x7fa6f40d2620 2023-07-09T02:18:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6f95f1640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f415c700 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40190e0 tx=0x7fa6e401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6ea7fc640 1 -- 172.21.15.45:0/3846980783 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40aa430 con 0x7fa6f40d2620 2023-07-09T02:18:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6ea7fc640 1 -- 172.21.15.45:0/3846980783 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e40b3820 con 0x7fa6f40d2620 2023-07-09T02:18:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6ea7fc640 1 -- 172.21.15.45:0/3846980783 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40b3bd0 con 0x7fa6f40d2620 2023-07-09T02:18:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f40b59f0 con 0x7fa6f40d2620 2023-07-09T02:18:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.767+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f415cc40 con 0x7fa6f40d2620 2023-07-09T02:18:29.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.771+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f404d7d0 con 0x7fa6f40d2620 2023-07-09T02:18:29.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.771+0000 7fa6ea7fc640 1 -- 172.21.15.45:0/3846980783 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6e40b3d30 con 0x7fa6f40d2620 2023-07-09T02:18:29.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.771+0000 7fa6ea7fc640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6d8066280 0x7fa6d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:29.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.771+0000 7fa6ea7fc640 1 -- 172.21.15.45:0/3846980783 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6e411de60 con 0x7fa6f40d2620 2023-07-09T02:18:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.771+0000 7fa6ea7fc640 1 -- 172.21.15.45:0/3846980783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7fa6d806e3c0 con 0x7fa6f40d2620 2023-07-09T02:18:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.771+0000 7fa6f9df2640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6d8066280 0x7fa6d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.771+0000 7fa6f9df2640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6d8066280 0x7fa6d8068730 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0007fd0 tx=0x7fa6f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:29.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.775+0000 7fa6ea7fc640 1 -- 172.21.15.45:0/3846980783 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6e40c3070 con 0x7fa6f40d2620 2023-07-09T02:18:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.959+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6f406baa0 con 0x7fa6f40d2620 2023-07-09T02:18:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.959+0000 7fa6ea7fc640 1 -- 172.21.15.45:0/3846980783 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fa6e40eb2f0 con 0x7fa6f40d2620 2023-07-09T02:18:29.963 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:29.964 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:18:29.964 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:18:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6d8066280 msgr2=0x7fa6d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6d8066280 0x7fa6d8068730 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0007fd0 tx=0x7fa6f0009040 comp rx=0 tx=0).stop 2023-07-09T02:18:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 msgr2=0x7fa6f415c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f415c700 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40190e0 tx=0x7fa6e401ad10 comp rx=0 tx=0).stop 2023-07-09T02:18:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 shutdown_connections 2023-07-09T02:18:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f415c060 0x7fa6f415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6f40d2620 0x7fa6f415c700 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa6d8066280 0x7fa6d8068730 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 --2- 172.21.15.45:0/3846980783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6f40cd120 0x7fa6f4143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 >> 172.21.15.45:0/3846980783 conn(0x7fa6f40698e0 msgr2=0x7fa6f40b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:29.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 shutdown_connections 2023-07-09T02:18:29.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:29.963+0000 7fa6fc056640 1 -- 172.21.15.45:0/3846980783 wait complete. 2023-07-09T02:18:29.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5892f2c640 1 Processor -- start 2023-07-09T02:18:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5892f2c640 1 -- start start 2023-07-09T02:18:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5892f2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5892f2c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f588c15db00 0x7f588c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5892f2c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588c06bf30 con 0x7f588c0ca0f0 2023-07-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5892f2c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588c15e4c0 con 0x7f588c15db00 2023-07-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5892f2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c06bc50 con 0x7f588c0c8d10 2023-07-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5890cc8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f588c0ca0f0 0x7f588c0cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33462/0 (socket says 172.21.15.45:33462) 2023-07-09T02:18:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f5890cc8640 1 -- 172.21.15.45:0/1695788438 learned_addr learned my addr 172.21.15.45:0/1695788438 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f588bfff640 1 --2- 172.21.15.45:0/1695788438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f58914c9640 1 --2- 172.21.15.45:0/1695788438 >> v2:172.21.15.155:3300/0 conn(0x7f588c15db00 0x7f588c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f588b7fe640 1 -- 172.21.15.45:0/1695788438 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829973156 0 0) 0x7f588c06bf30 con 0x7f588c0ca0f0 2023-07-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f588b7fe640 1 -- 172.21.15.45:0/1695788438 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f587c003530 con 0x7f588c0ca0f0 2023-07-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f588bfff640 1 -- 172.21.15.45:0/1695788438 >> v2:172.21.15.155:3300/0 conn(0x7f588c15db00 msgr2=0x7f588c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f588bfff640 1 --2- 172.21.15.45:0/1695788438 >> v2:172.21.15.155:3300/0 conn(0x7f588c15db00 0x7f588c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f588bfff640 1 -- 172.21.15.45:0/1695788438 >> v1:172.21.15.45:6789/0 conn(0x7f588c0ca0f0 legacy=0x7f588c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.127+0000 7f588bfff640 1 -- 172.21.15.45:0/1695788438 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0cab90 con 0x7f588c0c8d10 2023-07-09T02:18:30.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f588bfff640 1 --2- 172.21.15.45:0/1695788438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c0c9160 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f58780097c0 tx=0x7f587801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b518d8a3100ccf11 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f588b7fe640 1 -- 172.21.15.45:0/1695788438 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780ab5f0 con 0x7f588c0c8d10 2023-07-09T02:18:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f588b7fe640 1 -- 172.21.15.45:0/1695788438 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780ab750 con 0x7f588c0c8d10 2023-07-09T02:18:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f588b7fe640 1 -- 172.21.15.45:0/1695788438 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780abae0 con 0x7f588c0c8d10 2023-07-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f5892f2c640 1 -- 172.21.15.45:0/1695788438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 msgr2=0x7f588c0c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1695788438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c0c9160 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f58780097c0 tx=0x7f587801c3f0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f5892f2c640 1 -- 172.21.15.45:0/1695788438 shutdown_connections 2023-07-09T02:18:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1695788438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c0c9160 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1695788438 >> v2:172.21.15.155:3300/0 conn(0x7f588c15db00 0x7f588c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f5892f2c640 1 -- 172.21.15.45:0/1695788438 >> 172.21.15.45:0/1695788438 conn(0x7f588c0694b0 msgr2=0x7f588c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f5892f2c640 1 -- 172.21.15.45:0/1695788438 shutdown_connections 2023-07-09T02:18:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.131+0000 7f5892f2c640 1 -- 172.21.15.45:0/1695788438 wait complete. 2023-07-09T02:18:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 Processor -- start 2023-07-09T02:18:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 -- start start 2023-07-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f588c0ca0f0 0x7f588c13c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f588c15db00 0x7f588c13cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c150680 con 0x7f588c15db00 2023-07-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0c71d0 con 0x7f588c0ca0f0 2023-07-09T02:18:30.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0c74b0 con 0x7f588c0c8d10 2023-07-09T02:18:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f588c15db00 0x7f588c13cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f588c15db00 0x7f588c13cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43302/0 (socket says 172.21.15.45:43302) 2023-07-09T02:18:30.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 -- 172.21.15.45:0/1199136585 learned_addr learned my addr 172.21.15.45:0/1199136585 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5890cc8640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f588bfff640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f588c0ca0f0 0x7f588c13c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 -- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 msgr2=0x7f588c13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 -- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f588c0ca0f0 msgr2=0x7f588c13c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f588c0ca0f0 0x7f588c13c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 -- 172.21.15.45:0/1199136585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009420 con 0x7f588c15db00 2023-07-09T02:18:30.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f588bfff640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f588c0ca0f0 0x7f588c13c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58914c9640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f588c15db00 0x7f588c13cd30 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f588400efc0 tx=0x7f588400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58897fa640 1 -- 172.21.15.45:0/1199136585 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884009ba0 con 0x7f588c15db00 2023-07-09T02:18:30.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58897fa640 1 -- 172.21.15.45:0/1199136585 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588400f040 con 0x7f588c15db00 2023-07-09T02:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f58897fa640 1 -- 172.21.15.45:0/1199136585 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840146c0 con 0x7f588c15db00 2023-07-09T02:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588c0c7790 con 0x7f588c15db00 2023-07-09T02:18:30.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.135+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588c13c9f0 con 0x7f588c15db00 2023-07-09T02:18:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.139+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588c04d7d0 con 0x7f588c15db00 2023-07-09T02:18:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.139+0000 7f58897fa640 1 -- 172.21.15.45:0/1199136585 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5884014820 con 0x7f588c15db00 2023-07-09T02:18:30.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.139+0000 7f58897fa640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58700662b0 0x7f5870068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.139+0000 7f58897fa640 1 -- 172.21.15.45:0/1199136585 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58840847b0 con 0x7f588c15db00 2023-07-09T02:18:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.139+0000 7f58897fa640 1 -- 172.21.15.45:0/1199136585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f587006e3f0 con 0x7f588c15db00 2023-07-09T02:18:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.139+0000 7f5890cc8640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58700662b0 0x7f5870068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.139+0000 7f5890cc8640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58700662b0 0x7f5870068760 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f58800011f0 tx=0x7f5880007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.143+0000 7f58897fa640 1 -- 172.21.15.45:0/1199136585 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5884051b90 con 0x7f588c15db00 2023-07-09T02:18:30.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.299+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f588c0c5550 con 0x7f588c15db00 2023-07-09T02:18:30.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.299+0000 7f58897fa640 1 -- 172.21.15.45:0/1199136585 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18389 (secure 0 0 0) 0x7f5884018090 con 0x7f588c15db00 2023-07-09T02:18:30.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:30.304 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":142,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:29.384862+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:44.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:45.234988+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:30.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58700662b0 msgr2=0x7f5870068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58700662b0 0x7f5870068760 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f58800011f0 tx=0x7f5880007d40 comp rx=0 tx=0).stop 2023-07-09T02:18:30.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f588c15db00 msgr2=0x7f588c13cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f588c15db00 0x7f588c13cd30 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f588400efc0 tx=0x7f588400c490 comp rx=0 tx=0).stop 2023-07-09T02:18:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 shutdown_connections 2023-07-09T02:18:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f588c15db00 0x7f588c13cd30 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f588c0ca0f0 0x7f588c13c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f58700662b0 0x7f5870068760 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 --2- 172.21.15.45:0/1199136585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f588c0c8d10 0x7f588c13f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 >> 172.21.15.45:0/1199136585 conn(0x7f588c0694b0 msgr2=0x7f588c069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 shutdown_connections 2023-07-09T02:18:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.303+0000 7f5892f2c640 1 -- 172.21.15.45:0/1199136585 wait complete. 2023-07-09T02:18:30.325 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:18:30.325 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f87900a9640 1 Processor -- start 2023-07-09T02:18:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f87900a9640 1 -- start start 2023-07-09T02:18:30.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f87900a9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8788158e30 0x7f878806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f87900a9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806fd10 0x7f878806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f87900a9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87880ccf80 con 0x7f878806c650 2023-07-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f87900a9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878806cad0 con 0x7f8788158e30 2023-07-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f87900a9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87880cd540 con 0x7f878806fd10 2023-07-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878de45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8788158e30 0x7f878806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878e646640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f878806c650 0x7f87880caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33466/0 (socket says 172.21.15.45:33466) 2023-07-09T02:18:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878de45640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8788158e30 0x7f878806f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43306/0 (socket says 172.21.15.45:43306) 2023-07-09T02:18:30.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878e646640 1 -- 172.21.15.45:0/1364542468 learned_addr learned my addr 172.21.15.45:0/1364542468 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878d644640 1 --2- 172.21.15.45:0/1364542468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806fd10 0x7f878806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878de45640 1 -- 172.21.15.45:0/1364542468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806fd10 msgr2=0x7f878806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878de45640 1 --2- 172.21.15.45:0/1364542468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806fd10 0x7f878806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878de45640 1 -- 172.21.15.45:0/1364542468 >> v1:172.21.15.45:6789/0 conn(0x7f878806c650 legacy=0x7f87880caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878de45640 1 -- 172.21.15.45:0/1364542468 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880c8fb0 con 0x7f8788158e30 2023-07-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878ce43640 1 -- 172.21.15.45:0/1364542468 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734930220 0 0) 0x7f87880ccf80 con 0x7f878806c650 2023-07-09T02:18:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.467+0000 7f878d644640 1 --2- 172.21.15.45:0/1364542468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806fd10 0x7f878806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f878de45640 1 --2- 172.21.15.45:0/1364542468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8788158e30 0x7f878806f7d0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f87840097c0 tx=0x7f878401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb44c240d1522a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f878ce43640 1 -- 172.21.15.45:0/1364542468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840ac620 con 0x7f8788158e30 2023-07-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f878ce43640 1 -- 172.21.15.45:0/1364542468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87840ac780 con 0x7f8788158e30 2023-07-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f878ce43640 1 -- 172.21.15.45:0/1364542468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87840acb10 con 0x7f8788158e30 2023-07-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f87900a9640 1 -- 172.21.15.45:0/1364542468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8788158e30 msgr2=0x7f878806f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f87900a9640 1 --2- 172.21.15.45:0/1364542468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8788158e30 0x7f878806f7d0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f87840097c0 tx=0x7f878401c3c0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f87900a9640 1 -- 172.21.15.45:0/1364542468 shutdown_connections 2023-07-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f87900a9640 1 --2- 172.21.15.45:0/1364542468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806fd10 0x7f878806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f87900a9640 1 --2- 172.21.15.45:0/1364542468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8788158e30 0x7f878806f7d0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f87900a9640 1 -- 172.21.15.45:0/1364542468 >> 172.21.15.45:0/1364542468 conn(0x7f87880694b0 msgr2=0x7f87880698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f87900a9640 1 -- 172.21.15.45:0/1364542468 shutdown_connections 2023-07-09T02:18:30.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.471+0000 7f87900a9640 1 -- 172.21.15.45:0/1364542468 wait complete. 2023-07-09T02:18:30.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 Processor -- start 2023-07-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 -- start start 2023-07-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806c650 0x7f87880b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878806fd10 0x7f878815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8788158e30 0x7f878815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880c6440 con 0x7f878806fd10 2023-07-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880adf70 con 0x7f8788158e30 2023-07-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87880ae250 con 0x7f878806c650 2023-07-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878806fd10 0x7f878815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878806fd10 0x7f878815b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43318/0 (socket says 172.21.15.45:43318) 2023-07-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 -- 172.21.15.45:0/3587876477 learned_addr learned my addr 172.21.15.45:0/3587876477 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878de45640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806c650 0x7f87880b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878e646640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8788158e30 0x7f878815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 -- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806c650 msgr2=0x7f87880b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806c650 0x7f87880b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 -- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8788158e30 msgr2=0x7f878815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8788158e30 0x7f878815b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 -- 172.21.15.45:0/3587876477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784009420 con 0x7f878806fd10 2023-07-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f878d644640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878806fd10 0x7f878815b4a0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f877800c7c0 tx=0x7f877800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f877e7fc640 1 -- 172.21.15.45:0/3587876477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778007a30 con 0x7f878806fd10 2023-07-09T02:18:30.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f877e7fc640 1 -- 172.21.15.45:0/3587876477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8778007b90 con 0x7f878806fd10 2023-07-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87880ae530 con 0x7f878806fd10 2023-07-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f877e7fc640 1 -- 172.21.15.45:0/3587876477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800ce70 con 0x7f878806fd10 2023-07-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.475+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87880aeaf0 con 0x7f878806fd10 2023-07-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.479+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87880c65b0 con 0x7f878806fd10 2023-07-09T02:18:30.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.479+0000 7f877e7fc640 1 -- 172.21.15.45:0/3587876477 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87780113f0 con 0x7f878806fd10 2023-07-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.479+0000 7f877e7fc640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c066280 0x7f876c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.479+0000 7f877e7fc640 1 -- 172.21.15.45:0/3587876477 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87780841a0 con 0x7f878806fd10 2023-07-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.479+0000 7f877e7fc640 1 -- 172.21.15.45:0/3587876477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f876c06e3c0 con 0x7f878806fd10 2023-07-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.479+0000 7f878de45640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c066280 0x7f876c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.479+0000 7f878de45640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c066280 0x7f876c068730 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f87840ae000 tx=0x7f87840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.483+0000 7f877e7fc640 1 -- 172.21.15.45:0/3587876477 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87780516c0 con 0x7f878806fd10 2023-07-09T02:18:30.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f878804d7d0 con 0x7f878806fd10 2023-07-09T02:18:30.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f877e7fc640 1 -- 172.21.15.45:0/3587876477 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f8778054ce0 con 0x7f878806fd10 2023-07-09T02:18:30.674 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:30.674 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:18:30.675 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:18:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c066280 msgr2=0x7f876c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c066280 0x7f876c068730 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f87840ae000 tx=0x7f87840a7000 comp rx=0 tx=0).stop 2023-07-09T02:18:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878806fd10 msgr2=0x7f878815b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878806fd10 0x7f878815b4a0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f877800c7c0 tx=0x7f877800cc80 comp rx=0 tx=0).stop 2023-07-09T02:18:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 shutdown_connections 2023-07-09T02:18:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8788158e30 0x7f878815b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f878806fd10 0x7f878815b4a0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f876c066280 0x7f876c068730 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 --2- 172.21.15.45:0/3587876477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f878806c650 0x7f87880b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.671+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 >> 172.21.15.45:0/3587876477 conn(0x7f87880694b0 msgr2=0x7f87880700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.675+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 shutdown_connections 2023-07-09T02:18:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.675+0000 7f87900a9640 1 -- 172.21.15.45:0/3587876477 wait complete. 2023-07-09T02:18:30.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:30.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd385c640 1 Processor -- start 2023-07-09T02:18:30.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd385c640 1 -- start start 2023-07-09T02:18:30.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd385c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc15c060 0x7f4fcc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd385c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc160a50 con 0x7f4fcc0cd120 2023-07-09T02:18:30.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd385c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc15c430 con 0x7f4fcc0d2620 2023-07-09T02:18:30.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd385c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc15fb60 con 0x7f4fcc15c060 2023-07-09T02:18:30.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd0df7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4fcc0cd120 0x7f4fcc0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33482/0 (socket says 172.21.15.45:33482) 2023-07-09T02:18:30.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd0df7640 1 -- 172.21.15.45:0/2050206131 learned_addr learned my addr 172.21.15.45:0/2050206131 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:30.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd15f8640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc15c060 0x7f4fcc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538685958 0 0) 0x7f4fcc160a50 con 0x7f4fcc0cd120 2023-07-09T02:18:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb8003530 con 0x7f4fcc0cd120 2023-07-09T02:18:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796165117 0 0) 0x7f4fcc15c430 con 0x7f4fcc0d2620 2023-07-09T02:18:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fcc160a50 con 0x7f4fcc0d2620 2023-07-09T02:18:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 114733291 0 0) 0x7f4fb8003530 con 0x7f4fcc0cd120 2023-07-09T02:18:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc15c060 msgr2=0x7f4fcc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc15c060 0x7f4fcc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 >> v1:172.21.15.155:6789/0 conn(0x7f4fcc0d2620 legacy=0x7f4fcc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc15fe40 con 0x7f4fcc0cd120 2023-07-09T02:18:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f4fbc001680 con 0x7f4fcc0cd120 2023-07-09T02:18:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 >> v1:172.21.15.45:6789/0 conn(0x7f4fcc0cd120 legacy=0x7f4fcc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb8003b40 0x7f4fb8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80047d0 0x7f4fb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc15fb60 con 0x7f4fb8005180 2023-07-09T02:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb800bf50 con 0x7f4fb80047d0 2023-07-09T02:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb800c110 con 0x7f4fb8003b40 2023-07-09T02:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd15f8640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc15c060 0x7f4fcc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd1df9640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fb800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd0df7640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80047d0 0x7f4fb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd15f8640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb8003b40 0x7f4fb8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd1df9640 1 -- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb8003b40 msgr2=0x7f4fb8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:30.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd1df9640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fb8003b40 0x7f4fb8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd1df9640 1 -- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80047d0 msgr2=0x7f4fb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:30.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd1df9640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb80047d0 0x7f4fb8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.839+0000 7f4fd1df9640 1 -- 172.21.15.45:0/2050206131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8003530 con 0x7f4fb8005180 2023-07-09T02:18:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fd1df9640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fb800b990 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc08bcc0 tx=0x7f4fc401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4040450979aa7e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc007ea0 con 0x7f4fb8005180 2023-07-09T02:18:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4003ba0 con 0x7f4fb8005180 2023-07-09T02:18:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fc3fff640 1 -- 172.21.15.45:0/2050206131 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40050d0 con 0x7f4fb8005180 2023-07-09T02:18:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fd385c640 1 -- 172.21.15.45:0/2050206131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 msgr2=0x7f4fb800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fd385c640 1 --2- 172.21.15.45:0/2050206131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fb800b990 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc08bcc0 tx=0x7f4fc401c880 comp rx=0 tx=0).stop 2023-07-09T02:18:30.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fd1df9640 1 -- 172.21.15.45:0/2050206131 reap_dead start 2023-07-09T02:18:30.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fd385c640 1 -- 172.21.15.45:0/2050206131 shutdown_connections 2023-07-09T02:18:30.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fd385c640 1 -- 172.21.15.45:0/2050206131 >> 172.21.15.45:0/2050206131 conn(0x7f4fcc0698e0 msgr2=0x7f4fcc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:30.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fd385c640 1 -- 172.21.15.45:0/2050206131 shutdown_connections 2023-07-09T02:18:30.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.843+0000 7f4fd385c640 1 -- 172.21.15.45:0/2050206131 wait complete. 2023-07-09T02:18:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 Processor -- start 2023-07-09T02:18:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 -- start start 2023-07-09T02:18:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fcc0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc0b5e40 0x7f4fcc1464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fcc0b62b0 0x7f4fcc1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc0b6820 con 0x7f4fb8005180 2023-07-09T02:18:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc0b6b00 con 0x7f4fcc0b62b0 2023-07-09T02:18:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc0b6de0 con 0x7f4fcc0b5e40 2023-07-09T02:18:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fcc0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fcc0c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43332/0 (socket says 172.21.15.45:43332) 2023-07-09T02:18:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 -- 172.21.15.45:0/1913945333 learned_addr learned my addr 172.21.15.45:0/1913945333 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd0df7640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc0b5e40 0x7f4fcc1464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd1df9640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fcc0b62b0 0x7f4fcc1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 -- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc0b5e40 msgr2=0x7f4fcc1464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc0b5e40 0x7f4fcc1464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 -- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fcc0b62b0 msgr2=0x7f4fcc1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:30.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fcc0b62b0 0x7f4fcc1469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:30.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 -- 172.21.15.45:0/1913945333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc0b70c0 con 0x7f4fb8005180 2023-07-09T02:18:30.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd15f8640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fcc0c9d70 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80119a0 tx=0x7f4fc8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fc1ffb640 1 -- 172.21.15.45:0/1913945333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800f810 con 0x7f4fb8005180 2023-07-09T02:18:30.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fc1ffb640 1 -- 172.21.15.45:0/1913945333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc800f970 con 0x7f4fb8005180 2023-07-09T02:18:30.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fc1ffb640 1 -- 172.21.15.45:0/1913945333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800fce0 con 0x7f4fb8005180 2023-07-09T02:18:30.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc0b73a0 con 0x7f4fb8005180 2023-07-09T02:18:30.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.847+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc15d000 con 0x7f4fb8005180 2023-07-09T02:18:30.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.851+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fcc0b7530 con 0x7f4fb8005180 2023-07-09T02:18:30.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.851+0000 7f4fc1ffb640 1 -- 172.21.15.45:0/1913945333 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fc8014440 con 0x7f4fb8005180 2023-07-09T02:18:30.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.851+0000 7f4fc1ffb640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fb00662b0 0x7f4fb0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:30.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.851+0000 7f4fc1ffb640 1 -- 172.21.15.45:0/1913945333 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fc8084380 con 0x7f4fb8005180 2023-07-09T02:18:30.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.851+0000 7f4fc1ffb640 1 -- 172.21.15.45:0/1913945333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f4fb006e3f0 con 0x7f4fb8005180 2023-07-09T02:18:30.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.851+0000 7f4fd0df7640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fb00662b0 0x7f4fb0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.851+0000 7f4fd0df7640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fb00662b0 0x7f4fb0068760 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc001060 tx=0x7f4fbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:30.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:30.855+0000 7f4fc1ffb640 1 -- 172.21.15.45:0/1913945333 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fc8051760 con 0x7f4fb8005180 2023-07-09T02:18:31.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.047+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fcc1600f0 con 0x7f4fb8005180 2023-07-09T02:18:31.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.047+0000 7f4fc1ffb640 1 -- 172.21.15.45:0/1913945333 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f4fc8054d80 con 0x7f4fb8005180 2023-07-09T02:18:31.051 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:31.051 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:17:46.233793+0000","modified":"2023-07-09T02:17:49.897938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7809},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7809":{"gid":7809,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/1298123765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1298123765},{"type":"v1","addr":"172.21.15.155:6837","nonce":1298123765}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T02:18:31.051 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-07-09T02:18:31.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fb00662b0 msgr2=0x7f4fb0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fb00662b0 0x7f4fb0068760 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc001060 tx=0x7f4fbc009040 comp rx=0 tx=0).stop 2023-07-09T02:18:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 msgr2=0x7f4fcc0c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fcc0c9d70 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80119a0 tx=0x7f4fc8011a90 comp rx=0 tx=0).stop 2023-07-09T02:18:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 shutdown_connections 2023-07-09T02:18:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fcc0b62b0 0x7f4fcc1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4fb00662b0 0x7f4fb0068760 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4fcc0b5e40 0x7f4fcc1464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 --2- 172.21.15.45:0/1913945333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb8005180 0x7f4fcc0c9d70 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 >> 172.21.15.45:0/1913945333 conn(0x7f4fcc0698e0 msgr2=0x7f4fcc0b7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 shutdown_connections 2023-07-09T02:18:31.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.051+0000 7f4fd385c640 1 -- 172.21.15.45:0/1913945333 wait complete. 2023-07-09T02:18:31.072 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:31.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.215+0000 7f4e7a60b640 1 Processor -- start 2023-07-09T02:18:31.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.215+0000 7f4e7a60b640 1 -- start start 2023-07-09T02:18:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.215+0000 7f4e7a60b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4e74158e30 0x7f4e7406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.215+0000 7f4e7a60b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e7406c820 0x7f4e740caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.215+0000 7f4e7a60b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e740ccf80 con 0x7f4e7406fd10 2023-07-09T02:18:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.215+0000 7f4e7a60b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e740cd540 con 0x7f4e74158e30 2023-07-09T02:18:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.215+0000 7f4e7a60b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740c8fb0 con 0x7f4e7406c820 2023-07-09T02:18:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e78ba8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e7406c820 0x7f4e740caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e78ba8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e7406c820 0x7f4e740caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:59644/0 (socket says 172.21.15.45:59644) 2023-07-09T02:18:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e78ba8640 1 -- 172.21.15.45:0/2430142195 learned_addr learned my addr 172.21.15.45:0/2430142195 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e73fff640 1 --2- 172.21.15.45:0/2430142195 >> v2:172.21.15.155:3300/0 conn(0x7f4e74158e30 0x7f4e7406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e78ba8640 1 -- 172.21.15.45:0/2430142195 >> v2:172.21.15.155:3300/0 conn(0x7f4e74158e30 msgr2=0x7f4e7406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e78ba8640 1 --2- 172.21.15.45:0/2430142195 >> v2:172.21.15.155:3300/0 conn(0x7f4e74158e30 0x7f4e7406f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e78ba8640 1 -- 172.21.15.45:0/2430142195 >> v1:172.21.15.155:6789/0 conn(0x7f4e7406fd10 legacy=0x7f4e7406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e78ba8640 1 -- 172.21.15.45:0/2430142195 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e740cbad0 con 0x7f4e7406c820 2023-07-09T02:18:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e73fff640 1 --2- 172.21.15.45:0/2430142195 >> v2:172.21.15.155:3300/0 conn(0x7f4e74158e30 0x7f4e7406f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e78ba8640 1 --2- 172.21.15.45:0/2430142195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e7406c820 0x7f4e740caec0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009e50 tx=0x7f4e6c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b18f5ca9b005851 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e72ffd640 1 -- 172.21.15.45:0/2430142195 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0a5830 con 0x7f4e7406c820 2023-07-09T02:18:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e72ffd640 1 -- 172.21.15.45:0/2430142195 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c0a5990 con 0x7f4e7406c820 2023-07-09T02:18:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.219+0000 7f4e72ffd640 1 -- 172.21.15.45:0/2430142195 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0a5d20 con 0x7f4e7406c820 2023-07-09T02:18:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- 172.21.15.45:0/2430142195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e7406c820 msgr2=0x7f4e740caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/2430142195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e7406c820 0x7f4e740caec0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009e50 tx=0x7f4e6c01c950 comp rx=0 tx=0).stop 2023-07-09T02:18:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- 172.21.15.45:0/2430142195 shutdown_connections 2023-07-09T02:18:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/2430142195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e7406c820 0x7f4e740caec0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/2430142195 >> v2:172.21.15.155:3300/0 conn(0x7f4e74158e30 0x7f4e7406f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- 172.21.15.45:0/2430142195 >> 172.21.15.45:0/2430142195 conn(0x7f4e740694b0 msgr2=0x7f4e740698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- 172.21.15.45:0/2430142195 shutdown_connections 2023-07-09T02:18:31.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- 172.21.15.45:0/2430142195 wait complete. 2023-07-09T02:18:31.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 Processor -- start 2023-07-09T02:18:31.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- start start 2023-07-09T02:18:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e7406c820 0x7f4e74146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7406fd10 0x7f4e740c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74158e30 0x7f4e740c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e741594b0 con 0x7f4e7406c820 2023-07-09T02:18:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7415a510 con 0x7f4e7406fd10 2023-07-09T02:18:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e7a60b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74159750 con 0x7f4e74158e30 2023-07-09T02:18:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e7406c820 0x7f4e74146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e7406c820 0x7f4e74146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43336/0 (socket says 172.21.15.45:43336) 2023-07-09T02:18:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e73fff640 1 -- 172.21.15.45:0/4221747339 learned_addr learned my addr 172.21.15.45:0/4221747339 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e737fe640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7406fd10 0x7f4e740c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.223+0000 7f4e78ba8640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74158e30 0x7f4e740c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e73fff640 1 -- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74158e30 msgr2=0x7f4e740c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e73fff640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74158e30 0x7f4e740c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e73fff640 1 -- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7406fd10 msgr2=0x7f4e740c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e73fff640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7406fd10 0x7f4e740c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e73fff640 1 -- 172.21.15.45:0/4221747339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64009420 con 0x7f4e7406c820 2023-07-09T02:18:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e73fff640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e7406c820 0x7f4e74146150 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400e980 tx=0x7f4e6400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e70ff9640 1 -- 172.21.15.45:0/4221747339 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400ca00 con 0x7f4e7406c820 2023-07-09T02:18:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e70ff9640 1 -- 172.21.15.45:0/4221747339 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6400cb60 con 0x7f4e7406c820 2023-07-09T02:18:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c009b30 con 0x7f4e7406c820 2023-07-09T02:18:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e70ff9640 1 -- 172.21.15.45:0/4221747339 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64013470 con 0x7f4e7406c820 2023-07-09T02:18:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e74159d10 con 0x7f4e7406c820 2023-07-09T02:18:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7404d7d0 con 0x7f4e7406c820 2023-07-09T02:18:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e70ff9640 1 -- 172.21.15.45:0/4221747339 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e640135d0 con 0x7f4e7406c820 2023-07-09T02:18:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e70ff9640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e600662b0 0x7f4e60068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e70ff9640 1 -- 172.21.15.45:0/4221747339 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e64083e50 con 0x7f4e7406c820 2023-07-09T02:18:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.227+0000 7f4e70ff9640 1 -- 172.21.15.45:0/4221747339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f4e6006e3f0 con 0x7f4e7406c820 2023-07-09T02:18:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.231+0000 7f4e737fe640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e600662b0 0x7f4e60068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.231+0000 7f4e737fe640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e600662b0 0x7f4e60068760 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4e740c7930 tx=0x7f4e68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.231+0000 7f4e70ff9640 1 -- 172.21.15.45:0/4221747339 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e64051410 con 0x7f4e7406c820 2023-07-09T02:18:31.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.391+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e740ccb30 con 0x7f4e7406c820 2023-07-09T02:18:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.391+0000 7f4e70ff9640 1 -- 172.21.15.45:0/4221747339 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18389 (secure 0 0 0) 0x7f4e64021020 con 0x7f4e7406c820 2023-07-09T02:18:31.395 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:31.395 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":142,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:29.384862+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:17:44.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T02:17:45.234988+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e600662b0 msgr2=0x7f4e60068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e600662b0 0x7f4e60068760 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4e740c7930 tx=0x7f4e68009040 comp rx=0 tx=0).stop 2023-07-09T02:18:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e7406c820 msgr2=0x7f4e74146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e7406c820 0x7f4e74146150 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400e980 tx=0x7f4e6400ee40 comp rx=0 tx=0).stop 2023-07-09T02:18:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 shutdown_connections 2023-07-09T02:18:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4e600662b0 0x7f4e60068760 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e74158e30 0x7f4e740c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7406fd10 0x7f4e740c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 --2- 172.21.15.45:0/4221747339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e7406c820 0x7f4e74146150 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 >> 172.21.15.45:0/4221747339 conn(0x7f4e740694b0 msgr2=0x7f4e740c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 shutdown_connections 2023-07-09T02:18:31.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.395+0000 7f4e7a60b640 1 -- 172.21.15.45:0/4221747339 wait complete. 2023-07-09T02:18:31.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.559+0000 7f8076e9c640 1 Processor -- start 2023-07-09T02:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.559+0000 7f8076e9c640 1 -- start start 2023-07-09T02:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.559+0000 7f8076e9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807015c060 0x7f80700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.559+0000 7f8076e9c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80700cd120 0x7f80700d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.559+0000 7f8076e9c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80700d2450 0x7f80700d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.559+0000 7f8076e9c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80700d28f0 con 0x7f80700d2450 2023-07-09T02:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.559+0000 7f8076e9c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8070160a50 con 0x7f80700cd120 2023-07-09T02:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.559+0000 7f8076e9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807015c430 con 0x7f807015c060 2023-07-09T02:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80700d2450 0x7f80700d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80700d2450 0x7f80700d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43348/0 (socket says 172.21.15.45:43348) 2023-07-09T02:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 -- 172.21.15.45:0/3564053813 learned_addr learned my addr 172.21.15.45:0/3564053813 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8074c38640 1 --2- 172.21.15.45:0/3564053813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807015c060 0x7f80700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f806ffff640 1 --2- 172.21.15.45:0/3564053813 >> v2:172.21.15.155:3300/0 conn(0x7f80700cd120 0x7f80700d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 -- 172.21.15.45:0/3564053813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807015c060 msgr2=0x7f80700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 --2- 172.21.15.45:0/3564053813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807015c060 0x7f80700b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 -- 172.21.15.45:0/3564053813 >> v2:172.21.15.155:3300/0 conn(0x7f80700cd120 msgr2=0x7f80700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 --2- 172.21.15.45:0/3564053813 >> v2:172.21.15.155:3300/0 conn(0x7f80700cd120 0x7f80700d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 -- 172.21.15.45:0/3564053813 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807015fb60 con 0x7f80700d2450 2023-07-09T02:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f8075439640 1 --2- 172.21.15.45:0/3564053813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80700d2450 0x7f80700d0610 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f80700b5600 tx=0x7f806801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a17aeffe96654e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f806f7fe640 1 -- 172.21.15.45:0/3564053813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680a5560 con 0x7f80700d2450 2023-07-09T02:18:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f806f7fe640 1 -- 172.21.15.45:0/3564053813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80680a56c0 con 0x7f80700d2450 2023-07-09T02:18:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.563+0000 7f806f7fe640 1 -- 172.21.15.45:0/3564053813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680a5a50 con 0x7f80700d2450 2023-07-09T02:18:31.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- 172.21.15.45:0/3564053813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80700d2450 msgr2=0x7f80700d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 --2- 172.21.15.45:0/3564053813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80700d2450 0x7f80700d0610 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f80700b5600 tx=0x7f806801c6e0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- 172.21.15.45:0/3564053813 shutdown_connections 2023-07-09T02:18:31.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 --2- 172.21.15.45:0/3564053813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80700d2450 0x7f80700d0610 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 --2- 172.21.15.45:0/3564053813 >> v2:172.21.15.155:3300/0 conn(0x7f80700cd120 0x7f80700d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 --2- 172.21.15.45:0/3564053813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f807015c060 0x7f80700b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- 172.21.15.45:0/3564053813 >> 172.21.15.45:0/3564053813 conn(0x7f80700698e0 msgr2=0x7f8070069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:31.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- 172.21.15.45:0/3564053813 shutdown_connections 2023-07-09T02:18:31.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- 172.21.15.45:0/3564053813 wait complete. 2023-07-09T02:18:31.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 Processor -- start 2023-07-09T02:18:31.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- start start 2023-07-09T02:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80700cd120 0x7f8070151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80700d2450 0x7f80700ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f807015c060 0x7f807015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80701f4fe0 con 0x7f807015c060 2023-07-09T02:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070151fb0 con 0x7f80700cd120 2023-07-09T02:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8076e9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80701f4680 con 0x7f80700d2450 2023-07-09T02:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8075439640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f807015c060 0x7f807015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8075439640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f807015c060 0x7f807015ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43354/0 (socket says 172.21.15.45:43354) 2023-07-09T02:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8075439640 1 -- 172.21.15.45:0/1438557248 learned_addr learned my addr 172.21.15.45:0/1438557248 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8074c38640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80700cd120 0x7f8070151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f806ffff640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80700d2450 0x7f80700ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8075439640 1 -- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80700d2450 msgr2=0x7f80700ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8075439640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80700d2450 0x7f80700ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8075439640 1 -- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80700cd120 msgr2=0x7f8070151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8075439640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80700cd120 0x7f8070151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.567+0000 7f8075439640 1 -- 172.21.15.45:0/1438557248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068009b30 con 0x7f807015c060 2023-07-09T02:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f8075439640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f807015c060 0x7f807015ecc0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f80680af040 tx=0x7f8068019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680b8670 con 0x7f807015c060 2023-07-09T02:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80680b87f0 con 0x7f807015c060 2023-07-09T02:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680b8ba0 con 0x7f807015c060 2023-07-09T02:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80701f4920 con 0x7f807015c060 2023-07-09T02:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80701f5400 con 0x7f807015c060 2023-07-09T02:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80701f5120 con 0x7f807015c060 2023-07-09T02:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80680b8d00 con 0x7f807015c060 2023-07-09T02:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f806d7fa640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8054066280 0x7f8054068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f806811f100 con 0x7f807015c060 2023-07-09T02:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f805406e3c0 con 0x7f807015c060 2023-07-09T02:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.571+0000 7f8074c38640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8054066280 0x7f8054068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.575+0000 7f8074c38640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8054066280 0x7f8054068730 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8070158a80 tx=0x7f8064008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.575+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80701f5120 con 0x7f807015c060 2023-07-09T02:18:31.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.763+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f80701f5120 con 0x7f807015c060 2023-07-09T02:18:31.767 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:18:31.763+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:18:31.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.767+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(143..143 src has 1..143) v4 ==== 374+0+0 (secure 0 0 0) 0x7f80680f4320 con 0x7f807015c060 2023-07-09T02:18:31.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.767+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7f805406ec70 con 0x7f807015c060 2023-07-09T02:18:31.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.771+0000 7f806d7fa640 1 -- 172.21.15.45:0/1438557248 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7f80701f5120 con 0x7f807015c060 2023-07-09T02:18:31.773 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:18:31.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.771+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8054066280 msgr2=0x7f8054068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.771+0000 7f8076e9c640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8054066280 0x7f8054068730 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8070158a80 tx=0x7f8064008040 comp rx=0 tx=0).stop 2023-07-09T02:18:31.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.771+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f807015c060 msgr2=0x7f807015ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.771+0000 7f8076e9c640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f807015c060 0x7f807015ecc0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f80680af040 tx=0x7f8068019480 comp rx=0 tx=0).stop 2023-07-09T02:18:31.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.775+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 shutdown_connections 2023-07-09T02:18:31.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.775+0000 7f8076e9c640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f807015c060 0x7f807015ecc0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.775+0000 7f8076e9c640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8054066280 0x7f8054068730 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.775+0000 7f8076e9c640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80700d2450 0x7f80700ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.775+0000 7f8076e9c640 1 --2- 172.21.15.45:0/1438557248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80700cd120 0x7f8070151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.775+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 >> 172.21.15.45:0/1438557248 conn(0x7f80700698e0 msgr2=0x7f80700b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:31.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.775+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 shutdown_connections 2023-07-09T02:18:31.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.775+0000 7f8076e9c640 1 -- 172.21.15.45:0/1438557248 wait complete. 2023-07-09T02:18:31.785 INFO:tasks.ceph.mds.b.smithi155.stderr: -9126> 2023-07-09T02:17:51.825+0000 7f730bf77640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:18:31.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:18:31.841 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:18:31.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecefc56640 1 Processor -- start 2023-07-09T02:18:31.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecefc56640 1 -- start start 2023-07-09T02:18:31.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecefc56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fece815c060 0x7fece80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecefc56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fece80cd120 0x7fece80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecefc56640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece8160a50 con 0x7fece80d2450 2023-07-09T02:18:31.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecefc56640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece80d28d0 con 0x7fece80cd120 2023-07-09T02:18:31.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecefc56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece80cfe40 con 0x7fece815c060 2023-07-09T02:18:31.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7feced1f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fece80cd120 0x7fece80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecee1f3640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fece80d2450 0x7fece80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33078/0 (socket says 172.21.15.45:33078) 2023-07-09T02:18:31.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.939+0000 7fecee1f3640 1 -- 172.21.15.45:0/3146119674 learned_addr learned my addr 172.21.15.45:0/3146119674 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:31.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7feced9f2640 1 --2- 172.21.15.45:0/3146119674 >> v2:172.21.15.155:3300/0 conn(0x7fece815c060 0x7fece80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7feced1f1640 1 -- 172.21.15.45:0/3146119674 >> v2:172.21.15.155:3300/0 conn(0x7fece815c060 msgr2=0x7fece80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:31.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7feced1f1640 1 --2- 172.21.15.45:0/3146119674 >> v2:172.21.15.155:3300/0 conn(0x7fece815c060 0x7fece80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7feced1f1640 1 -- 172.21.15.45:0/3146119674 >> v1:172.21.15.45:6789/0 conn(0x7fece80d2450 legacy=0x7fece80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7fecec9f0640 1 -- 172.21.15.45:0/3146119674 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447673256 0 0) 0x7fece8160a50 con 0x7fece80d2450 2023-07-09T02:18:31.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7feced1f1640 1 -- 172.21.15.45:0/3146119674 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece815c430 con 0x7fece80cd120 2023-07-09T02:18:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7feced1f1640 1 --2- 172.21.15.45:0/3146119674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80cd120 0x7fece80d1f10 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fece80d3ad0 tx=0x7fecd801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d2c6c100a4ed0c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7fecec9f0640 1 -- 172.21.15.45:0/3146119674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8004230 con 0x7fece80cd120 2023-07-09T02:18:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7fecec9f0640 1 -- 172.21.15.45:0/3146119674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd80a7050 con 0x7fece80cd120 2023-07-09T02:18:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.943+0000 7fecec9f0640 1 -- 172.21.15.45:0/3146119674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8003620 con 0x7fece80cd120 2023-07-09T02:18:31.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- 172.21.15.45:0/3146119674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80cd120 msgr2=0x7fece80d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 --2- 172.21.15.45:0/3146119674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80cd120 0x7fece80d1f10 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fece80d3ad0 tx=0x7fecd801c430 comp rx=0 tx=0).stop 2023-07-09T02:18:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- 172.21.15.45:0/3146119674 shutdown_connections 2023-07-09T02:18:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 --2- 172.21.15.45:0/3146119674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80cd120 0x7fece80d1f10 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 --2- 172.21.15.45:0/3146119674 >> v2:172.21.15.155:3300/0 conn(0x7fece815c060 0x7fece80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- 172.21.15.45:0/3146119674 >> 172.21.15.45:0/3146119674 conn(0x7fece80698e0 msgr2=0x7fece8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- 172.21.15.45:0/3146119674 shutdown_connections 2023-07-09T02:18:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- 172.21.15.45:0/3146119674 wait complete. 2023-07-09T02:18:31.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 Processor -- start 2023-07-09T02:18:31.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- start start 2023-07-09T02:18:31.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fece80cd120 0x7fece815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80d2450 0x7fece8156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fece815c060 0x7fece81599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8157260 con 0x7fece80d2450 2023-07-09T02:18:31.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8156790 con 0x7fece815c060 2023-07-09T02:18:31.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecefc56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece81569c0 con 0x7fece80cd120 2023-07-09T02:18:31.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced1f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80d2450 0x7fece8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced1f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80d2450 0x7fece8156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42324/0 (socket says 172.21.15.45:42324) 2023-07-09T02:18:31.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced1f1640 1 -- 172.21.15.45:0/3586484383 learned_addr learned my addr 172.21.15.45:0/3586484383 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:31.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced9f2640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fece80cd120 0x7fece815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7fecee1f3640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fece815c060 0x7fece81599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced1f1640 1 -- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fece80cd120 msgr2=0x7fece815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced1f1640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fece80cd120 0x7fece815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced1f1640 1 -- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fece815c060 msgr2=0x7fece81599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:31.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced1f1640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fece815c060 0x7fece81599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:31.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.947+0000 7feced1f1640 1 -- 172.21.15.45:0/3586484383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8009420 con 0x7fece80d2450 2023-07-09T02:18:31.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7feced1f1640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80d2450 0x7fece8156250 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fecd8019040 tx=0x7fecd80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecde7fc640 1 -- 172.21.15.45:0/3586484383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8003bf0 con 0x7fece80d2450 2023-07-09T02:18:31.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecde7fc640 1 -- 172.21.15.45:0/3586484383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd8003d50 con 0x7fece80d2450 2023-07-09T02:18:31.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece8156ca0 con 0x7fece80d2450 2023-07-09T02:18:31.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecde7fc640 1 -- 172.21.15.45:0/3586484383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd80ab640 con 0x7fece80d2450 2023-07-09T02:18:31.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece80c9cb0 con 0x7fece80d2450 2023-07-09T02:18:31.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece80c9af0 con 0x7fece80d2450 2023-07-09T02:18:31.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecde7fc640 1 -- 172.21.15.45:0/3586484383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fecd80b2040 con 0x7fece80d2450 2023-07-09T02:18:31.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecde7fc640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feccc066280 0x7feccc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:31.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecde7fc640 1 -- 172.21.15.45:0/3586484383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fecd811dd30 con 0x7fece80d2450 2023-07-09T02:18:31.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7feced9f2640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feccc066280 0x7feccc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:31.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.951+0000 7fecde7fc640 1 -- 172.21.15.45:0/3586484383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7feccc06e4d0 con 0x7fece80d2450 2023-07-09T02:18:31.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.955+0000 7feced9f2640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feccc066280 0x7feccc068730 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fece400b930 tx=0x7fece4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:31.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:31.955+0000 7fecde7fc640 1 -- 172.21.15.45:0/3586484383 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecd80b0060 con 0x7fece80d2450 2023-07-09T02:18:32.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.143+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fece80c9ea0 con 0x7fece80d2450 2023-07-09T02:18:32.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.771+0000 7fecde7fc640 1 -- 172.21.15.45:0/3586484383 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7fecd80eb150 con 0x7fece80d2450 2023-07-09T02:18:32.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feccc066280 msgr2=0x7feccc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:32.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feccc066280 0x7feccc068730 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fece400b930 tx=0x7fece4008040 comp rx=0 tx=0).stop 2023-07-09T02:18:32.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80d2450 msgr2=0x7fece8156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:32.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80d2450 0x7fece8156250 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fecd8019040 tx=0x7fecd80191d0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 shutdown_connections 2023-07-09T02:18:32.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fece815c060 0x7fece81599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece80d2450 0x7fece8156250 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feccc066280 0x7feccc068730 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 --2- 172.21.15.45:0/3586484383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fece80cd120 0x7fece815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 >> 172.21.15.45:0/3586484383 conn(0x7fece80698e0 msgr2=0x7fece80b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:32.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 shutdown_connections 2023-07-09T02:18:32.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.775+0000 7fecefc56640 1 -- 172.21.15.45:0/3586484383 wait complete. 2023-07-09T02:18:32.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:18:32.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8ce1c19640 1 Processor -- start 2023-07-09T02:18:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8ce1c19640 1 -- start start 2023-07-09T02:18:32.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8ce1c19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8cdc0cafc0 0x7f8cdc0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:32.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8ce1c19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cdc0c9660 0x7f8cdc0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8ce1c19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc0cd540 con 0x7f8cdc0b3e90 2023-07-09T02:18:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8ce1c19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc0cd350 con 0x7f8cdc0c9660 2023-07-09T02:18:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8ce1c19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc0c9bd0 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8cdaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cdc0c9660 0x7f8cdc0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8cdaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cdc0c9660 0x7f8cdc0b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42332/0 (socket says 172.21.15.45:42332) 2023-07-09T02:18:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.947+0000 7f8cdaffd640 1 -- 172.21.15.45:0/1413642729 learned_addr learned my addr 172.21.15.45:0/1413642729 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8cdaffd640 1 -- 172.21.15.45:0/1413642729 >> v2:172.21.15.155:3300/0 conn(0x7f8cdc0cafc0 msgr2=0x7f8cdc0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8cdaffd640 1 --2- 172.21.15.45:0/1413642729 >> v2:172.21.15.155:3300/0 conn(0x7f8cdc0cafc0 0x7f8cdc0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8cdaffd640 1 -- 172.21.15.45:0/1413642729 >> v1:172.21.15.155:6789/0 conn(0x7f8cdc0b3e90 legacy=0x7f8cdc0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8cdaffd640 1 -- 172.21.15.45:0/1413642729 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0cb8d0 con 0x7f8cdc0c9660 2023-07-09T02:18:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8cdaffd640 1 --2- 172.21.15.45:0/1413642729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0c9660 0x7f8cdc0b0080 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc06a3a0 tx=0x7f8cd001fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3f899103c5b3c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8cda7fc640 1 -- 172.21.15.45:0/1413642729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00a9ac0 con 0x7f8cdc0c9660 2023-07-09T02:18:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8cda7fc640 1 -- 172.21.15.45:0/1413642729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd00a9c20 con 0x7f8cdc0c9660 2023-07-09T02:18:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8cda7fc640 1 -- 172.21.15.45:0/1413642729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00b1440 con 0x7f8cdc0c9660 2023-07-09T02:18:32.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1413642729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0c9660 msgr2=0x7f8cdc0b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:32.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.951+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1413642729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0c9660 0x7f8cdc0b0080 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc06a3a0 tx=0x7f8cd001fdc0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1413642729 shutdown_connections 2023-07-09T02:18:32.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1413642729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0c9660 0x7f8cdc0b0080 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1413642729 >> v2:172.21.15.155:3300/0 conn(0x7f8cdc0cafc0 0x7f8cdc0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1413642729 >> 172.21.15.45:0/1413642729 conn(0x7f8cdc06ae60 msgr2=0x7f8cdc06b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:32.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1413642729 shutdown_connections 2023-07-09T02:18:32.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1413642729 wait complete. 2023-07-09T02:18:32.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 Processor -- start 2023-07-09T02:18:32.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 -- start start 2023-07-09T02:18:32.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc0b3e90 0x7f8cdc0c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:32.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cdc0c9660 0x7f8cdc1f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:32.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0cafc0 0x7f8cdc156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:32.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0c2f70 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc1f9f00 con 0x7f8cdc0b3e90 2023-07-09T02:18:32.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8ce1c19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc1570e0 con 0x7f8cdc0c9660 2023-07-09T02:18:32.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0cafc0 0x7f8cdc156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:32.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0cafc0 0x7f8cdc156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42336/0 (socket says 172.21.15.45:42336) 2023-07-09T02:18:32.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdbfff640 1 -- 172.21.15.45:0/1195483079 learned_addr learned my addr 172.21.15.45:0/1195483079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:32.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdb7fe640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc0b3e90 0x7f8cdc0c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:32.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdaffd640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cdc0c9660 0x7f8cdc1f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:32.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdbfff640 1 -- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cdc0c9660 msgr2=0x7f8cdc1f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:32.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdbfff640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cdc0c9660 0x7f8cdc1f99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdbfff640 1 -- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc0b3e90 msgr2=0x7f8cdc0c2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:32.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdbfff640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc0b3e90 0x7f8cdc0c2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:32.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.955+0000 7f8cdbfff640 1 -- 172.21.15.45:0/1195483079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd00094d0 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.959+0000 7f8cdbfff640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0cafc0 0x7f8cdc156ba0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c7b0 tx=0x7f8cd400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:32.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.959+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4003d90 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.959+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd4005070 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.959+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4005420 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.959+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc15b940 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.959+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc158e80 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.959+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc0cd7c0 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.959+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8cd4005580 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.963+0000 7f8cc3fff640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cc8066280 0x7f8cc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:32.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.963+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8cd40831d0 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.963+0000 7f8cdb7fe640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cc8066280 0x7f8cc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:32.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.963+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7f8cc806e4d0 con 0x7f8cdc0cafc0 2023-07-09T02:18:32.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.963+0000 7f8cdb7fe640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cc8066280 0x7f8cc8068730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc006fd0 tx=0x7f8ccc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:32.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:32.967+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8cdc0cd7c0 con 0x7f8cdc0cafc0 2023-07-09T02:18:33.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.123+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8cdc158a00 con 0x7f8cdc0cafc0 2023-07-09T02:18:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.771+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(144..144 src has 1..144) v4 ==== 296+0+0 (secure 0 0 0) 0x7f8cd405a0c0 con 0x7f8cdc0cafc0 2023-07-09T02:18:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.771+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7f8cc806c900 con 0x7f8cdc0cafc0 2023-07-09T02:18:33.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.779+0000 7f8cc3fff640 1 -- 172.21.15.45:0/1195483079 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8cdc158a00 con 0x7f8cdc0cafc0 2023-07-09T02:18:33.781 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:18:33.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cc8066280 msgr2=0x7f8cc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cc8066280 0x7f8cc8068730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc006fd0 tx=0x7f8ccc008040 comp rx=0 tx=0).stop 2023-07-09T02:18:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0cafc0 msgr2=0x7f8cdc156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0cafc0 0x7f8cdc156ba0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c7b0 tx=0x7f8cd400cc70 comp rx=0 tx=0).stop 2023-07-09T02:18:33.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 shutdown_connections 2023-07-09T02:18:33.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cdc0cafc0 0x7f8cdc156ba0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8cc8066280 0x7f8cc8068730 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cdc0c9660 0x7f8cdc1f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 --2- 172.21.15.45:0/1195483079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc0b3e90 0x7f8cdc0c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 >> 172.21.15.45:0/1195483079 conn(0x7f8cdc06ae60 msgr2=0x7f8cdc157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 shutdown_connections 2023-07-09T02:18:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.783+0000 7f8ce1c19640 1 -- 172.21.15.45:0/1195483079 wait complete. 2023-07-09T02:18:33.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:18:33.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335c8a640 1 Processor -- start 2023-07-09T02:18:33.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335c8a640 1 -- start start 2023-07-09T02:18:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335c8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335c8a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3300cead0 0x7fe330160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335c8a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3300cced0 con 0x7fe330069980 2023-07-09T02:18:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335c8a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3300cd6e0 con 0x7fe3300cead0 2023-07-09T02:18:33.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335c8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300d0450 con 0x7fe33015c280 2023-07-09T02:18:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe32ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3300cead0 0x7fe330160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335489640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe330069980 0x7fe3300d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33080/0 (socket says 172.21.15.45:33080) 2023-07-09T02:18:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe335489640 1 -- 172.21.15.45:0/358417094 learned_addr learned my addr 172.21.15.45:0/358417094 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:33.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe32ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3300cead0 0x7fe330160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42344/0 (socket says 172.21.15.45:42344) 2023-07-09T02:18:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe334c88640 1 --2- 172.21.15.45:0/358417094 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe32ffff640 1 -- 172.21.15.45:0/358417094 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 msgr2=0x7fe3300b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe32ffff640 1 --2- 172.21.15.45:0/358417094 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe32ffff640 1 -- 172.21.15.45:0/358417094 >> v1:172.21.15.45:6789/0 conn(0x7fe330069980 legacy=0x7fe3300d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe32ffff640 1 -- 172.21.15.45:0/358417094 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330160b40 con 0x7fe3300cead0 2023-07-09T02:18:33.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.955+0000 7fe32f7fe640 1 -- 172.21.15.45:0/358417094 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540731150 0 0) 0x7fe3300cced0 con 0x7fe330069980 2023-07-09T02:18:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe32ffff640 1 --2- 172.21.15.45:0/358417094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3300cead0 0x7fe330160600 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0097c0 tx=0x7fe31c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26887f22fc86613 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe32f7fe640 1 -- 172.21.15.45:0/358417094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0ab680 con 0x7fe3300cead0 2023-07-09T02:18:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe32f7fe640 1 -- 172.21.15.45:0/358417094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c0ab7e0 con 0x7fe3300cead0 2023-07-09T02:18:33.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe32f7fe640 1 -- 172.21.15.45:0/358417094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0abb70 con 0x7fe3300cead0 2023-07-09T02:18:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 -- 172.21.15.45:0/358417094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3300cead0 msgr2=0x7fe330160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 --2- 172.21.15.45:0/358417094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3300cead0 0x7fe330160600 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0097c0 tx=0x7fe31c01c480 comp rx=0 tx=0).stop 2023-07-09T02:18:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 -- 172.21.15.45:0/358417094 shutdown_connections 2023-07-09T02:18:33.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 --2- 172.21.15.45:0/358417094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3300cead0 0x7fe330160600 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 --2- 172.21.15.45:0/358417094 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 -- 172.21.15.45:0/358417094 >> 172.21.15.45:0/358417094 conn(0x7fe3300cff90 msgr2=0x7fe3300d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 -- 172.21.15.45:0/358417094 shutdown_connections 2023-07-09T02:18:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 -- 172.21.15.45:0/358417094 wait complete. 2023-07-09T02:18:33.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 Processor -- start 2023-07-09T02:18:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.959+0000 7fe335c8a640 1 -- start start 2023-07-09T02:18:33.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe330069980 0x7fe33014ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3300cead0 0x7fe3300b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3301507d0 con 0x7fe330069980 2023-07-09T02:18:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33014da50 con 0x7fe3300cead0 2023-07-09T02:18:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33015b6d0 con 0x7fe33015c280 2023-07-09T02:18:33.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe330069980 0x7fe33014ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:33.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe330069980 0x7fe33014ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42348/0 (socket says 172.21.15.45:42348) 2023-07-09T02:18:33.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 -- 172.21.15.45:0/2606192598 learned_addr learned my addr 172.21.15.45:0/2606192598 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:33.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 -- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 msgr2=0x7fe3300b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335489640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe32ffff640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3300cead0 0x7fe3300b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 -- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3300cead0 msgr2=0x7fe3300b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:33.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3300cead0 0x7fe3300b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 -- 172.21.15.45:0/2606192598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c009420 con 0x7fe330069980 2023-07-09T02:18:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335489640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe32ffff640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3300cead0 0x7fe3300b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe334c88640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe330069980 0x7fe33014ae20 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe32400e930 tx=0x7fe32400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324009690 con 0x7fe330069980 2023-07-09T02:18:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32400ca00 con 0x7fe330069980 2023-07-09T02:18:33.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400cd70 con 0x7fe330069980 2023-07-09T02:18:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33014dcf0 con 0x7fe330069980 2023-07-09T02:18:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33014e2b0 con 0x7fe330069980 2023-07-09T02:18:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.963+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33004e020 con 0x7fe330069980 2023-07-09T02:18:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.967+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe324013470 con 0x7fe330069980 2023-07-09T02:18:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.967+0000 7fe32d7fa640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe314066280 0x7fe314068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.967+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fe324083d90 con 0x7fe330069980 2023-07-09T02:18:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.967+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7fe31406d660 con 0x7fe330069980 2023-07-09T02:18:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.967+0000 7fe32ffff640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe314066280 0x7fe314068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:33.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.967+0000 7fe32ffff640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe314066280 0x7fe314068730 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0af000 tx=0x7fe31c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:33.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:33.971+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe324017060 con 0x7fe330069980 2023-07-09T02:18:34.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.123+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3300d31b0 con 0x7fe330069980 2023-07-09T02:18:34.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.775+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(145..145 src has 1..145) v4 ==== 296+0+0 (secure 0 0 0) 0x7fe324059140 con 0x7fe330069980 2023-07-09T02:18:34.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.775+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7fe31406c3f0 con 0x7fe330069980 2023-07-09T02:18:34.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.779+0000 7fe32d7fa640 1 -- 172.21.15.45:0/2606192598 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe324021070 con 0x7fe330069980 2023-07-09T02:18:34.784 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:18:34.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe314066280 msgr2=0x7fe314068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:34.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe314066280 0x7fe314068730 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0af000 tx=0x7fe31c0a7000 comp rx=0 tx=0).stop 2023-07-09T02:18:34.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe330069980 msgr2=0x7fe33014ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:34.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe330069980 0x7fe33014ae20 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe32400e930 tx=0x7fe32400edf0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 shutdown_connections 2023-07-09T02:18:34.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe314066280 0x7fe314068730 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe33015c280 0x7fe3300b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3300cead0 0x7fe3300b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 --2- 172.21.15.45:0/2606192598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe330069980 0x7fe33014ae20 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 >> 172.21.15.45:0/2606192598 conn(0x7fe3300cff90 msgr2=0x7fe3300b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 shutdown_connections 2023-07-09T02:18:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.787+0000 7fe335c8a640 1 -- 172.21.15.45:0/2606192598 wait complete. 2023-07-09T02:18:34.810 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:18:34.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7c5782640 1 Processor -- start 2023-07-09T02:18:34.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7c5782640 1 -- start start 2023-07-09T02:18:34.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7c5782640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd7c015c060 0x7fd7c00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:34.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7c5782640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00cd120 0x7fd7c00d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:34.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7c5782640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c0160a50 con 0x7fd7c00d2450 2023-07-09T02:18:34.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7c5782640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c00d28f0 con 0x7fd7c015c060 2023-07-09T02:18:34.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7c5782640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00cfe40 con 0x7fd7c00cd120 2023-07-09T02:18:34.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7bf7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd7c00d2450 0x7fd7c00d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33096/0 (socket says 172.21.15.45:33096) 2023-07-09T02:18:34.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7bf7fe640 1 -- 172.21.15.45:0/1758931036 learned_addr learned my addr 172.21.15.45:0/1758931036 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:34.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7beffd640 1 --2- 172.21.15.45:0/1758931036 >> v2:172.21.15.155:3300/0 conn(0x7fd7c015c060 0x7fd7c00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:34.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7be7fc640 1 --2- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00cd120 0x7fd7c00d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:34.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7bdffb640 1 -- 172.21.15.45:0/1758931036 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036573508 0 0) 0x7fd7c0160a50 con 0x7fd7c00d2450 2023-07-09T02:18:34.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7bdffb640 1 -- 172.21.15.45:0/1758931036 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a8003530 con 0x7fd7c00d2450 2023-07-09T02:18:34.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7bdffb640 1 -- 172.21.15.45:0/1758931036 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 46557666 0 0) 0x7fd7a8003530 con 0x7fd7c00d2450 2023-07-09T02:18:34.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7beffd640 1 -- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00cd120 msgr2=0x7fd7c00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:34.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7beffd640 1 --2- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00cd120 0x7fd7c00d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7beffd640 1 -- 172.21.15.45:0/1758931036 >> v1:172.21.15.45:6789/0 conn(0x7fd7c00d2450 legacy=0x7fd7c00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:34.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7beffd640 1 -- 172.21.15.45:0/1758931036 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c015c430 con 0x7fd7c015c060 2023-07-09T02:18:34.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.955+0000 7fd7be7fc640 1 --2- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00cd120 0x7fd7c00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:34.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7beffd640 1 --2- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c015c060 0x7fd7c00b4ed0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00097c0 tx=0x7fd7b001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18a77f38d6854c6b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:34.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7bdffb640 1 -- 172.21.15.45:0/1758931036 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8001a00 con 0x7fd7c015c060 2023-07-09T02:18:34.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7bdffb640 1 -- 172.21.15.45:0/1758931036 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b00a7050 con 0x7fd7c015c060 2023-07-09T02:18:34.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7bdffb640 1 -- 172.21.15.45:0/1758931036 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00ab620 con 0x7fd7c015c060 2023-07-09T02:18:34.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7c5782640 1 -- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c015c060 msgr2=0x7fd7c00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:34.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7c5782640 1 --2- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c015c060 0x7fd7c00b4ed0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00097c0 tx=0x7fd7b001c370 comp rx=0 tx=0).stop 2023-07-09T02:18:34.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7c5782640 1 -- 172.21.15.45:0/1758931036 shutdown_connections 2023-07-09T02:18:34.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7c5782640 1 --2- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00cd120 0x7fd7c00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7c5782640 1 --2- 172.21.15.45:0/1758931036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c015c060 0x7fd7c00b4ed0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7c5782640 1 -- 172.21.15.45:0/1758931036 >> 172.21.15.45:0/1758931036 conn(0x7fd7c00698e0 msgr2=0x7fd7c0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:34.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7c5782640 1 -- 172.21.15.45:0/1758931036 shutdown_connections 2023-07-09T02:18:34.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.959+0000 7fd7c5782640 1 -- 172.21.15.45:0/1758931036 wait complete. 2023-07-09T02:18:34.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 Processor -- start 2023-07-09T02:18:34.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 -- start start 2023-07-09T02:18:34.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c00cd120 0x7fd7c014e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:34.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00d2450 0x7fd7c00b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:34.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c015c060 0x7fd7c0157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:34.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c0152310 con 0x7fd7c015c060 2023-07-09T02:18:34.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c014eaf0 con 0x7fd7c00cd120 2023-07-09T02:18:34.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00b4400 con 0x7fd7c00d2450 2023-07-09T02:18:34.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7bf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c015c060 0x7fd7c0157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:34.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7beffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c00cd120 0x7fd7c014e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:34.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7beffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c00cd120 0x7fd7c014e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:50472/0 (socket says 172.21.15.45:50472) 2023-07-09T02:18:34.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7beffd640 1 -- 172.21.15.45:0/3574299591 learned_addr learned my addr 172.21.15.45:0/3574299591 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:34.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7be7fc640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00d2450 0x7fd7c00b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:34.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7bf7fe640 1 -- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00d2450 msgr2=0x7fd7c00b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:34.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7bf7fe640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00d2450 0x7fd7c00b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7bf7fe640 1 -- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c00cd120 msgr2=0x7fd7c014e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:34.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7bf7fe640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c00cd120 0x7fd7c014e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:34.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7bf7fe640 1 -- 172.21.15.45:0/3574299591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009420 con 0x7fd7c015c060 2023-07-09T02:18:34.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7beffd640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c00cd120 0x7fd7c014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:34.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7bf7fe640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c015c060 0x7fd7c0157d90 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800cc40 tx=0x7fd7b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:34.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3574299591 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800ce50 con 0x7fd7c015c060 2023-07-09T02:18:34.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3574299591 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b8012400 con 0x7fd7c015c060 2023-07-09T02:18:34.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3574299591 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b80127f0 con 0x7fd7c015c060 2023-07-09T02:18:34.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b0009420 con 0x7fd7c015c060 2023-07-09T02:18:34.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.963+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c00b49b0 con 0x7fd7c015c060 2023-07-09T02:18:34.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.967+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c01524c0 con 0x7fd7c015c060 2023-07-09T02:18:34.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.967+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3574299591 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7b8012950 con 0x7fd7c015c060 2023-07-09T02:18:34.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.967+0000 7fd7a77fe640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7ac066280 0x7fd7ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:34.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.967+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3574299591 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd7b8083ff0 con 0x7fd7c015c060 2023-07-09T02:18:34.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.967+0000 7fd7beffd640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7ac066280 0x7fd7ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:34.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.967+0000 7fd7beffd640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7ac066280 0x7fd7ac068730 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00097c0 tx=0x7fd7b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:34.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:34.971+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3574299591 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7b80b4700 con 0x7fd7c015c060 2023-07-09T02:18:35.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.127+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd7c004d7d0 con 0x7fd7c015c060 2023-07-09T02:18:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.131+0000 7fd7a77fe640 1 -- 172.21.15.45:0/3574299591 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd7c01524c0 con 0x7fd7c015c060 2023-07-09T02:18:35.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7ac066280 msgr2=0x7fd7ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7ac066280 0x7fd7ac068730 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00097c0 tx=0x7fd7b00a6000 comp rx=0 tx=0).stop 2023-07-09T02:18:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c015c060 msgr2=0x7fd7c0157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c015c060 0x7fd7c0157d90 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800cc40 tx=0x7fd7b800a430 comp rx=0 tx=0).stop 2023-07-09T02:18:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 shutdown_connections 2023-07-09T02:18:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7c015c060 0x7fd7c0157d90 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd7ac066280 0x7fd7ac068730 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7c00d2450 0x7fd7c00b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 --2- 172.21.15.45:0/3574299591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7c00cd120 0x7fd7c014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 >> 172.21.15.45:0/3574299591 conn(0x7fd7c00698e0 msgr2=0x7fd7c00b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 shutdown_connections 2023-07-09T02:18:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.135+0000 7fd7c5782640 1 -- 172.21.15.45:0/3574299591 wait complete. 2023-07-09T02:18:35.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-07-09T02:18:35.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.295+0000 7fc950f1f640 1 Processor -- start 2023-07-09T02:18:35.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.295+0000 7fc950f1f640 1 -- start start 2023-07-09T02:18:35.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.295+0000 7fc950f1f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc94c0cb5d0 0x7fc94c06c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.295+0000 7fc950f1f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c06caa0 con 0x7fc94c06c110 2023-07-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc950f1f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c0ccf80 con 0x7fc94c158e30 2023-07-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc950f1f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0cd540 con 0x7fc94c0cb5d0 2023-07-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc94ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc94c0cb5d0 0x7fc94c06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc943fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc94c06c110 0x7fc94c0caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33104/0 (socket says 172.21.15.45:33104) 2023-07-09T02:18:35.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc943fff640 1 -- 172.21.15.45:0/3451072909 learned_addr learned my addr 172.21.15.45:0/3451072909 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc94ad9d640 1 -- 172.21.15.45:0/3451072909 >> v1:172.21.15.155:6789/0 conn(0x7fc94c158e30 legacy=0x7fc94c06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc94ad9d640 1 -- 172.21.15.45:0/3451072909 >> v1:172.21.15.45:6789/0 conn(0x7fc94c06c110 legacy=0x7fc94c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc94ad9d640 1 -- 172.21.15.45:0/3451072909 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0c8fb0 con 0x7fc94c0cb5d0 2023-07-09T02:18:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc949d9b640 1 -- 172.21.15.45:0/3451072909 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369753520 0 0) 0x7fc934001120 con 0x7fc94c06c110 2023-07-09T02:18:35.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc94ad9d640 1 --2- 172.21.15.45:0/3451072909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cb5d0 0x7fc94c06c560 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc944009d90 tx=0x7fc94401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2318985bbb4cb3e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:35.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc949d9b640 1 -- 172.21.15.45:0/3451072909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440a5950 con 0x7fc94c0cb5d0 2023-07-09T02:18:35.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc949d9b640 1 -- 172.21.15.45:0/3451072909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9440a5ab0 con 0x7fc94c0cb5d0 2023-07-09T02:18:35.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.299+0000 7fc949d9b640 1 -- 172.21.15.45:0/3451072909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440a5e40 con 0x7fc94c0cb5d0 2023-07-09T02:18:35.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- 172.21.15.45:0/3451072909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cb5d0 msgr2=0x7fc94c06c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 --2- 172.21.15.45:0/3451072909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cb5d0 0x7fc94c06c560 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc944009d90 tx=0x7fc94401c890 comp rx=0 tx=0).stop 2023-07-09T02:18:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- 172.21.15.45:0/3451072909 shutdown_connections 2023-07-09T02:18:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 --2- 172.21.15.45:0/3451072909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cb5d0 0x7fc94c06c560 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- 172.21.15.45:0/3451072909 >> 172.21.15.45:0/3451072909 conn(0x7fc94c0694b0 msgr2=0x7fc94c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- 172.21.15.45:0/3451072909 shutdown_connections 2023-07-09T02:18:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- 172.21.15.45:0/3451072909 wait complete. 2023-07-09T02:18:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 Processor -- start 2023-07-09T02:18:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- start start 2023-07-09T02:18:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c06c110 0x7fc94c159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cb5d0 0x7fc94c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c158e30 0x7fc94c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c5d00 con 0x7fc94c06c110 2023-07-09T02:18:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0b3e90 con 0x7fc94c0cb5d0 2023-07-09T02:18:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc950f1f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c159ef0 con 0x7fc94c158e30 2023-07-09T02:18:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc94a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c06c110 0x7fc94c159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc94a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c06c110 0x7fc94c159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42370/0 (socket says 172.21.15.45:42370) 2023-07-09T02:18:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc94a59c640 1 -- 172.21.15.45:0/646552137 learned_addr learned my addr 172.21.15.45:0/646552137 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc943fff640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cb5d0 0x7fc94c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.303+0000 7fc94ad9d640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c158e30 0x7fc94c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc94a59c640 1 -- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c158e30 msgr2=0x7fc94c15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc94a59c640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c158e30 0x7fc94c15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc94a59c640 1 -- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cb5d0 msgr2=0x7fc94c1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc94a59c640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cb5d0 0x7fc94c1598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc94a59c640 1 -- 172.21.15.45:0/646552137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009a70 con 0x7fc94c06c110 2023-07-09T02:18:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc94a59c640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c06c110 0x7fc94c159380 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00c3c0 tx=0x7fc93c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc942ffd640 1 -- 172.21.15.45:0/646552137 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0052d0 con 0x7fc94c06c110 2023-07-09T02:18:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc942ffd640 1 -- 172.21.15.45:0/646552137 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c005430 con 0x7fc94c06c110 2023-07-09T02:18:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc942ffd640 1 -- 172.21.15.45:0/646552137 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c003840 con 0x7fc94c06c110 2023-07-09T02:18:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c15a1d0 con 0x7fc94c06c110 2023-07-09T02:18:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c15a790 con 0x7fc94c06c110 2023-07-09T02:18:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c04d7d0 con 0x7fc94c06c110 2023-07-09T02:18:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc942ffd640 1 -- 172.21.15.45:0/646552137 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc93c0039a0 con 0x7fc94c06c110 2023-07-09T02:18:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc942ffd640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc92c066280 0x7fc92c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.307+0000 7fc942ffd640 1 -- 172.21.15.45:0/646552137 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc93c082eb0 con 0x7fc94c06c110 2023-07-09T02:18:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.311+0000 7fc943fff640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc92c066280 0x7fc92c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.311+0000 7fc943fff640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc92c066280 0x7fc92c068730 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0c8790 tx=0x7fc934007d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.311+0000 7fc942ffd640 1 -- 172.21.15.45:0/646552137 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc93c0506e0 con 0x7fc94c06c110 2023-07-09T02:18:35.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.527+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fc94c15b7b0 con 0x7fc94c06c110 2023-07-09T02:18:35.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.559+0000 7fc942ffd640 1 -- 172.21.15.45:0/646552137 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v395) v1 ==== 140+0+0 (secure 0 0 0) 0x7fc93c053d00 con 0x7fc94c06c110 2023-07-09T02:18:35.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc92c066280 msgr2=0x7fc92c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc92c066280 0x7fc92c068730 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0c8790 tx=0x7fc934007d90 comp rx=0 tx=0).stop 2023-07-09T02:18:35.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c06c110 msgr2=0x7fc94c159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c06c110 0x7fc94c159380 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00c3c0 tx=0x7fc93c00c880 comp rx=0 tx=0).stop 2023-07-09T02:18:35.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 shutdown_connections 2023-07-09T02:18:35.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc92c066280 0x7fc92c068730 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c158e30 0x7fc94c15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cb5d0 0x7fc94c1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 --2- 172.21.15.45:0/646552137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c06c110 0x7fc94c159380 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 >> 172.21.15.45:0/646552137 conn(0x7fc94c0694b0 msgr2=0x7fc94c155490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:35.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 shutdown_connections 2023-07-09T02:18:35.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.563+0000 7fc950f1f640 1 -- 172.21.15.45:0/646552137 wait complete. 2023-07-09T02:18:35.585 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-07-09T02:18:35.585 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-07-09T02:18:35.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-07-09T02:18:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f8647c19640 1 Processor -- start 2023-07-09T02:18:35.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f8647c19640 1 -- start start 2023-07-09T02:18:35.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f8647c19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f864015c060 0x7f86400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f8647c19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86400cd120 0x7f86400d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f8647c19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8640160a50 con 0x7f86400d2450 2023-07-09T02:18:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f8647c19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86400d28f0 con 0x7f864015c060 2023-07-09T02:18:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f8647c19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86400cfe40 con 0x7f86400cd120 2023-07-09T02:18:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86461b6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f86400d2450 0x7f86400d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33114/0 (socket says 172.21.15.45:33114) 2023-07-09T02:18:35.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86461b6640 1 -- 172.21.15.45:0/2260254702 learned_addr learned my addr 172.21.15.45:0/2260254702 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:35.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86451b4640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86400cd120 0x7f86400d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86459b5640 1 --2- 172.21.15.45:0/2260254702 >> v2:172.21.15.155:3300/0 conn(0x7f864015c060 0x7f86400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514647451 0 0) 0x7f8640160a50 con 0x7f86400d2450 2023-07-09T02:18:35.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f862c003530 con 0x7f86400d2450 2023-07-09T02:18:35.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1541239853 0 0) 0x7f862c003530 con 0x7f86400d2450 2023-07-09T02:18:35.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86400cd120 msgr2=0x7f86400d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:35.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86400cd120 0x7f86400d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 >> v2:172.21.15.155:3300/0 conn(0x7f864015c060 msgr2=0x7f86400b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:35.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 --2- 172.21.15.45:0/2260254702 >> v2:172.21.15.155:3300/0 conn(0x7f864015c060 0x7f86400b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864015c430 con 0x7f86400d2450 2023-07-09T02:18:35.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f8638001a00 con 0x7f86400d2450 2023-07-09T02:18:35.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 >> v1:172.21.15.45:6789/0 conn(0x7f86400d2450 legacy=0x7f86400d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f862c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86400cd120 0x7f862c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.727+0000 7f86449b3640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f862c004d10 0x7f862c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86400cfe40 con 0x7f862c003980 2023-07-09T02:18:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c00b990 con 0x7f862c004d10 2023-07-09T02:18:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c00bad0 con 0x7f86400cd120 2023-07-09T02:18:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86459b5640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f862c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86451b4640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86400cd120 0x7f862c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86461b6640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f862c004d10 0x7f862c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86459b5640 1 -- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86400cd120 msgr2=0x7f862c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86459b5640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86400cd120 0x7f862c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86459b5640 1 -- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f862c004d10 msgr2=0x7f862c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86459b5640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f862c004d10 0x7f862c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86459b5640 1 -- 172.21.15.45:0/2260254702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c003530 con 0x7f862c003980 2023-07-09T02:18:35.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86459b5640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f862c003d90 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f863c009ae0 tx=0x7f863c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1875997f3fb1f2b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0a5540 con 0x7f862c003980 2023-07-09T02:18:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c0a56a0 con 0x7f862c003980 2023-07-09T02:18:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.731+0000 7f86449b3640 1 -- 172.21.15.45:0/2260254702 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0a5a50 con 0x7f862c003980 2023-07-09T02:18:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- 172.21.15.45:0/2260254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 msgr2=0x7f862c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 --2- 172.21.15.45:0/2260254702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f862c003d90 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f863c009ae0 tx=0x7f863c01ca00 comp rx=0 tx=0).stop 2023-07-09T02:18:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86461b6640 1 -- 172.21.15.45:0/2260254702 reap_dead start 2023-07-09T02:18:35.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- 172.21.15.45:0/2260254702 shutdown_connections 2023-07-09T02:18:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- 172.21.15.45:0/2260254702 >> 172.21.15.45:0/2260254702 conn(0x7f86400698e0 msgr2=0x7f8640069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- 172.21.15.45:0/2260254702 shutdown_connections 2023-07-09T02:18:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- 172.21.15.45:0/2260254702 wait complete. 2023-07-09T02:18:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 Processor -- start 2023-07-09T02:18:35.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- start start 2023-07-09T02:18:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f8640159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8640161b70 0x7f864015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86400c9b10 0x7f864015d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8640159bc0 con 0x7f862c003980 2023-07-09T02:18:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864015c8d0 con 0x7f86400c9b10 2023-07-09T02:18:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f8647c19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86400caa30 con 0x7f8640161b70 2023-07-09T02:18:35.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f8640159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f8640159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42382/0 (socket says 172.21.15.45:42382) 2023-07-09T02:18:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 -- 172.21.15.45:0/1699723839 learned_addr learned my addr 172.21.15.45:0/1699723839 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86461b6640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86400c9b10 0x7f864015d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86451b4640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8640161b70 0x7f864015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 -- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8640161b70 msgr2=0x7f864015d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8640161b70 0x7f864015d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 -- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86400c9b10 msgr2=0x7f864015d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86400c9b10 0x7f864015d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 -- 172.21.15.45:0/1699723839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86400cb520 con 0x7f862c003980 2023-07-09T02:18:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.735+0000 7f86459b5640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f8640159680 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f863c01d2a0 tx=0x7f862c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f86367fc640 1 -- 172.21.15.45:0/1699723839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00f000 con 0x7f862c003980 2023-07-09T02:18:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f86367fc640 1 -- 172.21.15.45:0/1699723839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c004020 con 0x7f862c003980 2023-07-09T02:18:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f86367fc640 1 -- 172.21.15.45:0/1699723839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0043d0 con 0x7f862c003980 2023-07-09T02:18:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86400cac80 con 0x7f862c003980 2023-07-09T02:18:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86400cb240 con 0x7f862c003980 2023-07-09T02:18:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864004d7d0 con 0x7f862c003980 2023-07-09T02:18:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f86367fc640 1 -- 172.21.15.45:0/1699723839 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f863c0b4040 con 0x7f862c003980 2023-07-09T02:18:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f86367fc640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8624066280 0x7f8624068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f86367fc640 1 -- 172.21.15.45:0/1699723839 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f863c11dae0 con 0x7f862c003980 2023-07-09T02:18:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.739+0000 7f86451b4640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8624066280 0x7f8624068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.743+0000 7f86451b4640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8624066280 0x7f8624068730 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f864015f7f0 tx=0x7f8630008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.743+0000 7f86367fc640 1 -- 172.21.15.45:0/1699723839 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f863c0eb440 con 0x7f862c003980 2023-07-09T02:18:35.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:35.951+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f864006baa0 con 0x7f862c003980 2023-07-09T02:18:36.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.563+0000 7f86367fc640 1 -- 172.21.15.45:0/1699723839 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v396) v1 ==== 135+0+0 (secure 0 0 0) 0x7f863c0eea60 con 0x7f862c003980 2023-07-09T02:18:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8624066280 msgr2=0x7f8624068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8624066280 0x7f8624068730 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f864015f7f0 tx=0x7f8630008040 comp rx=0 tx=0).stop 2023-07-09T02:18:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 msgr2=0x7f8640159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f8640159680 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f863c01d2a0 tx=0x7f862c005800 comp rx=0 tx=0).stop 2023-07-09T02:18:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 shutdown_connections 2023-07-09T02:18:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86400c9b10 0x7f864015d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8624066280 0x7f8624068730 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8640161b70 0x7f864015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 --2- 172.21.15.45:0/1699723839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f862c003980 0x7f8640159680 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 >> 172.21.15.45:0/1699723839 conn(0x7f86400698e0 msgr2=0x7f86400b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:36.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 shutdown_connections 2023-07-09T02:18:36.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.567+0000 7f8647c19640 1 -- 172.21.15.45:0/1699723839 wait complete. 2023-07-09T02:18:36.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:18:36.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c4ad82640 1 Processor -- start 2023-07-09T02:18:36.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c4ad82640 1 -- start start 2023-07-09T02:18:36.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c4ad82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4415c060 0x7f6c440b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c4ad82640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c440cd120 0x7f6c440d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c4ad82640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c44160a50 con 0x7f6c440d2450 2023-07-09T02:18:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c4ad82640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c440d28f0 con 0x7f6c440cd120 2023-07-09T02:18:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c4ad82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440cfe40 con 0x7f6c4415c060 2023-07-09T02:18:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c440cd120 0x7f6c440d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c440cd120 0x7f6c440d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42384/0 (socket says 172.21.15.45:42384) 2023-07-09T02:18:36.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c43fff640 1 -- 172.21.15.45:0/2822079290 learned_addr learned my addr 172.21.15.45:0/2822079290 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:36.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.739+0000 7f6c48b1e640 1 --2- 172.21.15.45:0/2822079290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4415c060 0x7f6c440b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:36.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c43fff640 1 -- 172.21.15.45:0/2822079290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4415c060 msgr2=0x7f6c440b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:36.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c43fff640 1 --2- 172.21.15.45:0/2822079290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4415c060 0x7f6c440b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c43fff640 1 -- 172.21.15.45:0/2822079290 >> v1:172.21.15.155:6789/0 conn(0x7f6c440d2450 legacy=0x7f6c440d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:36.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c43fff640 1 -- 172.21.15.45:0/2822079290 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4415c430 con 0x7f6c440cd120 2023-07-09T02:18:36.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c48b1e640 1 --2- 172.21.15.45:0/2822079290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4415c060 0x7f6c440b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:36.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c43fff640 1 --2- 172.21.15.45:0/2822079290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c440d1f10 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009870 tx=0x7f6c3001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97eb23573d4b605 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c437fe640 1 -- 172.21.15.45:0/2822079290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c300a7070 con 0x7f6c440cd120 2023-07-09T02:18:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c437fe640 1 -- 172.21.15.45:0/2822079290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c300ab430 con 0x7f6c440cd120 2023-07-09T02:18:36.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c437fe640 1 -- 172.21.15.45:0/2822079290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c300ab7c0 con 0x7f6c440cd120 2023-07-09T02:18:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c4ad82640 1 -- 172.21.15.45:0/2822079290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 msgr2=0x7f6c440d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/2822079290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c440d1f10 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009870 tx=0x7f6c3001c510 comp rx=0 tx=0).stop 2023-07-09T02:18:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c4ad82640 1 -- 172.21.15.45:0/2822079290 shutdown_connections 2023-07-09T02:18:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/2822079290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c440d1f10 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/2822079290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c4415c060 0x7f6c440b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c4ad82640 1 -- 172.21.15.45:0/2822079290 >> 172.21.15.45:0/2822079290 conn(0x7f6c440698e0 msgr2=0x7f6c44069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.743+0000 7f6c4ad82640 1 -- 172.21.15.45:0/2822079290 shutdown_connections 2023-07-09T02:18:36.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 -- 172.21.15.45:0/2822079290 wait complete. 2023-07-09T02:18:36.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 Processor -- start 2023-07-09T02:18:36.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 -- start start 2023-07-09T02:18:36.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c441521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:36.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c440d2450 0x7f6c44152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c4415c060 0x7f6c44152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441535f0 con 0x7f6c440cd120 2023-07-09T02:18:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441538d0 con 0x7f6c4415c060 2023-07-09T02:18:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4ad82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44153bb0 con 0x7f6c440d2450 2023-07-09T02:18:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c441521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c441521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42400/0 (socket says 172.21.15.45:42400) 2023-07-09T02:18:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 -- 172.21.15.45:0/4109348793 learned_addr learned my addr 172.21.15.45:0/4109348793 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:36.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4931f640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c4415c060 0x7f6c44152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:36.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c43fff640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c440d2450 0x7f6c44152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 -- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c440d2450 msgr2=0x7f6c44152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c440d2450 0x7f6c44152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 -- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c4415c060 msgr2=0x7f6c44152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c4415c060 0x7f6c44152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 -- 172.21.15.45:0/4109348793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c300094d0 con 0x7f6c440cd120 2023-07-09T02:18:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c4931f640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c4415c060 0x7f6c44152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.747+0000 7f6c48b1e640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c441521e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800d800 tx=0x7f6c3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c417fa640 1 -- 172.21.15.45:0/4109348793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380096c0 con 0x7f6c440cd120 2023-07-09T02:18:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4415c7e0 con 0x7f6c440cd120 2023-07-09T02:18:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c417fa640 1 -- 172.21.15.45:0/4109348793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c38009820 con 0x7f6c440cd120 2023-07-09T02:18:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c417fa640 1 -- 172.21.15.45:0/4109348793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38009bd0 con 0x7f6c440cd120 2023-07-09T02:18:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c44152720 con 0x7f6c440cd120 2023-07-09T02:18:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c44153dd0 con 0x7f6c440cd120 2023-07-09T02:18:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c417fa640 1 -- 172.21.15.45:0/4109348793 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c38009d30 con 0x7f6c440cd120 2023-07-09T02:18:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c417fa640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c28066280 0x7f6c28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c417fa640 1 -- 172.21.15.45:0/4109348793 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6c38084190 con 0x7f6c440cd120 2023-07-09T02:18:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.751+0000 7f6c43fff640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c28066280 0x7f6c28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.755+0000 7f6c43fff640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c28066280 0x7f6c28068730 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6c300af000 tx=0x7f6c30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.755+0000 7f6c417fa640 1 -- 172.21.15.45:0/4109348793 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c38051810 con 0x7f6c440cd120 2023-07-09T02:18:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.915+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6c440d08a0 con 0x7f6c440cd120 2023-07-09T02:18:36.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c417fa640 1 -- 172.21.15.45:0/4109348793 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c38054e30 con 0x7f6c440cd120 2023-07-09T02:18:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c28066280 msgr2=0x7f6c28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c28066280 0x7f6c28068730 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6c300af000 tx=0x7f6c30008040 comp rx=0 tx=0).stop 2023-07-09T02:18:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 msgr2=0x7f6c441521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c441521e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800d800 tx=0x7f6c3800dcc0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 shutdown_connections 2023-07-09T02:18:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c4415c060 0x7f6c44152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6c28066280 0x7f6c28068730 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c440d2450 0x7f6c44152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 --2- 172.21.15.45:0/4109348793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c440cd120 0x7f6c441521e0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 >> 172.21.15.45:0/4109348793 conn(0x7f6c440698e0 msgr2=0x7f6c440b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 shutdown_connections 2023-07-09T02:18:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:36.919+0000 7f6c4ad82640 1 -- 172.21.15.45:0/4109348793 wait complete. 2023-07-09T02:18:36.942 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:18:36.943 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:18:36.990 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:18:37.050 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:18:37.050 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:18:37.051 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:37.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:18:37.062 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:18:37.062 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:37.073 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:18:37.073 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:18:37.074 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:37.111 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:18:37.112 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:18:37.112 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:37.123 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:18:37.123 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:18:37.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:37.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.299+0000 7fa7233d2640 1 Processor -- start 2023-07-09T02:18:37.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.299+0000 7fa7233d2640 1 -- start start 2023-07-09T02:18:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.299+0000 7fa7233d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa71c06a5c0 0x7fa71c15fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.299+0000 7fa7233d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 0x7fa71c160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.299+0000 7fa7233d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c071140 con 0x7fa71c0cd290 2023-07-09T02:18:37.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.299+0000 7fa7233d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c06b010 con 0x7fa71c06a5c0 2023-07-09T02:18:37.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.299+0000 7fa7233d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c15c970 con 0x7fa71c06aa40 2023-07-09T02:18:37.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72096d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa71c06a5c0 0x7fa71c15fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72096d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa71c06a5c0 0x7fa71c15fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42416/0 (socket says 172.21.15.45:42416) 2023-07-09T02:18:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72096d640 1 -- 172.21.15.45:0/1270110659 learned_addr learned my addr 172.21.15.45:0/1270110659 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72196f640 1 --2- 172.21.15.45:0/1270110659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 0x7fa71c160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72096d640 1 -- 172.21.15.45:0/1270110659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 msgr2=0x7fa71c160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72096d640 1 --2- 172.21.15.45:0/1270110659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 0x7fa71c160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72096d640 1 -- 172.21.15.45:0/1270110659 >> v1:172.21.15.155:6789/0 conn(0x7fa71c0cd290 legacy=0x7fa71c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72096d640 1 -- 172.21.15.45:0/1270110659 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c15cc50 con 0x7fa71c06a5c0 2023-07-09T02:18:37.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa72096d640 1 --2- 172.21.15.45:0/1270110659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c06a5c0 0x7fa71c15fdd0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009870 tx=0x7fa70c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0edfe5d4df7d025 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:37.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa713fff640 1 -- 172.21.15.45:0/1270110659 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0ab600 con 0x7fa71c06a5c0 2023-07-09T02:18:37.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa713fff640 1 -- 172.21.15.45:0/1270110659 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c0a7050 con 0x7fa71c06a5c0 2023-07-09T02:18:37.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.303+0000 7fa713fff640 1 -- 172.21.15.45:0/1270110659 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0ab980 con 0x7fa71c06a5c0 2023-07-09T02:18:37.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- 172.21.15.45:0/1270110659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c06a5c0 msgr2=0x7fa71c15fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1270110659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c06a5c0 0x7fa71c15fdd0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009870 tx=0x7fa70c01c540 comp rx=0 tx=0).stop 2023-07-09T02:18:37.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- 172.21.15.45:0/1270110659 shutdown_connections 2023-07-09T02:18:37.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1270110659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 0x7fa71c160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1270110659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c06a5c0 0x7fa71c15fdd0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- 172.21.15.45:0/1270110659 >> 172.21.15.45:0/1270110659 conn(0x7fa71c06d140 msgr2=0x7fa71c06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:37.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- 172.21.15.45:0/1270110659 shutdown_connections 2023-07-09T02:18:37.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- 172.21.15.45:0/1270110659 wait complete. 2023-07-09T02:18:37.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 Processor -- start 2023-07-09T02:18:37.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- start start 2023-07-09T02:18:37.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71c06a5c0 0x7fa71c14d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 0x7fa71c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0cd290 0x7fa71c0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c14dbe0 con 0x7fa71c0cd290 2023-07-09T02:18:37.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c154f70 con 0x7fa71c06a5c0 2023-07-09T02:18:37.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa7233d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c1545a0 con 0x7fa71c06aa40 2023-07-09T02:18:37.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72196f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0cd290 0x7fa71c0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72096d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 0x7fa71c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72196f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0cd290 0x7fa71c0b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42432/0 (socket says 172.21.15.45:42432) 2023-07-09T02:18:37.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72196f640 1 -- 172.21.15.45:0/1450640957 learned_addr learned my addr 172.21.15.45:0/1450640957 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:37.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72116e640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71c06a5c0 0x7fa71c14d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72196f640 1 -- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 msgr2=0x7fa71c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72196f640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 0x7fa71c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72196f640 1 -- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71c06a5c0 msgr2=0x7fa71c14d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72196f640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71c06a5c0 0x7fa71c14d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.307+0000 7fa72196f640 1 -- 172.21.15.45:0/1450640957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c0094d0 con 0x7fa71c0cd290 2023-07-09T02:18:37.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa72196f640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0cd290 0x7fa71c0b1540 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa714009dd0 tx=0x7fa71400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:37.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa711ffb640 1 -- 172.21.15.45:0/1450640957 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714014480 con 0x7fa71c0cd290 2023-07-09T02:18:37.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa711ffb640 1 -- 172.21.15.45:0/1450640957 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71400f040 con 0x7fa71c0cd290 2023-07-09T02:18:37.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa711ffb640 1 -- 172.21.15.45:0/1450640957 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714014840 con 0x7fa71c0cd290 2023-07-09T02:18:37.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c0b1e20 con 0x7fa71c0cd290 2023-07-09T02:18:37.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c154230 con 0x7fa71c0cd290 2023-07-09T02:18:37.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c153db0 con 0x7fa71c0cd290 2023-07-09T02:18:37.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa711ffb640 1 -- 172.21.15.45:0/1450640957 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7140149a0 con 0x7fa71c0cd290 2023-07-09T02:18:37.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa711ffb640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa700066280 0x7fa700068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.311+0000 7fa711ffb640 1 -- 172.21.15.45:0/1450640957 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa714084430 con 0x7fa71c0cd290 2023-07-09T02:18:37.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.315+0000 7fa72116e640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa700066280 0x7fa700068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.315+0000 7fa72116e640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa700066280 0x7fa700068730 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0afc80 tx=0x7fa718009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:37.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.315+0000 7fa711ffb640 1 -- 172.21.15.45:0/1450640957 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa71c153db0 con 0x7fa71c0cd290 2023-07-09T02:18:37.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.507+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa71c153db0 con 0x7fa71c0cd290 2023-07-09T02:18:37.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.507+0000 7fa711ffb640 1 -- 172.21.15.45:0/1450640957 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fa714018de0 con 0x7fa71c0cd290 2023-07-09T02:18:37.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:37.510 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/4280507470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4280507470},{"type":"v1","addr":"172.21.15.155:6836","nonce":4280507470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4194601604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4194601604},{"type":"v1","addr":"172.21.15.45:6834","nonce":4194601604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/21656398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":21656398},{"type":"v1","addr":"172.21.15.155:6837","nonce":21656398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":7806,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/358231114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":358231114},{"type":"v1","addr":"172.21.15.45:6835","nonce":358231114}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-07-09T02:18:37.511 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 69 2023-07-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa700066280 msgr2=0x7fa700068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa700066280 0x7fa700068730 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0afc80 tx=0x7fa718009040 comp rx=0 tx=0).stop 2023-07-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0cd290 msgr2=0x7fa71c0b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0cd290 0x7fa71c0b1540 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa714009dd0 tx=0x7fa71400c490 comp rx=0 tx=0).stop 2023-07-09T02:18:37.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 shutdown_connections 2023-07-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0cd290 0x7fa71c0b1540 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa700066280 0x7fa700068730 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71c06aa40 0x7fa71c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 --2- 172.21.15.45:0/1450640957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71c06a5c0 0x7fa71c14d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 >> 172.21.15.45:0/1450640957 conn(0x7fa71c06d140 msgr2=0x7fa71c0cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 shutdown_connections 2023-07-09T02:18:37.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.511+0000 7fa7233d2640 1 -- 172.21.15.45:0/1450640957 wait complete. 2023-07-09T02:18:37.531 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:18:37.532 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:18:37.532 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:18:37.532 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:18:37.532 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:18:37.533 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:18:37.533 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:18:37.533 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:18:37.533 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:18:37.534 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:18:37.534 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:18:37.534 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:18:37.534 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:18:37.534 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:18:37.535 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:18:37.535 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:18:37.544 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:18:37.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:18:37.546 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:18:37.546 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:18:37.553 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:18:37.554 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:18:37.554 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:18:37.555 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:18:37.590 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:18:37.590 DEBUG:teuthology.parallel:result is None 2023-07-09T02:18:37.592 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:18:37.592 DEBUG:teuthology.parallel:result is None 2023-07-09T02:18:37.597 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:18:37.598 DEBUG:teuthology.parallel:result is None 2023-07-09T02:18:37.599 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:18:37.600 DEBUG:teuthology.parallel:result is None 2023-07-09T02:18:37.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:18:37.680 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:18:37.681 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:18:37.690 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:18:37.690 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:18:37.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6de8ec640 1 Processor -- start 2023-07-09T02:18:37.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6de8ec640 1 -- start start 2023-07-09T02:18:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6de8ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6d80ca0f0 0x7fd6d80cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6de8ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80cbbb0 0x7fd6d80c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6de8ec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d806bf30 con 0x7fd6d80c9250 2023-07-09T02:18:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6de8ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d806bc50 con 0x7fd6d80ca0f0 2023-07-09T02:18:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6de8ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80cab90 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6dce89640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd6d80c9250 0x7fd6d815db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33126/0 (socket says 172.21.15.45:33126) 2023-07-09T02:18:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6dce89640 1 -- 172.21.15.45:0/463189561 learned_addr learned my addr 172.21.15.45:0/463189561 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6d7fff640 1 --2- 172.21.15.45:0/463189561 >> v2:172.21.15.155:3300/0 conn(0x7fd6d80ca0f0 0x7fd6d80cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6d77fe640 1 --2- 172.21.15.45:0/463189561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80cbbb0 0x7fd6d80c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6d6ffd640 1 -- 172.21.15.45:0/463189561 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134347451 0 0) 0x7fd6d806bf30 con 0x7fd6d80c9250 2023-07-09T02:18:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6d7fff640 1 -- 172.21.15.45:0/463189561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80cbbb0 msgr2=0x7fd6d80c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6d7fff640 1 --2- 172.21.15.45:0/463189561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80cbbb0 0x7fd6d80c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6d7fff640 1 -- 172.21.15.45:0/463189561 >> v1:172.21.15.45:6789/0 conn(0x7fd6d80c9250 legacy=0x7fd6d815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.747+0000 7fd6d7fff640 1 -- 172.21.15.45:0/463189561 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80cae70 con 0x7fd6d80ca0f0 2023-07-09T02:18:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6d7fff640 1 --2- 172.21.15.45:0/463189561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80ca0f0 0x7fd6d80cb670 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80097c0 tx=0x7fd6c801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2dd304d83aaf746 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6d6ffd640 1 -- 172.21.15.45:0/463189561 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80ab600 con 0x7fd6d80ca0f0 2023-07-09T02:18:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6d6ffd640 1 -- 172.21.15.45:0/463189561 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c80a7050 con 0x7fd6d80ca0f0 2023-07-09T02:18:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6d6ffd640 1 -- 172.21.15.45:0/463189561 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80ab980 con 0x7fd6d80ca0f0 2023-07-09T02:18:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6de8ec640 1 -- 172.21.15.45:0/463189561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80ca0f0 msgr2=0x7fd6d80cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/463189561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80ca0f0 0x7fd6d80cb670 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80097c0 tx=0x7fd6c801c3f0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6de8ec640 1 -- 172.21.15.45:0/463189561 shutdown_connections 2023-07-09T02:18:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/463189561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80cbbb0 0x7fd6d80c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/463189561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80ca0f0 0x7fd6d80cb670 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6de8ec640 1 -- 172.21.15.45:0/463189561 >> 172.21.15.45:0/463189561 conn(0x7fd6d80694b0 msgr2=0x7fd6d80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.751+0000 7fd6de8ec640 1 -- 172.21.15.45:0/463189561 shutdown_connections 2023-07-09T02:18:37.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 -- 172.21.15.45:0/463189561 wait complete. 2023-07-09T02:18:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 Processor -- start 2023-07-09T02:18:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 -- start start 2023-07-09T02:18:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80c9250 0x7fd6d8149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80ca0f0 0x7fd6d814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d80cbbb0 0x7fd6d814eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8149850 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80cd180 con 0x7fd6d80c9250 2023-07-09T02:18:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6de8ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80cc290 con 0x7fd6d80ca0f0 2023-07-09T02:18:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d80cbbb0 0x7fd6d814eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d80cbbb0 0x7fd6d814eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42470/0 (socket says 172.21.15.45:42470) 2023-07-09T02:18:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 -- 172.21.15.45:0/4124731499 learned_addr learned my addr 172.21.15.45:0/4124731499 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6d77fe640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80ca0f0 0x7fd6d814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6d7fff640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80c9250 0x7fd6d8149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 -- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80ca0f0 msgr2=0x7fd6d814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80ca0f0 0x7fd6d814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 -- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80c9250 msgr2=0x7fd6d8149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80c9250 0x7fd6d8149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 -- 172.21.15.45:0/4124731499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8009420 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.755+0000 7fd6dce89640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d80cbbb0 0x7fd6d814eeb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0001570 tx=0x7fd6d000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6d4ff9640 1 -- 172.21.15.45:0/4124731499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000a640 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6d4ff9640 1 -- 172.21.15.45:0/4124731499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d000a7c0 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6d4ff9640 1 -- 172.21.15.45:0/4124731499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000ab70 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80cc570 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d80ccb30 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80cd2f0 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6d4ff9640 1 -- 172.21.15.45:0/4124731499 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6d000acd0 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6d4ff9640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6c4066280 0x7fd6c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:37.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6d4ff9640 1 -- 172.21.15.45:0/4124731499 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd6d0082fc0 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.759+0000 7fd6d7fff640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6c4066280 0x7fd6c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:37.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.763+0000 7fd6d7fff640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6c4066280 0x7fd6c4068730 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80ad000 tx=0x7fd6c80a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:37.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.763+0000 7fd6d4ff9640 1 -- 172.21.15.45:0/4124731499 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6d0050770 con 0x7fd6d80cbbb0 2023-07-09T02:18:37.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:37.927+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd6d804d7d0 con 0x7fd6d80cbbb0 2023-07-09T02:18:38.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6d4ff9640 1 -- 172.21.15.45:0/4124731499 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v147) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd6d0018020 con 0x7fd6d80cbbb0 2023-07-09T02:18:38.589 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:18:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6c4066280 msgr2=0x7fd6c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6c4066280 0x7fd6c4068730 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80ad000 tx=0x7fd6c80a4f90 comp rx=0 tx=0).stop 2023-07-09T02:18:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d80cbbb0 msgr2=0x7fd6d814eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:38.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d80cbbb0 0x7fd6d814eeb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0001570 tx=0x7fd6d000cca0 comp rx=0 tx=0).stop 2023-07-09T02:18:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 shutdown_connections 2023-07-09T02:18:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6d80cbbb0 0x7fd6d814eeb0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd6c4066280 0x7fd6c4068730 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6d80ca0f0 0x7fd6d814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 --2- 172.21.15.45:0/4124731499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d80c9250 0x7fd6d8149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:38.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 >> 172.21.15.45:0/4124731499 conn(0x7fd6d80694b0 msgr2=0x7fd6d815ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:38.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 shutdown_connections 2023-07-09T02:18:38.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.587+0000 7fd6de8ec640 1 -- 172.21.15.45:0/4124731499 wait complete. 2023-07-09T02:18:38.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:18:38.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f203dbf4640 1 Processor -- start 2023-07-09T02:18:38.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f203dbf4640 1 -- start start 2023-07-09T02:18:38.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f203dbf4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f203806b240 0x7f203806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:38.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f203dbf4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380b2090 con 0x7f203815c870 2023-07-09T02:18:38.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f203dbf4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2038160520 con 0x7f20380d0d70 2023-07-09T02:18:38.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f203dbf4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203806bc00 con 0x7f203806b240 2023-07-09T02:18:38.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f203cbf2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f203815c870 0x7f20380b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33130/0 (socket says 172.21.15.45:33130) 2023-07-09T02:18:38.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f203cbf2640 1 -- 172.21.15.45:0/1154986568 learned_addr learned my addr 172.21.15.45:0/1154986568 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:38.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f202ffff640 1 --2- 172.21.15.45:0/1154986568 >> v2:172.21.15.155:3300/0 conn(0x7f203806b240 0x7f203806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:38.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f202f7fe640 1 -- 172.21.15.45:0/1154986568 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290738667 0 0) 0x7f20380b2090 con 0x7f203815c870 2023-07-09T02:18:38.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f202f7fe640 1 -- 172.21.15.45:0/1154986568 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2020003530 con 0x7f203815c870 2023-07-09T02:18:38.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f202ffff640 1 -- 172.21.15.45:0/1154986568 >> v1:172.21.15.155:6789/0 conn(0x7f20380d0d70 legacy=0x7f20380d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:38.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f202f7fe640 1 -- 172.21.15.45:0/1154986568 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631981235 0 0) 0x7f2038160520 con 0x7f20380d0d70 2023-07-09T02:18:38.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f202ffff640 1 -- 172.21.15.45:0/1154986568 >> v1:172.21.15.45:6789/0 conn(0x7f203815c870 legacy=0x7f20380b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:38.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.763+0000 7f202ffff640 1 -- 172.21.15.45:0/1154986568 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038160800 con 0x7f203806b240 2023-07-09T02:18:38.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f202ffff640 1 --2- 172.21.15.45:0/1154986568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f203806b240 0x7f203806b6c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f20280097c0 tx=0x7f202801c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ecb33578238666 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f202f7fe640 1 -- 172.21.15.45:0/1154986568 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034001680 con 0x7f203806b240 2023-07-09T02:18:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f202f7fe640 1 -- 172.21.15.45:0/1154986568 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280a7050 con 0x7f203806b240 2023-07-09T02:18:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f202f7fe640 1 -- 172.21.15.45:0/1154986568 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280ab620 con 0x7f203806b240 2023-07-09T02:18:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f203dbf4640 1 -- 172.21.15.45:0/1154986568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f203806b240 msgr2=0x7f203806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f203dbf4640 1 --2- 172.21.15.45:0/1154986568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f203806b240 0x7f203806b6c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f20280097c0 tx=0x7f202801c290 comp rx=0 tx=0).stop 2023-07-09T02:18:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f203dbf4640 1 -- 172.21.15.45:0/1154986568 shutdown_connections 2023-07-09T02:18:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f203dbf4640 1 --2- 172.21.15.45:0/1154986568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f203806b240 0x7f203806b6c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f203dbf4640 1 -- 172.21.15.45:0/1154986568 >> 172.21.15.45:0/1154986568 conn(0x7f2038070be0 msgr2=0x7f2038070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f203dbf4640 1 -- 172.21.15.45:0/1154986568 shutdown_connections 2023-07-09T02:18:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.767+0000 7f203dbf4640 1 -- 172.21.15.45:0/1154986568 wait complete. 2023-07-09T02:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 Processor -- start 2023-07-09T02:18:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 -- start start 2023-07-09T02:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f203806b240 0x7f20380c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20380d0d70 0x7f20380b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f203815c870 0x7f2038158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b7340 con 0x7f203815c870 2023-07-09T02:18:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b66c0 con 0x7f20380d0d70 2023-07-09T02:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b69a0 con 0x7f203806b240 2023-07-09T02:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f203815c870 0x7f2038158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f203815c870 0x7f2038158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42484/0 (socket says 172.21.15.45:42484) 2023-07-09T02:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 -- 172.21.15.45:0/2338545986 learned_addr learned my addr 172.21.15.45:0/2338545986 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f202ffff640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20380d0d70 0x7f20380b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203cbf2640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f203806b240 0x7f20380c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 -- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f203806b240 msgr2=0x7f20380c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:38.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f203806b240 0x7f20380c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:38.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 -- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20380d0d70 msgr2=0x7f20380b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:38.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20380d0d70 0x7f20380b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:38.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 -- 172.21.15.45:0/2338545986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009420 con 0x7f203815c870 2023-07-09T02:18:38.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203cbf2640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f203806b240 0x7f20380c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203d3f3640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f203815c870 0x7f2038158600 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f2030001570 tx=0x7f203000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f202d7fa640 1 -- 172.21.15.45:0/2338545986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030003db0 con 0x7f203815c870 2023-07-09T02:18:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f202d7fa640 1 -- 172.21.15.45:0/2338545986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030005070 con 0x7f203815c870 2023-07-09T02:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f202d7fa640 1 -- 172.21.15.45:0/2338545986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030005420 con 0x7f203815c870 2023-07-09T02:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20380b6c80 con 0x7f203815c870 2023-07-09T02:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.771+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20380c8c20 con 0x7f203815c870 2023-07-09T02:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.775+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203804e020 con 0x7f203815c870 2023-07-09T02:18:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.775+0000 7f202d7fa640 1 -- 172.21.15.45:0/2338545986 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2030005580 con 0x7f203815c870 2023-07-09T02:18:38.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.775+0000 7f202d7fa640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2024066280 0x7f2024068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:38.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.775+0000 7f202d7fa640 1 -- 172.21.15.45:0/2338545986 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2030083240 con 0x7f203815c870 2023-07-09T02:18:38.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.775+0000 7f203cbf2640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2024066280 0x7f2024068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:38.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.775+0000 7f203cbf2640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2024066280 0x7f2024068730 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f20340016d0 tx=0x7f2034001960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:38.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.779+0000 7f202d7fa640 1 -- 172.21.15.45:0/2338545986 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2030050ab0 con 0x7f203815c870 2023-07-09T02:18:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f20380cfef0 con 0x7f203815c870 2023-07-09T02:18:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f202d7fa640 1 -- 172.21.15.45:0/2338545986 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f20300540d0 con 0x7f203815c870 2023-07-09T02:18:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:38.989 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:18:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:38.989 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:18:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:18:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:18:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:18:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:18:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:38.990 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:18:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:18:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:18:38.991 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:18:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:18:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:38.992 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:18:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:18:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:18:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:18:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:18:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:38.993 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:18:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:18:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:18:38.994 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:18:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:18:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:18:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:18:38.995 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:18:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:18:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:38.996 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:18:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:18:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:18:38.997 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:18:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:18:38.998 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:18:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:18:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:18:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:38.999 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:18:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:18:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:18:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:18:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:18:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:18:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:18:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:18:39.001 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:18:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:18:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.002 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:18:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:18:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:18:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:18:39.003 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:18:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:18:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.004 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:18:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:18:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:18:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:18:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.005 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:18:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:18:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:18:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:18:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:18:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.006 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:18:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:18:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:18:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:18:39.007 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:18:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:18:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:18:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:18:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.008 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:18:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:18:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:18:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:18:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.009 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:18:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:18:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:18:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:18:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:18:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:18:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:18:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:18:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:18:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:18:39.011 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:18:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:18:39.012 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:18:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:18:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:18:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:39.013 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:18:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:18:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:18:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:18:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:18:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:18:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.014 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:39.015 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:18:39.015 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2024066280 msgr2=0x7f2024068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2024066280 0x7f2024068730 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f20340016d0 tx=0x7f2034001960 comp rx=0 tx=0).stop 2023-07-09T02:18:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f203815c870 msgr2=0x7f2038158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f203815c870 0x7f2038158600 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f2030001570 tx=0x7f203000cd20 comp rx=0 tx=0).stop 2023-07-09T02:18:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 shutdown_connections 2023-07-09T02:18:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f203815c870 0x7f2038158600 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20380d0d70 0x7f20380b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2024066280 0x7f2024068730 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 --2- 172.21.15.45:0/2338545986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f203806b240 0x7f20380c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 >> 172.21.15.45:0/2338545986 conn(0x7f2038070be0 msgr2=0x7f203815b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 shutdown_connections 2023-07-09T02:18:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:38.987+0000 7f203dbf4640 1 -- 172.21.15.45:0/2338545986 wait complete. 2023-07-09T02:18:39.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4deb06d640 1 Processor -- start 2023-07-09T02:18:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4deb06d640 1 -- start start 2023-07-09T02:18:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4deb06d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4de415c060 0x7f4de40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4deb06d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de4160a50 con 0x7f4de40cd120 2023-07-09T02:18:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4deb06d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de415c430 con 0x7f4de40d2620 2023-07-09T02:18:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4deb06d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de415fb60 con 0x7f4de415c060 2023-07-09T02:18:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4de8e09640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4de415c060 0x7f4de40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4de3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4de40cd120 0x7f4de40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33144/0 (socket says 172.21.15.45:33144) 2023-07-09T02:18:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4de3fff640 1 -- 172.21.15.45:0/2289126227 learned_addr learned my addr 172.21.15.45:0/2289126227 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4de8e09640 1 -- 172.21.15.45:0/2289126227 >> v1:172.21.15.155:6789/0 conn(0x7f4de40d2620 legacy=0x7f4de40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4de8e09640 1 -- 172.21.15.45:0/2289126227 >> v1:172.21.15.45:6789/0 conn(0x7f4de40cd120 legacy=0x7f4de40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4de8e09640 1 -- 172.21.15.45:0/2289126227 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de415fe40 con 0x7f4de415c060 2023-07-09T02:18:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.159+0000 7f4de37fe640 1 -- 172.21.15.45:0/2289126227 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042098352 0 0) 0x7f4de4160a50 con 0x7f4de40cd120 2023-07-09T02:18:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4de8e09640 1 --2- 172.21.15.45:0/2289126227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de415c060 0x7f4de40b4ed0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80097c0 tx=0x7f4dd801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d351304ba148510 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4de37fe640 1 -- 172.21.15.45:0/2289126227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80ab650 con 0x7f4de415c060 2023-07-09T02:18:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4de37fe640 1 -- 172.21.15.45:0/2289126227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd80ab7b0 con 0x7f4de415c060 2023-07-09T02:18:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4de37fe640 1 -- 172.21.15.45:0/2289126227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80abb40 con 0x7f4de415c060 2023-07-09T02:18:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4deb06d640 1 -- 172.21.15.45:0/2289126227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de415c060 msgr2=0x7f4de40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4deb06d640 1 --2- 172.21.15.45:0/2289126227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de415c060 0x7f4de40b4ed0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80097c0 tx=0x7f4dd801c450 comp rx=0 tx=0).stop 2023-07-09T02:18:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4deb06d640 1 -- 172.21.15.45:0/2289126227 shutdown_connections 2023-07-09T02:18:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4deb06d640 1 --2- 172.21.15.45:0/2289126227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de415c060 0x7f4de40b4ed0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4deb06d640 1 -- 172.21.15.45:0/2289126227 >> 172.21.15.45:0/2289126227 conn(0x7f4de40698e0 msgr2=0x7f4de4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4deb06d640 1 -- 172.21.15.45:0/2289126227 shutdown_connections 2023-07-09T02:18:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.163+0000 7f4deb06d640 1 -- 172.21.15.45:0/2289126227 wait complete. 2023-07-09T02:18:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 Processor -- start 2023-07-09T02:18:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 -- start start 2023-07-09T02:18:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4de40cd120 0x7f4de4157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de40d2620 0x7f4de415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4de415c060 0x7f4de41587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de41612e0 con 0x7f4de40d2620 2023-07-09T02:18:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de415eef0 con 0x7f4de415c060 2023-07-09T02:18:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4160cb0 con 0x7f4de40cd120 2023-07-09T02:18:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de40d2620 0x7f4de415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de40d2620 0x7f4de415e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42506/0 (socket says 172.21.15.45:42506) 2023-07-09T02:18:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 -- 172.21.15.45:0/4216274774 learned_addr learned my addr 172.21.15.45:0/4216274774 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de8e09640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4de40cd120 0x7f4de4157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de960a640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4de415c060 0x7f4de41587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 -- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4de40cd120 msgr2=0x7f4de4157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4de40cd120 0x7f4de4157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 -- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4de415c060 msgr2=0x7f4de41587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4de415c060 0x7f4de41587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 -- 172.21.15.45:0/4216274774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8009420 con 0x7f4de40d2620 2023-07-09T02:18:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de960a640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4de415c060 0x7f4de41587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de8e09640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4de40cd120 0x7f4de4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de3fff640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de40d2620 0x7f4de415e1b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000c480 tx=0x7f4dd000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de17fa640 1 -- 172.21.15.45:0/4216274774 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00074e0 con 0x7f4de40d2620 2023-07-09T02:18:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de17fa640 1 -- 172.21.15.45:0/4216274774 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0007640 con 0x7f4de40d2620 2023-07-09T02:18:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4de17fa640 1 -- 172.21.15.45:0/4216274774 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004a10 con 0x7f4de40d2620 2023-07-09T02:18:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de40b59f0 con 0x7f4de40d2620 2023-07-09T02:18:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.167+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de415f420 con 0x7f4de40d2620 2023-07-09T02:18:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.171+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de415f660 con 0x7f4de40d2620 2023-07-09T02:18:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.171+0000 7f4de17fa640 1 -- 172.21.15.45:0/4216274774 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4dd0004b70 con 0x7f4de40d2620 2023-07-09T02:18:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.171+0000 7f4de17fa640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dc8066280 0x7f4dc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.171+0000 7f4de17fa640 1 -- 172.21.15.45:0/4216274774 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4dd0082ba0 con 0x7f4de40d2620 2023-07-09T02:18:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.171+0000 7f4de8e09640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dc8066280 0x7f4dc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.171+0000 7f4de8e09640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dc8066280 0x7f4dc8068730 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80af000 tx=0x7f4dd80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.175+0000 7f4de17fa640 1 -- 172.21.15.45:0/4216274774 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4dd0050410 con 0x7f4de40d2620 2023-07-09T02:18:39.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.331+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4de4161420 con 0x7f4de40d2620 2023-07-09T02:18:39.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.331+0000 7f4de17fa640 1 -- 172.21.15.45:0/4216274774 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+14651 (secure 0 0 0) 0x7f4de4161420 con 0x7f4de40d2620 2023-07-09T02:18:39.335 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:39.335 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":149,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:38.602792+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dc8066280 msgr2=0x7f4dc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dc8066280 0x7f4dc8068730 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80af000 tx=0x7f4dd80a7000 comp rx=0 tx=0).stop 2023-07-09T02:18:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de40d2620 msgr2=0x7f4de415e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de40d2620 0x7f4de415e1b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000c480 tx=0x7f4dd000c940 comp rx=0 tx=0).stop 2023-07-09T02:18:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 shutdown_connections 2023-07-09T02:18:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4de415c060 0x7f4de41587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4de40d2620 0x7f4de415e1b0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dc8066280 0x7f4dc8068730 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 --2- 172.21.15.45:0/4216274774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4de40cd120 0x7f4de4157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 >> 172.21.15.45:0/4216274774 conn(0x7f4de40698e0 msgr2=0x7f4de40b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 shutdown_connections 2023-07-09T02:18:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.335+0000 7f4deb06d640 1 -- 172.21.15.45:0/4216274774 wait complete. 2023-07-09T02:18:39.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:18:39.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:18:39.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3fe7b640 1 Processor -- start 2023-07-09T02:18:39.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3fe7b640 1 -- start start 2023-07-09T02:18:39.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3fe7b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa380c8f70 0x7ffa3806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3fe7b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa380c9340 0x7ffa38159660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3fe7b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3806b690 con 0x7ffa38155c30 2023-07-09T02:18:39.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3fe7b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3806b970 con 0x7ffa380c9340 2023-07-09T02:18:39.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3fe7b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3806bc50 con 0x7ffa380c8f70 2023-07-09T02:18:39.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3d416640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa380c9340 0x7ffa38159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3d416640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa380c9340 0x7ffa38159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42520/0 (socket says 172.21.15.45:42520) 2023-07-09T02:18:39.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3d416640 1 -- 172.21.15.45:0/2294962245 learned_addr learned my addr 172.21.15.45:0/2294962245 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:39.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3dc17640 1 --2- 172.21.15.45:0/2294962245 >> v2:172.21.15.155:3300/0 conn(0x7ffa380c8f70 0x7ffa3806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3d416640 1 -- 172.21.15.45:0/2294962245 >> v2:172.21.15.155:3300/0 conn(0x7ffa380c8f70 msgr2=0x7ffa3806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:39.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3d416640 1 --2- 172.21.15.45:0/2294962245 >> v2:172.21.15.155:3300/0 conn(0x7ffa380c8f70 0x7ffa3806b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3d416640 1 -- 172.21.15.45:0/2294962245 >> v1:172.21.15.155:6789/0 conn(0x7ffa38155c30 legacy=0x7ffa38156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.503+0000 7ffa3d416640 1 -- 172.21.15.45:0/2294962245 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3806bf30 con 0x7ffa380c9340 2023-07-09T02:18:39.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3d416640 1 --2- 172.21.15.45:0/2294962245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c9340 0x7ffa38159660 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7ffa3806ec20 tx=0x7ffa2801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488a52f1406e9dab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3cc15640 1 -- 172.21.15.45:0/2294962245 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280a89f0 con 0x7ffa380c9340 2023-07-09T02:18:39.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3cc15640 1 -- 172.21.15.45:0/2294962245 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa280a8b50 con 0x7ffa380c9340 2023-07-09T02:18:39.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3cc15640 1 -- 172.21.15.45:0/2294962245 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280b0440 con 0x7ffa380c9340 2023-07-09T02:18:39.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2294962245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c9340 msgr2=0x7ffa38159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2294962245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c9340 0x7ffa38159660 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7ffa3806ec20 tx=0x7ffa2801ecf0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2294962245 shutdown_connections 2023-07-09T02:18:39.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2294962245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c9340 0x7ffa38159660 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2294962245 >> v2:172.21.15.155:3300/0 conn(0x7ffa380c8f70 0x7ffa3806b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2294962245 >> 172.21.15.45:0/2294962245 conn(0x7ffa380694b0 msgr2=0x7ffa380698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:39.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2294962245 shutdown_connections 2023-07-09T02:18:39.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2294962245 wait complete. 2023-07-09T02:18:39.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 Processor -- start 2023-07-09T02:18:39.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.507+0000 7ffa3fe7b640 1 -- start start 2023-07-09T02:18:39.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c8f70 0x7ffa38157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa380c9340 0x7ffa3814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa38155c30 0x7ffa3814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3814bd30 con 0x7ffa380c8f70 2023-07-09T02:18:39.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3814c150 con 0x7ffa38155c30 2023-07-09T02:18:39.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3814b390 con 0x7ffa380c9340 2023-07-09T02:18:39.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c8f70 0x7ffa38157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c8f70 0x7ffa38157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42530/0 (socket says 172.21.15.45:42530) 2023-07-09T02:18:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 -- 172.21.15.45:0/2153085496 learned_addr learned my addr 172.21.15.45:0/2153085496 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3d416640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa380c9340 0x7ffa3814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3e418640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa38155c30 0x7ffa3814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 -- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa380c9340 msgr2=0x7ffa3814d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa380c9340 0x7ffa3814d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 -- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa38155c30 msgr2=0x7ffa3814dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa38155c30 0x7ffa3814dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 -- 172.21.15.45:0/2153085496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280094d0 con 0x7ffa380c8f70 2023-07-09T02:18:39.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3dc17640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c8f70 0x7ffa38157e40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400d800 tx=0x7ffa3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa2e7fc640 1 -- 172.21.15.45:0/2153085496 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400b6c0 con 0x7ffa380c8f70 2023-07-09T02:18:39.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa2e7fc640 1 -- 172.21.15.45:0/2153085496 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3400b820 con 0x7ffa380c8f70 2023-07-09T02:18:39.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa2e7fc640 1 -- 172.21.15.45:0/2153085496 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400bb90 con 0x7ffa380c8f70 2023-07-09T02:18:39.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3814b670 con 0x7ffa380c8f70 2023-07-09T02:18:39.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa38158420 con 0x7ffa380c8f70 2023-07-09T02:18:39.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.511+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3814bfa0 con 0x7ffa380c8f70 2023-07-09T02:18:39.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.515+0000 7ffa2e7fc640 1 -- 172.21.15.45:0/2153085496 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa3400bcf0 con 0x7ffa380c8f70 2023-07-09T02:18:39.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.515+0000 7ffa2e7fc640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa1c0662b0 0x7ffa1c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.515+0000 7ffa2e7fc640 1 -- 172.21.15.45:0/2153085496 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffa34083f80 con 0x7ffa380c8f70 2023-07-09T02:18:39.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.515+0000 7ffa3d416640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa1c0662b0 0x7ffa1c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.515+0000 7ffa3d416640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa1c0662b0 0x7ffa1c068760 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ffa280b2000 tx=0x7ffa28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.519+0000 7ffa2e7fc640 1 -- 172.21.15.45:0/2153085496 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa34051740 con 0x7ffa380c8f70 2023-07-09T02:18:39.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.675+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa3804d7d0 con 0x7ffa380c8f70 2023-07-09T02:18:39.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.675+0000 7ffa2e7fc640 1 -- 172.21.15.45:0/2153085496 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa34054d60 con 0x7ffa380c8f70 2023-07-09T02:18:39.679 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:18:39.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa1c0662b0 msgr2=0x7ffa1c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa1c0662b0 0x7ffa1c068760 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ffa280b2000 tx=0x7ffa28008040 comp rx=0 tx=0).stop 2023-07-09T02:18:39.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c8f70 msgr2=0x7ffa38157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c8f70 0x7ffa38157e40 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400d800 tx=0x7ffa3400dcc0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 shutdown_connections 2023-07-09T02:18:39.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa38155c30 0x7ffa3814dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ffa1c0662b0 0x7ffa1c068760 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa380c9340 0x7ffa3814d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 --2- 172.21.15.45:0/2153085496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa380c8f70 0x7ffa38157e40 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 >> 172.21.15.45:0/2153085496 conn(0x7ffa380694b0 msgr2=0x7ffa380c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 shutdown_connections 2023-07-09T02:18:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.679+0000 7ffa3fe7b640 1 -- 172.21.15.45:0/2153085496 wait complete. 2023-07-09T02:18:39.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:18:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.843+0000 7f566151f640 1 Processor -- start 2023-07-09T02:18:39.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.843+0000 7f566151f640 1 -- start start 2023-07-09T02:18:39.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f566151f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f565c0c8d10 0x7f565c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f566151f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c15db00 0x7f565c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f566151f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c06bf30 con 0x7f565c0ca0f0 2023-07-09T02:18:39.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f566151f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c15e4c0 con 0x7f565c0c8d10 2023-07-09T02:18:39.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f566151f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c06bc50 con 0x7f565c15db00 2023-07-09T02:18:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f5653fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f565c0c8d10 0x7f565c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f5653fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f565c0c8d10 0x7f565c0c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:50610/0 (socket says 172.21.15.45:50610) 2023-07-09T02:18:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f5653fff640 1 -- 172.21.15.45:0/3969068286 learned_addr learned my addr 172.21.15.45:0/3969068286 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f565b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c15db00 0x7f565c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f565b7fe640 1 -- 172.21.15.45:0/3969068286 >> v2:172.21.15.155:3300/0 conn(0x7f565c0c8d10 msgr2=0x7f565c0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f565b7fe640 1 --2- 172.21.15.45:0/3969068286 >> v2:172.21.15.155:3300/0 conn(0x7f565c0c8d10 0x7f565c0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f565b7fe640 1 -- 172.21.15.45:0/3969068286 >> v1:172.21.15.155:6789/0 conn(0x7f565c0ca0f0 legacy=0x7f565c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f565b7fe640 1 -- 172.21.15.45:0/3969068286 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0cab90 con 0x7f565c15db00 2023-07-09T02:18:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f5653fff640 1 --2- 172.21.15.45:0/3969068286 >> v2:172.21.15.155:3300/0 conn(0x7f565c0c8d10 0x7f565c0c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:39.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.847+0000 7f565a7fc640 1 -- 172.21.15.45:0/3969068286 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993126362 0 0) 0x7f565c06bf30 con 0x7f565c0ca0f0 2023-07-09T02:18:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f565b7fe640 1 --2- 172.21.15.45:0/3969068286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c15db00 0x7f565c15df80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5654009d90 tx=0x7f565401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f9b789db1ab2057 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f565a7fc640 1 -- 172.21.15.45:0/3969068286 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540a5980 con 0x7f565c15db00 2023-07-09T02:18:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f565a7fc640 1 -- 172.21.15.45:0/3969068286 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56540a5ae0 con 0x7f565c15db00 2023-07-09T02:18:39.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f565a7fc640 1 -- 172.21.15.45:0/3969068286 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540a5e70 con 0x7f565c15db00 2023-07-09T02:18:39.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 -- 172.21.15.45:0/3969068286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c15db00 msgr2=0x7f565c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 --2- 172.21.15.45:0/3969068286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c15db00 0x7f565c15df80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5654009d90 tx=0x7f565401c8c0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 -- 172.21.15.45:0/3969068286 shutdown_connections 2023-07-09T02:18:39.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 --2- 172.21.15.45:0/3969068286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c15db00 0x7f565c15df80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 --2- 172.21.15.45:0/3969068286 >> v2:172.21.15.155:3300/0 conn(0x7f565c0c8d10 0x7f565c0c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 -- 172.21.15.45:0/3969068286 >> 172.21.15.45:0/3969068286 conn(0x7f565c0694b0 msgr2=0x7f565c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:39.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 -- 172.21.15.45:0/3969068286 shutdown_connections 2023-07-09T02:18:39.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 -- 172.21.15.45:0/3969068286 wait complete. 2023-07-09T02:18:39.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 Processor -- start 2023-07-09T02:18:39.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.851+0000 7f566151f640 1 -- start start 2023-07-09T02:18:39.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f565c0c8d10 0x7f565c14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c0ca0f0 0x7f565c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c15db00 0x7f565c14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0b30b0 con 0x7f565c15db00 2023-07-09T02:18:39.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0b24a0 con 0x7f565c0c8d10 2023-07-09T02:18:39.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0b2780 con 0x7f565c0ca0f0 2023-07-09T02:18:39.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c15db00 0x7f565c14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c15db00 0x7f565c14fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42544/0 (socket says 172.21.15.45:42544) 2023-07-09T02:18:39.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 -- 172.21.15.45:0/1649011972 learned_addr learned my addr 172.21.15.45:0/1649011972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:39.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565affd640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f565c0c8d10 0x7f565c14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f5653fff640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c0ca0f0 0x7f565c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 -- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c0ca0f0 msgr2=0x7f565c0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c0ca0f0 0x7f565c0c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 -- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f565c0c8d10 msgr2=0x7f565c14ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f565c0c8d10 0x7f565c14ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 -- 172.21.15.45:0/1649011972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440094d0 con 0x7f565c15db00 2023-07-09T02:18:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f565b7fe640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c15db00 0x7f565c14fda0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f565401af70 tx=0x7f5654019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f56537fe640 1 -- 172.21.15.45:0/1649011972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540ad850 con 0x7f565c15db00 2023-07-09T02:18:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f56537fe640 1 -- 172.21.15.45:0/1649011972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56540a5970 con 0x7f565c15db00 2023-07-09T02:18:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f56537fe640 1 -- 172.21.15.45:0/1649011972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540adbb0 con 0x7f565c15db00 2023-07-09T02:18:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5654009a70 con 0x7f565c15db00 2023-07-09T02:18:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c0b2d40 con 0x7f565c15db00 2023-07-09T02:18:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.855+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c0b3220 con 0x7f565c15db00 2023-07-09T02:18:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.859+0000 7f56537fe640 1 -- 172.21.15.45:0/1649011972 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56540b4050 con 0x7f565c15db00 2023-07-09T02:18:39.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.859+0000 7f56537fe640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f563c066280 0x7f563c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:39.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.859+0000 7f56537fe640 1 -- 172.21.15.45:0/1649011972 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f565411e770 con 0x7f565c15db00 2023-07-09T02:18:39.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.859+0000 7f565affd640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f563c066280 0x7f563c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:39.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.859+0000 7f565affd640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f563c066280 0x7f563c068730 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f564c000f70 tx=0x7f564c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:39.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:39.863+0000 7f56537fe640 1 -- 172.21.15.45:0/1649011972 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56540ebfe0 con 0x7f565c15db00 2023-07-09T02:18:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f565c04d7d0 con 0x7f565c15db00 2023-07-09T02:18:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f56537fe640 1 -- 172.21.15.45:0/1649011972 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56540b2020 con 0x7f565c15db00 2023-07-09T02:18:40.025 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:18:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f563c066280 msgr2=0x7f563c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f563c066280 0x7f563c068730 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f564c000f70 tx=0x7f564c009040 comp rx=0 tx=0).stop 2023-07-09T02:18:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c15db00 msgr2=0x7f565c14fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c15db00 0x7f565c14fda0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f565401af70 tx=0x7f5654019660 comp rx=0 tx=0).stop 2023-07-09T02:18:40.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 shutdown_connections 2023-07-09T02:18:40.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c15db00 0x7f565c14fda0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f563c066280 0x7f563c068730 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f565c0ca0f0 0x7f565c0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 --2- 172.21.15.45:0/1649011972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f565c0c8d10 0x7f565c14ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 >> 172.21.15.45:0/1649011972 conn(0x7f565c0694b0 msgr2=0x7f565c0c3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:40.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 shutdown_connections 2023-07-09T02:18:40.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.023+0000 7f566151f640 1 -- 172.21.15.45:0/1649011972 wait complete. 2023-07-09T02:18:40.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:18:40.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe17c9c640 1 Processor -- start 2023-07-09T02:18:40.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe17c9c640 1 -- start start 2023-07-09T02:18:40.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe17c9c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe100d2620 0x7efe100b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe17c9c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe10160a50 con 0x7efe100cd120 2023-07-09T02:18:40.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe17c9c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1015c430 con 0x7efe1015c060 2023-07-09T02:18:40.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe17c9c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1015fb60 con 0x7efe100d2620 2023-07-09T02:18:40.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe16239640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efe100cd120 0x7efe100cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33156/0 (socket says 172.21.15.45:33156) 2023-07-09T02:18:40.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe16239640 1 -- 172.21.15.45:0/1078805880 learned_addr learned my addr 172.21.15.45:0/1078805880 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:40.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe15237640 1 --2- 172.21.15.45:0/1078805880 >> v2:172.21.15.155:3300/0 conn(0x7efe100d2620 0x7efe100b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe14a36640 1 -- 172.21.15.45:0/1078805880 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816341306 0 0) 0x7efe10160a50 con 0x7efe100cd120 2023-07-09T02:18:40.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe14a36640 1 -- 172.21.15.45:0/1078805880 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdfc003530 con 0x7efe100cd120 2023-07-09T02:18:40.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe14a36640 1 -- 172.21.15.45:0/1078805880 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120381562 0 0) 0x7efe1015c430 con 0x7efe1015c060 2023-07-09T02:18:40.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe14a36640 1 -- 172.21.15.45:0/1078805880 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe10160a50 con 0x7efe1015c060 2023-07-09T02:18:40.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe14a36640 1 -- 172.21.15.45:0/1078805880 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1165445985 0 0) 0x7efdfc003530 con 0x7efe100cd120 2023-07-09T02:18:40.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe15237640 1 -- 172.21.15.45:0/1078805880 >> v1:172.21.15.155:6789/0 conn(0x7efe1015c060 legacy=0x7efe100d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe15237640 1 -- 172.21.15.45:0/1078805880 >> v1:172.21.15.45:6789/0 conn(0x7efe100cd120 legacy=0x7efe100cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.187+0000 7efe15237640 1 -- 172.21.15.45:0/1078805880 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1015fe40 con 0x7efe100d2620 2023-07-09T02:18:40.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe15237640 1 --2- 172.21.15.45:0/1078805880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100d2620 0x7efe100b4ed0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efe000097c0 tx=0x7efe0001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64594bff33b523e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:40.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe14a36640 1 -- 172.21.15.45:0/1078805880 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08001a00 con 0x7efe100d2620 2023-07-09T02:18:40.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe14a36640 1 -- 172.21.15.45:0/1078805880 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe000a7050 con 0x7efe100d2620 2023-07-09T02:18:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe14a36640 1 -- 172.21.15.45:0/1078805880 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000ab620 con 0x7efe100d2620 2023-07-09T02:18:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe17c9c640 1 -- 172.21.15.45:0/1078805880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100d2620 msgr2=0x7efe100b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe17c9c640 1 --2- 172.21.15.45:0/1078805880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100d2620 0x7efe100b4ed0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efe000097c0 tx=0x7efe0001c370 comp rx=0 tx=0).stop 2023-07-09T02:18:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe17c9c640 1 -- 172.21.15.45:0/1078805880 shutdown_connections 2023-07-09T02:18:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe17c9c640 1 --2- 172.21.15.45:0/1078805880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100d2620 0x7efe100b4ed0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe17c9c640 1 -- 172.21.15.45:0/1078805880 >> 172.21.15.45:0/1078805880 conn(0x7efe100698e0 msgr2=0x7efe10069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe17c9c640 1 -- 172.21.15.45:0/1078805880 shutdown_connections 2023-07-09T02:18:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.191+0000 7efe17c9c640 1 -- 172.21.15.45:0/1078805880 wait complete. 2023-07-09T02:18:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 Processor -- start 2023-07-09T02:18:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 -- start start 2023-07-09T02:18:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100cd120 0x7efe100b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100d2620 0x7efe10160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe1015c060 0x7efe10161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101617a0 con 0x7efe100d2620 2023-07-09T02:18:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10161a50 con 0x7efe100cd120 2023-07-09T02:18:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe10161d30 con 0x7efe1015c060 2023-07-09T02:18:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100d2620 0x7efe10160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100d2620 0x7efe10160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42548/0 (socket says 172.21.15.45:42548) 2023-07-09T02:18:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 -- 172.21.15.45:0/2071939134 learned_addr learned my addr 172.21.15.45:0/2071939134 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe16239640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe1015c060 0x7efe10161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15a38640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100cd120 0x7efe100b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 -- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe1015c060 msgr2=0x7efe10161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe1015c060 0x7efe10161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 -- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100cd120 msgr2=0x7efe100b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100cd120 0x7efe100b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 -- 172.21.15.45:0/2071939134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009420 con 0x7efe100d2620 2023-07-09T02:18:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15a38640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100cd120 0x7efe100b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:40.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe15237640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100d2620 0x7efe10160d20 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7efe000ae040 tx=0x7efe00019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe067fc640 1 -- 172.21.15.45:0/2071939134 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000abe70 con 0x7efe100d2620 2023-07-09T02:18:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe067fc640 1 -- 172.21.15.45:0/2071939134 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe00004020 con 0x7efe100d2620 2023-07-09T02:18:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe067fc640 1 -- 172.21.15.45:0/2071939134 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00004390 con 0x7efe100d2620 2023-07-09T02:18:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe100b59f0 con 0x7efe100d2620 2023-07-09T02:18:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101622f0 con 0x7efe100d2620 2023-07-09T02:18:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.195+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1004d7d0 con 0x7efe100d2620 2023-07-09T02:18:40.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.199+0000 7efe067fc640 1 -- 172.21.15.45:0/2071939134 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe000b2040 con 0x7efe100d2620 2023-07-09T02:18:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.199+0000 7efe067fc640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdf4066280 0x7efdf4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.199+0000 7efe067fc640 1 -- 172.21.15.45:0/2071939134 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efe0011dbb0 con 0x7efe100d2620 2023-07-09T02:18:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.199+0000 7efe15a38640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdf4066280 0x7efdf4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.199+0000 7efe15a38640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdf4066280 0x7efdf4068730 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0011f0 tx=0x7efe0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:40.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.203+0000 7efe067fc640 1 -- 172.21.15.45:0/2071939134 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe000eb370 con 0x7efe100d2620 2023-07-09T02:18:40.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.359+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efe1006baa0 con 0x7efe100d2620 2023-07-09T02:18:40.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.359+0000 7efe067fc640 1 -- 172.21.15.45:0/2071939134 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) v1 ==== 84+0+126 (secure 0 0 0) 0x7efe000b0090 con 0x7efe100d2620 2023-07-09T02:18:40.362 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:40.362 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:18:40.363 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:40.363 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:18:40.363 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:18:40.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:18:40.363 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:18:40.363 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:18:40.363 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:18:40.364 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:18:40.364 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:18:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdf4066280 msgr2=0x7efdf4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdf4066280 0x7efdf4068730 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0011f0 tx=0x7efe0c009040 comp rx=0 tx=0).stop 2023-07-09T02:18:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100d2620 msgr2=0x7efe10160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100d2620 0x7efe10160d20 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7efe000ae040 tx=0x7efe00019110 comp rx=0 tx=0).stop 2023-07-09T02:18:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 shutdown_connections 2023-07-09T02:18:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdf4066280 0x7efdf4068730 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe1015c060 0x7efe10161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100d2620 0x7efe10160d20 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 --2- 172.21.15.45:0/2071939134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe100cd120 0x7efe100b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 >> 172.21.15.45:0/2071939134 conn(0x7efe100698e0 msgr2=0x7efe100b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 shutdown_connections 2023-07-09T02:18:40.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.363+0000 7efe17c9c640 1 -- 172.21.15.45:0/2071939134 wait complete. 2023-07-09T02:18:40.383 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:18:40.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:18:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe62a248640 1 Processor -- start 2023-07-09T02:18:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe62a248640 1 -- start start 2023-07-09T02:18:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe62a248640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe62415c480 0x7fe6240cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe62a248640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe6240cecd0 0x7fe6240d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe62a248640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6240d19c0 con 0x7fe6240b4490 2023-07-09T02:18:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe62a248640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe62415c850 con 0x7fe62415c480 2023-07-09T02:18:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe62a248640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6240d1090 con 0x7fe6240cecd0 2023-07-09T02:18:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe6237fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe62415c480 0x7fe6240cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe6237fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe62415c480 0x7fe6240cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42564/0 (socket says 172.21.15.45:42564) 2023-07-09T02:18:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe6237fe640 1 -- 172.21.15.45:0/3870142224 learned_addr learned my addr 172.21.15.45:0/3870142224 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe622ffd640 1 --2- 172.21.15.45:0/3870142224 >> v2:172.21.15.155:3300/0 conn(0x7fe6240cecd0 0x7fe6240d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe6237fe640 1 -- 172.21.15.45:0/3870142224 >> v2:172.21.15.155:3300/0 conn(0x7fe6240cecd0 msgr2=0x7fe6240d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:40.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe6237fe640 1 --2- 172.21.15.45:0/3870142224 >> v2:172.21.15.155:3300/0 conn(0x7fe6240cecd0 0x7fe6240d1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe6237fe640 1 -- 172.21.15.45:0/3870142224 >> v1:172.21.15.155:6789/0 conn(0x7fe6240b4490 legacy=0x7fe6240b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:40.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.527+0000 7fe6237fe640 1 -- 172.21.15.45:0/3870142224 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240d1370 con 0x7fe62415c480 2023-07-09T02:18:40.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe6237fe640 1 --2- 172.21.15.45:0/3870142224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62415c480 0x7fe6240cd060 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe6240b1840 tx=0x7fe61401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef3afd8c570a6f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:40.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe6227fc640 1 -- 172.21.15.45:0/3870142224 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6140ac630 con 0x7fe62415c480 2023-07-09T02:18:40.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe6227fc640 1 -- 172.21.15.45:0/3870142224 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6140ac790 con 0x7fe62415c480 2023-07-09T02:18:40.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe6227fc640 1 -- 172.21.15.45:0/3870142224 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6140acb20 con 0x7fe62415c480 2023-07-09T02:18:40.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe62a248640 1 -- 172.21.15.45:0/3870142224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62415c480 msgr2=0x7fe6240cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe62a248640 1 --2- 172.21.15.45:0/3870142224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62415c480 0x7fe6240cd060 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe6240b1840 tx=0x7fe61401c4c0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe62a248640 1 -- 172.21.15.45:0/3870142224 shutdown_connections 2023-07-09T02:18:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe62a248640 1 --2- 172.21.15.45:0/3870142224 >> v2:172.21.15.155:3300/0 conn(0x7fe6240cecd0 0x7fe6240d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe62a248640 1 --2- 172.21.15.45:0/3870142224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe62415c480 0x7fe6240cd060 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe62a248640 1 -- 172.21.15.45:0/3870142224 >> 172.21.15.45:0/3870142224 conn(0x7fe6240cf490 msgr2=0x7fe6240cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe62a248640 1 -- 172.21.15.45:0/3870142224 shutdown_connections 2023-07-09T02:18:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.531+0000 7fe62a248640 1 -- 172.21.15.45:0/3870142224 wait complete. 2023-07-09T02:18:40.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 Processor -- start 2023-07-09T02:18:40.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 -- start start 2023-07-09T02:18:40.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6240b4490 0x7fe62414d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6240cecd0 0x7fe6240c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe62415c480 0x7fe6240ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240b8430 con 0x7fe6240cecd0 2023-07-09T02:18:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62415dc80 con 0x7fe62415c480 2023-07-09T02:18:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62415df60 con 0x7fe6240b4490 2023-07-09T02:18:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6240cecd0 0x7fe6240c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6240cecd0 0x7fe6240c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42570/0 (socket says 172.21.15.45:42570) 2023-07-09T02:18:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 -- 172.21.15.45:0/174289840 learned_addr learned my addr 172.21.15.45:0/174289840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe6237fe640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6240b4490 0x7fe62414d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe623fff640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe62415c480 0x7fe6240ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 -- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6240b4490 msgr2=0x7fe62414d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6240b4490 0x7fe62414d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 -- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe62415c480 msgr2=0x7fe6240ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe62415c480 0x7fe6240ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 -- 172.21.15.45:0/174289840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140094d0 con 0x7fe6240cecd0 2023-07-09T02:18:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe6237fe640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6240b4490 0x7fe62414d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe622ffd640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6240cecd0 0x7fe6240c9c00 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe61800d800 tx=0x7fe61800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:40.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe60bfff640 1 -- 172.21.15.45:0/174289840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61800b6c0 con 0x7fe6240cecd0 2023-07-09T02:18:40.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe60bfff640 1 -- 172.21.15.45:0/174289840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61800b820 con 0x7fe6240cecd0 2023-07-09T02:18:40.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe60bfff640 1 -- 172.21.15.45:0/174289840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61800bb90 con 0x7fe6240cecd0 2023-07-09T02:18:40.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.535+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62415e240 con 0x7fe6240cecd0 2023-07-09T02:18:40.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.539+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6240c6540 con 0x7fe6240cecd0 2023-07-09T02:18:40.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.539+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62404d7d0 con 0x7fe6240cecd0 2023-07-09T02:18:40.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.539+0000 7fe60bfff640 1 -- 172.21.15.45:0/174289840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe61800bcf0 con 0x7fe6240cecd0 2023-07-09T02:18:40.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.539+0000 7fe60bfff640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe610066280 0x7fe610068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:40.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.539+0000 7fe60bfff640 1 -- 172.21.15.45:0/174289840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe618083ff0 con 0x7fe6240cecd0 2023-07-09T02:18:40.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.539+0000 7fe6237fe640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe610066280 0x7fe610068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.543+0000 7fe6237fe640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe610066280 0x7fe610068730 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe6140ae000 tx=0x7fe614008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:40.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.543+0000 7fe60bfff640 1 -- 172.21.15.45:0/174289840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6180551b0 con 0x7fe6240cecd0 2023-07-09T02:18:40.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:40.707+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe6240b8570 con 0x7fe6240cecd0 2023-07-09T02:18:41.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.603+0000 7fe60bfff640 1 -- 172.21.15.45:0/174289840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe618054d40 con 0x7fe6240cecd0 2023-07-09T02:18:41.607 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:18:41.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe610066280 msgr2=0x7fe610068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:41.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe610066280 0x7fe610068730 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe6140ae000 tx=0x7fe614008040 comp rx=0 tx=0).stop 2023-07-09T02:18:41.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6240cecd0 msgr2=0x7fe6240c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:41.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6240cecd0 0x7fe6240c9c00 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe61800d800 tx=0x7fe61800dcc0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 shutdown_connections 2023-07-09T02:18:41.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe62415c480 0x7fe6240ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6240cecd0 0x7fe6240c9c00 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe610066280 0x7fe610068730 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 --2- 172.21.15.45:0/174289840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6240b4490 0x7fe62414d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 >> 172.21.15.45:0/174289840 conn(0x7fe6240cf490 msgr2=0x7fe6240b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:41.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 shutdown_connections 2023-07-09T02:18:41.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.607+0000 7fe62a248640 1 -- 172.21.15.45:0/174289840 wait complete. 2023-07-09T02:18:41.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:18:41.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e0e1ac640 1 Processor -- start 2023-07-09T02:18:41.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e0e1ac640 1 -- start start 2023-07-09T02:18:41.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e0e1ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e080b23b0 0x7f2e0806acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:41.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e0e1ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080afd60 0x7f2e0806cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:41.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e0e1ac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0806c1c0 con 0x7f2e080af990 2023-07-09T02:18:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e0e1ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e080ccdd0 con 0x7f2e080b23b0 2023-07-09T02:18:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e0e1ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080cbf00 con 0x7f2e080afd60 2023-07-09T02:18:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e06ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e080b23b0 0x7f2e0806acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e06ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e080b23b0 0x7f2e0806acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37796/0 (socket says 172.21.15.45:37796) 2023-07-09T02:18:41.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e06ffd640 1 -- 172.21.15.45:0/472778305 learned_addr learned my addr 172.21.15.45:0/472778305 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e07fff640 1 --2- 172.21.15.45:0/472778305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080afd60 0x7f2e0806cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e06ffd640 1 -- 172.21.15.45:0/472778305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080afd60 msgr2=0x7f2e0806cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e06ffd640 1 --2- 172.21.15.45:0/472778305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080afd60 0x7f2e0806cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e06ffd640 1 -- 172.21.15.45:0/472778305 >> v1:172.21.15.155:6789/0 conn(0x7f2e080af990 legacy=0x7f2e0806a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:41.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.787+0000 7f2e06ffd640 1 -- 172.21.15.45:0/472778305 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080cd120 con 0x7f2e080b23b0 2023-07-09T02:18:41.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e06ffd640 1 --2- 172.21.15.45:0/472778305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0806acd0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009870 tx=0x7f2dfc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e41ddeb939c689 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e067fc640 1 -- 172.21.15.45:0/472778305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0aa670 con 0x7f2e080b23b0 2023-07-09T02:18:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e067fc640 1 -- 172.21.15.45:0/472778305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0aa7d0 con 0x7f2e080b23b0 2023-07-09T02:18:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e067fc640 1 -- 172.21.15.45:0/472778305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0aab60 con 0x7f2e080b23b0 2023-07-09T02:18:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/472778305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 msgr2=0x7f2e0806acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/472778305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0806acd0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009870 tx=0x7f2dfc01c510 comp rx=0 tx=0).stop 2023-07-09T02:18:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/472778305 shutdown_connections 2023-07-09T02:18:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/472778305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080afd60 0x7f2e0806cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/472778305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0806acd0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/472778305 >> 172.21.15.45:0/472778305 conn(0x7f2e080999f0 msgr2=0x7f2e080d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:41.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/472778305 shutdown_connections 2023-07-09T02:18:41.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.791+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/472778305 wait complete. 2023-07-09T02:18:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 Processor -- start 2023-07-09T02:18:41.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 -- start start 2023-07-09T02:18:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080af990 0x7f2e080cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e080afd60 0x7f2e0814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e081575d0 con 0x7f2e080b23b0 2023-07-09T02:18:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0814f160 con 0x7f2e080afd60 2023-07-09T02:18:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080cff00 con 0x7f2e080af990 2023-07-09T02:18:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0814e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37800/0 (socket says 172.21.15.45:37800) 2023-07-09T02:18:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 -- 172.21.15.45:0/1403332256 learned_addr learned my addr 172.21.15.45:0/1403332256 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e077fe640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080af990 0x7f2e080cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e06ffd640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e080afd60 0x7f2e0814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 -- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080af990 msgr2=0x7f2e080cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080af990 0x7f2e080cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 -- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e080afd60 msgr2=0x7f2e0814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e080afd60 0x7f2e0814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 -- 172.21.15.45:0/1403332256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0094d0 con 0x7f2e080b23b0 2023-07-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e07fff640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0814e1b0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f2e00007e40 tx=0x7f2e0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2deffff640 1 -- 172.21.15.45:0/1403332256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00014620 con 0x7f2e080b23b0 2023-07-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2deffff640 1 -- 172.21.15.45:0/1403332256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0000ee90 con 0x7f2e080b23b0 2023-07-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e080d01e0 con 0x7f2e080b23b0 2023-07-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2deffff640 1 -- 172.21.15.45:0/1403332256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000149e0 con 0x7f2e080b23b0 2023-07-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.795+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e080d04c0 con 0x7f2e080b23b0 2023-07-09T02:18:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.799+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0804d7d0 con 0x7f2e080b23b0 2023-07-09T02:18:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.799+0000 7f2deffff640 1 -- 172.21.15.45:0/1403332256 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e00014b40 con 0x7f2e080b23b0 2023-07-09T02:18:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.799+0000 7f2deffff640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2df4066280 0x7f2df4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.799+0000 7f2deffff640 1 -- 172.21.15.45:0/1403332256 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2e00084440 con 0x7f2e080b23b0 2023-07-09T02:18:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.799+0000 7f2e077fe640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2df4066280 0x7f2df4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.799+0000 7f2e077fe640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2df4066280 0x7f2df4068730 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2df80017e0 tx=0x7f2df8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.803+0000 7f2deffff640 1 -- 172.21.15.45:0/1403332256 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e00051ab0 con 0x7f2e080b23b0 2023-07-09T02:18:41.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:41.963+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2e08157a40 con 0x7f2e080b23b0 2023-07-09T02:18:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.611+0000 7f2deffff640 1 -- 172.21.15.45:0/1403332256 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2e000550d0 con 0x7f2e080b23b0 2023-07-09T02:18:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:18:42.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2df4066280 msgr2=0x7f2df4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:42.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2df4066280 0x7f2df4068730 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2df80017e0 tx=0x7f2df8009040 comp rx=0 tx=0).stop 2023-07-09T02:18:42.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 msgr2=0x7f2e0814e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:42.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0814e1b0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f2e00007e40 tx=0x7f2e0000e4b0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 shutdown_connections 2023-07-09T02:18:42.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e080b23b0 0x7f2e0814e1b0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e080afd60 0x7f2e0814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2df4066280 0x7f2df4068730 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 --2- 172.21.15.45:0/1403332256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e080af990 0x7f2e080cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 >> 172.21.15.45:0/1403332256 conn(0x7f2e080999f0 msgr2=0x7f2e08155950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 shutdown_connections 2023-07-09T02:18:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.623+0000 7f2e0e1ac640 1 -- 172.21.15.45:0/1403332256 wait complete. 2023-07-09T02:18:42.648 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:18:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83eccd8640 1 Processor -- start 2023-07-09T02:18:42.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83eccd8640 1 -- start start 2023-07-09T02:18:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83eccd8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83e80d2620 0x7f83e80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83eccd8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f83e80cd120 0x7f83e80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83eccd8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e8160a50 con 0x7f83e815c060 2023-07-09T02:18:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83eccd8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e815c430 con 0x7f83e80d2620 2023-07-09T02:18:42.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83eccd8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e815fb60 con 0x7f83e80cd120 2023-07-09T02:18:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83e80d2620 0x7f83e80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83dffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83e80d2620 0x7f83e80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37802/0 (socket says 172.21.15.45:37802) 2023-07-09T02:18:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83dffff640 1 -- 172.21.15.45:0/4250629695 learned_addr learned my addr 172.21.15.45:0/4250629695 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:42.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83e6d9d640 1 --2- 172.21.15.45:0/4250629695 >> v2:172.21.15.155:3300/0 conn(0x7f83e80cd120 0x7f83e80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83dffff640 1 -- 172.21.15.45:0/4250629695 >> v2:172.21.15.155:3300/0 conn(0x7f83e80cd120 msgr2=0x7f83e80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83dffff640 1 --2- 172.21.15.45:0/4250629695 >> v2:172.21.15.155:3300/0 conn(0x7f83e80cd120 0x7f83e80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83dffff640 1 -- 172.21.15.45:0/4250629695 >> v1:172.21.15.155:6789/0 conn(0x7f83e815c060 legacy=0x7f83e80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.795+0000 7f83dffff640 1 -- 172.21.15.45:0/4250629695 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e815fe40 con 0x7f83e80d2620 2023-07-09T02:18:42.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83dffff640 1 --2- 172.21.15.45:0/4250629695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e80b4ed0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f83e806b120 tx=0x7f83d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b790f8983f390bb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:42.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83e5d9b640 1 -- 172.21.15.45:0/4250629695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d00aa430 con 0x7f83e80d2620 2023-07-09T02:18:42.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83e5d9b640 1 -- 172.21.15.45:0/4250629695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d00aa590 con 0x7f83e80d2620 2023-07-09T02:18:42.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83e5d9b640 1 -- 172.21.15.45:0/4250629695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d00aa920 con 0x7f83e80d2620 2023-07-09T02:18:42.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 -- 172.21.15.45:0/4250629695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 msgr2=0x7f83e80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:42.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 --2- 172.21.15.45:0/4250629695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e80b4ed0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f83e806b120 tx=0x7f83d001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 -- 172.21.15.45:0/4250629695 shutdown_connections 2023-07-09T02:18:42.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 --2- 172.21.15.45:0/4250629695 >> v2:172.21.15.155:3300/0 conn(0x7f83e80cd120 0x7f83e80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 --2- 172.21.15.45:0/4250629695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e80b4ed0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 -- 172.21.15.45:0/4250629695 >> 172.21.15.45:0/4250629695 conn(0x7f83e80698e0 msgr2=0x7f83e8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 -- 172.21.15.45:0/4250629695 shutdown_connections 2023-07-09T02:18:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 -- 172.21.15.45:0/4250629695 wait complete. 2023-07-09T02:18:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.799+0000 7f83eccd8640 1 Processor -- start 2023-07-09T02:18:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 -- start start 2023-07-09T02:18:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e80cd120 0x7f83e80cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83e815c060 0x7f83e815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e815a3b0 con 0x7f83e80d2620 2023-07-09T02:18:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80cced0 con 0x7f83e80cd120 2023-07-09T02:18:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8153580 con 0x7f83e815c060 2023-07-09T02:18:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e8151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37810/0 (socket says 172.21.15.45:37810) 2023-07-09T02:18:42.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 -- 172.21.15.45:0/2528464955 learned_addr learned my addr 172.21.15.45:0/2528464955 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83e659c640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e80cd120 0x7f83e80cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83e6d9d640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83e815c060 0x7f83e815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 -- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83e815c060 msgr2=0x7f83e815c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83e815c060 0x7f83e815c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 -- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e80cd120 msgr2=0x7f83e80cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e80cd120 0x7f83e80cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 -- 172.21.15.45:0/2528464955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d00094d0 con 0x7f83e80d2620 2023-07-09T02:18:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83dffff640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e8151d00 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f83d00190e0 tx=0x7f83d001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83deffd640 1 -- 172.21.15.45:0/2528464955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d00aa430 con 0x7f83e80d2620 2023-07-09T02:18:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83deffd640 1 -- 172.21.15.45:0/2528464955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d00b3820 con 0x7f83e80d2620 2023-07-09T02:18:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83deffd640 1 -- 172.21.15.45:0/2528464955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d00b3bd0 con 0x7f83e80d2620 2023-07-09T02:18:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e80b59f0 con 0x7f83e80d2620 2023-07-09T02:18:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e815a900 con 0x7f83e80d2620 2023-07-09T02:18:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.803+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e804d7d0 con 0x7f83e80d2620 2023-07-09T02:18:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.807+0000 7f83deffd640 1 -- 172.21.15.45:0/2528464955 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f83d00b3d30 con 0x7f83e80d2620 2023-07-09T02:18:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.807+0000 7f83deffd640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83c8066280 0x7f83c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.807+0000 7f83deffd640 1 -- 172.21.15.45:0/2528464955 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f83d011de90 con 0x7f83e80d2620 2023-07-09T02:18:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.807+0000 7f83e659c640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83c8066280 0x7f83c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.807+0000 7f83e659c640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83c8066280 0x7f83c8068730 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f83d8000f70 tx=0x7f83d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.811+0000 7f83deffd640 1 -- 172.21.15.45:0/2528464955 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83d00eb2f0 con 0x7f83e80d2620 2023-07-09T02:18:43.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:42.999+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f83e80b1d70 con 0x7f83e80d2620 2023-07-09T02:18:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.631+0000 7f83deffd640 1 -- 172.21.15.45:0/2528464955 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7f83d00c3070 con 0x7f83e80d2620 2023-07-09T02:18:43.637 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 19 and data pool 20 2023-07-09T02:18:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83c8066280 msgr2=0x7f83c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83c8066280 0x7f83c8068730 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f83d8000f70 tx=0x7f83d8009040 comp rx=0 tx=0).stop 2023-07-09T02:18:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 msgr2=0x7f83e8151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:43.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e8151d00 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f83d00190e0 tx=0x7f83d001ad10 comp rx=0 tx=0).stop 2023-07-09T02:18:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 shutdown_connections 2023-07-09T02:18:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f83c8066280 0x7f83c8068730 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83e815c060 0x7f83e815c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83e80d2620 0x7f83e8151d00 secure :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f83d00190e0 tx=0x7f83d001ad10 comp rx=0 tx=0).stop 2023-07-09T02:18:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 --2- 172.21.15.45:0/2528464955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83e80cd120 0x7f83e80cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 >> 172.21.15.45:0/2528464955 conn(0x7f83e80698e0 msgr2=0x7f83e80d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:43.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 shutdown_connections 2023-07-09T02:18:43.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.643+0000 7f83eccd8640 1 -- 172.21.15.45:0/2528464955 wait complete. 2023-07-09T02:18:43.673 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:43.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf98834640 1 Processor -- start 2023-07-09T02:18:43.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf98834640 1 -- start start 2023-07-09T02:18:43.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf98834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:43.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf98834640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faf940cd120 0x7faf940cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:43.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf98834640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf94160a50 con 0x7faf9415c060 2023-07-09T02:18:43.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf98834640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9415c430 con 0x7faf940cd120 2023-07-09T02:18:43.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf98834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9415fb60 con 0x7faf940d2620 2023-07-09T02:18:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf92d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faf940cd120 0x7faf940cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf92d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faf940cd120 0x7faf940cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37814/0 (socket says 172.21.15.45:37814) 2023-07-09T02:18:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf92d9d640 1 -- 172.21.15.45:0/2285387891 learned_addr learned my addr 172.21.15.45:0/2285387891 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf8bfff640 1 --2- 172.21.15.45:0/2285387891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:43.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf92d9d640 1 -- 172.21.15.45:0/2285387891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 msgr2=0x7faf940b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf92d9d640 1 --2- 172.21.15.45:0/2285387891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf940b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf92d9d640 1 -- 172.21.15.45:0/2285387891 >> v1:172.21.15.155:6789/0 conn(0x7faf9415c060 legacy=0x7faf940d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf92d9d640 1 -- 172.21.15.45:0/2285387891 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9415fe40 con 0x7faf940cd120 2023-07-09T02:18:43.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.815+0000 7faf8bfff640 1 --2- 172.21.15.45:0/2285387891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf940b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf92d9d640 1 --2- 172.21.15.45:0/2285387891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf940cd120 0x7faf940cee30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009e50 tx=0x7faf8c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4a295b3e9c985b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf91d9b640 1 -- 172.21.15.45:0/2285387891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0a58a0 con 0x7faf940cd120 2023-07-09T02:18:43.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf91d9b640 1 -- 172.21.15.45:0/2285387891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c0a5a00 con 0x7faf940cd120 2023-07-09T02:18:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf91d9b640 1 -- 172.21.15.45:0/2285387891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0a5d90 con 0x7faf940cd120 2023-07-09T02:18:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf98834640 1 -- 172.21.15.45:0/2285387891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf940cd120 msgr2=0x7faf940cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:43.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf98834640 1 --2- 172.21.15.45:0/2285387891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf940cd120 0x7faf940cee30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009e50 tx=0x7faf8c01c9e0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf98834640 1 -- 172.21.15.45:0/2285387891 shutdown_connections 2023-07-09T02:18:43.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf98834640 1 --2- 172.21.15.45:0/2285387891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf940cd120 0x7faf940cee30 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf98834640 1 --2- 172.21.15.45:0/2285387891 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf940b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf98834640 1 -- 172.21.15.45:0/2285387891 >> 172.21.15.45:0/2285387891 conn(0x7faf940698e0 msgr2=0x7faf94069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:43.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf98834640 1 -- 172.21.15.45:0/2285387891 shutdown_connections 2023-07-09T02:18:43.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.819+0000 7faf98834640 1 -- 172.21.15.45:0/2285387891 wait complete. 2023-07-09T02:18:43.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf98834640 1 Processor -- start 2023-07-09T02:18:43.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf98834640 1 -- start start 2023-07-09T02:18:43.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf98834640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf940cd120 0x7faf940cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:43.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf98834640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf94154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:43.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf98834640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf9415c060 0x7faf940cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf98834640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf940cb0f0 con 0x7faf9415c060 2023-07-09T02:18:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf98834640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf940c9b10 con 0x7faf940cd120 2023-07-09T02:18:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf98834640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf940c9df0 con 0x7faf940d2620 2023-07-09T02:18:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf9415c060 0x7faf940cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf9415c060 0x7faf940cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37830/0 (socket says 172.21.15.45:37830) 2023-07-09T02:18:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 -- 172.21.15.45:0/828075383 learned_addr learned my addr 172.21.15.45:0/828075383 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf9259c640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf940cd120 0x7faf940cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:43.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf8bfff640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf94154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:43.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 -- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 msgr2=0x7faf94154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf94154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 -- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf940cd120 msgr2=0x7faf940cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf940cd120 0x7faf940cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 -- 172.21.15.45:0/828075383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c009b30 con 0x7faf9415c060 2023-07-09T02:18:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.823+0000 7faf92d9d640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf9415c060 0x7faf940cb700 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7faf8c01a610 tx=0x7faf8c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf8affd640 1 -- 172.21.15.45:0/828075383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0b8670 con 0x7faf9415c060 2023-07-09T02:18:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf8affd640 1 -- 172.21.15.45:0/828075383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c0b87f0 con 0x7faf9415c060 2023-07-09T02:18:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf8affd640 1 -- 172.21.15.45:0/828075383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0b8ba0 con 0x7faf9415c060 2023-07-09T02:18:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf940b59f0 con 0x7faf9415c060 2023-07-09T02:18:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf940ca3b0 con 0x7faf9415c060 2023-07-09T02:18:43.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf940cef70 con 0x7faf9415c060 2023-07-09T02:18:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf8affd640 1 -- 172.21.15.45:0/828075383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf8c0b8d00 con 0x7faf9415c060 2023-07-09T02:18:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf8affd640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faf74066280 0x7faf74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf8affd640 1 -- 172.21.15.45:0/828075383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf8c11fd90 con 0x7faf9415c060 2023-07-09T02:18:43.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.827+0000 7faf9259c640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faf74066280 0x7faf74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:43.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.831+0000 7faf9259c640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faf74066280 0x7faf74068730 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faf84007fd0 tx=0x7faf84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:43.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.831+0000 7faf8affd640 1 -- 172.21.15.45:0/828075383 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf8c0ed480 con 0x7faf9415c060 2023-07-09T02:18:43.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf9404d7d0 con 0x7faf9415c060 2023-07-09T02:18:43.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf8affd640 1 -- 172.21.15.45:0/828075383 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+18324 (secure 0 0 0) 0x7faf8c0f0aa0 con 0x7faf9415c060 2023-07-09T02:18:43.990 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:43.990 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":152,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:43.004954+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:18:40.756512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T02:18:42.013313+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faf74066280 msgr2=0x7faf74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faf74066280 0x7faf74068730 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faf84007fd0 tx=0x7faf84009040 comp rx=0 tx=0).stop 2023-07-09T02:18:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf9415c060 msgr2=0x7faf940cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf9415c060 0x7faf940cb700 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7faf8c01a610 tx=0x7faf8c019780 comp rx=0 tx=0).stop 2023-07-09T02:18:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 shutdown_connections 2023-07-09T02:18:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf9415c060 0x7faf940cb700 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faf74066280 0x7faf74068730 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faf940d2620 0x7faf94154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 --2- 172.21.15.45:0/828075383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf940cd120 0x7faf940cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.987+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 >> 172.21.15.45:0/828075383 conn(0x7faf940698e0 msgr2=0x7faf940b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:43.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.991+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 shutdown_connections 2023-07-09T02:18:43.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:43.991+0000 7faf98834640 1 -- 172.21.15.45:0/828075383 wait complete. 2023-07-09T02:18:44.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efddc4d8640 1 Processor -- start 2023-07-09T02:18:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efddc4d8640 1 -- start start 2023-07-09T02:18:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efddc4d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efdd4158f40 0x7efdd406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efddc4d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40caf00 con 0x7efdd40ce5c0 2023-07-09T02:18:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efddc4d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40c9400 con 0x7efdd4158b70 2023-07-09T02:18:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efddc4d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd40cac20 con 0x7efdd4158f40 2023-07-09T02:18:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efdd9a73640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efdd4158f40 0x7efdd406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efddaa75640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efdd40ce5c0 0x7efdd406b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34708/0 (socket says 172.21.15.45:34708) 2023-07-09T02:18:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.151+0000 7efddaa75640 1 -- 172.21.15.45:0/939029095 learned_addr learned my addr 172.21.15.45:0/939029095 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.155+0000 7efdd9a73640 1 -- 172.21.15.45:0/939029095 >> v1:172.21.15.155:6789/0 conn(0x7efdd4158b70 legacy=0x7efdd415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.155+0000 7efdd9272640 1 -- 172.21.15.45:0/939029095 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705799397 0 0) 0x7efdd40caf00 con 0x7efdd40ce5c0 2023-07-09T02:18:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.155+0000 7efdd9a73640 1 -- 172.21.15.45:0/939029095 >> v1:172.21.15.45:6789/0 conn(0x7efdd40ce5c0 legacy=0x7efdd406b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.155+0000 7efdd9a73640 1 -- 172.21.15.45:0/939029095 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd40c8db0 con 0x7efdd4158f40 2023-07-09T02:18:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.155+0000 7efdd9a73640 1 --2- 172.21.15.45:0/939029095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd406eed0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009740 tx=0x7efdc401bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b9ede1187aa4fd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.155+0000 7efdd9272640 1 -- 172.21.15.45:0/939029095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40a8660 con 0x7efdd4158f40 2023-07-09T02:18:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.155+0000 7efdd9272640 1 -- 172.21.15.45:0/939029095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc40a87c0 con 0x7efdd4158f40 2023-07-09T02:18:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.155+0000 7efdd9272640 1 -- 172.21.15.45:0/939029095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40a8b50 con 0x7efdd4158f40 2023-07-09T02:18:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- 172.21.15.45:0/939029095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 msgr2=0x7efdd406eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 --2- 172.21.15.45:0/939029095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd406eed0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009740 tx=0x7efdc401bf00 comp rx=0 tx=0).stop 2023-07-09T02:18:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- 172.21.15.45:0/939029095 shutdown_connections 2023-07-09T02:18:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 --2- 172.21.15.45:0/939029095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd406eed0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- 172.21.15.45:0/939029095 >> 172.21.15.45:0/939029095 conn(0x7efdd40694b0 msgr2=0x7efdd40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- 172.21.15.45:0/939029095 shutdown_connections 2023-07-09T02:18:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- 172.21.15.45:0/939029095 wait complete. 2023-07-09T02:18:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 Processor -- start 2023-07-09T02:18:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- start start 2023-07-09T02:18:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd40ce5c0 0x7efdd41477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd4158b70 0x7efdd41595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd4159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4156a50 con 0x7efdd4158f40 2023-07-09T02:18:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4156720 con 0x7efdd40ce5c0 2023-07-09T02:18:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddc4d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4150660 con 0x7efdd4158b70 2023-07-09T02:18:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddaa75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd4159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddaa75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd4159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37856/0 (socket says 172.21.15.45:37856) 2023-07-09T02:18:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddaa75640 1 -- 172.21.15.45:0/739493580 learned_addr learned my addr 172.21.15.45:0/739493580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:44.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efdda274640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd40ce5c0 0x7efdd41477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efdd9a73640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd4158b70 0x7efdd41595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddaa75640 1 -- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd4158b70 msgr2=0x7efdd41595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddaa75640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd4158b70 0x7efdd41595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddaa75640 1 -- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd40ce5c0 msgr2=0x7efdd41477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddaa75640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd40ce5c0 0x7efdd41477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.159+0000 7efddaa75640 1 -- 172.21.15.45:0/739493580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc4009420 con 0x7efdd4158f40 2023-07-09T02:18:44.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efddaa75640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd4159b10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c7a0 tx=0x7efdcc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:44.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efdcaffd640 1 -- 172.21.15.45:0/739493580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00a640 con 0x7efdd4158f40 2023-07-09T02:18:44.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efdcaffd640 1 -- 172.21.15.45:0/739493580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00a7a0 con 0x7efdd4158f40 2023-07-09T02:18:44.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efdcaffd640 1 -- 172.21.15.45:0/739493580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00abd0 con 0x7efdd4158f40 2023-07-09T02:18:44.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd4150940 con 0x7efdd4158f40 2023-07-09T02:18:44.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd4150c20 con 0x7efdd4158f40 2023-07-09T02:18:44.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd4156890 con 0x7efdd4158f40 2023-07-09T02:18:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efdcaffd640 1 -- 172.21.15.45:0/739493580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efdcc00ad30 con 0x7efdd4158f40 2023-07-09T02:18:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efdcaffd640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdb8066280 0x7efdb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efdcaffd640 1 -- 172.21.15.45:0/739493580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efdcc083270 con 0x7efdd4158f40 2023-07-09T02:18:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.163+0000 7efdda274640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdb8066280 0x7efdb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.167+0000 7efdda274640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdb8066280 0x7efdb8068730 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efdd0007fd0 tx=0x7efdd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.167+0000 7efdcaffd640 1 -- 172.21.15.45:0/739493580 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efdd4156890 con 0x7efdd4158f40 2023-07-09T02:18:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.323+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdd4156890 con 0x7efdd4158f40 2023-07-09T02:18:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.323+0000 7efdcaffd640 1 -- 172.21.15.45:0/739493580 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+18324 (secure 0 0 0) 0x7efdd4156890 con 0x7efdd4158f40 2023-07-09T02:18:44.327 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:44.327 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":152,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:43.004954+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:18:40.756512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T02:18:42.013313+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdb8066280 msgr2=0x7efdb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdb8066280 0x7efdb8068730 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efdd0007fd0 tx=0x7efdd0009040 comp rx=0 tx=0).stop 2023-07-09T02:18:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 msgr2=0x7efdd4159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd4159b10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c7a0 tx=0x7efdcc00cc60 comp rx=0 tx=0).stop 2023-07-09T02:18:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 shutdown_connections 2023-07-09T02:18:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdd4158f40 0x7efdd4159b10 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efdb8066280 0x7efdb8068730 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdd4158b70 0x7efdd41595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 --2- 172.21.15.45:0/739493580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd40ce5c0 0x7efdd41477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 >> 172.21.15.45:0/739493580 conn(0x7efdd40694b0 msgr2=0x7efdd406f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 shutdown_connections 2023-07-09T02:18:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.327+0000 7efddc4d8640 1 -- 172.21.15.45:0/739493580 wait complete. 2023-07-09T02:18:44.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:18:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d3448640 1 Processor -- start 2023-07-09T02:18:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d3448640 1 -- start start 2023-07-09T02:18:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d3448640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26cc0c8f70 0x7f26cc06b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d3448640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26cc156340 0x7f26cc159660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d3448640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc06b690 con 0x7f26cc0c9340 2023-07-09T02:18:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d3448640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc06b970 con 0x7f26cc156340 2023-07-09T02:18:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d3448640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc06bc50 con 0x7f26cc0c8f70 2023-07-09T02:18:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d19e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26cc156340 0x7f26cc159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d19e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26cc156340 0x7f26cc159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37858/0 (socket says 172.21.15.45:37858) 2023-07-09T02:18:44.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d19e5640 1 -- 172.21.15.45:0/1203074821 learned_addr learned my addr 172.21.15.45:0/1203074821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:44.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d11e4640 1 --2- 172.21.15.45:0/1203074821 >> v2:172.21.15.155:3300/0 conn(0x7f26cc0c8f70 0x7f26cc06b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d19e5640 1 -- 172.21.15.45:0/1203074821 >> v2:172.21.15.155:3300/0 conn(0x7f26cc0c8f70 msgr2=0x7f26cc06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:44.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d19e5640 1 --2- 172.21.15.45:0/1203074821 >> v2:172.21.15.155:3300/0 conn(0x7f26cc0c8f70 0x7f26cc06b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d19e5640 1 -- 172.21.15.45:0/1203074821 >> v1:172.21.15.155:6789/0 conn(0x7f26cc0c9340 legacy=0x7f26cc155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d19e5640 1 -- 172.21.15.45:0/1203074821 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc06bf30 con 0x7f26cc156340 2023-07-09T02:18:44.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.495+0000 7f26d11e4640 1 --2- 172.21.15.45:0/1203074821 >> v2:172.21.15.155:3300/0 conn(0x7f26cc0c8f70 0x7f26cc06b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d19e5640 1 --2- 172.21.15.45:0/1203074821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc156340 0x7f26cc159660 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f26cc06ec20 tx=0x7f26c40213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b311ada3cef9e247 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26c3fff640 1 -- 172.21.15.45:0/1203074821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400b2d0 con 0x7f26cc156340 2023-07-09T02:18:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26c3fff640 1 -- 172.21.15.45:0/1203074821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c40ad050 con 0x7f26cc156340 2023-07-09T02:18:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26c3fff640 1 -- 172.21.15.45:0/1203074821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c4009820 con 0x7f26cc156340 2023-07-09T02:18:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d3448640 1 -- 172.21.15.45:0/1203074821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc156340 msgr2=0x7f26cc159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d3448640 1 --2- 172.21.15.45:0/1203074821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc156340 0x7f26cc159660 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f26cc06ec20 tx=0x7f26c40213c0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d3448640 1 -- 172.21.15.45:0/1203074821 shutdown_connections 2023-07-09T02:18:44.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d3448640 1 --2- 172.21.15.45:0/1203074821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc156340 0x7f26cc159660 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d3448640 1 --2- 172.21.15.45:0/1203074821 >> v2:172.21.15.155:3300/0 conn(0x7f26cc0c8f70 0x7f26cc06b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d3448640 1 -- 172.21.15.45:0/1203074821 >> 172.21.15.45:0/1203074821 conn(0x7f26cc0694b0 msgr2=0x7f26cc0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:44.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d3448640 1 -- 172.21.15.45:0/1203074821 shutdown_connections 2023-07-09T02:18:44.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.499+0000 7f26d3448640 1 -- 172.21.15.45:0/1203074821 wait complete. 2023-07-09T02:18:44.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 Processor -- start 2023-07-09T02:18:44.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 -- start start 2023-07-09T02:18:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0c8f70 0x7f26cc0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc0c9340 0x7f26cc15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc156340 0x7f26cc15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc15c9f0 con 0x7f26cc0c9340 2023-07-09T02:18:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc1e2cd0 con 0x7f26cc156340 2023-07-09T02:18:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc1e2fb0 con 0x7f26cc0c8f70 2023-07-09T02:18:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc0c9340 0x7f26cc15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc0c9340 0x7f26cc15bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37870/0 (socket says 172.21.15.45:37870) 2023-07-09T02:18:44.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 -- 172.21.15.45:0/360696548 learned_addr learned my addr 172.21.15.45:0/360696548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:44.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d19e5640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc156340 0x7f26cc15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d11e4640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0c8f70 0x7f26cc0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 -- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0c8f70 msgr2=0x7f26cc0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0c8f70 0x7f26cc0b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 -- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc156340 msgr2=0x7f26cc15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc156340 0x7f26cc15c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 -- 172.21.15.45:0/360696548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c400bd40 con 0x7f26cc0c9340 2023-07-09T02:18:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d09e3640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc0c9340 0x7f26cc15bf70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00c500 tx=0x7f26bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26c1ffb640 1 -- 172.21.15.45:0/360696548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc005220 con 0x7f26cc0c9340 2023-07-09T02:18:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26c1ffb640 1 -- 172.21.15.45:0/360696548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc005380 con 0x7f26cc0c9340 2023-07-09T02:18:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26c1ffb640 1 -- 172.21.15.45:0/360696548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc007270 con 0x7f26cc0c9340 2023-07-09T02:18:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc1e3290 con 0x7f26cc0c9340 2023-07-09T02:18:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.503+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc1e3850 con 0x7f26cc0c9340 2023-07-09T02:18:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.507+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc04d7d0 con 0x7f26cc0c9340 2023-07-09T02:18:44.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.507+0000 7f26c1ffb640 1 -- 172.21.15.45:0/360696548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26bc0073d0 con 0x7f26cc0c9340 2023-07-09T02:18:44.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.507+0000 7f26c1ffb640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26b00662b0 0x7f26b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.507+0000 7f26c1ffb640 1 -- 172.21.15.45:0/360696548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26bc0834e0 con 0x7f26cc0c9340 2023-07-09T02:18:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.507+0000 7f26d11e4640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26b00662b0 0x7f26b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.511+0000 7f26d11e4640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26b00662b0 0x7f26b0068760 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009950 tx=0x7f26c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.511+0000 7f26c1ffb640 1 -- 172.21.15.45:0/360696548 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26bc050a20 con 0x7f26cc0c9340 2023-07-09T02:18:44.599 INFO:tasks.ceph.mds.d.smithi155.stderr:2023-07-09T02:18:44.597+0000 7fdf794b9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:18:44.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:44.703+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f26cc0cc290 con 0x7f26cc0c9340 2023-07-09T02:18:45.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26c1ffb640 1 -- 172.21.15.45:0/360696548 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) v1 ==== 118+0+0 (secure 0 0 0) 0x7f26bc054040 con 0x7f26cc0c9340 2023-07-09T02:18:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26b00662b0 msgr2=0x7f26b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26b00662b0 0x7f26b0068760 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009950 tx=0x7f26c8008040 comp rx=0 tx=0).stop 2023-07-09T02:18:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc0c9340 msgr2=0x7f26cc15bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc0c9340 0x7f26cc15bf70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00c500 tx=0x7f26bc00c9c0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 shutdown_connections 2023-07-09T02:18:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26cc156340 0x7f26cc15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26cc0c9340 0x7f26cc15bf70 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26b00662b0 0x7f26b0068760 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 --2- 172.21.15.45:0/360696548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26cc0c8f70 0x7f26cc0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.659+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 >> 172.21.15.45:0/360696548 conn(0x7f26cc0694b0 msgr2=0x7f26cc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.663+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 shutdown_connections 2023-07-09T02:18:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.663+0000 7f26d3448640 1 -- 172.21.15.45:0/360696548 wait complete. 2023-07-09T02:18:45.686 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:18:45.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:18:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f622b47b640 1 Processor -- start 2023-07-09T02:18:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f622b47b640 1 -- start start 2023-07-09T02:18:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f622b47b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62240d2620 0x7f62240b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f622b47b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6224160a50 con 0x7f62240cd120 2023-07-09T02:18:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f622b47b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622415c430 con 0x7f622415c060 2023-07-09T02:18:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f622b47b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622415fb60 con 0x7f62240d2620 2023-07-09T02:18:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f6229a18640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f62240cd120 0x7f62240cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34712/0 (socket says 172.21.15.45:34712) 2023-07-09T02:18:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f6229a18640 1 -- 172.21.15.45:0/2868163709 learned_addr learned my addr 172.21.15.45:0/2868163709 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f6228a16640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62240d2620 0x7f62240b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153970400 0 0) 0x7f6224160a50 con 0x7f62240cd120 2023-07-09T02:18:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6210003530 con 0x7f62240cd120 2023-07-09T02:18:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593373672 0 0) 0x7f6210003530 con 0x7f62240cd120 2023-07-09T02:18:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62240d2620 msgr2=0x7f62240b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62240d2620 0x7f62240b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 >> v1:172.21.15.155:6789/0 conn(0x7f622415c060 legacy=0x7f62240d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622415fe40 con 0x7f62240cd120 2023-07-09T02:18:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f621c001a00 con 0x7f62240cd120 2023-07-09T02:18:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 >> v1:172.21.15.45:6789/0 conn(0x7f62240cd120 legacy=0x7f62240cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62240d2620 0x7f62100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6210003f30 0x7f62100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210004d10 0x7f6210005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622415fb60 con 0x7f6210003f30 2023-07-09T02:18:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621000ba70 con 0x7f6210004d10 2023-07-09T02:18:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621000bc30 con 0x7f62240d2620 2023-07-09T02:18:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f6228a16640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6210003f30 0x7f62100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.835+0000 7f6229217640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62240d2620 0x7f62100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f6229a18640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210004d10 0x7f6210005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f6228a16640 1 -- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62240d2620 msgr2=0x7f62100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f6228a16640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62240d2620 0x7f62100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f6228a16640 1 -- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210004d10 msgr2=0x7f6210005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f6228a16640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210004d10 0x7f6210005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f6228a16640 1 -- 172.21.15.45:0/2868163709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210003530 con 0x7f6210003f30 2023-07-09T02:18:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f6228a16640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6210003f30 0x7f62100047d0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f62240d2a10 tx=0x7f621401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1537aa009e15bd0f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:45.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140a64e0 con 0x7f6210003f30 2023-07-09T02:18:45.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62140a6640 con 0x7f6210003f30 2023-07-09T02:18:45.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f621bfff640 1 -- 172.21.15.45:0/2868163709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140a69f0 con 0x7f6210003f30 2023-07-09T02:18:45.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f622b47b640 1 -- 172.21.15.45:0/2868163709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6210003f30 msgr2=0x7f62100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:45.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f622b47b640 1 --2- 172.21.15.45:0/2868163709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6210003f30 0x7f62100047d0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f62240d2a10 tx=0x7f621401c9f0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f6229a18640 1 -- 172.21.15.45:0/2868163709 reap_dead start 2023-07-09T02:18:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f622b47b640 1 -- 172.21.15.45:0/2868163709 shutdown_connections 2023-07-09T02:18:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.839+0000 7f622b47b640 1 -- 172.21.15.45:0/2868163709 >> 172.21.15.45:0/2868163709 conn(0x7f62240698e0 msgr2=0x7f6224069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:45.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 -- 172.21.15.45:0/2868163709 shutdown_connections 2023-07-09T02:18:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 -- 172.21.15.45:0/2868163709 wait complete. 2023-07-09T02:18:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 Processor -- start 2023-07-09T02:18:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 -- start start 2023-07-09T02:18:45.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6210003f30 0x7f62241f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622415ecc0 0x7f62240cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622415f130 0x7f62240ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240c9ec0 con 0x7f622415ecc0 2023-07-09T02:18:45.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622415d9d0 con 0x7f622415f130 2023-07-09T02:18:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f622b47b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622415dc20 con 0x7f6210003f30 2023-07-09T02:18:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622415ecc0 0x7f62240cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:45.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622415ecc0 0x7f62240cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37884/0 (socket says 172.21.15.45:37884) 2023-07-09T02:18:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 -- 172.21.15.45:0/863726409 learned_addr learned my addr 172.21.15.45:0/863726409 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6229217640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6210003f30 0x7f62241f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6229a18640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622415f130 0x7f62240ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:45.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 -- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6210003f30 msgr2=0x7f62241f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6210003f30 0x7f62241f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 -- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622415f130 msgr2=0x7f62240ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622415f130 0x7f62240ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 -- 172.21.15.45:0/863726409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622415df00 con 0x7f622415ecc0 2023-07-09T02:18:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.843+0000 7f6228a16640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622415ecc0 0x7f62240cc630 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f62140b0040 tx=0x7f6210005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f6219ffb640 1 -- 172.21.15.45:0/863726409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140a69c0 con 0x7f622415ecc0 2023-07-09T02:18:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f6219ffb640 1 -- 172.21.15.45:0/863726409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62140a6b20 con 0x7f622415ecc0 2023-07-09T02:18:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f6219ffb640 1 -- 172.21.15.45:0/863726409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214006040 con 0x7f622415ecc0 2023-07-09T02:18:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622415e1e0 con 0x7f622415ecc0 2023-07-09T02:18:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622415e7a0 con 0x7f622415ecc0 2023-07-09T02:18:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622404d7d0 con 0x7f622415ecc0 2023-07-09T02:18:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f6219ffb640 1 -- 172.21.15.45:0/863726409 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62140061a0 con 0x7f622415ecc0 2023-07-09T02:18:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f6219ffb640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6208066280 0x7f6208068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f6219ffb640 1 -- 172.21.15.45:0/863726409 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62140aa070 con 0x7f622415ecc0 2023-07-09T02:18:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.847+0000 7f6229217640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6208066280 0x7f6208068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.851+0000 7f6229217640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6208066280 0x7f6208068730 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6220000c10 tx=0x7f6220009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:45.851+0000 7f6219ffb640 1 -- 172.21.15.45:0/863726409 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62140ec200 con 0x7f622415ecc0 2023-07-09T02:18:46.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.039+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f62240d00e0 con 0x7f622415ecc0 2023-07-09T02:18:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f6219ffb640 1 -- 172.21.15.45:0/863726409 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v75) v1 ==== 122+0+0 (secure 0 0 0) 0x7f62140ef820 con 0x7f622415ecc0 2023-07-09T02:18:46.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6208066280 msgr2=0x7f6208068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6208066280 0x7f6208068730 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6220000c10 tx=0x7f6220009040 comp rx=0 tx=0).stop 2023-07-09T02:18:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622415ecc0 msgr2=0x7f62240cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622415ecc0 0x7f62240cc630 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f62140b0040 tx=0x7f6210005800 comp rx=0 tx=0).stop 2023-07-09T02:18:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 shutdown_connections 2023-07-09T02:18:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622415f130 0x7f62240ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622415ecc0 0x7f62240cc630 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6208066280 0x7f6208068730 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 --2- 172.21.15.45:0/863726409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6210003f30 0x7f62241f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 >> 172.21.15.45:0/863726409 conn(0x7f62240698e0 msgr2=0x7f62240d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 shutdown_connections 2023-07-09T02:18:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.667+0000 7f622b47b640 1 -- 172.21.15.45:0/863726409 wait complete. 2023-07-09T02:18:46.692 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:18:46.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:46.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.835+0000 7facfc33a640 1 Processor -- start 2023-07-09T02:18:46.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.835+0000 7facfc33a640 1 -- start start 2023-07-09T02:18:46.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facfc33a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7facf40d2620 0x7facf40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facfc33a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf4160a50 con 0x7facf40cd120 2023-07-09T02:18:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facfc33a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf415c430 con 0x7facf415c060 2023-07-09T02:18:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facfc33a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf415fb60 con 0x7facf40d2620 2023-07-09T02:18:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facf98d5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7facf40d2620 0x7facf40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facfa8d7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7facf40cd120 0x7facf40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34720/0 (socket says 172.21.15.45:34720) 2023-07-09T02:18:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facfa8d7640 1 -- 172.21.15.45:0/158462484 learned_addr learned my addr 172.21.15.45:0/158462484 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facf98d5640 1 -- 172.21.15.45:0/158462484 >> v1:172.21.15.155:6789/0 conn(0x7facf415c060 legacy=0x7facf40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facf98d5640 1 -- 172.21.15.45:0/158462484 >> v1:172.21.15.45:6789/0 conn(0x7facf40cd120 legacy=0x7facf40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facf98d5640 1 -- 172.21.15.45:0/158462484 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf415fe40 con 0x7facf40d2620 2023-07-09T02:18:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facf98d5640 1 --2- 172.21.15.45:0/158462484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf40d2620 0x7facf40b4ed0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7face40097c0 tx=0x7face401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2425b843c06a9f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.839+0000 7facf90d4640 1 -- 172.21.15.45:0/158462484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face40ab650 con 0x7facf40d2620 2023-07-09T02:18:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facf90d4640 1 -- 172.21.15.45:0/158462484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face40ab7b0 con 0x7facf40d2620 2023-07-09T02:18:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facf90d4640 1 -- 172.21.15.45:0/158462484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face40abb40 con 0x7facf40d2620 2023-07-09T02:18:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- 172.21.15.45:0/158462484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf40d2620 msgr2=0x7facf40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 --2- 172.21.15.45:0/158462484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf40d2620 0x7facf40b4ed0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7face40097c0 tx=0x7face401c450 comp rx=0 tx=0).stop 2023-07-09T02:18:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- 172.21.15.45:0/158462484 shutdown_connections 2023-07-09T02:18:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 --2- 172.21.15.45:0/158462484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf40d2620 0x7facf40b4ed0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- 172.21.15.45:0/158462484 >> 172.21.15.45:0/158462484 conn(0x7facf40698e0 msgr2=0x7facf4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- 172.21.15.45:0/158462484 shutdown_connections 2023-07-09T02:18:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- 172.21.15.45:0/158462484 wait complete. 2023-07-09T02:18:46.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 Processor -- start 2023-07-09T02:18:46.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- start start 2023-07-09T02:18:46.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facf40cd120 0x7facf4150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:46.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf40d2620 0x7facf40b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:46.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf415c060 0x7facf40b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf41510e0 con 0x7facf415c060 2023-07-09T02:18:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf415e9e0 con 0x7facf40d2620 2023-07-09T02:18:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfc33a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf4154db0 con 0x7facf40cd120 2023-07-09T02:18:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfa8d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf415c060 0x7facf40b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfa8d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf415c060 0x7facf40b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37912/0 (socket says 172.21.15.45:37912) 2023-07-09T02:18:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.843+0000 7facfa8d7640 1 -- 172.21.15.45:0/2432227395 learned_addr learned my addr 172.21.15.45:0/2432227395 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facf98d5640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf40d2620 0x7facf40b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfa0d6640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facf40cd120 0x7facf4150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfa8d7640 1 -- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facf40cd120 msgr2=0x7facf4150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfa8d7640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facf40cd120 0x7facf4150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfa8d7640 1 -- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf40d2620 msgr2=0x7facf40b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfa8d7640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf40d2620 0x7facf40b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfa8d7640 1 -- 172.21.15.45:0/2432227395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face4009420 con 0x7facf415c060 2023-07-09T02:18:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfa8d7640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf415c060 0x7facf40b74e0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7facec00cbc0 tx=0x7facec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7faceaffd640 1 -- 172.21.15.45:0/2432227395 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00ad40 con 0x7facf415c060 2023-07-09T02:18:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7faceaffd640 1 -- 172.21.15.45:0/2432227395 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec012400 con 0x7facf415c060 2023-07-09T02:18:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7faceaffd640 1 -- 172.21.15.45:0/2432227395 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00aea0 con 0x7facf415c060 2023-07-09T02:18:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf40b59f0 con 0x7facf415c060 2023-07-09T02:18:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf4155370 con 0x7facf415c060 2023-07-09T02:18:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf4155560 con 0x7facf415c060 2023-07-09T02:18:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7faceaffd640 1 -- 172.21.15.45:0/2432227395 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7facec007070 con 0x7facf415c060 2023-07-09T02:18:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7faceaffd640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd8066280 0x7facd8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.847+0000 7faceaffd640 1 -- 172.21.15.45:0/2432227395 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7facec083cc0 con 0x7facf415c060 2023-07-09T02:18:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.851+0000 7facfa0d6640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd8066280 0x7facd8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.851+0000 7facfa0d6640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd8066280 0x7facd8068730 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7facf0007fd0 tx=0x7facf0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:46.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:46.851+0000 7faceaffd640 1 -- 172.21.15.45:0/2432227395 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7facec08a080 con 0x7facf415c060 2023-07-09T02:18:47.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facf404d7d0 con 0x7facf415c060 2023-07-09T02:18:47.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7faceaffd640 1 -- 172.21.15.45:0/2432227395 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4679 (secure 0 0 0) 0x7facec017090 con 0x7facf415c060 2023-07-09T02:18:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:47.046 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1878423144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1878423144},{"type":"v1","addr":"172.21.15.155:6836","nonce":1878423144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":8259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1407467413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1407467413},{"type":"v1","addr":"172.21.15.45:6833","nonce":1407467413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2772552547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2772552547},{"type":"v1","addr":"172.21.15.45:6835","nonce":2772552547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:18:43.005298+0000","modified":"2023-07-09T02:18:46.662099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8274":{"gid":8274,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3076932418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3076932418},{"type":"v1","addr":"172.21.15.155:6837","nonce":3076932418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T02:18:47.047 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 75 2023-07-09T02:18:47.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd8066280 msgr2=0x7facd8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd8066280 0x7facd8068730 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7facf0007fd0 tx=0x7facf0009040 comp rx=0 tx=0).stop 2023-07-09T02:18:47.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf415c060 msgr2=0x7facf40b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf415c060 0x7facf40b74e0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7facec00cbc0 tx=0x7facec00a430 comp rx=0 tx=0).stop 2023-07-09T02:18:47.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 shutdown_connections 2023-07-09T02:18:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf415c060 0x7facf40b74e0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf40d2620 0x7facf40b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd8066280 0x7facd8068730 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 --2- 172.21.15.45:0/2432227395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facf40cd120 0x7facf4150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 >> 172.21.15.45:0/2432227395 conn(0x7facf40698e0 msgr2=0x7facf40d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 shutdown_connections 2023-07-09T02:18:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.043+0000 7facfc33a640 1 -- 172.21.15.45:0/2432227395 wait complete. 2023-07-09T02:18:47.066 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:18:47.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31bd40b640 1 Processor -- start 2023-07-09T02:18:47.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31bd40b640 1 -- start start 2023-07-09T02:18:47.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31bd40b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31b80d2620 0x7f31b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31bd40b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b8160a50 con 0x7f31b80cd120 2023-07-09T02:18:47.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31bd40b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b815c430 con 0x7f31b815c060 2023-07-09T02:18:47.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31bd40b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b815fb60 con 0x7f31b80d2620 2023-07-09T02:18:47.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31affff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31b80d2620 0x7f31b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31b77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f31b80cd120 0x7f31b80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34736/0 (socket says 172.21.15.45:34736) 2023-07-09T02:18:47.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.207+0000 7f31b77fe640 1 -- 172.21.15.45:0/1734194037 learned_addr learned my addr 172.21.15.45:0/1734194037 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:47.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31affff640 1 -- 172.21.15.45:0/1734194037 >> v1:172.21.15.155:6789/0 conn(0x7f31b815c060 legacy=0x7f31b80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31affff640 1 -- 172.21.15.45:0/1734194037 >> v1:172.21.15.45:6789/0 conn(0x7f31b80cd120 legacy=0x7f31b80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31affff640 1 -- 172.21.15.45:0/1734194037 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b815fe40 con 0x7f31b80d2620 2023-07-09T02:18:47.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31b67fc640 1 -- 172.21.15.45:0/1734194037 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754750263 0 0) 0x7f31b8160a50 con 0x7f31b80cd120 2023-07-09T02:18:47.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31affff640 1 --2- 172.21.15.45:0/1734194037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80d2620 0x7f31b80b4ed0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f31a00097c0 tx=0x7f31a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8041660f0a237c70 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31b67fc640 1 -- 172.21.15.45:0/1734194037 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00ab650 con 0x7f31b80d2620 2023-07-09T02:18:47.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31b67fc640 1 -- 172.21.15.45:0/1734194037 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00ab7b0 con 0x7f31b80d2620 2023-07-09T02:18:47.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31b67fc640 1 -- 172.21.15.45:0/1734194037 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00abb40 con 0x7f31b80d2620 2023-07-09T02:18:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31bd40b640 1 -- 172.21.15.45:0/1734194037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80d2620 msgr2=0x7f31b80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31bd40b640 1 --2- 172.21.15.45:0/1734194037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80d2620 0x7f31b80b4ed0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f31a00097c0 tx=0x7f31a001c450 comp rx=0 tx=0).stop 2023-07-09T02:18:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31bd40b640 1 -- 172.21.15.45:0/1734194037 shutdown_connections 2023-07-09T02:18:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31bd40b640 1 --2- 172.21.15.45:0/1734194037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80d2620 0x7f31b80b4ed0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31bd40b640 1 -- 172.21.15.45:0/1734194037 >> 172.21.15.45:0/1734194037 conn(0x7f31b80698e0 msgr2=0x7f31b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31bd40b640 1 -- 172.21.15.45:0/1734194037 shutdown_connections 2023-07-09T02:18:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.211+0000 7f31bd40b640 1 -- 172.21.15.45:0/1734194037 wait complete. 2023-07-09T02:18:47.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 Processor -- start 2023-07-09T02:18:47.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 -- start start 2023-07-09T02:18:47.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80cd120 0x7f31b81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b80d2620 0x7f31b81623e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b815c060 0x7f31b8158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8161340 con 0x7f31b80cd120 2023-07-09T02:18:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8161620 con 0x7f31b815c060 2023-07-09T02:18:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8161900 con 0x7f31b80d2620 2023-07-09T02:18:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80cd120 0x7f31b81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80cd120 0x7f31b81580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37930/0 (socket says 172.21.15.45:37930) 2023-07-09T02:18:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 -- 172.21.15.45:0/3360553639 learned_addr learned my addr 172.21.15.45:0/3360553639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31affff640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b80d2620 0x7f31b81623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b77fe640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b815c060 0x7f31b8158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 -- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b80d2620 msgr2=0x7f31b81623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b80d2620 0x7f31b81623e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 -- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b815c060 msgr2=0x7f31b8158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b815c060 0x7f31b8158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 -- 172.21.15.45:0/3360553639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0009420 con 0x7f31b80cd120 2023-07-09T02:18:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b77fe640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b815c060 0x7f31b8158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31b6ffd640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80cd120 0x7f31b81580b0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c3c0 tx=0x7f31a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31af7fe640 1 -- 172.21.15.45:0/3360553639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80052d0 con 0x7f31b80cd120 2023-07-09T02:18:47.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31af7fe640 1 -- 172.21.15.45:0/3360553639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8005430 con 0x7f31b80cd120 2023-07-09T02:18:47.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31af7fe640 1 -- 172.21.15.45:0/3360553639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8003840 con 0x7f31b80cd120 2023-07-09T02:18:47.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.215+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b80b59f0 con 0x7f31b80cd120 2023-07-09T02:18:47.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.219+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b8161ec0 con 0x7f31b80cd120 2023-07-09T02:18:47.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.219+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b804d7d0 con 0x7f31b80cd120 2023-07-09T02:18:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.219+0000 7f31af7fe640 1 -- 172.21.15.45:0/3360553639 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31a80039a0 con 0x7f31b80cd120 2023-07-09T02:18:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.219+0000 7f31af7fe640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3198066280 0x7f3198068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.219+0000 7f31af7fe640 1 -- 172.21.15.45:0/3360553639 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31a80831c0 con 0x7f31b80cd120 2023-07-09T02:18:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.219+0000 7f31affff640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3198066280 0x7f3198068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.223+0000 7f31affff640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3198066280 0x7f3198068730 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f31a00af000 tx=0x7f31a00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.223+0000 7f31af7fe640 1 -- 172.21.15.45:0/3360553639 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31a80506f0 con 0x7f31b80cd120 2023-07-09T02:18:47.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.379+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31b806baa0 con 0x7f31b80cd120 2023-07-09T02:18:47.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31af7fe640 1 -- 172.21.15.45:0/3360553639 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f31a8053d10 con 0x7f31b80cd120 2023-07-09T02:18:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:47.384 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":153,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:18:44.629975+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:18:40.756512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T02:18:42.013313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:18:47.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3198066280 msgr2=0x7f3198068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3198066280 0x7f3198068730 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f31a00af000 tx=0x7f31a00a7000 comp rx=0 tx=0).stop 2023-07-09T02:18:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80cd120 msgr2=0x7f31b81580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80cd120 0x7f31b81580b0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c3c0 tx=0x7f31a800c880 comp rx=0 tx=0).stop 2023-07-09T02:18:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 shutdown_connections 2023-07-09T02:18:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31b815c060 0x7f31b8158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3198066280 0x7f3198068730 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31b80d2620 0x7f31b81623e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 --2- 172.21.15.45:0/3360553639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31b80cd120 0x7f31b81580b0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 >> 172.21.15.45:0/3360553639 conn(0x7f31b80698e0 msgr2=0x7f31b80d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:47.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 shutdown_connections 2023-07-09T02:18:47.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.383+0000 7f31bd40b640 1 -- 172.21.15.45:0/3360553639 wait complete. 2023-07-09T02:18:47.405 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:18:47.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:18:47.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb979419640 1 Processor -- start 2023-07-09T02:18:47.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb979419640 1 -- start start 2023-07-09T02:18:47.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb979419640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb97415c060 0x7fb9740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb979419640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb974160a50 con 0x7fb9740d2620 2023-07-09T02:18:47.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb979419640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97415c430 con 0x7fb9740cd120 2023-07-09T02:18:47.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb979419640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97415fb60 con 0x7fb97415c060 2023-07-09T02:18:47.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb9737fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb9740d2620 0x7fb9740cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34750/0 (socket says 172.21.15.45:34750) 2023-07-09T02:18:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb9737fe640 1 -- 172.21.15.45:0/3459757810 learned_addr learned my addr 172.21.15.45:0/3459757810 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb972ffd640 1 --2- 172.21.15.45:0/3459757810 >> v2:172.21.15.155:3300/0 conn(0x7fb97415c060 0x7fb9740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb9727fc640 1 -- 172.21.15.45:0/3459757810 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799997257 0 0) 0x7fb974160a50 con 0x7fb9740d2620 2023-07-09T02:18:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb9727fc640 1 -- 172.21.15.45:0/3459757810 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb960003530 con 0x7fb9740d2620 2023-07-09T02:18:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb9727fc640 1 -- 172.21.15.45:0/3459757810 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039146751 0 0) 0x7fb97415c430 con 0x7fb9740cd120 2023-07-09T02:18:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb972ffd640 1 -- 172.21.15.45:0/3459757810 >> v1:172.21.15.155:6789/0 conn(0x7fb9740cd120 legacy=0x7fb9740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb972ffd640 1 -- 172.21.15.45:0/3459757810 >> v1:172.21.15.45:6789/0 conn(0x7fb9740d2620 legacy=0x7fb9740cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.547+0000 7fb972ffd640 1 -- 172.21.15.45:0/3459757810 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97415fe40 con 0x7fb97415c060 2023-07-09T02:18:47.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb972ffd640 1 --2- 172.21.15.45:0/3459757810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb97415c060 0x7fb9740b4ed0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb9640097c0 tx=0x7fb96401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba1d7f0e648df1ca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb9727fc640 1 -- 172.21.15.45:0/3459757810 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9640ab650 con 0x7fb97415c060 2023-07-09T02:18:47.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb9727fc640 1 -- 172.21.15.45:0/3459757810 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9640ab7b0 con 0x7fb97415c060 2023-07-09T02:18:47.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb9727fc640 1 -- 172.21.15.45:0/3459757810 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9640abb40 con 0x7fb97415c060 2023-07-09T02:18:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb979419640 1 -- 172.21.15.45:0/3459757810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb97415c060 msgr2=0x7fb9740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb979419640 1 --2- 172.21.15.45:0/3459757810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb97415c060 0x7fb9740b4ed0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb9640097c0 tx=0x7fb96401c450 comp rx=0 tx=0).stop 2023-07-09T02:18:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb979419640 1 -- 172.21.15.45:0/3459757810 shutdown_connections 2023-07-09T02:18:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb979419640 1 --2- 172.21.15.45:0/3459757810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb97415c060 0x7fb9740b4ed0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb979419640 1 -- 172.21.15.45:0/3459757810 >> 172.21.15.45:0/3459757810 conn(0x7fb9740698e0 msgr2=0x7fb974069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb979419640 1 -- 172.21.15.45:0/3459757810 shutdown_connections 2023-07-09T02:18:47.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.551+0000 7fb979419640 1 -- 172.21.15.45:0/3459757810 wait complete. 2023-07-09T02:18:47.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 Processor -- start 2023-07-09T02:18:47.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 -- start start 2023-07-09T02:18:47.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740cd120 0x7fb974150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9740d2620 0x7fb9741557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb97415c060 0x7fb9740b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974154a50 con 0x7fb97415c060 2023-07-09T02:18:47.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97415d350 con 0x7fb9740cd120 2023-07-09T02:18:47.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974154d00 con 0x7fb9740d2620 2023-07-09T02:18:47.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb97415c060 0x7fb9740b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb97415c060 0x7fb9740b7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37936/0 (socket says 172.21.15.45:37936) 2023-07-09T02:18:47.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 -- 172.21.15.45:0/2498292369 learned_addr learned my addr 172.21.15.45:0/2498292369 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:47.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb972ffd640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740cd120 0x7fb974150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb96bfff640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9740d2620 0x7fb9741557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 -- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9740d2620 msgr2=0x7fb9741557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9740d2620 0x7fb9741557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 -- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740cd120 msgr2=0x7fb974150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740cd120 0x7fb974150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 -- 172.21.15.45:0/2498292369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964009420 con 0x7fb97415c060 2023-07-09T02:18:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb9737fe640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb97415c060 0x7fb9740b7f60 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00cae0 tx=0x7fb96c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb96b7fe640 1 -- 172.21.15.45:0/2498292369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00ac40 con 0x7fb97415c060 2023-07-09T02:18:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb96b7fe640 1 -- 172.21.15.45:0/2498292369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c00ada0 con 0x7fb97415c060 2023-07-09T02:18:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb96b7fe640 1 -- 172.21.15.45:0/2498292369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c012640 con 0x7fb97415c060 2023-07-09T02:18:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9740b59f0 con 0x7fb97415c060 2023-07-09T02:18:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.555+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9741552c0 con 0x7fb97415c060 2023-07-09T02:18:47.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.559+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97404d7d0 con 0x7fb97415c060 2023-07-09T02:18:47.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.559+0000 7fb96b7fe640 1 -- 172.21.15.45:0/2498292369 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb96c007070 con 0x7fb97415c060 2023-07-09T02:18:47.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.559+0000 7fb96b7fe640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb954066280 0x7fb954068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.559+0000 7fb96b7fe640 1 -- 172.21.15.45:0/2498292369 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb96c083cd0 con 0x7fb97415c060 2023-07-09T02:18:47.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.559+0000 7fb972ffd640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb954066280 0x7fb954068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.559+0000 7fb972ffd640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb954066280 0x7fb954068730 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb9640af000 tx=0x7fb9640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.563+0000 7fb96b7fe640 1 -- 172.21.15.45:0/2498292369 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb96c0511f0 con 0x7fb97415c060 2023-07-09T02:18:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.715+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb974154b90 con 0x7fb954066280 2023-07-09T02:18:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb96b7fe640 1 -- 172.21.15.45:0/2498292369 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306167 (secure 0 0 0) 0x7fb974154b90 con 0x7fb954066280 2023-07-09T02:18:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:47.731 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:18:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb954066280 msgr2=0x7fb954068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb954066280 0x7fb954068730 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb9640af000 tx=0x7fb9640a7000 comp rx=0 tx=0).stop 2023-07-09T02:18:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb97415c060 msgr2=0x7fb9740b7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb97415c060 0x7fb9740b7f60 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb96c00cae0 tx=0x7fb96c00a060 comp rx=0 tx=0).stop 2023-07-09T02:18:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 shutdown_connections 2023-07-09T02:18:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb97415c060 0x7fb9740b7f60 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb954066280 0x7fb954068730 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9740d2620 0x7fb9741557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 --2- 172.21.15.45:0/2498292369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9740cd120 0x7fb974150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 >> 172.21.15.45:0/2498292369 conn(0x7fb9740698e0 msgr2=0x7fb9740c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 shutdown_connections 2023-07-09T02:18:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.727+0000 7fb979419640 1 -- 172.21.15.45:0/2498292369 wait complete. 2023-07-09T02:18:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2023-07-09T02:18:46.636687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554273,"statfs":{"total":1600000000,"available":1591575840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.026201"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406735+0000","last_change":"2023-07-09T02:18:43.640744+0000","last_active":"2023-07-09T02:18:45.406735+0000","last_peered":"2023-07-09T02:18:45.406735+0000","last_clean":"2023-07-09T02:18:45.406735+0000","last_became_active":"2023-07-09T02:18:43.640532+0000","last_became_peered":"2023-07-09T02:18:43.640532+0000","last_unstale":"2023-07-09T02:18:45.406735+0000","last_undegraded":"2023-07-09T02:18:45.406735+0000","last_fullsized":"2023-07-09T02:18:45.406735+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:50:16.750946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405972+0000","last_change":"2023-07-09T02:18:43.640166+0000","last_active":"2023-07-09T02:18:45.405972+0000","last_peered":"2023-07-09T02:18:45.405972+0000","last_clean":"2023-07-09T02:18:45.405972+0000","last_became_active":"2023-07-09T02:18:43.639766+0000","last_became_peered":"2023-07-09T02:18:43.639766+0000","last_unstale":"2023-07-09T02:18:45.405972+0000","last_undegraded":"2023-07-09T02:18:45.405972+0000","last_fullsized":"2023-07-09T02:18:45.405972+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:44:34.724704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006684+0000","last_change":"2023-07-09T02:18:43.657027+0000","last_active":"2023-07-09T02:18:45.006684+0000","last_peered":"2023-07-09T02:18:45.006684+0000","last_clean":"2023-07-09T02:18:45.006684+0000","last_became_active":"2023-07-09T02:18:43.654368+0000","last_became_peered":"2023-07-09T02:18:43.654368+0000","last_unstale":"2023-07-09T02:18:45.006684+0000","last_undegraded":"2023-07-09T02:18:45.006684+0000","last_fullsized":"2023-07-09T02:18:45.006684+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:49:57.453751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406507+0000","last_change":"2023-07-09T02:18:43.654773+0000","last_active":"2023-07-09T02:18:45.406507+0000","last_peered":"2023-07-09T02:18:45.406507+0000","last_clean":"2023-07-09T02:18:45.406507+0000","last_became_active":"2023-07-09T02:18:43.652714+0000","last_became_peered":"2023-07-09T02:18:43.652714+0000","last_unstale":"2023-07-09T02:18:45.406507+0000","last_undegraded":"2023-07-09T02:18:45.406507+0000","last_fullsized":"2023-07-09T02:18:45.406507+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:09:05.520865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406775+0000","last_change":"2023-07-09T02:18:43.640055+0000","last_active":"2023-07-09T02:18:45.406775+0000","last_peered":"2023-07-09T02:18:45.406775+0000","last_clean":"2023-07-09T02:18:45.406775+0000","last_became_active":"2023-07-09T02:18:43.639797+0000","last_became_peered":"2023-07-09T02:18:43.639797+0000","last_unstale":"2023-07-09T02:18:45.406775+0000","last_undegraded":"2023-07-09T02:18:45.406775+0000","last_fullsized":"2023-07-09T02:18:45.406775+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:04:53.989635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633332+0000","last_change":"2023-07-09T02:18:43.647980+0000","last_active":"2023-07-09T02:18:44.633332+0000","last_peered":"2023-07-09T02:18:44.633332+0000","last_clean":"2023-07-09T02:18:44.633332+0000","last_became_active":"2023-07-09T02:18:43.647664+0000","last_became_peered":"2023-07-09T02:18:43.647664+0000","last_unstale":"2023-07-09T02:18:44.633332+0000","last_undegraded":"2023-07-09T02:18:44.633332+0000","last_fullsized":"2023-07-09T02:18:44.633332+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:12:04.143620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635627+0000","last_change":"2023-07-09T02:18:43.651932+0000","last_active":"2023-07-09T02:18:44.635627+0000","last_peered":"2023-07-09T02:18:44.635627+0000","last_clean":"2023-07-09T02:18:44.635627+0000","last_became_active":"2023-07-09T02:18:43.651518+0000","last_became_peered":"2023-07-09T02:18:43.651518+0000","last_unstale":"2023-07-09T02:18:44.635627+0000","last_undegraded":"2023-07-09T02:18:44.635627+0000","last_fullsized":"2023-07-09T02:18:44.635627+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:47:31.298866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405834+0000","last_change":"2023-07-09T02:18:43.639017+0000","last_active":"2023-07-09T02:18:45.405834+0000","last_peered":"2023-07-09T02:18:45.405834+0000","last_clean":"2023-07-09T02:18:45.405834+0000","last_became_active":"2023-07-09T02:18:43.638657+0000","last_became_peered":"2023-07-09T02:18:43.638657+0000","last_unstale":"2023-07-09T02:18:45.405834+0000","last_undegraded":"2023-07-09T02:18:45.405834+0000","last_fullsized":"2023-07-09T02:18:45.405834+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:52:20.350259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633219+0000","last_change":"2023-07-09T02:18:43.644406+0000","last_active":"2023-07-09T02:18:44.633219+0000","last_peered":"2023-07-09T02:18:44.633219+0000","last_clean":"2023-07-09T02:18:44.633219+0000","last_became_active":"2023-07-09T02:18:43.643396+0000","last_became_peered":"2023-07-09T02:18:43.643396+0000","last_unstale":"2023-07-09T02:18:44.633219+0000","last_undegraded":"2023-07-09T02:18:44.633219+0000","last_fullsized":"2023-07-09T02:18:44.633219+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:52:27.670007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636603+0000","last_change":"2023-07-09T02:18:43.640434+0000","last_active":"2023-07-09T02:18:44.636603+0000","last_peered":"2023-07-09T02:18:44.636603+0000","last_clean":"2023-07-09T02:18:44.636603+0000","last_became_active":"2023-07-09T02:18:43.640186+0000","last_became_peered":"2023-07-09T02:18:43.640186+0000","last_unstale":"2023-07-09T02:18:44.636603+0000","last_undegraded":"2023-07-09T02:18:44.636603+0000","last_fullsized":"2023-07-09T02:18:44.636603+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:54:23.179429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406208+0000","last_change":"2023-07-09T02:18:43.651606+0000","last_active":"2023-07-09T02:18:45.406208+0000","last_peered":"2023-07-09T02:18:45.406208+0000","last_clean":"2023-07-09T02:18:45.406208+0000","last_became_active":"2023-07-09T02:18:43.647447+0000","last_became_peered":"2023-07-09T02:18:43.647447+0000","last_unstale":"2023-07-09T02:18:45.406208+0000","last_undegraded":"2023-07-09T02:18:45.406208+0000","last_fullsized":"2023-07-09T02:18:45.406208+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:23:53.510424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406453+0000","last_change":"2023-07-09T02:18:43.644184+0000","last_active":"2023-07-09T02:18:45.406453+0000","last_peered":"2023-07-09T02:18:45.406453+0000","last_clean":"2023-07-09T02:18:45.406453+0000","last_became_active":"2023-07-09T02:18:43.643601+0000","last_became_peered":"2023-07-09T02:18:43.643601+0000","last_unstale":"2023-07-09T02:18:45.406453+0000","last_undegraded":"2023-07-09T02:18:45.406453+0000","last_fullsized":"2023-07-09T02:18:45.406453+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:32:16.862053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633219+0000","last_change":"2023-07-09T02:18:43.656409+0000","last_active":"2023-07-09T02:18:44.633219+0000","last_peered":"2023-07-09T02:18:44.633219+0000","last_clean":"2023-07-09T02:18:44.633219+0000","last_became_active":"2023-07-09T02:18:43.656033+0000","last_became_peered":"2023-07-09T02:18:43.656033+0000","last_unstale":"2023-07-09T02:18:44.633219+0000","last_undegraded":"2023-07-09T02:18:44.633219+0000","last_fullsized":"2023-07-09T02:18:44.633219+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:48:20.223882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406425+0000","last_change":"2023-07-09T02:18:43.655066+0000","last_active":"2023-07-09T02:18:45.406425+0000","last_peered":"2023-07-09T02:18:45.406425+0000","last_clean":"2023-07-09T02:18:45.406425+0000","last_became_active":"2023-07-09T02:18:43.654854+0000","last_became_peered":"2023-07-09T02:18:43.654854+0000","last_unstale":"2023-07-09T02:18:45.406425+0000","last_undegraded":"2023-07-09T02:18:45.406425+0000","last_fullsized":"2023-07-09T02:18:45.406425+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:14:49.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406167+0000","last_change":"2023-07-09T02:18:43.649955+0000","last_active":"2023-07-09T02:18:45.406167+0000","last_peered":"2023-07-09T02:18:45.406167+0000","last_clean":"2023-07-09T02:18:45.406167+0000","last_became_active":"2023-07-09T02:18:43.649714+0000","last_became_peered":"2023-07-09T02:18:43.649714+0000","last_unstale":"2023-07-09T02:18:45.406167+0000","last_undegraded":"2023-07-09T02:18:45.406167+0000","last_fullsized":"2023-07-09T02:18:45.406167+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:50:48.196160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633403+0000","last_change":"2023-07-09T02:18:43.644369+0000","last_active":"2023-07-09T02:18:44.633403+0000","last_peered":"2023-07-09T02:18:44.633403+0000","last_clean":"2023-07-09T02:18:44.633403+0000","last_became_active":"2023-07-09T02:18:43.644104+0000","last_became_peered":"2023-07-09T02:18:43.644104+0000","last_unstale":"2023-07-09T02:18:44.633403+0000","last_undegraded":"2023-07-09T02:18:44.633403+0000","last_fullsized":"2023-07-09T02:18:44.633403+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:55:14.367933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633231+0000","last_change":"2023-07-09T02:18:43.643108+0000","last_active":"2023-07-09T02:18:44.633231+0000","last_peered":"2023-07-09T02:18:44.633231+0000","last_clean":"2023-07-09T02:18:44.633231+0000","last_became_active":"2023-07-09T02:18:43.642339+0000","last_became_peered":"2023-07-09T02:18:43.642339+0000","last_unstale":"2023-07-09T02:18:44.633231+0000","last_undegraded":"2023-07-09T02:18:44.633231+0000","last_fullsized":"2023-07-09T02:18:44.633231+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:22.318454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406116+0000","last_change":"2023-07-09T02:18:43.639133+0000","last_active":"2023-07-09T02:18:45.406116+0000","last_peered":"2023-07-09T02:18:45.406116+0000","last_clean":"2023-07-09T02:18:45.406116+0000","last_became_active":"2023-07-09T02:18:43.638843+0000","last_became_peered":"2023-07-09T02:18:43.638843+0000","last_unstale":"2023-07-09T02:18:45.406116+0000","last_undegraded":"2023-07-09T02:18:45.406116+0000","last_fullsized":"2023-07-09T02:18:45.406116+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:47:03.135066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635188+0000","last_change":"2023-07-09T02:18:43.652736+0000","last_active":"2023-07-09T02:18:44.635188+0000","last_peered":"2023-07-09T02:18:44.635188+0000","last_clean":"2023-07-09T02:18:44.635188+0000","last_became_active":"2023-07-09T02:18:43.652343+0000","last_became_peered":"2023-07-09T02:18:43.652343+0000","last_unstale":"2023-07-09T02:18:44.635188+0000","last_undegraded":"2023-07-09T02:18:44.635188+0000","last_fullsized":"2023-07-09T02:18:44.635188+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:20:09.203326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406866+0000","last_change":"2023-07-09T02:18:43.650655+0000","last_active":"2023-07-09T02:18:45.406866+0000","last_peered":"2023-07-09T02:18:45.406866+0000","last_clean":"2023-07-09T02:18:45.406866+0000","last_became_active":"2023-07-09T02:18:43.650127+0000","last_became_peered":"2023-07-09T02:18:43.650127+0000","last_unstale":"2023-07-09T02:18:45.406866+0000","last_undegraded":"2023-07-09T02:18:45.406866+0000","last_fullsized":"2023-07-09T02:18:45.406866+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:53:54.544683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406342+0000","last_change":"2023-07-09T02:18:43.647776+0000","last_active":"2023-07-09T02:18:45.406342+0000","last_peered":"2023-07-09T02:18:45.406342+0000","last_clean":"2023-07-09T02:18:45.406342+0000","last_became_active":"2023-07-09T02:18:43.647083+0000","last_became_peered":"2023-07-09T02:18:43.647083+0000","last_unstale":"2023-07-09T02:18:45.406342+0000","last_undegraded":"2023-07-09T02:18:45.406342+0000","last_fullsized":"2023-07-09T02:18:45.406342+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:06:30.027056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406620+0000","last_change":"2023-07-09T02:18:43.644339+0000","last_active":"2023-07-09T02:18:45.406620+0000","last_peered":"2023-07-09T02:18:45.406620+0000","last_clean":"2023-07-09T02:18:45.406620+0000","last_became_active":"2023-07-09T02:18:43.643927+0000","last_became_peered":"2023-07-09T02:18:43.643927+0000","last_unstale":"2023-07-09T02:18:45.406620+0000","last_undegraded":"2023-07-09T02:18:45.406620+0000","last_fullsized":"2023-07-09T02:18:45.406620+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:10:23.094356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405741+0000","last_change":"2023-07-09T02:18:43.651986+0000","last_active":"2023-07-09T02:18:45.405741+0000","last_peered":"2023-07-09T02:18:45.405741+0000","last_clean":"2023-07-09T02:18:45.405741+0000","last_became_active":"2023-07-09T02:18:43.650434+0000","last_became_peered":"2023-07-09T02:18:43.650434+0000","last_unstale":"2023-07-09T02:18:45.405741+0000","last_undegraded":"2023-07-09T02:18:45.405741+0000","last_fullsized":"2023-07-09T02:18:45.405741+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:02:55.101218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633354+0000","last_change":"2023-07-09T02:18:43.646286+0000","last_active":"2023-07-09T02:18:44.633354+0000","last_peered":"2023-07-09T02:18:44.633354+0000","last_clean":"2023-07-09T02:18:44.633354+0000","last_became_active":"2023-07-09T02:18:43.643710+0000","last_became_peered":"2023-07-09T02:18:43.643710+0000","last_unstale":"2023-07-09T02:18:44.633354+0000","last_undegraded":"2023-07-09T02:18:44.633354+0000","last_fullsized":"2023-07-09T02:18:44.633354+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:09:44.219530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006729+0000","last_change":"2023-07-09T02:18:43.651384+0000","last_active":"2023-07-09T02:18:45.006729+0000","last_peered":"2023-07-09T02:18:45.006729+0000","last_clean":"2023-07-09T02:18:45.006729+0000","last_became_active":"2023-07-09T02:18:43.650816+0000","last_became_peered":"2023-07-09T02:18:43.650816+0000","last_unstale":"2023-07-09T02:18:45.006729+0000","last_undegraded":"2023-07-09T02:18:45.006729+0000","last_fullsized":"2023-07-09T02:18:45.006729+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:58:29.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006711+0000","last_change":"2023-07-09T02:18:43.650875+0000","last_active":"2023-07-09T02:18:45.006711+0000","last_peered":"2023-07-09T02:18:45.006711+0000","last_clean":"2023-07-09T02:18:45.006711+0000","last_became_active":"2023-07-09T02:18:43.650353+0000","last_became_peered":"2023-07-09T02:18:43.650353+0000","last_unstale":"2023-07-09T02:18:45.006711+0000","last_undegraded":"2023-07-09T02:18:45.006711+0000","last_fullsized":"2023-07-09T02:18:45.006711+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:17:25.423310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635187+0000","last_change":"2023-07-09T02:18:43.651744+0000","last_active":"2023-07-09T02:18:44.635187+0000","last_peered":"2023-07-09T02:18:44.635187+0000","last_clean":"2023-07-09T02:18:44.635187+0000","last_became_active":"2023-07-09T02:18:43.650996+0000","last_became_peered":"2023-07-09T02:18:43.650996+0000","last_unstale":"2023-07-09T02:18:44.635187+0000","last_undegraded":"2023-07-09T02:18:44.635187+0000","last_fullsized":"2023-07-09T02:18:44.635187+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:43:30.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636414+0000","last_change":"2023-07-09T02:18:43.641793+0000","last_active":"2023-07-09T02:18:44.636414+0000","last_peered":"2023-07-09T02:18:44.636414+0000","last_clean":"2023-07-09T02:18:44.636414+0000","last_became_active":"2023-07-09T02:18:43.641573+0000","last_became_peered":"2023-07-09T02:18:43.641573+0000","last_unstale":"2023-07-09T02:18:44.636414+0000","last_undegraded":"2023-07-09T02:18:44.636414+0000","last_fullsized":"2023-07-09T02:18:44.636414+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:20:12.368168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006677+0000","last_change":"2023-07-09T02:18:43.648252+0000","last_active":"2023-07-09T02:18:45.006677+0000","last_peered":"2023-07-09T02:18:45.006677+0000","last_clean":"2023-07-09T02:18:45.006677+0000","last_became_active":"2023-07-09T02:18:43.648004+0000","last_became_peered":"2023-07-09T02:18:43.648004+0000","last_unstale":"2023-07-09T02:18:45.006677+0000","last_undegraded":"2023-07-09T02:18:45.006677+0000","last_fullsized":"2023-07-09T02:18:45.006677+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:44:47.181297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006907+0000","last_change":"2023-07-09T02:18:43.651237+0000","last_active":"2023-07-09T02:18:45.006907+0000","last_peered":"2023-07-09T02:18:45.006907+0000","last_clean":"2023-07-09T02:18:45.006907+0000","last_became_active":"2023-07-09T02:18:43.650489+0000","last_became_peered":"2023-07-09T02:18:43.650489+0000","last_unstale":"2023-07-09T02:18:45.006907+0000","last_undegraded":"2023-07-09T02:18:45.006907+0000","last_fullsized":"2023-07-09T02:18:45.006907+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:32:52.779477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406041+0000","last_change":"2023-07-09T02:18:43.643915+0000","last_active":"2023-07-09T02:18:45.406041+0000","last_peered":"2023-07-09T02:18:45.406041+0000","last_clean":"2023-07-09T02:18:45.406041+0000","last_became_active":"2023-07-09T02:18:43.643346+0000","last_became_peered":"2023-07-09T02:18:43.643346+0000","last_unstale":"2023-07-09T02:18:45.406041+0000","last_undegraded":"2023-07-09T02:18:45.406041+0000","last_fullsized":"2023-07-09T02:18:45.406041+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:55:24.523209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636438+0000","last_change":"2023-07-09T02:18:43.641133+0000","last_active":"2023-07-09T02:18:44.636438+0000","last_peered":"2023-07-09T02:18:44.636438+0000","last_clean":"2023-07-09T02:18:44.636438+0000","last_became_active":"2023-07-09T02:18:43.640908+0000","last_became_peered":"2023-07-09T02:18:43.640908+0000","last_unstale":"2023-07-09T02:18:44.636438+0000","last_undegraded":"2023-07-09T02:18:44.636438+0000","last_fullsized":"2023-07-09T02:18:44.636438+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:16:31.516833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406353+0000","last_change":"2023-07-09T02:18:43.650889+0000","last_active":"2023-07-09T02:18:45.406353+0000","last_peered":"2023-07-09T02:18:45.406353+0000","last_clean":"2023-07-09T02:18:45.406353+0000","last_became_active":"2023-07-09T02:18:43.649070+0000","last_became_peered":"2023-07-09T02:18:43.649070+0000","last_unstale":"2023-07-09T02:18:45.406353+0000","last_undegraded":"2023-07-09T02:18:45.406353+0000","last_fullsized":"2023-07-09T02:18:45.406353+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:35:28.037444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"152'4","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007242+0000","last_change":"2023-07-09T02:18:42.620010+0000","last_active":"2023-07-09T02:18:45.007242+0000","last_peered":"2023-07-09T02:18:45.007242+0000","last_clean":"2023-07-09T02:18:45.007242+0000","last_became_active":"2023-07-09T02:18:42.619695+0000","last_became_peered":"2023-07-09T02:18:42.619695+0000","last_unstale":"2023-07-09T02:18:45.007242+0000","last_undegraded":"2023-07-09T02:18:45.007242+0000","last_fullsized":"2023-07-09T02:18:45.007242+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:59:03.607948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406204+0000","last_change":"2023-07-09T02:18:43.641680+0000","last_active":"2023-07-09T02:18:45.406204+0000","last_peered":"2023-07-09T02:18:45.406204+0000","last_clean":"2023-07-09T02:18:45.406204+0000","last_became_active":"2023-07-09T02:18:43.641026+0000","last_became_peered":"2023-07-09T02:18:43.641026+0000","last_unstale":"2023-07-09T02:18:45.406204+0000","last_undegraded":"2023-07-09T02:18:45.406204+0000","last_fullsized":"2023-07-09T02:18:45.406204+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:51:35.546185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406400+0000","last_change":"2023-07-09T02:18:42.625511+0000","last_active":"2023-07-09T02:18:45.406400+0000","last_peered":"2023-07-09T02:18:45.406400+0000","last_clean":"2023-07-09T02:18:45.406400+0000","last_became_active":"2023-07-09T02:18:42.625234+0000","last_became_peered":"2023-07-09T02:18:42.625234+0000","last_unstale":"2023-07-09T02:18:45.406400+0000","last_undegraded":"2023-07-09T02:18:45.406400+0000","last_fullsized":"2023-07-09T02:18:45.406400+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:58:42.051192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405886+0000","last_change":"2023-07-09T02:18:43.650661+0000","last_active":"2023-07-09T02:18:45.405886+0000","last_peered":"2023-07-09T02:18:45.405886+0000","last_clean":"2023-07-09T02:18:45.405886+0000","last_became_active":"2023-07-09T02:18:43.650121+0000","last_became_peered":"2023-07-09T02:18:43.650121+0000","last_unstale":"2023-07-09T02:18:45.405886+0000","last_undegraded":"2023-07-09T02:18:45.405886+0000","last_fullsized":"2023-07-09T02:18:45.405886+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:25:52.557418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636298+0000","last_change":"2023-07-09T02:18:42.626157+0000","last_active":"2023-07-09T02:18:44.636298+0000","last_peered":"2023-07-09T02:18:44.636298+0000","last_clean":"2023-07-09T02:18:44.636298+0000","last_became_active":"2023-07-09T02:18:42.625558+0000","last_became_peered":"2023-07-09T02:18:42.625558+0000","last_unstale":"2023-07-09T02:18:44.636298+0000","last_undegraded":"2023-07-09T02:18:44.636298+0000","last_fullsized":"2023-07-09T02:18:44.636298+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:55:33.520738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406757+0000","last_change":"2023-07-09T02:18:43.649435+0000","last_active":"2023-07-09T02:18:45.406757+0000","last_peered":"2023-07-09T02:18:45.406757+0000","last_clean":"2023-07-09T02:18:45.406757+0000","last_became_active":"2023-07-09T02:18:43.648561+0000","last_became_peered":"2023-07-09T02:18:43.648561+0000","last_unstale":"2023-07-09T02:18:45.406757+0000","last_undegraded":"2023-07-09T02:18:45.406757+0000","last_fullsized":"2023-07-09T02:18:45.406757+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:21:46.623042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635645+0000","last_change":"2023-07-09T02:18:42.624244+0000","last_active":"2023-07-09T02:18:44.635645+0000","last_peered":"2023-07-09T02:18:44.635645+0000","last_clean":"2023-07-09T02:18:44.635645+0000","last_became_active":"2023-07-09T02:18:42.623859+0000","last_became_peered":"2023-07-09T02:18:42.623859+0000","last_unstale":"2023-07-09T02:18:44.635645+0000","last_undegraded":"2023-07-09T02:18:44.635645+0000","last_fullsized":"2023-07-09T02:18:44.635645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:52.190492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406187+0000","last_change":"2023-07-09T02:18:43.644104+0000","last_active":"2023-07-09T02:18:45.406187+0000","last_peered":"2023-07-09T02:18:45.406187+0000","last_clean":"2023-07-09T02:18:45.406187+0000","last_became_active":"2023-07-09T02:18:43.643671+0000","last_became_peered":"2023-07-09T02:18:43.643671+0000","last_unstale":"2023-07-09T02:18:45.406187+0000","last_undegraded":"2023-07-09T02:18:45.406187+0000","last_fullsized":"2023-07-09T02:18:45.406187+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:25.588689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406035+0000","last_change":"2023-07-09T02:18:42.615275+0000","last_active":"2023-07-09T02:18:45.406035+0000","last_peered":"2023-07-09T02:18:45.406035+0000","last_clean":"2023-07-09T02:18:45.406035+0000","last_became_active":"2023-07-09T02:18:42.615024+0000","last_became_peered":"2023-07-09T02:18:42.615024+0000","last_unstale":"2023-07-09T02:18:45.406035+0000","last_undegraded":"2023-07-09T02:18:45.406035+0000","last_fullsized":"2023-07-09T02:18:45.406035+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:14:06.330721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406139+0000","last_change":"2023-07-09T02:18:43.638928+0000","last_active":"2023-07-09T02:18:45.406139+0000","last_peered":"2023-07-09T02:18:45.406139+0000","last_clean":"2023-07-09T02:18:45.406139+0000","last_became_active":"2023-07-09T02:18:43.638681+0000","last_became_peered":"2023-07-09T02:18:43.638681+0000","last_unstale":"2023-07-09T02:18:45.406139+0000","last_undegraded":"2023-07-09T02:18:45.406139+0000","last_fullsized":"2023-07-09T02:18:45.406139+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:12:02.664722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406254+0000","last_change":"2023-07-09T02:18:42.626060+0000","last_active":"2023-07-09T02:18:45.406254+0000","last_peered":"2023-07-09T02:18:45.406254+0000","last_clean":"2023-07-09T02:18:45.406254+0000","last_became_active":"2023-07-09T02:18:42.625818+0000","last_became_peered":"2023-07-09T02:18:42.625818+0000","last_unstale":"2023-07-09T02:18:45.406254+0000","last_undegraded":"2023-07-09T02:18:45.406254+0000","last_fullsized":"2023-07-09T02:18:45.406254+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:14:07.417632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406195+0000","last_change":"2023-07-09T02:18:43.653829+0000","last_active":"2023-07-09T02:18:45.406195+0000","last_peered":"2023-07-09T02:18:45.406195+0000","last_clean":"2023-07-09T02:18:45.406195+0000","last_became_active":"2023-07-09T02:18:43.653573+0000","last_became_peered":"2023-07-09T02:18:43.653573+0000","last_unstale":"2023-07-09T02:18:45.406195+0000","last_undegraded":"2023-07-09T02:18:45.406195+0000","last_fullsized":"2023-07-09T02:18:45.406195+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:10:33.506931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633662+0000","last_change":"2023-07-09T02:18:42.624154+0000","last_active":"2023-07-09T02:18:44.633662+0000","last_peered":"2023-07-09T02:18:44.633662+0000","last_clean":"2023-07-09T02:18:44.633662+0000","last_became_active":"2023-07-09T02:18:42.623797+0000","last_became_peered":"2023-07-09T02:18:42.623797+0000","last_unstale":"2023-07-09T02:18:44.633662+0000","last_undegraded":"2023-07-09T02:18:44.633662+0000","last_fullsized":"2023-07-09T02:18:44.633662+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:06:00.358727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635299+0000","last_change":"2023-07-09T02:18:43.649358+0000","last_active":"2023-07-09T02:18:44.635299+0000","last_peered":"2023-07-09T02:18:44.635299+0000","last_clean":"2023-07-09T02:18:44.635299+0000","last_became_active":"2023-07-09T02:18:43.649087+0000","last_became_peered":"2023-07-09T02:18:43.649087+0000","last_unstale":"2023-07-09T02:18:44.635299+0000","last_undegraded":"2023-07-09T02:18:44.635299+0000","last_fullsized":"2023-07-09T02:18:44.635299+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:48:42.968279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007161+0000","last_change":"2023-07-09T02:18:42.621502+0000","last_active":"2023-07-09T02:18:45.007161+0000","last_peered":"2023-07-09T02:18:45.007161+0000","last_clean":"2023-07-09T02:18:45.007161+0000","last_became_active":"2023-07-09T02:18:42.621060+0000","last_became_peered":"2023-07-09T02:18:42.621060+0000","last_unstale":"2023-07-09T02:18:45.007161+0000","last_undegraded":"2023-07-09T02:18:45.007161+0000","last_fullsized":"2023-07-09T02:18:45.007161+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:29:11.855193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006953+0000","last_change":"2023-07-09T02:18:43.645095+0000","last_active":"2023-07-09T02:18:45.006953+0000","last_peered":"2023-07-09T02:18:45.006953+0000","last_clean":"2023-07-09T02:18:45.006953+0000","last_became_active":"2023-07-09T02:18:43.644513+0000","last_became_peered":"2023-07-09T02:18:43.644513+0000","last_unstale":"2023-07-09T02:18:45.006953+0000","last_undegraded":"2023-07-09T02:18:45.006953+0000","last_fullsized":"2023-07-09T02:18:45.006953+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:23:04.629073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406682+0000","last_change":"2023-07-09T02:18:42.624286+0000","last_active":"2023-07-09T02:18:45.406682+0000","last_peered":"2023-07-09T02:18:45.406682+0000","last_clean":"2023-07-09T02:18:45.406682+0000","last_became_active":"2023-07-09T02:18:42.624063+0000","last_became_peered":"2023-07-09T02:18:42.624063+0000","last_unstale":"2023-07-09T02:18:45.406682+0000","last_undegraded":"2023-07-09T02:18:45.406682+0000","last_fullsized":"2023-07-09T02:18:45.406682+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:58:47.152131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636149+0000","last_change":"2023-07-09T02:18:43.652898+0000","last_active":"2023-07-09T02:18:44.636149+0000","last_peered":"2023-07-09T02:18:44.636149+0000","last_clean":"2023-07-09T02:18:44.636149+0000","last_became_active":"2023-07-09T02:18:43.652573+0000","last_became_peered":"2023-07-09T02:18:43.652573+0000","last_unstale":"2023-07-09T02:18:44.636149+0000","last_undegraded":"2023-07-09T02:18:44.636149+0000","last_fullsized":"2023-07-09T02:18:44.636149+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:14:12.233876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007275+0000","last_change":"2023-07-09T02:18:42.621350+0000","last_active":"2023-07-09T02:18:45.007275+0000","last_peered":"2023-07-09T02:18:45.007275+0000","last_clean":"2023-07-09T02:18:45.007275+0000","last_became_active":"2023-07-09T02:18:42.620728+0000","last_became_peered":"2023-07-09T02:18:42.620728+0000","last_unstale":"2023-07-09T02:18:45.007275+0000","last_undegraded":"2023-07-09T02:18:45.007275+0000","last_fullsized":"2023-07-09T02:18:45.007275+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:18:22.766148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635342+0000","last_change":"2023-07-09T02:18:43.652588+0000","last_active":"2023-07-09T02:18:44.635342+0000","last_peered":"2023-07-09T02:18:44.635342+0000","last_clean":"2023-07-09T02:18:44.635342+0000","last_became_active":"2023-07-09T02:18:43.652017+0000","last_became_peered":"2023-07-09T02:18:43.652017+0000","last_unstale":"2023-07-09T02:18:44.635342+0000","last_undegraded":"2023-07-09T02:18:44.635342+0000","last_fullsized":"2023-07-09T02:18:44.635342+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:04:23.260327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633473+0000","last_change":"2023-07-09T02:18:42.623062+0000","last_active":"2023-07-09T02:18:44.633473+0000","last_peered":"2023-07-09T02:18:44.633473+0000","last_clean":"2023-07-09T02:18:44.633473+0000","last_became_active":"2023-07-09T02:18:42.622841+0000","last_became_peered":"2023-07-09T02:18:42.622841+0000","last_unstale":"2023-07-09T02:18:44.633473+0000","last_undegraded":"2023-07-09T02:18:44.633473+0000","last_fullsized":"2023-07-09T02:18:44.633473+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:52.408937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636633+0000","last_change":"2023-07-09T02:18:43.654838+0000","last_active":"2023-07-09T02:18:44.636633+0000","last_peered":"2023-07-09T02:18:44.636633+0000","last_clean":"2023-07-09T02:18:44.636633+0000","last_became_active":"2023-07-09T02:18:43.654473+0000","last_became_peered":"2023-07-09T02:18:43.654473+0000","last_unstale":"2023-07-09T02:18:44.636633+0000","last_undegraded":"2023-07-09T02:18:44.636633+0000","last_fullsized":"2023-07-09T02:18:44.636633+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:22:38.668128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406555+0000","last_change":"2023-07-09T02:18:42.621027+0000","last_active":"2023-07-09T02:18:45.406555+0000","last_peered":"2023-07-09T02:18:45.406555+0000","last_clean":"2023-07-09T02:18:45.406555+0000","last_became_active":"2023-07-09T02:18:42.620608+0000","last_became_peered":"2023-07-09T02:18:42.620608+0000","last_unstale":"2023-07-09T02:18:45.406555+0000","last_undegraded":"2023-07-09T02:18:45.406555+0000","last_fullsized":"2023-07-09T02:18:45.406555+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:24:49.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406174+0000","last_change":"2023-07-09T02:18:43.645912+0000","last_active":"2023-07-09T02:18:45.406174+0000","last_peered":"2023-07-09T02:18:45.406174+0000","last_clean":"2023-07-09T02:18:45.406174+0000","last_became_active":"2023-07-09T02:18:43.645390+0000","last_became_peered":"2023-07-09T02:18:43.645390+0000","last_unstale":"2023-07-09T02:18:45.406174+0000","last_undegraded":"2023-07-09T02:18:45.406174+0000","last_fullsized":"2023-07-09T02:18:45.406174+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:47:52.255454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406101+0000","last_change":"2023-07-09T02:18:42.623238+0000","last_active":"2023-07-09T02:18:45.406101+0000","last_peered":"2023-07-09T02:18:45.406101+0000","last_clean":"2023-07-09T02:18:45.406101+0000","last_became_active":"2023-07-09T02:18:42.622952+0000","last_became_peered":"2023-07-09T02:18:42.622952+0000","last_unstale":"2023-07-09T02:18:45.406101+0000","last_undegraded":"2023-07-09T02:18:45.406101+0000","last_fullsized":"2023-07-09T02:18:45.406101+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:38:44.739025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406875+0000","last_change":"2023-07-09T02:18:43.648671+0000","last_active":"2023-07-09T02:18:45.406875+0000","last_peered":"2023-07-09T02:18:45.406875+0000","last_clean":"2023-07-09T02:18:45.406875+0000","last_became_active":"2023-07-09T02:18:43.648432+0000","last_became_peered":"2023-07-09T02:18:43.648432+0000","last_unstale":"2023-07-09T02:18:45.406875+0000","last_undegraded":"2023-07-09T02:18:45.406875+0000","last_fullsized":"2023-07-09T02:18:45.406875+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:04:54.433455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406579+0000","last_change":"2023-07-09T02:18:42.621823+0000","last_active":"2023-07-09T02:18:45.406579+0000","last_peered":"2023-07-09T02:18:45.406579+0000","last_clean":"2023-07-09T02:18:45.406579+0000","last_became_active":"2023-07-09T02:18:42.621516+0000","last_became_peered":"2023-07-09T02:18:42.621516+0000","last_unstale":"2023-07-09T02:18:45.406579+0000","last_undegraded":"2023-07-09T02:18:45.406579+0000","last_fullsized":"2023-07-09T02:18:45.406579+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:01:47.182901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406935+0000","last_change":"2023-07-09T02:18:43.650425+0000","last_active":"2023-07-09T02:18:45.406935+0000","last_peered":"2023-07-09T02:18:45.406935+0000","last_clean":"2023-07-09T02:18:45.406935+0000","last_became_active":"2023-07-09T02:18:43.649826+0000","last_became_peered":"2023-07-09T02:18:43.649826+0000","last_unstale":"2023-07-09T02:18:45.406935+0000","last_undegraded":"2023-07-09T02:18:45.406935+0000","last_fullsized":"2023-07-09T02:18:45.406935+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:56:41.416564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636404+0000","last_change":"2023-07-09T02:18:42.625793+0000","last_active":"2023-07-09T02:18:44.636404+0000","last_peered":"2023-07-09T02:18:44.636404+0000","last_clean":"2023-07-09T02:18:44.636404+0000","last_became_active":"2023-07-09T02:18:42.625055+0000","last_became_peered":"2023-07-09T02:18:42.625055+0000","last_unstale":"2023-07-09T02:18:44.636404+0000","last_undegraded":"2023-07-09T02:18:44.636404+0000","last_fullsized":"2023-07-09T02:18:44.636404+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:34:00.101251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406601+0000","last_change":"2023-07-09T02:18:43.655012+0000","last_active":"2023-07-09T02:18:45.406601+0000","last_peered":"2023-07-09T02:18:45.406601+0000","last_clean":"2023-07-09T02:18:45.406601+0000","last_became_active":"2023-07-09T02:18:43.653875+0000","last_became_peered":"2023-07-09T02:18:43.653875+0000","last_unstale":"2023-07-09T02:18:45.406601+0000","last_undegraded":"2023-07-09T02:18:45.406601+0000","last_fullsized":"2023-07-09T02:18:45.406601+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:21:38.688746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633584+0000","last_change":"2023-07-09T02:18:42.621400+0000","last_active":"2023-07-09T02:18:44.633584+0000","last_peered":"2023-07-09T02:18:44.633584+0000","last_clean":"2023-07-09T02:18:44.633584+0000","last_became_active":"2023-07-09T02:18:42.621084+0000","last_became_peered":"2023-07-09T02:18:42.621084+0000","last_unstale":"2023-07-09T02:18:44.633584+0000","last_undegraded":"2023-07-09T02:18:44.633584+0000","last_fullsized":"2023-07-09T02:18:44.633584+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:12:32.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406046+0000","last_change":"2023-07-09T02:18:43.653727+0000","last_active":"2023-07-09T02:18:45.406046+0000","last_peered":"2023-07-09T02:18:45.406046+0000","last_clean":"2023-07-09T02:18:45.406046+0000","last_became_active":"2023-07-09T02:18:43.653236+0000","last_became_peered":"2023-07-09T02:18:43.653236+0000","last_unstale":"2023-07-09T02:18:45.406046+0000","last_undegraded":"2023-07-09T02:18:45.406046+0000","last_fullsized":"2023-07-09T02:18:45.406046+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:09:47.031191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.407148+0000","last_change":"2023-07-09T02:18:42.624209+0000","last_active":"2023-07-09T02:18:45.407148+0000","last_peered":"2023-07-09T02:18:45.407148+0000","last_clean":"2023-07-09T02:18:45.407148+0000","last_became_active":"2023-07-09T02:18:42.623644+0000","last_became_peered":"2023-07-09T02:18:42.623644+0000","last_unstale":"2023-07-09T02:18:45.407148+0000","last_undegraded":"2023-07-09T02:18:45.407148+0000","last_fullsized":"2023-07-09T02:18:45.407148+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:21:30.903712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007028+0000","last_change":"2023-07-09T02:18:43.656482+0000","last_active":"2023-07-09T02:18:45.007028+0000","last_peered":"2023-07-09T02:18:45.007028+0000","last_clean":"2023-07-09T02:18:45.007028+0000","last_became_active":"2023-07-09T02:18:43.653651+0000","last_became_peered":"2023-07-09T02:18:43.653651+0000","last_unstale":"2023-07-09T02:18:45.007028+0000","last_undegraded":"2023-07-09T02:18:45.007028+0000","last_fullsized":"2023-07-09T02:18:45.007028+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:12:53.233012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406186+0000","last_change":"2023-07-09T02:18:42.617734+0000","last_active":"2023-07-09T02:18:45.406186+0000","last_peered":"2023-07-09T02:18:45.406186+0000","last_clean":"2023-07-09T02:18:45.406186+0000","last_became_active":"2023-07-09T02:18:42.617077+0000","last_became_peered":"2023-07-09T02:18:42.617077+0000","last_unstale":"2023-07-09T02:18:45.406186+0000","last_undegraded":"2023-07-09T02:18:45.406186+0000","last_fullsized":"2023-07-09T02:18:45.406186+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:30:58.886392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635928+0000","last_change":"2023-07-09T02:18:43.657792+0000","last_active":"2023-07-09T02:18:44.635928+0000","last_peered":"2023-07-09T02:18:44.635928+0000","last_clean":"2023-07-09T02:18:44.635928+0000","last_became_active":"2023-07-09T02:18:43.657357+0000","last_became_peered":"2023-07-09T02:18:43.657357+0000","last_unstale":"2023-07-09T02:18:44.635928+0000","last_undegraded":"2023-07-09T02:18:44.635928+0000","last_fullsized":"2023-07-09T02:18:44.635928+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:47:20.904645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405876+0000","last_change":"2023-07-09T02:18:42.617087+0000","last_active":"2023-07-09T02:18:45.405876+0000","last_peered":"2023-07-09T02:18:45.405876+0000","last_clean":"2023-07-09T02:18:45.405876+0000","last_became_active":"2023-07-09T02:18:42.616839+0000","last_became_peered":"2023-07-09T02:18:42.616839+0000","last_unstale":"2023-07-09T02:18:45.405876+0000","last_undegraded":"2023-07-09T02:18:45.405876+0000","last_fullsized":"2023-07-09T02:18:45.405876+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:49:19.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636552+0000","last_change":"2023-07-09T02:18:43.639478+0000","last_active":"2023-07-09T02:18:44.636552+0000","last_peered":"2023-07-09T02:18:44.636552+0000","last_clean":"2023-07-09T02:18:44.636552+0000","last_became_active":"2023-07-09T02:18:43.639238+0000","last_became_peered":"2023-07-09T02:18:43.639238+0000","last_unstale":"2023-07-09T02:18:44.636552+0000","last_undegraded":"2023-07-09T02:18:44.636552+0000","last_fullsized":"2023-07-09T02:18:44.636552+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:15:34.889686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633808+0000","last_change":"2023-07-09T02:18:42.623475+0000","last_active":"2023-07-09T02:18:44.633808+0000","last_peered":"2023-07-09T02:18:44.633808+0000","last_clean":"2023-07-09T02:18:44.633808+0000","last_became_active":"2023-07-09T02:18:42.623092+0000","last_became_peered":"2023-07-09T02:18:42.623092+0000","last_unstale":"2023-07-09T02:18:44.633808+0000","last_undegraded":"2023-07-09T02:18:44.633808+0000","last_fullsized":"2023-07-09T02:18:44.633808+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:02:54.092697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633728+0000","last_change":"2023-07-09T02:18:43.641917+0000","last_active":"2023-07-09T02:18:44.633728+0000","last_peered":"2023-07-09T02:18:44.633728+0000","last_clean":"2023-07-09T02:18:44.633728+0000","last_became_active":"2023-07-09T02:18:43.641296+0000","last_became_peered":"2023-07-09T02:18:43.641296+0000","last_unstale":"2023-07-09T02:18:44.633728+0000","last_undegraded":"2023-07-09T02:18:44.633728+0000","last_fullsized":"2023-07-09T02:18:44.633728+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:44:58.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406588+0000","last_change":"2023-07-09T02:18:42.617206+0000","last_active":"2023-07-09T02:18:45.406588+0000","last_peered":"2023-07-09T02:18:45.406588+0000","last_clean":"2023-07-09T02:18:45.406588+0000","last_became_active":"2023-07-09T02:18:42.615841+0000","last_became_peered":"2023-07-09T02:18:42.615841+0000","last_unstale":"2023-07-09T02:18:45.406588+0000","last_undegraded":"2023-07-09T02:18:45.406588+0000","last_fullsized":"2023-07-09T02:18:45.406588+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:09:41.505984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633554+0000","last_change":"2023-07-09T02:18:43.646515+0000","last_active":"2023-07-09T02:18:44.633554+0000","last_peered":"2023-07-09T02:18:44.633554+0000","last_clean":"2023-07-09T02:18:44.633554+0000","last_became_active":"2023-07-09T02:18:43.644098+0000","last_became_peered":"2023-07-09T02:18:43.644098+0000","last_unstale":"2023-07-09T02:18:44.633554+0000","last_undegraded":"2023-07-09T02:18:44.633554+0000","last_fullsized":"2023-07-09T02:18:44.633554+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:54:35.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636068+0000","last_change":"2023-07-09T02:18:42.623028+0000","last_active":"2023-07-09T02:18:44.636068+0000","last_peered":"2023-07-09T02:18:44.636068+0000","last_clean":"2023-07-09T02:18:44.636068+0000","last_became_active":"2023-07-09T02:18:42.622781+0000","last_became_peered":"2023-07-09T02:18:42.622781+0000","last_unstale":"2023-07-09T02:18:44.636068+0000","last_undegraded":"2023-07-09T02:18:44.636068+0000","last_fullsized":"2023-07-09T02:18:44.636068+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:23:09.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633498+0000","last_change":"2023-07-09T02:18:43.647794+0000","last_active":"2023-07-09T02:18:44.633498+0000","last_peered":"2023-07-09T02:18:44.633498+0000","last_clean":"2023-07-09T02:18:44.633498+0000","last_became_active":"2023-07-09T02:18:43.647454+0000","last_became_peered":"2023-07-09T02:18:43.647454+0000","last_unstale":"2023-07-09T02:18:44.633498+0000","last_undegraded":"2023-07-09T02:18:44.633498+0000","last_fullsized":"2023-07-09T02:18:44.633498+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:24:49.757472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633619+0000","last_change":"2023-07-09T02:18:42.623494+0000","last_active":"2023-07-09T02:18:44.633619+0000","last_peered":"2023-07-09T02:18:44.633619+0000","last_clean":"2023-07-09T02:18:44.633619+0000","last_became_active":"2023-07-09T02:18:42.623120+0000","last_became_peered":"2023-07-09T02:18:42.623120+0000","last_unstale":"2023-07-09T02:18:44.633619+0000","last_undegraded":"2023-07-09T02:18:44.633619+0000","last_fullsized":"2023-07-09T02:18:44.633619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:57:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635766+0000","last_change":"2023-07-09T02:18:43.657647+0000","last_active":"2023-07-09T02:18:44.635766+0000","last_peered":"2023-07-09T02:18:44.635766+0000","last_clean":"2023-07-09T02:18:44.635766+0000","last_became_active":"2023-07-09T02:18:43.656958+0000","last_became_peered":"2023-07-09T02:18:43.656958+0000","last_unstale":"2023-07-09T02:18:44.635766+0000","last_undegraded":"2023-07-09T02:18:44.635766+0000","last_fullsized":"2023-07-09T02:18:44.635766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:15:50.287589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406555+0000","last_change":"2023-07-09T02:18:42.622541+0000","last_active":"2023-07-09T02:18:45.406555+0000","last_peered":"2023-07-09T02:18:45.406555+0000","last_clean":"2023-07-09T02:18:45.406555+0000","last_became_active":"2023-07-09T02:18:42.621847+0000","last_became_peered":"2023-07-09T02:18:42.621847+0000","last_unstale":"2023-07-09T02:18:45.406555+0000","last_undegraded":"2023-07-09T02:18:45.406555+0000","last_fullsized":"2023-07-09T02:18:45.406555+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:39:18.985745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006854+0000","last_change":"2023-07-09T02:18:43.656842+0000","last_active":"2023-07-09T02:18:45.006854+0000","last_peered":"2023-07-09T02:18:45.006854+0000","last_clean":"2023-07-09T02:18:45.006854+0000","last_became_active":"2023-07-09T02:18:43.654076+0000","last_became_peered":"2023-07-09T02:18:43.654076+0000","last_unstale":"2023-07-09T02:18:45.006854+0000","last_undegraded":"2023-07-09T02:18:45.006854+0000","last_fullsized":"2023-07-09T02:18:45.006854+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:27:38.809097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635796+0000","last_change":"2023-07-09T02:18:42.624087+0000","last_active":"2023-07-09T02:18:44.635796+0000","last_peered":"2023-07-09T02:18:44.635796+0000","last_clean":"2023-07-09T02:18:44.635796+0000","last_became_active":"2023-07-09T02:18:42.623550+0000","last_became_peered":"2023-07-09T02:18:42.623550+0000","last_unstale":"2023-07-09T02:18:44.635796+0000","last_undegraded":"2023-07-09T02:18:44.635796+0000","last_fullsized":"2023-07-09T02:18:44.635796+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:23:47.400861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":394,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636007+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:18:44.636007+0000","last_peered":"2023-07-09T02:18:44.636007+0000","last_clean":"2023-07-09T02:18:44.636007+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:18:44.636007+0000","last_undegraded":"2023-07-09T02:18:44.636007+0000","last_fullsized":"2023-07-09T02:18:44.636007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:09:43.217974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":274,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406669+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:18:45.406669+0000","last_peered":"2023-07-09T02:18:45.406669+0000","last_clean":"2023-07-09T02:18:45.406669+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:18:45.406669+0000","last_undegraded":"2023-07-09T02:18:45.406669+0000","last_fullsized":"2023-07-09T02:18:45.406669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:10:37.881394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635468+0000","last_change":"2023-07-09T02:18:43.654711+0000","last_active":"2023-07-09T02:18:44.635468+0000","last_peered":"2023-07-09T02:18:44.635468+0000","last_clean":"2023-07-09T02:18:44.635468+0000","last_became_active":"2023-07-09T02:18:43.654405+0000","last_became_peered":"2023-07-09T02:18:43.654405+0000","last_unstale":"2023-07-09T02:18:44.635468+0000","last_undegraded":"2023-07-09T02:18:44.635468+0000","last_fullsized":"2023-07-09T02:18:44.635468+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:22.284058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006845+0000","last_change":"2023-07-09T02:18:42.619966+0000","last_active":"2023-07-09T02:18:45.006845+0000","last_peered":"2023-07-09T02:18:45.006845+0000","last_clean":"2023-07-09T02:18:45.006845+0000","last_became_active":"2023-07-09T02:18:42.619440+0000","last_became_peered":"2023-07-09T02:18:42.619440+0000","last_unstale":"2023-07-09T02:18:45.006845+0000","last_undegraded":"2023-07-09T02:18:45.006845+0000","last_fullsized":"2023-07-09T02:18:45.006845+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:45:44.943677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":240,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635878+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:18:44.635878+0000","last_peered":"2023-07-09T02:18:44.635878+0000","last_clean":"2023-07-09T02:18:44.635878+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:18:44.635878+0000","last_undegraded":"2023-07-09T02:18:44.635878+0000","last_fullsized":"2023-07-09T02:18:44.635878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:35:44.305007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406210+0000","last_change":"2023-07-09T02:18:43.646200+0000","last_active":"2023-07-09T02:18:45.406210+0000","last_peered":"2023-07-09T02:18:45.406210+0000","last_clean":"2023-07-09T02:18:45.406210+0000","last_became_active":"2023-07-09T02:18:43.645783+0000","last_became_peered":"2023-07-09T02:18:43.645783+0000","last_unstale":"2023-07-09T02:18:45.406210+0000","last_undegraded":"2023-07-09T02:18:45.406210+0000","last_fullsized":"2023-07-09T02:18:45.406210+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:55:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"152'8","reported_seq":21,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633353+0000","last_change":"2023-07-09T02:18:42.624390+0000","last_active":"2023-07-09T02:18:44.633353+0000","last_peered":"2023-07-09T02:18:44.633353+0000","last_clean":"2023-07-09T02:18:44.633353+0000","last_became_active":"2023-07-09T02:18:42.624161+0000","last_became_peered":"2023-07-09T02:18:42.624161+0000","last_unstale":"2023-07-09T02:18:44.633353+0000","last_undegraded":"2023-07-09T02:18:44.633353+0000","last_fullsized":"2023-07-09T02:18:44.633353+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:25:26.416065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":242,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406733+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:18:45.406733+0000","last_peered":"2023-07-09T02:18:45.406733+0000","last_clean":"2023-07-09T02:18:45.406733+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:18:45.406733+0000","last_undegraded":"2023-07-09T02:18:45.406733+0000","last_fullsized":"2023-07-09T02:18:45.406733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:48:38.759597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636352+0000","last_change":"2023-07-09T02:18:43.640518+0000","last_active":"2023-07-09T02:18:44.636352+0000","last_peered":"2023-07-09T02:18:44.636352+0000","last_clean":"2023-07-09T02:18:44.636352+0000","last_became_active":"2023-07-09T02:18:43.640269+0000","last_became_peered":"2023-07-09T02:18:43.640269+0000","last_unstale":"2023-07-09T02:18:44.636352+0000","last_undegraded":"2023-07-09T02:18:44.636352+0000","last_fullsized":"2023-07-09T02:18:44.636352+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:39:03.127911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406558+0000","last_change":"2023-07-09T02:18:42.615994+0000","last_active":"2023-07-09T02:18:45.406558+0000","last_peered":"2023-07-09T02:18:45.406558+0000","last_clean":"2023-07-09T02:18:45.406558+0000","last_became_active":"2023-07-09T02:18:42.615772+0000","last_became_peered":"2023-07-09T02:18:42.615772+0000","last_unstale":"2023-07-09T02:18:45.406558+0000","last_undegraded":"2023-07-09T02:18:45.406558+0000","last_fullsized":"2023-07-09T02:18:45.406558+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:24:09.794133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":274,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406057+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:18:45.406057+0000","last_peered":"2023-07-09T02:18:45.406057+0000","last_clean":"2023-07-09T02:18:45.406057+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:18:45.406057+0000","last_undegraded":"2023-07-09T02:18:45.406057+0000","last_fullsized":"2023-07-09T02:18:45.406057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:16:32.092596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006834+0000","last_change":"2023-07-09T02:18:43.645260+0000","last_active":"2023-07-09T02:18:45.006834+0000","last_peered":"2023-07-09T02:18:45.006834+0000","last_clean":"2023-07-09T02:18:45.006834+0000","last_became_active":"2023-07-09T02:18:43.644772+0000","last_became_peered":"2023-07-09T02:18:43.644772+0000","last_unstale":"2023-07-09T02:18:45.006834+0000","last_undegraded":"2023-07-09T02:18:45.006834+0000","last_fullsized":"2023-07-09T02:18:45.006834+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:41:01.878744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"152'3","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635628+0000","last_change":"2023-07-09T02:18:42.626292+0000","last_active":"2023-07-09T02:18:44.635628+0000","last_peered":"2023-07-09T02:18:44.635628+0000","last_clean":"2023-07-09T02:18:44.635628+0000","last_became_active":"2023-07-09T02:18:42.626040+0000","last_became_peered":"2023-07-09T02:18:42.626040+0000","last_unstale":"2023-07-09T02:18:44.635628+0000","last_undegraded":"2023-07-09T02:18:44.635628+0000","last_fullsized":"2023-07-09T02:18:44.635628+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:10:59.420992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633846+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:18:44.633846+0000","last_peered":"2023-07-09T02:18:44.633846+0000","last_clean":"2023-07-09T02:18:44.633846+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:18:44.633846+0000","last_undegraded":"2023-07-09T02:18:44.633846+0000","last_fullsized":"2023-07-09T02:18:44.633846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:18:21.054705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007033+0000","last_change":"2023-07-09T02:18:43.646548+0000","last_active":"2023-07-09T02:18:45.007033+0000","last_peered":"2023-07-09T02:18:45.007033+0000","last_clean":"2023-07-09T02:18:45.007033+0000","last_became_active":"2023-07-09T02:18:43.646315+0000","last_became_peered":"2023-07-09T02:18:43.646315+0000","last_unstale":"2023-07-09T02:18:45.007033+0000","last_undegraded":"2023-07-09T02:18:45.007033+0000","last_fullsized":"2023-07-09T02:18:45.007033+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:43:11.836185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"152'6","reported_seq":19,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635638+0000","last_change":"2023-07-09T02:18:42.625268+0000","last_active":"2023-07-09T02:18:44.635638+0000","last_peered":"2023-07-09T02:18:44.635638+0000","last_clean":"2023-07-09T02:18:44.635638+0000","last_became_active":"2023-07-09T02:18:42.624793+0000","last_became_peered":"2023-07-09T02:18:42.624793+0000","last_unstale":"2023-07-09T02:18:44.635638+0000","last_undegraded":"2023-07-09T02:18:44.635638+0000","last_fullsized":"2023-07-09T02:18:44.635638+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:52:57.484048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":242,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635744+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:18:44.635744+0000","last_peered":"2023-07-09T02:18:44.635744+0000","last_clean":"2023-07-09T02:18:44.635744+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:18:44.635744+0000","last_undegraded":"2023-07-09T02:18:44.635744+0000","last_fullsized":"2023-07-09T02:18:44.635744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:43:42.458460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406556+0000","last_change":"2023-07-09T02:18:43.656161+0000","last_active":"2023-07-09T02:18:45.406556+0000","last_peered":"2023-07-09T02:18:45.406556+0000","last_clean":"2023-07-09T02:18:45.406556+0000","last_became_active":"2023-07-09T02:18:43.655942+0000","last_became_peered":"2023-07-09T02:18:43.655942+0000","last_unstale":"2023-07-09T02:18:45.406556+0000","last_undegraded":"2023-07-09T02:18:45.406556+0000","last_fullsized":"2023-07-09T02:18:45.406556+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:36:16.261514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406465+0000","last_change":"2023-07-09T02:18:42.623510+0000","last_active":"2023-07-09T02:18:45.406465+0000","last_peered":"2023-07-09T02:18:45.406465+0000","last_clean":"2023-07-09T02:18:45.406465+0000","last_became_active":"2023-07-09T02:18:42.623283+0000","last_became_peered":"2023-07-09T02:18:42.623283+0000","last_unstale":"2023-07-09T02:18:45.406465+0000","last_undegraded":"2023-07-09T02:18:45.406465+0000","last_fullsized":"2023-07-09T02:18:45.406465+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:59:19.860021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633690+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:18:44.633690+0000","last_peered":"2023-07-09T02:18:44.633690+0000","last_clean":"2023-07-09T02:18:44.633690+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:18:44.633690+0000","last_undegraded":"2023-07-09T02:18:44.633690+0000","last_fullsized":"2023-07-09T02:18:44.633690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:50:22.920908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633351+0000","last_change":"2023-07-09T02:18:43.643252+0000","last_active":"2023-07-09T02:18:44.633351+0000","last_peered":"2023-07-09T02:18:44.633351+0000","last_clean":"2023-07-09T02:18:44.633351+0000","last_became_active":"2023-07-09T02:18:43.642764+0000","last_became_peered":"2023-07-09T02:18:43.642764+0000","last_unstale":"2023-07-09T02:18:44.633351+0000","last_undegraded":"2023-07-09T02:18:44.633351+0000","last_fullsized":"2023-07-09T02:18:44.633351+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:24:47.881909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.407013+0000","last_change":"2023-07-09T02:18:42.617162+0000","last_active":"2023-07-09T02:18:45.407013+0000","last_peered":"2023-07-09T02:18:45.407013+0000","last_clean":"2023-07-09T02:18:45.407013+0000","last_became_active":"2023-07-09T02:18:42.616921+0000","last_became_peered":"2023-07-09T02:18:42.616921+0000","last_unstale":"2023-07-09T02:18:45.407013+0000","last_undegraded":"2023-07-09T02:18:45.407013+0000","last_fullsized":"2023-07-09T02:18:45.407013+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:16:38.490187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":240,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006914+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:18:45.006914+0000","last_peered":"2023-07-09T02:18:45.006914+0000","last_clean":"2023-07-09T02:18:45.006914+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:18:45.006914+0000","last_undegraded":"2023-07-09T02:18:45.006914+0000","last_fullsized":"2023-07-09T02:18:45.006914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:15:02.945383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1465,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193847,"statfs":{"total":200000000,"available":198499814,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.74199999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91100000000000003,"5min":1.2330000000000001,"15min":1.4950000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71799999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68700000000000006,"15min":0.68000000000000005},"min":{"1min":0.55500000000000005,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.877,"5min":1.1839999999999999,"15min":1.423},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68300000000000005,"15min":0.79500000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93899999999999995,"5min":1.1559999999999999,"15min":29.498999999999999},"last":0.62}]},{"osd":2,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92100000000000004,"5min":1.0840000000000001,"15min":5.0460000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.71799999999999997,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.93500000000000005,"5min":1.01,"15min":26.524000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.68400000000000005},"min":{"1min":0.59499999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.96699999999999997,"15min":4.3789999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73499999999999999,"15min":0.77500000000000002},"min":{"1min":0.51100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":1.242,"15min":10.609999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84599999999999997,"5min":0.91100000000000003,"15min":0.91500000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88700000000000001,"5min":1.032,"15min":1.032},"last":0.75700000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61199999999999999,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.94899999999999995,"15min":0.94999999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.048,"15min":1.048},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68600000000000005,"15min":0.73299999999999998},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89800000000000002,"5min":1.0009999999999999,"15min":1.087},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.67800000000000005},"min":{"1min":0.45500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":881,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194431,"statfs":{"total":200000000,"available":199097817,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.39700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90600000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.70699999999999996},"min":{"1min":0.502,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90200000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.4379999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.72699999999999998},"min":{"1min":0.57999999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":1.165},"last":0.98399999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81899999999999995,"5min":0.90900000000000003,"15min":0.95699999999999996},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.442,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72699999999999998,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86399999999999999,"5min":1.45,"15min":1.45},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82599999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.79100000000000004}]},{"osd":4,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86299999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.753},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.39300000000000002,"15min":0.38800000000000001},"max":{"1min":0.875,"5min":1.117,"15min":1.117},"last":0.97099999999999997}]},{"osd":5,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.63500000000000001},"min":{"1min":0.48499999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84699999999999998,"5min":0.86299999999999999,"15min":0.88200000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.44600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.879,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.44900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92000000000000004,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85599999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":880,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194432,"statfs":{"total":200000000,"available":199098467,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":1.248,"15min":1.248},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.44700000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93700000000000006,"5min":0.98599999999999999,"15min":1.179},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.44,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69199999999999995,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.39800000000000002},"max":{"1min":0.88300000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.751}]},{"osd":2,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":0.81100000000000005,"5min":1.0169999999999999,"15min":1.103},"last":0.874},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86399999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.76300000000000001,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.50600000000000001,"15min":0.47399999999999998},"max":{"1min":0.87,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.96999999999999997,"15min":0.98399999999999999},"last":0.86599999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.314},"max":{"1min":0.82399999999999995,"5min":1.008,"15min":1.008},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90100000000000002,"5min":0.92800000000000005,"15min":1.0720000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":0.91900000000000004,"15min":1.054},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90200000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80300000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.1619999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.754},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.091},"last":0.89200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":880,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194432,"statfs":{"total":200000000,"available":199098489,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65100000000000002,"15min":0.85199999999999998},"min":{"1min":0.42099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":50.508000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.97899999999999998,"15min":0.98999999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.34100000000000003},"max":{"1min":0.79500000000000004,"5min":0.97199999999999998,"15min":8.6039999999999992},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83999999999999997,"5min":0.98199999999999998,"15min":1.4550000000000001},"last":0.76700000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":0.998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.879,"5min":1.008,"15min":1.323},"last":0.86299999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69199999999999995,"15min":0.69399999999999995},"min":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.84199999999999997,"5min":0.94299999999999995,"15min":1.0369999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.94999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83699999999999997,"5min":0.95099999999999996,"15min":71.909000000000006},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.63900000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92100000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.89100000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59899999999999998,"15min":0.628},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90300000000000002,"5min":0.93100000000000005,"15min":7.9909999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93899999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.72599999999999998},"min":{"1min":0.496,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.40300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":8.0359999999999996},"last":0.78900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":888,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194424,"statfs":{"total":200000000,"available":199090202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.442,"15min":0.42399999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48699999999999999,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":0.87,"15min":1.198},"last":0.46100000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.71599999999999997,"5min":0.80400000000000005,"15min":1.048},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.505,"15min":0.51300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65800000000000003,"5min":0.83999999999999997,"15min":0.85299999999999998},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.76100000000000001,"5min":0.76700000000000002,"15min":1.155},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.1040000000000001},"last":0.439}]},{"osd":4,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.749},"min":{"1min":0.502,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.96299999999999997,"5min":1.466,"15min":1.466},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76200000000000001,"15min":0.71199999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93300000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.86599999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.77300000000000002,"15min":0.72599999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97799999999999998,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80900000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0629999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0840000000000001,"5min":1.395,"15min":1.5569999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.367,"15min":1.367},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.84099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":880,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194431,"statfs":{"total":200000000,"available":199097873,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.26300000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52600000000000002,"5min":0.92100000000000004,"15min":7.7450000000000001},"last":0.433},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.60699999999999998,"5min":0.67100000000000004,"15min":1.127},"last":0.45100000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.35799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56899999999999995,"5min":0.70099999999999996,"15min":2.8879999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54700000000000004,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":2.0600000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.502},"min":{"1min":0.433,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66100000000000003,"5min":0.90300000000000002,"15min":1.6879999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64100000000000001,"5min":0.83299999999999996,"15min":7.8710000000000004},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.5,"5min":0.47199999999999998,"15min":0.46500000000000002},"max":{"1min":0.85099999999999998,"5min":1.1220000000000001,"15min":7.7990000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.72599999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.821,"15min":1.821},"last":0.66600000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.496},"max":{"1min":0.95999999999999996,"5min":1.1799999999999999,"15min":1.319},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.91100000000000003,"5min":1.99,"15min":7.8369999999999997},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79400000000000004,"15min":0.76900000000000002},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.85699999999999998,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93400000000000005,"5min":1.226,"15min":1.452},"last":0.629}]},{"osd":7,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76800000000000002,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88500000000000001,"5min":1.1399999999999999,"15min":1.351},"last":0.54300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":886,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194425,"statfs":{"total":200000000,"available":199091766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.63900000000000001,"5min":0.72499999999999998,"15min":0.80300000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48799999999999999,"15min":0.46700000000000003},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41799999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65900000000000003,"5min":0.96999999999999997,"15min":1.1080000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57399999999999995,"15min":0.55200000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.61199999999999999,"5min":0.73999999999999999,"15min":1.163},"last":0.35599999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.46800000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79600000000000004,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.73199999999999998},"min":{"1min":0.59999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.032,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76800000000000002,"15min":0.73299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.002,"5min":1.034,"15min":1.034},"last":0.75600000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.77700000000000002},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0860000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.78700000000000003},"min":{"1min":0.66000000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.89600000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78700000000000003,"15min":0.76800000000000002},"min":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":1.129,"15min":1.3600000000000001},"last":0.78500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1463,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193849,"statfs":{"total":200000000,"available":198501412,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.42699999999999999},"min":{"1min":0.33300000000000002,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.69699999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.47899999999999998},"min":{"1min":0.371,"5min":0.36699999999999999,"15min":0.35199999999999998},"max":{"1min":0.60899999999999999,"5min":1.1180000000000001,"15min":1.3240000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47999999999999998,"15min":0.45800000000000002},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.88900000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48799999999999999,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":1.161,"15min":1.4139999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46300000000000002,"15min":0.42499999999999999},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.621,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.89200000000000002,"15min":3.8929999999999998},"last":0.48899999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.145},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.54400000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.153},"last":0.628}]},{"osd":5,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47199999999999998},"max":{"1min":1.02,"5min":1.401,"15min":1.4350000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.57599999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0549999999999999,"5min":1.0860000000000001,"15min":1.238},"last":0.752}]},{"osd":6,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.47799999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.1040000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.57099999999999995,"5min":0.51200000000000001,"15min":0.46899999999999997},"max":{"1min":0.91600000000000004,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0569999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.53100000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98199999999999998,"5min":1.0629999999999999,"15min":1.1819999999999999},"last":0.70799999999999996}]}]}],"pool_statfs":[]}} 2023-07-09T02:18:47.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:18:47.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f81799d5640 1 Processor -- start 2023-07-09T02:18:47.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f81799d5640 1 -- start start 2023-07-09T02:18:47.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f81799d5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f81740d2620 0x7f81740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f81799d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81740cd120 0x7f81740cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f81799d5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8174160a50 con 0x7f817415c060 2023-07-09T02:18:47.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f81799d5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817415c430 con 0x7f81740d2620 2023-07-09T02:18:47.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f81799d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817415fb60 con 0x7f81740cd120 2023-07-09T02:18:47.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f816bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f81740d2620 0x7f81740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f816bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f81740d2620 0x7f81740b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37944/0 (socket says 172.21.15.45:37944) 2023-07-09T02:18:47.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f816bfff640 1 -- 172.21.15.45:0/4219499173 learned_addr learned my addr 172.21.15.45:0/4219499173 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:47.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f81737fe640 1 --2- 172.21.15.45:0/4219499173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81740cd120 0x7f81740cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f816bfff640 1 -- 172.21.15.45:0/4219499173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81740cd120 msgr2=0x7f81740cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:47.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f816bfff640 1 --2- 172.21.15.45:0/4219499173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81740cd120 0x7f81740cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f816bfff640 1 -- 172.21.15.45:0/4219499173 >> v1:172.21.15.155:6789/0 conn(0x7f817415c060 legacy=0x7f81740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:47.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.935+0000 7f816bfff640 1 -- 172.21.15.45:0/4219499173 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817415fe40 con 0x7f81740d2620 2023-07-09T02:18:47.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f816bfff640 1 --2- 172.21.15.45:0/4219499173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f81740b4ed0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f815c009870 tx=0x7f815c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba336b1a22d610e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81727fc640 1 -- 172.21.15.45:0/4219499173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0aa5f0 con 0x7f81740d2620 2023-07-09T02:18:47.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81727fc640 1 -- 172.21.15.45:0/4219499173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c0aa750 con 0x7f81740d2620 2023-07-09T02:18:47.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81727fc640 1 -- 172.21.15.45:0/4219499173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0aaae0 con 0x7f81740d2620 2023-07-09T02:18:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81799d5640 1 -- 172.21.15.45:0/4219499173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 msgr2=0x7f81740b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81799d5640 1 --2- 172.21.15.45:0/4219499173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f81740b4ed0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f815c009870 tx=0x7f815c01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81799d5640 1 -- 172.21.15.45:0/4219499173 shutdown_connections 2023-07-09T02:18:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81799d5640 1 --2- 172.21.15.45:0/4219499173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81740cd120 0x7f81740cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81799d5640 1 --2- 172.21.15.45:0/4219499173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f81740b4ed0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81799d5640 1 -- 172.21.15.45:0/4219499173 >> 172.21.15.45:0/4219499173 conn(0x7f81740698e0 msgr2=0x7f8174069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81799d5640 1 -- 172.21.15.45:0/4219499173 shutdown_connections 2023-07-09T02:18:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.939+0000 7f81799d5640 1 -- 172.21.15.45:0/4219499173 wait complete. 2023-07-09T02:18:47.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81799d5640 1 Processor -- start 2023-07-09T02:18:47.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81799d5640 1 -- start start 2023-07-09T02:18:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81799d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81740cd120 0x7f81740cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81799d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f8174155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81799d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f817415c060 0x7f8174159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81799d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817415f5e0 con 0x7f81740d2620 2023-07-09T02:18:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81799d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817415f300 con 0x7f81740cd120 2023-07-09T02:18:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81799d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81740c9cf0 con 0x7f817415c060 2023-07-09T02:18:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f8174155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f8174155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37952/0 (socket says 172.21.15.45:37952) 2023-07-09T02:18:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 -- 172.21.15.45:0/2297791941 learned_addr learned my addr 172.21.15.45:0/2297791941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f8172ffd640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81740cd120 0x7f81740cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f81737fe640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f817415c060 0x7f8174159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 -- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f817415c060 msgr2=0x7f8174159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f817415c060 0x7f8174159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 -- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81740cd120 msgr2=0x7f81740cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81740cd120 0x7f81740cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 -- 172.21.15.45:0/2297791941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c0094d0 con 0x7f81740d2620 2023-07-09T02:18:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f816bfff640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f8174155210 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f815c0ac040 tx=0x7f815c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f8170ff9640 1 -- 172.21.15.45:0/2297791941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0aa5f0 con 0x7f81740d2620 2023-07-09T02:18:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.943+0000 7f8170ff9640 1 -- 172.21.15.45:0/2297791941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c0b3800 con 0x7f81740d2620 2023-07-09T02:18:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.947+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81740b59f0 con 0x7f81740d2620 2023-07-09T02:18:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.947+0000 7f8170ff9640 1 -- 172.21.15.45:0/2297791941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0b3bb0 con 0x7f81740d2620 2023-07-09T02:18:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.947+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81740ca2b0 con 0x7f81740d2620 2023-07-09T02:18:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.947+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81740ca4a0 con 0x7f81740d2620 2023-07-09T02:18:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.947+0000 7f8170ff9640 1 -- 172.21.15.45:0/2297791941 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f815c0b3d10 con 0x7f81740d2620 2023-07-09T02:18:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.947+0000 7f8170ff9640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8154066280 0x7f8154068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.947+0000 7f8170ff9640 1 -- 172.21.15.45:0/2297791941 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f815c0a7070 con 0x7f81740d2620 2023-07-09T02:18:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.951+0000 7f8172ffd640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8154066280 0x7f8154068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:47.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.951+0000 7f8172ffd640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8154066280 0x7f8154068730 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f81741f8070 tx=0x7f8164007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:47.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:47.951+0000 7f8170ff9640 1 -- 172.21.15.45:0/2297791941 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f815c0ebd30 con 0x7f81740d2620 2023-07-09T02:18:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.103+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81740b5870 con 0x7f8154066280 2023-07-09T02:18:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.111+0000 7f8170ff9640 1 -- 172.21.15.45:0/2297791941 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306167 (secure 0 0 0) 0x7f8164003bf0 con 0x7f8154066280 2023-07-09T02:18:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:48.116 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:18:48.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8154066280 msgr2=0x7f8154068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8154066280 0x7f8154068730 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f81741f8070 tx=0x7f8164007e40 comp rx=0 tx=0).stop 2023-07-09T02:18:48.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 msgr2=0x7f8174155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f8174155210 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f815c0ac040 tx=0x7f815c01ad10 comp rx=0 tx=0).stop 2023-07-09T02:18:48.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 shutdown_connections 2023-07-09T02:18:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8154066280 0x7f8154068730 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f817415c060 0x7f8174159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81740d2620 0x7f8174155210 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 --2- 172.21.15.45:0/2297791941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81740cd120 0x7f81740cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 >> 172.21.15.45:0/2297791941 conn(0x7f81740698e0 msgr2=0x7f8174069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 shutdown_connections 2023-07-09T02:18:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.115+0000 7f81799d5640 1 -- 172.21.15.45:0/2297791941 wait complete. 2023-07-09T02:18:48.136 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2023-07-09T02:18:46.636687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554273,"statfs":{"total":1600000000,"available":1591575840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.026201"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406735+0000","last_change":"2023-07-09T02:18:43.640744+0000","last_active":"2023-07-09T02:18:45.406735+0000","last_peered":"2023-07-09T02:18:45.406735+0000","last_clean":"2023-07-09T02:18:45.406735+0000","last_became_active":"2023-07-09T02:18:43.640532+0000","last_became_peered":"2023-07-09T02:18:43.640532+0000","last_unstale":"2023-07-09T02:18:45.406735+0000","last_undegraded":"2023-07-09T02:18:45.406735+0000","last_fullsized":"2023-07-09T02:18:45.406735+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:50:16.750946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405972+0000","last_change":"2023-07-09T02:18:43.640166+0000","last_active":"2023-07-09T02:18:45.405972+0000","last_peered":"2023-07-09T02:18:45.405972+0000","last_clean":"2023-07-09T02:18:45.405972+0000","last_became_active":"2023-07-09T02:18:43.639766+0000","last_became_peered":"2023-07-09T02:18:43.639766+0000","last_unstale":"2023-07-09T02:18:45.405972+0000","last_undegraded":"2023-07-09T02:18:45.405972+0000","last_fullsized":"2023-07-09T02:18:45.405972+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:44:34.724704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006684+0000","last_change":"2023-07-09T02:18:43.657027+0000","last_active":"2023-07-09T02:18:45.006684+0000","last_peered":"2023-07-09T02:18:45.006684+0000","last_clean":"2023-07-09T02:18:45.006684+0000","last_became_active":"2023-07-09T02:18:43.654368+0000","last_became_peered":"2023-07-09T02:18:43.654368+0000","last_unstale":"2023-07-09T02:18:45.006684+0000","last_undegraded":"2023-07-09T02:18:45.006684+0000","last_fullsized":"2023-07-09T02:18:45.006684+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:49:57.453751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406507+0000","last_change":"2023-07-09T02:18:43.654773+0000","last_active":"2023-07-09T02:18:45.406507+0000","last_peered":"2023-07-09T02:18:45.406507+0000","last_clean":"2023-07-09T02:18:45.406507+0000","last_became_active":"2023-07-09T02:18:43.652714+0000","last_became_peered":"2023-07-09T02:18:43.652714+0000","last_unstale":"2023-07-09T02:18:45.406507+0000","last_undegraded":"2023-07-09T02:18:45.406507+0000","last_fullsized":"2023-07-09T02:18:45.406507+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:09:05.520865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406775+0000","last_change":"2023-07-09T02:18:43.640055+0000","last_active":"2023-07-09T02:18:45.406775+0000","last_peered":"2023-07-09T02:18:45.406775+0000","last_clean":"2023-07-09T02:18:45.406775+0000","last_became_active":"2023-07-09T02:18:43.639797+0000","last_became_peered":"2023-07-09T02:18:43.639797+0000","last_unstale":"2023-07-09T02:18:45.406775+0000","last_undegraded":"2023-07-09T02:18:45.406775+0000","last_fullsized":"2023-07-09T02:18:45.406775+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:04:53.989635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633332+0000","last_change":"2023-07-09T02:18:43.647980+0000","last_active":"2023-07-09T02:18:44.633332+0000","last_peered":"2023-07-09T02:18:44.633332+0000","last_clean":"2023-07-09T02:18:44.633332+0000","last_became_active":"2023-07-09T02:18:43.647664+0000","last_became_peered":"2023-07-09T02:18:43.647664+0000","last_unstale":"2023-07-09T02:18:44.633332+0000","last_undegraded":"2023-07-09T02:18:44.633332+0000","last_fullsized":"2023-07-09T02:18:44.633332+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:12:04.143620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635627+0000","last_change":"2023-07-09T02:18:43.651932+0000","last_active":"2023-07-09T02:18:44.635627+0000","last_peered":"2023-07-09T02:18:44.635627+0000","last_clean":"2023-07-09T02:18:44.635627+0000","last_became_active":"2023-07-09T02:18:43.651518+0000","last_became_peered":"2023-07-09T02:18:43.651518+0000","last_unstale":"2023-07-09T02:18:44.635627+0000","last_undegraded":"2023-07-09T02:18:44.635627+0000","last_fullsized":"2023-07-09T02:18:44.635627+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:47:31.298866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405834+0000","last_change":"2023-07-09T02:18:43.639017+0000","last_active":"2023-07-09T02:18:45.405834+0000","last_peered":"2023-07-09T02:18:45.405834+0000","last_clean":"2023-07-09T02:18:45.405834+0000","last_became_active":"2023-07-09T02:18:43.638657+0000","last_became_peered":"2023-07-09T02:18:43.638657+0000","last_unstale":"2023-07-09T02:18:45.405834+0000","last_undegraded":"2023-07-09T02:18:45.405834+0000","last_fullsized":"2023-07-09T02:18:45.405834+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:52:20.350259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633219+0000","last_change":"2023-07-09T02:18:43.644406+0000","last_active":"2023-07-09T02:18:44.633219+0000","last_peered":"2023-07-09T02:18:44.633219+0000","last_clean":"2023-07-09T02:18:44.633219+0000","last_became_active":"2023-07-09T02:18:43.643396+0000","last_became_peered":"2023-07-09T02:18:43.643396+0000","last_unstale":"2023-07-09T02:18:44.633219+0000","last_undegraded":"2023-07-09T02:18:44.633219+0000","last_fullsized":"2023-07-09T02:18:44.633219+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:52:27.670007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636603+0000","last_change":"2023-07-09T02:18:43.640434+0000","last_active":"2023-07-09T02:18:44.636603+0000","last_peered":"2023-07-09T02:18:44.636603+0000","last_clean":"2023-07-09T02:18:44.636603+0000","last_became_active":"2023-07-09T02:18:43.640186+0000","last_became_peered":"2023-07-09T02:18:43.640186+0000","last_unstale":"2023-07-09T02:18:44.636603+0000","last_undegraded":"2023-07-09T02:18:44.636603+0000","last_fullsized":"2023-07-09T02:18:44.636603+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:54:23.179429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406208+0000","last_change":"2023-07-09T02:18:43.651606+0000","last_active":"2023-07-09T02:18:45.406208+0000","last_peered":"2023-07-09T02:18:45.406208+0000","last_clean":"2023-07-09T02:18:45.406208+0000","last_became_active":"2023-07-09T02:18:43.647447+0000","last_became_peered":"2023-07-09T02:18:43.647447+0000","last_unstale":"2023-07-09T02:18:45.406208+0000","last_undegraded":"2023-07-09T02:18:45.406208+0000","last_fullsized":"2023-07-09T02:18:45.406208+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:23:53.510424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406453+0000","last_change":"2023-07-09T02:18:43.644184+0000","last_active":"2023-07-09T02:18:45.406453+0000","last_peered":"2023-07-09T02:18:45.406453+0000","last_clean":"2023-07-09T02:18:45.406453+0000","last_became_active":"2023-07-09T02:18:43.643601+0000","last_became_peered":"2023-07-09T02:18:43.643601+0000","last_unstale":"2023-07-09T02:18:45.406453+0000","last_undegraded":"2023-07-09T02:18:45.406453+0000","last_fullsized":"2023-07-09T02:18:45.406453+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:32:16.862053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633219+0000","last_change":"2023-07-09T02:18:43.656409+0000","last_active":"2023-07-09T02:18:44.633219+0000","last_peered":"2023-07-09T02:18:44.633219+0000","last_clean":"2023-07-09T02:18:44.633219+0000","last_became_active":"2023-07-09T02:18:43.656033+0000","last_became_peered":"2023-07-09T02:18:43.656033+0000","last_unstale":"2023-07-09T02:18:44.633219+0000","last_undegraded":"2023-07-09T02:18:44.633219+0000","last_fullsized":"2023-07-09T02:18:44.633219+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:48:20.223882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406425+0000","last_change":"2023-07-09T02:18:43.655066+0000","last_active":"2023-07-09T02:18:45.406425+0000","last_peered":"2023-07-09T02:18:45.406425+0000","last_clean":"2023-07-09T02:18:45.406425+0000","last_became_active":"2023-07-09T02:18:43.654854+0000","last_became_peered":"2023-07-09T02:18:43.654854+0000","last_unstale":"2023-07-09T02:18:45.406425+0000","last_undegraded":"2023-07-09T02:18:45.406425+0000","last_fullsized":"2023-07-09T02:18:45.406425+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:14:49.900805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406167+0000","last_change":"2023-07-09T02:18:43.649955+0000","last_active":"2023-07-09T02:18:45.406167+0000","last_peered":"2023-07-09T02:18:45.406167+0000","last_clean":"2023-07-09T02:18:45.406167+0000","last_became_active":"2023-07-09T02:18:43.649714+0000","last_became_peered":"2023-07-09T02:18:43.649714+0000","last_unstale":"2023-07-09T02:18:45.406167+0000","last_undegraded":"2023-07-09T02:18:45.406167+0000","last_fullsized":"2023-07-09T02:18:45.406167+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:50:48.196160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633403+0000","last_change":"2023-07-09T02:18:43.644369+0000","last_active":"2023-07-09T02:18:44.633403+0000","last_peered":"2023-07-09T02:18:44.633403+0000","last_clean":"2023-07-09T02:18:44.633403+0000","last_became_active":"2023-07-09T02:18:43.644104+0000","last_became_peered":"2023-07-09T02:18:43.644104+0000","last_unstale":"2023-07-09T02:18:44.633403+0000","last_undegraded":"2023-07-09T02:18:44.633403+0000","last_fullsized":"2023-07-09T02:18:44.633403+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:55:14.367933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633231+0000","last_change":"2023-07-09T02:18:43.643108+0000","last_active":"2023-07-09T02:18:44.633231+0000","last_peered":"2023-07-09T02:18:44.633231+0000","last_clean":"2023-07-09T02:18:44.633231+0000","last_became_active":"2023-07-09T02:18:43.642339+0000","last_became_peered":"2023-07-09T02:18:43.642339+0000","last_unstale":"2023-07-09T02:18:44.633231+0000","last_undegraded":"2023-07-09T02:18:44.633231+0000","last_fullsized":"2023-07-09T02:18:44.633231+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:08:22.318454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406116+0000","last_change":"2023-07-09T02:18:43.639133+0000","last_active":"2023-07-09T02:18:45.406116+0000","last_peered":"2023-07-09T02:18:45.406116+0000","last_clean":"2023-07-09T02:18:45.406116+0000","last_became_active":"2023-07-09T02:18:43.638843+0000","last_became_peered":"2023-07-09T02:18:43.638843+0000","last_unstale":"2023-07-09T02:18:45.406116+0000","last_undegraded":"2023-07-09T02:18:45.406116+0000","last_fullsized":"2023-07-09T02:18:45.406116+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:47:03.135066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635188+0000","last_change":"2023-07-09T02:18:43.652736+0000","last_active":"2023-07-09T02:18:44.635188+0000","last_peered":"2023-07-09T02:18:44.635188+0000","last_clean":"2023-07-09T02:18:44.635188+0000","last_became_active":"2023-07-09T02:18:43.652343+0000","last_became_peered":"2023-07-09T02:18:43.652343+0000","last_unstale":"2023-07-09T02:18:44.635188+0000","last_undegraded":"2023-07-09T02:18:44.635188+0000","last_fullsized":"2023-07-09T02:18:44.635188+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:20:09.203326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406866+0000","last_change":"2023-07-09T02:18:43.650655+0000","last_active":"2023-07-09T02:18:45.406866+0000","last_peered":"2023-07-09T02:18:45.406866+0000","last_clean":"2023-07-09T02:18:45.406866+0000","last_became_active":"2023-07-09T02:18:43.650127+0000","last_became_peered":"2023-07-09T02:18:43.650127+0000","last_unstale":"2023-07-09T02:18:45.406866+0000","last_undegraded":"2023-07-09T02:18:45.406866+0000","last_fullsized":"2023-07-09T02:18:45.406866+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:53:54.544683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406342+0000","last_change":"2023-07-09T02:18:43.647776+0000","last_active":"2023-07-09T02:18:45.406342+0000","last_peered":"2023-07-09T02:18:45.406342+0000","last_clean":"2023-07-09T02:18:45.406342+0000","last_became_active":"2023-07-09T02:18:43.647083+0000","last_became_peered":"2023-07-09T02:18:43.647083+0000","last_unstale":"2023-07-09T02:18:45.406342+0000","last_undegraded":"2023-07-09T02:18:45.406342+0000","last_fullsized":"2023-07-09T02:18:45.406342+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:06:30.027056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406620+0000","last_change":"2023-07-09T02:18:43.644339+0000","last_active":"2023-07-09T02:18:45.406620+0000","last_peered":"2023-07-09T02:18:45.406620+0000","last_clean":"2023-07-09T02:18:45.406620+0000","last_became_active":"2023-07-09T02:18:43.643927+0000","last_became_peered":"2023-07-09T02:18:43.643927+0000","last_unstale":"2023-07-09T02:18:45.406620+0000","last_undegraded":"2023-07-09T02:18:45.406620+0000","last_fullsized":"2023-07-09T02:18:45.406620+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:10:23.094356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405741+0000","last_change":"2023-07-09T02:18:43.651986+0000","last_active":"2023-07-09T02:18:45.405741+0000","last_peered":"2023-07-09T02:18:45.405741+0000","last_clean":"2023-07-09T02:18:45.405741+0000","last_became_active":"2023-07-09T02:18:43.650434+0000","last_became_peered":"2023-07-09T02:18:43.650434+0000","last_unstale":"2023-07-09T02:18:45.405741+0000","last_undegraded":"2023-07-09T02:18:45.405741+0000","last_fullsized":"2023-07-09T02:18:45.405741+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:02:55.101218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633354+0000","last_change":"2023-07-09T02:18:43.646286+0000","last_active":"2023-07-09T02:18:44.633354+0000","last_peered":"2023-07-09T02:18:44.633354+0000","last_clean":"2023-07-09T02:18:44.633354+0000","last_became_active":"2023-07-09T02:18:43.643710+0000","last_became_peered":"2023-07-09T02:18:43.643710+0000","last_unstale":"2023-07-09T02:18:44.633354+0000","last_undegraded":"2023-07-09T02:18:44.633354+0000","last_fullsized":"2023-07-09T02:18:44.633354+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:09:44.219530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006729+0000","last_change":"2023-07-09T02:18:43.651384+0000","last_active":"2023-07-09T02:18:45.006729+0000","last_peered":"2023-07-09T02:18:45.006729+0000","last_clean":"2023-07-09T02:18:45.006729+0000","last_became_active":"2023-07-09T02:18:43.650816+0000","last_became_peered":"2023-07-09T02:18:43.650816+0000","last_unstale":"2023-07-09T02:18:45.006729+0000","last_undegraded":"2023-07-09T02:18:45.006729+0000","last_fullsized":"2023-07-09T02:18:45.006729+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:58:29.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006711+0000","last_change":"2023-07-09T02:18:43.650875+0000","last_active":"2023-07-09T02:18:45.006711+0000","last_peered":"2023-07-09T02:18:45.006711+0000","last_clean":"2023-07-09T02:18:45.006711+0000","last_became_active":"2023-07-09T02:18:43.650353+0000","last_became_peered":"2023-07-09T02:18:43.650353+0000","last_unstale":"2023-07-09T02:18:45.006711+0000","last_undegraded":"2023-07-09T02:18:45.006711+0000","last_fullsized":"2023-07-09T02:18:45.006711+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:17:25.423310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635187+0000","last_change":"2023-07-09T02:18:43.651744+0000","last_active":"2023-07-09T02:18:44.635187+0000","last_peered":"2023-07-09T02:18:44.635187+0000","last_clean":"2023-07-09T02:18:44.635187+0000","last_became_active":"2023-07-09T02:18:43.650996+0000","last_became_peered":"2023-07-09T02:18:43.650996+0000","last_unstale":"2023-07-09T02:18:44.635187+0000","last_undegraded":"2023-07-09T02:18:44.635187+0000","last_fullsized":"2023-07-09T02:18:44.635187+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:43:30.499159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636414+0000","last_change":"2023-07-09T02:18:43.641793+0000","last_active":"2023-07-09T02:18:44.636414+0000","last_peered":"2023-07-09T02:18:44.636414+0000","last_clean":"2023-07-09T02:18:44.636414+0000","last_became_active":"2023-07-09T02:18:43.641573+0000","last_became_peered":"2023-07-09T02:18:43.641573+0000","last_unstale":"2023-07-09T02:18:44.636414+0000","last_undegraded":"2023-07-09T02:18:44.636414+0000","last_fullsized":"2023-07-09T02:18:44.636414+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:20:12.368168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006677+0000","last_change":"2023-07-09T02:18:43.648252+0000","last_active":"2023-07-09T02:18:45.006677+0000","last_peered":"2023-07-09T02:18:45.006677+0000","last_clean":"2023-07-09T02:18:45.006677+0000","last_became_active":"2023-07-09T02:18:43.648004+0000","last_became_peered":"2023-07-09T02:18:43.648004+0000","last_unstale":"2023-07-09T02:18:45.006677+0000","last_undegraded":"2023-07-09T02:18:45.006677+0000","last_fullsized":"2023-07-09T02:18:45.006677+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:44:47.181297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006907+0000","last_change":"2023-07-09T02:18:43.651237+0000","last_active":"2023-07-09T02:18:45.006907+0000","last_peered":"2023-07-09T02:18:45.006907+0000","last_clean":"2023-07-09T02:18:45.006907+0000","last_became_active":"2023-07-09T02:18:43.650489+0000","last_became_peered":"2023-07-09T02:18:43.650489+0000","last_unstale":"2023-07-09T02:18:45.006907+0000","last_undegraded":"2023-07-09T02:18:45.006907+0000","last_fullsized":"2023-07-09T02:18:45.006907+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:32:52.779477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406041+0000","last_change":"2023-07-09T02:18:43.643915+0000","last_active":"2023-07-09T02:18:45.406041+0000","last_peered":"2023-07-09T02:18:45.406041+0000","last_clean":"2023-07-09T02:18:45.406041+0000","last_became_active":"2023-07-09T02:18:43.643346+0000","last_became_peered":"2023-07-09T02:18:43.643346+0000","last_unstale":"2023-07-09T02:18:45.406041+0000","last_undegraded":"2023-07-09T02:18:45.406041+0000","last_fullsized":"2023-07-09T02:18:45.406041+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:55:24.523209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636438+0000","last_change":"2023-07-09T02:18:43.641133+0000","last_active":"2023-07-09T02:18:44.636438+0000","last_peered":"2023-07-09T02:18:44.636438+0000","last_clean":"2023-07-09T02:18:44.636438+0000","last_became_active":"2023-07-09T02:18:43.640908+0000","last_became_peered":"2023-07-09T02:18:43.640908+0000","last_unstale":"2023-07-09T02:18:44.636438+0000","last_undegraded":"2023-07-09T02:18:44.636438+0000","last_fullsized":"2023-07-09T02:18:44.636438+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:16:31.516833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406353+0000","last_change":"2023-07-09T02:18:43.650889+0000","last_active":"2023-07-09T02:18:45.406353+0000","last_peered":"2023-07-09T02:18:45.406353+0000","last_clean":"2023-07-09T02:18:45.406353+0000","last_became_active":"2023-07-09T02:18:43.649070+0000","last_became_peered":"2023-07-09T02:18:43.649070+0000","last_unstale":"2023-07-09T02:18:45.406353+0000","last_undegraded":"2023-07-09T02:18:45.406353+0000","last_fullsized":"2023-07-09T02:18:45.406353+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:35:28.037444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"152'4","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007242+0000","last_change":"2023-07-09T02:18:42.620010+0000","last_active":"2023-07-09T02:18:45.007242+0000","last_peered":"2023-07-09T02:18:45.007242+0000","last_clean":"2023-07-09T02:18:45.007242+0000","last_became_active":"2023-07-09T02:18:42.619695+0000","last_became_peered":"2023-07-09T02:18:42.619695+0000","last_unstale":"2023-07-09T02:18:45.007242+0000","last_undegraded":"2023-07-09T02:18:45.007242+0000","last_fullsized":"2023-07-09T02:18:45.007242+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:59:03.607948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406204+0000","last_change":"2023-07-09T02:18:43.641680+0000","last_active":"2023-07-09T02:18:45.406204+0000","last_peered":"2023-07-09T02:18:45.406204+0000","last_clean":"2023-07-09T02:18:45.406204+0000","last_became_active":"2023-07-09T02:18:43.641026+0000","last_became_peered":"2023-07-09T02:18:43.641026+0000","last_unstale":"2023-07-09T02:18:45.406204+0000","last_undegraded":"2023-07-09T02:18:45.406204+0000","last_fullsized":"2023-07-09T02:18:45.406204+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:51:35.546185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406400+0000","last_change":"2023-07-09T02:18:42.625511+0000","last_active":"2023-07-09T02:18:45.406400+0000","last_peered":"2023-07-09T02:18:45.406400+0000","last_clean":"2023-07-09T02:18:45.406400+0000","last_became_active":"2023-07-09T02:18:42.625234+0000","last_became_peered":"2023-07-09T02:18:42.625234+0000","last_unstale":"2023-07-09T02:18:45.406400+0000","last_undegraded":"2023-07-09T02:18:45.406400+0000","last_fullsized":"2023-07-09T02:18:45.406400+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:58:42.051192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405886+0000","last_change":"2023-07-09T02:18:43.650661+0000","last_active":"2023-07-09T02:18:45.405886+0000","last_peered":"2023-07-09T02:18:45.405886+0000","last_clean":"2023-07-09T02:18:45.405886+0000","last_became_active":"2023-07-09T02:18:43.650121+0000","last_became_peered":"2023-07-09T02:18:43.650121+0000","last_unstale":"2023-07-09T02:18:45.405886+0000","last_undegraded":"2023-07-09T02:18:45.405886+0000","last_fullsized":"2023-07-09T02:18:45.405886+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:25:52.557418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636298+0000","last_change":"2023-07-09T02:18:42.626157+0000","last_active":"2023-07-09T02:18:44.636298+0000","last_peered":"2023-07-09T02:18:44.636298+0000","last_clean":"2023-07-09T02:18:44.636298+0000","last_became_active":"2023-07-09T02:18:42.625558+0000","last_became_peered":"2023-07-09T02:18:42.625558+0000","last_unstale":"2023-07-09T02:18:44.636298+0000","last_undegraded":"2023-07-09T02:18:44.636298+0000","last_fullsized":"2023-07-09T02:18:44.636298+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:55:33.520738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406757+0000","last_change":"2023-07-09T02:18:43.649435+0000","last_active":"2023-07-09T02:18:45.406757+0000","last_peered":"2023-07-09T02:18:45.406757+0000","last_clean":"2023-07-09T02:18:45.406757+0000","last_became_active":"2023-07-09T02:18:43.648561+0000","last_became_peered":"2023-07-09T02:18:43.648561+0000","last_unstale":"2023-07-09T02:18:45.406757+0000","last_undegraded":"2023-07-09T02:18:45.406757+0000","last_fullsized":"2023-07-09T02:18:45.406757+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:21:46.623042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635645+0000","last_change":"2023-07-09T02:18:42.624244+0000","last_active":"2023-07-09T02:18:44.635645+0000","last_peered":"2023-07-09T02:18:44.635645+0000","last_clean":"2023-07-09T02:18:44.635645+0000","last_became_active":"2023-07-09T02:18:42.623859+0000","last_became_peered":"2023-07-09T02:18:42.623859+0000","last_unstale":"2023-07-09T02:18:44.635645+0000","last_undegraded":"2023-07-09T02:18:44.635645+0000","last_fullsized":"2023-07-09T02:18:44.635645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:52.190492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406187+0000","last_change":"2023-07-09T02:18:43.644104+0000","last_active":"2023-07-09T02:18:45.406187+0000","last_peered":"2023-07-09T02:18:45.406187+0000","last_clean":"2023-07-09T02:18:45.406187+0000","last_became_active":"2023-07-09T02:18:43.643671+0000","last_became_peered":"2023-07-09T02:18:43.643671+0000","last_unstale":"2023-07-09T02:18:45.406187+0000","last_undegraded":"2023-07-09T02:18:45.406187+0000","last_fullsized":"2023-07-09T02:18:45.406187+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:56:25.588689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406035+0000","last_change":"2023-07-09T02:18:42.615275+0000","last_active":"2023-07-09T02:18:45.406035+0000","last_peered":"2023-07-09T02:18:45.406035+0000","last_clean":"2023-07-09T02:18:45.406035+0000","last_became_active":"2023-07-09T02:18:42.615024+0000","last_became_peered":"2023-07-09T02:18:42.615024+0000","last_unstale":"2023-07-09T02:18:45.406035+0000","last_undegraded":"2023-07-09T02:18:45.406035+0000","last_fullsized":"2023-07-09T02:18:45.406035+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:14:06.330721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406139+0000","last_change":"2023-07-09T02:18:43.638928+0000","last_active":"2023-07-09T02:18:45.406139+0000","last_peered":"2023-07-09T02:18:45.406139+0000","last_clean":"2023-07-09T02:18:45.406139+0000","last_became_active":"2023-07-09T02:18:43.638681+0000","last_became_peered":"2023-07-09T02:18:43.638681+0000","last_unstale":"2023-07-09T02:18:45.406139+0000","last_undegraded":"2023-07-09T02:18:45.406139+0000","last_fullsized":"2023-07-09T02:18:45.406139+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:12:02.664722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406254+0000","last_change":"2023-07-09T02:18:42.626060+0000","last_active":"2023-07-09T02:18:45.406254+0000","last_peered":"2023-07-09T02:18:45.406254+0000","last_clean":"2023-07-09T02:18:45.406254+0000","last_became_active":"2023-07-09T02:18:42.625818+0000","last_became_peered":"2023-07-09T02:18:42.625818+0000","last_unstale":"2023-07-09T02:18:45.406254+0000","last_undegraded":"2023-07-09T02:18:45.406254+0000","last_fullsized":"2023-07-09T02:18:45.406254+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:14:07.417632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406195+0000","last_change":"2023-07-09T02:18:43.653829+0000","last_active":"2023-07-09T02:18:45.406195+0000","last_peered":"2023-07-09T02:18:45.406195+0000","last_clean":"2023-07-09T02:18:45.406195+0000","last_became_active":"2023-07-09T02:18:43.653573+0000","last_became_peered":"2023-07-09T02:18:43.653573+0000","last_unstale":"2023-07-09T02:18:45.406195+0000","last_undegraded":"2023-07-09T02:18:45.406195+0000","last_fullsized":"2023-07-09T02:18:45.406195+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:10:33.506931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633662+0000","last_change":"2023-07-09T02:18:42.624154+0000","last_active":"2023-07-09T02:18:44.633662+0000","last_peered":"2023-07-09T02:18:44.633662+0000","last_clean":"2023-07-09T02:18:44.633662+0000","last_became_active":"2023-07-09T02:18:42.623797+0000","last_became_peered":"2023-07-09T02:18:42.623797+0000","last_unstale":"2023-07-09T02:18:44.633662+0000","last_undegraded":"2023-07-09T02:18:44.633662+0000","last_fullsized":"2023-07-09T02:18:44.633662+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:06:00.358727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635299+0000","last_change":"2023-07-09T02:18:43.649358+0000","last_active":"2023-07-09T02:18:44.635299+0000","last_peered":"2023-07-09T02:18:44.635299+0000","last_clean":"2023-07-09T02:18:44.635299+0000","last_became_active":"2023-07-09T02:18:43.649087+0000","last_became_peered":"2023-07-09T02:18:43.649087+0000","last_unstale":"2023-07-09T02:18:44.635299+0000","last_undegraded":"2023-07-09T02:18:44.635299+0000","last_fullsized":"2023-07-09T02:18:44.635299+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:48:42.968279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007161+0000","last_change":"2023-07-09T02:18:42.621502+0000","last_active":"2023-07-09T02:18:45.007161+0000","last_peered":"2023-07-09T02:18:45.007161+0000","last_clean":"2023-07-09T02:18:45.007161+0000","last_became_active":"2023-07-09T02:18:42.621060+0000","last_became_peered":"2023-07-09T02:18:42.621060+0000","last_unstale":"2023-07-09T02:18:45.007161+0000","last_undegraded":"2023-07-09T02:18:45.007161+0000","last_fullsized":"2023-07-09T02:18:45.007161+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:29:11.855193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006953+0000","last_change":"2023-07-09T02:18:43.645095+0000","last_active":"2023-07-09T02:18:45.006953+0000","last_peered":"2023-07-09T02:18:45.006953+0000","last_clean":"2023-07-09T02:18:45.006953+0000","last_became_active":"2023-07-09T02:18:43.644513+0000","last_became_peered":"2023-07-09T02:18:43.644513+0000","last_unstale":"2023-07-09T02:18:45.006953+0000","last_undegraded":"2023-07-09T02:18:45.006953+0000","last_fullsized":"2023-07-09T02:18:45.006953+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:23:04.629073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406682+0000","last_change":"2023-07-09T02:18:42.624286+0000","last_active":"2023-07-09T02:18:45.406682+0000","last_peered":"2023-07-09T02:18:45.406682+0000","last_clean":"2023-07-09T02:18:45.406682+0000","last_became_active":"2023-07-09T02:18:42.624063+0000","last_became_peered":"2023-07-09T02:18:42.624063+0000","last_unstale":"2023-07-09T02:18:45.406682+0000","last_undegraded":"2023-07-09T02:18:45.406682+0000","last_fullsized":"2023-07-09T02:18:45.406682+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:58:47.152131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636149+0000","last_change":"2023-07-09T02:18:43.652898+0000","last_active":"2023-07-09T02:18:44.636149+0000","last_peered":"2023-07-09T02:18:44.636149+0000","last_clean":"2023-07-09T02:18:44.636149+0000","last_became_active":"2023-07-09T02:18:43.652573+0000","last_became_peered":"2023-07-09T02:18:43.652573+0000","last_unstale":"2023-07-09T02:18:44.636149+0000","last_undegraded":"2023-07-09T02:18:44.636149+0000","last_fullsized":"2023-07-09T02:18:44.636149+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:14:12.233876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007275+0000","last_change":"2023-07-09T02:18:42.621350+0000","last_active":"2023-07-09T02:18:45.007275+0000","last_peered":"2023-07-09T02:18:45.007275+0000","last_clean":"2023-07-09T02:18:45.007275+0000","last_became_active":"2023-07-09T02:18:42.620728+0000","last_became_peered":"2023-07-09T02:18:42.620728+0000","last_unstale":"2023-07-09T02:18:45.007275+0000","last_undegraded":"2023-07-09T02:18:45.007275+0000","last_fullsized":"2023-07-09T02:18:45.007275+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:18:22.766148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635342+0000","last_change":"2023-07-09T02:18:43.652588+0000","last_active":"2023-07-09T02:18:44.635342+0000","last_peered":"2023-07-09T02:18:44.635342+0000","last_clean":"2023-07-09T02:18:44.635342+0000","last_became_active":"2023-07-09T02:18:43.652017+0000","last_became_peered":"2023-07-09T02:18:43.652017+0000","last_unstale":"2023-07-09T02:18:44.635342+0000","last_undegraded":"2023-07-09T02:18:44.635342+0000","last_fullsized":"2023-07-09T02:18:44.635342+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:04:23.260327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"152'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633473+0000","last_change":"2023-07-09T02:18:42.623062+0000","last_active":"2023-07-09T02:18:44.633473+0000","last_peered":"2023-07-09T02:18:44.633473+0000","last_clean":"2023-07-09T02:18:44.633473+0000","last_became_active":"2023-07-09T02:18:42.622841+0000","last_became_peered":"2023-07-09T02:18:42.622841+0000","last_unstale":"2023-07-09T02:18:44.633473+0000","last_undegraded":"2023-07-09T02:18:44.633473+0000","last_fullsized":"2023-07-09T02:18:44.633473+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:52.408937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636633+0000","last_change":"2023-07-09T02:18:43.654838+0000","last_active":"2023-07-09T02:18:44.636633+0000","last_peered":"2023-07-09T02:18:44.636633+0000","last_clean":"2023-07-09T02:18:44.636633+0000","last_became_active":"2023-07-09T02:18:43.654473+0000","last_became_peered":"2023-07-09T02:18:43.654473+0000","last_unstale":"2023-07-09T02:18:44.636633+0000","last_undegraded":"2023-07-09T02:18:44.636633+0000","last_fullsized":"2023-07-09T02:18:44.636633+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:22:38.668128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406555+0000","last_change":"2023-07-09T02:18:42.621027+0000","last_active":"2023-07-09T02:18:45.406555+0000","last_peered":"2023-07-09T02:18:45.406555+0000","last_clean":"2023-07-09T02:18:45.406555+0000","last_became_active":"2023-07-09T02:18:42.620608+0000","last_became_peered":"2023-07-09T02:18:42.620608+0000","last_unstale":"2023-07-09T02:18:45.406555+0000","last_undegraded":"2023-07-09T02:18:45.406555+0000","last_fullsized":"2023-07-09T02:18:45.406555+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:24:49.832318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406174+0000","last_change":"2023-07-09T02:18:43.645912+0000","last_active":"2023-07-09T02:18:45.406174+0000","last_peered":"2023-07-09T02:18:45.406174+0000","last_clean":"2023-07-09T02:18:45.406174+0000","last_became_active":"2023-07-09T02:18:43.645390+0000","last_became_peered":"2023-07-09T02:18:43.645390+0000","last_unstale":"2023-07-09T02:18:45.406174+0000","last_undegraded":"2023-07-09T02:18:45.406174+0000","last_fullsized":"2023-07-09T02:18:45.406174+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:47:52.255454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406101+0000","last_change":"2023-07-09T02:18:42.623238+0000","last_active":"2023-07-09T02:18:45.406101+0000","last_peered":"2023-07-09T02:18:45.406101+0000","last_clean":"2023-07-09T02:18:45.406101+0000","last_became_active":"2023-07-09T02:18:42.622952+0000","last_became_peered":"2023-07-09T02:18:42.622952+0000","last_unstale":"2023-07-09T02:18:45.406101+0000","last_undegraded":"2023-07-09T02:18:45.406101+0000","last_fullsized":"2023-07-09T02:18:45.406101+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:38:44.739025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406875+0000","last_change":"2023-07-09T02:18:43.648671+0000","last_active":"2023-07-09T02:18:45.406875+0000","last_peered":"2023-07-09T02:18:45.406875+0000","last_clean":"2023-07-09T02:18:45.406875+0000","last_became_active":"2023-07-09T02:18:43.648432+0000","last_became_peered":"2023-07-09T02:18:43.648432+0000","last_unstale":"2023-07-09T02:18:45.406875+0000","last_undegraded":"2023-07-09T02:18:45.406875+0000","last_fullsized":"2023-07-09T02:18:45.406875+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:04:54.433455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406579+0000","last_change":"2023-07-09T02:18:42.621823+0000","last_active":"2023-07-09T02:18:45.406579+0000","last_peered":"2023-07-09T02:18:45.406579+0000","last_clean":"2023-07-09T02:18:45.406579+0000","last_became_active":"2023-07-09T02:18:42.621516+0000","last_became_peered":"2023-07-09T02:18:42.621516+0000","last_unstale":"2023-07-09T02:18:45.406579+0000","last_undegraded":"2023-07-09T02:18:45.406579+0000","last_fullsized":"2023-07-09T02:18:45.406579+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:01:47.182901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406935+0000","last_change":"2023-07-09T02:18:43.650425+0000","last_active":"2023-07-09T02:18:45.406935+0000","last_peered":"2023-07-09T02:18:45.406935+0000","last_clean":"2023-07-09T02:18:45.406935+0000","last_became_active":"2023-07-09T02:18:43.649826+0000","last_became_peered":"2023-07-09T02:18:43.649826+0000","last_unstale":"2023-07-09T02:18:45.406935+0000","last_undegraded":"2023-07-09T02:18:45.406935+0000","last_fullsized":"2023-07-09T02:18:45.406935+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:56:41.416564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636404+0000","last_change":"2023-07-09T02:18:42.625793+0000","last_active":"2023-07-09T02:18:44.636404+0000","last_peered":"2023-07-09T02:18:44.636404+0000","last_clean":"2023-07-09T02:18:44.636404+0000","last_became_active":"2023-07-09T02:18:42.625055+0000","last_became_peered":"2023-07-09T02:18:42.625055+0000","last_unstale":"2023-07-09T02:18:44.636404+0000","last_undegraded":"2023-07-09T02:18:44.636404+0000","last_fullsized":"2023-07-09T02:18:44.636404+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:34:00.101251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406601+0000","last_change":"2023-07-09T02:18:43.655012+0000","last_active":"2023-07-09T02:18:45.406601+0000","last_peered":"2023-07-09T02:18:45.406601+0000","last_clean":"2023-07-09T02:18:45.406601+0000","last_became_active":"2023-07-09T02:18:43.653875+0000","last_became_peered":"2023-07-09T02:18:43.653875+0000","last_unstale":"2023-07-09T02:18:45.406601+0000","last_undegraded":"2023-07-09T02:18:45.406601+0000","last_fullsized":"2023-07-09T02:18:45.406601+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:21:38.688746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633584+0000","last_change":"2023-07-09T02:18:42.621400+0000","last_active":"2023-07-09T02:18:44.633584+0000","last_peered":"2023-07-09T02:18:44.633584+0000","last_clean":"2023-07-09T02:18:44.633584+0000","last_became_active":"2023-07-09T02:18:42.621084+0000","last_became_peered":"2023-07-09T02:18:42.621084+0000","last_unstale":"2023-07-09T02:18:44.633584+0000","last_undegraded":"2023-07-09T02:18:44.633584+0000","last_fullsized":"2023-07-09T02:18:44.633584+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:12:32.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406046+0000","last_change":"2023-07-09T02:18:43.653727+0000","last_active":"2023-07-09T02:18:45.406046+0000","last_peered":"2023-07-09T02:18:45.406046+0000","last_clean":"2023-07-09T02:18:45.406046+0000","last_became_active":"2023-07-09T02:18:43.653236+0000","last_became_peered":"2023-07-09T02:18:43.653236+0000","last_unstale":"2023-07-09T02:18:45.406046+0000","last_undegraded":"2023-07-09T02:18:45.406046+0000","last_fullsized":"2023-07-09T02:18:45.406046+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:09:47.031191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.407148+0000","last_change":"2023-07-09T02:18:42.624209+0000","last_active":"2023-07-09T02:18:45.407148+0000","last_peered":"2023-07-09T02:18:45.407148+0000","last_clean":"2023-07-09T02:18:45.407148+0000","last_became_active":"2023-07-09T02:18:42.623644+0000","last_became_peered":"2023-07-09T02:18:42.623644+0000","last_unstale":"2023-07-09T02:18:45.407148+0000","last_undegraded":"2023-07-09T02:18:45.407148+0000","last_fullsized":"2023-07-09T02:18:45.407148+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:21:30.903712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007028+0000","last_change":"2023-07-09T02:18:43.656482+0000","last_active":"2023-07-09T02:18:45.007028+0000","last_peered":"2023-07-09T02:18:45.007028+0000","last_clean":"2023-07-09T02:18:45.007028+0000","last_became_active":"2023-07-09T02:18:43.653651+0000","last_became_peered":"2023-07-09T02:18:43.653651+0000","last_unstale":"2023-07-09T02:18:45.007028+0000","last_undegraded":"2023-07-09T02:18:45.007028+0000","last_fullsized":"2023-07-09T02:18:45.007028+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:12:53.233012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406186+0000","last_change":"2023-07-09T02:18:42.617734+0000","last_active":"2023-07-09T02:18:45.406186+0000","last_peered":"2023-07-09T02:18:45.406186+0000","last_clean":"2023-07-09T02:18:45.406186+0000","last_became_active":"2023-07-09T02:18:42.617077+0000","last_became_peered":"2023-07-09T02:18:42.617077+0000","last_unstale":"2023-07-09T02:18:45.406186+0000","last_undegraded":"2023-07-09T02:18:45.406186+0000","last_fullsized":"2023-07-09T02:18:45.406186+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:30:58.886392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635928+0000","last_change":"2023-07-09T02:18:43.657792+0000","last_active":"2023-07-09T02:18:44.635928+0000","last_peered":"2023-07-09T02:18:44.635928+0000","last_clean":"2023-07-09T02:18:44.635928+0000","last_became_active":"2023-07-09T02:18:43.657357+0000","last_became_peered":"2023-07-09T02:18:43.657357+0000","last_unstale":"2023-07-09T02:18:44.635928+0000","last_undegraded":"2023-07-09T02:18:44.635928+0000","last_fullsized":"2023-07-09T02:18:44.635928+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:47:20.904645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.405876+0000","last_change":"2023-07-09T02:18:42.617087+0000","last_active":"2023-07-09T02:18:45.405876+0000","last_peered":"2023-07-09T02:18:45.405876+0000","last_clean":"2023-07-09T02:18:45.405876+0000","last_became_active":"2023-07-09T02:18:42.616839+0000","last_became_peered":"2023-07-09T02:18:42.616839+0000","last_unstale":"2023-07-09T02:18:45.405876+0000","last_undegraded":"2023-07-09T02:18:45.405876+0000","last_fullsized":"2023-07-09T02:18:45.405876+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:49:19.897734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636552+0000","last_change":"2023-07-09T02:18:43.639478+0000","last_active":"2023-07-09T02:18:44.636552+0000","last_peered":"2023-07-09T02:18:44.636552+0000","last_clean":"2023-07-09T02:18:44.636552+0000","last_became_active":"2023-07-09T02:18:43.639238+0000","last_became_peered":"2023-07-09T02:18:43.639238+0000","last_unstale":"2023-07-09T02:18:44.636552+0000","last_undegraded":"2023-07-09T02:18:44.636552+0000","last_fullsized":"2023-07-09T02:18:44.636552+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:15:34.889686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633808+0000","last_change":"2023-07-09T02:18:42.623475+0000","last_active":"2023-07-09T02:18:44.633808+0000","last_peered":"2023-07-09T02:18:44.633808+0000","last_clean":"2023-07-09T02:18:44.633808+0000","last_became_active":"2023-07-09T02:18:42.623092+0000","last_became_peered":"2023-07-09T02:18:42.623092+0000","last_unstale":"2023-07-09T02:18:44.633808+0000","last_undegraded":"2023-07-09T02:18:44.633808+0000","last_fullsized":"2023-07-09T02:18:44.633808+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:02:54.092697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633728+0000","last_change":"2023-07-09T02:18:43.641917+0000","last_active":"2023-07-09T02:18:44.633728+0000","last_peered":"2023-07-09T02:18:44.633728+0000","last_clean":"2023-07-09T02:18:44.633728+0000","last_became_active":"2023-07-09T02:18:43.641296+0000","last_became_peered":"2023-07-09T02:18:43.641296+0000","last_unstale":"2023-07-09T02:18:44.633728+0000","last_undegraded":"2023-07-09T02:18:44.633728+0000","last_fullsized":"2023-07-09T02:18:44.633728+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:44:58.788303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406588+0000","last_change":"2023-07-09T02:18:42.617206+0000","last_active":"2023-07-09T02:18:45.406588+0000","last_peered":"2023-07-09T02:18:45.406588+0000","last_clean":"2023-07-09T02:18:45.406588+0000","last_became_active":"2023-07-09T02:18:42.615841+0000","last_became_peered":"2023-07-09T02:18:42.615841+0000","last_unstale":"2023-07-09T02:18:45.406588+0000","last_undegraded":"2023-07-09T02:18:45.406588+0000","last_fullsized":"2023-07-09T02:18:45.406588+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:09:41.505984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633554+0000","last_change":"2023-07-09T02:18:43.646515+0000","last_active":"2023-07-09T02:18:44.633554+0000","last_peered":"2023-07-09T02:18:44.633554+0000","last_clean":"2023-07-09T02:18:44.633554+0000","last_became_active":"2023-07-09T02:18:43.644098+0000","last_became_peered":"2023-07-09T02:18:43.644098+0000","last_unstale":"2023-07-09T02:18:44.633554+0000","last_undegraded":"2023-07-09T02:18:44.633554+0000","last_fullsized":"2023-07-09T02:18:44.633554+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:54:35.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636068+0000","last_change":"2023-07-09T02:18:42.623028+0000","last_active":"2023-07-09T02:18:44.636068+0000","last_peered":"2023-07-09T02:18:44.636068+0000","last_clean":"2023-07-09T02:18:44.636068+0000","last_became_active":"2023-07-09T02:18:42.622781+0000","last_became_peered":"2023-07-09T02:18:42.622781+0000","last_unstale":"2023-07-09T02:18:44.636068+0000","last_undegraded":"2023-07-09T02:18:44.636068+0000","last_fullsized":"2023-07-09T02:18:44.636068+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:23:09.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633498+0000","last_change":"2023-07-09T02:18:43.647794+0000","last_active":"2023-07-09T02:18:44.633498+0000","last_peered":"2023-07-09T02:18:44.633498+0000","last_clean":"2023-07-09T02:18:44.633498+0000","last_became_active":"2023-07-09T02:18:43.647454+0000","last_became_peered":"2023-07-09T02:18:43.647454+0000","last_unstale":"2023-07-09T02:18:44.633498+0000","last_undegraded":"2023-07-09T02:18:44.633498+0000","last_fullsized":"2023-07-09T02:18:44.633498+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:24:49.757472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633619+0000","last_change":"2023-07-09T02:18:42.623494+0000","last_active":"2023-07-09T02:18:44.633619+0000","last_peered":"2023-07-09T02:18:44.633619+0000","last_clean":"2023-07-09T02:18:44.633619+0000","last_became_active":"2023-07-09T02:18:42.623120+0000","last_became_peered":"2023-07-09T02:18:42.623120+0000","last_unstale":"2023-07-09T02:18:44.633619+0000","last_undegraded":"2023-07-09T02:18:44.633619+0000","last_fullsized":"2023-07-09T02:18:44.633619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:57:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635766+0000","last_change":"2023-07-09T02:18:43.657647+0000","last_active":"2023-07-09T02:18:44.635766+0000","last_peered":"2023-07-09T02:18:44.635766+0000","last_clean":"2023-07-09T02:18:44.635766+0000","last_became_active":"2023-07-09T02:18:43.656958+0000","last_became_peered":"2023-07-09T02:18:43.656958+0000","last_unstale":"2023-07-09T02:18:44.635766+0000","last_undegraded":"2023-07-09T02:18:44.635766+0000","last_fullsized":"2023-07-09T02:18:44.635766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:15:50.287589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406555+0000","last_change":"2023-07-09T02:18:42.622541+0000","last_active":"2023-07-09T02:18:45.406555+0000","last_peered":"2023-07-09T02:18:45.406555+0000","last_clean":"2023-07-09T02:18:45.406555+0000","last_became_active":"2023-07-09T02:18:42.621847+0000","last_became_peered":"2023-07-09T02:18:42.621847+0000","last_unstale":"2023-07-09T02:18:45.406555+0000","last_undegraded":"2023-07-09T02:18:45.406555+0000","last_fullsized":"2023-07-09T02:18:45.406555+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:39:18.985745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006854+0000","last_change":"2023-07-09T02:18:43.656842+0000","last_active":"2023-07-09T02:18:45.006854+0000","last_peered":"2023-07-09T02:18:45.006854+0000","last_clean":"2023-07-09T02:18:45.006854+0000","last_became_active":"2023-07-09T02:18:43.654076+0000","last_became_peered":"2023-07-09T02:18:43.654076+0000","last_unstale":"2023-07-09T02:18:45.006854+0000","last_undegraded":"2023-07-09T02:18:45.006854+0000","last_fullsized":"2023-07-09T02:18:45.006854+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:27:38.809097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635796+0000","last_change":"2023-07-09T02:18:42.624087+0000","last_active":"2023-07-09T02:18:44.635796+0000","last_peered":"2023-07-09T02:18:44.635796+0000","last_clean":"2023-07-09T02:18:44.635796+0000","last_became_active":"2023-07-09T02:18:42.623550+0000","last_became_peered":"2023-07-09T02:18:42.623550+0000","last_unstale":"2023-07-09T02:18:44.635796+0000","last_undegraded":"2023-07-09T02:18:44.635796+0000","last_fullsized":"2023-07-09T02:18:44.635796+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:23:47.400861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":394,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636007+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:18:44.636007+0000","last_peered":"2023-07-09T02:18:44.636007+0000","last_clean":"2023-07-09T02:18:44.636007+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:18:44.636007+0000","last_undegraded":"2023-07-09T02:18:44.636007+0000","last_fullsized":"2023-07-09T02:18:44.636007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:09:43.217974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":274,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406669+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:18:45.406669+0000","last_peered":"2023-07-09T02:18:45.406669+0000","last_clean":"2023-07-09T02:18:45.406669+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:18:45.406669+0000","last_undegraded":"2023-07-09T02:18:45.406669+0000","last_fullsized":"2023-07-09T02:18:45.406669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:10:37.881394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635468+0000","last_change":"2023-07-09T02:18:43.654711+0000","last_active":"2023-07-09T02:18:44.635468+0000","last_peered":"2023-07-09T02:18:44.635468+0000","last_clean":"2023-07-09T02:18:44.635468+0000","last_became_active":"2023-07-09T02:18:43.654405+0000","last_became_peered":"2023-07-09T02:18:43.654405+0000","last_unstale":"2023-07-09T02:18:44.635468+0000","last_undegraded":"2023-07-09T02:18:44.635468+0000","last_fullsized":"2023-07-09T02:18:44.635468+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:22.284058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006845+0000","last_change":"2023-07-09T02:18:42.619966+0000","last_active":"2023-07-09T02:18:45.006845+0000","last_peered":"2023-07-09T02:18:45.006845+0000","last_clean":"2023-07-09T02:18:45.006845+0000","last_became_active":"2023-07-09T02:18:42.619440+0000","last_became_peered":"2023-07-09T02:18:42.619440+0000","last_unstale":"2023-07-09T02:18:45.006845+0000","last_undegraded":"2023-07-09T02:18:45.006845+0000","last_fullsized":"2023-07-09T02:18:45.006845+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:45:44.943677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":240,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635878+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:18:44.635878+0000","last_peered":"2023-07-09T02:18:44.635878+0000","last_clean":"2023-07-09T02:18:44.635878+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:18:44.635878+0000","last_undegraded":"2023-07-09T02:18:44.635878+0000","last_fullsized":"2023-07-09T02:18:44.635878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:35:44.305007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406210+0000","last_change":"2023-07-09T02:18:43.646200+0000","last_active":"2023-07-09T02:18:45.406210+0000","last_peered":"2023-07-09T02:18:45.406210+0000","last_clean":"2023-07-09T02:18:45.406210+0000","last_became_active":"2023-07-09T02:18:43.645783+0000","last_became_peered":"2023-07-09T02:18:43.645783+0000","last_unstale":"2023-07-09T02:18:45.406210+0000","last_undegraded":"2023-07-09T02:18:45.406210+0000","last_fullsized":"2023-07-09T02:18:45.406210+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:55:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"152'8","reported_seq":21,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633353+0000","last_change":"2023-07-09T02:18:42.624390+0000","last_active":"2023-07-09T02:18:44.633353+0000","last_peered":"2023-07-09T02:18:44.633353+0000","last_clean":"2023-07-09T02:18:44.633353+0000","last_became_active":"2023-07-09T02:18:42.624161+0000","last_became_peered":"2023-07-09T02:18:42.624161+0000","last_unstale":"2023-07-09T02:18:44.633353+0000","last_undegraded":"2023-07-09T02:18:44.633353+0000","last_fullsized":"2023-07-09T02:18:44.633353+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:25:26.416065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":242,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406733+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:18:45.406733+0000","last_peered":"2023-07-09T02:18:45.406733+0000","last_clean":"2023-07-09T02:18:45.406733+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:18:45.406733+0000","last_undegraded":"2023-07-09T02:18:45.406733+0000","last_fullsized":"2023-07-09T02:18:45.406733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:48:38.759597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.636352+0000","last_change":"2023-07-09T02:18:43.640518+0000","last_active":"2023-07-09T02:18:44.636352+0000","last_peered":"2023-07-09T02:18:44.636352+0000","last_clean":"2023-07-09T02:18:44.636352+0000","last_became_active":"2023-07-09T02:18:43.640269+0000","last_became_peered":"2023-07-09T02:18:43.640269+0000","last_unstale":"2023-07-09T02:18:44.636352+0000","last_undegraded":"2023-07-09T02:18:44.636352+0000","last_fullsized":"2023-07-09T02:18:44.636352+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:39:03.127911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"152'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406558+0000","last_change":"2023-07-09T02:18:42.615994+0000","last_active":"2023-07-09T02:18:45.406558+0000","last_peered":"2023-07-09T02:18:45.406558+0000","last_clean":"2023-07-09T02:18:45.406558+0000","last_became_active":"2023-07-09T02:18:42.615772+0000","last_became_peered":"2023-07-09T02:18:42.615772+0000","last_unstale":"2023-07-09T02:18:45.406558+0000","last_undegraded":"2023-07-09T02:18:45.406558+0000","last_fullsized":"2023-07-09T02:18:45.406558+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:24:09.794133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":274,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406057+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:18:45.406057+0000","last_peered":"2023-07-09T02:18:45.406057+0000","last_clean":"2023-07-09T02:18:45.406057+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:18:45.406057+0000","last_undegraded":"2023-07-09T02:18:45.406057+0000","last_fullsized":"2023-07-09T02:18:45.406057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:16:32.092596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006834+0000","last_change":"2023-07-09T02:18:43.645260+0000","last_active":"2023-07-09T02:18:45.006834+0000","last_peered":"2023-07-09T02:18:45.006834+0000","last_clean":"2023-07-09T02:18:45.006834+0000","last_became_active":"2023-07-09T02:18:43.644772+0000","last_became_peered":"2023-07-09T02:18:43.644772+0000","last_unstale":"2023-07-09T02:18:45.006834+0000","last_undegraded":"2023-07-09T02:18:45.006834+0000","last_fullsized":"2023-07-09T02:18:45.006834+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:41:01.878744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"152'3","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635628+0000","last_change":"2023-07-09T02:18:42.626292+0000","last_active":"2023-07-09T02:18:44.635628+0000","last_peered":"2023-07-09T02:18:44.635628+0000","last_clean":"2023-07-09T02:18:44.635628+0000","last_became_active":"2023-07-09T02:18:42.626040+0000","last_became_peered":"2023-07-09T02:18:42.626040+0000","last_unstale":"2023-07-09T02:18:44.635628+0000","last_undegraded":"2023-07-09T02:18:44.635628+0000","last_fullsized":"2023-07-09T02:18:44.635628+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:10:59.420992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633846+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:18:44.633846+0000","last_peered":"2023-07-09T02:18:44.633846+0000","last_clean":"2023-07-09T02:18:44.633846+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:18:44.633846+0000","last_undegraded":"2023-07-09T02:18:44.633846+0000","last_fullsized":"2023-07-09T02:18:44.633846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:18:21.054705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.007033+0000","last_change":"2023-07-09T02:18:43.646548+0000","last_active":"2023-07-09T02:18:45.007033+0000","last_peered":"2023-07-09T02:18:45.007033+0000","last_clean":"2023-07-09T02:18:45.007033+0000","last_became_active":"2023-07-09T02:18:43.646315+0000","last_became_peered":"2023-07-09T02:18:43.646315+0000","last_unstale":"2023-07-09T02:18:45.007033+0000","last_undegraded":"2023-07-09T02:18:45.007033+0000","last_fullsized":"2023-07-09T02:18:45.007033+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:43:11.836185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"152'6","reported_seq":19,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635638+0000","last_change":"2023-07-09T02:18:42.625268+0000","last_active":"2023-07-09T02:18:44.635638+0000","last_peered":"2023-07-09T02:18:44.635638+0000","last_clean":"2023-07-09T02:18:44.635638+0000","last_became_active":"2023-07-09T02:18:42.624793+0000","last_became_peered":"2023-07-09T02:18:42.624793+0000","last_unstale":"2023-07-09T02:18:44.635638+0000","last_undegraded":"2023-07-09T02:18:44.635638+0000","last_fullsized":"2023-07-09T02:18:44.635638+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:52:57.484048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":242,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.635744+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:18:44.635744+0000","last_peered":"2023-07-09T02:18:44.635744+0000","last_clean":"2023-07-09T02:18:44.635744+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:18:44.635744+0000","last_undegraded":"2023-07-09T02:18:44.635744+0000","last_fullsized":"2023-07-09T02:18:44.635744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:43:42.458460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406556+0000","last_change":"2023-07-09T02:18:43.656161+0000","last_active":"2023-07-09T02:18:45.406556+0000","last_peered":"2023-07-09T02:18:45.406556+0000","last_clean":"2023-07-09T02:18:45.406556+0000","last_became_active":"2023-07-09T02:18:43.655942+0000","last_became_peered":"2023-07-09T02:18:43.655942+0000","last_unstale":"2023-07-09T02:18:45.406556+0000","last_undegraded":"2023-07-09T02:18:45.406556+0000","last_fullsized":"2023-07-09T02:18:45.406556+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:36:16.261514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.406465+0000","last_change":"2023-07-09T02:18:42.623510+0000","last_active":"2023-07-09T02:18:45.406465+0000","last_peered":"2023-07-09T02:18:45.406465+0000","last_clean":"2023-07-09T02:18:45.406465+0000","last_became_active":"2023-07-09T02:18:42.623283+0000","last_became_peered":"2023-07-09T02:18:42.623283+0000","last_unstale":"2023-07-09T02:18:45.406465+0000","last_undegraded":"2023-07-09T02:18:45.406465+0000","last_fullsized":"2023-07-09T02:18:45.406465+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:59:19.860021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633690+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:18:44.633690+0000","last_peered":"2023-07-09T02:18:44.633690+0000","last_clean":"2023-07-09T02:18:44.633690+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:18:44.633690+0000","last_undegraded":"2023-07-09T02:18:44.633690+0000","last_fullsized":"2023-07-09T02:18:44.633690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:50:22.920908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:44.633351+0000","last_change":"2023-07-09T02:18:43.643252+0000","last_active":"2023-07-09T02:18:44.633351+0000","last_peered":"2023-07-09T02:18:44.633351+0000","last_clean":"2023-07-09T02:18:44.633351+0000","last_became_active":"2023-07-09T02:18:43.642764+0000","last_became_peered":"2023-07-09T02:18:43.642764+0000","last_unstale":"2023-07-09T02:18:44.633351+0000","last_undegraded":"2023-07-09T02:18:44.633351+0000","last_fullsized":"2023-07-09T02:18:44.633351+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:42.606178+0000","last_clean_scrub_stamp":"2023-07-09T02:18:42.606178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:24:47.881909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.407013+0000","last_change":"2023-07-09T02:18:42.617162+0000","last_active":"2023-07-09T02:18:45.407013+0000","last_peered":"2023-07-09T02:18:45.407013+0000","last_clean":"2023-07-09T02:18:45.407013+0000","last_became_active":"2023-07-09T02:18:42.616921+0000","last_became_peered":"2023-07-09T02:18:42.616921+0000","last_unstale":"2023-07-09T02:18:45.407013+0000","last_undegraded":"2023-07-09T02:18:45.407013+0000","last_fullsized":"2023-07-09T02:18:45.407013+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:18:41.597656+0000","last_clean_scrub_stamp":"2023-07-09T02:18:41.597656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:16:38.490187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":240,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-07-09T02:18:45.006914+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:18:45.006914+0000","last_peered":"2023-07-09T02:18:45.006914+0000","last_clean":"2023-07-09T02:18:45.006914+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:18:45.006914+0000","last_undegraded":"2023-07-09T02:18:45.006914+0000","last_fullsized":"2023-07-09T02:18:45.006914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:15:02.945383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1465,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193847,"statfs":{"total":200000000,"available":198499814,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71699999999999997,"15min":0.74199999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91100000000000003,"5min":1.2330000000000001,"15min":1.4950000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.71799999999999997,"15min":0.72499999999999998},"min":{"1min":0.47199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68700000000000006,"15min":0.68000000000000005},"min":{"1min":0.55500000000000005,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.877,"5min":1.1839999999999999,"15min":1.423},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68300000000000005,"15min":0.79500000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93899999999999995,"5min":1.1559999999999999,"15min":29.498999999999999},"last":0.62}]},{"osd":2,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69699999999999995,"15min":0.70299999999999996},"min":{"1min":0.45100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.92100000000000004,"5min":1.0840000000000001,"15min":5.0460000000000003},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.71799999999999997,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.93500000000000005,"5min":1.01,"15min":26.524000000000001},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69999999999999996,"15min":0.68400000000000005},"min":{"1min":0.59499999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.95099999999999996,"5min":0.96699999999999997,"15min":4.3789999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73499999999999999,"15min":0.77500000000000002},"min":{"1min":0.51100000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":1.242,"15min":10.609999999999999},"last":0.64100000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84599999999999997,"5min":0.91100000000000003,"15min":0.91500000000000004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.88700000000000001,"5min":1.032,"15min":1.032},"last":0.75700000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61199999999999999,"15min":0.65600000000000003},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.94899999999999995,"15min":0.94999999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.048,"15min":1.048},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68600000000000005,"15min":0.73299999999999998},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89800000000000002,"5min":1.0009999999999999,"15min":1.087},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.67800000000000005},"min":{"1min":0.45500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":881,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194431,"statfs":{"total":200000000,"available":199097817,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.39700000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90600000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.70699999999999996},"min":{"1min":0.502,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.78800000000000003,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.90200000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69499999999999995,"15min":0.72299999999999998},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.4379999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.72699999999999998},"min":{"1min":0.57999999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":1.165},"last":0.98399999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81899999999999995,"5min":0.90900000000000003,"15min":0.95699999999999996},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.44900000000000001,"5min":0.442,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72699999999999998,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86399999999999999,"5min":1.45,"15min":1.45},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82599999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.79100000000000004}]},{"osd":4,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.86299999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.753},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.52000000000000002,"5min":0.39300000000000002,"15min":0.38800000000000001},"max":{"1min":0.875,"5min":1.117,"15min":1.117},"last":0.97099999999999997}]},{"osd":5,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.63500000000000001},"min":{"1min":0.48499999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84699999999999998,"5min":0.86299999999999999,"15min":0.88200000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.44600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.879,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.44900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92000000000000004,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.54300000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85599999999999998,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":880,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194432,"statfs":{"total":200000000,"available":199098467,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":1.248,"15min":1.248},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.44700000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93700000000000006,"5min":0.98599999999999999,"15min":1.179},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.44,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69199999999999995,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.39800000000000002},"max":{"1min":0.88300000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.751}]},{"osd":2,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":0.81100000000000005,"5min":1.0169999999999999,"15min":1.103},"last":0.874},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86399999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.76300000000000001,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.50600000000000001,"15min":0.47399999999999998},"max":{"1min":0.87,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.96999999999999997,"15min":0.98399999999999999},"last":0.86599999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.314},"max":{"1min":0.82399999999999995,"5min":1.008,"15min":1.008},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90100000000000002,"5min":0.92800000000000005,"15min":1.0720000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90200000000000002,"5min":0.91900000000000004,"15min":1.054},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.67000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90200000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80300000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.1619999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.754},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93400000000000005,"5min":0.999,"15min":1.091},"last":0.89200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":880,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194432,"statfs":{"total":200000000,"available":199098489,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65100000000000002,"15min":0.85199999999999998},"min":{"1min":0.42099999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":50.508000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.83899999999999997,"5min":0.97899999999999998,"15min":0.98999999999999999},"last":0.73199999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.34100000000000003},"max":{"1min":0.79500000000000004,"5min":0.97199999999999998,"15min":8.6039999999999992},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83999999999999997,"5min":0.98199999999999998,"15min":1.4550000000000001},"last":0.76700000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":0.998,"15min":0.998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.502,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.879,"5min":1.008,"15min":1.323},"last":0.86299999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69199999999999995,"15min":0.69399999999999995},"min":{"1min":0.52900000000000003,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.84199999999999997,"5min":0.94299999999999995,"15min":1.0369999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68799999999999994,"15min":0.94999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83699999999999997,"5min":0.95099999999999996,"15min":71.909000000000006},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59699999999999998,"15min":0.63900000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92100000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.89100000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59899999999999998,"15min":0.628},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90300000000000002,"5min":0.93100000000000005,"15min":7.9909999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93899999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90900000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.72599999999999998},"min":{"1min":0.496,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88500000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.40300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":8.0359999999999996},"last":0.78900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":888,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194424,"statfs":{"total":200000000,"available":199090202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.442,"15min":0.42399999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48699999999999999,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":0.87,"15min":1.198},"last":0.46100000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.71599999999999997,"5min":0.80400000000000005,"15min":1.048},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.505,"15min":0.51300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65800000000000003,"5min":0.83999999999999997,"15min":0.85299999999999998},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51000000000000001,"15min":0.52300000000000002},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.76100000000000001,"5min":0.76700000000000002,"15min":1.155},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.1040000000000001},"last":0.439}]},{"osd":4,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.749},"min":{"1min":0.502,"5min":0.501,"15min":0.45300000000000001},"max":{"1min":0.96299999999999997,"5min":1.466,"15min":1.466},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76200000000000001,"15min":0.71199999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93300000000000005,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.86599999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.77300000000000002,"15min":0.72599999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97799999999999998,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.80000000000000004,"15min":0.80900000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0629999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0840000000000001,"5min":1.395,"15min":1.5569999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.367,"15min":1.367},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78500000000000003,"15min":0.76900000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.84099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":880,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194431,"statfs":{"total":200000000,"available":199097873,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.42399999999999999,"15min":0.434},"min":{"1min":0.26300000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.52600000000000002,"5min":0.92100000000000004,"15min":7.7450000000000001},"last":0.433},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.44700000000000001,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.27700000000000002,"15min":0.255},"max":{"1min":0.60699999999999998,"5min":0.67100000000000004,"15min":1.127},"last":0.45100000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.35799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56899999999999995,"5min":0.70099999999999996,"15min":2.8879999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54700000000000004,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":2.0600000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.502},"min":{"1min":0.433,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.66100000000000003,"5min":0.90300000000000002,"15min":1.6879999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64100000000000001,"5min":0.83299999999999996,"15min":7.8710000000000004},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.5,"5min":0.47199999999999998,"15min":0.46500000000000002},"max":{"1min":0.85099999999999998,"5min":1.1220000000000001,"15min":7.7990000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.72599999999999998},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":0.95299999999999996,"5min":1.821,"15min":1.821},"last":0.66600000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74099999999999999,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.496},"max":{"1min":0.95999999999999996,"5min":1.1799999999999999,"15min":1.319},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.91100000000000003,"5min":1.99,"15min":7.8369999999999997},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79400000000000004,"15min":0.76900000000000002},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.85699999999999998,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.80400000000000005},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93400000000000005,"5min":1.226,"15min":1.452},"last":0.629}]},{"osd":7,"last update":"Sun Jul 9 02:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76800000000000002,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97599999999999998,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88500000000000001,"5min":1.1399999999999999,"15min":1.351},"last":0.54300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":886,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194425,"statfs":{"total":200000000,"available":199091766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.63900000000000001,"5min":0.72499999999999998,"15min":0.80300000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48799999999999999,"15min":0.46700000000000003},"min":{"1min":0.36099999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41799999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.59999999999999998,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65900000000000003,"5min":0.96999999999999997,"15min":1.1080000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57399999999999995,"15min":0.55200000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48199999999999998,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.61199999999999999,"5min":0.73999999999999999,"15min":1.163},"last":0.35599999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.74199999999999999,"15min":0.72799999999999998},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.46800000000000003},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79600000000000004,"15min":0.752},"min":{"1min":0.58999999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.73199999999999998},"min":{"1min":0.59999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.032,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.76800000000000002,"15min":0.73299999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.002,"5min":1.034,"15min":1.034},"last":0.75600000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.77700000000000002},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0860000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.78700000000000003},"min":{"1min":0.66000000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.89600000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78700000000000003,"15min":0.76800000000000002},"min":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.55600000000000005},"max":{"1min":1.099,"5min":1.129,"15min":1.3600000000000001},"last":0.78500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1463,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193849,"statfs":{"total":200000000,"available":198501412,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.42699999999999999},"min":{"1min":0.33300000000000002,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.69699999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.47899999999999998},"min":{"1min":0.371,"5min":0.36699999999999999,"15min":0.35199999999999998},"max":{"1min":0.60899999999999999,"5min":1.1180000000000001,"15min":1.3240000000000001},"last":0.42799999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47999999999999998,"15min":0.45800000000000002},"min":{"1min":0.36299999999999999,"5min":0.308,"15min":0.29899999999999999},"max":{"1min":0.64800000000000002,"5min":0.71599999999999997,"15min":0.88900000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48799999999999999,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66600000000000004,"5min":1.161,"15min":1.4139999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46300000000000002,"15min":0.42499999999999999},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.621,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.89200000000000002,"15min":3.8929999999999998},"last":0.48899999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.145},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76900000000000002,"15min":0.77600000000000002},"min":{"1min":0.54400000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.153},"last":0.628}]},{"osd":5,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76600000000000001,"15min":0.79000000000000004},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47199999999999998},"max":{"1min":1.02,"5min":1.401,"15min":1.4350000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.77900000000000003},"min":{"1min":0.57599999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0549999999999999,"5min":1.0860000000000001,"15min":1.238},"last":0.752}]},{"osd":6,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.47799999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.1040000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.57099999999999995,"5min":0.51200000000000001,"15min":0.46899999999999997},"max":{"1min":0.91600000000000004,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0569999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.53100000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.98199999999999998,"5min":1.0629999999999999,"15min":1.1819999999999999},"last":0.70799999999999996}]}]}],"pool_statfs":[]}} 2023-07-09T02:18:48.143 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:18:48.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:18:48.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f822e5d5640 1 Processor -- start 2023-07-09T02:18:48.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f822e5d5640 1 -- start start 2023-07-09T02:18:48.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f822e5d5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f822815c410 0x7f82281608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f822e5d5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280ced10 con 0x7f82280b4cf0 2023-07-09T02:18:48.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f822e5d5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822815c7e0 con 0x7f82280b59b0 2023-07-09T02:18:48.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f822e5d5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82280cd1b0 con 0x7f822815c410 2023-07-09T02:18:48.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f8227fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f822815c410 0x7f82281608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f822cb72640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f82280b4cf0 0x7f82280d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34762/0 (socket says 172.21.15.45:34762) 2023-07-09T02:18:48.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f822cb72640 1 -- 172.21.15.45:0/856029630 learned_addr learned my addr 172.21.15.45:0/856029630 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:48.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f8227fff640 1 -- 172.21.15.45:0/856029630 >> v1:172.21.15.155:6789/0 conn(0x7f82280b59b0 legacy=0x7f82280b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:48.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f8227fff640 1 -- 172.21.15.45:0/856029630 >> v1:172.21.15.45:6789/0 conn(0x7f82280b4cf0 legacy=0x7f82280d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f8227fff640 1 -- 172.21.15.45:0/856029630 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228160de0 con 0x7f822815c410 2023-07-09T02:18:48.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.327+0000 7f8226ffd640 1 -- 172.21.15.45:0/856029630 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372898316 0 0) 0x7f82280ced10 con 0x7f82280b4cf0 2023-07-09T02:18:48.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f8227fff640 1 --2- 172.21.15.45:0/856029630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c410 0x7f82281608a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f82180097f0 tx=0x7f821801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f40f66566dee434 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:48.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f8226ffd640 1 -- 172.21.15.45:0/856029630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180ac640 con 0x7f822815c410 2023-07-09T02:18:48.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f8226ffd640 1 -- 172.21.15.45:0/856029630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82180ac7a0 con 0x7f822815c410 2023-07-09T02:18:48.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f8226ffd640 1 -- 172.21.15.45:0/856029630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180acb30 con 0x7f822815c410 2023-07-09T02:18:48.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f822e5d5640 1 -- 172.21.15.45:0/856029630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c410 msgr2=0x7f82281608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f822e5d5640 1 --2- 172.21.15.45:0/856029630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c410 0x7f82281608a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f82180097f0 tx=0x7f821801c410 comp rx=0 tx=0).stop 2023-07-09T02:18:48.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f822e5d5640 1 -- 172.21.15.45:0/856029630 shutdown_connections 2023-07-09T02:18:48.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f822e5d5640 1 --2- 172.21.15.45:0/856029630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c410 0x7f82281608a0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f822e5d5640 1 -- 172.21.15.45:0/856029630 >> 172.21.15.45:0/856029630 conn(0x7f822806a590 msgr2=0x7f82280cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:48.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f822e5d5640 1 -- 172.21.15.45:0/856029630 shutdown_connections 2023-07-09T02:18:48.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f822e5d5640 1 -- 172.21.15.45:0/856029630 wait complete. 2023-07-09T02:18:48.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.331+0000 7f822e5d5640 1 Processor -- start 2023-07-09T02:18:48.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 -- start start 2023-07-09T02:18:48.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280b4cf0 0x7f8228153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82280b59b0 0x7f822814bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822815c410 0x7f822815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8228153550 con 0x7f82280b4cf0 2023-07-09T02:18:48.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822815bc00 con 0x7f822815c410 2023-07-09T02:18:48.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822814c430 con 0x7f82280b59b0 2023-07-09T02:18:48.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280b4cf0 0x7f8228153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280b4cf0 0x7f8228153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37968/0 (socket says 172.21.15.45:37968) 2023-07-09T02:18:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 -- 172.21.15.45:0/3926871122 learned_addr learned my addr 172.21.15.45:0/3926871122 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f82277fe640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82280b59b0 0x7f822814bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822cb72640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822815c410 0x7f822815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 -- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82280b59b0 msgr2=0x7f822814bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82280b59b0 0x7f822814bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 -- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822815c410 msgr2=0x7f822815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822815c410 0x7f822815aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 -- 172.21.15.45:0/3926871122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009420 con 0x7f82280b4cf0 2023-07-09T02:18:48.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8227fff640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280b4cf0 0x7f8228153970 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f82180af040 tx=0x7f82180191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:48.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8224ff9640 1 -- 172.21.15.45:0/3926871122 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180ac640 con 0x7f82280b4cf0 2023-07-09T02:18:48.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8224ff9640 1 -- 172.21.15.45:0/3926871122 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82180b5840 con 0x7f82280b4cf0 2023-07-09T02:18:48.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f8224ff9640 1 -- 172.21.15.45:0/3926871122 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180b5bf0 con 0x7f82280b4cf0 2023-07-09T02:18:48.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822815b920 con 0x7f82280b4cf0 2023-07-09T02:18:48.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8228153170 con 0x7f82280b4cf0 2023-07-09T02:18:48.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.335+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8228152cf0 con 0x7f82280b4cf0 2023-07-09T02:18:48.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.339+0000 7f8224ff9640 1 -- 172.21.15.45:0/3926871122 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82180b3040 con 0x7f82280b4cf0 2023-07-09T02:18:48.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.339+0000 7f8224ff9640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8214066280 0x7f8214068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.339+0000 7f8224ff9640 1 -- 172.21.15.45:0/3926871122 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f821811e3b0 con 0x7f82280b4cf0 2023-07-09T02:18:48.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.339+0000 7f82277fe640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8214066280 0x7f8214068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.339+0000 7f82277fe640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8214066280 0x7f8214068730 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f822815f970 tx=0x7f821c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:48.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.343+0000 7f8224ff9640 1 -- 172.21.15.45:0/3926871122 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8228152cf0 con 0x7f82280b4cf0 2023-07-09T02:18:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.547+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8228152cf0 con 0x7f82280b4cf0 2023-07-09T02:18:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f8224ff9640 1 -- 172.21.15.45:0/3926871122 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f8228152cf0 con 0x7f82280b4cf0 2023-07-09T02:18:48.557 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:18:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:18:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:18:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:18:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:18:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:18:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8214066280 msgr2=0x7f8214068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8214066280 0x7f8214068730 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f822815f970 tx=0x7f821c008040 comp rx=0 tx=0).stop 2023-07-09T02:18:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280b4cf0 msgr2=0x7f8228153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280b4cf0 0x7f8228153970 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f82180af040 tx=0x7f82180191b0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 shutdown_connections 2023-07-09T02:18:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f822815c410 0x7f822815aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8214066280 0x7f8214068730 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82280b59b0 0x7f822814bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 --2- 172.21.15.45:0/3926871122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280b4cf0 0x7f8228153970 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 >> 172.21.15.45:0/3926871122 conn(0x7f822806a590 msgr2=0x7f82280b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 shutdown_connections 2023-07-09T02:18:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.555+0000 7f822e5d5640 1 -- 172.21.15.45:0/3926871122 wait complete. 2023-07-09T02:18:48.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:48.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ef11640 1 Processor -- start 2023-07-09T02:18:48.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ef11640 1 -- start start 2023-07-09T02:18:48.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ef11640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d480d2620 0x7f0d480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ef11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d480cd120 0x7f0d480cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ef11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d48160a50 con 0x7f0d4815c060 2023-07-09T02:18:48.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ef11640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4815c430 con 0x7f0d480d2620 2023-07-09T02:18:48.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ef11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4815fb60 con 0x7f0d480cd120 2023-07-09T02:18:48.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d47fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d480d2620 0x7f0d480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ccad640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0d4815c060 0x7f0d480d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:36092/0 (socket says 172.21.15.45:36092) 2023-07-09T02:18:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4ccad640 1 -- 172.21.15.45:0/925975537 learned_addr learned my addr 172.21.15.45:0/925975537 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4d4ae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d480cd120 0x7f0d480cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d47fff640 1 -- 172.21.15.45:0/925975537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d480cd120 msgr2=0x7f0d480cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d47fff640 1 --2- 172.21.15.45:0/925975537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d480cd120 0x7f0d480cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d47fff640 1 -- 172.21.15.45:0/925975537 >> v1:172.21.15.155:6789/0 conn(0x7f0d4815c060 legacy=0x7f0d480d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d477fe640 1 -- 172.21.15.45:0/925975537 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974964386 0 0) 0x7f0d48160a50 con 0x7f0d4815c060 2023-07-09T02:18:48.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d47fff640 1 -- 172.21.15.45:0/925975537 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4815fe40 con 0x7f0d480d2620 2023-07-09T02:18:48.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.723+0000 7f0d4d4ae640 1 --2- 172.21.15.45:0/925975537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d480cd120 0x7f0d480cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d47fff640 1 --2- 172.21.15.45:0/925975537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d480d2620 0x7f0d480b4ed0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d340097c0 tx=0x7f0d3401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8a79b0e04cebcd4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:48.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d477fe640 1 -- 172.21.15.45:0/925975537 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340ab650 con 0x7f0d480d2620 2023-07-09T02:18:48.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d477fe640 1 -- 172.21.15.45:0/925975537 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d340ab7b0 con 0x7f0d480d2620 2023-07-09T02:18:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d477fe640 1 -- 172.21.15.45:0/925975537 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340abb40 con 0x7f0d480d2620 2023-07-09T02:18:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d4ef11640 1 -- 172.21.15.45:0/925975537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d480d2620 msgr2=0x7f0d480b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/925975537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d480d2620 0x7f0d480b4ed0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d340097c0 tx=0x7f0d3401c450 comp rx=0 tx=0).stop 2023-07-09T02:18:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d4ef11640 1 -- 172.21.15.45:0/925975537 shutdown_connections 2023-07-09T02:18:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/925975537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d480cd120 0x7f0d480cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/925975537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d480d2620 0x7f0d480b4ed0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d4ef11640 1 -- 172.21.15.45:0/925975537 >> 172.21.15.45:0/925975537 conn(0x7f0d480698e0 msgr2=0x7f0d48069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:48.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d4ef11640 1 -- 172.21.15.45:0/925975537 shutdown_connections 2023-07-09T02:18:48.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.727+0000 7f0d4ef11640 1 -- 172.21.15.45:0/925975537 wait complete. 2023-07-09T02:18:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 Processor -- start 2023-07-09T02:18:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 -- start start 2023-07-09T02:18:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd120 0x7f0d480c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d480d2620 0x7f0d4815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d4815c060 0x7f0d480b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4815cfc0 con 0x7f0d480cd120 2023-07-09T02:18:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4815d2a0 con 0x7f0d480d2620 2023-07-09T02:18:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4815d580 con 0x7f0d4815c060 2023-07-09T02:18:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd120 0x7f0d480c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd120 0x7f0d480c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37978/0 (socket says 172.21.15.45:37978) 2023-07-09T02:18:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 -- 172.21.15.45:0/2351287787 learned_addr learned my addr 172.21.15.45:0/2351287787 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 -- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d4815c060 msgr2=0x7f0d480b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d4815c060 0x7f0d480b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 -- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d480d2620 msgr2=0x7f0d4815c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d480d2620 0x7f0d4815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 -- 172.21.15.45:0/2351287787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40009a70 con 0x7f0d480cd120 2023-07-09T02:18:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ccad640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd120 0x7f0d480c8b50 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00c480 tx=0x7f0d3c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d457fa640 1 -- 172.21.15.45:0/2351287787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0074e0 con 0x7f0d480cd120 2023-07-09T02:18:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d457fa640 1 -- 172.21.15.45:0/2351287787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c007660 con 0x7f0d480cd120 2023-07-09T02:18:48.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d34009420 con 0x7f0d480cd120 2023-07-09T02:18:48.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d457fa640 1 -- 172.21.15.45:0/2351287787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c004a30 con 0x7f0d480cd120 2023-07-09T02:18:48.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.731+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d480b59f0 con 0x7f0d480cd120 2023-07-09T02:18:48.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.735+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4804d7d0 con 0x7f0d480cd120 2023-07-09T02:18:48.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.735+0000 7f0d457fa640 1 -- 172.21.15.45:0/2351287787 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d3c004b90 con 0x7f0d480cd120 2023-07-09T02:18:48.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.735+0000 7f0d457fa640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d2c066280 0x7f0d2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:48.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.735+0000 7f0d457fa640 1 -- 172.21.15.45:0/2351287787 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d3c083230 con 0x7f0d480cd120 2023-07-09T02:18:48.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.735+0000 7f0d47fff640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d2c066280 0x7f0d2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:48.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.735+0000 7f0d47fff640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d2c066280 0x7f0d2c068730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0d340af000 tx=0x7f0d34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:48.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.739+0000 7f0d457fa640 1 -- 172.21.15.45:0/2351287787 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d3c054130 con 0x7f0d480cd120 2023-07-09T02:18:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.927+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d4806baa0 con 0x7f0d480cd120 2023-07-09T02:18:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.927+0000 7f0d457fa640 1 -- 172.21.15.45:0/2351287787 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f0d3c053cc0 con 0x7f0d480cd120 2023-07-09T02:18:48.931 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:48.931 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1878423144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1878423144},{"type":"v1","addr":"172.21.15.155:6836","nonce":1878423144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":8259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1407467413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1407467413},{"type":"v1","addr":"172.21.15.45:6833","nonce":1407467413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2772552547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2772552547},{"type":"v1","addr":"172.21.15.45:6835","nonce":2772552547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:18:43.005298+0000","modified":"2023-07-09T02:18:46.662099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8274":{"gid":8274,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3076932418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3076932418},{"type":"v1","addr":"172.21.15.155:6837","nonce":3076932418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T02:18:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 75 2023-07-09T02:18:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d2c066280 msgr2=0x7f0d2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d2c066280 0x7f0d2c068730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0d340af000 tx=0x7f0d34008040 comp rx=0 tx=0).stop 2023-07-09T02:18:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd120 msgr2=0x7f0d480c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd120 0x7f0d480c8b50 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00c480 tx=0x7f0d3c00c940 comp rx=0 tx=0).stop 2023-07-09T02:18:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 shutdown_connections 2023-07-09T02:18:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d2c066280 0x7f0d2c068730 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d4815c060 0x7f0d480b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d480d2620 0x7f0d4815c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 --2- 172.21.15.45:0/2351287787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd120 0x7f0d480c8b50 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 >> 172.21.15.45:0/2351287787 conn(0x7f0d480698e0 msgr2=0x7f0d480b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 shutdown_connections 2023-07-09T02:18:48.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:48.931+0000 7f0d4ef11640 1 -- 172.21.15.45:0/2351287787 wait complete. 2023-07-09T02:18:49.208 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:18:49.213 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:18:49.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:18:43.005298+0000', 'modified': '2023-07-09T02:18:46.662099+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8274}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8274': {'gid': 8274, 'name': 'd', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6837/3076932418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6835', 'nonce': 3076932418}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 3076932418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:18:49.354 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:18:49.354 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-09T02:18:49.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff16c174640 1 Processor -- start 2023-07-09T02:18:49.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff16c174640 1 -- start start 2023-07-09T02:18:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff16c174640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415c060 0x7ff1640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff16c174640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff164160a50 con 0x7ff1640cd120 2023-07-09T02:18:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff16c174640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16415c430 con 0x7ff1640d2620 2023-07-09T02:18:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff16c174640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16415fb60 con 0x7ff16415c060 2023-07-09T02:18:49.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff16970f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1640cd120 0x7ff1640d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34778/0 (socket says 172.21.15.45:34778) 2023-07-09T02:18:49.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff16970f640 1 -- 172.21.15.45:0/3867516979 learned_addr learned my addr 172.21.15.45:0/3867516979 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff169f10640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415c060 0x7ff1640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861904603 0 0) 0x7ff164160a50 con 0x7ff1640cd120 2023-07-09T02:18:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff150003530 con 0x7ff1640cd120 2023-07-09T02:18:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683528363 0 0) 0x7ff16415c430 con 0x7ff1640d2620 2023-07-09T02:18:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff164160a50 con 0x7ff1640d2620 2023-07-09T02:18:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 526175858 0 0) 0x7ff150003530 con 0x7ff1640cd120 2023-07-09T02:18:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415c060 msgr2=0x7ff1640b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415c060 0x7ff1640b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 >> v1:172.21.15.155:6789/0 conn(0x7ff1640d2620 legacy=0x7ff1640cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16415fe40 con 0x7ff1640cd120 2023-07-09T02:18:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7ff154001680 con 0x7ff1640cd120 2023-07-09T02:18:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 >> v1:172.21.15.45:6789/0 conn(0x7ff1640cd120 legacy=0x7ff1640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.499+0000 7ff168f0e640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff150003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff168f0e640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1500047d0 0x7ff150004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff168f0e640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff150005180 0x7ff15000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16415fb60 con 0x7ff150003b40 2023-07-09T02:18:49.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15000bf50 con 0x7ff1500047d0 2023-07-09T02:18:49.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15000c110 con 0x7ff150005180 2023-07-09T02:18:49.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff169f10640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415c060 0x7ff1640b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:18:49.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff169f10640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff150003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff16970f640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1500047d0 0x7ff150004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff16a711640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff150005180 0x7ff15000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff169f10640 1 -- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff150005180 msgr2=0x7ff15000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff169f10640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff150005180 0x7ff15000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff169f10640 1 -- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1500047d0 msgr2=0x7ff150004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff169f10640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1500047d0 0x7ff150004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff169f10640 1 -- 172.21.15.45:0/3867516979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff150003530 con 0x7ff150003b40 2023-07-09T02:18:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff169f10640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff150003f30 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff1640d3a50 tx=0x7ff16001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54d08dab3cf1568 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600a7070 con 0x7ff150003b40 2023-07-09T02:18:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160004030 con 0x7ff150003b40 2023-07-09T02:18:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.503+0000 7ff168f0e640 1 -- 172.21.15.45:0/3867516979 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600041c0 con 0x7ff150003b40 2023-07-09T02:18:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- 172.21.15.45:0/3867516979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 msgr2=0x7ff150003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 --2- 172.21.15.45:0/3867516979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff150003f30 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff1640d3a50 tx=0x7ff16001c9c0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16a711640 1 -- 172.21.15.45:0/3867516979 reap_dead start 2023-07-09T02:18:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- 172.21.15.45:0/3867516979 shutdown_connections 2023-07-09T02:18:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- 172.21.15.45:0/3867516979 >> 172.21.15.45:0/3867516979 conn(0x7ff1640698e0 msgr2=0x7ff164069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- 172.21.15.45:0/3867516979 shutdown_connections 2023-07-09T02:18:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- 172.21.15.45:0/3867516979 wait complete. 2023-07-09T02:18:49.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 Processor -- start 2023-07-09T02:18:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- start start 2023-07-09T02:18:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff1641f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16414e3e0 0x7ff16414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415d900 0x7ff16415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff164149340 con 0x7ff150003b40 2023-07-09T02:18:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff164148a30 con 0x7ff16414e3e0 2023-07-09T02:18:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16c174640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16414bf20 con 0x7ff16415d900 2023-07-09T02:18:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff169f10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff1641f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff169f10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff1641f8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37998/0 (socket says 172.21.15.45:37998) 2023-07-09T02:18:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff169f10640 1 -- 172.21.15.45:0/1455943935 learned_addr learned my addr 172.21.15.45:0/1455943935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16970f640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16414e3e0 0x7ff16414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.507+0000 7ff16a711640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415d900 0x7ff16415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff169f10640 1 -- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415d900 msgr2=0x7ff16415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff169f10640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415d900 0x7ff16415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff169f10640 1 -- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16414e3e0 msgr2=0x7ff16414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff169f10640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16414e3e0 0x7ff16414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff169f10640 1 -- 172.21.15.45:0/1455943935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16415e6b0 con 0x7ff150003b40 2023-07-09T02:18:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff169f10640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff1641f8420 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff1600ae040 tx=0x7ff150005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff15a7fc640 1 -- 172.21.15.45:0/1455943935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600039a0 con 0x7ff150003b40 2023-07-09T02:18:49.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff15a7fc640 1 -- 172.21.15.45:0/1455943935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160003b00 con 0x7ff150003b40 2023-07-09T02:18:49.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff15a7fc640 1 -- 172.21.15.45:0/1455943935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160003e90 con 0x7ff150003b40 2023-07-09T02:18:49.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff16c174640 1 -- 172.21.15.45:0/1455943935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff164148c80 con 0x7ff150003b40 2023-07-09T02:18:49.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff16c174640 1 -- 172.21.15.45:0/1455943935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16414ed90 con 0x7ff150003b40 2023-07-09T02:18:49.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.511+0000 7ff15a7fc640 1 -- 172.21.15.45:0/1455943935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1600b5440 con 0x7ff150003b40 2023-07-09T02:18:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff15a7fc640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff148066280 0x7ff148068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff15a7fc640 1 -- 172.21.15.45:0/1455943935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff16011d090 con 0x7ff150003b40 2023-07-09T02:18:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16970f640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff148066280 0x7ff148068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 Processor -- start 2023-07-09T02:18:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- start start 2023-07-09T02:18:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16970f640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff148066280 0x7ff148068730 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff1640cd0f0 tx=0x7ff154001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd7800 0x56332fbd7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd8110 0x56332fb8da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fb8e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332fa54f80 con 0x56332fb8df90 2023-07-09T02:18:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332f98ec60 con 0x56332fbd8110 2023-07-09T02:18:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332f9e2700 con 0x56332fbd7800 2023-07-09T02:18:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fb8e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fb8e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38006/0 (socket says 172.21.15.45:38006) 2023-07-09T02:18:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 -- 172.21.15.45:0/134610621 learned_addr learned my addr 172.21.15.45:0/134610621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 -- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd7800 msgr2=0x56332fbd7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff169f10640 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd7800 0x56332fbd7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16970f640 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd8110 0x56332fb8da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd7800 0x56332fbd7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 -- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd8110 msgr2=0x56332fb8da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd8110 0x56332fb8da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 -- 172.21.15.45:0/134610621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56332f6d7890 con 0x56332fb8df90 2023-07-09T02:18:49.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16970f640 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd8110 0x56332fb8da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:49.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff169f10640 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd7800 0x56332fbd7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:18:49.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16a711640 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fb8e360 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7ff16408bcc0 tx=0x7ff15c001ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bb5d0870c6f940 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff1477fe640 1 -- 172.21.15.45:0/134610621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c01a070 con 0x56332fb8df90 2023-07-09T02:18:49.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff1477fe640 1 -- 172.21.15.45:0/134610621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c003b90 con 0x56332fb8df90 2023-07-09T02:18:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff1477fe640 1 -- 172.21.15.45:0/134610621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c003d40 con 0x56332fb8df90 2023-07-09T02:18:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- 172.21.15.45:0/134610621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 msgr2=0x56332fb8e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fb8e360 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7ff16408bcc0 tx=0x7ff15c001ea0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- 172.21.15.45:0/134610621 shutdown_connections 2023-07-09T02:18:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fb8e360 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd8110 0x56332fb8da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/134610621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd7800 0x56332fbd7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- 172.21.15.45:0/134610621 >> 172.21.15.45:0/134610621 conn(0x56332fa50a70 msgr2=0x56332fb8c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- 172.21.15.45:0/134610621 shutdown_connections 2023-07-09T02:18:49.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.515+0000 7ff16f4ef000 1 -- 172.21.15.45:0/134610621 wait complete. 2023-07-09T02:18:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 -- start start 2023-07-09T02:18:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 Processor -- start 2023-07-09T02:18:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fb8df90 0x56332fb98fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fb99510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd8110 0x56332fb99a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332f9db7a0 con 0x56332fbd8110 2023-07-09T02:18:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332f997f00 con 0x56332fbd7800 2023-07-09T02:18:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332f997ba0 con 0x56332fb8df90 2023-07-09T02:18:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 10 client.0 _ll_register_callbacks cb 0x56332fb79930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:18:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd8110 0x56332fb99a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd8110 0x56332fb99a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38016/0 (socket says 172.21.15.45:38016) 2023-07-09T02:18:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 -- 172.21.15.45:0/4023422063 learned_addr learned my addr 172.21.15.45:0/4023422063 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff169f10640 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fb8df90 0x56332fb98fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16970f640 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fb99510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 -- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fb8df90 msgr2=0x56332fb98fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fb8df90 0x56332fb98fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 -- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 msgr2=0x56332fb99510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fb99510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 -- 172.21.15.45:0/4023422063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff164160a50 con 0x56332fbd8110 2023-07-09T02:18:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16970f640 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fb99510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16a711640 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd8110 0x56332fb99a50 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x56332f9cd1d0 tx=0x7ff15c001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991269feab928945 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff144ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:18:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff144ff9640 1 -- 172.21.15.45:0/4023422063 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c01a070 con 0x56332fbd8110 2023-07-09T02:18:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff144ff9640 1 -- 172.21.15.45:0/4023422063 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff15c006e30 con 0x56332fbd8110 2023-07-09T02:18:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4023422063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56332f9da0f0 con 0x56332fbd8110 2023-07-09T02:18:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff144ff9640 1 -- 172.21.15.45:0/4023422063 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff15c0056b0 con 0x56332fbd8110 2023-07-09T02:18:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 10 client.8409 fetch_fsmap learned FSMap version 75 2023-07-09T02:18:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4023422063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x56332f9a0130 con 0x56332fbd8110 2023-07-09T02:18:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff144ff9640 1 -- 172.21.15.45:0/4023422063 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56332f9da0f0 con 0x56332fbd8110 2023-07-09T02:18:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff144ff9640 1 -- 172.21.15.45:0/4023422063 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 75) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff15c012070 con 0x56332fbd8110 2023-07-09T02:18:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 10 client.8409 fetch_fsmap finished waiting for FSMap version 75 2023-07-09T02:18:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 10 client.8409 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T02:18:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 20 client.8409 populate_metadata read hostname 'smithi045' 2023-07-09T02:18:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] conn(0x56332fb9a320 0x56332fbe8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 4 client.8409 mds_command: new command op to 8274 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:18:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.519+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4023422063 --> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56332f9a2e40 con 0x56332fb9a320 2023-07-09T02:18:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff169f10640 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] conn(0x56332fb9a320 0x56332fbe8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff169f10640 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] conn(0x56332fb9a320 0x56332fbe8d50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3f0fbebd4966294 server_cookie=c4f88af89ef8afdd in_seq=0 out_seq=0 2023-07-09T02:18:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff144ff9640 10 client.8409 ms_handle_connect on v2:172.21.15.155:6835/3076932418 2023-07-09T02:18:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff144ff9640 1 -- 172.21.15.45:0/4023422063 <== mds.0 v2:172.21.15.155:6835/3076932418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56332f9a2e40 con 0x56332fb9a320 2023-07-09T02:18:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff144ff9640 10 client.8409 handle_command_reply: tid=0 2023-07-09T02:18:49.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 client.8409 shutdown 2023-07-09T02:18:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4023422063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd8110 msgr2=0x56332fb99a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd8110 0x56332fb99a50 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x56332f9cd1d0 tx=0x7ff15c001660 comp rx=0 tx=0).stop 2023-07-09T02:18:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4023422063 shutdown_connections 2023-07-09T02:18:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] conn(0x56332fb9a320 0x56332fbe8d50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd8110 0x56332fb99a50 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fb99510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4023422063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fb8df90 0x56332fb98fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff144ff9640 0 client.8409 ms_handle_reset on v2:172.21.15.155:6835/3076932418 2023-07-09T02:18:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4023422063 >> 172.21.15.45:0/4023422063 conn(0x56332fa50a70 msgr2=0x56332fb8ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4023422063 shutdown_connections 2023-07-09T02:18:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4023422063 wait complete. 2023-07-09T02:18:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.523+0000 7ff16f4ef000 20 client.8409 trim_cache size 0 max 16384 2023-07-09T02:18:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16f4ef000 1 Processor -- start 2023-07-09T02:18:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16f4ef000 1 -- start start 2023-07-09T02:18:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fb8df90 0x56332fbea470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd7800 0x56332fbea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 0x56332fbd28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332f698940 con 0x56332fbd7800 2023-07-09T02:18:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332f9aa740 con 0x56332fb8df90 2023-07-09T02:18:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332fb857a0 con 0x56332fbd8110 2023-07-09T02:18:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd7800 0x56332fbea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd7800 0x56332fbea9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38018/0 (socket says 172.21.15.45:38018) 2023-07-09T02:18:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 -- 172.21.15.45:0/4188630397 learned_addr learned my addr 172.21.15.45:0/4188630397 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 -- 172.21.15.45:0/4188630397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 msgr2=0x56332fbd28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 --2- 172.21.15.45:0/4188630397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 0x56332fbd28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 -- 172.21.15.45:0/4188630397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fb8df90 msgr2=0x56332fbea470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 --2- 172.21.15.45:0/4188630397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fb8df90 0x56332fbea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 -- 172.21.15.45:0/4188630397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56332f9863c0 con 0x56332fbd7800 2023-07-09T02:18:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff16970f640 1 --2- 172.21.15.45:0/4188630397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd7800 0x56332fbea9b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7ff154005f80 tx=0x7ff15400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30321f9a14a9a540 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff147fff640 1 -- 172.21.15.45:0/4188630397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15401a040 con 0x56332fbd7800 2023-07-09T02:18:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff147fff640 1 -- 172.21.15.45:0/4188630397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154007e90 con 0x56332fbd7800 2023-07-09T02:18:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.539+0000 7ff147fff640 1 -- 172.21.15.45:0/4188630397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154015b50 con 0x56332fbd7800 2023-07-09T02:18:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4188630397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd7800 msgr2=0x56332fbea9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4188630397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd7800 0x56332fbea9b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7ff154005f80 tx=0x7ff15400c000 comp rx=0 tx=0).stop 2023-07-09T02:18:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4188630397 shutdown_connections 2023-07-09T02:18:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4188630397 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 0x56332fbd28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4188630397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fbd7800 0x56332fbea9b0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/4188630397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fb8df90 0x56332fbea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4188630397 >> 172.21.15.45:0/4188630397 conn(0x56332fa50a70 msgr2=0x56332fbe8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4188630397 shutdown_connections 2023-07-09T02:18:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- 172.21.15.45:0/4188630397 wait complete. 2023-07-09T02:18:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- start start 2023-07-09T02:18:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 Processor -- start 2023-07-09T02:18:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fc34ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fc35530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 0x56332fbd5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332fb924c0 con 0x56332fb8df90 2023-07-09T02:18:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332f9aa230 con 0x56332fbd7800 2023-07-09T02:18:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x56332fa7ba50 con 0x56332fbd8110 2023-07-09T02:18:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 10 client.0 _ll_register_callbacks cb 0x56332fb5a4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:18:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fc34ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fc34ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38024/0 (socket says 172.21.15.45:38024) 2023-07-09T02:18:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 -- 172.21.15.45:0/1907372901 learned_addr learned my addr 172.21.15.45:0/1907372901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16970f640 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fc35530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16a711640 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 0x56332fbd5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 -- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 msgr2=0x56332fbd5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 0x56332fbd5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 -- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 msgr2=0x56332fc35530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fc35530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 -- 172.21.15.45:0/1907372901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16415fe40 con 0x56332fb8df90 2023-07-09T02:18:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16970f640 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fc35530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff169f10640 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fc34ff0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7ff1600ede30 tx=0x7ff1600edf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e34307f6fecc50 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff144ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:18:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff144ff9640 1 -- 172.21.15.45:0/1907372901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600ed820 con 0x56332fb8df90 2023-07-09T02:18:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff144ff9640 1 -- 172.21.15.45:0/1907372901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1600098b0 con 0x56332fb8df90 2023-07-09T02:18:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- 172.21.15.45:0/1907372901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56332fb91920 con 0x56332fb8df90 2023-07-09T02:18:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff144ff9640 1 -- 172.21.15.45:0/1907372901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1600f5ff0 con 0x56332fb8df90 2023-07-09T02:18:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 10 client.8415 fetch_fsmap learned FSMap version 75 2023-07-09T02:18:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- 172.21.15.45:0/1907372901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x56332f6d7cc0 con 0x56332fb8df90 2023-07-09T02:18:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff144ff9640 1 -- 172.21.15.45:0/1907372901 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56332fb91920 con 0x56332fb8df90 2023-07-09T02:18:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff144ff9640 1 -- 172.21.15.45:0/1907372901 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 75) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff1600e9f20 con 0x56332fb8df90 2023-07-09T02:18:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 10 client.8415 fetch_fsmap finished waiting for FSMap version 75 2023-07-09T02:18:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 10 client.8415 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T02:18:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 20 client.8415 populate_metadata read hostname 'smithi045' 2023-07-09T02:18:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] conn(0x56332fbd5ed0 0x56332fbd62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 4 client.8415 mds_command: new command op to 8274 tid=0[{"prefix": "status"}] 2023-07-09T02:18:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.543+0000 7ff16f4ef000 1 -- 172.21.15.45:0/1907372901 --> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56332f9946f0 con 0x56332fbd5ed0 2023-07-09T02:18:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16970f640 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] conn(0x56332fbd5ed0 0x56332fbd62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff144ff9640 10 client.8415 ms_handle_connect on v2:172.21.15.155:6835/3076932418 2023-07-09T02:18:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16970f640 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] conn(0x56332fbd5ed0 0x56332fbd62a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f0aed08d09ef1f server_cookie=b41bb06dbb4c0fbc in_seq=0 out_seq=0 2023-07-09T02:18:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff144ff9640 1 -- 172.21.15.45:0/1907372901 <== mds.0 v2:172.21.15.155:6835/3076932418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x56332f9946f0 con 0x56332fbd5ed0 2023-07-09T02:18:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff144ff9640 10 client.8415 handle_command_reply: tid=0 2023-07-09T02:18:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 client.8415 shutdown 2023-07-09T02:18:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 -- 172.21.15.45:0/1907372901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 msgr2=0x56332fc34ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fc34ff0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7ff1600ede30 tx=0x7ff1600edf00 comp rx=0 tx=0).stop 2023-07-09T02:18:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 -- 172.21.15.45:0/1907372901 shutdown_connections 2023-07-09T02:18:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:6835/3076932418,v1:172.21.15.155:6837/3076932418] conn(0x56332fbd5ed0 0x56332fbd62a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56332fbd8110 0x56332fbd5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56332fbd7800 0x56332fc35530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff144ff9640 0 client.8415 ms_handle_reset on v2:172.21.15.155:6835/3076932418 2023-07-09T02:18:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 --2- 172.21.15.45:0/1907372901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56332fb8df90 0x56332fc34ff0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 -- 172.21.15.45:0/1907372901 >> 172.21.15.45:0/1907372901 conn(0x56332fa50a70 msgr2=0x56332fbe8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 -- 172.21.15.45:0/1907372901 shutdown_connections 2023-07-09T02:18:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 1 -- 172.21.15.45:0/1907372901 wait complete. 2023-07-09T02:18:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16f4ef000 20 client.8415 trim_cache size 0 max 16384 2023-07-09T02:18:49.557 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:18:49.557 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:18:49.557 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:18:49.557 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 8274, 2023-07-09T02:18:49.557 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:18:49.557 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:18:49.558 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:18:49.558 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9205530810000004, 2023-07-09T02:18:49.558 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 75, 2023-07-09T02:18:49.558 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 153, 2023-07-09T02:18:49.558 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 153, 2023-07-09T02:18:49.558 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.854556046000001 2023-07-09T02:18:49.558 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:18:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 -- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff148066280 msgr2=0x7ff148068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff148066280 0x7ff148068730 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff1640cd0f0 tx=0x7ff154001e30 comp rx=0 tx=0).stop 2023-07-09T02:18:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 -- 172.21.15.45:0/1455943935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 msgr2=0x7ff1641f8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff1641f8420 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff1600ae040 tx=0x7ff150005800 comp rx=0 tx=0).stop 2023-07-09T02:18:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 -- 172.21.15.45:0/1455943935 shutdown_connections 2023-07-09T02:18:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff148066280 0x7ff148068730 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff16415d900 0x7ff16415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16414e3e0 0x7ff16414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 --2- 172.21.15.45:0/1455943935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff150003b40 0x7ff1641f8420 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 -- 172.21.15.45:0/1455943935 >> 172.21.15.45:0/1455943935 conn(0x7ff1640698e0 msgr2=0x7ff1640b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 -- 172.21.15.45:0/1455943935 shutdown_connections 2023-07-09T02:18:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.547+0000 7ff16c174640 1 -- 172.21.15.45:0/1455943935 wait complete. 2023-07-09T02:18:49.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:18:49.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.711+0000 7fe662456640 1 Processor -- start 2023-07-09T02:18:49.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.711+0000 7fe662456640 1 -- start start 2023-07-09T02:18:49.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe662456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c0cd290 0x7fe65c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe662456640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe65c06aa10 0x7fe65c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe662456640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c071140 con 0x7fe65c06a5c0 2023-07-09T02:18:49.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe662456640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c06b010 con 0x7fe65c06aa10 2023-07-09T02:18:49.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe662456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0cdba0 con 0x7fe65c0cd290 2023-07-09T02:18:49.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c0cd290 0x7fe65c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe6609f3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe65c06aa10 0x7fe65c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65b7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe65c06a5c0 0x7fe65c0b2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:36122/0 (socket says 172.21.15.45:36122) 2023-07-09T02:18:49.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65b7fe640 1 -- 172.21.15.45:0/3460564103 learned_addr learned my addr 172.21.15.45:0/3460564103 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:49.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65affd640 1 -- 172.21.15.45:0/3460564103 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268268256 0 0) 0x7fe65c071140 con 0x7fe65c06a5c0 2023-07-09T02:18:49.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65affd640 1 -- 172.21.15.45:0/3460564103 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe644003530 con 0x7fe65c06a5c0 2023-07-09T02:18:49.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65bfff640 1 -- 172.21.15.45:0/3460564103 >> v2:172.21.15.155:3300/0 conn(0x7fe65c06aa10 msgr2=0x7fe65c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:49.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65bfff640 1 --2- 172.21.15.45:0/3460564103 >> v2:172.21.15.155:3300/0 conn(0x7fe65c06aa10 0x7fe65c0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65bfff640 1 -- 172.21.15.45:0/3460564103 >> v1:172.21.15.155:6789/0 conn(0x7fe65c06a5c0 legacy=0x7fe65c0b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.715+0000 7fe65bfff640 1 -- 172.21.15.45:0/3460564103 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c15c970 con 0x7fe65c0cd290 2023-07-09T02:18:49.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe65bfff640 1 --2- 172.21.15.45:0/3460564103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c0cd290 0x7fe65c0cd660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097c0 tx=0x7fe64c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde301d1cd9070cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe65affd640 1 -- 172.21.15.45:0/3460564103 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0ab600 con 0x7fe65c0cd290 2023-07-09T02:18:49.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe65affd640 1 -- 172.21.15.45:0/3460564103 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c0a7050 con 0x7fe65c0cd290 2023-07-09T02:18:49.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe65affd640 1 -- 172.21.15.45:0/3460564103 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0ab980 con 0x7fe65c0cd290 2023-07-09T02:18:49.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 -- 172.21.15.45:0/3460564103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c0cd290 msgr2=0x7fe65c0cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 --2- 172.21.15.45:0/3460564103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c0cd290 0x7fe65c0cd660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097c0 tx=0x7fe64c01c480 comp rx=0 tx=0).stop 2023-07-09T02:18:49.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 -- 172.21.15.45:0/3460564103 shutdown_connections 2023-07-09T02:18:49.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 --2- 172.21.15.45:0/3460564103 >> v2:172.21.15.155:3300/0 conn(0x7fe65c06aa10 0x7fe65c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 --2- 172.21.15.45:0/3460564103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c0cd290 0x7fe65c0cd660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 -- 172.21.15.45:0/3460564103 >> 172.21.15.45:0/3460564103 conn(0x7fe65c06d140 msgr2=0x7fe65c06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:49.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 -- 172.21.15.45:0/3460564103 shutdown_connections 2023-07-09T02:18:49.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 -- 172.21.15.45:0/3460564103 wait complete. 2023-07-09T02:18:49.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 Processor -- start 2023-07-09T02:18:49.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.719+0000 7fe662456640 1 -- start start 2023-07-09T02:18:49.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe65c06a5c0 0x7fe65c1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c06aa10 0x7fe65c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe65c0cd290 0x7fe65c14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c153470 con 0x7fe65c06a5c0 2023-07-09T02:18:49.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c153710 con 0x7fe65c0cd290 2023-07-09T02:18:49.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c1539f0 con 0x7fe65c06aa10 2023-07-09T02:18:49.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe65c06a5c0 0x7fe65c1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe65c06a5c0 0x7fe65c1541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38028/0 (socket says 172.21.15.45:38028) 2023-07-09T02:18:49.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 -- 172.21.15.45:0/1625785113 learned_addr learned my addr 172.21.15.45:0/1625785113 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:49.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65b7fe640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c06aa10 0x7fe65c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe6609f3640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe65c0cd290 0x7fe65c14bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 -- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c06aa10 msgr2=0x7fe65c147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c06aa10 0x7fe65c147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 -- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe65c0cd290 msgr2=0x7fe65c14bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe65c0cd290 0x7fe65c14bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 -- 172.21.15.45:0/1625785113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c009420 con 0x7fe65c06a5c0 2023-07-09T02:18:49.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe65bfff640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe65c06a5c0 0x7fe65c1541f0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fe64c01ab30 tx=0x7fe64c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe658ff9640 1 -- 172.21.15.45:0/1625785113 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0b5470 con 0x7fe65c06a5c0 2023-07-09T02:18:49.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe658ff9640 1 -- 172.21.15.45:0/1625785113 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c0b55f0 con 0x7fe65c06a5c0 2023-07-09T02:18:49.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c153cd0 con 0x7fe65c06a5c0 2023-07-09T02:18:49.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe658ff9640 1 -- 172.21.15.45:0/1625785113 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0b59a0 con 0x7fe65c06a5c0 2023-07-09T02:18:49.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c1480f0 con 0x7fe65c06a5c0 2023-07-09T02:18:49.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.723+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c153b30 con 0x7fe65c06a5c0 2023-07-09T02:18:49.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.727+0000 7fe658ff9640 1 -- 172.21.15.45:0/1625785113 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe64c0b2040 con 0x7fe65c06a5c0 2023-07-09T02:18:49.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.727+0000 7fe658ff9640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe648066280 0x7fe648068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:49.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.727+0000 7fe658ff9640 1 -- 172.21.15.45:0/1625785113 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe64c11e860 con 0x7fe65c06a5c0 2023-07-09T02:18:49.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.727+0000 7fe65b7fe640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe648066280 0x7fe648068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:49.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.727+0000 7fe65b7fe640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe648066280 0x7fe648068730 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0afc80 tx=0x7fe650007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:49.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.731+0000 7fe658ff9640 1 -- 172.21.15.45:0/1625785113 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe64c0ebe90 con 0x7fe65c06a5c0 2023-07-09T02:18:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe65c153b30 con 0x7fe65c06a5c0 2023-07-09T02:18:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe658ff9640 1 -- 172.21.15.45:0/1625785113 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe65c153b30 con 0x7fe65c06a5c0 2023-07-09T02:18:49.917 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:18:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe648066280 msgr2=0x7fe648068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe648066280 0x7fe648068730 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0afc80 tx=0x7fe650007d40 comp rx=0 tx=0).stop 2023-07-09T02:18:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe65c06a5c0 msgr2=0x7fe65c1541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe65c06a5c0 0x7fe65c1541f0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fe64c01ab30 tx=0x7fe64c019220 comp rx=0 tx=0).stop 2023-07-09T02:18:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 shutdown_connections 2023-07-09T02:18:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe65c0cd290 0x7fe65c14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe648066280 0x7fe648068730 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65c06aa10 0x7fe65c147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 --2- 172.21.15.45:0/1625785113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe65c06a5c0 0x7fe65c1541f0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.915+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 >> 172.21.15.45:0/1625785113 conn(0x7fe65c06d140 msgr2=0x7fe65c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.919+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 shutdown_connections 2023-07-09T02:18:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:49.919+0000 7fe662456640 1 -- 172.21.15.45:0/1625785113 wait complete. 2023-07-09T02:18:49.939 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:18:49.939 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:18:49.939 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:18:49.939 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:18:49.940 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:18:49.940 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:18:49.940 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:18:49.941 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:18:49.941 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:18:49.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:49.942 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:18:49.951 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:18:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:18:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:18:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:49.951 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:18:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:49.952 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:18:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:18:49.952 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:18:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:49.952 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:18:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:18:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41997sec preferred_lft 41997sec 2023-07-09T02:18:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:18:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:49.953 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:18:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:49.953 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:18:49.953 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:18:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:18:49.954 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:18:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:18:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:49.954 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:18:49.954 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:18:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:18:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:49.955 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:18:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:18:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:18:49.955 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:49.956 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:18:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:18:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:18:49.956 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:49.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:49.957 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:18:50.018 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:18:50.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:50.020 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:18:50.072 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:18:50.073 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:18:50.073 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:18:50.073 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:18:50.073 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:18:50.073 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:18:50.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:50.074 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:18:50.074 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:18:50.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:18:50.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:18:50.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:18:50.076 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:18:50.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:50.169 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:18:50.178 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:18:50.178 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:18:50.179 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:18:50.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:50.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:18:50.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:18:50.240 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:18:50.292 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:18:50.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:18:50.293 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:18:50.342 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:18:50.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:50.343 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:18:50.434 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:18:50.434 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:18:50.448 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:18:50.448 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:18:50.448 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:18:50.448 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:18:50.448 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:18:50.451 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:18:50.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:50.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:18:50.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:50.474 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:18:50.534 INFO:teuthology.orchestra.run.smithi045.stdout:client7969 2023-07-09T02:18:50.534 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:18:50.534 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:50.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:18:50.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed759e640 1 Processor -- start 2023-07-09T02:18:50.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed759e640 1 -- start start 2023-07-09T02:18:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8159f40 0x7f0ed815da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ed80d0020 0x7f0ed815c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed815b320 con 0x7f0ed8099f40 2023-07-09T02:18:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed80d0500 con 0x7f0ed80d0020 2023-07-09T02:18:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80d11c0 con 0x7f0ed8159f40 2023-07-09T02:18:50.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ecffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0ed8099f40 0x7f0ed815df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34790/0 (socket says 172.21.15.45:34790) 2023-07-09T02:18:50.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ecffff640 1 -- 172.21.15.45:0/977435284 learned_addr learned my addr 172.21.15.45:0/977435284 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:50.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ed80d0020 0x7f0ed815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:50.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed659c640 1 --2- 172.21.15.45:0/977435284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8159f40 0x7f0ed815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed5d9b640 1 -- 172.21.15.45:0/977435284 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388203560 0 0) 0x7f0ed815b320 con 0x7f0ed8099f40 2023-07-09T02:18:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed5d9b640 1 -- 172.21.15.45:0/977435284 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4003530 con 0x7f0ed8099f40 2023-07-09T02:18:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/977435284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8159f40 msgr2=0x7f0ed815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:18:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/977435284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8159f40 0x7f0ed815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/977435284 >> v1:172.21.15.45:6789/0 conn(0x7f0ed8099f40 legacy=0x7f0ed815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.771+0000 7f0ed6d9d640 1 -- 172.21.15.45:0/977435284 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80d14a0 con 0x7f0ed80d0020 2023-07-09T02:18:50.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/977435284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed815c320 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009d90 tx=0x7f0ed001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cba94bec839fbd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:50.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed5d9b640 1 -- 172.21.15.45:0/977435284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00a59e0 con 0x7f0ed80d0020 2023-07-09T02:18:50.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed5d9b640 1 -- 172.21.15.45:0/977435284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed00a5b40 con 0x7f0ed80d0020 2023-07-09T02:18:50.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed5d9b640 1 -- 172.21.15.45:0/977435284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00ad440 con 0x7f0ed80d0020 2023-07-09T02:18:50.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 -- 172.21.15.45:0/977435284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 msgr2=0x7f0ed815c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:50.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 --2- 172.21.15.45:0/977435284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed815c320 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009d90 tx=0x7f0ed001c920 comp rx=0 tx=0).stop 2023-07-09T02:18:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 -- 172.21.15.45:0/977435284 shutdown_connections 2023-07-09T02:18:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 --2- 172.21.15.45:0/977435284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed815c320 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 --2- 172.21.15.45:0/977435284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8159f40 0x7f0ed815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 -- 172.21.15.45:0/977435284 >> 172.21.15.45:0/977435284 conn(0x7f0ed80999f0 msgr2=0x7f0ed80d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:50.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 -- 172.21.15.45:0/977435284 shutdown_connections 2023-07-09T02:18:50.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 -- 172.21.15.45:0/977435284 wait complete. 2023-07-09T02:18:50.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.775+0000 7f0ed759e640 1 Processor -- start 2023-07-09T02:18:50.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 -- start start 2023-07-09T02:18:50.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8099f40 0x7f0ed80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:50.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed8151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:50.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed8159f40 0x7f0ed8154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:50.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80b4e90 con 0x7f0ed80d0020 2023-07-09T02:18:50.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed8151fd0 con 0x7f0ed8159f40 2023-07-09T02:18:50.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80b5cb0 con 0x7f0ed8099f40 2023-07-09T02:18:50.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed8151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:50.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed8151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38054/0 (socket says 172.21.15.45:38054) 2023-07-09T02:18:50.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 -- 172.21.15.45:0/387412840 learned_addr learned my addr 172.21.15.45:0/387412840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:50.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed659c640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8099f40 0x7f0ed80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:50.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed8159f40 0x7f0ed8154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:50.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 -- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8099f40 msgr2=0x7f0ed80b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:50.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8099f40 0x7f0ed80b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 -- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed8159f40 msgr2=0x7f0ed8154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:50.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed8159f40 0x7f0ed8154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 -- 172.21.15.45:0/387412840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0009a70 con 0x7f0ed80d0020 2023-07-09T02:18:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed6d9d640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed8159f40 0x7f0ed8154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ecffff640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed8151020 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c420 tx=0x7f0ec000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0eceffd640 1 -- 172.21.15.45:0/387412840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0005cf0 con 0x7f0ed80d0020 2023-07-09T02:18:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0eceffd640 1 -- 172.21.15.45:0/387412840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec0005e70 con 0x7f0ed80d0020 2023-07-09T02:18:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed8151560 con 0x7f0ed80d0020 2023-07-09T02:18:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0eceffd640 1 -- 172.21.15.45:0/387412840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec00072f0 con 0x7f0ed80d0020 2023-07-09T02:18:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed80b5380 con 0x7f0ed80d0020 2023-07-09T02:18:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.779+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed80ce190 con 0x7f0ed80d0020 2023-07-09T02:18:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.783+0000 7f0eceffd640 1 -- 172.21.15.45:0/387412840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ec0007490 con 0x7f0ed80d0020 2023-07-09T02:18:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.783+0000 7f0eceffd640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.783+0000 7f0eceffd640 1 -- 172.21.15.45:0/387412840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ec0083360 con 0x7f0ed80d0020 2023-07-09T02:18:50.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.783+0000 7f0ed659c640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:50.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.783+0000 7f0ed659c640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009ac0 tx=0x7f0ec8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:50.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.787+0000 7f0eceffd640 1 -- 172.21.15.45:0/387412840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ec0054340 con 0x7f0ed80d0020 2023-07-09T02:18:50.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ed804e020 con 0x7f0ed80d0020 2023-07-09T02:18:50.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0eceffd640 1 -- 172.21.15.45:0/387412840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ec0053ed0 con 0x7f0ed80d0020 2023-07-09T02:18:50.978 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:18:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 msgr2=0x7f0eb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009ac0 tx=0x7f0ec8009190 comp rx=0 tx=0).stop 2023-07-09T02:18:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 msgr2=0x7f0ed8151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:50.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed8151020 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c420 tx=0x7f0ec000c8e0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 shutdown_connections 2023-07-09T02:18:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ed8159f40 0x7f0ed8154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ed80d0020 0x7f0ed8151020 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0eb8066280 0x7f0eb8068730 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 --2- 172.21.15.45:0/387412840 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ed8099f40 0x7f0ed80b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 >> 172.21.15.45:0/387412840 conn(0x7f0ed80999f0 msgr2=0x7f0ed8153010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:50.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 shutdown_connections 2023-07-09T02:18:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:50.975+0000 7f0ed759e640 1 -- 172.21.15.45:0/387412840 wait complete. 2023-07-09T02:18:50.998 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:18:50.998 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:18:50.999 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:18:50.999 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:18:50.999 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:18:50.999 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:18:51.000 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:18:51.000 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:18:51.000 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:18:51.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.001 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:18:51.011 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:18:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:18:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:18:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:51.011 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:18:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:51.012 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:18:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:18:51.012 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:18:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:51.012 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:18:51.013 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:18:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:51.013 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:18:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:18:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42003sec preferred_lft 42003sec 2023-07-09T02:18:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:18:51.013 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:51.014 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:18:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:18:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:51.014 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:18:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:18:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:18:51.014 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:18:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:51.015 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:18:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:18:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:18:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:51.015 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:18:51.015 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:18:51.016 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:18:51.016 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:18:51.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.017 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:18:51.079 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:18:51.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.081 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:18:51.133 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:18:51.133 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:18:51.133 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:18:51.133 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:18:51.133 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:18:51.134 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:18:51.134 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:18:51.134 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:18:51.134 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:18:51.134 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:18:51.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.135 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:18:51.135 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:18:51.135 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:18:51.136 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:18:51.136 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:18:51.136 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:18:51.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.230 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:18:51.239 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:18:51.240 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:18:51.240 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:18:51.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.241 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:18:51.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:18:51.308 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:18:51.358 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:18:51.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:18:51.359 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:18:51.410 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:18:51.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.411 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:18:51.502 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:18:51.502 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:18:51.514 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:18:51.514 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:18:51.515 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:18:51.515 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:18:51.515 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:18:51.519 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:18:51.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.519 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:18:51.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:18:51.540 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:18:51.593 INFO:teuthology.orchestra.run.smithi155.stdout:client8430 2023-07-09T02:18:51.594 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:18:51.594 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:18:51.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:18:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc66759e640 1 Processor -- start 2023-07-09T02:18:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc66759e640 1 -- start start 2023-07-09T02:18:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc66759e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc6680ccf10 0x7fc668160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc66759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680cd5d0 con 0x7fc6680c8d40 2023-07-09T02:18:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc66759e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680d2050 con 0x7fc6680b4ae0 2023-07-09T02:18:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc66759e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6680d27a0 con 0x7fc6680ccf10 2023-07-09T02:18:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc66659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc6680c8d40 0x7fc6680b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51974/0 (socket says 172.21.15.45:51974) 2023-07-09T02:18:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc66659c640 1 -- 172.21.15.45:0/891127454 learned_addr learned my addr 172.21.15.45:0/891127454 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.791+0000 7fc666d9d640 1 --2- 172.21.15.45:0/891127454 >> v2:172.21.15.155:3300/0 conn(0x7fc6680ccf10 0x7fc668160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc665d9b640 1 -- 172.21.15.45:0/891127454 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703660585 0 0) 0x7fc6680cd5d0 con 0x7fc6680c8d40 2023-07-09T02:18:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc665d9b640 1 -- 172.21.15.45:0/891127454 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc654003530 con 0x7fc6680c8d40 2023-07-09T02:18:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc665d9b640 1 -- 172.21.15.45:0/891127454 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491817112 0 0) 0x7fc6680d2050 con 0x7fc6680b4ae0 2023-07-09T02:18:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc665d9b640 1 -- 172.21.15.45:0/891127454 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6680cd5d0 con 0x7fc6680b4ae0 2023-07-09T02:18:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc666d9d640 1 -- 172.21.15.45:0/891127454 >> v1:172.21.15.155:6789/0 conn(0x7fc6680b4ae0 legacy=0x7fc6680d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc666d9d640 1 -- 172.21.15.45:0/891127454 >> v1:172.21.15.45:6789/0 conn(0x7fc6680c8d40 legacy=0x7fc6680b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc666d9d640 1 -- 172.21.15.45:0/891127454 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6680cd370 con 0x7fc6680ccf10 2023-07-09T02:18:51.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc666d9d640 1 --2- 172.21.15.45:0/891127454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 0x7fc668160670 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc66001f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e48cdf1726e4fe38 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc665d9b640 1 -- 172.21.15.45:0/891127454 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600af600 con 0x7fc6680ccf10 2023-07-09T02:18:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc665d9b640 1 -- 172.21.15.45:0/891127454 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6600ab050 con 0x7fc6680ccf10 2023-07-09T02:18:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc665d9b640 1 -- 172.21.15.45:0/891127454 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600af980 con 0x7fc6680ccf10 2023-07-09T02:18:51.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc66759e640 1 -- 172.21.15.45:0/891127454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 msgr2=0x7fc668160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:51.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.795+0000 7fc66759e640 1 --2- 172.21.15.45:0/891127454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 0x7fc668160670 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc66001f130 comp rx=0 tx=0).stop 2023-07-09T02:18:51.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 -- 172.21.15.45:0/891127454 shutdown_connections 2023-07-09T02:18:51.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 --2- 172.21.15.45:0/891127454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 0x7fc668160670 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:51.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 -- 172.21.15.45:0/891127454 >> 172.21.15.45:0/891127454 conn(0x7fc6680d2950 msgr2=0x7fc6680d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:51.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 -- 172.21.15.45:0/891127454 shutdown_connections 2023-07-09T02:18:51.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 -- 172.21.15.45:0/891127454 wait complete. 2023-07-09T02:18:51.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 Processor -- start 2023-07-09T02:18:51.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 -- start start 2023-07-09T02:18:51.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680b4ae0 0x7fc668157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:51.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680c8d40 0x7fc6680b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 0x7fc6680b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b6e50 con 0x7fc6680b4ae0 2023-07-09T02:18:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668157f90 con 0x7fc6680ccf10 2023-07-09T02:18:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b6240 con 0x7fc6680c8d40 2023-07-09T02:18:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680b4ae0 0x7fc668157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680b4ae0 0x7fc668157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48818/0 (socket says 172.21.15.45:48818) 2023-07-09T02:18:51.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66659c640 1 -- 172.21.15.45:0/469188758 learned_addr learned my addr 172.21.15.45:0/469188758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:51.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc666d9d640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 0x7fc6680b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:51.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc65ffff640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680c8d40 0x7fc6680b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:51.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66659c640 1 -- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680c8d40 msgr2=0x7fc6680b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:51.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66659c640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680c8d40 0x7fc6680b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:51.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66659c640 1 -- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 msgr2=0x7fc6680b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:51.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66659c640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 0x7fc6680b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:51.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc66659c640 1 -- 172.21.15.45:0/469188758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009a70 con 0x7fc6680b4ae0 2023-07-09T02:18:51.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.799+0000 7fc666d9d640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 0x7fc6680b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:51.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc66659c640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680b4ae0 0x7fc668157a50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c4d0 tx=0x7fc65800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:51.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc65effd640 1 -- 172.21.15.45:0/469188758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658005cf0 con 0x7fc6680b4ae0 2023-07-09T02:18:51.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc65effd640 1 -- 172.21.15.45:0/469188758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc658005e50 con 0x7fc6680b4ae0 2023-07-09T02:18:51.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc65effd640 1 -- 172.21.15.45:0/469188758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6580072b0 con 0x7fc6680b4ae0 2023-07-09T02:18:51.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6680b6520 con 0x7fc6680b4ae0 2023-07-09T02:18:51.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6680b6ae0 con 0x7fc6680b4ae0 2023-07-09T02:18:51.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66804e020 con 0x7fc6680b4ae0 2023-07-09T02:18:51.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc65effd640 1 -- 172.21.15.45:0/469188758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc658007410 con 0x7fc6680b4ae0 2023-07-09T02:18:51.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc65effd640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:51.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.803+0000 7fc65effd640 1 -- 172.21.15.45:0/469188758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc658083340 con 0x7fc6680b4ae0 2023-07-09T02:18:51.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.807+0000 7fc65ffff640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:51.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.807+0000 7fc65ffff640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc6681e5200 tx=0x7fc650009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:51.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.807+0000 7fc65effd640 1 -- 172.21.15.45:0/469188758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6580507d0 con 0x7fc6680b4ae0 2023-07-09T02:18:52.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:51.999+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc66806a360 con 0x7fc6680b4ae0 2023-07-09T02:18:52.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc65effd640 1 -- 172.21.15.45:0/469188758 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fc658053df0 con 0x7fc6680b4ae0 2023-07-09T02:18:52.004 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:18:52.005 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1878423144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1878423144},{"type":"v1","addr":"172.21.15.155:6836","nonce":1878423144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":8259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1407467413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1407467413},{"type":"v1","addr":"172.21.15.45:6833","nonce":1407467413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2772552547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2772552547},{"type":"v1","addr":"172.21.15.45:6835","nonce":2772552547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:18:43.005298+0000","modified":"2023-07-09T02:18:46.662099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8274":{"gid":8274,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3076932418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3076932418},{"type":"v1","addr":"172.21.15.155:6837","nonce":3076932418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T02:18:52.006 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 75 2023-07-09T02:18:52.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 msgr2=0x7fc648068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc6681e5200 tx=0x7fc650009040 comp rx=0 tx=0).stop 2023-07-09T02:18:52.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680b4ae0 msgr2=0x7fc668157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680b4ae0 0x7fc668157a50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c4d0 tx=0x7fc65800c990 comp rx=0 tx=0).stop 2023-07-09T02:18:52.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 shutdown_connections 2023-07-09T02:18:52.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6680ccf10 0x7fc6680b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc648066280 0x7fc648068730 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6680c8d40 0x7fc6680b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 --2- 172.21.15.45:0/469188758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6680b4ae0 0x7fc668157a50 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 >> 172.21.15.45:0/469188758 conn(0x7fc6680d2950 msgr2=0x7fc6680c7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:52.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 shutdown_connections 2023-07-09T02:18:52.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.003+0000 7fc66759e640 1 -- 172.21.15.45:0/469188758 wait complete. 2023-07-09T02:18:52.025 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-07-09T02:18:52.183 INFO:teuthology.orchestra.run.smithi155.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":8274,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5402171609999993,"mdsmap_epoch":75,"osdmap_epoch":153,"osdmap_epoch_barrier":153,"uptime":14.474221767} 2023-07-09T02:18:52.183 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 8274, "mdsmap_epoch": 75, "osdmap_epoch": 153, "osdmap_epoch_barrier": 153, "rank_uptime": 8.540217161, "state": "up:active", "uptime": 14.474221767, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:18:52.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-07-09T02:18:52.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.327+0000 7f44c24f7640 1 Processor -- start 2023-07-09T02:18:52.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c24f7640 1 -- start start 2023-07-09T02:18:52.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c24f7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f44bc06a090 0x7f44bc0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:52.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c24f7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0cced0 con 0x7f44bc0cead0 2023-07-09T02:18:52.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c24f7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0cef40 con 0x7f44bc15c280 2023-07-09T02:18:52.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c24f7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0cd6e0 con 0x7f44bc06a090 2023-07-09T02:18:52.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c0cf4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f44bc0cead0 0x7f44bc069980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51986/0 (socket says 172.21.15.45:51986) 2023-07-09T02:18:52.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c0cf4640 1 -- 172.21.15.45:0/3969400667 learned_addr learned my addr 172.21.15.45:0/3969400667 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:18:52.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c1cf6640 1 --2- 172.21.15.45:0/3969400667 >> v2:172.21.15.155:3300/0 conn(0x7f44bc06a090 0x7f44bc0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:52.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44b3fff640 1 -- 172.21.15.45:0/3969400667 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791925152 0 0) 0x7f44bc0cced0 con 0x7f44bc0cead0 2023-07-09T02:18:52.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44b3fff640 1 -- 172.21.15.45:0/3969400667 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a8003530 con 0x7f44bc0cead0 2023-07-09T02:18:52.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44b3fff640 1 -- 172.21.15.45:0/3969400667 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383364656 0 0) 0x7f44bc0cef40 con 0x7f44bc15c280 2023-07-09T02:18:52.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44b3fff640 1 -- 172.21.15.45:0/3969400667 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44bc0cced0 con 0x7f44bc15c280 2023-07-09T02:18:52.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c1cf6640 1 -- 172.21.15.45:0/3969400667 >> v1:172.21.15.155:6789/0 conn(0x7f44bc15c280 legacy=0x7f44bc160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c1cf6640 1 -- 172.21.15.45:0/3969400667 >> v1:172.21.15.45:6789/0 conn(0x7f44bc0cead0 legacy=0x7f44bc069980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.331+0000 7f44c1cf6640 1 -- 172.21.15.45:0/3969400667 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0cd120 con 0x7f44bc06a090 2023-07-09T02:18:52.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44c1cf6640 1 --2- 172.21.15.45:0/3969400667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 0x7f44bc0b56d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009d90 tx=0x7f44b401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e185fae940237bd1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44b3fff640 1 -- 172.21.15.45:0/3969400667 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a5920 con 0x7f44bc06a090 2023-07-09T02:18:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44b3fff640 1 -- 172.21.15.45:0/3969400667 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b40a5a80 con 0x7f44bc06a090 2023-07-09T02:18:52.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44b3fff640 1 -- 172.21.15.45:0/3969400667 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a5e10 con 0x7f44bc06a090 2023-07-09T02:18:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44c24f7640 1 -- 172.21.15.45:0/3969400667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 msgr2=0x7f44bc0b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44c24f7640 1 --2- 172.21.15.45:0/3969400667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 0x7f44bc0b56d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009d90 tx=0x7f44b401c950 comp rx=0 tx=0).stop 2023-07-09T02:18:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44c24f7640 1 -- 172.21.15.45:0/3969400667 shutdown_connections 2023-07-09T02:18:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44c24f7640 1 --2- 172.21.15.45:0/3969400667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 0x7f44bc0b56d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44c24f7640 1 -- 172.21.15.45:0/3969400667 >> 172.21.15.45:0/3969400667 conn(0x7f44bc0cff90 msgr2=0x7f44bc0d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:52.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44c24f7640 1 -- 172.21.15.45:0/3969400667 shutdown_connections 2023-07-09T02:18:52.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.335+0000 7f44c24f7640 1 -- 172.21.15.45:0/3969400667 wait complete. 2023-07-09T02:18:52.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 Processor -- start 2023-07-09T02:18:52.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 -- start start 2023-07-09T02:18:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 0x7f44bc0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44bc0cead0 0x7f44bc0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44bc15c280 0x7f44bc154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0cb5c0 con 0x7f44bc15c280 2023-07-09T02:18:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0ca940 con 0x7f44bc06a090 2023-07-09T02:18:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0cac20 con 0x7f44bc0cead0 2023-07-09T02:18:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44bc15c280 0x7f44bc154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:52.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44bc15c280 0x7f44bc154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48824/0 (socket says 172.21.15.45:48824) 2023-07-09T02:18:52.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 -- 172.21.15.45:0/3479949022 learned_addr learned my addr 172.21.15.45:0/3479949022 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:18:52.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c14f5640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 0x7f44bc0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:52.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c0cf4640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44bc0cead0 0x7f44bc0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:52.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 -- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44bc0cead0 msgr2=0x7f44bc0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44bc0cead0 0x7f44bc0c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 -- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 msgr2=0x7f44bc0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 0x7f44bc0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 -- 172.21.15.45:0/3479949022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4009a70 con 0x7f44bc15c280 2023-07-09T02:18:52.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c14f5640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 0x7f44bc0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:18:52.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c1cf6640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44bc15c280 0x7f44bc154df0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f44b401a580 tx=0x7f44b40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:52.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44b1ffb640 1 -- 172.21.15.45:0/3479949022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40adc60 con 0x7f44bc15c280 2023-07-09T02:18:52.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44b1ffb640 1 -- 172.21.15.45:0/3479949022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b40addc0 con 0x7f44bc15c280 2023-07-09T02:18:52.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44b1ffb640 1 -- 172.21.15.45:0/3479949022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40b9650 con 0x7f44bc15c280 2023-07-09T02:18:52.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc0caf00 con 0x7f44bc15c280 2023-07-09T02:18:52.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc0c84b0 con 0x7f44bc15c280 2023-07-09T02:18:52.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.339+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc04e020 con 0x7f44bc15c280 2023-07-09T02:18:52.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.343+0000 7f44b1ffb640 1 -- 172.21.15.45:0/3479949022 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44b40b97b0 con 0x7f44bc15c280 2023-07-09T02:18:52.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.343+0000 7f44b1ffb640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44a0066280 0x7f44a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:18:52.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.343+0000 7f44b1ffb640 1 -- 172.21.15.45:0/3479949022 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44b411f290 con 0x7f44bc15c280 2023-07-09T02:18:52.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.343+0000 7f44c14f5640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44a0066280 0x7f44a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:18:52.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.343+0000 7f44c14f5640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44a0066280 0x7f44a0068730 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f44b80011f0 tx=0x7f44b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:18:52.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.347+0000 7f44b1ffb640 1 -- 172.21.15.45:0/3479949022 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44b40ec710 con 0x7f44bc15c280 2023-07-09T02:18:52.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.499+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f44bc0d31b0 con 0x7f44bc15c280 2023-07-09T02:18:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44b1ffb640 1 -- 172.21.15.45:0/3479949022 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v154) v1 ==== 181+0+0 (secure 0 0 0) 0x7f44b4009450 con 0x7f44bc15c280 2023-07-09T02:18:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-07-09T02:18:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44a0066280 msgr2=0x7f44a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44a0066280 0x7f44a0068730 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f44b80011f0 tx=0x7f44b8009040 comp rx=0 tx=0).stop 2023-07-09T02:18:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44bc15c280 msgr2=0x7f44bc154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:18:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44bc15c280 0x7f44bc154df0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f44b401a580 tx=0x7f44b40196f0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 shutdown_connections 2023-07-09T02:18:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44bc15c280 0x7f44bc154df0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f44a0066280 0x7f44a0068730 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44bc0cead0 0x7f44bc0c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 --2- 172.21.15.45:0/3479949022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44bc06a090 0x7f44bc0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:18:52.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 >> 172.21.15.45:0/3479949022 conn(0x7f44bc0cff90 msgr2=0x7f44bc069980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:18:52.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 shutdown_connections 2023-07-09T02:18:52.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:18:52.687+0000 7f44c24f7640 1 -- 172.21.15.45:0/3479949022 wait complete. 2023-07-09T02:18:52.711 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-07-09T02:18:52.869 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_mon_report_interval":"5"} 2023-07-09T02:18:52.870 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-07-09T02:18:52.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-07-09T02:18:53.024 INFO:teuthology.orchestra.run.smithi045.stdout:{"mon_tick_interval":"5"} 2023-07-09T02:18:53.025 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-07-09T02:18:53.025 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-07-09T02:18:53.026 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:18:53.026 DEBUG:teuthology.orchestra.run.smithi045:> import time 2023-07-09T02:18:53.026 DEBUG:teuthology.orchestra.run.smithi045:> import datetime 2023-07-09T02:18:53.027 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-07-09T02:18:53.027 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:18:53.027 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.027 DEBUG:teuthology.orchestra.run.smithi045:> # Write some buffered data through before going full, all should be well 2023-07-09T02:18:53.028 DEBUG:teuthology.orchestra.run.smithi045:> print("writing some data through which we expect to succeed") 2023-07-09T02:18:53.028 DEBUG:teuthology.orchestra.run.smithi045:> bytes = 0 2023-07-09T02:18:53.029 DEBUG:teuthology.orchestra.run.smithi045:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-07-09T02:18:53.029 DEBUG:teuthology.orchestra.run.smithi045:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-07-09T02:18:53.029 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-07-09T02:18:53.030 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f) 2023-07-09T02:18:53.030 DEBUG:teuthology.orchestra.run.smithi045:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-07-09T02:18:53.030 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.030 DEBUG:teuthology.orchestra.run.smithi045:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-07-09T02:18:53.031 DEBUG:teuthology.orchestra.run.smithi045:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-07-09T02:18:53.031 DEBUG:teuthology.orchestra.run.smithi045:> # buffered IO, the error should always only appear from fsync and not 2023-07-09T02:18:53.031 DEBUG:teuthology.orchestra.run.smithi045:> # from write 2023-07-09T02:18:53.031 DEBUG:teuthology.orchestra.run.smithi045:> full = False 2023-07-09T02:18:53.032 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.032 DEBUG:teuthology.orchestra.run.smithi045:> for n in range(0, int(32 * 0.9)): 2023-07-09T02:18:53.032 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-07-09T02:18:53.033 DEBUG:teuthology.orchestra.run.smithi045:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-07-09T02:18:53.033 DEBUG:teuthology.orchestra.run.smithi045:> print("done writing {0} bytes".format(bytes)) 2023-07-09T02:18:53.033 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.034 DEBUG:teuthology.orchestra.run.smithi045:> # OK, now we should sneak in under the full condition 2023-07-09T02:18:53.034 DEBUG:teuthology.orchestra.run.smithi045:> # due to the time it takes the OSDs to report to the 2023-07-09T02:18:53.034 DEBUG:teuthology.orchestra.run.smithi045:> # mons, and get a successful fsync on our full-making data 2023-07-09T02:18:53.034 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f) 2023-07-09T02:18:53.035 DEBUG:teuthology.orchestra.run.smithi045:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-07-09T02:18:53.035 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.035 DEBUG:teuthology.orchestra.run.smithi045:> # buffered write, add more dirty data to the buffer 2023-07-09T02:18:53.035 DEBUG:teuthology.orchestra.run.smithi045:> print("starting buffered write") 2023-07-09T02:18:53.036 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-07-09T02:18:53.036 DEBUG:teuthology.orchestra.run.smithi045:> for n in range(0, int(32 * 0.2)): 2023-07-09T02:18:53.036 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-07-09T02:18:53.036 DEBUG:teuthology.orchestra.run.smithi045:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-07-09T02:18:53.037 DEBUG:teuthology.orchestra.run.smithi045:> time.sleep(15.0) 2023-07-09T02:18:53.037 DEBUG:teuthology.orchestra.run.smithi045:> except OSError: 2023-07-09T02:18:53.037 DEBUG:teuthology.orchestra.run.smithi045:> pass; 2023-07-09T02:18:53.038 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.038 DEBUG:teuthology.orchestra.run.smithi045:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-07-09T02:18:53.038 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.038 DEBUG:teuthology.orchestra.run.smithi045:> # Wait long enough for a background flush that should fail 2023-07-09T02:18:53.039 DEBUG:teuthology.orchestra.run.smithi045:> time.sleep(30) 2023-07-09T02:18:53.039 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.039 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-07-09T02:18:53.039 DEBUG:teuthology.orchestra.run.smithi045:> # ...and check that the failed background flush is reflected in fclose 2023-07-09T02:18:53.040 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-07-09T02:18:53.040 DEBUG:teuthology.orchestra.run.smithi045:> os.close(f) 2023-07-09T02:18:53.040 DEBUG:teuthology.orchestra.run.smithi045:> except OSError: 2023-07-09T02:18:53.041 DEBUG:teuthology.orchestra.run.smithi045:> print("close() returned an error as expected") 2023-07-09T02:18:53.041 DEBUG:teuthology.orchestra.run.smithi045:> else: 2023-07-09T02:18:53.041 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("close() failed to raise error") 2023-07-09T02:18:53.041 DEBUG:teuthology.orchestra.run.smithi045:> else: 2023-07-09T02:18:53.042 DEBUG:teuthology.orchestra.run.smithi045:> # The kernel cephfs client does not raise errors on fclose 2023-07-09T02:18:53.042 DEBUG:teuthology.orchestra.run.smithi045:> os.close(f) 2023-07-09T02:18:53.042 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:18:53.042 DEBUG:teuthology.orchestra.run.smithi045:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-07-09T02:18:53.043 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:19:19.440 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:19:19.444 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:19:49.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:19:49.526 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:20:19.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:20:19.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:20:42.899 INFO:teuthology.orchestra.run.smithi045.stdout:writing some data through which we expect to succeed 2023-07-09T02:20:42.899 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-07-09T02:20:42.899 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-07-09T02:20:42.900 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-07-09T02:20:42.900 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-07-09T02:20:42.900 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-07-09T02:20:42.900 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-07-09T02:20:42.900 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-07-09T02:20:42.900 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-07-09T02:20:42.900 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-07-09T02:20:42.901 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-07-09T02:20:42.901 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-07-09T02:20:42.901 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-07-09T02:20:42.901 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-07-09T02:20:42.901 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-07-09T02:20:42.901 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-07-09T02:20:42.901 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-07-09T02:20:42.901 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-07-09T02:20:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-07-09T02:20:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-07-09T02:20:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-07-09T02:20:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-07-09T02:20:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-07-09T02:20:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-07-09T02:20:42.903 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-07-09T02:20:42.903 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-07-09T02:20:42.903 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-07-09T02:20:42.903 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-07-09T02:20:42.903 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-07-09T02:20:42.903 INFO:teuthology.orchestra.run.smithi045.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-07-09T02:20:42.903 INFO:teuthology.orchestra.run.smithi045.stdout:done writing 29884416 bytes 2023-07-09T02:20:42.903 INFO:teuthology.orchestra.run.smithi045.stdout:successfully fsync'ed prior to getting full state reported 2023-07-09T02:20:42.904 INFO:teuthology.orchestra.run.smithi045.stdout:starting buffered write 2023-07-09T02:20:42.904 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:20:42.904 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:20:42.904 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:20:42.904 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:20:42.904 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:20:42.904 INFO:teuthology.orchestra.run.smithi045.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-07-09T02:20:43.069 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:20:43.069 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:20:43.130 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:20:43.189 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:20:43.190 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:20:43.191 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:43.201 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:20:43.202 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:43.252 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:20:43.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12dca6d640 1 Processor -- start 2023-07-09T02:20:43.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12dca6d640 1 -- start start 2023-07-09T02:20:43.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12dca6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12d80cd120 0x7f12d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12dca6d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d8160a50 con 0x7f12d815c060 2023-07-09T02:20:43.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12dca6d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d815c430 con 0x7f12d80d2620 2023-07-09T02:20:43.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12dca6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d815fb60 con 0x7f12d80cd120 2023-07-09T02:20:43.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12d6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12d80cd120 0x7f12d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12d6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12d80cd120 0x7f12d80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46700/0 (socket says 172.21.15.45:46700) 2023-07-09T02:20:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12d6d9d640 1 -- 172.21.15.45:0/1088354913 learned_addr learned my addr 172.21.15.45:0/1088354913 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12d6d9d640 1 -- 172.21.15.45:0/1088354913 >> v1:172.21.15.155:6789/0 conn(0x7f12d80d2620 legacy=0x7f12d80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:43.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12d6d9d640 1 -- 172.21.15.45:0/1088354913 >> v1:172.21.15.45:6789/0 conn(0x7f12d815c060 legacy=0x7f12d80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.450+0000 7f12d6d9d640 1 -- 172.21.15.45:0/1088354913 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d815fe40 con 0x7f12d80cd120 2023-07-09T02:20:43.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12d6d9d640 1 --2- 172.21.15.45:0/1088354913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d80b4ed0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009870 tx=0x7f12d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30793a180bc5c7f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:43.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12d5d9b640 1 -- 172.21.15.45:0/1088354913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d00aa430 con 0x7f12d80cd120 2023-07-09T02:20:43.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12d5d9b640 1 -- 172.21.15.45:0/1088354913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d00aa590 con 0x7f12d80cd120 2023-07-09T02:20:43.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12d5d9b640 1 -- 172.21.15.45:0/1088354913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d00aa920 con 0x7f12d80cd120 2023-07-09T02:20:43.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12dca6d640 1 -- 172.21.15.45:0/1088354913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 msgr2=0x7f12d80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12dca6d640 1 --2- 172.21.15.45:0/1088354913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d80b4ed0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009870 tx=0x7f12d001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12dca6d640 1 -- 172.21.15.45:0/1088354913 shutdown_connections 2023-07-09T02:20:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12dca6d640 1 --2- 172.21.15.45:0/1088354913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d80b4ed0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12dca6d640 1 -- 172.21.15.45:0/1088354913 >> 172.21.15.45:0/1088354913 conn(0x7f12d80698e0 msgr2=0x7f12d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12dca6d640 1 -- 172.21.15.45:0/1088354913 shutdown_connections 2023-07-09T02:20:43.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.454+0000 7f12dca6d640 1 -- 172.21.15.45:0/1088354913 wait complete. 2023-07-09T02:20:43.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 Processor -- start 2023-07-09T02:20:43.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 -- start start 2023-07-09T02:20:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d8158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80d2620 0x7f12d80b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d815c060 0x7f12d80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8163160 con 0x7f12d80cd120 2023-07-09T02:20:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8166c00 con 0x7f12d815c060 2023-07-09T02:20:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8166ee0 con 0x7f12d80d2620 2023-07-09T02:20:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d8158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46716/0 (socket says 172.21.15.45:46716) 2023-07-09T02:20:43.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 -- 172.21.15.45:0/1855920768 learned_addr learned my addr 172.21.15.45:0/1855920768 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:43.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12cdd9b640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80d2620 0x7f12d80b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d6d9d640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d815c060 0x7f12d80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 -- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80d2620 msgr2=0x7f12d80b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80d2620 0x7f12d80b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 -- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d815c060 msgr2=0x7f12d80b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d815c060 0x7f12d80b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 -- 172.21.15.45:0/1855920768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00094d0 con 0x7f12d80cd120 2023-07-09T02:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12d659c640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d8158650 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f12c800c3c0 tx=0x7f12c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12cf7fe640 1 -- 172.21.15.45:0/1855920768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80052d0 con 0x7f12d80cd120 2023-07-09T02:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12cf7fe640 1 -- 172.21.15.45:0/1855920768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8005430 con 0x7f12d80cd120 2023-07-09T02:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d80b59f0 con 0x7f12d80cd120 2023-07-09T02:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12cf7fe640 1 -- 172.21.15.45:0/1855920768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8003840 con 0x7f12d80cd120 2023-07-09T02:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d8158b90 con 0x7f12d80cd120 2023-07-09T02:20:43.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.458+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d8167390 con 0x7f12d80cd120 2023-07-09T02:20:43.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.462+0000 7f12cf7fe640 1 -- 172.21.15.45:0/1855920768 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12c80039a0 con 0x7f12d80cd120 2023-07-09T02:20:43.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.462+0000 7f12cf7fe640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12b8066280 0x7f12b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.462+0000 7f12cf7fe640 1 -- 172.21.15.45:0/1855920768 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12c8083270 con 0x7f12d80cd120 2023-07-09T02:20:43.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.462+0000 7f12cf7fe640 1 -- 172.21.15.45:0/1855920768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f12b806e3c0 con 0x7f12d80cd120 2023-07-09T02:20:43.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.462+0000 7f12cdd9b640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12b8066280 0x7f12b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.462+0000 7f12cdd9b640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12b8066280 0x7f12b8068730 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f12d8167750 tx=0x7f12c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.466+0000 7f12cf7fe640 1 -- 172.21.15.45:0/1855920768 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12c80506e0 con 0x7f12d80cd120 2023-07-09T02:20:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.618+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12d804d7d0 con 0x7f12d80cd120 2023-07-09T02:20:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12cf7fe640 1 -- 172.21.15.45:0/1855920768 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18337 (secure 0 0 0) 0x7f12c8017070 con 0x7f12d80cd120 2023-07-09T02:20:43.620 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:43.621 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":155,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:19:54.428525+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:18:40.756512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T02:18:42.013313+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:20:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12b8066280 msgr2=0x7f12b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12b8066280 0x7f12b8068730 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f12d8167750 tx=0x7f12c0009040 comp rx=0 tx=0).stop 2023-07-09T02:20:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 msgr2=0x7f12d8158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d8158650 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f12c800c3c0 tx=0x7f12c800c880 comp rx=0 tx=0).stop 2023-07-09T02:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 shutdown_connections 2023-07-09T02:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12d815c060 0x7f12d80b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12b8066280 0x7f12b8068730 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12d80d2620 0x7f12d80b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 --2- 172.21.15.45:0/1855920768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12d80cd120 0x7f12d8158650 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 >> 172.21.15.45:0/1855920768 conn(0x7f12d80698e0 msgr2=0x7f12d80cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 shutdown_connections 2023-07-09T02:20:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.622+0000 7f12dca6d640 1 -- 172.21.15.45:0/1855920768 wait complete. 2023-07-09T02:20:43.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:18:40.756512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:18:42.013313+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:20:43.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:20:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.790+0000 7f5301c34640 1 Processor -- start 2023-07-09T02:20:43.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f5301c34640 1 -- start start 2023-07-09T02:20:43.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f5301c34640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f52fc0ca0f0 0x7f52fc0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f5301c34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc06bf30 con 0x7f52fc15db00 2023-07-09T02:20:43.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f5301c34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc06bc50 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f5301c34640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc0cab90 con 0x7f52fc0ca0f0 2023-07-09T02:20:43.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52fc15db00 0x7f52fc06b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40194/0 (socket says 172.21.15.45:40194) 2023-07-09T02:20:43.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fbfff640 1 -- 172.21.15.45:0/2241332656 learned_addr learned my addr 172.21.15.45:0/2241332656 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:43.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fb7fe640 1 --2- 172.21.15.45:0/2241332656 >> v2:172.21.15.155:3300/0 conn(0x7f52fc0ca0f0 0x7f52fc0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fa7fc640 1 -- 172.21.15.45:0/2241332656 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119437255 0 0) 0x7f52fc06bf30 con 0x7f52fc15db00 2023-07-09T02:20:43.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fa7fc640 1 -- 172.21.15.45:0/2241332656 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e4003530 con 0x7f52fc15db00 2023-07-09T02:20:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fa7fc640 1 -- 172.21.15.45:0/2241332656 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714053494 0 0) 0x7f52fc06bc50 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fa7fc640 1 -- 172.21.15.45:0/2241332656 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52fc06bf30 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fb7fe640 1 -- 172.21.15.45:0/2241332656 >> v1:172.21.15.155:6789/0 conn(0x7f52fc0cbbb0 legacy=0x7f52fc0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fb7fe640 1 -- 172.21.15.45:0/2241332656 >> v1:172.21.15.45:6789/0 conn(0x7f52fc15db00 legacy=0x7f52fc06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.794+0000 7f52fb7fe640 1 -- 172.21.15.45:0/2241332656 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0cae70 con 0x7f52fc0ca0f0 2023-07-09T02:20:43.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f52fb7fe640 1 --2- 172.21.15.45:0/2241332656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc0ca0f0 0x7f52fc0cb670 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0097c0 tx=0x7f52ec01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9bdaeaf813bbd11 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:43.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f52fa7fc640 1 -- 172.21.15.45:0/2241332656 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0ab600 con 0x7f52fc0ca0f0 2023-07-09T02:20:43.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f52fa7fc640 1 -- 172.21.15.45:0/2241332656 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec0a7050 con 0x7f52fc0ca0f0 2023-07-09T02:20:43.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f52fa7fc640 1 -- 172.21.15.45:0/2241332656 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0ab980 con 0x7f52fc0ca0f0 2023-07-09T02:20:43.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f5301c34640 1 -- 172.21.15.45:0/2241332656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc0ca0f0 msgr2=0x7f52fc0cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f5301c34640 1 --2- 172.21.15.45:0/2241332656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc0ca0f0 0x7f52fc0cb670 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0097c0 tx=0x7f52ec01c3f0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f5301c34640 1 -- 172.21.15.45:0/2241332656 shutdown_connections 2023-07-09T02:20:43.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f5301c34640 1 --2- 172.21.15.45:0/2241332656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc0ca0f0 0x7f52fc0cb670 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f5301c34640 1 -- 172.21.15.45:0/2241332656 >> 172.21.15.45:0/2241332656 conn(0x7f52fc0694b0 msgr2=0x7f52fc0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:43.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f5301c34640 1 -- 172.21.15.45:0/2241332656 shutdown_connections 2023-07-09T02:20:43.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f5301c34640 1 -- 172.21.15.45:0/2241332656 wait complete. 2023-07-09T02:20:43.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.798+0000 7f5301c34640 1 Processor -- start 2023-07-09T02:20:43.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 -- start start 2023-07-09T02:20:43.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52fc0ca0f0 0x7f52fc0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0cbbb0 0x7f52fc15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc15db00 0x7f52fc15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0c5790 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc14b3e0 con 0x7f52fc15db00 2023-07-09T02:20:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc14b6c0 con 0x7f52fc0ca0f0 2023-07-09T02:20:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0cbbb0 0x7f52fc15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0cbbb0 0x7f52fc15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46722/0 (socket says 172.21.15.45:46722) 2023-07-09T02:20:43.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 -- 172.21.15.45:0/3041510316 learned_addr learned my addr 172.21.15.45:0/3041510316 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:43.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52fb7fe640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52fc0ca0f0 0x7f52fc0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52fbfff640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc15db00 0x7f52fc15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 -- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52fc0ca0f0 msgr2=0x7f52fc0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52fc0ca0f0 0x7f52fc0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 -- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc15db00 msgr2=0x7f52fc15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc15db00 0x7f52fc15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 -- 172.21.15.45:0/3041510316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec009420 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52faffd640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0cbbb0 0x7f52fc15a660 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c490 tx=0x7f52f000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52e3fff640 1 -- 172.21.15.45:0/3041510316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f00052d0 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52e3fff640 1 -- 172.21.15.45:0/3041510316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0005430 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc14b9a0 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f52e3fff640 1 -- 172.21.15.45:0/3041510316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0012870 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc14b000 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.802+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc04d7d0 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.806+0000 7f52e3fff640 1 -- 172.21.15.45:0/3041510316 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52f00129d0 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.806+0000 7f52e3fff640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52e8066280 0x7f52e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.806+0000 7f52e3fff640 1 -- 172.21.15.45:0/3041510316 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52f0083880 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.806+0000 7f52e3fff640 1 -- 172.21.15.45:0/3041510316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f52e806e3c0 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.806+0000 7f52fb7fe640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52e8066280 0x7f52e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:43.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.806+0000 7f52fb7fe640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52e8066280 0x7f52e8068730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0ad000 tx=0x7f52ec0a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:43.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.810+0000 7f52e3fff640 1 -- 172.21.15.45:0/3041510316 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52f0050d20 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.966+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52fc06c540 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.966+0000 7f52e3fff640 1 -- 172.21.15.45:0/3041510316 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52f0054340 con 0x7f52fc0cbbb0 2023-07-09T02:20:43.966 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:20:43.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52e8066280 msgr2=0x7f52e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52e8066280 0x7f52e8068730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0ad000 tx=0x7f52ec0a4f90 comp rx=0 tx=0).stop 2023-07-09T02:20:43.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0cbbb0 msgr2=0x7f52fc15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:43.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0cbbb0 0x7f52fc15a660 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c490 tx=0x7f52f000c950 comp rx=0 tx=0).stop 2023-07-09T02:20:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 shutdown_connections 2023-07-09T02:20:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52fc15db00 0x7f52fc15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52fc0cbbb0 0x7f52fc15a660 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f52e8066280 0x7f52e8068730 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 --2- 172.21.15.45:0/3041510316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52fc0ca0f0 0x7f52fc0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 >> 172.21.15.45:0/3041510316 conn(0x7f52fc0694b0 msgr2=0x7f52fc0c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 shutdown_connections 2023-07-09T02:20:43.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:43.970+0000 7f5301c34640 1 -- 172.21.15.45:0/3041510316 wait complete. 2023-07-09T02:20:43.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:20:44.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f007a6d8640 1 Processor -- start 2023-07-09T02:20:44.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f007a6d8640 1 -- start start 2023-07-09T02:20:44.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f007a6d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f007415c060 0x7f00740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f007a6d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0074160a50 con 0x7f00740cd120 2023-07-09T02:20:44.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f007a6d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007415c430 con 0x7f00740d2620 2023-07-09T02:20:44.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f007a6d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007415fb60 con 0x7f007415c060 2023-07-09T02:20:44.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f00737fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f00740cd120 0x7f00740d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40206/0 (socket says 172.21.15.45:40206) 2023-07-09T02:20:44.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f00737fe640 1 -- 172.21.15.45:0/3177758717 learned_addr learned my addr 172.21.15.45:0/3177758717 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:44.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0073fff640 1 --2- 172.21.15.45:0/3177758717 >> v2:172.21.15.155:3300/0 conn(0x7f007415c060 0x7f00740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533817818 0 0) 0x7f0074160a50 con 0x7f00740cd120 2023-07-09T02:20:44.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c003530 con 0x7f00740cd120 2023-07-09T02:20:44.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689601850 0 0) 0x7f007415c430 con 0x7f00740d2620 2023-07-09T02:20:44.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0074160a50 con 0x7f00740d2620 2023-07-09T02:20:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714282888 0 0) 0x7f005c003530 con 0x7f00740cd120 2023-07-09T02:20:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 >> v2:172.21.15.155:3300/0 conn(0x7f007415c060 msgr2=0x7f00740b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 --2- 172.21.15.45:0/3177758717 >> v2:172.21.15.155:3300/0 conn(0x7f007415c060 0x7f00740b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 >> v1:172.21.15.155:6789/0 conn(0x7f00740d2620 legacy=0x7f00740cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007415fe40 con 0x7f00740cd120 2023-07-09T02:20:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f0068001680 con 0x7f00740cd120 2023-07-09T02:20:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0073fff640 1 --2- 172.21.15.45:0/3177758717 >> v2:172.21.15.155:3300/0 conn(0x7f007415c060 0x7f00740b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 >> v1:172.21.15.45:6789/0 conn(0x7f00740cd120 legacy=0x7f00740d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c003b10 0x7f005c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0047d0 0x7f005c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.134+0000 7f0072ffd640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c005180 0x7f005c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007415fb60 con 0x7f005c005180 2023-07-09T02:20:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c00bfe0 con 0x7f005c0047d0 2023-07-09T02:20:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c00c1a0 con 0x7f005c003b10 2023-07-09T02:20:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0078c75640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c005180 0x7f005c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f00737fe640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0047d0 0x7f005c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0073fff640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c003b10 0x7f005c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0078c75640 1 -- 172.21.15.45:0/3177758717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c003b10 msgr2=0x7f005c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:44.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0078c75640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c003b10 0x7f005c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0078c75640 1 -- 172.21.15.45:0/3177758717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0047d0 msgr2=0x7f005c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:44.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0078c75640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0047d0 0x7f005c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0078c75640 1 -- 172.21.15.45:0/3177758717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c003530 con 0x7f005c005180 2023-07-09T02:20:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0078c75640 1 -- 172.21.15.45:0/3177758717 reap_dead start 2023-07-09T02:20:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0078c75640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c005180 0x7f005c00b990 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f007406b140 tx=0x7f006c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3415fb34cde7750c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068007ea0 con 0x7f005c005180 2023-07-09T02:20:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c003b80 con 0x7f005c005180 2023-07-09T02:20:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.138+0000 7f0072ffd640 1 -- 172.21.15.45:0/3177758717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0050d0 con 0x7f005c005180 2023-07-09T02:20:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- 172.21.15.45:0/3177758717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c005180 msgr2=0x7f005c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c005180 0x7f005c00b990 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f007406b140 tx=0x7f006c01c880 comp rx=0 tx=0).stop 2023-07-09T02:20:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- 172.21.15.45:0/3177758717 shutdown_connections 2023-07-09T02:20:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 --2- 172.21.15.45:0/3177758717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c005180 0x7f005c00b990 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- 172.21.15.45:0/3177758717 >> 172.21.15.45:0/3177758717 conn(0x7f00740698e0 msgr2=0x7f0074069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- 172.21.15.45:0/3177758717 shutdown_connections 2023-07-09T02:20:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- 172.21.15.45:0/3177758717 wait complete. 2023-07-09T02:20:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 Processor -- start 2023-07-09T02:20:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- start start 2023-07-09T02:20:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c005180 0x7f00741f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00741f4ec0 0x7f00741f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00741f5870 0x7f007414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00741f5ce0 con 0x7f00741f5870 2023-07-09T02:20:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740cc4d0 con 0x7f005c005180 2023-07-09T02:20:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f007a6d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740cb950 con 0x7f00741f4ec0 2023-07-09T02:20:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f0078c75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00741f5870 0x7f007414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f0078c75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00741f5870 0x7f007414a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46734/0 (socket says 172.21.15.45:46734) 2023-07-09T02:20:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.142+0000 7f0078c75640 1 -- 172.21.15.45:0/4187688561 learned_addr learned my addr 172.21.15.45:0/4187688561 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0073fff640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c005180 0x7f00741f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f00737fe640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00741f4ec0 0x7f00741f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0078c75640 1 -- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00741f4ec0 msgr2=0x7f00741f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0078c75640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00741f4ec0 0x7f00741f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0078c75640 1 -- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c005180 msgr2=0x7f00741f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0078c75640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c005180 0x7f00741f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0078c75640 1 -- 172.21.15.45:0/4187688561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740cbc30 con 0x7f00741f5870 2023-07-09T02:20:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0073fff640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c005180 0x7f00741f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0078c75640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00741f5870 0x7f007414a6a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f006c01d120 tx=0x7f005c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0070ff9640 1 -- 172.21.15.45:0/4187688561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0ae070 con 0x7f00741f5870 2023-07-09T02:20:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0070ff9640 1 -- 172.21.15.45:0/4187688561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c003980 con 0x7f00741f5870 2023-07-09T02:20:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0070ff9640 1 -- 172.21.15.45:0/4187688561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c006d60 con 0x7f00741f5870 2023-07-09T02:20:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00740cbf10 con 0x7f00741f5870 2023-07-09T02:20:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00741f1670 con 0x7f00741f5870 2023-07-09T02:20:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074148650 con 0x7f00741f5870 2023-07-09T02:20:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.146+0000 7f0070ff9640 1 -- 172.21.15.45:0/4187688561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f006c0a6470 con 0x7f00741f5870 2023-07-09T02:20:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.150+0000 7f0070ff9640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0060066280 0x7f0060068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.150+0000 7f0070ff9640 1 -- 172.21.15.45:0/4187688561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f006c11ccc0 con 0x7f00741f5870 2023-07-09T02:20:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.150+0000 7f0070ff9640 1 -- 172.21.15.45:0/4187688561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f006006e3c0 con 0x7f00741f5870 2023-07-09T02:20:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.150+0000 7f0073fff640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0060066280 0x7f0060068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.150+0000 7f0073fff640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0060066280 0x7f0060068730 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0064009cf0 tx=0x7f0064008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.154+0000 7f0070ff9640 1 -- 172.21.15.45:0/4187688561 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0074148650 con 0x7f00741f5870 2023-07-09T02:20:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.306+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0074148650 con 0x7f00741f5870 2023-07-09T02:20:44.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.306+0000 7f0070ff9640 1 -- 172.21.15.45:0/4187688561 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0074148650 con 0x7f00741f5870 2023-07-09T02:20:44.305 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:20:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.306+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0060066280 msgr2=0x7f0060068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.306+0000 7f007a6d8640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0060066280 0x7f0060068730 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0064009cf0 tx=0x7f0064008040 comp rx=0 tx=0).stop 2023-07-09T02:20:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.306+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00741f5870 msgr2=0x7f007414a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.306+0000 7f007a6d8640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00741f5870 0x7f007414a6a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f006c01d120 tx=0x7f005c005800 comp rx=0 tx=0).stop 2023-07-09T02:20:44.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.310+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 shutdown_connections 2023-07-09T02:20:44.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.310+0000 7f007a6d8640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00741f5870 0x7f007414a6a0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.310+0000 7f007a6d8640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0060066280 0x7f0060068730 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.310+0000 7f007a6d8640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00741f4ec0 0x7f00741f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.310+0000 7f007a6d8640 1 --2- 172.21.15.45:0/4187688561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c005180 0x7f00741f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.310+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 >> 172.21.15.45:0/4187688561 conn(0x7f00740698e0 msgr2=0x7f00740b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:44.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.310+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 shutdown_connections 2023-07-09T02:20:44.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.310+0000 7f007a6d8640 1 -- 172.21.15.45:0/4187688561 wait complete. 2023-07-09T02:20:44.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:20:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15ced3a640 1 Processor -- start 2023-07-09T02:20:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15ced3a640 1 -- start start 2023-07-09T02:20:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15ced3a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15c80d2620 0x7f15c80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15ced3a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c8160a50 con 0x7f15c815c060 2023-07-09T02:20:44.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15ced3a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c815c430 con 0x7f15c80cd120 2023-07-09T02:20:44.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15ced3a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c815fb60 con 0x7f15c80d2620 2023-07-09T02:20:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15c7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15c80d2620 0x7f15c80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15c7fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15c80d2620 0x7f15c80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46746/0 (socket says 172.21.15.45:46746) 2023-07-09T02:20:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15ccad6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f15c815c060 0x7f15c80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40222/0 (socket says 172.21.15.45:40222) 2023-07-09T02:20:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.474+0000 7f15c7fff640 1 -- 172.21.15.45:0/1913542485 learned_addr learned my addr 172.21.15.45:0/1913542485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.478+0000 7f15c7fff640 1 -- 172.21.15.45:0/1913542485 >> v1:172.21.15.155:6789/0 conn(0x7f15c80cd120 legacy=0x7f15c80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.478+0000 7f15c77fe640 1 -- 172.21.15.45:0/1913542485 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619000101 0 0) 0x7f15c8160a50 con 0x7f15c815c060 2023-07-09T02:20:44.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.478+0000 7f15c7fff640 1 -- 172.21.15.45:0/1913542485 >> v1:172.21.15.45:6789/0 conn(0x7f15c815c060 legacy=0x7f15c80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.478+0000 7f15c7fff640 1 -- 172.21.15.45:0/1913542485 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c815fe40 con 0x7f15c80d2620 2023-07-09T02:20:44.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.478+0000 7f15c7fff640 1 --2- 172.21.15.45:0/1913542485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80b4ed0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009870 tx=0x7f15b401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a37765ad599d862 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.478+0000 7f15c77fe640 1 -- 172.21.15.45:0/1913542485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40aa670 con 0x7f15c80d2620 2023-07-09T02:20:44.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.478+0000 7f15c77fe640 1 -- 172.21.15.45:0/1913542485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b40aa7d0 con 0x7f15c80d2620 2023-07-09T02:20:44.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.478+0000 7f15c77fe640 1 -- 172.21.15.45:0/1913542485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40aab60 con 0x7f15c80d2620 2023-07-09T02:20:44.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- 172.21.15.45:0/1913542485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 msgr2=0x7f15c80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 --2- 172.21.15.45:0/1913542485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80b4ed0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009870 tx=0x7f15b401c510 comp rx=0 tx=0).stop 2023-07-09T02:20:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- 172.21.15.45:0/1913542485 shutdown_connections 2023-07-09T02:20:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 --2- 172.21.15.45:0/1913542485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80b4ed0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- 172.21.15.45:0/1913542485 >> 172.21.15.45:0/1913542485 conn(0x7f15c80698e0 msgr2=0x7f15c8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- 172.21.15.45:0/1913542485 shutdown_connections 2023-07-09T02:20:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- 172.21.15.45:0/1913542485 wait complete. 2023-07-09T02:20:44.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 Processor -- start 2023-07-09T02:20:44.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- start start 2023-07-09T02:20:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15c80cd120 0x7f15c8161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c815c060 0x7f15c8163800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80cba30 con 0x7f15c80d2620 2023-07-09T02:20:44.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8165ce0 con 0x7f15c815c060 2023-07-09T02:20:44.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ced3a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c80caef0 con 0x7f15c80cd120 2023-07-09T02:20:44.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15c7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46758/0 (socket says 172.21.15.45:46758) 2023-07-09T02:20:44.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15c7fff640 1 -- 172.21.15.45:0/2864388915 learned_addr learned my addr 172.21.15.45:0/2864388915 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:44.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15ccad6640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15c80cd120 0x7f15c8161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15cd2d7640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c815c060 0x7f15c8163800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15c7fff640 1 -- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15c80cd120 msgr2=0x7f15c8161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15c7fff640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15c80cd120 0x7f15c8161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15c7fff640 1 -- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c815c060 msgr2=0x7f15c8163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15c7fff640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c815c060 0x7f15c8163800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.482+0000 7f15c7fff640 1 -- 172.21.15.45:0/2864388915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40094d0 con 0x7f15c80d2620 2023-07-09T02:20:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15c7fff640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80ca9b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f15b4019120 tx=0x7f15b401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15c57fa640 1 -- 172.21.15.45:0/2864388915 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40b38c0 con 0x7f15c80d2620 2023-07-09T02:20:44.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15c57fa640 1 -- 172.21.15.45:0/2864388915 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b40b3a20 con 0x7f15c80d2620 2023-07-09T02:20:44.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15c57fa640 1 -- 172.21.15.45:0/2864388915 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40b3dd0 con 0x7f15c80d2620 2023-07-09T02:20:44.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c80b59f0 con 0x7f15c80d2620 2023-07-09T02:20:44.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c80cb470 con 0x7f15c80d2620 2023-07-09T02:20:44.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c8165e20 con 0x7f15c80d2620 2023-07-09T02:20:44.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15c57fa640 1 -- 172.21.15.45:0/2864388915 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15b40c6440 con 0x7f15c80d2620 2023-07-09T02:20:44.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15c57fa640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15ac066280 0x7f15ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15c57fa640 1 -- 172.21.15.45:0/2864388915 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15b411ec60 con 0x7f15c80d2620 2023-07-09T02:20:44.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15c57fa640 1 -- 172.21.15.45:0/2864388915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f15ac06e3c0 con 0x7f15c80d2620 2023-07-09T02:20:44.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.486+0000 7f15ccad6640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15ac066280 0x7f15ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.490+0000 7f15ccad6640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15ac066280 0x7f15ac068730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f15bc000f70 tx=0x7f15bc007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.490+0000 7f15c57fa640 1 -- 172.21.15.45:0/2864388915 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15c8165e20 con 0x7f15c80d2620 2023-07-09T02:20:44.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.646+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15c8165e20 con 0x7f15c80d2620 2023-07-09T02:20:44.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.646+0000 7f15c57fa640 1 -- 172.21.15.45:0/2864388915 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15c8165e20 con 0x7f15c80d2620 2023-07-09T02:20:44.646 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:20:44.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15ac066280 msgr2=0x7f15ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15ac066280 0x7f15ac068730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f15bc000f70 tx=0x7f15bc007d30 comp rx=0 tx=0).stop 2023-07-09T02:20:44.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 msgr2=0x7f15c80ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80ca9b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f15b4019120 tx=0x7f15b401ad50 comp rx=0 tx=0).stop 2023-07-09T02:20:44.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 shutdown_connections 2023-07-09T02:20:44.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c815c060 0x7f15c8163800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15c80d2620 0x7f15c80ca9b0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f15ac066280 0x7f15ac068730 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 --2- 172.21.15.45:0/2864388915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15c80cd120 0x7f15c8161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 >> 172.21.15.45:0/2864388915 conn(0x7f15c80698e0 msgr2=0x7f15c815e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:44.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 shutdown_connections 2023-07-09T02:20:44.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.650+0000 7f15ced3a640 1 -- 172.21.15.45:0/2864388915 wait complete. 2023-07-09T02:20:44.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:20:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e8510d640 1 Processor -- start 2023-07-09T02:20:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e8510d640 1 -- start start 2023-07-09T02:20:44.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e8510d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800ca0f0 0x7f0e800cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e8510d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e800cbbb0 0x7f0e800c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e8510d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8006bf30 con 0x7f0e800c9250 2023-07-09T02:20:44.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e8510d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8006bc50 con 0x7f0e800cbbb0 2023-07-09T02:20:44.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e8510d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800cab90 con 0x7f0e800ca0f0 2023-07-09T02:20:44.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e77fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e800cbbb0 0x7f0e800c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e77fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e800cbbb0 0x7f0e800c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46766/0 (socket says 172.21.15.45:46766) 2023-07-09T02:20:44.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.814+0000 7f0e77fff640 1 -- 172.21.15.45:0/2291056100 learned_addr learned my addr 172.21.15.45:0/2291056100 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:44.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e7ed9d640 1 --2- 172.21.15.45:0/2291056100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800ca0f0 0x7f0e800cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e77fff640 1 -- 172.21.15.45:0/2291056100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800ca0f0 msgr2=0x7f0e800cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:44.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e77fff640 1 --2- 172.21.15.45:0/2291056100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800ca0f0 0x7f0e800cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e77fff640 1 -- 172.21.15.45:0/2291056100 >> v1:172.21.15.45:6789/0 conn(0x7f0e800c9250 legacy=0x7f0e8015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e77fff640 1 -- 172.21.15.45:0/2291056100 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800cae70 con 0x7f0e800cbbb0 2023-07-09T02:20:44.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e7ed9d640 1 --2- 172.21.15.45:0/2291056100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800ca0f0 0x7f0e800cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:44.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e77fff640 1 --2- 172.21.15.45:0/2291056100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800cbbb0 0x7f0e800c8d10 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009870 tx=0x7f0e6801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610516c926231cdd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e7e59c640 1 -- 172.21.15.45:0/2291056100 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e680ac620 con 0x7f0e800cbbb0 2023-07-09T02:20:44.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e7e59c640 1 -- 172.21.15.45:0/2291056100 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e680ac780 con 0x7f0e800cbbb0 2023-07-09T02:20:44.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.818+0000 7f0e7e59c640 1 -- 172.21.15.45:0/2291056100 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e680acb10 con 0x7f0e800cbbb0 2023-07-09T02:20:44.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- 172.21.15.45:0/2291056100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800cbbb0 msgr2=0x7f0e800c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 --2- 172.21.15.45:0/2291056100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800cbbb0 0x7f0e800c8d10 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0e68009870 tx=0x7f0e6801c4b0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- 172.21.15.45:0/2291056100 shutdown_connections 2023-07-09T02:20:44.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 --2- 172.21.15.45:0/2291056100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800cbbb0 0x7f0e800c8d10 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 --2- 172.21.15.45:0/2291056100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800ca0f0 0x7f0e800cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- 172.21.15.45:0/2291056100 >> 172.21.15.45:0/2291056100 conn(0x7f0e800694b0 msgr2=0x7f0e800698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:44.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- 172.21.15.45:0/2291056100 shutdown_connections 2023-07-09T02:20:44.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- 172.21.15.45:0/2291056100 wait complete. 2023-07-09T02:20:44.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 Processor -- start 2023-07-09T02:20:44.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- start start 2023-07-09T02:20:44.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800c9250 0x7f0e8014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800ca0f0 0x7f0e80158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e800cbbb0 0x7f0e80159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80152ef0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80152b50 con 0x7f0e800cbbb0 2023-07-09T02:20:44.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e8510d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8014cf90 con 0x7f0e800c9250 2023-07-09T02:20:44.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800ca0f0 0x7f0e80158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800ca0f0 0x7f0e80158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46768/0 (socket says 172.21.15.45:46768) 2023-07-09T02:20:44.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e77fff640 1 -- 172.21.15.45:0/206557060 learned_addr learned my addr 172.21.15.45:0/206557060 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:44.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e77fff640 1 -- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800c9250 msgr2=0x7f0e8014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e77fff640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800c9250 0x7f0e8014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e77fff640 1 -- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e800cbbb0 msgr2=0x7f0e80159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e77fff640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e800cbbb0 0x7f0e80159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.822+0000 7f0e77fff640 1 -- 172.21.15.45:0/206557060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680094d0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e77fff640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800ca0f0 0x7f0e80158f50 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f0e680af040 tx=0x7f0e68019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e777fe640 1 -- 172.21.15.45:0/206557060 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e680b5640 con 0x7f0e800ca0f0 2023-07-09T02:20:44.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e777fe640 1 -- 172.21.15.45:0/206557060 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e680b57c0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e800cdab0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e777fe640 1 -- 172.21.15.45:0/206557060 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e680b5b70 con 0x7f0e800ca0f0 2023-07-09T02:20:44.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e800ce070 con 0x7f0e800ca0f0 2023-07-09T02:20:44.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e80152cc0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e777fe640 1 -- 172.21.15.45:0/206557060 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e680b3070 con 0x7f0e800ca0f0 2023-07-09T02:20:44.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e777fe640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e60066280 0x7f0e60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:44.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e777fe640 1 -- 172.21.15.45:0/206557060 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e6811e060 con 0x7f0e800ca0f0 2023-07-09T02:20:44.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e777fe640 1 -- 172.21.15.45:0/206557060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f0e6006e3c0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.826+0000 7f0e7ed9d640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e60066280 0x7f0e60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:44.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.830+0000 7f0e7ed9d640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e60066280 0x7f0e60068730 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0e70006e90 tx=0x7f0e70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:44.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.830+0000 7f0e777fe640 1 -- 172.21.15.45:0/206557060 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e80152cc0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e80152cc0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e777fe640 1 -- 172.21.15.45:0/206557060 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e80152cc0 con 0x7f0e800ca0f0 2023-07-09T02:20:44.985 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:20:44.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e60066280 msgr2=0x7f0e60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e60066280 0x7f0e60068730 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0e70006e90 tx=0x7f0e70008040 comp rx=0 tx=0).stop 2023-07-09T02:20:44.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800ca0f0 msgr2=0x7f0e80158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:44.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800ca0f0 0x7f0e80158f50 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f0e680af040 tx=0x7f0e68019250 comp rx=0 tx=0).stop 2023-07-09T02:20:44.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 shutdown_connections 2023-07-09T02:20:44.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e800cbbb0 0x7f0e80159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e800ca0f0 0x7f0e80158f50 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0e60066280 0x7f0e60068730 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 --2- 172.21.15.45:0/206557060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e800c9250 0x7f0e8014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:44.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 >> 172.21.15.45:0/206557060 conn(0x7f0e800694b0 msgr2=0x7f0e800b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:44.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 shutdown_connections 2023-07-09T02:20:44.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:44.986+0000 7f0e8510d640 1 -- 172.21.15.45:0/206557060 wait complete. 2023-07-09T02:20:45.006 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:20:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.150+0000 7f4845634640 1 Processor -- start 2023-07-09T02:20:45.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.150+0000 7f4845634640 1 -- start start 2023-07-09T02:20:45.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.150+0000 7f4845634640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48400cd120 0x7f48400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.150+0000 7f4845634640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4840160a50 con 0x7f48400d2620 2023-07-09T02:20:45.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.150+0000 7f4845634640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484015c430 con 0x7f484015c060 2023-07-09T02:20:45.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.150+0000 7f4845634640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484015fb60 con 0x7f48400cd120 2023-07-09T02:20:45.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.150+0000 7f4837fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f48400d2620 0x7f48400cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40242/0 (socket says 172.21.15.45:40242) 2023-07-09T02:20:45.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.150+0000 7f4837fff640 1 -- 172.21.15.45:0/3581631729 learned_addr learned my addr 172.21.15.45:0/3581631729 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:45.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483f7fe640 1 --2- 172.21.15.45:0/3581631729 >> v2:172.21.15.155:3300/0 conn(0x7f48400cd120 0x7f48400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483e7fc640 1 -- 172.21.15.45:0/3581631729 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252782532 0 0) 0x7f4840160a50 con 0x7f48400d2620 2023-07-09T02:20:45.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483e7fc640 1 -- 172.21.15.45:0/3581631729 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482c003530 con 0x7f48400d2620 2023-07-09T02:20:45.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483f7fe640 1 -- 172.21.15.45:0/3581631729 >> v1:172.21.15.155:6789/0 conn(0x7f484015c060 legacy=0x7f48400d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483f7fe640 1 -- 172.21.15.45:0/3581631729 >> v1:172.21.15.45:6789/0 conn(0x7f48400d2620 legacy=0x7f48400cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483f7fe640 1 -- 172.21.15.45:0/3581631729 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484015fe40 con 0x7f48400cd120 2023-07-09T02:20:45.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483f7fe640 1 --2- 172.21.15.45:0/3581631729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 0x7f48400b4ed0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4838009d90 tx=0x7f483801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d3ed42d7adf083 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:45.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483e7fc640 1 -- 172.21.15.45:0/3581631729 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380a59e0 con 0x7f48400cd120 2023-07-09T02:20:45.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483e7fc640 1 -- 172.21.15.45:0/3581631729 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48380a5b40 con 0x7f48400cd120 2023-07-09T02:20:45.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.154+0000 7f483e7fc640 1 -- 172.21.15.45:0/3581631729 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380ad440 con 0x7f48400cd120 2023-07-09T02:20:45.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- 172.21.15.45:0/3581631729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 msgr2=0x7f48400b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 --2- 172.21.15.45:0/3581631729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 0x7f48400b4ed0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4838009d90 tx=0x7f483801c920 comp rx=0 tx=0).stop 2023-07-09T02:20:45.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- 172.21.15.45:0/3581631729 shutdown_connections 2023-07-09T02:20:45.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 --2- 172.21.15.45:0/3581631729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 0x7f48400b4ed0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- 172.21.15.45:0/3581631729 >> 172.21.15.45:0/3581631729 conn(0x7f48400698e0 msgr2=0x7f4840069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:45.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- 172.21.15.45:0/3581631729 shutdown_connections 2023-07-09T02:20:45.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- 172.21.15.45:0/3581631729 wait complete. 2023-07-09T02:20:45.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 Processor -- start 2023-07-09T02:20:45.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- start start 2023-07-09T02:20:45.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 0x7f484015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48400d2620 0x7f484015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484015c060 0x7f4840151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4840159410 con 0x7f48400d2620 2023-07-09T02:20:45.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484015ec10 con 0x7f48400cd120 2023-07-09T02:20:45.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4845634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484015eef0 con 0x7f484015c060 2023-07-09T02:20:45.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4837fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48400d2620 0x7f484015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4837fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48400d2620 0x7f484015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46782/0 (socket says 172.21.15.45:46782) 2023-07-09T02:20:45.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f4837fff640 1 -- 172.21.15.45:0/661817894 learned_addr learned my addr 172.21.15.45:0/661817894 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:45.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f483effd640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 0x7f484015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.158+0000 7f483f7fe640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484015c060 0x7f4840151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4837fff640 1 -- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484015c060 msgr2=0x7f4840151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4837fff640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484015c060 0x7f4840151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4837fff640 1 -- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 msgr2=0x7f484015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4837fff640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 0x7f484015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4837fff640 1 -- 172.21.15.45:0/661817894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838009a70 con 0x7f48400d2620 2023-07-09T02:20:45.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4837fff640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48400d2620 0x7f484015b320 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f4828001ec0 tx=0x7f482800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:45.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f48377fe640 1 -- 172.21.15.45:0/661817894 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828005d50 con 0x7f48400d2620 2023-07-09T02:20:45.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f48377fe640 1 -- 172.21.15.45:0/661817894 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4828007070 con 0x7f48400d2620 2023-07-09T02:20:45.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48400b59f0 con 0x7f48400d2620 2023-07-09T02:20:45.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f48377fe640 1 -- 172.21.15.45:0/661817894 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828007420 con 0x7f48400d2620 2023-07-09T02:20:45.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484015f4b0 con 0x7f48400d2620 2023-07-09T02:20:45.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484004d7d0 con 0x7f48400d2620 2023-07-09T02:20:45.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f48377fe640 1 -- 172.21.15.45:0/661817894 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4828007580 con 0x7f48400d2620 2023-07-09T02:20:45.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f48377fe640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4820066280 0x7f4820068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f48377fe640 1 -- 172.21.15.45:0/661817894 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4828083310 con 0x7f48400d2620 2023-07-09T02:20:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.162+0000 7f48377fe640 1 -- 172.21.15.45:0/661817894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f482006e3c0 con 0x7f48400d2620 2023-07-09T02:20:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.166+0000 7f483effd640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4820066280 0x7f4820068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.166+0000 7f483effd640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4820066280 0x7f4820068730 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4830001770 tx=0x7f4830009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:45.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.166+0000 7f48377fe640 1 -- 172.21.15.45:0/661817894 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4828050860 con 0x7f48400d2620 2023-07-09T02:20:45.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.330+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f484006baa0 con 0x7f48400d2620 2023-07-09T02:20:45.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.330+0000 7f48377fe640 1 -- 172.21.15.45:0/661817894 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v155) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4828017020 con 0x7f48400d2620 2023-07-09T02:20:45.331 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:20:45.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4820066280 msgr2=0x7f4820068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4820066280 0x7f4820068730 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4830001770 tx=0x7f4830009040 comp rx=0 tx=0).stop 2023-07-09T02:20:45.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48400d2620 msgr2=0x7f484015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48400d2620 0x7f484015b320 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f4828001ec0 tx=0x7f482800c960 comp rx=0 tx=0).stop 2023-07-09T02:20:45.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 shutdown_connections 2023-07-09T02:20:45.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4820066280 0x7f4820068730 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f484015c060 0x7f4840151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48400d2620 0x7f484015b320 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 --2- 172.21.15.45:0/661817894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48400cd120 0x7f484015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 >> 172.21.15.45:0/661817894 conn(0x7f48400698e0 msgr2=0x7f48400b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:45.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 shutdown_connections 2023-07-09T02:20:45.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.334+0000 7f4845634640 1 -- 172.21.15.45:0/661817894 wait complete. 2023-07-09T02:20:45.351 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:20:45.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:20:45.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:20:45.419 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:20:45.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:20:45.420 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:20:45.430 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:20:45.431 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:45.441 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:20:45.441 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:45.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:20:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.638+0000 7f8842112640 1 Processor -- start 2023-07-09T02:20:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f8842112640 1 -- start start 2023-07-09T02:20:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f8842112640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f883c15c870 0x7f883c0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f8842112640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f883c0b1b50 0x7f883c06b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f8842112640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c06bbb0 con 0x7f883c06b780 2023-07-09T02:20:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f8842112640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c0d1d80 con 0x7f883c0b1b50 2023-07-09T02:20:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f8842112640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c0b2090 con 0x7f883c15c870 2023-07-09T02:20:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f884090f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f883c0b1b50 0x7f883c06b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f884090f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f883c0b1b50 0x7f883c06b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46792/0 (socket says 172.21.15.45:46792) 2023-07-09T02:20:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f884090f640 1 -- 172.21.15.45:0/530625182 learned_addr learned my addr 172.21.15.45:0/530625182 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f884090f640 1 -- 172.21.15.45:0/530625182 >> v2:172.21.15.155:3300/0 conn(0x7f883c15c870 msgr2=0x7f883c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f8841110640 1 --2- 172.21.15.45:0/530625182 >> v2:172.21.15.155:3300/0 conn(0x7f883c15c870 0x7f883c0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f884090f640 1 --2- 172.21.15.45:0/530625182 >> v2:172.21.15.155:3300/0 conn(0x7f883c15c870 0x7f883c0b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f884090f640 1 -- 172.21.15.45:0/530625182 >> v1:172.21.15.155:6789/0 conn(0x7f883c06b780 legacy=0x7f883c0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f884090f640 1 -- 172.21.15.45:0/530625182 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c160520 con 0x7f883c0b1b50 2023-07-09T02:20:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.642+0000 7f8841110640 1 --2- 172.21.15.45:0/530625182 >> v2:172.21.15.155:3300/0 conn(0x7f883c15c870 0x7f883c0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f884090f640 1 --2- 172.21.15.45:0/530625182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c06b240 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f883c0cf340 tx=0x7f882c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409801d074e252d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8833fff640 1 -- 172.21.15.45:0/530625182 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab5f0 con 0x7f883c0b1b50 2023-07-09T02:20:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8833fff640 1 -- 172.21.15.45:0/530625182 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c0ab750 con 0x7f883c0b1b50 2023-07-09T02:20:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8833fff640 1 -- 172.21.15.45:0/530625182 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0abae0 con 0x7f883c0b1b50 2023-07-09T02:20:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 -- 172.21.15.45:0/530625182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 msgr2=0x7f883c06b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 --2- 172.21.15.45:0/530625182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c06b240 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f883c0cf340 tx=0x7f882c01c4d0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 -- 172.21.15.45:0/530625182 shutdown_connections 2023-07-09T02:20:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 --2- 172.21.15.45:0/530625182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c06b240 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 --2- 172.21.15.45:0/530625182 >> v2:172.21.15.155:3300/0 conn(0x7f883c15c870 0x7f883c0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 -- 172.21.15.45:0/530625182 >> 172.21.15.45:0/530625182 conn(0x7f883c070be0 msgr2=0x7f883c070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 -- 172.21.15.45:0/530625182 shutdown_connections 2023-07-09T02:20:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 -- 172.21.15.45:0/530625182 wait complete. 2023-07-09T02:20:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.646+0000 7f8842112640 1 Processor -- start 2023-07-09T02:20:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 -- start start 2023-07-09T02:20:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c06b780 0x7f883c0b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883c15c870 0x7f883c0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c15d660 con 0x7f883c0b1b50 2023-07-09T02:20:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0b7160 con 0x7f883c06b780 2023-07-09T02:20:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0b6830 con 0x7f883c15c870 2023-07-09T02:20:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c14dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46806/0 (socket says 172.21.15.45:46806) 2023-07-09T02:20:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 -- 172.21.15.45:0/211951285 learned_addr learned my addr 172.21.15.45:0/211951285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8841110640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c06b780 0x7f883c0b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 -- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883c15c870 msgr2=0x7f883c0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8841911640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883c15c870 0x7f883c0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883c15c870 0x7f883c0b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 -- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c06b780 msgr2=0x7f883c0b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c06b780 0x7f883c0b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 -- 172.21.15.45:0/211951285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0094d0 con 0x7f883c0b1b50 2023-07-09T02:20:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8841110640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c06b780 0x7f883c0b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8841911640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883c15c870 0x7f883c0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f884090f640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c14dad0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f882c01c9b0 tx=0x7f882c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8831ffb640 1 -- 172.21.15.45:0/211951285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0b4800 con 0x7f883c0b1b50 2023-07-09T02:20:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8831ffb640 1 -- 172.21.15.45:0/211951285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c0b4960 con 0x7f883c0b1b50 2023-07-09T02:20:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c0b6270 con 0x7f883c0b1b50 2023-07-09T02:20:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8831ffb640 1 -- 172.21.15.45:0/211951285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0b4d10 con 0x7f883c0b1b50 2023-07-09T02:20:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c15d280 con 0x7f883c0b1b50 2023-07-09T02:20:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.650+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c15d7a0 con 0x7f883c0b1b50 2023-07-09T02:20:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.654+0000 7f8831ffb640 1 -- 172.21.15.45:0/211951285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f882c0c7440 con 0x7f883c0b1b50 2023-07-09T02:20:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.654+0000 7f8831ffb640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8820066280 0x7f8820068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.654+0000 7f8831ffb640 1 -- 172.21.15.45:0/211951285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f882c0a8050 con 0x7f883c0b1b50 2023-07-09T02:20:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.654+0000 7f8831ffb640 1 -- 172.21.15.45:0/211951285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f882006e3c0 con 0x7f883c0b1b50 2023-07-09T02:20:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.654+0000 7f8841110640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8820066280 0x7f8820068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.654+0000 7f8841110640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8820066280 0x7f8820068730 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f883c155e50 tx=0x7f8838008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:45.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.658+0000 7f8831ffb640 1 -- 172.21.15.45:0/211951285 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f883c15d7a0 con 0x7f883c0b1b50 2023-07-09T02:20:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.818+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f883c15d7a0 con 0x7f883c0b1b50 2023-07-09T02:20:45.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8831ffb640 1 -- 172.21.15.45:0/211951285 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18337 (secure 0 0 0) 0x7f883c15d7a0 con 0x7f883c0b1b50 2023-07-09T02:20:45.819 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:45.819 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":155,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:19:54.428525+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:18:40.756512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T02:18:42.013313+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:20:45.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8820066280 msgr2=0x7f8820068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8820066280 0x7f8820068730 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f883c155e50 tx=0x7f8838008040 comp rx=0 tx=0).stop 2023-07-09T02:20:45.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 msgr2=0x7f883c14dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c14dad0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f882c01c9b0 tx=0x7f882c01ad10 comp rx=0 tx=0).stop 2023-07-09T02:20:45.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 shutdown_connections 2023-07-09T02:20:45.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8820066280 0x7f8820068730 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883c15c870 0x7f883c0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f883c0b1b50 0x7f883c14dad0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 --2- 172.21.15.45:0/211951285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883c06b780 0x7f883c0b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 >> 172.21.15.45:0/211951285 conn(0x7f883c070be0 msgr2=0x7f883c0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:45.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 shutdown_connections 2023-07-09T02:20:45.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.822+0000 7f8842112640 1 -- 172.21.15.45:0/211951285 wait complete. 2023-07-09T02:20:45.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:18:40.756512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:18:42.013313+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:20:45.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:20:45.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3191737640 1 Processor -- start 2023-07-09T02:20:45.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3191737640 1 -- start start 2023-07-09T02:20:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3191737640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0d2620 0x7f318c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3191737640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f318c0cd120 0x7f318c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3191737640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c160a50 con 0x7f318c15c060 2023-07-09T02:20:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3191737640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c15c430 con 0x7f318c0cd120 2023-07-09T02:20:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3191737640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c15fb60 con 0x7f318c0d2620 2023-07-09T02:20:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3183fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0d2620 0x7f318c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f318b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f318c0cd120 0x7f318c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f318affd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f318c15c060 0x7f318c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:52978/0 (socket says 172.21.15.45:52978) 2023-07-09T02:20:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f318affd640 1 -- 172.21.15.45:0/3256636749 learned_addr learned my addr 172.21.15.45:0/3256636749 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3183fff640 1 -- 172.21.15.45:0/3256636749 >> v2:172.21.15.155:3300/0 conn(0x7f318c0cd120 msgr2=0x7f318c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3183fff640 1 --2- 172.21.15.45:0/3256636749 >> v2:172.21.15.155:3300/0 conn(0x7f318c0cd120 0x7f318c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3183fff640 1 -- 172.21.15.45:0/3256636749 >> v1:172.21.15.155:6789/0 conn(0x7f318c15c060 legacy=0x7f318c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f3183fff640 1 -- 172.21.15.45:0/3256636749 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c15fe40 con 0x7f318c0d2620 2023-07-09T02:20:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f318b7fe640 1 --2- 172.21.15.45:0/3256636749 >> v2:172.21.15.155:3300/0 conn(0x7f318c0cd120 0x7f318c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.990+0000 7f318a7fc640 1 -- 172.21.15.45:0/3256636749 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454944122 0 0) 0x7f318c160a50 con 0x7f318c15c060 2023-07-09T02:20:45.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3183fff640 1 --2- 172.21.15.45:0/3256636749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0d2620 0x7f318c0b4ed0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f31740097c0 tx=0x7f317401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f18e6521b283f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f318a7fc640 1 -- 172.21.15.45:0/3256636749 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740ab650 con 0x7f318c0d2620 2023-07-09T02:20:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f318a7fc640 1 -- 172.21.15.45:0/3256636749 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31740ab7b0 con 0x7f318c0d2620 2023-07-09T02:20:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f318a7fc640 1 -- 172.21.15.45:0/3256636749 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740abb40 con 0x7f318c0d2620 2023-07-09T02:20:45.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3191737640 1 -- 172.21.15.45:0/3256636749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0d2620 msgr2=0x7f318c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:45.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3191737640 1 --2- 172.21.15.45:0/3256636749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0d2620 0x7f318c0b4ed0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f31740097c0 tx=0x7f317401c450 comp rx=0 tx=0).stop 2023-07-09T02:20:45.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3191737640 1 -- 172.21.15.45:0/3256636749 shutdown_connections 2023-07-09T02:20:45.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3191737640 1 --2- 172.21.15.45:0/3256636749 >> v2:172.21.15.155:3300/0 conn(0x7f318c0cd120 0x7f318c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3191737640 1 --2- 172.21.15.45:0/3256636749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c0d2620 0x7f318c0b4ed0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:45.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3191737640 1 -- 172.21.15.45:0/3256636749 >> 172.21.15.45:0/3256636749 conn(0x7f318c0698e0 msgr2=0x7f318c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:45.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3191737640 1 -- 172.21.15.45:0/3256636749 shutdown_connections 2023-07-09T02:20:45.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.994+0000 7f3191737640 1 -- 172.21.15.45:0/3256636749 wait complete. 2023-07-09T02:20:45.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 Processor -- start 2023-07-09T02:20:45.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 -- start start 2023-07-09T02:20:45.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0cd120 0x7f318c156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0d2620 0x7f318c0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c15c060 0x7f318c0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c15cbf0 con 0x7f318c0cd120 2023-07-09T02:20:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0cb250 con 0x7f318c0d2620 2023-07-09T02:20:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0cb530 con 0x7f318c15c060 2023-07-09T02:20:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0cd120 0x7f318c156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0cd120 0x7f318c156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46818/0 (socket says 172.21.15.45:46818) 2023-07-09T02:20:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 -- 172.21.15.45:0/1002227668 learned_addr learned my addr 172.21.15.45:0/1002227668 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318b7fe640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c15c060 0x7f318c0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3183fff640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0d2620 0x7f318c0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 -- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c15c060 msgr2=0x7f318c0caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c15c060 0x7f318c0caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 -- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0d2620 msgr2=0x7f318c0ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0d2620 0x7f318c0ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 -- 172.21.15.45:0/1002227668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009a70 con 0x7f318c0cd120 2023-07-09T02:20:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318b7fe640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c15c060 0x7f318c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3183fff640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0d2620 0x7f318c0ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f318affd640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0cd120 0x7f318c156b20 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f317c00c480 tx=0x7f317c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f31837fe640 1 -- 172.21.15.45:0/1002227668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c0074e0 con 0x7f318c0cd120 2023-07-09T02:20:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f31837fe640 1 -- 172.21.15.45:0/1002227668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c007660 con 0x7f318c0cd120 2023-07-09T02:20:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f31837fe640 1 -- 172.21.15.45:0/1002227668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c004a30 con 0x7f318c0cd120 2023-07-09T02:20:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3174009420 con 0x7f318c0cd120 2023-07-09T02:20:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:45.998+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c0b59f0 con 0x7f318c0cd120 2023-07-09T02:20:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.002+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c04d7d0 con 0x7f318c0cd120 2023-07-09T02:20:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.002+0000 7f31837fe640 1 -- 172.21.15.45:0/1002227668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f317c004b90 con 0x7f318c0cd120 2023-07-09T02:20:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.002+0000 7f31837fe640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f316c066280 0x7f316c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.002+0000 7f31837fe640 1 -- 172.21.15.45:0/1002227668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f317c082f30 con 0x7f318c0cd120 2023-07-09T02:20:46.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.002+0000 7f3183fff640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f316c066280 0x7f316c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.002+0000 7f31837fe640 1 -- 172.21.15.45:0/1002227668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f316c06e3c0 con 0x7f318c0cd120 2023-07-09T02:20:46.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.002+0000 7f3183fff640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f316c066280 0x7f316c068730 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f31740af000 tx=0x7f3174008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.006+0000 7f31837fe640 1 -- 172.21.15.45:0/1002227668 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f317c018070 con 0x7f318c0cd120 2023-07-09T02:20:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.158+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f318c15cd30 con 0x7f318c0cd120 2023-07-09T02:20:46.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f31837fe640 1 -- 172.21.15.45:0/1002227668 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7f318c15cd30 con 0x7f318c0cd120 2023-07-09T02:20:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:20:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f316c066280 msgr2=0x7f316c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f316c066280 0x7f316c068730 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f31740af000 tx=0x7f3174008040 comp rx=0 tx=0).stop 2023-07-09T02:20:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0cd120 msgr2=0x7f318c156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0cd120 0x7f318c156b20 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f317c00c480 tx=0x7f317c00c940 comp rx=0 tx=0).stop 2023-07-09T02:20:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 shutdown_connections 2023-07-09T02:20:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f316c066280 0x7f316c068730 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f318c15c060 0x7f318c0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f318c0d2620 0x7f318c0ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 --2- 172.21.15.45:0/1002227668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0cd120 0x7f318c156b20 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 >> 172.21.15.45:0/1002227668 conn(0x7f318c0698e0 msgr2=0x7f318c0b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 shutdown_connections 2023-07-09T02:20:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.162+0000 7f3191737640 1 -- 172.21.15.45:0/1002227668 wait complete. 2023-07-09T02:20:46.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:20:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.326+0000 7f05d47d2640 1 Processor -- start 2023-07-09T02:20:46.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.326+0000 7f05d47d2640 1 -- start start 2023-07-09T02:20:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d47d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05cc15c060 0x7f05cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d47d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05cc0d2620 0x7f05cc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d47d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc160a50 con 0x7f05cc0cd120 2023-07-09T02:20:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d47d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc15c430 con 0x7f05cc0d2620 2023-07-09T02:20:46.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d47d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc15fb60 con 0x7f05cc15c060 2023-07-09T02:20:46.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d2d6f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05cc0d2620 0x7f05cc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d2d6f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05cc0d2620 0x7f05cc0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46830/0 (socket says 172.21.15.45:46830) 2023-07-09T02:20:46.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d2d6f640 1 -- 172.21.15.45:0/4268498418 learned_addr learned my addr 172.21.15.45:0/4268498418 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:46.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d256e640 1 --2- 172.21.15.45:0/4268498418 >> v2:172.21.15.155:3300/0 conn(0x7f05cc15c060 0x7f05cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d2d6f640 1 -- 172.21.15.45:0/4268498418 >> v2:172.21.15.155:3300/0 conn(0x7f05cc15c060 msgr2=0x7f05cc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:46.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d2d6f640 1 --2- 172.21.15.45:0/4268498418 >> v2:172.21.15.155:3300/0 conn(0x7f05cc15c060 0x7f05cc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d2d6f640 1 -- 172.21.15.45:0/4268498418 >> v1:172.21.15.155:6789/0 conn(0x7f05cc0cd120 legacy=0x7f05cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.330+0000 7f05d2d6f640 1 -- 172.21.15.45:0/4268498418 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc15fe40 con 0x7f05cc0d2620 2023-07-09T02:20:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d2d6f640 1 --2- 172.21.15.45:0/4268498418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc0cee30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0d3ad0 tx=0x7f05c401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cc6e0b616a2355 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:46.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d156c640 1 -- 172.21.15.45:0/4268498418 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c40a5860 con 0x7f05cc0d2620 2023-07-09T02:20:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d156c640 1 -- 172.21.15.45:0/4268498418 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c40a59c0 con 0x7f05cc0d2620 2023-07-09T02:20:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d156c640 1 -- 172.21.15.45:0/4268498418 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c40a5d50 con 0x7f05cc0d2620 2023-07-09T02:20:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- 172.21.15.45:0/4268498418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 msgr2=0x7f05cc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 --2- 172.21.15.45:0/4268498418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc0cee30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0d3ad0 tx=0x7f05c401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- 172.21.15.45:0/4268498418 shutdown_connections 2023-07-09T02:20:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 --2- 172.21.15.45:0/4268498418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc0cee30 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 --2- 172.21.15.45:0/4268498418 >> v2:172.21.15.155:3300/0 conn(0x7f05cc15c060 0x7f05cc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- 172.21.15.45:0/4268498418 >> 172.21.15.45:0/4268498418 conn(0x7f05cc0698e0 msgr2=0x7f05cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:46.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- 172.21.15.45:0/4268498418 shutdown_connections 2023-07-09T02:20:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- 172.21.15.45:0/4268498418 wait complete. 2023-07-09T02:20:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 Processor -- start 2023-07-09T02:20:46.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- start start 2023-07-09T02:20:46.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05cc0cd120 0x7f05cc0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05cc15c060 0x7f05cc15d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc15ab80 con 0x7f05cc0d2620 2023-07-09T02:20:46.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc159ae0 con 0x7f05cc15c060 2023-07-09T02:20:46.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.334+0000 7f05d47d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc159dc0 con 0x7f05cc0cd120 2023-07-09T02:20:46.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc1590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46840/0 (socket says 172.21.15.45:46840) 2023-07-09T02:20:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 -- 172.21.15.45:0/2336032252 learned_addr learned my addr 172.21.15.45:0/2336032252 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d2d6f640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05cc15c060 0x7f05cc15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d256e640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05cc0cd120 0x7f05cc0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 -- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05cc0cd120 msgr2=0x7f05cc0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05cc0cd120 0x7f05cc0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 -- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05cc15c060 msgr2=0x7f05cc15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05cc15c060 0x7f05cc15d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 -- 172.21.15.45:0/2336032252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c4009b30 con 0x7f05cc0d2620 2023-07-09T02:20:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d1d6d640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc1590d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00c4d0 tx=0x7f05bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05c2ffd640 1 -- 172.21.15.45:0/2336032252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0052d0 con 0x7f05cc0d2620 2023-07-09T02:20:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05c2ffd640 1 -- 172.21.15.45:0/2336032252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc005430 con 0x7f05cc0d2620 2023-07-09T02:20:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05c2ffd640 1 -- 172.21.15.45:0/2336032252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc012830 con 0x7f05cc0d2620 2023-07-09T02:20:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc0b59f0 con 0x7f05cc0d2620 2023-07-09T02:20:46.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc15a380 con 0x7f05cc0d2620 2023-07-09T02:20:46.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc04d7d0 con 0x7f05cc0d2620 2023-07-09T02:20:46.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.338+0000 7f05c2ffd640 1 -- 172.21.15.45:0/2336032252 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05bc012990 con 0x7f05cc0d2620 2023-07-09T02:20:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.342+0000 7f05c2ffd640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b0066280 0x7f05b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.342+0000 7f05c2ffd640 1 -- 172.21.15.45:0/2336032252 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05bc0836a0 con 0x7f05cc0d2620 2023-07-09T02:20:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.342+0000 7f05d256e640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b0066280 0x7f05b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.342+0000 7f05c2ffd640 1 -- 172.21.15.45:0/2336032252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f05b006e3c0 con 0x7f05cc0d2620 2023-07-09T02:20:46.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.342+0000 7f05d256e640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b0066280 0x7f05b0068730 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f05cc15aed0 tx=0x7f05c8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:46.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.346+0000 7f05c2ffd640 1 -- 172.21.15.45:0/2336032252 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05bc050bc0 con 0x7f05cc0d2620 2023-07-09T02:20:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05cc06baa0 con 0x7f05cc0d2620 2023-07-09T02:20:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05c2ffd640 1 -- 172.21.15.45:0/2336032252 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05bc0541e0 con 0x7f05cc0d2620 2023-07-09T02:20:46.497 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:20:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b0066280 msgr2=0x7f05b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b0066280 0x7f05b0068730 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f05cc15aed0 tx=0x7f05c8009190 comp rx=0 tx=0).stop 2023-07-09T02:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 msgr2=0x7f05cc1590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc1590d0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00c4d0 tx=0x7f05bc00c990 comp rx=0 tx=0).stop 2023-07-09T02:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 shutdown_connections 2023-07-09T02:20:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05cc15c060 0x7f05cc15d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05cc0d2620 0x7f05cc1590d0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f05b0066280 0x7f05b0068730 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 --2- 172.21.15.45:0/2336032252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05cc0cd120 0x7f05cc0c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 >> 172.21.15.45:0/2336032252 conn(0x7f05cc0698e0 msgr2=0x7f05cc15b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 shutdown_connections 2023-07-09T02:20:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.498+0000 7f05d47d2640 1 -- 172.21.15.45:0/2336032252 wait complete. 2023-07-09T02:20:46.518 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:20:46.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a451e640 1 Processor -- start 2023-07-09T02:20:46.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a451e640 1 -- start start 2023-07-09T02:20:46.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a451e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f669c0d2620 0x7f669c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a451e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c160a50 con 0x7f669c15c060 2023-07-09T02:20:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a451e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c15c430 con 0x7f669c0cd120 2023-07-09T02:20:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a451e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c15fb60 con 0x7f669c0d2620 2023-07-09T02:20:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a22ba640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f669c15c060 0x7f669c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40252/0 (socket says 172.21.15.45:40252) 2023-07-09T02:20:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a22ba640 1 -- 172.21.15.45:0/2543796316 learned_addr learned my addr 172.21.15.45:0/2543796316 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a1ab9640 1 --2- 172.21.15.45:0/2543796316 >> v2:172.21.15.45:3300/0 conn(0x7f669c0d2620 0x7f669c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a12b8640 1 -- 172.21.15.45:0/2543796316 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178856001 0 0) 0x7f669c160a50 con 0x7f669c15c060 2023-07-09T02:20:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a12b8640 1 -- 172.21.15.45:0/2543796316 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6688003530 con 0x7f669c15c060 2023-07-09T02:20:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a1ab9640 1 -- 172.21.15.45:0/2543796316 >> v1:172.21.15.155:6789/0 conn(0x7f669c0cd120 legacy=0x7f669c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a1ab9640 1 -- 172.21.15.45:0/2543796316 >> v1:172.21.15.45:6789/0 conn(0x7f669c15c060 legacy=0x7f669c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.666+0000 7f66a1ab9640 1 -- 172.21.15.45:0/2543796316 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c15fe40 con 0x7f669c0d2620 2023-07-09T02:20:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a1ab9640 1 --2- 172.21.15.45:0/2543796316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0d2620 0x7f669c0b4ed0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f668c0097c0 tx=0x7f668c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dea020aa4b0fafd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a12b8640 1 -- 172.21.15.45:0/2543796316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0ab650 con 0x7f669c0d2620 2023-07-09T02:20:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a12b8640 1 -- 172.21.15.45:0/2543796316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c0ab7b0 con 0x7f669c0d2620 2023-07-09T02:20:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a12b8640 1 -- 172.21.15.45:0/2543796316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0abb40 con 0x7f669c0d2620 2023-07-09T02:20:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a451e640 1 -- 172.21.15.45:0/2543796316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0d2620 msgr2=0x7f669c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a451e640 1 --2- 172.21.15.45:0/2543796316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0d2620 0x7f669c0b4ed0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f668c0097c0 tx=0x7f668c01c450 comp rx=0 tx=0).stop 2023-07-09T02:20:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a451e640 1 -- 172.21.15.45:0/2543796316 shutdown_connections 2023-07-09T02:20:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a451e640 1 --2- 172.21.15.45:0/2543796316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0d2620 0x7f669c0b4ed0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a451e640 1 -- 172.21.15.45:0/2543796316 >> 172.21.15.45:0/2543796316 conn(0x7f669c0698e0 msgr2=0x7f669c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a451e640 1 -- 172.21.15.45:0/2543796316 shutdown_connections 2023-07-09T02:20:46.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.670+0000 7f66a451e640 1 -- 172.21.15.45:0/2543796316 wait complete. 2023-07-09T02:20:46.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 Processor -- start 2023-07-09T02:20:46.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 -- start start 2023-07-09T02:20:46.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0cd120 0x7f669c156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f669c0d2620 0x7f669c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f669c15c060 0x7f669c0b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0ca650 con 0x7f669c0cd120 2023-07-09T02:20:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c14e840 con 0x7f669c15c060 2023-07-09T02:20:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0cbae0 con 0x7f669c0d2620 2023-07-09T02:20:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0cd120 0x7f669c156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0cd120 0x7f669c156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46864/0 (socket says 172.21.15.45:46864) 2023-07-09T02:20:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 -- 172.21.15.45:0/1327080503 learned_addr learned my addr 172.21.15.45:0/1327080503 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a2abb640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f669c15c060 0x7f669c0b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a1ab9640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f669c0d2620 0x7f669c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 -- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f669c0d2620 msgr2=0x7f669c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f669c0d2620 0x7f669c0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 -- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f669c15c060 msgr2=0x7f669c0b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f669c15c060 0x7f669c0b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 -- 172.21.15.45:0/1327080503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c009420 con 0x7f669c0cd120 2023-07-09T02:20:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a1ab9640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f669c0d2620 0x7f669c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a22ba640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0cd120 0x7f669c156770 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f669800c450 tx=0x7f669800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f6692ffd640 1 -- 172.21.15.45:0/1327080503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698005cf0 con 0x7f669c0cd120 2023-07-09T02:20:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f6692ffd640 1 -- 172.21.15.45:0/1327080503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698005e50 con 0x7f669c0cd120 2023-07-09T02:20:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c0b59f0 con 0x7f669c0cd120 2023-07-09T02:20:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f6692ffd640 1 -- 172.21.15.45:0/1327080503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698007270 con 0x7f669c0cd120 2023-07-09T02:20:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c0cc0a0 con 0x7f669c0cd120 2023-07-09T02:20:46.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.674+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c04d7d0 con 0x7f669c0cd120 2023-07-09T02:20:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.678+0000 7f6692ffd640 1 -- 172.21.15.45:0/1327080503 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66980073d0 con 0x7f669c0cd120 2023-07-09T02:20:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.678+0000 7f6692ffd640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6680066280 0x7f6680068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.678+0000 7f6692ffd640 1 -- 172.21.15.45:0/1327080503 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6698083180 con 0x7f669c0cd120 2023-07-09T02:20:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.678+0000 7f6692ffd640 1 -- 172.21.15.45:0/1327080503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f668006e3c0 con 0x7f669c0cd120 2023-07-09T02:20:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.678+0000 7f66a1ab9640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6680066280 0x7f6680068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.678+0000 7f66a1ab9640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6680066280 0x7f6680068730 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f668c0af000 tx=0x7f668c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.682+0000 7f6692ffd640 1 -- 172.21.15.45:0/1327080503 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66980506b0 con 0x7f669c0cd120 2023-07-09T02:20:46.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.838+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f669c06baa0 con 0x7f669c0cd120 2023-07-09T02:20:46.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.838+0000 7f6692ffd640 1 -- 172.21.15.45:0/1327080503 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66980170a0 con 0x7f669c0cd120 2023-07-09T02:20:46.839 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:20:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6680066280 msgr2=0x7f6680068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6680066280 0x7f6680068730 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f668c0af000 tx=0x7f668c0a7000 comp rx=0 tx=0).stop 2023-07-09T02:20:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0cd120 msgr2=0x7f669c156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0cd120 0x7f669c156770 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f669800c450 tx=0x7f669800c910 comp rx=0 tx=0).stop 2023-07-09T02:20:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 shutdown_connections 2023-07-09T02:20:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f669c15c060 0x7f669c0b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6680066280 0x7f6680068730 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f669c0d2620 0x7f669c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 --2- 172.21.15.45:0/1327080503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f669c0cd120 0x7f669c156770 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 >> 172.21.15.45:0/1327080503 conn(0x7f669c0698e0 msgr2=0x7f669c153930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 shutdown_connections 2023-07-09T02:20:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:46.842+0000 7f66a451e640 1 -- 172.21.15.45:0/1327080503 wait complete. 2023-07-09T02:20:46.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:20:47.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f38ec640 1 Processor -- start 2023-07-09T02:20:47.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f38ec640 1 -- start start 2023-07-09T02:20:47.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f38ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f73ec15c060 0x7f73ec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f38ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ec0cd120 0x7f73ec0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f38ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec160a50 con 0x7f73ec0d2450 2023-07-09T02:20:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f38ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec0d28f0 con 0x7f73ec15c060 2023-07-09T02:20:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f38ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0cfe40 con 0x7f73ec0cd120 2023-07-09T02:20:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f1688640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f73ec15c060 0x7f73ec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f1688640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f73ec15c060 0x7f73ec0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46878/0 (socket says 172.21.15.45:46878) 2023-07-09T02:20:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f1688640 1 -- 172.21.15.45:0/944674116 learned_addr learned my addr 172.21.15.45:0/944674116 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f1688640 1 -- 172.21.15.45:0/944674116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ec0cd120 msgr2=0x7f73ec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f1688640 1 --2- 172.21.15.45:0/944674116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ec0cd120 0x7f73ec0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f1688640 1 -- 172.21.15.45:0/944674116 >> v1:172.21.15.155:6789/0 conn(0x7f73ec0d2450 legacy=0x7f73ec0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.006+0000 7f73f1688640 1 -- 172.21.15.45:0/944674116 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec15c430 con 0x7f73ec15c060 2023-07-09T02:20:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f1688640 1 --2- 172.21.15.45:0/944674116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec0b4ed0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009870 tx=0x7f73e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d89a56659831d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73e3fff640 1 -- 172.21.15.45:0/944674116 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80ac410 con 0x7f73ec15c060 2023-07-09T02:20:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73e3fff640 1 -- 172.21.15.45:0/944674116 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e80ac570 con 0x7f73ec15c060 2023-07-09T02:20:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73e3fff640 1 -- 172.21.15.45:0/944674116 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80ac900 con 0x7f73ec15c060 2023-07-09T02:20:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f38ec640 1 -- 172.21.15.45:0/944674116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 msgr2=0x7f73ec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f38ec640 1 --2- 172.21.15.45:0/944674116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec0b4ed0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009870 tx=0x7f73e801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f38ec640 1 -- 172.21.15.45:0/944674116 shutdown_connections 2023-07-09T02:20:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f38ec640 1 --2- 172.21.15.45:0/944674116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ec0cd120 0x7f73ec0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f38ec640 1 --2- 172.21.15.45:0/944674116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec0b4ed0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f38ec640 1 -- 172.21.15.45:0/944674116 >> 172.21.15.45:0/944674116 conn(0x7f73ec0698e0 msgr2=0x7f73ec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:47.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f38ec640 1 -- 172.21.15.45:0/944674116 shutdown_connections 2023-07-09T02:20:47.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.010+0000 7f73f38ec640 1 -- 172.21.15.45:0/944674116 wait complete. 2023-07-09T02:20:47.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 Processor -- start 2023-07-09T02:20:47.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 -- start start 2023-07-09T02:20:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73ec0cd120 0x7f73ec15b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ec0d2450 0x7f73ec157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0b24a0 con 0x7f73ec15c060 2023-07-09T02:20:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0b2a60 con 0x7f73ec0cd120 2023-07-09T02:20:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0b4d90 con 0x7f73ec0d2450 2023-07-09T02:20:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46886/0 (socket says 172.21.15.45:46886) 2023-07-09T02:20:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 -- 172.21.15.45:0/2220246573 learned_addr learned my addr 172.21.15.45:0/2220246573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 -- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ec0d2450 msgr2=0x7f73ec157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ec0d2450 0x7f73ec157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 -- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73ec0cd120 msgr2=0x7f73ec15b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73ec0cd120 0x7f73ec15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 -- 172.21.15.45:0/2220246573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80094d0 con 0x7f73ec15c060 2023-07-09T02:20:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f1e89640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec150380 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f73e400c7b0 tx=0x7f73e400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73e1ffb640 1 -- 172.21.15.45:0/2220246573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4003d90 con 0x7f73ec15c060 2023-07-09T02:20:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73e1ffb640 1 -- 172.21.15.45:0/2220246573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4005070 con 0x7f73ec15c060 2023-07-09T02:20:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73e1ffb640 1 -- 172.21.15.45:0/2220246573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4005420 con 0x7f73ec15c060 2023-07-09T02:20:47.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec0b5070 con 0x7f73ec15c060 2023-07-09T02:20:47.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.014+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec151b00 con 0x7f73ec15c060 2023-07-09T02:20:47.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.018+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec04d7d0 con 0x7f73ec15c060 2023-07-09T02:20:47.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.018+0000 7f73e1ffb640 1 -- 172.21.15.45:0/2220246573 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73e4005580 con 0x7f73ec15c060 2023-07-09T02:20:47.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.018+0000 7f73e1ffb640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f73d0066280 0x7f73d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.018+0000 7f73e1ffb640 1 -- 172.21.15.45:0/2220246573 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73e4083140 con 0x7f73ec15c060 2023-07-09T02:20:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.018+0000 7f73e1ffb640 1 -- 172.21.15.45:0/2220246573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f73d006e3c0 con 0x7f73ec15c060 2023-07-09T02:20:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.018+0000 7f73f1688640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f73d0066280 0x7f73d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.018+0000 7f73f1688640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f73d0066280 0x7f73d0068730 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f73e80ae000 tx=0x7f73e8004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.022+0000 7f73e1ffb640 1 -- 172.21.15.45:0/2220246573 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73e4050650 con 0x7f73ec15c060 2023-07-09T02:20:47.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73ec0b2ba0 con 0x7f73ec15c060 2023-07-09T02:20:47.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73e1ffb640 1 -- 172.21.15.45:0/2220246573 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73e40170a0 con 0x7f73ec15c060 2023-07-09T02:20:47.173 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:20:47.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f73d0066280 msgr2=0x7f73d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f73d0066280 0x7f73d0068730 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f73e80ae000 tx=0x7f73e8004740 comp rx=0 tx=0).stop 2023-07-09T02:20:47.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 msgr2=0x7f73ec150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec150380 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f73e400c7b0 tx=0x7f73e400cc70 comp rx=0 tx=0).stop 2023-07-09T02:20:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 shutdown_connections 2023-07-09T02:20:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ec15c060 0x7f73ec150380 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f73d0066280 0x7f73d0068730 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73ec0d2450 0x7f73ec157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 --2- 172.21.15.45:0/2220246573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73ec0cd120 0x7f73ec15b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 >> 172.21.15.45:0/2220246573 conn(0x7f73ec0698e0 msgr2=0x7f73ec0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:47.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 shutdown_connections 2023-07-09T02:20:47.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.174+0000 7f73f38ec640 1 -- 172.21.15.45:0/2220246573 wait complete. 2023-07-09T02:20:47.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:20:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0c711640 1 Processor -- start 2023-07-09T02:20:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0c711640 1 -- start start 2023-07-09T02:20:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0c711640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9d04158e30 0x7f9d0406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0c711640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d0406c820 0x7f9d040caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0c711640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d040ccf80 con 0x7f9d0406fd10 2023-07-09T02:20:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0c711640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040cd540 con 0x7f9d04158e30 2023-07-09T02:20:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0c711640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040c8fb0 con 0x7f9d0406c820 2023-07-09T02:20:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0a4ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9d04158e30 0x7f9d0406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0a4ad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9d04158e30 0x7f9d0406f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46894/0 (socket says 172.21.15.45:46894) 2023-07-09T02:20:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0a4ad640 1 -- 172.21.15.45:0/2868998280 learned_addr learned my addr 172.21.15.45:0/2868998280 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0acae640 1 --2- 172.21.15.45:0/2868998280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d0406c820 0x7f9d040caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0a4ad640 1 -- 172.21.15.45:0/2868998280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d0406c820 msgr2=0x7f9d040caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0a4ad640 1 --2- 172.21.15.45:0/2868998280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d0406c820 0x7f9d040caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0a4ad640 1 -- 172.21.15.45:0/2868998280 >> v1:172.21.15.155:6789/0 conn(0x7f9d0406fd10 legacy=0x7f9d0406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:47.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0a4ad640 1 -- 172.21.15.45:0/2868998280 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040cbad0 con 0x7f9d04158e30 2023-07-09T02:20:47.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.338+0000 7f9d0acae640 1 --2- 172.21.15.45:0/2868998280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d0406c820 0x7f9d040caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:47.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0a4ad640 1 --2- 172.21.15.45:0/2868998280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d04158e30 0x7f9d0406f7d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009870 tx=0x7f9d0001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8e6db18d514f9e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d094ab640 1 -- 172.21.15.45:0/2868998280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000ab620 con 0x7f9d04158e30 2023-07-09T02:20:47.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d094ab640 1 -- 172.21.15.45:0/2868998280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d000ab780 con 0x7f9d04158e30 2023-07-09T02:20:47.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d094ab640 1 -- 172.21.15.45:0/2868998280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000abb10 con 0x7f9d04158e30 2023-07-09T02:20:47.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0c711640 1 -- 172.21.15.45:0/2868998280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d04158e30 msgr2=0x7f9d0406f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0c711640 1 --2- 172.21.15.45:0/2868998280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d04158e30 0x7f9d0406f7d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009870 tx=0x7f9d0001c440 comp rx=0 tx=0).stop 2023-07-09T02:20:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0c711640 1 -- 172.21.15.45:0/2868998280 shutdown_connections 2023-07-09T02:20:47.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0c711640 1 --2- 172.21.15.45:0/2868998280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d0406c820 0x7f9d040caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0c711640 1 --2- 172.21.15.45:0/2868998280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d04158e30 0x7f9d0406f7d0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0c711640 1 -- 172.21.15.45:0/2868998280 >> 172.21.15.45:0/2868998280 conn(0x7f9d040694b0 msgr2=0x7f9d040698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0c711640 1 -- 172.21.15.45:0/2868998280 shutdown_connections 2023-07-09T02:20:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.342+0000 7f9d0c711640 1 -- 172.21.15.45:0/2868998280 wait complete. 2023-07-09T02:20:47.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 Processor -- start 2023-07-09T02:20:47.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 -- start start 2023-07-09T02:20:47.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0406c820 0x7f9d0414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d0406fd10 0x7f9d0414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d04158e30 0x7f9d040b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040b3c40 con 0x7f9d0406fd10 2023-07-09T02:20:47.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0415c190 con 0x7f9d0406c820 2023-07-09T02:20:47.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040b33a0 con 0x7f9d04158e30 2023-07-09T02:20:47.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d0406fd10 0x7f9d0414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d0406fd10 0x7f9d0414eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46900/0 (socket says 172.21.15.45:46900) 2023-07-09T02:20:47.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 -- 172.21.15.45:0/3107750083 learned_addr learned my addr 172.21.15.45:0/3107750083 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:47.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0a4ad640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0406c820 0x7f9d0414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0acae640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d04158e30 0x7f9d040b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 -- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d04158e30 msgr2=0x7f9d040b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d04158e30 0x7f9d040b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 -- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0406c820 msgr2=0x7f9d0414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0406c820 0x7f9d0414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 -- 172.21.15.45:0/3107750083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d000094d0 con 0x7f9d0406fd10 2023-07-09T02:20:47.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d09cac640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d0406fd10 0x7f9d0414eb60 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400c450 tx=0x7f9cf400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9cfaffd640 1 -- 172.21.15.45:0/3107750083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4012830 con 0x7f9d0406fd10 2023-07-09T02:20:47.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9cfaffd640 1 -- 172.21.15.45:0/3107750083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40129b0 con 0x7f9d0406fd10 2023-07-09T02:20:47.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d040b3680 con 0x7f9d0406fd10 2023-07-09T02:20:47.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9cfaffd640 1 -- 172.21.15.45:0/3107750083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4012d60 con 0x7f9d0406fd10 2023-07-09T02:20:47.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.346+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d04159a40 con 0x7f9d0406fd10 2023-07-09T02:20:47.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.350+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d04159880 con 0x7f9d0406fd10 2023-07-09T02:20:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.350+0000 7f9cfaffd640 1 -- 172.21.15.45:0/3107750083 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9cf401c460 con 0x7f9d0406fd10 2023-07-09T02:20:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.350+0000 7f9cfaffd640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ce80662b0 0x7f9ce8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.350+0000 7f9cfaffd640 1 -- 172.21.15.45:0/3107750083 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9cf4083a70 con 0x7f9d0406fd10 2023-07-09T02:20:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.350+0000 7f9cfaffd640 1 -- 172.21.15.45:0/3107750083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f9ce806e3f0 con 0x7f9d0406fd10 2023-07-09T02:20:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.350+0000 7f9d0a4ad640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ce80662b0 0x7f9ce8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.350+0000 7f9d0a4ad640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ce80662b0 0x7f9ce8068760 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9d000af000 tx=0x7f9d000b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.354+0000 7f9cfaffd640 1 -- 172.21.15.45:0/3107750083 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9cf4050f90 con 0x7f9d0406fd10 2023-07-09T02:20:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d0404d7d0 con 0x7f9d0406fd10 2023-07-09T02:20:47.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9cfaffd640 1 -- 172.21.15.45:0/3107750083 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v155) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9cf40545b0 con 0x7f9d0406fd10 2023-07-09T02:20:47.521 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:20:47.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ce80662b0 msgr2=0x7f9ce8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ce80662b0 0x7f9ce8068760 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9d000af000 tx=0x7f9d000b6040 comp rx=0 tx=0).stop 2023-07-09T02:20:47.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d0406fd10 msgr2=0x7f9d0414eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d0406fd10 0x7f9d0414eb60 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400c450 tx=0x7f9cf400c910 comp rx=0 tx=0).stop 2023-07-09T02:20:47.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 shutdown_connections 2023-07-09T02:20:47.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9ce80662b0 0x7f9ce8068760 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d04158e30 0x7f9d040b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d0406fd10 0x7f9d0414eb60 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 --2- 172.21.15.45:0/3107750083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d0406c820 0x7f9d0414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.522+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 >> 172.21.15.45:0/3107750083 conn(0x7f9d040694b0 msgr2=0x7f9d040c4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.526+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 shutdown_connections 2023-07-09T02:20:47.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.526+0000 7f9d0c711640 1 -- 172.21.15.45:0/3107750083 wait complete. 2023-07-09T02:20:47.542 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:20:47.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:20:47.543 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:20:47.614 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:20:47.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:20:47.615 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:20:47.626 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:20:47.626 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:47.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:20:47.636 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:20:47.637 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:47.678 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:20:47.678 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:20:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7683bfa640 1 Processor -- start 2023-07-09T02:20:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7683bfa640 1 -- start start 2023-07-09T02:20:47.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7683bfa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f767c15c060 0x7f767c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7683bfa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f767c0cd120 0x7f767c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7683bfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 0x7f767c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7683bfa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c0d28f0 con 0x7f767c0cd120 2023-07-09T02:20:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7683bfa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c160a50 con 0x7f767c15c060 2023-07-09T02:20:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7683bfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c15c430 con 0x7f767c0d2450 2023-07-09T02:20:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7681195640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f767c0cd120 0x7f767c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7681195640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f767c0cd120 0x7f767c0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46912/0 (socket says 172.21.15.45:46912) 2023-07-09T02:20:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.822+0000 7f7681195640 1 -- 172.21.15.45:0/1189869727 learned_addr learned my addr 172.21.15.45:0/1189869727 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7682197640 1 --2- 172.21.15.45:0/1189869727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 0x7f767c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7681996640 1 --2- 172.21.15.45:0/1189869727 >> v2:172.21.15.155:3300/0 conn(0x7f767c15c060 0x7f767c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7681195640 1 -- 172.21.15.45:0/1189869727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 msgr2=0x7f767c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7681195640 1 --2- 172.21.15.45:0/1189869727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 0x7f767c0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7681195640 1 -- 172.21.15.45:0/1189869727 >> v2:172.21.15.155:3300/0 conn(0x7f767c15c060 msgr2=0x7f767c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7681195640 1 --2- 172.21.15.45:0/1189869727 >> v2:172.21.15.155:3300/0 conn(0x7f767c15c060 0x7f767c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7681195640 1 -- 172.21.15.45:0/1189869727 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c15fb60 con 0x7f767c0cd120 2023-07-09T02:20:47.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7681195640 1 --2- 172.21.15.45:0/1189869727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c0cd120 0x7f767c0d1f10 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f767c0d3ad0 tx=0x7f766c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297d6a2aab951da4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7680994640 1 -- 172.21.15.45:0/1189869727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0ab600 con 0x7f767c0cd120 2023-07-09T02:20:47.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7680994640 1 -- 172.21.15.45:0/1189869727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c0a7050 con 0x7f767c0cd120 2023-07-09T02:20:47.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7680994640 1 -- 172.21.15.45:0/1189869727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0ab980 con 0x7f767c0cd120 2023-07-09T02:20:47.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7683bfa640 1 -- 172.21.15.45:0/1189869727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c0cd120 msgr2=0x7f767c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.826+0000 7f7683bfa640 1 --2- 172.21.15.45:0/1189869727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c0cd120 0x7f767c0d1f10 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f767c0d3ad0 tx=0x7f766c01c210 comp rx=0 tx=0).stop 2023-07-09T02:20:47.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 -- 172.21.15.45:0/1189869727 shutdown_connections 2023-07-09T02:20:47.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 --2- 172.21.15.45:0/1189869727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 0x7f767c0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 --2- 172.21.15.45:0/1189869727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c0cd120 0x7f767c0d1f10 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 --2- 172.21.15.45:0/1189869727 >> v2:172.21.15.155:3300/0 conn(0x7f767c15c060 0x7f767c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 -- 172.21.15.45:0/1189869727 >> 172.21.15.45:0/1189869727 conn(0x7f767c0698e0 msgr2=0x7f767c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:47.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 -- 172.21.15.45:0/1189869727 shutdown_connections 2023-07-09T02:20:47.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 -- 172.21.15.45:0/1189869727 wait complete. 2023-07-09T02:20:47.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 Processor -- start 2023-07-09T02:20:47.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 -- start start 2023-07-09T02:20:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f767c0cd120 0x7f767c0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 0x7f767c1f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c15c060 0x7f767c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0ccb70 con 0x7f767c15c060 2023-07-09T02:20:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0cb1f0 con 0x7f767c0cd120 2023-07-09T02:20:47.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7683bfa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c15db20 con 0x7f767c0d2450 2023-07-09T02:20:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7681996640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f767c0cd120 0x7f767c0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7682197640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c15c060 0x7f767c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7681996640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f767c0cd120 0x7f767c0caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:54248/0 (socket says 172.21.15.45:54248) 2023-07-09T02:20:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7681996640 1 -- 172.21.15.45:0/275506443 learned_addr learned my addr 172.21.15.45:0/275506443 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.830+0000 7f7681195640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 0x7f767c1f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7681996640 1 -- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 msgr2=0x7f767c1f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7681996640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 0x7f767c1f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7681996640 1 -- 172.21.15.45:0/275506443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c15c060 msgr2=0x7f767c0cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7681996640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c15c060 0x7f767c0cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7681996640 1 -- 172.21.15.45:0/275506443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0094d0 con 0x7f767c0cd120 2023-07-09T02:20:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7682197640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c15c060 0x7f767c0cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7681996640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f767c0cd120 0x7f767c0caaf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f767800e8a0 tx=0x7f767800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f76727fc640 1 -- 172.21.15.45:0/275506443 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678009510 con 0x7f767c0cd120 2023-07-09T02:20:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f76727fc640 1 -- 172.21.15.45:0/275506443 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767800c940 con 0x7f767c0cd120 2023-07-09T02:20:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f76727fc640 1 -- 172.21.15.45:0/275506443 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800ccb0 con 0x7f767c0cd120 2023-07-09T02:20:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c15de00 con 0x7f767c0cd120 2023-07-09T02:20:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c15e3c0 con 0x7f767c0cd120 2023-07-09T02:20:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c15e5b0 con 0x7f767c0cd120 2023-07-09T02:20:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f76727fc640 1 -- 172.21.15.45:0/275506443 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7678013470 con 0x7f767c0cd120 2023-07-09T02:20:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.834+0000 7f76727fc640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7660066280 0x7f7660068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.838+0000 7f76727fc640 1 -- 172.21.15.45:0/275506443 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76780845e0 con 0x7f767c0cd120 2023-07-09T02:20:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.838+0000 7f7681195640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7660066280 0x7f7660068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.838+0000 7f76727fc640 1 -- 172.21.15.45:0/275506443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f766006e3c0 con 0x7f767c0cd120 2023-07-09T02:20:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.838+0000 7f7681195640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7660066280 0x7f7660068730 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ad000 tx=0x7f766c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:47.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:47.838+0000 7f76727fc640 1 -- 172.21.15.45:0/275506443 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7678051af0 con 0x7f767c0cd120 2023-07-09T02:20:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.026+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f767c04d7d0 con 0x7f767c0cd120 2023-07-09T02:20:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.026+0000 7f76727fc640 1 -- 172.21.15.45:0/275506443 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f7678021020 con 0x7f767c0cd120 2023-07-09T02:20:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:48.027 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1878423144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1878423144},{"type":"v1","addr":"172.21.15.155:6836","nonce":1878423144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":8259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1407467413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1407467413},{"type":"v1","addr":"172.21.15.45:6833","nonce":1407467413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2772552547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2772552547},{"type":"v1","addr":"172.21.15.45:6835","nonce":2772552547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:18:43.005298+0000","modified":"2023-07-09T02:18:46.662099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8274":{"gid":8274,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3076932418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3076932418},{"type":"v1","addr":"172.21.15.155:6837","nonce":3076932418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T02:20:48.027 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 75 2023-07-09T02:20:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7660066280 msgr2=0x7f7660068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7660066280 0x7f7660068730 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ad000 tx=0x7f766c008040 comp rx=0 tx=0).stop 2023-07-09T02:20:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f767c0cd120 msgr2=0x7f767c0caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f767c0cd120 0x7f767c0caaf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f767800e8a0 tx=0x7f767800eca0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 shutdown_connections 2023-07-09T02:20:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f767c15c060 0x7f767c0cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7660066280 0x7f7660068730 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f767c0d2450 0x7f767c1f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 --2- 172.21.15.45:0/275506443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f767c0cd120 0x7f767c0caaf0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 >> 172.21.15.45:0/275506443 conn(0x7f767c0698e0 msgr2=0x7f767c0b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 shutdown_connections 2023-07-09T02:20:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.030+0000 7f7683bfa640 1 -- 172.21.15.45:0/275506443 wait complete. 2023-07-09T02:20:48.047 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:20:48.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.190+0000 7ff1f8700640 1 Processor -- start 2023-07-09T02:20:48.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.190+0000 7ff1f8700640 1 -- start start 2023-07-09T02:20:48.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f8700640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1f00d2620 0x7ff1f00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f8700640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f0160a50 con 0x7ff1f015c060 2023-07-09T02:20:48.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f8700640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f015c430 con 0x7ff1f00cd120 2023-07-09T02:20:48.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f8700640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f015fb60 con 0x7ff1f00d2620 2023-07-09T02:20:48.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f649c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1f015c060 0x7ff1f00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40256/0 (socket says 172.21.15.45:40256) 2023-07-09T02:20:48.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f649c640 1 -- 172.21.15.45:0/4242225908 learned_addr learned my addr 172.21.15.45:0/4242225908 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:48.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f5c9b640 1 --2- 172.21.15.45:0/4242225908 >> v2:172.21.15.155:3300/0 conn(0x7ff1f00d2620 0x7ff1f00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307703637 0 0) 0x7ff1f0160a50 con 0x7ff1f015c060 2023-07-09T02:20:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1dc003530 con 0x7ff1f015c060 2023-07-09T02:20:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495030781 0 0) 0x7ff1dc003530 con 0x7ff1f015c060 2023-07-09T02:20:48.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 >> v2:172.21.15.155:3300/0 conn(0x7ff1f00d2620 msgr2=0x7ff1f00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:48.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 --2- 172.21.15.45:0/4242225908 >> v2:172.21.15.155:3300/0 conn(0x7ff1f00d2620 0x7ff1f00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 >> v1:172.21.15.155:6789/0 conn(0x7ff1f00cd120 legacy=0x7ff1f00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f015fe40 con 0x7ff1f015c060 2023-07-09T02:20:48.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7ff1ec001680 con 0x7ff1f015c060 2023-07-09T02:20:48.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 >> v1:172.21.15.45:6789/0 conn(0x7ff1f015c060 legacy=0x7ff1f00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1dc003980 0x7ff1dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0047d0 0x7ff1dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc005180 0x7ff1dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f015fb60 con 0x7ff1dc003980 2023-07-09T02:20:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc00c000 con 0x7ff1dc005180 2023-07-09T02:20:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc00c1c0 con 0x7ff1dc0047d0 2023-07-09T02:20:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f649c640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1dc003980 0x7ff1dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f6c9d640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc005180 0x7ff1dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f5c9b640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0047d0 0x7ff1dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f649c640 1 -- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0047d0 msgr2=0x7ff1dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:48.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f649c640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0047d0 0x7ff1dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f649c640 1 -- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc005180 msgr2=0x7ff1dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:48.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f649c640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc005180 0x7ff1dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f649c640 1 -- 172.21.15.45:0/4242225908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc003530 con 0x7ff1dc003980 2023-07-09T02:20:48.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f6c9d640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc005180 0x7ff1dc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:48.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.194+0000 7ff1f6c9d640 1 -- 172.21.15.45:0/4242225908 reap_dead start 2023-07-09T02:20:48.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f649c640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1dc003980 0x7ff1dc003d90 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00c240 tx=0x7ff1ec01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1201d5d124f21589 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec005ae0 con 0x7ff1dc003980 2023-07-09T02:20:48.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec005c60 con 0x7ff1dc003980 2023-07-09T02:20:48.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f549a640 1 -- 172.21.15.45:0/4242225908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec0a5830 con 0x7ff1dc003980 2023-07-09T02:20:48.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 -- 172.21.15.45:0/4242225908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1dc003980 msgr2=0x7ff1dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1dc003980 0x7ff1dc003d90 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00c240 tx=0x7ff1ec01cc10 comp rx=0 tx=0).stop 2023-07-09T02:20:48.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 -- 172.21.15.45:0/4242225908 shutdown_connections 2023-07-09T02:20:48.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 --2- 172.21.15.45:0/4242225908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1dc003980 0x7ff1dc003d90 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 -- 172.21.15.45:0/4242225908 >> 172.21.15.45:0/4242225908 conn(0x7ff1f00698e0 msgr2=0x7ff1f0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:48.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 -- 172.21.15.45:0/4242225908 shutdown_connections 2023-07-09T02:20:48.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 -- 172.21.15.45:0/4242225908 wait complete. 2023-07-09T02:20:48.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 Processor -- start 2023-07-09T02:20:48.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.198+0000 7ff1f8700640 1 -- start start 2023-07-09T02:20:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc003980 0x7ff1f014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01f4d40 0x7ff1f015e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f01f51b0 0x7ff1f015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00cac80 con 0x7ff1f01f4d40 2023-07-09T02:20:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00c9db0 con 0x7ff1dc003980 2023-07-09T02:20:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00ca000 con 0x7ff1f01f51b0 2023-07-09T02:20:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01f4d40 0x7ff1f015e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01f4d40 0x7ff1f015e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46942/0 (socket says 172.21.15.45:46942) 2023-07-09T02:20:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 -- 172.21.15.45:0/3756421631 learned_addr learned my addr 172.21.15.45:0/3756421631 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f649c640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc003980 0x7ff1f014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f6c9d640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f01f51b0 0x7ff1f015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 -- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f01f51b0 msgr2=0x7ff1f015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f01f51b0 0x7ff1f015ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 -- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc003980 msgr2=0x7ff1f014ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc003980 0x7ff1f014ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 -- 172.21.15.45:0/3756421631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00ca2e0 con 0x7ff1f01f4d40 2023-07-09T02:20:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f6c9d640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f01f51b0 0x7ff1f015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f5c9b640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01f4d40 0x7ff1f015e6b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0011630 tx=0x7ff1e0011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1e6ffd640 1 -- 172.21.15.45:0/3756421631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0004220 con 0x7ff1f01f4d40 2023-07-09T02:20:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1e6ffd640 1 -- 172.21.15.45:0/3756421631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e0004380 con 0x7ff1f01f4d40 2023-07-09T02:20:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1e6ffd640 1 -- 172.21.15.45:0/3756421631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e000f960 con 0x7ff1f01f4d40 2023-07-09T02:20:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f00ca5c0 con 0x7ff1f01f4d40 2023-07-09T02:20:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f014f2a0 con 0x7ff1f01f4d40 2023-07-09T02:20:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.202+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f004d7d0 con 0x7ff1f01f4d40 2023-07-09T02:20:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.206+0000 7ff1e6ffd640 1 -- 172.21.15.45:0/3756421631 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1e000fac0 con 0x7ff1f01f4d40 2023-07-09T02:20:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.206+0000 7ff1e6ffd640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d4066280 0x7ff1d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.206+0000 7ff1e6ffd640 1 -- 172.21.15.45:0/3756421631 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1e0083f00 con 0x7ff1f01f4d40 2023-07-09T02:20:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.206+0000 7ff1e6ffd640 1 -- 172.21.15.45:0/3756421631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7ff1d406e3c0 con 0x7ff1f01f4d40 2023-07-09T02:20:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.206+0000 7ff1f649c640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d4066280 0x7ff1d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.206+0000 7ff1f649c640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d4066280 0x7ff1d4068730 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0ab000 tx=0x7ff1ec0b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.210+0000 7ff1e6ffd640 1 -- 172.21.15.45:0/3756421631 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1e0022060 con 0x7ff1f01f4d40 2023-07-09T02:20:48.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.362+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1f006baa0 con 0x7ff1f01f4d40 2023-07-09T02:20:48.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.362+0000 7ff1e6ffd640 1 -- 172.21.15.45:0/3756421631 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18337 (secure 0 0 0) 0x7ff1e0051370 con 0x7ff1f01f4d40 2023-07-09T02:20:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:48.363 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":155,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:19:54.428525+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:18:40.756512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T02:18:42.013313+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:20:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d4066280 msgr2=0x7ff1d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d4066280 0x7ff1d4068730 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0ab000 tx=0x7ff1ec0b1040 comp rx=0 tx=0).stop 2023-07-09T02:20:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01f4d40 msgr2=0x7ff1f015e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01f4d40 0x7ff1f015e6b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0011630 tx=0x7ff1e0011af0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 shutdown_connections 2023-07-09T02:20:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1d4066280 0x7ff1d4068730 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1f01f51b0 0x7ff1f015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1f01f4d40 0x7ff1f015e6b0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 --2- 172.21.15.45:0/3756421631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc003980 0x7ff1f014ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 >> 172.21.15.45:0/3756421631 conn(0x7ff1f00698e0 msgr2=0x7ff1f015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 shutdown_connections 2023-07-09T02:20:48.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.366+0000 7ff1f8700640 1 -- 172.21.15.45:0/3756421631 wait complete. 2023-07-09T02:20:48.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:18:40.756512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:18:42.013313+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:20:48.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:20:48.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.534+0000 7fb115669640 1 Processor -- start 2023-07-09T02:20:48.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.534+0000 7fb115669640 1 -- start start 2023-07-09T02:20:48.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb115669640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb1100b1bc0 0x7fb110069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb115669640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b68b0 0x7fb110069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb115669640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100ceff0 con 0x7fb1100d2400 2023-07-09T02:20:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb115669640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1100cea70 con 0x7fb1100b1bc0 2023-07-09T02:20:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb115669640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100b1f90 con 0x7fb1100b68b0 2023-07-09T02:20:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb1100d2400 0x7fb110070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40272/0 (socket says 172.21.15.45:40272) 2023-07-09T02:20:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10f7fe640 1 -- 172.21.15.45:0/2068533237 learned_addr learned my addr 172.21.15.45:0/2068533237 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb114e68640 1 --2- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b68b0 0x7fb110069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10ffff640 1 --2- 172.21.15.45:0/2068533237 >> v2:172.21.15.155:3300/0 conn(0x7fb1100b1bc0 0x7fb110069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10effd640 1 -- 172.21.15.45:0/2068533237 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609948710 0 0) 0x7fb1100ceff0 con 0x7fb1100d2400 2023-07-09T02:20:48.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10effd640 1 -- 172.21.15.45:0/2068533237 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f8003530 con 0x7fb1100d2400 2023-07-09T02:20:48.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10ffff640 1 -- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b68b0 msgr2=0x7fb110069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:48.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10ffff640 1 --2- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b68b0 0x7fb110069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10ffff640 1 -- 172.21.15.45:0/2068533237 >> v1:172.21.15.45:6789/0 conn(0x7fb1100d2400 legacy=0x7fb110070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb10ffff640 1 -- 172.21.15.45:0/2068533237 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100d1500 con 0x7fb1100b1bc0 2023-07-09T02:20:48.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.538+0000 7fb114e68640 1 --2- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b68b0 0x7fb110069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:48.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb10ffff640 1 --2- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100b1bc0 0x7fb110069870 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097c0 tx=0x7fb10001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54b3098419a0a9a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb10effd640 1 -- 172.21.15.45:0/2068533237 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000ab650 con 0x7fb1100b1bc0 2023-07-09T02:20:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb10effd640 1 -- 172.21.15.45:0/2068533237 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000ab7b0 con 0x7fb1100b1bc0 2023-07-09T02:20:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb10effd640 1 -- 172.21.15.45:0/2068533237 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1000abb40 con 0x7fb1100b1bc0 2023-07-09T02:20:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 -- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100b1bc0 msgr2=0x7fb110069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 --2- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100b1bc0 0x7fb110069870 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097c0 tx=0x7fb10001c450 comp rx=0 tx=0).stop 2023-07-09T02:20:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 -- 172.21.15.45:0/2068533237 shutdown_connections 2023-07-09T02:20:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 --2- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b68b0 0x7fb110069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 --2- 172.21.15.45:0/2068533237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100b1bc0 0x7fb110069870 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 -- 172.21.15.45:0/2068533237 >> 172.21.15.45:0/2068533237 conn(0x7fb1100d35b0 msgr2=0x7fb1100cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 -- 172.21.15.45:0/2068533237 shutdown_connections 2023-07-09T02:20:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 -- 172.21.15.45:0/2068533237 wait complete. 2023-07-09T02:20:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 Processor -- start 2023-07-09T02:20:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.542+0000 7fb115669640 1 -- start start 2023-07-09T02:20:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b1bc0 0x7fb1101538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1100b68b0 0x7fb11015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100d2400 0x7fb1100b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100cc2f0 con 0x7fb1100b68b0 2023-07-09T02:20:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100cc5d0 con 0x7fb1100d2400 2023-07-09T02:20:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100cc8b0 con 0x7fb1100b1bc0 2023-07-09T02:20:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1100b68b0 0x7fb11015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1100b68b0 0x7fb11015e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46952/0 (socket says 172.21.15.45:46952) 2023-07-09T02:20:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 -- 172.21.15.45:0/411567042 learned_addr learned my addr 172.21.15.45:0/411567042 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10ffff640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b1bc0 0x7fb1101538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb114e68640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100d2400 0x7fb1100b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 -- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b1bc0 msgr2=0x7fb1101538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b1bc0 0x7fb1101538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 -- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100d2400 msgr2=0x7fb1100b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100d2400 0x7fb1100b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 -- 172.21.15.45:0/411567042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb108009a70 con 0x7fb1100b68b0 2023-07-09T02:20:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10f7fe640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1100b68b0 0x7fb11015e730 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c400 tx=0x7fb10400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10cff9640 1 -- 172.21.15.45:0/411567042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104005cf0 con 0x7fb1100b68b0 2023-07-09T02:20:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10cff9640 1 -- 172.21.15.45:0/411567042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb104005e50 con 0x7fb1100b68b0 2023-07-09T02:20:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100009420 con 0x7fb1100b68b0 2023-07-09T02:20:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb10cff9640 1 -- 172.21.15.45:0/411567042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040072d0 con 0x7fb1100b68b0 2023-07-09T02:20:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11015cc30 con 0x7fb1100b68b0 2023-07-09T02:20:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.546+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11004e020 con 0x7fb1100b68b0 2023-07-09T02:20:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.550+0000 7fb10cff9640 1 -- 172.21.15.45:0/411567042 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb104007430 con 0x7fb1100b68b0 2023-07-09T02:20:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.550+0000 7fb10cff9640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb0fc066280 0x7fb0fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.550+0000 7fb10cff9640 1 -- 172.21.15.45:0/411567042 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb104083240 con 0x7fb1100b68b0 2023-07-09T02:20:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.550+0000 7fb10cff9640 1 -- 172.21.15.45:0/411567042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7fb0fc06e3c0 con 0x7fb1100b68b0 2023-07-09T02:20:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.550+0000 7fb10ffff640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb0fc066280 0x7fb0fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.550+0000 7fb10ffff640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb0fc066280 0x7fb0fc068730 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb1000af000 tx=0x7fb1000a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.554+0000 7fb10cff9640 1 -- 172.21.15.45:0/411567042 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb104050830 con 0x7fb1100b68b0 2023-07-09T02:20:48.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.710+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb11015f1d0 con 0x7fb1100b68b0 2023-07-09T02:20:48.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.710+0000 7fb10cff9640 1 -- 172.21.15.45:0/411567042 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb104017020 con 0x7fb1100b68b0 2023-07-09T02:20:48.711 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:20:48.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb0fc066280 msgr2=0x7fb0fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb0fc066280 0x7fb0fc068730 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb1000af000 tx=0x7fb1000a7000 comp rx=0 tx=0).stop 2023-07-09T02:20:48.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1100b68b0 msgr2=0x7fb11015e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1100b68b0 0x7fb11015e730 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c400 tx=0x7fb10400c800 comp rx=0 tx=0).stop 2023-07-09T02:20:48.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 shutdown_connections 2023-07-09T02:20:48.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1100d2400 0x7fb1100b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1100b68b0 0x7fb11015e730 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb0fc066280 0x7fb0fc068730 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 --2- 172.21.15.45:0/411567042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1100b1bc0 0x7fb1101538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 >> 172.21.15.45:0/411567042 conn(0x7fb1100d35b0 msgr2=0x7fb1100b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:48.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 shutdown_connections 2023-07-09T02:20:48.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.714+0000 7fb115669640 1 -- 172.21.15.45:0/411567042 wait complete. 2023-07-09T02:20:48.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:20:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64f4d8f640 1 Processor -- start 2023-07-09T02:20:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64f4d8f640 1 -- start start 2023-07-09T02:20:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64f4d8f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f64f00cd120 0x7f64f00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64f4d8f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f0160a50 con 0x7f64f00d2620 2023-07-09T02:20:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64f4d8f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f015c430 con 0x7f64f015c060 2023-07-09T02:20:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64f4d8f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f015fb60 con 0x7f64f00cd120 2023-07-09T02:20:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64e7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f64f00d2620 0x7f64f00cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40274/0 (socket says 172.21.15.45:40274) 2023-07-09T02:20:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64e7fff640 1 -- 172.21.15.45:0/1509686924 learned_addr learned my addr 172.21.15.45:0/1509686924 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64eed9d640 1 --2- 172.21.15.45:0/1509686924 >> v2:172.21.15.155:3300/0 conn(0x7f64f00cd120 0x7f64f00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64edd9b640 1 -- 172.21.15.45:0/1509686924 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591700347 0 0) 0x7f64f0160a50 con 0x7f64f00d2620 2023-07-09T02:20:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64edd9b640 1 -- 172.21.15.45:0/1509686924 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64dc003530 con 0x7f64f00d2620 2023-07-09T02:20:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64edd9b640 1 -- 172.21.15.45:0/1509686924 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122027006 0 0) 0x7f64f015c430 con 0x7f64f015c060 2023-07-09T02:20:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64edd9b640 1 -- 172.21.15.45:0/1509686924 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f0160a50 con 0x7f64f015c060 2023-07-09T02:20:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64eed9d640 1 -- 172.21.15.45:0/1509686924 >> v1:172.21.15.155:6789/0 conn(0x7f64f015c060 legacy=0x7f64f00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64edd9b640 1 -- 172.21.15.45:0/1509686924 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229652700 0 0) 0x7f64dc003530 con 0x7f64f00d2620 2023-07-09T02:20:48.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64eed9d640 1 -- 172.21.15.45:0/1509686924 >> v1:172.21.15.45:6789/0 conn(0x7f64f00d2620 legacy=0x7f64f00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.882+0000 7f64eed9d640 1 -- 172.21.15.45:0/1509686924 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f015fe40 con 0x7f64f00cd120 2023-07-09T02:20:48.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64eed9d640 1 --2- 172.21.15.45:0/1509686924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 0x7f64f00b4ed0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009d90 tx=0x7f64e801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a09d4fb66d45de8c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64edd9b640 1 -- 172.21.15.45:0/1509686924 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8001680 con 0x7f64f00cd120 2023-07-09T02:20:48.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64edd9b640 1 -- 172.21.15.45:0/1509686924 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e80a5680 con 0x7f64f00cd120 2023-07-09T02:20:48.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64edd9b640 1 -- 172.21.15.45:0/1509686924 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e80a5a10 con 0x7f64f00cd120 2023-07-09T02:20:48.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64f4d8f640 1 -- 172.21.15.45:0/1509686924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 msgr2=0x7f64f00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64f4d8f640 1 --2- 172.21.15.45:0/1509686924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 0x7f64f00b4ed0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009d90 tx=0x7f64e801c840 comp rx=0 tx=0).stop 2023-07-09T02:20:48.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64f4d8f640 1 -- 172.21.15.45:0/1509686924 shutdown_connections 2023-07-09T02:20:48.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64f4d8f640 1 --2- 172.21.15.45:0/1509686924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 0x7f64f00b4ed0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64f4d8f640 1 -- 172.21.15.45:0/1509686924 >> 172.21.15.45:0/1509686924 conn(0x7f64f00698e0 msgr2=0x7f64f0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:48.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64f4d8f640 1 -- 172.21.15.45:0/1509686924 shutdown_connections 2023-07-09T02:20:48.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.886+0000 7f64f4d8f640 1 -- 172.21.15.45:0/1509686924 wait complete. 2023-07-09T02:20:48.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 Processor -- start 2023-07-09T02:20:48.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 -- start start 2023-07-09T02:20:48.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 0x7f64f00cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f00d2620 0x7f64f0153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64f015c060 0x7f64f0154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f00ca9e0 con 0x7f64f015c060 2023-07-09T02:20:48.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f015f500 con 0x7f64f00cd120 2023-07-09T02:20:48.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f00c9b10 con 0x7f64f00d2620 2023-07-09T02:20:48.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64f015c060 0x7f64f0154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64f015c060 0x7f64f0154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46954/0 (socket says 172.21.15.45:46954) 2023-07-09T02:20:48.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 -- 172.21.15.45:0/414291022 learned_addr learned my addr 172.21.15.45:0/414291022 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:48.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64ee59c640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 0x7f64f00cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64e7fff640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f00d2620 0x7f64f0153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 -- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f00d2620 msgr2=0x7f64f0153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f00d2620 0x7f64f0153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 -- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 msgr2=0x7f64f00cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 0x7f64f00cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 -- 172.21.15.45:0/414291022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8009a70 con 0x7f64f015c060 2023-07-09T02:20:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64eed9d640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64f015c060 0x7f64f0154330 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f64e801cd20 tx=0x7f64e80195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64e6ffd640 1 -- 172.21.15.45:0/414291022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e8003ba0 con 0x7f64f015c060 2023-07-09T02:20:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64e6ffd640 1 -- 172.21.15.45:0/414291022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e8003d00 con 0x7f64f015c060 2023-07-09T02:20:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f00b59f0 con 0x7f64f015c060 2023-07-09T02:20:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64e6ffd640 1 -- 172.21.15.45:0/414291022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e80b98a0 con 0x7f64f015c060 2023-07-09T02:20:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.890+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f00ca0b0 con 0x7f64f015c060 2023-07-09T02:20:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.894+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f004d7d0 con 0x7f64f015c060 2023-07-09T02:20:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.894+0000 7f64e6ffd640 1 -- 172.21.15.45:0/414291022 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64e80b9a00 con 0x7f64f015c060 2023-07-09T02:20:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.894+0000 7f64e6ffd640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f64d0066280 0x7f64d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.894+0000 7f64e6ffd640 1 -- 172.21.15.45:0/414291022 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64e811eda0 con 0x7f64f015c060 2023-07-09T02:20:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.894+0000 7f64e6ffd640 1 -- 172.21.15.45:0/414291022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f64d006e3c0 con 0x7f64f015c060 2023-07-09T02:20:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.894+0000 7f64ee59c640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f64d0066280 0x7f64d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:48.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.894+0000 7f64ee59c640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f64d0066280 0x7f64d0068730 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f64e00011f0 tx=0x7f64e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:48.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:48.898+0000 7f64e6ffd640 1 -- 172.21.15.45:0/414291022 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64e80ec3e0 con 0x7f64f015c060 2023-07-09T02:20:49.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.050+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64f00ccf00 con 0x7f64f015c060 2023-07-09T02:20:49.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.050+0000 7f64e6ffd640 1 -- 172.21.15.45:0/414291022 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f64e80b2070 con 0x7f64f015c060 2023-07-09T02:20:49.050 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:20:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f64d0066280 msgr2=0x7f64d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f64d0066280 0x7f64d0068730 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f64e00011f0 tx=0x7f64e0009040 comp rx=0 tx=0).stop 2023-07-09T02:20:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64f015c060 msgr2=0x7f64f0154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64f015c060 0x7f64f0154330 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f64e801cd20 tx=0x7f64e80195e0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 shutdown_connections 2023-07-09T02:20:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64f015c060 0x7f64f0154330 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f64d0066280 0x7f64d0068730 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f00d2620 0x7f64f0153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 --2- 172.21.15.45:0/414291022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64f00cd120 0x7f64f00cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 >> 172.21.15.45:0/414291022 conn(0x7f64f00698e0 msgr2=0x7f64f00b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 shutdown_connections 2023-07-09T02:20:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.054+0000 7f64f4d8f640 1 -- 172.21.15.45:0/414291022 wait complete. 2023-07-09T02:20:49.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:20:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.218+0000 7fdc15634640 1 Processor -- start 2023-07-09T02:20:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.218+0000 7fdc15634640 1 -- start start 2023-07-09T02:20:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.218+0000 7fdc15634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc10158e30 0x7fdc1006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.218+0000 7fdc15634640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100ccf80 con 0x7fdc1006fd10 2023-07-09T02:20:49.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.218+0000 7fdc15634640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100cd540 con 0x7fdc1006c820 2023-07-09T02:20:49.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.218+0000 7fdc15634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100c8fb0 con 0x7fdc10158e30 2023-07-09T02:20:49.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc07fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdc1006fd10 0x7fdc1006c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40284/0 (socket says 172.21.15.45:40284) 2023-07-09T02:20:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc07fff640 1 -- 172.21.15.45:0/859455350 learned_addr learned my addr 172.21.15.45:0/859455350 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0effd640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc10158e30 0x7fdc1006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189287205 0 0) 0x7fdc100ccf80 con 0x7fdc1006fd10 2023-07-09T02:20:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbfc003530 con 0x7fdc1006fd10 2023-07-09T02:20:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134736279 0 0) 0x7fdc100cd540 con 0x7fdc1006c820 2023-07-09T02:20:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc100ccf80 con 0x7fdc1006c820 2023-07-09T02:20:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442147812 0 0) 0x7fdbfc003530 con 0x7fdc1006fd10 2023-07-09T02:20:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc10158e30 msgr2=0x7fdc1006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc10158e30 0x7fdc1006f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 >> v1:172.21.15.155:6789/0 conn(0x7fdc1006c820 legacy=0x7fdc100caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100cbad0 con 0x7fdc1006fd10 2023-07-09T02:20:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fdbf8001680 con 0x7fdc1006fd10 2023-07-09T02:20:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 >> v1:172.21.15.45:6789/0 conn(0x7fdc1006fd10 legacy=0x7fdc1006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc003b40 0x7fdbfc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbfc0047d0 0x7fdbfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc10158e30 0x7fdbfc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100c8fb0 con 0x7fdbfc0047d0 2023-07-09T02:20:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc00dc80 con 0x7fdbfc003b40 2023-07-09T02:20:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc00de40 con 0x7fdc10158e30 2023-07-09T02:20:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc07fff640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbfc0047d0 0x7fdbfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0effd640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc003b40 0x7fdbfc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc0f7fe640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc10158e30 0x7fdbfc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc07fff640 1 -- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc10158e30 msgr2=0x7fdbfc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:49.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc07fff640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc10158e30 0x7fdbfc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc07fff640 1 -- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc003b40 msgr2=0x7fdbfc003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:49.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc07fff640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc003b40 0x7fdbfc003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.222+0000 7fdc07fff640 1 -- 172.21.15.45:0/859455350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc003530 con 0x7fdbfc0047d0 2023-07-09T02:20:49.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc07fff640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbfc0047d0 0x7fdbfc004c40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c160 tx=0x7fdbf8020f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6344c77ae3f706fa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80a9c80 con 0x7fdbfc0047d0 2023-07-09T02:20:49.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf80a9e00 con 0x7fdbfc0047d0 2023-07-09T02:20:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc0e7fc640 1 -- 172.21.15.45:0/859455350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8005b20 con 0x7fdbfc0047d0 2023-07-09T02:20:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc15634640 1 -- 172.21.15.45:0/859455350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbfc0047d0 msgr2=0x7fdbfc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc15634640 1 --2- 172.21.15.45:0/859455350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbfc0047d0 0x7fdbfc004c40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c160 tx=0x7fdbf8020f80 comp rx=0 tx=0).stop 2023-07-09T02:20:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc0f7fe640 1 -- 172.21.15.45:0/859455350 reap_dead start 2023-07-09T02:20:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc15634640 1 -- 172.21.15.45:0/859455350 shutdown_connections 2023-07-09T02:20:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc15634640 1 -- 172.21.15.45:0/859455350 >> 172.21.15.45:0/859455350 conn(0x7fdc100694b0 msgr2=0x7fdc100698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc15634640 1 -- 172.21.15.45:0/859455350 shutdown_connections 2023-07-09T02:20:49.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc15634640 1 -- 172.21.15.45:0/859455350 wait complete. 2023-07-09T02:20:49.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc15634640 1 Processor -- start 2023-07-09T02:20:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.226+0000 7fdc15634640 1 -- start start 2023-07-09T02:20:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc0047d0 0x7fdc101511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c5cd0 0x7fdc1015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015b650 0x7fdc1015bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1014a060 con 0x7fdc100c5cd0 2023-07-09T02:20:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10152b40 con 0x7fdbfc0047d0 2023-07-09T02:20:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1015c000 con 0x7fdc1015b650 2023-07-09T02:20:49.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c5cd0 0x7fdc1015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c5cd0 0x7fdc1015b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46966/0 (socket says 172.21.15.45:46966) 2023-07-09T02:20:49.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 -- 172.21.15.45:0/2347074715 learned_addr learned my addr 172.21.15.45:0/2347074715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:49.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc0effd640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc0047d0 0x7fdc101511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc0f7fe640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015b650 0x7fdc1015bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 -- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015b650 msgr2=0x7fdc1015bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015b650 0x7fdc1015bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 -- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc0047d0 msgr2=0x7fdc101511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc0047d0 0x7fdc101511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 -- 172.21.15.45:0/2347074715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10151aa0 con 0x7fdc100c5cd0 2023-07-09T02:20:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc0f7fe640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015b650 0x7fdc1015bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc0effd640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc0047d0 0x7fdc101511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc07fff640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c5cd0 0x7fdc1015b110 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80af040 tx=0x7fdbfc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc077fe640 1 -- 172.21.15.45:0/2347074715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8005d00 con 0x7fdc100c5cd0 2023-07-09T02:20:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc077fe640 1 -- 172.21.15.45:0/2347074715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf80b7070 con 0x7fdc100c5cd0 2023-07-09T02:20:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc10151d80 con 0x7fdc100c5cd0 2023-07-09T02:20:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc077fe640 1 -- 172.21.15.45:0/2347074715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8004a10 con 0x7fdc100c5cd0 2023-07-09T02:20:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc10152340 con 0x7fdc100c5cd0 2023-07-09T02:20:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1004d7d0 con 0x7fdc100c5cd0 2023-07-09T02:20:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.230+0000 7fdc077fe640 1 -- 172.21.15.45:0/2347074715 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdbf8004b70 con 0x7fdc100c5cd0 2023-07-09T02:20:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.234+0000 7fdc077fe640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbf00662b0 0x7fdbf0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.234+0000 7fdc077fe640 1 -- 172.21.15.45:0/2347074715 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbf80b9070 con 0x7fdc100c5cd0 2023-07-09T02:20:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.234+0000 7fdc077fe640 1 -- 172.21.15.45:0/2347074715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7fdbf006e3f0 con 0x7fdc100c5cd0 2023-07-09T02:20:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.234+0000 7fdc0effd640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbf00662b0 0x7fdbf0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.234+0000 7fdc0effd640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbf00662b0 0x7fdbf0068760 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009a80 tx=0x7fdc00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.238+0000 7fdc077fe640 1 -- 172.21.15.45:0/2347074715 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbf80ef400 con 0x7fdc100c5cd0 2023-07-09T02:20:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.386+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc100ccb30 con 0x7fdc100c5cd0 2023-07-09T02:20:49.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc077fe640 1 -- 172.21.15.45:0/2347074715 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbf8005e60 con 0x7fdc100c5cd0 2023-07-09T02:20:49.388 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:20:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbf00662b0 msgr2=0x7fdbf0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbf00662b0 0x7fdbf0068760 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009a80 tx=0x7fdc00008040 comp rx=0 tx=0).stop 2023-07-09T02:20:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c5cd0 msgr2=0x7fdc1015b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c5cd0 0x7fdc1015b110 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80af040 tx=0x7fdbfc005800 comp rx=0 tx=0).stop 2023-07-09T02:20:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 shutdown_connections 2023-07-09T02:20:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdbf00662b0 0x7fdbf0068760 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015b650 0x7fdc1015bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc100c5cd0 0x7fdc1015b110 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 --2- 172.21.15.45:0/2347074715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbfc0047d0 0x7fdc101511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 >> 172.21.15.45:0/2347074715 conn(0x7fdc100694b0 msgr2=0x7fdc100701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 shutdown_connections 2023-07-09T02:20:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.390+0000 7fdc15634640 1 -- 172.21.15.45:0/2347074715 wait complete. 2023-07-09T02:20:49.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:20:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45d1740640 1 Processor -- start 2023-07-09T02:20:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45d1740640 1 -- start start 2023-07-09T02:20:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45d1740640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45cc15c060 0x7f45cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45d1740640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45d1740640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc160a50 con 0x7f45cc0cd120 2023-07-09T02:20:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45d1740640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc15c430 con 0x7f45cc15c060 2023-07-09T02:20:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45d1740640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc15fb60 con 0x7f45cc0d2620 2023-07-09T02:20:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45ca7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f45cc0cd120 0x7f45cc0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40290/0 (socket says 172.21.15.45:40290) 2023-07-09T02:20:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45ca7fc640 1 -- 172.21.15.45:0/4111328300 learned_addr learned my addr 172.21.15.45:0/4111328300 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45caffd640 1 --2- 172.21.15.45:0/4111328300 >> v2:172.21.15.155:3300/0 conn(0x7f45cc15c060 0x7f45cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45cb7fe640 1 --2- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45c9ffb640 1 -- 172.21.15.45:0/4111328300 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336537691 0 0) 0x7f45cc160a50 con 0x7f45cc0cd120 2023-07-09T02:20:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45c9ffb640 1 -- 172.21.15.45:0/4111328300 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b4003530 con 0x7f45cc0cd120 2023-07-09T02:20:49.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45caffd640 1 -- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 msgr2=0x7f45cc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45caffd640 1 --2- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45caffd640 1 -- 172.21.15.45:0/4111328300 >> v1:172.21.15.45:6789/0 conn(0x7f45cc0cd120 legacy=0x7f45cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45caffd640 1 -- 172.21.15.45:0/4111328300 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc15fe40 con 0x7f45cc15c060 2023-07-09T02:20:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.558+0000 7f45cb7fe640 1 --2- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45caffd640 1 --2- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc15c060 0x7f45cc0b4ed0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0097c0 tx=0x7f45bc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ef060c6d3042cb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45c9ffb640 1 -- 172.21.15.45:0/4111328300 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0ab650 con 0x7f45cc15c060 2023-07-09T02:20:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45c9ffb640 1 -- 172.21.15.45:0/4111328300 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc0ab7b0 con 0x7f45cc15c060 2023-07-09T02:20:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45c9ffb640 1 -- 172.21.15.45:0/4111328300 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0abb40 con 0x7f45cc15c060 2023-07-09T02:20:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45d1740640 1 -- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc15c060 msgr2=0x7f45cc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45d1740640 1 --2- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc15c060 0x7f45cc0b4ed0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0097c0 tx=0x7f45bc01c450 comp rx=0 tx=0).stop 2023-07-09T02:20:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45d1740640 1 -- 172.21.15.45:0/4111328300 shutdown_connections 2023-07-09T02:20:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45d1740640 1 --2- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45d1740640 1 --2- 172.21.15.45:0/4111328300 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc15c060 0x7f45cc0b4ed0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45d1740640 1 -- 172.21.15.45:0/4111328300 >> 172.21.15.45:0/4111328300 conn(0x7f45cc0698e0 msgr2=0x7f45cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45d1740640 1 -- 172.21.15.45:0/4111328300 shutdown_connections 2023-07-09T02:20:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.562+0000 7f45d1740640 1 -- 172.21.15.45:0/4111328300 wait complete. 2023-07-09T02:20:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 Processor -- start 2023-07-09T02:20:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 -- start start 2023-07-09T02:20:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc0cd120 0x7f45cc15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45cc15c060 0x7f45cc153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0cb3a0 con 0x7f45cc15c060 2023-07-09T02:20:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0caab0 con 0x7f45cc0cd120 2023-07-09T02:20:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc15a900 con 0x7f45cc0d2620 2023-07-09T02:20:49.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45cc15c060 0x7f45cc153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45cc15c060 0x7f45cc153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46980/0 (socket says 172.21.15.45:46980) 2023-07-09T02:20:49.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 -- 172.21.15.45:0/938403960 learned_addr learned my addr 172.21.15.45:0/938403960 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:49.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45caffd640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc0cd120 0x7f45cc15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45ca7fc640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 -- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 msgr2=0x7f45cc0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 -- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc0cd120 msgr2=0x7f45cc15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc0cd120 0x7f45cc15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 -- 172.21.15.45:0/938403960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4009a70 con 0x7f45cc15c060 2023-07-09T02:20:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45ca7fc640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45cb7fe640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45cc15c060 0x7f45cc153540 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f45c400ef90 tx=0x7f45c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45b37fe640 1 -- 172.21.15.45:0/938403960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4014480 con 0x7f45cc15c060 2023-07-09T02:20:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45b37fe640 1 -- 172.21.15.45:0/938403960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c400f040 con 0x7f45cc15c060 2023-07-09T02:20:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45b37fe640 1 -- 172.21.15.45:0/938403960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c4014840 con 0x7f45cc15c060 2023-07-09T02:20:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc009420 con 0x7f45cc15c060 2023-07-09T02:20:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc0b59f0 con 0x7f45cc15c060 2023-07-09T02:20:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.566+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45cc0cb4e0 con 0x7f45cc15c060 2023-07-09T02:20:49.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.570+0000 7f45b37fe640 1 -- 172.21.15.45:0/938403960 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45c40149a0 con 0x7f45cc15c060 2023-07-09T02:20:49.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.570+0000 7f45b37fe640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45b8066280 0x7f45b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.570+0000 7f45b37fe640 1 -- 172.21.15.45:0/938403960 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45c4084fd0 con 0x7f45cc15c060 2023-07-09T02:20:49.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.570+0000 7f45b37fe640 1 -- 172.21.15.45:0/938403960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f45b806e3c0 con 0x7f45cc15c060 2023-07-09T02:20:49.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.570+0000 7f45caffd640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45b8066280 0x7f45b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.570+0000 7f45caffd640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45b8066280 0x7f45b8068730 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0af000 tx=0x7f45bc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.574+0000 7f45b37fe640 1 -- 172.21.15.45:0/938403960 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45c4018060 con 0x7f45cc15c060 2023-07-09T02:20:49.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:20:49.675 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:20:49.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.726+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45cc0cb4e0 con 0x7f45cc15c060 2023-07-09T02:20:49.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45b37fe640 1 -- 172.21.15.45:0/938403960 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45cc0cb4e0 con 0x7f45cc15c060 2023-07-09T02:20:49.728 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:20:49.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45b8066280 msgr2=0x7f45b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45b8066280 0x7f45b8068730 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0af000 tx=0x7f45bc0a7000 comp rx=0 tx=0).stop 2023-07-09T02:20:49.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45cc15c060 msgr2=0x7f45cc153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45cc15c060 0x7f45cc153540 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f45c400ef90 tx=0x7f45c400c490 comp rx=0 tx=0).stop 2023-07-09T02:20:49.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 shutdown_connections 2023-07-09T02:20:49.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45cc15c060 0x7f45cc153540 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45b8066280 0x7f45b8068730 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45cc0d2620 0x7f45cc0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 --2- 172.21.15.45:0/938403960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45cc0cd120 0x7f45cc15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 >> 172.21.15.45:0/938403960 conn(0x7f45cc0698e0 msgr2=0x7f45cc0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:49.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 shutdown_connections 2023-07-09T02:20:49.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.730+0000 7f45d1740640 1 -- 172.21.15.45:0/938403960 wait complete. 2023-07-09T02:20:49.748 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:20:49.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f626dfc5640 1 Processor -- start 2023-07-09T02:20:49.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f626dfc5640 1 -- start start 2023-07-09T02:20:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f626dfc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f626815c060 0x7f62680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f626dfc5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6268160a50 con 0x7f62680d2620 2023-07-09T02:20:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f626dfc5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626815c430 con 0x7f62680cd120 2023-07-09T02:20:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f626dfc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626815fb60 con 0x7f626815c060 2023-07-09T02:20:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f6267fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f62680d2620 0x7f62680cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40302/0 (socket says 172.21.15.45:40302) 2023-07-09T02:20:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f6267fff640 1 -- 172.21.15.45:0/2478547041 learned_addr learned my addr 172.21.15.45:0/2478547041 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:49.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f62677fe640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f626815c060 0x7f62680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305695081 0 0) 0x7f6268160a50 con 0x7f62680d2620 2023-07-09T02:20:49.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.934+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6250003530 con 0x7f62680d2620 2023-07-09T02:20:49.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483615755 0 0) 0x7f626815c430 con 0x7f62680cd120 2023-07-09T02:20:49.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6268160a50 con 0x7f62680cd120 2023-07-09T02:20:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3780064987 0 0) 0x7f6250003530 con 0x7f62680d2620 2023-07-09T02:20:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f626815c060 msgr2=0x7f62680b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f626815c060 0x7f62680b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 >> v1:172.21.15.155:6789/0 conn(0x7f62680cd120 legacy=0x7f62680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626815fe40 con 0x7f62680d2620 2023-07-09T02:20:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f6260001a00 con 0x7f62680d2620 2023-07-09T02:20:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 >> v1:172.21.15.45:6789/0 conn(0x7f62680d2620 legacy=0x7f62680cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6250003b40 0x7f6250003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f626815c060 0x7f62500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250004d10 0x7f6250005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626815fb60 con 0x7f6250003b40 2023-07-09T02:20:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625000ba40 con 0x7f6250004d10 2023-07-09T02:20:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625000bc00 con 0x7f626815c060 2023-07-09T02:20:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62677fe640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6250003b40 0x7f6250003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f6266ffd640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f626815c060 0x7f62500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f6267fff640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250004d10 0x7f6250005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62677fe640 1 -- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f626815c060 msgr2=0x7f62500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:49.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62677fe640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f626815c060 0x7f62500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62677fe640 1 -- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250004d10 msgr2=0x7f6250005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:49.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62677fe640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250004d10 0x7f6250005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62677fe640 1 -- 172.21.15.45:0/2478547041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250003530 con 0x7f6250003b40 2023-07-09T02:20:49.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f6267fff640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250004d10 0x7f6250005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:49.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.938+0000 7f62677fe640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6250003b40 0x7f6250003f30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f6258009ab0 tx=0x7f625801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a719df7a8ad90181 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580a55f0 con 0x7f6250003b40 2023-07-09T02:20:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580a5750 con 0x7f6250003b40 2023-07-09T02:20:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f62667fc640 1 -- 172.21.15.45:0/2478547041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62580a5b00 con 0x7f6250003b40 2023-07-09T02:20:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- 172.21.15.45:0/2478547041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6250003b40 msgr2=0x7f6250003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 --2- 172.21.15.45:0/2478547041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6250003b40 0x7f6250003f30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f6258009ab0 tx=0x7f625801ca00 comp rx=0 tx=0).stop 2023-07-09T02:20:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f6267fff640 1 -- 172.21.15.45:0/2478547041 reap_dead start 2023-07-09T02:20:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- 172.21.15.45:0/2478547041 shutdown_connections 2023-07-09T02:20:49.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- 172.21.15.45:0/2478547041 >> 172.21.15.45:0/2478547041 conn(0x7f62680698e0 msgr2=0x7f6268069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:49.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- 172.21.15.45:0/2478547041 shutdown_connections 2023-07-09T02:20:49.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- 172.21.15.45:0/2478547041 wait complete. 2023-07-09T02:20:49.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 Processor -- start 2023-07-09T02:20:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- start start 2023-07-09T02:20:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250003b40 0x7f626815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815ecf0 0x7f626814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6268070310 0x7f62680cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626814fc60 con 0x7f626815ecf0 2023-07-09T02:20:49.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626815dc50 con 0x7f6250003b40 2023-07-09T02:20:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f626dfc5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626815df30 con 0x7f6268070310 2023-07-09T02:20:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f6266ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815ecf0 0x7f626814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f6266ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815ecf0 0x7f626814f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46988/0 (socket says 172.21.15.45:46988) 2023-07-09T02:20:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.942+0000 7f6266ffd640 1 -- 172.21.15.45:0/431888974 learned_addr learned my addr 172.21.15.45:0/431888974 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f62677fe640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250003b40 0x7f626815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f6267fff640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6268070310 0x7f62680cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f6266ffd640 1 -- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6268070310 msgr2=0x7f62680cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f6266ffd640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6268070310 0x7f62680cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f6266ffd640 1 -- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250003b40 msgr2=0x7f626815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f6266ffd640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250003b40 0x7f626815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f6266ffd640 1 -- 172.21.15.45:0/431888974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626815e210 con 0x7f626815ecf0 2023-07-09T02:20:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f6266ffd640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815ecf0 0x7f626814f720 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f625c00e780 tx=0x7f625c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f624ffff640 1 -- 172.21.15.45:0/431888974 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0050d0 con 0x7f626815ecf0 2023-07-09T02:20:49.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f624ffff640 1 -- 172.21.15.45:0/431888974 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c005250 con 0x7f626815ecf0 2023-07-09T02:20:49.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f624ffff640 1 -- 172.21.15.45:0/431888974 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c00c6c0 con 0x7f626815ecf0 2023-07-09T02:20:49.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626815e4f0 con 0x7f626815ecf0 2023-07-09T02:20:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62680707b0 con 0x7f626815ecf0 2023-07-09T02:20:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62680709d0 con 0x7f626815ecf0 2023-07-09T02:20:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.946+0000 7f624ffff640 1 -- 172.21.15.45:0/431888974 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f625c00c820 con 0x7f626815ecf0 2023-07-09T02:20:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.950+0000 7f624ffff640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6254066280 0x7f6254068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.950+0000 7f624ffff640 1 -- 172.21.15.45:0/431888974 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f625c083d00 con 0x7f626815ecf0 2023-07-09T02:20:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.950+0000 7f624ffff640 1 -- 172.21.15.45:0/431888974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f625406e3c0 con 0x7f626815ecf0 2023-07-09T02:20:49.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.950+0000 7f62677fe640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6254066280 0x7f6254068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.950+0000 7f62677fe640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6254066280 0x7f6254068730 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6258009ab0 tx=0x7f62580046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:49.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:49.954+0000 7f624ffff640 1 -- 172.21.15.45:0/431888974 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f625c0511a0 con 0x7f626815ecf0 2023-07-09T02:20:50.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.138+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62680709d0 con 0x7f626815ecf0 2023-07-09T02:20:50.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f624ffff640 1 -- 172.21.15.45:0/431888974 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f625c07e260 con 0x7f626815ecf0 2023-07-09T02:20:50.140 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:50.140 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1878423144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1878423144},{"type":"v1","addr":"172.21.15.155:6836","nonce":1878423144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":8259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1407467413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1407467413},{"type":"v1","addr":"172.21.15.45:6833","nonce":1407467413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2772552547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2772552547},{"type":"v1","addr":"172.21.15.45:6835","nonce":2772552547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:18:43.005298+0000","modified":"2023-07-09T02:18:46.662099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8274":{"gid":8274,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3076932418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3076932418},{"type":"v1","addr":"172.21.15.155:6837","nonce":3076932418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T02:20:50.140 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 75 2023-07-09T02:20:50.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6254066280 msgr2=0x7f6254068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6254066280 0x7f6254068730 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6258009ab0 tx=0x7f62580046d0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815ecf0 msgr2=0x7f626814f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815ecf0 0x7f626814f720 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f625c00e780 tx=0x7f625c00ec40 comp rx=0 tx=0).stop 2023-07-09T02:20:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 shutdown_connections 2023-07-09T02:20:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6254066280 0x7f6254068730 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6268070310 0x7f62680cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626815ecf0 0x7f626814f720 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 --2- 172.21.15.45:0/431888974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6250003b40 0x7f626815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 >> 172.21.15.45:0/431888974 conn(0x7f62680698e0 msgr2=0x7f62680d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:50.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 shutdown_connections 2023-07-09T02:20:50.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.142+0000 7f626dfc5640 1 -- 172.21.15.45:0/431888974 wait complete. 2023-07-09T02:20:50.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:20:50.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.306+0000 7f502ae48640 1 Processor -- start 2023-07-09T02:20:50.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.306+0000 7f502ae48640 1 -- start start 2023-07-09T02:20:50.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.306+0000 7f502ae48640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50240ca0f0 0x7f50240cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.306+0000 7f502ae48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f502415db00 0x7f502415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.306+0000 7f502ae48640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502406bf30 con 0x7f50240cbbb0 2023-07-09T02:20:50.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.306+0000 7f502ae48640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502415e4c0 con 0x7f50240ca0f0 2023-07-09T02:20:50.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.306+0000 7f502ae48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502406bc50 con 0x7f502415db00 2023-07-09T02:20:50.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.306+0000 7f5028be4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50240ca0f0 0x7f50240cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f5028be4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50240ca0f0 0x7f50240cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:54376/0 (socket says 172.21.15.45:54376) 2023-07-09T02:20:50.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f5028be4640 1 -- 172.21.15.45:0/290734882 learned_addr learned my addr 172.21.15.45:0/290734882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:50.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f5023fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f50240cbbb0 0x7f50240c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:53068/0 (socket says 172.21.15.45:53068) 2023-07-09T02:20:50.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f50293e5640 1 --2- 172.21.15.45:0/290734882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f502415db00 0x7f502415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f5028be4640 1 -- 172.21.15.45:0/290734882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f502415db00 msgr2=0x7f502415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:50.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f5028be4640 1 --2- 172.21.15.45:0/290734882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f502415db00 0x7f502415df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f5028be4640 1 -- 172.21.15.45:0/290734882 >> v1:172.21.15.155:6789/0 conn(0x7f50240cbbb0 legacy=0x7f50240c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f5028be4640 1 -- 172.21.15.45:0/290734882 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240cab90 con 0x7f50240ca0f0 2023-07-09T02:20:50.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f5028be4640 1 --2- 172.21.15.45:0/290734882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50240ca0f0 0x7f50240cb670 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5018009870 tx=0x7f501801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=490ee17cbbb13506 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:50.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f50237fe640 1 -- 172.21.15.45:0/290734882 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180ac620 con 0x7f50240ca0f0 2023-07-09T02:20:50.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f50237fe640 1 -- 172.21.15.45:0/290734882 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180ac780 con 0x7f50240ca0f0 2023-07-09T02:20:50.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.310+0000 7f50237fe640 1 -- 172.21.15.45:0/290734882 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180acb10 con 0x7f50240ca0f0 2023-07-09T02:20:50.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- 172.21.15.45:0/290734882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50240ca0f0 msgr2=0x7f50240cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 --2- 172.21.15.45:0/290734882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50240ca0f0 0x7f50240cb670 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5018009870 tx=0x7f501801c4b0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- 172.21.15.45:0/290734882 shutdown_connections 2023-07-09T02:20:50.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 --2- 172.21.15.45:0/290734882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f502415db00 0x7f502415df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 --2- 172.21.15.45:0/290734882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50240ca0f0 0x7f50240cb670 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- 172.21.15.45:0/290734882 >> 172.21.15.45:0/290734882 conn(0x7f50240694b0 msgr2=0x7f50240698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:50.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- 172.21.15.45:0/290734882 shutdown_connections 2023-07-09T02:20:50.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- 172.21.15.45:0/290734882 wait complete. 2023-07-09T02:20:50.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 Processor -- start 2023-07-09T02:20:50.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- start start 2023-07-09T02:20:50.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50240ca0f0 0x7f50240b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50240cbbb0 0x7f502413a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f502415db00 0x7f502415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502414d2e0 con 0x7f50240cbbb0 2023-07-09T02:20:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502414ce50 con 0x7f502415db00 2023-07-09T02:20:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f502ae48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502413ade0 con 0x7f50240ca0f0 2023-07-09T02:20:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5023fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50240cbbb0 0x7f502413a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5023fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50240cbbb0 0x7f502413a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46992/0 (socket says 172.21.15.45:46992) 2023-07-09T02:20:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5023fff640 1 -- 172.21.15.45:0/3550462710 learned_addr learned my addr 172.21.15.45:0/3550462710 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5028be4640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50240ca0f0 0x7f50240b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f50293e5640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f502415db00 0x7f502415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5023fff640 1 -- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50240ca0f0 msgr2=0x7f50240b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5023fff640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50240ca0f0 0x7f50240b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5023fff640 1 -- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f502415db00 msgr2=0x7f502415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5023fff640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f502415db00 0x7f502415a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.314+0000 7f5023fff640 1 -- 172.21.15.45:0/3550462710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50180094d0 con 0x7f50240cbbb0 2023-07-09T02:20:50.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f5023fff640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50240cbbb0 0x7f502413a8a0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f501000c490 tx=0x7f501000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:50.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f50217fa640 1 -- 172.21.15.45:0/3550462710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010007480 con 0x7f50240cbbb0 2023-07-09T02:20:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f50217fa640 1 -- 172.21.15.45:0/3550462710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50100075e0 con 0x7f50240cbbb0 2023-07-09T02:20:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502414c240 con 0x7f50240cbbb0 2023-07-09T02:20:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f50217fa640 1 -- 172.21.15.45:0/3550462710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010004a10 con 0x7f50240cbbb0 2023-07-09T02:20:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502414c800 con 0x7f50240cbbb0 2023-07-09T02:20:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502414cfe0 con 0x7f50240cbbb0 2023-07-09T02:20:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f50217fa640 1 -- 172.21.15.45:0/3550462710 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5010004b70 con 0x7f50240cbbb0 2023-07-09T02:20:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f50217fa640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50080662b0 0x7f5008068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f50217fa640 1 -- 172.21.15.45:0/3550462710 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5010083130 con 0x7f50240cbbb0 2023-07-09T02:20:50.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f50217fa640 1 -- 172.21.15.45:0/3550462710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f500806e3f0 con 0x7f50240cbbb0 2023-07-09T02:20:50.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.318+0000 7f5028be4640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50080662b0 0x7f5008068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.322+0000 7f5028be4640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50080662b0 0x7f5008068760 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f50180ae000 tx=0x7f50180a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:50.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.322+0000 7f50217fa640 1 -- 172.21.15.45:0/3550462710 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50100505c0 con 0x7f50240cbbb0 2023-07-09T02:20:50.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.478+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f502404d7d0 con 0x7f50240cbbb0 2023-07-09T02:20:50.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.478+0000 7f50217fa640 1 -- 172.21.15.45:0/3550462710 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18337 (secure 0 0 0) 0x7f5010018020 con 0x7f50240cbbb0 2023-07-09T02:20:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:50.478 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":155,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:19:54.428525+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:18:40.756512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T02:18:42.013313+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:20:50.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50080662b0 msgr2=0x7f5008068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50080662b0 0x7f5008068760 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f50180ae000 tx=0x7f50180a7000 comp rx=0 tx=0).stop 2023-07-09T02:20:50.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50240cbbb0 msgr2=0x7f502413a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50240cbbb0 0x7f502413a8a0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f501000c490 tx=0x7f501000c950 comp rx=0 tx=0).stop 2023-07-09T02:20:50.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 shutdown_connections 2023-07-09T02:20:50.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f502415db00 0x7f502415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50240cbbb0 0x7f502413a8a0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f50080662b0 0x7f5008068760 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 --2- 172.21.15.45:0/3550462710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f50240ca0f0 0x7f50240b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 >> 172.21.15.45:0/3550462710 conn(0x7f50240694b0 msgr2=0x7f502415b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:50.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 shutdown_connections 2023-07-09T02:20:50.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.482+0000 7f502ae48640 1 -- 172.21.15.45:0/3550462710 wait complete. 2023-07-09T02:20:50.499 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:20:50.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:20:50.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa2409d2640 1 Processor -- start 2023-07-09T02:20:50.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa2409d2640 1 -- start start 2023-07-09T02:20:50.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa2409d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa23c0d2620 0x7fa23c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa2409d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa23c0cd120 0x7fa23c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa2409d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c160a50 con 0x7fa23c15c060 2023-07-09T02:20:50.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa2409d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c15c430 con 0x7fa23c0cd120 2023-07-09T02:20:50.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa2409d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c15fb60 con 0x7fa23c0d2620 2023-07-09T02:20:50.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa23ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa23c0cd120 0x7fa23c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa23ad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa23c0cd120 0x7fa23c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47004/0 (socket says 172.21.15.45:47004) 2023-07-09T02:20:50.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa233fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa23c0d2620 0x7fa23c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa23ad9d640 1 -- 172.21.15.45:0/3679823048 learned_addr learned my addr 172.21.15.45:0/3679823048 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:50.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa23a59c640 1 --1- 172.21.15.45:0/3679823048 >> v1:172.21.15.155:6789/0 conn(0x7fa23c15c060 0x7fa23c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:53076/0 (socket says 172.21.15.45:53076) 2023-07-09T02:20:50.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa23ad9d640 1 -- 172.21.15.45:0/3679823048 >> v2:172.21.15.155:3300/0 conn(0x7fa23c0d2620 msgr2=0x7fa23c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:50.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa23ad9d640 1 --2- 172.21.15.45:0/3679823048 >> v2:172.21.15.155:3300/0 conn(0x7fa23c0d2620 0x7fa23c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa23ad9d640 1 -- 172.21.15.45:0/3679823048 >> v1:172.21.15.155:6789/0 conn(0x7fa23c15c060 legacy=0x7fa23c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa23ad9d640 1 -- 172.21.15.45:0/3679823048 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c15fe40 con 0x7fa23c0cd120 2023-07-09T02:20:50.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.646+0000 7fa239d9b640 1 -- 172.21.15.45:0/3679823048 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751444876 0 0) 0x7fa23c160a50 con 0x7fa23c15c060 2023-07-09T02:20:50.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa23ad9d640 1 --2- 172.21.15.45:0/3679823048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0cd120 0x7fa23c0cee30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa23c15fac0 tx=0x7fa23401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae42fe52a7ac3ad server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:50.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa239d9b640 1 -- 172.21.15.45:0/3679823048 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340a5860 con 0x7fa23c0cd120 2023-07-09T02:20:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa239d9b640 1 -- 172.21.15.45:0/3679823048 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2340a59c0 con 0x7fa23c0cd120 2023-07-09T02:20:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa239d9b640 1 -- 172.21.15.45:0/3679823048 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340a5d50 con 0x7fa23c0cd120 2023-07-09T02:20:50.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa2409d2640 1 -- 172.21.15.45:0/3679823048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0cd120 msgr2=0x7fa23c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa2409d2640 1 --2- 172.21.15.45:0/3679823048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0cd120 0x7fa23c0cee30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa23c15fac0 tx=0x7fa23401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa2409d2640 1 -- 172.21.15.45:0/3679823048 shutdown_connections 2023-07-09T02:20:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa2409d2640 1 --2- 172.21.15.45:0/3679823048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0cd120 0x7fa23c0cee30 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa2409d2640 1 --2- 172.21.15.45:0/3679823048 >> v2:172.21.15.155:3300/0 conn(0x7fa23c0d2620 0x7fa23c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa2409d2640 1 -- 172.21.15.45:0/3679823048 >> 172.21.15.45:0/3679823048 conn(0x7fa23c0698e0 msgr2=0x7fa23c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa2409d2640 1 -- 172.21.15.45:0/3679823048 shutdown_connections 2023-07-09T02:20:50.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.650+0000 7fa2409d2640 1 -- 172.21.15.45:0/3679823048 wait complete. 2023-07-09T02:20:50.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 Processor -- start 2023-07-09T02:20:50.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 -- start start 2023-07-09T02:20:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23c0cd120 0x7fa23c14e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0d2620 0x7fa23c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa23c15c060 0x7fa23c14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c151eb0 con 0x7fa23c0d2620 2023-07-09T02:20:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c15a1e0 con 0x7fa23c15c060 2023-07-09T02:20:50.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c151510 con 0x7fa23c0cd120 2023-07-09T02:20:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0d2620 0x7fa23c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0d2620 0x7fa23c1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47010/0 (socket says 172.21.15.45:47010) 2023-07-09T02:20:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 -- 172.21.15.45:0/596284708 learned_addr learned my addr 172.21.15.45:0/596284708 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa23a59c640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23c0cd120 0x7fa23c14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa23ad9d640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa23c15c060 0x7fa23c14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 -- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23c0cd120 msgr2=0x7fa23c14e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23c0cd120 0x7fa23c14e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 -- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa23c15c060 msgr2=0x7fa23c14f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa23c15c060 0x7fa23c14f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 -- 172.21.15.45:0/596284708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234009b30 con 0x7fa23c0d2620 2023-07-09T02:20:50.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa23ad9d640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa23c15c060 0x7fa23c14f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:50.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa233fff640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0d2620 0x7fa23c1598e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa22400e930 tx=0x7fa22400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:50.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa232ffd640 1 -- 172.21.15.45:0/596284708 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224009690 con 0x7fa23c0d2620 2023-07-09T02:20:50.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa232ffd640 1 -- 172.21.15.45:0/596284708 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22400ca00 con 0x7fa23c0d2620 2023-07-09T02:20:50.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa232ffd640 1 -- 172.21.15.45:0/596284708 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400cdb0 con 0x7fa23c0d2620 2023-07-09T02:20:50.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c0b59f0 con 0x7fa23c0d2620 2023-07-09T02:20:50.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.654+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c151ad0 con 0x7fa23c0d2620 2023-07-09T02:20:50.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.658+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c04d7d0 con 0x7fa23c0d2620 2023-07-09T02:20:50.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.658+0000 7fa232ffd640 1 -- 172.21.15.45:0/596284708 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa224013470 con 0x7fa23c0d2620 2023-07-09T02:20:50.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.658+0000 7fa232ffd640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa21c066280 0x7fa21c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:50.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.658+0000 7fa232ffd640 1 -- 172.21.15.45:0/596284708 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa224083ee0 con 0x7fa23c0d2620 2023-07-09T02:20:50.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.658+0000 7fa232ffd640 1 -- 172.21.15.45:0/596284708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7fa21c06e3c0 con 0x7fa23c0d2620 2023-07-09T02:20:50.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.658+0000 7fa23a59c640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa21c066280 0x7fa21c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:50.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.658+0000 7fa23a59c640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa21c066280 0x7fa21c068730 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa22c000f70 tx=0x7fa22c007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:50.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.662+0000 7fa232ffd640 1 -- 172.21.15.45:0/596284708 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa224017060 con 0x7fa23c0d2620 2023-07-09T02:20:50.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa23c06baa0 con 0x7fa23c0d2620 2023-07-09T02:20:50.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa232ffd640 1 -- 172.21.15.45:0/596284708 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fa224021070 con 0x7fa23c0d2620 2023-07-09T02:20:50.853 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:50.854 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1878423144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1878423144},{"type":"v1","addr":"172.21.15.155:6836","nonce":1878423144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":8259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1407467413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1407467413},{"type":"v1","addr":"172.21.15.45:6833","nonce":1407467413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2772552547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2772552547},{"type":"v1","addr":"172.21.15.45:6835","nonce":2772552547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:18:43.005298+0000","modified":"2023-07-09T02:18:46.662099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8274":{"gid":8274,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3076932418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3076932418},{"type":"v1","addr":"172.21.15.155:6837","nonce":3076932418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T02:20:50.855 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 75 2023-07-09T02:20:50.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa21c066280 msgr2=0x7fa21c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa21c066280 0x7fa21c068730 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa22c000f70 tx=0x7fa22c007df0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0d2620 msgr2=0x7fa23c1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:50.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0d2620 0x7fa23c1598e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa22400e930 tx=0x7fa22400edf0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 shutdown_connections 2023-07-09T02:20:50.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa23c15c060 0x7fa23c14f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa23c0d2620 0x7fa23c1598e0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa21c066280 0x7fa21c068730 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 --2- 172.21.15.45:0/596284708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa23c0cd120 0x7fa23c14e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:50.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 >> 172.21.15.45:0/596284708 conn(0x7fa23c0698e0 msgr2=0x7fa23c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:50.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 shutdown_connections 2023-07-09T02:20:50.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:50.854+0000 7fa2409d2640 1 -- 172.21.15.45:0/596284708 wait complete. 2023-07-09T02:20:50.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:20:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ec16d8640 1 Processor -- start 2023-07-09T02:20:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ec16d8640 1 -- start start 2023-07-09T02:20:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ec16d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ebc15c060 0x7f2ebc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ec16d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ec16d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc160a50 con 0x7f2ebc0d2450 2023-07-09T02:20:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ec16d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc0d28f0 con 0x7f2ebc15c060 2023-07-09T02:20:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ec16d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0cfe40 con 0x7f2ebc0cd120 2023-07-09T02:20:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ebaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ebc15c060 0x7f2ebc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ebaffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ebc15c060 0x7f2ebc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47018/0 (socket says 172.21.15.45:47018) 2023-07-09T02:20:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ebaffd640 1 -- 172.21.15.45:0/588832511 learned_addr learned my addr 172.21.15.45:0/588832511 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2eb3fff640 1 --2- 172.21.15.45:0/588832511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ebaffd640 1 -- 172.21.15.45:0/588832511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 msgr2=0x7f2ebc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ebaffd640 1 --2- 172.21.15.45:0/588832511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ebaffd640 1 -- 172.21.15.45:0/588832511 >> v1:172.21.15.155:6789/0 conn(0x7f2ebc0d2450 legacy=0x7f2ebc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2ebaffd640 1 -- 172.21.15.45:0/588832511 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc15c430 con 0x7f2ebc15c060 2023-07-09T02:20:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.022+0000 7f2eb3fff640 1 --2- 172.21.15.45:0/588832511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ebaffd640 1 --2- 172.21.15.45:0/588832511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc15c060 0x7f2ebc0b4ed0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009870 tx=0x7f2eac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3370c7f99656fc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2eba7fc640 1 -- 172.21.15.45:0/588832511 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0a7070 con 0x7f2ebc15c060 2023-07-09T02:20:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2eba7fc640 1 -- 172.21.15.45:0/588832511 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ab430 con 0x7f2ebc15c060 2023-07-09T02:20:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2eba7fc640 1 -- 172.21.15.45:0/588832511 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ab7c0 con 0x7f2ebc15c060 2023-07-09T02:20:51.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ec16d8640 1 -- 172.21.15.45:0/588832511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc15c060 msgr2=0x7f2ebc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/588832511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc15c060 0x7f2ebc0b4ed0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009870 tx=0x7f2eac01c510 comp rx=0 tx=0).stop 2023-07-09T02:20:51.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ec16d8640 1 -- 172.21.15.45:0/588832511 shutdown_connections 2023-07-09T02:20:51.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/588832511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/588832511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc15c060 0x7f2ebc0b4ed0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ec16d8640 1 -- 172.21.15.45:0/588832511 >> 172.21.15.45:0/588832511 conn(0x7f2ebc0698e0 msgr2=0x7f2ebc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:51.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ec16d8640 1 -- 172.21.15.45:0/588832511 shutdown_connections 2023-07-09T02:20:51.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.026+0000 7f2ec16d8640 1 -- 172.21.15.45:0/588832511 wait complete. 2023-07-09T02:20:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 Processor -- start 2023-07-09T02:20:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 -- start start 2023-07-09T02:20:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc0d2450 0x7f2ebc0b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ebc15c060 0x7f2ebc0b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0b6710 con 0x7f2ebc0d2450 2023-07-09T02:20:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0b5360 con 0x7f2ebc15c060 2023-07-09T02:20:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0b4de0 con 0x7f2ebc0cd120 2023-07-09T02:20:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc0d2450 0x7f2ebc0b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc0d2450 0x7f2ebc0b7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47026/0 (socket says 172.21.15.45:47026) 2023-07-09T02:20:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 -- 172.21.15.45:0/3038772776 learned_addr learned my addr 172.21.15.45:0/3038772776 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ebb7fe640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ebc15c060 0x7f2ebc0b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 -- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 msgr2=0x7f2ebc153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ebaffd640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 -- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ebc15c060 msgr2=0x7f2ebc0b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ebc15c060 0x7f2ebc0b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 -- 172.21.15.45:0/3038772776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0094d0 con 0x7f2ebc0d2450 2023-07-09T02:20:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ebb7fe640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ebc15c060 0x7f2ebc0b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ebaffd640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb3fff640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc0d2450 0x7f2ebc0b7c90 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400e7e0 tx=0x7f2ea400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb37fe640 1 -- 172.21.15.45:0/3038772776 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400c6d0 con 0x7f2ebc0d2450 2023-07-09T02:20:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb37fe640 1 -- 172.21.15.45:0/3038772776 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea400c830 con 0x7f2ebc0d2450 2023-07-09T02:20:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc0b47f0 con 0x7f2ebc0d2450 2023-07-09T02:20:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2eb37fe640 1 -- 172.21.15.45:0/3038772776 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400cbe0 con 0x7f2ebc0d2450 2023-07-09T02:20:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc0b3ff0 con 0x7f2ebc0d2450 2023-07-09T02:20:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.030+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc04d7d0 con 0x7f2ebc0d2450 2023-07-09T02:20:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.034+0000 7f2eb37fe640 1 -- 172.21.15.45:0/3038772776 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ea400cd40 con 0x7f2ebc0d2450 2023-07-09T02:20:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.034+0000 7f2eb37fe640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e9c066280 0x7f2e9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.034+0000 7f2eb37fe640 1 -- 172.21.15.45:0/3038772776 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ea4083c40 con 0x7f2ebc0d2450 2023-07-09T02:20:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.034+0000 7f2eb37fe640 1 -- 172.21.15.45:0/3038772776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f2e9c06e3c0 con 0x7f2ebc0d2450 2023-07-09T02:20:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.034+0000 7f2ebaffd640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e9c066280 0x7f2e9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.034+0000 7f2ebaffd640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e9c066280 0x7f2e9c068730 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0af000 tx=0x7f2eac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.038+0000 7f2eb37fe640 1 -- 172.21.15.45:0/3038772776 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ea4054b40 con 0x7f2ebc0d2450 2023-07-09T02:20:51.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.222+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ebc06baa0 con 0x7f2ebc0d2450 2023-07-09T02:20:51.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.222+0000 7f2eb37fe640 1 -- 172.21.15.45:0/3038772776 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f2ea4021030 con 0x7f2ebc0d2450 2023-07-09T02:20:51.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:51.223 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1878423144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1878423144},{"type":"v1","addr":"172.21.15.155:6836","nonce":1878423144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":8259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1407467413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1407467413},{"type":"v1","addr":"172.21.15.45:6833","nonce":1407467413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2772552547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2772552547},{"type":"v1","addr":"172.21.15.45:6835","nonce":2772552547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:18:43.005298+0000","modified":"2023-07-09T02:18:46.662099+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8274":{"gid":8274,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6837/3076932418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3076932418},{"type":"v1","addr":"172.21.15.155:6837","nonce":3076932418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T02:20:51.223 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 75 2023-07-09T02:20:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e9c066280 msgr2=0x7f2e9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e9c066280 0x7f2e9c068730 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0af000 tx=0x7f2eac008040 comp rx=0 tx=0).stop 2023-07-09T02:20:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc0d2450 msgr2=0x7f2ebc0b7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc0d2450 0x7f2ebc0b7c90 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400e7e0 tx=0x7f2ea400eca0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 shutdown_connections 2023-07-09T02:20:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ebc15c060 0x7f2ebc0b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ebc0d2450 0x7f2ebc0b7c90 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e9c066280 0x7f2e9c068730 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 --2- 172.21.15.45:0/3038772776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ebc0cd120 0x7f2ebc153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 >> 172.21.15.45:0/3038772776 conn(0x7f2ebc0698e0 msgr2=0x7f2ebc0b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 shutdown_connections 2023-07-09T02:20:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.226+0000 7f2ec16d8640 1 -- 172.21.15.45:0/3038772776 wait complete. 2023-07-09T02:20:51.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:20:51.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.386+0000 7fdf90e5c640 1 Processor -- start 2023-07-09T02:20:51.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.386+0000 7fdf90e5c640 1 -- start start 2023-07-09T02:20:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf90e5c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf90e5c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdf8c0d2620 0x7fdf8c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf90e5c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c160a50 con 0x7fdf8c0cd120 2023-07-09T02:20:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf90e5c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c15c430 con 0x7fdf8c0d2620 2023-07-09T02:20:51.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf90e5c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c15fb60 con 0x7fdf8c15c060 2023-07-09T02:20:51.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf83fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdf8c0cd120 0x7fdf8c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40306/0 (socket says 172.21.15.45:40306) 2023-07-09T02:20:51.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf83fff640 1 -- 172.21.15.45:0/3852389012 learned_addr learned my addr 172.21.15.45:0/3852389012 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:51.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf8ad9d640 1 --2- 172.21.15.45:0/3852389012 >> v2:172.21.15.155:3300/0 conn(0x7fdf8c0d2620 0x7fdf8c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf8a59c640 1 --2- 172.21.15.45:0/3852389012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf89d9b640 1 -- 172.21.15.45:0/3852389012 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719084814 0 0) 0x7fdf8c160a50 con 0x7fdf8c0cd120 2023-07-09T02:20:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf89d9b640 1 -- 172.21.15.45:0/3852389012 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf78003530 con 0x7fdf8c0cd120 2023-07-09T02:20:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf89d9b640 1 -- 172.21.15.45:0/3852389012 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3424476867 0 0) 0x7fdf78003530 con 0x7fdf8c0cd120 2023-07-09T02:20:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf8ad9d640 1 -- 172.21.15.45:0/3852389012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 msgr2=0x7fdf8c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf8ad9d640 1 --2- 172.21.15.45:0/3852389012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf8ad9d640 1 -- 172.21.15.45:0/3852389012 >> v1:172.21.15.45:6789/0 conn(0x7fdf8c0cd120 legacy=0x7fdf8c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.390+0000 7fdf8ad9d640 1 -- 172.21.15.45:0/3852389012 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c15fe40 con 0x7fdf8c0d2620 2023-07-09T02:20:51.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf8ad9d640 1 --2- 172.21.15.45:0/3852389012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0cee30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009dc0 tx=0x7fdf8401c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2321a3345e3efa5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf89d9b640 1 -- 172.21.15.45:0/3852389012 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74001680 con 0x7fdf8c0d2620 2023-07-09T02:20:51.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf89d9b640 1 -- 172.21.15.45:0/3852389012 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840a5660 con 0x7fdf8c0d2620 2023-07-09T02:20:51.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf89d9b640 1 -- 172.21.15.45:0/3852389012 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840a59f0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 -- 172.21.15.45:0/3852389012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0d2620 msgr2=0x7fdf8c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/3852389012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0cee30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009dc0 tx=0x7fdf8401c820 comp rx=0 tx=0).stop 2023-07-09T02:20:51.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 -- 172.21.15.45:0/3852389012 shutdown_connections 2023-07-09T02:20:51.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/3852389012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0cee30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/3852389012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 -- 172.21.15.45:0/3852389012 >> 172.21.15.45:0/3852389012 conn(0x7fdf8c0698e0 msgr2=0x7fdf8c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:51.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 -- 172.21.15.45:0/3852389012 shutdown_connections 2023-07-09T02:20:51.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 -- 172.21.15.45:0/3852389012 wait complete. 2023-07-09T02:20:51.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.394+0000 7fdf90e5c640 1 Processor -- start 2023-07-09T02:20:51.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 -- start start 2023-07-09T02:20:51.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0cd120 0x7fdf8c0d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c152890 con 0x7fdf8c0d2620 2023-07-09T02:20:51.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c1540a0 con 0x7fdf8c0cd120 2023-07-09T02:20:51.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0cc580 con 0x7fdf8c15c060 2023-07-09T02:20:51.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47034/0 (socket says 172.21.15.45:47034) 2023-07-09T02:20:51.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 -- 172.21.15.45:0/2933569533 learned_addr learned my addr 172.21.15.45:0/2933569533 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:51.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf8a59c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0cd120 0x7fdf8c0d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf8ad9d640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 -- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 msgr2=0x7fdf8c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 -- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0cd120 msgr2=0x7fdf8c0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0cd120 0x7fdf8c0d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 -- 172.21.15.45:0/2933569533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009a70 con 0x7fdf8c0d2620 2023-07-09T02:20:51.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf8ad9d640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:51.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf83fff640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0b4240 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c750 tx=0x7fdf7400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf82ffd640 1 -- 172.21.15.45:0/2933569533 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74005af0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf82ffd640 1 -- 172.21.15.45:0/2933569533 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74005c50 con 0x7fdf8c0d2620 2023-07-09T02:20:51.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf82ffd640 1 -- 172.21.15.45:0/2933569533 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74007070 con 0x7fdf8c0d2620 2023-07-09T02:20:51.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c0b59f0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c0ccb00 con 0x7fdf8c0d2620 2023-07-09T02:20:51.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.398+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c1529d0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.402+0000 7fdf82ffd640 1 -- 172.21.15.45:0/2933569533 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf740071d0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.402+0000 7fdf82ffd640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdf6c0662b0 0x7fdf6c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.402+0000 7fdf82ffd640 1 -- 172.21.15.45:0/2933569533 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf74083ac0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.402+0000 7fdf82ffd640 1 -- 172.21.15.45:0/2933569533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7fdf6c06e3f0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.402+0000 7fdf8a59c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdf6c0662b0 0x7fdf6c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.402+0000 7fdf8a59c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdf6c0662b0 0x7fdf6c068760 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009a50 tx=0x7fdf7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.406+0000 7fdf82ffd640 1 -- 172.21.15.45:0/2933569533 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf8c1529d0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.562+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf8c1529d0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf82ffd640 1 -- 172.21.15.45:0/2933569533 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18337 (secure 0 0 0) 0x7fdf8c1529d0 con 0x7fdf8c0d2620 2023-07-09T02:20:51.563 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:51.564 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":155,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:19:54.428525+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:18:40.756512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T02:18:42.013313+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:20:51.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdf6c0662b0 msgr2=0x7fdf6c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdf6c0662b0 0x7fdf6c068760 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009a50 tx=0x7fdf7c008040 comp rx=0 tx=0).stop 2023-07-09T02:20:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8c0d2620 msgr2=0x7fdf8c0b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0b4240 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c750 tx=0x7fdf7400cc10 comp rx=0 tx=0).stop 2023-07-09T02:20:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 shutdown_connections 2023-07-09T02:20:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdf6c0662b0 0x7fdf6c068760 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf8c15c060 0x7fdf8c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf8c0d2620 0x7fdf8c0b4240 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 --2- 172.21.15.45:0/2933569533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf8c0cd120 0x7fdf8c0d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 >> 172.21.15.45:0/2933569533 conn(0x7fdf8c0698e0 msgr2=0x7fdf8c0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:51.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 shutdown_connections 2023-07-09T02:20:51.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.566+0000 7fdf90e5c640 1 -- 172.21.15.45:0/2933569533 wait complete. 2023-07-09T02:20:51.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:20:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f6825c19640 1 Processor -- start 2023-07-09T02:20:51.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f6825c19640 1 -- start start 2023-07-09T02:20:51.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f6825c19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f682015c060 0x7f68200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f6825c19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68200d2620 0x7f68200cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f6825c19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6820160a50 con 0x7f68200cd120 2023-07-09T02:20:51.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f6825c19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682015c430 con 0x7f68200d2620 2023-07-09T02:20:51.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f6825c19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682015fb60 con 0x7f682015c060 2023-07-09T02:20:51.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f681ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68200d2620 0x7f68200cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f681f7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f682015c060 0x7f68200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f681ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68200d2620 0x7f68200cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55932/0 (socket says 172.21.15.45:55932) 2023-07-09T02:20:51.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f681ffff640 1 -- 172.21.15.45:0/509641942 learned_addr learned my addr 172.21.15.45:0/509641942 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:51.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f681ffff640 1 -- 172.21.15.45:0/509641942 >> v2:172.21.15.155:3300/0 conn(0x7f682015c060 msgr2=0x7f68200b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:51.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f681ffff640 1 --2- 172.21.15.45:0/509641942 >> v2:172.21.15.155:3300/0 conn(0x7f682015c060 0x7f68200b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f681ffff640 1 -- 172.21.15.45:0/509641942 >> v1:172.21.15.155:6789/0 conn(0x7f68200cd120 legacy=0x7f68200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.734+0000 7f681ffff640 1 -- 172.21.15.45:0/509641942 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682015fe40 con 0x7f68200d2620 2023-07-09T02:20:51.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f681ffff640 1 --2- 172.21.15.45:0/509641942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200d2620 0x7f68200cee30 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f68200d3ad0 tx=0x7f681801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb40eb08390ccbc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f681effd640 1 -- 172.21.15.45:0/509641942 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68180a5860 con 0x7f68200d2620 2023-07-09T02:20:51.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f681effd640 1 -- 172.21.15.45:0/509641942 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68180a59c0 con 0x7f68200d2620 2023-07-09T02:20:51.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f681effd640 1 -- 172.21.15.45:0/509641942 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68180a5d50 con 0x7f68200d2620 2023-07-09T02:20:51.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f6825c19640 1 -- 172.21.15.45:0/509641942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200d2620 msgr2=0x7f68200cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f6825c19640 1 --2- 172.21.15.45:0/509641942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200d2620 0x7f68200cee30 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f68200d3ad0 tx=0x7f681801c9a0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f6825c19640 1 -- 172.21.15.45:0/509641942 shutdown_connections 2023-07-09T02:20:51.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f6825c19640 1 --2- 172.21.15.45:0/509641942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68200d2620 0x7f68200cee30 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f6825c19640 1 --2- 172.21.15.45:0/509641942 >> v2:172.21.15.155:3300/0 conn(0x7f682015c060 0x7f68200b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f6825c19640 1 -- 172.21.15.45:0/509641942 >> 172.21.15.45:0/509641942 conn(0x7f68200698e0 msgr2=0x7f6820069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:51.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f6825c19640 1 -- 172.21.15.45:0/509641942 shutdown_connections 2023-07-09T02:20:51.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.738+0000 7f6825c19640 1 -- 172.21.15.45:0/509641942 wait complete. 2023-07-09T02:20:51.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 Processor -- start 2023-07-09T02:20:51.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 -- start start 2023-07-09T02:20:51.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68200cd120 0x7f68200cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68200d2620 0x7f682015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682015c060 0x7f68200cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68200c9b10 con 0x7f682015c060 2023-07-09T02:20:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68200c9df0 con 0x7f68200cd120 2023-07-09T02:20:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68200ca0d0 con 0x7f68200d2620 2023-07-09T02:20:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682015c060 0x7f68200cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682015c060 0x7f68200cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55942/0 (socket says 172.21.15.45:55942) 2023-07-09T02:20:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 -- 172.21.15.45:0/596574820 learned_addr learned my addr 172.21.15.45:0/596574820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681f7fe640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68200cd120 0x7f68200cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6817fff640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68200d2620 0x7f682015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 -- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68200d2620 msgr2=0x7f682015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68200d2620 0x7f682015e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 -- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68200cd120 msgr2=0x7f68200cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68200cd120 0x7f68200cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 -- 172.21.15.45:0/596574820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818009b30 con 0x7f682015c060 2023-07-09T02:20:51.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681ffff640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682015c060 0x7f68200cae90 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f68180af040 tx=0x7f6818019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68180b8670 con 0x7f682015c060 2023-07-09T02:20:51.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68180b87d0 con 0x7f682015c060 2023-07-09T02:20:51.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68200b59f0 con 0x7f682015c060 2023-07-09T02:20:51.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68180b8b80 con 0x7f682015c060 2023-07-09T02:20:51.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.742+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68200ca690 con 0x7f682015c060 2023-07-09T02:20:51.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.746+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682004d7d0 con 0x7f682015c060 2023-07-09T02:20:51.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.746+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68180b8ce0 con 0x7f682015c060 2023-07-09T02:20:51.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.746+0000 7f681cff9640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6800066280 0x7f6800068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:51.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.746+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f681811f320 con 0x7f682015c060 2023-07-09T02:20:51.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.746+0000 7f681f7fe640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6800066280 0x7f6800068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:51.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.746+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f680006e3c0 con 0x7f682015c060 2023-07-09T02:20:51.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.746+0000 7f681f7fe640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6800066280 0x7f6800068730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6810009ac0 tx=0x7f6810009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:51.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.750+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68180ec8e0 con 0x7f682015c060 2023-07-09T02:20:51.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.938+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f682006baa0 con 0x7f682015c060 2023-07-09T02:20:51.938 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:20:51.938+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:20:51.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.942+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(156..156 src has 1..156) v4 ==== 374+0+0 (secure 0 0 0) 0x7f68180f4560 con 0x7f682015c060 2023-07-09T02:20:51.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.942+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f680006eb00 con 0x7f682015c060 2023-07-09T02:20:51.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f681cff9640 1 -- 172.21.15.45:0/596574820 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) v1 ==== 161+0+0 (secure 0 0 0) 0x7f68180eff00 con 0x7f682015c060 2023-07-09T02:20:51.944 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:20:51.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6800066280 msgr2=0x7f6800068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6800066280 0x7f6800068730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6810009ac0 tx=0x7f6810009190 comp rx=0 tx=0).stop 2023-07-09T02:20:51.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682015c060 msgr2=0x7f68200cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682015c060 0x7f68200cae90 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f68180af040 tx=0x7f6818019740 comp rx=0 tx=0).stop 2023-07-09T02:20:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 shutdown_connections 2023-07-09T02:20:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f682015c060 0x7f68200cae90 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6800066280 0x7f6800068730 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68200d2620 0x7f682015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 --2- 172.21.15.45:0/596574820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68200cd120 0x7f68200cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 >> 172.21.15.45:0/596574820 conn(0x7f68200698e0 msgr2=0x7f6820158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 shutdown_connections 2023-07-09T02:20:51.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:51.946+0000 7f6825c19640 1 -- 172.21.15.45:0/596574820 wait complete. 2023-07-09T02:20:51.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:20:52.010 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:20:52.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a868d8640 1 Processor -- start 2023-07-09T02:20:52.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a868d8640 1 -- start start 2023-07-09T02:20:52.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a868d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a80158e30 0x7f0a8006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:52.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a868d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a8006fd10 0x7f0a8006c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:52.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a868d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8006c650 0x7f0a800caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:52.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a868d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8006cad0 con 0x7f0a80158e30 2023-07-09T02:20:52.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a868d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a800ccf80 con 0x7f0a8006fd10 2023-07-09T02:20:52.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a868d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800cd540 con 0x7f0a8006c650 2023-07-09T02:20:52.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a80158e30 0x7f0a8006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:52.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a80158e30 0x7f0a8006f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55956/0 (socket says 172.21.15.45:55956) 2023-07-09T02:20:52.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7ffff640 1 -- 172.21.15.45:0/1116881489 learned_addr learned my addr 172.21.15.45:0/1116881489 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:52.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7f7fe640 1 --2- 172.21.15.45:0/1116881489 >> v2:172.21.15.155:3300/0 conn(0x7f0a8006fd10 0x7f0a8006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:52.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a84e75640 1 --2- 172.21.15.45:0/1116881489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8006c650 0x7f0a800caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:52.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7ffff640 1 -- 172.21.15.45:0/1116881489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8006c650 msgr2=0x7f0a800caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:52.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7ffff640 1 --2- 172.21.15.45:0/1116881489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8006c650 0x7f0a800caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7ffff640 1 -- 172.21.15.45:0/1116881489 >> v2:172.21.15.155:3300/0 conn(0x7f0a8006fd10 msgr2=0x7f0a8006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:52.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7ffff640 1 --2- 172.21.15.45:0/1116881489 >> v2:172.21.15.155:3300/0 conn(0x7f0a8006fd10 0x7f0a8006c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a7ffff640 1 -- 172.21.15.45:0/1116881489 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a800c8fb0 con 0x7f0a80158e30 2023-07-09T02:20:52.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.114+0000 7f0a84e75640 1 --2- 172.21.15.45:0/1116881489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8006c650 0x7f0a800caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:20:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a7ffff640 1 --2- 172.21.15.45:0/1116881489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a80158e30 0x7f0a8006f7d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f0a8006f260 tx=0x7f0a7001e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e9959967148d17 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a7effd640 1 -- 172.21.15.45:0/1116881489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700aa660 con 0x7f0a80158e30 2023-07-09T02:20:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a7effd640 1 -- 172.21.15.45:0/1116881489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a700aa7c0 con 0x7f0a80158e30 2023-07-09T02:20:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a7effd640 1 -- 172.21.15.45:0/1116881489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700aab50 con 0x7f0a80158e30 2023-07-09T02:20:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 -- 172.21.15.45:0/1116881489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a80158e30 msgr2=0x7f0a8006f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 --2- 172.21.15.45:0/1116881489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a80158e30 0x7f0a8006f7d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f0a8006f260 tx=0x7f0a7001e650 comp rx=0 tx=0).stop 2023-07-09T02:20:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 -- 172.21.15.45:0/1116881489 shutdown_connections 2023-07-09T02:20:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 --2- 172.21.15.45:0/1116881489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8006c650 0x7f0a800caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 --2- 172.21.15.45:0/1116881489 >> v2:172.21.15.155:3300/0 conn(0x7f0a8006fd10 0x7f0a8006c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 --2- 172.21.15.45:0/1116881489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a80158e30 0x7f0a8006f7d0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 -- 172.21.15.45:0/1116881489 >> 172.21.15.45:0/1116881489 conn(0x7f0a800694b0 msgr2=0x7f0a800698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 -- 172.21.15.45:0/1116881489 shutdown_connections 2023-07-09T02:20:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.118+0000 7f0a868d8640 1 -- 172.21.15.45:0/1116881489 wait complete. 2023-07-09T02:20:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 Processor -- start 2023-07-09T02:20:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 -- start start 2023-07-09T02:20:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a8006c650 0x7f0a80159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8006fd10 0x7f0a8014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a80158e30 0x7f0a8015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015afb0 con 0x7f0a8006fd10 2023-07-09T02:20:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8014d770 con 0x7f0a8006c650 2023-07-09T02:20:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015c270 con 0x7f0a80158e30 2023-07-09T02:20:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8006fd10 0x7f0a8014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a8006c650 0x7f0a80159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8006fd10 0x7f0a8014d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55960/0 (socket says 172.21.15.45:55960) 2023-07-09T02:20:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7f7fe640 1 -- 172.21.15.45:0/2180627118 learned_addr learned my addr 172.21.15.45:0/2180627118 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a8006c650 0x7f0a80159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:36972/0 (socket says 172.21.15.45:36972) 2023-07-09T02:20:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a84e75640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a80158e30 0x7f0a8015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7ffff640 1 -- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a80158e30 msgr2=0x7f0a8015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7ffff640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a80158e30 0x7f0a8015bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7ffff640 1 -- 172.21.15.45:0/2180627118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8006fd10 msgr2=0x7f0a8014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7ffff640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8006fd10 0x7f0a8014d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7ffff640 1 -- 172.21.15.45:0/2180627118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700094d0 con 0x7f0a8006c650 2023-07-09T02:20:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7ffff640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a8006c650 0x7f0a80159e20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0a700ae000 tx=0x7f0a7001b3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7cff9640 1 -- 172.21.15.45:0/2180627118 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700b2a50 con 0x7f0a8006c650 2023-07-09T02:20:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7cff9640 1 -- 172.21.15.45:0/2180627118 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a700b2bf0 con 0x7f0a8006c650 2023-07-09T02:20:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8015a430 con 0x7f0a8006c650 2023-07-09T02:20:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a7cff9640 1 -- 172.21.15.45:0/2180627118 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700a8400 con 0x7f0a8006c650 2023-07-09T02:20:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.122+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8015a9f0 con 0x7f0a8006c650 2023-07-09T02:20:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.126+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a800c5820 con 0x7f0a8006c650 2023-07-09T02:20:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.126+0000 7f0a7cff9640 1 -- 172.21.15.45:0/2180627118 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a700a8560 con 0x7f0a8006c650 2023-07-09T02:20:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.126+0000 7f0a7cff9640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a6c066280 0x7f0a6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.126+0000 7f0a7cff9640 1 -- 172.21.15.45:0/2180627118 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f0a70120bf0 con 0x7f0a8006c650 2023-07-09T02:20:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.126+0000 7f0a7cff9640 1 -- 172.21.15.45:0/2180627118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f0a6c06e4d0 con 0x7f0a8006c650 2023-07-09T02:20:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.126+0000 7f0a7f7fe640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a6c066280 0x7f0a6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.126+0000 7f0a7f7fe640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a6c066280 0x7f0a6c068730 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0a8015ba50 tx=0x7f0a74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.130+0000 7f0a7cff9640 1 -- 172.21.15.45:0/2180627118 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a700ee230 con 0x7f0a8006c650 2023-07-09T02:20:52.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.318+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a8004d7d0 con 0x7f0a8006c650 2023-07-09T02:20:52.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.950+0000 7f0a7cff9640 1 -- 172.21.15.45:0/2180627118 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0a700f1850 con 0x7f0a8006c650 2023-07-09T02:20:52.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a6c066280 msgr2=0x7f0a6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:52.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a6c066280 0x7f0a6c068730 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0a8015ba50 tx=0x7f0a74008040 comp rx=0 tx=0).stop 2023-07-09T02:20:52.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a8006c650 msgr2=0x7f0a80159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:52.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a8006c650 0x7f0a80159e20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0a700ae000 tx=0x7f0a7001b3f0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 shutdown_connections 2023-07-09T02:20:52.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a6c066280 0x7f0a6c068730 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a80158e30 0x7f0a8015bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a8006fd10 0x7f0a8014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 --2- 172.21.15.45:0/2180627118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a8006c650 0x7f0a80159e20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:52.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 >> 172.21.15.45:0/2180627118 conn(0x7f0a800694b0 msgr2=0x7f0a8006bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:52.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 shutdown_connections 2023-07-09T02:20:52.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:52.954+0000 7f0a868d8640 1 -- 172.21.15.45:0/2180627118 wait complete. 2023-07-09T02:20:52.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:20:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f560c80b640 1 Processor -- start 2023-07-09T02:20:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f560c80b640 1 -- start start 2023-07-09T02:20:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f560c80b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f56080cead0 0x7f56080b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f560c80b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 0x7f5608069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f560c80b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080cced0 con 0x7f560815c280 2023-07-09T02:20:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f560c80b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56080cd6e0 con 0x7f56080cead0 2023-07-09T02:20:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f560c80b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080d0450 con 0x7f5608069980 2023-07-09T02:20:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f5606ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f56080cead0 0x7f56080b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:53.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f5606ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f56080cead0 0x7f56080b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55976/0 (socket says 172.21.15.45:55976) 2023-07-09T02:20:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f5606ffd640 1 -- 172.21.15.45:0/4169720785 learned_addr learned my addr 172.21.15.45:0/4169720785 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f5607fff640 1 --2- 172.21.15.45:0/4169720785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 0x7f5608069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f5606ffd640 1 -- 172.21.15.45:0/4169720785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 msgr2=0x7f5608069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f5606ffd640 1 --2- 172.21.15.45:0/4169720785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 0x7f5608069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f5606ffd640 1 -- 172.21.15.45:0/4169720785 >> v1:172.21.15.155:6789/0 conn(0x7f560815c280 legacy=0x7f5608160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.126+0000 7f5606ffd640 1 -- 172.21.15.45:0/4169720785 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080cef40 con 0x7f56080cead0 2023-07-09T02:20:53.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f5606ffd640 1 --2- 172.21.15.45:0/4169720785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f56080b56d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009870 tx=0x7f55fc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c257d3091fa818 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:53.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f56067fc640 1 -- 172.21.15.45:0/4169720785 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0ab650 con 0x7f56080cead0 2023-07-09T02:20:53.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f56067fc640 1 -- 172.21.15.45:0/4169720785 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc0ab7b0 con 0x7f56080cead0 2023-07-09T02:20:53.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f56067fc640 1 -- 172.21.15.45:0/4169720785 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0abb40 con 0x7f56080cead0 2023-07-09T02:20:53.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f560c80b640 1 -- 172.21.15.45:0/4169720785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 msgr2=0x7f56080b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:53.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f560c80b640 1 --2- 172.21.15.45:0/4169720785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f56080b56d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009870 tx=0x7f55fc01c540 comp rx=0 tx=0).stop 2023-07-09T02:20:53.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f560c80b640 1 -- 172.21.15.45:0/4169720785 shutdown_connections 2023-07-09T02:20:53.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f560c80b640 1 --2- 172.21.15.45:0/4169720785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 0x7f5608069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f560c80b640 1 --2- 172.21.15.45:0/4169720785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f56080b56d0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f560c80b640 1 -- 172.21.15.45:0/4169720785 >> 172.21.15.45:0/4169720785 conn(0x7f56080cff90 msgr2=0x7f56080d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:53.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f560c80b640 1 -- 172.21.15.45:0/4169720785 shutdown_connections 2023-07-09T02:20:53.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.130+0000 7f560c80b640 1 -- 172.21.15.45:0/4169720785 wait complete. 2023-07-09T02:20:53.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 Processor -- start 2023-07-09T02:20:53.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 -- start start 2023-07-09T02:20:53.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 0x7f5608150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:53.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f5608150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f560815c280 0x7f5608154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608153bc0 con 0x7f56080cead0 2023-07-09T02:20:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608157a20 con 0x7f560815c280 2023-07-09T02:20:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5608157ce0 con 0x7f5608069980 2023-07-09T02:20:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f5608150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f5608150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55988/0 (socket says 172.21.15.45:55988) 2023-07-09T02:20:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 -- 172.21.15.45:0/3967726140 learned_addr learned my addr 172.21.15.45:0/3967726140 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f56077fe640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 0x7f5608150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5607fff640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f560815c280 0x7f5608154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 -- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 msgr2=0x7f5608150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 0x7f5608150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 -- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f560815c280 msgr2=0x7f5608154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f560815c280 0x7f5608154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 -- 172.21.15.45:0/3967726140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0094d0 con 0x7f56080cead0 2023-07-09T02:20:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f5606ffd640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f5608150f50 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0ad040 tx=0x7f55fc01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:53.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0b4800 con 0x7f56080cead0 2023-07-09T02:20:53.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc0b4960 con 0x7f56080cead0 2023-07-09T02:20:53.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0b4d10 con 0x7f56080cead0 2023-07-09T02:20:53.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5608157fc0 con 0x7f56080cead0 2023-07-09T02:20:53.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.134+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560814f600 con 0x7f56080cead0 2023-07-09T02:20:53.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.138+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5608153d30 con 0x7f56080cead0 2023-07-09T02:20:53.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.138+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55fc0b3380 con 0x7f56080cead0 2023-07-09T02:20:53.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.138+0000 7f55effff640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f55f40662b0 0x7f55f4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:53.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.138+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f55fc11e3c0 con 0x7f56080cead0 2023-07-09T02:20:53.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.138+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f55f406e500 con 0x7f56080cead0 2023-07-09T02:20:53.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.138+0000 7f56077fe640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f55f40662b0 0x7f55f4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:53.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.138+0000 7f56077fe640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f55f40662b0 0x7f55f4068760 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007fd0 tx=0x7f55f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:53.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.142+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55fc0eb910 con 0x7f56080cead0 2023-07-09T02:20:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.294+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f560804e020 con 0x7f56080cead0 2023-07-09T02:20:53.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.950+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(157..157 src has 1..157) v4 ==== 296+0+0 (secure 0 0 0) 0x7f55fc0ab5d0 con 0x7f56080cead0 2023-07-09T02:20:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.950+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f55f406c930 con 0x7f56080cead0 2023-07-09T02:20:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.954+0000 7f55effff640 1 -- 172.21.15.45:0/3967726140 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) v1 ==== 181+0+0 (secure 0 0 0) 0x7f55fc0c40d0 con 0x7f56080cead0 2023-07-09T02:20:53.955 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:20:53.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f55f40662b0 msgr2=0x7f55f4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:53.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f55f40662b0 0x7f55f4068760 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007fd0 tx=0x7f55f8009040 comp rx=0 tx=0).stop 2023-07-09T02:20:53.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 msgr2=0x7f5608150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:53.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f5608150f50 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0ad040 tx=0x7f55fc01ad80 comp rx=0 tx=0).stop 2023-07-09T02:20:53.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 shutdown_connections 2023-07-09T02:20:53.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f560815c280 0x7f5608154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080cead0 0x7f5608150f50 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f55f40662b0 0x7f55f4068760 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 --2- 172.21.15.45:0/3967726140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5608069980 0x7f5608150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.958+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 >> 172.21.15.45:0/3967726140 conn(0x7f56080cff90 msgr2=0x7f56080b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.962+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 shutdown_connections 2023-07-09T02:20:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:53.962+0000 7f560c80b640 1 -- 172.21.15.45:0/3967726140 wait complete. 2023-07-09T02:20:53.980 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:20:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78eaa5c640 1 Processor -- start 2023-07-09T02:20:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78eaa5c640 1 -- start start 2023-07-09T02:20:54.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78eaa5c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78e40cafc0 0x7f78e40cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78eaa5c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78e40c9660 0x7f78e40b0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78eaa5c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e40cd540 con 0x7f78e40b3e90 2023-07-09T02:20:54.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78eaa5c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e40cd350 con 0x7f78e40c9660 2023-07-09T02:20:54.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78eaa5c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e40c9bd0 con 0x7f78e40cafc0 2023-07-09T02:20:54.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78e37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78e40c9660 0x7f78e40b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78e37fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78e40c9660 0x7f78e40b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55990/0 (socket says 172.21.15.45:55990) 2023-07-09T02:20:54.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78e37fe640 1 -- 172.21.15.45:0/4207517200 learned_addr learned my addr 172.21.15.45:0/4207517200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:54.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78e3fff640 1 --2- 172.21.15.45:0/4207517200 >> v2:172.21.15.155:3300/0 conn(0x7f78e40cafc0 0x7f78e40cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78e37fe640 1 -- 172.21.15.45:0/4207517200 >> v2:172.21.15.155:3300/0 conn(0x7f78e40cafc0 msgr2=0x7f78e40cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:54.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78e37fe640 1 --2- 172.21.15.45:0/4207517200 >> v2:172.21.15.155:3300/0 conn(0x7f78e40cafc0 0x7f78e40cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78e37fe640 1 -- 172.21.15.45:0/4207517200 >> v1:172.21.15.155:6789/0 conn(0x7f78e40b3e90 legacy=0x7f78e40b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.130+0000 7f78e37fe640 1 -- 172.21.15.45:0/4207517200 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e40cb8d0 con 0x7f78e40c9660 2023-07-09T02:20:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78e37fe640 1 --2- 172.21.15.45:0/4207517200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e40b0080 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f78e406a3a0 tx=0x7f78d80211a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dae56228a7991b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78e2ffd640 1 -- 172.21.15.45:0/4207517200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8004030 con 0x7f78e40c9660 2023-07-09T02:20:54.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78e2ffd640 1 -- 172.21.15.45:0/4207517200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d80ad030 con 0x7f78e40c9660 2023-07-09T02:20:54.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78e2ffd640 1 -- 172.21.15.45:0/4207517200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8004410 con 0x7f78e40c9660 2023-07-09T02:20:54.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78eaa5c640 1 -- 172.21.15.45:0/4207517200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 msgr2=0x7f78e40b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/4207517200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e40b0080 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f78e406a3a0 tx=0x7f78d80211a0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78eaa5c640 1 -- 172.21.15.45:0/4207517200 shutdown_connections 2023-07-09T02:20:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/4207517200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e40b0080 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/4207517200 >> v2:172.21.15.155:3300/0 conn(0x7f78e40cafc0 0x7f78e40cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78eaa5c640 1 -- 172.21.15.45:0/4207517200 >> 172.21.15.45:0/4207517200 conn(0x7f78e406ae60 msgr2=0x7f78e406b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78eaa5c640 1 -- 172.21.15.45:0/4207517200 shutdown_connections 2023-07-09T02:20:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.134+0000 7f78eaa5c640 1 -- 172.21.15.45:0/4207517200 wait complete. 2023-07-09T02:20:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 Processor -- start 2023-07-09T02:20:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 -- start start 2023-07-09T02:20:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78e40b3e90 0x7f78e4071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78e40cafc0 0x7f78e41f94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4159790 con 0x7f78e40c9660 2023-07-09T02:20:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4159a70 con 0x7f78e40b3e90 2023-07-09T02:20:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4159d50 con 0x7f78e40cafc0 2023-07-09T02:20:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e415b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55998/0 (socket says 172.21.15.45:55998) 2023-07-09T02:20:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 -- 172.21.15.45:0/2441979693 learned_addr learned my addr 172.21.15.45:0/2441979693 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e3fff640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78e40b3e90 0x7f78e4071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e8ff9640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78e40cafc0 0x7f78e41f94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 -- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78e40cafc0 msgr2=0x7f78e41f94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78e40cafc0 0x7f78e41f94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 -- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78e40b3e90 msgr2=0x7f78e4071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78e40b3e90 0x7f78e4071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 -- 172.21.15.45:0/2441979693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d800b780 con 0x7f78e40c9660 2023-07-09T02:20:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e37fe640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e415b360 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f78d80b5040 tx=0x7f78d801df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8003a30 con 0x7f78e40c9660 2023-07-09T02:20:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d8003bb0 con 0x7f78e40c9660 2023-07-09T02:20:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d80be470 con 0x7f78e40c9660 2023-07-09T02:20:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e415a030 con 0x7f78e40c9660 2023-07-09T02:20:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.138+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e41fa310 con 0x7f78e40c9660 2023-07-09T02:20:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.142+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e40720d0 con 0x7f78e40c9660 2023-07-09T02:20:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.142+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78d80be5d0 con 0x7f78e40c9660 2023-07-09T02:20:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.142+0000 7f78e0ff9640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78d0066280 0x7f78d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.142+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f78d8121f60 con 0x7f78e40c9660 2023-07-09T02:20:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.146+0000 7f78e3fff640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78d0066280 0x7f78d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.146+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f78d006d660 con 0x7f78e40c9660 2023-07-09T02:20:54.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.146+0000 7f78e3fff640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78d0066280 0x7f78d0068730 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009ac0 tx=0x7f78d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.146+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78d80ef780 con 0x7f78e40c9660 2023-07-09T02:20:54.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.298+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f78e404d7d0 con 0x7f78e40c9660 2023-07-09T02:20:54.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.442+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(158..158 src has 1..158) v4 ==== 687+0+0 (secure 0 0 0) 0x7f78d80f7350 con 0x7f78e40c9660 2023-07-09T02:20:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.446+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f78d006c3f0 con 0x7f78e40c9660 2023-07-09T02:20:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.450+0000 7f78e0ff9640 1 -- 172.21.15.45:0/2441979693 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) v1 ==== 169+0+0 (secure 0 0 0) 0x7f78d80c50d0 con 0x7f78e40c9660 2023-07-09T02:20:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:20:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78d0066280 msgr2=0x7f78d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78d0066280 0x7f78d0068730 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009ac0 tx=0x7f78d4009190 comp rx=0 tx=0).stop 2023-07-09T02:20:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 msgr2=0x7f78e415b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e415b360 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f78d80b5040 tx=0x7f78d801df40 comp rx=0 tx=0).stop 2023-07-09T02:20:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 shutdown_connections 2023-07-09T02:20:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78d0066280 0x7f78d0068730 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78e40cafc0 0x7f78e41f94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e40c9660 0x7f78e415b360 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 --2- 172.21.15.45:0/2441979693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78e40b3e90 0x7f78e4071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 >> 172.21.15.45:0/2441979693 conn(0x7f78e406ae60 msgr2=0x7f78e40acfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 shutdown_connections 2023-07-09T02:20:54.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.454+0000 7f78eaa5c640 1 -- 172.21.15.45:0/2441979693 wait complete. 2023-07-09T02:20:54.473 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:20:54.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f2155ffa640 1 Processor -- start 2023-07-09T02:20:54.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f2155ffa640 1 -- start start 2023-07-09T02:20:54.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f2155ffa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21500cd290 0x7f21500cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f2155ffa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2150071140 con 0x7f215006a5c0 2023-07-09T02:20:54.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f2155ffa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500b3160 con 0x7f215006aa40 2023-07-09T02:20:54.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f2155ffa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215006b010 con 0x7f21500cd290 2023-07-09T02:20:54.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f214effd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f215006a5c0 0x7f21500b2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58070/0 (socket says 172.21.15.45:58070) 2023-07-09T02:20:54.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f214f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21500cd290 0x7f21500cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f214effd640 1 -- 172.21.15.45:0/3313174295 learned_addr learned my addr 172.21.15.45:0/3313174295 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:54.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f214f7fe640 1 -- 172.21.15.45:0/3313174295 >> v1:172.21.15.155:6789/0 conn(0x7f215006aa40 legacy=0x7f21500b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:54.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f214f7fe640 1 -- 172.21.15.45:0/3313174295 >> v1:172.21.15.45:6789/0 conn(0x7f215006a5c0 legacy=0x7f21500b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f214f7fe640 1 -- 172.21.15.45:0/3313174295 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500cdba0 con 0x7f21500cd290 2023-07-09T02:20:54.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.622+0000 7f214e7fc640 1 -- 172.21.15.45:0/3313174295 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049099560 0 0) 0x7f2150071140 con 0x7f215006a5c0 2023-07-09T02:20:54.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f214f7fe640 1 --2- 172.21.15.45:0/3313174295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21500cd290 0x7f21500cd660 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f21400097c0 tx=0x7f214001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda18d015bde4cd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f214e7fc640 1 -- 172.21.15.45:0/3313174295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400ab600 con 0x7f21500cd290 2023-07-09T02:20:54.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f214e7fc640 1 -- 172.21.15.45:0/3313174295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21400a7050 con 0x7f21500cd290 2023-07-09T02:20:54.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f214e7fc640 1 -- 172.21.15.45:0/3313174295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400ab980 con 0x7f21500cd290 2023-07-09T02:20:54.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f2155ffa640 1 -- 172.21.15.45:0/3313174295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21500cd290 msgr2=0x7f21500cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f2155ffa640 1 --2- 172.21.15.45:0/3313174295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21500cd290 0x7f21500cd660 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f21400097c0 tx=0x7f214001c3b0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f2155ffa640 1 -- 172.21.15.45:0/3313174295 shutdown_connections 2023-07-09T02:20:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f2155ffa640 1 --2- 172.21.15.45:0/3313174295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21500cd290 0x7f21500cd660 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f2155ffa640 1 -- 172.21.15.45:0/3313174295 >> 172.21.15.45:0/3313174295 conn(0x7f215006d140 msgr2=0x7f215006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f2155ffa640 1 -- 172.21.15.45:0/3313174295 shutdown_connections 2023-07-09T02:20:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f2155ffa640 1 -- 172.21.15.45:0/3313174295 wait complete. 2023-07-09T02:20:54.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.626+0000 7f2155ffa640 1 Processor -- start 2023-07-09T02:20:54.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 -- start start 2023-07-09T02:20:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215006a5c0 0x7f2150157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215006aa40 0x7f2150150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21500cd290 0x7f21501553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150152840 con 0x7f215006aa40 2023-07-09T02:20:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150154f60 con 0x7f215006a5c0 2023-07-09T02:20:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2150154630 con 0x7f21500cd290 2023-07-09T02:20:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215006aa40 0x7f2150150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215006aa40 0x7f2150150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56010/0 (socket says 172.21.15.45:56010) 2023-07-09T02:20:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 -- 172.21.15.45:0/800023163 learned_addr learned my addr 172.21.15.45:0/800023163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214f7fe640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215006a5c0 0x7f2150157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214ffff640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21500cd290 0x7f21501553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 -- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21500cd290 msgr2=0x7f21501553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21500cd290 0x7f21501553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 -- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215006a5c0 msgr2=0x7f2150157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215006a5c0 0x7f2150157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 -- 172.21.15.45:0/800023163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140009420 con 0x7f215006aa40 2023-07-09T02:20:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214f7fe640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215006a5c0 0x7f2150157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f214effd640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215006aa40 0x7f2150150570 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f213800c480 tx=0x7f213800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2147fff640 1 -- 172.21.15.45:0/800023163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380074e0 con 0x7f215006aa40 2023-07-09T02:20:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2147fff640 1 -- 172.21.15.45:0/800023163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2138007660 con 0x7f215006aa40 2023-07-09T02:20:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2147fff640 1 -- 172.21.15.45:0/800023163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138004a30 con 0x7f215006aa40 2023-07-09T02:20:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2150154910 con 0x7f215006aa40 2023-07-09T02:20:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21501390b0 con 0x7f215006aa40 2023-07-09T02:20:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.630+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21501550d0 con 0x7f215006aa40 2023-07-09T02:20:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.634+0000 7f2147fff640 1 -- 172.21.15.45:0/800023163 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2138004b90 con 0x7f215006aa40 2023-07-09T02:20:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.634+0000 7f2147fff640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2130066280 0x7f2130068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.634+0000 7f2147fff640 1 -- 172.21.15.45:0/800023163 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2138082c20 con 0x7f215006aa40 2023-07-09T02:20:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.634+0000 7f214f7fe640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2130066280 0x7f2130068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.634+0000 7f214f7fe640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2130066280 0x7f2130068730 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f21400ad000 tx=0x7f21400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.638+0000 7f2147fff640 1 -- 172.21.15.45:0/800023163 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2138053e40 con 0x7f215006aa40 2023-07-09T02:20:54.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.794+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f215004d7d0 con 0x7f215006aa40 2023-07-09T02:20:54.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.798+0000 7f2147fff640 1 -- 172.21.15.45:0/800023163 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21380180a0 con 0x7f215006aa40 2023-07-09T02:20:54.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2130066280 msgr2=0x7f2130068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2130066280 0x7f2130068730 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f21400ad000 tx=0x7f21400a6000 comp rx=0 tx=0).stop 2023-07-09T02:20:54.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215006aa40 msgr2=0x7f2150150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215006aa40 0x7f2150150570 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f213800c480 tx=0x7f213800c940 comp rx=0 tx=0).stop 2023-07-09T02:20:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 shutdown_connections 2023-07-09T02:20:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2130066280 0x7f2130068730 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21500cd290 0x7f21501553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f215006aa40 0x7f2150150570 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 --2- 172.21.15.45:0/800023163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215006a5c0 0x7f2150157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 >> 172.21.15.45:0/800023163 conn(0x7f215006d140 msgr2=0x7f21500b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:54.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 shutdown_connections 2023-07-09T02:20:54.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.802+0000 7f2155ffa640 1 -- 172.21.15.45:0/800023163 wait complete. 2023-07-09T02:20:54.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-07-09T02:20:54.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.962+0000 7f7dcee19640 1 Processor -- start 2023-07-09T02:20:54.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.962+0000 7f7dcee19640 1 -- start start 2023-07-09T02:20:54.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dcee19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7dc8158e30 0x7f7dc806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dcee19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7dc806c820 0x7f7dc80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dcee19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80ccf80 con 0x7f7dc806fd10 2023-07-09T02:20:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dcee19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80cd540 con 0x7f7dc8158e30 2023-07-09T02:20:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dcee19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80c8fb0 con 0x7f7dc806c820 2023-07-09T02:20:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dc7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7dc806fd10 0x7f7dc806c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58074/0 (socket says 172.21.15.45:58074) 2023-07-09T02:20:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dc7fff640 1 -- 172.21.15.45:0/1597552626 learned_addr learned my addr 172.21.15.45:0/1597552626 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:54.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dccbb5640 1 --2- 172.21.15.45:0/1597552626 >> v2:172.21.15.45:3300/0 conn(0x7f7dc8158e30 0x7f7dc806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dcd3b6640 1 --2- 172.21.15.45:0/1597552626 >> v2:172.21.15.155:3300/0 conn(0x7f7dc806c820 0x7f7dc80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dccbb5640 1 -- 172.21.15.45:0/1597552626 >> v2:172.21.15.155:3300/0 conn(0x7f7dc806c820 msgr2=0x7f7dc80caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:54.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dccbb5640 1 --2- 172.21.15.45:0/1597552626 >> v2:172.21.15.155:3300/0 conn(0x7f7dc806c820 0x7f7dc80caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dccbb5640 1 -- 172.21.15.45:0/1597552626 >> v1:172.21.15.45:6789/0 conn(0x7f7dc806fd10 legacy=0x7f7dc806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dccbb5640 1 -- 172.21.15.45:0/1597552626 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80cbad0 con 0x7f7dc8158e30 2023-07-09T02:20:54.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dc77fe640 1 -- 172.21.15.45:0/1597552626 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055302771 0 0) 0x7f7dc80ccf80 con 0x7f7dc806fd10 2023-07-09T02:20:54.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dcd3b6640 1 --2- 172.21.15.45:0/1597552626 >> v2:172.21.15.155:3300/0 conn(0x7f7dc806c820 0x7f7dc80caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:54.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.966+0000 7f7dccbb5640 1 --2- 172.21.15.45:0/1597552626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc806f7d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80c9590 tx=0x7f7dbc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2340c019d3053b54 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dc77fe640 1 -- 172.21.15.45:0/1597552626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0ac620 con 0x7f7dc8158e30 2023-07-09T02:20:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dc77fe640 1 -- 172.21.15.45:0/1597552626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc0ac780 con 0x7f7dc8158e30 2023-07-09T02:20:54.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dc77fe640 1 -- 172.21.15.45:0/1597552626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0acb10 con 0x7f7dc8158e30 2023-07-09T02:20:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- 172.21.15.45:0/1597552626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 msgr2=0x7f7dc806f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 --2- 172.21.15.45:0/1597552626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc806f7d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80c9590 tx=0x7f7dbc01c3a0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- 172.21.15.45:0/1597552626 shutdown_connections 2023-07-09T02:20:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 --2- 172.21.15.45:0/1597552626 >> v2:172.21.15.155:3300/0 conn(0x7f7dc806c820 0x7f7dc80caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 --2- 172.21.15.45:0/1597552626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc806f7d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- 172.21.15.45:0/1597552626 >> 172.21.15.45:0/1597552626 conn(0x7f7dc80694b0 msgr2=0x7f7dc80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- 172.21.15.45:0/1597552626 shutdown_connections 2023-07-09T02:20:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- 172.21.15.45:0/1597552626 wait complete. 2023-07-09T02:20:54.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 Processor -- start 2023-07-09T02:20:54.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- start start 2023-07-09T02:20:54.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc806c820 0x7f7dc8141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc806fd10 0x7f7dc813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc80adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc81526f0 con 0x7f7dc8158e30 2023-07-09T02:20:54.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8153270 con 0x7f7dc806fd10 2023-07-09T02:20:54.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcee19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80ae4d0 con 0x7f7dc806c820 2023-07-09T02:20:54.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.970+0000 7f7dcd3b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc80adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcd3b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc80adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56024/0 (socket says 172.21.15.45:56024) 2023-07-09T02:20:54.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcd3b6640 1 -- 172.21.15.45:0/2536265755 learned_addr learned my addr 172.21.15.45:0/2536265755 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:54.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dccbb5640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc806c820 0x7f7dc8141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dc7fff640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc806fd10 0x7f7dc813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcd3b6640 1 -- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc806c820 msgr2=0x7f7dc8141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcd3b6640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc806c820 0x7f7dc8141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcd3b6640 1 -- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc806fd10 msgr2=0x7f7dc813df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:54.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcd3b6640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc806fd10 0x7f7dc813df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:54.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcd3b6640 1 -- 172.21.15.45:0/2536265755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009420 con 0x7f7dc8158e30 2023-07-09T02:20:54.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dc7fff640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc806fd10 0x7f7dc813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcd3b6640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc80adf90 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007e70 tx=0x7f7dc000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dc57fa640 1 -- 172.21.15.45:0/2536265755 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0015600 con 0x7f7dc8158e30 2023-07-09T02:20:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dc57fa640 1 -- 172.21.15.45:0/2536265755 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000f040 con 0x7f7dc8158e30 2023-07-09T02:20:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dc57fa640 1 -- 172.21.15.45:0/2536265755 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00159a0 con 0x7f7dc8158e30 2023-07-09T02:20:54.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc8152940 con 0x7f7dc8158e30 2023-07-09T02:20:54.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc8152f00 con 0x7f7dc8158e30 2023-07-09T02:20:54.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc80ae770 con 0x7f7dc8158e30 2023-07-09T02:20:54.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.974+0000 7f7dc57fa640 1 -- 172.21.15.45:0/2536265755 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7dc001e3b0 con 0x7f7dc8158e30 2023-07-09T02:20:54.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.978+0000 7f7dc57fa640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7dac066280 0x7f7dac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:54.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.978+0000 7f7dc57fa640 1 -- 172.21.15.45:0/2536265755 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7dc0083c70 con 0x7f7dc8158e30 2023-07-09T02:20:54.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.978+0000 7f7dccbb5640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7dac066280 0x7f7dac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:54.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.978+0000 7f7dccbb5640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7dac066280 0x7f7dac068730 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0ae000 tx=0x7f7dbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:54.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:54.982+0000 7f7dc57fa640 1 -- 172.21.15.45:0/2536265755 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7dc0051530 con 0x7f7dc8158e30 2023-07-09T02:20:55.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.186+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f7dc8163d50 con 0x7f7dc8158e30 2023-07-09T02:20:55.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dc57fa640 1 -- 172.21.15.45:0/2536265755 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v480) v1 ==== 132+0+0 (secure 0 0 0) 0x7f7dc001a0c0 con 0x7f7dc8158e30 2023-07-09T02:20:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7dac066280 msgr2=0x7f7dac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7dac066280 0x7f7dac068730 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0ae000 tx=0x7f7dbc008040 comp rx=0 tx=0).stop 2023-07-09T02:20:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 msgr2=0x7f7dc80adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc80adf90 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007e70 tx=0x7f7dc000d4a0 comp rx=0 tx=0).stop 2023-07-09T02:20:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 shutdown_connections 2023-07-09T02:20:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dc8158e30 0x7f7dc80adf90 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc806fd10 0x7f7dc813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7dac066280 0x7f7dac068730 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:55.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 --2- 172.21.15.45:0/2536265755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7dc806c820 0x7f7dc8141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:55.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 >> 172.21.15.45:0/2536265755 conn(0x7f7dc80694b0 msgr2=0x7f7dc80c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:55.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.958+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 shutdown_connections 2023-07-09T02:20:55.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:55.962+0000 7f7dcee19640 1 -- 172.21.15.45:0/2536265755 wait complete. 2023-07-09T02:20:55.983 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-07-09T02:20:55.983 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-07-09T02:20:55.984 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-07-09T02:20:56.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f6337711640 1 Processor -- start 2023-07-09T02:20:56.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f6337711640 1 -- start start 2023-07-09T02:20:56.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f6337711640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f633006c110 0x7f633006c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:56.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f6337711640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 0x7f63300cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:56.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f6337711640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633006caa0 con 0x7f6330158e30 2023-07-09T02:20:56.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f6337711640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63300ccf80 con 0x7f633006c110 2023-07-09T02:20:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f6337711640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300cd540 con 0x7f63300caec0 2023-07-09T02:20:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f63354ad640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6330158e30 0x7f633006f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58080/0 (socket says 172.21.15.45:58080) 2023-07-09T02:20:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f63354ad640 1 -- 172.21.15.45:0/3055133409 learned_addr learned my addr 172.21.15.45:0/3055133409 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.134+0000 7f6334cac640 1 --2- 172.21.15.45:0/3055133409 >> v2:172.21.15.45:3300/0 conn(0x7f633006c110 0x7f633006c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6327fff640 1 -- 172.21.15.45:0/3055133409 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893190146 0 0) 0x7f632c001120 con 0x7f6330158e30 2023-07-09T02:20:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6335cae640 1 --2- 172.21.15.45:0/3055133409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 0x7f63300cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6327fff640 1 -- 172.21.15.45:0/3055133409 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f631c005740 con 0x7f6330158e30 2023-07-09T02:20:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6334cac640 1 -- 172.21.15.45:0/3055133409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 msgr2=0x7f63300cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6334cac640 1 --2- 172.21.15.45:0/3055133409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 0x7f63300cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6334cac640 1 -- 172.21.15.45:0/3055133409 >> v1:172.21.15.45:6789/0 conn(0x7f6330158e30 legacy=0x7f633006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6334cac640 1 -- 172.21.15.45:0/3055133409 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300cb880 con 0x7f633006c110 2023-07-09T02:20:56.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6334cac640 1 --2- 172.21.15.45:0/3055133409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f633006c560 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f63200097c0 tx=0x7f632001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbab18694d1835a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:56.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6327fff640 1 -- 172.21.15.45:0/3055133409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200ac620 con 0x7f633006c110 2023-07-09T02:20:56.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6327fff640 1 -- 172.21.15.45:0/3055133409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63200ac780 con 0x7f633006c110 2023-07-09T02:20:56.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.138+0000 7f6327fff640 1 -- 172.21.15.45:0/3055133409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200acb10 con 0x7f633006c110 2023-07-09T02:20:56.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- 172.21.15.45:0/3055133409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 msgr2=0x7f633006c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:56.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 --2- 172.21.15.45:0/3055133409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f633006c560 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f63200097c0 tx=0x7f632001c3c0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- 172.21.15.45:0/3055133409 shutdown_connections 2023-07-09T02:20:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 --2- 172.21.15.45:0/3055133409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 0x7f63300cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 --2- 172.21.15.45:0/3055133409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f633006c560 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- 172.21.15.45:0/3055133409 >> 172.21.15.45:0/3055133409 conn(0x7f63300694b0 msgr2=0x7f63300698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- 172.21.15.45:0/3055133409 shutdown_connections 2023-07-09T02:20:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- 172.21.15.45:0/3055133409 wait complete. 2023-07-09T02:20:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 Processor -- start 2023-07-09T02:20:56.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- start start 2023-07-09T02:20:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f63301582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 0x7f63301f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6330158e30 0x7f633014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63301f5cb0 con 0x7f633006c110 2023-07-09T02:20:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633014e270 con 0x7f6330158e30 2023-07-09T02:20:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6337711640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633014e550 con 0x7f63300caec0 2023-07-09T02:20:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f63354ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f63301582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:56.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f63354ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f63301582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56046/0 (socket says 172.21.15.45:56046) 2023-07-09T02:20:56.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f63354ad640 1 -- 172.21.15.45:0/596529546 learned_addr learned my addr 172.21.15.45:0/596529546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:56.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6334cac640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 0x7f63301f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:56.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6335cae640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6330158e30 0x7f633014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:56.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f63354ad640 1 -- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 msgr2=0x7f63301f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:56.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f63354ad640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 0x7f63301f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f63354ad640 1 -- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6330158e30 msgr2=0x7f633014da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:56.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f63354ad640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6330158e30 0x7f633014da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f63354ad640 1 -- 172.21.15.45:0/596529546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320009420 con 0x7f633006c110 2023-07-09T02:20:56.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.142+0000 7f6335cae640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6330158e30 0x7f633014da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:56.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f63354ad640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f63301582d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c420 tx=0x7f632c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:56.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6325ffb640 1 -- 172.21.15.45:0/596529546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c005cf0 con 0x7f633006c110 2023-07-09T02:20:56.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6325ffb640 1 -- 172.21.15.45:0/596529546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c005e50 con 0x7f633006c110 2023-07-09T02:20:56.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6325ffb640 1 -- 172.21.15.45:0/596529546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0072f0 con 0x7f633006c110 2023-07-09T02:20:56.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633014e830 con 0x7f633006c110 2023-07-09T02:20:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63300ce650 con 0x7f633006c110 2023-07-09T02:20:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633014ea70 con 0x7f633006c110 2023-07-09T02:20:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6325ffb640 1 -- 172.21.15.45:0/596529546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f632c007450 con 0x7f633006c110 2023-07-09T02:20:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6325ffb640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63140662b0 0x7f6314068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6325ffb640 1 -- 172.21.15.45:0/596529546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f632c082e70 con 0x7f633006c110 2023-07-09T02:20:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.146+0000 7f6334cac640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63140662b0 0x7f6314068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.150+0000 7f6334cac640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63140662b0 0x7f6314068760 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f63200ae000 tx=0x7f6320008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.150+0000 7f6325ffb640 1 -- 172.21.15.45:0/596529546 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f633014ea70 con 0x7f633006c110 2023-07-09T02:20:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.358+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f633006caa0 con 0x7f633006c110 2023-07-09T02:20:56.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.966+0000 7f6325ffb640 1 -- 172.21.15.45:0/596529546 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v481) v1 ==== 134+0+0 (secure 0 0 0) 0x7f633006caa0 con 0x7f633006c110 2023-07-09T02:20:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63140662b0 msgr2=0x7f6314068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63140662b0 0x7f6314068760 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f63200ae000 tx=0x7f6320008040 comp rx=0 tx=0).stop 2023-07-09T02:20:56.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 msgr2=0x7f63301582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:56.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f63301582d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c420 tx=0x7f632c00c8e0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 shutdown_connections 2023-07-09T02:20:56.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6330158e30 0x7f633014da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f63140662b0 0x7f6314068760 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63300caec0 0x7f63301f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 --2- 172.21.15.45:0/596529546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633006c110 0x7f63301582d0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:56.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 >> 172.21.15.45:0/596529546 conn(0x7f63300694b0 msgr2=0x7f63300ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 shutdown_connections 2023-07-09T02:20:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:56.970+0000 7f6337711640 1 -- 172.21.15.45:0/596529546 wait complete. 2023-07-09T02:20:56.988 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:20:57.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.134+0000 7f7c66eec640 1 Processor -- start 2023-07-09T02:20:57.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c66eec640 1 -- start start 2023-07-09T02:20:57.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c66eec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c600ca0f0 0x7f7c600cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c66eec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 0x7f7c6015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c66eec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6006bf30 con 0x7f7c600cbbb0 2023-07-09T02:20:57.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c66eec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6015e4c0 con 0x7f7c600ca0f0 2023-07-09T02:20:57.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c66eec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6006bc50 con 0x7f7c6015db00 2023-07-09T02:20:57.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c5ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7c600cbbb0 0x7f7c600c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58088/0 (socket says 172.21.15.45:58088) 2023-07-09T02:20:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c5ffff640 1 -- 172.21.15.45:0/3509800353 learned_addr learned my addr 172.21.15.45:0/3509800353 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c64c88640 1 --2- 172.21.15.45:0/3509800353 >> v2:172.21.15.45:3300/0 conn(0x7f7c600ca0f0 0x7f7c600cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c65489640 1 --2- 172.21.15.45:0/3509800353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 0x7f7c6015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c64c88640 1 -- 172.21.15.45:0/3509800353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 msgr2=0x7f7c6015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c64c88640 1 --2- 172.21.15.45:0/3509800353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 0x7f7c6015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c64c88640 1 -- 172.21.15.45:0/3509800353 >> v1:172.21.15.45:6789/0 conn(0x7f7c600cbbb0 legacy=0x7f7c600c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c5f7fe640 1 -- 172.21.15.45:0/3509800353 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467863949 0 0) 0x7f7c6006bf30 con 0x7f7c600cbbb0 2023-07-09T02:20:57.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.138+0000 7f7c64c88640 1 -- 172.21.15.45:0/3509800353 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600cab90 con 0x7f7c600ca0f0 2023-07-09T02:20:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c64c88640 1 --2- 172.21.15.45:0/3509800353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c600cb670 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097c0 tx=0x7f7c5401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfeab7a095dafb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:57.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c5f7fe640 1 -- 172.21.15.45:0/3509800353 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540ab600 con 0x7f7c600ca0f0 2023-07-09T02:20:57.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c5f7fe640 1 -- 172.21.15.45:0/3509800353 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c540a7050 con 0x7f7c600ca0f0 2023-07-09T02:20:57.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c5f7fe640 1 -- 172.21.15.45:0/3509800353 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540ab980 con 0x7f7c600ca0f0 2023-07-09T02:20:57.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 -- 172.21.15.45:0/3509800353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 msgr2=0x7f7c600cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 --2- 172.21.15.45:0/3509800353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c600cb670 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097c0 tx=0x7f7c5401c3f0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 -- 172.21.15.45:0/3509800353 shutdown_connections 2023-07-09T02:20:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 --2- 172.21.15.45:0/3509800353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 0x7f7c6015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 --2- 172.21.15.45:0/3509800353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c600cb670 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 -- 172.21.15.45:0/3509800353 >> 172.21.15.45:0/3509800353 conn(0x7f7c600694b0 msgr2=0x7f7c600698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 -- 172.21.15.45:0/3509800353 shutdown_connections 2023-07-09T02:20:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 -- 172.21.15.45:0/3509800353 wait complete. 2023-07-09T02:20:57.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.142+0000 7f7c66eec640 1 Processor -- start 2023-07-09T02:20:57.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 -- start start 2023-07-09T02:20:57.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c6014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c600cbbb0 0x7f7c600c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 0x7f7c601f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60138940 con 0x7f7c600ca0f0 2023-07-09T02:20:57.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60138010 con 0x7f7c600cbbb0 2023-07-09T02:20:57.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c601382f0 con 0x7f7c6015db00 2023-07-09T02:20:57.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c6014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c6014d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56052/0 (socket says 172.21.15.45:56052) 2023-07-09T02:20:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 -- 172.21.15.45:0/2796003083 learned_addr learned my addr 172.21.15.45:0/2796003083 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c5ffff640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c600cbbb0 0x7f7c600c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c65489640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 0x7f7c601f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 -- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 msgr2=0x7f7c601f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 0x7f7c601f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 -- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c600cbbb0 msgr2=0x7f7c600c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c600cbbb0 0x7f7c600c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 -- 172.21.15.45:0/2796003083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54009420 con 0x7f7c600ca0f0 2023-07-09T02:20:57.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c64c88640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c6014d380 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f7c540ae040 tx=0x7f7c5401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:57.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c5d7fa640 1 -- 172.21.15.45:0/2796003083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540b7650 con 0x7f7c600ca0f0 2023-07-09T02:20:57.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c5d7fa640 1 -- 172.21.15.45:0/2796003083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c540abe90 con 0x7f7c600ca0f0 2023-07-09T02:20:57.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c601385d0 con 0x7f7c600ca0f0 2023-07-09T02:20:57.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c5d7fa640 1 -- 172.21.15.45:0/2796003083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540b7a10 con 0x7f7c600ca0f0 2023-07-09T02:20:57.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6014d8c0 con 0x7f7c600ca0f0 2023-07-09T02:20:57.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.146+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6004d7d0 con 0x7f7c600ca0f0 2023-07-09T02:20:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.150+0000 7f7c5d7fa640 1 -- 172.21.15.45:0/2796003083 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c540b7b70 con 0x7f7c600ca0f0 2023-07-09T02:20:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.150+0000 7f7c5d7fa640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7c44066280 0x7f7c44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.150+0000 7f7c5d7fa640 1 -- 172.21.15.45:0/2796003083 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7c5411e1a0 con 0x7f7c600ca0f0 2023-07-09T02:20:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.150+0000 7f7c5ffff640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7c44066280 0x7f7c44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.150+0000 7f7c5ffff640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7c44066280 0x7f7c44068730 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7c601540c0 tx=0x7f7c4c007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:57.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.154+0000 7f7c5d7fa640 1 -- 172.21.15.45:0/2796003083 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c540eb8d0 con 0x7f7c600ca0f0 2023-07-09T02:20:57.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.310+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7c60069880 con 0x7f7c600ca0f0 2023-07-09T02:20:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c5d7fa640 1 -- 172.21.15.45:0/2796003083 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c540eeef0 con 0x7f7c600ca0f0 2023-07-09T02:20:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7c44066280 msgr2=0x7f7c44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7c44066280 0x7f7c44068730 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7c601540c0 tx=0x7f7c4c007d60 comp rx=0 tx=0).stop 2023-07-09T02:20:57.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 msgr2=0x7f7c6014d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c6014d380 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f7c540ae040 tx=0x7f7c5401ac30 comp rx=0 tx=0).stop 2023-07-09T02:20:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 shutdown_connections 2023-07-09T02:20:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7c44066280 0x7f7c44068730 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c6015db00 0x7f7c601f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c600cbbb0 0x7f7c600c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 --2- 172.21.15.45:0/2796003083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c600ca0f0 0x7f7c6014d380 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 >> 172.21.15.45:0/2796003083 conn(0x7f7c600694b0 msgr2=0x7f7c60069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 shutdown_connections 2023-07-09T02:20:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.314+0000 7f7c66eec640 1 -- 172.21.15.45:0/2796003083 wait complete. 2023-07-09T02:20:57.333 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:20:57.334 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:20:57.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:20:57.464 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:20:57.464 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:20:57.465 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:57.474 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:20:57.475 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:20:57.475 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:57.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:20:57.484 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:20:57.484 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:57.526 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:20:57.527 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:20:57.527 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:20:57.536 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:20:57.536 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:20:57.537 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:20:57.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a474d8640 1 Processor -- start 2023-07-09T02:20:57.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a474d8640 1 -- start start 2023-07-09T02:20:57.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a474d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a400d2620 0x7f0a400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a474d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a400cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a474d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a40160a50 con 0x7f0a4015c060 2023-07-09T02:20:57.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a474d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4015c430 con 0x7f0a400d2620 2023-07-09T02:20:57.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a474d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4015fb60 con 0x7f0a400cd120 2023-07-09T02:20:57.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a44a73640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a400d2620 0x7f0a400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a45a75640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a400cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a44a73640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a400d2620 0x7f0a400b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:37068/0 (socket says 172.21.15.45:37068) 2023-07-09T02:20:57.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.714+0000 7f0a44a73640 1 -- 172.21.15.45:0/672602593 learned_addr learned my addr 172.21.15.45:0/672602593 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:57.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a45a75640 1 -- 172.21.15.45:0/672602593 >> v2:172.21.15.155:3300/0 conn(0x7f0a400d2620 msgr2=0x7f0a400b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:57.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a45a75640 1 --2- 172.21.15.45:0/672602593 >> v2:172.21.15.155:3300/0 conn(0x7f0a400d2620 0x7f0a400b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a45a75640 1 -- 172.21.15.45:0/672602593 >> v1:172.21.15.155:6789/0 conn(0x7f0a4015c060 legacy=0x7f0a400d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a45a75640 1 -- 172.21.15.45:0/672602593 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4015fe40 con 0x7f0a400cd120 2023-07-09T02:20:57.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a37fff640 1 -- 172.21.15.45:0/672602593 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077263742 0 0) 0x7f0a40160a50 con 0x7f0a4015c060 2023-07-09T02:20:57.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a44a73640 1 --2- 172.21.15.45:0/672602593 >> v2:172.21.15.155:3300/0 conn(0x7f0a400d2620 0x7f0a400b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:57.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a45a75640 1 --2- 172.21.15.45:0/672602593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a400cee30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009d90 tx=0x7f0a3801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483d0e66a005edd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:57.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a37fff640 1 -- 172.21.15.45:0/672602593 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380a59e0 con 0x7f0a400cd120 2023-07-09T02:20:57.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a37fff640 1 -- 172.21.15.45:0/672602593 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a380a5b40 con 0x7f0a400cd120 2023-07-09T02:20:57.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.718+0000 7f0a37fff640 1 -- 172.21.15.45:0/672602593 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380ad440 con 0x7f0a400cd120 2023-07-09T02:20:57.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- 172.21.15.45:0/672602593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 msgr2=0x7f0a400cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 --2- 172.21.15.45:0/672602593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a400cee30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009d90 tx=0x7f0a3801c920 comp rx=0 tx=0).stop 2023-07-09T02:20:57.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- 172.21.15.45:0/672602593 shutdown_connections 2023-07-09T02:20:57.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 --2- 172.21.15.45:0/672602593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a400cee30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 --2- 172.21.15.45:0/672602593 >> v2:172.21.15.155:3300/0 conn(0x7f0a400d2620 0x7f0a400b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- 172.21.15.45:0/672602593 >> 172.21.15.45:0/672602593 conn(0x7f0a400698e0 msgr2=0x7f0a40069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:57.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- 172.21.15.45:0/672602593 shutdown_connections 2023-07-09T02:20:57.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- 172.21.15.45:0/672602593 wait complete. 2023-07-09T02:20:57.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 Processor -- start 2023-07-09T02:20:57.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- start start 2023-07-09T02:20:57.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a40155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a400d2620 0x7f0a400d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a4015c060 0x7f0a400d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4015d9f0 con 0x7f0a400d2620 2023-07-09T02:20:57.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4015aee0 con 0x7f0a4015c060 2023-07-09T02:20:57.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a474d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4015d150 con 0x7f0a400cd120 2023-07-09T02:20:57.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a44a73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a400d2620 0x7f0a400d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a44a73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a400d2620 0x7f0a400d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56068/0 (socket says 172.21.15.45:56068) 2023-07-09T02:20:57.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a44a73640 1 -- 172.21.15.45:0/413459110 learned_addr learned my addr 172.21.15.45:0/413459110 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:57.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a45a75640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a4015c060 0x7f0a400d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a45274640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a40155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a44a73640 1 -- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 msgr2=0x7f0a40155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a44a73640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a40155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a44a73640 1 -- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a4015c060 msgr2=0x7f0a400d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.722+0000 7f0a44a73640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a4015c060 0x7f0a400d1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a44a73640 1 -- 172.21.15.45:0/413459110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300094d0 con 0x7f0a400d2620 2023-07-09T02:20:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a44a73640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a400d2620 0x7f0a400d17b0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000e9a0 tx=0x7f0a3000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:57.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a35ffb640 1 -- 172.21.15.45:0/413459110 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000ca00 con 0x7f0a400d2620 2023-07-09T02:20:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a35ffb640 1 -- 172.21.15.45:0/413459110 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3000cb60 con 0x7f0a400d2620 2023-07-09T02:20:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a35ffb640 1 -- 172.21.15.45:0/413459110 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30013470 con 0x7f0a400d2620 2023-07-09T02:20:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a38009a70 con 0x7f0a400d2620 2023-07-09T02:20:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a400b59f0 con 0x7f0a400d2620 2023-07-09T02:20:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4004d7d0 con 0x7f0a400d2620 2023-07-09T02:20:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a35ffb640 1 -- 172.21.15.45:0/413459110 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a300135d0 con 0x7f0a400d2620 2023-07-09T02:20:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a35ffb640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a24066280 0x7f0a24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.726+0000 7f0a35ffb640 1 -- 172.21.15.45:0/413459110 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0a30084090 con 0x7f0a400d2620 2023-07-09T02:20:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.730+0000 7f0a45274640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a24066280 0x7f0a24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.730+0000 7f0a45274640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a24066280 0x7f0a24068730 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0a400b4260 tx=0x7f0a3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:57.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.730+0000 7f0a35ffb640 1 -- 172.21.15.45:0/413459110 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a30051840 con 0x7f0a400d2620 2023-07-09T02:20:57.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a400b1840 con 0x7f0a400d2620 2023-07-09T02:20:57.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a35ffb640 1 -- 172.21.15.45:0/413459110 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f0a30017de0 con 0x7f0a400d2620 2023-07-09T02:20:57.920 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:57.920 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7058,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3928620454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3928620454},{"type":"v1","addr":"172.21.15.155:6837","nonce":3928620454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":7819,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1878423144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1878423144},{"type":"v1","addr":"172.21.15.155:6836","nonce":1878423144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":8259,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/1407467413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1407467413},{"type":"v1","addr":"172.21.15.45:6833","nonce":1407467413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70},{"gid":8268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2772552547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2772552547},{"type":"v1","addr":"172.21.15.45:6835","nonce":2772552547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-07-09T02:20:57.921 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 77 2023-07-09T02:20:57.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a24066280 msgr2=0x7f0a24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a24066280 0x7f0a24068730 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0a400b4260 tx=0x7f0a3c009040 comp rx=0 tx=0).stop 2023-07-09T02:20:57.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a400d2620 msgr2=0x7f0a400d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:57.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a400d2620 0x7f0a400d17b0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000e9a0 tx=0x7f0a3000ee60 comp rx=0 tx=0).stop 2023-07-09T02:20:57.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 shutdown_connections 2023-07-09T02:20:57.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a4015c060 0x7f0a400d1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a400d2620 0x7f0a400d17b0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a24066280 0x7f0a24068730 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 --2- 172.21.15.45:0/413459110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a400cd120 0x7f0a40155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:57.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 >> 172.21.15.45:0/413459110 conn(0x7f0a400698e0 msgr2=0x7f0a40157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:57.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 shutdown_connections 2023-07-09T02:20:57.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:57.922+0000 7f0a474d8640 1 -- 172.21.15.45:0/413459110 wait complete. 2023-07-09T02:20:57.941 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:20:57.942 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:20:57.942 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:20:57.943 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:20:57.943 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:20:57.944 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:20:57.944 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:20:57.944 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:20:57.945 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:20:57.945 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:20:57.946 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:20:57.946 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:20:57.946 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:20:57.947 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:20:57.947 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:20:57.947 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:20:57.956 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:20:57.957 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:20:57.959 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:20:57.959 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:20:57.961 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:20:57.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:20:57.963 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:20:57.963 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:20:58.009 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:20:58.010 DEBUG:teuthology.parallel:result is None 2023-07-09T02:20:58.012 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:20:58.012 DEBUG:teuthology.parallel:result is None 2023-07-09T02:20:58.013 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:20:58.014 DEBUG:teuthology.parallel:result is None 2023-07-09T02:20:58.015 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:20:58.015 DEBUG:teuthology.parallel:result is None 2023-07-09T02:20:58.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:20:58.098 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:20:58.100 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:20:58.105 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:20:58.105 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:20:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.166+0000 7f4a5a511640 1 Processor -- start 2023-07-09T02:20:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a5a511640 1 -- start start 2023-07-09T02:20:58.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a5a511640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4a5415c060 0x7f4a540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a5a511640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a540cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a5a511640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a54160a50 con 0x7f4a540cd120 2023-07-09T02:20:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a5a511640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5415c430 con 0x7f4a5415c060 2023-07-09T02:20:58.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a5a511640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5415fb60 con 0x7f4a540d2620 2023-07-09T02:20:58.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a537fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4a540cd120 0x7f4a540d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58118/0 (socket says 172.21.15.45:58118) 2023-07-09T02:20:58.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a537fe640 1 -- 172.21.15.45:0/3824620870 learned_addr learned my addr 172.21.15.45:0/3824620870 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:58.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a58aae640 1 --2- 172.21.15.45:0/3824620870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a540cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a53fff640 1 --2- 172.21.15.45:0/3824620870 >> v2:172.21.15.155:3300/0 conn(0x7f4a5415c060 0x7f4a540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a52ffd640 1 -- 172.21.15.45:0/3824620870 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827411417 0 0) 0x7f4a54160a50 con 0x7f4a540cd120 2023-07-09T02:20:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a52ffd640 1 -- 172.21.15.45:0/3824620870 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a3c003530 con 0x7f4a540cd120 2023-07-09T02:20:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a58aae640 1 -- 172.21.15.45:0/3824620870 >> v2:172.21.15.155:3300/0 conn(0x7f4a5415c060 msgr2=0x7f4a540b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a58aae640 1 --2- 172.21.15.45:0/3824620870 >> v2:172.21.15.155:3300/0 conn(0x7f4a5415c060 0x7f4a540b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a58aae640 1 -- 172.21.15.45:0/3824620870 >> v1:172.21.15.45:6789/0 conn(0x7f4a540cd120 legacy=0x7f4a540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a58aae640 1 -- 172.21.15.45:0/3824620870 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5415fe40 con 0x7f4a540d2620 2023-07-09T02:20:58.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.170+0000 7f4a53fff640 1 --2- 172.21.15.45:0/3824620870 >> v2:172.21.15.155:3300/0 conn(0x7f4a5415c060 0x7f4a540b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a58aae640 1 --2- 172.21.15.45:0/3824620870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a540cee30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009d90 tx=0x7f4a4c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=432736207a099260 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a52ffd640 1 -- 172.21.15.45:0/3824620870 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0a59e0 con 0x7f4a540d2620 2023-07-09T02:20:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a52ffd640 1 -- 172.21.15.45:0/3824620870 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0a5b40 con 0x7f4a540d2620 2023-07-09T02:20:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a52ffd640 1 -- 172.21.15.45:0/3824620870 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0ad440 con 0x7f4a540d2620 2023-07-09T02:20:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 -- 172.21.15.45:0/3824620870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 msgr2=0x7f4a540cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3824620870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a540cee30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009d90 tx=0x7f4a4c01c920 comp rx=0 tx=0).stop 2023-07-09T02:20:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 -- 172.21.15.45:0/3824620870 shutdown_connections 2023-07-09T02:20:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3824620870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a540cee30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3824620870 >> v2:172.21.15.155:3300/0 conn(0x7f4a5415c060 0x7f4a540b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 -- 172.21.15.45:0/3824620870 >> 172.21.15.45:0/3824620870 conn(0x7f4a540698e0 msgr2=0x7f4a54069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:58.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 -- 172.21.15.45:0/3824620870 shutdown_connections 2023-07-09T02:20:58.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 -- 172.21.15.45:0/3824620870 wait complete. 2023-07-09T02:20:58.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 Processor -- start 2023-07-09T02:20:58.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.174+0000 7f4a5a511640 1 -- start start 2023-07-09T02:20:58.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a540cd120 0x7f4a5415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:58.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a5415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a5415c060 0x7f4a540b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5415d140 con 0x7f4a5415c060 2023-07-09T02:20:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5415ad80 con 0x7f4a540cd120 2023-07-09T02:20:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5415f3f0 con 0x7f4a540d2620 2023-07-09T02:20:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a5415c060 0x7f4a540b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a5415c060 0x7f4a540b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56098/0 (socket says 172.21.15.45:56098) 2023-07-09T02:20:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 -- 172.21.15.45:0/3710372861 learned_addr learned my addr 172.21.15.45:0/3710372861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:58.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a53fff640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a540cd120 0x7f4a5415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:58.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a537fe640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a5415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:58.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 -- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 msgr2=0x7f4a5415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:58.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a5415eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 -- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a540cd120 msgr2=0x7f4a5415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:58.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a540cd120 0x7f4a5415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 -- 172.21.15.45:0/3710372861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44009420 con 0x7f4a5415c060 2023-07-09T02:20:58.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a53fff640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a540cd120 0x7f4a5415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:58.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a58aae640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a5415c060 0x7f4a540b70d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0b0040 tx=0x7f4a4c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:58.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a50ff9640 1 -- 172.21.15.45:0/3710372861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0adce0 con 0x7f4a5415c060 2023-07-09T02:20:58.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a50ff9640 1 -- 172.21.15.45:0/3710372861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0ade40 con 0x7f4a5415c060 2023-07-09T02:20:58.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a50ff9640 1 -- 172.21.15.45:0/3710372861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0b9670 con 0x7f4a5415c060 2023-07-09T02:20:58.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c009a70 con 0x7f4a5415c060 2023-07-09T02:20:58.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a540b59f0 con 0x7f4a5415c060 2023-07-09T02:20:58.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.178+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5415d3b0 con 0x7f4a5415c060 2023-07-09T02:20:58.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.182+0000 7f4a50ff9640 1 -- 172.21.15.45:0/3710372861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a4c0b97d0 con 0x7f4a5415c060 2023-07-09T02:20:58.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.182+0000 7f4a50ff9640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a40066280 0x7f4a40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:58.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.182+0000 7f4a50ff9640 1 -- 172.21.15.45:0/3710372861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4a4c11f010 con 0x7f4a5415c060 2023-07-09T02:20:58.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.182+0000 7f4a53fff640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a40066280 0x7f4a40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:58.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.182+0000 7f4a53fff640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a40066280 0x7f4a40068730 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4a540cf020 tx=0x7f4a44009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:58.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.186+0000 7f4a50ff9640 1 -- 172.21.15.45:0/3710372861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a4c0ec850 con 0x7f4a5415c060 2023-07-09T02:20:58.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.354+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4a5404d7d0 con 0x7f4a5415c060 2023-07-09T02:20:58.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a50ff9640 1 -- 172.21.15.45:0/3710372861 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v160) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4a4c009450 con 0x7f4a5415c060 2023-07-09T02:20:58.988 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:20:58.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a40066280 msgr2=0x7f4a40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:58.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a40066280 0x7f4a40068730 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4a540cf020 tx=0x7f4a44009190 comp rx=0 tx=0).stop 2023-07-09T02:20:58.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a5415c060 msgr2=0x7f4a540b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a5415c060 0x7f4a540b70d0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0b0040 tx=0x7f4a4c0196c0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 shutdown_connections 2023-07-09T02:20:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a5415c060 0x7f4a540b70d0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a40066280 0x7f4a40068730 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a540d2620 0x7f4a5415eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 --2- 172.21.15.45:0/3710372861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a540cd120 0x7f4a5415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 >> 172.21.15.45:0/3710372861 conn(0x7f4a540698e0 msgr2=0x7f4a54069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:58.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 shutdown_connections 2023-07-09T02:20:58.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:58.990+0000 7f4a5a511640 1 -- 172.21.15.45:0/3710372861 wait complete. 2023-07-09T02:20:59.014 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:20:59.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f89753ac640 1 Processor -- start 2023-07-09T02:20:59.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f89753ac640 1 -- start start 2023-07-09T02:20:59.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f89753ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f897015c060 0x7f89700b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f89753ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f89700cd120 0x7f89700d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f89753ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8970160a50 con 0x7f89700d2450 2023-07-09T02:20:59.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f89753ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89700d28f0 con 0x7f89700cd120 2023-07-09T02:20:59.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f89753ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89700cfe40 con 0x7f897015c060 2023-07-09T02:20:59.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89700d2450 0x7f89700d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58122/0 (socket says 172.21.15.45:58122) 2023-07-09T02:20:59.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896f7fe640 1 -- 172.21.15.45:0/894974026 learned_addr learned my addr 172.21.15.45:0/894974026 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:59.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f8967fff640 1 --2- 172.21.15.45:0/894974026 >> v2:172.21.15.155:3300/0 conn(0x7f89700cd120 0x7f89700d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896effd640 1 --2- 172.21.15.45:0/894974026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f897015c060 0x7f89700b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896e7fc640 1 -- 172.21.15.45:0/894974026 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773248665 0 0) 0x7f8970160a50 con 0x7f89700d2450 2023-07-09T02:20:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896e7fc640 1 -- 172.21.15.45:0/894974026 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f895c003530 con 0x7f89700d2450 2023-07-09T02:20:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896effd640 1 -- 172.21.15.45:0/894974026 >> v2:172.21.15.155:3300/0 conn(0x7f89700cd120 msgr2=0x7f89700d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896effd640 1 --2- 172.21.15.45:0/894974026 >> v2:172.21.15.155:3300/0 conn(0x7f89700cd120 0x7f89700d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896effd640 1 -- 172.21.15.45:0/894974026 >> v1:172.21.15.45:6789/0 conn(0x7f89700d2450 legacy=0x7f89700d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f896effd640 1 -- 172.21.15.45:0/894974026 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897015c430 con 0x7f897015c060 2023-07-09T02:20:59.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.162+0000 7f8967fff640 1 --2- 172.21.15.45:0/894974026 >> v2:172.21.15.155:3300/0 conn(0x7f89700cd120 0x7f89700d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:20:59.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f896effd640 1 --2- 172.21.15.45:0/894974026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f897015c060 0x7f89700b4ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f89600097c0 tx=0x7f896001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2234666cb3c76d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f896e7fc640 1 -- 172.21.15.45:0/894974026 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600ab600 con 0x7f897015c060 2023-07-09T02:20:59.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f896e7fc640 1 -- 172.21.15.45:0/894974026 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89600a7050 con 0x7f897015c060 2023-07-09T02:20:59.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f896e7fc640 1 -- 172.21.15.45:0/894974026 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600ab980 con 0x7f897015c060 2023-07-09T02:20:59.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f89753ac640 1 -- 172.21.15.45:0/894974026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f897015c060 msgr2=0x7f89700b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f89753ac640 1 --2- 172.21.15.45:0/894974026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f897015c060 0x7f89700b4ed0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f89600097c0 tx=0x7f896001c450 comp rx=0 tx=0).stop 2023-07-09T02:20:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f89753ac640 1 -- 172.21.15.45:0/894974026 shutdown_connections 2023-07-09T02:20:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f89753ac640 1 --2- 172.21.15.45:0/894974026 >> v2:172.21.15.155:3300/0 conn(0x7f89700cd120 0x7f89700d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f89753ac640 1 --2- 172.21.15.45:0/894974026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f897015c060 0x7f89700b4ed0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f89753ac640 1 -- 172.21.15.45:0/894974026 >> 172.21.15.45:0/894974026 conn(0x7f89700698e0 msgr2=0x7f8970069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:59.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f89753ac640 1 -- 172.21.15.45:0/894974026 shutdown_connections 2023-07-09T02:20:59.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.166+0000 7f89753ac640 1 -- 172.21.15.45:0/894974026 wait complete. 2023-07-09T02:20:59.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 Processor -- start 2023-07-09T02:20:59.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 -- start start 2023-07-09T02:20:59.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89700cd120 0x7f8970153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89700d2450 0x7f89700c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897015c060 0x7f89700b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897015ca40 con 0x7f89700cd120 2023-07-09T02:20:59.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897015cd20 con 0x7f897015c060 2023-07-09T02:20:59.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897015d000 con 0x7f89700d2450 2023-07-09T02:20:59.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89700cd120 0x7f8970153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89700cd120 0x7f8970153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56106/0 (socket says 172.21.15.45:56106) 2023-07-09T02:20:59.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 -- 172.21.15.45:0/3636638016 learned_addr learned my addr 172.21.15.45:0/3636638016 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:59.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f8967fff640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89700d2450 0x7f89700c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896f7fe640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897015c060 0x7f89700b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 -- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89700d2450 msgr2=0x7f89700c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89700d2450 0x7f89700c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 -- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897015c060 msgr2=0x7f89700b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897015c060 0x7f89700b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 -- 172.21.15.45:0/3636638016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958009420 con 0x7f89700cd120 2023-07-09T02:20:59.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f896effd640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89700cd120 0x7f8970153840 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f8960019060 tx=0x7f89600191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89677fe640 1 -- 172.21.15.45:0/3636638016 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600b4400 con 0x7f89700cd120 2023-07-09T02:20:59.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89677fe640 1 -- 172.21.15.45:0/3636638016 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89600b4560 con 0x7f89700cd120 2023-07-09T02:20:59.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8960009420 con 0x7f89700cd120 2023-07-09T02:20:59.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89677fe640 1 -- 172.21.15.45:0/3636638016 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600b4910 con 0x7f89700cd120 2023-07-09T02:20:59.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.170+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897015d5c0 con 0x7f89700cd120 2023-07-09T02:20:59.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.174+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89700ccf70 con 0x7f89700cd120 2023-07-09T02:20:59.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.174+0000 7f89677fe640 1 -- 172.21.15.45:0/3636638016 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f89600b2040 con 0x7f89700cd120 2023-07-09T02:20:59.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.174+0000 7f89677fe640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8950066280 0x7f8950068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.174+0000 7f89677fe640 1 -- 172.21.15.45:0/3636638016 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f896011daa0 con 0x7f89700cd120 2023-07-09T02:20:59.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.174+0000 7f8967fff640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8950066280 0x7f8950068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.178+0000 7f8967fff640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8950066280 0x7f8950068730 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f89700b3730 tx=0x7f8958008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.178+0000 7f89677fe640 1 -- 172.21.15.45:0/3636638016 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89600eb300 con 0x7f89700cd120 2023-07-09T02:20:59.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f89700d0370 con 0x7f89700cd120 2023-07-09T02:20:59.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89677fe640 1 -- 172.21.15.45:0/3636638016 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f89600b0090 con 0x7f89700cd120 2023-07-09T02:20:59.384 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:59.384 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:20:59.384 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:20:59.384 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.385 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:20:59.385 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:20:59.385 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.385 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:20:59.385 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:20:59.385 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:20:59.385 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.386 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.386 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.386 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:20:59.386 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:20:59.386 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.386 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:20:59.387 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:20:59.387 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:20:59.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.387 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.387 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.387 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.387 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:20:59.388 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:20:59.388 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.388 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:20:59.388 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:20:59.388 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:20:59.388 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.389 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.389 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.389 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.389 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:20:59.389 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:20:59.389 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.389 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:20:59.390 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:20:59.390 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:20:59.390 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.390 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.390 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.390 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:20:59.391 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:20:59.391 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.391 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:20:59.391 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:20:59.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.392 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.392 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.392 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:20:59.392 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:20:59.392 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.393 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:20:59.393 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:20:59.393 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.393 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.393 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.393 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.393 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:20:59.394 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:20:59.394 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.394 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:20:59.394 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:20:59.394 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.394 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:20:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:20:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:20:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:20:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.395 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.396 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.396 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:20:59.396 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:20:59.396 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.396 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:20:59.397 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:20:59.397 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.397 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.397 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.397 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:20:59.397 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:20:59.398 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.398 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:20:59.398 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:20:59.398 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.398 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.398 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.398 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.398 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:20:59.399 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:20:59.399 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.399 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:20:59.399 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:20:59.399 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.399 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.399 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.400 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.400 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:20:59.400 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:20:59.400 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.400 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:20:59.400 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:20:59.401 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.401 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.401 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.401 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:20:59.401 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:20:59.401 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:20:59.402 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:20:59.402 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:20:59.402 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.402 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.402 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:20:59.403 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:20:59.403 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:20:59.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:20:59.403 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:20:59.403 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:20:59.403 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.404 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.404 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:20:59.404 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:20:59.404 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:20:59.404 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:20:59.405 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:20:59.405 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:20:59.405 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.405 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.405 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:20:59.405 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:20:59.406 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:20:59.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:20:59.406 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:20:59.406 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:20:59.406 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.407 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.407 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:20:59.407 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:20:59.407 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:20:59.407 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:20:59.408 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:20:59.408 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.408 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.408 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.408 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.408 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:20:59.409 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:20:59.409 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:20:59.409 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:20:59.409 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.409 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:20:59.410 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:20:59.410 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:20:59.410 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:20:59.410 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:20:59.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:20:59.410 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:20:59.410 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:20:59.411 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.411 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:20:59.411 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:20:59.411 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:20:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8950066280 msgr2=0x7f8950068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8950066280 0x7f8950068730 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f89700b3730 tx=0x7f8958008040 comp rx=0 tx=0).stop 2023-07-09T02:20:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89700cd120 msgr2=0x7f8970153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89700cd120 0x7f8970153840 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f8960019060 tx=0x7f89600191f0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 shutdown_connections 2023-07-09T02:20:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897015c060 0x7f89700b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8950066280 0x7f8950068730 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89700d2450 0x7f89700c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 --2- 172.21.15.45:0/3636638016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89700cd120 0x7f8970153840 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 >> 172.21.15.45:0/3636638016 conn(0x7f89700698e0 msgr2=0x7f89700b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 shutdown_connections 2023-07-09T02:20:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.386+0000 7f89753ac640 1 -- 172.21.15.45:0/3636638016 wait complete. 2023-07-09T02:20:59.415 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:20:59.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c1d807640 1 Processor -- start 2023-07-09T02:20:59.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c1d807640 1 -- start start 2023-07-09T02:20:59.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c1d807640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c180cd120 0x7f9c180b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c1d807640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c18160a50 con 0x7f9c1815c060 2023-07-09T02:20:59.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c1d807640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1815c430 con 0x7f9c180d2620 2023-07-09T02:20:59.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c1d807640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1815fb60 con 0x7f9c180cd120 2023-07-09T02:20:59.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c16ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9c1815c060 0x7f9c180d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58134/0 (socket says 172.21.15.45:58134) 2023-07-09T02:20:59.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c16ffd640 1 -- 172.21.15.45:0/3569130254 learned_addr learned my addr 172.21.15.45:0/3569130254 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:59.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c177fe640 1 --2- 172.21.15.45:0/3569130254 >> v2:172.21.15.155:3300/0 conn(0x7f9c180cd120 0x7f9c180b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184406318 0 0) 0x7f9c18160a50 con 0x7f9c1815c060 2023-07-09T02:20:59.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c04003530 con 0x7f9c1815c060 2023-07-09T02:20:59.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1120669502 0 0) 0x7f9c04003530 con 0x7f9c1815c060 2023-07-09T02:20:59.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 >> v2:172.21.15.155:3300/0 conn(0x7f9c180cd120 msgr2=0x7f9c180b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 --2- 172.21.15.45:0/3569130254 >> v2:172.21.15.155:3300/0 conn(0x7f9c180cd120 0x7f9c180b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 >> v1:172.21.15.155:6789/0 conn(0x7f9c180d2620 legacy=0x7f9c180cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1815fe40 con 0x7f9c1815c060 2023-07-09T02:20:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f9c08001680 con 0x7f9c1815c060 2023-07-09T02:20:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 >> v1:172.21.15.45:6789/0 conn(0x7f9c1815c060 legacy=0x7f9c180d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c04003980 0x7f9c04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c040047d0 0x7f9c04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04005180 0x7f9c0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1815fb60 con 0x7f9c040047d0 2023-07-09T02:20:59.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0400c000 con 0x7f9c04003980 2023-07-09T02:20:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0400c1c0 con 0x7f9c04005180 2023-07-09T02:20:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c0ffff640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c040047d0 0x7f9c04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c16ffd640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c04003980 0x7f9c04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.562+0000 7f9c177fe640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04005180 0x7f9c0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c16ffd640 1 -- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04005180 msgr2=0x7f9c0400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c16ffd640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04005180 0x7f9c0400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c16ffd640 1 -- 172.21.15.45:0/3569130254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c040047d0 msgr2=0x7f9c04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c16ffd640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c040047d0 0x7f9c04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c16ffd640 1 -- 172.21.15.45:0/3569130254 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04003530 con 0x7f9c04003980 2023-07-09T02:20:59.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c177fe640 1 -- 172.21.15.45:0/3569130254 reap_dead start 2023-07-09T02:20:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c16ffd640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c04003980 0x7f9c04003d90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c240 tx=0x7f9c0801f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2d95fa5eecb6339 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080a8e50 con 0x7f9c04003980 2023-07-09T02:20:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c080058e0 con 0x7f9c04003980 2023-07-09T02:20:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c167fc640 1 -- 172.21.15.45:0/3569130254 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08005d10 con 0x7f9c04003980 2023-07-09T02:20:59.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c1d807640 1 -- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c04003980 msgr2=0x7f9c04003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c1d807640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c04003980 0x7f9c04003d90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c240 tx=0x7f9c0801f330 comp rx=0 tx=0).stop 2023-07-09T02:20:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.566+0000 7f9c1d807640 1 -- 172.21.15.45:0/3569130254 shutdown_connections 2023-07-09T02:20:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 --2- 172.21.15.45:0/3569130254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c04003980 0x7f9c04003d90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 -- 172.21.15.45:0/3569130254 >> 172.21.15.45:0/3569130254 conn(0x7f9c180698e0 msgr2=0x7f9c18069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 -- 172.21.15.45:0/3569130254 shutdown_connections 2023-07-09T02:20:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 -- 172.21.15.45:0/3569130254 wait complete. 2023-07-09T02:20:59.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 Processor -- start 2023-07-09T02:20:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 -- start start 2023-07-09T02:20:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04003980 0x7f9c181f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c180b1190 0x7f9c180d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c180d0b30 0x7f9c181f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180d0fd0 con 0x7f9c180d0b30 2023-07-09T02:20:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1815f680 con 0x7f9c180b1190 2023-07-09T02:20:59.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c1d807640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1815ee20 con 0x7f9c04003980 2023-07-09T02:20:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c180d0b30 0x7f9c181f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c180d0b30 0x7f9c181f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56122/0 (socket says 172.21.15.45:56122) 2023-07-09T02:20:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 -- 172.21.15.45:0/468263615 learned_addr learned my addr 172.21.15.45:0/468263615 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c16ffd640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04003980 0x7f9c181f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c0ffff640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c180b1190 0x7f9c180d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 -- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04003980 msgr2=0x7f9c181f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04003980 0x7f9c181f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 -- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c180b1190 msgr2=0x7f9c180d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c180b1190 0x7f9c180d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 -- 172.21.15.45:0/468263615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c181f3010 con 0x7f9c180d0b30 2023-07-09T02:20:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.570+0000 7f9c177fe640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c180d0b30 0x7f9c181f52a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f9c1808bca0 tx=0x7f9c10011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c14ff9640 1 -- 172.21.15.45:0/468263615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000e040 con 0x7f9c180d0b30 2023-07-09T02:20:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c14ff9640 1 -- 172.21.15.45:0/468263615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000f040 con 0x7f9c180d0b30 2023-07-09T02:20:59.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c14ff9640 1 -- 172.21.15.45:0/468263615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10015a80 con 0x7f9c180d0b30 2023-07-09T02:20:59.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1815f0c0 con 0x7f9c180d0b30 2023-07-09T02:20:59.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c181f32b0 con 0x7f9c180d0b30 2023-07-09T02:20:59.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c181f2e70 con 0x7f9c180d0b30 2023-07-09T02:20:59.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c14ff9640 1 -- 172.21.15.45:0/468263615 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c10015be0 con 0x7f9c180d0b30 2023-07-09T02:20:59.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c14ff9640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bf80662b0 0x7f9bf8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c14ff9640 1 -- 172.21.15.45:0/468263615 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9c100837e0 con 0x7f9c180d0b30 2023-07-09T02:20:59.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.574+0000 7f9c16ffd640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bf80662b0 0x7f9bf8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.578+0000 7f9c16ffd640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bf80662b0 0x7f9bf8068760 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9c080ae000 tx=0x7f9c080aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.578+0000 7f9c14ff9640 1 -- 172.21.15.45:0/468263615 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c181f2e70 con 0x7f9c180d0b30 2023-07-09T02:20:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c181f2e70 con 0x7f9c180d0b30 2023-07-09T02:20:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c14ff9640 1 -- 172.21.15.45:0/468263615 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+14651 (secure 0 0 0) 0x7f9c181f2e70 con 0x7f9c180d0b30 2023-07-09T02:20:59.736 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:20:59.736 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":162,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:20:58.998651+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:20:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bf80662b0 msgr2=0x7f9bf8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bf80662b0 0x7f9bf8068760 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9c080ae000 tx=0x7f9c080aa070 comp rx=0 tx=0).stop 2023-07-09T02:20:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c180d0b30 msgr2=0x7f9c181f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c180d0b30 0x7f9c181f52a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f9c1808bca0 tx=0x7f9c10011cb0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 shutdown_connections 2023-07-09T02:20:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c180d0b30 0x7f9c181f52a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c180b1190 0x7f9c180d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9bf80662b0 0x7f9bf8068760 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 --2- 172.21.15.45:0/468263615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c04003980 0x7f9c181f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 >> 172.21.15.45:0/468263615 conn(0x7f9c180698e0 msgr2=0x7f9c18069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 shutdown_connections 2023-07-09T02:20:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.738+0000 7f9c1d807640 1 -- 172.21.15.45:0/468263615 wait complete. 2023-07-09T02:20:59.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:20:59.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:20:59.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d268a640 1 Processor -- start 2023-07-09T02:20:59.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d268a640 1 -- start start 2023-07-09T02:20:59.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d268a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe5cc0b1bc0 0x7fe5cc069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d268a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5cc0d2400 0x7fe5cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d268a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5cc0ceff0 con 0x7fe5cc0ccf10 2023-07-09T02:20:59.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d268a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5cc0cea70 con 0x7fe5cc0d2400 2023-07-09T02:20:59.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d268a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5cc0b1f90 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d0e87640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5cc0d2400 0x7fe5cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d1e89640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe5cc0ccf10 0x7fe5cc070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58138/0 (socket says 172.21.15.45:58138) 2023-07-09T02:20:59.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d1e89640 1 -- 172.21.15.45:0/2560511200 learned_addr learned my addr 172.21.15.45:0/2560511200 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:20:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d1688640 1 --2- 172.21.15.45:0/2560511200 >> v2:172.21.15.155:3300/0 conn(0x7fe5cc0b1bc0 0x7fe5cc069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d0e87640 1 -- 172.21.15.45:0/2560511200 >> v2:172.21.15.155:3300/0 conn(0x7fe5cc0b1bc0 msgr2=0x7fe5cc069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:20:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d0e87640 1 --2- 172.21.15.45:0/2560511200 >> v2:172.21.15.155:3300/0 conn(0x7fe5cc0b1bc0 0x7fe5cc069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d0e87640 1 -- 172.21.15.45:0/2560511200 >> v1:172.21.15.45:6789/0 conn(0x7fe5cc0ccf10 legacy=0x7fe5cc070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5c3fff640 1 -- 172.21.15.45:0/2560511200 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238104448 0 0) 0x7fe5cc0ceff0 con 0x7fe5cc0ccf10 2023-07-09T02:20:59.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.906+0000 7fe5d0e87640 1 -- 172.21.15.45:0/2560511200 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc0d1500 con 0x7fe5cc0d2400 2023-07-09T02:20:59.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d0e87640 1 --2- 172.21.15.45:0/2560511200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0d2400 0x7fe5cc069db0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0d28b0 tx=0x7fe5bc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f810c1b64a8167 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5c3fff640 1 -- 172.21.15.45:0/2560511200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0ac600 con 0x7fe5cc0d2400 2023-07-09T02:20:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5c3fff640 1 -- 172.21.15.45:0/2560511200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0a8050 con 0x7fe5cc0d2400 2023-07-09T02:20:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5c3fff640 1 -- 172.21.15.45:0/2560511200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0ac980 con 0x7fe5cc0d2400 2023-07-09T02:20:59.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d268a640 1 -- 172.21.15.45:0/2560511200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0d2400 msgr2=0x7fe5cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d268a640 1 --2- 172.21.15.45:0/2560511200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0d2400 0x7fe5cc069db0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0d28b0 tx=0x7fe5bc01c3a0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d268a640 1 -- 172.21.15.45:0/2560511200 shutdown_connections 2023-07-09T02:20:59.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d268a640 1 --2- 172.21.15.45:0/2560511200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0d2400 0x7fe5cc069db0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d268a640 1 --2- 172.21.15.45:0/2560511200 >> v2:172.21.15.155:3300/0 conn(0x7fe5cc0b1bc0 0x7fe5cc069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d268a640 1 -- 172.21.15.45:0/2560511200 >> 172.21.15.45:0/2560511200 conn(0x7fe5cc0d35b0 msgr2=0x7fe5cc0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:20:59.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d268a640 1 -- 172.21.15.45:0/2560511200 shutdown_connections 2023-07-09T02:20:59.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.910+0000 7fe5d268a640 1 -- 172.21.15.45:0/2560511200 wait complete. 2023-07-09T02:20:59.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 Processor -- start 2023-07-09T02:20:59.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 -- start start 2023-07-09T02:20:59.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0b1bc0 0x7fe5cc1f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5cc0ccf10 0x7fe5cc15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5cc0d2400 0x7fe5cc158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc15cbe0 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc15d9e0 con 0x7fe5cc0ccf10 2023-07-09T02:20:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc15cdd0 con 0x7fe5cc0d2400 2023-07-09T02:20:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0b1bc0 0x7fe5cc1f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0b1bc0 0x7fe5cc1f8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56136/0 (socket says 172.21.15.45:56136) 2023-07-09T02:20:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 -- 172.21.15.45:0/1559844578 learned_addr learned my addr 172.21.15.45:0/1559844578 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:20:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d0e87640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5cc0ccf10 0x7fe5cc15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1e89640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5cc0d2400 0x7fe5cc158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 -- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5cc0d2400 msgr2=0x7fe5cc158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5cc0d2400 0x7fe5cc158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 -- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5cc0ccf10 msgr2=0x7fe5cc15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:20:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5cc0ccf10 0x7fe5cc15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:20:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 -- 172.21.15.45:0/1559844578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009420 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d0e87640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5cc0ccf10 0x7fe5cc15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:20:59.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d1688640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0b1bc0 0x7fe5cc1f8840 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d800 tx=0x7fe5c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5c1ffb640 1 -- 172.21.15.45:0/1559844578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800b6c0 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5c1ffb640 1 -- 172.21.15.45:0/1559844578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c800b820 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5c1ffb640 1 -- 172.21.15.45:0/1559844578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800bb90 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5cc15d0b0 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5cc15d670 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.914+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5cc04e020 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.918+0000 7fe5c1ffb640 1 -- 172.21.15.45:0/1559844578 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5c800bcf0 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.918+0000 7fe5c1ffb640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5b00662b0 0x7fe5b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:20:59.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.918+0000 7fe5c1ffb640 1 -- 172.21.15.45:0/1559844578 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe5c8083ff0 con 0x7fe5cc0b1bc0 2023-07-09T02:20:59.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.918+0000 7fe5d0e87640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5b00662b0 0x7fe5b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:20:59.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.918+0000 7fe5d0e87640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5b00662b0 0x7fe5b0068760 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0ae000 tx=0x7fe5bc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:20:59.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:20:59.922+0000 7fe5c1ffb640 1 -- 172.21.15.45:0/1559844578 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5c80b4700 con 0x7fe5cc0b1bc0 2023-07-09T02:21:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5cc0cc930 con 0x7fe5cc0b1bc0 2023-07-09T02:21:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5c1ffb640 1 -- 172.21.15.45:0/1559844578 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5c80551d0 con 0x7fe5cc0b1bc0 2023-07-09T02:21:00.077 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:21:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5b00662b0 msgr2=0x7fe5b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5b00662b0 0x7fe5b0068760 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0ae000 tx=0x7fe5bc0a7000 comp rx=0 tx=0).stop 2023-07-09T02:21:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0b1bc0 msgr2=0x7fe5cc1f8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0b1bc0 0x7fe5cc1f8840 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d800 tx=0x7fe5c800dcc0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 shutdown_connections 2023-07-09T02:21:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe5b00662b0 0x7fe5b0068760 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5cc0d2400 0x7fe5cc158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5cc0ccf10 0x7fe5cc15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 --2- 172.21.15.45:0/1559844578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5cc0b1bc0 0x7fe5cc1f8840 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.078+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 >> 172.21.15.45:0/1559844578 conn(0x7fe5cc0d35b0 msgr2=0x7fe5cc0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:00.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.082+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 shutdown_connections 2023-07-09T02:21:00.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.082+0000 7fe5d268a640 1 -- 172.21.15.45:0/1559844578 wait complete. 2023-07-09T02:21:00.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:21:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c5a07b640 1 Processor -- start 2023-07-09T02:21:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c5a07b640 1 -- start start 2023-07-09T02:21:00.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c5a07b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c5415c060 0x7f8c540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c5a07b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8c540cd120 0x7f8c540d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c5a07b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c54160a50 con 0x7f8c540d2450 2023-07-09T02:21:00.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c5a07b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c540d28d0 con 0x7f8c5415c060 2023-07-09T02:21:00.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c5a07b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c540cfe40 con 0x7f8c540cd120 2023-07-09T02:21:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c537fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c5415c060 0x7f8c540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c537fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c5415c060 0x7f8c540b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56138/0 (socket says 172.21.15.45:56138) 2023-07-09T02:21:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c537fe640 1 -- 172.21.15.45:0/356329499 learned_addr learned my addr 172.21.15.45:0/356329499 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c52ffd640 1 --2- 172.21.15.45:0/356329499 >> v2:172.21.15.155:3300/0 conn(0x7f8c540cd120 0x7f8c540d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c537fe640 1 -- 172.21.15.45:0/356329499 >> v2:172.21.15.155:3300/0 conn(0x7f8c540cd120 msgr2=0x7f8c540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c537fe640 1 --2- 172.21.15.45:0/356329499 >> v2:172.21.15.155:3300/0 conn(0x7f8c540cd120 0x7f8c540d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c537fe640 1 -- 172.21.15.45:0/356329499 >> v1:172.21.15.45:6789/0 conn(0x7f8c540d2450 legacy=0x7f8c540d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c527fc640 1 -- 172.21.15.45:0/356329499 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134742091 0 0) 0x7f8c54160a50 con 0x7f8c540d2450 2023-07-09T02:21:00.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.246+0000 7f8c537fe640 1 -- 172.21.15.45:0/356329499 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5415c430 con 0x7f8c5415c060 2023-07-09T02:21:00.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c537fe640 1 --2- 172.21.15.45:0/356329499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c5415c060 0x7f8c540b4ed0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f8c5415fac0 tx=0x7f8c4401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6908ade9cdab7dc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c527fc640 1 -- 172.21.15.45:0/356329499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c440ab5f0 con 0x7f8c5415c060 2023-07-09T02:21:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c527fc640 1 -- 172.21.15.45:0/356329499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c440ab750 con 0x7f8c5415c060 2023-07-09T02:21:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c527fc640 1 -- 172.21.15.45:0/356329499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c440abae0 con 0x7f8c5415c060 2023-07-09T02:21:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c5a07b640 1 -- 172.21.15.45:0/356329499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c5415c060 msgr2=0x7f8c540b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/356329499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c5415c060 0x7f8c540b4ed0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f8c5415fac0 tx=0x7f8c4401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c5a07b640 1 -- 172.21.15.45:0/356329499 shutdown_connections 2023-07-09T02:21:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/356329499 >> v2:172.21.15.155:3300/0 conn(0x7f8c540cd120 0x7f8c540d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/356329499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c5415c060 0x7f8c540b4ed0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c5a07b640 1 -- 172.21.15.45:0/356329499 >> 172.21.15.45:0/356329499 conn(0x7f8c540698e0 msgr2=0x7f8c54069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:00.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c5a07b640 1 -- 172.21.15.45:0/356329499 shutdown_connections 2023-07-09T02:21:00.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.250+0000 7f8c5a07b640 1 -- 172.21.15.45:0/356329499 wait complete. 2023-07-09T02:21:00.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 Processor -- start 2023-07-09T02:21:00.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 -- start start 2023-07-09T02:21:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c540cd120 0x7f8c54153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c540d2450 0x7f8c540b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c5415c060 0x7f8c540b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540c9b10 con 0x7f8c540d2450 2023-07-09T02:21:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c54154470 con 0x7f8c540cd120 2023-07-09T02:21:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5415b460 con 0x7f8c5415c060 2023-07-09T02:21:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c540d2450 0x7f8c540b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c540d2450 0x7f8c540b7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56148/0 (socket says 172.21.15.45:56148) 2023-07-09T02:21:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 -- 172.21.15.45:0/2312025104 learned_addr learned my addr 172.21.15.45:0/2312025104 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c537fe640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c540cd120 0x7f8c54153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c53fff640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c5415c060 0x7f8c540b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 -- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c5415c060 msgr2=0x7f8c540b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c5415c060 0x7f8c540b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 -- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c540cd120 msgr2=0x7f8c54153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c540cd120 0x7f8c54153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 -- 172.21.15.45:0/2312025104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c440094d0 con 0x7f8c540d2450 2023-07-09T02:21:00.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c537fe640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c540cd120 0x7f8c54153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:00.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c52ffd640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c540d2450 0x7f8c540b7a20 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800d7d0 tx=0x7f8c4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c3bfff640 1 -- 172.21.15.45:0/2312025104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48018070 con 0x7f8c540d2450 2023-07-09T02:21:00.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c3bfff640 1 -- 172.21.15.45:0/2312025104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48004020 con 0x7f8c540d2450 2023-07-09T02:21:00.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c3bfff640 1 -- 172.21.15.45:0/2312025104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480041d0 con 0x7f8c540d2450 2023-07-09T02:21:00.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5415b740 con 0x7f8c540d2450 2023-07-09T02:21:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.254+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c540ca040 con 0x7f8c540d2450 2023-07-09T02:21:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.258+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c540ca200 con 0x7f8c540d2450 2023-07-09T02:21:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.258+0000 7f8c3bfff640 1 -- 172.21.15.45:0/2312025104 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c48004330 con 0x7f8c540d2450 2023-07-09T02:21:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.258+0000 7f8c3bfff640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c40066280 0x7f8c40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.258+0000 7f8c3bfff640 1 -- 172.21.15.45:0/2312025104 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8c480838d0 con 0x7f8c540d2450 2023-07-09T02:21:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.258+0000 7f8c537fe640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c40066280 0x7f8c40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.258+0000 7f8c537fe640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c40066280 0x7f8c40068730 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8c440af000 tx=0x7f8c440b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.262+0000 7f8c3bfff640 1 -- 172.21.15.45:0/2312025104 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c48054b20 con 0x7f8c540d2450 2023-07-09T02:21:00.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c5404d7d0 con 0x7f8c540d2450 2023-07-09T02:21:00.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c3bfff640 1 -- 172.21.15.45:0/2312025104 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c480546b0 con 0x7f8c540d2450 2023-07-09T02:21:00.416 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:21:00.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c40066280 msgr2=0x7f8c40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c40066280 0x7f8c40068730 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8c440af000 tx=0x7f8c440b6040 comp rx=0 tx=0).stop 2023-07-09T02:21:00.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c540d2450 msgr2=0x7f8c540b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c540d2450 0x7f8c540b7a20 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800d7d0 tx=0x7f8c4800dc90 comp rx=0 tx=0).stop 2023-07-09T02:21:00.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 shutdown_connections 2023-07-09T02:21:00.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8c40066280 0x7f8c40068730 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c5415c060 0x7f8c540b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c540d2450 0x7f8c540b7a20 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 --2- 172.21.15.45:0/2312025104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c540cd120 0x7f8c54153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 >> 172.21.15.45:0/2312025104 conn(0x7f8c540698e0 msgr2=0x7f8c540b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 shutdown_connections 2023-07-09T02:21:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.418+0000 7f8c5a07b640 1 -- 172.21.15.45:0/2312025104 wait complete. 2023-07-09T02:21:00.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:21:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.582+0000 7fdc2c456640 1 Processor -- start 2023-07-09T02:21:00.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.582+0000 7fdc2c456640 1 -- start start 2023-07-09T02:21:00.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2c456640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdc240d2620 0x7fdc240b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2c456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240cd120 0x7fdc240cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2c456640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc24160a50 con 0x7fdc2415c060 2023-07-09T02:21:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2c456640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2415c430 con 0x7fdc240d2620 2023-07-09T02:21:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2c456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2415fb60 con 0x7fdc240cd120 2023-07-09T02:21:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a1f2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdc2415c060 0x7fdc240d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58162/0 (socket says 172.21.15.45:58162) 2023-07-09T02:21:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a1f2640 1 -- 172.21.15.45:0/1505096854 learned_addr learned my addr 172.21.15.45:0/1505096854 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48845866 0 0) 0x7fdc24160a50 con 0x7fdc2415c060 2023-07-09T02:21:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc299f1640 1 --2- 172.21.15.45:0/1505096854 >> v2:172.21.15.155:3300/0 conn(0x7fdc240d2620 0x7fdc240b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc10003530 con 0x7fdc2415c060 2023-07-09T02:21:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a9f3640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240cd120 0x7fdc240cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141368705 0 0) 0x7fdc10003530 con 0x7fdc2415c060 2023-07-09T02:21:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240cd120 msgr2=0x7fdc240cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240cd120 0x7fdc240cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 >> v2:172.21.15.155:3300/0 conn(0x7fdc240d2620 msgr2=0x7fdc240b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 --2- 172.21.15.45:0/1505096854 >> v2:172.21.15.155:3300/0 conn(0x7fdc240d2620 0x7fdc240b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2415fe40 con 0x7fdc2415c060 2023-07-09T02:21:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fdc20001680 con 0x7fdc2415c060 2023-07-09T02:21:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 >> v1:172.21.15.45:6789/0 conn(0x7fdc2415c060 legacy=0x7fdc240d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240cd120 0x7fdc10003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10003f00 0x7fdc100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc10004d10 0x7fdc10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2415c430 con 0x7fdc10004d10 2023-07-09T02:21:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2415fb60 con 0x7fdc10003f00 2023-07-09T02:21:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1000b9c0 con 0x7fdc240cd120 2023-07-09T02:21:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a9f3640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc10004d10 0x7fdc10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a1f2640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240cd120 0x7fdc10003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc299f1640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10003f00 0x7fdc100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a9f3640 1 -- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240cd120 msgr2=0x7fdc10003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a9f3640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc240cd120 0x7fdc10003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a9f3640 1 -- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10003f00 msgr2=0x7fdc100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a9f3640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10003f00 0x7fdc100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.586+0000 7fdc2a9f3640 1 -- 172.21.15.45:0/1505096854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10003530 con 0x7fdc10004d10 2023-07-09T02:21:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc2a9f3640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc10004d10 0x7fdc10005180 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c007360 tx=0x7fdc1c01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176110f06dba50a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0a5d20 con 0x7fdc10004d10 2023-07-09T02:21:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0a5e80 con 0x7fdc10004d10 2023-07-09T02:21:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc291f0640 1 -- 172.21.15.45:0/1505096854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0ad660 con 0x7fdc10004d10 2023-07-09T02:21:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc2c456640 1 -- 172.21.15.45:0/1505096854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc10004d10 msgr2=0x7fdc10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc2c456640 1 --2- 172.21.15.45:0/1505096854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc10004d10 0x7fdc10005180 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c007360 tx=0x7fdc1c01ce20 comp rx=0 tx=0).stop 2023-07-09T02:21:00.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc2a9f3640 1 -- 172.21.15.45:0/1505096854 reap_dead start 2023-07-09T02:21:00.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc2c456640 1 -- 172.21.15.45:0/1505096854 shutdown_connections 2023-07-09T02:21:00.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc2c456640 1 -- 172.21.15.45:0/1505096854 >> 172.21.15.45:0/1505096854 conn(0x7fdc240698e0 msgr2=0x7fdc24069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:00.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc2c456640 1 -- 172.21.15.45:0/1505096854 shutdown_connections 2023-07-09T02:21:00.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.590+0000 7fdc2c456640 1 -- 172.21.15.45:0/1505096854 wait complete. 2023-07-09T02:21:00.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 Processor -- start 2023-07-09T02:21:00.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 -- start start 2023-07-09T02:21:00.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10004d10 0x7fdc241f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc241f4e80 0x7fdc240ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc241f52f0 0x7fdc240cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc241f5aa0 con 0x7fdc241f52f0 2023-07-09T02:21:00.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240cb2b0 con 0x7fdc10004d10 2023-07-09T02:21:00.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2415d740 con 0x7fdc241f4e80 2023-07-09T02:21:00.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc241f52f0 0x7fdc240cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc241f52f0 0x7fdc240cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56158/0 (socket says 172.21.15.45:56158) 2023-07-09T02:21:00.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 -- 172.21.15.45:0/3748105579 learned_addr learned my addr 172.21.15.45:0/3748105579 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:00.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a1f2640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10004d10 0x7fdc241f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc299f1640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc241f4e80 0x7fdc240ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 -- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc241f4e80 msgr2=0x7fdc240ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc241f4e80 0x7fdc240ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 -- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10004d10 msgr2=0x7fdc241f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10004d10 0x7fdc241f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 -- 172.21.15.45:0/3748105579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2415da20 con 0x7fdc241f52f0 2023-07-09T02:21:00.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc299f1640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc241f4e80 0x7fdc240ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:00.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2a9f3640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc241f52f0 0x7fdc240cac10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c007360 tx=0x7fdc10005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc1affd640 1 -- 172.21.15.45:0/3748105579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0adb50 con 0x7fdc241f52f0 2023-07-09T02:21:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc1affd640 1 -- 172.21.15.45:0/3748105579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0adcb0 con 0x7fdc241f52f0 2023-07-09T02:21:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2415dd00 con 0x7fdc241f52f0 2023-07-09T02:21:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc1affd640 1 -- 172.21.15.45:0/3748105579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0b6660 con 0x7fdc241f52f0 2023-07-09T02:21:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc24158b70 con 0x7fdc241f52f0 2023-07-09T02:21:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.594+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2404d7d0 con 0x7fdc241f52f0 2023-07-09T02:21:00.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.598+0000 7fdc1affd640 1 -- 172.21.15.45:0/3748105579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc1c0b4070 con 0x7fdc241f52f0 2023-07-09T02:21:00.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.598+0000 7fdc1affd640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.598+0000 7fdc1affd640 1 -- 172.21.15.45:0/3748105579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdc1c11dbf0 con 0x7fdc241f52f0 2023-07-09T02:21:00.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.598+0000 7fdc2a1f2640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.598+0000 7fdc2a1f2640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdc20001560 tx=0x7fdc20007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.602+0000 7fdc1affd640 1 -- 172.21.15.45:0/3748105579 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc1c0eb340 con 0x7fdc241f52f0 2023-07-09T02:21:00.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.762+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdc240d1470 con 0x7fdc241f52f0 2023-07-09T02:21:00.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.762+0000 7fdc1affd640 1 -- 172.21.15.45:0/3748105579 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v162) v1 ==== 84+0+126 (secure 0 0 0) 0x7fdc1c0b2020 con 0x7fdc241f52f0 2023-07-09T02:21:00.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:00.761 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:21:00.762 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:21:00.762 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:21:00.762 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:21:00.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:21:00.762 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:21:00.762 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:21:00.763 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:21:00.763 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:21:00.763 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:21:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.762+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 msgr2=0x7fdc08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.762+0000 7fdc2c456640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdc20001560 tx=0x7fdc20007900 comp rx=0 tx=0).stop 2023-07-09T02:21:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.762+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc241f52f0 msgr2=0x7fdc240cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.762+0000 7fdc2c456640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc241f52f0 0x7fdc240cac10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c007360 tx=0x7fdc10005800 comp rx=0 tx=0).stop 2023-07-09T02:21:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.766+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 shutdown_connections 2023-07-09T02:21:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.766+0000 7fdc2c456640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc241f52f0 0x7fdc240cac10 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.766+0000 7fdc2c456640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdc08066280 0x7fdc08068730 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.766+0000 7fdc2c456640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc241f4e80 0x7fdc240ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.766+0000 7fdc2c456640 1 --2- 172.21.15.45:0/3748105579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc10004d10 0x7fdc241f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.766+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 >> 172.21.15.45:0/3748105579 conn(0x7fdc240698e0 msgr2=0x7fdc240d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.766+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 shutdown_connections 2023-07-09T02:21:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.766+0000 7fdc2c456640 1 -- 172.21.15.45:0/3748105579 wait complete. 2023-07-09T02:21:00.782 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:21:00.782 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:21:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.930+0000 7fd0a1856640 1 Processor -- start 2023-07-09T02:21:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.930+0000 7fd0a1856640 1 -- start start 2023-07-09T02:21:00.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.930+0000 7fd0a1856640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd09c15c480 0x7fd09c0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.930+0000 7fd0a1856640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd09c0b4490 0x7fd09c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.930+0000 7fd0a1856640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c0d19c0 con 0x7fd09c0cecd0 2023-07-09T02:21:00.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.930+0000 7fd0a1856640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c15c850 con 0x7fd09c15c480 2023-07-09T02:21:00.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.930+0000 7fd0a1856640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0b4e50 con 0x7fd09c0b4490 2023-07-09T02:21:00.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd09c15c480 0x7fd09c0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd09c15c480 0x7fd09c0cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56172/0 (socket says 172.21.15.45:56172) 2023-07-09T02:21:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09affd640 1 -- 172.21.15.45:0/3964792340 learned_addr learned my addr 172.21.15.45:0/3964792340 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09a7fc640 1 --1- 172.21.15.45:0/3964792340 >> v1:172.21.15.45:6789/0 conn(0x7fd09c0cecd0 0x7fd09c0d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58168/0 (socket says 172.21.15.45:58168) 2023-07-09T02:21:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09affd640 1 -- 172.21.15.45:0/3964792340 >> v2:172.21.15.155:3300/0 conn(0x7fd09c0b4490 msgr2=0x7fd09c0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09b7fe640 1 --2- 172.21.15.45:0/3964792340 >> v2:172.21.15.155:3300/0 conn(0x7fd09c0b4490 0x7fd09c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd099ffb640 1 -- 172.21.15.45:0/3964792340 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202457674 0 0) 0x7fd09c0d19c0 con 0x7fd09c0cecd0 2023-07-09T02:21:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09affd640 1 --2- 172.21.15.45:0/3964792340 >> v2:172.21.15.155:3300/0 conn(0x7fd09c0b4490 0x7fd09c0b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09affd640 1 -- 172.21.15.45:0/3964792340 >> v1:172.21.15.45:6789/0 conn(0x7fd09c0cecd0 legacy=0x7fd09c0d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09affd640 1 -- 172.21.15.45:0/3964792340 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0d1090 con 0x7fd09c15c480 2023-07-09T02:21:00.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09b7fe640 1 --2- 172.21.15.45:0/3964792340 >> v2:172.21.15.155:3300/0 conn(0x7fd09c0b4490 0x7fd09c0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:21:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd09affd640 1 --2- 172.21.15.45:0/3964792340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c15c480 0x7fd09c0cd060 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0b8b60 tx=0x7fd08c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce47e8846ced96f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd099ffb640 1 -- 172.21.15.45:0/3964792340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0ab610 con 0x7fd09c15c480 2023-07-09T02:21:00.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd099ffb640 1 -- 172.21.15.45:0/3964792340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c0ab770 con 0x7fd09c15c480 2023-07-09T02:21:00.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.934+0000 7fd099ffb640 1 -- 172.21.15.45:0/3964792340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0abb00 con 0x7fd09c15c480 2023-07-09T02:21:00.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- 172.21.15.45:0/3964792340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c15c480 msgr2=0x7fd09c0cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 --2- 172.21.15.45:0/3964792340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c15c480 0x7fd09c0cd060 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0b8b60 tx=0x7fd08c01c500 comp rx=0 tx=0).stop 2023-07-09T02:21:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- 172.21.15.45:0/3964792340 shutdown_connections 2023-07-09T02:21:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 --2- 172.21.15.45:0/3964792340 >> v2:172.21.15.155:3300/0 conn(0x7fd09c0b4490 0x7fd09c0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 --2- 172.21.15.45:0/3964792340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c15c480 0x7fd09c0cd060 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- 172.21.15.45:0/3964792340 >> 172.21.15.45:0/3964792340 conn(0x7fd09c0cf490 msgr2=0x7fd09c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- 172.21.15.45:0/3964792340 shutdown_connections 2023-07-09T02:21:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- 172.21.15.45:0/3964792340 wait complete. 2023-07-09T02:21:00.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 Processor -- start 2023-07-09T02:21:00.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- start start 2023-07-09T02:21:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd09c0b4490 0x7fd09c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c0cecd0 0x7fd09c0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd09c15c480 0x7fd09c152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c1537d0 con 0x7fd09c0cecd0 2023-07-09T02:21:00.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c1594a0 con 0x7fd09c15c480 2023-07-09T02:21:00.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd0a1856640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0cb8a0 con 0x7fd09c0b4490 2023-07-09T02:21:00.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd09a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c0cecd0 0x7fd09c0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd09a7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c0cecd0 0x7fd09c0cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56184/0 (socket says 172.21.15.45:56184) 2023-07-09T02:21:00.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd09a7fc640 1 -- 172.21.15.45:0/933802910 learned_addr learned my addr 172.21.15.45:0/933802910 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:00.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd09a7fc640 1 -- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd09c0b4490 msgr2=0x7fd09c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.938+0000 7fd09a7fc640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd09c0b4490 0x7fd09c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd09a7fc640 1 -- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd09c15c480 msgr2=0x7fd09c152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:00.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd09a7fc640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd09c15c480 0x7fd09c152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:00.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd09a7fc640 1 -- 172.21.15.45:0/933802910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0094d0 con 0x7fd09c0cecd0 2023-07-09T02:21:00.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd09a7fc640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c0cecd0 0x7fd09c0cb360 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fd09000c520 tx=0x7fd09000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd083fff640 1 -- 172.21.15.45:0/933802910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0900074e0 con 0x7fd09c0cecd0 2023-07-09T02:21:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd083fff640 1 -- 172.21.15.45:0/933802910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd090007640 con 0x7fd09c0cecd0 2023-07-09T02:21:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd083fff640 1 -- 172.21.15.45:0/933802910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0900049f0 con 0x7fd09c0cecd0 2023-07-09T02:21:00.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c152cb0 con 0x7fd09c0cecd0 2023-07-09T02:21:00.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c153210 con 0x7fd09c0cecd0 2023-07-09T02:21:00.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c159270 con 0x7fd09c0cecd0 2023-07-09T02:21:00.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd083fff640 1 -- 172.21.15.45:0/933802910 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd090004b50 con 0x7fd09c0cecd0 2023-07-09T02:21:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd083fff640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd088066280 0x7fd088068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd083fff640 1 -- 172.21.15.45:0/933802910 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd090082d40 con 0x7fd09c0cecd0 2023-07-09T02:21:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.942+0000 7fd09affd640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd088066280 0x7fd088068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.946+0000 7fd09affd640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd088066280 0x7fd088068730 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0af000 tx=0x7fd08c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:00.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:00.946+0000 7fd083fff640 1 -- 172.21.15.45:0/933802910 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd09c159270 con 0x7fd09c0cecd0 2023-07-09T02:21:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:01.106+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd09c159270 con 0x7fd09c0cecd0 2023-07-09T02:21:02.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.002+0000 7fd083fff640 1 -- 172.21.15.45:0/933802910 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v163) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd09c159270 con 0x7fd09c0cecd0 2023-07-09T02:21:02.003 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:21:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd088066280 msgr2=0x7fd088068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd088066280 0x7fd088068730 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0af000 tx=0x7fd08c008040 comp rx=0 tx=0).stop 2023-07-09T02:21:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c0cecd0 msgr2=0x7fd09c0cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c0cecd0 0x7fd09c0cb360 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fd09000c520 tx=0x7fd09000c9e0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 shutdown_connections 2023-07-09T02:21:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd09c15c480 0x7fd09c152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd09c0cecd0 0x7fd09c0cb360 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd088066280 0x7fd088068730 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 --2- 172.21.15.45:0/933802910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd09c0b4490 0x7fd09c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 >> 172.21.15.45:0/933802910 conn(0x7fd09c0cf490 msgr2=0x7fd09c158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:02.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 shutdown_connections 2023-07-09T02:21:02.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.010+0000 7fd0a1856640 1 -- 172.21.15.45:0/933802910 wait complete. 2023-07-09T02:21:02.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:21:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.186+0000 7f0bfa27b640 1 Processor -- start 2023-07-09T02:21:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.186+0000 7f0bfa27b640 1 -- start start 2023-07-09T02:21:02.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bfa27b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0bf415c410 0x7f0bf41608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:02.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bfa27b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40b59b0 0x7f0bf40b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bfa27b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf40ced10 con 0x7f0bf40d2340 2023-07-09T02:21:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bfa27b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf415c7e0 con 0x7f0bf415c410 2023-07-09T02:21:02.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bfa27b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40cd1b0 con 0x7f0bf40b59b0 2023-07-09T02:21:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bebfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40b59b0 0x7f0bf40b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bf3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0bf415c410 0x7f0bf41608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bf8818640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0bf40d2340 0x7f0bf40d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:48688/0 (socket says 172.21.15.45:48688) 2023-07-09T02:21:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bf8818640 1 -- 172.21.15.45:0/3901797089 learned_addr learned my addr 172.21.15.45:0/3901797089 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bebfff640 1 -- 172.21.15.45:0/3901797089 >> v2:172.21.15.155:3300/0 conn(0x7f0bf415c410 msgr2=0x7f0bf41608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bebfff640 1 --2- 172.21.15.45:0/3901797089 >> v2:172.21.15.155:3300/0 conn(0x7f0bf415c410 0x7f0bf41608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bebfff640 1 -- 172.21.15.45:0/3901797089 >> v1:172.21.15.155:6789/0 conn(0x7f0bf40d2340 legacy=0x7f0bf40d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bebfff640 1 -- 172.21.15.45:0/3901797089 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf4160de0 con 0x7f0bf40b59b0 2023-07-09T02:21:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bf37fe640 1 -- 172.21.15.45:0/3901797089 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107985234 0 0) 0x7f0bf40ced10 con 0x7f0bf40d2340 2023-07-09T02:21:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.190+0000 7f0bf3fff640 1 --2- 172.21.15.45:0/3901797089 >> v2:172.21.15.155:3300/0 conn(0x7f0bf415c410 0x7f0bf41608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:21:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bebfff640 1 --2- 172.21.15.45:0/3901797089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40b59b0 0x7f0bf40b45e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0097c0 tx=0x7f0bdc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fe3484925b0f485 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bf37fe640 1 -- 172.21.15.45:0/3901797089 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc0ab600 con 0x7f0bf40b59b0 2023-07-09T02:21:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bf37fe640 1 -- 172.21.15.45:0/3901797089 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc0a7050 con 0x7f0bf40b59b0 2023-07-09T02:21:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bf37fe640 1 -- 172.21.15.45:0/3901797089 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc0ab980 con 0x7f0bf40b59b0 2023-07-09T02:21:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- 172.21.15.45:0/3901797089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40b59b0 msgr2=0x7f0bf40b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/3901797089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40b59b0 0x7f0bf40b45e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0097c0 tx=0x7f0bdc01c450 comp rx=0 tx=0).stop 2023-07-09T02:21:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- 172.21.15.45:0/3901797089 shutdown_connections 2023-07-09T02:21:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/3901797089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40b59b0 0x7f0bf40b45e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/3901797089 >> v2:172.21.15.155:3300/0 conn(0x7f0bf415c410 0x7f0bf41608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- 172.21.15.45:0/3901797089 >> 172.21.15.45:0/3901797089 conn(0x7f0bf406a590 msgr2=0x7f0bf40cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- 172.21.15.45:0/3901797089 shutdown_connections 2023-07-09T02:21:02.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- 172.21.15.45:0/3901797089 wait complete. 2023-07-09T02:21:02.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 Processor -- start 2023-07-09T02:21:02.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- start start 2023-07-09T02:21:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bf40b59b0 0x7f0bf4151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40d2340 0x7f0bf40b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf415c410 0x7f0bf40b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415f070 con 0x7f0bf415c410 2023-07-09T02:21:02.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415e460 con 0x7f0bf40b59b0 2023-07-09T02:21:02.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.194+0000 7f0bfa27b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415e740 con 0x7f0bf40d2340 2023-07-09T02:21:02.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf415c410 0x7f0bf40b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:02.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf415c410 0x7f0bf40b7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60770/0 (socket says 172.21.15.45:60770) 2023-07-09T02:21:02.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bebfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40d2340 0x7f0bf40b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:02.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 -- 172.21.15.45:0/1127639283 learned_addr learned my addr 172.21.15.45:0/1127639283 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:02.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bf40b59b0 0x7f0bf4151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:02.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 -- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40d2340 msgr2=0x7f0bf40b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:02.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40d2340 0x7f0bf40b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 -- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bf40b59b0 msgr2=0x7f0bf4151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:02.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bf40b59b0 0x7f0bf4151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:02.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 -- 172.21.15.45:0/1127639283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009420 con 0x7f0bf415c410 2023-07-09T02:21:02.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf8818640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf415c410 0x7f0bf40b7620 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c700 tx=0x7f0bec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:02.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf17fa640 1 -- 172.21.15.45:0/1127639283 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00ce10 con 0x7f0bf415c410 2023-07-09T02:21:02.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf17fa640 1 -- 172.21.15.45:0/1127639283 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec00a640 con 0x7f0bf415c410 2023-07-09T02:21:02.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf17fa640 1 -- 172.21.15.45:0/1127639283 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec00aa70 con 0x7f0bf415c410 2023-07-09T02:21:02.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc009420 con 0x7f0bf415c410 2023-07-09T02:21:02.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf415ed00 con 0x7f0bf415c410 2023-07-09T02:21:02.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf404d7d0 con 0x7f0bf415c410 2023-07-09T02:21:02.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.198+0000 7f0bf17fa640 1 -- 172.21.15.45:0/1127639283 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0bec00abd0 con 0x7f0bf415c410 2023-07-09T02:21:02.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.202+0000 7f0bf17fa640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bd40662b0 0x7f0bd4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:02.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.202+0000 7f0bf17fa640 1 -- 172.21.15.45:0/1127639283 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f0bec083230 con 0x7f0bf415c410 2023-07-09T02:21:02.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.202+0000 7f0bf3fff640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bd40662b0 0x7f0bd4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:02.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.202+0000 7f0bf3fff640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bd40662b0 0x7f0bd4068760 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009c30 tx=0x7f0be4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:02.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.206+0000 7f0bf17fa640 1 -- 172.21.15.45:0/1127639283 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0bec050920 con 0x7f0bf415c410 2023-07-09T02:21:02.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:02.362+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0bf40cfea0 con 0x7f0bf415c410 2023-07-09T02:21:03.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.014+0000 7f0bf17fa640 1 -- 172.21.15.45:0/1127639283 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v164) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0bec053f40 con 0x7f0bf415c410 2023-07-09T02:21:03.016 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:21:03.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bd40662b0 msgr2=0x7f0bd4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:03.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bd40662b0 0x7f0bd4068760 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009c30 tx=0x7f0be4009190 comp rx=0 tx=0).stop 2023-07-09T02:21:03.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf415c410 msgr2=0x7f0bf40b7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:03.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf415c410 0x7f0bf40b7620 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c700 tx=0x7f0bec00cbc0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 shutdown_connections 2023-07-09T02:21:03.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bf415c410 0x7f0bf40b7620 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0bd40662b0 0x7f0bd4068760 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bf40d2340 0x7f0bf40b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 --2- 172.21.15.45:0/1127639283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bf40b59b0 0x7f0bf4151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.022+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 >> 172.21.15.45:0/1127639283 conn(0x7f0bf406a590 msgr2=0x7f0bf40d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:03.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.026+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 shutdown_connections 2023-07-09T02:21:03.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.026+0000 7f0bfa27b640 1 -- 172.21.15.45:0/1127639283 wait complete. 2023-07-09T02:21:03.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:21:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.190+0000 7f26f3e19640 1 Processor -- start 2023-07-09T02:21:03.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.190+0000 7f26f3e19640 1 -- start start 2023-07-09T02:21:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f3e19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26ec15c060 0x7f26ec0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f3e19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26ec0d2620 0x7f26ec0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f3e19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ec160a50 con 0x7f26ec0cd120 2023-07-09T02:21:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f3e19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec15c430 con 0x7f26ec15c060 2023-07-09T02:21:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f3e19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec15fb60 con 0x7f26ec0d2620 2023-07-09T02:21:03.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f1bb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26ec15c060 0x7f26ec0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f1bb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26ec15c060 0x7f26ec0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60786/0 (socket says 172.21.15.45:60786) 2023-07-09T02:21:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f1bb5640 1 -- 172.21.15.45:0/500633418 learned_addr learned my addr 172.21.15.45:0/500633418 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f23b6640 1 --2- 172.21.15.45:0/500633418 >> v2:172.21.15.155:3300/0 conn(0x7f26ec0d2620 0x7f26ec0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:03.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f1bb5640 1 -- 172.21.15.45:0/500633418 >> v2:172.21.15.155:3300/0 conn(0x7f26ec0d2620 msgr2=0x7f26ec0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:03.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f1bb5640 1 --2- 172.21.15.45:0/500633418 >> v2:172.21.15.155:3300/0 conn(0x7f26ec0d2620 0x7f26ec0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f1bb5640 1 -- 172.21.15.45:0/500633418 >> v1:172.21.15.45:6789/0 conn(0x7f26ec0cd120 legacy=0x7f26ec0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:03.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.194+0000 7f26f1bb5640 1 -- 172.21.15.45:0/500633418 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec15fe40 con 0x7f26ec15c060 2023-07-09T02:21:03.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f1bb5640 1 --2- 172.21.15.45:0/500633418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec15c060 0x7f26ec0b4ed0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f26ec08bca0 tx=0x7f26e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbaaac2f35aea54 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:03.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f0bb3640 1 -- 172.21.15.45:0/500633418 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e80aa430 con 0x7f26ec15c060 2023-07-09T02:21:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f0bb3640 1 -- 172.21.15.45:0/500633418 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e80aa590 con 0x7f26ec15c060 2023-07-09T02:21:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f0bb3640 1 -- 172.21.15.45:0/500633418 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e80aa920 con 0x7f26ec15c060 2023-07-09T02:21:03.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 -- 172.21.15.45:0/500633418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec15c060 msgr2=0x7f26ec0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 --2- 172.21.15.45:0/500633418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec15c060 0x7f26ec0b4ed0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f26ec08bca0 tx=0x7f26e801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 -- 172.21.15.45:0/500633418 shutdown_connections 2023-07-09T02:21:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 --2- 172.21.15.45:0/500633418 >> v2:172.21.15.155:3300/0 conn(0x7f26ec0d2620 0x7f26ec0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 --2- 172.21.15.45:0/500633418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec15c060 0x7f26ec0b4ed0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 -- 172.21.15.45:0/500633418 >> 172.21.15.45:0/500633418 conn(0x7f26ec0698e0 msgr2=0x7f26ec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 -- 172.21.15.45:0/500633418 shutdown_connections 2023-07-09T02:21:03.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 -- 172.21.15.45:0/500633418 wait complete. 2023-07-09T02:21:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 Processor -- start 2023-07-09T02:21:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.198+0000 7f26f3e19640 1 -- start start 2023-07-09T02:21:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ec0cd120 0x7f26ec15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec0d2620 0x7f26ec15ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ec15c060 0x7f26ec1572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec1617a0 con 0x7f26ec0d2620 2023-07-09T02:21:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec15d560 con 0x7f26ec15c060 2023-07-09T02:21:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec15d840 con 0x7f26ec0cd120 2023-07-09T02:21:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec0d2620 0x7f26ec15ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec0d2620 0x7f26ec15ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60788/0 (socket says 172.21.15.45:60788) 2023-07-09T02:21:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 -- 172.21.15.45:0/711813826 learned_addr learned my addr 172.21.15.45:0/711813826 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f23b6640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ec15c060 0x7f26ec1572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f1bb5640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ec0cd120 0x7f26ec15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 -- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ec0cd120 msgr2=0x7f26ec15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ec0cd120 0x7f26ec15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 -- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ec15c060 msgr2=0x7f26ec1572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ec15c060 0x7f26ec1572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 -- 172.21.15.45:0/711813826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e80094d0 con 0x7f26ec0d2620 2023-07-09T02:21:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f23b6640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ec15c060 0x7f26ec1572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f13b4640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec0d2620 0x7f26ec15ef80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00c4d0 tx=0x7f26dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26e27fc640 1 -- 172.21.15.45:0/711813826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0052d0 con 0x7f26ec0d2620 2023-07-09T02:21:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26e27fc640 1 -- 172.21.15.45:0/711813826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc005430 con 0x7f26ec0d2620 2023-07-09T02:21:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec0b59f0 con 0x7f26ec0d2620 2023-07-09T02:21:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26e27fc640 1 -- 172.21.15.45:0/711813826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc012830 con 0x7f26ec0d2620 2023-07-09T02:21:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec15de00 con 0x7f26ec0d2620 2023-07-09T02:21:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec161600 con 0x7f26ec0d2620 2023-07-09T02:21:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.202+0000 7f26e27fc640 1 -- 172.21.15.45:0/711813826 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26dc012990 con 0x7f26ec0d2620 2023-07-09T02:21:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.206+0000 7f26e27fc640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26d0066280 0x7f26d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.206+0000 7f26e27fc640 1 -- 172.21.15.45:0/711813826 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f26dc083930 con 0x7f26ec0d2620 2023-07-09T02:21:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.206+0000 7f26f1bb5640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26d0066280 0x7f26d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.206+0000 7f26f1bb5640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26d0066280 0x7f26d0068730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f26e80ae000 tx=0x7f26e80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:03.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.210+0000 7f26e27fc640 1 -- 172.21.15.45:0/711813826 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26ec161600 con 0x7f26ec0d2620 2023-07-09T02:21:03.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:03.394+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f26ec161600 con 0x7f26ec0d2620 2023-07-09T02:21:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.018+0000 7f26e27fc640 1 -- 172.21.15.45:0/711813826 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v80) v1 ==== 174+0+0 (secure 0 0 0) 0x7f26ec161600 con 0x7f26ec0d2620 2023-07-09T02:21:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 21 and data pool 22 2023-07-09T02:21:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26d0066280 msgr2=0x7f26d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26d0066280 0x7f26d0068730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f26e80ae000 tx=0x7f26e80a7000 comp rx=0 tx=0).stop 2023-07-09T02:21:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec0d2620 msgr2=0x7f26ec15ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec0d2620 0x7f26ec15ef80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00c4d0 tx=0x7f26dc00c990 comp rx=0 tx=0).stop 2023-07-09T02:21:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 shutdown_connections 2023-07-09T02:21:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26ec15c060 0x7f26ec1572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26ec0d2620 0x7f26ec15ef80 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f26d0066280 0x7f26d0068730 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 --2- 172.21.15.45:0/711813826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26ec0cd120 0x7f26ec15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 >> 172.21.15.45:0/711813826 conn(0x7f26ec0698e0 msgr2=0x7f26ec069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 shutdown_connections 2023-07-09T02:21:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.026+0000 7f26f3e19640 1 -- 172.21.15.45:0/711813826 wait complete. 2023-07-09T02:21:04.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:21:04.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ae3fa640 1 Processor -- start 2023-07-09T02:21:04.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ae3fa640 1 -- start start 2023-07-09T02:21:04.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ae3fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 0x7f60a80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ae3fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f60a80cd120 0x7f60a80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ae3fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a8160a50 con 0x7f60a815c060 2023-07-09T02:21:04.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ae3fa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a815c430 con 0x7f60a80cd120 2023-07-09T02:21:04.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ae3fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a815fb60 con 0x7f60a80d2620 2023-07-09T02:21:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f60a815c060 0x7f60a80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44292/0 (socket says 172.21.15.45:44292) 2023-07-09T02:21:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a7fff640 1 -- 172.21.15.45:0/1117182915 learned_addr learned my addr 172.21.15.45:0/1117182915 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a77fe640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 0x7f60a80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ac997640 1 --2- 172.21.15.45:0/1117182915 >> v2:172.21.15.155:3300/0 conn(0x7f60a80cd120 0x7f60a80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292818078 0 0) 0x7f60a8160a50 con 0x7f60a815c060 2023-07-09T02:21:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6090003530 con 0x7f60a815c060 2023-07-09T02:21:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464132838 0 0) 0x7f6090003530 con 0x7f60a815c060 2023-07-09T02:21:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 msgr2=0x7f60a80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 0x7f60a80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 >> v2:172.21.15.155:3300/0 conn(0x7f60a80cd120 msgr2=0x7f60a80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:04.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 --2- 172.21.15.45:0/1117182915 >> v2:172.21.15.155:3300/0 conn(0x7f60a80cd120 0x7f60a80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a815fe40 con 0x7f60a815c060 2023-07-09T02:21:04.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f6098001680 con 0x7f60a815c060 2023-07-09T02:21:04.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ac997640 1 --2- 172.21.15.45:0/1117182915 >> v2:172.21.15.155:3300/0 conn(0x7f60a80cd120 0x7f60a80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:21:04.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a77fe640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 0x7f60a80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:21:04.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 >> v1:172.21.15.45:6789/0 conn(0x7f60a815c060 legacy=0x7f60a80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f6090003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60900043b0 0x7f6090004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 0x7f6090004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a815c430 con 0x7f6090003980 2023-07-09T02:21:04.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a815fb60 con 0x7f60900043b0 2023-07-09T02:21:04.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609000b990 con 0x7f60a80d2620 2023-07-09T02:21:04.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a7fff640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f6090003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60a77fe640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60900043b0 0x7f6090004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.202+0000 7f60ac997640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 0x7f6090004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a7fff640 1 -- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 msgr2=0x7f6090004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a7fff640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 0x7f6090004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a7fff640 1 -- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60900043b0 msgr2=0x7f6090004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a7fff640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60900043b0 0x7f6090004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a7fff640 1 -- 172.21.15.45:0/1117182915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c009420 con 0x7f6090003980 2023-07-09T02:21:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60ac997640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a80d2620 0x7f6090004f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:21:04.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a77fe640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60900043b0 0x7f6090004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:21:04.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a7fff640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f6090003d90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f609800c240 tx=0x7f609801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f1cb1f7cd88e0a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980a5930 con 0x7f6090003980 2023-07-09T02:21:04.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60980a5a90 con 0x7f6090003980 2023-07-09T02:21:04.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60a6ffd640 1 -- 172.21.15.45:0/1117182915 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980a5e60 con 0x7f6090003980 2023-07-09T02:21:04.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1117182915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 msgr2=0x7f6090003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60ae3fa640 1 --2- 172.21.15.45:0/1117182915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f6090003d90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f609800c240 tx=0x7f609801cc30 comp rx=0 tx=0).stop 2023-07-09T02:21:04.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.206+0000 7f60ac997640 1 -- 172.21.15.45:0/1117182915 reap_dead start 2023-07-09T02:21:04.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1117182915 shutdown_connections 2023-07-09T02:21:04.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1117182915 >> 172.21.15.45:0/1117182915 conn(0x7f60a80698e0 msgr2=0x7f60a8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:04.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1117182915 shutdown_connections 2023-07-09T02:21:04.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1117182915 wait complete. 2023-07-09T02:21:04.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 Processor -- start 2023-07-09T02:21:04.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 -- start start 2023-07-09T02:21:04.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f60a80c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60a815dbb0 0x7f60a8157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a814ea90 0x7f60a814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a81fd070 con 0x7f6090003980 2023-07-09T02:21:04.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a815e020 con 0x7f60a815dbb0 2023-07-09T02:21:04.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ae3fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a814f440 con 0x7f60a814ea90 2023-07-09T02:21:04.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f60a80c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f60a80c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60792/0 (socket says 172.21.15.45:60792) 2023-07-09T02:21:04.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 -- 172.21.15.45:0/1993188626 learned_addr learned my addr 172.21.15.45:0/1993188626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ac997640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a814ea90 0x7f60a814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 -- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a814ea90 msgr2=0x7f60a814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a77fe640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60a815dbb0 0x7f60a8157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a814ea90 0x7f60a814ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 -- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60a815dbb0 msgr2=0x7f60a8157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60a815dbb0 0x7f60a8157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 -- 172.21.15.45:0/1993188626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a815cef0 con 0x7f6090003980 2023-07-09T02:21:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60ac997640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a814ea90 0x7f60a814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:21:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a77fe640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60a815dbb0 0x7f60a8157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:21:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.210+0000 7f60a7fff640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f60a80c8aa0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f609800c240 tx=0x7f6090005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60a4ff9640 1 -- 172.21.15.45:0/1993188626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098004ab0 con 0x7f6090003980 2023-07-09T02:21:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60a4ff9640 1 -- 172.21.15.45:0/1993188626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60980b3070 con 0x7f6090003980 2023-07-09T02:21:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60a4ff9640 1 -- 172.21.15.45:0/1993188626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098004e10 con 0x7f6090003980 2023-07-09T02:21:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a81fc3f0 con 0x7f6090003980 2023-07-09T02:21:04.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a81fc9b0 con 0x7f6090003980 2023-07-09T02:21:04.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a804d7d0 con 0x7f6090003980 2023-07-09T02:21:04.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60a4ff9640 1 -- 172.21.15.45:0/1993188626 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6098007070 con 0x7f6090003980 2023-07-09T02:21:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60a4ff9640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f60940662b0 0x7f6094068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60a4ff9640 1 -- 172.21.15.45:0/1993188626 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60980b5070 con 0x7f6090003980 2023-07-09T02:21:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60a77fe640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f60940662b0 0x7f6094068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.214+0000 7f60a77fe640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f60940662b0 0x7f6094068760 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f60a80b87d0 tx=0x7f609c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.218+0000 7f60a4ff9640 1 -- 172.21.15.45:0/1993188626 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60980eb590 con 0x7f6090003980 2023-07-09T02:21:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.374+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60a80cf150 con 0x7f6090003980 2023-07-09T02:21:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.374+0000 7f60a4ff9640 1 -- 172.21.15.45:0/1993188626 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+18316 (secure 0 0 0) 0x7f60980bf090 con 0x7f6090003980 2023-07-09T02:21:04.374 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:04.374 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":165,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:21:03.398143+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:21:01.154000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T02:21:02.407446+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:21:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f60940662b0 msgr2=0x7f6094068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f60940662b0 0x7f6094068760 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f60a80b87d0 tx=0x7f609c008040 comp rx=0 tx=0).stop 2023-07-09T02:21:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 msgr2=0x7f60a80c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f60a80c8aa0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f609800c240 tx=0x7f6090005800 comp rx=0 tx=0).stop 2023-07-09T02:21:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 shutdown_connections 2023-07-09T02:21:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f60940662b0 0x7f6094068760 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60a814ea90 0x7f60a814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60a815dbb0 0x7f60a8157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 --2- 172.21.15.45:0/1993188626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6090003980 0x7f60a80c8aa0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 >> 172.21.15.45:0/1993188626 conn(0x7f60a80698e0 msgr2=0x7f60a80b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 shutdown_connections 2023-07-09T02:21:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.378+0000 7f60ae3fa640 1 -- 172.21.15.45:0/1993188626 wait complete. 2023-07-09T02:21:04.396 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:21:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ef419640 1 Processor -- start 2023-07-09T02:21:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ef419640 1 -- start start 2023-07-09T02:21:04.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ef419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e815c060 0x7f97e80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ef419640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f97e80cd120 0x7f97e80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ef419640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e8160a50 con 0x7f97e80d2450 2023-07-09T02:21:04.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ef419640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e80d28f0 con 0x7f97e80cd120 2023-07-09T02:21:04.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ef419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cfe40 con 0x7f97e815c060 2023-07-09T02:21:04.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ed9b6640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f97e80d2450 0x7f97e80d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44308/0 (socket says 172.21.15.45:44308) 2023-07-09T02:21:04.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ed9b6640 1 -- 172.21.15.45:0/1183437492 learned_addr learned my addr 172.21.15.45:0/1183437492 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:04.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ed1b5640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e815c060 0x7f97e80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ec9b4640 1 --2- 172.21.15.45:0/1183437492 >> v2:172.21.15.155:3300/0 conn(0x7f97e80cd120 0x7f97e80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707127896 0 0) 0x7f97e8160a50 con 0x7f97e80d2450 2023-07-09T02:21:04.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d4003530 con 0x7f97e80d2450 2023-07-09T02:21:04.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129211986 0 0) 0x7f97d4003530 con 0x7f97e80d2450 2023-07-09T02:21:04.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e815c060 msgr2=0x7f97e80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e815c060 0x7f97e80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 >> v2:172.21.15.155:3300/0 conn(0x7f97e80cd120 msgr2=0x7f97e80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 --2- 172.21.15.45:0/1183437492 >> v2:172.21.15.155:3300/0 conn(0x7f97e80cd120 0x7f97e80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e815c430 con 0x7f97e80d2450 2023-07-09T02:21:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f97e0001a00 con 0x7f97e80d2450 2023-07-09T02:21:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 >> v1:172.21.15.45:6789/0 conn(0x7f97e80d2450 legacy=0x7f97e80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d4003980 0x7f97d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d40043b0 0x7f97d4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4004e90 0x7f97d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cfe40 con 0x7f97d4003980 2023-07-09T02:21:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40056a0 con 0x7f97d4004e90 2023-07-09T02:21:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d400bf50 con 0x7f97d40043b0 2023-07-09T02:21:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.546+0000 7f97ed1b5640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d4003980 0x7f97d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ed9b6640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4004e90 0x7f97d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ec9b4640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d40043b0 0x7f97d4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ed1b5640 1 -- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d40043b0 msgr2=0x7f97d4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ed1b5640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97d40043b0 0x7f97d4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ed1b5640 1 -- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4004e90 msgr2=0x7f97d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ed1b5640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4004e90 0x7f97d400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ed1b5640 1 -- 172.21.15.45:0/1183437492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4003530 con 0x7f97d4003980 2023-07-09T02:21:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ed1b5640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d4003980 0x7f97d4003d90 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d3a50 tx=0x7f97e401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cb6e103e23a9f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40ab400 con 0x7f97d4003980 2023-07-09T02:21:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e40a7050 con 0x7f97d4003980 2023-07-09T02:21:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97dffff640 1 -- 172.21.15.45:0/1183437492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40ab760 con 0x7f97d4003980 2023-07-09T02:21:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ef419640 1 -- 172.21.15.45:0/1183437492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d4003980 msgr2=0x7f97d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ef419640 1 --2- 172.21.15.45:0/1183437492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d4003980 0x7f97d4003d90 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d3a50 tx=0x7f97e401c900 comp rx=0 tx=0).stop 2023-07-09T02:21:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ed9b6640 1 -- 172.21.15.45:0/1183437492 reap_dead start 2023-07-09T02:21:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ef419640 1 -- 172.21.15.45:0/1183437492 shutdown_connections 2023-07-09T02:21:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.550+0000 7f97ef419640 1 -- 172.21.15.45:0/1183437492 >> 172.21.15.45:0/1183437492 conn(0x7f97e80698e0 msgr2=0x7f97e8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 -- 172.21.15.45:0/1183437492 shutdown_connections 2023-07-09T02:21:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 -- 172.21.15.45:0/1183437492 wait complete. 2023-07-09T02:21:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 Processor -- start 2023-07-09T02:21:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 -- start start 2023-07-09T02:21:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4003980 0x7f97e814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e80b3260 0x7f97e814be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e815ead0 0x7f97e815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e815f480 con 0x7f97e815ead0 2023-07-09T02:21:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cbd80 con 0x7f97d4003980 2023-07-09T02:21:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ef419640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e814c3a0 con 0x7f97e80b3260 2023-07-09T02:21:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e815ead0 0x7f97e815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e815ead0 0x7f97e815ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60808/0 (socket says 172.21.15.45:60808) 2023-07-09T02:21:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 -- 172.21.15.45:0/1422311595 learned_addr learned my addr 172.21.15.45:0/1422311595 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed1b5640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4003980 0x7f97e814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ec9b4640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e80b3260 0x7f97e814be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 -- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e80b3260 msgr2=0x7f97e814be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e80b3260 0x7f97e814be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 -- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4003980 msgr2=0x7f97e814c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4003980 0x7f97e814c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 -- 172.21.15.45:0/1422311595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80b36d0 con 0x7f97e815ead0 2023-07-09T02:21:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.554+0000 7f97ed9b6640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e815ead0 0x7f97e815ef40 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d3a80 tx=0x7f97e0007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ddffb640 1 -- 172.21.15.45:0/1422311595 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0007b10 con 0x7f97e815ead0 2023-07-09T02:21:04.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ddffb640 1 -- 172.21.15.45:0/1422311595 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e000a570 con 0x7f97e815ead0 2023-07-09T02:21:04.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e80cb170 con 0x7f97e815ead0 2023-07-09T02:21:04.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ddffb640 1 -- 172.21.15.45:0/1422311595 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000a920 con 0x7f97e815ead0 2023-07-09T02:21:04.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e80cb730 con 0x7f97e815ead0 2023-07-09T02:21:04.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e804d7d0 con 0x7f97e815ead0 2023-07-09T02:21:04.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ddffb640 1 -- 172.21.15.45:0/1422311595 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97e000aa80 con 0x7f97e815ead0 2023-07-09T02:21:04.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ddffb640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97cc066280 0x7f97cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ddffb640 1 -- 172.21.15.45:0/1422311595 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97e0083c60 con 0x7f97e815ead0 2023-07-09T02:21:04.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.558+0000 7f97ed1b5640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97cc066280 0x7f97cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.562+0000 7f97ed1b5640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97cc066280 0x7f97cc068730 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f97e40ad000 tx=0x7f97e40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.562+0000 7f97ddffb640 1 -- 172.21.15.45:0/1422311595 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97e00510f0 con 0x7f97e815ead0 2023-07-09T02:21:04.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.718+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97e806baa0 con 0x7f97e815ead0 2023-07-09T02:21:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.718+0000 7f97ddffb640 1 -- 172.21.15.45:0/1422311595 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+18316 (secure 0 0 0) 0x7f97e0054710 con 0x7f97e815ead0 2023-07-09T02:21:04.718 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:04.718 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":165,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:21:03.398143+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:21:01.154000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T02:21:02.407446+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:21:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97cc066280 msgr2=0x7f97cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97cc066280 0x7f97cc068730 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f97e40ad000 tx=0x7f97e40046d0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e815ead0 msgr2=0x7f97e815ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e815ead0 0x7f97e815ef40 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d3a80 tx=0x7f97e0007730 comp rx=0 tx=0).stop 2023-07-09T02:21:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 shutdown_connections 2023-07-09T02:21:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e815ead0 0x7f97e815ef40 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f97cc066280 0x7f97cc068730 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97e80b3260 0x7f97e814be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 --2- 172.21.15.45:0/1422311595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d4003980 0x7f97e814c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 >> 172.21.15.45:0/1422311595 conn(0x7f97e80698e0 msgr2=0x7f97e80b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 shutdown_connections 2023-07-09T02:21:04.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.722+0000 7f97ef419640 1 -- 172.21.15.45:0/1422311595 wait complete. 2023-07-09T02:21:04.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:21:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.886+0000 7fa499e18640 1 Processor -- start 2023-07-09T02:21:04.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.886+0000 7fa499e18640 1 -- start start 2023-07-09T02:21:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa499e18640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa494142500 0x7fa4940cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa499e18640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4940cf320 con 0x7fa494069bc0 2023-07-09T02:21:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa499e18640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49415d590 con 0x7fa494160630 2023-07-09T02:21:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa499e18640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4940cd6d0 con 0x7fa494142500 2023-07-09T02:21:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa4937fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa494142500 0x7fa4940cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa4937fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa494142500 0x7fa4940cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60810/0 (socket says 172.21.15.45:60810) 2023-07-09T02:21:04.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa4937fe640 1 -- 172.21.15.45:0/1901268987 learned_addr learned my addr 172.21.15.45:0/1901268987 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:04.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa4937fe640 1 -- 172.21.15.45:0/1901268987 >> v1:172.21.15.155:6789/0 conn(0x7fa494160630 legacy=0x7fa4940694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa4937fe640 1 -- 172.21.15.45:0/1901268987 >> v1:172.21.15.45:6789/0 conn(0x7fa494069bc0 legacy=0x7fa4940cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa4937fe640 1 -- 172.21.15.45:0/1901268987 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49415c7d0 con 0x7fa494142500 2023-07-09T02:21:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa4927fc640 1 -- 172.21.15.45:0/1901268987 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127687269 0 0) 0x7fa4940cf320 con 0x7fa494069bc0 2023-07-09T02:21:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.890+0000 7fa4937fe640 1 --2- 172.21.15.45:0/1901268987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494142500 0x7fa4940cecf0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fa484009870 tx=0x7fa48401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8f3c2481306de server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa4927fc640 1 -- 172.21.15.45:0/1901268987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840aa670 con 0x7fa494142500 2023-07-09T02:21:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa4927fc640 1 -- 172.21.15.45:0/1901268987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840aa7d0 con 0x7fa494142500 2023-07-09T02:21:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa4927fc640 1 -- 172.21.15.45:0/1901268987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840aab60 con 0x7fa494142500 2023-07-09T02:21:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- 172.21.15.45:0/1901268987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494142500 msgr2=0x7fa4940cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 --2- 172.21.15.45:0/1901268987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494142500 0x7fa4940cecf0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fa484009870 tx=0x7fa48401c510 comp rx=0 tx=0).stop 2023-07-09T02:21:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- 172.21.15.45:0/1901268987 shutdown_connections 2023-07-09T02:21:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 --2- 172.21.15.45:0/1901268987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494142500 0x7fa4940cecf0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- 172.21.15.45:0/1901268987 >> 172.21.15.45:0/1901268987 conn(0x7fa4940650b0 msgr2=0x7fa4940654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- 172.21.15.45:0/1901268987 shutdown_connections 2023-07-09T02:21:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- 172.21.15.45:0/1901268987 wait complete. 2023-07-09T02:21:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 Processor -- start 2023-07-09T02:21:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- start start 2023-07-09T02:21:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494069bc0 0x7fa49413f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa494142500 0x7fa4940b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa494160630 0x7fa49415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940b51d0 con 0x7fa494069bc0 2023-07-09T02:21:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49413f810 con 0x7fa494142500 2023-07-09T02:21:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa499e18640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940b45c0 con 0x7fa494160630 2023-07-09T02:21:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa4937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494069bc0 0x7fa49413f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa4937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494069bc0 0x7fa49413f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60826/0 (socket says 172.21.15.45:60826) 2023-07-09T02:21:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.894+0000 7fa4937fe640 1 -- 172.21.15.45:0/455958422 learned_addr learned my addr 172.21.15.45:0/455958422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa493fff640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa494160630 0x7fa49415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa492ffd640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa494142500 0x7fa4940b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa4937fe640 1 -- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa494160630 msgr2=0x7fa49415ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa4937fe640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa494160630 0x7fa49415ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa4937fe640 1 -- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa494142500 msgr2=0x7fa4940b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa4937fe640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa494142500 0x7fa4940b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa4937fe640 1 -- 172.21.15.45:0/455958422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840094d0 con 0x7fa494069bc0 2023-07-09T02:21:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa492ffd640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa494142500 0x7fa4940b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:21:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa4937fe640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494069bc0 0x7fa49413f2d0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ac040 tx=0x7fa48401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa47bfff640 1 -- 172.21.15.45:0/455958422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840aae90 con 0x7fa494069bc0 2023-07-09T02:21:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa47bfff640 1 -- 172.21.15.45:0/455958422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840b7070 con 0x7fa494069bc0 2023-07-09T02:21:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa47bfff640 1 -- 172.21.15.45:0/455958422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484004220 con 0x7fa494069bc0 2023-07-09T02:21:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4940b48a0 con 0x7fa494069bc0 2023-07-09T02:21:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4940b4e60 con 0x7fa494069bc0 2023-07-09T02:21:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49404d7d0 con 0x7fa494069bc0 2023-07-09T02:21:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.898+0000 7fa47bfff640 1 -- 172.21.15.45:0/455958422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa484004380 con 0x7fa494069bc0 2023-07-09T02:21:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.902+0000 7fa47bfff640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa480066280 0x7fa480068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.902+0000 7fa47bfff640 1 -- 172.21.15.45:0/455958422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa48411e470 con 0x7fa494069bc0 2023-07-09T02:21:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.902+0000 7fa492ffd640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa480066280 0x7fa480068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.902+0000 7fa492ffd640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa480066280 0x7fa480068730 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa49415f660 tx=0x7fa488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:04.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:04.906+0000 7fa47bfff640 1 -- 172.21.15.45:0/455958422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4840eb860 con 0x7fa494069bc0 2023-07-09T02:21:04.988 INFO:tasks.ceph.mds.d.smithi155.stderr:2023-07-09T02:21:04.988+0000 7f095ebd8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:21:05.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:05.094+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa4940c4800 con 0x7fa494069bc0 2023-07-09T02:21:06.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa47bfff640 1 -- 172.21.15.45:0/455958422 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa4840eee80 con 0x7fa494069bc0 2023-07-09T02:21:06.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa480066280 msgr2=0x7fa480068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:06.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa480066280 0x7fa480068730 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa49415f660 tx=0x7fa488009040 comp rx=0 tx=0).stop 2023-07-09T02:21:06.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494069bc0 msgr2=0x7fa49413f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:06.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494069bc0 0x7fa49413f2d0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ac040 tx=0x7fa48401ad50 comp rx=0 tx=0).stop 2023-07-09T02:21:06.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 shutdown_connections 2023-07-09T02:21:06.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa480066280 0x7fa480068730 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa494160630 0x7fa49415ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa494142500 0x7fa4940b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 --2- 172.21.15.45:0/455958422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494069bc0 0x7fa49413f2d0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 >> 172.21.15.45:0/455958422 conn(0x7fa4940650b0 msgr2=0x7fa4940b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:06.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 shutdown_connections 2023-07-09T02:21:06.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.042+0000 7fa499e18640 1 -- 172.21.15.45:0/455958422 wait complete. 2023-07-09T02:21:06.068 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:21:06.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:21:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.218+0000 7ff839c5c640 1 Processor -- start 2023-07-09T02:21:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.218+0000 7ff839c5c640 1 -- start start 2023-07-09T02:21:06.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff839c5c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8340cd120 0x7ff8340b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff839c5c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff834160a50 con 0x7ff83415c060 2023-07-09T02:21:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff839c5c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83415c430 con 0x7ff8340d2620 2023-07-09T02:21:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff839c5c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83415fb60 con 0x7ff8340cd120 2023-07-09T02:21:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8337fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff83415c060 0x7ff8340d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44326/0 (socket says 172.21.15.45:44326) 2023-07-09T02:21:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8337fe640 1 -- 172.21.15.45:0/3006741041 learned_addr learned my addr 172.21.15.45:0/3006741041 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:06.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff833fff640 1 --2- 172.21.15.45:0/3006741041 >> v2:172.21.15.155:3300/0 conn(0x7ff8340cd120 0x7ff8340b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293429909 0 0) 0x7ff834160a50 con 0x7ff83415c060 2023-07-09T02:21:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff81c003530 con 0x7ff83415c060 2023-07-09T02:21:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3530721671 0 0) 0x7ff81c003530 con 0x7ff83415c060 2023-07-09T02:21:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 >> v2:172.21.15.155:3300/0 conn(0x7ff8340cd120 msgr2=0x7ff8340b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 --2- 172.21.15.45:0/3006741041 >> v2:172.21.15.155:3300/0 conn(0x7ff8340cd120 0x7ff8340b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 >> v1:172.21.15.155:6789/0 conn(0x7ff8340d2620 legacy=0x7ff8340cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83415fe40 con 0x7ff83415c060 2023-07-09T02:21:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7ff824001680 con 0x7ff83415c060 2023-07-09T02:21:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 >> v1:172.21.15.45:6789/0 conn(0x7ff83415c060 legacy=0x7ff8340d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c003980 0x7ff81c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c004370 0x7ff81c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff81c005030 0x7ff81c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83415fb60 con 0x7ff81c005030 2023-07-09T02:21:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c00bf80 con 0x7ff81c004370 2023-07-09T02:21:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81c00c140 con 0x7ff81c003980 2023-07-09T02:21:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff833fff640 1 --2- 172.21.15.45:0/3006741041 >> v2:172.21.15.155:3300/0 conn(0x7ff8340cd120 0x7ff8340b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:21:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff833fff640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff81c005030 0x7ff81c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff832ffd640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c004370 0x7ff81c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff8337fe640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c003980 0x7ff81c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff833fff640 1 -- 172.21.15.45:0/3006741041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c003980 msgr2=0x7ff81c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff833fff640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c003980 0x7ff81c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff833fff640 1 -- 172.21.15.45:0/3006741041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c004370 msgr2=0x7ff81c004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff833fff640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff81c004370 0x7ff81c004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.222+0000 7ff833fff640 1 -- 172.21.15.45:0/3006741041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81c003530 con 0x7ff81c005030 2023-07-09T02:21:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff833fff640 1 -- 172.21.15.45:0/3006741041 reap_dead start 2023-07-09T02:21:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff833fff640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff81c005030 0x7ff81c00b990 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00e350 tx=0x7ff82c01ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef8f64ffa05ea63 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0a5d40 con 0x7ff81c005030 2023-07-09T02:21:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00f040 con 0x7ff81c005030 2023-07-09T02:21:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff8327fc640 1 -- 172.21.15.45:0/3006741041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c003be0 con 0x7ff81c005030 2023-07-09T02:21:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff839c5c640 1 -- 172.21.15.45:0/3006741041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff81c005030 msgr2=0x7ff81c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff839c5c640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff81c005030 0x7ff81c00b990 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00e350 tx=0x7ff82c01ce40 comp rx=0 tx=0).stop 2023-07-09T02:21:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff839c5c640 1 -- 172.21.15.45:0/3006741041 shutdown_connections 2023-07-09T02:21:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff839c5c640 1 --2- 172.21.15.45:0/3006741041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff81c005030 0x7ff81c00b990 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff839c5c640 1 -- 172.21.15.45:0/3006741041 >> 172.21.15.45:0/3006741041 conn(0x7ff8340698e0 msgr2=0x7ff834069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff839c5c640 1 -- 172.21.15.45:0/3006741041 shutdown_connections 2023-07-09T02:21:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.226+0000 7ff839c5c640 1 -- 172.21.15.45:0/3006741041 wait complete. 2023-07-09T02:21:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 Processor -- start 2023-07-09T02:21:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 -- start start 2023-07-09T02:21:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c005030 0x7ff8340ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8341f55d0 0x7ff8341f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8340b0ef0 0x7ff8340b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340cbc60 con 0x7ff8341f55d0 2023-07-09T02:21:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8341f49d0 con 0x7ff8340b0ef0 2023-07-09T02:21:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c9e40 con 0x7ff81c005030 2023-07-09T02:21:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8341f55d0 0x7ff8341f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8341f55d0 0x7ff8341f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60832/0 (socket says 172.21.15.45:60832) 2023-07-09T02:21:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 -- 172.21.15.45:0/3488630686 learned_addr learned my addr 172.21.15.45:0/3488630686 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff8337fe640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c005030 0x7ff8340ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff833fff640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8340b0ef0 0x7ff8340b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 -- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c005030 msgr2=0x7ff8340ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c005030 0x7ff8340ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 -- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8340b0ef0 msgr2=0x7ff8340b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8340b0ef0 0x7ff8340b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 -- 172.21.15.45:0/3488630686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8341f5a20 con 0x7ff8341f55d0 2023-07-09T02:21:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff832ffd640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8341f55d0 0x7ff8341f1630 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7ff82800f7c0 tx=0x7ff82800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:06.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff81bfff640 1 -- 172.21.15.45:0/3488630686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800fe70 con 0x7ff8341f55d0 2023-07-09T02:21:06.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff81bfff640 1 -- 172.21.15.45:0/3488630686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8280052e0 con 0x7ff8341f55d0 2023-07-09T02:21:06.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff81bfff640 1 -- 172.21.15.45:0/3488630686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800d970 con 0x7ff8341f55d0 2023-07-09T02:21:06.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8340ca820 con 0x7ff8341f55d0 2023-07-09T02:21:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8340cade0 con 0x7ff8341f55d0 2023-07-09T02:21:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.230+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8340cbda0 con 0x7ff8341f55d0 2023-07-09T02:21:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.234+0000 7ff81bfff640 1 -- 172.21.15.45:0/3488630686 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff82800dad0 con 0x7ff8341f55d0 2023-07-09T02:21:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.234+0000 7ff81bfff640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff820066280 0x7ff820068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.234+0000 7ff81bfff640 1 -- 172.21.15.45:0/3488630686 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff828083df0 con 0x7ff8341f55d0 2023-07-09T02:21:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.234+0000 7ff8337fe640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff820066280 0x7ff820068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:06.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.234+0000 7ff8337fe640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff820066280 0x7ff820068730 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff824005260 tx=0x7ff824009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.238+0000 7ff81bfff640 1 -- 172.21.15.45:0/3488630686 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8340cbda0 con 0x7ff8341f55d0 2023-07-09T02:21:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:06.422+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff8340cbda0 con 0x7ff8341f55d0 2023-07-09T02:21:07.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.050+0000 7ff81bfff640 1 -- 172.21.15.45:0/3488630686 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff8340cbda0 con 0x7ff8341f55d0 2023-07-09T02:21:07.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff820066280 msgr2=0x7ff820068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff820066280 0x7ff820068730 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff824005260 tx=0x7ff824009040 comp rx=0 tx=0).stop 2023-07-09T02:21:07.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8341f55d0 msgr2=0x7ff8341f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8341f55d0 0x7ff8341f1630 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7ff82800f7c0 tx=0x7ff82800fc80 comp rx=0 tx=0).stop 2023-07-09T02:21:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 shutdown_connections 2023-07-09T02:21:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8340b0ef0 0x7ff8340b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8341f55d0 0x7ff8341f1630 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff820066280 0x7ff820068730 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 --2- 172.21.15.45:0/3488630686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff81c005030 0x7ff8340ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 >> 172.21.15.45:0/3488630686 conn(0x7ff8340698e0 msgr2=0x7ff8341597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:07.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 shutdown_connections 2023-07-09T02:21:07.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.054+0000 7ff839c5c640 1 -- 172.21.15.45:0/3488630686 wait complete. 2023-07-09T02:21:07.073 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:21:07.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:21:07.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9b269640 1 Processor -- start 2023-07-09T02:21:07.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9b269640 1 -- start start 2023-07-09T02:21:07.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9b269640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a9415c870 0x7f0a940b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9b269640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a9406b950 0x7f0a940d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9b269640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a940b2090 con 0x7f0a940b1b50 2023-07-09T02:21:07.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9b269640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a94160520 con 0x7f0a9415c870 2023-07-09T02:21:07.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9b269640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a94160800 con 0x7f0a9406b950 2023-07-09T02:21:07.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9a267640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a9415c870 0x7f0a940b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9a267640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a9415c870 0x7f0a940b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60846/0 (socket says 172.21.15.45:60846) 2023-07-09T02:21:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9a267640 1 -- 172.21.15.45:0/1837866573 learned_addr learned my addr 172.21.15.45:0/1837866573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9aa68640 1 --2- 172.21.15.45:0/1837866573 >> v2:172.21.15.155:3300/0 conn(0x7f0a9406b950 0x7f0a940d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9a267640 1 -- 172.21.15.45:0/1837866573 >> v2:172.21.15.155:3300/0 conn(0x7f0a9406b950 msgr2=0x7f0a940d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9a267640 1 --2- 172.21.15.45:0/1837866573 >> v2:172.21.15.155:3300/0 conn(0x7f0a9406b950 0x7f0a940d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9a267640 1 -- 172.21.15.45:0/1837866573 >> v1:172.21.15.155:6789/0 conn(0x7f0a940b1b50 legacy=0x7f0a9406b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.222+0000 7f0a9a267640 1 -- 172.21.15.45:0/1837866573 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94160ae0 con 0x7f0a9415c870 2023-07-09T02:21:07.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9a267640 1 --2- 172.21.15.45:0/1837866573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a940b1610 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f0a940cfe90 tx=0x7f0a9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4dcfc16bd182d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a99265640 1 -- 172.21.15.45:0/1837866573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900ab670 con 0x7f0a9415c870 2023-07-09T02:21:07.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a99265640 1 -- 172.21.15.45:0/1837866573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a900ab7d0 con 0x7f0a9415c870 2023-07-09T02:21:07.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a99265640 1 -- 172.21.15.45:0/1837866573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900abb60 con 0x7f0a9415c870 2023-07-09T02:21:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 -- 172.21.15.45:0/1837866573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 msgr2=0x7f0a940b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1837866573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a940b1610 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f0a940cfe90 tx=0x7f0a9001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 -- 172.21.15.45:0/1837866573 shutdown_connections 2023-07-09T02:21:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1837866573 >> v2:172.21.15.155:3300/0 conn(0x7f0a9406b950 0x7f0a940d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1837866573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a940b1610 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 -- 172.21.15.45:0/1837866573 >> 172.21.15.45:0/1837866573 conn(0x7f0a94070be0 msgr2=0x7f0a94070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:07.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 -- 172.21.15.45:0/1837866573 shutdown_connections 2023-07-09T02:21:07.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 -- 172.21.15.45:0/1837866573 wait complete. 2023-07-09T02:21:07.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.226+0000 7f0a9b269640 1 Processor -- start 2023-07-09T02:21:07.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 -- start start 2023-07-09T02:21:07.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9406b950 0x7f0a940b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a940b1b50 0x7f0a9414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a94150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94154780 con 0x7f0a9415c870 2023-07-09T02:21:07.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940cb050 con 0x7f0a9406b950 2023-07-09T02:21:07.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94154a20 con 0x7f0a940b1b50 2023-07-09T02:21:07.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a94150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a94150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60858/0 (socket says 172.21.15.45:60858) 2023-07-09T02:21:07.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 -- 172.21.15.45:0/1046024973 learned_addr learned my addr 172.21.15.45:0/1046024973 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:07.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9a267640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9406b950 0x7f0a940b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a99a66640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a940b1b50 0x7f0a9414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 -- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a940b1b50 msgr2=0x7f0a9414fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a940b1b50 0x7f0a9414fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 -- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9406b950 msgr2=0x7f0a940b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9406b950 0x7f0a940b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 -- 172.21.15.45:0/1046024973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900094d0 con 0x7f0a9415c870 2023-07-09T02:21:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9aa68640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a94150240 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c007e30 tx=0x7f0a8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a8affd640 1 -- 172.21.15.45:0/1046024973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c014620 con 0x7f0a9415c870 2023-07-09T02:21:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a8affd640 1 -- 172.21.15.45:0/1046024973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00ee90 con 0x7f0a9415c870 2023-07-09T02:21:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94154d00 con 0x7f0a9415c870 2023-07-09T02:21:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a8affd640 1 -- 172.21.15.45:0/1046024973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0149c0 con 0x7f0a9415c870 2023-07-09T02:21:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a940b8650 con 0x7f0a9415c870 2023-07-09T02:21:07.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.230+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a940b8870 con 0x7f0a9415c870 2023-07-09T02:21:07.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.234+0000 7f0a8affd640 1 -- 172.21.15.45:0/1046024973 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a8c014b20 con 0x7f0a9415c870 2023-07-09T02:21:07.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.234+0000 7f0a8affd640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a78066280 0x7f0a78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.234+0000 7f0a8affd640 1 -- 172.21.15.45:0/1046024973 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a8c084610 con 0x7f0a9415c870 2023-07-09T02:21:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.234+0000 7f0a9a267640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a78066280 0x7f0a78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.234+0000 7f0a9a267640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a78066280 0x7f0a78068730 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0a900af000 tx=0x7f0a900b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.238+0000 7f0a8affd640 1 -- 172.21.15.45:0/1046024973 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a8c051aa0 con 0x7f0a9415c870 2023-07-09T02:21:07.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.422+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a94154f40 con 0x7f0a9415c870 2023-07-09T02:21:07.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.422+0000 7f0a8affd640 1 -- 172.21.15.45:0/1046024973 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f0a94154f40 con 0x7f0a9415c870 2023-07-09T02:21:07.421 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:07.422 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2937988619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2937988619},{"type":"v1","addr":"172.21.15.45:6835","nonce":2937988619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/202593650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":202593650},{"type":"v1","addr":"172.21.15.45:6833","nonce":202593650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1590703663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1590703663},{"type":"v1","addr":"172.21.15.155:6837","nonce":1590703663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:21:03.398485+0000","modified":"2023-07-09T02:21:07.041368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8206":{"gid":8206,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/390558772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":390558772},{"type":"v1","addr":"172.21.15.155:6836","nonce":390558772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T02:21:07.422 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 83 2023-07-09T02:21:07.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a78066280 msgr2=0x7f0a78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a78066280 0x7f0a78068730 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0a900af000 tx=0x7f0a900b6040 comp rx=0 tx=0).stop 2023-07-09T02:21:07.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 msgr2=0x7f0a94150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a94150240 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c007e30 tx=0x7f0a8c00e4b0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 shutdown_connections 2023-07-09T02:21:07.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a9415c870 0x7f0a94150240 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a78066280 0x7f0a78068730 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a940b1b50 0x7f0a9414fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 --2- 172.21.15.45:0/1046024973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a9406b950 0x7f0a940b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 >> 172.21.15.45:0/1046024973 conn(0x7f0a94070be0 msgr2=0x7f0a9415d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:07.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 shutdown_connections 2023-07-09T02:21:07.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.426+0000 7f0a9b269640 1 -- 172.21.15.45:0/1046024973 wait complete. 2023-07-09T02:21:07.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:21:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.586+0000 7f0ad68cb640 1 Processor -- start 2023-07-09T02:21:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.586+0000 7f0ad68cb640 1 -- start start 2023-07-09T02:21:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.586+0000 7f0ad68cb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ad0142500 0x7f0ad00cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.586+0000 7f0ad68cb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0ad0160630 0x7f0ad00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0ad68cb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad0069df0 con 0x7f0ad00699f0 2023-07-09T02:21:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0ad68cb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00cd6d0 con 0x7f0ad0142500 2023-07-09T02:21:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0ad68cb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad00d0630 con 0x7f0ad0160630 2023-07-09T02:21:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ad0142500 0x7f0ad00cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ad0142500 0x7f0ad00cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60866/0 (socket says 172.21.15.45:60866) 2023-07-09T02:21:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acffff640 1 -- 172.21.15.45:0/2387627524 learned_addr learned my addr 172.21.15.45:0/2387627524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acf7fe640 1 --2- 172.21.15.45:0/2387627524 >> v2:172.21.15.155:3300/0 conn(0x7f0ad0160630 0x7f0ad00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acffff640 1 -- 172.21.15.45:0/2387627524 >> v2:172.21.15.155:3300/0 conn(0x7f0ad0160630 msgr2=0x7f0ad00694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acffff640 1 --2- 172.21.15.45:0/2387627524 >> v2:172.21.15.155:3300/0 conn(0x7f0ad0160630 0x7f0ad00694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acffff640 1 -- 172.21.15.45:0/2387627524 >> v1:172.21.15.155:6789/0 conn(0x7f0ad00699f0 legacy=0x7f0ad006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acffff640 1 -- 172.21.15.45:0/2387627524 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00cf320 con 0x7f0ad0142500 2023-07-09T02:21:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0acffff640 1 --2- 172.21.15.45:0/2387627524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0142500 0x7f0ad00cecf0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0ad006e080 tx=0x7f0ac001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c12e17d66da1de1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0aceffd640 1 -- 172.21.15.45:0/2387627524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00ab5f0 con 0x7f0ad0142500 2023-07-09T02:21:07.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0aceffd640 1 -- 172.21.15.45:0/2387627524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac00ab750 con 0x7f0ad0142500 2023-07-09T02:21:07.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.590+0000 7f0aceffd640 1 -- 172.21.15.45:0/2387627524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00abae0 con 0x7f0ad0142500 2023-07-09T02:21:07.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2387627524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0142500 msgr2=0x7f0ad00cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2387627524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0142500 0x7f0ad00cecf0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0ad006e080 tx=0x7f0ac001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2387627524 shutdown_connections 2023-07-09T02:21:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2387627524 >> v2:172.21.15.155:3300/0 conn(0x7f0ad0160630 0x7f0ad00694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2387627524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0142500 0x7f0ad00cecf0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2387627524 >> 172.21.15.45:0/2387627524 conn(0x7f0ad00650b0 msgr2=0x7f0ad00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2387627524 shutdown_connections 2023-07-09T02:21:07.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2387627524 wait complete. 2023-07-09T02:21:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 Processor -- start 2023-07-09T02:21:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- start start 2023-07-09T02:21:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ad00699f0 0x7f0ad00caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ad0142500 0x7f0ad0157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0160630 0x7f0ad01592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0159c90 con 0x7f0ad0160630 2023-07-09T02:21:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0157fc0 con 0x7f0ad00699f0 2023-07-09T02:21:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad68cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0158e20 con 0x7f0ad0142500 2023-07-09T02:21:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad4e68640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0160630 0x7f0ad01592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad4e68640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0160630 0x7f0ad01592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60876/0 (socket says 172.21.15.45:60876) 2023-07-09T02:21:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.594+0000 7f0ad4e68640 1 -- 172.21.15.45:0/2763668568 learned_addr learned my addr 172.21.15.45:0/2763668568 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:07.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0acffff640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ad00699f0 0x7f0ad00caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0acf7fe640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ad0142500 0x7f0ad0157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad4e68640 1 -- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ad0142500 msgr2=0x7f0ad0157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad4e68640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ad0142500 0x7f0ad0157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad4e68640 1 -- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ad00699f0 msgr2=0x7f0ad00caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad4e68640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ad00699f0 0x7f0ad00caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad4e68640 1 -- 172.21.15.45:0/2763668568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00094d0 con 0x7f0ad0160630 2023-07-09T02:21:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad4e68640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0160630 0x7f0ad01592b0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c760 tx=0x7f0ac800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0accff9640 1 -- 172.21.15.45:0/2763668568 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8003ba0 con 0x7f0ad0160630 2023-07-09T02:21:07.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0accff9640 1 -- 172.21.15.45:0/2763668568 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8003d00 con 0x7f0ad0160630 2023-07-09T02:21:07.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0accff9640 1 -- 172.21.15.45:0/2763668568 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800aa90 con 0x7f0ad0160630 2023-07-09T02:21:07.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad0157da0 con 0x7f0ad0160630 2023-07-09T02:21:07.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad01584f0 con 0x7f0ad0160630 2023-07-09T02:21:07.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad004d7d0 con 0x7f0ad0160630 2023-07-09T02:21:07.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0accff9640 1 -- 172.21.15.45:0/2763668568 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ac800abf0 con 0x7f0ad0160630 2023-07-09T02:21:07.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0accff9640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0abc0662b0 0x7f0abc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0accff9640 1 -- 172.21.15.45:0/2763668568 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ac8083ae0 con 0x7f0ad0160630 2023-07-09T02:21:07.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.598+0000 7f0acffff640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0abc0662b0 0x7f0abc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.602+0000 7f0acffff640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0abc0662b0 0x7f0abc068760 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00af000 tx=0x7f0ac00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.602+0000 7f0accff9640 1 -- 172.21.15.45:0/2763668568 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ac8050f50 con 0x7f0ad0160630 2023-07-09T02:21:07.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.758+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ad006c040 con 0x7f0ad0160630 2023-07-09T02:21:07.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.758+0000 7f0accff9640 1 -- 172.21.15.45:0/2763668568 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f0ac8054570 con 0x7f0ad0160630 2023-07-09T02:21:07.758 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:07.758 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":166,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:21:05.013931+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:21:01.154000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T02:21:02.407446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:21:07.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0abc0662b0 msgr2=0x7f0abc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0abc0662b0 0x7f0abc068760 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00af000 tx=0x7f0ac00a7000 comp rx=0 tx=0).stop 2023-07-09T02:21:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0160630 msgr2=0x7f0ad01592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0160630 0x7f0ad01592b0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800c760 tx=0x7f0ac800cc20 comp rx=0 tx=0).stop 2023-07-09T02:21:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 shutdown_connections 2023-07-09T02:21:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad0160630 0x7f0ad01592b0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0abc0662b0 0x7f0abc068760 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ad0142500 0x7f0ad0157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 --2- 172.21.15.45:0/2763668568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ad00699f0 0x7f0ad00caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 >> 172.21.15.45:0/2763668568 conn(0x7f0ad00650b0 msgr2=0x7f0ad015d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 shutdown_connections 2023-07-09T02:21:07.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.762+0000 7f0ad68cb640 1 -- 172.21.15.45:0/2763668568 wait complete. 2023-07-09T02:21:07.779 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:21:07.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:21:07.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.922+0000 7faac5b82640 1 Processor -- start 2023-07-09T02:21:07.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.922+0000 7faac5b82640 1 -- start start 2023-07-09T02:21:07.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faac5b82640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faac015c060 0x7faac00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faac5b82640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac0160a50 con 0x7faac00cd120 2023-07-09T02:21:07.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faac5b82640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac015c430 con 0x7faac00d2620 2023-07-09T02:21:07.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faac5b82640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac015fb60 con 0x7faac015c060 2023-07-09T02:21:07.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabeffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faac00cd120 0x7faac00d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44334/0 (socket says 172.21.15.45:44334) 2023-07-09T02:21:07.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabeffd640 1 -- 172.21.15.45:0/1659250685 learned_addr learned my addr 172.21.15.45:0/1659250685 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:07.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabf7fe640 1 --2- 172.21.15.45:0/1659250685 >> v2:172.21.15.155:3300/0 conn(0x7faac015c060 0x7faac00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524730229 0 0) 0x7faac0160a50 con 0x7faac00cd120 2023-07-09T02:21:07.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa8003530 con 0x7faac00cd120 2023-07-09T02:21:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399330447 0 0) 0x7faac015c430 con 0x7faac00d2620 2023-07-09T02:21:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac0160a50 con 0x7faac00d2620 2023-07-09T02:21:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286285406 0 0) 0x7faaa8003530 con 0x7faac00cd120 2023-07-09T02:21:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 >> v2:172.21.15.155:3300/0 conn(0x7faac015c060 msgr2=0x7faac00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 --2- 172.21.15.45:0/1659250685 >> v2:172.21.15.155:3300/0 conn(0x7faac015c060 0x7faac00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 >> v1:172.21.15.155:6789/0 conn(0x7faac00d2620 legacy=0x7faac00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac015fe40 con 0x7faac00cd120 2023-07-09T02:21:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7faab4001680 con 0x7faac00cd120 2023-07-09T02:21:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabf7fe640 1 --2- 172.21.15.45:0/1659250685 >> v2:172.21.15.155:3300/0 conn(0x7faac015c060 0x7faac00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:21:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 >> v1:172.21.15.45:6789/0 conn(0x7faac00cd120 legacy=0x7faac00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa8003b10 0x7faaa8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaa8005180 0x7faaa800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac015fb60 con 0x7faaa80047d0 2023-07-09T02:21:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa800bfe0 con 0x7faaa8005180 2023-07-09T02:21:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa800c1a0 con 0x7faaa8003b10 2023-07-09T02:21:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabeffd640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabf7fe640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa8003b10 0x7faaa8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabffff640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaa8005180 0x7faaa800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabeffd640 1 -- 172.21.15.45:0/1659250685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa8003b10 msgr2=0x7faaa8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabeffd640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa8003b10 0x7faaa8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabeffd640 1 -- 172.21.15.45:0/1659250685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaa8005180 msgr2=0x7faaa800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabeffd640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faaa8005180 0x7faaa800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabeffd640 1 -- 172.21.15.45:0/1659250685 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa8003530 con 0x7faaa80047d0 2023-07-09T02:21:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.926+0000 7faabffff640 1 -- 172.21.15.45:0/1659250685 reap_dead start 2023-07-09T02:21:07.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faabeffd640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7faac00cd570 tx=0x7faab401cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61375a2f6d521a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40058e0 con 0x7faaa80047d0 2023-07-09T02:21:07.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4005a60 con 0x7faaa80047d0 2023-07-09T02:21:07.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faabe7fc640 1 -- 172.21.15.45:0/1659250685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4005e50 con 0x7faaa80047d0 2023-07-09T02:21:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faac5b82640 1 -- 172.21.15.45:0/1659250685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80047d0 msgr2=0x7faaa8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faac5b82640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7faac00cd570 tx=0x7faab401cb80 comp rx=0 tx=0).stop 2023-07-09T02:21:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faac5b82640 1 -- 172.21.15.45:0/1659250685 shutdown_connections 2023-07-09T02:21:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faac5b82640 1 --2- 172.21.15.45:0/1659250685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa80047d0 0x7faaa8004c40 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faac5b82640 1 -- 172.21.15.45:0/1659250685 >> 172.21.15.45:0/1659250685 conn(0x7faac00698e0 msgr2=0x7faac0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faac5b82640 1 -- 172.21.15.45:0/1659250685 shutdown_connections 2023-07-09T02:21:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.930+0000 7faac5b82640 1 -- 172.21.15.45:0/1659250685 wait complete. 2023-07-09T02:21:07.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 Processor -- start 2023-07-09T02:21:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 -- start start 2023-07-09T02:21:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa80047d0 0x7faac01f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faac015c620 0x7faac01f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01f51d0 0x7faac00cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac01f5670 con 0x7faac01f51d0 2023-07-09T02:21:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac01f5af0 con 0x7faac015c620 2023-07-09T02:21:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac015f3c0 con 0x7faaa80047d0 2023-07-09T02:21:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01f51d0 0x7faac00cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01f51d0 0x7faac00cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60900/0 (socket says 172.21.15.45:60900) 2023-07-09T02:21:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 -- 172.21.15.45:0/4145811546 learned_addr learned my addr 172.21.15.45:0/4145811546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabeffd640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faac015c620 0x7faac01f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabf7fe640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa80047d0 0x7faac01f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 -- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa80047d0 msgr2=0x7faac01f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa80047d0 0x7faac01f1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 -- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faac015c620 msgr2=0x7faac01f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faac015c620 0x7faac01f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 -- 172.21.15.45:0/4145811546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac015edb0 con 0x7faac01f51d0 2023-07-09T02:21:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faabffff640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01f51d0 0x7faac00cb090 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7faab8007fd0 tx=0x7faab8012930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faaa7fff640 1 -- 172.21.15.45:0/4145811546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80155e0 con 0x7faac01f51d0 2023-07-09T02:21:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faaa7fff640 1 -- 172.21.15.45:0/4145811546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8015740 con 0x7faac01f51d0 2023-07-09T02:21:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faaa7fff640 1 -- 172.21.15.45:0/4145811546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8015af0 con 0x7faac01f51d0 2023-07-09T02:21:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac015d3d0 con 0x7faac01f51d0 2023-07-09T02:21:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.934+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac01f1540 con 0x7faac01f51d0 2023-07-09T02:21:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.938+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac004d7d0 con 0x7faac01f51d0 2023-07-09T02:21:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.938+0000 7faaa7fff640 1 -- 172.21.15.45:0/4145811546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faab8015c50 con 0x7faac01f51d0 2023-07-09T02:21:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.938+0000 7faaa7fff640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faaac066280 0x7faaac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.938+0000 7faaa7fff640 1 -- 172.21.15.45:0/4145811546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faab8086020 con 0x7faac01f51d0 2023-07-09T02:21:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.938+0000 7faabf7fe640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faaac066280 0x7faaac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.938+0000 7faabf7fe640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faaac066280 0x7faaac068730 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7faac00b2710 tx=0x7faab0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:07.942+0000 7faaa7fff640 1 -- 172.21.15.45:0/4145811546 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faab80534a0 con 0x7faac01f51d0 2023-07-09T02:21:08.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.094+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faac015ec30 con 0x7faaac066280 2023-07-09T02:21:08.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.102+0000 7faaa7fff640 1 -- 172.21.15.45:0/4145811546 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305800 (secure 0 0 0) 0x7faab00098c0 con 0x7faaac066280 2023-07-09T02:21:08.104 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:08.105 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:21:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faaac066280 msgr2=0x7faaac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faaac066280 0x7faaac068730 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7faac00b2710 tx=0x7faab0008040 comp rx=0 tx=0).stop 2023-07-09T02:21:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01f51d0 msgr2=0x7faac00cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01f51d0 0x7faac00cb090 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7faab8007fd0 tx=0x7faab8012930 comp rx=0 tx=0).stop 2023-07-09T02:21:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 shutdown_connections 2023-07-09T02:21:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac01f51d0 0x7faac00cb090 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faac015c620 0x7faac01f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7faaac066280 0x7faaac068730 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 --2- 172.21.15.45:0/4145811546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaa80047d0 0x7faac01f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 >> 172.21.15.45:0/4145811546 conn(0x7faac00698e0 msgr2=0x7faac00b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:08.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 shutdown_connections 2023-07-09T02:21:08.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.106+0000 7faac5b82640 1 -- 172.21.15.45:0/4145811546 wait complete. 2023-07-09T02:21:08.124 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":458,"stamp":"2023-07-09T02:21:06.673935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8864,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553635,"statfs":{"total":1600000000,"available":1590922947,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.666487"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019076+0000","last_change":"2023-07-09T02:21:04.040238+0000","last_active":"2023-07-09T02:21:05.019076+0000","last_peered":"2023-07-09T02:21:05.019076+0000","last_clean":"2023-07-09T02:21:05.019076+0000","last_became_active":"2023-07-09T02:21:04.040024+0000","last_became_peered":"2023-07-09T02:21:04.040024+0000","last_unstale":"2023-07-09T02:21:05.019076+0000","last_undegraded":"2023-07-09T02:21:05.019076+0000","last_fullsized":"2023-07-09T02:21:05.019076+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:47:30.653683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038134+0000","last_change":"2023-07-09T02:21:04.039401+0000","last_active":"2023-07-09T02:21:05.038134+0000","last_peered":"2023-07-09T02:21:05.038134+0000","last_clean":"2023-07-09T02:21:05.038134+0000","last_became_active":"2023-07-09T02:21:04.039158+0000","last_became_peered":"2023-07-09T02:21:04.039158+0000","last_unstale":"2023-07-09T02:21:05.038134+0000","last_undegraded":"2023-07-09T02:21:05.038134+0000","last_fullsized":"2023-07-09T02:21:05.038134+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:55:31.809427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037741+0000","last_change":"2023-07-09T02:21:04.031554+0000","last_active":"2023-07-09T02:21:05.037741+0000","last_peered":"2023-07-09T02:21:05.037741+0000","last_clean":"2023-07-09T02:21:05.037741+0000","last_became_active":"2023-07-09T02:21:04.031291+0000","last_became_peered":"2023-07-09T02:21:04.031291+0000","last_unstale":"2023-07-09T02:21:05.037741+0000","last_undegraded":"2023-07-09T02:21:05.037741+0000","last_fullsized":"2023-07-09T02:21:05.037741+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:30:03.175313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038137+0000","last_change":"2023-07-09T02:21:04.034372+0000","last_active":"2023-07-09T02:21:05.038137+0000","last_peered":"2023-07-09T02:21:05.038137+0000","last_clean":"2023-07-09T02:21:05.038137+0000","last_became_active":"2023-07-09T02:21:04.033183+0000","last_became_peered":"2023-07-09T02:21:04.033183+0000","last_unstale":"2023-07-09T02:21:05.038137+0000","last_undegraded":"2023-07-09T02:21:05.038137+0000","last_fullsized":"2023-07-09T02:21:05.038137+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:14:39.212672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017663+0000","last_change":"2023-07-09T02:21:04.022829+0000","last_active":"2023-07-09T02:21:05.017663+0000","last_peered":"2023-07-09T02:21:05.017663+0000","last_clean":"2023-07-09T02:21:05.017663+0000","last_became_active":"2023-07-09T02:21:04.022310+0000","last_became_peered":"2023-07-09T02:21:04.022310+0000","last_unstale":"2023-07-09T02:21:05.017663+0000","last_undegraded":"2023-07-09T02:21:05.017663+0000","last_fullsized":"2023-07-09T02:21:05.017663+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:05.445009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017431+0000","last_change":"2023-07-09T02:21:04.021823+0000","last_active":"2023-07-09T02:21:05.017431+0000","last_peered":"2023-07-09T02:21:05.017431+0000","last_clean":"2023-07-09T02:21:05.017431+0000","last_became_active":"2023-07-09T02:21:04.021564+0000","last_became_peered":"2023-07-09T02:21:04.021564+0000","last_unstale":"2023-07-09T02:21:05.017431+0000","last_undegraded":"2023-07-09T02:21:05.017431+0000","last_fullsized":"2023-07-09T02:21:05.017431+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:08:10.029533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018839+0000","last_change":"2023-07-09T02:21:04.032141+0000","last_active":"2023-07-09T02:21:05.018839+0000","last_peered":"2023-07-09T02:21:05.018839+0000","last_clean":"2023-07-09T02:21:05.018839+0000","last_became_active":"2023-07-09T02:21:04.031781+0000","last_became_peered":"2023-07-09T02:21:04.031781+0000","last_unstale":"2023-07-09T02:21:05.018839+0000","last_undegraded":"2023-07-09T02:21:05.018839+0000","last_fullsized":"2023-07-09T02:21:05.018839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:51:26.729074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039531+0000","last_change":"2023-07-09T02:21:04.035521+0000","last_active":"2023-07-09T02:21:05.039531+0000","last_peered":"2023-07-09T02:21:05.039531+0000","last_clean":"2023-07-09T02:21:05.039531+0000","last_became_active":"2023-07-09T02:21:04.034705+0000","last_became_peered":"2023-07-09T02:21:04.034705+0000","last_unstale":"2023-07-09T02:21:05.039531+0000","last_undegraded":"2023-07-09T02:21:05.039531+0000","last_fullsized":"2023-07-09T02:21:05.039531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:51:29.490163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017564+0000","last_change":"2023-07-09T02:21:04.032400+0000","last_active":"2023-07-09T02:21:05.017564+0000","last_peered":"2023-07-09T02:21:05.017564+0000","last_clean":"2023-07-09T02:21:05.017564+0000","last_became_active":"2023-07-09T02:21:04.032191+0000","last_became_peered":"2023-07-09T02:21:04.032191+0000","last_unstale":"2023-07-09T02:21:05.017564+0000","last_undegraded":"2023-07-09T02:21:05.017564+0000","last_fullsized":"2023-07-09T02:21:05.017564+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:35:26.131940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017761+0000","last_change":"2023-07-09T02:21:04.019167+0000","last_active":"2023-07-09T02:21:05.017761+0000","last_peered":"2023-07-09T02:21:05.017761+0000","last_clean":"2023-07-09T02:21:05.017761+0000","last_became_active":"2023-07-09T02:21:04.018950+0000","last_became_peered":"2023-07-09T02:21:04.018950+0000","last_unstale":"2023-07-09T02:21:05.017761+0000","last_undegraded":"2023-07-09T02:21:05.017761+0000","last_fullsized":"2023-07-09T02:21:05.017761+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:18:54.479029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038095+0000","last_change":"2023-07-09T02:21:04.032676+0000","last_active":"2023-07-09T02:21:05.038095+0000","last_peered":"2023-07-09T02:21:05.038095+0000","last_clean":"2023-07-09T02:21:05.038095+0000","last_became_active":"2023-07-09T02:21:04.032463+0000","last_became_peered":"2023-07-09T02:21:04.032463+0000","last_unstale":"2023-07-09T02:21:05.038095+0000","last_undegraded":"2023-07-09T02:21:05.038095+0000","last_fullsized":"2023-07-09T02:21:05.038095+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:38:22.576053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039474+0000","last_change":"2023-07-09T02:21:04.038976+0000","last_active":"2023-07-09T02:21:05.039474+0000","last_peered":"2023-07-09T02:21:05.039474+0000","last_clean":"2023-07-09T02:21:05.039474+0000","last_became_active":"2023-07-09T02:21:04.038355+0000","last_became_peered":"2023-07-09T02:21:04.038355+0000","last_unstale":"2023-07-09T02:21:05.039474+0000","last_undegraded":"2023-07-09T02:21:05.039474+0000","last_fullsized":"2023-07-09T02:21:05.039474+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:09.947632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017262+0000","last_change":"2023-07-09T02:21:04.018128+0000","last_active":"2023-07-09T02:21:05.017262+0000","last_peered":"2023-07-09T02:21:05.017262+0000","last_clean":"2023-07-09T02:21:05.017262+0000","last_became_active":"2023-07-09T02:21:04.017888+0000","last_became_peered":"2023-07-09T02:21:04.017888+0000","last_unstale":"2023-07-09T02:21:05.017262+0000","last_undegraded":"2023-07-09T02:21:05.017262+0000","last_fullsized":"2023-07-09T02:21:05.017262+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:49:40.780817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038271+0000","last_change":"2023-07-09T02:21:04.034235+0000","last_active":"2023-07-09T02:21:05.038271+0000","last_peered":"2023-07-09T02:21:05.038271+0000","last_clean":"2023-07-09T02:21:05.038271+0000","last_became_active":"2023-07-09T02:21:04.032882+0000","last_became_peered":"2023-07-09T02:21:04.032882+0000","last_unstale":"2023-07-09T02:21:05.038271+0000","last_undegraded":"2023-07-09T02:21:05.038271+0000","last_fullsized":"2023-07-09T02:21:05.038271+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:49:21.992883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037350+0000","last_change":"2023-07-09T02:21:04.031025+0000","last_active":"2023-07-09T02:21:05.037350+0000","last_peered":"2023-07-09T02:21:05.037350+0000","last_clean":"2023-07-09T02:21:05.037350+0000","last_became_active":"2023-07-09T02:21:04.030473+0000","last_became_peered":"2023-07-09T02:21:04.030473+0000","last_unstale":"2023-07-09T02:21:05.037350+0000","last_undegraded":"2023-07-09T02:21:05.037350+0000","last_fullsized":"2023-07-09T02:21:05.037350+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:08:21.100884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017580+0000","last_change":"2023-07-09T02:21:04.039948+0000","last_active":"2023-07-09T02:21:05.017580+0000","last_peered":"2023-07-09T02:21:05.017580+0000","last_clean":"2023-07-09T02:21:05.017580+0000","last_became_active":"2023-07-09T02:21:04.039774+0000","last_became_peered":"2023-07-09T02:21:04.039774+0000","last_unstale":"2023-07-09T02:21:05.017580+0000","last_undegraded":"2023-07-09T02:21:05.017580+0000","last_fullsized":"2023-07-09T02:21:05.017580+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:06:13.954365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039908+0000","last_change":"2023-07-09T02:21:04.038739+0000","last_active":"2023-07-09T02:21:05.039908+0000","last_peered":"2023-07-09T02:21:05.039908+0000","last_clean":"2023-07-09T02:21:05.039908+0000","last_became_active":"2023-07-09T02:21:04.037510+0000","last_became_peered":"2023-07-09T02:21:04.037510+0000","last_unstale":"2023-07-09T02:21:05.039908+0000","last_undegraded":"2023-07-09T02:21:05.039908+0000","last_fullsized":"2023-07-09T02:21:05.039908+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:47:54.333371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037417+0000","last_change":"2023-07-09T02:21:04.026181+0000","last_active":"2023-07-09T02:21:05.037417+0000","last_peered":"2023-07-09T02:21:05.037417+0000","last_clean":"2023-07-09T02:21:05.037417+0000","last_became_active":"2023-07-09T02:21:04.025909+0000","last_became_peered":"2023-07-09T02:21:04.025909+0000","last_unstale":"2023-07-09T02:21:05.037417+0000","last_undegraded":"2023-07-09T02:21:05.037417+0000","last_fullsized":"2023-07-09T02:21:05.037417+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:19:11.093160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038420+0000","last_change":"2023-07-09T02:21:04.038486+0000","last_active":"2023-07-09T02:21:05.038420+0000","last_peered":"2023-07-09T02:21:05.038420+0000","last_clean":"2023-07-09T02:21:05.038420+0000","last_became_active":"2023-07-09T02:21:04.038040+0000","last_became_peered":"2023-07-09T02:21:04.038040+0000","last_unstale":"2023-07-09T02:21:05.038420+0000","last_undegraded":"2023-07-09T02:21:05.038420+0000","last_fullsized":"2023-07-09T02:21:05.038420+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:15:59.159625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018900+0000","last_change":"2023-07-09T02:21:04.025069+0000","last_active":"2023-07-09T02:21:05.018900+0000","last_peered":"2023-07-09T02:21:05.018900+0000","last_clean":"2023-07-09T02:21:05.018900+0000","last_became_active":"2023-07-09T02:21:04.024338+0000","last_became_peered":"2023-07-09T02:21:04.024338+0000","last_unstale":"2023-07-09T02:21:05.018900+0000","last_undegraded":"2023-07-09T02:21:05.018900+0000","last_fullsized":"2023-07-09T02:21:05.018900+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:28:41.223912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017707+0000","last_change":"2023-07-09T02:21:04.034290+0000","last_active":"2023-07-09T02:21:05.017707+0000","last_peered":"2023-07-09T02:21:05.017707+0000","last_clean":"2023-07-09T02:21:05.017707+0000","last_became_active":"2023-07-09T02:21:04.033415+0000","last_became_peered":"2023-07-09T02:21:04.033415+0000","last_unstale":"2023-07-09T02:21:05.017707+0000","last_undegraded":"2023-07-09T02:21:05.017707+0000","last_fullsized":"2023-07-09T02:21:05.017707+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:09.535527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019024+0000","last_change":"2023-07-09T02:21:04.031999+0000","last_active":"2023-07-09T02:21:05.019024+0000","last_peered":"2023-07-09T02:21:05.019024+0000","last_clean":"2023-07-09T02:21:05.019024+0000","last_became_active":"2023-07-09T02:21:04.031493+0000","last_became_peered":"2023-07-09T02:21:04.031493+0000","last_unstale":"2023-07-09T02:21:05.019024+0000","last_undegraded":"2023-07-09T02:21:05.019024+0000","last_fullsized":"2023-07-09T02:21:05.019024+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:01:39.607099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039600+0000","last_change":"2023-07-09T02:21:04.035214+0000","last_active":"2023-07-09T02:21:05.039600+0000","last_peered":"2023-07-09T02:21:05.039600+0000","last_clean":"2023-07-09T02:21:05.039600+0000","last_became_active":"2023-07-09T02:21:04.034053+0000","last_became_peered":"2023-07-09T02:21:04.034053+0000","last_unstale":"2023-07-09T02:21:05.039600+0000","last_undegraded":"2023-07-09T02:21:05.039600+0000","last_fullsized":"2023-07-09T02:21:05.039600+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:48:28.996991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037542+0000","last_change":"2023-07-09T02:21:04.022399+0000","last_active":"2023-07-09T02:21:05.037542+0000","last_peered":"2023-07-09T02:21:05.037542+0000","last_clean":"2023-07-09T02:21:05.037542+0000","last_became_active":"2023-07-09T02:21:04.022187+0000","last_became_peered":"2023-07-09T02:21:04.022187+0000","last_unstale":"2023-07-09T02:21:05.037542+0000","last_undegraded":"2023-07-09T02:21:05.037542+0000","last_fullsized":"2023-07-09T02:21:05.037542+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:08:28.535238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019389+0000","last_change":"2023-07-09T02:21:04.023873+0000","last_active":"2023-07-09T02:21:05.019389+0000","last_peered":"2023-07-09T02:21:05.019389+0000","last_clean":"2023-07-09T02:21:05.019389+0000","last_became_active":"2023-07-09T02:21:04.023176+0000","last_became_peered":"2023-07-09T02:21:04.023176+0000","last_unstale":"2023-07-09T02:21:05.019389+0000","last_undegraded":"2023-07-09T02:21:05.019389+0000","last_fullsized":"2023-07-09T02:21:05.019389+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:53.230526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019235+0000","last_change":"2023-07-09T02:21:04.026319+0000","last_active":"2023-07-09T02:21:05.019235+0000","last_peered":"2023-07-09T02:21:05.019235+0000","last_clean":"2023-07-09T02:21:05.019235+0000","last_became_active":"2023-07-09T02:21:04.026098+0000","last_became_peered":"2023-07-09T02:21:04.026098+0000","last_unstale":"2023-07-09T02:21:05.019235+0000","last_undegraded":"2023-07-09T02:21:05.019235+0000","last_fullsized":"2023-07-09T02:21:05.019235+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:41:48.857507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017431+0000","last_change":"2023-07-09T02:21:04.031467+0000","last_active":"2023-07-09T02:21:05.017431+0000","last_peered":"2023-07-09T02:21:05.017431+0000","last_clean":"2023-07-09T02:21:05.017431+0000","last_became_active":"2023-07-09T02:21:04.031178+0000","last_became_peered":"2023-07-09T02:21:04.031178+0000","last_unstale":"2023-07-09T02:21:05.017431+0000","last_undegraded":"2023-07-09T02:21:05.017431+0000","last_fullsized":"2023-07-09T02:21:05.017431+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:25:48.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037542+0000","last_change":"2023-07-09T02:21:04.024802+0000","last_active":"2023-07-09T02:21:05.037542+0000","last_peered":"2023-07-09T02:21:05.037542+0000","last_clean":"2023-07-09T02:21:05.037542+0000","last_became_active":"2023-07-09T02:21:04.024454+0000","last_became_peered":"2023-07-09T02:21:04.024454+0000","last_unstale":"2023-07-09T02:21:05.037542+0000","last_undegraded":"2023-07-09T02:21:05.037542+0000","last_fullsized":"2023-07-09T02:21:05.037542+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:49.450145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038447+0000","last_change":"2023-07-09T02:21:04.038472+0000","last_active":"2023-07-09T02:21:05.038447+0000","last_peered":"2023-07-09T02:21:05.038447+0000","last_clean":"2023-07-09T02:21:05.038447+0000","last_became_active":"2023-07-09T02:21:04.037564+0000","last_became_peered":"2023-07-09T02:21:04.037564+0000","last_unstale":"2023-07-09T02:21:05.038447+0000","last_undegraded":"2023-07-09T02:21:05.038447+0000","last_fullsized":"2023-07-09T02:21:05.038447+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:18:03.454505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038165+0000","last_change":"2023-07-09T02:21:04.031131+0000","last_active":"2023-07-09T02:21:05.038165+0000","last_peered":"2023-07-09T02:21:05.038165+0000","last_clean":"2023-07-09T02:21:05.038165+0000","last_became_active":"2023-07-09T02:21:04.030909+0000","last_became_peered":"2023-07-09T02:21:04.030909+0000","last_unstale":"2023-07-09T02:21:05.038165+0000","last_undegraded":"2023-07-09T02:21:05.038165+0000","last_fullsized":"2023-07-09T02:21:05.038165+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:48:29.250410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017839+0000","last_change":"2023-07-09T02:21:04.034423+0000","last_active":"2023-07-09T02:21:05.017839+0000","last_peered":"2023-07-09T02:21:05.017839+0000","last_clean":"2023-07-09T02:21:05.017839+0000","last_became_active":"2023-07-09T02:21:04.034074+0000","last_became_peered":"2023-07-09T02:21:04.034074+0000","last_unstale":"2023-07-09T02:21:05.017839+0000","last_undegraded":"2023-07-09T02:21:05.017839+0000","last_fullsized":"2023-07-09T02:21:05.017839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:29:38.132088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039172+0000","last_change":"2023-07-09T02:21:04.036966+0000","last_active":"2023-07-09T02:21:05.039172+0000","last_peered":"2023-07-09T02:21:05.039172+0000","last_clean":"2023-07-09T02:21:05.039172+0000","last_became_active":"2023-07-09T02:21:04.036490+0000","last_became_peered":"2023-07-09T02:21:04.036490+0000","last_unstale":"2023-07-09T02:21:05.039172+0000","last_undegraded":"2023-07-09T02:21:05.039172+0000","last_fullsized":"2023-07-09T02:21:05.039172+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:57:30.662187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037516+0000","last_change":"2023-07-09T02:21:04.034004+0000","last_active":"2023-07-09T02:21:05.037516+0000","last_peered":"2023-07-09T02:21:05.037516+0000","last_clean":"2023-07-09T02:21:05.037516+0000","last_became_active":"2023-07-09T02:21:04.033723+0000","last_became_peered":"2023-07-09T02:21:04.033723+0000","last_unstale":"2023-07-09T02:21:05.037516+0000","last_undegraded":"2023-07-09T02:21:05.037516+0000","last_fullsized":"2023-07-09T02:21:05.037516+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:35:03.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"165'4","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017479+0000","last_change":"2023-07-09T02:21:03.020452+0000","last_active":"2023-07-09T02:21:05.017479+0000","last_peered":"2023-07-09T02:21:05.017479+0000","last_clean":"2023-07-09T02:21:05.017479+0000","last_became_active":"2023-07-09T02:21:03.020052+0000","last_became_peered":"2023-07-09T02:21:03.020052+0000","last_unstale":"2023-07-09T02:21:05.017479+0000","last_undegraded":"2023-07-09T02:21:05.017479+0000","last_fullsized":"2023-07-09T02:21:05.017479+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:05:33.085357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037479+0000","last_change":"2023-07-09T02:21:04.031183+0000","last_active":"2023-07-09T02:21:05.037479+0000","last_peered":"2023-07-09T02:21:05.037479+0000","last_clean":"2023-07-09T02:21:05.037479+0000","last_became_active":"2023-07-09T02:21:04.030804+0000","last_became_peered":"2023-07-09T02:21:04.030804+0000","last_unstale":"2023-07-09T02:21:05.037479+0000","last_undegraded":"2023-07-09T02:21:05.037479+0000","last_fullsized":"2023-07-09T02:21:05.037479+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:53.230526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038084+0000","last_change":"2023-07-09T02:21:03.029177+0000","last_active":"2023-07-09T02:21:05.038084+0000","last_peered":"2023-07-09T02:21:05.038084+0000","last_clean":"2023-07-09T02:21:05.038084+0000","last_became_active":"2023-07-09T02:21:03.028920+0000","last_became_peered":"2023-07-09T02:21:03.028920+0000","last_unstale":"2023-07-09T02:21:05.038084+0000","last_undegraded":"2023-07-09T02:21:05.038084+0000","last_fullsized":"2023-07-09T02:21:05.038084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:00:57.113583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038061+0000","last_change":"2023-07-09T02:21:04.038646+0000","last_active":"2023-07-09T02:21:05.038061+0000","last_peered":"2023-07-09T02:21:05.038061+0000","last_clean":"2023-07-09T02:21:05.038061+0000","last_became_active":"2023-07-09T02:21:04.037856+0000","last_became_peered":"2023-07-09T02:21:04.037856+0000","last_unstale":"2023-07-09T02:21:05.038061+0000","last_undegraded":"2023-07-09T02:21:05.038061+0000","last_fullsized":"2023-07-09T02:21:05.038061+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:35:29.797400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038884+0000","last_change":"2023-07-09T02:21:03.023434+0000","last_active":"2023-07-09T02:21:05.038884+0000","last_peered":"2023-07-09T02:21:05.038884+0000","last_clean":"2023-07-09T02:21:05.038884+0000","last_became_active":"2023-07-09T02:21:03.023113+0000","last_became_peered":"2023-07-09T02:21:03.023113+0000","last_unstale":"2023-07-09T02:21:05.038884+0000","last_undegraded":"2023-07-09T02:21:05.038884+0000","last_fullsized":"2023-07-09T02:21:05.038884+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:46:40.304035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039238+0000","last_change":"2023-07-09T02:21:04.031226+0000","last_active":"2023-07-09T02:21:05.039238+0000","last_peered":"2023-07-09T02:21:05.039238+0000","last_clean":"2023-07-09T02:21:05.039238+0000","last_became_active":"2023-07-09T02:21:04.030980+0000","last_became_peered":"2023-07-09T02:21:04.030980+0000","last_unstale":"2023-07-09T02:21:05.039238+0000","last_undegraded":"2023-07-09T02:21:05.039238+0000","last_fullsized":"2023-07-09T02:21:05.039238+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:29:45.348829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037644+0000","last_change":"2023-07-09T02:21:03.025013+0000","last_active":"2023-07-09T02:21:05.037644+0000","last_peered":"2023-07-09T02:21:05.037644+0000","last_clean":"2023-07-09T02:21:05.037644+0000","last_became_active":"2023-07-09T02:21:03.024760+0000","last_became_peered":"2023-07-09T02:21:03.024760+0000","last_unstale":"2023-07-09T02:21:05.037644+0000","last_undegraded":"2023-07-09T02:21:05.037644+0000","last_fullsized":"2023-07-09T02:21:05.037644+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:09:33.786019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018525+0000","last_change":"2023-07-09T02:21:04.025276+0000","last_active":"2023-07-09T02:21:05.018525+0000","last_peered":"2023-07-09T02:21:05.018525+0000","last_clean":"2023-07-09T02:21:05.018525+0000","last_became_active":"2023-07-09T02:21:04.024809+0000","last_became_peered":"2023-07-09T02:21:04.024809+0000","last_unstale":"2023-07-09T02:21:05.018525+0000","last_undegraded":"2023-07-09T02:21:05.018525+0000","last_fullsized":"2023-07-09T02:21:05.018525+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:58.164376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039376+0000","last_change":"2023-07-09T02:21:03.029649+0000","last_active":"2023-07-09T02:21:05.039376+0000","last_peered":"2023-07-09T02:21:05.039376+0000","last_clean":"2023-07-09T02:21:05.039376+0000","last_became_active":"2023-07-09T02:21:03.029371+0000","last_became_peered":"2023-07-09T02:21:03.029371+0000","last_unstale":"2023-07-09T02:21:05.039376+0000","last_undegraded":"2023-07-09T02:21:05.039376+0000","last_fullsized":"2023-07-09T02:21:05.039376+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:18:42.070899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038393+0000","last_change":"2023-07-09T02:21:04.034526+0000","last_active":"2023-07-09T02:21:05.038393+0000","last_peered":"2023-07-09T02:21:05.038393+0000","last_clean":"2023-07-09T02:21:05.038393+0000","last_became_active":"2023-07-09T02:21:04.033642+0000","last_became_peered":"2023-07-09T02:21:04.033642+0000","last_unstale":"2023-07-09T02:21:05.038393+0000","last_undegraded":"2023-07-09T02:21:05.038393+0000","last_fullsized":"2023-07-09T02:21:05.038393+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:19:18.472723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017613+0000","last_change":"2023-07-09T02:21:03.023235+0000","last_active":"2023-07-09T02:21:05.017613+0000","last_peered":"2023-07-09T02:21:05.017613+0000","last_clean":"2023-07-09T02:21:05.017613+0000","last_became_active":"2023-07-09T02:21:03.023022+0000","last_became_peered":"2023-07-09T02:21:03.023022+0000","last_unstale":"2023-07-09T02:21:05.017613+0000","last_undegraded":"2023-07-09T02:21:05.017613+0000","last_fullsized":"2023-07-09T02:21:05.017613+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:25:41.255040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037263+0000","last_change":"2023-07-09T02:21:04.024277+0000","last_active":"2023-07-09T02:21:05.037263+0000","last_peered":"2023-07-09T02:21:05.037263+0000","last_clean":"2023-07-09T02:21:05.037263+0000","last_became_active":"2023-07-09T02:21:04.024021+0000","last_became_peered":"2023-07-09T02:21:04.024021+0000","last_unstale":"2023-07-09T02:21:05.037263+0000","last_undegraded":"2023-07-09T02:21:05.037263+0000","last_fullsized":"2023-07-09T02:21:05.037263+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:43:28.109542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019010+0000","last_change":"2023-07-09T02:21:03.017405+0000","last_active":"2023-07-09T02:21:05.019010+0000","last_peered":"2023-07-09T02:21:05.019010+0000","last_clean":"2023-07-09T02:21:05.019010+0000","last_became_active":"2023-07-09T02:21:03.017160+0000","last_became_peered":"2023-07-09T02:21:03.017160+0000","last_unstale":"2023-07-09T02:21:05.019010+0000","last_undegraded":"2023-07-09T02:21:05.019010+0000","last_fullsized":"2023-07-09T02:21:05.019010+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:56:12.733300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019444+0000","last_change":"2023-07-09T02:21:04.035834+0000","last_active":"2023-07-09T02:21:05.019444+0000","last_peered":"2023-07-09T02:21:05.019444+0000","last_clean":"2023-07-09T02:21:05.019444+0000","last_became_active":"2023-07-09T02:21:04.035624+0000","last_became_peered":"2023-07-09T02:21:04.035624+0000","last_unstale":"2023-07-09T02:21:05.019444+0000","last_undegraded":"2023-07-09T02:21:05.019444+0000","last_fullsized":"2023-07-09T02:21:05.019444+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:35:03.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018029+0000","last_change":"2023-07-09T02:21:03.023971+0000","last_active":"2023-07-09T02:21:05.018029+0000","last_peered":"2023-07-09T02:21:05.018029+0000","last_clean":"2023-07-09T02:21:05.018029+0000","last_became_active":"2023-07-09T02:21:03.023737+0000","last_became_peered":"2023-07-09T02:21:03.023737+0000","last_unstale":"2023-07-09T02:21:05.018029+0000","last_undegraded":"2023-07-09T02:21:05.018029+0000","last_fullsized":"2023-07-09T02:21:05.018029+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:51:58.475844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038936+0000","last_change":"2023-07-09T02:21:04.031578+0000","last_active":"2023-07-09T02:21:05.038936+0000","last_peered":"2023-07-09T02:21:05.038936+0000","last_clean":"2023-07-09T02:21:05.038936+0000","last_became_active":"2023-07-09T02:21:04.031321+0000","last_became_peered":"2023-07-09T02:21:04.031321+0000","last_unstale":"2023-07-09T02:21:05.038936+0000","last_undegraded":"2023-07-09T02:21:05.038936+0000","last_fullsized":"2023-07-09T02:21:05.038936+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:15:50.805764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037661+0000","last_change":"2023-07-09T02:21:03.025449+0000","last_active":"2023-07-09T02:21:05.037661+0000","last_peered":"2023-07-09T02:21:05.037661+0000","last_clean":"2023-07-09T02:21:05.037661+0000","last_became_active":"2023-07-09T02:21:03.025174+0000","last_became_peered":"2023-07-09T02:21:03.025174+0000","last_unstale":"2023-07-09T02:21:05.037661+0000","last_undegraded":"2023-07-09T02:21:05.037661+0000","last_fullsized":"2023-07-09T02:21:05.037661+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:30:57.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039373+0000","last_change":"2023-07-09T02:21:04.040359+0000","last_active":"2023-07-09T02:21:05.039373+0000","last_peered":"2023-07-09T02:21:05.039373+0000","last_clean":"2023-07-09T02:21:05.039373+0000","last_became_active":"2023-07-09T02:21:04.039803+0000","last_became_peered":"2023-07-09T02:21:04.039803+0000","last_unstale":"2023-07-09T02:21:05.039373+0000","last_undegraded":"2023-07-09T02:21:05.039373+0000","last_fullsized":"2023-07-09T02:21:05.039373+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:58.847898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039045+0000","last_change":"2023-07-09T02:21:03.024555+0000","last_active":"2023-07-09T02:21:05.039045+0000","last_peered":"2023-07-09T02:21:05.039045+0000","last_clean":"2023-07-09T02:21:05.039045+0000","last_became_active":"2023-07-09T02:21:03.024234+0000","last_became_peered":"2023-07-09T02:21:03.024234+0000","last_unstale":"2023-07-09T02:21:05.039045+0000","last_undegraded":"2023-07-09T02:21:05.039045+0000","last_fullsized":"2023-07-09T02:21:05.039045+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:31:57.975745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019530+0000","last_change":"2023-07-09T02:21:04.024102+0000","last_active":"2023-07-09T02:21:05.019530+0000","last_peered":"2023-07-09T02:21:05.019530+0000","last_clean":"2023-07-09T02:21:05.019530+0000","last_became_active":"2023-07-09T02:21:04.023646+0000","last_became_peered":"2023-07-09T02:21:04.023646+0000","last_unstale":"2023-07-09T02:21:05.019530+0000","last_undegraded":"2023-07-09T02:21:05.019530+0000","last_fullsized":"2023-07-09T02:21:05.019530+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:09:34.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037778+0000","last_change":"2023-07-09T02:21:03.022697+0000","last_active":"2023-07-09T02:21:05.037778+0000","last_peered":"2023-07-09T02:21:05.037778+0000","last_clean":"2023-07-09T02:21:05.037778+0000","last_became_active":"2023-07-09T02:21:03.022415+0000","last_became_peered":"2023-07-09T02:21:03.022415+0000","last_unstale":"2023-07-09T02:21:05.037778+0000","last_undegraded":"2023-07-09T02:21:05.037778+0000","last_fullsized":"2023-07-09T02:21:05.037778+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:32:41.948248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018858+0000","last_change":"2023-07-09T02:21:04.035157+0000","last_active":"2023-07-09T02:21:05.018858+0000","last_peered":"2023-07-09T02:21:05.018858+0000","last_clean":"2023-07-09T02:21:05.018858+0000","last_became_active":"2023-07-09T02:21:04.034940+0000","last_became_peered":"2023-07-09T02:21:04.034940+0000","last_unstale":"2023-07-09T02:21:05.018858+0000","last_undegraded":"2023-07-09T02:21:05.018858+0000","last_fullsized":"2023-07-09T02:21:05.018858+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:49:34.678766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039776+0000","last_change":"2023-07-09T02:21:03.029510+0000","last_active":"2023-07-09T02:21:05.039776+0000","last_peered":"2023-07-09T02:21:05.039776+0000","last_clean":"2023-07-09T02:21:05.039776+0000","last_became_active":"2023-07-09T02:21:03.029078+0000","last_became_peered":"2023-07-09T02:21:03.029078+0000","last_unstale":"2023-07-09T02:21:05.039776+0000","last_undegraded":"2023-07-09T02:21:05.039776+0000","last_fullsized":"2023-07-09T02:21:05.039776+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:00:56.405598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039505+0000","last_change":"2023-07-09T02:21:04.040495+0000","last_active":"2023-07-09T02:21:05.039505+0000","last_peered":"2023-07-09T02:21:05.039505+0000","last_clean":"2023-07-09T02:21:05.039505+0000","last_became_active":"2023-07-09T02:21:04.040132+0000","last_became_peered":"2023-07-09T02:21:04.040132+0000","last_unstale":"2023-07-09T02:21:05.039505+0000","last_undegraded":"2023-07-09T02:21:05.039505+0000","last_fullsized":"2023-07-09T02:21:05.039505+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:52:02.010471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018632+0000","last_change":"2023-07-09T02:21:03.024420+0000","last_active":"2023-07-09T02:21:05.018632+0000","last_peered":"2023-07-09T02:21:05.018632+0000","last_clean":"2023-07-09T02:21:05.018632+0000","last_became_active":"2023-07-09T02:21:03.023796+0000","last_became_peered":"2023-07-09T02:21:03.023796+0000","last_unstale":"2023-07-09T02:21:05.018632+0000","last_undegraded":"2023-07-09T02:21:05.018632+0000","last_fullsized":"2023-07-09T02:21:05.018632+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:37:29.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037795+0000","last_change":"2023-07-09T02:21:04.026768+0000","last_active":"2023-07-09T02:21:05.037795+0000","last_peered":"2023-07-09T02:21:05.037795+0000","last_clean":"2023-07-09T02:21:05.037795+0000","last_became_active":"2023-07-09T02:21:04.026007+0000","last_became_peered":"2023-07-09T02:21:04.026007+0000","last_unstale":"2023-07-09T02:21:05.037795+0000","last_undegraded":"2023-07-09T02:21:05.037795+0000","last_fullsized":"2023-07-09T02:21:05.037795+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:16:24.814017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038701+0000","last_change":"2023-07-09T02:21:03.027928+0000","last_active":"2023-07-09T02:21:05.038701+0000","last_peered":"2023-07-09T02:21:05.038701+0000","last_clean":"2023-07-09T02:21:05.038701+0000","last_became_active":"2023-07-09T02:21:03.027230+0000","last_became_peered":"2023-07-09T02:21:03.027230+0000","last_unstale":"2023-07-09T02:21:05.038701+0000","last_undegraded":"2023-07-09T02:21:05.038701+0000","last_fullsized":"2023-07-09T02:21:05.038701+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:46:07.538850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038748+0000","last_change":"2023-07-09T02:21:04.038286+0000","last_active":"2023-07-09T02:21:05.038748+0000","last_peered":"2023-07-09T02:21:05.038748+0000","last_clean":"2023-07-09T02:21:05.038748+0000","last_became_active":"2023-07-09T02:21:04.036022+0000","last_became_peered":"2023-07-09T02:21:04.036022+0000","last_unstale":"2023-07-09T02:21:05.038748+0000","last_undegraded":"2023-07-09T02:21:05.038748+0000","last_fullsized":"2023-07-09T02:21:05.038748+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:43:36.475405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018653+0000","last_change":"2023-07-09T02:21:03.024142+0000","last_active":"2023-07-09T02:21:05.018653+0000","last_peered":"2023-07-09T02:21:05.018653+0000","last_clean":"2023-07-09T02:21:05.018653+0000","last_became_active":"2023-07-09T02:21:03.023877+0000","last_became_peered":"2023-07-09T02:21:03.023877+0000","last_unstale":"2023-07-09T02:21:05.018653+0000","last_undegraded":"2023-07-09T02:21:05.018653+0000","last_fullsized":"2023-07-09T02:21:05.018653+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:06:22.497673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037616+0000","last_change":"2023-07-09T02:21:04.032010+0000","last_active":"2023-07-09T02:21:05.037616+0000","last_peered":"2023-07-09T02:21:05.037616+0000","last_clean":"2023-07-09T02:21:05.037616+0000","last_became_active":"2023-07-09T02:21:04.031791+0000","last_became_peered":"2023-07-09T02:21:04.031791+0000","last_unstale":"2023-07-09T02:21:05.037616+0000","last_undegraded":"2023-07-09T02:21:05.037616+0000","last_fullsized":"2023-07-09T02:21:05.037616+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:18.372841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039337+0000","last_change":"2023-07-09T02:21:03.028184+0000","last_active":"2023-07-09T02:21:05.039337+0000","last_peered":"2023-07-09T02:21:05.039337+0000","last_clean":"2023-07-09T02:21:05.039337+0000","last_became_active":"2023-07-09T02:21:03.027932+0000","last_became_peered":"2023-07-09T02:21:03.027932+0000","last_unstale":"2023-07-09T02:21:05.039337+0000","last_undegraded":"2023-07-09T02:21:05.039337+0000","last_fullsized":"2023-07-09T02:21:05.039337+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:07.101142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017557+0000","last_change":"2023-07-09T02:21:04.022573+0000","last_active":"2023-07-09T02:21:05.017557+0000","last_peered":"2023-07-09T02:21:05.017557+0000","last_clean":"2023-07-09T02:21:05.017557+0000","last_became_active":"2023-07-09T02:21:04.022005+0000","last_became_peered":"2023-07-09T02:21:04.022005+0000","last_unstale":"2023-07-09T02:21:05.017557+0000","last_undegraded":"2023-07-09T02:21:05.017557+0000","last_fullsized":"2023-07-09T02:21:05.017557+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:43:18.281510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.040041+0000","last_change":"2023-07-09T02:21:03.029358+0000","last_active":"2023-07-09T02:21:05.040041+0000","last_peered":"2023-07-09T02:21:05.040041+0000","last_clean":"2023-07-09T02:21:05.040041+0000","last_became_active":"2023-07-09T02:21:03.028748+0000","last_became_peered":"2023-07-09T02:21:03.028748+0000","last_unstale":"2023-07-09T02:21:05.040041+0000","last_undegraded":"2023-07-09T02:21:05.040041+0000","last_fullsized":"2023-07-09T02:21:05.040041+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:59:17.776590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038519+0000","last_change":"2023-07-09T02:21:04.033420+0000","last_active":"2023-07-09T02:21:05.038519+0000","last_peered":"2023-07-09T02:21:05.038519+0000","last_clean":"2023-07-09T02:21:05.038519+0000","last_became_active":"2023-07-09T02:21:04.032575+0000","last_became_peered":"2023-07-09T02:21:04.032575+0000","last_unstale":"2023-07-09T02:21:05.038519+0000","last_undegraded":"2023-07-09T02:21:05.038519+0000","last_fullsized":"2023-07-09T02:21:05.038519+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:58.214509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019271+0000","last_change":"2023-07-09T02:21:03.026551+0000","last_active":"2023-07-09T02:21:05.019271+0000","last_peered":"2023-07-09T02:21:05.019271+0000","last_clean":"2023-07-09T02:21:05.019271+0000","last_became_active":"2023-07-09T02:21:03.025758+0000","last_became_peered":"2023-07-09T02:21:03.025758+0000","last_unstale":"2023-07-09T02:21:05.019271+0000","last_undegraded":"2023-07-09T02:21:05.019271+0000","last_fullsized":"2023-07-09T02:21:05.019271+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:43:27.100390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018997+0000","last_change":"2023-07-09T02:21:04.024559+0000","last_active":"2023-07-09T02:21:05.018997+0000","last_peered":"2023-07-09T02:21:05.018997+0000","last_clean":"2023-07-09T02:21:05.018997+0000","last_became_active":"2023-07-09T02:21:04.024330+0000","last_became_peered":"2023-07-09T02:21:04.024330+0000","last_unstale":"2023-07-09T02:21:05.018997+0000","last_undegraded":"2023-07-09T02:21:05.018997+0000","last_fullsized":"2023-07-09T02:21:05.018997+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:40:08.670717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037352+0000","last_change":"2023-07-09T02:21:03.023861+0000","last_active":"2023-07-09T02:21:05.037352+0000","last_peered":"2023-07-09T02:21:05.037352+0000","last_clean":"2023-07-09T02:21:05.037352+0000","last_became_active":"2023-07-09T02:21:03.023607+0000","last_became_peered":"2023-07-09T02:21:03.023607+0000","last_unstale":"2023-07-09T02:21:05.037352+0000","last_undegraded":"2023-07-09T02:21:05.037352+0000","last_fullsized":"2023-07-09T02:21:05.037352+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:44:53.449783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017556+0000","last_change":"2023-07-09T02:21:04.039572+0000","last_active":"2023-07-09T02:21:05.017556+0000","last_peered":"2023-07-09T02:21:05.017556+0000","last_clean":"2023-07-09T02:21:05.017556+0000","last_became_active":"2023-07-09T02:21:04.039177+0000","last_became_peered":"2023-07-09T02:21:04.039177+0000","last_unstale":"2023-07-09T02:21:05.017556+0000","last_undegraded":"2023-07-09T02:21:05.017556+0000","last_fullsized":"2023-07-09T02:21:05.017556+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:26:38.312405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017974+0000","last_change":"2023-07-09T02:21:03.028421+0000","last_active":"2023-07-09T02:21:05.017974+0000","last_peered":"2023-07-09T02:21:05.017974+0000","last_clean":"2023-07-09T02:21:05.017974+0000","last_became_active":"2023-07-09T02:21:03.028176+0000","last_became_peered":"2023-07-09T02:21:03.028176+0000","last_unstale":"2023-07-09T02:21:05.017974+0000","last_undegraded":"2023-07-09T02:21:05.017974+0000","last_fullsized":"2023-07-09T02:21:05.017974+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:05:47.438293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038321+0000","last_change":"2023-07-09T02:21:04.038303+0000","last_active":"2023-07-09T02:21:05.038321+0000","last_peered":"2023-07-09T02:21:05.038321+0000","last_clean":"2023-07-09T02:21:05.038321+0000","last_became_active":"2023-07-09T02:21:04.037066+0000","last_became_peered":"2023-07-09T02:21:04.037066+0000","last_unstale":"2023-07-09T02:21:05.038321+0000","last_undegraded":"2023-07-09T02:21:05.038321+0000","last_fullsized":"2023-07-09T02:21:05.038321+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:18:14.587954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019367+0000","last_change":"2023-07-09T02:21:03.026945+0000","last_active":"2023-07-09T02:21:05.019367+0000","last_peered":"2023-07-09T02:21:05.019367+0000","last_clean":"2023-07-09T02:21:05.019367+0000","last_became_active":"2023-07-09T02:21:03.026709+0000","last_became_peered":"2023-07-09T02:21:03.026709+0000","last_unstale":"2023-07-09T02:21:05.019367+0000","last_undegraded":"2023-07-09T02:21:05.019367+0000","last_fullsized":"2023-07-09T02:21:05.019367+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:08:20.091733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038190+0000","last_change":"2023-07-09T02:21:04.032197+0000","last_active":"2023-07-09T02:21:05.038190+0000","last_peered":"2023-07-09T02:21:05.038190+0000","last_clean":"2023-07-09T02:21:05.038190+0000","last_became_active":"2023-07-09T02:21:04.031978+0000","last_became_peered":"2023-07-09T02:21:04.031978+0000","last_unstale":"2023-07-09T02:21:05.038190+0000","last_undegraded":"2023-07-09T02:21:05.038190+0000","last_fullsized":"2023-07-09T02:21:05.038190+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:55.773640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038112+0000","last_change":"2023-07-09T02:21:03.022697+0000","last_active":"2023-07-09T02:21:05.038112+0000","last_peered":"2023-07-09T02:21:05.038112+0000","last_clean":"2023-07-09T02:21:05.038112+0000","last_became_active":"2023-07-09T02:21:03.022291+0000","last_became_peered":"2023-07-09T02:21:03.022291+0000","last_unstale":"2023-07-09T02:21:05.038112+0000","last_undegraded":"2023-07-09T02:21:05.038112+0000","last_fullsized":"2023-07-09T02:21:05.038112+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:44:59.192004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038290+0000","last_change":"2023-07-09T02:21:04.035846+0000","last_active":"2023-07-09T02:21:05.038290+0000","last_peered":"2023-07-09T02:21:05.038290+0000","last_clean":"2023-07-09T02:21:05.038290+0000","last_became_active":"2023-07-09T02:21:04.035469+0000","last_became_peered":"2023-07-09T02:21:04.035469+0000","last_unstale":"2023-07-09T02:21:05.038290+0000","last_undegraded":"2023-07-09T02:21:05.038290+0000","last_fullsized":"2023-07-09T02:21:05.038290+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:52:27.030485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019365+0000","last_change":"2023-07-09T02:21:03.023520+0000","last_active":"2023-07-09T02:21:05.019365+0000","last_peered":"2023-07-09T02:21:05.019365+0000","last_clean":"2023-07-09T02:21:05.019365+0000","last_became_active":"2023-07-09T02:21:03.023260+0000","last_became_peered":"2023-07-09T02:21:03.023260+0000","last_unstale":"2023-07-09T02:21:05.019365+0000","last_undegraded":"2023-07-09T02:21:05.019365+0000","last_fullsized":"2023-07-09T02:21:05.019365+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:44:53.449783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038765+0000","last_change":"2023-07-09T02:21:04.044858+0000","last_active":"2023-07-09T02:21:05.038765+0000","last_peered":"2023-07-09T02:21:05.038765+0000","last_clean":"2023-07-09T02:21:05.038765+0000","last_became_active":"2023-07-09T02:21:04.041212+0000","last_became_peered":"2023-07-09T02:21:04.041212+0000","last_unstale":"2023-07-09T02:21:05.038765+0000","last_undegraded":"2023-07-09T02:21:05.038765+0000","last_fullsized":"2023-07-09T02:21:05.038765+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:05:04.263019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038204+0000","last_change":"2023-07-09T02:21:03.026690+0000","last_active":"2023-07-09T02:21:05.038204+0000","last_peered":"2023-07-09T02:21:05.038204+0000","last_clean":"2023-07-09T02:21:05.038204+0000","last_became_active":"2023-07-09T02:21:03.026376+0000","last_became_peered":"2023-07-09T02:21:03.026376+0000","last_unstale":"2023-07-09T02:21:05.038204+0000","last_undegraded":"2023-07-09T02:21:05.038204+0000","last_fullsized":"2023-07-09T02:21:05.038204+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:00:31.622590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038972+0000","last_change":"2023-07-09T02:21:04.040974+0000","last_active":"2023-07-09T02:21:05.038972+0000","last_peered":"2023-07-09T02:21:05.038972+0000","last_clean":"2023-07-09T02:21:05.038972+0000","last_became_active":"2023-07-09T02:21:04.037154+0000","last_became_peered":"2023-07-09T02:21:04.037154+0000","last_unstale":"2023-07-09T02:21:05.038972+0000","last_undegraded":"2023-07-09T02:21:05.038972+0000","last_fullsized":"2023-07-09T02:21:05.038972+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:40:39.477773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"165'6","reported_seq":19,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018306+0000","last_change":"2023-07-09T02:21:03.024489+0000","last_active":"2023-07-09T02:21:05.018306+0000","last_peered":"2023-07-09T02:21:05.018306+0000","last_clean":"2023-07-09T02:21:05.018306+0000","last_became_active":"2023-07-09T02:21:03.024275+0000","last_became_peered":"2023-07-09T02:21:03.024275+0000","last_unstale":"2023-07-09T02:21:05.018306+0000","last_undegraded":"2023-07-09T02:21:05.018306+0000","last_fullsized":"2023-07-09T02:21:05.018306+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:15:41.730938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":417,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038967+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:21:05.038967+0000","last_peered":"2023-07-09T02:21:05.038967+0000","last_clean":"2023-07-09T02:21:05.038967+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:21:05.038967+0000","last_undegraded":"2023-07-09T02:21:05.038967+0000","last_fullsized":"2023-07-09T02:21:05.038967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:22:42.228587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":301,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019449+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:21:05.019449+0000","last_peered":"2023-07-09T02:21:05.019449+0000","last_clean":"2023-07-09T02:21:05.019449+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:21:05.019449+0000","last_undegraded":"2023-07-09T02:21:05.019449+0000","last_fullsized":"2023-07-09T02:21:05.019449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:34:26.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038196+0000","last_change":"2023-07-09T02:21:04.033740+0000","last_active":"2023-07-09T02:21:05.038196+0000","last_peered":"2023-07-09T02:21:05.038196+0000","last_clean":"2023-07-09T02:21:05.038196+0000","last_became_active":"2023-07-09T02:21:04.033422+0000","last_became_peered":"2023-07-09T02:21:04.033422+0000","last_unstale":"2023-07-09T02:21:05.038196+0000","last_undegraded":"2023-07-09T02:21:05.038196+0000","last_fullsized":"2023-07-09T02:21:05.038196+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:35:52.438175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039619+0000","last_change":"2023-07-09T02:21:03.024834+0000","last_active":"2023-07-09T02:21:05.039619+0000","last_peered":"2023-07-09T02:21:05.039619+0000","last_clean":"2023-07-09T02:21:05.039619+0000","last_became_active":"2023-07-09T02:21:03.024544+0000","last_became_peered":"2023-07-09T02:21:03.024544+0000","last_unstale":"2023-07-09T02:21:05.039619+0000","last_undegraded":"2023-07-09T02:21:05.039619+0000","last_fullsized":"2023-07-09T02:21:05.039619+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:27:15.967513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":263,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038836+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:21:05.038836+0000","last_peered":"2023-07-09T02:21:05.038836+0000","last_clean":"2023-07-09T02:21:05.038836+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:21:05.038836+0000","last_undegraded":"2023-07-09T02:21:05.038836+0000","last_fullsized":"2023-07-09T02:21:05.038836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:36:03.288522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037917+0000","last_change":"2023-07-09T02:21:04.033204+0000","last_active":"2023-07-09T02:21:05.037917+0000","last_peered":"2023-07-09T02:21:05.037917+0000","last_clean":"2023-07-09T02:21:05.037917+0000","last_became_active":"2023-07-09T02:21:04.032575+0000","last_became_peered":"2023-07-09T02:21:04.032575+0000","last_unstale":"2023-07-09T02:21:05.037917+0000","last_undegraded":"2023-07-09T02:21:05.037917+0000","last_fullsized":"2023-07-09T02:21:05.037917+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:38:11.242365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019164+0000","last_change":"2023-07-09T02:21:03.018507+0000","last_active":"2023-07-09T02:21:05.019164+0000","last_peered":"2023-07-09T02:21:05.019164+0000","last_clean":"2023-07-09T02:21:05.019164+0000","last_became_active":"2023-07-09T02:21:03.018225+0000","last_became_peered":"2023-07-09T02:21:03.018225+0000","last_unstale":"2023-07-09T02:21:05.019164+0000","last_undegraded":"2023-07-09T02:21:05.019164+0000","last_fullsized":"2023-07-09T02:21:05.019164+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:07:05.122875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037992+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:21:05.037992+0000","last_peered":"2023-07-09T02:21:05.037992+0000","last_clean":"2023-07-09T02:21:05.037992+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:21:05.037992+0000","last_undegraded":"2023-07-09T02:21:05.037992+0000","last_fullsized":"2023-07-09T02:21:05.037992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:02.871333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037936+0000","last_change":"2023-07-09T02:21:04.025885+0000","last_active":"2023-07-09T02:21:05.037936+0000","last_peered":"2023-07-09T02:21:05.037936+0000","last_clean":"2023-07-09T02:21:05.037936+0000","last_became_active":"2023-07-09T02:21:04.025667+0000","last_became_peered":"2023-07-09T02:21:04.025667+0000","last_unstale":"2023-07-09T02:21:05.037936+0000","last_undegraded":"2023-07-09T02:21:05.037936+0000","last_fullsized":"2023-07-09T02:21:05.037936+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:40:00.823368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"165'3","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037788+0000","last_change":"2023-07-09T02:21:03.022978+0000","last_active":"2023-07-09T02:21:05.037788+0000","last_peered":"2023-07-09T02:21:05.037788+0000","last_clean":"2023-07-09T02:21:05.037788+0000","last_became_active":"2023-07-09T02:21:03.022336+0000","last_became_peered":"2023-07-09T02:21:03.022336+0000","last_unstale":"2023-07-09T02:21:05.037788+0000","last_undegraded":"2023-07-09T02:21:05.037788+0000","last_fullsized":"2023-07-09T02:21:05.037788+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:10:56.013990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":301,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019534+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:21:05.019534+0000","last_peered":"2023-07-09T02:21:05.019534+0000","last_clean":"2023-07-09T02:21:05.019534+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:21:05.019534+0000","last_undegraded":"2023-07-09T02:21:05.019534+0000","last_fullsized":"2023-07-09T02:21:05.019534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:09:43.992729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039664+0000","last_change":"2023-07-09T02:21:04.035363+0000","last_active":"2023-07-09T02:21:05.039664+0000","last_peered":"2023-07-09T02:21:05.039664+0000","last_clean":"2023-07-09T02:21:05.039664+0000","last_became_active":"2023-07-09T02:21:04.034375+0000","last_became_peered":"2023-07-09T02:21:04.034375+0000","last_unstale":"2023-07-09T02:21:05.039664+0000","last_undegraded":"2023-07-09T02:21:05.039664+0000","last_fullsized":"2023-07-09T02:21:05.039664+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:36:08.542082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017887+0000","last_change":"2023-07-09T02:21:03.019120+0000","last_active":"2023-07-09T02:21:05.017887+0000","last_peered":"2023-07-09T02:21:05.017887+0000","last_clean":"2023-07-09T02:21:05.017887+0000","last_became_active":"2023-07-09T02:21:03.018879+0000","last_became_peered":"2023-07-09T02:21:03.018879+0000","last_unstale":"2023-07-09T02:21:05.017887+0000","last_undegraded":"2023-07-09T02:21:05.017887+0000","last_fullsized":"2023-07-09T02:21:05.017887+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:33:30.885467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":283,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037935+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:21:05.037935+0000","last_peered":"2023-07-09T02:21:05.037935+0000","last_clean":"2023-07-09T02:21:05.037935+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:21:05.037935+0000","last_undegraded":"2023-07-09T02:21:05.037935+0000","last_fullsized":"2023-07-09T02:21:05.037935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:42:15.513159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038230+0000","last_change":"2023-07-09T02:21:04.038375+0000","last_active":"2023-07-09T02:21:05.038230+0000","last_peered":"2023-07-09T02:21:05.038230+0000","last_clean":"2023-07-09T02:21:05.038230+0000","last_became_active":"2023-07-09T02:21:04.038104+0000","last_became_peered":"2023-07-09T02:21:04.038104+0000","last_unstale":"2023-07-09T02:21:05.038230+0000","last_undegraded":"2023-07-09T02:21:05.038230+0000","last_fullsized":"2023-07-09T02:21:05.038230+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:54:40.186682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039392+0000","last_change":"2023-07-09T02:21:03.030231+0000","last_active":"2023-07-09T02:21:05.039392+0000","last_peered":"2023-07-09T02:21:05.039392+0000","last_clean":"2023-07-09T02:21:05.039392+0000","last_became_active":"2023-07-09T02:21:03.029995+0000","last_became_peered":"2023-07-09T02:21:03.029995+0000","last_unstale":"2023-07-09T02:21:05.039392+0000","last_undegraded":"2023-07-09T02:21:05.039392+0000","last_fullsized":"2023-07-09T02:21:05.039392+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:48:27.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":265,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038500+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:21:05.038500+0000","last_peered":"2023-07-09T02:21:05.038500+0000","last_clean":"2023-07-09T02:21:05.038500+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:21:05.038500+0000","last_undegraded":"2023-07-09T02:21:05.038500+0000","last_fullsized":"2023-07-09T02:21:05.038500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:59:02.778353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017962+0000","last_change":"2023-07-09T02:21:04.025039+0000","last_active":"2023-07-09T02:21:05.017962+0000","last_peered":"2023-07-09T02:21:05.017962+0000","last_clean":"2023-07-09T02:21:05.017962+0000","last_became_active":"2023-07-09T02:21:04.024792+0000","last_became_peered":"2023-07-09T02:21:04.024792+0000","last_unstale":"2023-07-09T02:21:05.017962+0000","last_undegraded":"2023-07-09T02:21:05.017962+0000","last_fullsized":"2023-07-09T02:21:05.017962+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:51:47.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039664+0000","last_change":"2023-07-09T02:21:03.025704+0000","last_active":"2023-07-09T02:21:05.039664+0000","last_peered":"2023-07-09T02:21:05.039664+0000","last_clean":"2023-07-09T02:21:05.039664+0000","last_became_active":"2023-07-09T02:21:03.025485+0000","last_became_peered":"2023-07-09T02:21:03.025485+0000","last_unstale":"2023-07-09T02:21:05.039664+0000","last_undegraded":"2023-07-09T02:21:05.039664+0000","last_fullsized":"2023-07-09T02:21:05.039664+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:14:32.333285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037813+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:21:05.037813+0000","last_peered":"2023-07-09T02:21:05.037813+0000","last_clean":"2023-07-09T02:21:05.037813+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:21:05.037813+0000","last_undegraded":"2023-07-09T02:21:05.037813+0000","last_fullsized":"2023-07-09T02:21:05.037813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:35:09.912358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037669+0000","last_change":"2023-07-09T02:21:04.027075+0000","last_active":"2023-07-09T02:21:05.037669+0000","last_peered":"2023-07-09T02:21:05.037669+0000","last_clean":"2023-07-09T02:21:05.037669+0000","last_became_active":"2023-07-09T02:21:04.026524+0000","last_became_peered":"2023-07-09T02:21:04.026524+0000","last_unstale":"2023-07-09T02:21:05.037669+0000","last_undegraded":"2023-07-09T02:21:05.037669+0000","last_fullsized":"2023-07-09T02:21:05.037669+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:19:35.893404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"165'8","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019158+0000","last_change":"2023-07-09T02:21:03.026697+0000","last_active":"2023-07-09T02:21:05.019158+0000","last_peered":"2023-07-09T02:21:05.019158+0000","last_clean":"2023-07-09T02:21:05.019158+0000","last_became_active":"2023-07-09T02:21:03.026103+0000","last_became_peered":"2023-07-09T02:21:03.026103+0000","last_unstale":"2023-07-09T02:21:05.019158+0000","last_undegraded":"2023-07-09T02:21:05.019158+0000","last_fullsized":"2023-07-09T02:21:05.019158+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:22:29.401743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":263,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.040120+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:21:05.040120+0000","last_peered":"2023-07-09T02:21:05.040120+0000","last_clean":"2023-07-09T02:21:05.040120+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:21:05.040120+0000","last_undegraded":"2023-07-09T02:21:05.040120+0000","last_fullsized":"2023-07-09T02:21:05.040120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:22:01.994929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574970,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1542,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193770,"statfs":{"total":200000000,"available":198420666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":1.204,"15min":1.4950000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.004,"15min":1.2110000000000001},"last":0.501}]},{"osd":1,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83099999999999996,"5min":1.079,"15min":1.423},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68999999999999995,"15min":0.80000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95799999999999996,"5min":1.117,"15min":29.498999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.70599999999999996},"min":{"1min":0.51900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.879,"5min":1.028,"15min":5.0460000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.81299999999999994},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.94599999999999995,"5min":1.01,"15min":26.524000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.72299999999999998,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.95099999999999996,"15min":4.3789999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.77200000000000002},"min":{"1min":0.54300000000000004,"5min":0.5,"15min":0.432},"max":{"1min":0.89900000000000002,"5min":1.242,"15min":10.609999999999999},"last":0.72399999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79000000000000004,"5min":0.91100000000000003,"15min":0.91500000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.59399999999999997,"5min":0.47199999999999998,"15min":0.38100000000000001},"max":{"1min":0.79800000000000004,"5min":1.032,"15min":1.032},"last":0.748}]},{"osd":5,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.84799999999999998,"5min":0.86699999999999999,"15min":0.94999999999999996},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.499,"5min":0.38700000000000001,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":1.048},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.087},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.55700000000000005,"5min":0.37,"15min":0.37},"max":{"1min":0.88600000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":965,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194346,"statfs":{"total":200000000,"available":199010986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.69699999999999995,"15min":0.67400000000000004},"min":{"1min":0.63500000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.69399999999999995,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.94699999999999995,"5min":1.0229999999999999,"15min":1.0269999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.58999999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84599999999999997,"5min":0.99199999999999999,"15min":1.4379999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.63,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.036,"15min":1.165},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.71899999999999997,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.55800000000000005,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.97999999999999998,"5min":1.0169999999999999,"15min":1.0740000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.73599999999999999,"15min":0.71799999999999997},"min":{"1min":0.59399999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":1.45},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.622,"5min":0.498,"15min":0.45700000000000002},"max":{"1min":0.89700000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.998,"15min":1.6499999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.97799999999999998,"15min":1.117},"last":0.621}]},{"osd":5,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.72199999999999998,"5min":0.86299999999999999,"15min":0.88200000000000001},"last":0.436},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.6060000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.74399999999999999,"5min":0.95599999999999996,"15min":1.4059999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.83299999999999996,"5min":0.92900000000000005,"15min":1.0289999999999999},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":965,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194346,"statfs":{"total":200000000,"available":199011056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.67800000000000005,"15min":0.65200000000000002},"min":{"1min":0.49399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":1.248,"15min":1.248},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.179},"last":0.71299999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89100000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70199999999999996,"15min":0.67100000000000004},"min":{"1min":0.622,"5min":0.46500000000000002,"15min":0.39800000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.97299999999999998},"last":0.72899999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.103},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72099999999999997,"15min":0.69799999999999995},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.98599999999999999},"last":0.84899999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76900000000000002,"15min":0.72299999999999998},"min":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.47399999999999998},"max":{"1min":0.98999999999999999,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.59299999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.98399999999999999},"last":0.74299999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56999999999999995,"15min":0.59599999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.314},"max":{"1min":0.86499999999999999,"5min":0.88700000000000001,"15min":1.008},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.90900000000000003,"5min":0.94099999999999995,"15min":1.0720000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.441,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85499999999999998,"5min":1.042,"15min":1.054},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66500000000000004,"15min":0.66800000000000004},"min":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90200000000000002,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70499999999999996,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":1.0049999999999999,"15min":1.1619999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.745,"15min":0.753},"min":{"1min":0.497,"5min":0.437,"15min":0.437},"max":{"1min":1.006,"5min":1.0840000000000001,"15min":1.091},"last":0.79500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.85999999999999999},"min":{"1min":0.505,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":50.508000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.68100000000000005},"min":{"1min":0.39800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.83099999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.56799999999999995,"5min":0.38,"15min":0.34100000000000003},"max":{"1min":0.89300000000000002,"5min":1.024,"15min":8.6039999999999992},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.81999999999999995}]},{"osd":2,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72199999999999998,"15min":0.68400000000000005},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97899999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.747},{"interface":"front","average":{"1min":0.754,"5min":0.755,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96899999999999997,"5min":1.008,"15min":1.323},"last":0.78600000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.70399999999999996},"min":{"1min":0.59599999999999997,"5min":0.49199999999999999,"15min":0.47999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.96499999999999997},"min":{"1min":0.57699999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.0169999999999999,"5min":1.073,"15min":71.909000000000006},"last":0.76600000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.47199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.69999999999999996,"5min":0.94699999999999995,"15min":1.0169999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.45800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.496},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.94099999999999995,"5min":0.98199999999999998,"15min":1.0529999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.71899999999999997},"min":{"1min":0.55500000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92000000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.995,"5min":0.995,"15min":8.0359999999999996},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199017093,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"min":{"1min":0.30599999999999999,"5min":0.217,"15min":0.216},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.96499999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":0.82699999999999996,"15min":1.198},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46000000000000002,"15min":0.46700000000000003},"min":{"1min":0.378,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.56299999999999994,"5min":0.80400000000000005,"15min":1.048},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.85299999999999998},"last":0.51100000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.61199999999999999,"5min":0.76100000000000001,"15min":1.155},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.441,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84799999999999998,"15min":1.1040000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":1.466,"15min":1.466},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.755,"15min":0.72399999999999998},"min":{"1min":0.57299999999999995,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0920000000000001,"5min":1.1899999999999999,"15min":1.3560000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.57699999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.04,"5min":1.097,"15min":1.3420000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.77700000000000002,"15min":0.76200000000000001},"min":{"1min":0.60699999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.054,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.622,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98699999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.627},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.65200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.0369999999999999,"5min":1.395,"15min":1.5569999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.52000000000000002},"max":{"1min":1.073,"5min":1.3149999999999999,"15min":1.367},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78300000000000003,"15min":0.77400000000000002},"min":{"1min":0.60499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574970,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194353,"statfs":{"total":200000000,"available":199017597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.33400000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":7.7450000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.44},"min":{"1min":0.39200000000000002,"5min":0.29799999999999999,"15min":0.255},"max":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":1.127},"last":0.35699999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.46200000000000002},"min":{"1min":0.379,"5min":0.308,"15min":0.26800000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":2.8879999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.56299999999999994,"15min":0.53800000000000003},"min":{"1min":0.47499999999999998,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":2.0600000000000001},"last":0.45300000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.42199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.438,"5min":0.33600000000000002,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":7.8710000000000004},"last":0.438}]},{"osd":4,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.47199999999999998,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":1.081,"15min":7.7990000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79300000000000004,"15min":0.74299999999999999},"min":{"1min":0.64900000000000002,"5min":0.51000000000000001,"15min":0.47899999999999998},"max":{"1min":0.95799999999999996,"5min":1.821,"15min":1.821},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.66700000000000004,"5min":0.51000000000000001,"15min":0.496},"max":{"1min":0.97399999999999998,"5min":1.052,"15min":1.319},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.58599999999999997,"5min":0.5,"15min":0.5},"max":{"1min":0.97999999999999998,"5min":1.99,"15min":7.8369999999999997},"last":0.64400000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79600000000000004,"15min":0.77700000000000002},"min":{"1min":0.66200000000000003,"5min":0.53900000000000003,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80200000000000005,"15min":0.80900000000000005},"min":{"1min":0.68200000000000005,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":0.97199999999999998,"5min":1.0580000000000001,"15min":1.452},"last":0.65700000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.74099999999999999},"min":{"1min":0.64400000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97799999999999998,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77000000000000002,"15min":0.77100000000000002},"min":{"1min":0.67600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95599999999999996,"5min":1.0049999999999999,"15min":1.351},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194353,"statfs":{"total":200000000,"available":199017639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.34000000000000002,"5min":0.26500000000000001,"15min":0.25},"max":{"1min":0.54400000000000004,"5min":0.72499999999999998,"15min":0.80300000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.47799999999999998},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37}]},{"osd":2,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.495},"min":{"1min":0.42599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66300000000000003,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.432},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.39900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.96999999999999997,"15min":1.1080000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.495,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77600000000000002,"5min":0.84499999999999997,"15min":0.85099999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":0.73099999999999998,"15min":1.163},"last":0.46899999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.53600000000000003,"15min":0.46800000000000003},"max":{"1min":1.069,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79600000000000004,"15min":0.76000000000000001},"min":{"1min":0.68700000000000006,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.095,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.73899999999999999},"min":{"1min":0.627,"5min":0.53400000000000003,"15min":0.46500000000000002},"max":{"1min":1.0369999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.878},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.57199999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.78600000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.64300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82099999999999995,"15min":0.79500000000000004},"min":{"1min":0.66300000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.996,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.94099999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.61299999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94799999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1544,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193767,"statfs":{"total":200000000,"available":198418418,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.47999999999999998,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.72599999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.49099999999999999},"min":{"1min":0.47799999999999998,"5min":0.36699999999999999,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":1.1180000000000001,"15min":1.3240000000000001},"last":0.433}]},{"osd":2,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.46700000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.505,"15min":0.46600000000000003},"min":{"1min":0.41899999999999998,"5min":0.313,"15min":0.29899999999999999},"max":{"1min":0.76600000000000001,"5min":1.161,"15min":1.4139999999999999},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.441},"min":{"1min":0.41299999999999998,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":0.70099999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55300000000000005,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76500000000000001,"5min":0.89200000000000002,"15min":3.8929999999999998},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77800000000000002,"15min":0.77000000000000002},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.089,"5min":1.1439999999999999,"15min":1.145},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.71199999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0580000000000001,"5min":1.1240000000000001,"15min":1.153},"last":0.70999999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"max":{"1min":1.0389999999999999,"5min":1.401,"15min":1.4350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.80300000000000005,"15min":0.79000000000000004},"min":{"1min":0.64600000000000002,"5min":0.504,"15min":0.46100000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.238},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.751,"15min":0.745},"min":{"1min":0.62,"5min":0.48699999999999999,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.117,"15min":1.117},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.78800000000000003,"15min":0.77700000000000002},"min":{"1min":0.66300000000000003,"5min":0.51000000000000001,"15min":0.49099999999999999},"max":{"1min":1.079,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.63600000000000001,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.69199999999999995}]}]}],"pool_statfs":[]}} 2023-07-09T02:21:08.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:21:08.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dc2fba640 1 Processor -- start 2023-07-09T02:21:08.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dc2fba640 1 -- start start 2023-07-09T02:21:08.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dc2fba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8dbc0d2620 0x7f8dbc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dc2fba640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc160a50 con 0x7f8dbc15c060 2023-07-09T02:21:08.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dc2fba640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc15c430 con 0x7f8dbc0cd120 2023-07-09T02:21:08.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dc2fba640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc15fb60 con 0x7f8dbc0d2620 2023-07-09T02:21:08.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dc0d56640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8dbc15c060 0x7f8dbc0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44342/0 (socket says 172.21.15.45:44342) 2023-07-09T02:21:08.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dc0d56640 1 -- 172.21.15.45:0/2558879181 learned_addr learned my addr 172.21.15.45:0/2558879181 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:08.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dbbfff640 1 --2- 172.21.15.45:0/2558879181 >> v2:172.21.15.45:3300/0 conn(0x7f8dbc0d2620 0x7f8dbc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dbb7fe640 1 -- 172.21.15.45:0/2558879181 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368223018 0 0) 0x7f8dbc160a50 con 0x7f8dbc15c060 2023-07-09T02:21:08.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dbb7fe640 1 -- 172.21.15.45:0/2558879181 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac003530 con 0x7f8dbc15c060 2023-07-09T02:21:08.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2558879181 >> v1:172.21.15.155:6789/0 conn(0x7f8dbc0cd120 legacy=0x7f8dbc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2558879181 >> v1:172.21.15.45:6789/0 conn(0x7f8dbc15c060 legacy=0x7f8dbc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.310+0000 7f8dbbfff640 1 -- 172.21.15.45:0/2558879181 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc15fe40 con 0x7f8dbc0d2620 2023-07-09T02:21:08.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dbbfff640 1 --2- 172.21.15.45:0/2558879181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0d2620 0x7f8dbc0b4ed0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8da80097c0 tx=0x7f8da801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c06edb065a3cdfc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:08.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dbb7fe640 1 -- 172.21.15.45:0/2558879181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da80ab650 con 0x7f8dbc0d2620 2023-07-09T02:21:08.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dbb7fe640 1 -- 172.21.15.45:0/2558879181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da80ab7b0 con 0x7f8dbc0d2620 2023-07-09T02:21:08.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dbb7fe640 1 -- 172.21.15.45:0/2558879181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da80abb20 con 0x7f8dbc0d2620 2023-07-09T02:21:08.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2558879181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0d2620 msgr2=0x7f8dbc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dc2fba640 1 --2- 172.21.15.45:0/2558879181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0d2620 0x7f8dbc0b4ed0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8da80097c0 tx=0x7f8da801c450 comp rx=0 tx=0).stop 2023-07-09T02:21:08.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2558879181 shutdown_connections 2023-07-09T02:21:08.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dc2fba640 1 --2- 172.21.15.45:0/2558879181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0d2620 0x7f8dbc0b4ed0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2558879181 >> 172.21.15.45:0/2558879181 conn(0x7f8dbc0698e0 msgr2=0x7f8dbc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:08.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2558879181 shutdown_connections 2023-07-09T02:21:08.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.314+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2558879181 wait complete. 2023-07-09T02:21:08.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 Processor -- start 2023-07-09T02:21:08.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 -- start start 2023-07-09T02:21:08.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0cd120 0x7f8dbc15d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc0d2620 0x7f8dbc14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc15c060 0x7f8dbc0ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc1503a0 con 0x7f8dbc0cd120 2023-07-09T02:21:08.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc15dd80 con 0x7f8dbc0d2620 2023-07-09T02:21:08.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc155930 con 0x7f8dbc15c060 2023-07-09T02:21:08.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0cd120 0x7f8dbc15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0cd120 0x7f8dbc15d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60928/0 (socket says 172.21.15.45:60928) 2023-07-09T02:21:08.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 -- 172.21.15.45:0/2451085386 learned_addr learned my addr 172.21.15.45:0/2451085386 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:08.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dbbfff640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc0d2620 0x7f8dbc14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc1557640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc15c060 0x7f8dbc0ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 -- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc15c060 msgr2=0x7f8dbc0ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc15c060 0x7f8dbc0ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 -- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc0d2620 msgr2=0x7f8dbc14f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc0d2620 0x7f8dbc14f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 -- 172.21.15.45:0/2451085386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da8009420 con 0x7f8dbc0cd120 2023-07-09T02:21:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dbbfff640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc0d2620 0x7f8dbc14f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc0d56640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0cd120 0x7f8dbc15d840 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8db000c450 tx=0x7f8db000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8db97fa640 1 -- 172.21.15.45:0/2451085386 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0005cf0 con 0x7f8dbc0cd120 2023-07-09T02:21:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8db97fa640 1 -- 172.21.15.45:0/2451085386 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0005e50 con 0x7f8dbc0cd120 2023-07-09T02:21:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8db97fa640 1 -- 172.21.15.45:0/2451085386 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0007270 con 0x7f8dbc0cd120 2023-07-09T02:21:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc0b59f0 con 0x7f8dbc0cd120 2023-07-09T02:21:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.318+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc153e80 con 0x7f8dbc0cd120 2023-07-09T02:21:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.322+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc1606c0 con 0x7f8dbc0cd120 2023-07-09T02:21:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.322+0000 7f8db97fa640 1 -- 172.21.15.45:0/2451085386 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8db00073d0 con 0x7f8dbc0cd120 2023-07-09T02:21:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.322+0000 7f8db97fa640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8da00662b0 0x7f8da0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.322+0000 7f8db97fa640 1 -- 172.21.15.45:0/2451085386 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8db0083210 con 0x7f8dbc0cd120 2023-07-09T02:21:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.322+0000 7f8dbbfff640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8da00662b0 0x7f8da0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.322+0000 7f8dbbfff640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8da00662b0 0x7f8da0068760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8da80af000 tx=0x7f8da80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.326+0000 7f8db97fa640 1 -- 172.21.15.45:0/2451085386 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8dbc1606c0 con 0x7f8dbc0cd120 2023-07-09T02:21:08.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.478+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8dbc0b5870 con 0x7f8da00662b0 2023-07-09T02:21:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.486+0000 7f8db97fa640 1 -- 172.21.15.45:0/2451085386 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305800 (secure 0 0 0) 0x7f8da80ab450 con 0x7f8da00662b0 2023-07-09T02:21:08.487 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:21:08.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8da00662b0 msgr2=0x7f8da0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8da00662b0 0x7f8da0068760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8da80af000 tx=0x7f8da80a7000 comp rx=0 tx=0).stop 2023-07-09T02:21:08.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0cd120 msgr2=0x7f8dbc15d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0cd120 0x7f8dbc15d840 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8db000c450 tx=0x7f8db000c910 comp rx=0 tx=0).stop 2023-07-09T02:21:08.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 shutdown_connections 2023-07-09T02:21:08.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8da00662b0 0x7f8da0068760 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc15c060 0x7f8dbc0ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc0d2620 0x7f8dbc14f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 --2- 172.21.15.45:0/2451085386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dbc0cd120 0x7f8dbc15d840 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 >> 172.21.15.45:0/2451085386 conn(0x7f8dbc0698e0 msgr2=0x7f8dbc0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:08.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 shutdown_connections 2023-07-09T02:21:08.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.490+0000 7f8dc2fba640 1 -- 172.21.15.45:0/2451085386 wait complete. 2023-07-09T02:21:08.508 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":458,"stamp":"2023-07-09T02:21:06.673935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8864,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553635,"statfs":{"total":1600000000,"available":1590922947,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.666487"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019076+0000","last_change":"2023-07-09T02:21:04.040238+0000","last_active":"2023-07-09T02:21:05.019076+0000","last_peered":"2023-07-09T02:21:05.019076+0000","last_clean":"2023-07-09T02:21:05.019076+0000","last_became_active":"2023-07-09T02:21:04.040024+0000","last_became_peered":"2023-07-09T02:21:04.040024+0000","last_unstale":"2023-07-09T02:21:05.019076+0000","last_undegraded":"2023-07-09T02:21:05.019076+0000","last_fullsized":"2023-07-09T02:21:05.019076+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:47:30.653683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038134+0000","last_change":"2023-07-09T02:21:04.039401+0000","last_active":"2023-07-09T02:21:05.038134+0000","last_peered":"2023-07-09T02:21:05.038134+0000","last_clean":"2023-07-09T02:21:05.038134+0000","last_became_active":"2023-07-09T02:21:04.039158+0000","last_became_peered":"2023-07-09T02:21:04.039158+0000","last_unstale":"2023-07-09T02:21:05.038134+0000","last_undegraded":"2023-07-09T02:21:05.038134+0000","last_fullsized":"2023-07-09T02:21:05.038134+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:55:31.809427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037741+0000","last_change":"2023-07-09T02:21:04.031554+0000","last_active":"2023-07-09T02:21:05.037741+0000","last_peered":"2023-07-09T02:21:05.037741+0000","last_clean":"2023-07-09T02:21:05.037741+0000","last_became_active":"2023-07-09T02:21:04.031291+0000","last_became_peered":"2023-07-09T02:21:04.031291+0000","last_unstale":"2023-07-09T02:21:05.037741+0000","last_undegraded":"2023-07-09T02:21:05.037741+0000","last_fullsized":"2023-07-09T02:21:05.037741+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:30:03.175313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038137+0000","last_change":"2023-07-09T02:21:04.034372+0000","last_active":"2023-07-09T02:21:05.038137+0000","last_peered":"2023-07-09T02:21:05.038137+0000","last_clean":"2023-07-09T02:21:05.038137+0000","last_became_active":"2023-07-09T02:21:04.033183+0000","last_became_peered":"2023-07-09T02:21:04.033183+0000","last_unstale":"2023-07-09T02:21:05.038137+0000","last_undegraded":"2023-07-09T02:21:05.038137+0000","last_fullsized":"2023-07-09T02:21:05.038137+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:14:39.212672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017663+0000","last_change":"2023-07-09T02:21:04.022829+0000","last_active":"2023-07-09T02:21:05.017663+0000","last_peered":"2023-07-09T02:21:05.017663+0000","last_clean":"2023-07-09T02:21:05.017663+0000","last_became_active":"2023-07-09T02:21:04.022310+0000","last_became_peered":"2023-07-09T02:21:04.022310+0000","last_unstale":"2023-07-09T02:21:05.017663+0000","last_undegraded":"2023-07-09T02:21:05.017663+0000","last_fullsized":"2023-07-09T02:21:05.017663+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:05.445009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017431+0000","last_change":"2023-07-09T02:21:04.021823+0000","last_active":"2023-07-09T02:21:05.017431+0000","last_peered":"2023-07-09T02:21:05.017431+0000","last_clean":"2023-07-09T02:21:05.017431+0000","last_became_active":"2023-07-09T02:21:04.021564+0000","last_became_peered":"2023-07-09T02:21:04.021564+0000","last_unstale":"2023-07-09T02:21:05.017431+0000","last_undegraded":"2023-07-09T02:21:05.017431+0000","last_fullsized":"2023-07-09T02:21:05.017431+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:08:10.029533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018839+0000","last_change":"2023-07-09T02:21:04.032141+0000","last_active":"2023-07-09T02:21:05.018839+0000","last_peered":"2023-07-09T02:21:05.018839+0000","last_clean":"2023-07-09T02:21:05.018839+0000","last_became_active":"2023-07-09T02:21:04.031781+0000","last_became_peered":"2023-07-09T02:21:04.031781+0000","last_unstale":"2023-07-09T02:21:05.018839+0000","last_undegraded":"2023-07-09T02:21:05.018839+0000","last_fullsized":"2023-07-09T02:21:05.018839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:51:26.729074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039531+0000","last_change":"2023-07-09T02:21:04.035521+0000","last_active":"2023-07-09T02:21:05.039531+0000","last_peered":"2023-07-09T02:21:05.039531+0000","last_clean":"2023-07-09T02:21:05.039531+0000","last_became_active":"2023-07-09T02:21:04.034705+0000","last_became_peered":"2023-07-09T02:21:04.034705+0000","last_unstale":"2023-07-09T02:21:05.039531+0000","last_undegraded":"2023-07-09T02:21:05.039531+0000","last_fullsized":"2023-07-09T02:21:05.039531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:51:29.490163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017564+0000","last_change":"2023-07-09T02:21:04.032400+0000","last_active":"2023-07-09T02:21:05.017564+0000","last_peered":"2023-07-09T02:21:05.017564+0000","last_clean":"2023-07-09T02:21:05.017564+0000","last_became_active":"2023-07-09T02:21:04.032191+0000","last_became_peered":"2023-07-09T02:21:04.032191+0000","last_unstale":"2023-07-09T02:21:05.017564+0000","last_undegraded":"2023-07-09T02:21:05.017564+0000","last_fullsized":"2023-07-09T02:21:05.017564+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:35:26.131940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017761+0000","last_change":"2023-07-09T02:21:04.019167+0000","last_active":"2023-07-09T02:21:05.017761+0000","last_peered":"2023-07-09T02:21:05.017761+0000","last_clean":"2023-07-09T02:21:05.017761+0000","last_became_active":"2023-07-09T02:21:04.018950+0000","last_became_peered":"2023-07-09T02:21:04.018950+0000","last_unstale":"2023-07-09T02:21:05.017761+0000","last_undegraded":"2023-07-09T02:21:05.017761+0000","last_fullsized":"2023-07-09T02:21:05.017761+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:18:54.479029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038095+0000","last_change":"2023-07-09T02:21:04.032676+0000","last_active":"2023-07-09T02:21:05.038095+0000","last_peered":"2023-07-09T02:21:05.038095+0000","last_clean":"2023-07-09T02:21:05.038095+0000","last_became_active":"2023-07-09T02:21:04.032463+0000","last_became_peered":"2023-07-09T02:21:04.032463+0000","last_unstale":"2023-07-09T02:21:05.038095+0000","last_undegraded":"2023-07-09T02:21:05.038095+0000","last_fullsized":"2023-07-09T02:21:05.038095+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:38:22.576053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039474+0000","last_change":"2023-07-09T02:21:04.038976+0000","last_active":"2023-07-09T02:21:05.039474+0000","last_peered":"2023-07-09T02:21:05.039474+0000","last_clean":"2023-07-09T02:21:05.039474+0000","last_became_active":"2023-07-09T02:21:04.038355+0000","last_became_peered":"2023-07-09T02:21:04.038355+0000","last_unstale":"2023-07-09T02:21:05.039474+0000","last_undegraded":"2023-07-09T02:21:05.039474+0000","last_fullsized":"2023-07-09T02:21:05.039474+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:09.947632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017262+0000","last_change":"2023-07-09T02:21:04.018128+0000","last_active":"2023-07-09T02:21:05.017262+0000","last_peered":"2023-07-09T02:21:05.017262+0000","last_clean":"2023-07-09T02:21:05.017262+0000","last_became_active":"2023-07-09T02:21:04.017888+0000","last_became_peered":"2023-07-09T02:21:04.017888+0000","last_unstale":"2023-07-09T02:21:05.017262+0000","last_undegraded":"2023-07-09T02:21:05.017262+0000","last_fullsized":"2023-07-09T02:21:05.017262+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:49:40.780817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038271+0000","last_change":"2023-07-09T02:21:04.034235+0000","last_active":"2023-07-09T02:21:05.038271+0000","last_peered":"2023-07-09T02:21:05.038271+0000","last_clean":"2023-07-09T02:21:05.038271+0000","last_became_active":"2023-07-09T02:21:04.032882+0000","last_became_peered":"2023-07-09T02:21:04.032882+0000","last_unstale":"2023-07-09T02:21:05.038271+0000","last_undegraded":"2023-07-09T02:21:05.038271+0000","last_fullsized":"2023-07-09T02:21:05.038271+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:49:21.992883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037350+0000","last_change":"2023-07-09T02:21:04.031025+0000","last_active":"2023-07-09T02:21:05.037350+0000","last_peered":"2023-07-09T02:21:05.037350+0000","last_clean":"2023-07-09T02:21:05.037350+0000","last_became_active":"2023-07-09T02:21:04.030473+0000","last_became_peered":"2023-07-09T02:21:04.030473+0000","last_unstale":"2023-07-09T02:21:05.037350+0000","last_undegraded":"2023-07-09T02:21:05.037350+0000","last_fullsized":"2023-07-09T02:21:05.037350+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:08:21.100884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017580+0000","last_change":"2023-07-09T02:21:04.039948+0000","last_active":"2023-07-09T02:21:05.017580+0000","last_peered":"2023-07-09T02:21:05.017580+0000","last_clean":"2023-07-09T02:21:05.017580+0000","last_became_active":"2023-07-09T02:21:04.039774+0000","last_became_peered":"2023-07-09T02:21:04.039774+0000","last_unstale":"2023-07-09T02:21:05.017580+0000","last_undegraded":"2023-07-09T02:21:05.017580+0000","last_fullsized":"2023-07-09T02:21:05.017580+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:06:13.954365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039908+0000","last_change":"2023-07-09T02:21:04.038739+0000","last_active":"2023-07-09T02:21:05.039908+0000","last_peered":"2023-07-09T02:21:05.039908+0000","last_clean":"2023-07-09T02:21:05.039908+0000","last_became_active":"2023-07-09T02:21:04.037510+0000","last_became_peered":"2023-07-09T02:21:04.037510+0000","last_unstale":"2023-07-09T02:21:05.039908+0000","last_undegraded":"2023-07-09T02:21:05.039908+0000","last_fullsized":"2023-07-09T02:21:05.039908+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:47:54.333371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037417+0000","last_change":"2023-07-09T02:21:04.026181+0000","last_active":"2023-07-09T02:21:05.037417+0000","last_peered":"2023-07-09T02:21:05.037417+0000","last_clean":"2023-07-09T02:21:05.037417+0000","last_became_active":"2023-07-09T02:21:04.025909+0000","last_became_peered":"2023-07-09T02:21:04.025909+0000","last_unstale":"2023-07-09T02:21:05.037417+0000","last_undegraded":"2023-07-09T02:21:05.037417+0000","last_fullsized":"2023-07-09T02:21:05.037417+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:19:11.093160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038420+0000","last_change":"2023-07-09T02:21:04.038486+0000","last_active":"2023-07-09T02:21:05.038420+0000","last_peered":"2023-07-09T02:21:05.038420+0000","last_clean":"2023-07-09T02:21:05.038420+0000","last_became_active":"2023-07-09T02:21:04.038040+0000","last_became_peered":"2023-07-09T02:21:04.038040+0000","last_unstale":"2023-07-09T02:21:05.038420+0000","last_undegraded":"2023-07-09T02:21:05.038420+0000","last_fullsized":"2023-07-09T02:21:05.038420+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:15:59.159625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018900+0000","last_change":"2023-07-09T02:21:04.025069+0000","last_active":"2023-07-09T02:21:05.018900+0000","last_peered":"2023-07-09T02:21:05.018900+0000","last_clean":"2023-07-09T02:21:05.018900+0000","last_became_active":"2023-07-09T02:21:04.024338+0000","last_became_peered":"2023-07-09T02:21:04.024338+0000","last_unstale":"2023-07-09T02:21:05.018900+0000","last_undegraded":"2023-07-09T02:21:05.018900+0000","last_fullsized":"2023-07-09T02:21:05.018900+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:28:41.223912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017707+0000","last_change":"2023-07-09T02:21:04.034290+0000","last_active":"2023-07-09T02:21:05.017707+0000","last_peered":"2023-07-09T02:21:05.017707+0000","last_clean":"2023-07-09T02:21:05.017707+0000","last_became_active":"2023-07-09T02:21:04.033415+0000","last_became_peered":"2023-07-09T02:21:04.033415+0000","last_unstale":"2023-07-09T02:21:05.017707+0000","last_undegraded":"2023-07-09T02:21:05.017707+0000","last_fullsized":"2023-07-09T02:21:05.017707+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:20:09.535527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019024+0000","last_change":"2023-07-09T02:21:04.031999+0000","last_active":"2023-07-09T02:21:05.019024+0000","last_peered":"2023-07-09T02:21:05.019024+0000","last_clean":"2023-07-09T02:21:05.019024+0000","last_became_active":"2023-07-09T02:21:04.031493+0000","last_became_peered":"2023-07-09T02:21:04.031493+0000","last_unstale":"2023-07-09T02:21:05.019024+0000","last_undegraded":"2023-07-09T02:21:05.019024+0000","last_fullsized":"2023-07-09T02:21:05.019024+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:01:39.607099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039600+0000","last_change":"2023-07-09T02:21:04.035214+0000","last_active":"2023-07-09T02:21:05.039600+0000","last_peered":"2023-07-09T02:21:05.039600+0000","last_clean":"2023-07-09T02:21:05.039600+0000","last_became_active":"2023-07-09T02:21:04.034053+0000","last_became_peered":"2023-07-09T02:21:04.034053+0000","last_unstale":"2023-07-09T02:21:05.039600+0000","last_undegraded":"2023-07-09T02:21:05.039600+0000","last_fullsized":"2023-07-09T02:21:05.039600+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:48:28.996991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037542+0000","last_change":"2023-07-09T02:21:04.022399+0000","last_active":"2023-07-09T02:21:05.037542+0000","last_peered":"2023-07-09T02:21:05.037542+0000","last_clean":"2023-07-09T02:21:05.037542+0000","last_became_active":"2023-07-09T02:21:04.022187+0000","last_became_peered":"2023-07-09T02:21:04.022187+0000","last_unstale":"2023-07-09T02:21:05.037542+0000","last_undegraded":"2023-07-09T02:21:05.037542+0000","last_fullsized":"2023-07-09T02:21:05.037542+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:08:28.535238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019389+0000","last_change":"2023-07-09T02:21:04.023873+0000","last_active":"2023-07-09T02:21:05.019389+0000","last_peered":"2023-07-09T02:21:05.019389+0000","last_clean":"2023-07-09T02:21:05.019389+0000","last_became_active":"2023-07-09T02:21:04.023176+0000","last_became_peered":"2023-07-09T02:21:04.023176+0000","last_unstale":"2023-07-09T02:21:05.019389+0000","last_undegraded":"2023-07-09T02:21:05.019389+0000","last_fullsized":"2023-07-09T02:21:05.019389+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:53.230526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019235+0000","last_change":"2023-07-09T02:21:04.026319+0000","last_active":"2023-07-09T02:21:05.019235+0000","last_peered":"2023-07-09T02:21:05.019235+0000","last_clean":"2023-07-09T02:21:05.019235+0000","last_became_active":"2023-07-09T02:21:04.026098+0000","last_became_peered":"2023-07-09T02:21:04.026098+0000","last_unstale":"2023-07-09T02:21:05.019235+0000","last_undegraded":"2023-07-09T02:21:05.019235+0000","last_fullsized":"2023-07-09T02:21:05.019235+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:41:48.857507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017431+0000","last_change":"2023-07-09T02:21:04.031467+0000","last_active":"2023-07-09T02:21:05.017431+0000","last_peered":"2023-07-09T02:21:05.017431+0000","last_clean":"2023-07-09T02:21:05.017431+0000","last_became_active":"2023-07-09T02:21:04.031178+0000","last_became_peered":"2023-07-09T02:21:04.031178+0000","last_unstale":"2023-07-09T02:21:05.017431+0000","last_undegraded":"2023-07-09T02:21:05.017431+0000","last_fullsized":"2023-07-09T02:21:05.017431+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:25:48.262014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037542+0000","last_change":"2023-07-09T02:21:04.024802+0000","last_active":"2023-07-09T02:21:05.037542+0000","last_peered":"2023-07-09T02:21:05.037542+0000","last_clean":"2023-07-09T02:21:05.037542+0000","last_became_active":"2023-07-09T02:21:04.024454+0000","last_became_peered":"2023-07-09T02:21:04.024454+0000","last_unstale":"2023-07-09T02:21:05.037542+0000","last_undegraded":"2023-07-09T02:21:05.037542+0000","last_fullsized":"2023-07-09T02:21:05.037542+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:59:49.450145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038447+0000","last_change":"2023-07-09T02:21:04.038472+0000","last_active":"2023-07-09T02:21:05.038447+0000","last_peered":"2023-07-09T02:21:05.038447+0000","last_clean":"2023-07-09T02:21:05.038447+0000","last_became_active":"2023-07-09T02:21:04.037564+0000","last_became_peered":"2023-07-09T02:21:04.037564+0000","last_unstale":"2023-07-09T02:21:05.038447+0000","last_undegraded":"2023-07-09T02:21:05.038447+0000","last_fullsized":"2023-07-09T02:21:05.038447+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:18:03.454505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038165+0000","last_change":"2023-07-09T02:21:04.031131+0000","last_active":"2023-07-09T02:21:05.038165+0000","last_peered":"2023-07-09T02:21:05.038165+0000","last_clean":"2023-07-09T02:21:05.038165+0000","last_became_active":"2023-07-09T02:21:04.030909+0000","last_became_peered":"2023-07-09T02:21:04.030909+0000","last_unstale":"2023-07-09T02:21:05.038165+0000","last_undegraded":"2023-07-09T02:21:05.038165+0000","last_fullsized":"2023-07-09T02:21:05.038165+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:48:29.250410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017839+0000","last_change":"2023-07-09T02:21:04.034423+0000","last_active":"2023-07-09T02:21:05.017839+0000","last_peered":"2023-07-09T02:21:05.017839+0000","last_clean":"2023-07-09T02:21:05.017839+0000","last_became_active":"2023-07-09T02:21:04.034074+0000","last_became_peered":"2023-07-09T02:21:04.034074+0000","last_unstale":"2023-07-09T02:21:05.017839+0000","last_undegraded":"2023-07-09T02:21:05.017839+0000","last_fullsized":"2023-07-09T02:21:05.017839+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:29:38.132088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039172+0000","last_change":"2023-07-09T02:21:04.036966+0000","last_active":"2023-07-09T02:21:05.039172+0000","last_peered":"2023-07-09T02:21:05.039172+0000","last_clean":"2023-07-09T02:21:05.039172+0000","last_became_active":"2023-07-09T02:21:04.036490+0000","last_became_peered":"2023-07-09T02:21:04.036490+0000","last_unstale":"2023-07-09T02:21:05.039172+0000","last_undegraded":"2023-07-09T02:21:05.039172+0000","last_fullsized":"2023-07-09T02:21:05.039172+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:57:30.662187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037516+0000","last_change":"2023-07-09T02:21:04.034004+0000","last_active":"2023-07-09T02:21:05.037516+0000","last_peered":"2023-07-09T02:21:05.037516+0000","last_clean":"2023-07-09T02:21:05.037516+0000","last_became_active":"2023-07-09T02:21:04.033723+0000","last_became_peered":"2023-07-09T02:21:04.033723+0000","last_unstale":"2023-07-09T02:21:05.037516+0000","last_undegraded":"2023-07-09T02:21:05.037516+0000","last_fullsized":"2023-07-09T02:21:05.037516+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:35:03.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"165'4","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017479+0000","last_change":"2023-07-09T02:21:03.020452+0000","last_active":"2023-07-09T02:21:05.017479+0000","last_peered":"2023-07-09T02:21:05.017479+0000","last_clean":"2023-07-09T02:21:05.017479+0000","last_became_active":"2023-07-09T02:21:03.020052+0000","last_became_peered":"2023-07-09T02:21:03.020052+0000","last_unstale":"2023-07-09T02:21:05.017479+0000","last_undegraded":"2023-07-09T02:21:05.017479+0000","last_fullsized":"2023-07-09T02:21:05.017479+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:05:33.085357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037479+0000","last_change":"2023-07-09T02:21:04.031183+0000","last_active":"2023-07-09T02:21:05.037479+0000","last_peered":"2023-07-09T02:21:05.037479+0000","last_clean":"2023-07-09T02:21:05.037479+0000","last_became_active":"2023-07-09T02:21:04.030804+0000","last_became_peered":"2023-07-09T02:21:04.030804+0000","last_unstale":"2023-07-09T02:21:05.037479+0000","last_undegraded":"2023-07-09T02:21:05.037479+0000","last_fullsized":"2023-07-09T02:21:05.037479+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:53.230526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038084+0000","last_change":"2023-07-09T02:21:03.029177+0000","last_active":"2023-07-09T02:21:05.038084+0000","last_peered":"2023-07-09T02:21:05.038084+0000","last_clean":"2023-07-09T02:21:05.038084+0000","last_became_active":"2023-07-09T02:21:03.028920+0000","last_became_peered":"2023-07-09T02:21:03.028920+0000","last_unstale":"2023-07-09T02:21:05.038084+0000","last_undegraded":"2023-07-09T02:21:05.038084+0000","last_fullsized":"2023-07-09T02:21:05.038084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:00:57.113583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038061+0000","last_change":"2023-07-09T02:21:04.038646+0000","last_active":"2023-07-09T02:21:05.038061+0000","last_peered":"2023-07-09T02:21:05.038061+0000","last_clean":"2023-07-09T02:21:05.038061+0000","last_became_active":"2023-07-09T02:21:04.037856+0000","last_became_peered":"2023-07-09T02:21:04.037856+0000","last_unstale":"2023-07-09T02:21:05.038061+0000","last_undegraded":"2023-07-09T02:21:05.038061+0000","last_fullsized":"2023-07-09T02:21:05.038061+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:35:29.797400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038884+0000","last_change":"2023-07-09T02:21:03.023434+0000","last_active":"2023-07-09T02:21:05.038884+0000","last_peered":"2023-07-09T02:21:05.038884+0000","last_clean":"2023-07-09T02:21:05.038884+0000","last_became_active":"2023-07-09T02:21:03.023113+0000","last_became_peered":"2023-07-09T02:21:03.023113+0000","last_unstale":"2023-07-09T02:21:05.038884+0000","last_undegraded":"2023-07-09T02:21:05.038884+0000","last_fullsized":"2023-07-09T02:21:05.038884+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:46:40.304035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039238+0000","last_change":"2023-07-09T02:21:04.031226+0000","last_active":"2023-07-09T02:21:05.039238+0000","last_peered":"2023-07-09T02:21:05.039238+0000","last_clean":"2023-07-09T02:21:05.039238+0000","last_became_active":"2023-07-09T02:21:04.030980+0000","last_became_peered":"2023-07-09T02:21:04.030980+0000","last_unstale":"2023-07-09T02:21:05.039238+0000","last_undegraded":"2023-07-09T02:21:05.039238+0000","last_fullsized":"2023-07-09T02:21:05.039238+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:29:45.348829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037644+0000","last_change":"2023-07-09T02:21:03.025013+0000","last_active":"2023-07-09T02:21:05.037644+0000","last_peered":"2023-07-09T02:21:05.037644+0000","last_clean":"2023-07-09T02:21:05.037644+0000","last_became_active":"2023-07-09T02:21:03.024760+0000","last_became_peered":"2023-07-09T02:21:03.024760+0000","last_unstale":"2023-07-09T02:21:05.037644+0000","last_undegraded":"2023-07-09T02:21:05.037644+0000","last_fullsized":"2023-07-09T02:21:05.037644+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:09:33.786019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018525+0000","last_change":"2023-07-09T02:21:04.025276+0000","last_active":"2023-07-09T02:21:05.018525+0000","last_peered":"2023-07-09T02:21:05.018525+0000","last_clean":"2023-07-09T02:21:05.018525+0000","last_became_active":"2023-07-09T02:21:04.024809+0000","last_became_peered":"2023-07-09T02:21:04.024809+0000","last_unstale":"2023-07-09T02:21:05.018525+0000","last_undegraded":"2023-07-09T02:21:05.018525+0000","last_fullsized":"2023-07-09T02:21:05.018525+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:58.164376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039376+0000","last_change":"2023-07-09T02:21:03.029649+0000","last_active":"2023-07-09T02:21:05.039376+0000","last_peered":"2023-07-09T02:21:05.039376+0000","last_clean":"2023-07-09T02:21:05.039376+0000","last_became_active":"2023-07-09T02:21:03.029371+0000","last_became_peered":"2023-07-09T02:21:03.029371+0000","last_unstale":"2023-07-09T02:21:05.039376+0000","last_undegraded":"2023-07-09T02:21:05.039376+0000","last_fullsized":"2023-07-09T02:21:05.039376+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:18:42.070899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038393+0000","last_change":"2023-07-09T02:21:04.034526+0000","last_active":"2023-07-09T02:21:05.038393+0000","last_peered":"2023-07-09T02:21:05.038393+0000","last_clean":"2023-07-09T02:21:05.038393+0000","last_became_active":"2023-07-09T02:21:04.033642+0000","last_became_peered":"2023-07-09T02:21:04.033642+0000","last_unstale":"2023-07-09T02:21:05.038393+0000","last_undegraded":"2023-07-09T02:21:05.038393+0000","last_fullsized":"2023-07-09T02:21:05.038393+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:19:18.472723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017613+0000","last_change":"2023-07-09T02:21:03.023235+0000","last_active":"2023-07-09T02:21:05.017613+0000","last_peered":"2023-07-09T02:21:05.017613+0000","last_clean":"2023-07-09T02:21:05.017613+0000","last_became_active":"2023-07-09T02:21:03.023022+0000","last_became_peered":"2023-07-09T02:21:03.023022+0000","last_unstale":"2023-07-09T02:21:05.017613+0000","last_undegraded":"2023-07-09T02:21:05.017613+0000","last_fullsized":"2023-07-09T02:21:05.017613+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:25:41.255040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037263+0000","last_change":"2023-07-09T02:21:04.024277+0000","last_active":"2023-07-09T02:21:05.037263+0000","last_peered":"2023-07-09T02:21:05.037263+0000","last_clean":"2023-07-09T02:21:05.037263+0000","last_became_active":"2023-07-09T02:21:04.024021+0000","last_became_peered":"2023-07-09T02:21:04.024021+0000","last_unstale":"2023-07-09T02:21:05.037263+0000","last_undegraded":"2023-07-09T02:21:05.037263+0000","last_fullsized":"2023-07-09T02:21:05.037263+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:43:28.109542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019010+0000","last_change":"2023-07-09T02:21:03.017405+0000","last_active":"2023-07-09T02:21:05.019010+0000","last_peered":"2023-07-09T02:21:05.019010+0000","last_clean":"2023-07-09T02:21:05.019010+0000","last_became_active":"2023-07-09T02:21:03.017160+0000","last_became_peered":"2023-07-09T02:21:03.017160+0000","last_unstale":"2023-07-09T02:21:05.019010+0000","last_undegraded":"2023-07-09T02:21:05.019010+0000","last_fullsized":"2023-07-09T02:21:05.019010+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:56:12.733300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019444+0000","last_change":"2023-07-09T02:21:04.035834+0000","last_active":"2023-07-09T02:21:05.019444+0000","last_peered":"2023-07-09T02:21:05.019444+0000","last_clean":"2023-07-09T02:21:05.019444+0000","last_became_active":"2023-07-09T02:21:04.035624+0000","last_became_peered":"2023-07-09T02:21:04.035624+0000","last_unstale":"2023-07-09T02:21:05.019444+0000","last_undegraded":"2023-07-09T02:21:05.019444+0000","last_fullsized":"2023-07-09T02:21:05.019444+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:35:03.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018029+0000","last_change":"2023-07-09T02:21:03.023971+0000","last_active":"2023-07-09T02:21:05.018029+0000","last_peered":"2023-07-09T02:21:05.018029+0000","last_clean":"2023-07-09T02:21:05.018029+0000","last_became_active":"2023-07-09T02:21:03.023737+0000","last_became_peered":"2023-07-09T02:21:03.023737+0000","last_unstale":"2023-07-09T02:21:05.018029+0000","last_undegraded":"2023-07-09T02:21:05.018029+0000","last_fullsized":"2023-07-09T02:21:05.018029+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:51:58.475844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038936+0000","last_change":"2023-07-09T02:21:04.031578+0000","last_active":"2023-07-09T02:21:05.038936+0000","last_peered":"2023-07-09T02:21:05.038936+0000","last_clean":"2023-07-09T02:21:05.038936+0000","last_became_active":"2023-07-09T02:21:04.031321+0000","last_became_peered":"2023-07-09T02:21:04.031321+0000","last_unstale":"2023-07-09T02:21:05.038936+0000","last_undegraded":"2023-07-09T02:21:05.038936+0000","last_fullsized":"2023-07-09T02:21:05.038936+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:15:50.805764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037661+0000","last_change":"2023-07-09T02:21:03.025449+0000","last_active":"2023-07-09T02:21:05.037661+0000","last_peered":"2023-07-09T02:21:05.037661+0000","last_clean":"2023-07-09T02:21:05.037661+0000","last_became_active":"2023-07-09T02:21:03.025174+0000","last_became_peered":"2023-07-09T02:21:03.025174+0000","last_unstale":"2023-07-09T02:21:05.037661+0000","last_undegraded":"2023-07-09T02:21:05.037661+0000","last_fullsized":"2023-07-09T02:21:05.037661+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:30:57.717249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039373+0000","last_change":"2023-07-09T02:21:04.040359+0000","last_active":"2023-07-09T02:21:05.039373+0000","last_peered":"2023-07-09T02:21:05.039373+0000","last_clean":"2023-07-09T02:21:05.039373+0000","last_became_active":"2023-07-09T02:21:04.039803+0000","last_became_peered":"2023-07-09T02:21:04.039803+0000","last_unstale":"2023-07-09T02:21:05.039373+0000","last_undegraded":"2023-07-09T02:21:05.039373+0000","last_fullsized":"2023-07-09T02:21:05.039373+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:58.847898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039045+0000","last_change":"2023-07-09T02:21:03.024555+0000","last_active":"2023-07-09T02:21:05.039045+0000","last_peered":"2023-07-09T02:21:05.039045+0000","last_clean":"2023-07-09T02:21:05.039045+0000","last_became_active":"2023-07-09T02:21:03.024234+0000","last_became_peered":"2023-07-09T02:21:03.024234+0000","last_unstale":"2023-07-09T02:21:05.039045+0000","last_undegraded":"2023-07-09T02:21:05.039045+0000","last_fullsized":"2023-07-09T02:21:05.039045+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:31:57.975745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019530+0000","last_change":"2023-07-09T02:21:04.024102+0000","last_active":"2023-07-09T02:21:05.019530+0000","last_peered":"2023-07-09T02:21:05.019530+0000","last_clean":"2023-07-09T02:21:05.019530+0000","last_became_active":"2023-07-09T02:21:04.023646+0000","last_became_peered":"2023-07-09T02:21:04.023646+0000","last_unstale":"2023-07-09T02:21:05.019530+0000","last_undegraded":"2023-07-09T02:21:05.019530+0000","last_fullsized":"2023-07-09T02:21:05.019530+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:09:34.795170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"165'1","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037778+0000","last_change":"2023-07-09T02:21:03.022697+0000","last_active":"2023-07-09T02:21:05.037778+0000","last_peered":"2023-07-09T02:21:05.037778+0000","last_clean":"2023-07-09T02:21:05.037778+0000","last_became_active":"2023-07-09T02:21:03.022415+0000","last_became_peered":"2023-07-09T02:21:03.022415+0000","last_unstale":"2023-07-09T02:21:05.037778+0000","last_undegraded":"2023-07-09T02:21:05.037778+0000","last_fullsized":"2023-07-09T02:21:05.037778+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:32:41.948248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018858+0000","last_change":"2023-07-09T02:21:04.035157+0000","last_active":"2023-07-09T02:21:05.018858+0000","last_peered":"2023-07-09T02:21:05.018858+0000","last_clean":"2023-07-09T02:21:05.018858+0000","last_became_active":"2023-07-09T02:21:04.034940+0000","last_became_peered":"2023-07-09T02:21:04.034940+0000","last_unstale":"2023-07-09T02:21:05.018858+0000","last_undegraded":"2023-07-09T02:21:05.018858+0000","last_fullsized":"2023-07-09T02:21:05.018858+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:49:34.678766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039776+0000","last_change":"2023-07-09T02:21:03.029510+0000","last_active":"2023-07-09T02:21:05.039776+0000","last_peered":"2023-07-09T02:21:05.039776+0000","last_clean":"2023-07-09T02:21:05.039776+0000","last_became_active":"2023-07-09T02:21:03.029078+0000","last_became_peered":"2023-07-09T02:21:03.029078+0000","last_unstale":"2023-07-09T02:21:05.039776+0000","last_undegraded":"2023-07-09T02:21:05.039776+0000","last_fullsized":"2023-07-09T02:21:05.039776+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:00:56.405598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039505+0000","last_change":"2023-07-09T02:21:04.040495+0000","last_active":"2023-07-09T02:21:05.039505+0000","last_peered":"2023-07-09T02:21:05.039505+0000","last_clean":"2023-07-09T02:21:05.039505+0000","last_became_active":"2023-07-09T02:21:04.040132+0000","last_became_peered":"2023-07-09T02:21:04.040132+0000","last_unstale":"2023-07-09T02:21:05.039505+0000","last_undegraded":"2023-07-09T02:21:05.039505+0000","last_fullsized":"2023-07-09T02:21:05.039505+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:52:02.010471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018632+0000","last_change":"2023-07-09T02:21:03.024420+0000","last_active":"2023-07-09T02:21:05.018632+0000","last_peered":"2023-07-09T02:21:05.018632+0000","last_clean":"2023-07-09T02:21:05.018632+0000","last_became_active":"2023-07-09T02:21:03.023796+0000","last_became_peered":"2023-07-09T02:21:03.023796+0000","last_unstale":"2023-07-09T02:21:05.018632+0000","last_undegraded":"2023-07-09T02:21:05.018632+0000","last_fullsized":"2023-07-09T02:21:05.018632+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:37:29.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037795+0000","last_change":"2023-07-09T02:21:04.026768+0000","last_active":"2023-07-09T02:21:05.037795+0000","last_peered":"2023-07-09T02:21:05.037795+0000","last_clean":"2023-07-09T02:21:05.037795+0000","last_became_active":"2023-07-09T02:21:04.026007+0000","last_became_peered":"2023-07-09T02:21:04.026007+0000","last_unstale":"2023-07-09T02:21:05.037795+0000","last_undegraded":"2023-07-09T02:21:05.037795+0000","last_fullsized":"2023-07-09T02:21:05.037795+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:16:24.814017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038701+0000","last_change":"2023-07-09T02:21:03.027928+0000","last_active":"2023-07-09T02:21:05.038701+0000","last_peered":"2023-07-09T02:21:05.038701+0000","last_clean":"2023-07-09T02:21:05.038701+0000","last_became_active":"2023-07-09T02:21:03.027230+0000","last_became_peered":"2023-07-09T02:21:03.027230+0000","last_unstale":"2023-07-09T02:21:05.038701+0000","last_undegraded":"2023-07-09T02:21:05.038701+0000","last_fullsized":"2023-07-09T02:21:05.038701+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:46:07.538850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038748+0000","last_change":"2023-07-09T02:21:04.038286+0000","last_active":"2023-07-09T02:21:05.038748+0000","last_peered":"2023-07-09T02:21:05.038748+0000","last_clean":"2023-07-09T02:21:05.038748+0000","last_became_active":"2023-07-09T02:21:04.036022+0000","last_became_peered":"2023-07-09T02:21:04.036022+0000","last_unstale":"2023-07-09T02:21:05.038748+0000","last_undegraded":"2023-07-09T02:21:05.038748+0000","last_fullsized":"2023-07-09T02:21:05.038748+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:43:36.475405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018653+0000","last_change":"2023-07-09T02:21:03.024142+0000","last_active":"2023-07-09T02:21:05.018653+0000","last_peered":"2023-07-09T02:21:05.018653+0000","last_clean":"2023-07-09T02:21:05.018653+0000","last_became_active":"2023-07-09T02:21:03.023877+0000","last_became_peered":"2023-07-09T02:21:03.023877+0000","last_unstale":"2023-07-09T02:21:05.018653+0000","last_undegraded":"2023-07-09T02:21:05.018653+0000","last_fullsized":"2023-07-09T02:21:05.018653+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:06:22.497673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037616+0000","last_change":"2023-07-09T02:21:04.032010+0000","last_active":"2023-07-09T02:21:05.037616+0000","last_peered":"2023-07-09T02:21:05.037616+0000","last_clean":"2023-07-09T02:21:05.037616+0000","last_became_active":"2023-07-09T02:21:04.031791+0000","last_became_peered":"2023-07-09T02:21:04.031791+0000","last_unstale":"2023-07-09T02:21:05.037616+0000","last_undegraded":"2023-07-09T02:21:05.037616+0000","last_fullsized":"2023-07-09T02:21:05.037616+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:18.372841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039337+0000","last_change":"2023-07-09T02:21:03.028184+0000","last_active":"2023-07-09T02:21:05.039337+0000","last_peered":"2023-07-09T02:21:05.039337+0000","last_clean":"2023-07-09T02:21:05.039337+0000","last_became_active":"2023-07-09T02:21:03.027932+0000","last_became_peered":"2023-07-09T02:21:03.027932+0000","last_unstale":"2023-07-09T02:21:05.039337+0000","last_undegraded":"2023-07-09T02:21:05.039337+0000","last_fullsized":"2023-07-09T02:21:05.039337+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:38:07.101142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017557+0000","last_change":"2023-07-09T02:21:04.022573+0000","last_active":"2023-07-09T02:21:05.017557+0000","last_peered":"2023-07-09T02:21:05.017557+0000","last_clean":"2023-07-09T02:21:05.017557+0000","last_became_active":"2023-07-09T02:21:04.022005+0000","last_became_peered":"2023-07-09T02:21:04.022005+0000","last_unstale":"2023-07-09T02:21:05.017557+0000","last_undegraded":"2023-07-09T02:21:05.017557+0000","last_fullsized":"2023-07-09T02:21:05.017557+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:43:18.281510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.040041+0000","last_change":"2023-07-09T02:21:03.029358+0000","last_active":"2023-07-09T02:21:05.040041+0000","last_peered":"2023-07-09T02:21:05.040041+0000","last_clean":"2023-07-09T02:21:05.040041+0000","last_became_active":"2023-07-09T02:21:03.028748+0000","last_became_peered":"2023-07-09T02:21:03.028748+0000","last_unstale":"2023-07-09T02:21:05.040041+0000","last_undegraded":"2023-07-09T02:21:05.040041+0000","last_fullsized":"2023-07-09T02:21:05.040041+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:59:17.776590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038519+0000","last_change":"2023-07-09T02:21:04.033420+0000","last_active":"2023-07-09T02:21:05.038519+0000","last_peered":"2023-07-09T02:21:05.038519+0000","last_clean":"2023-07-09T02:21:05.038519+0000","last_became_active":"2023-07-09T02:21:04.032575+0000","last_became_peered":"2023-07-09T02:21:04.032575+0000","last_unstale":"2023-07-09T02:21:05.038519+0000","last_undegraded":"2023-07-09T02:21:05.038519+0000","last_fullsized":"2023-07-09T02:21:05.038519+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:58.214509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019271+0000","last_change":"2023-07-09T02:21:03.026551+0000","last_active":"2023-07-09T02:21:05.019271+0000","last_peered":"2023-07-09T02:21:05.019271+0000","last_clean":"2023-07-09T02:21:05.019271+0000","last_became_active":"2023-07-09T02:21:03.025758+0000","last_became_peered":"2023-07-09T02:21:03.025758+0000","last_unstale":"2023-07-09T02:21:05.019271+0000","last_undegraded":"2023-07-09T02:21:05.019271+0000","last_fullsized":"2023-07-09T02:21:05.019271+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:43:27.100390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018997+0000","last_change":"2023-07-09T02:21:04.024559+0000","last_active":"2023-07-09T02:21:05.018997+0000","last_peered":"2023-07-09T02:21:05.018997+0000","last_clean":"2023-07-09T02:21:05.018997+0000","last_became_active":"2023-07-09T02:21:04.024330+0000","last_became_peered":"2023-07-09T02:21:04.024330+0000","last_unstale":"2023-07-09T02:21:05.018997+0000","last_undegraded":"2023-07-09T02:21:05.018997+0000","last_fullsized":"2023-07-09T02:21:05.018997+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:40:08.670717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037352+0000","last_change":"2023-07-09T02:21:03.023861+0000","last_active":"2023-07-09T02:21:05.037352+0000","last_peered":"2023-07-09T02:21:05.037352+0000","last_clean":"2023-07-09T02:21:05.037352+0000","last_became_active":"2023-07-09T02:21:03.023607+0000","last_became_peered":"2023-07-09T02:21:03.023607+0000","last_unstale":"2023-07-09T02:21:05.037352+0000","last_undegraded":"2023-07-09T02:21:05.037352+0000","last_fullsized":"2023-07-09T02:21:05.037352+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:44:53.449783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017556+0000","last_change":"2023-07-09T02:21:04.039572+0000","last_active":"2023-07-09T02:21:05.017556+0000","last_peered":"2023-07-09T02:21:05.017556+0000","last_clean":"2023-07-09T02:21:05.017556+0000","last_became_active":"2023-07-09T02:21:04.039177+0000","last_became_peered":"2023-07-09T02:21:04.039177+0000","last_unstale":"2023-07-09T02:21:05.017556+0000","last_undegraded":"2023-07-09T02:21:05.017556+0000","last_fullsized":"2023-07-09T02:21:05.017556+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:26:38.312405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017974+0000","last_change":"2023-07-09T02:21:03.028421+0000","last_active":"2023-07-09T02:21:05.017974+0000","last_peered":"2023-07-09T02:21:05.017974+0000","last_clean":"2023-07-09T02:21:05.017974+0000","last_became_active":"2023-07-09T02:21:03.028176+0000","last_became_peered":"2023-07-09T02:21:03.028176+0000","last_unstale":"2023-07-09T02:21:05.017974+0000","last_undegraded":"2023-07-09T02:21:05.017974+0000","last_fullsized":"2023-07-09T02:21:05.017974+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:05:47.438293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038321+0000","last_change":"2023-07-09T02:21:04.038303+0000","last_active":"2023-07-09T02:21:05.038321+0000","last_peered":"2023-07-09T02:21:05.038321+0000","last_clean":"2023-07-09T02:21:05.038321+0000","last_became_active":"2023-07-09T02:21:04.037066+0000","last_became_peered":"2023-07-09T02:21:04.037066+0000","last_unstale":"2023-07-09T02:21:05.038321+0000","last_undegraded":"2023-07-09T02:21:05.038321+0000","last_fullsized":"2023-07-09T02:21:05.038321+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:18:14.587954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019367+0000","last_change":"2023-07-09T02:21:03.026945+0000","last_active":"2023-07-09T02:21:05.019367+0000","last_peered":"2023-07-09T02:21:05.019367+0000","last_clean":"2023-07-09T02:21:05.019367+0000","last_became_active":"2023-07-09T02:21:03.026709+0000","last_became_peered":"2023-07-09T02:21:03.026709+0000","last_unstale":"2023-07-09T02:21:05.019367+0000","last_undegraded":"2023-07-09T02:21:05.019367+0000","last_fullsized":"2023-07-09T02:21:05.019367+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:08:20.091733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038190+0000","last_change":"2023-07-09T02:21:04.032197+0000","last_active":"2023-07-09T02:21:05.038190+0000","last_peered":"2023-07-09T02:21:05.038190+0000","last_clean":"2023-07-09T02:21:05.038190+0000","last_became_active":"2023-07-09T02:21:04.031978+0000","last_became_peered":"2023-07-09T02:21:04.031978+0000","last_unstale":"2023-07-09T02:21:05.038190+0000","last_undegraded":"2023-07-09T02:21:05.038190+0000","last_fullsized":"2023-07-09T02:21:05.038190+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:48:55.773640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038112+0000","last_change":"2023-07-09T02:21:03.022697+0000","last_active":"2023-07-09T02:21:05.038112+0000","last_peered":"2023-07-09T02:21:05.038112+0000","last_clean":"2023-07-09T02:21:05.038112+0000","last_became_active":"2023-07-09T02:21:03.022291+0000","last_became_peered":"2023-07-09T02:21:03.022291+0000","last_unstale":"2023-07-09T02:21:05.038112+0000","last_undegraded":"2023-07-09T02:21:05.038112+0000","last_fullsized":"2023-07-09T02:21:05.038112+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:44:59.192004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038290+0000","last_change":"2023-07-09T02:21:04.035846+0000","last_active":"2023-07-09T02:21:05.038290+0000","last_peered":"2023-07-09T02:21:05.038290+0000","last_clean":"2023-07-09T02:21:05.038290+0000","last_became_active":"2023-07-09T02:21:04.035469+0000","last_became_peered":"2023-07-09T02:21:04.035469+0000","last_unstale":"2023-07-09T02:21:05.038290+0000","last_undegraded":"2023-07-09T02:21:05.038290+0000","last_fullsized":"2023-07-09T02:21:05.038290+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:52:27.030485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019365+0000","last_change":"2023-07-09T02:21:03.023520+0000","last_active":"2023-07-09T02:21:05.019365+0000","last_peered":"2023-07-09T02:21:05.019365+0000","last_clean":"2023-07-09T02:21:05.019365+0000","last_became_active":"2023-07-09T02:21:03.023260+0000","last_became_peered":"2023-07-09T02:21:03.023260+0000","last_unstale":"2023-07-09T02:21:05.019365+0000","last_undegraded":"2023-07-09T02:21:05.019365+0000","last_fullsized":"2023-07-09T02:21:05.019365+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:44:53.449783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038765+0000","last_change":"2023-07-09T02:21:04.044858+0000","last_active":"2023-07-09T02:21:05.038765+0000","last_peered":"2023-07-09T02:21:05.038765+0000","last_clean":"2023-07-09T02:21:05.038765+0000","last_became_active":"2023-07-09T02:21:04.041212+0000","last_became_peered":"2023-07-09T02:21:04.041212+0000","last_unstale":"2023-07-09T02:21:05.038765+0000","last_undegraded":"2023-07-09T02:21:05.038765+0000","last_fullsized":"2023-07-09T02:21:05.038765+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:05:04.263019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038204+0000","last_change":"2023-07-09T02:21:03.026690+0000","last_active":"2023-07-09T02:21:05.038204+0000","last_peered":"2023-07-09T02:21:05.038204+0000","last_clean":"2023-07-09T02:21:05.038204+0000","last_became_active":"2023-07-09T02:21:03.026376+0000","last_became_peered":"2023-07-09T02:21:03.026376+0000","last_unstale":"2023-07-09T02:21:05.038204+0000","last_undegraded":"2023-07-09T02:21:05.038204+0000","last_fullsized":"2023-07-09T02:21:05.038204+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:00:31.622590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038972+0000","last_change":"2023-07-09T02:21:04.040974+0000","last_active":"2023-07-09T02:21:05.038972+0000","last_peered":"2023-07-09T02:21:05.038972+0000","last_clean":"2023-07-09T02:21:05.038972+0000","last_became_active":"2023-07-09T02:21:04.037154+0000","last_became_peered":"2023-07-09T02:21:04.037154+0000","last_unstale":"2023-07-09T02:21:05.038972+0000","last_undegraded":"2023-07-09T02:21:05.038972+0000","last_fullsized":"2023-07-09T02:21:05.038972+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:40:39.477773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"165'6","reported_seq":19,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.018306+0000","last_change":"2023-07-09T02:21:03.024489+0000","last_active":"2023-07-09T02:21:05.018306+0000","last_peered":"2023-07-09T02:21:05.018306+0000","last_clean":"2023-07-09T02:21:05.018306+0000","last_became_active":"2023-07-09T02:21:03.024275+0000","last_became_peered":"2023-07-09T02:21:03.024275+0000","last_unstale":"2023-07-09T02:21:05.018306+0000","last_undegraded":"2023-07-09T02:21:05.018306+0000","last_fullsized":"2023-07-09T02:21:05.018306+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:15:41.730938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":417,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038967+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:21:05.038967+0000","last_peered":"2023-07-09T02:21:05.038967+0000","last_clean":"2023-07-09T02:21:05.038967+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:21:05.038967+0000","last_undegraded":"2023-07-09T02:21:05.038967+0000","last_fullsized":"2023-07-09T02:21:05.038967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:22:42.228587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":301,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019449+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:21:05.019449+0000","last_peered":"2023-07-09T02:21:05.019449+0000","last_clean":"2023-07-09T02:21:05.019449+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:21:05.019449+0000","last_undegraded":"2023-07-09T02:21:05.019449+0000","last_fullsized":"2023-07-09T02:21:05.019449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:34:26.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038196+0000","last_change":"2023-07-09T02:21:04.033740+0000","last_active":"2023-07-09T02:21:05.038196+0000","last_peered":"2023-07-09T02:21:05.038196+0000","last_clean":"2023-07-09T02:21:05.038196+0000","last_became_active":"2023-07-09T02:21:04.033422+0000","last_became_peered":"2023-07-09T02:21:04.033422+0000","last_unstale":"2023-07-09T02:21:05.038196+0000","last_undegraded":"2023-07-09T02:21:05.038196+0000","last_fullsized":"2023-07-09T02:21:05.038196+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:35:52.438175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039619+0000","last_change":"2023-07-09T02:21:03.024834+0000","last_active":"2023-07-09T02:21:05.039619+0000","last_peered":"2023-07-09T02:21:05.039619+0000","last_clean":"2023-07-09T02:21:05.039619+0000","last_became_active":"2023-07-09T02:21:03.024544+0000","last_became_peered":"2023-07-09T02:21:03.024544+0000","last_unstale":"2023-07-09T02:21:05.039619+0000","last_undegraded":"2023-07-09T02:21:05.039619+0000","last_fullsized":"2023-07-09T02:21:05.039619+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:27:15.967513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":263,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038836+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:21:05.038836+0000","last_peered":"2023-07-09T02:21:05.038836+0000","last_clean":"2023-07-09T02:21:05.038836+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:21:05.038836+0000","last_undegraded":"2023-07-09T02:21:05.038836+0000","last_fullsized":"2023-07-09T02:21:05.038836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:36:03.288522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037917+0000","last_change":"2023-07-09T02:21:04.033204+0000","last_active":"2023-07-09T02:21:05.037917+0000","last_peered":"2023-07-09T02:21:05.037917+0000","last_clean":"2023-07-09T02:21:05.037917+0000","last_became_active":"2023-07-09T02:21:04.032575+0000","last_became_peered":"2023-07-09T02:21:04.032575+0000","last_unstale":"2023-07-09T02:21:05.037917+0000","last_undegraded":"2023-07-09T02:21:05.037917+0000","last_fullsized":"2023-07-09T02:21:05.037917+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:38:11.242365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019164+0000","last_change":"2023-07-09T02:21:03.018507+0000","last_active":"2023-07-09T02:21:05.019164+0000","last_peered":"2023-07-09T02:21:05.019164+0000","last_clean":"2023-07-09T02:21:05.019164+0000","last_became_active":"2023-07-09T02:21:03.018225+0000","last_became_peered":"2023-07-09T02:21:03.018225+0000","last_unstale":"2023-07-09T02:21:05.019164+0000","last_undegraded":"2023-07-09T02:21:05.019164+0000","last_fullsized":"2023-07-09T02:21:05.019164+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:07:05.122875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037992+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:21:05.037992+0000","last_peered":"2023-07-09T02:21:05.037992+0000","last_clean":"2023-07-09T02:21:05.037992+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:21:05.037992+0000","last_undegraded":"2023-07-09T02:21:05.037992+0000","last_fullsized":"2023-07-09T02:21:05.037992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:44:02.871333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037936+0000","last_change":"2023-07-09T02:21:04.025885+0000","last_active":"2023-07-09T02:21:05.037936+0000","last_peered":"2023-07-09T02:21:05.037936+0000","last_clean":"2023-07-09T02:21:05.037936+0000","last_became_active":"2023-07-09T02:21:04.025667+0000","last_became_peered":"2023-07-09T02:21:04.025667+0000","last_unstale":"2023-07-09T02:21:05.037936+0000","last_undegraded":"2023-07-09T02:21:05.037936+0000","last_fullsized":"2023-07-09T02:21:05.037936+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:40:00.823368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"165'3","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037788+0000","last_change":"2023-07-09T02:21:03.022978+0000","last_active":"2023-07-09T02:21:05.037788+0000","last_peered":"2023-07-09T02:21:05.037788+0000","last_clean":"2023-07-09T02:21:05.037788+0000","last_became_active":"2023-07-09T02:21:03.022336+0000","last_became_peered":"2023-07-09T02:21:03.022336+0000","last_unstale":"2023-07-09T02:21:05.037788+0000","last_undegraded":"2023-07-09T02:21:05.037788+0000","last_fullsized":"2023-07-09T02:21:05.037788+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:10:56.013990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":301,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019534+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:21:05.019534+0000","last_peered":"2023-07-09T02:21:05.019534+0000","last_clean":"2023-07-09T02:21:05.019534+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:21:05.019534+0000","last_undegraded":"2023-07-09T02:21:05.019534+0000","last_fullsized":"2023-07-09T02:21:05.019534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:09:43.992729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039664+0000","last_change":"2023-07-09T02:21:04.035363+0000","last_active":"2023-07-09T02:21:05.039664+0000","last_peered":"2023-07-09T02:21:05.039664+0000","last_clean":"2023-07-09T02:21:05.039664+0000","last_became_active":"2023-07-09T02:21:04.034375+0000","last_became_peered":"2023-07-09T02:21:04.034375+0000","last_unstale":"2023-07-09T02:21:05.039664+0000","last_undegraded":"2023-07-09T02:21:05.039664+0000","last_fullsized":"2023-07-09T02:21:05.039664+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:36:08.542082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"165'2","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017887+0000","last_change":"2023-07-09T02:21:03.019120+0000","last_active":"2023-07-09T02:21:05.017887+0000","last_peered":"2023-07-09T02:21:05.017887+0000","last_clean":"2023-07-09T02:21:05.017887+0000","last_became_active":"2023-07-09T02:21:03.018879+0000","last_became_peered":"2023-07-09T02:21:03.018879+0000","last_unstale":"2023-07-09T02:21:05.017887+0000","last_undegraded":"2023-07-09T02:21:05.017887+0000","last_fullsized":"2023-07-09T02:21:05.017887+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:33:30.885467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":283,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037935+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:21:05.037935+0000","last_peered":"2023-07-09T02:21:05.037935+0000","last_clean":"2023-07-09T02:21:05.037935+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:21:05.037935+0000","last_undegraded":"2023-07-09T02:21:05.037935+0000","last_fullsized":"2023-07-09T02:21:05.037935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:42:15.513159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038230+0000","last_change":"2023-07-09T02:21:04.038375+0000","last_active":"2023-07-09T02:21:05.038230+0000","last_peered":"2023-07-09T02:21:05.038230+0000","last_clean":"2023-07-09T02:21:05.038230+0000","last_became_active":"2023-07-09T02:21:04.038104+0000","last_became_peered":"2023-07-09T02:21:04.038104+0000","last_unstale":"2023-07-09T02:21:05.038230+0000","last_undegraded":"2023-07-09T02:21:05.038230+0000","last_fullsized":"2023-07-09T02:21:05.038230+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:54:40.186682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039392+0000","last_change":"2023-07-09T02:21:03.030231+0000","last_active":"2023-07-09T02:21:05.039392+0000","last_peered":"2023-07-09T02:21:05.039392+0000","last_clean":"2023-07-09T02:21:05.039392+0000","last_became_active":"2023-07-09T02:21:03.029995+0000","last_became_peered":"2023-07-09T02:21:03.029995+0000","last_unstale":"2023-07-09T02:21:05.039392+0000","last_undegraded":"2023-07-09T02:21:05.039392+0000","last_fullsized":"2023-07-09T02:21:05.039392+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:48:27.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":265,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.038500+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:21:05.038500+0000","last_peered":"2023-07-09T02:21:05.038500+0000","last_clean":"2023-07-09T02:21:05.038500+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:21:05.038500+0000","last_undegraded":"2023-07-09T02:21:05.038500+0000","last_fullsized":"2023-07-09T02:21:05.038500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:59:02.778353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.017962+0000","last_change":"2023-07-09T02:21:04.025039+0000","last_active":"2023-07-09T02:21:05.017962+0000","last_peered":"2023-07-09T02:21:05.017962+0000","last_clean":"2023-07-09T02:21:05.017962+0000","last_became_active":"2023-07-09T02:21:04.024792+0000","last_became_peered":"2023-07-09T02:21:04.024792+0000","last_unstale":"2023-07-09T02:21:05.017962+0000","last_undegraded":"2023-07-09T02:21:05.017962+0000","last_fullsized":"2023-07-09T02:21:05.017962+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:51:47.389899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.039664+0000","last_change":"2023-07-09T02:21:03.025704+0000","last_active":"2023-07-09T02:21:05.039664+0000","last_peered":"2023-07-09T02:21:05.039664+0000","last_clean":"2023-07-09T02:21:05.039664+0000","last_became_active":"2023-07-09T02:21:03.025485+0000","last_became_peered":"2023-07-09T02:21:03.025485+0000","last_unstale":"2023-07-09T02:21:05.039664+0000","last_undegraded":"2023-07-09T02:21:05.039664+0000","last_fullsized":"2023-07-09T02:21:05.039664+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:14:32.333285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037813+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:21:05.037813+0000","last_peered":"2023-07-09T02:21:05.037813+0000","last_clean":"2023-07-09T02:21:05.037813+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:21:05.037813+0000","last_undegraded":"2023-07-09T02:21:05.037813+0000","last_fullsized":"2023-07-09T02:21:05.037813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:35:09.912358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.037669+0000","last_change":"2023-07-09T02:21:04.027075+0000","last_active":"2023-07-09T02:21:05.037669+0000","last_peered":"2023-07-09T02:21:05.037669+0000","last_clean":"2023-07-09T02:21:05.037669+0000","last_became_active":"2023-07-09T02:21:04.026524+0000","last_became_peered":"2023-07-09T02:21:04.026524+0000","last_unstale":"2023-07-09T02:21:05.037669+0000","last_undegraded":"2023-07-09T02:21:05.037669+0000","last_fullsized":"2023-07-09T02:21:05.037669+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:03.004140+0000","last_clean_scrub_stamp":"2023-07-09T02:21:03.004140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:19:35.893404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"165'8","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.019158+0000","last_change":"2023-07-09T02:21:03.026697+0000","last_active":"2023-07-09T02:21:05.019158+0000","last_peered":"2023-07-09T02:21:05.019158+0000","last_clean":"2023-07-09T02:21:05.019158+0000","last_became_active":"2023-07-09T02:21:03.026103+0000","last_became_peered":"2023-07-09T02:21:03.026103+0000","last_unstale":"2023-07-09T02:21:05.019158+0000","last_undegraded":"2023-07-09T02:21:05.019158+0000","last_fullsized":"2023-07-09T02:21:05.019158+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:21:01.994989+0000","last_clean_scrub_stamp":"2023-07-09T02:21:01.994989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:22:29.401743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":263,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-07-09T02:21:05.040120+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:21:05.040120+0000","last_peered":"2023-07-09T02:21:05.040120+0000","last_clean":"2023-07-09T02:21:05.040120+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:21:05.040120+0000","last_undegraded":"2023-07-09T02:21:05.040120+0000","last_fullsized":"2023-07-09T02:21:05.040120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:22:01.994929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574970,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1542,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193770,"statfs":{"total":200000000,"available":198420666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":1.204,"15min":1.4950000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":1.004,"15min":1.2110000000000001},"last":0.501}]},{"osd":1,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83099999999999996,"5min":1.079,"15min":1.423},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68999999999999995,"15min":0.80000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95799999999999996,"5min":1.117,"15min":29.498999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.70599999999999996},"min":{"1min":0.51900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.879,"5min":1.028,"15min":5.0460000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.81299999999999994},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.94599999999999995,"5min":1.01,"15min":26.524000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.72299999999999998,"15min":0.69799999999999995},"min":{"1min":0.438,"5min":0.374,"15min":0.374},"max":{"1min":0.94099999999999995,"5min":0.95099999999999996,"15min":4.3789999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.77200000000000002},"min":{"1min":0.54300000000000004,"5min":0.5,"15min":0.432},"max":{"1min":0.89900000000000002,"5min":1.242,"15min":10.609999999999999},"last":0.72399999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79000000000000004,"5min":0.91100000000000003,"15min":0.91500000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.59399999999999997,"5min":0.47199999999999998,"15min":0.38100000000000001},"max":{"1min":0.79800000000000004,"5min":1.032,"15min":1.032},"last":0.748}]},{"osd":5,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.64600000000000002},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.35699999999999998},"max":{"1min":0.84799999999999998,"5min":0.86699999999999999,"15min":0.94999999999999996},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.499,"5min":0.38700000000000001,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":1.048},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67800000000000005,"15min":0.72299999999999998},"min":{"1min":0.52600000000000002,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":1.087},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.55700000000000005,"5min":0.37,"15min":0.37},"max":{"1min":0.88600000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":965,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194346,"statfs":{"total":200000000,"available":199010986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.69699999999999995,"15min":0.67400000000000004},"min":{"1min":0.63500000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.69399999999999995,"15min":0.70999999999999996},"min":{"1min":0.61399999999999999,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.94699999999999995,"5min":1.0229999999999999,"15min":1.0269999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.58999999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84599999999999997,"5min":0.99199999999999999,"15min":1.4379999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.63,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.036,"15min":1.165},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.71899999999999997,"15min":0.70199999999999996},"min":{"1min":0.52700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.55800000000000005,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.97999999999999998,"5min":1.0169999999999999,"15min":1.0740000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.73599999999999999,"15min":0.71799999999999997},"min":{"1min":0.59399999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":1.45},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.622,"5min":0.498,"15min":0.45700000000000002},"max":{"1min":0.89700000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.432,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.998,"15min":1.6499999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.97799999999999998,"15min":1.117},"last":0.621}]},{"osd":5,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.72199999999999998,"5min":0.86299999999999999,"15min":0.88200000000000001},"last":0.436},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.6060000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.46200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.74399999999999999,"5min":0.95599999999999996,"15min":1.4059999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.83299999999999996,"5min":0.92900000000000005,"15min":1.0289999999999999},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":965,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194346,"statfs":{"total":200000000,"available":199011056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.67800000000000005,"15min":0.65200000000000002},"min":{"1min":0.49399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89600000000000002,"5min":1.248,"15min":1.248},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68500000000000005,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.179},"last":0.71299999999999997}]},{"osd":1,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89100000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70199999999999996,"15min":0.67100000000000004},"min":{"1min":0.622,"5min":0.46500000000000002,"15min":0.39800000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.97299999999999998},"last":0.72899999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.103},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72099999999999997,"15min":0.69799999999999995},"min":{"1min":0.58799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.98599999999999999},"last":0.84899999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76900000000000002,"15min":0.72299999999999998},"min":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.47399999999999998},"max":{"1min":0.98999999999999999,"5min":5.1989999999999998,"15min":5.1989999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74199999999999999,"15min":0.73499999999999999},"min":{"1min":0.59299999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.98399999999999999},"last":0.74299999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56999999999999995,"15min":0.59599999999999997},"min":{"1min":0.41599999999999998,"5min":0.35599999999999998,"15min":0.314},"max":{"1min":0.86499999999999999,"5min":0.88700000000000001,"15min":1.008},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.90900000000000003,"5min":0.94099999999999995,"15min":1.0720000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.441,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85499999999999998,"5min":1.042,"15min":1.054},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66500000000000004,"15min":0.66800000000000004},"min":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90200000000000002,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70499999999999996,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89400000000000002,"5min":1.0049999999999999,"15min":1.1619999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.745,"15min":0.753},"min":{"1min":0.497,"5min":0.437,"15min":0.437},"max":{"1min":1.006,"5min":1.0840000000000001,"15min":1.091},"last":0.79500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194345,"statfs":{"total":200000000,"available":199009492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.85999999999999999},"min":{"1min":0.505,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":50.508000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69799999999999995,"15min":0.68100000000000005},"min":{"1min":0.39800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.83099999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.56799999999999995,"5min":0.38,"15min":0.34100000000000003},"max":{"1min":0.89300000000000002,"5min":1.024,"15min":8.6039999999999992},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.81999999999999995}]},{"osd":2,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72199999999999998,"15min":0.68400000000000005},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97899999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.747},{"interface":"front","average":{"1min":0.754,"5min":0.755,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96899999999999997,"5min":1.008,"15min":1.323},"last":0.78600000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.70399999999999996},"min":{"1min":0.59599999999999997,"5min":0.49199999999999999,"15min":0.47999999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.96499999999999997},"min":{"1min":0.57699999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.0169999999999999,"5min":1.073,"15min":71.909000000000006},"last":0.76600000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.47199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.69999999999999996,"5min":0.94699999999999995,"15min":1.0169999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.45800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.871,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.496},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.94099999999999995,"5min":0.98199999999999998,"15min":1.0529999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Jul 9 02:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.71899999999999997},"min":{"1min":0.55500000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.92000000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.46500000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.995,"5min":0.995,"15min":8.0359999999999996},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199017093,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42799999999999999,"15min":0.42299999999999999},"min":{"1min":0.30599999999999999,"5min":0.217,"15min":0.216},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.96499999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":0.82699999999999996,"15min":1.198},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46000000000000002,"15min":0.46700000000000003},"min":{"1min":0.378,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.56299999999999994,"5min":0.80400000000000005,"15min":1.048},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.85299999999999998},"last":0.51100000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.61199999999999999,"5min":0.76100000000000001,"15min":1.155},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.441,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84799999999999998,"15min":1.1040000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.502,"15min":0.45300000000000001},"max":{"1min":0.95599999999999996,"5min":1.466,"15min":1.466},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.755,"15min":0.72399999999999998},"min":{"1min":0.57299999999999995,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0920000000000001,"5min":1.1899999999999999,"15min":1.3560000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76200000000000001,"15min":0.73599999999999999},"min":{"1min":0.57699999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.04,"5min":1.097,"15min":1.3420000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.77700000000000002,"15min":0.76200000000000001},"min":{"1min":0.60699999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.054,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.622,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98699999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.627},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.65200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.0369999999999999,"5min":1.395,"15min":1.5569999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:20:26 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53600000000000003,"15min":0.52000000000000002},"max":{"1min":1.073,"5min":1.3149999999999999,"15min":1.367},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.78300000000000003,"15min":0.77400000000000002},"min":{"1min":0.60499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574970,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194353,"statfs":{"total":200000000,"available":199017597,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.33400000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58599999999999997,"5min":0.69399999999999995,"15min":7.7450000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.46200000000000002,"15min":0.44},"min":{"1min":0.39200000000000002,"5min":0.29799999999999999,"15min":0.255},"max":{"1min":0.64500000000000002,"5min":0.66400000000000003,"15min":1.127},"last":0.35699999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.46200000000000002},"min":{"1min":0.379,"5min":0.308,"15min":0.26800000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":2.8879999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.56299999999999994,"15min":0.53800000000000003},"min":{"1min":0.47499999999999998,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":2.0600000000000001},"last":0.45300000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.42199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.438,"5min":0.33600000000000002,"15min":0.29999999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":7.8710000000000004},"last":0.438}]},{"osd":4,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.47199999999999998,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":1.081,"15min":7.7990000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.79300000000000004,"15min":0.74299999999999999},"min":{"1min":0.64900000000000002,"5min":0.51000000000000001,"15min":0.47899999999999998},"max":{"1min":0.95799999999999996,"5min":1.821,"15min":1.821},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.66700000000000004,"5min":0.51000000000000001,"15min":0.496},"max":{"1min":0.97399999999999998,"5min":1.052,"15min":1.319},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.58599999999999997,"5min":0.5,"15min":0.5},"max":{"1min":0.97999999999999998,"5min":1.99,"15min":7.8369999999999997},"last":0.64400000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79600000000000004,"15min":0.77700000000000002},"min":{"1min":0.66200000000000003,"5min":0.53900000000000003,"15min":0.48299999999999998},"max":{"1min":1.004,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80200000000000005,"15min":0.80900000000000005},"min":{"1min":0.68200000000000005,"5min":0.55500000000000005,"15min":0.51500000000000001},"max":{"1min":0.97199999999999998,"5min":1.0580000000000001,"15min":1.452},"last":0.65700000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:20:19 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.78200000000000003,"15min":0.74099999999999999},"min":{"1min":0.64400000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.97799999999999998,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77000000000000002,"15min":0.77100000000000002},"min":{"1min":0.67600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.95599999999999996,"5min":1.0049999999999999,"15min":1.351},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194353,"statfs":{"total":200000000,"available":199017639,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.438,"15min":0.44800000000000001},"min":{"1min":0.34000000000000002,"5min":0.26500000000000001,"15min":0.25},"max":{"1min":0.54400000000000004,"5min":0.72499999999999998,"15min":0.80300000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.47799999999999998},"min":{"1min":0.39600000000000002,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37}]},{"osd":2,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.504,"15min":0.495},"min":{"1min":0.42599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66300000000000003,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.432},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.39900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.96999999999999997,"15min":1.1080000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.495,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77600000000000002,"5min":0.84499999999999997,"15min":0.85099999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":0.73099999999999998,"15min":1.163},"last":0.46899999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.53600000000000003,"15min":0.46800000000000003},"max":{"1min":1.069,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79600000000000004,"15min":0.76000000000000001},"min":{"1min":0.68700000000000006,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.095,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.73899999999999999},"min":{"1min":0.627,"5min":0.53400000000000003,"15min":0.46500000000000002},"max":{"1min":1.0369999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.878},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.752,"15min":0.73799999999999999},"min":{"1min":0.57199999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.78600000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.77800000000000002,"15min":0.78300000000000003},"min":{"1min":0.64300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82099999999999995,"15min":0.79500000000000004},"min":{"1min":0.66300000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.996,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.94099999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:20:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.61299999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94799999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.55600000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1544,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193767,"statfs":{"total":200000000,"available":198418418,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.47999999999999998,"15min":0.439},"min":{"1min":0.31900000000000001,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.72599999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.49099999999999999},"min":{"1min":0.47799999999999998,"5min":0.36699999999999999,"15min":0.35199999999999998},"max":{"1min":0.72099999999999997,"5min":1.1180000000000001,"15min":1.3240000000000001},"last":0.433}]},{"osd":2,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48599999999999999,"15min":0.46700000000000003},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.505,"15min":0.46600000000000003},"min":{"1min":0.41899999999999998,"5min":0.313,"15min":0.29899999999999999},"max":{"1min":0.76600000000000001,"5min":1.161,"15min":1.4139999999999999},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.49199999999999999,"15min":0.441},"min":{"1min":0.41299999999999998,"5min":0.31900000000000001,"15min":0.28199999999999997},"max":{"1min":0.70099999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55300000000000005,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76500000000000001,"5min":0.89200000000000002,"15min":3.8929999999999998},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77800000000000002,"15min":0.77000000000000002},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.089,"5min":1.1439999999999999,"15min":1.145},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.71199999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0580000000000001,"5min":1.1240000000000001,"15min":1.153},"last":0.70999999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"max":{"1min":1.0389999999999999,"5min":1.401,"15min":1.4350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.80300000000000005,"15min":0.79000000000000004},"min":{"1min":0.64600000000000002,"5min":0.504,"15min":0.46100000000000002},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.238},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.751,"15min":0.745},"min":{"1min":0.62,"5min":0.48699999999999999,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.117,"15min":1.117},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.78800000000000003,"15min":0.77700000000000002},"min":{"1min":0.66300000000000003,"5min":0.51000000000000001,"15min":0.49099999999999999},"max":{"1min":1.079,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.63600000000000001,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.1499999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.69199999999999995}]}]}],"pool_statfs":[]}} 2023-07-09T02:21:08.514 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:21:08.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:21:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01edad640 1 Processor -- start 2023-07-09T02:21:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01edad640 1 -- start start 2023-07-09T02:21:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01edad640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff01815c410 0x7ff0181608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01edad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0180b4cf0 0x7ff0180d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01edad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0180ced10 con 0x7ff0180b59b0 2023-07-09T02:21:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01edad640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01815c7e0 con 0x7ff01815c410 2023-07-09T02:21:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01edad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180cd1b0 con 0x7ff0180b4cf0 2023-07-09T02:21:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff017fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0180b59b0 0x7ff0180b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44354/0 (socket says 172.21.15.45:44354) 2023-07-09T02:21:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff017fff640 1 -- 172.21.15.45:0/3827331732 learned_addr learned my addr 172.21.15.45:0/3827331732 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01cb49640 1 --2- 172.21.15.45:0/3827331732 >> v2:172.21.15.155:3300/0 conn(0x7ff01815c410 0x7ff0181608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01d34a640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0180b4cf0 0x7ff0180d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434455138 0 0) 0x7ff0180ced10 con 0x7ff0180b59b0 2023-07-09T02:21:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff008003530 con 0x7ff0180b59b0 2023-07-09T02:21:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154460154 0 0) 0x7ff008003530 con 0x7ff0180b59b0 2023-07-09T02:21:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0180b4cf0 msgr2=0x7ff0180d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0180b4cf0 0x7ff0180d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 >> v2:172.21.15.155:3300/0 conn(0x7ff01815c410 msgr2=0x7ff0181608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 --2- 172.21.15.45:0/3827331732 >> v2:172.21.15.155:3300/0 conn(0x7ff01815c410 0x7ff0181608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff018160de0 con 0x7ff0180b59b0 2023-07-09T02:21:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7ff004001680 con 0x7ff0180b59b0 2023-07-09T02:21:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 >> v1:172.21.15.45:6789/0 conn(0x7ff0180b59b0 legacy=0x7ff0180b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff008003980 0x7ff008003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff008004360 0x7ff008004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff00800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01815c7e0 con 0x7ff008004ea0 2023-07-09T02:21:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180cd1b0 con 0x7ff008004360 2023-07-09T02:21:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00800bed0 con 0x7ff008003980 2023-07-09T02:21:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01d34a640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff00800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff01cb49640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff008003980 0x7ff008003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.706+0000 7ff017fff640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff008004360 0x7ff008004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01d34a640 1 -- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff008003980 msgr2=0x7ff008003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01d34a640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff008003980 0x7ff008003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01d34a640 1 -- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff008004360 msgr2=0x7ff008004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01d34a640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff008004360 0x7ff008004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01d34a640 1 -- 172.21.15.45:0/3827331732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008003530 con 0x7ff008004ea0 2023-07-09T02:21:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01d34a640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff00800b990 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff01808bf50 tx=0x7ff01001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dd21db703fd579 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100a67d0 con 0x7ff008004ea0 2023-07-09T02:21:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000f040 con 0x7ff008004ea0 2023-07-09T02:21:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff0177fe640 1 -- 172.21.15.45:0/3827331732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0100a6b90 con 0x7ff008004ea0 2023-07-09T02:21:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01edad640 1 -- 172.21.15.45:0/3827331732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 msgr2=0x7ff00800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01edad640 1 --2- 172.21.15.45:0/3827331732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff00800b990 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff01808bf50 tx=0x7ff01001cb40 comp rx=0 tx=0).stop 2023-07-09T02:21:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01d34a640 1 -- 172.21.15.45:0/3827331732 reap_dead start 2023-07-09T02:21:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01edad640 1 -- 172.21.15.45:0/3827331732 shutdown_connections 2023-07-09T02:21:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01edad640 1 -- 172.21.15.45:0/3827331732 >> 172.21.15.45:0/3827331732 conn(0x7ff01806a590 msgr2=0x7ff0180cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.710+0000 7ff01edad640 1 -- 172.21.15.45:0/3827331732 shutdown_connections 2023-07-09T02:21:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 -- 172.21.15.45:0/3827331732 wait complete. 2023-07-09T02:21:08.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 Processor -- start 2023-07-09T02:21:08.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 -- start start 2023-07-09T02:21:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff0180d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff018155010 0x7ff0180cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0180c8df0 0x7ff0180cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff018158cd0 con 0x7ff008004ea0 2023-07-09T02:21:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180d3240 con 0x7ff0180c8df0 2023-07-09T02:21:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01edad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff018158840 con 0x7ff018155010 2023-07-09T02:21:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff0180d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff0180d2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60952/0 (socket says 172.21.15.45:60952) 2023-07-09T02:21:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 -- 172.21.15.45:0/1036618869 learned_addr learned my addr 172.21.15.45:0/1036618869 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff017fff640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff018155010 0x7ff0180cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01d34a640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0180c8df0 0x7ff0180cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 -- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff018155010 msgr2=0x7ff0180cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff018155010 0x7ff0180cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 -- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0180c8df0 msgr2=0x7ff0180cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0180c8df0 0x7ff0180cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 -- 172.21.15.45:0/1036618869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0180d2fc0 con 0x7ff008004ea0 2023-07-09T02:21:08.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.714+0000 7ff01cb49640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff0180d2a80 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7ff00c011980 tx=0x7ff00c011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff0157fa640 1 -- 172.21.15.45:0/1036618869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00fa90 con 0x7ff008004ea0 2023-07-09T02:21:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff0157fa640 1 -- 172.21.15.45:0/1036618869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c00fbf0 con 0x7ff008004ea0 2023-07-09T02:21:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff0157fa640 1 -- 172.21.15.45:0/1036618869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c014440 con 0x7ff008004ea0 2023-07-09T02:21:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff018157f50 con 0x7ff008004ea0 2023-07-09T02:21:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0181584d0 con 0x7ff008004ea0 2023-07-09T02:21:08.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff018158690 con 0x7ff008004ea0 2023-07-09T02:21:08.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff0157fa640 1 -- 172.21.15.45:0/1036618869 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff00c0145a0 con 0x7ff008004ea0 2023-07-09T02:21:08.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff0157fa640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feffc066280 0x7feffc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:08.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff0157fa640 1 -- 172.21.15.45:0/1036618869 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff00c084650 con 0x7ff008004ea0 2023-07-09T02:21:08.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.718+0000 7ff017fff640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feffc066280 0x7feffc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:08.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.722+0000 7ff017fff640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feffc066280 0x7feffc068730 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff01815b9a0 tx=0x7ff004009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:08.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.722+0000 7ff0157fa640 1 -- 172.21.15.45:0/1036618869 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff00c051a30 con 0x7ff008004ea0 2023-07-09T02:21:08.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.930+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff01804d7d0 con 0x7ff008004ea0 2023-07-09T02:21:08.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff0157fa640 1 -- 172.21.15.45:0/1036618869 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff00c055050 con 0x7ff008004ea0 2023-07-09T02:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:21:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:21:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:21:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feffc066280 msgr2=0x7feffc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feffc066280 0x7feffc068730 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff01815b9a0 tx=0x7ff004009040 comp rx=0 tx=0).stop 2023-07-09T02:21:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 msgr2=0x7ff0180d2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff0180d2a80 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7ff00c011980 tx=0x7ff00c011e40 comp rx=0 tx=0).stop 2023-07-09T02:21:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 shutdown_connections 2023-07-09T02:21:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0180c8df0 0x7ff0180cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feffc066280 0x7feffc068730 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff018155010 0x7ff0180cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 --2- 172.21.15.45:0/1036618869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff008004ea0 0x7ff0180d2a80 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:08.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 >> 172.21.15.45:0/1036618869 conn(0x7ff01806a590 msgr2=0x7ff018156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:08.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 shutdown_connections 2023-07-09T02:21:08.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:08.938+0000 7ff01edad640 1 -- 172.21.15.45:0/1036618869 wait complete. 2023-07-09T02:21:08.957 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:21:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e34d8640 1 Processor -- start 2023-07-09T02:21:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e34d8640 1 -- start start 2023-07-09T02:21:09.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e34d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc15c060 0x7fa8dc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e34d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa8dc0cd120 0x7fa8dc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e34d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc160a50 con 0x7fa8dc0d2450 2023-07-09T02:21:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e34d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8dc0d28f0 con 0x7fa8dc0cd120 2023-07-09T02:21:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e34d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0cfe40 con 0x7fa8dc15c060 2023-07-09T02:21:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1a75640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa8dc0d2450 0x7fa8dc0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44360/0 (socket says 172.21.15.45:44360) 2023-07-09T02:21:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1a75640 1 -- 172.21.15.45:0/1945207674 learned_addr learned my addr 172.21.15.45:0/1945207674 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e0a73640 1 --2- 172.21.15.45:0/1945207674 >> v2:172.21.15.155:3300/0 conn(0x7fa8dc0cd120 0x7fa8dc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1274640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc15c060 0x7fa8dc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489277770 0 0) 0x7fa8dc160a50 con 0x7fa8dc0d2450 2023-07-09T02:21:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c8003530 con 0x7fa8dc0d2450 2023-07-09T02:21:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1171234936 0 0) 0x7fa8c8003530 con 0x7fa8dc0d2450 2023-07-09T02:21:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc15c060 msgr2=0x7fa8dc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc15c060 0x7fa8dc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 >> v2:172.21.15.155:3300/0 conn(0x7fa8dc0cd120 msgr2=0x7fa8dc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 --2- 172.21.15.45:0/1945207674 >> v2:172.21.15.155:3300/0 conn(0x7fa8dc0cd120 0x7fa8dc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc15c430 con 0x7fa8dc0d2450 2023-07-09T02:21:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fa8d4001a00 con 0x7fa8dc0d2450 2023-07-09T02:21:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e0a73640 1 --2- 172.21.15.45:0/1945207674 >> v2:172.21.15.155:3300/0 conn(0x7fa8dc0cd120 0x7fa8dc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:21:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 >> v1:172.21.15.45:6789/0 conn(0x7fa8dc0d2450 legacy=0x7fa8dc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8c8003980 0x7fa8c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c80043b0 0x7fa8c8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc15c060 0x7fa8c8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0cfe40 con 0x7fa8c8003980 2023-07-09T02:21:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8005680 con 0x7fa8c80043b0 2023-07-09T02:21:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c800ba10 con 0x7fa8dc15c060 2023-07-09T02:21:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1274640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8c8003980 0x7fa8c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e0a73640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c80043b0 0x7fa8c8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1a75640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc15c060 0x7fa8c8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1274640 1 -- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc15c060 msgr2=0x7fa8c8004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1274640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc15c060 0x7fa8c8004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1274640 1 -- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c80043b0 msgr2=0x7fa8c8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1274640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c80043b0 0x7fa8c8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e1274640 1 -- 172.21.15.45:0/1945207674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8003530 con 0x7fa8c8003980 2023-07-09T02:21:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.106+0000 7fa8e0a73640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c80043b0 0x7fa8c8004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8e1274640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8c8003980 0x7fa8c8003d90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009ae0 tx=0x7fa8d801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01559dbf32aa177 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80a5610 con 0x7fa8c8003980 2023-07-09T02:21:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d80a5770 con 0x7fa8c8003980 2023-07-09T02:21:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8d3fff640 1 -- 172.21.15.45:0/1945207674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80a5b20 con 0x7fa8c8003980 2023-07-09T02:21:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1945207674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8c8003980 msgr2=0x7fa8c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8e34d8640 1 --2- 172.21.15.45:0/1945207674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8c8003980 0x7fa8c8003d90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009ae0 tx=0x7fa8d801ca20 comp rx=0 tx=0).stop 2023-07-09T02:21:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8e1a75640 1 -- 172.21.15.45:0/1945207674 reap_dead start 2023-07-09T02:21:09.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1945207674 shutdown_connections 2023-07-09T02:21:09.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1945207674 >> 172.21.15.45:0/1945207674 conn(0x7fa8dc0698e0 msgr2=0x7fa8dc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:09.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1945207674 shutdown_connections 2023-07-09T02:21:09.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.110+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1945207674 wait complete. 2023-07-09T02:21:09.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 Processor -- start 2023-07-09T02:21:09.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 -- start start 2023-07-09T02:21:09.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c8003980 0x7fa8dc0a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc0cbc90 0x7fa8dc0aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc1f48d0 0x7fa8dc1f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0aa960 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0cb7b0 con 0x7fa8c8003980 2023-07-09T02:21:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0a9ce0 con 0x7fa8dc0cbc90 2023-07-09T02:21:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc1f48d0 0x7fa8dc1f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc1f48d0 0x7fa8dc1f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60970/0 (socket says 172.21.15.45:60970) 2023-07-09T02:21:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 -- 172.21.15.45:0/1584436024 learned_addr learned my addr 172.21.15.45:0/1584436024 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e0a73640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc0cbc90 0x7fa8dc0aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1274640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c8003980 0x7fa8dc0a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 -- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc0cbc90 msgr2=0x7fa8dc0aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc0cbc90 0x7fa8dc0aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 -- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c8003980 msgr2=0x7fa8dc0a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c8003980 0x7fa8dc0a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 -- 172.21.15.45:0/1584436024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0a9fc0 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e1a75640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc1f48d0 0x7fa8dc1f4d70 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4001340 tx=0x7fa8d4007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8d1ffb640 1 -- 172.21.15.45:0/1584436024 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40114f0 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8d1ffb640 1 -- 172.21.15.45:0/1584436024 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d4011670 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8d1ffb640 1 -- 172.21.15.45:0/1584436024 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4011a20 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc0aa2a0 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.114+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc0a9940 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.118+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc0aaaa0 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.118+0000 7fa8d1ffb640 1 -- 172.21.15.45:0/1584436024 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8d4011b80 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.118+0000 7fa8d1ffb640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa8c00662b0 0x7fa8c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.118+0000 7fa8d1ffb640 1 -- 172.21.15.45:0/1584436024 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8d40833a0 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.118+0000 7fa8e1274640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa8c00662b0 0x7fa8c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.118+0000 7fa8e1274640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa8c00662b0 0x7fa8c0068760 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80af000 tx=0x7fa8d80046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.122+0000 7fa8d1ffb640 1 -- 172.21.15.45:0/1584436024 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8dc0aaaa0 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8dc0aaaa0 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8d1ffb640 1 -- 172.21.15.45:0/1584436024 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4675 (secure 0 0 0) 0x7fa8dc0aaaa0 con 0x7fa8dc1f48d0 2023-07-09T02:21:09.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:09.309 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2937988619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2937988619},{"type":"v1","addr":"172.21.15.45:6835","nonce":2937988619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/202593650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":202593650},{"type":"v1","addr":"172.21.15.45:6833","nonce":202593650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1590703663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1590703663},{"type":"v1","addr":"172.21.15.155:6837","nonce":1590703663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:21:03.398485+0000","modified":"2023-07-09T02:21:07.041368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8206":{"gid":8206,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/390558772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":390558772},{"type":"v1","addr":"172.21.15.155:6836","nonce":390558772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T02:21:09.309 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 83 2023-07-09T02:21:09.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa8c00662b0 msgr2=0x7fa8c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa8c00662b0 0x7fa8c0068760 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80af000 tx=0x7fa8d80046d0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc1f48d0 msgr2=0x7fa8dc1f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc1f48d0 0x7fa8dc1f4d70 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4001340 tx=0x7fa8d4007960 comp rx=0 tx=0).stop 2023-07-09T02:21:09.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 shutdown_connections 2023-07-09T02:21:09.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc1f48d0 0x7fa8dc1f4d70 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa8c00662b0 0x7fa8c0068760 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8dc0cbc90 0x7fa8dc0aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 --2- 172.21.15.45:0/1584436024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8c8003980 0x7fa8dc0a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.310+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 >> 172.21.15.45:0/1584436024 conn(0x7fa8dc0698e0 msgr2=0x7fa8dc15db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:09.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.314+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 shutdown_connections 2023-07-09T02:21:09.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.314+0000 7fa8e34d8640 1 -- 172.21.15.45:0/1584436024 wait complete. 2023-07-09T02:21:09.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:21:03.398485+0000', 'modified': '2023-07-09T02:21:07.041368+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8206}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8206': {'gid': 8206, 'name': 'd', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6836/390558772', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 390558772}, {'type': 'v1', 'addr': '172.21.15.155:6836', 'nonce': 390558772}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:21:09.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:21:09.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-09T02:21:09.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.878+0000 7f17563d2640 1 Processor -- start 2023-07-09T02:21:09.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.878+0000 7f17563d2640 1 -- start start 2023-07-09T02:21:09.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f17563d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17500cd120 0x7f17500b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f17563d2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1750160a50 con 0x7f17500d2620 2023-07-09T02:21:09.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f17563d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175015c430 con 0x7f175015c060 2023-07-09T02:21:09.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f17563d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175015fb60 con 0x7f17500cd120 2023-07-09T02:21:09.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f17500d2620 0x7f17500cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44366/0 (socket says 172.21.15.45:44366) 2023-07-09T02:21:09.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174f7fe640 1 -- 172.21.15.45:0/2948004859 learned_addr learned my addr 172.21.15.45:0/2948004859 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:09.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f175496f640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17500cd120 0x7f17500b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298856984 0 0) 0x7f1750160a50 con 0x7f17500d2620 2023-07-09T02:21:09.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1738003530 con 0x7f17500d2620 2023-07-09T02:21:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3028112928 0 0) 0x7f1738003530 con 0x7f17500d2620 2023-07-09T02:21:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17500cd120 msgr2=0x7f17500b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17500cd120 0x7f17500b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 >> v1:172.21.15.155:6789/0 conn(0x7f175015c060 legacy=0x7f17500d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175015fe40 con 0x7f17500d2620 2023-07-09T02:21:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f1744001680 con 0x7f17500d2620 2023-07-09T02:21:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 >> v1:172.21.15.45:6789/0 conn(0x7f17500d2620 legacy=0x7f17500cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17380039b0 0x7f1738003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17500cd120 0x7f17380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1738004d10 0x7f1738005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175015fb60 con 0x7f17380039b0 2023-07-09T02:21:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173800b990 con 0x7f1738004d10 2023-07-09T02:21:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173800bb20 con 0x7f17500cd120 2023-07-09T02:21:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174ffff640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17380039b0 0x7f1738003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174f7fe640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17500cd120 0x7f17380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f175496f640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1738004d10 0x7f1738005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174ffff640 1 -- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17500cd120 msgr2=0x7f17380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174ffff640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17500cd120 0x7f17380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174ffff640 1 -- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1738004d10 msgr2=0x7f1738005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174ffff640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1738004d10 0x7f1738005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.882+0000 7f174ffff640 1 -- 172.21.15.45:0/2948004859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738003530 con 0x7f17380039b0 2023-07-09T02:21:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f174ffff640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17380039b0 0x7f1738003d80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f1740001910 tx=0x7f174001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e56a9581dbfdfd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400ab670 con 0x7f17380039b0 2023-07-09T02:21:09.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17400ab7f0 con 0x7f17380039b0 2023-07-09T02:21:09.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f174effd640 1 -- 172.21.15.45:0/2948004859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400abba0 con 0x7f17380039b0 2023-07-09T02:21:09.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f17563d2640 1 -- 172.21.15.45:0/2948004859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17380039b0 msgr2=0x7f1738003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f17563d2640 1 --2- 172.21.15.45:0/2948004859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17380039b0 0x7f1738003d80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f1740001910 tx=0x7f174001c530 comp rx=0 tx=0).stop 2023-07-09T02:21:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f175496f640 1 -- 172.21.15.45:0/2948004859 reap_dead start 2023-07-09T02:21:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f17563d2640 1 -- 172.21.15.45:0/2948004859 shutdown_connections 2023-07-09T02:21:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f17563d2640 1 -- 172.21.15.45:0/2948004859 >> 172.21.15.45:0/2948004859 conn(0x7f17500698e0 msgr2=0x7f1750069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f17563d2640 1 -- 172.21.15.45:0/2948004859 shutdown_connections 2023-07-09T02:21:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f17563d2640 1 -- 172.21.15.45:0/2948004859 wait complete. 2023-07-09T02:21:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f17563d2640 1 Processor -- start 2023-07-09T02:21:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.886+0000 7f17563d2640 1 -- start start 2023-07-09T02:21:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f17563d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17380039b0 0x7f17500c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f17563d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1750156830 0x7f17500b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f17563d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17500b6110 0x7f175015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f17563d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17500c8fb0 con 0x7f17500b6110 2023-07-09T02:21:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f17563d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750150210 con 0x7f1750156830 2023-07-09T02:21:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f17563d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500b6580 con 0x7f17380039b0 2023-07-09T02:21:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17500b6110 0x7f175015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17500b6110 0x7f175015c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60984/0 (socket says 172.21.15.45:60984) 2023-07-09T02:21:09.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 -- 172.21.15.45:0/4258757860 learned_addr learned my addr 172.21.15.45:0/4258757860 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f174ffff640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17380039b0 0x7f17500c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f174f7fe640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1750156830 0x7f17500b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 -- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17380039b0 msgr2=0x7f17500c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17380039b0 0x7f17500c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 -- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1750156830 msgr2=0x7f17500b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1750156830 0x7f17500b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 -- 172.21.15.45:0/4258757860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17501514c0 con 0x7f17500b6110 2023-07-09T02:21:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f174ffff640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17380039b0 0x7f17500c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f175496f640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17500b6110 0x7f175015c5c0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f175008bca0 tx=0x7f1748011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f174cff9640 1 -- 172.21.15.45:0/4258757860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174800e040 con 0x7f17500b6110 2023-07-09T02:21:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f174cff9640 1 -- 172.21.15.45:0/4258757860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174800f040 con 0x7f17500b6110 2023-07-09T02:21:09.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f174cff9640 1 -- 172.21.15.45:0/4258757860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748015a80 con 0x7f17500b6110 2023-07-09T02:21:09.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f17563d2640 1 -- 172.21.15.45:0/4258757860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1750151030 con 0x7f17500b6110 2023-07-09T02:21:09.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.890+0000 7f17563d2640 1 -- 172.21.15.45:0/4258757860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1750150700 con 0x7f17500b6110 2023-07-09T02:21:09.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174cff9640 1 -- 172.21.15.45:0/4258757860 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1748015be0 con 0x7f17500b6110 2023-07-09T02:21:09.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174cff9640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f173c066280 0x7f173c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175973c000 1 Processor -- start 2023-07-09T02:21:09.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174cff9640 1 -- 172.21.15.45:0/4258757860 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1748083c90 con 0x7f17500b6110 2023-07-09T02:21:09.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175973c000 1 -- start start 2023-07-09T02:21:09.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174ffff640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f173c066280 0x7f173c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175973c000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175973c000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa3868a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175973c000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3869360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175973c000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa372ff80 con 0x561aa38b2800 2023-07-09T02:21:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175973c000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa3669c60 con 0x561aa3868f90 2023-07-09T02:21:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175973c000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561aa36bd700 con 0x561aa38b3110 2023-07-09T02:21:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa3868a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175496f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3869360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa3868a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:50668/0 (socket says 172.21.15.45:50668) 2023-07-09T02:21:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174f7fe640 1 -- 172.21.15.45:0/3703637424 learned_addr learned my addr 172.21.15.45:0/3703637424 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174ffff640 1 --2- 172.21.15.45:0/3703637424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175496f640 1 -- 172.21.15.45:0/3703637424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 msgr2=0x561aa3868a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175496f640 1 --2- 172.21.15.45:0/3703637424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa3868a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175496f640 1 -- 172.21.15.45:0/3703637424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 msgr2=0x561aa38b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f175496f640 1 --2- 172.21.15.45:0/3703637424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.894+0000 7f174ffff640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f173c066280 0x7f173c068730 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f17400af000 tx=0x7f17400012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175496f640 1 -- 172.21.15.45:0/3703637424 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561aa33b2890 con 0x561aa3868f90 2023-07-09T02:21:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175496f640 1 --2- 172.21.15.45:0/3703637424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3869360 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f17480511a0 tx=0x7f1748054910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7577a7382f5ed43 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f1735ffb640 1 -- 172.21.15.45:0/3703637424 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748053040 con 0x561aa3868f90 2023-07-09T02:21:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f1735ffb640 1 -- 172.21.15.45:0/3703637424 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748015e90 con 0x561aa3868f90 2023-07-09T02:21:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f1735ffb640 1 -- 172.21.15.45:0/3703637424 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174804edb0 con 0x561aa3868f90 2023-07-09T02:21:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- 172.21.15.45:0/3703637424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 msgr2=0x561aa3869360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 --2- 172.21.15.45:0/3703637424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3869360 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f17480511a0 tx=0x7f1748054910 comp rx=0 tx=0).stop 2023-07-09T02:21:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- 172.21.15.45:0/3703637424 shutdown_connections 2023-07-09T02:21:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 --2- 172.21.15.45:0/3703637424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3869360 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 --2- 172.21.15.45:0/3703637424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa3868a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 --2- 172.21.15.45:0/3703637424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- 172.21.15.45:0/3703637424 >> 172.21.15.45:0/3703637424 conn(0x561aa372ba70 msgr2=0x561aa3867330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:09.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- 172.21.15.45:0/3703637424 shutdown_connections 2023-07-09T02:21:09.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- 172.21.15.45:0/3703637424 wait complete. 2023-07-09T02:21:09.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- start start 2023-07-09T02:21:09.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 Processor -- start 2023-07-09T02:21:09.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa3868f90 0x561aa3873fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa38b2800 0x561aa3874510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b3110 0x561aa3874a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa36b67a0 con 0x561aa38b3110 2023-07-09T02:21:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa3672f00 con 0x561aa38b2800 2023-07-09T02:21:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561aa3672ba0 con 0x561aa3868f90 2023-07-09T02:21:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175973c000 10 client.0 _ll_register_callbacks cb 0x561aa3854930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:21:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175496f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b3110 0x561aa3874a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175496f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b3110 0x561aa3874a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32780/0 (socket says 172.21.15.45:32780) 2023-07-09T02:21:09.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f175496f640 1 -- 172.21.15.45:0/1890592455 learned_addr learned my addr 172.21.15.45:0/1890592455 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:09.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f174ffff640 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa3868f90 0x561aa3873fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.898+0000 7f174f7fe640 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa38b2800 0x561aa3874510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175496f640 1 -- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa3868f90 msgr2=0x561aa3873fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175496f640 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa3868f90 0x561aa3873fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175496f640 1 -- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa38b2800 msgr2=0x561aa3874510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175496f640 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa38b2800 0x561aa3874510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175496f640 1 -- 172.21.15.45:0/1890592455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1750150700 con 0x561aa38b3110 2023-07-09T02:21:09.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f174ffff640 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa3868f90 0x561aa3873fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:09.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175496f640 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b3110 0x561aa3874a50 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f174805cb50 tx=0x7f1748004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369bf618980467e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:21:09.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 1 -- 172.21.15.45:0/1890592455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748071070 con 0x561aa38b3110 2023-07-09T02:21:09.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 1 -- 172.21.15.45:0/1890592455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f174804ed60 con 0x561aa38b3110 2023-07-09T02:21:09.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 -- 172.21.15.45:0/1890592455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561aa36b50f0 con 0x561aa38b3110 2023-07-09T02:21:09.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 1 -- 172.21.15.45:0/1890592455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f174804ef60 con 0x561aa38b3110 2023-07-09T02:21:09.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 10 client.8826 fetch_fsmap learned FSMap version 83 2023-07-09T02:21:09.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 -- 172.21.15.45:0/1890592455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x561aa367b130 con 0x561aa38b3110 2023-07-09T02:21:09.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 1 -- 172.21.15.45:0/1890592455 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561aa36b50f0 con 0x561aa38b3110 2023-07-09T02:21:09.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 1 -- 172.21.15.45:0/1890592455 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 83) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1748005d20 con 0x561aa38b3110 2023-07-09T02:21:09.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 10 client.8826 fetch_fsmap finished waiting for FSMap version 83 2023-07-09T02:21:09.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 10 client.8826 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T02:21:09.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 20 client.8826 populate_metadata read hostname 'smithi045' 2023-07-09T02:21:09.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] conn(0x561aa3875320 0x561aa38c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 4 client.8826 mds_command: new command op to 8206 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:21:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 -- 172.21.15.45:0/1890592455 --> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561aa367de40 con 0x561aa3875320 2023-07-09T02:21:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f174ffff640 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] conn(0x561aa3875320 0x561aa38c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f174ffff640 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] conn(0x561aa3875320 0x561aa38c3d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4be61aeeb08344c server_cookie=55749894ddc9b853 in_seq=0 out_seq=0 2023-07-09T02:21:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 10 client.8826 ms_handle_connect on v2:172.21.15.155:6834/390558772 2023-07-09T02:21:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 1 -- 172.21.15.45:0/1890592455 <== mds.0 v2:172.21.15.155:6834/390558772 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561aa367de40 con 0x561aa3875320 2023-07-09T02:21:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 10 client.8826 handle_command_reply: tid=0 2023-07-09T02:21:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 client.8826 shutdown 2023-07-09T02:21:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 -- 172.21.15.45:0/1890592455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b3110 msgr2=0x561aa3874a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b3110 0x561aa3874a50 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f174805cb50 tx=0x7f1748004ac0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 -- 172.21.15.45:0/1890592455 shutdown_connections 2023-07-09T02:21:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] conn(0x561aa3875320 0x561aa38c3d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b3110 0x561aa3874a50 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa38b2800 0x561aa3874510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 --2- 172.21.15.45:0/1890592455 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa3868f90 0x561aa3873fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f172effd640 0 client.8826 ms_handle_reset on v2:172.21.15.155:6834/390558772 2023-07-09T02:21:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 -- 172.21.15.45:0/1890592455 >> 172.21.15.45:0/1890592455 conn(0x561aa372ba70 msgr2=0x561aa3867a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 -- 172.21.15.45:0/1890592455 shutdown_connections 2023-07-09T02:21:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.902+0000 7f175973c000 1 -- 172.21.15.45:0/1890592455 wait complete. 2023-07-09T02:21:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.906+0000 7f175973c000 20 client.8826 trim_cache size 0 max 16384 2023-07-09T02:21:09.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.918+0000 7f175973c000 1 Processor -- start 2023-07-09T02:21:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.918+0000 7f175973c000 1 -- start start 2023-07-09T02:21:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.918+0000 7f175973c000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa38c5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.918+0000 7f175973c000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.918+0000 7f175973c000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa38ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.918+0000 7f175973c000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa3373940 con 0x561aa38b2800 2023-07-09T02:21:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.918+0000 7f175973c000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa3868ab0 con 0x561aa3868f90 2023-07-09T02:21:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.918+0000 7f175973c000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561aa38607a0 con 0x561aa38b3110 2023-07-09T02:21:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32794/0 (socket says 172.21.15.45:32794) 2023-07-09T02:21:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 -- 172.21.15.45:0/3888097753 learned_addr learned my addr 172.21.15.45:0/3888097753 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174ffff640 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa38c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175496f640 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa38ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 -- 172.21.15.45:0/3888097753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 msgr2=0x561aa38ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa38ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 -- 172.21.15.45:0/3888097753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 msgr2=0x561aa38c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa38c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 -- 172.21.15.45:0/3888097753 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561aa36613c0 con 0x561aa38b2800 2023-07-09T02:21:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38c59b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f1744007d30 tx=0x7f1744000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8841cd428f10b408 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f17367fc640 1 -- 172.21.15.45:0/3888097753 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174401b070 con 0x561aa38b2800 2023-07-09T02:21:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f17367fc640 1 -- 172.21.15.45:0/3888097753 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1744004c80 con 0x561aa38b2800 2023-07-09T02:21:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f17367fc640 1 -- 172.21.15.45:0/3888097753 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744004e30 con 0x561aa38b2800 2023-07-09T02:21:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- 172.21.15.45:0/3888097753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 msgr2=0x561aa38c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38c59b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f1744007d30 tx=0x7f1744000ee0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- 172.21.15.45:0/3888097753 shutdown_connections 2023-07-09T02:21:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa38ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa38c59b0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 --2- 172.21.15.45:0/3888097753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa38c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- 172.21.15.45:0/3888097753 >> 172.21.15.45:0/3888097753 conn(0x561aa372ba70 msgr2=0x561aa38c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- 172.21.15.45:0/3888097753 shutdown_connections 2023-07-09T02:21:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- 172.21.15.45:0/3888097753 wait complete. 2023-07-09T02:21:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- start start 2023-07-09T02:21:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 Processor -- start 2023-07-09T02:21:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3910200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa3910740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa38b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa3682760 con 0x561aa38b2800 2023-07-09T02:21:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa3672ba0 con 0x561aa3868f90 2023-07-09T02:21:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x561aa3685230 con 0x561aa38b3110 2023-07-09T02:21:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f175973c000 10 client.0 _ll_register_callbacks cb 0x561aa38354d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:21:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa3910740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3910200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.922+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa3910740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32808/0 (socket says 172.21.15.45:32808) 2023-07-09T02:21:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174f7fe640 1 -- 172.21.15.45:0/197810021 learned_addr learned my addr 172.21.15.45:0/197810021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175496f640 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa38b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174f7fe640 1 -- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 msgr2=0x561aa38b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174f7fe640 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa38b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174f7fe640 1 -- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 msgr2=0x561aa3910200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174f7fe640 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3910200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174f7fe640 1 -- 172.21.15.45:0/197810021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175015fe40 con 0x561aa38b2800 2023-07-09T02:21:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174f7fe640 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa3910740 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f1744000f20 tx=0x7f1744001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819f27b7e956b20b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:21:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 1 -- 172.21.15.45:0/197810021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744007a90 con 0x561aa38b2800 2023-07-09T02:21:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 -- 172.21.15.45:0/197810021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561aa386c920 con 0x561aa38b2800 2023-07-09T02:21:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 1 -- 172.21.15.45:0/197810021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17440015e0 con 0x561aa38b2800 2023-07-09T02:21:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 1 -- 172.21.15.45:0/197810021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1744017de0 con 0x561aa38b2800 2023-07-09T02:21:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 10 client.8832 fetch_fsmap learned FSMap version 83 2023-07-09T02:21:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 -- 172.21.15.45:0/197810021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x561aa33b2cc0 con 0x561aa38b2800 2023-07-09T02:21:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 1 -- 172.21.15.45:0/197810021 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561aa386c920 con 0x561aa38b2800 2023-07-09T02:21:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 1 -- 172.21.15.45:0/197810021 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 83) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1744012070 con 0x561aa38b2800 2023-07-09T02:21:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 10 client.8832 fetch_fsmap finished waiting for FSMap version 83 2023-07-09T02:21:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 10 client.8832 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T02:21:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 20 client.8832 populate_metadata read hostname 'smithi045' 2023-07-09T02:21:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] conn(0x561aa3917060 0x561aa3919440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 4 client.8832 mds_command: new command op to 8206 tid=0[{"prefix": "status"}] 2023-07-09T02:21:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 -- 172.21.15.45:0/197810021 --> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561aa366f6f0 con 0x561aa3917060 2023-07-09T02:21:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174ffff640 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] conn(0x561aa3917060 0x561aa3919440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f174ffff640 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] conn(0x561aa3917060 0x561aa3919440 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61b529ebf2d453b server_cookie=faddde810d0227c0 in_seq=0 out_seq=0 2023-07-09T02:21:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 10 client.8832 ms_handle_connect on v2:172.21.15.155:6834/390558772 2023-07-09T02:21:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 1 -- 172.21.15.45:0/197810021 <== mds.0 v2:172.21.15.155:6834/390558772 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x561aa366f6f0 con 0x561aa3917060 2023-07-09T02:21:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 10 client.8832 handle_command_reply: tid=0 2023-07-09T02:21:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 client.8832 shutdown 2023-07-09T02:21:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 -- 172.21.15.45:0/197810021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 msgr2=0x561aa3910740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa3910740 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f1744000f20 tx=0x7f1744001990 comp rx=0 tx=0).stop 2023-07-09T02:21:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 -- 172.21.15.45:0/197810021 shutdown_connections 2023-07-09T02:21:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:6834/390558772,v1:172.21.15.155:6836/390558772] conn(0x561aa3917060 0x561aa3919440 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x561aa38b3110 0x561aa38b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561aa38b2800 0x561aa3910740 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 --2- 172.21.15.45:0/197810021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561aa3868f90 0x561aa3910200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f172effd640 0 client.8832 ms_handle_reset on v2:172.21.15.155:6834/390558772 2023-07-09T02:21:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 -- 172.21.15.45:0/197810021 >> 172.21.15.45:0/197810021 conn(0x561aa372ba70 msgr2=0x561aa38c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 -- 172.21.15.45:0/197810021 shutdown_connections 2023-07-09T02:21:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 1 -- 172.21.15.45:0/197810021 wait complete. 2023-07-09T02:21:09.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.926+0000 7f175973c000 20 client.8832 trim_cache size 0 max 16384 2023-07-09T02:21:09.933 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:21:09.933 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:21:09.934 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:21:09.934 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 8206, 2023-07-09T02:21:09.934 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:21:09.934 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:21:09.934 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:21:09.934 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.913519913, 2023-07-09T02:21:09.934 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 83, 2023-07-09T02:21:09.935 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 166, 2023-07-09T02:21:09.935 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 166, 2023-07-09T02:21:09.935 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.817131307 2023-07-09T02:21:09.935 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:21:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 -- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f173c066280 msgr2=0x7f173c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f173c066280 0x7f173c068730 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f17400af000 tx=0x7f17400012c0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 -- 172.21.15.45:0/4258757860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17500b6110 msgr2=0x7f175015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17500b6110 0x7f175015c5c0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f175008bca0 tx=0x7f1748011bf0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 -- 172.21.15.45:0/4258757860 shutdown_connections 2023-07-09T02:21:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17500b6110 0x7f175015c5c0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1750156830 0x7f17500b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f173c066280 0x7f173c068730 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 --2- 172.21.15.45:0/4258757860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17380039b0 0x7f17500c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 -- 172.21.15.45:0/4258757860 >> 172.21.15.45:0/4258757860 conn(0x7f17500698e0 msgr2=0x7f17500d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 -- 172.21.15.45:0/4258757860 shutdown_connections 2023-07-09T02:21:09.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:09.930+0000 7f17563d2640 1 -- 172.21.15.45:0/4258757860 wait complete. 2023-07-09T02:21:09.945 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:21:10.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d3c8bc640 1 Processor -- start 2023-07-09T02:21:10.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d3c8bc640 1 -- start start 2023-07-09T02:21:10.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d3c8bc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d3806b240 0x7f0d3806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:10.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d3c8bc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d380d0d70 0x7f0d380d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:10.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d3c8bc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380b2090 con 0x7f0d3815c870 2023-07-09T02:21:10.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d3c8bc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3806bc00 con 0x7f0d3806b240 2023-07-09T02:21:10.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d3c8bc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38160520 con 0x7f0d380d0d70 2023-07-09T02:21:10.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d37fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d380d0d70 0x7f0d380d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:10.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d36ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0d3806b240 0x7f0d3806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d377fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0d3815c870 0x7f0d380b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:48746/0 (socket says 172.21.15.45:48746) 2023-07-09T02:21:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d377fe640 1 -- 172.21.15.45:0/1195028485 learned_addr learned my addr 172.21.15.45:0/1195028485 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d36ffd640 1 -- 172.21.15.45:0/1195028485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d380d0d70 msgr2=0x7f0d380d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d36ffd640 1 --2- 172.21.15.45:0/1195028485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d380d0d70 0x7f0d380d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d36ffd640 1 -- 172.21.15.45:0/1195028485 >> v1:172.21.15.155:6789/0 conn(0x7f0d3815c870 legacy=0x7f0d380b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d36ffd640 1 -- 172.21.15.45:0/1195028485 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d38160800 con 0x7f0d3806b240 2023-07-09T02:21:10.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.094+0000 7f0d367fc640 1 -- 172.21.15.45:0/1195028485 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251736980 0 0) 0x7f0d380b2090 con 0x7f0d3815c870 2023-07-09T02:21:10.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d36ffd640 1 --2- 172.21.15.45:0/1195028485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d3806b240 0x7f0d3806b6c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097c0 tx=0x7f0d2c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4659320c7a662bdf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:10.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d367fc640 1 -- 172.21.15.45:0/1195028485 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0ab650 con 0x7f0d3806b240 2023-07-09T02:21:10.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d367fc640 1 -- 172.21.15.45:0/1195028485 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0ab7b0 con 0x7f0d3806b240 2023-07-09T02:21:10.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d367fc640 1 -- 172.21.15.45:0/1195028485 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0abb40 con 0x7f0d3806b240 2023-07-09T02:21:10.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/1195028485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d3806b240 msgr2=0x7f0d3806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:10.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/1195028485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d3806b240 0x7f0d3806b6c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0097c0 tx=0x7f0d2c01c450 comp rx=0 tx=0).stop 2023-07-09T02:21:10.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/1195028485 shutdown_connections 2023-07-09T02:21:10.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/1195028485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d380d0d70 0x7f0d380d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/1195028485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d3806b240 0x7f0d3806b6c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/1195028485 >> 172.21.15.45:0/1195028485 conn(0x7f0d38070be0 msgr2=0x7f0d38070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:10.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/1195028485 shutdown_connections 2023-07-09T02:21:10.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/1195028485 wait complete. 2023-07-09T02:21:10.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.098+0000 7f0d3c8bc640 1 Processor -- start 2023-07-09T02:21:10.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 -- start start 2023-07-09T02:21:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d3806b240 0x7f0d381568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d380d0d70 0x7f0d38156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d3815c870 0x7f0d38158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d381541c0 con 0x7f0d3806b240 2023-07-09T02:21:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380cadb0 con 0x7f0d380d0d70 2023-07-09T02:21:10.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38166c90 con 0x7f0d3815c870 2023-07-09T02:21:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d3806b240 0x7f0d381568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d3806b240 0x7f0d381568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32822/0 (socket says 172.21.15.45:32822) 2023-07-09T02:21:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 -- 172.21.15.45:0/373343193 learned_addr learned my addr 172.21.15.45:0/373343193 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d36ffd640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d380d0d70 0x7f0d38156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d37fff640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d3815c870 0x7f0d38158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 -- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d3815c870 msgr2=0x7f0d38158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d3815c870 0x7f0d38158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 -- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d380d0d70 msgr2=0x7f0d38156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d380d0d70 0x7f0d38156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 -- 172.21.15.45:0/373343193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c009420 con 0x7f0d3806b240 2023-07-09T02:21:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d37fff640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d3815c870 0x7f0d38158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d377fe640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d3806b240 0x7f0d381568f0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c580 tx=0x7f0d2800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d1ffff640 1 -- 172.21.15.45:0/373343193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28005cf0 con 0x7f0d3806b240 2023-07-09T02:21:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d1ffff640 1 -- 172.21.15.45:0/373343193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d28005e70 con 0x7f0d3806b240 2023-07-09T02:21:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d380cc5f0 con 0x7f0d3806b240 2023-07-09T02:21:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d1ffff640 1 -- 172.21.15.45:0/373343193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28007310 con 0x7f0d3806b240 2023-07-09T02:21:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d381546b0 con 0x7f0d3806b240 2023-07-09T02:21:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.102+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3804e020 con 0x7f0d3806b240 2023-07-09T02:21:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.106+0000 7f0d1ffff640 1 -- 172.21.15.45:0/373343193 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d28007470 con 0x7f0d3806b240 2023-07-09T02:21:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.106+0000 7f0d1ffff640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d24066280 0x7f0d24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.106+0000 7f0d1ffff640 1 -- 172.21.15.45:0/373343193 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d28083310 con 0x7f0d3806b240 2023-07-09T02:21:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.106+0000 7f0d36ffd640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d24066280 0x7f0d24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.106+0000 7f0d36ffd640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d24066280 0x7f0d24068730 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0af000 tx=0x7f0d2c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.110+0000 7f0d1ffff640 1 -- 172.21.15.45:0/373343193 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d28050850 con 0x7f0d3806b240 2023-07-09T02:21:10.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.294+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d380cfef0 con 0x7f0d3806b240 2023-07-09T02:21:10.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.294+0000 7f0d1ffff640 1 -- 172.21.15.45:0/373343193 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d28053e70 con 0x7f0d3806b240 2023-07-09T02:21:10.295 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:21:10.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d24066280 msgr2=0x7f0d24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:10.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d24066280 0x7f0d24068730 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0af000 tx=0x7f0d2c0a7000 comp rx=0 tx=0).stop 2023-07-09T02:21:10.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d3806b240 msgr2=0x7f0d381568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:10.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d3806b240 0x7f0d381568f0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c580 tx=0x7f0d2800ca40 comp rx=0 tx=0).stop 2023-07-09T02:21:10.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 shutdown_connections 2023-07-09T02:21:10.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0d24066280 0x7f0d24068730 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d3815c870 0x7f0d38158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d380d0d70 0x7f0d38156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 --2- 172.21.15.45:0/373343193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d3806b240 0x7f0d381568f0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:10.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 >> 172.21.15.45:0/373343193 conn(0x7f0d38070be0 msgr2=0x7f0d380b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:10.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 shutdown_connections 2023-07-09T02:21:10.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:10.298+0000 7f0d3c8bc640 1 -- 172.21.15.45:0/373343193 wait complete. 2023-07-09T02:21:10.315 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:21:10.316 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:21:10.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:21:10.316 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:21:10.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:21:10.317 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:21:10.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:21:10.317 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:21:10.317 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:21:10.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.318 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:21:10.327 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:21:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:21:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:21:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:21:10.328 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:10.328 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:21:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:21:10.329 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:21:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:21:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:21:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41856sec preferred_lft 41856sec 2023-07-09T02:21:10.329 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:21:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:10.330 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:21:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:21:10.330 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:21:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:10.330 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:21:10.330 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:21:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:21:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:10.331 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:21:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:21:10.331 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:21:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:10.332 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:21:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:21:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:21:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:10.332 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:21:10.332 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:21:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:21:10.333 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:10.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.334 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:21:10.393 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:21:10.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.395 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:21:10.451 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:21:10.452 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:21:10.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.453 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:21:10.453 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:21:10.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:21:10.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:21:10.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:21:10.455 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:21:10.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.548 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:21:10.557 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:21:10.557 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:21:10.558 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:21:10.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.558 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:21:10.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:21:10.623 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:21:10.674 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:21:10.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:21:10.675 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:21:10.726 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:21:10.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.727 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:21:10.818 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:21:10.818 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:21:10.832 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:21:10.832 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:21:10.832 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:21:10.832 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:21:10.832 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:21:10.836 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:21:10.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:21:10.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:10.860 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:21:10.926 INFO:teuthology.orchestra.run.smithi045.stdout:client7217 2023-07-09T02:21:10.926 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:21:10.926 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:21:10.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:21:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.162+0000 7f6dea99f640 1 Processor -- start 2023-07-09T02:21:11.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.162+0000 7f6dea99f640 1 -- start start 2023-07-09T02:21:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6dea99f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6de40c8d10 0x7f6de40c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6dea99f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 0x7f6de415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6dea99f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de406bf30 con 0x7f6de40ca0f0 2023-07-09T02:21:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6dea99f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de415e4c0 con 0x7f6de40c8d10 2023-07-09T02:21:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6dea99f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de406bc50 con 0x7f6de415db00 2023-07-09T02:21:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6de40ca0f0 0x7f6de40cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44370/0 (socket says 172.21.15.45:44370) 2023-07-09T02:21:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de3fff640 1 -- 172.21.15.45:0/1502180168 learned_addr learned my addr 172.21.15.45:0/1502180168 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de37fe640 1 --2- 172.21.15.45:0/1502180168 >> v2:172.21.15.155:3300/0 conn(0x7f6de40c8d10 0x7f6de40c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de8f3c640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 0x7f6de415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561254904 0 0) 0x7f6de406bf30 con 0x7f6de40ca0f0 2023-07-09T02:21:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dcc003530 con 0x7f6de40ca0f0 2023-07-09T02:21:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2164161116 0 0) 0x7f6dcc003530 con 0x7f6de40ca0f0 2023-07-09T02:21:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 msgr2=0x7f6de415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 0x7f6de415df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 >> v2:172.21.15.155:3300/0 conn(0x7f6de40c8d10 msgr2=0x7f6de40c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 --2- 172.21.15.45:0/1502180168 >> v2:172.21.15.155:3300/0 conn(0x7f6de40c8d10 0x7f6de40c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40cab90 con 0x7f6de40ca0f0 2023-07-09T02:21:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f6dd4001680 con 0x7f6de40ca0f0 2023-07-09T02:21:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 >> v1:172.21.15.45:6789/0 conn(0x7f6de40ca0f0 legacy=0x7f6de40cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003980 0x7f6dcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0043b0 0x7f6dcc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 0x7f6dcc004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de415e4c0 con 0x7f6dcc0043b0 2023-07-09T02:21:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de406bc50 con 0x7f6dcc003980 2023-07-09T02:21:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc00fda0 con 0x7f6de415db00 2023-07-09T02:21:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de37fe640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0043b0 0x7f6dcc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de3fff640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003980 0x7f6dcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de8f3c640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 0x7f6dcc004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de37fe640 1 -- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 msgr2=0x7f6dcc004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de37fe640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 0x7f6dcc004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de37fe640 1 -- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003980 msgr2=0x7f6dcc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de37fe640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dcc003980 0x7f6dcc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de37fe640 1 -- 172.21.15.45:0/1502180168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc003530 con 0x7f6dcc0043b0 2023-07-09T02:21:11.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.166+0000 7f6de8f3c640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6de415db00 0x7f6dcc004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:11.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6de37fe640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0043b0 0x7f6dcc004870 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009b10 tx=0x7f6dd801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d2a9a4c7b637bf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:11.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80a5570 con 0x7f6dcc0043b0 2023-07-09T02:21:11.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd80a56d0 con 0x7f6dcc0043b0 2023-07-09T02:21:11.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6de2ffd640 1 -- 172.21.15.45:0/1502180168 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd80a5880 con 0x7f6dcc0043b0 2023-07-09T02:21:11.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6dea99f640 1 -- 172.21.15.45:0/1502180168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0043b0 msgr2=0x7f6dcc004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:11.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6dea99f640 1 --2- 172.21.15.45:0/1502180168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6dcc0043b0 0x7f6dcc004870 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009b10 tx=0x7f6dd801ca90 comp rx=0 tx=0).stop 2023-07-09T02:21:11.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6de8f3c640 1 -- 172.21.15.45:0/1502180168 reap_dead start 2023-07-09T02:21:11.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6dea99f640 1 -- 172.21.15.45:0/1502180168 shutdown_connections 2023-07-09T02:21:11.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6dea99f640 1 -- 172.21.15.45:0/1502180168 >> 172.21.15.45:0/1502180168 conn(0x7f6de40694b0 msgr2=0x7f6de40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:11.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6dea99f640 1 -- 172.21.15.45:0/1502180168 shutdown_connections 2023-07-09T02:21:11.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6dea99f640 1 -- 172.21.15.45:0/1502180168 wait complete. 2023-07-09T02:21:11.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6dea99f640 1 Processor -- start 2023-07-09T02:21:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.170+0000 7f6dea99f640 1 -- start start 2023-07-09T02:21:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc0043b0 0x7f6de40c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4146610 0x7f6de40c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de4145ad0 0x7f6de415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40b1760 con 0x7f6de4145ad0 2023-07-09T02:21:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40b20d0 con 0x7f6de4146610 2023-07-09T02:21:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40b4460 con 0x7f6dcc0043b0 2023-07-09T02:21:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de4145ad0 0x7f6de415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de4145ad0 0x7f6de415c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32842/0 (socket says 172.21.15.45:32842) 2023-07-09T02:21:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 -- 172.21.15.45:0/1127365780 learned_addr learned my addr 172.21.15.45:0/1127365780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de3fff640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc0043b0 0x7f6de40c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de37fe640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4146610 0x7f6de40c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 -- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc0043b0 msgr2=0x7f6de40c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc0043b0 0x7f6de40c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 -- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4146610 msgr2=0x7f6de40c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4146610 0x7f6de40c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 -- 172.21.15.45:0/1127365780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40b19b0 con 0x7f6de4145ad0 2023-07-09T02:21:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de8f3c640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de4145ad0 0x7f6de415c9e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f6de40b1310 tx=0x7f6ddc009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de0ff9640 1 -- 172.21.15.45:0/1127365780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc01b070 con 0x7f6de4145ad0 2023-07-09T02:21:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de0ff9640 1 -- 172.21.15.45:0/1127365780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc00f040 con 0x7f6de4145ad0 2023-07-09T02:21:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de0ff9640 1 -- 172.21.15.45:0/1127365780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00e050 con 0x7f6de4145ad0 2023-07-09T02:21:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de40b1c90 con 0x7f6de4145ad0 2023-07-09T02:21:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de40c7580 con 0x7f6de4145ad0 2023-07-09T02:21:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de40c9c20 con 0x7f6de4145ad0 2023-07-09T02:21:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.174+0000 7f6de0ff9640 1 -- 172.21.15.45:0/1127365780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ddc015650 con 0x7f6de4145ad0 2023-07-09T02:21:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.178+0000 7f6de0ff9640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dd00662b0 0x7f6dd0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.178+0000 7f6de0ff9640 1 -- 172.21.15.45:0/1127365780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ddc083990 con 0x7f6de4145ad0 2023-07-09T02:21:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.178+0000 7f6de3fff640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dd00662b0 0x7f6dd0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.178+0000 7f6de3fff640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dd00662b0 0x7f6dd0068760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40015e0 tx=0x7f6dd4007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:11.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.182+0000 7f6de0ff9640 1 -- 172.21.15.45:0/1127365780 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ddc050cf0 con 0x7f6de4145ad0 2023-07-09T02:21:11.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.366+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6de40b3f10 con 0x7f6de4145ad0 2023-07-09T02:21:11.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6de0ff9640 1 -- 172.21.15.45:0/1127365780 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6ddc054310 con 0x7f6de4145ad0 2023-07-09T02:21:11.367 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:21:11.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dd00662b0 msgr2=0x7f6dd0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:11.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dd00662b0 0x7f6dd0068760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40015e0 tx=0x7f6dd4007900 comp rx=0 tx=0).stop 2023-07-09T02:21:11.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de4145ad0 msgr2=0x7f6de415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:11.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de4145ad0 0x7f6de415c9e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f6de40b1310 tx=0x7f6ddc009ed0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 shutdown_connections 2023-07-09T02:21:11.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de4145ad0 0x7f6de415c9e0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6de4146610 0x7f6de40c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6dd00662b0 0x7f6dd0068760 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 --2- 172.21.15.45:0/1127365780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dcc0043b0 0x7f6de40c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:11.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 >> 172.21.15.45:0/1127365780 conn(0x7f6de40694b0 msgr2=0x7f6de40c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:11.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 shutdown_connections 2023-07-09T02:21:11.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:11.370+0000 7f6dea99f640 1 -- 172.21.15.45:0/1127365780 wait complete. 2023-07-09T02:21:11.387 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:21:11.388 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:21:11.388 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:21:11.388 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:21:11.389 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:21:11.389 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:21:11.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:21:11.389 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:21:11.390 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:21:11.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.390 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:21:11.400 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:21:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:21:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:21:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:21:11.401 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:11.401 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:21:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:21:11.402 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:21:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:21:11.402 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:21:11.402 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:11.402 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:21:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:21:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 41862sec preferred_lft 41862sec 2023-07-09T02:21:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:21:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:11.403 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:21:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:11.403 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:21:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:11.404 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:21:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:21:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:21:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:11.404 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:21:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:11.405 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:21:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:21:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:21:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:11.405 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:21:11.405 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:21:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:21:11.406 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:21:11.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.407 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:21:11.474 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:21:11.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.477 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:21:11.527 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:21:11.527 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:21:11.527 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:21:11.527 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:21:11.527 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:21:11.528 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:21:11.528 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:21:11.528 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:21:11.528 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:21:11.528 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:21:11.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.529 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:21:11.530 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:21:11.530 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:21:11.530 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:21:11.531 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:21:11.531 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:21:11.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.629 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:21:11.637 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:21:11.638 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:21:11.638 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:21:11.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.639 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:21:11.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:21:11.702 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:21:11.753 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:21:11.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:21:11.753 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:21:11.806 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:21:11.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.807 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:21:11.900 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:21:11.900 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:21:11.912 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:21:11.912 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:21:11.912 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:21:11.912 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:21:11.912 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:21:11.916 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:21:11.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.917 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:21:11.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:21:11.938 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:21:11.991 INFO:teuthology.orchestra.run.smithi155.stdout:client8353 2023-07-09T02:21:11.992 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:21:11.992 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:21:12.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:21:12.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65358f640 1 Processor -- start 2023-07-09T02:21:12.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65358f640 1 -- start start 2023-07-09T02:21:12.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65358f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb64c0d2620 0x7fb64c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65358f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb64c0cd120 0x7fb64c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65358f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c160a50 con 0x7fb64c15c060 2023-07-09T02:21:12.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65358f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c15c430 con 0x7fb64c0d2620 2023-07-09T02:21:12.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65358f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c15fb60 con 0x7fb64c0cd120 2023-07-09T02:21:12.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65132b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb64c15c060 0x7fb64c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35144/0 (socket says 172.21.15.45:35144) 2023-07-09T02:21:12.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb65132b640 1 -- 172.21.15.45:0/784866635 learned_addr learned my addr 172.21.15.45:0/784866635 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:12.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb650b2a640 1 --2- 172.21.15.45:0/784866635 >> v2:172.21.15.45:3300/0 conn(0x7fb64c0d2620 0x7fb64c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb651b2c640 1 --2- 172.21.15.45:0/784866635 >> v2:172.21.15.155:3300/0 conn(0x7fb64c0cd120 0x7fb64c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb650b2a640 1 -- 172.21.15.45:0/784866635 >> v2:172.21.15.155:3300/0 conn(0x7fb64c0cd120 msgr2=0x7fb64c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:12.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb650b2a640 1 --2- 172.21.15.45:0/784866635 >> v2:172.21.15.155:3300/0 conn(0x7fb64c0cd120 0x7fb64c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb650b2a640 1 -- 172.21.15.45:0/784866635 >> v1:172.21.15.45:6789/0 conn(0x7fb64c15c060 legacy=0x7fb64c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb650b2a640 1 -- 172.21.15.45:0/784866635 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c15fe40 con 0x7fb64c0d2620 2023-07-09T02:21:12.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.190+0000 7fb643fff640 1 -- 172.21.15.45:0/784866635 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426117163 0 0) 0x7fb64c160a50 con 0x7fb64c15c060 2023-07-09T02:21:12.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb650b2a640 1 --2- 172.21.15.45:0/784866635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c0b4ed0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fb64c06b120 tx=0x7fb63c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f86a4eac369915 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:12.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb643fff640 1 -- 172.21.15.45:0/784866635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0a7070 con 0x7fb64c0d2620 2023-07-09T02:21:12.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb643fff640 1 -- 172.21.15.45:0/784866635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c0ab430 con 0x7fb64c0d2620 2023-07-09T02:21:12.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb643fff640 1 -- 172.21.15.45:0/784866635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0ab7c0 con 0x7fb64c0d2620 2023-07-09T02:21:12.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb65358f640 1 -- 172.21.15.45:0/784866635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 msgr2=0x7fb64c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb65358f640 1 --2- 172.21.15.45:0/784866635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c0b4ed0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fb64c06b120 tx=0x7fb63c01c430 comp rx=0 tx=0).stop 2023-07-09T02:21:12.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb65358f640 1 -- 172.21.15.45:0/784866635 shutdown_connections 2023-07-09T02:21:12.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb65358f640 1 --2- 172.21.15.45:0/784866635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c0b4ed0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb65358f640 1 --2- 172.21.15.45:0/784866635 >> v2:172.21.15.155:3300/0 conn(0x7fb64c0cd120 0x7fb64c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb65358f640 1 -- 172.21.15.45:0/784866635 >> 172.21.15.45:0/784866635 conn(0x7fb64c0698e0 msgr2=0x7fb64c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:12.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb65358f640 1 -- 172.21.15.45:0/784866635 shutdown_connections 2023-07-09T02:21:12.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.194+0000 7fb65358f640 1 -- 172.21.15.45:0/784866635 wait complete. 2023-07-09T02:21:12.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 Processor -- start 2023-07-09T02:21:12.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 -- start start 2023-07-09T02:21:12.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb64c0cd120 0x7fb64c154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb64c15c060 0x7fb64c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c1550e0 con 0x7fb64c0d2620 2023-07-09T02:21:12.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0cb1e0 con 0x7fb64c0cd120 2023-07-09T02:21:12.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0cb4c0 con 0x7fb64c15c060 2023-07-09T02:21:12.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48624/0 (socket says 172.21.15.45:48624) 2023-07-09T02:21:12.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 -- 172.21.15.45:0/660669049 learned_addr learned my addr 172.21.15.45:0/660669049 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65132b640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb64c0cd120 0x7fb64c154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb651b2c640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb64c15c060 0x7fb64c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 -- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb64c15c060 msgr2=0x7fb64c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb64c15c060 0x7fb64c156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 -- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb64c0cd120 msgr2=0x7fb64c154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb64c0cd120 0x7fb64c154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 -- 172.21.15.45:0/660669049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c009420 con 0x7fb64c0d2620 2023-07-09T02:21:12.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb651b2c640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb64c15c060 0x7fb64c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb650b2a640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c156640 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fb63c019040 tx=0x7fb63c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb641ffb640 1 -- 172.21.15.45:0/660669049 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b5610 con 0x7fb64c0d2620 2023-07-09T02:21:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb641ffb640 1 -- 172.21.15.45:0/660669049 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c0b5790 con 0x7fb64c0d2620 2023-07-09T02:21:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb641ffb640 1 -- 172.21.15.45:0/660669049 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b5b40 con 0x7fb64c0d2620 2023-07-09T02:21:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c0b59f0 con 0x7fb64c0d2620 2023-07-09T02:21:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.198+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c0cba80 con 0x7fb64c0d2620 2023-07-09T02:21:12.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.202+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c04d7d0 con 0x7fb64c0d2620 2023-07-09T02:21:12.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.202+0000 7fb641ffb640 1 -- 172.21.15.45:0/660669049 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb63c0b5ca0 con 0x7fb64c0d2620 2023-07-09T02:21:12.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.202+0000 7fb641ffb640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb630066280 0x7fb630068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.202+0000 7fb641ffb640 1 -- 172.21.15.45:0/660669049 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb63c11e480 con 0x7fb64c0d2620 2023-07-09T02:21:12.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.202+0000 7fb65132b640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb630066280 0x7fb630068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.202+0000 7fb65132b640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb630066280 0x7fb630068730 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb648000f70 tx=0x7fb648007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:12.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.206+0000 7fb641ffb640 1 -- 172.21.15.45:0/660669049 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb63c0eb910 con 0x7fb64c0d2620 2023-07-09T02:21:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb64c06baa0 con 0x7fb64c0d2620 2023-07-09T02:21:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb641ffb640 1 -- 172.21.15.45:0/660669049 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4675 (secure 0 0 0) 0x7fb63c0b4390 con 0x7fb64c0d2620 2023-07-09T02:21:12.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:21:12.392 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2937988619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2937988619},{"type":"v1","addr":"172.21.15.45:6835","nonce":2937988619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/202593650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":202593650},{"type":"v1","addr":"172.21.15.45:6833","nonce":202593650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1590703663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1590703663},{"type":"v1","addr":"172.21.15.155:6837","nonce":1590703663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:21:03.398485+0000","modified":"2023-07-09T02:21:07.041368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8206":{"gid":8206,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/390558772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":390558772},{"type":"v1","addr":"172.21.15.155:6836","nonce":390558772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T02:21:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 83 2023-07-09T02:21:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb630066280 msgr2=0x7fb630068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb630066280 0x7fb630068730 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb648000f70 tx=0x7fb648007df0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 msgr2=0x7fb64c156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c156640 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fb63c019040 tx=0x7fb63c01ac70 comp rx=0 tx=0).stop 2023-07-09T02:21:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 shutdown_connections 2023-07-09T02:21:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb630066280 0x7fb630068730 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb64c15c060 0x7fb64c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb64c0d2620 0x7fb64c156640 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 --2- 172.21.15.45:0/660669049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb64c0cd120 0x7fb64c154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 >> 172.21.15.45:0/660669049 conn(0x7fb64c0698e0 msgr2=0x7fb64c0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 shutdown_connections 2023-07-09T02:21:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.394+0000 7fb65358f640 1 -- 172.21.15.45:0/660669049 wait complete. 2023-07-09T02:21:12.413 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-07-09T02:21:12.572 INFO:teuthology.orchestra.run.smithi155.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":8206,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5445316689999995,"mdsmap_epoch":83,"osdmap_epoch":166,"osdmap_epoch_barrier":166,"uptime":14.448146225} 2023-07-09T02:21:12.572 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 8206, "mdsmap_epoch": 83, "osdmap_epoch": 166, "osdmap_epoch_barrier": 166, "rank_uptime": 8.544531669, "state": "up:active", "uptime": 14.448146225, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:21:12.573 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-07-09T02:21:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.722+0000 7fbfc26bd640 1 Processor -- start 2023-07-09T02:21:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.722+0000 7fbfc26bd640 1 -- start start 2023-07-09T02:21:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.722+0000 7fbfc26bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.722+0000 7fbfc26bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0d19c0 con 0x7fbfbc15c480 2023-07-09T02:21:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.722+0000 7fbfc26bd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0cf210 con 0x7fbfbc0cd060 2023-07-09T02:21:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.722+0000 7fbfc26bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc15c850 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.722+0000 7fbfbbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbfbc15c480 0x7fbfbc0d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35150/0 (socket says 172.21.15.45:35150) 2023-07-09T02:21:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.722+0000 7fbfbbfff640 1 -- 172.21.15.45:0/3822062436 learned_addr learned my addr 172.21.15.45:0/3822062436 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:21:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfc0c5a640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347144608 0 0) 0x7fbfbc0d19c0 con 0x7fbfbc15c480 2023-07-09T02:21:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa8003530 con 0x7fbfbc15c480 2023-07-09T02:21:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3515725409 0 0) 0x7fbfa8003530 con 0x7fbfbc15c480 2023-07-09T02:21:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 msgr2=0x7fbfbc0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 >> v1:172.21.15.155:6789/0 conn(0x7fbfbc0cd060 legacy=0x7fbfbc0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0cd4d0 con 0x7fbfbc15c480 2023-07-09T02:21:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fbfac001680 con 0x7fbfbc15c480 2023-07-09T02:21:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 >> v1:172.21.15.45:6789/0 conn(0x7fbfbc15c480 legacy=0x7fbfbc0d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 0x7fbfa80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa8003ef0 0x7fbfa80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa8004d10 0x7fbfa8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc15c850 con 0x7fbfa8003ef0 2023-07-09T02:21:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa800b9c0 con 0x7fbfa8004d10 2023-07-09T02:21:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa800bb80 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbbfff640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 0x7fbfa80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfc0c5a640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa8004d10 0x7fbfa8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfb3fff640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa8003ef0 0x7fbfa80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbbfff640 1 -- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa8004d10 msgr2=0x7fbfa8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbbfff640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfa8004d10 0x7fbfa8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbbfff640 1 -- 172.21.15.45:0/3822062436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa8003ef0 msgr2=0x7fbfa80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:21:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbbfff640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa8003ef0 0x7fbfa80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.726+0000 7fbfbbfff640 1 -- 172.21.15.45:0/3822062436 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa8003530 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfbbfff640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 0x7fbfa80039b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c210 tx=0x7fbfac01cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4ae685159e5a69 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:12.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0a5b60 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac0a5ce0 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfbb7fe640 1 -- 172.21.15.45:0/3822062436 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac005b20 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 -- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 msgr2=0x7fbfa80039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 --2- 172.21.15.45:0/3822062436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc0b4ba0 0x7fbfa80039b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c210 tx=0x7fbfac01cc60 comp rx=0 tx=0).stop 2023-07-09T02:21:12.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc0c5a640 1 -- 172.21.15.45:0/3822062436 reap_dead start 2023-07-09T02:21:12.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 -- 172.21.15.45:0/3822062436 shutdown_connections 2023-07-09T02:21:12.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 -- 172.21.15.45:0/3822062436 >> 172.21.15.45:0/3822062436 conn(0x7fbfbc0cf490 msgr2=0x7fbfbc0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:12.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 -- 172.21.15.45:0/3822062436 shutdown_connections 2023-07-09T02:21:12.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 -- 172.21.15.45:0/3822062436 wait complete. 2023-07-09T02:21:12.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 Processor -- start 2023-07-09T02:21:12.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 -- start start 2023-07-09T02:21:12.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.730+0000 7fbfc26bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc26bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfbc14a990 0x7fbfbc14ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc26bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc15cc60 0x7fbfbc15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc26bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc15d9d0 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc26bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc15dcb0 con 0x7fbfbc14a990 2023-07-09T02:21:12.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc26bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc15df90 con 0x7fbfbc15cc60 2023-07-09T02:21:12.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48642/0 (socket says 172.21.15.45:48642) 2023-07-09T02:21:12.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 -- 172.21.15.45:0/1597201057 learned_addr learned my addr 172.21.15.45:0/1597201057 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:21:12.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfb3fff640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfbc14a990 0x7fbfbc14ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc0c5a640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc15cc60 0x7fbfbc15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 -- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc15cc60 msgr2=0x7fbfbc15d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc15cc60 0x7fbfbc15d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 -- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfbc14a990 msgr2=0x7fbfbc14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:12.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfbc14a990 0x7fbfbc14ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:12.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 -- 172.21.15.45:0/1597201057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc15e270 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfb3fff640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfbc14a990 0x7fbfbc14ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:21:12.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfbbfff640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0c8b20 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fbfac01ca90 tx=0x7fbfa8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:12.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfb97fa640 1 -- 172.21.15.45:0/1597201057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0b4070 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfb97fa640 1 -- 172.21.15.45:0/1597201057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac0a5b70 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfb97fa640 1 -- 172.21.15.45:0/1597201057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac001640 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc0c6540 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc15d620 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfbc04d7d0 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.734+0000 7fbfb97fa640 1 -- 172.21.15.45:0/1597201057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbfac007070 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.738+0000 7fbfb97fa640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf9c066280 0x7fbf9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:21:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.738+0000 7fbfb97fa640 1 -- 172.21.15.45:0/1597201057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfac11dee0 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.738+0000 7fbfb3fff640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf9c066280 0x7fbf9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:21:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.738+0000 7fbfb3fff640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf9c066280 0x7fbf9c068730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc1589f0 tx=0x7fbfa4005130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:21:12.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.742+0000 7fbfb97fa640 1 -- 172.21.15.45:0/1597201057 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfac0eb350 con 0x7fbfbc0b4ba0 2023-07-09T02:21:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:12.898+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fbfbc159c10 con 0x7fbfbc0b4ba0 2023-07-09T02:21:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.078+0000 7fbfb97fa640 1 -- 172.21.15.45:0/1597201057 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v167) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbfac0ee970 con 0x7fbfbc0b4ba0 2023-07-09T02:21:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-07-09T02:21:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf9c066280 msgr2=0x7fbf9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf9c066280 0x7fbf9c068730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc1589f0 tx=0x7fbfa4005130 comp rx=0 tx=0).stop 2023-07-09T02:21:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfbc0b4ba0 msgr2=0x7fbfbc0c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:21:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0c8b20 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fbfac01ca90 tx=0x7fbfa8005800 comp rx=0 tx=0).stop 2023-07-09T02:21:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 shutdown_connections 2023-07-09T02:21:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbf9c066280 0x7fbf9c068730 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfbc15cc60 0x7fbfbc15d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfbc14a990 0x7fbfbc14ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 --2- 172.21.15.45:0/1597201057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfbc0b4ba0 0x7fbfbc0c8b20 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:21:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 >> 172.21.15.45:0/1597201057 conn(0x7fbfbc0cf490 msgr2=0x7fbfbc159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:21:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 shutdown_connections 2023-07-09T02:21:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:21:13.082+0000 7fbfc26bd640 1 -- 172.21.15.45:0/1597201057 wait complete. 2023-07-09T02:21:13.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-07-09T02:21:13.261 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_mon_report_interval":"5"} 2023-07-09T02:21:13.261 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-07-09T02:21:13.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-07-09T02:21:13.415 INFO:teuthology.orchestra.run.smithi045.stdout:{"mon_tick_interval":"5"} 2023-07-09T02:21:13.415 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-07-09T02:21:13.416 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-07-09T02:21:13.416 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T02:21:13.416 DEBUG:teuthology.orchestra.run.smithi045:> import time 2023-07-09T02:21:13.417 DEBUG:teuthology.orchestra.run.smithi045:> import datetime 2023-07-09T02:21:13.417 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-07-09T02:21:13.417 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-07-09T02:21:13.417 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:21:13.418 DEBUG:teuthology.orchestra.run.smithi045:> # Write some buffered data through before going full, all should be well 2023-07-09T02:21:13.418 DEBUG:teuthology.orchestra.run.smithi045:> print("writing some data through which we expect to succeed") 2023-07-09T02:21:13.418 DEBUG:teuthology.orchestra.run.smithi045:> bytes = 0 2023-07-09T02:21:13.419 DEBUG:teuthology.orchestra.run.smithi045:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-07-09T02:21:13.419 DEBUG:teuthology.orchestra.run.smithi045:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-07-09T02:21:13.419 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-07-09T02:21:13.419 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f) 2023-07-09T02:21:13.420 DEBUG:teuthology.orchestra.run.smithi045:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-07-09T02:21:13.420 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:21:13.420 DEBUG:teuthology.orchestra.run.smithi045:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-07-09T02:21:13.420 DEBUG:teuthology.orchestra.run.smithi045:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-07-09T02:21:13.421 DEBUG:teuthology.orchestra.run.smithi045:> # buffered IO, the error should always only appear from fsync and not 2023-07-09T02:21:13.421 DEBUG:teuthology.orchestra.run.smithi045:> # from write 2023-07-09T02:21:13.421 DEBUG:teuthology.orchestra.run.smithi045:> full = False 2023-07-09T02:21:13.422 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:21:13.422 DEBUG:teuthology.orchestra.run.smithi045:> for n in range(0, int(32 * 1.1)): 2023-07-09T02:21:13.422 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-07-09T02:21:13.422 DEBUG:teuthology.orchestra.run.smithi045:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-07-09T02:21:13.423 DEBUG:teuthology.orchestra.run.smithi045:> print("wrote bytes via buffered write, moving on to fsync") 2023-07-09T02:21:13.423 DEBUG:teuthology.orchestra.run.smithi045:> except OSError as e: 2023-07-09T02:21:13.423 DEBUG:teuthology.orchestra.run.smithi045:> if False: 2023-07-09T02:21:13.424 DEBUG:teuthology.orchestra.run.smithi045:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-07-09T02:21:13.424 DEBUG:teuthology.orchestra.run.smithi045:> raise 2023-07-09T02:21:13.424 DEBUG:teuthology.orchestra.run.smithi045:> else: 2023-07-09T02:21:13.425 DEBUG:teuthology.orchestra.run.smithi045:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-07-09T02:21:13.425 DEBUG:teuthology.orchestra.run.smithi045:> full = True 2023-07-09T02:21:13.425 DEBUG:teuthology.orchestra.run.smithi045:> break 2023-07-09T02:21:13.425 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:21:13.426 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-07-09T02:21:13.426 DEBUG:teuthology.orchestra.run.smithi045:> os.fsync(f) 2023-07-09T02:21:13.426 DEBUG:teuthology.orchestra.run.smithi045:> print("fsync'"'"'ed successfully") 2023-07-09T02:21:13.427 DEBUG:teuthology.orchestra.run.smithi045:> except OSError as e: 2023-07-09T02:21:13.427 DEBUG:teuthology.orchestra.run.smithi045:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-07-09T02:21:13.427 DEBUG:teuthology.orchestra.run.smithi045:> full = True 2023-07-09T02:21:13.427 DEBUG:teuthology.orchestra.run.smithi045:> break 2023-07-09T02:21:13.428 DEBUG:teuthology.orchestra.run.smithi045:> else: 2023-07-09T02:21:13.428 DEBUG:teuthology.orchestra.run.smithi045:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-07-09T02:21:13.428 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:21:13.428 DEBUG:teuthology.orchestra.run.smithi045:> if n > 32 * 0.9: 2023-07-09T02:21:13.429 DEBUG:teuthology.orchestra.run.smithi045:> # Be cautious in the last region where we expect to hit 2023-07-09T02:21:13.429 DEBUG:teuthology.orchestra.run.smithi045:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-07-09T02:21:13.429 DEBUG:teuthology.orchestra.run.smithi045:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-07-09T02:21:13.429 DEBUG:teuthology.orchestra.run.smithi045:> time.sleep(15.0) 2023-07-09T02:21:13.430 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:21:13.430 DEBUG:teuthology.orchestra.run.smithi045:> if not full: 2023-07-09T02:21:13.430 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-07-09T02:21:13.431 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:21:13.431 DEBUG:teuthology.orchestra.run.smithi045:> # close() should not raise an error because we already caught it in 2023-07-09T02:21:13.431 DEBUG:teuthology.orchestra.run.smithi045:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-07-09T02:21:13.431 DEBUG:teuthology.orchestra.run.smithi045:> # since then because all IOs got cancelled on the full flag. 2023-07-09T02:21:13.432 DEBUG:teuthology.orchestra.run.smithi045:> print("calling close") 2023-07-09T02:21:13.432 DEBUG:teuthology.orchestra.run.smithi045:> os.close(f) 2023-07-09T02:21:13.432 DEBUG:teuthology.orchestra.run.smithi045:> print("close() did not raise error") 2023-07-09T02:21:13.432 DEBUG:teuthology.orchestra.run.smithi045:> 2023-07-09T02:21:13.433 DEBUG:teuthology.orchestra.run.smithi045:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-07-09T02:21:13.433 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-07-09T02:21:19.782 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:21:19.786 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:21:49.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:21:49.842 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:22:18.420 INFO:teuthology.orchestra.run.smithi045.stdout:writing some data through which we expect to succeed 2023-07-09T02:22:18.420 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-07-09T02:22:18.420 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.420 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.421 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 1.00 MB 2023-07-09T02:22:18.421 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.421 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.421 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 2.00 MB 2023-07-09T02:22:18.421 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.421 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.422 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 3.00 MB 2023-07-09T02:22:18.422 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.422 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.422 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 4.00 MB 2023-07-09T02:22:18.422 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.422 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.422 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 5.00 MB 2023-07-09T02:22:18.423 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.423 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.423 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 6.00 MB 2023-07-09T02:22:18.423 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.423 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.423 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 7.00 MB 2023-07-09T02:22:18.423 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.424 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.424 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 8.00 MB 2023-07-09T02:22:18.424 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.424 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.425 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 9.00 MB 2023-07-09T02:22:18.425 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.425 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.425 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 10.00 MB 2023-07-09T02:22:18.425 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.425 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.425 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 11.00 MB 2023-07-09T02:22:18.426 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.426 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.426 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 12.00 MB 2023-07-09T02:22:18.426 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.426 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.426 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 13.00 MB 2023-07-09T02:22:18.426 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.427 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.427 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 14.00 MB 2023-07-09T02:22:18.427 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.427 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.427 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 15.00 MB 2023-07-09T02:22:18.427 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.428 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.428 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 16.00 MB 2023-07-09T02:22:18.428 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.428 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.428 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 17.00 MB 2023-07-09T02:22:18.428 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.428 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.429 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 18.00 MB 2023-07-09T02:22:18.429 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.429 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.429 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 19.00 MB 2023-07-09T02:22:18.429 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.429 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.429 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 20.00 MB 2023-07-09T02:22:18.430 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.430 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.430 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 21.00 MB 2023-07-09T02:22:18.430 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.430 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.430 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 22.00 MB 2023-07-09T02:22:18.430 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.430 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.431 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 23.00 MB 2023-07-09T02:22:18.431 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.431 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.431 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 24.00 MB 2023-07-09T02:22:18.431 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.431 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.431 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 25.00 MB 2023-07-09T02:22:18.431 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.432 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.432 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 26.00 MB 2023-07-09T02:22:18.432 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.432 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.432 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 27.00 MB 2023-07-09T02:22:18.433 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.433 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.433 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 28.00 MB 2023-07-09T02:22:18.433 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.433 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.433 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 29.00 MB 2023-07-09T02:22:18.433 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.433 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.434 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 30.00 MB 2023-07-09T02:22:18.434 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:22:18.434 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.434 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.434 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 31.00 MB 2023-07-09T02:22:18.434 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:22:18.434 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.434 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.435 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 32.00 MB 2023-07-09T02:22:18.435 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:22:18.435 INFO:teuthology.orchestra.run.smithi045.stdout:wrote bytes via buffered write, moving on to fsync 2023-07-09T02:22:18.435 INFO:teuthology.orchestra.run.smithi045.stdout:fsync'ed successfully 2023-07-09T02:22:18.435 INFO:teuthology.orchestra.run.smithi045.stdout:Not full yet after 33.00 MB 2023-07-09T02:22:18.435 INFO:teuthology.orchestra.run.smithi045.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-07-09T02:22:18.435 INFO:teuthology.orchestra.run.smithi045.stdout:Reached fullness after 33.00 MB 2023-07-09T02:22:18.436 INFO:teuthology.orchestra.run.smithi045.stdout:calling close 2023-07-09T02:22:18.436 INFO:teuthology.orchestra.run.smithi045.stdout:close() did not raise error 2023-07-09T02:22:18.590 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:22:18.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:22:18.646 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:22:18.695 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:22:18.696 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:18.696 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:18.708 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:18.708 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:18.759 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e2eaf640 1 Processor -- start 2023-07-09T02:22:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e2eaf640 1 -- start start 2023-07-09T02:22:18.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e2eaf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9dc0b4ae0 0x7fe9dc0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:18.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e2eaf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc0cd5d0 con 0x7fe9dc0c8d40 2023-07-09T02:22:18.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e2eaf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc0d2050 con 0x7fe9dc160670 2023-07-09T02:22:18.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e2eaf640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0d27a0 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e1ead640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe9dc0c8d40 0x7fe9dc0b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50050/0 (socket says 172.21.15.45:50050) 2023-07-09T02:22:18.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e1ead640 1 -- 172.21.15.45:0/1057240389 learned_addr learned my addr 172.21.15.45:0/1057240389 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:18.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e16ac640 1 --2- 172.21.15.45:0/1057240389 >> v2:172.21.15.45:3300/0 conn(0x7fe9dc0b4ae0 0x7fe9dc0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e0eab640 1 -- 172.21.15.45:0/1057240389 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100455198 0 0) 0x7fe9dc0cd5d0 con 0x7fe9dc0c8d40 2023-07-09T02:22:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e0eab640 1 -- 172.21.15.45:0/1057240389 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c8003530 con 0x7fe9dc0c8d40 2023-07-09T02:22:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e16ac640 1 -- 172.21.15.45:0/1057240389 >> v1:172.21.15.155:6789/0 conn(0x7fe9dc160670 legacy=0x7fe9dc0d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:18.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e16ac640 1 -- 172.21.15.45:0/1057240389 >> v1:172.21.15.45:6789/0 conn(0x7fe9dc0c8d40 legacy=0x7fe9dc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:18.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.956+0000 7fe9e16ac640 1 -- 172.21.15.45:0/1057240389 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc160ad0 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e16ac640 1 --2- 172.21.15.45:0/1057240389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc0ccf10 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0097c0 tx=0x7fe9cc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ba7af2ccd5ad55 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e0eab640 1 -- 172.21.15.45:0/1057240389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0a8970 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e0eab640 1 -- 172.21.15.45:0/1057240389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0a8ad0 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e0eab640 1 -- 172.21.15.45:0/1057240389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0a8e40 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/1057240389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 msgr2=0x7fe9dc0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:18.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e2eaf640 1 --2- 172.21.15.45:0/1057240389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc0ccf10 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0097c0 tx=0x7fe9cc01ec70 comp rx=0 tx=0).stop 2023-07-09T02:22:18.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/1057240389 shutdown_connections 2023-07-09T02:22:18.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e2eaf640 1 --2- 172.21.15.45:0/1057240389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc0ccf10 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:18.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/1057240389 >> 172.21.15.45:0/1057240389 conn(0x7fe9dc0d2950 msgr2=0x7fe9dc0d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:18.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/1057240389 shutdown_connections 2023-07-09T02:22:18.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.960+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/1057240389 wait complete. 2023-07-09T02:22:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 Processor -- start 2023-07-09T02:22:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 -- start start 2023-07-09T02:22:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc1f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9dc0c8d40 0x7fe9dc1f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9dc160670 0x7fe9dc0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0cc980 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc15cb70 con 0x7fe9dc0c8d40 2023-07-09T02:22:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc15b4f0 con 0x7fe9dc160670 2023-07-09T02:22:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc1f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc1f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51150/0 (socket says 172.21.15.45:51150) 2023-07-09T02:22:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 -- 172.21.15.45:0/2554373287 learned_addr learned my addr 172.21.15.45:0/2554373287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:18.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e16ac640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9dc0c8d40 0x7fe9dc1f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e26ae640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9dc160670 0x7fe9dc0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 -- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9dc160670 msgr2=0x7fe9dc0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9dc160670 0x7fe9dc0cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 -- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9dc0c8d40 msgr2=0x7fe9dc1f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9dc0c8d40 0x7fe9dc1f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 -- 172.21.15.45:0/2554373287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc009420 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e1ead640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc1f4810 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c4d0 tx=0x7fe9d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:18.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9d27fc640 1 -- 172.21.15.45:0/2554373287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8005cf0 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9d27fc640 1 -- 172.21.15.45:0/2554373287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8005e50 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9d27fc640 1 -- 172.21.15.45:0/2554373287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8007270 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc15e540 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc15c800 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.964+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc04e020 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.968+0000 7fe9d27fc640 1 -- 172.21.15.45:0/2554373287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9d80073d0 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.968+0000 7fe9d27fc640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9c00662b0 0x7fe9c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:18.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.968+0000 7fe9d27fc640 1 -- 172.21.15.45:0/2554373287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe9d8083250 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.968+0000 7fe9d27fc640 1 -- 172.21.15.45:0/2554373287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7fe9c006e4b0 con 0x7fe9dc0b4ae0 2023-07-09T02:22:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.968+0000 7fe9e16ac640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9c00662b0 0x7fe9c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:18.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.968+0000 7fe9e16ac640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9c00662b0 0x7fe9c0068760 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0b2000 tx=0x7fe9cc0aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:18.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:18.972+0000 7fe9d27fc640 1 -- 172.21.15.45:0/2554373287 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9d8050730 con 0x7fe9dc0b4ae0 2023-07-09T02:22:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.128+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9dc06a360 con 0x7fe9dc0b4ae0 2023-07-09T02:22:19.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9d27fc640 1 -- 172.21.15.45:0/2554373287 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+18486 (secure 0 0 0) 0x7fe9d8017020 con 0x7fe9dc0b4ae0 2023-07-09T02:22:19.132 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:19.132 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":170,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:07.572065+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:21:01.154000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T02:21:02.407446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.12","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:19.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9c00662b0 msgr2=0x7fe9c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9c00662b0 0x7fe9c0068760 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0b2000 tx=0x7fe9cc0aa070 comp rx=0 tx=0).stop 2023-07-09T02:22:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 msgr2=0x7fe9dc1f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc1f4810 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c4d0 tx=0x7fe9d800c990 comp rx=0 tx=0).stop 2023-07-09T02:22:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 shutdown_connections 2023-07-09T02:22:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe9c00662b0 0x7fe9c0068760 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9dc160670 0x7fe9dc0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9dc0c8d40 0x7fe9dc1f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 --2- 172.21.15.45:0/2554373287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9dc0b4ae0 0x7fe9dc1f4810 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 >> 172.21.15.45:0/2554373287 conn(0x7fe9dc0d2950 msgr2=0x7fe9dc0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:19.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 shutdown_connections 2023-07-09T02:22:19.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.132+0000 7fe9e2eaf640 1 -- 172.21.15.45:0/2554373287 wait complete. 2023-07-09T02:22:19.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:21:01.154000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:21:02.407446+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:22:19.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:22:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.296+0000 7f3bc3140640 1 Processor -- start 2023-07-09T02:22:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.296+0000 7f3bc3140640 1 -- start start 2023-07-09T02:22:19.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bc3140640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0ac870 0x7f3bbc06c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bc3140640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc0acde0 con 0x7f3bbc0694b0 2023-07-09T02:22:19.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bc3140640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc0ad0c0 con 0x7f3bbc06b800 2023-07-09T02:22:19.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bc3140640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0ad3a0 con 0x7f3bbc0ac870 2023-07-09T02:22:19.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bc16dd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3bbc0694b0 0x7f3bbc0ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50058/0 (socket says 172.21.15.45:50058) 2023-07-09T02:22:19.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bc16dd640 1 -- 172.21.15.45:0/2879862909 learned_addr learned my addr 172.21.15.45:0/2879862909 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:19.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0ac870 0x7f3bbc06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154955620 0 0) 0x7f3bbc0acde0 con 0x7f3bbc0694b0 2023-07-09T02:22:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bac003530 con 0x7f3bbc0694b0 2023-07-09T02:22:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181018075 0 0) 0x7f3bbc0ad0c0 con 0x7f3bbc06b800 2023-07-09T02:22:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bbc0acde0 con 0x7f3bbc06b800 2023-07-09T02:22:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521808099 0 0) 0x7f3bac003530 con 0x7f3bbc0694b0 2023-07-09T02:22:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0ac870 msgr2=0x7f3bbc06c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0ac870 0x7f3bbc06c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 >> v1:172.21.15.155:6789/0 conn(0x7f3bbc06b800 legacy=0x7f3bbc06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0cda70 con 0x7f3bbc0694b0 2023-07-09T02:22:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f3bb4001a00 con 0x7f3bbc0694b0 2023-07-09T02:22:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 >> v1:172.21.15.45:6789/0 conn(0x7f3bbc0694b0 legacy=0x7f3bbc0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bac003b40 0x7f3bac003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0ac870 0x7f3bac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0ad3a0 con 0x7f3bac0047d0 2023-07-09T02:22:19.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac00ba40 con 0x7f3bac003b40 2023-07-09T02:22:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac00bbb0 con 0x7f3bbc0ac870 2023-07-09T02:22:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bc0edc640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bac003b40 0x7f3bac003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bc16dd640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0ac870 0x7f3bac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbbfff640 1 -- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0ac870 msgr2=0x7f3bac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0ac870 0x7f3bac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbbfff640 1 -- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bac003b40 msgr2=0x7f3bac003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:19.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bac003b40 0x7f3bac003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.300+0000 7f3bbbfff640 1 -- 172.21.15.45:0/2879862909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac003530 con 0x7f3bac0047d0 2023-07-09T02:22:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bac004c40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009ae0 tx=0x7f3ba801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b3c1c49a1ff14c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80a5640 con 0x7f3bac0047d0 2023-07-09T02:22:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba80a57a0 con 0x7f3bac0047d0 2023-07-09T02:22:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bbb7fe640 1 -- 172.21.15.45:0/2879862909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80a5b50 con 0x7f3bac0047d0 2023-07-09T02:22:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bc3140640 1 -- 172.21.15.45:0/2879862909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 msgr2=0x7f3bac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bc3140640 1 --2- 172.21.15.45:0/2879862909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bac004c40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009ae0 tx=0x7f3ba801ca50 comp rx=0 tx=0).stop 2023-07-09T02:22:19.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bc16dd640 1 -- 172.21.15.45:0/2879862909 reap_dead start 2023-07-09T02:22:19.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bc3140640 1 -- 172.21.15.45:0/2879862909 shutdown_connections 2023-07-09T02:22:19.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bc3140640 1 -- 172.21.15.45:0/2879862909 >> 172.21.15.45:0/2879862909 conn(0x7f3bbc0cfb50 msgr2=0x7f3bbc0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:19.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bc3140640 1 -- 172.21.15.45:0/2879862909 shutdown_connections 2023-07-09T02:22:19.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.304+0000 7f3bc3140640 1 -- 172.21.15.45:0/2879862909 wait complete. 2023-07-09T02:22:19.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 Processor -- start 2023-07-09T02:22:19.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 -- start start 2023-07-09T02:22:19.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bbc14b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bbc14c490 0x7f3bbc14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0c5f00 0x7f3bbc0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c68b0 con 0x7f3bac0047d0 2023-07-09T02:22:19.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc159840 con 0x7f3bbc14c490 2023-07-09T02:22:19.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc14b8c0 con 0x7f3bbc0c5f00 2023-07-09T02:22:19.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bbc14b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bbc14b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51158/0 (socket says 172.21.15.45:51158) 2023-07-09T02:22:19.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 -- 172.21.15.45:0/2025578316 learned_addr learned my addr 172.21.15.45:0/2025578316 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:19.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bbc14c490 0x7f3bbc14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc16dd640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0c5f00 0x7f3bbc0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 -- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0c5f00 msgr2=0x7f3bbc0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0c5f00 0x7f3bbc0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 -- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bbc14c490 msgr2=0x7f3bbc14c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bbc14c490 0x7f3bbc14c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 -- 172.21.15.45:0/2025578316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc14cf60 con 0x7f3bac0047d0 2023-07-09T02:22:19.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bbc14c490 0x7f3bbc14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:19.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc16dd640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0c5f00 0x7f3bbc0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc0edc640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bbc14b380 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00079b0 tx=0x7f3bb0012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bb97fa640 1 -- 172.21.15.45:0/2025578316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0010bd0 con 0x7f3bac0047d0 2023-07-09T02:22:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bb97fa640 1 -- 172.21.15.45:0/2025578316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0010d70 con 0x7f3bac0047d0 2023-07-09T02:22:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bb97fa640 1 -- 172.21.15.45:0/2025578316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0010ee0 con 0x7f3bac0047d0 2023-07-09T02:22:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc14d240 con 0x7f3bac0047d0 2023-07-09T02:22:19.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.308+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc159d70 con 0x7f3bac0047d0 2023-07-09T02:22:19.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.312+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc06ae60 con 0x7f3bac0047d0 2023-07-09T02:22:19.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.312+0000 7f3bb97fa640 1 -- 172.21.15.45:0/2025578316 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3bb00166c0 con 0x7f3bac0047d0 2023-07-09T02:22:19.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.312+0000 7f3bb97fa640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ba0066280 0x7f3ba0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.312+0000 7f3bb97fa640 1 -- 172.21.15.45:0/2025578316 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3bb0087630 con 0x7f3bac0047d0 2023-07-09T02:22:19.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.312+0000 7f3bb97fa640 1 -- 172.21.15.45:0/2025578316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f3ba006e480 con 0x7f3bac0047d0 2023-07-09T02:22:19.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.312+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ba0066280 0x7f3ba0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.312+0000 7f3bbbfff640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ba0066280 0x7f3ba0068730 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80af000 tx=0x7f3ba80046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.316+0000 7f3bb97fa640 1 -- 172.21.15.45:0/2025578316 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3bb0054a60 con 0x7f3bac0047d0 2023-07-09T02:22:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.468+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bbc14d430 con 0x7f3bac0047d0 2023-07-09T02:22:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.468+0000 7f3bb97fa640 1 -- 172.21.15.45:0/2025578316 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bb0058080 con 0x7f3bac0047d0 2023-07-09T02:22:19.471 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:22:19.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ba0066280 msgr2=0x7f3ba0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ba0066280 0x7f3ba0068730 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80af000 tx=0x7f3ba80046d0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 msgr2=0x7f3bbc14b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bbc14b380 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00079b0 tx=0x7f3bb0012d00 comp rx=0 tx=0).stop 2023-07-09T02:22:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 shutdown_connections 2023-07-09T02:22:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3ba0066280 0x7f3ba0068730 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bbc0c5f00 0x7f3bbc0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bbc14c490 0x7f3bbc14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 --2- 172.21.15.45:0/2025578316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bac0047d0 0x7f3bbc14b380 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 >> 172.21.15.45:0/2025578316 conn(0x7f3bbc0cfb50 msgr2=0x7f3bbc151610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 shutdown_connections 2023-07-09T02:22:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.472+0000 7f3bc3140640 1 -- 172.21.15.45:0/2025578316 wait complete. 2023-07-09T02:22:19.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:22:19.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7824e34640 1 Processor -- start 2023-07-09T02:22:19.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7824e34640 1 -- start start 2023-07-09T02:22:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7824e34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f782006a5c0 0x7f782015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7824e34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7820071140 con 0x7f782006aa40 2023-07-09T02:22:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7824e34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782006b010 con 0x7f78200cd290 2023-07-09T02:22:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7824e34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782015c970 con 0x7f782006a5c0 2023-07-09T02:22:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f781ed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f782006aa40 0x7f7820160310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50066/0 (socket says 172.21.15.45:50066) 2023-07-09T02:22:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f781ed9d640 1 -- 172.21.15.45:0/1941022273 learned_addr learned my addr 172.21.15.45:0/1941022273 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7817fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f782006a5c0 0x7f782015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f781dd9b640 1 -- 172.21.15.45:0/1941022273 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515792972 0 0) 0x7f7820071140 con 0x7f782006aa40 2023-07-09T02:22:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f781dd9b640 1 -- 172.21.15.45:0/1941022273 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f780c003530 con 0x7f782006aa40 2023-07-09T02:22:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7817fff640 1 -- 172.21.15.45:0/1941022273 >> v1:172.21.15.155:6789/0 conn(0x7f78200cd290 legacy=0x7f78200cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7817fff640 1 -- 172.21.15.45:0/1941022273 >> v1:172.21.15.45:6789/0 conn(0x7f782006aa40 legacy=0x7f7820160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.640+0000 7f7817fff640 1 -- 172.21.15.45:0/1941022273 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782015cc50 con 0x7f782006a5c0 2023-07-09T02:22:19.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f7817fff640 1 --2- 172.21.15.45:0/1941022273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f782015fdd0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f78080097c0 tx=0x7f780801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fcaf918ae3f2c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f781dd9b640 1 -- 172.21.15.45:0/1941022273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080ab600 con 0x7f782006a5c0 2023-07-09T02:22:19.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f781dd9b640 1 -- 172.21.15.45:0/1941022273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78080a7050 con 0x7f782006a5c0 2023-07-09T02:22:19.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f781dd9b640 1 -- 172.21.15.45:0/1941022273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080ab960 con 0x7f782006a5c0 2023-07-09T02:22:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f7824e34640 1 -- 172.21.15.45:0/1941022273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 msgr2=0x7f782015fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f7824e34640 1 --2- 172.21.15.45:0/1941022273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f782015fdd0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f78080097c0 tx=0x7f780801c480 comp rx=0 tx=0).stop 2023-07-09T02:22:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f7824e34640 1 -- 172.21.15.45:0/1941022273 shutdown_connections 2023-07-09T02:22:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f7824e34640 1 --2- 172.21.15.45:0/1941022273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f782015fdd0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f7824e34640 1 -- 172.21.15.45:0/1941022273 >> 172.21.15.45:0/1941022273 conn(0x7f782006d140 msgr2=0x7f782006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f7824e34640 1 -- 172.21.15.45:0/1941022273 shutdown_connections 2023-07-09T02:22:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.644+0000 7f7824e34640 1 -- 172.21.15.45:0/1941022273 wait complete. 2023-07-09T02:22:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 Processor -- start 2023-07-09T02:22:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 -- start start 2023-07-09T02:22:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f78200b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f782006aa40 0x7f782014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78200cd290 0x7f782015ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782014ae40 con 0x7f782006a5c0 2023-07-09T02:22:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78200b6690 con 0x7f78200cd290 2023-07-09T02:22:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78200b1370 con 0x7f782006aa40 2023-07-09T02:22:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f78200b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f78200b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51186/0 (socket says 172.21.15.45:51186) 2023-07-09T02:22:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 -- 172.21.15.45:0/3053394317 learned_addr learned my addr 172.21.15.45:0/3053394317 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7817fff640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f782006aa40 0x7f782014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781ed9d640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78200cd290 0x7f782015ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 -- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f782006aa40 msgr2=0x7f782014a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f782006aa40 0x7f782014a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 -- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78200cd290 msgr2=0x7f782015ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78200cd290 0x7f782015ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 -- 172.21.15.45:0/3053394317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808009420 con 0x7f782006a5c0 2023-07-09T02:22:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f781e59c640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f78200b5f00 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f781000c3c0 tx=0x7f781000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7816ffd640 1 -- 172.21.15.45:0/3053394317 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78100052d0 con 0x7f782006a5c0 2023-07-09T02:22:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7816ffd640 1 -- 172.21.15.45:0/3053394317 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7810005430 con 0x7f782006a5c0 2023-07-09T02:22:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7816ffd640 1 -- 172.21.15.45:0/3053394317 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810003840 con 0x7f782006a5c0 2023-07-09T02:22:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78200b6440 con 0x7f782006a5c0 2023-07-09T02:22:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.648+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78200cfa30 con 0x7f782006a5c0 2023-07-09T02:22:19.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.652+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78200b14e0 con 0x7f782006a5c0 2023-07-09T02:22:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.652+0000 7f7816ffd640 1 -- 172.21.15.45:0/3053394317 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78100039a0 con 0x7f782006a5c0 2023-07-09T02:22:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.652+0000 7f7816ffd640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78000662b0 0x7f7800068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.652+0000 7f7816ffd640 1 -- 172.21.15.45:0/3053394317 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7810083120 con 0x7f782006a5c0 2023-07-09T02:22:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.652+0000 7f7817fff640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78000662b0 0x7f7800068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.652+0000 7f7816ffd640 1 -- 172.21.15.45:0/3053394317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f780006e4b0 con 0x7f782006a5c0 2023-07-09T02:22:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.652+0000 7f7817fff640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78000662b0 0x7f7800068760 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f78080ad000 tx=0x7f7808008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.656+0000 7f7816ffd640 1 -- 172.21.15.45:0/3053394317 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78100506a0 con 0x7f782006a5c0 2023-07-09T02:22:19.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f782004d7d0 con 0x7f782006a5c0 2023-07-09T02:22:19.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7816ffd640 1 -- 172.21.15.45:0/3053394317 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7810017070 con 0x7f782006a5c0 2023-07-09T02:22:19.813 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:22:19.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78000662b0 msgr2=0x7f7800068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78000662b0 0x7f7800068760 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f78080ad000 tx=0x7f7808008040 comp rx=0 tx=0).stop 2023-07-09T02:22:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 msgr2=0x7f78200b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f78200b5f00 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f781000c3c0 tx=0x7f781000c880 comp rx=0 tx=0).stop 2023-07-09T02:22:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 shutdown_connections 2023-07-09T02:22:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78200cd290 0x7f782015ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f78000662b0 0x7f7800068760 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f782006aa40 0x7f782014a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 --2- 172.21.15.45:0/3053394317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f782006a5c0 0x7f78200b5f00 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 >> 172.21.15.45:0/3053394317 conn(0x7f782006d140 msgr2=0x7f7820151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 shutdown_connections 2023-07-09T02:22:19.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.812+0000 7f7824e34640 1 -- 172.21.15.45:0/3053394317 wait complete. 2023-07-09T02:22:19.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:22:19.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff7513fa640 1 Processor -- start 2023-07-09T02:22:19.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff7513fa640 1 -- start start 2023-07-09T02:22:19.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff7513fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff74c15c060 0x7ff74c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff7513fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff74c0cd120 0x7ff74c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff7513fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74c160a50 con 0x7ff74c0d2450 2023-07-09T02:22:19.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff7513fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c0d28d0 con 0x7ff74c15c060 2023-07-09T02:22:19.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff7513fa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74c0cfe40 con 0x7ff74c0cd120 2023-07-09T02:22:19.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff74affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff74c15c060 0x7ff74c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff74b7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff74c0d2450 0x7ff74c0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50070/0 (socket says 172.21.15.45:50070) 2023-07-09T02:22:19.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff74b7fe640 1 -- 172.21.15.45:0/2302444189 learned_addr learned my addr 172.21.15.45:0/2302444189 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff743fff640 1 --2- 172.21.15.45:0/2302444189 >> v2:172.21.15.155:3300/0 conn(0x7ff74c0cd120 0x7ff74c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff74affd640 1 -- 172.21.15.45:0/2302444189 >> v2:172.21.15.155:3300/0 conn(0x7ff74c0cd120 msgr2=0x7ff74c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff74affd640 1 --2- 172.21.15.45:0/2302444189 >> v2:172.21.15.155:3300/0 conn(0x7ff74c0cd120 0x7ff74c0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff74affd640 1 -- 172.21.15.45:0/2302444189 >> v1:172.21.15.45:6789/0 conn(0x7ff74c0d2450 legacy=0x7ff74c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.980+0000 7ff74affd640 1 -- 172.21.15.45:0/2302444189 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c15c430 con 0x7ff74c15c060 2023-07-09T02:22:19.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff74affd640 1 --2- 172.21.15.45:0/2302444189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c15c060 0x7ff74c0b4ed0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff74c15fac0 tx=0x7ff73c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fffd8ef8c13cb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff74a7fc640 1 -- 172.21.15.45:0/2302444189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c004230 con 0x7ff74c15c060 2023-07-09T02:22:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff74a7fc640 1 -- 172.21.15.45:0/2302444189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c0a7050 con 0x7ff74c15c060 2023-07-09T02:22:19.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff74a7fc640 1 -- 172.21.15.45:0/2302444189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c003620 con 0x7ff74c15c060 2023-07-09T02:22:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff7513fa640 1 -- 172.21.15.45:0/2302444189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c15c060 msgr2=0x7ff74c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff7513fa640 1 --2- 172.21.15.45:0/2302444189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c15c060 0x7ff74c0b4ed0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff74c15fac0 tx=0x7ff73c01c430 comp rx=0 tx=0).stop 2023-07-09T02:22:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff7513fa640 1 -- 172.21.15.45:0/2302444189 shutdown_connections 2023-07-09T02:22:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff7513fa640 1 --2- 172.21.15.45:0/2302444189 >> v2:172.21.15.155:3300/0 conn(0x7ff74c0cd120 0x7ff74c0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff7513fa640 1 --2- 172.21.15.45:0/2302444189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c15c060 0x7ff74c0b4ed0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff7513fa640 1 -- 172.21.15.45:0/2302444189 >> 172.21.15.45:0/2302444189 conn(0x7ff74c0698e0 msgr2=0x7ff74c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:19.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff7513fa640 1 -- 172.21.15.45:0/2302444189 shutdown_connections 2023-07-09T02:22:19.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.984+0000 7ff7513fa640 1 -- 172.21.15.45:0/2302444189 wait complete. 2023-07-09T02:22:19.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 Processor -- start 2023-07-09T02:22:19.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 -- start start 2023-07-09T02:22:19.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff74c0cd120 0x7ff74c158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c0d2450 0x7ff74c0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff74c15c060 0x7ff74c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0cc900 con 0x7ff74c0d2450 2023-07-09T02:22:19.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0b3280 con 0x7ff74c15c060 2023-07-09T02:22:19.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74c0b3560 con 0x7ff74c0cd120 2023-07-09T02:22:19.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c0d2450 0x7ff74c0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c0d2450 0x7ff74c0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51200/0 (socket says 172.21.15.45:51200) 2023-07-09T02:22:19.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 -- 172.21.15.45:0/1619667259 learned_addr learned my addr 172.21.15.45:0/1619667259 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:19.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff74b7fe640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff74c15c060 0x7ff74c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff74affd640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff74c0cd120 0x7ff74c158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 -- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff74c0cd120 msgr2=0x7ff74c158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff74c0cd120 0x7ff74c158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 -- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff74c15c060 msgr2=0x7ff74c0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:19.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff74c15c060 0x7ff74c0b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:19.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 -- 172.21.15.45:0/1619667259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009420 con 0x7ff74c0d2450 2023-07-09T02:22:19.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff743fff640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c0d2450 0x7ff74c0b4040 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff73400d7d0 tx=0x7ff73400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7437fe640 1 -- 172.21.15.45:0/1619667259 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734018070 con 0x7ff74c0d2450 2023-07-09T02:22:19.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7437fe640 1 -- 172.21.15.45:0/1619667259 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff734004020 con 0x7ff74c0d2450 2023-07-09T02:22:19.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74c0b3840 con 0x7ff74c0d2450 2023-07-09T02:22:19.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7437fe640 1 -- 172.21.15.45:0/1619667259 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340041d0 con 0x7ff74c0d2450 2023-07-09T02:22:19.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74c0b6470 con 0x7ff74c0d2450 2023-07-09T02:22:19.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.988+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74c04d7d0 con 0x7ff74c0d2450 2023-07-09T02:22:19.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.992+0000 7ff7437fe640 1 -- 172.21.15.45:0/1619667259 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff734004330 con 0x7ff74c0d2450 2023-07-09T02:22:19.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.992+0000 7ff7437fe640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff72c0662b0 0x7ff72c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:19.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.992+0000 7ff7437fe640 1 -- 172.21.15.45:0/1619667259 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff734083ca0 con 0x7ff74c0d2450 2023-07-09T02:22:19.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.992+0000 7ff7437fe640 1 -- 172.21.15.45:0/1619667259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7ff72c06e4b0 con 0x7ff74c0d2450 2023-07-09T02:22:19.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.992+0000 7ff74affd640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff72c0662b0 0x7ff72c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:19.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.992+0000 7ff74affd640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff72c0662b0 0x7ff72c068760 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0ad000 tx=0x7ff73c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:19.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:19.996+0000 7ff7437fe640 1 -- 172.21.15.45:0/1619667259 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff734054ad0 con 0x7ff74c0d2450 2023-07-09T02:22:20.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:22:20.006 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:22:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.148+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff74c06baa0 con 0x7ff74c0d2450 2023-07-09T02:22:20.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.148+0000 7ff7437fe640 1 -- 172.21.15.45:0/1619667259 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v170) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff734054660 con 0x7ff74c0d2450 2023-07-09T02:22:20.150 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:22:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff72c0662b0 msgr2=0x7ff72c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff72c0662b0 0x7ff72c068760 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0ad000 tx=0x7ff73c008040 comp rx=0 tx=0).stop 2023-07-09T02:22:20.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c0d2450 msgr2=0x7ff74c0b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c0d2450 0x7ff74c0b4040 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff73400d7d0 tx=0x7ff73400dc90 comp rx=0 tx=0).stop 2023-07-09T02:22:20.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 shutdown_connections 2023-07-09T02:22:20.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff74c15c060 0x7ff74c0b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff74c0d2450 0x7ff74c0b4040 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff72c0662b0 0x7ff72c068760 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 --2- 172.21.15.45:0/1619667259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff74c0cd120 0x7ff74c158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 >> 172.21.15.45:0/1619667259 conn(0x7ff74c0698e0 msgr2=0x7ff74c0b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:20.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 shutdown_connections 2023-07-09T02:22:20.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.152+0000 7ff7513fa640 1 -- 172.21.15.45:0/1619667259 wait complete. 2023-07-09T02:22:20.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:22:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84ae79f640 1 Processor -- start 2023-07-09T02:22:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84ae79f640 1 -- start start 2023-07-09T02:22:20.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84ae79f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a80cb5d0 0x7f84a806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84ae79f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a806caa0 con 0x7f84a806c110 2023-07-09T02:22:20.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84ae79f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80ccf80 con 0x7f84a8158e30 2023-07-09T02:22:20.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84ae79f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80cd540 con 0x7f84a80cb5d0 2023-07-09T02:22:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84a77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84a806c110 0x7f84a80caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50076/0 (socket says 172.21.15.45:50076) 2023-07-09T02:22:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84a77fe640 1 -- 172.21.15.45:0/3807662694 learned_addr learned my addr 172.21.15.45:0/3807662694 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.316+0000 7f84acd3c640 1 --2- 172.21.15.45:0/3807662694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a80cb5d0 0x7f84a806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84a6ffd640 1 -- 172.21.15.45:0/3807662694 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681760102 0 0) 0x7f849c001120 con 0x7f84a806c110 2023-07-09T02:22:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84a6ffd640 1 -- 172.21.15.45:0/3807662694 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8490005740 con 0x7f84a806c110 2023-07-09T02:22:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84a6ffd640 1 -- 172.21.15.45:0/3807662694 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025663851 0 0) 0x7f84a80ccf80 con 0x7f84a8158e30 2023-07-09T02:22:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84a6ffd640 1 -- 172.21.15.45:0/3807662694 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f849c001120 con 0x7f84a8158e30 2023-07-09T02:22:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84acd3c640 1 -- 172.21.15.45:0/3807662694 >> v1:172.21.15.155:6789/0 conn(0x7f84a8158e30 legacy=0x7f84a806f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84acd3c640 1 -- 172.21.15.45:0/3807662694 >> v1:172.21.15.45:6789/0 conn(0x7f84a806c110 legacy=0x7f84a80caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84a6ffd640 1 -- 172.21.15.45:0/3807662694 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596207218 0 0) 0x7f8490005740 con 0x7f84a806c110 2023-07-09T02:22:20.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84acd3c640 1 -- 172.21.15.45:0/3807662694 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80c8fb0 con 0x7f84a80cb5d0 2023-07-09T02:22:20.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84acd3c640 1 --2- 172.21.15.45:0/3807662694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a80cb5d0 0x7f84a806c560 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009dc0 tx=0x7f84a001c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ec5d779e27e7b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:20.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84a6ffd640 1 -- 172.21.15.45:0/3807662694 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c001810 con 0x7f84a80cb5d0 2023-07-09T02:22:20.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84a6ffd640 1 -- 172.21.15.45:0/3807662694 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00a5610 con 0x7f84a80cb5d0 2023-07-09T02:22:20.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.320+0000 7f84a6ffd640 1 -- 172.21.15.45:0/3807662694 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00a59a0 con 0x7f84a80cb5d0 2023-07-09T02:22:20.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- 172.21.15.45:0/3807662694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a80cb5d0 msgr2=0x7f84a806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 --2- 172.21.15.45:0/3807662694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a80cb5d0 0x7f84a806c560 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009dc0 tx=0x7f84a001c7d0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- 172.21.15.45:0/3807662694 shutdown_connections 2023-07-09T02:22:20.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 --2- 172.21.15.45:0/3807662694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a80cb5d0 0x7f84a806c560 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- 172.21.15.45:0/3807662694 >> 172.21.15.45:0/3807662694 conn(0x7f84a80694b0 msgr2=0x7f84a80698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:20.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- 172.21.15.45:0/3807662694 shutdown_connections 2023-07-09T02:22:20.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- 172.21.15.45:0/3807662694 wait complete. 2023-07-09T02:22:20.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 Processor -- start 2023-07-09T02:22:20.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- start start 2023-07-09T02:22:20.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a806c110 0x7f84a80b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a80cb5d0 0x7f84a80b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a8158e30 0x7f84a8145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8145e80 con 0x7f84a806c110 2023-07-09T02:22:20.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80b29c0 con 0x7f84a80cb5d0 2023-07-09T02:22:20.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84ae79f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80b2ca0 con 0x7f84a8158e30 2023-07-09T02:22:20.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a806c110 0x7f84a80b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a806c110 0x7f84a80b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51204/0 (socket says 172.21.15.45:51204) 2023-07-09T02:22:20.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a7fff640 1 -- 172.21.15.45:0/3623786157 learned_addr learned my addr 172.21.15.45:0/3623786157 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84acd3c640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a8158e30 0x7f84a8145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a77fe640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a80cb5d0 0x7f84a80b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a7fff640 1 -- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a8158e30 msgr2=0x7f84a8145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a7fff640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a8158e30 0x7f84a8145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a7fff640 1 -- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a80cb5d0 msgr2=0x7f84a80b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a7fff640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a80cb5d0 0x7f84a80b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a7fff640 1 -- 172.21.15.45:0/3623786157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009a70 con 0x7f84a806c110 2023-07-09T02:22:20.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84acd3c640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a8158e30 0x7f84a8145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:20.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.324+0000 7f84a77fe640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a80cb5d0 0x7f84a80b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:20.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a7fff640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a806c110 0x7f84a80b23c0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f849800c430 tx=0x7f849800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:20.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a4ff9640 1 -- 172.21.15.45:0/3623786157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84980052d0 con 0x7f84a806c110 2023-07-09T02:22:20.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a4ff9640 1 -- 172.21.15.45:0/3623786157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8498005450 con 0x7f84a806c110 2023-07-09T02:22:20.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a4ff9640 1 -- 172.21.15.45:0/3623786157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498003840 con 0x7f84a806c110 2023-07-09T02:22:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a80b2f80 con 0x7f84a806c110 2023-07-09T02:22:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a80b3540 con 0x7f84a806c110 2023-07-09T02:22:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a80b3760 con 0x7f84a806c110 2023-07-09T02:22:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a4ff9640 1 -- 172.21.15.45:0/3623786157 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84980039a0 con 0x7f84a806c110 2023-07-09T02:22:20.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a4ff9640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a4ff9640 1 -- 172.21.15.45:0/3623786157 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f84980833d0 con 0x7f84a806c110 2023-07-09T02:22:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a4ff9640 1 -- 172.21.15.45:0/3623786157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f849406e480 con 0x7f84a806c110 2023-07-09T02:22:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.328+0000 7f84a77fe640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.332+0000 7f84a77fe640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f849c001940 tx=0x7f849c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:20.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.332+0000 7f84a4ff9640 1 -- 172.21.15.45:0/3623786157 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8498050800 con 0x7f84a806c110 2023-07-09T02:22:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84a804d7d0 con 0x7f84a806c110 2023-07-09T02:22:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84a4ff9640 1 -- 172.21.15.45:0/3623786157 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v170) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8498017070 con 0x7f84a806c110 2023-07-09T02:22:20.493 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:22:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 msgr2=0x7f8494068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f849c001940 tx=0x7f849c009040 comp rx=0 tx=0).stop 2023-07-09T02:22:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a806c110 msgr2=0x7f84a80b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a806c110 0x7f84a80b23c0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f849800c430 tx=0x7f849800c8f0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 shutdown_connections 2023-07-09T02:22:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8494066280 0x7f8494068730 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a8158e30 0x7f84a8145940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a80cb5d0 0x7f84a80b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 --2- 172.21.15.45:0/3623786157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a806c110 0x7f84a80b23c0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 >> 172.21.15.45:0/3623786157 conn(0x7f84a80694b0 msgr2=0x7f84a8155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 shutdown_connections 2023-07-09T02:22:20.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.492+0000 7f84ae79f640 1 -- 172.21.15.45:0/3623786157 wait complete. 2023-07-09T02:22:20.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:22:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f924d9db640 1 Processor -- start 2023-07-09T02:22:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f924d9db640 1 -- start start 2023-07-09T02:22:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f924d9db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924815c060 0x7f92480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f924d9db640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92480cd120 0x7f92480d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f924d9db640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f92480d2450 0x7f92480d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f924d9db640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92480d28f0 con 0x7f92480cd120 2023-07-09T02:22:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f924d9db640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9248160a50 con 0x7f92480d2450 2023-07-09T02:22:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f924d9db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924815c430 con 0x7f924815c060 2023-07-09T02:22:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92467fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92480cd120 0x7f92480d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92467fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92480cd120 0x7f92480d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51212/0 (socket says 172.21.15.45:51212) 2023-07-09T02:22:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92467fc640 1 -- 172.21.15.45:0/830014230 learned_addr learned my addr 172.21.15.45:0/830014230 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92477fe640 1 --2- 172.21.15.45:0/830014230 >> v2:172.21.15.155:3300/0 conn(0x7f92480d2450 0x7f92480d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f9246ffd640 1 --2- 172.21.15.45:0/830014230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924815c060 0x7f92480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92467fc640 1 -- 172.21.15.45:0/830014230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924815c060 msgr2=0x7f92480b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92467fc640 1 --2- 172.21.15.45:0/830014230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924815c060 0x7f92480b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92467fc640 1 -- 172.21.15.45:0/830014230 >> v2:172.21.15.155:3300/0 conn(0x7f92480d2450 msgr2=0x7f92480d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92467fc640 1 --2- 172.21.15.45:0/830014230 >> v2:172.21.15.155:3300/0 conn(0x7f92480d2450 0x7f92480d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.660+0000 7f92467fc640 1 -- 172.21.15.45:0/830014230 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924815fb60 con 0x7f92480cd120 2023-07-09T02:22:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f92467fc640 1 --2- 172.21.15.45:0/830014230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480d1f10 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f924806b120 tx=0x7f923c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ff0d16376c5e78 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f9245ffb640 1 -- 172.21.15.45:0/830014230 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c0ab600 con 0x7f92480cd120 2023-07-09T02:22:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f9245ffb640 1 -- 172.21.15.45:0/830014230 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c0a7050 con 0x7f92480cd120 2023-07-09T02:22:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f9245ffb640 1 -- 172.21.15.45:0/830014230 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c0ab980 con 0x7f92480cd120 2023-07-09T02:22:20.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 -- 172.21.15.45:0/830014230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 msgr2=0x7f92480d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 --2- 172.21.15.45:0/830014230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480d1f10 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f924806b120 tx=0x7f923c01c210 comp rx=0 tx=0).stop 2023-07-09T02:22:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 -- 172.21.15.45:0/830014230 shutdown_connections 2023-07-09T02:22:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 --2- 172.21.15.45:0/830014230 >> v2:172.21.15.155:3300/0 conn(0x7f92480d2450 0x7f92480d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 --2- 172.21.15.45:0/830014230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480d1f10 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 --2- 172.21.15.45:0/830014230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f924815c060 0x7f92480b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 -- 172.21.15.45:0/830014230 >> 172.21.15.45:0/830014230 conn(0x7f92480698e0 msgr2=0x7f9248069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 -- 172.21.15.45:0/830014230 shutdown_connections 2023-07-09T02:22:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 -- 172.21.15.45:0/830014230 wait complete. 2023-07-09T02:22:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.664+0000 7f924d9db640 1 Processor -- start 2023-07-09T02:22:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 -- start start 2023-07-09T02:22:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92480d2450 0x7f9248154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924815c060 0x7f9248154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b8580 con 0x7f92480cd120 2023-07-09T02:22:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b82a0 con 0x7f924815c060 2023-07-09T02:22:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924815cff0 con 0x7f92480d2450 2023-07-09T02:22:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51218/0 (socket says 172.21.15.45:51218) 2023-07-09T02:22:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 -- 172.21.15.45:0/3046842173 learned_addr learned my addr 172.21.15.45:0/3046842173 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:20.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f92477fe640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924815c060 0x7f9248154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f92467fc640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92480d2450 0x7f9248154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 -- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92480d2450 msgr2=0x7f9248154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92480d2450 0x7f9248154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 -- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924815c060 msgr2=0x7f9248154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924815c060 0x7f9248154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 -- 172.21.15.45:0/3046842173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c0094d0 con 0x7f92480cd120 2023-07-09T02:22:20.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f9246ffd640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480c9ce0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f923800e870 tx=0x7f923800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:20.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f922ffff640 1 -- 172.21.15.45:0/3046842173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238009510 con 0x7f92480cd120 2023-07-09T02:22:20.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f922ffff640 1 -- 172.21.15.45:0/3046842173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800eec0 con 0x7f92480cd120 2023-07-09T02:22:20.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924815d2d0 con 0x7f92480cd120 2023-07-09T02:22:20.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f922ffff640 1 -- 172.21.15.45:0/3046842173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800cb40 con 0x7f92480cd120 2023-07-09T02:22:20.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92480ca220 con 0x7f92480cd120 2023-07-09T02:22:20.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.668+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924815ce50 con 0x7f92480cd120 2023-07-09T02:22:20.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.672+0000 7f922ffff640 1 -- 172.21.15.45:0/3046842173 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f923800cca0 con 0x7f92480cd120 2023-07-09T02:22:20.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.672+0000 7f922ffff640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9234066280 0x7f9234068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:20.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.672+0000 7f922ffff640 1 -- 172.21.15.45:0/3046842173 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9238083f60 con 0x7f92480cd120 2023-07-09T02:22:20.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.672+0000 7f922ffff640 1 -- 172.21.15.45:0/3046842173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f923406e480 con 0x7f92480cd120 2023-07-09T02:22:20.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.672+0000 7f92467fc640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9234066280 0x7f9234068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:20.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.672+0000 7f92467fc640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9234066280 0x7f9234068730 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f923c0ad000 tx=0x7f923c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:20.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.676+0000 7f922ffff640 1 -- 172.21.15.45:0/3046842173 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9238017060 con 0x7f92480cd120 2023-07-09T02:22:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.840+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92481603d0 con 0x7f92480cd120 2023-07-09T02:22:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.840+0000 7f922ffff640 1 -- 172.21.15.45:0/3046842173 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v170) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9238021020 con 0x7f92480cd120 2023-07-09T02:22:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:22:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9234066280 msgr2=0x7f9234068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9234066280 0x7f9234068730 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f923c0ad000 tx=0x7f923c0a6000 comp rx=0 tx=0).stop 2023-07-09T02:22:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 msgr2=0x7f92480c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480c9ce0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f923800e870 tx=0x7f923800ec70 comp rx=0 tx=0).stop 2023-07-09T02:22:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 shutdown_connections 2023-07-09T02:22:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924815c060 0x7f9248154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9234066280 0x7f9234068730 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92480d2450 0x7f9248154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 --2- 172.21.15.45:0/3046842173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480cd120 0x7f92480c9ce0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 >> 172.21.15.45:0/3046842173 conn(0x7f92480698e0 msgr2=0x7f924815b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 shutdown_connections 2023-07-09T02:22:20.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:20.844+0000 7f924d9db640 1 -- 172.21.15.45:0/3046842173 wait complete. 2023-07-09T02:22:20.863 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:22:20.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:20.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:22:20.947 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:22:20.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:20.949 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:22:20.958 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:22:20.959 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:20.969 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:22:20.969 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:21.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f524ad11640 1 Processor -- start 2023-07-09T02:22:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f524ad11640 1 -- start start 2023-07-09T02:22:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f524ad11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f524415c060 0x7f52440b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f524ad11640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5244160a50 con 0x7f52440cd120 2023-07-09T02:22:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f524ad11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524415c430 con 0x7f52440d2620 2023-07-09T02:22:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f524ad11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524415fb60 con 0x7f524415c060 2023-07-09T02:22:21.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f5243fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52440cd120 0x7f52440d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50082/0 (socket says 172.21.15.45:50082) 2023-07-09T02:22:21.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f5243fff640 1 -- 172.21.15.45:0/2403301140 learned_addr learned my addr 172.21.15.45:0/2403301140 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:21.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f5248aad640 1 --2- 172.21.15.45:0/2403301140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f524415c060 0x7f52440b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f52437fe640 1 -- 172.21.15.45:0/2403301140 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749452805 0 0) 0x7f5244160a50 con 0x7f52440cd120 2023-07-09T02:22:21.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f52437fe640 1 -- 172.21.15.45:0/2403301140 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5234003530 con 0x7f52440cd120 2023-07-09T02:22:21.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f52437fe640 1 -- 172.21.15.45:0/2403301140 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393554343 0 0) 0x7f524415c430 con 0x7f52440d2620 2023-07-09T02:22:21.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f52437fe640 1 -- 172.21.15.45:0/2403301140 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5244160a50 con 0x7f52440d2620 2023-07-09T02:22:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f5248aad640 1 -- 172.21.15.45:0/2403301140 >> v1:172.21.15.155:6789/0 conn(0x7f52440d2620 legacy=0x7f52440cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.168+0000 7f5248aad640 1 -- 172.21.15.45:0/2403301140 >> v1:172.21.15.45:6789/0 conn(0x7f52440cd120 legacy=0x7f52440d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f5248aad640 1 -- 172.21.15.45:0/2403301140 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524415fe40 con 0x7f524415c060 2023-07-09T02:22:21.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f5248aad640 1 --2- 172.21.15.45:0/2403301140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f524415c060 0x7f52440b4ed0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5238009820 tx=0x7f523801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f402a877e4fde71e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f52437fe640 1 -- 172.21.15.45:0/2403301140 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380ab670 con 0x7f524415c060 2023-07-09T02:22:21.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f52437fe640 1 -- 172.21.15.45:0/2403301140 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52380ab7d0 con 0x7f524415c060 2023-07-09T02:22:21.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f52437fe640 1 -- 172.21.15.45:0/2403301140 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380abb60 con 0x7f524415c060 2023-07-09T02:22:21.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f524ad11640 1 -- 172.21.15.45:0/2403301140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f524415c060 msgr2=0x7f52440b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f524ad11640 1 --2- 172.21.15.45:0/2403301140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f524415c060 0x7f52440b4ed0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5238009820 tx=0x7f523801c470 comp rx=0 tx=0).stop 2023-07-09T02:22:21.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f524ad11640 1 -- 172.21.15.45:0/2403301140 shutdown_connections 2023-07-09T02:22:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f524ad11640 1 --2- 172.21.15.45:0/2403301140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f524415c060 0x7f52440b4ed0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f524ad11640 1 -- 172.21.15.45:0/2403301140 >> 172.21.15.45:0/2403301140 conn(0x7f52440698e0 msgr2=0x7f5244069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f524ad11640 1 -- 172.21.15.45:0/2403301140 shutdown_connections 2023-07-09T02:22:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.172+0000 7f524ad11640 1 -- 172.21.15.45:0/2403301140 wait complete. 2023-07-09T02:22:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 Processor -- start 2023-07-09T02:22:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 -- start start 2023-07-09T02:22:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52440cd120 0x7f52440b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52440d2620 0x7f524415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524415c060 0x7f524415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244154da0 con 0x7f52440d2620 2023-07-09T02:22:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524415d4a0 con 0x7f524415c060 2023-07-09T02:22:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5244159850 con 0x7f52440cd120 2023-07-09T02:22:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52440d2620 0x7f524415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52440d2620 0x7f524415a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51228/0 (socket says 172.21.15.45:51228) 2023-07-09T02:22:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 -- 172.21.15.45:0/2001784189 learned_addr learned my addr 172.21.15.45:0/2001784189 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f52492ae640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524415c060 0x7f524415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5248aad640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52440cd120 0x7f52440b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 -- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52440cd120 msgr2=0x7f52440b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52440cd120 0x7f52440b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 -- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524415c060 msgr2=0x7f524415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524415c060 0x7f524415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 -- 172.21.15.45:0/2001784189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238009420 con 0x7f52440d2620 2023-07-09T02:22:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5248aad640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52440cd120 0x7f52440b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f52492ae640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524415c060 0x7f524415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f5243fff640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52440d2620 0x7f524415a610 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f5230005890 tx=0x7f523000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f52417fa640 1 -- 172.21.15.45:0/2001784189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230005cf0 con 0x7f52440d2620 2023-07-09T02:22:21.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f52417fa640 1 -- 172.21.15.45:0/2001784189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5230005e50 con 0x7f52440d2620 2023-07-09T02:22:21.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f52417fa640 1 -- 172.21.15.45:0/2001784189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300072b0 con 0x7f52440d2620 2023-07-09T02:22:21.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.176+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440b59f0 con 0x7f52440d2620 2023-07-09T02:22:21.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.180+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5244159e10 con 0x7f52440d2620 2023-07-09T02:22:21.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.180+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524404d7d0 con 0x7f52440d2620 2023-07-09T02:22:21.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.180+0000 7f52417fa640 1 -- 172.21.15.45:0/2001784189 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5230007410 con 0x7f52440d2620 2023-07-09T02:22:21.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.180+0000 7f52417fa640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5228066280 0x7f5228068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.180+0000 7f52417fa640 1 -- 172.21.15.45:0/2001784189 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5230083440 con 0x7f52440d2620 2023-07-09T02:22:21.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.180+0000 7f52417fa640 1 -- 172.21.15.45:0/2001784189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f522806e480 con 0x7f52440d2620 2023-07-09T02:22:21.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.180+0000 7f5248aad640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5228066280 0x7f5228068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.180+0000 7f5248aad640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5228066280 0x7f5228068730 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f52380af000 tx=0x7f52380a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.184+0000 7f52417fa640 1 -- 172.21.15.45:0/2001784189 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52300507f0 con 0x7f52440d2620 2023-07-09T02:22:21.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f524406baa0 con 0x7f52440d2620 2023-07-09T02:22:21.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f52417fa640 1 -- 172.21.15.45:0/2001784189 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+18486 (secure 0 0 0) 0x7f5230017020 con 0x7f52440d2620 2023-07-09T02:22:21.341 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:21.342 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":170,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:07.572065+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:21:01.154000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T02:21:02.407446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.12","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:21.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5228066280 msgr2=0x7f5228068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5228066280 0x7f5228068730 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f52380af000 tx=0x7f52380a7000 comp rx=0 tx=0).stop 2023-07-09T02:22:21.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52440d2620 msgr2=0x7f524415a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52440d2620 0x7f524415a610 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f5230005890 tx=0x7f523000c960 comp rx=0 tx=0).stop 2023-07-09T02:22:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 shutdown_connections 2023-07-09T02:22:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524415c060 0x7f524415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52440d2620 0x7f524415a610 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5228066280 0x7f5228068730 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 --2- 172.21.15.45:0/2001784189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52440cd120 0x7f52440b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.340+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 >> 172.21.15.45:0/2001784189 conn(0x7f52440698e0 msgr2=0x7f52440b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.344+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 shutdown_connections 2023-07-09T02:22:21.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.344+0000 7f524ad11640 1 -- 172.21.15.45:0/2001784189 wait complete. 2023-07-09T02:22:21.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:21:01.154000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:21:02.407446+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:22:21.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:22:21.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.508+0000 7f5a202fc640 1 Processor -- start 2023-07-09T02:22:21.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.508+0000 7f5a202fc640 1 -- start start 2023-07-09T02:22:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.508+0000 7f5a202fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a1815c060 0x7f5a180b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.508+0000 7f5a202fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a180cd120 0x7f5a180d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.508+0000 7f5a202fc640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a18160a50 con 0x7f5a180d2450 2023-07-09T02:22:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.508+0000 7f5a202fc640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a180d28d0 con 0x7f5a1815c060 2023-07-09T02:22:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.508+0000 7f5a202fc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a180cfe40 con 0x7f5a180cd120 2023-07-09T02:22:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e098640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a1815c060 0x7f5a180b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e098640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a1815c060 0x7f5a180b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51240/0 (socket says 172.21.15.45:51240) 2023-07-09T02:22:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e899640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5a180d2450 0x7f5a180d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50090/0 (socket says 172.21.15.45:50090) 2023-07-09T02:22:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e098640 1 -- 172.21.15.45:0/2266151825 learned_addr learned my addr 172.21.15.45:0/2266151825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1d897640 1 --2- 172.21.15.45:0/2266151825 >> v2:172.21.15.155:3300/0 conn(0x7f5a180cd120 0x7f5a180d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e098640 1 -- 172.21.15.45:0/2266151825 >> v2:172.21.15.155:3300/0 conn(0x7f5a180cd120 msgr2=0x7f5a180d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:21.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1d096640 1 -- 172.21.15.45:0/2266151825 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132281499 0 0) 0x7f5a18160a50 con 0x7f5a180d2450 2023-07-09T02:22:21.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e098640 1 --2- 172.21.15.45:0/2266151825 >> v2:172.21.15.155:3300/0 conn(0x7f5a180cd120 0x7f5a180d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e098640 1 -- 172.21.15.45:0/2266151825 >> v1:172.21.15.45:6789/0 conn(0x7f5a180d2450 legacy=0x7f5a180d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e098640 1 -- 172.21.15.45:0/2266151825 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1815c430 con 0x7f5a1815c060 2023-07-09T02:22:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1e098640 1 --2- 172.21.15.45:0/2266151825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a1815c060 0x7f5a180b4ed0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f5a1815fac0 tx=0x7f5a1401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86003df9dbcaeb9d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1d096640 1 -- 172.21.15.45:0/2266151825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140ab5f0 con 0x7f5a1815c060 2023-07-09T02:22:21.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1d096640 1 -- 172.21.15.45:0/2266151825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a140ab750 con 0x7f5a1815c060 2023-07-09T02:22:21.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.512+0000 7f5a1d096640 1 -- 172.21.15.45:0/2266151825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140abae0 con 0x7f5a1815c060 2023-07-09T02:22:21.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- 172.21.15.45:0/2266151825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a1815c060 msgr2=0x7f5a180b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 --2- 172.21.15.45:0/2266151825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a1815c060 0x7f5a180b4ed0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f5a1815fac0 tx=0x7f5a1401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- 172.21.15.45:0/2266151825 shutdown_connections 2023-07-09T02:22:21.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 --2- 172.21.15.45:0/2266151825 >> v2:172.21.15.155:3300/0 conn(0x7f5a180cd120 0x7f5a180d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 --2- 172.21.15.45:0/2266151825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a1815c060 0x7f5a180b4ed0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- 172.21.15.45:0/2266151825 >> 172.21.15.45:0/2266151825 conn(0x7f5a180698e0 msgr2=0x7f5a18069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:21.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- 172.21.15.45:0/2266151825 shutdown_connections 2023-07-09T02:22:21.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- 172.21.15.45:0/2266151825 wait complete. 2023-07-09T02:22:21.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 Processor -- start 2023-07-09T02:22:21.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- start start 2023-07-09T02:22:21.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a180cd120 0x7f5a18153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a180d2450 0x7f5a180b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1815c060 0x7f5a180b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a180c9b10 con 0x7f5a180cd120 2023-07-09T02:22:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a18154470 con 0x7f5a180d2450 2023-07-09T02:22:21.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a202fc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1815b460 con 0x7f5a1815c060 2023-07-09T02:22:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a1e098640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a180cd120 0x7f5a18153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a1e098640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a180cd120 0x7f5a18153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51244/0 (socket says 172.21.15.45:51244) 2023-07-09T02:22:21.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a1e098640 1 -- 172.21.15.45:0/3398930398 learned_addr learned my addr 172.21.15.45:0/3398930398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:21.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a1d897640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a180d2450 0x7f5a180b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.516+0000 7f5a1e899640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1815c060 0x7f5a180b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a1e098640 1 -- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1815c060 msgr2=0x7f5a180b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a1e098640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1815c060 0x7f5a180b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a1e098640 1 -- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a180d2450 msgr2=0x7f5a180b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a1e098640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a180d2450 0x7f5a180b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a1e098640 1 -- 172.21.15.45:0/3398930398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140094d0 con 0x7f5a180cd120 2023-07-09T02:22:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a1d897640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a180d2450 0x7f5a180b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a1e098640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a180cd120 0x7f5a18153f30 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f5a1401ab80 tx=0x7f5a1401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a0effd640 1 -- 172.21.15.45:0/3398930398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140abcd0 con 0x7f5a180cd120 2023-07-09T02:22:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a0effd640 1 -- 172.21.15.45:0/3398930398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a140b8070 con 0x7f5a180cd120 2023-07-09T02:22:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1815b740 con 0x7f5a180cd120 2023-07-09T02:22:21.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a0effd640 1 -- 172.21.15.45:0/3398930398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14004220 con 0x7f5a180cd120 2023-07-09T02:22:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a180ca040 con 0x7f5a180cd120 2023-07-09T02:22:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1804d7d0 con 0x7f5a180cd120 2023-07-09T02:22:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a0effd640 1 -- 172.21.15.45:0/3398930398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a14004380 con 0x7f5a180cd120 2023-07-09T02:22:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a0effd640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f59fc066280 0x7f59fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a0effd640 1 -- 172.21.15.45:0/3398930398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5a140a8050 con 0x7f5a180cd120 2023-07-09T02:22:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.520+0000 7f5a0effd640 1 -- 172.21.15.45:0/3398930398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f59fc06e480 con 0x7f5a180cd120 2023-07-09T02:22:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.524+0000 7f5a1d897640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f59fc066280 0x7f59fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.524+0000 7f5a1d897640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f59fc066280 0x7f59fc068730 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5a180b68b0 tx=0x7f5a08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.524+0000 7f5a0effd640 1 -- 172.21.15.45:0/3398930398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a140ba020 con 0x7f5a180cd120 2023-07-09T02:22:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a1806baa0 con 0x7f5a180cd120 2023-07-09T02:22:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a0effd640 1 -- 172.21.15.45:0/3398930398 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a140eb2c0 con 0x7f5a180cd120 2023-07-09T02:22:21.680 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:22:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f59fc066280 msgr2=0x7f59fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f59fc066280 0x7f59fc068730 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5a180b68b0 tx=0x7f5a08008040 comp rx=0 tx=0).stop 2023-07-09T02:22:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a180cd120 msgr2=0x7f5a18153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a180cd120 0x7f5a18153f30 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f5a1401ab80 tx=0x7f5a1401ad10 comp rx=0 tx=0).stop 2023-07-09T02:22:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 shutdown_connections 2023-07-09T02:22:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f59fc066280 0x7f59fc068730 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a1815c060 0x7f5a180b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a180d2450 0x7f5a180b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 --2- 172.21.15.45:0/3398930398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a180cd120 0x7f5a18153f30 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 >> 172.21.15.45:0/3398930398 conn(0x7f5a180698e0 msgr2=0x7f5a180b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:21.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 shutdown_connections 2023-07-09T02:22:21.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.680+0000 7f5a202fc640 1 -- 172.21.15.45:0/3398930398 wait complete. 2023-07-09T02:22:21.701 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:22:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f1303311640 1 Processor -- start 2023-07-09T02:22:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f1303311640 1 -- start start 2023-07-09T02:22:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f1303311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc06a5c0 0x7f12fc06aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f1303311640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12fc15fdd0 0x7f12fc160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f1303311640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12fc071140 con 0x7f12fc0cd290 2023-07-09T02:22:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f1303311640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc06b010 con 0x7f12fc15fdd0 2023-07-09T02:22:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f1303311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc15c970 con 0x7f12fc06a5c0 2023-07-09T02:22:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f13018ae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12fc15fdd0 0x7f12fc160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f13018ae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12fc15fdd0 0x7f12fc160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55178/0 (socket says 172.21.15.45:55178) 2023-07-09T02:22:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f13018ae640 1 -- 172.21.15.45:0/1721123045 learned_addr learned my addr 172.21.15.45:0/1721123045 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f13008ac640 1 --2- 172.21.15.45:0/1721123045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc06a5c0 0x7f12fc06aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f13018ae640 1 -- 172.21.15.45:0/1721123045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc06a5c0 msgr2=0x7f12fc06aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f13018ae640 1 --2- 172.21.15.45:0/1721123045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc06a5c0 0x7f12fc06aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f13018ae640 1 -- 172.21.15.45:0/1721123045 >> v1:172.21.15.155:6789/0 conn(0x7f12fc0cd290 legacy=0x7f12fc0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.848+0000 7f13018ae640 1 -- 172.21.15.45:0/1721123045 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc15cc50 con 0x7f12fc15fdd0 2023-07-09T02:22:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f13018ae640 1 --2- 172.21.15.45:0/1721123045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc15fdd0 0x7f12fc160270 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009e50 tx=0x7f12f401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28de534794e25663 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f12f3fff640 1 -- 172.21.15.45:0/1721123045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40a57d0 con 0x7f12fc15fdd0 2023-07-09T02:22:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f12f3fff640 1 -- 172.21.15.45:0/1721123045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f40a5930 con 0x7f12fc15fdd0 2023-07-09T02:22:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f12f3fff640 1 -- 172.21.15.45:0/1721123045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40a5cc0 con 0x7f12fc15fdd0 2023-07-09T02:22:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f1303311640 1 -- 172.21.15.45:0/1721123045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc15fdd0 msgr2=0x7f12fc160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f1303311640 1 --2- 172.21.15.45:0/1721123045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc15fdd0 0x7f12fc160270 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009e50 tx=0x7f12f401ca10 comp rx=0 tx=0).stop 2023-07-09T02:22:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f1303311640 1 -- 172.21.15.45:0/1721123045 shutdown_connections 2023-07-09T02:22:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f1303311640 1 --2- 172.21.15.45:0/1721123045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc15fdd0 0x7f12fc160270 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f1303311640 1 --2- 172.21.15.45:0/1721123045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc06a5c0 0x7f12fc06aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f1303311640 1 -- 172.21.15.45:0/1721123045 >> 172.21.15.45:0/1721123045 conn(0x7f12fc06d140 msgr2=0x7f12fc06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:21.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f1303311640 1 -- 172.21.15.45:0/1721123045 shutdown_connections 2023-07-09T02:22:21.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.852+0000 7f1303311640 1 -- 172.21.15.45:0/1721123045 wait complete. 2023-07-09T02:22:21.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 Processor -- start 2023-07-09T02:22:21.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 -- start start 2023-07-09T02:22:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc06a5c0 0x7f12fc159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc0cd290 0x7f12fc151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12fc15fdd0 0x7f12fc151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b1cd0 con 0x7f12fc06a5c0 2023-07-09T02:22:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b1fb0 con 0x7f12fc15fdd0 2023-07-09T02:22:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b2290 con 0x7f12fc0cd290 2023-07-09T02:22:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc06a5c0 0x7f12fc159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc06a5c0 0x7f12fc159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55194/0 (socket says 172.21.15.45:55194) 2023-07-09T02:22:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 -- 172.21.15.45:0/1428687408 learned_addr learned my addr 172.21.15.45:0/1428687408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13018ae640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12fc15fdd0 0x7f12fc151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13008ac640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc0cd290 0x7f12fc151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 -- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc0cd290 msgr2=0x7f12fc151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc0cd290 0x7f12fc151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 -- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12fc15fdd0 msgr2=0x7f12fc151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:21.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12fc15fdd0 0x7f12fc151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:21.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 -- 172.21.15.45:0/1428687408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4009b30 con 0x7f12fc06a5c0 2023-07-09T02:22:21.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f13010ad640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc06a5c0 0x7f12fc159040 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c500 tx=0x7f12f800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f12f1ffb640 1 -- 172.21.15.45:0/1428687408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8005220 con 0x7f12fc06a5c0 2023-07-09T02:22:21.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f12f1ffb640 1 -- 172.21.15.45:0/1428687408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8005380 con 0x7f12fc06a5c0 2023-07-09T02:22:21.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f12f1ffb640 1 -- 172.21.15.45:0/1428687408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8007270 con 0x7f12fc06a5c0 2023-07-09T02:22:21.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc0b2570 con 0x7f12fc06a5c0 2023-07-09T02:22:21.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.856+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc0b0f30 con 0x7f12fc06a5c0 2023-07-09T02:22:21.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.860+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc0b2790 con 0x7f12fc06a5c0 2023-07-09T02:22:21.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.860+0000 7f12f1ffb640 1 -- 172.21.15.45:0/1428687408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12f80073d0 con 0x7f12fc06a5c0 2023-07-09T02:22:21.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.860+0000 7f12f1ffb640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12e00662b0 0x7f12e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:21.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.860+0000 7f12f1ffb640 1 -- 172.21.15.45:0/1428687408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f12f8083560 con 0x7f12fc06a5c0 2023-07-09T02:22:21.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.860+0000 7f12f1ffb640 1 -- 172.21.15.45:0/1428687408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f12e006e4b0 con 0x7f12fc06a5c0 2023-07-09T02:22:21.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.860+0000 7f13008ac640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12e00662b0 0x7f12e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:21.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.860+0000 7f13008ac640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12e00662b0 0x7f12e0068760 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f12fc160350 tx=0x7f12ec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:21.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:21.864+0000 7f12f1ffb640 1 -- 172.21.15.45:0/1428687408 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12f80509c0 con 0x7f12fc06a5c0 2023-07-09T02:22:22.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.016+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12fc04d7d0 con 0x7f12fc06a5c0 2023-07-09T02:22:22.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.016+0000 7f12f1ffb640 1 -- 172.21.15.45:0/1428687408 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12f8053fe0 con 0x7f12fc06a5c0 2023-07-09T02:22:22.018 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:22:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12e00662b0 msgr2=0x7f12e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12e00662b0 0x7f12e0068760 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f12fc160350 tx=0x7f12ec009190 comp rx=0 tx=0).stop 2023-07-09T02:22:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc06a5c0 msgr2=0x7f12fc159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc06a5c0 0x7f12fc159040 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c500 tx=0x7f12f800c9c0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 shutdown_connections 2023-07-09T02:22:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12fc15fdd0 0x7f12fc151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f12e00662b0 0x7f12e0068760 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12fc0cd290 0x7f12fc151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 --2- 172.21.15.45:0/1428687408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12fc06a5c0 0x7f12fc159040 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 >> 172.21.15.45:0/1428687408 conn(0x7f12fc06d140 msgr2=0x7f12fc0cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 shutdown_connections 2023-07-09T02:22:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.020+0000 7f1303311640 1 -- 172.21.15.45:0/1428687408 wait complete. 2023-07-09T02:22:22.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:22:22.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a4ea34640 1 Processor -- start 2023-07-09T02:22:22.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a4ea34640 1 -- start start 2023-07-09T02:22:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a4ea34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a4815c060 0x7f5a480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a4ea34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a48160a50 con 0x7f5a480cd120 2023-07-09T02:22:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a4ea34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4815c430 con 0x7f5a480d2620 2023-07-09T02:22:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a4ea34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4815fb60 con 0x7f5a4815c060 2023-07-09T02:22:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a47fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a4815c060 0x7f5a480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a47fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a4815c060 0x7f5a480b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55204/0 (socket says 172.21.15.45:55204) 2023-07-09T02:22:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a47fff640 1 -- 172.21.15.45:0/3050133744 learned_addr learned my addr 172.21.15.45:0/3050133744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a477fe640 1 --1- 172.21.15.45:0/3050133744 >> v1:172.21.15.45:6789/0 conn(0x7f5a480cd120 0x7f5a480d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41352/0 (socket says 172.21.15.45:41352) 2023-07-09T02:22:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a47fff640 1 -- 172.21.15.45:0/3050133744 >> v1:172.21.15.155:6789/0 conn(0x7f5a480d2620 legacy=0x7f5a480cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a47fff640 1 -- 172.21.15.45:0/3050133744 >> v1:172.21.15.45:6789/0 conn(0x7f5a480cd120 legacy=0x7f5a480d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.184+0000 7f5a47fff640 1 -- 172.21.15.45:0/3050133744 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4815fe40 con 0x7f5a4815c060 2023-07-09T02:22:22.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a47fff640 1 --2- 172.21.15.45:0/3050133744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a4815c060 0x7f5a480b4ed0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009870 tx=0x7f5a3801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248eeace3377f258 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a46ffd640 1 -- 172.21.15.45:0/3050133744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380aa670 con 0x7f5a4815c060 2023-07-09T02:22:22.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a46ffd640 1 -- 172.21.15.45:0/3050133744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a380aa7d0 con 0x7f5a4815c060 2023-07-09T02:22:22.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a46ffd640 1 -- 172.21.15.45:0/3050133744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380aab60 con 0x7f5a4815c060 2023-07-09T02:22:22.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a4ea34640 1 -- 172.21.15.45:0/3050133744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a4815c060 msgr2=0x7f5a480b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a4ea34640 1 --2- 172.21.15.45:0/3050133744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a4815c060 0x7f5a480b4ed0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009870 tx=0x7f5a3801c510 comp rx=0 tx=0).stop 2023-07-09T02:22:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a4ea34640 1 -- 172.21.15.45:0/3050133744 shutdown_connections 2023-07-09T02:22:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a4ea34640 1 --2- 172.21.15.45:0/3050133744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a4815c060 0x7f5a480b4ed0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a4ea34640 1 -- 172.21.15.45:0/3050133744 >> 172.21.15.45:0/3050133744 conn(0x7f5a480698e0 msgr2=0x7f5a48069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a4ea34640 1 -- 172.21.15.45:0/3050133744 shutdown_connections 2023-07-09T02:22:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.188+0000 7f5a4ea34640 1 -- 172.21.15.45:0/3050133744 wait complete. 2023-07-09T02:22:22.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 Processor -- start 2023-07-09T02:22:22.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 -- start start 2023-07-09T02:22:22.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a480cd120 0x7f5a4815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a480d2620 0x7f5a48159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4815c060 0x7f5a48154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48159970 con 0x7f5a480d2620 2023-07-09T02:22:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48159620 con 0x7f5a4815c060 2023-07-09T02:22:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815ae20 con 0x7f5a480cd120 2023-07-09T02:22:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a480d2620 0x7f5a48159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a47fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a480cd120 0x7f5a4815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4cfd1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4815c060 0x7f5a48154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a47fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a480cd120 0x7f5a4815c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:40020/0 (socket says 172.21.15.45:40020) 2023-07-09T02:22:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a47fff640 1 -- 172.21.15.45:0/608549280 learned_addr learned my addr 172.21.15.45:0/608549280 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a477fe640 1 -- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a480cd120 msgr2=0x7f5a4815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a477fe640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a480cd120 0x7f5a4815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a477fe640 1 -- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4815c060 msgr2=0x7f5a48154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a477fe640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4815c060 0x7f5a48154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a477fe640 1 -- 172.21.15.45:0/608549280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380094d0 con 0x7f5a480d2620 2023-07-09T02:22:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a47fff640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a480cd120 0x7f5a4815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:22:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a477fe640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a480d2620 0x7f5a48159d90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00c400 tx=0x7f5a3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a44ff9640 1 -- 172.21.15.45:0/608549280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0074e0 con 0x7f5a480d2620 2023-07-09T02:22:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a44ff9640 1 -- 172.21.15.45:0/608549280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c007640 con 0x7f5a480d2620 2023-07-09T02:22:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a44ff9640 1 -- 172.21.15.45:0/608549280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c004a10 con 0x7f5a480d2620 2023-07-09T02:22:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a480b59f0 con 0x7f5a480d2620 2023-07-09T02:22:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.192+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4815b3e0 con 0x7f5a480d2620 2023-07-09T02:22:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.196+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a48159ab0 con 0x7f5a480d2620 2023-07-09T02:22:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.196+0000 7f5a44ff9640 1 -- 172.21.15.45:0/608549280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a3c004b70 con 0x7f5a480d2620 2023-07-09T02:22:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.196+0000 7f5a44ff9640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a34066280 0x7f5a34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.196+0000 7f5a44ff9640 1 -- 172.21.15.45:0/608549280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5a3c083600 con 0x7f5a480d2620 2023-07-09T02:22:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.196+0000 7f5a44ff9640 1 -- 172.21.15.45:0/608549280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f5a3406e480 con 0x7f5a480d2620 2023-07-09T02:22:22.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.196+0000 7f5a47fff640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a34066280 0x7f5a34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.196+0000 7f5a47fff640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a34066280 0x7f5a34068730 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5a3801c550 tx=0x7f5a380b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.200+0000 7f5a44ff9640 1 -- 172.21.15.45:0/608549280 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a48159ab0 con 0x7f5a480d2620 2023-07-09T02:22:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.352+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a48159ab0 con 0x7f5a480d2620 2023-07-09T02:22:22.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.352+0000 7f5a44ff9640 1 -- 172.21.15.45:0/608549280 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v170) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a48159ab0 con 0x7f5a480d2620 2023-07-09T02:22:22.356 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:22:22.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a34066280 msgr2=0x7f5a34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a34066280 0x7f5a34068730 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5a3801c550 tx=0x7f5a380b5040 comp rx=0 tx=0).stop 2023-07-09T02:22:22.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a480d2620 msgr2=0x7f5a48159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a480d2620 0x7f5a48159d90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00c400 tx=0x7f5a3c00c8c0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 shutdown_connections 2023-07-09T02:22:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a4815c060 0x7f5a48154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a480d2620 0x7f5a48159d90 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a34066280 0x7f5a34068730 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 --2- 172.21.15.45:0/608549280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a480cd120 0x7f5a4815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 >> 172.21.15.45:0/608549280 conn(0x7f5a480698e0 msgr2=0x7f5a480b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 shutdown_connections 2023-07-09T02:22:22.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.356+0000 7f5a4ea34640 1 -- 172.21.15.45:0/608549280 wait complete. 2023-07-09T02:22:22.376 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:22:22.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.520+0000 7f84e3e34640 1 Processor -- start 2023-07-09T02:22:22.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.520+0000 7f84e3e34640 1 -- start start 2023-07-09T02:22:22.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.520+0000 7f84e3e34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f84dc15c060 0x7f84dc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.520+0000 7f84e3e34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84dc160a50 con 0x7f84dc0d2620 2023-07-09T02:22:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.520+0000 7f84e3e34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84dc15c430 con 0x7f84dc0cd120 2023-07-09T02:22:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.520+0000 7f84e3e34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84dc15fb60 con 0x7f84dc15c060 2023-07-09T02:22:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.520+0000 7f84e1bd0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f84dc15c060 0x7f84dc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e23d1640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84dc0d2620 0x7f84dc0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41358/0 (socket says 172.21.15.45:41358) 2023-07-09T02:22:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e1bd0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f84dc15c060 0x7f84dc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55230/0 (socket says 172.21.15.45:55230) 2023-07-09T02:22:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e23d1640 1 -- 172.21.15.45:0/1070963291 learned_addr learned my addr 172.21.15.45:0/1070963291 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e1bd0640 1 -- 172.21.15.45:0/1070963291 >> v1:172.21.15.155:6789/0 conn(0x7f84dc0cd120 legacy=0x7f84dc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e1bd0640 1 -- 172.21.15.45:0/1070963291 >> v1:172.21.15.45:6789/0 conn(0x7f84dc0d2620 legacy=0x7f84dc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e0bce640 1 -- 172.21.15.45:0/1070963291 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799501033 0 0) 0x7f84dc160a50 con 0x7f84dc0d2620 2023-07-09T02:22:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e1bd0640 1 -- 172.21.15.45:0/1070963291 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc15fe40 con 0x7f84dc15c060 2023-07-09T02:22:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e1bd0640 1 --2- 172.21.15.45:0/1070963291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc0b4ed0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f84d80097c0 tx=0x7f84d801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684e2452232e28f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e0bce640 1 -- 172.21.15.45:0/1070963291 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80ab610 con 0x7f84dc15c060 2023-07-09T02:22:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e0bce640 1 -- 172.21.15.45:0/1070963291 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d80ab770 con 0x7f84dc15c060 2023-07-09T02:22:22.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.524+0000 7f84e0bce640 1 -- 172.21.15.45:0/1070963291 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80abb00 con 0x7f84dc15c060 2023-07-09T02:22:22.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- 172.21.15.45:0/1070963291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 msgr2=0x7f84dc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 --2- 172.21.15.45:0/1070963291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc0b4ed0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f84d80097c0 tx=0x7f84d801c410 comp rx=0 tx=0).stop 2023-07-09T02:22:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- 172.21.15.45:0/1070963291 shutdown_connections 2023-07-09T02:22:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 --2- 172.21.15.45:0/1070963291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc0b4ed0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- 172.21.15.45:0/1070963291 >> 172.21.15.45:0/1070963291 conn(0x7f84dc0698e0 msgr2=0x7f84dc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- 172.21.15.45:0/1070963291 shutdown_connections 2023-07-09T02:22:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- 172.21.15.45:0/1070963291 wait complete. 2023-07-09T02:22:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 Processor -- start 2023-07-09T02:22:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- start start 2023-07-09T02:22:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84dc0cd120 0x7f84dc151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84dc0d2620 0x7f84dc151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc15aae0 con 0x7f84dc15c060 2023-07-09T02:22:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc152400 con 0x7f84dc0d2620 2023-07-09T02:22:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e3e34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc15a1b0 con 0x7f84dc0cd120 2023-07-09T02:22:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e23d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e23d1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55234/0 (socket says 172.21.15.45:55234) 2023-07-09T02:22:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e23d1640 1 -- 172.21.15.45:0/4292937733 learned_addr learned my addr 172.21.15.45:0/4292937733 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e1bd0640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84dc0cd120 0x7f84dc151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e13cf640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84dc0d2620 0x7f84dc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e23d1640 1 -- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84dc0cd120 msgr2=0x7f84dc151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e23d1640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84dc0cd120 0x7f84dc151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e23d1640 1 -- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84dc0d2620 msgr2=0x7f84dc151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e23d1640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84dc0d2620 0x7f84dc151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.528+0000 7f84e23d1640 1 -- 172.21.15.45:0/4292937733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8009420 con 0x7f84dc15c060 2023-07-09T02:22:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84e23d1640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc15c620 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c750 tx=0x7f84d400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84d27fc640 1 -- 172.21.15.45:0/4292937733 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400ce60 con 0x7f84dc15c060 2023-07-09T02:22:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84d27fc640 1 -- 172.21.15.45:0/4292937733 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d400a640 con 0x7f84dc15c060 2023-07-09T02:22:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84d27fc640 1 -- 172.21.15.45:0/4292937733 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400aa10 con 0x7f84dc15c060 2023-07-09T02:22:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc0b59f0 con 0x7f84dc15c060 2023-07-09T02:22:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc15a770 con 0x7f84dc15c060 2023-07-09T02:22:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc04d7d0 con 0x7f84dc15c060 2023-07-09T02:22:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84d27fc640 1 -- 172.21.15.45:0/4292937733 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84d400ab70 con 0x7f84dc15c060 2023-07-09T02:22:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84d27fc640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84c0066280 0x7f84c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84d27fc640 1 -- 172.21.15.45:0/4292937733 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f84d40832b0 con 0x7f84dc15c060 2023-07-09T02:22:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84d27fc640 1 -- 172.21.15.45:0/4292937733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f84c006e480 con 0x7f84dc15c060 2023-07-09T02:22:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.532+0000 7f84e1bd0640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84c0066280 0x7f84c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.536+0000 7f84e1bd0640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84c0066280 0x7f84c0068730 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f84d80af000 tx=0x7f84d80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.536+0000 7f84d27fc640 1 -- 172.21.15.45:0/4292937733 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84d4018060 con 0x7f84dc15c060 2023-07-09T02:22:22.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84dc06baa0 con 0x7f84dc15c060 2023-07-09T02:22:22.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84d27fc640 1 -- 172.21.15.45:0/4292937733 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v170) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84d4018070 con 0x7f84dc15c060 2023-07-09T02:22:22.693 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:22:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84c0066280 msgr2=0x7f84c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84c0066280 0x7f84c0068730 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f84d80af000 tx=0x7f84d80a7000 comp rx=0 tx=0).stop 2023-07-09T02:22:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 msgr2=0x7f84dc15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc15c620 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c750 tx=0x7f84d400cc10 comp rx=0 tx=0).stop 2023-07-09T02:22:22.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 shutdown_connections 2023-07-09T02:22:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84dc15c060 0x7f84dc15c620 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84dc0d2620 0x7f84dc151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f84c0066280 0x7f84c0068730 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 --2- 172.21.15.45:0/4292937733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84dc0cd120 0x7f84dc151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.692+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 >> 172.21.15.45:0/4292937733 conn(0x7f84dc0698e0 msgr2=0x7f84dc0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.696+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 shutdown_connections 2023-07-09T02:22:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.696+0000 7f84e3e34640 1 -- 172.21.15.45:0/4292937733 wait complete. 2023-07-09T02:22:22.714 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:22:22.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.856+0000 7f6fe0be9640 1 Processor -- start 2023-07-09T02:22:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.856+0000 7f6fe0be9640 1 -- start start 2023-07-09T02:22:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fe0be9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc0d2620 0x7f6fdc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fe0be9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fdc0cd120 0x7f6fdc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fe0be9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc160a50 con 0x7f6fdc15c060 2023-07-09T02:22:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fe0be9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc15c430 con 0x7f6fdc0cd120 2023-07-09T02:22:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fe0be9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc15fb60 con 0x7f6fdc0d2620 2023-07-09T02:22:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fdad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fdc0cd120 0x7f6fdc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fdad9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6fdc0cd120 0x7f6fdc0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55250/0 (socket says 172.21.15.45:55250) 2023-07-09T02:22:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fdad9d640 1 -- 172.21.15.45:0/3094451963 learned_addr learned my addr 172.21.15.45:0/3094451963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/3094451963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc0d2620 0x7f6fdc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fdad9d640 1 -- 172.21.15.45:0/3094451963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc0d2620 msgr2=0x7f6fdc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fdad9d640 1 --2- 172.21.15.45:0/3094451963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc0d2620 0x7f6fdc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fdad9d640 1 -- 172.21.15.45:0/3094451963 >> v1:172.21.15.45:6789/0 conn(0x7f6fdc15c060 legacy=0x7f6fdc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.860+0000 7f6fdad9d640 1 -- 172.21.15.45:0/3094451963 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc15fe40 con 0x7f6fdc0cd120 2023-07-09T02:22:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fdad9d640 1 --2- 172.21.15.45:0/3094451963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cee30 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009e50 tx=0x7f6fd401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dae3486b93eb14f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fd9d9b640 1 -- 172.21.15.45:0/3094451963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40a58a0 con 0x7f6fdc0cd120 2023-07-09T02:22:22.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fd9d9b640 1 -- 172.21.15.45:0/3094451963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd40a5a00 con 0x7f6fdc0cd120 2023-07-09T02:22:22.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fd9d9b640 1 -- 172.21.15.45:0/3094451963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40a5d90 con 0x7f6fdc0cd120 2023-07-09T02:22:22.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 -- 172.21.15.45:0/3094451963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 msgr2=0x7f6fdc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/3094451963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cee30 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009e50 tx=0x7f6fd401c9e0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 -- 172.21.15.45:0/3094451963 shutdown_connections 2023-07-09T02:22:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/3094451963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cee30 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/3094451963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc0d2620 0x7f6fdc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 -- 172.21.15.45:0/3094451963 >> 172.21.15.45:0/3094451963 conn(0x7f6fdc0698e0 msgr2=0x7f6fdc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 -- 172.21.15.45:0/3094451963 shutdown_connections 2023-07-09T02:22:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 -- 172.21.15.45:0/3094451963 wait complete. 2023-07-09T02:22:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 Processor -- start 2023-07-09T02:22:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.864+0000 7f6fe0be9640 1 -- start start 2023-07-09T02:22:22.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fdc0d2620 0x7f6fdc154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc15c060 0x7f6fdc0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0cb0f0 con 0x7f6fdc0cd120 2023-07-09T02:22:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0c9b10 con 0x7f6fdc0d2620 2023-07-09T02:22:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0c9df0 con 0x7f6fdc15c060 2023-07-09T02:22:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55260/0 (socket says 172.21.15.45:55260) 2023-07-09T02:22:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 -- 172.21.15.45:0/1216849305 learned_addr learned my addr 172.21.15.45:0/1216849305 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:22.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fdc0d2620 0x7f6fdc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fdad9d640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc15c060 0x7f6fdc0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 -- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc15c060 msgr2=0x7f6fdc0cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc15c060 0x7f6fdc0cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 -- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fdc0d2620 msgr2=0x7f6fdc154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fdc0d2620 0x7f6fdc154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 -- 172.21.15.45:0/1216849305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd4009b30 con 0x7f6fdc0cd120 2023-07-09T02:22:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fda59c640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cabb0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00c3c0 tx=0x7f6fcc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/1216849305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0052d0 con 0x7f6fdc0cd120 2023-07-09T02:22:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/1216849305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc005430 con 0x7f6fdc0cd120 2023-07-09T02:22:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/1216849305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc003840 con 0x7f6fdc0cd120 2023-07-09T02:22:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc0b59f0 con 0x7f6fdc0cd120 2023-07-09T02:22:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0ca3b0 con 0x7f6fdc0cd120 2023-07-09T02:22:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc0cef70 con 0x7f6fdc0cd120 2023-07-09T02:22:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.868+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/1216849305 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fcc0039a0 con 0x7f6fdc0cd120 2023-07-09T02:22:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.872+0000 7f6fd2ffd640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fbc066280 0x7f6fbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.872+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/1216849305 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6fcc0832a0 con 0x7f6fdc0cd120 2023-07-09T02:22:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.872+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/1216849305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f6fbc06e480 con 0x7f6fdc0cd120 2023-07-09T02:22:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.872+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fbc066280 0x7f6fbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.872+0000 7f6fd3fff640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fbc066280 0x7f6fbc068730 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc1575b0 tx=0x7f6fc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:22.876+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/1216849305 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6fcc0506f0 con 0x7f6fdc0cd120 2023-07-09T02:22:23.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6fdc04d7d0 con 0x7f6fdc0cd120 2023-07-09T02:22:23.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fd2ffd640 1 -- 172.21.15.45:0/1216849305 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v170) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6fcc017070 con 0x7f6fdc0cd120 2023-07-09T02:22:23.044 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:22:23.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fbc066280 msgr2=0x7f6fbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fbc066280 0x7f6fbc068730 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc1575b0 tx=0x7f6fc4008040 comp rx=0 tx=0).stop 2023-07-09T02:22:23.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 msgr2=0x7f6fdc0cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cabb0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00c3c0 tx=0x7f6fcc00c880 comp rx=0 tx=0).stop 2023-07-09T02:22:23.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 shutdown_connections 2023-07-09T02:22:23.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6fbc066280 0x7f6fbc068730 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fdc15c060 0x7f6fdc0cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fdc0d2620 0x7f6fdc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 --2- 172.21.15.45:0/1216849305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fdc0cd120 0x7f6fdc0cabb0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 >> 172.21.15.45:0/1216849305 conn(0x7f6fdc0698e0 msgr2=0x7f6fdc0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:23.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 shutdown_connections 2023-07-09T02:22:23.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.044+0000 7f6fe0be9640 1 -- 172.21.15.45:0/1216849305 wait complete. 2023-07-09T02:22:23.065 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:22:23.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:23.066 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:22:23.129 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:22:23.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:23.130 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:22:23.140 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:23.140 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:23.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:22:23.150 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:22:23.151 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:23.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:22:23.193 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e41e9c640 1 Processor -- start 2023-07-09T02:22:23.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e41e9c640 1 -- start start 2023-07-09T02:22:23.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e41e9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c15c060 0x7f3e3c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e41e9c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e3c0cd120 0x7f3e3c0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e41e9c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c160a50 con 0x7f3e3c0d2450 2023-07-09T02:22:23.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e41e9c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0d28f0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e41e9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0cfe40 con 0x7f3e3c15c060 2023-07-09T02:22:23.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e3affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e3c0cd120 0x7f3e3c0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e3affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e3c0cd120 0x7f3e3c0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55270/0 (socket says 172.21.15.45:55270) 2023-07-09T02:22:23.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e3affd640 1 -- 172.21.15.45:0/2758598304 learned_addr learned my addr 172.21.15.45:0/2758598304 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:23.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e3b7fe640 1 --2- 172.21.15.45:0/2758598304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c15c060 0x7f3e3c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e3affd640 1 -- 172.21.15.45:0/2758598304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c15c060 msgr2=0x7f3e3c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e3affd640 1 --2- 172.21.15.45:0/2758598304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c15c060 0x7f3e3c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e3affd640 1 -- 172.21.15.45:0/2758598304 >> v1:172.21.15.155:6789/0 conn(0x7f3e3c0d2450 legacy=0x7f3e3c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.336+0000 7f3e3affd640 1 -- 172.21.15.45:0/2758598304 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c15c430 con 0x7f3e3c0cd120 2023-07-09T02:22:23.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e3affd640 1 --2- 172.21.15.45:0/2758598304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c0d1f10 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009870 tx=0x7f3e3001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83093e131b71fc72 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e3a7fc640 1 -- 172.21.15.45:0/2758598304 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300a7070 con 0x7f3e3c0cd120 2023-07-09T02:22:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e3a7fc640 1 -- 172.21.15.45:0/2758598304 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e300ab430 con 0x7f3e3c0cd120 2023-07-09T02:22:23.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e3a7fc640 1 -- 172.21.15.45:0/2758598304 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300ab7c0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e41e9c640 1 -- 172.21.15.45:0/2758598304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 msgr2=0x7f3e3c0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/2758598304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c0d1f10 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009870 tx=0x7f3e3001c510 comp rx=0 tx=0).stop 2023-07-09T02:22:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e41e9c640 1 -- 172.21.15.45:0/2758598304 shutdown_connections 2023-07-09T02:22:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/2758598304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c0d1f10 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/2758598304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c15c060 0x7f3e3c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e41e9c640 1 -- 172.21.15.45:0/2758598304 >> 172.21.15.45:0/2758598304 conn(0x7f3e3c0698e0 msgr2=0x7f3e3c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e41e9c640 1 -- 172.21.15.45:0/2758598304 shutdown_connections 2023-07-09T02:22:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.340+0000 7f3e41e9c640 1 -- 172.21.15.45:0/2758598304 wait complete. 2023-07-09T02:22:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 Processor -- start 2023-07-09T02:22:23.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 -- start start 2023-07-09T02:22:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c0d2450 0x7f3e3c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e3c15c060 0x7f3e3c157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1554f0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c15d040 con 0x7f3e3c15c060 2023-07-09T02:22:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c15d320 con 0x7f3e3c0d2450 2023-07-09T02:22:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55282/0 (socket says 172.21.15.45:55282) 2023-07-09T02:22:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 -- 172.21.15.45:0/4248572229 learned_addr learned my addr 172.21.15.45:0/4248572229 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3affd640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c0d2450 0x7f3e3c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3bfff640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e3c15c060 0x7f3e3c157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 -- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c0d2450 msgr2=0x7f3e3c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c0d2450 0x7f3e3c15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 -- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e3c15c060 msgr2=0x7f3e3c157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e3c15c060 0x7f3e3c157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 -- 172.21.15.45:0/4248572229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300094d0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e3b7fe640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c154fb0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00e870 tx=0x7f3e2c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e23fff640 1 -- 172.21.15.45:0/4248572229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c009510 con 0x7f3e3c0cd120 2023-07-09T02:22:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e23fff640 1 -- 172.21.15.45:0/4248572229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c00eec0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e23fff640 1 -- 172.21.15.45:0/4248572229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c00cb40 con 0x7f3e3c0cd120 2023-07-09T02:22:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c15d600 con 0x7f3e3c0cd120 2023-07-09T02:22:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c15dbc0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.344+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c0c9820 con 0x7f3e3c0cd120 2023-07-09T02:22:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.348+0000 7f3e23fff640 1 -- 172.21.15.45:0/4248572229 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e2c00cca0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.348+0000 7f3e23fff640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e280662b0 0x7f3e28068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.348+0000 7f3e23fff640 1 -- 172.21.15.45:0/4248572229 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3e2c083e20 con 0x7f3e3c0cd120 2023-07-09T02:22:23.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.348+0000 7f3e3affd640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e280662b0 0x7f3e28068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.348+0000 7f3e23fff640 1 -- 172.21.15.45:0/4248572229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f3e2806e4b0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.348+0000 7f3e3affd640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e280662b0 0x7f3e28068760 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3e300af000 tx=0x7f3e30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:23.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.352+0000 7f3e23fff640 1 -- 172.21.15.45:0/4248572229 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e2c017060 con 0x7f3e3c0cd120 2023-07-09T02:22:23.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e3c04d7d0 con 0x7f3e3c0cd120 2023-07-09T02:22:23.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e23fff640 1 -- 172.21.15.45:0/4248572229 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f3e2c021070 con 0x7f3e3c0cd120 2023-07-09T02:22:23.544 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:23.545 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2937988619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2937988619},{"type":"v1","addr":"172.21.15.45:6835","nonce":2937988619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/202593650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":202593650},{"type":"v1","addr":"172.21.15.45:6833","nonce":202593650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1590703663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1590703663},{"type":"v1","addr":"172.21.15.155:6837","nonce":1590703663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:21:03.398485+0000","modified":"2023-07-09T02:21:07.041368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8206":{"gid":8206,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/390558772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":390558772},{"type":"v1","addr":"172.21.15.155:6836","nonce":390558772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T02:22:23.545 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 83 2023-07-09T02:22:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e280662b0 msgr2=0x7f3e28068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e280662b0 0x7f3e28068760 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3e300af000 tx=0x7f3e30008040 comp rx=0 tx=0).stop 2023-07-09T02:22:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 msgr2=0x7f3e3c154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c154fb0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00e870 tx=0x7f3e2c00ec70 comp rx=0 tx=0).stop 2023-07-09T02:22:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 shutdown_connections 2023-07-09T02:22:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e3c15c060 0x7f3e3c157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3e280662b0 0x7f3e28068760 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3c0d2450 0x7f3e3c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 --2- 172.21.15.45:0/4248572229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e3c0cd120 0x7f3e3c154fb0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 >> 172.21.15.45:0/4248572229 conn(0x7f3e3c0698e0 msgr2=0x7f3e3c15b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:23.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 shutdown_connections 2023-07-09T02:22:23.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.544+0000 7f3e41e9c640 1 -- 172.21.15.45:0/4248572229 wait complete. 2023-07-09T02:22:23.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.708+0000 7f6d44e34640 1 Processor -- start 2023-07-09T02:22:23.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.708+0000 7f6d44e34640 1 -- start start 2023-07-09T02:22:23.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.708+0000 7f6d44e34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4015c060 0x7f6d400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.708+0000 7f6d44e34640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d400cd120 0x7f6d400d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.708+0000 7f6d44e34640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d40160a50 con 0x7f6d400d2450 2023-07-09T02:22:23.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.708+0000 7f6d44e34640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d400d28f0 con 0x7f6d400cd120 2023-07-09T02:22:23.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.708+0000 7f6d44e34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400cfe40 con 0x7f6d4015c060 2023-07-09T02:22:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.708+0000 7f6d37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d400cd120 0x7f6d400d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d3ed9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6d400d2450 0x7f6d400d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41380/0 (socket says 172.21.15.45:41380) 2023-07-09T02:22:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d3ed9d640 1 -- 172.21.15.45:0/446109463 learned_addr learned my addr 172.21.15.45:0/446109463 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d3e59c640 1 --2- 172.21.15.45:0/446109463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4015c060 0x7f6d400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d37fff640 1 -- 172.21.15.45:0/446109463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4015c060 msgr2=0x7f6d400b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d37fff640 1 --2- 172.21.15.45:0/446109463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4015c060 0x7f6d400b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d37fff640 1 -- 172.21.15.45:0/446109463 >> v1:172.21.15.45:6789/0 conn(0x7f6d400d2450 legacy=0x7f6d400d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d37fff640 1 -- 172.21.15.45:0/446109463 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4015c430 con 0x7f6d400cd120 2023-07-09T02:22:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d3e59c640 1 --2- 172.21.15.45:0/446109463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4015c060 0x7f6d400b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d3dd9b640 1 -- 172.21.15.45:0/446109463 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199200978 0 0) 0x7f6d40160a50 con 0x7f6d400d2450 2023-07-09T02:22:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d37fff640 1 --2- 172.21.15.45:0/446109463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400cd120 0x7f6d400d1f10 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f6d280097c0 tx=0x7f6d2801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd7843bc8f94a62 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d3dd9b640 1 -- 172.21.15.45:0/446109463 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280ab600 con 0x7f6d400cd120 2023-07-09T02:22:23.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d3dd9b640 1 -- 172.21.15.45:0/446109463 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280a7050 con 0x7f6d400cd120 2023-07-09T02:22:23.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.712+0000 7f6d3dd9b640 1 -- 172.21.15.45:0/446109463 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280ab980 con 0x7f6d400cd120 2023-07-09T02:22:23.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- 172.21.15.45:0/446109463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400cd120 msgr2=0x7f6d400d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 --2- 172.21.15.45:0/446109463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400cd120 0x7f6d400d1f10 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f6d280097c0 tx=0x7f6d2801c450 comp rx=0 tx=0).stop 2023-07-09T02:22:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- 172.21.15.45:0/446109463 shutdown_connections 2023-07-09T02:22:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 --2- 172.21.15.45:0/446109463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400cd120 0x7f6d400d1f10 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 --2- 172.21.15.45:0/446109463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d4015c060 0x7f6d400b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- 172.21.15.45:0/446109463 >> 172.21.15.45:0/446109463 conn(0x7f6d400698e0 msgr2=0x7f6d40069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- 172.21.15.45:0/446109463 shutdown_connections 2023-07-09T02:22:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- 172.21.15.45:0/446109463 wait complete. 2023-07-09T02:22:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 Processor -- start 2023-07-09T02:22:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- start start 2023-07-09T02:22:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d400cd120 0x7f6d400b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400d2450 0x7f6d40153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4015c060 0x7f6d40152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400cc990 con 0x7f6d400d2450 2023-07-09T02:22:23.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4015c9e0 con 0x7f6d4015c060 2023-07-09T02:22:23.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d44e34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4015ccc0 con 0x7f6d400cd120 2023-07-09T02:22:23.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d37fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400d2450 0x7f6d40153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d37fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400d2450 0x7f6d40153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55308/0 (socket says 172.21.15.45:55308) 2023-07-09T02:22:23.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d37fff640 1 -- 172.21.15.45:0/4226924356 learned_addr learned my addr 172.21.15.45:0/4226924356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:23.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d3ed9d640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4015c060 0x7f6d40152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d3e59c640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d400cd120 0x7f6d400b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d37fff640 1 -- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d400cd120 msgr2=0x7f6d400b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d37fff640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d400cd120 0x7f6d400b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d37fff640 1 -- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4015c060 msgr2=0x7f6d40152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d37fff640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4015c060 0x7f6d40152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.716+0000 7f6d37fff640 1 -- 172.21.15.45:0/4226924356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d28009420 con 0x7f6d400d2450 2023-07-09T02:22:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d37fff640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400d2450 0x7f6d40153e70 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f6d280ae040 tx=0x7f6d2801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d36ffd640 1 -- 172.21.15.45:0/4226924356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280b7650 con 0x7f6d400d2450 2023-07-09T02:22:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d36ffd640 1 -- 172.21.15.45:0/4226924356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280abe90 con 0x7f6d400d2450 2023-07-09T02:22:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d36ffd640 1 -- 172.21.15.45:0/4226924356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280b7a10 con 0x7f6d400d2450 2023-07-09T02:22:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4015cfa0 con 0x7f6d400d2450 2023-07-09T02:22:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4015d560 con 0x7f6d400d2450 2023-07-09T02:22:23.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4015d750 con 0x7f6d400d2450 2023-07-09T02:22:23.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d36ffd640 1 -- 172.21.15.45:0/4226924356 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d280b7b70 con 0x7f6d400d2450 2023-07-09T02:22:23.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d36ffd640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6d20066280 0x7f6d20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:23.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.720+0000 7f6d36ffd640 1 -- 172.21.15.45:0/4226924356 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6d2811e790 con 0x7f6d400d2450 2023-07-09T02:22:23.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.724+0000 7f6d36ffd640 1 -- 172.21.15.45:0/4226924356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f6d2006e480 con 0x7f6d400d2450 2023-07-09T02:22:23.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.724+0000 7f6d3e59c640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6d20066280 0x7f6d20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:23.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.724+0000 7f6d3e59c640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6d20066280 0x7f6d20068730 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000ba10 tx=0x7f6d30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:23.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.724+0000 7f6d36ffd640 1 -- 172.21.15.45:0/4226924356 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d280ebaa0 con 0x7f6d400d2450 2023-07-09T02:22:23.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.880+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d4004d7d0 con 0x7f6d400d2450 2023-07-09T02:22:23.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d36ffd640 1 -- 172.21.15.45:0/4226924356 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+18486 (secure 0 0 0) 0x7f6d280ef0c0 con 0x7f6d400d2450 2023-07-09T02:22:23.883 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:23.884 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":170,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:07.572065+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:21:01.154000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T02:21:02.407446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.12","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:23.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6d20066280 msgr2=0x7f6d20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6d20066280 0x7f6d20068730 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000ba10 tx=0x7f6d30008040 comp rx=0 tx=0).stop 2023-07-09T02:22:23.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400d2450 msgr2=0x7f6d40153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400d2450 0x7f6d40153e70 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f6d280ae040 tx=0x7f6d2801ac90 comp rx=0 tx=0).stop 2023-07-09T02:22:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 shutdown_connections 2023-07-09T02:22:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d4015c060 0x7f6d40152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d400d2450 0x7f6d40153e70 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6d20066280 0x7f6d20068730 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 --2- 172.21.15.45:0/4226924356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d400cd120 0x7f6d400b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 >> 172.21.15.45:0/4226924356 conn(0x7f6d400698e0 msgr2=0x7f6d401573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 shutdown_connections 2023-07-09T02:22:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:23.884+0000 7f6d44e34640 1 -- 172.21.15.45:0/4226924356 wait complete. 2023-07-09T02:22:23.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:21:01.154000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:21:02.407446+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:22:23.906 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:22:24.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.052+0000 7fedff6bd640 1 Processor -- start 2023-07-09T02:22:24.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.052+0000 7fedff6bd640 1 -- start start 2023-07-09T02:22:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedff6bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fedf80cd120 0x7fedf80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedff6bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf8160a50 con 0x7fedf815c060 2023-07-09T02:22:24.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedff6bd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf815c430 con 0x7fedf80d2620 2023-07-09T02:22:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedff6bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf815fb60 con 0x7fedf80cd120 2023-07-09T02:22:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedfdc5a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fedf80cd120 0x7fedf80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedfdc5a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fedf80cd120 0x7fedf80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55314/0 (socket says 172.21.15.45:55314) 2023-07-09T02:22:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedfdc5a640 1 -- 172.21.15.45:0/998326454 learned_addr learned my addr 172.21.15.45:0/998326454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:24.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedfd459640 1 --1- 172.21.15.45:0/998326454 >> v1:172.21.15.45:6789/0 conn(0x7fedf815c060 0x7fedf80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41384/0 (socket says 172.21.15.45:41384) 2023-07-09T02:22:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedfdc5a640 1 -- 172.21.15.45:0/998326454 >> v1:172.21.15.155:6789/0 conn(0x7fedf80d2620 legacy=0x7fedf80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedfdc5a640 1 -- 172.21.15.45:0/998326454 >> v1:172.21.15.45:6789/0 conn(0x7fedf815c060 legacy=0x7fedf80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.056+0000 7fedfdc5a640 1 -- 172.21.15.45:0/998326454 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf815fe40 con 0x7fedf80cd120 2023-07-09T02:22:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedfdc5a640 1 --2- 172.21.15.45:0/998326454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf80b4ed0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009e50 tx=0x7fedf001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf06f609081f720 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedeffff640 1 -- 172.21.15.45:0/998326454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a5860 con 0x7fedf80cd120 2023-07-09T02:22:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedeffff640 1 -- 172.21.15.45:0/998326454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00a59c0 con 0x7fedf80cd120 2023-07-09T02:22:24.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedeffff640 1 -- 172.21.15.45:0/998326454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a5d50 con 0x7fedf80cd120 2023-07-09T02:22:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 -- 172.21.15.45:0/998326454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 msgr2=0x7fedf80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 --2- 172.21.15.45:0/998326454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf80b4ed0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009e50 tx=0x7fedf001c9a0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 -- 172.21.15.45:0/998326454 shutdown_connections 2023-07-09T02:22:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 --2- 172.21.15.45:0/998326454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf80b4ed0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 -- 172.21.15.45:0/998326454 >> 172.21.15.45:0/998326454 conn(0x7fedf80698e0 msgr2=0x7fedf8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 -- 172.21.15.45:0/998326454 shutdown_connections 2023-07-09T02:22:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 -- 172.21.15.45:0/998326454 wait complete. 2023-07-09T02:22:24.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 Processor -- start 2023-07-09T02:22:24.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.060+0000 7fedff6bd640 1 -- start start 2023-07-09T02:22:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf80d2620 0x7fedf81418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf815c060 0x7fedf81677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8141de0 con 0x7fedf80cd120 2023-07-09T02:22:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8142c00 con 0x7fedf80d2620 2023-07-09T02:22:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8167ce0 con 0x7fedf815c060 2023-07-09T02:22:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf815e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55326/0 (socket says 172.21.15.45:55326) 2023-07-09T02:22:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 -- 172.21.15.45:0/852256999 learned_addr learned my addr 172.21.15.45:0/852256999 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfdc5a640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf815c060 0x7fedf81677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfcc58640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf80d2620 0x7fedf81418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 -- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf815c060 msgr2=0x7fedf81677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf815c060 0x7fedf81677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 -- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf80d2620 msgr2=0x7fedf81418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf80d2620 0x7fedf81418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 -- 172.21.15.45:0/852256999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0009b30 con 0x7fedf80cd120 2023-07-09T02:22:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedfd459640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf815e3b0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fedf400c430 tx=0x7fedf400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fededffb640 1 -- 172.21.15.45:0/852256999 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf40074e0 con 0x7fedf80cd120 2023-07-09T02:22:24.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fededffb640 1 -- 172.21.15.45:0/852256999 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf4007640 con 0x7fedf80cd120 2023-07-09T02:22:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fededffb640 1 -- 172.21.15.45:0/852256999 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4004a10 con 0x7fedf80cd120 2023-07-09T02:22:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf80b59f0 con 0x7fedf80cd120 2023-07-09T02:22:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf81422d0 con 0x7fedf80cd120 2023-07-09T02:22:24.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf804d7d0 con 0x7fedf80cd120 2023-07-09T02:22:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.064+0000 7fededffb640 1 -- 172.21.15.45:0/852256999 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fedf4004b70 con 0x7fedf80cd120 2023-07-09T02:22:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.068+0000 7fededffb640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feddc0662b0 0x7feddc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.068+0000 7fededffb640 1 -- 172.21.15.45:0/852256999 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fedf4083760 con 0x7fedf80cd120 2023-07-09T02:22:24.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.068+0000 7fededffb640 1 -- 172.21.15.45:0/852256999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7feddc06e4b0 con 0x7fedf80cd120 2023-07-09T02:22:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.068+0000 7fedfcc58640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feddc0662b0 0x7feddc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.068+0000 7fedfcc58640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feddc0662b0 0x7feddc068760 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fedf8161cb0 tx=0x7fede8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.072+0000 7fededffb640 1 -- 172.21.15.45:0/852256999 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedf4050b90 con 0x7fedf80cd120 2023-07-09T02:22:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.224+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedf80b7790 con 0x7fedf80cd120 2023-07-09T02:22:24.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.224+0000 7fededffb640 1 -- 172.21.15.45:0/852256999 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedf40541b0 con 0x7fedf80cd120 2023-07-09T02:22:24.227 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:22:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feddc0662b0 msgr2=0x7feddc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feddc0662b0 0x7feddc068760 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fedf8161cb0 tx=0x7fede8009040 comp rx=0 tx=0).stop 2023-07-09T02:22:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 msgr2=0x7fedf815e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf815e3b0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fedf400c430 tx=0x7fedf400c8f0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 shutdown_connections 2023-07-09T02:22:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7feddc0662b0 0x7feddc068760 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf815c060 0x7fedf81677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf80d2620 0x7fedf81418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 --2- 172.21.15.45:0/852256999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fedf80cd120 0x7fedf815e3b0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 >> 172.21.15.45:0/852256999 conn(0x7fedf80698e0 msgr2=0x7fedf80cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 shutdown_connections 2023-07-09T02:22:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.228+0000 7fedff6bd640 1 -- 172.21.15.45:0/852256999 wait complete. 2023-07-09T02:22:24.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:22:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.392+0000 7f978dacb640 1 Processor -- start 2023-07-09T02:22:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.392+0000 7f978dacb640 1 -- start start 2023-07-09T02:22:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f978dacb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f978815c060 0x7f97880b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f978dacb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97880d2620 0x7f97880cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f978dacb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9788160a50 con 0x7f97880cd120 2023-07-09T02:22:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f978dacb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978815c430 con 0x7f97880d2620 2023-07-09T02:22:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f978dacb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978815fb60 con 0x7f978815c060 2023-07-09T02:22:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f9787fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97880d2620 0x7f97880cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f9787fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97880d2620 0x7f97880cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55340/0 (socket says 172.21.15.45:55340) 2023-07-09T02:22:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f9787fff640 1 -- 172.21.15.45:0/3141089690 learned_addr learned my addr 172.21.15.45:0/3141089690 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f97877fe640 1 --2- 172.21.15.45:0/3141089690 >> v2:172.21.15.155:3300/0 conn(0x7f978815c060 0x7f97880b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f9787fff640 1 -- 172.21.15.45:0/3141089690 >> v2:172.21.15.155:3300/0 conn(0x7f978815c060 msgr2=0x7f97880b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f9787fff640 1 --2- 172.21.15.45:0/3141089690 >> v2:172.21.15.155:3300/0 conn(0x7f978815c060 0x7f97880b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f9787fff640 1 -- 172.21.15.45:0/3141089690 >> v1:172.21.15.155:6789/0 conn(0x7f97880cd120 legacy=0x7f97880d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.396+0000 7f9787fff640 1 -- 172.21.15.45:0/3141089690 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978815fe40 con 0x7f97880d2620 2023-07-09T02:22:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f9787fff640 1 --2- 172.21.15.45:0/3141089690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880d2620 0x7f97880cee30 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f97880d3ad0 tx=0x7f978001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7207b36ae70ca37 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f97867fc640 1 -- 172.21.15.45:0/3141089690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97800a5860 con 0x7f97880d2620 2023-07-09T02:22:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f97867fc640 1 -- 172.21.15.45:0/3141089690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97800a59c0 con 0x7f97880d2620 2023-07-09T02:22:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f97867fc640 1 -- 172.21.15.45:0/3141089690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97800a5d50 con 0x7f97880d2620 2023-07-09T02:22:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 -- 172.21.15.45:0/3141089690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880d2620 msgr2=0x7f97880cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 --2- 172.21.15.45:0/3141089690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880d2620 0x7f97880cee30 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f97880d3ad0 tx=0x7f978001c9a0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 -- 172.21.15.45:0/3141089690 shutdown_connections 2023-07-09T02:22:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 --2- 172.21.15.45:0/3141089690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880d2620 0x7f97880cee30 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 --2- 172.21.15.45:0/3141089690 >> v2:172.21.15.155:3300/0 conn(0x7f978815c060 0x7f97880b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 -- 172.21.15.45:0/3141089690 >> 172.21.15.45:0/3141089690 conn(0x7f97880698e0 msgr2=0x7f9788069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 -- 172.21.15.45:0/3141089690 shutdown_connections 2023-07-09T02:22:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 -- 172.21.15.45:0/3141089690 wait complete. 2023-07-09T02:22:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 Processor -- start 2023-07-09T02:22:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.400+0000 7f978dacb640 1 -- start start 2023-07-09T02:22:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880cd120 0x7f97880c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97880d2620 0x7f97881590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f978815c060 0x7f978815d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978815ab80 con 0x7f97880cd120 2023-07-09T02:22:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788159ae0 con 0x7f978815c060 2023-07-09T02:22:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9788159dc0 con 0x7f97880d2620 2023-07-09T02:22:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880cd120 0x7f97880c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880cd120 0x7f97880c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55350/0 (socket says 172.21.15.45:55350) 2023-07-09T02:22:24.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 -- 172.21.15.45:0/1599309235 learned_addr learned my addr 172.21.15.45:0/1599309235 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:24.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f9786ffd640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97880d2620 0x7f97881590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f9787fff640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f978815c060 0x7f978815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 -- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97880d2620 msgr2=0x7f97881590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97880d2620 0x7f97881590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 -- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f978815c060 msgr2=0x7f978815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f978815c060 0x7f978815d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 -- 172.21.15.45:0/1599309235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780009b30 con 0x7f97880cd120 2023-07-09T02:22:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f97877fe640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880cd120 0x7f97880c86f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f977800e870 tx=0x7f977800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f976ffff640 1 -- 172.21.15.45:0/1599309235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778009510 con 0x7f97880cd120 2023-07-09T02:22:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f976ffff640 1 -- 172.21.15.45:0/1599309235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977800eec0 con 0x7f97880cd120 2023-07-09T02:22:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f976ffff640 1 -- 172.21.15.45:0/1599309235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800cb40 con 0x7f97880cd120 2023-07-09T02:22:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97880b59f0 con 0x7f97880cd120 2023-07-09T02:22:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978815a380 con 0x7f97880cd120 2023-07-09T02:22:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978804d7d0 con 0x7f97880cd120 2023-07-09T02:22:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.404+0000 7f976ffff640 1 -- 172.21.15.45:0/1599309235 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f977800cca0 con 0x7f97880cd120 2023-07-09T02:22:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.408+0000 7f976ffff640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9774066280 0x7f9774068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.408+0000 7f976ffff640 1 -- 172.21.15.45:0/1599309235 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9778083d90 con 0x7f97880cd120 2023-07-09T02:22:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.408+0000 7f976ffff640 1 -- 172.21.15.45:0/1599309235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f977406e480 con 0x7f97880cd120 2023-07-09T02:22:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.408+0000 7f9786ffd640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9774066280 0x7f9774068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.408+0000 7f9786ffd640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9774066280 0x7f9774068730 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f97880b4e60 tx=0x7f977c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.412+0000 7f976ffff640 1 -- 172.21.15.45:0/1599309235 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9778017060 con 0x7f97880cd120 2023-07-09T02:22:24.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.564+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f978806baa0 con 0x7f97880cd120 2023-07-09T02:22:24.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.564+0000 7f976ffff640 1 -- 172.21.15.45:0/1599309235 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9778021070 con 0x7f97880cd120 2023-07-09T02:22:24.567 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:22:24.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9774066280 msgr2=0x7f9774068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9774066280 0x7f9774068730 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f97880b4e60 tx=0x7f977c009040 comp rx=0 tx=0).stop 2023-07-09T02:22:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880cd120 msgr2=0x7f97880c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880cd120 0x7f97880c86f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f977800e870 tx=0x7f977800ec70 comp rx=0 tx=0).stop 2023-07-09T02:22:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 shutdown_connections 2023-07-09T02:22:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f978815c060 0x7f978815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9774066280 0x7f9774068730 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97880d2620 0x7f97881590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 --2- 172.21.15.45:0/1599309235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97880cd120 0x7f97880c86f0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 >> 172.21.15.45:0/1599309235 conn(0x7f97880698e0 msgr2=0x7f978815b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 shutdown_connections 2023-07-09T02:22:24.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.568+0000 7f978dacb640 1 -- 172.21.15.45:0/1599309235 wait complete. 2023-07-09T02:22:24.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:22:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.732+0000 7f6cd4b70640 1 Processor -- start 2023-07-09T02:22:24.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.732+0000 7f6cd4b70640 1 -- start start 2023-07-09T02:22:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6cd4b70640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd0069f80 0x7f6cd00b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6cd4b70640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6cd00d2400 0x7f6cd00b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6cd4b70640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd00ceff0 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6cd4b70640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd00cea70 con 0x7f6cd00d2400 2023-07-09T02:22:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6cd4b70640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00b1f90 con 0x7f6cd0069f80 2023-07-09T02:22:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6ccffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6cd00d2400 0x7f6cd00b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6ccf7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6cd00b1bc0 0x7f6cd0069870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41388/0 (socket says 172.21.15.45:41388) 2023-07-09T02:22:24.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6ccf7fe640 1 -- 172.21.15.45:0/1458793983 learned_addr learned my addr 172.21.15.45:0/1458793983 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:24.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6cc7fff640 1 --2- 172.21.15.45:0/1458793983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd0069f80 0x7f6cd00b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6ccffff640 1 -- 172.21.15.45:0/1458793983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd0069f80 msgr2=0x7f6cd00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:24.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6ccffff640 1 --2- 172.21.15.45:0/1458793983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd0069f80 0x7f6cd00b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6ccffff640 1 -- 172.21.15.45:0/1458793983 >> v1:172.21.15.45:6789/0 conn(0x7f6cd00b1bc0 legacy=0x7f6cd0069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6ccffff640 1 -- 172.21.15.45:0/1458793983 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd00d1500 con 0x7f6cd00d2400 2023-07-09T02:22:24.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.736+0000 7f6cceffd640 1 -- 172.21.15.45:0/1458793983 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581635661 0 0) 0x7f6cd00ceff0 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6ccffff640 1 --2- 172.21.15.45:0/1458793983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00d2400 0x7f6cd00b5de0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009d90 tx=0x7f6cc801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194ee87e31c84bae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cceffd640 1 -- 172.21.15.45:0/1458793983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80a59e0 con 0x7f6cd00d2400 2023-07-09T02:22:24.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cceffd640 1 -- 172.21.15.45:0/1458793983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc80a5b40 con 0x7f6cd00d2400 2023-07-09T02:22:24.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cceffd640 1 -- 172.21.15.45:0/1458793983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80ad440 con 0x7f6cd00d2400 2023-07-09T02:22:24.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1458793983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00d2400 msgr2=0x7f6cd00b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1458793983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00d2400 0x7f6cd00b5de0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009d90 tx=0x7f6cc801c920 comp rx=0 tx=0).stop 2023-07-09T02:22:24.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1458793983 shutdown_connections 2023-07-09T02:22:24.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1458793983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00d2400 0x7f6cd00b5de0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1458793983 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd0069f80 0x7f6cd00b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1458793983 >> 172.21.15.45:0/1458793983 conn(0x7f6cd00d35b0 msgr2=0x7f6cd00cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:24.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1458793983 shutdown_connections 2023-07-09T02:22:24.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1458793983 wait complete. 2023-07-09T02:22:24.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 Processor -- start 2023-07-09T02:22:24.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- start start 2023-07-09T02:22:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cd0069f80 0x7f6cd00c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00b1bc0 0x7f6cd00b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd00d2400 0x7f6cd00b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00ca650 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd015c840 con 0x7f6cd0069f80 2023-07-09T02:22:24.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.740+0000 7f6cd4b70640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd015cb20 con 0x7f6cd00d2400 2023-07-09T02:22:24.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00b1bc0 0x7f6cd00b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00b1bc0 0x7f6cd00b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55374/0 (socket says 172.21.15.45:55374) 2023-07-09T02:22:24.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6ccf7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cd0069f80 0x7f6cd00c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 -- 172.21.15.45:0/1590089086 learned_addr learned my addr 172.21.15.45:0/1590089086 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:24.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6ccffff640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd00d2400 0x7f6cd00b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 -- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd00d2400 msgr2=0x7f6cd00b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd00d2400 0x7f6cd00b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 -- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cd0069f80 msgr2=0x7f6cd00c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cd0069f80 0x7f6cd00c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 -- 172.21.15.45:0/1590089086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8009a70 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6ccf7fe640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cd0069f80 0x7f6cd00c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:22:24.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cc7fff640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00b1bc0 0x7f6cd00b2af0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800d7d0 tx=0x7f6cb800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cccff9640 1 -- 172.21.15.45:0/1590089086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800b6c0 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cccff9640 1 -- 172.21.15.45:0/1590089086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb800b820 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cccff9640 1 -- 172.21.15.45:0/1590089086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800bbd0 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd015ce00 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd00c8ae0 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd004e020 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.744+0000 7f6cccff9640 1 -- 172.21.15.45:0/1590089086 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6cb800bd30 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.748+0000 7f6cccff9640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6cb0066280 0x7f6cb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:24.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.748+0000 7f6cccff9640 1 -- 172.21.15.45:0/1590089086 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6cb8084210 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.748+0000 7f6ccf7fe640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6cb0066280 0x7f6cb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:24.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.748+0000 7f6cccff9640 1 -- 172.21.15.45:0/1590089086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f6cb006e480 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.748+0000 7f6ccf7fe640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6cb0066280 0x7f6cb0068730 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0007fd0 tx=0x7f6cc0007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:24.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.752+0000 7f6cccff9640 1 -- 172.21.15.45:0/1590089086 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6cb8051660 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6cd00b7a60 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cccff9640 1 -- 172.21.15.45:0/1590089086 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v170) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6cb8054c80 con 0x7f6cd00b1bc0 2023-07-09T02:22:24.908 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:22:24.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6cb0066280 msgr2=0x7f6cb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6cb0066280 0x7f6cb0068730 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0007fd0 tx=0x7f6cc0007d60 comp rx=0 tx=0).stop 2023-07-09T02:22:24.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00b1bc0 msgr2=0x7f6cd00b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00b1bc0 0x7f6cd00b2af0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800d7d0 tx=0x7f6cb800dc90 comp rx=0 tx=0).stop 2023-07-09T02:22:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 shutdown_connections 2023-07-09T02:22:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6cb0066280 0x7f6cb0068730 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6cd00d2400 0x7f6cd00b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cd00b1bc0 0x7f6cd00b2af0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 --2- 172.21.15.45:0/1590089086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cd0069f80 0x7f6cd00c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 >> 172.21.15.45:0/1590089086 conn(0x7f6cd00d35b0 msgr2=0x7f6cd00b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 shutdown_connections 2023-07-09T02:22:24.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:24.908+0000 7f6cd4b70640 1 -- 172.21.15.45:0/1590089086 wait complete. 2023-07-09T02:22:24.929 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:22:25.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70bcc6d640 1 Processor -- start 2023-07-09T02:22:25.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70bcc6d640 1 -- start start 2023-07-09T02:22:25.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70bcc6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f70b815c060 0x7f70b80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70bcc6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70bcc6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70b80d2450 0x7f70b80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70bcc6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80d28f0 con 0x7f70b80d2450 2023-07-09T02:22:25.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70bcc6d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b8160a50 con 0x7f70b815c060 2023-07-09T02:22:25.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70bcc6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b815c430 con 0x7f70b80cd120 2023-07-09T02:22:25.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70b80d2450 0x7f70b80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b6d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70b80d2450 0x7f70b80d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55382/0 (socket says 172.21.15.45:55382) 2023-07-09T02:22:25.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b6d9d640 1 -- 172.21.15.45:0/2243006162 learned_addr learned my addr 172.21.15.45:0/2243006162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:25.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b659c640 1 --2- 172.21.15.45:0/2243006162 >> v2:172.21.15.155:3300/0 conn(0x7f70b815c060 0x7f70b80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70affff640 1 --2- 172.21.15.45:0/2243006162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b6d9d640 1 -- 172.21.15.45:0/2243006162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 msgr2=0x7f70b80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:25.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b6d9d640 1 --2- 172.21.15.45:0/2243006162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b6d9d640 1 -- 172.21.15.45:0/2243006162 >> v2:172.21.15.155:3300/0 conn(0x7f70b815c060 msgr2=0x7f70b80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:25.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b6d9d640 1 --2- 172.21.15.45:0/2243006162 >> v2:172.21.15.155:3300/0 conn(0x7f70b815c060 0x7f70b80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.076+0000 7f70b6d9d640 1 -- 172.21.15.45:0/2243006162 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b815fb60 con 0x7f70b80d2450 2023-07-09T02:22:25.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70b6d9d640 1 --2- 172.21.15.45:0/2243006162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b80d0610 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f70b80d3ad0 tx=0x7f70b001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da89a1bb198f235b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70b5d9b640 1 -- 172.21.15.45:0/2243006162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00a5560 con 0x7f70b80d2450 2023-07-09T02:22:25.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70b5d9b640 1 -- 172.21.15.45:0/2243006162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b00a56c0 con 0x7f70b80d2450 2023-07-09T02:22:25.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70b5d9b640 1 -- 172.21.15.45:0/2243006162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00a5a50 con 0x7f70b80d2450 2023-07-09T02:22:25.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 -- 172.21.15.45:0/2243006162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 msgr2=0x7f70b80d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/2243006162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b80d0610 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f70b80d3ad0 tx=0x7f70b001c6e0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 -- 172.21.15.45:0/2243006162 shutdown_connections 2023-07-09T02:22:25.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/2243006162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b80d0610 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/2243006162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/2243006162 >> v2:172.21.15.155:3300/0 conn(0x7f70b815c060 0x7f70b80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 -- 172.21.15.45:0/2243006162 >> 172.21.15.45:0/2243006162 conn(0x7f70b80698e0 msgr2=0x7f70b8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:25.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 -- 172.21.15.45:0/2243006162 shutdown_connections 2023-07-09T02:22:25.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 -- 172.21.15.45:0/2243006162 wait complete. 2023-07-09T02:22:25.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.080+0000 7f70bcc6d640 1 Processor -- start 2023-07-09T02:22:25.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 -- start start 2023-07-09T02:22:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b8153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b8152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70b815c060 0x7f70b8156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81527f0 con 0x7f70b80d2450 2023-07-09T02:22:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8153650 con 0x7f70b815c060 2023-07-09T02:22:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8154020 con 0x7f70b80cd120 2023-07-09T02:22:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b8152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b8152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55396/0 (socket says 172.21.15.45:55396) 2023-07-09T02:22:25.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 -- 172.21.15.45:0/359492360 learned_addr learned my addr 172.21.15.45:0/359492360 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70b6d9d640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70b815c060 0x7f70b8156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70b659c640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b8153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 -- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 msgr2=0x7f70b8153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b8153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 -- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70b815c060 msgr2=0x7f70b8156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70b815c060 0x7f70b8156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 -- 172.21.15.45:0/359492360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0009b30 con 0x7f70b80d2450 2023-07-09T02:22:25.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70b659c640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b8153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70affff640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b8152050 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f70a000e8b0 tx=0x7f70a000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70aeffd640 1 -- 172.21.15.45:0/359492360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000c940 con 0x7f70b80d2450 2023-07-09T02:22:25.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70aeffd640 1 -- 172.21.15.45:0/359492360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a000caa0 con 0x7f70b80d2450 2023-07-09T02:22:25.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70aeffd640 1 -- 172.21.15.45:0/359492360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000ce30 con 0x7f70b80d2450 2023-07-09T02:22:25.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b815b400 con 0x7f70b80d2450 2023-07-09T02:22:25.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b8152d20 con 0x7f70b80d2450 2023-07-09T02:22:25.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.084+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b804d7d0 con 0x7f70b80d2450 2023-07-09T02:22:25.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.088+0000 7f70aeffd640 1 -- 172.21.15.45:0/359492360 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70a0013470 con 0x7f70b80d2450 2023-07-09T02:22:25.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.088+0000 7f70aeffd640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7098066280 0x7f7098068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.088+0000 7f70aeffd640 1 -- 172.21.15.45:0/359492360 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f70a0083f60 con 0x7f70b80d2450 2023-07-09T02:22:25.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.088+0000 7f70aeffd640 1 -- 172.21.15.45:0/359492360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f709806e480 con 0x7f70b80d2450 2023-07-09T02:22:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.088+0000 7f70b659c640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7098066280 0x7f7098068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.088+0000 7f70b659c640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7098066280 0x7f7098068730 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f70b81547a0 tx=0x7f70a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.092+0000 7f70aeffd640 1 -- 172.21.15.45:0/359492360 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70a00513b0 con 0x7f70b80d2450 2023-07-09T02:22:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70b806baa0 con 0x7f70b80d2450 2023-07-09T02:22:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70aeffd640 1 -- 172.21.15.45:0/359492360 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v170) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70a0021020 con 0x7f70b80d2450 2023-07-09T02:22:25.245 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:22:25.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7098066280 msgr2=0x7f7098068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7098066280 0x7f7098068730 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f70b81547a0 tx=0x7f70a8008040 comp rx=0 tx=0).stop 2023-07-09T02:22:25.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 msgr2=0x7f70b8152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b8152050 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f70a000e8b0 tx=0x7f70a000ed70 comp rx=0 tx=0).stop 2023-07-09T02:22:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 shutdown_connections 2023-07-09T02:22:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70b815c060 0x7f70b8156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80d2450 0x7f70b8152050 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7098066280 0x7f7098068730 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 --2- 172.21.15.45:0/359492360 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70b80cd120 0x7f70b8153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 >> 172.21.15.45:0/359492360 conn(0x7f70b80698e0 msgr2=0x7f70b80b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 shutdown_connections 2023-07-09T02:22:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.244+0000 7f70bcc6d640 1 -- 172.21.15.45:0/359492360 wait complete. 2023-07-09T02:22:25.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f224af40640 1 Processor -- start 2023-07-09T02:22:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f224af40640 1 -- start start 2023-07-09T02:22:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f224af40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f224415e210 0x7f22440c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f224af40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224406bf30 con 0x7f22440ca0f0 2023-07-09T02:22:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f224af40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224406bc50 con 0x7f22440c8d10 2023-07-09T02:22:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f224af40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440cab90 con 0x7f224415e210 2023-07-09T02:22:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f2248cdc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f22440ca0f0 0x7f22440cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41404/0 (socket says 172.21.15.45:41404) 2023-07-09T02:22:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f2248cdc640 1 -- 172.21.15.45:0/2682245871 learned_addr learned my addr 172.21.15.45:0/2682245871 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f22494dd640 1 --2- 172.21.15.45:0/2682245871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f224415e210 0x7f22440c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f22437fe640 1 -- 172.21.15.45:0/2682245871 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130808437 0 0) 0x7f224406bf30 con 0x7f22440ca0f0 2023-07-09T02:22:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f22437fe640 1 -- 172.21.15.45:0/2682245871 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2234003530 con 0x7f22440ca0f0 2023-07-09T02:22:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f22437fe640 1 -- 172.21.15.45:0/2682245871 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296494485 0 0) 0x7f224406bc50 con 0x7f22440c8d10 2023-07-09T02:22:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.408+0000 7f22437fe640 1 -- 172.21.15.45:0/2682245871 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f224406bf30 con 0x7f22440c8d10 2023-07-09T02:22:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.412+0000 7f22494dd640 1 -- 172.21.15.45:0/2682245871 >> v1:172.21.15.155:6789/0 conn(0x7f22440c8d10 legacy=0x7f224415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.412+0000 7f22494dd640 1 -- 172.21.15.45:0/2682245871 >> v1:172.21.15.45:6789/0 conn(0x7f22440ca0f0 legacy=0x7f22440cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.412+0000 7f22437fe640 1 -- 172.21.15.45:0/2682245871 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3793289332 0 0) 0x7f2234003530 con 0x7f22440ca0f0 2023-07-09T02:22:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.412+0000 7f22494dd640 1 -- 172.21.15.45:0/2682245871 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440cae70 con 0x7f224415e210 2023-07-09T02:22:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.412+0000 7f22494dd640 1 --2- 172.21.15.45:0/2682245871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f224415e210 0x7f22440c9160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f223c009dc0 tx=0x7f223c01c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19074e9d7957ad5a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.412+0000 7f22437fe640 1 -- 172.21.15.45:0/2682245871 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238001680 con 0x7f224415e210 2023-07-09T02:22:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.412+0000 7f22437fe640 1 -- 172.21.15.45:0/2682245871 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c0a5660 con 0x7f224415e210 2023-07-09T02:22:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.412+0000 7f22437fe640 1 -- 172.21.15.45:0/2682245871 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0a59d0 con 0x7f224415e210 2023-07-09T02:22:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- 172.21.15.45:0/2682245871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f224415e210 msgr2=0x7f22440c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 --2- 172.21.15.45:0/2682245871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f224415e210 0x7f22440c9160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f223c009dc0 tx=0x7f223c01c800 comp rx=0 tx=0).stop 2023-07-09T02:22:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- 172.21.15.45:0/2682245871 shutdown_connections 2023-07-09T02:22:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 --2- 172.21.15.45:0/2682245871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f224415e210 0x7f22440c9160 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- 172.21.15.45:0/2682245871 >> 172.21.15.45:0/2682245871 conn(0x7f22440694b0 msgr2=0x7f22440698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- 172.21.15.45:0/2682245871 shutdown_connections 2023-07-09T02:22:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- 172.21.15.45:0/2682245871 wait complete. 2023-07-09T02:22:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 Processor -- start 2023-07-09T02:22:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- start start 2023-07-09T02:22:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22440c8d10 0x7f22440b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22440ca0f0 0x7f22440c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415e210 0x7f22440b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224414f530 con 0x7f224415e210 2023-07-09T02:22:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b1bb0 con 0x7f22440ca0f0 2023-07-09T02:22:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f224af40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b1e90 con 0x7f22440c8d10 2023-07-09T02:22:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f22494dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415e210 0x7f22440b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f22494dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415e210 0x7f22440b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55410/0 (socket says 172.21.15.45:55410) 2023-07-09T02:22:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f22494dd640 1 -- 172.21.15.45:0/540293981 learned_addr learned my addr 172.21.15.45:0/540293981 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f2248cdc640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22440c8d10 0x7f22440b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.416+0000 7f2243fff640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22440ca0f0 0x7f22440c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22494dd640 1 -- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22440c8d10 msgr2=0x7f22440b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22494dd640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22440c8d10 0x7f22440b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22494dd640 1 -- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22440ca0f0 msgr2=0x7f22440c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22494dd640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22440ca0f0 0x7f22440c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22494dd640 1 -- 172.21.15.45:0/540293981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009a70 con 0x7f224415e210 2023-07-09T02:22:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f2248cdc640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22440c8d10 0x7f22440b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:22:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22494dd640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415e210 0x7f22440b2c50 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f223c01aeb0 tx=0x7f223c0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22417fa640 1 -- 172.21.15.45:0/540293981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c009450 con 0x7f224415e210 2023-07-09T02:22:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22417fa640 1 -- 172.21.15.45:0/540293981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c0a59e0 con 0x7f224415e210 2023-07-09T02:22:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22417fa640 1 -- 172.21.15.45:0/540293981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0a5d50 con 0x7f224415e210 2023-07-09T02:22:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22440b2170 con 0x7f224415e210 2023-07-09T02:22:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22440b2730 con 0x7f224415e210 2023-07-09T02:22:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22440b2920 con 0x7f224415e210 2023-07-09T02:22:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22417fa640 1 -- 172.21.15.45:0/540293981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f223c004040 con 0x7f224415e210 2023-07-09T02:22:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22417fa640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2228066280 0x7f2228068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22417fa640 1 -- 172.21.15.45:0/540293981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f223c11e760 con 0x7f224415e210 2023-07-09T02:22:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.420+0000 7f22417fa640 1 -- 172.21.15.45:0/540293981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f222806e480 con 0x7f224415e210 2023-07-09T02:22:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.424+0000 7f2248cdc640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2228066280 0x7f2228068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.424+0000 7f2248cdc640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2228066280 0x7f2228068730 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2238000fc0 tx=0x7f2238001a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.424+0000 7f22417fa640 1 -- 172.21.15.45:0/540293981 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f223c0ebbb0 con 0x7f224415e210 2023-07-09T02:22:25.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.612+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f224404d7d0 con 0x7f224415e210 2023-07-09T02:22:25.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.612+0000 7f22417fa640 1 -- 172.21.15.45:0/540293981 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f223c0b2090 con 0x7f224415e210 2023-07-09T02:22:25.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:25.614 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2937988619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2937988619},{"type":"v1","addr":"172.21.15.45:6835","nonce":2937988619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/202593650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":202593650},{"type":"v1","addr":"172.21.15.45:6833","nonce":202593650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1590703663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1590703663},{"type":"v1","addr":"172.21.15.155:6837","nonce":1590703663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:21:03.398485+0000","modified":"2023-07-09T02:21:07.041368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8206":{"gid":8206,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/390558772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":390558772},{"type":"v1","addr":"172.21.15.155:6836","nonce":390558772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T02:22:25.615 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 83 2023-07-09T02:22:25.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2228066280 msgr2=0x7f2228068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2228066280 0x7f2228068730 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2238000fc0 tx=0x7f2238001a40 comp rx=0 tx=0).stop 2023-07-09T02:22:25.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415e210 msgr2=0x7f22440b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415e210 0x7f22440b2c50 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f223c01aeb0 tx=0x7f223c0195a0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 shutdown_connections 2023-07-09T02:22:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415e210 0x7f22440b2c50 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22440ca0f0 0x7f22440c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2228066280 0x7f2228068730 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 --2- 172.21.15.45:0/540293981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22440c8d10 0x7f22440b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 >> 172.21.15.45:0/540293981 conn(0x7f22440694b0 msgr2=0x7f2244158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 shutdown_connections 2023-07-09T02:22:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.616+0000 7f224af40640 1 -- 172.21.15.45:0/540293981 wait complete. 2023-07-09T02:22:25.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:25.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.776+0000 7fd4c9fe9640 1 Processor -- start 2023-07-09T02:22:25.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c9fe9640 1 -- start start 2023-07-09T02:22:25.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c9fe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 0x7fd4c406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c9fe9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4c40caec0 0x7fd4c40cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c9fe9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c406caa0 con 0x7fd4c4158e30 2023-07-09T02:22:25.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c9fe9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c40ccf80 con 0x7fd4c40caec0 2023-07-09T02:22:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c9fe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40cd540 con 0x7fd4c406c110 2023-07-09T02:22:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4c40caec0 0x7fd4c40cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4c40caec0 0x7fd4c40cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55416/0 (socket says 172.21.15.45:55416) 2023-07-09T02:22:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c3fff640 1 -- 172.21.15.45:0/4061289249 learned_addr learned my addr 172.21.15.45:0/4061289249 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c2ffd640 1 --2- 172.21.15.45:0/4061289249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 0x7fd4c406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c3fff640 1 -- 172.21.15.45:0/4061289249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 msgr2=0x7fd4c406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c3fff640 1 --2- 172.21.15.45:0/4061289249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 0x7fd4c406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c3fff640 1 -- 172.21.15.45:0/4061289249 >> v1:172.21.15.155:6789/0 conn(0x7fd4c4158e30 legacy=0x7fd4c406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.780+0000 7fd4c3fff640 1 -- 172.21.15.45:0/4061289249 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40cb880 con 0x7fd4c40caec0 2023-07-09T02:22:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c3fff640 1 --2- 172.21.15.45:0/4061289249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c40caec0 0x7fd4c40cb340 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009e50 tx=0x7fd4bc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b273b944d0d718 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c27fc640 1 -- 172.21.15.45:0/4061289249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0a5810 con 0x7fd4c40caec0 2023-07-09T02:22:25.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c27fc640 1 -- 172.21.15.45:0/4061289249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0a5970 con 0x7fd4c40caec0 2023-07-09T02:22:25.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c27fc640 1 -- 172.21.15.45:0/4061289249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0a5d00 con 0x7fd4c40caec0 2023-07-09T02:22:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/4061289249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c40caec0 msgr2=0x7fd4c40cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/4061289249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c40caec0 0x7fd4c40cb340 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009e50 tx=0x7fd4bc01c950 comp rx=0 tx=0).stop 2023-07-09T02:22:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/4061289249 shutdown_connections 2023-07-09T02:22:25.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/4061289249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c40caec0 0x7fd4c40cb340 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/4061289249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 0x7fd4c406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/4061289249 >> 172.21.15.45:0/4061289249 conn(0x7fd4c40694b0 msgr2=0x7fd4c40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:25.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/4061289249 shutdown_connections 2023-07-09T02:22:25.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/4061289249 wait complete. 2023-07-09T02:22:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 Processor -- start 2023-07-09T02:22:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.784+0000 7fd4c9fe9640 1 -- start start 2023-07-09T02:22:25.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 0x7fd4c41497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4c40caec0 0x7fd4c4149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c4158e30 0x7fd4c41fbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c414a270 con 0x7fd4c4158e30 2023-07-09T02:22:25.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c414a750 con 0x7fd4c40caec0 2023-07-09T02:22:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c415a380 con 0x7fd4c406c110 2023-07-09T02:22:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c4158e30 0x7fd4c41fbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c4158e30 0x7fd4c41fbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55424/0 (socket says 172.21.15.45:55424) 2023-07-09T02:22:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 -- 172.21.15.45:0/967668302 learned_addr learned my addr 172.21.15.45:0/967668302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c37fe640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 0x7fd4c41497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c2ffd640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4c40caec0 0x7fd4c4149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 -- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 msgr2=0x7fd4c41497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 0x7fd4c41497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 -- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4c40caec0 msgr2=0x7fd4c4149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4c40caec0 0x7fd4c4149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 -- 172.21.15.45:0/967668302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc009b30 con 0x7fd4c4158e30 2023-07-09T02:22:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c3fff640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c4158e30 0x7fd4c41fbbd0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0af040 tx=0x7fd4bc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4abfff640 1 -- 172.21.15.45:0/967668302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0b8670 con 0x7fd4c4158e30 2023-07-09T02:22:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4abfff640 1 -- 172.21.15.45:0/967668302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0b87f0 con 0x7fd4c4158e30 2023-07-09T02:22:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c415a660 con 0x7fd4c4158e30 2023-07-09T02:22:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4abfff640 1 -- 172.21.15.45:0/967668302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0b8ba0 con 0x7fd4c4158e30 2023-07-09T02:22:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c415ac20 con 0x7fd4c4158e30 2023-07-09T02:22:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.788+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c415b140 con 0x7fd4c4158e30 2023-07-09T02:22:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.792+0000 7fd4abfff640 1 -- 172.21.15.45:0/967668302 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4bc0b8d00 con 0x7fd4c4158e30 2023-07-09T02:22:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.792+0000 7fd4abfff640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4b0066280 0x7fd4b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:25.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.792+0000 7fd4abfff640 1 -- 172.21.15.45:0/967668302 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd4bc11f670 con 0x7fd4c4158e30 2023-07-09T02:22:25.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.792+0000 7fd4abfff640 1 -- 172.21.15.45:0/967668302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7fd4b006e480 con 0x7fd4c4158e30 2023-07-09T02:22:25.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.792+0000 7fd4c37fe640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4b0066280 0x7fd4b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:25.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.792+0000 7fd4c37fe640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4b0066280 0x7fd4b0068730 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40c8740 tx=0x7fd4b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:25.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.796+0000 7fd4abfff640 1 -- 172.21.15.45:0/967668302 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4c415b140 con 0x7fd4c4158e30 2023-07-09T02:22:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.948+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4c415b140 con 0x7fd4c4158e30 2023-07-09T02:22:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4abfff640 1 -- 172.21.15.45:0/967668302 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+18486 (secure 0 0 0) 0x7fd4c415b140 con 0x7fd4c4158e30 2023-07-09T02:22:25.951 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:25.952 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":170,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:07.572065+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:21:01.154000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T02:21:02.407446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.12","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4b0066280 msgr2=0x7fd4b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4b0066280 0x7fd4b0068730 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40c8740 tx=0x7fd4b4009040 comp rx=0 tx=0).stop 2023-07-09T02:22:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c4158e30 msgr2=0x7fd4c41fbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c4158e30 0x7fd4c41fbbd0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0af040 tx=0x7fd4bc0196f0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 shutdown_connections 2023-07-09T02:22:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c4158e30 0x7fd4c41fbbd0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4c40caec0 0x7fd4c4149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd4b0066280 0x7fd4b0068730 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 --2- 172.21.15.45:0/967668302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4c406c110 0x7fd4c41497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 >> 172.21.15.45:0/967668302 conn(0x7fd4c40694b0 msgr2=0x7fd4c4070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 shutdown_connections 2023-07-09T02:22:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:25.952+0000 7fd4c9fe9640 1 -- 172.21.15.45:0/967668302 wait complete. 2023-07-09T02:22:25.973 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:22:25.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:26.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54bad1e640 1 Processor -- start 2023-07-09T02:22:26.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54bad1e640 1 -- start start 2023-07-09T02:22:26.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54bad1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54b415c060 0x7f54b40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54bad1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40d2620 0x7f54b40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54bad1e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b4160a50 con 0x7f54b40cd120 2023-07-09T02:22:26.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54bad1e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b415c430 con 0x7f54b415c060 2023-07-09T02:22:26.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54bad1e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b415fb60 con 0x7f54b40d2620 2023-07-09T02:22:26.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54b8aba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54b415c060 0x7f54b40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54b8aba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54b415c060 0x7f54b40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55430/0 (socket says 172.21.15.45:55430) 2023-07-09T02:22:26.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54b8aba640 1 -- 172.21.15.45:0/2794552322 learned_addr learned my addr 172.21.15.45:0/2794552322 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:26.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54b92bb640 1 --2- 172.21.15.45:0/2794552322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40d2620 0x7f54b40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54b8aba640 1 -- 172.21.15.45:0/2794552322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40d2620 msgr2=0x7f54b40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:26.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54b8aba640 1 --2- 172.21.15.45:0/2794552322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40d2620 0x7f54b40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54b8aba640 1 -- 172.21.15.45:0/2794552322 >> v1:172.21.15.155:6789/0 conn(0x7f54b40cd120 legacy=0x7f54b40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.116+0000 7f54b8aba640 1 -- 172.21.15.45:0/2794552322 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b415fe40 con 0x7f54b415c060 2023-07-09T02:22:26.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.120+0000 7f54b8aba640 1 --2- 172.21.15.45:0/2794552322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b415c060 0x7f54b40b4ed0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009870 tx=0x7f54a801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48cf73b334664a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.120+0000 7f54b37fe640 1 -- 172.21.15.45:0/2794552322 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a80aa670 con 0x7f54b415c060 2023-07-09T02:22:26.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.120+0000 7f54b37fe640 1 -- 172.21.15.45:0/2794552322 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a80aa7d0 con 0x7f54b415c060 2023-07-09T02:22:26.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.120+0000 7f54b37fe640 1 -- 172.21.15.45:0/2794552322 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a80aab60 con 0x7f54b415c060 2023-07-09T02:22:26.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.120+0000 7f54bad1e640 1 -- 172.21.15.45:0/2794552322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b415c060 msgr2=0x7f54b40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.120+0000 7f54bad1e640 1 --2- 172.21.15.45:0/2794552322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b415c060 0x7f54b40b4ed0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009870 tx=0x7f54a801c510 comp rx=0 tx=0).stop 2023-07-09T02:22:26.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 -- 172.21.15.45:0/2794552322 shutdown_connections 2023-07-09T02:22:26.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 --2- 172.21.15.45:0/2794552322 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40d2620 0x7f54b40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 --2- 172.21.15.45:0/2794552322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b415c060 0x7f54b40b4ed0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 -- 172.21.15.45:0/2794552322 >> 172.21.15.45:0/2794552322 conn(0x7f54b40698e0 msgr2=0x7f54b4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:26.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 -- 172.21.15.45:0/2794552322 shutdown_connections 2023-07-09T02:22:26.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 -- 172.21.15.45:0/2794552322 wait complete. 2023-07-09T02:22:26.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 Processor -- start 2023-07-09T02:22:26.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 -- start start 2023-07-09T02:22:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40cd120 0x7f54b4153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b40d2620 0x7f54b40ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54b415c060 0x7f54b40b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40c9930 con 0x7f54b40d2620 2023-07-09T02:22:26.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40c9650 con 0x7f54b415c060 2023-07-09T02:22:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54bad1e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b415c6a0 con 0x7f54b40cd120 2023-07-09T02:22:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b40d2620 0x7f54b40ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b40d2620 0x7f54b40ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55438/0 (socket says 172.21.15.45:55438) 2023-07-09T02:22:26.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b3fff640 1 -- 172.21.15.45:0/262113929 learned_addr learned my addr 172.21.15.45:0/262113929 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:26.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b8aba640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40cd120 0x7f54b4153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b92bb640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54b415c060 0x7f54b40b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b3fff640 1 -- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40cd120 msgr2=0x7f54b4153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b3fff640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40cd120 0x7f54b4153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b3fff640 1 -- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54b415c060 msgr2=0x7f54b40b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b3fff640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54b415c060 0x7f54b40b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b3fff640 1 -- 172.21.15.45:0/262113929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80094d0 con 0x7f54b40d2620 2023-07-09T02:22:26.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.124+0000 7f54b92bb640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54b415c060 0x7f54b40b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:26.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b3fff640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b40d2620 0x7f54b40ca970 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c4d0 tx=0x7f54a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b17fa640 1 -- 172.21.15.45:0/262113929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a00052d0 con 0x7f54b40d2620 2023-07-09T02:22:26.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b17fa640 1 -- 172.21.15.45:0/262113929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a0005430 con 0x7f54b40d2620 2023-07-09T02:22:26.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b17fa640 1 -- 172.21.15.45:0/262113929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0012830 con 0x7f54b40d2620 2023-07-09T02:22:26.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b40b59f0 con 0x7f54b40d2620 2023-07-09T02:22:26.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b415cc60 con 0x7f54b40d2620 2023-07-09T02:22:26.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b415ce80 con 0x7f54b40d2620 2023-07-09T02:22:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b17fa640 1 -- 172.21.15.45:0/262113929 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54a0012990 con 0x7f54b40d2620 2023-07-09T02:22:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b17fa640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5498066280 0x7f5498068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b17fa640 1 -- 172.21.15.45:0/262113929 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f54a00838f0 con 0x7f54b40d2620 2023-07-09T02:22:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b17fa640 1 -- 172.21.15.45:0/262113929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f549806e480 con 0x7f54b40d2620 2023-07-09T02:22:26.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.128+0000 7f54b8aba640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5498066280 0x7f5498068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.132+0000 7f54b8aba640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5498066280 0x7f5498068730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f54a80ae000 tx=0x7f54a80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.132+0000 7f54b17fa640 1 -- 172.21.15.45:0/262113929 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54a0050d20 con 0x7f54b40d2620 2023-07-09T02:22:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.316+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54b404d7d0 con 0x7f54b40d2620 2023-07-09T02:22:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54b17fa640 1 -- 172.21.15.45:0/262113929 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f54a0054340 con 0x7f54b40d2620 2023-07-09T02:22:26.320 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:26.320 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2937988619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2937988619},{"type":"v1","addr":"172.21.15.45:6835","nonce":2937988619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/202593650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":202593650},{"type":"v1","addr":"172.21.15.45:6833","nonce":202593650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1590703663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1590703663},{"type":"v1","addr":"172.21.15.155:6837","nonce":1590703663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:21:03.398485+0000","modified":"2023-07-09T02:21:07.041368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8206":{"gid":8206,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/390558772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":390558772},{"type":"v1","addr":"172.21.15.155:6836","nonce":390558772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T02:22:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 83 2023-07-09T02:22:26.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5498066280 msgr2=0x7f5498068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5498066280 0x7f5498068730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f54a80ae000 tx=0x7f54a80a7000 comp rx=0 tx=0).stop 2023-07-09T02:22:26.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b40d2620 msgr2=0x7f54b40ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b40d2620 0x7f54b40ca970 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c4d0 tx=0x7f54a000c990 comp rx=0 tx=0).stop 2023-07-09T02:22:26.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 shutdown_connections 2023-07-09T02:22:26.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54b415c060 0x7f54b40b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54b40d2620 0x7f54b40ca970 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5498066280 0x7f5498068730 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 --2- 172.21.15.45:0/262113929 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54b40cd120 0x7f54b4153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 >> 172.21.15.45:0/262113929 conn(0x7f54b40698e0 msgr2=0x7f54b415b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:26.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 shutdown_connections 2023-07-09T02:22:26.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.320+0000 7f54bad1e640 1 -- 172.21.15.45:0/262113929 wait complete. 2023-07-09T02:22:26.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:26.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.480+0000 7f009e69c640 1 Processor -- start 2023-07-09T02:22:26.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.480+0000 7f009e69c640 1 -- start start 2023-07-09T02:22:26.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f009e69c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0098158e30 0x7f009806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f009e69c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00980ccf80 con 0x7f009806fd10 2023-07-09T02:22:26.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f009e69c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00980cd540 con 0x7f009806c820 2023-07-09T02:22:26.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f009e69c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00980c8fb0 con 0x7f0098158e30 2023-07-09T02:22:26.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f0097fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0098158e30 0x7f009806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f0097fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0098158e30 0x7f009806f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55452/0 (socket says 172.21.15.45:55452) 2023-07-09T02:22:26.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f0097fff640 1 -- 172.21.15.45:0/229900675 learned_addr learned my addr 172.21.15.45:0/229900675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:26.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f0097fff640 1 -- 172.21.15.45:0/229900675 >> v1:172.21.15.155:6789/0 conn(0x7f009806c820 legacy=0x7f00980caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:26.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f0097fff640 1 -- 172.21.15.45:0/229900675 >> v1:172.21.15.45:6789/0 conn(0x7f009806fd10 legacy=0x7f009806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f0097fff640 1 -- 172.21.15.45:0/229900675 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980cbad0 con 0x7f0098158e30 2023-07-09T02:22:26.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.484+0000 7f0096ffd640 1 -- 172.21.15.45:0/229900675 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837207581 0 0) 0x7f00980ccf80 con 0x7f009806fd10 2023-07-09T02:22:26.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f0097fff640 1 --2- 172.21.15.45:0/229900675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f009806f7d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f008800bb10 tx=0x7f008801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c70cad170653a7a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f0096ffd640 1 -- 172.21.15.45:0/229900675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880a7be0 con 0x7f0098158e30 2023-07-09T02:22:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f0096ffd640 1 -- 172.21.15.45:0/229900675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00880a7d40 con 0x7f0098158e30 2023-07-09T02:22:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f0096ffd640 1 -- 172.21.15.45:0/229900675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880af660 con 0x7f0098158e30 2023-07-09T02:22:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 -- 172.21.15.45:0/229900675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 msgr2=0x7f009806f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 --2- 172.21.15.45:0/229900675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f009806f7d0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f008800bb10 tx=0x7f008801eb10 comp rx=0 tx=0).stop 2023-07-09T02:22:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 -- 172.21.15.45:0/229900675 shutdown_connections 2023-07-09T02:22:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 --2- 172.21.15.45:0/229900675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f009806f7d0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 -- 172.21.15.45:0/229900675 >> 172.21.15.45:0/229900675 conn(0x7f00980694b0 msgr2=0x7f00980698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 -- 172.21.15.45:0/229900675 shutdown_connections 2023-07-09T02:22:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 -- 172.21.15.45:0/229900675 wait complete. 2023-07-09T02:22:26.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 Processor -- start 2023-07-09T02:22:26.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.488+0000 7f009e69c640 1 -- start start 2023-07-09T02:22:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f009806c820 0x7f00981fa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f009806fd10 0x7f00980b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f00980b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00981fa840 con 0x7f0098158e30 2023-07-09T02:22:26.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00981fa9d0 con 0x7f009806fd10 2023-07-09T02:22:26.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00981facb0 con 0x7f009806c820 2023-07-09T02:22:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f00980b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f00980b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55466/0 (socket says 172.21.15.45:55466) 2023-07-09T02:22:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f0097fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f009806c820 0x7f00981fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 -- 172.21.15.45:0/1826703920 learned_addr learned my addr 172.21.15.45:0/1826703920 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f00977fe640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f009806fd10 0x7f00980b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 -- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f009806c820 msgr2=0x7f00981fa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f009806c820 0x7f00981fa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 -- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f009806fd10 msgr2=0x7f00980b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f009806fd10 0x7f00980b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 -- 172.21.15.45:0/1826703920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008800b770 con 0x7f0098158e30 2023-07-09T02:22:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009cc39640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f00980b0b90 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f009000c780 tx=0x7f009000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f0094ff9640 1 -- 172.21.15.45:0/1826703920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000a9f0 con 0x7f0098158e30 2023-07-09T02:22:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f0094ff9640 1 -- 172.21.15.45:0/1826703920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009000ce90 con 0x7f0098158e30 2023-07-09T02:22:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f0094ff9640 1 -- 172.21.15.45:0/1826703920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000add0 con 0x7f0098158e30 2023-07-09T02:22:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00981faf90 con 0x7f0098158e30 2023-07-09T02:22:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00981fb550 con 0x7f0098158e30 2023-07-09T02:22:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.492+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009804d7d0 con 0x7f0098158e30 2023-07-09T02:22:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.496+0000 7f0094ff9640 1 -- 172.21.15.45:0/1826703920 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0090012420 con 0x7f0098158e30 2023-07-09T02:22:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.496+0000 7f0094ff9640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00840662b0 0x7f0084068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.496+0000 7f0094ff9640 1 -- 172.21.15.45:0/1826703920 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0090083e10 con 0x7f0098158e30 2023-07-09T02:22:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.496+0000 7f0094ff9640 1 -- 172.21.15.45:0/1826703920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7f008406e4b0 con 0x7f0098158e30 2023-07-09T02:22:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.496+0000 7f0097fff640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00840662b0 0x7f0084068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.496+0000 7f0097fff640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00840662b0 0x7f0084068760 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f00880b1000 tx=0x7f00880a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.500+0000 7f0094ff9640 1 -- 172.21.15.45:0/1826703920 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0090016020 con 0x7f0098158e30 2023-07-09T02:22:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.684+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f009814d600 con 0x7f0098158e30 2023-07-09T02:22:26.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.684+0000 7f0094ff9640 1 -- 172.21.15.45:0/1826703920 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f0090087030 con 0x7f0098158e30 2023-07-09T02:22:26.686 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:26.686 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2937988619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2937988619},{"type":"v1","addr":"172.21.15.45:6835","nonce":2937988619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/202593650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":202593650},{"type":"v1","addr":"172.21.15.45:6833","nonce":202593650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1590703663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1590703663},{"type":"v1","addr":"172.21.15.155:6837","nonce":1590703663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:21:03.398485+0000","modified":"2023-07-09T02:21:07.041368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8206},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8206":{"gid":8206,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/390558772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":390558772},{"type":"v1","addr":"172.21.15.155:6836","nonce":390558772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T02:22:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 83 2023-07-09T02:22:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00840662b0 msgr2=0x7f0084068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00840662b0 0x7f0084068760 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f00880b1000 tx=0x7f00880a9070 comp rx=0 tx=0).stop 2023-07-09T02:22:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 msgr2=0x7f00980b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f00980b0b90 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f009000c780 tx=0x7f009000cc40 comp rx=0 tx=0).stop 2023-07-09T02:22:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 shutdown_connections 2023-07-09T02:22:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0098158e30 0x7f00980b0b90 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f009806fd10 0x7f00980b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f00840662b0 0x7f0084068760 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 --2- 172.21.15.45:0/1826703920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f009806c820 0x7f00981fa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 >> 172.21.15.45:0/1826703920 conn(0x7f00980694b0 msgr2=0x7f00980c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 shutdown_connections 2023-07-09T02:22:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.688+0000 7f009e69c640 1 -- 172.21.15.45:0/1826703920 wait complete. 2023-07-09T02:22:26.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.848+0000 7fa9fcc0b640 1 Processor -- start 2023-07-09T02:22:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.848+0000 7fa9fcc0b640 1 -- start start 2023-07-09T02:22:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9fcc0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f80c8d40 0x7fa9f80ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9fcc0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9f8160670 0x7fa9f80b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9fcc0b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f80cd5d0 con 0x7fa9f80b4910 2023-07-09T02:22:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9fcc0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f80d2050 con 0x7fa9f8160670 2023-07-09T02:22:26.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9fcc0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80d27a0 con 0x7fa9f80c8d40 2023-07-09T02:22:26.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f80c8d40 0x7fa9f80ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f80c8d40 0x7fa9f80ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:40216/0 (socket says 172.21.15.45:40216) 2023-07-09T02:22:26.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f77fe640 1 -- 172.21.15.45:0/684207930 learned_addr learned my addr 172.21.15.45:0/684207930 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:26.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f6ffd640 1 --2- 172.21.15.45:0/684207930 >> v2:172.21.15.155:3300/0 conn(0x7fa9f8160670 0x7fa9f80b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f77fe640 1 -- 172.21.15.45:0/684207930 >> v2:172.21.15.155:3300/0 conn(0x7fa9f8160670 msgr2=0x7fa9f80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:26.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f77fe640 1 --2- 172.21.15.45:0/684207930 >> v2:172.21.15.155:3300/0 conn(0x7fa9f8160670 0x7fa9f80b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f77fe640 1 -- 172.21.15.45:0/684207930 >> v1:172.21.15.155:6789/0 conn(0x7fa9f80b4910 legacy=0x7fa9f806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f77fe640 1 -- 172.21.15.45:0/684207930 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80b4d10 con 0x7fa9f80c8d40 2023-07-09T02:22:26.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.852+0000 7fa9f67fc640 1 -- 172.21.15.45:0/684207930 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801570863 0 0) 0x7fa9f80cd5d0 con 0x7fa9f80b4910 2023-07-09T02:22:26.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9f77fe640 1 --2- 172.21.15.45:0/684207930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f80c8d40 0x7fa9f80ccf10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009870 tx=0x7fa9e801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=371f6f5a85123b80 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9f67fc640 1 -- 172.21.15.45:0/684207930 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80a8a30 con 0x7fa9f80c8d40 2023-07-09T02:22:26.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9f67fc640 1 -- 172.21.15.45:0/684207930 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e80a8b90 con 0x7fa9f80c8d40 2023-07-09T02:22:26.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9f67fc640 1 -- 172.21.15.45:0/684207930 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80b0440 con 0x7fa9f80c8d40 2023-07-09T02:22:26.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/684207930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f80c8d40 msgr2=0x7fa9f80ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/684207930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f80c8d40 0x7fa9f80ccf10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009870 tx=0x7fa9e801ed30 comp rx=0 tx=0).stop 2023-07-09T02:22:26.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/684207930 shutdown_connections 2023-07-09T02:22:26.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/684207930 >> v2:172.21.15.155:3300/0 conn(0x7fa9f8160670 0x7fa9f80b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/684207930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f80c8d40 0x7fa9f80ccf10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/684207930 >> 172.21.15.45:0/684207930 conn(0x7fa9f80d2950 msgr2=0x7fa9f80d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:26.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/684207930 shutdown_connections 2023-07-09T02:22:26.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/684207930 wait complete. 2023-07-09T02:22:26.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 Processor -- start 2023-07-09T02:22:26.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.856+0000 7fa9fcc0b640 1 -- start start 2023-07-09T02:22:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f80b4910 0x7fa9f8150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9f80c8d40 0x7fa9f815e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f8160670 0x7fa9f80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80c9b30 con 0x7fa9f80c8d40 2023-07-09T02:22:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80c9e10 con 0x7fa9f80b4910 2023-07-09T02:22:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80ca0f0 con 0x7fa9f8160670 2023-07-09T02:22:26.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9f80c8d40 0x7fa9f815e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9f80c8d40 0x7fa9f815e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55468/0 (socket says 172.21.15.45:55468) 2023-07-09T02:22:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 -- 172.21.15.45:0/1230889421 learned_addr learned my addr 172.21.15.45:0/1230889421 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f77fe640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f80b4910 0x7fa9f8150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f7fff640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f8160670 0x7fa9f80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 -- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f8160670 msgr2=0x7fa9f80b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f8160670 0x7fa9f80b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 -- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f80b4910 msgr2=0x7fa9f8150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:26.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f80b4910 0x7fa9f8150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:26.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 -- 172.21.15.45:0/1230889421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80094d0 con 0x7fa9f80c8d40 2023-07-09T02:22:26.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9f6ffd640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9f80c8d40 0x7fa9f815e5f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00e870 tx=0x7fa9ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9dffff640 1 -- 172.21.15.45:0/1230889421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec009510 con 0x7fa9f80c8d40 2023-07-09T02:22:26.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9dffff640 1 -- 172.21.15.45:0/1230889421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec00eec0 con 0x7fa9f80c8d40 2023-07-09T02:22:26.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f80ca3d0 con 0x7fa9f80c8d40 2023-07-09T02:22:26.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9dffff640 1 -- 172.21.15.45:0/1230889421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec00cb40 con 0x7fa9f80c8d40 2023-07-09T02:22:26.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f815b0e0 con 0x7fa9f80c8d40 2023-07-09T02:22:26.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f804e020 con 0x7fa9f80c8d40 2023-07-09T02:22:26.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.860+0000 7fa9dffff640 1 -- 172.21.15.45:0/1230889421 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9ec00cca0 con 0x7fa9f80c8d40 2023-07-09T02:22:26.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.864+0000 7fa9dffff640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9e4066280 0x7fa9e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:26.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.864+0000 7fa9dffff640 1 -- 172.21.15.45:0/1230889421 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa9ec083f20 con 0x7fa9f80c8d40 2023-07-09T02:22:26.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.864+0000 7fa9dffff640 1 -- 172.21.15.45:0/1230889421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7fa9e406e480 con 0x7fa9f80c8d40 2023-07-09T02:22:26.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.864+0000 7fa9f77fe640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9e4066280 0x7fa9e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:26.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.864+0000 7fa9f77fe640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9e4066280 0x7fa9e4068730 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80b2000 tx=0x7fa9e80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:26.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:26.868+0000 7fa9dffff640 1 -- 172.21.15.45:0/1230889421 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9ec017060 con 0x7fa9f80c8d40 2023-07-09T02:22:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.020+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9f806a360 con 0x7fa9f80c8d40 2023-07-09T02:22:27.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.020+0000 7fa9dffff640 1 -- 172.21.15.45:0/1230889421 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+18486 (secure 0 0 0) 0x7fa9ec021020 con 0x7fa9f80c8d40 2023-07-09T02:22:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:27.023 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":170,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:07.572065+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:21:01.154000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T02:21:02.407446+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.4","mappings":[{"from":3,"to":0}]},{"pgid":"22.12","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:27.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9e4066280 msgr2=0x7fa9e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9e4066280 0x7fa9e4068730 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80b2000 tx=0x7fa9e80aa070 comp rx=0 tx=0).stop 2023-07-09T02:22:27.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9f80c8d40 msgr2=0x7fa9f815e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9f80c8d40 0x7fa9f815e5f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00e870 tx=0x7fa9ec00ec70 comp rx=0 tx=0).stop 2023-07-09T02:22:27.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 shutdown_connections 2023-07-09T02:22:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fa9e4066280 0x7fa9e4068730 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f8160670 0x7fa9f80b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9f80c8d40 0x7fa9f815e5f0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 --2- 172.21.15.45:0/1230889421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f80b4910 0x7fa9f8150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 >> 172.21.15.45:0/1230889421 conn(0x7fa9f80d2950 msgr2=0x7fa9f80c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:27.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 shutdown_connections 2023-07-09T02:22:27.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.024+0000 7fa9fcc0b640 1 -- 172.21.15.45:0/1230889421 wait complete. 2023-07-09T02:22:27.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:22:27.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb8414d8640 1 Processor -- start 2023-07-09T02:22:27.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb8414d8640 1 -- start start 2023-07-09T02:22:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb8414d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c0d2620 0x7fb83c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb8414d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb83c0cd120 0x7fb83c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb8414d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c160a50 con 0x7fb83c15c060 2023-07-09T02:22:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb8414d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c15c430 con 0x7fb83c0cd120 2023-07-09T02:22:27.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb8414d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c15fb60 con 0x7fb83c0d2620 2023-07-09T02:22:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb83affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb83c15c060 0x7fb83c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41422/0 (socket says 172.21.15.45:41422) 2023-07-09T02:22:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb83affd640 1 -- 172.21.15.45:0/2879202026 learned_addr learned my addr 172.21.15.45:0/2879202026 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:27.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb833fff640 1 --2- 172.21.15.45:0/2879202026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c0d2620 0x7fb83c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb83b7fe640 1 --2- 172.21.15.45:0/2879202026 >> v2:172.21.15.155:3300/0 conn(0x7fb83c0cd120 0x7fb83c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb83a7fc640 1 -- 172.21.15.45:0/2879202026 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433033001 0 0) 0x7fb83c160a50 con 0x7fb83c15c060 2023-07-09T02:22:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb83a7fc640 1 -- 172.21.15.45:0/2879202026 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb828003530 con 0x7fb83c15c060 2023-07-09T02:22:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb833fff640 1 -- 172.21.15.45:0/2879202026 >> v2:172.21.15.155:3300/0 conn(0x7fb83c0cd120 msgr2=0x7fb83c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb833fff640 1 --2- 172.21.15.45:0/2879202026 >> v2:172.21.15.155:3300/0 conn(0x7fb83c0cd120 0x7fb83c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb833fff640 1 -- 172.21.15.45:0/2879202026 >> v1:172.21.15.45:6789/0 conn(0x7fb83c15c060 legacy=0x7fb83c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.188+0000 7fb833fff640 1 -- 172.21.15.45:0/2879202026 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c15fe40 con 0x7fb83c0d2620 2023-07-09T02:22:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb833fff640 1 --2- 172.21.15.45:0/2879202026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c0d2620 0x7fb83c0b4ed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097c0 tx=0x7fb82401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8320b1a2a25bd285 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb83a7fc640 1 -- 172.21.15.45:0/2879202026 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240ab650 con 0x7fb83c0d2620 2023-07-09T02:22:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb83a7fc640 1 -- 172.21.15.45:0/2879202026 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8240ab7b0 con 0x7fb83c0d2620 2023-07-09T02:22:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb83a7fc640 1 -- 172.21.15.45:0/2879202026 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240abb40 con 0x7fb83c0d2620 2023-07-09T02:22:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb8414d8640 1 -- 172.21.15.45:0/2879202026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c0d2620 msgr2=0x7fb83c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2879202026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c0d2620 0x7fb83c0b4ed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb8240097c0 tx=0x7fb82401c450 comp rx=0 tx=0).stop 2023-07-09T02:22:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb8414d8640 1 -- 172.21.15.45:0/2879202026 shutdown_connections 2023-07-09T02:22:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2879202026 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c0d2620 0x7fb83c0b4ed0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2879202026 >> v2:172.21.15.155:3300/0 conn(0x7fb83c0cd120 0x7fb83c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.192+0000 7fb8414d8640 1 -- 172.21.15.45:0/2879202026 >> 172.21.15.45:0/2879202026 conn(0x7fb83c0698e0 msgr2=0x7fb83c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 -- 172.21.15.45:0/2879202026 shutdown_connections 2023-07-09T02:22:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 -- 172.21.15.45:0/2879202026 wait complete. 2023-07-09T02:22:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 Processor -- start 2023-07-09T02:22:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 -- start start 2023-07-09T02:22:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb83c0cd120 0x7fb83c0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb83c0d2620 0x7fb83c15c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c15c060 0x7fb83c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0b4200 con 0x7fb83c0cd120 2023-07-09T02:22:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0b3580 con 0x7fb83c0d2620 2023-07-09T02:22:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb8414d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0b3860 con 0x7fb83c15c060 2023-07-09T02:22:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb83c0cd120 0x7fb83c0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb83c0cd120 0x7fb83c0b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55480/0 (socket says 172.21.15.45:55480) 2023-07-09T02:22:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 -- 172.21.15.45:0/2595585946 learned_addr learned my addr 172.21.15.45:0/2595585946 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb833fff640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb83c0d2620 0x7fb83c15c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83b7fe640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c15c060 0x7fb83c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 -- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c15c060 msgr2=0x7fb83c157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c15c060 0x7fb83c157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 -- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb83c0d2620 msgr2=0x7fb83c15c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb83c0d2620 0x7fb83c15c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 -- 172.21.15.45:0/2595585946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824009420 con 0x7fb83c0cd120 2023-07-09T02:22:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.196+0000 7fb83affd640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb83c0cd120 0x7fb83c0b4620 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00c420 tx=0x7fb82c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c005cf0 con 0x7fb83c0cd120 2023-07-09T02:22:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c005e50 con 0x7fb83c0cd120 2023-07-09T02:22:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c0072d0 con 0x7fb83c0cd120 2023-07-09T02:22:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c0b59f0 con 0x7fb83c0cd120 2023-07-09T02:22:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c0b3e20 con 0x7fb83c0cd120 2023-07-09T02:22:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c04d7d0 con 0x7fb83c0cd120 2023-07-09T02:22:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb82c007430 con 0x7fb83c0cd120 2023-07-09T02:22:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8337fe640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb81c066280 0x7fb81c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb82c0831e0 con 0x7fb83c0cd120 2023-07-09T02:22:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=171}) v3 -- 0x7fb81c06e480 con 0x7fb83c0cd120 2023-07-09T02:22:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.200+0000 7fb833fff640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb81c066280 0x7fb81c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.204+0000 7fb833fff640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb81c066280 0x7fb81c068730 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb8240af000 tx=0x7fb8240a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:27.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.204+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb82c050760 con 0x7fb83c0cd120 2023-07-09T02:22:27.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.388+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb83c06baa0 con 0x7fb83c0cd120 2023-07-09T02:22:27.391 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:22:27.392+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:22:27.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.392+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(171..171 src has 1..171) v4 ==== 432+0+0 (secure 0 0 0) 0x7fb82c058330 con 0x7fb83c0cd120 2023-07-09T02:22:27.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.392+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=172}) v3 -- 0x7fb81c06ecc0 con 0x7fb83c0cd120 2023-07-09T02:22:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.396+0000 7fb8337fe640 1 -- 172.21.15.45:0/2595585946 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb82c017020 con 0x7fb83c0cd120 2023-07-09T02:22:27.398 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:22:27.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb81c066280 msgr2=0x7fb81c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb81c066280 0x7fb81c068730 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb8240af000 tx=0x7fb8240a7000 comp rx=0 tx=0).stop 2023-07-09T02:22:27.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb83c0cd120 msgr2=0x7fb83c0b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb83c0cd120 0x7fb83c0b4620 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00c420 tx=0x7fb82c00c8e0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 shutdown_connections 2023-07-09T02:22:27.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb81c066280 0x7fb81c068730 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb83c15c060 0x7fb83c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb83c0d2620 0x7fb83c15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 --2- 172.21.15.45:0/2595585946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb83c0cd120 0x7fb83c0b4620 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 >> 172.21.15.45:0/2595585946 conn(0x7fb83c0698e0 msgr2=0x7fb83c15b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 shutdown_connections 2023-07-09T02:22:27.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.400+0000 7fb8414d8640 1 -- 172.21.15.45:0/2595585946 wait complete. 2023-07-09T02:22:27.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:22:27.468 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:22:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.564+0000 7f4a7fd40640 1 Processor -- start 2023-07-09T02:22:27.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.564+0000 7f4a7fd40640 1 -- start start 2023-07-09T02:22:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.564+0000 7f4a7fd40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a781604a0 0x7f4a78164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7fd40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4a780c8dc0 0x7f4a780cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7fd40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a780cde40 0x7f4a780cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7fd40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7806be90 con 0x7f4a780cde40 2023-07-09T02:22:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7fd40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7806b000 con 0x7f4a780c8dc0 2023-07-09T02:22:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7fd40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780ce2c0 con 0x7f4a781604a0 2023-07-09T02:22:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a780cde40 0x7f4a780cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a780cde40 0x7f4a780cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55486/0 (socket says 172.21.15.45:55486) 2023-07-09T02:22:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 -- 172.21.15.45:0/2206309489 learned_addr learned my addr 172.21.15.45:0/2206309489 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7dadc640 1 --2- 172.21.15.45:0/2206309489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a781604a0 0x7f4a78164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7d2db640 1 --2- 172.21.15.45:0/2206309489 >> v2:172.21.15.155:3300/0 conn(0x7f4a780c8dc0 0x7f4a780cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 -- 172.21.15.45:0/2206309489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a781604a0 msgr2=0x7f4a78164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 --2- 172.21.15.45:0/2206309489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a781604a0 0x7f4a78164b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 -- 172.21.15.45:0/2206309489 >> v2:172.21.15.155:3300/0 conn(0x7f4a780c8dc0 msgr2=0x7f4a780cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 --2- 172.21.15.45:0/2206309489 >> v2:172.21.15.155:3300/0 conn(0x7f4a780c8dc0 0x7f4a780cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 -- 172.21.15.45:0/2206309489 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7806ef30 con 0x7f4a780cde40 2023-07-09T02:22:27.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7e2dd640 1 --2- 172.21.15.45:0/2206309489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780cde40 0x7f4a780cc290 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f4a7806d020 tx=0x7f4a7001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545375d1156b5e82 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:27.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7cada640 1 -- 172.21.15.45:0/2206309489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700a5590 con 0x7f4a780cde40 2023-07-09T02:22:27.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7cada640 1 -- 172.21.15.45:0/2206309489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a700a56f0 con 0x7f4a780cde40 2023-07-09T02:22:27.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.568+0000 7f4a7cada640 1 -- 172.21.15.45:0/2206309489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700a5a80 con 0x7f4a780cde40 2023-07-09T02:22:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- 172.21.15.45:0/2206309489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780cde40 msgr2=0x7f4a780cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/2206309489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780cde40 0x7f4a780cc290 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f4a7806d020 tx=0x7f4a7001c710 comp rx=0 tx=0).stop 2023-07-09T02:22:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- 172.21.15.45:0/2206309489 shutdown_connections 2023-07-09T02:22:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/2206309489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a780cde40 0x7f4a780cc290 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/2206309489 >> v2:172.21.15.155:3300/0 conn(0x7f4a780c8dc0 0x7f4a780cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/2206309489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a781604a0 0x7f4a78164b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- 172.21.15.45:0/2206309489 >> 172.21.15.45:0/2206309489 conn(0x7f4a780694b0 msgr2=0x7f4a780698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- 172.21.15.45:0/2206309489 shutdown_connections 2023-07-09T02:22:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- 172.21.15.45:0/2206309489 wait complete. 2023-07-09T02:22:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 Processor -- start 2023-07-09T02:22:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- start start 2023-07-09T02:22:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a780c8dc0 0x7f4a78150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a780cde40 0x7f4a780ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a781604a0 0x7f4a780b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78151f60 con 0x7f4a781604a0 2023-07-09T02:22:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78151350 con 0x7f4a780cde40 2023-07-09T02:22:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7fd40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78151630 con 0x7f4a780c8dc0 2023-07-09T02:22:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7e2dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a781604a0 0x7f4a780b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7e2dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a781604a0 0x7f4a780b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55492/0 (socket says 172.21.15.45:55492) 2023-07-09T02:22:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7e2dd640 1 -- 172.21.15.45:0/3788530925 learned_addr learned my addr 172.21.15.45:0/3788530925 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7dadc640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a780c8dc0 0x7f4a78150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.572+0000 7f4a7d2db640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a780cde40 0x7f4a780ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7e2dd640 1 -- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a780c8dc0 msgr2=0x7f4a78150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7e2dd640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a780c8dc0 0x7f4a78150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7e2dd640 1 -- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a780cde40 msgr2=0x7f4a780ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:27.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7e2dd640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a780cde40 0x7f4a780ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:27.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7e2dd640 1 -- 172.21.15.45:0/3788530925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70009b30 con 0x7f4a781604a0 2023-07-09T02:22:27.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7e2dd640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a781604a0 0x7f4a780b0870 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f4a7001adc0 tx=0x7f4a700194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a6e7fc640 1 -- 172.21.15.45:0/3788530925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700bd070 con 0x7f4a781604a0 2023-07-09T02:22:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a6e7fc640 1 -- 172.21.15.45:0/3788530925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70009510 con 0x7f4a781604a0 2023-07-09T02:22:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a78151910 con 0x7f4a781604a0 2023-07-09T02:22:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a6e7fc640 1 -- 172.21.15.45:0/3788530925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700a5590 con 0x7f4a781604a0 2023-07-09T02:22:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a780c6000 con 0x7f4a781604a0 2023-07-09T02:22:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a78152110 con 0x7f4a781604a0 2023-07-09T02:22:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a6e7fc640 1 -- 172.21.15.45:0/3788530925 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a700039a0 con 0x7f4a781604a0 2023-07-09T02:22:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a6e7fc640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a5c0662b0 0x7f4a5c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a6e7fc640 1 -- 172.21.15.45:0/3788530925 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f4a7011e5e0 con 0x7f4a781604a0 2023-07-09T02:22:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.576+0000 7f4a6e7fc640 1 -- 172.21.15.45:0/3788530925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=172}) v3 -- 0x7f4a5c06e5c0 con 0x7f4a781604a0 2023-07-09T02:22:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.580+0000 7f4a7dadc640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a5c0662b0 0x7f4a5c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.580+0000 7f4a7dadc640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a5c0662b0 0x7f4a5c068760 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009a40 tx=0x7f4a74009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.580+0000 7f4a6e7fc640 1 -- 172.21.15.45:0/3788530925 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a78152110 con 0x7f4a781604a0 2023-07-09T02:22:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:27.768+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a7804d7d0 con 0x7f4a781604a0 2023-07-09T02:22:28.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.396+0000 7f4a6e7fc640 1 -- 172.21.15.45:0/3788530925 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a700ef510 con 0x7f4a781604a0 2023-07-09T02:22:28.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a5c0662b0 msgr2=0x7f4a5c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:28.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a5c0662b0 0x7f4a5c068760 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009a40 tx=0x7f4a74009190 comp rx=0 tx=0).stop 2023-07-09T02:22:28.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a781604a0 msgr2=0x7f4a780b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:28.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a781604a0 0x7f4a780b0870 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f4a7001adc0 tx=0x7f4a700194b0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 shutdown_connections 2023-07-09T02:22:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a781604a0 0x7f4a780b0870 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a780cde40 0x7f4a780ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4a5c0662b0 0x7f4a5c068760 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 --2- 172.21.15.45:0/3788530925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a780c8dc0 0x7f4a78150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 >> 172.21.15.45:0/3788530925 conn(0x7f4a780694b0 msgr2=0x7f4a7815f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 shutdown_connections 2023-07-09T02:22:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.400+0000 7f4a7fd40640 1 -- 172.21.15.45:0/3788530925 wait complete. 2023-07-09T02:22:28.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:22:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f45a2e93640 1 Processor -- start 2023-07-09T02:22:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f45a2e93640 1 -- start start 2023-07-09T02:22:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f45a2e93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0cd060 0x7f459c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f45a2e93640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0d19c0 con 0x7f459c0b4490 2023-07-09T02:22:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f45a2e93640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0cf210 con 0x7f459c15c480 2023-07-09T02:22:28.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f45a2e93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c15c850 con 0x7f459c0cd060 2023-07-09T02:22:28.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f45a1430640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f459c0b4490 0x7f459c0b5860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41426/0 (socket says 172.21.15.45:41426) 2023-07-09T02:22:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f45a1430640 1 -- 172.21.15.45:0/3213558235 learned_addr learned my addr 172.21.15.45:0/3213558235 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f459bfff640 1 --2- 172.21.15.45:0/3213558235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0cd060 0x7f459c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f459b7fe640 1 -- 172.21.15.45:0/3213558235 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791979258 0 0) 0x7f459c0d19c0 con 0x7f459c0b4490 2023-07-09T02:22:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f459b7fe640 1 -- 172.21.15.45:0/3213558235 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f458c003530 con 0x7f459c0b4490 2023-07-09T02:22:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f459b7fe640 1 -- 172.21.15.45:0/3213558235 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639446130 0 0) 0x7f459c0cf210 con 0x7f459c15c480 2023-07-09T02:22:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f459b7fe640 1 -- 172.21.15.45:0/3213558235 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f459c0d19c0 con 0x7f459c15c480 2023-07-09T02:22:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f459bfff640 1 -- 172.21.15.45:0/3213558235 >> v1:172.21.15.155:6789/0 conn(0x7f459c15c480 legacy=0x7f459c0d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f459bfff640 1 -- 172.21.15.45:0/3213558235 >> v1:172.21.15.45:6789/0 conn(0x7f459c0b4490 legacy=0x7f459c0b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.572+0000 7f459bfff640 1 -- 172.21.15.45:0/3213558235 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0cd4d0 con 0x7f459c0cd060 2023-07-09T02:22:28.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f459bfff640 1 --2- 172.21.15.45:0/3213558235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0cd060 0x7f459c0cecd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45880097f0 tx=0x7f458801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f9ced4030c55ab2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:28.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f459b7fe640 1 -- 172.21.15.45:0/3213558235 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880ab600 con 0x7f459c0cd060 2023-07-09T02:22:28.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f459b7fe640 1 -- 172.21.15.45:0/3213558235 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45880a7050 con 0x7f459c0cd060 2023-07-09T02:22:28.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f459b7fe640 1 -- 172.21.15.45:0/3213558235 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880ab980 con 0x7f459c0cd060 2023-07-09T02:22:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f45a2e93640 1 -- 172.21.15.45:0/3213558235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0cd060 msgr2=0x7f459c0cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f45a2e93640 1 --2- 172.21.15.45:0/3213558235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0cd060 0x7f459c0cecd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45880097f0 tx=0x7f458801c4c0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f45a2e93640 1 -- 172.21.15.45:0/3213558235 shutdown_connections 2023-07-09T02:22:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f45a2e93640 1 --2- 172.21.15.45:0/3213558235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0cd060 0x7f459c0cecd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f45a2e93640 1 -- 172.21.15.45:0/3213558235 >> 172.21.15.45:0/3213558235 conn(0x7f459c0cf490 msgr2=0x7f459c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f45a2e93640 1 -- 172.21.15.45:0/3213558235 shutdown_connections 2023-07-09T02:22:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.576+0000 7f45a2e93640 1 -- 172.21.15.45:0/3213558235 wait complete. 2023-07-09T02:22:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 Processor -- start 2023-07-09T02:22:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 -- start start 2023-07-09T02:22:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0b4490 0x7f459c15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f459c0cd060 0x7f459c150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f459c15c480 0x7f459c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c15f0d0 con 0x7f459c15c480 2023-07-09T02:22:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c15e210 con 0x7f459c0cd060 2023-07-09T02:22:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c15e450 con 0x7f459c0b4490 2023-07-09T02:22:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f459c15c480 0x7f459c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:28.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f459c15c480 0x7f459c0c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55496/0 (socket says 172.21.15.45:55496) 2023-07-09T02:22:28.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 -- 172.21.15.45:0/4233125778 learned_addr learned my addr 172.21.15.45:0/4233125778 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f459bfff640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f459c0cd060 0x7f459c150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a0c2f640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0b4490 0x7f459c15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 -- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0b4490 msgr2=0x7f459c15f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0b4490 0x7f459c15f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 -- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f459c0cd060 msgr2=0x7f459c150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f459c0cd060 0x7f459c150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 -- 172.21.15.45:0/4233125778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588009420 con 0x7f459c15c480 2023-07-09T02:22:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a0c2f640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0b4490 0x7f459c15f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a1430640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f459c15c480 0x7f459c0c78b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f459400cb70 tx=0x7f459400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400ad40 con 0x7f459c15c480 2023-07-09T02:22:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594012400 con 0x7f459c15c480 2023-07-09T02:22:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400aea0 con 0x7f459c15c480 2023-07-09T02:22:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c15e730 con 0x7f459c15c480 2023-07-09T02:22:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.580+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c15ecf0 con 0x7f459c15c480 2023-07-09T02:22:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.584+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c15f210 con 0x7f459c15c480 2023-07-09T02:22:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.584+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f459401b3b0 con 0x7f459c15c480 2023-07-09T02:22:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.584+0000 7f45997fa640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45800662b0 0x7f4580068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.584+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f4594083bc0 con 0x7f459c15c480 2023-07-09T02:22:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.584+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=172}) v3 -- 0x7f458006e5c0 con 0x7f459c15c480 2023-07-09T02:22:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.584+0000 7f45a0c2f640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45800662b0 0x7f4580068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.584+0000 7f45a0c2f640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45800662b0 0x7f4580068760 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f45900011f0 tx=0x7f4590009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.588+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4594017060 con 0x7f459c15c480 2023-07-09T02:22:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:28.744+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f459c04d7d0 con 0x7f459c15c480 2023-07-09T02:22:29.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.468+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(172..172 src has 1..172) v4 ==== 745+0+0 (secure 0 0 0) 0x7f4594058c20 con 0x7f459c15c480 2023-07-09T02:22:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.468+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f458006c9f0 con 0x7f459c15c480 2023-07-09T02:22:29.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.472+0000 7f45997fa640 1 -- 172.21.15.45:0/4233125778 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v172) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4594017020 con 0x7f459c15c480 2023-07-09T02:22:29.475 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:22:29.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45800662b0 msgr2=0x7f4580068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:29.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45800662b0 0x7f4580068760 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f45900011f0 tx=0x7f4590009040 comp rx=0 tx=0).stop 2023-07-09T02:22:29.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f459c15c480 msgr2=0x7f459c0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:29.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f459c15c480 0x7f459c0c78b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f459400cb70 tx=0x7f459400a430 comp rx=0 tx=0).stop 2023-07-09T02:22:29.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 shutdown_connections 2023-07-09T02:22:29.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f459c15c480 0x7f459c0c78b0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f459c0cd060 0x7f459c150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f45800662b0 0x7f4580068760 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 --2- 172.21.15.45:0/4233125778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459c0b4490 0x7f459c15f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 >> 172.21.15.45:0/4233125778 conn(0x7f459c0cf490 msgr2=0x7f459c0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:29.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 shutdown_connections 2023-07-09T02:22:29.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.476+0000 7f45a2e93640 1 -- 172.21.15.45:0/4233125778 wait complete. 2023-07-09T02:22:29.502 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:22:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.652+0000 7f9b6edac640 1 Processor -- start 2023-07-09T02:22:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.652+0000 7f9b6edac640 1 -- start start 2023-07-09T02:22:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6edac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b6815d5e0 0x7f9b680cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6edac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b680cf9f0 0x7f9b6815e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6edac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6815db60 con 0x7f9b681534f0 2023-07-09T02:22:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6edac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b681538c0 con 0x7f9b680cf9f0 2023-07-09T02:22:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6edac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b680cfe70 con 0x7f9b6815d5e0 2023-07-09T02:22:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6d349640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b680cf9f0 0x7f9b6815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b67fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b6815d5e0 0x7f9b680cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6cb48640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9b681534f0 0x7f9b680b4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:50024/0 (socket says 172.21.15.45:50024) 2023-07-09T02:22:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6cb48640 1 -- 172.21.15.45:0/4291729908 learned_addr learned my addr 172.21.15.45:0/4291729908 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6d349640 1 -- 172.21.15.45:0/4291729908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b6815d5e0 msgr2=0x7f9b680cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6d349640 1 --2- 172.21.15.45:0/4291729908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b6815d5e0 0x7f9b680cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6d349640 1 -- 172.21.15.45:0/4291729908 >> v1:172.21.15.155:6789/0 conn(0x7f9b681534f0 legacy=0x7f9b680b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.656+0000 7f9b6d349640 1 -- 172.21.15.45:0/4291729908 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b680cd290 con 0x7f9b680cf9f0 2023-07-09T02:22:29.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6d349640 1 --2- 172.21.15.45:0/4291729908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b680cf9f0 0x7f9b6815e320 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009d90 tx=0x7f9b6001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f992624a0ca682c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b677fe640 1 -- 172.21.15.45:0/4291729908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b600a59e0 con 0x7f9b680cf9f0 2023-07-09T02:22:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b677fe640 1 -- 172.21.15.45:0/4291729908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b600a5b40 con 0x7f9b680cf9f0 2023-07-09T02:22:29.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b677fe640 1 -- 172.21.15.45:0/4291729908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b600ad440 con 0x7f9b680cf9f0 2023-07-09T02:22:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 -- 172.21.15.45:0/4291729908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b680cf9f0 msgr2=0x7f9b6815e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 --2- 172.21.15.45:0/4291729908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b680cf9f0 0x7f9b6815e320 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009d90 tx=0x7f9b6001c920 comp rx=0 tx=0).stop 2023-07-09T02:22:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 -- 172.21.15.45:0/4291729908 shutdown_connections 2023-07-09T02:22:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 --2- 172.21.15.45:0/4291729908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b680cf9f0 0x7f9b6815e320 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 --2- 172.21.15.45:0/4291729908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b6815d5e0 0x7f9b680cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 -- 172.21.15.45:0/4291729908 >> 172.21.15.45:0/4291729908 conn(0x7f9b68069980 msgr2=0x7f9b68069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 -- 172.21.15.45:0/4291729908 shutdown_connections 2023-07-09T02:22:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 -- 172.21.15.45:0/4291729908 wait complete. 2023-07-09T02:22:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 Processor -- start 2023-07-09T02:22:29.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.660+0000 7f9b6edac640 1 -- start start 2023-07-09T02:22:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b680cf9f0 0x7f9b680c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b681534f0 0x7f9b68149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b6815d5e0 0x7f9b6814a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b680caa90 con 0x7f9b681534f0 2023-07-09T02:22:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b680cbaa0 con 0x7f9b6815d5e0 2023-07-09T02:22:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b680cace0 con 0x7f9b680cf9f0 2023-07-09T02:22:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b681534f0 0x7f9b68149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b681534f0 0x7f9b68149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55524/0 (socket says 172.21.15.45:55524) 2023-07-09T02:22:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 -- 172.21.15.45:0/1854476124 learned_addr learned my addr 172.21.15.45:0/1854476124 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6cb48640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b680cf9f0 0x7f9b680c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6d349640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b6815d5e0 0x7f9b6814a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 -- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b680cf9f0 msgr2=0x7f9b680c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b680cf9f0 0x7f9b680c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 -- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b6815d5e0 msgr2=0x7f9b6814a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b6815d5e0 0x7f9b6814a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 -- 172.21.15.45:0/1854476124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60009a70 con 0x7f9b681534f0 2023-07-09T02:22:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b67fff640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b681534f0 0x7f9b68149f60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400e8a0 tx=0x7f9b5400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b657fa640 1 -- 172.21.15.45:0/1854476124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54009510 con 0x7f9b681534f0 2023-07-09T02:22:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b657fa640 1 -- 172.21.15.45:0/1854476124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5400c940 con 0x7f9b681534f0 2023-07-09T02:22:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b680cafc0 con 0x7f9b681534f0 2023-07-09T02:22:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b657fa640 1 -- 172.21.15.45:0/1854476124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400ccb0 con 0x7f9b681534f0 2023-07-09T02:22:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b680cb580 con 0x7f9b681534f0 2023-07-09T02:22:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6804d7d0 con 0x7f9b681534f0 2023-07-09T02:22:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.664+0000 7f9b657fa640 1 -- 172.21.15.45:0/1854476124 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b54013470 con 0x7f9b681534f0 2023-07-09T02:22:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.668+0000 7f9b657fa640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b4c0662b0 0x7f9b4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.668+0000 7f9b657fa640 1 -- 172.21.15.45:0/1854476124 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f9b54083c20 con 0x7f9b681534f0 2023-07-09T02:22:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.668+0000 7f9b6cb48640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b4c0662b0 0x7f9b4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.668+0000 7f9b6cb48640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b4c0662b0 0x7f9b4c068760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005890 tx=0x7f9b5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.672+0000 7f9b657fa640 1 -- 172.21.15.45:0/1854476124 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b54051260 con 0x7f9b681534f0 2023-07-09T02:22:29.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:29.824+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b680b5af0 con 0x7f9b681534f0 2023-07-09T02:22:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.676+0000 7f9b657fa640 1 -- 172.21.15.45:0/1854476124 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v173) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9b540170d0 con 0x7f9b681534f0 2023-07-09T02:22:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:22:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b4c0662b0 msgr2=0x7f9b4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b4c0662b0 0x7f9b4c068760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005890 tx=0x7f9b5c009040 comp rx=0 tx=0).stop 2023-07-09T02:22:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b681534f0 msgr2=0x7f9b68149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:30.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b681534f0 0x7f9b68149f60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400e8a0 tx=0x7f9b5400eca0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 shutdown_connections 2023-07-09T02:22:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b6815d5e0 0x7f9b6814a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b681534f0 0x7f9b68149f60 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b4c0662b0 0x7f9b4c068760 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 --2- 172.21.15.45:0/1854476124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b680cf9f0 0x7f9b680c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 >> 172.21.15.45:0/1854476124 conn(0x7f9b68069980 msgr2=0x7f9b6814b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.680+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 shutdown_connections 2023-07-09T02:22:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.684+0000 7f9b6edac640 1 -- 172.21.15.45:0/1854476124 wait complete. 2023-07-09T02:22:30.706 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:22:30.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.852+0000 7fc0df51e640 1 Processor -- start 2023-07-09T02:22:30.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.852+0000 7fc0df51e640 1 -- start start 2023-07-09T02:22:30.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0df51e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d815c060 0x7fc0d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:30.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0df51e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc0d80cd120 0x7fc0d80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:30.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0df51e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0d80d2450 0x7fc0d80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:30.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0df51e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d80d28f0 con 0x7fc0d80d2450 2023-07-09T02:22:30.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0df51e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d8160a50 con 0x7fc0d80cd120 2023-07-09T02:22:30.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0df51e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d815c430 con 0x7fc0d815c060 2023-07-09T02:22:30.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0d80d2450 0x7fc0d80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:30.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0d80d2450 0x7fc0d80d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55532/0 (socket says 172.21.15.45:55532) 2023-07-09T02:22:30.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 -- 172.21.15.45:0/2986849803 learned_addr learned my addr 172.21.15.45:0/2986849803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:30.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0dcab9640 1 --2- 172.21.15.45:0/2986849803 >> v2:172.21.15.155:3300/0 conn(0x7fc0d80cd120 0x7fc0d80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:30.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0dd2ba640 1 --2- 172.21.15.45:0/2986849803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d815c060 0x7fc0d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:30.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 -- 172.21.15.45:0/2986849803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d815c060 msgr2=0x7fc0d80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:30.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 --2- 172.21.15.45:0/2986849803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d815c060 0x7fc0d80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 -- 172.21.15.45:0/2986849803 >> v2:172.21.15.155:3300/0 conn(0x7fc0d80cd120 msgr2=0x7fc0d80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:30.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 --2- 172.21.15.45:0/2986849803 >> v2:172.21.15.155:3300/0 conn(0x7fc0d80cd120 0x7fc0d80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 -- 172.21.15.45:0/2986849803 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d815fb60 con 0x7fc0d80d2450 2023-07-09T02:22:30.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.856+0000 7fc0ddabb640 1 --2- 172.21.15.45:0/2986849803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d80d2450 0x7fc0d80d0610 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80b5600 tx=0x7fc0d001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2e264a02efb06b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0cffff640 1 -- 172.21.15.45:0/2986849803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00a5560 con 0x7fc0d80d2450 2023-07-09T02:22:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0cffff640 1 -- 172.21.15.45:0/2986849803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d00a56c0 con 0x7fc0d80d2450 2023-07-09T02:22:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0cffff640 1 -- 172.21.15.45:0/2986849803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00a5a50 con 0x7fc0d80d2450 2023-07-09T02:22:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- 172.21.15.45:0/2986849803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d80d2450 msgr2=0x7fc0d80d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 --2- 172.21.15.45:0/2986849803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d80d2450 0x7fc0d80d0610 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80b5600 tx=0x7fc0d001c6e0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- 172.21.15.45:0/2986849803 shutdown_connections 2023-07-09T02:22:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 --2- 172.21.15.45:0/2986849803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d80d2450 0x7fc0d80d0610 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 --2- 172.21.15.45:0/2986849803 >> v2:172.21.15.155:3300/0 conn(0x7fc0d80cd120 0x7fc0d80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 --2- 172.21.15.45:0/2986849803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d815c060 0x7fc0d80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- 172.21.15.45:0/2986849803 >> 172.21.15.45:0/2986849803 conn(0x7fc0d80698e0 msgr2=0x7fc0d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:30.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- 172.21.15.45:0/2986849803 shutdown_connections 2023-07-09T02:22:30.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- 172.21.15.45:0/2986849803 wait complete. 2023-07-09T02:22:30.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 Processor -- start 2023-07-09T02:22:30.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- start start 2023-07-09T02:22:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d80cd120 0x7fc0d80b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0d80d2450 0x7fc0d80b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d815c060 0x7fc0d80ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d815b640 con 0x7fc0d815c060 2023-07-09T02:22:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80ca170 con 0x7fc0d80d2450 2023-07-09T02:22:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.860+0000 7fc0df51e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80c9bb0 con 0x7fc0d80cd120 2023-07-09T02:22:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d815c060 0x7fc0d80ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d815c060 0x7fc0d80ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55544/0 (socket says 172.21.15.45:55544) 2023-07-09T02:22:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 -- 172.21.15.45:0/3124050277 learned_addr learned my addr 172.21.15.45:0/3124050277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:30.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0dcab9640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0d80d2450 0x7fc0d80b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0dd2ba640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d80cd120 0x7fc0d80b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 -- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d80cd120 msgr2=0x7fc0d80b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:30.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d80cd120 0x7fc0d80b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 -- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0d80d2450 msgr2=0x7fc0d80b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0d80d2450 0x7fc0d80b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 -- 172.21.15.45:0/3124050277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d0009b30 con 0x7fc0d815c060 2023-07-09T02:22:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0ddabb640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d815c060 0x7fc0d80ca7e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00af040 tx=0x7fc0d0019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0cdffb640 1 -- 172.21.15.45:0/3124050277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00a5560 con 0x7fc0d815c060 2023-07-09T02:22:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0cdffb640 1 -- 172.21.15.45:0/3124050277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d00b8690 con 0x7fc0d815c060 2023-07-09T02:22:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d80c9e90 con 0x7fc0d815c060 2023-07-09T02:22:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0cdffb640 1 -- 172.21.15.45:0/3124050277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00b8a40 con 0x7fc0d815c060 2023-07-09T02:22:30.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d8154180 con 0x7fc0d815c060 2023-07-09T02:22:30.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d815b7f0 con 0x7fc0d815c060 2023-07-09T02:22:30.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.864+0000 7fc0cdffb640 1 -- 172.21.15.45:0/3124050277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0d00b8ba0 con 0x7fc0d815c060 2023-07-09T02:22:30.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.868+0000 7fc0cdffb640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0bc066280 0x7fc0bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:30.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.868+0000 7fc0cdffb640 1 -- 172.21.15.45:0/3124050277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc0d011ed00 con 0x7fc0d815c060 2023-07-09T02:22:30.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.868+0000 7fc0dd2ba640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0bc066280 0x7fc0bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:30.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.868+0000 7fc0dd2ba640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0bc066280 0x7fc0bc068730 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80ca560 tx=0x7fc0d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:30.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:30.872+0000 7fc0cdffb640 1 -- 172.21.15.45:0/3124050277 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0d815b7f0 con 0x7fc0d815c060 2023-07-09T02:22:31.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.024+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc0d815b7f0 con 0x7fc0d815c060 2023-07-09T02:22:31.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.028+0000 7fc0cdffb640 1 -- 172.21.15.45:0/3124050277 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc0d815b7f0 con 0x7fc0d815c060 2023-07-09T02:22:31.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0bc066280 msgr2=0x7fc0bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0bc066280 0x7fc0bc068730 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80ca560 tx=0x7fc0d4009190 comp rx=0 tx=0).stop 2023-07-09T02:22:31.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d815c060 msgr2=0x7fc0d80ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d815c060 0x7fc0d80ca7e0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00af040 tx=0x7fc0d0019480 comp rx=0 tx=0).stop 2023-07-09T02:22:31.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 shutdown_connections 2023-07-09T02:22:31.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d815c060 0x7fc0d80ca7e0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0d80d2450 0x7fc0d80b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc0bc066280 0x7fc0bc068730 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 --2- 172.21.15.45:0/3124050277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0d80cd120 0x7fc0d80b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 >> 172.21.15.45:0/3124050277 conn(0x7fc0d80698e0 msgr2=0x7fc0d80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:31.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 shutdown_connections 2023-07-09T02:22:31.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.032+0000 7fc0df51e640 1 -- 172.21.15.45:0/3124050277 wait complete. 2023-07-09T02:22:31.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-07-09T02:22:31.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5781ba9640 1 Processor -- start 2023-07-09T02:22:31.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5781ba9640 1 -- start start 2023-07-09T02:22:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5781ba9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577c0c8d40 0x7f577c0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5781ba9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f577c160670 0x7f577c0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5781ba9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c0cd5d0 con 0x7f577c0b4910 2023-07-09T02:22:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5781ba9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0d2050 con 0x7f577c0c8d40 2023-07-09T02:22:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5781ba9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0d27a0 con 0x7f577c160670 2023-07-09T02:22:31.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5780ba7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577c0c8d40 0x7f577c0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5780ba7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577c0c8d40 0x7f577c0ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55546/0 (socket says 172.21.15.45:55546) 2023-07-09T02:22:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5780ba7640 1 -- 172.21.15.45:0/2677188637 learned_addr learned my addr 172.21.15.45:0/2677188637 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:31.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f577bfff640 1 --2- 172.21.15.45:0/2677188637 >> v2:172.21.15.155:3300/0 conn(0x7f577c160670 0x7f577c0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5780ba7640 1 -- 172.21.15.45:0/2677188637 >> v2:172.21.15.155:3300/0 conn(0x7f577c160670 msgr2=0x7f577c0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5780ba7640 1 --2- 172.21.15.45:0/2677188637 >> v2:172.21.15.155:3300/0 conn(0x7f577c160670 0x7f577c0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f577b7fe640 1 -- 172.21.15.45:0/2677188637 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730868434 0 0) 0x7f577c0cd5d0 con 0x7f577c0b4910 2023-07-09T02:22:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5780ba7640 1 -- 172.21.15.45:0/2677188637 >> v1:172.21.15.45:6789/0 conn(0x7f577c0b4910 legacy=0x7f577c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.196+0000 7f5780ba7640 1 -- 172.21.15.45:0/2677188637 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c0b4d20 con 0x7f577c0c8d40 2023-07-09T02:22:31.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5780ba7640 1 --2- 172.21.15.45:0/2677188637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0c8d40 0x7f577c0ccf10 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f577c0b2120 tx=0x7f577001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23726fe84e58b8b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f577b7fe640 1 -- 172.21.15.45:0/2677188637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700a89f0 con 0x7f577c0c8d40 2023-07-09T02:22:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f577b7fe640 1 -- 172.21.15.45:0/2677188637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57700a8b50 con 0x7f577c0c8d40 2023-07-09T02:22:31.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f577b7fe640 1 -- 172.21.15.45:0/2677188637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700b0440 con 0x7f577c0c8d40 2023-07-09T02:22:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5781ba9640 1 -- 172.21.15.45:0/2677188637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0c8d40 msgr2=0x7f577c0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5781ba9640 1 --2- 172.21.15.45:0/2677188637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0c8d40 0x7f577c0ccf10 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f577c0b2120 tx=0x7f577001ecf0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5781ba9640 1 -- 172.21.15.45:0/2677188637 shutdown_connections 2023-07-09T02:22:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5781ba9640 1 --2- 172.21.15.45:0/2677188637 >> v2:172.21.15.155:3300/0 conn(0x7f577c160670 0x7f577c0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5781ba9640 1 --2- 172.21.15.45:0/2677188637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0c8d40 0x7f577c0ccf10 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5781ba9640 1 -- 172.21.15.45:0/2677188637 >> 172.21.15.45:0/2677188637 conn(0x7f577c0d2950 msgr2=0x7f577c0d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5781ba9640 1 -- 172.21.15.45:0/2677188637 shutdown_connections 2023-07-09T02:22:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.200+0000 7f5781ba9640 1 -- 172.21.15.45:0/2677188637 wait complete. 2023-07-09T02:22:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 Processor -- start 2023-07-09T02:22:31.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 -- start start 2023-07-09T02:22:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0b4910 0x7f577c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f577c0c8d40 0x7f577c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f577c160670 0x7f577c0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c1f5a30 con 0x7f577c0b4910 2023-07-09T02:22:31.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c14f700 con 0x7f577c160670 2023-07-09T02:22:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c1f4e20 con 0x7f577c0c8d40 2023-07-09T02:22:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0b4910 0x7f577c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0b4910 0x7f577c14f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55560/0 (socket says 172.21.15.45:55560) 2023-07-09T02:22:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 -- 172.21.15.45:0/1761611690 learned_addr learned my addr 172.21.15.45:0/1761611690 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f577bfff640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f577c0c8d40 0x7f577c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f57813a8640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f577c160670 0x7f577c0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 -- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f577c0c8d40 msgr2=0x7f577c0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f577c0c8d40 0x7f577c0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 -- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f577c160670 msgr2=0x7f577c0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f577c160670 0x7f577c0b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 -- 172.21.15.45:0/1761611690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700094d0 con 0x7f577c0b4910 2023-07-09T02:22:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5780ba7640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0b4910 0x7f577c14f1c0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f577001b900 tx=0x7f577001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f57797fa640 1 -- 172.21.15.45:0/1761611690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700ba600 con 0x7f577c0b4910 2023-07-09T02:22:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f57797fa640 1 -- 172.21.15.45:0/1761611690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57700ba760 con 0x7f577c0b4910 2023-07-09T02:22:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f57797fa640 1 -- 172.21.15.45:0/1761611690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700bab10 con 0x7f577c0b4910 2023-07-09T02:22:31.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c1f5100 con 0x7f577c0b4910 2023-07-09T02:22:31.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c1f56c0 con 0x7f577c0b4910 2023-07-09T02:22:31.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.204+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c04e020 con 0x7f577c0b4910 2023-07-09T02:22:31.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.208+0000 7f57797fa640 1 -- 172.21.15.45:0/1761611690 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57700bac70 con 0x7f577c0b4910 2023-07-09T02:22:31.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.208+0000 7f57797fa640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f57600662b0 0x7f5760068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.208+0000 7f57797fa640 1 -- 172.21.15.45:0/1761611690 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5770121f70 con 0x7f577c0b4910 2023-07-09T02:22:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.208+0000 7f577bfff640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f57600662b0 0x7f5760068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.208+0000 7f577bfff640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f57600662b0 0x7f5760068760 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f577c0b1460 tx=0x7f5768009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:31.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.212+0000 7f57797fa640 1 -- 172.21.15.45:0/1761611690 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57700ef720 con 0x7f577c0b4910 2023-07-09T02:22:31.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.416+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f577c06a360 con 0x7f577c0b4910 2023-07-09T02:22:31.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.676+0000 7f57797fa640 1 -- 172.21.15.45:0/1761611690 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v544) v1 ==== 131+0+0 (secure 0 0 0) 0x7f57700b5020 con 0x7f577c0b4910 2023-07-09T02:22:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f57600662b0 msgr2=0x7f5760068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f57600662b0 0x7f5760068760 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f577c0b1460 tx=0x7f5768009190 comp rx=0 tx=0).stop 2023-07-09T02:22:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0b4910 msgr2=0x7f577c14f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0b4910 0x7f577c14f1c0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f577001b900 tx=0x7f577001ba90 comp rx=0 tx=0).stop 2023-07-09T02:22:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 shutdown_connections 2023-07-09T02:22:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f577c160670 0x7f577c0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f57600662b0 0x7f5760068760 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f577c0c8d40 0x7f577c0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 --2- 172.21.15.45:0/1761611690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c0b4910 0x7f577c14f1c0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 >> 172.21.15.45:0/1761611690 conn(0x7f577c0d2950 msgr2=0x7f577c0d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:31.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 shutdown_connections 2023-07-09T02:22:31.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.680+0000 7f5781ba9640 1 -- 172.21.15.45:0/1761611690 wait complete. 2023-07-09T02:22:31.701 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-07-09T02:22:31.701 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-07-09T02:22:31.702 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-07-09T02:22:31.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15cf37640 1 Processor -- start 2023-07-09T02:22:31.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15cf37640 1 -- start start 2023-07-09T02:22:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15cf37640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc1580d2620 0x7fc1580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15cf37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580cd120 0x7fc1580cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15cf37640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc158160a50 con 0x7fc15815c060 2023-07-09T02:22:31.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15cf37640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15815c430 con 0x7fc1580d2620 2023-07-09T02:22:31.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15cf37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15815fb60 con 0x7fc1580cd120 2023-07-09T02:22:31.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc155d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc1580d2620 0x7fc1580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15659c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc15815c060 0x7fc1580d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36586/0 (socket says 172.21.15.45:36586) 2023-07-09T02:22:31.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15659c640 1 -- 172.21.15.45:0/2367943205 learned_addr learned my addr 172.21.15.45:0/2367943205 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc156d9d640 1 --2- 172.21.15.45:0/2367943205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580cd120 0x7fc1580cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc155d9b640 1 -- 172.21.15.45:0/2367943205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580cd120 msgr2=0x7fc1580cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc155d9b640 1 --2- 172.21.15.45:0/2367943205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580cd120 0x7fc1580cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc155d9b640 1 -- 172.21.15.45:0/2367943205 >> v1:172.21.15.45:6789/0 conn(0x7fc15815c060 legacy=0x7fc1580d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc155d9b640 1 -- 172.21.15.45:0/2367943205 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15815fe40 con 0x7fc1580d2620 2023-07-09T02:22:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc156d9d640 1 --2- 172.21.15.45:0/2367943205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580cd120 0x7fc1580cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:31.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.848+0000 7fc15559a640 1 -- 172.21.15.45:0/2367943205 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513105521 0 0) 0x7fc158160a50 con 0x7fc15815c060 2023-07-09T02:22:31.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc155d9b640 1 --2- 172.21.15.45:0/2367943205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580d2620 0x7fc1580b4ed0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0097c0 tx=0x7fc14c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426c5b37a6010f46 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:31.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15559a640 1 -- 172.21.15.45:0/2367943205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c0ab650 con 0x7fc1580d2620 2023-07-09T02:22:31.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15559a640 1 -- 172.21.15.45:0/2367943205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14c0ab7b0 con 0x7fc1580d2620 2023-07-09T02:22:31.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15559a640 1 -- 172.21.15.45:0/2367943205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c0abb40 con 0x7fc1580d2620 2023-07-09T02:22:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15cf37640 1 -- 172.21.15.45:0/2367943205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580d2620 msgr2=0x7fc1580b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15cf37640 1 --2- 172.21.15.45:0/2367943205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580d2620 0x7fc1580b4ed0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0097c0 tx=0x7fc14c01c450 comp rx=0 tx=0).stop 2023-07-09T02:22:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15cf37640 1 -- 172.21.15.45:0/2367943205 shutdown_connections 2023-07-09T02:22:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15cf37640 1 --2- 172.21.15.45:0/2367943205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580cd120 0x7fc1580cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15cf37640 1 --2- 172.21.15.45:0/2367943205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580d2620 0x7fc1580b4ed0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15cf37640 1 -- 172.21.15.45:0/2367943205 >> 172.21.15.45:0/2367943205 conn(0x7fc1580698e0 msgr2=0x7fc158069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:31.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15cf37640 1 -- 172.21.15.45:0/2367943205 shutdown_connections 2023-07-09T02:22:31.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.852+0000 7fc15cf37640 1 -- 172.21.15.45:0/2367943205 wait complete. 2023-07-09T02:22:31.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 Processor -- start 2023-07-09T02:22:31.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 -- start start 2023-07-09T02:22:31.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580cd120 0x7fc1580c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580d2620 0x7fc158155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15815c060 0x7fc1580b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158157110 con 0x7fc1580cd120 2023-07-09T02:22:31.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158156870 con 0x7fc15815c060 2023-07-09T02:22:31.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc158156b50 con 0x7fc1580d2620 2023-07-09T02:22:31.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580cd120 0x7fc1580c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580cd120 0x7fc1580c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60956/0 (socket says 172.21.15.45:60956) 2023-07-09T02:22:31.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 -- 172.21.15.45:0/186291318 learned_addr learned my addr 172.21.15.45:0/186291318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:31.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc155d9b640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580d2620 0x7fc158155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc156d9d640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15815c060 0x7fc1580b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 -- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580d2620 msgr2=0x7fc158155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580d2620 0x7fc158155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 -- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15815c060 msgr2=0x7fc1580b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:31.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15815c060 0x7fc1580b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:31.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 -- 172.21.15.45:0/186291318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c009420 con 0x7fc1580cd120 2023-07-09T02:22:31.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15659c640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580cd120 0x7fc1580c8850 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fc1480011f0 tx=0x7fc14800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc146ffd640 1 -- 172.21.15.45:0/186291318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480074e0 con 0x7fc1580cd120 2023-07-09T02:22:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc146ffd640 1 -- 172.21.15.45:0/186291318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148007640 con 0x7fc1580cd120 2023-07-09T02:22:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc146ffd640 1 -- 172.21.15.45:0/186291318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148004a10 con 0x7fc1580cd120 2023-07-09T02:22:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1580b59f0 con 0x7fc1580cd120 2023-07-09T02:22:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15815c6a0 con 0x7fc1580cd120 2023-07-09T02:22:31.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.856+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15804d7d0 con 0x7fc1580cd120 2023-07-09T02:22:31.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.860+0000 7fc146ffd640 1 -- 172.21.15.45:0/186291318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc148004b70 con 0x7fc1580cd120 2023-07-09T02:22:31.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.860+0000 7fc146ffd640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc138066280 0x7fc138068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:31.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.860+0000 7fc146ffd640 1 -- 172.21.15.45:0/186291318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc148082cb0 con 0x7fc1580cd120 2023-07-09T02:22:31.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.860+0000 7fc155d9b640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc138066280 0x7fc138068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:31.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.860+0000 7fc155d9b640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc138066280 0x7fc138068730 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0af000 tx=0x7fc14c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:31.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:31.864+0000 7fc146ffd640 1 -- 172.21.15.45:0/186291318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc148050460 con 0x7fc1580cd120 2023-07-09T02:22:32.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.072+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fc1580b1840 con 0x7fc1580cd120 2023-07-09T02:22:32.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.680+0000 7fc146ffd640 1 -- 172.21.15.45:0/186291318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v545) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc148018070 con 0x7fc1580cd120 2023-07-09T02:22:32.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.680+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc138066280 msgr2=0x7fc138068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:32.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.680+0000 7fc15cf37640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc138066280 0x7fc138068730 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0af000 tx=0x7fc14c0a7000 comp rx=0 tx=0).stop 2023-07-09T02:22:32.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.680+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580cd120 msgr2=0x7fc1580c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:32.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.680+0000 7fc15cf37640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580cd120 0x7fc1580c8850 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fc1480011f0 tx=0x7fc14800c9b0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.684+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 shutdown_connections 2023-07-09T02:22:32.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.684+0000 7fc15cf37640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc15815c060 0x7fc1580b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.684+0000 7fc15cf37640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc138066280 0x7fc138068730 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.684+0000 7fc15cf37640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1580d2620 0x7fc158155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.684+0000 7fc15cf37640 1 --2- 172.21.15.45:0/186291318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1580cd120 0x7fc1580c8850 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.684+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 >> 172.21.15.45:0/186291318 conn(0x7fc1580698e0 msgr2=0x7fc158069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:32.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.684+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 shutdown_connections 2023-07-09T02:22:32.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.684+0000 7fc15cf37640 1 -- 172.21.15.45:0/186291318 wait complete. 2023-07-09T02:22:32.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T02:22:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.852+0000 7f4f19634640 1 Processor -- start 2023-07-09T02:22:32.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f19634640 1 -- start start 2023-07-09T02:22:32.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f19634640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f1415c060 0x7f4f140b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:32.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f19634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140cd120 0x7f4f140d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:32.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f19634640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f14160a50 con 0x7f4f140d2450 2023-07-09T02:22:32.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f19634640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f140d28f0 con 0x7f4f1415c060 2023-07-09T02:22:32.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f19634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140cfe40 con 0x7f4f140cd120 2023-07-09T02:22:32.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f137fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4f140d2450 0x7f4f140d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36602/0 (socket says 172.21.15.45:36602) 2023-07-09T02:22:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f137fe640 1 -- 172.21.15.45:0/109073021 learned_addr learned my addr 172.21.15.45:0/109073021 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f0bfff640 1 --2- 172.21.15.45:0/109073021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140cd120 0x7f4f140d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f12ffd640 1 --2- 172.21.15.45:0/109073021 >> v2:172.21.15.155:3300/0 conn(0x7f4f1415c060 0x7f4f140b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f127fc640 1 -- 172.21.15.45:0/109073021 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785540444 0 0) 0x7f4f14160a50 con 0x7f4f140d2450 2023-07-09T02:22:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f127fc640 1 -- 172.21.15.45:0/109073021 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f00003530 con 0x7f4f140d2450 2023-07-09T02:22:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f0bfff640 1 -- 172.21.15.45:0/109073021 >> v2:172.21.15.155:3300/0 conn(0x7f4f1415c060 msgr2=0x7f4f140b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:32.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f0bfff640 1 --2- 172.21.15.45:0/109073021 >> v2:172.21.15.155:3300/0 conn(0x7f4f1415c060 0x7f4f140b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f0bfff640 1 -- 172.21.15.45:0/109073021 >> v1:172.21.15.45:6789/0 conn(0x7f4f140d2450 legacy=0x7f4f140d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:32.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.856+0000 7f4f0bfff640 1 -- 172.21.15.45:0/109073021 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1415c430 con 0x7f4f140cd120 2023-07-09T02:22:32.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f0bfff640 1 --2- 172.21.15.45:0/109073021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140cd120 0x7f4f140d1f10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0097c0 tx=0x7f4efc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3169ff218667af7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:32.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f127fc640 1 -- 172.21.15.45:0/109073021 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0ab600 con 0x7f4f140cd120 2023-07-09T02:22:32.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f127fc640 1 -- 172.21.15.45:0/109073021 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc0a7050 con 0x7f4f140cd120 2023-07-09T02:22:32.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f127fc640 1 -- 172.21.15.45:0/109073021 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0ab980 con 0x7f4f140cd120 2023-07-09T02:22:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 -- 172.21.15.45:0/109073021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140cd120 msgr2=0x7f4f140d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 --2- 172.21.15.45:0/109073021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140cd120 0x7f4f140d1f10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0097c0 tx=0x7f4efc01c450 comp rx=0 tx=0).stop 2023-07-09T02:22:32.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 -- 172.21.15.45:0/109073021 shutdown_connections 2023-07-09T02:22:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 --2- 172.21.15.45:0/109073021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140cd120 0x7f4f140d1f10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 --2- 172.21.15.45:0/109073021 >> v2:172.21.15.155:3300/0 conn(0x7f4f1415c060 0x7f4f140b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 -- 172.21.15.45:0/109073021 >> 172.21.15.45:0/109073021 conn(0x7f4f140698e0 msgr2=0x7f4f14069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 -- 172.21.15.45:0/109073021 shutdown_connections 2023-07-09T02:22:32.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 -- 172.21.15.45:0/109073021 wait complete. 2023-07-09T02:22:32.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.860+0000 7f4f19634640 1 Processor -- start 2023-07-09T02:22:32.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 -- start start 2023-07-09T02:22:32.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f140cd120 0x7f4f141575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140d2450 0x7f4f140cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f1415c060 0x7f4f140b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f141571d0 con 0x7f4f140cd120 2023-07-09T02:22:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f140cc780 con 0x7f4f1415c060 2023-07-09T02:22:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f14156550 con 0x7f4f140d2450 2023-07-09T02:22:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f140cd120 0x7f4f141575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f140cd120 0x7f4f141575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60966/0 (socket says 172.21.15.45:60966) 2023-07-09T02:22:32.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 -- 172.21.15.45:0/853547485 learned_addr learned my addr 172.21.15.45:0/853547485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f0bfff640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140d2450 0x7f4f140cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:32.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f137fe640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f1415c060 0x7f4f140b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 -- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140d2450 msgr2=0x7f4f140cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140d2450 0x7f4f140cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 -- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f1415c060 msgr2=0x7f4f140b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f1415c060 0x7f4f140b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 -- 172.21.15.45:0/853547485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc009420 con 0x7f4f140cd120 2023-07-09T02:22:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f137fe640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f1415c060 0x7f4f140b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f12ffd640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f140cd120 0x7f4f141575f0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400e870 tx=0x7f4f0400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f0b7fe640 1 -- 172.21.15.45:0/853547485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04009510 con 0x7f4f140cd120 2023-07-09T02:22:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f0b7fe640 1 -- 172.21.15.45:0/853547485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400eec0 con 0x7f4f140cd120 2023-07-09T02:22:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f14156830 con 0x7f4f140cd120 2023-07-09T02:22:32.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f0b7fe640 1 -- 172.21.15.45:0/853547485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400cb40 con 0x7f4f140cd120 2023-07-09T02:22:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f14156df0 con 0x7f4f140cd120 2023-07-09T02:22:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.864+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1406b480 con 0x7f4f140cd120 2023-07-09T02:22:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.868+0000 7f4f0b7fe640 1 -- 172.21.15.45:0/853547485 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f0400cca0 con 0x7f4f140cd120 2023-07-09T02:22:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.868+0000 7f4f0b7fe640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ef4066280 0x7f4ef4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.868+0000 7f4f0b7fe640 1 -- 172.21.15.45:0/853547485 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4f04083ba0 con 0x7f4f140cd120 2023-07-09T02:22:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.868+0000 7f4f0bfff640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ef4066280 0x7f4ef4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.868+0000 7f4f0bfff640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ef4066280 0x7f4ef4068730 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0ad000 tx=0x7f4efc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:32.872+0000 7f4f0b7fe640 1 -- 172.21.15.45:0/853547485 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f040512d0 con 0x7f4f140cd120 2023-07-09T02:22:33.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.024+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4f1404d7d0 con 0x7f4f140cd120 2023-07-09T02:22:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.028+0000 7f4f0b7fe640 1 -- 172.21.15.45:0/853547485 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4f040548f0 con 0x7f4f140cd120 2023-07-09T02:22:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ef4066280 msgr2=0x7f4ef4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ef4066280 0x7f4ef4068730 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0ad000 tx=0x7f4efc008040 comp rx=0 tx=0).stop 2023-07-09T02:22:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f140cd120 msgr2=0x7f4f141575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f140cd120 0x7f4f141575f0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400e870 tx=0x7f4f0400ec70 comp rx=0 tx=0).stop 2023-07-09T02:22:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 shutdown_connections 2023-07-09T02:22:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f1415c060 0x7f4f140b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4ef4066280 0x7f4ef4068730 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f140d2450 0x7f4f140cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 --2- 172.21.15.45:0/853547485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f140cd120 0x7f4f141575f0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 >> 172.21.15.45:0/853547485 conn(0x7f4f140698e0 msgr2=0x7f4f1415b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 shutdown_connections 2023-07-09T02:22:33.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.032+0000 7f4f19634640 1 -- 172.21.15.45:0/853547485 wait complete. 2023-07-09T02:22:33.052 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:22:33.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:22:33.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:22:33.143 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:22:33.144 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:33.144 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:33.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:22:33.154 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:22:33.154 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:33.193 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:22:33.194 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:33.194 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:33.203 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:22:33.205 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:22:33.205 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:33.245 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:22:33.245 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T02:22:33.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:33.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdfd40640 1 Processor -- start 2023-07-09T02:22:33.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdfd40640 1 -- start start 2023-07-09T02:22:33.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdfd40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4bd815c060 0x7f4bd80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdfd40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd8160a50 con 0x7f4bd80cd120 2023-07-09T02:22:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdfd40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd815c430 con 0x7f4bd80d2620 2023-07-09T02:22:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdfd40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd815fb60 con 0x7f4bd815c060 2023-07-09T02:22:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdd2db640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4bd80cd120 0x7f4bd80d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36606/0 (socket says 172.21.15.45:36606) 2023-07-09T02:22:33.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdd2db640 1 -- 172.21.15.45:0/393320007 learned_addr learned my addr 172.21.15.45:0/393320007 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:33.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bddadc640 1 --2- 172.21.15.45:0/393320007 >> v2:172.21.15.155:3300/0 conn(0x7f4bd815c060 0x7f4bd80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774075319 0 0) 0x7f4bd8160a50 con 0x7f4bd80cd120 2023-07-09T02:22:33.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc4003530 con 0x7f4bd80cd120 2023-07-09T02:22:33.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173331491 0 0) 0x7f4bd815c430 con 0x7f4bd80d2620 2023-07-09T02:22:33.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bd8160a50 con 0x7f4bd80d2620 2023-07-09T02:22:33.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910156029 0 0) 0x7f4bc4003530 con 0x7f4bd80cd120 2023-07-09T02:22:33.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 >> v2:172.21.15.155:3300/0 conn(0x7f4bd815c060 msgr2=0x7f4bd80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:33.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 --2- 172.21.15.45:0/393320007 >> v2:172.21.15.155:3300/0 conn(0x7f4bd815c060 0x7f4bd80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 >> v1:172.21.15.155:6789/0 conn(0x7f4bd80d2620 legacy=0x7f4bd80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd815fe40 con 0x7f4bd80cd120 2023-07-09T02:22:33.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f4bc8001680 con 0x7f4bd80cd120 2023-07-09T02:22:33.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 >> v1:172.21.15.45:6789/0 conn(0x7f4bd80cd120 legacy=0x7f4bd80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc4003b10 0x7f4bc4003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.388+0000 7f4bdcada640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc40047d0 0x7f4bc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdcada640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc4005180 0x7f4bc400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd815fb60 con 0x7f4bc40047d0 2023-07-09T02:22:33.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc400bfe0 con 0x7f4bc4003b10 2023-07-09T02:22:33.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc400c1a0 con 0x7f4bc4005180 2023-07-09T02:22:33.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdd2db640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc40047d0 0x7f4bc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bddadc640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc4003b10 0x7f4bc4003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bde2dd640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc4005180 0x7f4bc400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdd2db640 1 -- 172.21.15.45:0/393320007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc4005180 msgr2=0x7f4bc400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:33.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdd2db640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bc4005180 0x7f4bc400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdd2db640 1 -- 172.21.15.45:0/393320007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc4003b10 msgr2=0x7f4bc4003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:33.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdd2db640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc4003b10 0x7f4bc4003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdd2db640 1 -- 172.21.15.45:0/393320007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4003530 con 0x7f4bc40047d0 2023-07-09T02:22:33.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bde2dd640 1 -- 172.21.15.45:0/393320007 reap_dead start 2023-07-09T02:22:33.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdd2db640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc40047d0 0x7f4bc4004c40 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80cd570 tx=0x7f4bc801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5511f958c9ce8d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:33.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80058e0 con 0x7f4bc40047d0 2023-07-09T02:22:33.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8005a60 con 0x7f4bc40047d0 2023-07-09T02:22:33.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.392+0000 7f4bdcada640 1 -- 172.21.15.45:0/393320007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8005e50 con 0x7f4bc40047d0 2023-07-09T02:22:33.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- 172.21.15.45:0/393320007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc40047d0 msgr2=0x7f4bc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc40047d0 0x7f4bc4004c40 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80cd570 tx=0x7f4bc801cb80 comp rx=0 tx=0).stop 2023-07-09T02:22:33.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- 172.21.15.45:0/393320007 shutdown_connections 2023-07-09T02:22:33.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 --2- 172.21.15.45:0/393320007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc40047d0 0x7f4bc4004c40 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- 172.21.15.45:0/393320007 >> 172.21.15.45:0/393320007 conn(0x7f4bd80698e0 msgr2=0x7f4bd8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:33.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- 172.21.15.45:0/393320007 shutdown_connections 2023-07-09T02:22:33.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- 172.21.15.45:0/393320007 wait complete. 2023-07-09T02:22:33.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 Processor -- start 2023-07-09T02:22:33.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- start start 2023-07-09T02:22:33.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc40047d0 0x7f4bd80ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bd80b75f0 0x7f4bd81f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c9b10 0x7f4bd81f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80b6920 con 0x7f4bd80c9b10 2023-07-09T02:22:33.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80ca9f0 con 0x7f4bc40047d0 2023-07-09T02:22:33.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdfd40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80ca0b0 con 0x7f4bd80b75f0 2023-07-09T02:22:33.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bde2dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c9b10 0x7f4bd81f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bde2dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c9b10 0x7f4bd81f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60994/0 (socket says 172.21.15.45:60994) 2023-07-09T02:22:33.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bde2dd640 1 -- 172.21.15.45:0/3944843954 learned_addr learned my addr 172.21.15.45:0/3944843954 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:33.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bdd2db640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bd80b75f0 0x7f4bd81f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bddadc640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc40047d0 0x7f4bd80ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bde2dd640 1 -- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bd80b75f0 msgr2=0x7f4bd81f0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.396+0000 7f4bde2dd640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bd80b75f0 0x7f4bd81f0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bde2dd640 1 -- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc40047d0 msgr2=0x7f4bd80ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bde2dd640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc40047d0 0x7f4bd80ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bde2dd640 1 -- 172.21.15.45:0/3944843954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80b6b30 con 0x7f4bd80c9b10 2023-07-09T02:22:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bdd2db640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bd80b75f0 0x7f4bd81f0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bddadc640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc40047d0 0x7f4bd80ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bde2dd640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c9b10 0x7f4bd81f11e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f4bd806b140 tx=0x7f4bd0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bce7fc640 1 -- 172.21.15.45:0/3944843954 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00137a0 con 0x7f4bd80c9b10 2023-07-09T02:22:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bce7fc640 1 -- 172.21.15.45:0/3944843954 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0013920 con 0x7f4bd80c9b10 2023-07-09T02:22:33.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd80b6e10 con 0x7f4bd80c9b10 2023-07-09T02:22:33.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bce7fc640 1 -- 172.21.15.45:0/3944843954 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0013cd0 con 0x7f4bd80c9b10 2023-07-09T02:22:33.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd80cbef0 con 0x7f4bd80c9b10 2023-07-09T02:22:33.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd804d7d0 con 0x7f4bd80c9b10 2023-07-09T02:22:33.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bce7fc640 1 -- 172.21.15.45:0/3944843954 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bd00203b0 con 0x7f4bd80c9b10 2023-07-09T02:22:33.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bce7fc640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bbc0662b0 0x7f4bbc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bce7fc640 1 -- 172.21.15.45:0/3944843954 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4bd0086240 con 0x7f4bd80c9b10 2023-07-09T02:22:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.400+0000 7f4bddadc640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bbc0662b0 0x7f4bbc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.404+0000 7f4bddadc640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bbc0662b0 0x7f4bbc068760 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4006d50 tx=0x7f4bd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.404+0000 7f4bce7fc640 1 -- 172.21.15.45:0/3944843954 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bd0053940 con 0x7f4bd80c9b10 2023-07-09T02:22:33.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bd806baa0 con 0x7f4bd80c9b10 2023-07-09T02:22:33.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bce7fc640 1 -- 172.21.15.45:0/3944843954 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f4bd001cde0 con 0x7f4bd80c9b10 2023-07-09T02:22:33.596 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:33.596 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2937988619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2937988619},{"type":"v1","addr":"172.21.15.45:6835","nonce":2937988619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7352,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3260423198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3260423198},{"type":"v1","addr":"172.21.15.155:6836","nonce":3260423198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":8197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/202593650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":202593650},{"type":"v1","addr":"172.21.15.45:6833","nonce":202593650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1590703663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1590703663},{"type":"v1","addr":"172.21.15.155:6837","nonce":1590703663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[]} 2023-07-09T02:22:33.596 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 85 2023-07-09T02:22:33.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bbc0662b0 msgr2=0x7f4bbc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bbc0662b0 0x7f4bbc068760 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4006d50 tx=0x7f4bd4008040 comp rx=0 tx=0).stop 2023-07-09T02:22:33.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c9b10 msgr2=0x7f4bd81f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c9b10 0x7f4bd81f11e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f4bd806b140 tx=0x7f4bd0011c10 comp rx=0 tx=0).stop 2023-07-09T02:22:33.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 shutdown_connections 2023-07-09T02:22:33.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bd80c9b10 0x7f4bd81f11e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4bbc0662b0 0x7f4bbc068760 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bd80b75f0 0x7f4bd81f0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 --2- 172.21.15.45:0/3944843954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc40047d0 0x7f4bd80ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 >> 172.21.15.45:0/3944843954 conn(0x7f4bd80698e0 msgr2=0x7f4bd80b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:33.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 shutdown_connections 2023-07-09T02:22:33.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.596+0000 7f4bdfd40640 1 -- 172.21.15.45:0/3944843954 wait complete. 2023-07-09T02:22:33.617 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T02:22:33.617 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T02:22:33.617 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:22:33.617 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:22:33.618 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T02:22:33.618 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T02:22:33.619 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:22:33.619 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:22:33.620 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T02:22:33.620 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T02:22:33.621 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:22:33.621 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:22:33.622 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T02:22:33.622 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T02:22:33.623 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:22:33.623 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:22:33.632 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:22:33.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T02:22:33.633 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:22:33.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T02:22:33.637 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:22:33.637 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T02:22:33.639 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:22:33.639 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T02:22:33.682 INFO:tasks.ceph.mds.c:Started 2023-07-09T02:22:33.682 DEBUG:teuthology.parallel:result is None 2023-07-09T02:22:33.684 INFO:tasks.ceph.mds.a:Started 2023-07-09T02:22:33.684 DEBUG:teuthology.parallel:result is None 2023-07-09T02:22:33.686 INFO:tasks.ceph.mds.b:Started 2023-07-09T02:22:33.687 DEBUG:teuthology.parallel:result is None 2023-07-09T02:22:33.689 INFO:tasks.ceph.mds.d:Started 2023-07-09T02:22:33.690 DEBUG:teuthology.parallel:result is None 2023-07-09T02:22:33.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T02:22:33.772 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-07-09T02:22:33.772 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:22:33.781 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-07-09T02:22:33.781 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2023-07-09T02:22:33.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.836+0000 7f2e4ef82640 1 Processor -- start 2023-07-09T02:22:33.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4ef82640 1 -- start start 2023-07-09T02:22:33.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4ef82640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e4815c060 0x7f2e480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4ef82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e480cd120 0x7f2e480d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4ef82640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e48160a50 con 0x7f2e480d2450 2023-07-09T02:22:33.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4ef82640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480d28f0 con 0x7f2e4815c060 2023-07-09T02:22:33.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4ef82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480cfe40 con 0x7f2e480cd120 2023-07-09T02:22:33.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4d51f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2e480d2450 0x7f2e480d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36614/0 (socket says 172.21.15.45:36614) 2023-07-09T02:22:33.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4d51f640 1 -- 172.21.15.45:0/2290919836 learned_addr learned my addr 172.21.15.45:0/2290919836 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:33.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e47fff640 1 --2- 172.21.15.45:0/2290919836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e480cd120 0x7f2e480d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e4cd1e640 1 --2- 172.21.15.45:0/2290919836 >> v2:172.21.15.155:3300/0 conn(0x7f2e4815c060 0x7f2e480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e477fe640 1 -- 172.21.15.45:0/2290919836 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862495667 0 0) 0x7f2e48160a50 con 0x7f2e480d2450 2023-07-09T02:22:33.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e477fe640 1 -- 172.21.15.45:0/2290919836 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e38003530 con 0x7f2e480d2450 2023-07-09T02:22:33.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e47fff640 1 -- 172.21.15.45:0/2290919836 >> v2:172.21.15.155:3300/0 conn(0x7f2e4815c060 msgr2=0x7f2e480b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:33.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e47fff640 1 --2- 172.21.15.45:0/2290919836 >> v2:172.21.15.155:3300/0 conn(0x7f2e4815c060 0x7f2e480b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e47fff640 1 -- 172.21.15.45:0/2290919836 >> v1:172.21.15.45:6789/0 conn(0x7f2e480d2450 legacy=0x7f2e480d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.840+0000 7f2e47fff640 1 -- 172.21.15.45:0/2290919836 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4815c430 con 0x7f2e480cd120 2023-07-09T02:22:33.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e47fff640 1 --2- 172.21.15.45:0/2290919836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e480cd120 0x7f2e480d1f10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e340097c0 tx=0x7f2e3401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a56de6268e8cf182 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:33.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e477fe640 1 -- 172.21.15.45:0/2290919836 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340ab600 con 0x7f2e480cd120 2023-07-09T02:22:33.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e477fe640 1 -- 172.21.15.45:0/2290919836 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e340a7050 con 0x7f2e480cd120 2023-07-09T02:22:33.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e477fe640 1 -- 172.21.15.45:0/2290919836 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340ab980 con 0x7f2e480cd120 2023-07-09T02:22:33.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 -- 172.21.15.45:0/2290919836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e480cd120 msgr2=0x7f2e480d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/2290919836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e480cd120 0x7f2e480d1f10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e340097c0 tx=0x7f2e3401c450 comp rx=0 tx=0).stop 2023-07-09T02:22:33.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 -- 172.21.15.45:0/2290919836 shutdown_connections 2023-07-09T02:22:33.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/2290919836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e480cd120 0x7f2e480d1f10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/2290919836 >> v2:172.21.15.155:3300/0 conn(0x7f2e4815c060 0x7f2e480b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 -- 172.21.15.45:0/2290919836 >> 172.21.15.45:0/2290919836 conn(0x7f2e480698e0 msgr2=0x7f2e48069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:33.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 -- 172.21.15.45:0/2290919836 shutdown_connections 2023-07-09T02:22:33.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 -- 172.21.15.45:0/2290919836 wait complete. 2023-07-09T02:22:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 Processor -- start 2023-07-09T02:22:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.844+0000 7f2e4ef82640 1 -- start start 2023-07-09T02:22:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e480cd120 0x7f2e48151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e480d2450 0x7f2e480cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e4815c060 0x7f2e48157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480c9cb0 con 0x7f2e480cd120 2023-07-09T02:22:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480b4010 con 0x7f2e480d2450 2023-07-09T02:22:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48152120 con 0x7f2e4815c060 2023-07-09T02:22:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e480cd120 0x7f2e48151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e480cd120 0x7f2e48151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32804/0 (socket says 172.21.15.45:32804) 2023-07-09T02:22:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 -- 172.21.15.45:0/3650117586 learned_addr learned my addr 172.21.15.45:0/3650117586 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4d51f640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e4815c060 0x7f2e48157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e47fff640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e480d2450 0x7f2e480cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 -- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e4815c060 msgr2=0x7f2e48157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e4815c060 0x7f2e48157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 -- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e480d2450 msgr2=0x7f2e480cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e480d2450 0x7f2e480cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 -- 172.21.15.45:0/3650117586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34009420 con 0x7f2e480cd120 2023-07-09T02:22:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4cd1e640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e480cd120 0x7f2e48151be0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00e8a0 tx=0x7f2e3c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e457fa640 1 -- 172.21.15.45:0/3650117586 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c009510 con 0x7f2e480cd120 2023-07-09T02:22:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e457fa640 1 -- 172.21.15.45:0/3650117586 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00c940 con 0x7f2e480cd120 2023-07-09T02:22:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e457fa640 1 -- 172.21.15.45:0/3650117586 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00ccb0 con 0x7f2e480cd120 2023-07-09T02:22:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e480b3440 con 0x7f2e480cd120 2023-07-09T02:22:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e480b39c0 con 0x7f2e480cd120 2023-07-09T02:22:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.848+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4804d7d0 con 0x7f2e480cd120 2023-07-09T02:22:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.852+0000 7f2e457fa640 1 -- 172.21.15.45:0/3650117586 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e3c013470 con 0x7f2e480cd120 2023-07-09T02:22:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.852+0000 7f2e457fa640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e2c066280 0x7f2e2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.852+0000 7f2e457fa640 1 -- 172.21.15.45:0/3650117586 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2e3c083a60 con 0x7f2e480cd120 2023-07-09T02:22:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.852+0000 7f2e47fff640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e2c066280 0x7f2e2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.852+0000 7f2e47fff640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e2c066280 0x7f2e2c068730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2e340ad000 tx=0x7f2e340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:33.856+0000 7f2e457fa640 1 -- 172.21.15.45:0/3650117586 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e3c0512a0 con 0x7f2e480cd120 2023-07-09T02:22:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:34.036+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2e4815d840 con 0x7f2e480cd120 2023-07-09T02:22:35.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.488+0000 7f2e457fa640 1 -- 172.21.15.45:0/3650117586 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v178) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2e3c017080 con 0x7f2e480cd120 2023-07-09T02:22:35.490 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-07-09T02:22:35.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e2c066280 msgr2=0x7f2e2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e2c066280 0x7f2e2c068730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2e340ad000 tx=0x7f2e340a6000 comp rx=0 tx=0).stop 2023-07-09T02:22:35.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e480cd120 msgr2=0x7f2e48151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e480cd120 0x7f2e48151be0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00e8a0 tx=0x7f2e3c00eca0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 shutdown_connections 2023-07-09T02:22:35.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e2c066280 0x7f2e2c068730 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e4815c060 0x7f2e48157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e480d2450 0x7f2e480cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 --2- 172.21.15.45:0/3650117586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e480cd120 0x7f2e48151be0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 >> 172.21.15.45:0/3650117586 conn(0x7f2e480698e0 msgr2=0x7f2e480b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:35.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 shutdown_connections 2023-07-09T02:22:35.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.492+0000 7f2e4ef82640 1 -- 172.21.15.45:0/3650117586 wait complete. 2023-07-09T02:22:35.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T02:22:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da81ad640 1 Processor -- start 2023-07-09T02:22:35.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da81ad640 1 -- start start 2023-07-09T02:22:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da81ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da00c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da81ad640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da00c98c0 con 0x7f1da00cb0d0 2023-07-09T02:22:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da81ad640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da00cd1d0 con 0x7f1da015c110 2023-07-09T02:22:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da81ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00cd4b0 con 0x7f1da00ccc50 2023-07-09T02:22:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da674a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1da00cb0d0 0x7f1da006b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36626/0 (socket says 172.21.15.45:36626) 2023-07-09T02:22:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da674a640 1 -- 172.21.15.45:0/3081712469 learned_addr learned my addr 172.21.15.45:0/3081712469 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.664+0000 7f1da5748640 1 --2- 172.21.15.45:0/3081712469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da00c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da4f47640 1 -- 172.21.15.45:0/3081712469 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863278573 0 0) 0x7f1da00c98c0 con 0x7f1da00cb0d0 2023-07-09T02:22:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da4f47640 1 -- 172.21.15.45:0/3081712469 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8c003530 con 0x7f1da00cb0d0 2023-07-09T02:22:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da4f47640 1 -- 172.21.15.45:0/3081712469 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980090166 0 0) 0x7f1da00cd1d0 con 0x7f1da015c110 2023-07-09T02:22:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da4f47640 1 -- 172.21.15.45:0/3081712469 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1da00c98c0 con 0x7f1da015c110 2023-07-09T02:22:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da5748640 1 -- 172.21.15.45:0/3081712469 >> v1:172.21.15.155:6789/0 conn(0x7f1da015c110 legacy=0x7f1da01607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da5748640 1 -- 172.21.15.45:0/3081712469 >> v1:172.21.15.45:6789/0 conn(0x7f1da00cb0d0 legacy=0x7f1da006b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da5748640 1 -- 172.21.15.45:0/3081712469 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00c9270 con 0x7f1da00ccc50 2023-07-09T02:22:35.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da5748640 1 --2- 172.21.15.45:0/3081712469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da00c9d50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d900097f0 tx=0x7f1d9001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=986154665a5540fa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:35.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da4f47640 1 -- 172.21.15.45:0/3081712469 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900ac640 con 0x7f1da00ccc50 2023-07-09T02:22:35.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da4f47640 1 -- 172.21.15.45:0/3081712469 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900ac7a0 con 0x7f1da00ccc50 2023-07-09T02:22:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da4f47640 1 -- 172.21.15.45:0/3081712469 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900acb30 con 0x7f1da00ccc50 2023-07-09T02:22:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da81ad640 1 -- 172.21.15.45:0/3081712469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 msgr2=0x7f1da00c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.668+0000 7f1da81ad640 1 --2- 172.21.15.45:0/3081712469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da00c9d50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d900097f0 tx=0x7f1d9001c400 comp rx=0 tx=0).stop 2023-07-09T02:22:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 -- 172.21.15.45:0/3081712469 shutdown_connections 2023-07-09T02:22:35.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 --2- 172.21.15.45:0/3081712469 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da00c9d50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 -- 172.21.15.45:0/3081712469 >> 172.21.15.45:0/3081712469 conn(0x7f1da00694b0 msgr2=0x7f1da00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:35.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 -- 172.21.15.45:0/3081712469 shutdown_connections 2023-07-09T02:22:35.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 -- 172.21.15.45:0/3081712469 wait complete. 2023-07-09T02:22:35.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 Processor -- start 2023-07-09T02:22:35.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 -- start start 2023-07-09T02:22:35.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1da00cb0d0 0x7f1da0155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:35.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da0151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:35.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1da015c110 0x7f1da01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00c7220 con 0x7f1da00cb0d0 2023-07-09T02:22:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00c65a0 con 0x7f1da015c110 2023-07-09T02:22:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da81ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00c6880 con 0x7f1da00ccc50 2023-07-09T02:22:35.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5f49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1da00cb0d0 0x7f1da0155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:35.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5f49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1da00cb0d0 0x7f1da0155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32814/0 (socket says 172.21.15.45:32814) 2023-07-09T02:22:35.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5f49640 1 -- 172.21.15.45:0/2064829573 learned_addr learned my addr 172.21.15.45:0/2064829573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:35.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5748640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da0151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:35.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da674a640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1da015c110 0x7f1da01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:35.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5f49640 1 -- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 msgr2=0x7f1da0151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5f49640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da0151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5f49640 1 -- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1da015c110 msgr2=0x7f1da01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5f49640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1da015c110 0x7f1da01519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.672+0000 7f1da5f49640 1 -- 172.21.15.45:0/2064829573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d90009420 con 0x7f1da00cb0d0 2023-07-09T02:22:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1da5f49640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1da00cb0d0 0x7f1da0155aa0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c430 tx=0x7f1d9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1d967fc640 1 -- 172.21.15.45:0/2064829573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0052d0 con 0x7f1da00cb0d0 2023-07-09T02:22:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1d967fc640 1 -- 172.21.15.45:0/2064829573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c005450 con 0x7f1da00cb0d0 2023-07-09T02:22:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da00c6b60 con 0x7f1da00cb0d0 2023-07-09T02:22:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1d967fc640 1 -- 172.21.15.45:0/2064829573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c003840 con 0x7f1da00cb0d0 2023-07-09T02:22:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da0155fe0 con 0x7f1da00cb0d0 2023-07-09T02:22:35.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da004d7d0 con 0x7f1da00cb0d0 2023-07-09T02:22:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1d967fc640 1 -- 172.21.15.45:0/2064829573 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d9c0039a0 con 0x7f1da00cb0d0 2023-07-09T02:22:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1d967fc640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d84066280 0x7f1d84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1d967fc640 1 -- 172.21.15.45:0/2064829573 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1d9c082fa0 con 0x7f1da00cb0d0 2023-07-09T02:22:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.676+0000 7f1da5748640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d84066280 0x7f1d84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.680+0000 7f1da5748640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d84066280 0x7f1d84068730 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1d900ae000 tx=0x7f1d90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.680+0000 7f1d967fc640 1 -- 172.21.15.45:0/2064829573 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d9c050810 con 0x7f1da00cb0d0 2023-07-09T02:22:35.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1da00c9ef0 con 0x7f1da00cb0d0 2023-07-09T02:22:35.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1d967fc640 1 -- 172.21.15.45:0/2064829573 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1d9c053e30 con 0x7f1da00cb0d0 2023-07-09T02:22:35.889 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:35.889 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:22:35.889 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-07-09T02:22:35.889 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.889 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-07-09T02:22:35.890 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkkCsJEBAAWQZ7o9Tl+1+lZvvFXUzR1Q==", 2023-07-09T02:22:35.890 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.890 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:22:35.890 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:22:35.890 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:22:35.890 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.890 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.891 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.891 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-07-09T02:22:35.891 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkFj+jHBAAfKMqYHheRLS87Q3LtNn9Yg==", 2023-07-09T02:22:35.891 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.891 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:22:35.891 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:22:35.892 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:22:35.892 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.892 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.892 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.892 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.892 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-07-09T02:22:35.892 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkYqCQFxAAGXckywo7oliAcTo3ovRnLw==", 2023-07-09T02:22:35.893 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:22:35.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:22:35.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:22:35.893 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.893 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.893 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.894 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-07-09T02:22:35.894 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkORA6JBAAGIoymfQv//R3SfVKRQX5YA==", 2023-07-09T02:22:35.894 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.894 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:22:35.894 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:22:35.894 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:22:35.894 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.894 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.895 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.895 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-07-09T02:22:35.895 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkcCd1DhAAAxOqT+/u9R9l677UgpjyPQ==", 2023-07-09T02:22:35.895 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.895 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:22:35.896 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:22:35.896 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.896 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.896 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.896 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-07-09T02:22:35.896 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkTriuFhAA6+wmGdjS80IaHiOz3jtFrw==", 2023-07-09T02:22:35.897 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.897 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:22:35.897 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:22:35.897 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.897 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.897 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.897 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-07-09T02:22:35.898 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkXv2FHhAAaV5SDmKw7Fg+f0ZEHa8kZg==", 2023-07-09T02:22:35.898 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.898 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:22:35.898 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:22:35.898 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.898 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-07-09T02:22:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAsF6pkOj9hJhAAGtUKV6z8UxhQ1eIaHNGl4Q==", 2023-07-09T02:22:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:22:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:22:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.900 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.900 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-07-09T02:22:35.900 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkRfuUMhAAUFA05Xt42vaN4aWopD9D9g==", 2023-07-09T02:22:35.900 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.900 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:22:35.900 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:22:35.900 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.901 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.901 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.901 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-07-09T02:22:35.901 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvF6pkfwoPOxAArUVjs73H7tsRoscWWRlccA==", 2023-07-09T02:22:35.901 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.901 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:22:35.902 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:22:35.902 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.902 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.902 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.902 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-07-09T02:22:35.902 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pk06QRCBAAd4Xj5c0AXnNy6VfDDFWTdA==", 2023-07-09T02:22:35.902 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.903 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:22:35.903 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:22:35.903 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.903 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.903 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.904 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-07-09T02:22:35.904 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAwF6pkxVNsEBAA4bfyrUhDMHatjhRLg8bIDQ==", 2023-07-09T02:22:35.904 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.904 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-07-09T02:22:35.904 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-07-09T02:22:35.904 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.904 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.905 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.905 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-07-09T02:22:35.905 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg==", 2023-07-09T02:22:35.905 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.905 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:22:35.905 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-07-09T02:22:35.906 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T02:22:35.906 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.906 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.906 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-07-09T02:22:35.906 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkzI1fMhAAgta/7emIo1ScM3SKZAG39w==", 2023-07-09T02:22:35.906 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.907 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:22:35.907 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:22:35.907 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:22:35.907 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:22:35.907 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.907 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.907 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.907 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-07-09T02:22:35.908 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkvgmuLhAAwAFCKADkkTPAOmDgqEVuAQ==", 2023-07-09T02:22:35.908 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.908 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:22:35.908 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:22:35.908 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:22:35.908 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:22:35.908 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.909 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.909 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-07-09T02:22:35.909 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pkI6OWOBAAFbbXfe0xlEEmkQBgtNz6pA==", 2023-07-09T02:22:35.909 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.909 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-07-09T02:22:35.909 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-07-09T02:22:35.910 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-07-09T02:22:35.910 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-07-09T02:22:35.910 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.910 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.910 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.910 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-07-09T02:22:35.910 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQApF6pkW157LhAAUMSk+C8SBv62jWp8iOiI+w==", 2023-07-09T02:22:35.910 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.911 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:22:35.911 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-07-09T02:22:35.911 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-07-09T02:22:35.911 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.911 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.911 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.911 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-07-09T02:22:35.912 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pk04yHCxAA+zF9d0Rxw1ba7y04sr7DLA==", 2023-07-09T02:22:35.912 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.912 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:22:35.912 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:22:35.912 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.912 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:35.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:35.913 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-07-09T02:22:35.913 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAqF6pksiCYBxAAacSjhKHtm+CuaOs0fRkbeQ==", 2023-07-09T02:22:35.913 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-07-09T02:22:35.913 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-07-09T02:22:35.913 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-07-09T02:22:35.914 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-07-09T02:22:35.914 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.914 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:35.914 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:35.914 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:22:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d84066280 msgr2=0x7f1d84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d84066280 0x7f1d84068730 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1d900ae000 tx=0x7f1d90008040 comp rx=0 tx=0).stop 2023-07-09T02:22:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1da00cb0d0 msgr2=0x7f1da0155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1da00cb0d0 0x7f1da0155aa0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c430 tx=0x7f1d9c00c8f0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 shutdown_connections 2023-07-09T02:22:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1da015c110 0x7f1da01519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d84066280 0x7f1d84068730 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1da00ccc50 0x7f1da0151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 --2- 172.21.15.45:0/2064829573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1da00cb0d0 0x7f1da0155aa0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 >> 172.21.15.45:0/2064829573 conn(0x7f1da00694b0 msgr2=0x7f1da00b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 shutdown_connections 2023-07-09T02:22:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:35.888+0000 7f1da81ad640 1 -- 172.21.15.45:0/2064829573 wait complete. 2023-07-09T02:22:35.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec8d2d8640 1 Processor -- start 2023-07-09T02:22:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec8d2d8640 1 -- start start 2023-07-09T02:22:36.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec8d2d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec8806a5c0 0x7fec8815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec8d2d8640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec88071140 con 0x7fec8806aa40 2023-07-09T02:22:36.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec8d2d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8806b010 con 0x7fec880cd290 2023-07-09T02:22:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec8d2d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8815c970 con 0x7fec8806a5c0 2023-07-09T02:22:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec877fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fec8806aa40 0x7fec88160310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36628/0 (socket says 172.21.15.45:36628) 2023-07-09T02:22:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec877fe640 1 -- 172.21.15.45:0/4267218682 learned_addr learned my addr 172.21.15.45:0/4267218682 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec7ffff640 1 --2- 172.21.15.45:0/4267218682 >> v2:172.21.15.155:3300/0 conn(0x7fec8806a5c0 0x7fec8815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec867fc640 1 -- 172.21.15.45:0/4267218682 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357355950 0 0) 0x7fec88071140 con 0x7fec8806aa40 2023-07-09T02:22:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec867fc640 1 -- 172.21.15.45:0/4267218682 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec74003530 con 0x7fec8806aa40 2023-07-09T02:22:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec867fc640 1 -- 172.21.15.45:0/4267218682 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683973769 0 0) 0x7fec8806b010 con 0x7fec880cd290 2023-07-09T02:22:36.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec867fc640 1 -- 172.21.15.45:0/4267218682 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec88071140 con 0x7fec880cd290 2023-07-09T02:22:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec7ffff640 1 -- 172.21.15.45:0/4267218682 >> v1:172.21.15.155:6789/0 conn(0x7fec880cd290 legacy=0x7fec880cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec7ffff640 1 -- 172.21.15.45:0/4267218682 >> v1:172.21.15.45:6789/0 conn(0x7fec8806aa40 legacy=0x7fec88160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.064+0000 7fec7ffff640 1 -- 172.21.15.45:0/4267218682 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8815cc50 con 0x7fec8806a5c0 2023-07-09T02:22:36.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec7ffff640 1 --2- 172.21.15.45:0/4267218682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec8806a5c0 0x7fec8815fdd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fec700097c0 tx=0x7fec7001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df78eb9b7988232a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec867fc640 1 -- 172.21.15.45:0/4267218682 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700ab600 con 0x7fec8806a5c0 2023-07-09T02:22:36.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec867fc640 1 -- 172.21.15.45:0/4267218682 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec700a7050 con 0x7fec8806a5c0 2023-07-09T02:22:36.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec867fc640 1 -- 172.21.15.45:0/4267218682 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700ab960 con 0x7fec8806a5c0 2023-07-09T02:22:36.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec8d2d8640 1 -- 172.21.15.45:0/4267218682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec8806a5c0 msgr2=0x7fec8815fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec8d2d8640 1 --2- 172.21.15.45:0/4267218682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec8806a5c0 0x7fec8815fdd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fec700097c0 tx=0x7fec7001c480 comp rx=0 tx=0).stop 2023-07-09T02:22:36.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec8d2d8640 1 -- 172.21.15.45:0/4267218682 shutdown_connections 2023-07-09T02:22:36.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec8d2d8640 1 --2- 172.21.15.45:0/4267218682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec8806a5c0 0x7fec8815fdd0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec8d2d8640 1 -- 172.21.15.45:0/4267218682 >> 172.21.15.45:0/4267218682 conn(0x7fec8806d140 msgr2=0x7fec8806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:36.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec8d2d8640 1 -- 172.21.15.45:0/4267218682 shutdown_connections 2023-07-09T02:22:36.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.068+0000 7fec8d2d8640 1 -- 172.21.15.45:0/4267218682 wait complete. 2023-07-09T02:22:36.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 Processor -- start 2023-07-09T02:22:36.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 -- start start 2023-07-09T02:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec8806a5c0 0x7fec880c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec8806aa40 0x7fec88154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880cd290 0x7fec880adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88154ba0 con 0x7fec8806a5c0 2023-07-09T02:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec880c7320 con 0x7fec880cd290 2023-07-09T02:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec880acbe0 con 0x7fec8806aa40 2023-07-09T02:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec8806a5c0 0x7fec880c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec8806a5c0 0x7fec880c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32830/0 (socket says 172.21.15.45:32830) 2023-07-09T02:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 -- 172.21.15.45:0/2146602931 learned_addr learned my addr 172.21.15.45:0/2146602931 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec7ffff640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec8806aa40 0x7fec88154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec877fe640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880cd290 0x7fec880adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 -- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec8806aa40 msgr2=0x7fec88154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec8806aa40 0x7fec88154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 -- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880cd290 msgr2=0x7fec880adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880cd290 0x7fec880adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 -- 172.21.15.45:0/2146602931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec70009420 con 0x7fec8806a5c0 2023-07-09T02:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec877fe640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880cd290 0x7fec880adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec86ffd640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec8806a5c0 0x7fec880c6b00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c460 tx=0x7fec7800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2146602931 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780052d0 con 0x7fec8806a5c0 2023-07-09T02:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2146602931 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78005450 con 0x7fec8806a5c0 2023-07-09T02:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2146602931 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78003840 con 0x7fec8806a5c0 2023-07-09T02:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec880acec0 con 0x7fec8806a5c0 2023-07-09T02:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.072+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec880ad480 con 0x7fec8806a5c0 2023-07-09T02:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.076+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8804d7d0 con 0x7fec8806a5c0 2023-07-09T02:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.076+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2146602931 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec780039a0 con 0x7fec8806a5c0 2023-07-09T02:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.076+0000 7fec7f7fe640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec68066280 0x7fec68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.076+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2146602931 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fec78082ed0 con 0x7fec8806a5c0 2023-07-09T02:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.076+0000 7fec7ffff640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec68066280 0x7fec68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.076+0000 7fec7ffff640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec68066280 0x7fec68068730 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fec700ad000 tx=0x7fec700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.080+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2146602931 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec78050740 con 0x7fec8806a5c0 2023-07-09T02:22:36.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.236+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec880af680 con 0x7fec8806a5c0 2023-07-09T02:22:36.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.236+0000 7fec7f7fe640 1 -- 172.21.15.45:0/2146602931 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+14651 (secure 0 0 0) 0x7fec78053d60 con 0x7fec8806a5c0 2023-07-09T02:22:36.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:36.238 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":178,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:35.487163+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:36.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec68066280 msgr2=0x7fec68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec68066280 0x7fec68068730 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fec700ad000 tx=0x7fec700a6000 comp rx=0 tx=0).stop 2023-07-09T02:22:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec8806a5c0 msgr2=0x7fec880c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec8806a5c0 0x7fec880c6b00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c460 tx=0x7fec7800c920 comp rx=0 tx=0).stop 2023-07-09T02:22:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 shutdown_connections 2023-07-09T02:22:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec880cd290 0x7fec880adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fec68066280 0x7fec68068730 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec8806aa40 0x7fec88154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 --2- 172.21.15.45:0/2146602931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec8806a5c0 0x7fec880c6b00 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 >> 172.21.15.45:0/2146602931 conn(0x7fec8806d140 msgr2=0x7fec88159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 shutdown_connections 2023-07-09T02:22:36.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.240+0000 7fec8d2d8640 1 -- 172.21.15.45:0/2146602931 wait complete. 2023-07-09T02:22:36.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:22:36.260 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:22:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f833713a640 1 Processor -- start 2023-07-09T02:22:36.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f833713a640 1 -- start start 2023-07-09T02:22:36.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f833713a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f83300d2620 0x7f83300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f833713a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8330160a50 con 0x7f83300cd120 2023-07-09T02:22:36.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f833713a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833015c430 con 0x7f833015c060 2023-07-09T02:22:36.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f833713a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833015fb60 con 0x7f83300d2620 2023-07-09T02:22:36.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f83356d7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f83300cd120 0x7f83300cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36634/0 (socket says 172.21.15.45:36634) 2023-07-09T02:22:36.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f83356d7640 1 -- 172.21.15.45:0/1400632375 learned_addr learned my addr 172.21.15.45:0/1400632375 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:36.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f832ffff640 1 --2- 172.21.15.45:0/1400632375 >> v2:172.21.15.155:3300/0 conn(0x7f83300d2620 0x7f83300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f832f7fe640 1 -- 172.21.15.45:0/1400632375 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609441123 0 0) 0x7f8330160a50 con 0x7f83300cd120 2023-07-09T02:22:36.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f832f7fe640 1 -- 172.21.15.45:0/1400632375 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8320003530 con 0x7f83300cd120 2023-07-09T02:22:36.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f832ffff640 1 -- 172.21.15.45:0/1400632375 >> v1:172.21.15.155:6789/0 conn(0x7f833015c060 legacy=0x7f83300d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f832ffff640 1 -- 172.21.15.45:0/1400632375 >> v1:172.21.15.45:6789/0 conn(0x7f83300cd120 legacy=0x7f83300cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.408+0000 7f832ffff640 1 -- 172.21.15.45:0/1400632375 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833015fe40 con 0x7f83300d2620 2023-07-09T02:22:36.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f832ffff640 1 --2- 172.21.15.45:0/1400632375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300d2620 0x7f83300b4ed0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f831c0097c0 tx=0x7f831c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4c2fd99e82697a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f832f7fe640 1 -- 172.21.15.45:0/1400632375 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c0ab650 con 0x7f83300d2620 2023-07-09T02:22:36.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f832f7fe640 1 -- 172.21.15.45:0/1400632375 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c0ab7b0 con 0x7f83300d2620 2023-07-09T02:22:36.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f832f7fe640 1 -- 172.21.15.45:0/1400632375 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c0abb40 con 0x7f83300d2620 2023-07-09T02:22:36.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f833713a640 1 -- 172.21.15.45:0/1400632375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300d2620 msgr2=0x7f83300b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f833713a640 1 --2- 172.21.15.45:0/1400632375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300d2620 0x7f83300b4ed0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f831c0097c0 tx=0x7f831c01c450 comp rx=0 tx=0).stop 2023-07-09T02:22:36.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f833713a640 1 -- 172.21.15.45:0/1400632375 shutdown_connections 2023-07-09T02:22:36.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f833713a640 1 --2- 172.21.15.45:0/1400632375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300d2620 0x7f83300b4ed0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f833713a640 1 -- 172.21.15.45:0/1400632375 >> 172.21.15.45:0/1400632375 conn(0x7f83300698e0 msgr2=0x7f8330069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:36.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f833713a640 1 -- 172.21.15.45:0/1400632375 shutdown_connections 2023-07-09T02:22:36.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f833713a640 1 -- 172.21.15.45:0/1400632375 wait complete. 2023-07-09T02:22:36.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.412+0000 7f833713a640 1 Processor -- start 2023-07-09T02:22:36.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 -- start start 2023-07-09T02:22:36.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300cd120 0x7f8330150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83300d2620 0x7f833015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f833015c060 0x7f83300b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83300cb140 con 0x7f833015c060 2023-07-09T02:22:36.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83300cb420 con 0x7f83300cd120 2023-07-09T02:22:36.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83300cb700 con 0x7f83300d2620 2023-07-09T02:22:36.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f833015c060 0x7f83300b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f833015c060 0x7f83300b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32846/0 (socket says 172.21.15.45:32846) 2023-07-09T02:22:36.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 -- 172.21.15.45:0/1453870183 learned_addr learned my addr 172.21.15.45:0/1453870183 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:36.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f832ffff640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83300d2620 0x7f833015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f8334ed6640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300cd120 0x7f8330150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 -- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83300d2620 msgr2=0x7f833015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83300d2620 0x7f833015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 -- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300cd120 msgr2=0x7f8330150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300cd120 0x7f8330150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 -- 172.21.15.45:0/1453870183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c009420 con 0x7f833015c060 2023-07-09T02:22:36.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f83356d7640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f833015c060 0x7f83300b5de0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f832800cb40 tx=0x7f832800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f832d7fa640 1 -- 172.21.15.45:0/1453870183 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800aca0 con 0x7f833015c060 2023-07-09T02:22:36.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f832d7fa640 1 -- 172.21.15.45:0/1453870183 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832800ae00 con 0x7f833015c060 2023-07-09T02:22:36.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83300b59f0 con 0x7f833015c060 2023-07-09T02:22:36.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f832d7fa640 1 -- 172.21.15.45:0/1453870183 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328012620 con 0x7f833015c060 2023-07-09T02:22:36.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833015dfe0 con 0x7f833015c060 2023-07-09T02:22:36.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.416+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83300cb280 con 0x7f833015c060 2023-07-09T02:22:36.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.420+0000 7f832d7fa640 1 -- 172.21.15.45:0/1453870183 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8328007070 con 0x7f833015c060 2023-07-09T02:22:36.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.420+0000 7f832d7fa640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8314066280 0x7f8314068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.420+0000 7f832d7fa640 1 -- 172.21.15.45:0/1453870183 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8328083a40 con 0x7f833015c060 2023-07-09T02:22:36.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.420+0000 7f8334ed6640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8314066280 0x7f8314068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.420+0000 7f8334ed6640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8314066280 0x7f8314068730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8324007fd0 tx=0x7f8324009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.424+0000 7f832d7fa640 1 -- 172.21.15.45:0/1453870183 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83300cb280 con 0x7f833015c060 2023-07-09T02:22:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.576+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83300cb280 con 0x7f833015c060 2023-07-09T02:22:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f832d7fa640 1 -- 172.21.15.45:0/1453870183 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v178) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83300cb280 con 0x7f833015c060 2023-07-09T02:22:36.579 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:22:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8314066280 msgr2=0x7f8314068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8314066280 0x7f8314068730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f8324007fd0 tx=0x7f8324009040 comp rx=0 tx=0).stop 2023-07-09T02:22:36.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f833015c060 msgr2=0x7f83300b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f833015c060 0x7f83300b5de0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f832800cb40 tx=0x7f832800a060 comp rx=0 tx=0).stop 2023-07-09T02:22:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 shutdown_connections 2023-07-09T02:22:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f833015c060 0x7f83300b5de0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8314066280 0x7f8314068730 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83300d2620 0x7f833015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 --2- 172.21.15.45:0/1453870183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83300cd120 0x7f8330150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 >> 172.21.15.45:0/1453870183 conn(0x7f83300698e0 msgr2=0x7f83300c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 shutdown_connections 2023-07-09T02:22:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.580+0000 7f833713a640 1 -- 172.21.15.45:0/1453870183 wait complete. 2023-07-09T02:22:36.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:22:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35afeec640 1 Processor -- start 2023-07-09T02:22:36.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35afeec640 1 -- start start 2023-07-09T02:22:36.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35afeec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35a815c060 0x7f35a80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35afeec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35a80d2620 0x7f35a80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35afeec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a8160a50 con 0x7f35a80cd120 2023-07-09T02:22:36.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35afeec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a815c430 con 0x7f35a815c060 2023-07-09T02:22:36.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35afeec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a815fb60 con 0x7f35a80d2620 2023-07-09T02:22:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35adc88640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35a815c060 0x7f35a80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35adc88640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35a815c060 0x7f35a80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32854/0 (socket says 172.21.15.45:32854) 2023-07-09T02:22:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35adc88640 1 -- 172.21.15.45:0/2880815049 learned_addr learned my addr 172.21.15.45:0/2880815049 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35ae489640 1 --2- 172.21.15.45:0/2880815049 >> v2:172.21.15.155:3300/0 conn(0x7f35a80d2620 0x7f35a80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35adc88640 1 -- 172.21.15.45:0/2880815049 >> v2:172.21.15.155:3300/0 conn(0x7f35a80d2620 msgr2=0x7f35a80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:36.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35adc88640 1 --2- 172.21.15.45:0/2880815049 >> v2:172.21.15.155:3300/0 conn(0x7f35a80d2620 0x7f35a80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35adc88640 1 -- 172.21.15.45:0/2880815049 >> v1:172.21.15.155:6789/0 conn(0x7f35a80cd120 legacy=0x7f35a80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:36.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.748+0000 7f35adc88640 1 -- 172.21.15.45:0/2880815049 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a815fe40 con 0x7f35a815c060 2023-07-09T02:22:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35adc88640 1 --2- 172.21.15.45:0/2880815049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a80b4ed0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f35a808bca0 tx=0x7f35a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f834f8b7da99ddec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35acc86640 1 -- 172.21.15.45:0/2880815049 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a40aa5f0 con 0x7f35a815c060 2023-07-09T02:22:36.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35acc86640 1 -- 172.21.15.45:0/2880815049 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a40aa750 con 0x7f35a815c060 2023-07-09T02:22:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35acc86640 1 -- 172.21.15.45:0/2880815049 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a40aaae0 con 0x7f35a815c060 2023-07-09T02:22:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35afeec640 1 -- 172.21.15.45:0/2880815049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 msgr2=0x7f35a80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35afeec640 1 --2- 172.21.15.45:0/2880815049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a80b4ed0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f35a808bca0 tx=0x7f35a401c490 comp rx=0 tx=0).stop 2023-07-09T02:22:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35afeec640 1 -- 172.21.15.45:0/2880815049 shutdown_connections 2023-07-09T02:22:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35afeec640 1 --2- 172.21.15.45:0/2880815049 >> v2:172.21.15.155:3300/0 conn(0x7f35a80d2620 0x7f35a80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35afeec640 1 --2- 172.21.15.45:0/2880815049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a80b4ed0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35afeec640 1 -- 172.21.15.45:0/2880815049 >> 172.21.15.45:0/2880815049 conn(0x7f35a80698e0 msgr2=0x7f35a8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35afeec640 1 -- 172.21.15.45:0/2880815049 shutdown_connections 2023-07-09T02:22:36.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.752+0000 7f35afeec640 1 -- 172.21.15.45:0/2880815049 wait complete. 2023-07-09T02:22:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 Processor -- start 2023-07-09T02:22:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 -- start start 2023-07-09T02:22:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a80cd120 0x7f35a8152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a80d2620 0x7f35a815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a815de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8153170 con 0x7f35a815c060 2023-07-09T02:22:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8152590 con 0x7f35a80cd120 2023-07-09T02:22:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a815aef0 con 0x7f35a80d2620 2023-07-09T02:22:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a815de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a815de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32864/0 (socket says 172.21.15.45:32864) 2023-07-09T02:22:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 -- 172.21.15.45:0/1563136632 learned_addr learned my addr 172.21.15.45:0/1563136632 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35adc88640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a80cd120 0x7f35a8152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ad487640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a80d2620 0x7f35a815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 -- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a80d2620 msgr2=0x7f35a815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a80d2620 0x7f35a815a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 -- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a80cd120 msgr2=0x7f35a8152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a80cd120 0x7f35a8152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 -- 172.21.15.45:0/1563136632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40094d0 con 0x7f35a815c060 2023-07-09T02:22:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35adc88640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a80cd120 0x7f35a8152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ad487640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a80d2620 0x7f35a815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35ae489640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a815de90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007e10 tx=0x7f35a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f359e7fc640 1 -- 172.21.15.45:0/1563136632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0014620 con 0x7f35a815c060 2023-07-09T02:22:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f359e7fc640 1 -- 172.21.15.45:0/1563136632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a00147a0 con 0x7f35a815c060 2023-07-09T02:22:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f359e7fc640 1 -- 172.21.15.45:0/1563136632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0014b50 con 0x7f35a815c060 2023-07-09T02:22:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a80b59f0 con 0x7f35a815c060 2023-07-09T02:22:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.756+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a815b750 con 0x7f35a815c060 2023-07-09T02:22:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.760+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a80b8a10 con 0x7f35a815c060 2023-07-09T02:22:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.760+0000 7f359e7fc640 1 -- 172.21.15.45:0/1563136632 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35a0014cb0 con 0x7f35a815c060 2023-07-09T02:22:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.760+0000 7f359e7fc640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f358c066280 0x7f358c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.760+0000 7f359e7fc640 1 -- 172.21.15.45:0/1563136632 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35a0084340 con 0x7f35a815c060 2023-07-09T02:22:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.760+0000 7f35adc88640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f358c066280 0x7f358c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:36.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.760+0000 7f35adc88640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f358c066280 0x7f358c068730 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f35a40ae000 tx=0x7f35a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.764+0000 7f359e7fc640 1 -- 172.21.15.45:0/1563136632 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35a0051b00 con 0x7f35a815c060 2023-07-09T02:22:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.916+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35a804d7d0 con 0x7f35a815c060 2023-07-09T02:22:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.916+0000 7f359e7fc640 1 -- 172.21.15.45:0/1563136632 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v178) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35a0055120 con 0x7f35a815c060 2023-07-09T02:22:36.919 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:22:36.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f358c066280 msgr2=0x7f358c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f358c066280 0x7f358c068730 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f35a40ae000 tx=0x7f35a4008040 comp rx=0 tx=0).stop 2023-07-09T02:22:36.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 msgr2=0x7f35a815de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:36.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a815de90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007e10 tx=0x7f35a000e4b0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 shutdown_connections 2023-07-09T02:22:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a815c060 0x7f35a815de90 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f358c066280 0x7f358c068730 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35a80d2620 0x7f35a815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 --2- 172.21.15.45:0/1563136632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35a80cd120 0x7f35a8152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 >> 172.21.15.45:0/1563136632 conn(0x7f35a80698e0 msgr2=0x7f35a8158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 shutdown_connections 2023-07-09T02:22:36.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:36.920+0000 7f35afeec640 1 -- 172.21.15.45:0/1563136632 wait complete. 2023-07-09T02:22:36.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T02:22:37.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.080+0000 7f9b5c87b640 1 Processor -- start 2023-07-09T02:22:37.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.080+0000 7f9b5c87b640 1 -- start start 2023-07-09T02:22:37.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5c87b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9b5815c060 0x7f9b580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5c87b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b58160a50 con 0x7f9b580cd120 2023-07-09T02:22:37.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5c87b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5815c430 con 0x7f9b580d2620 2023-07-09T02:22:37.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5c87b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5815fb60 con 0x7f9b5815c060 2023-07-09T02:22:37.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b55d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9b580cd120 0x7f9b580d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36642/0 (socket says 172.21.15.45:36642) 2023-07-09T02:22:37.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b55d9b640 1 -- 172.21.15.45:0/3753825771 learned_addr learned my addr 172.21.15.45:0/3753825771 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:37.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5659c640 1 --2- 172.21.15.45:0/3753825771 >> v2:172.21.15.155:3300/0 conn(0x7f9b5815c060 0x7f9b580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5559a640 1 -- 172.21.15.45:0/3753825771 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570019591 0 0) 0x7f9b58160a50 con 0x7f9b580cd120 2023-07-09T02:22:37.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5559a640 1 -- 172.21.15.45:0/3753825771 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b40003530 con 0x7f9b580cd120 2023-07-09T02:22:37.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5559a640 1 -- 172.21.15.45:0/3753825771 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662098537 0 0) 0x7f9b40003530 con 0x7f9b580cd120 2023-07-09T02:22:37.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5659c640 1 -- 172.21.15.45:0/3753825771 >> v1:172.21.15.155:6789/0 conn(0x7f9b580d2620 legacy=0x7f9b580cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5659c640 1 -- 172.21.15.45:0/3753825771 >> v1:172.21.15.45:6789/0 conn(0x7f9b580cd120 legacy=0x7f9b580d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.084+0000 7f9b5659c640 1 -- 172.21.15.45:0/3753825771 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5815fe40 con 0x7f9b5815c060 2023-07-09T02:22:37.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5659c640 1 --2- 172.21.15.45:0/3753825771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 0x7f9b580b4ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9b480097c0 tx=0x7f9b4801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d57e32804a55c620 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5559a640 1 -- 172.21.15.45:0/3753825771 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c001680 con 0x7f9b5815c060 2023-07-09T02:22:37.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5559a640 1 -- 172.21.15.45:0/3753825771 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b480a7050 con 0x7f9b5815c060 2023-07-09T02:22:37.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5559a640 1 -- 172.21.15.45:0/3753825771 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480ab620 con 0x7f9b5815c060 2023-07-09T02:22:37.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 -- 172.21.15.45:0/3753825771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 msgr2=0x7f9b580b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 --2- 172.21.15.45:0/3753825771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 0x7f9b580b4ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9b480097c0 tx=0x7f9b4801c370 comp rx=0 tx=0).stop 2023-07-09T02:22:37.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 -- 172.21.15.45:0/3753825771 shutdown_connections 2023-07-09T02:22:37.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 --2- 172.21.15.45:0/3753825771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 0x7f9b580b4ed0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 -- 172.21.15.45:0/3753825771 >> 172.21.15.45:0/3753825771 conn(0x7f9b580698e0 msgr2=0x7f9b58069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:37.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 -- 172.21.15.45:0/3753825771 shutdown_connections 2023-07-09T02:22:37.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 -- 172.21.15.45:0/3753825771 wait complete. 2023-07-09T02:22:37.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 Processor -- start 2023-07-09T02:22:37.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.088+0000 7f9b5c87b640 1 -- start start 2023-07-09T02:22:37.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b580cd120 0x7f9b58155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b580d2620 0x7f9b58160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 0x7f9b580ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580cb300 con 0x7f9b580d2620 2023-07-09T02:22:37.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580cb5e0 con 0x7f9b5815c060 2023-07-09T02:22:37.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580cb8c0 con 0x7f9b580cd120 2023-07-09T02:22:37.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b580d2620 0x7f9b58160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b580d2620 0x7f9b58160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32866/0 (socket says 172.21.15.45:32866) 2023-07-09T02:22:37.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 -- 172.21.15.45:0/2609733175 learned_addr learned my addr 172.21.15.45:0/2609733175 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:37.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5659c640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b580cd120 0x7f9b58155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 -- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b580cd120 msgr2=0x7f9b58155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b56d9d640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 0x7f9b580ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b580cd120 0x7f9b58155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 -- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 msgr2=0x7f9b580ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 0x7f9b580ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 -- 172.21.15.45:0/2609733175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b48009420 con 0x7f9b580d2620 2023-07-09T02:22:37.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5659c640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b580cd120 0x7f9b58155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:37.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b56d9d640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 0x7f9b580ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:37.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b55d9b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b580d2620 0x7f9b58160cb0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c750 tx=0x7f9b4c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b46ffd640 1 -- 172.21.15.45:0/2609733175 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c005ae0 con 0x7f9b580d2620 2023-07-09T02:22:37.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b46ffd640 1 -- 172.21.15.45:0/2609733175 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c005c40 con 0x7f9b580d2620 2023-07-09T02:22:37.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b580b59f0 con 0x7f9b580d2620 2023-07-09T02:22:37.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b46ffd640 1 -- 172.21.15.45:0/2609733175 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c007290 con 0x7f9b580d2620 2023-07-09T02:22:37.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b580cbe80 con 0x7f9b580d2620 2023-07-09T02:22:37.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.092+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b580cc0a0 con 0x7f9b580d2620 2023-07-09T02:22:37.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.096+0000 7f9b46ffd640 1 -- 172.21.15.45:0/2609733175 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b4c0073f0 con 0x7f9b580d2620 2023-07-09T02:22:37.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.096+0000 7f9b46ffd640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b38066280 0x7f9b38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.096+0000 7f9b46ffd640 1 -- 172.21.15.45:0/2609733175 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9b4c0831c0 con 0x7f9b580d2620 2023-07-09T02:22:37.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.096+0000 7f9b5659c640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b38066280 0x7f9b38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.096+0000 7f9b5659c640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b38066280 0x7f9b38068730 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9b480ad000 tx=0x7f9b48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.100+0000 7f9b46ffd640 1 -- 172.21.15.45:0/2609733175 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b4c0509a0 con 0x7f9b580d2620 2023-07-09T02:22:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9b5804d7d0 con 0x7f9b580d2620 2023-07-09T02:22:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b46ffd640 1 -- 172.21.15.45:0/2609733175 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v178) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9b4c053fc0 con 0x7f9b580d2620 2023-07-09T02:22:37.258 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:37.258 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-07-09T02:22:37.258 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:37.259 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-07-09T02:22:37.259 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-07-09T02:22:37.259 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:37.259 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:37.260 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-07-09T02:22:37.260 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-07-09T02:22:37.260 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:37.261 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-07-09T02:22:37.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b38066280 msgr2=0x7f9b38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b38066280 0x7f9b38068730 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9b480ad000 tx=0x7f9b48008040 comp rx=0 tx=0).stop 2023-07-09T02:22:37.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b580d2620 msgr2=0x7f9b58160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b580d2620 0x7f9b58160cb0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c750 tx=0x7f9b4c00cc10 comp rx=0 tx=0).stop 2023-07-09T02:22:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 shutdown_connections 2023-07-09T02:22:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5815c060 0x7f9b580ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b580d2620 0x7f9b58160cb0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9b38066280 0x7f9b38068730 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 --2- 172.21.15.45:0/2609733175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b580cd120 0x7f9b58155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 >> 172.21.15.45:0/2609733175 conn(0x7f9b580698e0 msgr2=0x7f9b580b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 shutdown_connections 2023-07-09T02:22:37.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.256+0000 7f9b5c87b640 1 -- 172.21.15.45:0/2609733175 wait complete. 2023-07-09T02:22:37.278 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T02:22:37.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T02:22:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.424+0000 7fd1c385c640 1 Processor -- start 2023-07-09T02:22:37.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.424+0000 7fd1c385c640 1 -- start start 2023-07-09T02:22:37.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c385c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1bc15c480 0x7fd1bc0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c385c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd1bc0cecd0 0x7fd1bc0d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c385c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc0d19c0 con 0x7fd1bc0b4490 2023-07-09T02:22:37.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c385c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc15c850 con 0x7fd1bc15c480 2023-07-09T02:22:37.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c385c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0d1090 con 0x7fd1bc0cecd0 2023-07-09T02:22:37.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c15f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1bc15c480 0x7fd1bc0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c15f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1bc15c480 0x7fd1bc0cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32882/0 (socket says 172.21.15.45:32882) 2023-07-09T02:22:37.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c15f8640 1 -- 172.21.15.45:0/1412751923 learned_addr learned my addr 172.21.15.45:0/1412751923 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:37.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c15f8640 1 -- 172.21.15.45:0/1412751923 >> v2:172.21.15.155:3300/0 conn(0x7fd1bc0cecd0 msgr2=0x7fd1bc0d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:37.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c15f8640 1 --2- 172.21.15.45:0/1412751923 >> v2:172.21.15.155:3300/0 conn(0x7fd1bc0cecd0 0x7fd1bc0d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c15f8640 1 -- 172.21.15.45:0/1412751923 >> v1:172.21.15.155:6789/0 conn(0x7fd1bc0b4490 legacy=0x7fd1bc0b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:37.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.428+0000 7fd1c15f8640 1 -- 172.21.15.45:0/1412751923 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0d1370 con 0x7fd1bc15c480 2023-07-09T02:22:37.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c15f8640 1 --2- 172.21.15.45:0/1412751923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc15c480 0x7fd1bc0cd060 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0b1840 tx=0x7fd1b801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f93d32d05cc182b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1b3fff640 1 -- 172.21.15.45:0/1412751923 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80ac630 con 0x7fd1bc15c480 2023-07-09T02:22:37.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1b3fff640 1 -- 172.21.15.45:0/1412751923 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b80ac790 con 0x7fd1bc15c480 2023-07-09T02:22:37.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1b3fff640 1 -- 172.21.15.45:0/1412751923 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80acb20 con 0x7fd1bc15c480 2023-07-09T02:22:37.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 -- 172.21.15.45:0/1412751923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc15c480 msgr2=0x7fd1bc0cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1412751923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc15c480 0x7fd1bc0cd060 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0b1840 tx=0x7fd1b801c4c0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 -- 172.21.15.45:0/1412751923 shutdown_connections 2023-07-09T02:22:37.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1412751923 >> v2:172.21.15.155:3300/0 conn(0x7fd1bc0cecd0 0x7fd1bc0d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1412751923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc15c480 0x7fd1bc0cd060 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 -- 172.21.15.45:0/1412751923 >> 172.21.15.45:0/1412751923 conn(0x7fd1bc0cf490 msgr2=0x7fd1bc0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:37.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 -- 172.21.15.45:0/1412751923 shutdown_connections 2023-07-09T02:22:37.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 -- 172.21.15.45:0/1412751923 wait complete. 2023-07-09T02:22:37.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 Processor -- start 2023-07-09T02:22:37.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.432+0000 7fd1c385c640 1 -- start start 2023-07-09T02:22:37.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc0b4490 0x7fd1bc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1bc0cecd0 0x7fd1bc14fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1bc15c480 0x7fd1bc150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc15ca30 con 0x7fd1bc0b4490 2023-07-09T02:22:37.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c7830 con 0x7fd1bc15c480 2023-07-09T02:22:37.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0c7b10 con 0x7fd1bc0cecd0 2023-07-09T02:22:37.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc0b4490 0x7fd1bc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc0b4490 0x7fd1bc150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32894/0 (socket says 172.21.15.45:32894) 2023-07-09T02:22:37.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 -- 172.21.15.45:0/1799091446 learned_addr learned my addr 172.21.15.45:0/1799091446 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:37.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c0df7640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1bc0cecd0 0x7fd1bc14fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c1df9640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1bc15c480 0x7fd1bc150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 -- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1bc0cecd0 msgr2=0x7fd1bc14fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1bc0cecd0 0x7fd1bc14fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 -- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1bc15c480 msgr2=0x7fd1bc150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1bc15c480 0x7fd1bc150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 -- 172.21.15.45:0/1799091446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80094d0 con 0x7fd1bc0b4490 2023-07-09T02:22:37.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c1df9640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1bc15c480 0x7fd1bc150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:37.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c15f8640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc0b4490 0x7fd1bc150a00 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80af040 tx=0x7fd1b801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1b1ffb640 1 -- 172.21.15.45:0/1799091446 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80ac630 con 0x7fd1bc0b4490 2023-07-09T02:22:37.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1b1ffb640 1 -- 172.21.15.45:0/1799091446 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b80b7850 con 0x7fd1bc0b4490 2023-07-09T02:22:37.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1b1ffb640 1 -- 172.21.15.45:0/1799091446 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80b7c00 con 0x7fd1bc0b4490 2023-07-09T02:22:37.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc0c7df0 con 0x7fd1bc0b4490 2023-07-09T02:22:37.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc150f40 con 0x7fd1bc0b4490 2023-07-09T02:22:37.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc151130 con 0x7fd1bc0b4490 2023-07-09T02:22:37.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.436+0000 7fd1b1ffb640 1 -- 172.21.15.45:0/1799091446 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1b80b3040 con 0x7fd1bc0b4490 2023-07-09T02:22:37.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.440+0000 7fd1b1ffb640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1a0066280 0x7fd1a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.440+0000 7fd1b1ffb640 1 -- 172.21.15.45:0/1799091446 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd1b811de80 con 0x7fd1bc0b4490 2023-07-09T02:22:37.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.440+0000 7fd1c0df7640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1a0066280 0x7fd1a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.440+0000 7fd1c0df7640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1a0066280 0x7fd1a0068730 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac006fd0 tx=0x7fd1ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.444+0000 7fd1b1ffb640 1 -- 172.21.15.45:0/1799091446 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1bc151130 con 0x7fd1bc0b4490 2023-07-09T02:22:37.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.596+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd1bc151130 con 0x7fd1bc0b4490 2023-07-09T02:22:37.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.720+0000 7fd1b1ffb640 1 -- 172.21.15.45:0/1799091446 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v179) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd1bc151130 con 0x7fd1bc0b4490 2023-07-09T02:22:37.722 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-07-09T02:22:37.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1a0066280 msgr2=0x7fd1a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1a0066280 0x7fd1a0068730 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac006fd0 tx=0x7fd1ac008040 comp rx=0 tx=0).stop 2023-07-09T02:22:37.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc0b4490 msgr2=0x7fd1bc150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc0b4490 0x7fd1bc150a00 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80af040 tx=0x7fd1b801ad00 comp rx=0 tx=0).stop 2023-07-09T02:22:37.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 shutdown_connections 2023-07-09T02:22:37.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1bc15c480 0x7fd1bc150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fd1a0066280 0x7fd1a0068730 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd1bc0cecd0 0x7fd1bc14fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 --2- 172.21.15.45:0/1799091446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1bc0b4490 0x7fd1bc150a00 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 >> 172.21.15.45:0/1799091446 conn(0x7fd1bc0cf490 msgr2=0x7fd1bc156550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 shutdown_connections 2023-07-09T02:22:37.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.724+0000 7fd1c385c640 1 -- 172.21.15.45:0/1799091446 wait complete. 2023-07-09T02:22:37.746 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T02:22:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ee59f640 1 Processor -- start 2023-07-09T02:22:37.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ee59f640 1 -- start start 2023-07-09T02:22:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ee59f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e815c410 0x7f76e81608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ee59f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76e80b4cf0 0x7f76e80d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ee59f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e80ced10 con 0x7f76e80b59b0 2023-07-09T02:22:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ee59f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e815c7e0 con 0x7f76e80b4cf0 2023-07-09T02:22:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ee59f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80cd1b0 con 0x7f76e815c410 2023-07-09T02:22:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ecb3c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76e80b4cf0 0x7f76e80d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ecb3c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76e80b4cf0 0x7f76e80d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32900/0 (socket says 172.21.15.45:32900) 2023-07-09T02:22:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ecb3c640 1 -- 172.21.15.45:0/1884496616 learned_addr learned my addr 172.21.15.45:0/1884496616 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76e7fff640 1 --2- 172.21.15.45:0/1884496616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e815c410 0x7f76e81608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ecb3c640 1 -- 172.21.15.45:0/1884496616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e815c410 msgr2=0x7f76e81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ecb3c640 1 --2- 172.21.15.45:0/1884496616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e815c410 0x7f76e81608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ecb3c640 1 -- 172.21.15.45:0/1884496616 >> v1:172.21.15.155:6789/0 conn(0x7f76e80b59b0 legacy=0x7f76e80b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.896+0000 7f76ecb3c640 1 -- 172.21.15.45:0/1884496616 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8160de0 con 0x7f76e80b4cf0 2023-07-09T02:22:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ecb3c640 1 --2- 172.21.15.45:0/1884496616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e80b4cf0 0x7f76e80d0970 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009e50 tx=0x7f76e001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7e14f52d2e197b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76e6ffd640 1 -- 172.21.15.45:0/1884496616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00090d0 con 0x7f76e80b4cf0 2023-07-09T02:22:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76e6ffd640 1 -- 172.21.15.45:0/1884496616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0009230 con 0x7f76e80b4cf0 2023-07-09T02:22:37.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76e6ffd640 1 -- 172.21.15.45:0/1884496616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00a5ac0 con 0x7f76e80b4cf0 2023-07-09T02:22:37.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ee59f640 1 -- 172.21.15.45:0/1884496616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e80b4cf0 msgr2=0x7f76e80d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ee59f640 1 --2- 172.21.15.45:0/1884496616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e80b4cf0 0x7f76e80d0970 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009e50 tx=0x7f76e001c9e0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ee59f640 1 -- 172.21.15.45:0/1884496616 shutdown_connections 2023-07-09T02:22:37.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ee59f640 1 --2- 172.21.15.45:0/1884496616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e80b4cf0 0x7f76e80d0970 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ee59f640 1 --2- 172.21.15.45:0/1884496616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e815c410 0x7f76e81608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ee59f640 1 -- 172.21.15.45:0/1884496616 >> 172.21.15.45:0/1884496616 conn(0x7f76e806a590 msgr2=0x7f76e80cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:37.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ee59f640 1 -- 172.21.15.45:0/1884496616 shutdown_connections 2023-07-09T02:22:37.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.900+0000 7f76ee59f640 1 -- 172.21.15.45:0/1884496616 wait complete. 2023-07-09T02:22:37.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 Processor -- start 2023-07-09T02:22:37.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 -- start start 2023-07-09T02:22:37.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e80b4cf0 0x7f76e80b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e80b59b0 0x7f76e8150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e815c410 0x7f76e80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80b41a0 con 0x7f76e815c410 2023-07-09T02:22:37.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80b3d10 con 0x7f76e80b59b0 2023-07-09T02:22:37.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80b3100 con 0x7f76e80b4cf0 2023-07-09T02:22:37.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e815c410 0x7f76e80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76e7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e80b4cf0 0x7f76e80b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e815c410 0x7f76e80b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32906/0 (socket says 172.21.15.45:32906) 2023-07-09T02:22:37.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 -- 172.21.15.45:0/3913355310 learned_addr learned my addr 172.21.15.45:0/3913355310 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:37.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76e77fe640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e80b59b0 0x7f76e8150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 -- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e80b4cf0 msgr2=0x7f76e80b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e80b4cf0 0x7f76e80b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 -- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e80b59b0 msgr2=0x7f76e8150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:37.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e80b59b0 0x7f76e8150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:37.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 -- 172.21.15.45:0/3913355310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0009b30 con 0x7f76e815c410 2023-07-09T02:22:37.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ecb3c640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e815c410 0x7f76e80b5da0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f76e00af040 tx=0x7f76e0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76e4ff9640 1 -- 172.21.15.45:0/3913355310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00090d0 con 0x7f76e815c410 2023-07-09T02:22:37.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76e4ff9640 1 -- 172.21.15.45:0/3913355310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e00b88c0 con 0x7f76e815c410 2023-07-09T02:22:37.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76e4ff9640 1 -- 172.21.15.45:0/3913355310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00b8c70 con 0x7f76e815c410 2023-07-09T02:22:37.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e80b33e0 con 0x7f76e815c410 2023-07-09T02:22:37.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.904+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e80b39a0 con 0x7f76e815c410 2023-07-09T02:22:37.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.908+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e80b3e80 con 0x7f76e815c410 2023-07-09T02:22:37.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.908+0000 7f76e4ff9640 1 -- 172.21.15.45:0/3913355310 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76e00cd430 con 0x7f76e815c410 2023-07-09T02:22:37.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.908+0000 7f76e4ff9640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d4066280 0x7f76d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:37.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.908+0000 7f76e4ff9640 1 -- 172.21.15.45:0/3913355310 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f76e011fbe0 con 0x7f76e815c410 2023-07-09T02:22:37.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.908+0000 7f76e7fff640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d4066280 0x7f76d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:37.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.908+0000 7f76e7fff640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d4066280 0x7f76d4068730 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009b60 tx=0x7f76d8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:37.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:37.912+0000 7f76e4ff9640 1 -- 172.21.15.45:0/3913355310 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76e00ed3f0 con 0x7f76e815c410 2023-07-09T02:22:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.064+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f76e804d7d0 con 0x7f76e815c410 2023-07-09T02:22:38.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.728+0000 7f76e4ff9640 1 -- 172.21.15.45:0/3913355310 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v180) v1 ==== 170+0+0 (secure 0 0 0) 0x7f76e0009510 con 0x7f76e815c410 2023-07-09T02:22:38.730 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-07-09T02:22:38.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.740+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d4066280 msgr2=0x7f76d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:38.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.740+0000 7f76ee59f640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d4066280 0x7f76d4068730 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009b60 tx=0x7f76d8009190 comp rx=0 tx=0).stop 2023-07-09T02:22:38.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.740+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e815c410 msgr2=0x7f76e80b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:38.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.740+0000 7f76ee59f640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e815c410 0x7f76e80b5da0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f76e00af040 tx=0x7f76e0019780 comp rx=0 tx=0).stop 2023-07-09T02:22:38.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.744+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 shutdown_connections 2023-07-09T02:22:38.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.744+0000 7f76ee59f640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76e815c410 0x7f76e80b5da0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.744+0000 7f76ee59f640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76e80b59b0 0x7f76e8150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.744+0000 7f76ee59f640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f76d4066280 0x7f76d4068730 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.744+0000 7f76ee59f640 1 --2- 172.21.15.45:0/3913355310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e80b4cf0 0x7f76e80b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.744+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 >> 172.21.15.45:0/3913355310 conn(0x7f76e806a590 msgr2=0x7f76e8151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:38.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.744+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 shutdown_connections 2023-07-09T02:22:38.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.744+0000 7f76ee59f640 1 -- 172.21.15.45:0/3913355310 wait complete. 2023-07-09T02:22:38.766 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T02:22:38.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27da6e5640 1 Processor -- start 2023-07-09T02:22:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27da6e5640 1 -- start start 2023-07-09T02:22:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27da6e5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27d415c060 0x7f27d40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27da6e5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f27d40cd120 0x7f27d40d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27da6e5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d4160a50 con 0x7f27d40d2450 2023-07-09T02:22:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27da6e5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d40d28d0 con 0x7f27d415c060 2023-07-09T02:22:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27da6e5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d40cfe40 con 0x7f27d40cd120 2023-07-09T02:22:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27d3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27d415c060 0x7f27d40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27d3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27d415c060 0x7f27d40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32920/0 (socket says 172.21.15.45:32920) 2023-07-09T02:22:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27d3fff640 1 -- 172.21.15.45:0/385656528 learned_addr learned my addr 172.21.15.45:0/385656528 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27d37fe640 1 --2- 172.21.15.45:0/385656528 >> v2:172.21.15.155:3300/0 conn(0x7f27d40cd120 0x7f27d40d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27d3fff640 1 -- 172.21.15.45:0/385656528 >> v2:172.21.15.155:3300/0 conn(0x7f27d40cd120 msgr2=0x7f27d40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27d3fff640 1 --2- 172.21.15.45:0/385656528 >> v2:172.21.15.155:3300/0 conn(0x7f27d40cd120 0x7f27d40d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27d3fff640 1 -- 172.21.15.45:0/385656528 >> v1:172.21.15.155:6789/0 conn(0x7f27d40d2450 legacy=0x7f27d40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.916+0000 7f27d3fff640 1 -- 172.21.15.45:0/385656528 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d415c430 con 0x7f27d415c060 2023-07-09T02:22:38.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27d3fff640 1 --2- 172.21.15.45:0/385656528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d415c060 0x7f27d40b4ed0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f27d415fac0 tx=0x7f27c401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be659dab89116836 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:38.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27d2ffd640 1 -- 172.21.15.45:0/385656528 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40ab5f0 con 0x7f27d415c060 2023-07-09T02:22:38.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27d2ffd640 1 -- 172.21.15.45:0/385656528 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c40ab750 con 0x7f27d415c060 2023-07-09T02:22:38.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27d2ffd640 1 -- 172.21.15.45:0/385656528 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40abae0 con 0x7f27d415c060 2023-07-09T02:22:38.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27da6e5640 1 -- 172.21.15.45:0/385656528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d415c060 msgr2=0x7f27d40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27da6e5640 1 --2- 172.21.15.45:0/385656528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d415c060 0x7f27d40b4ed0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f27d415fac0 tx=0x7f27c401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27da6e5640 1 -- 172.21.15.45:0/385656528 shutdown_connections 2023-07-09T02:22:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27da6e5640 1 --2- 172.21.15.45:0/385656528 >> v2:172.21.15.155:3300/0 conn(0x7f27d40cd120 0x7f27d40d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27da6e5640 1 --2- 172.21.15.45:0/385656528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d415c060 0x7f27d40b4ed0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27da6e5640 1 -- 172.21.15.45:0/385656528 >> 172.21.15.45:0/385656528 conn(0x7f27d40698e0 msgr2=0x7f27d4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27da6e5640 1 -- 172.21.15.45:0/385656528 shutdown_connections 2023-07-09T02:22:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.920+0000 7f27da6e5640 1 -- 172.21.15.45:0/385656528 wait complete. 2023-07-09T02:22:38.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 Processor -- start 2023-07-09T02:22:38.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 -- start start 2023-07-09T02:22:38.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d40cd120 0x7f27d4151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:38.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d40d2450 0x7f27d40c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:38.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d415c060 0x7f27d40cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:38.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4152a00 con 0x7f27d40d2450 2023-07-09T02:22:38.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d41523d0 con 0x7f27d40cd120 2023-07-09T02:22:38.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40b1830 con 0x7f27d415c060 2023-07-09T02:22:38.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d40d2450 0x7f27d40c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:38.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d40d2450 0x7f27d40c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32930/0 (socket says 172.21.15.45:32930) 2023-07-09T02:22:38.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 -- 172.21.15.45:0/1684484698 learned_addr learned my addr 172.21.15.45:0/1684484698 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:38.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d8c82640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d415c060 0x7f27d40cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:38.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d3fff640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d40cd120 0x7f27d4151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:38.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 -- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d415c060 msgr2=0x7f27d40cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:38.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d415c060 0x7f27d40cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 -- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d40cd120 msgr2=0x7f27d4151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:38.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d40cd120 0x7f27d4151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:38.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 -- 172.21.15.45:0/1684484698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40094d0 con 0x7f27d40d2450 2023-07-09T02:22:38.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d37fe640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d40d2450 0x7f27d40c9b10 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f27c800d7d0 tx=0x7f27c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:38.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d0ff9640 1 -- 172.21.15.45:0/1684484698 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8004030 con 0x7f27d40d2450 2023-07-09T02:22:38.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d0ff9640 1 -- 172.21.15.45:0/1684484698 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8004190 con 0x7f27d40d2450 2023-07-09T02:22:38.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d40b1ad0 con 0x7f27d40d2450 2023-07-09T02:22:38.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27d0ff9640 1 -- 172.21.15.45:0/1684484698 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800b6c0 con 0x7f27d40d2450 2023-07-09T02:22:38.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.924+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d40cc9f0 con 0x7f27d40d2450 2023-07-09T02:22:38.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.928+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d4152b40 con 0x7f27d40d2450 2023-07-09T02:22:38.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.928+0000 7f27d0ff9640 1 -- 172.21.15.45:0/1684484698 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27c800b820 con 0x7f27d40d2450 2023-07-09T02:22:38.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.928+0000 7f27d0ff9640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27c0066280 0x7f27c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:38.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.928+0000 7f27d0ff9640 1 -- 172.21.15.45:0/1684484698 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f27c8083f40 con 0x7f27d40d2450 2023-07-09T02:22:38.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.928+0000 7f27d3fff640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27c0066280 0x7f27c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:38.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.928+0000 7f27d3fff640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27c0066280 0x7f27c0068730 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f27c40af000 tx=0x7f27c40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:38.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:38.932+0000 7f27d0ff9640 1 -- 172.21.15.45:0/1684484698 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27d4152b40 con 0x7f27d40d2450 2023-07-09T02:22:39.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.120+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f27d4152b40 con 0x7f27d40d2450 2023-07-09T02:22:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.752+0000 7f27d0ff9640 1 -- 172.21.15.45:0/1684484698 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v87) v1 ==== 174+0+0 (secure 0 0 0) 0x7f27d4152b40 con 0x7f27d40d2450 2023-07-09T02:22:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 23 and data pool 24 2023-07-09T02:22:39.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27c0066280 msgr2=0x7f27c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:39.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27c0066280 0x7f27c0068730 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f27c40af000 tx=0x7f27c40a7000 comp rx=0 tx=0).stop 2023-07-09T02:22:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d40d2450 msgr2=0x7f27d40c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d40d2450 0x7f27d40c9b10 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f27c800d7d0 tx=0x7f27c800dc90 comp rx=0 tx=0).stop 2023-07-09T02:22:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 shutdown_connections 2023-07-09T02:22:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27c0066280 0x7f27c0068730 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27d415c060 0x7f27d40cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27d40d2450 0x7f27d40c9b10 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 --2- 172.21.15.45:0/1684484698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27d40cd120 0x7f27d4151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 >> 172.21.15.45:0/1684484698 conn(0x7f27d40698e0 msgr2=0x7f27d40b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.756+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 shutdown_connections 2023-07-09T02:22:39.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.760+0000 7f27da6e5640 1 -- 172.21.15.45:0/1684484698 wait complete. 2023-07-09T02:22:39.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f4185e7b640 1 Processor -- start 2023-07-09T02:22:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f4185e7b640 1 -- start start 2023-07-09T02:22:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f4185e7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800cd120 0x7f41800b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f4185e7b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4180160a50 con 0x7f418015c060 2023-07-09T02:22:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f4185e7b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418015c430 con 0x7f41800d2620 2023-07-09T02:22:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f4185e7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418015fb60 con 0x7f41800cd120 2023-07-09T02:22:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417f7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f418015c060 0x7f41800d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36644/0 (socket says 172.21.15.45:36644) 2023-07-09T02:22:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417f7fe640 1 -- 172.21.15.45:0/2542462758 learned_addr learned my addr 172.21.15.45:0/2542462758 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:39.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417ffff640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800cd120 0x7f41800b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017047370 0 0) 0x7f4180160a50 con 0x7f418015c060 2023-07-09T02:22:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4168003530 con 0x7f418015c060 2023-07-09T02:22:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2965852217 0 0) 0x7f4168003530 con 0x7f418015c060 2023-07-09T02:22:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800cd120 msgr2=0x7f41800b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800cd120 0x7f41800b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 >> v1:172.21.15.155:6789/0 conn(0x7f41800d2620 legacy=0x7f41800cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418015fe40 con 0x7f418015c060 2023-07-09T02:22:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f4170001680 con 0x7f418015c060 2023-07-09T02:22:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 >> v1:172.21.15.45:6789/0 conn(0x7f418015c060 legacy=0x7f41800d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800cd120 0x7f41680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4168004d10 0x7f4168005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418015fb60 con 0x7f4168003f30 2023-07-09T02:22:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416800ba70 con 0x7f4168004d10 2023-07-09T02:22:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416800bc30 con 0x7f41800cd120 2023-07-09T02:22:39.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417effd640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:39.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417f7fe640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800cd120 0x7f41680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:39.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.928+0000 7f417ffff640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4168004d10 0x7f4168005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:39.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417effd640 1 -- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800cd120 msgr2=0x7f41680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:39.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417effd640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800cd120 0x7f41680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417effd640 1 -- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4168004d10 msgr2=0x7f4168005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:39.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417effd640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4168004d10 0x7f4168005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417effd640 1 -- 172.21.15.45:0/2542462758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4168003530 con 0x7f4168003f30 2023-07-09T02:22:39.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417effd640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41680047d0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f41800d2a10 tx=0x7f417401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c90767b8e773e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740052d0 con 0x7f4168003f30 2023-07-09T02:22:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41740a7050 con 0x7f4168003f30 2023-07-09T02:22:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417e7fc640 1 -- 172.21.15.45:0/2542462758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174003600 con 0x7f4168003f30 2023-07-09T02:22:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f4185e7b640 1 -- 172.21.15.45:0/2542462758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 msgr2=0x7f41680047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f4185e7b640 1 --2- 172.21.15.45:0/2542462758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41680047d0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f41800d2a10 tx=0x7f417401c3a0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f417ffff640 1 -- 172.21.15.45:0/2542462758 reap_dead start 2023-07-09T02:22:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f4185e7b640 1 -- 172.21.15.45:0/2542462758 shutdown_connections 2023-07-09T02:22:39.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f4185e7b640 1 -- 172.21.15.45:0/2542462758 >> 172.21.15.45:0/2542462758 conn(0x7f41800698e0 msgr2=0x7f4180069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:39.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f4185e7b640 1 -- 172.21.15.45:0/2542462758 shutdown_connections 2023-07-09T02:22:39.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.932+0000 7f4185e7b640 1 -- 172.21.15.45:0/2542462758 wait complete. 2023-07-09T02:22:39.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 Processor -- start 2023-07-09T02:22:39.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 -- start start 2023-07-09T02:22:39.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41801f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:39.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800c9b10 0x7f41801537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:39.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41800b4650 0x7f41800b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:39.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41801f27e0 con 0x7f4168003f30 2023-07-09T02:22:39.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800b5010 con 0x7f41800b4650 2023-07-09T02:22:39.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41801f1c10 con 0x7f41800c9b10 2023-07-09T02:22:39.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41801f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:39.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41801f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32946/0 (socket says 172.21.15.45:32946) 2023-07-09T02:22:39.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 -- 172.21.15.45:0/1919487161 learned_addr learned my addr 172.21.15.45:0/1919487161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417ffff640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41800b4650 0x7f41800b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417effd640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800c9b10 0x7f41801537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 -- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800c9b10 msgr2=0x7f41801537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800c9b10 0x7f41801537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 -- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41800b4650 msgr2=0x7f41800b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41800b4650 0x7f41800b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 -- 172.21.15.45:0/1919487161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41801f1e40 con 0x7f4168003f30 2023-07-09T02:22:39.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f417f7fe640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41801f5e10 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f4170012470 tx=0x7f4170012930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:39.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4167fff640 1 -- 172.21.15.45:0/1919487161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170014810 con 0x7f4168003f30 2023-07-09T02:22:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4167fff640 1 -- 172.21.15.45:0/1919487161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170014970 con 0x7f4168003f30 2023-07-09T02:22:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.936+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41801f2120 con 0x7f4168003f30 2023-07-09T02:22:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.940+0000 7f4167fff640 1 -- 172.21.15.45:0/1919487161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170014d00 con 0x7f4168003f30 2023-07-09T02:22:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.940+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180153cf0 con 0x7f4168003f30 2023-07-09T02:22:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.940+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418004d7d0 con 0x7f4168003f30 2023-07-09T02:22:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.940+0000 7f4167fff640 1 -- 172.21.15.45:0/1919487161 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f41700153e0 con 0x7f4168003f30 2023-07-09T02:22:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.940+0000 7f4167fff640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f416c066280 0x7f416c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.940+0000 7f4167fff640 1 -- 172.21.15.45:0/1919487161 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4170086870 con 0x7f4168003f30 2023-07-09T02:22:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.940+0000 7f417effd640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f416c066280 0x7f416c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.944+0000 7f417effd640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f416c066280 0x7f416c068730 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4168004750 tx=0x7f41740011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:39.944+0000 7f4167fff640 1 -- 172.21.15.45:0/1919487161 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4170053c50 con 0x7f4168003f30 2023-07-09T02:22:40.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.100+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41800b3590 con 0x7f4168003f30 2023-07-09T02:22:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4167fff640 1 -- 172.21.15.45:0/1919487161 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+18308 (secure 0 0 0) 0x7f4170014e60 con 0x7f4168003f30 2023-07-09T02:22:40.104 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:40.104 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":181,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:39.125004+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:22:37.645121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T02:22:38.115103+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f416c066280 msgr2=0x7f416c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f416c066280 0x7f416c068730 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4168004750 tx=0x7f41740011a0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 msgr2=0x7f41801f5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41801f5e10 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f4170012470 tx=0x7f4170012930 comp rx=0 tx=0).stop 2023-07-09T02:22:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 shutdown_connections 2023-07-09T02:22:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41800b4650 0x7f41800b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f416c066280 0x7f416c068730 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41800c9b10 0x7f41801537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 --2- 172.21.15.45:0/1919487161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4168003f30 0x7f41801f5e10 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 >> 172.21.15.45:0/1919487161 conn(0x7f41800698e0 msgr2=0x7f41800b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 shutdown_connections 2023-07-09T02:22:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.104+0000 7f4185e7b640 1 -- 172.21.15.45:0/1919487161 wait complete. 2023-07-09T02:22:40.125 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:40.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa3e19640 1 Processor -- start 2023-07-09T02:22:40.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa3e19640 1 -- start start 2023-07-09T02:22:40.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa3e19640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a9c15c060 0x7f5a9c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa3e19640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a9c0d2620 0x7f5a9c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa3e19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c160a50 con 0x7f5a9c0cd120 2023-07-09T02:22:40.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa3e19640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c15c430 con 0x7f5a9c15c060 2023-07-09T02:22:40.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa3e19640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c15fb60 con 0x7f5a9c0d2620 2023-07-09T02:22:40.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa1bb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a9c15c060 0x7f5a9c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa1bb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a9c15c060 0x7f5a9c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32950/0 (socket says 172.21.15.45:32950) 2023-07-09T02:22:40.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa1bb5640 1 -- 172.21.15.45:0/3930380004 learned_addr learned my addr 172.21.15.45:0/3930380004 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:40.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa1bb5640 1 -- 172.21.15.45:0/3930380004 >> v2:172.21.15.155:3300/0 conn(0x7f5a9c0d2620 msgr2=0x7f5a9c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:40.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa23b6640 1 --2- 172.21.15.45:0/3930380004 >> v2:172.21.15.155:3300/0 conn(0x7f5a9c0d2620 0x7f5a9c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa1bb5640 1 --2- 172.21.15.45:0/3930380004 >> v2:172.21.15.155:3300/0 conn(0x7f5a9c0d2620 0x7f5a9c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa1bb5640 1 -- 172.21.15.45:0/3930380004 >> v1:172.21.15.155:6789/0 conn(0x7f5a9c0cd120 legacy=0x7f5a9c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:40.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa1bb5640 1 -- 172.21.15.45:0/3930380004 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c15fe40 con 0x7f5a9c15c060 2023-07-09T02:22:40.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.268+0000 7f5aa23b6640 1 --2- 172.21.15.45:0/3930380004 >> v2:172.21.15.155:3300/0 conn(0x7f5a9c0d2620 0x7f5a9c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:40.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa1bb5640 1 --2- 172.21.15.45:0/3930380004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15c060 0x7f5a9c0b4ed0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c08bca0 tx=0x7f5a9801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23472fbba03a95d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:40.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa0bb3640 1 -- 172.21.15.45:0/3930380004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980aa5f0 con 0x7f5a9c15c060 2023-07-09T02:22:40.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa0bb3640 1 -- 172.21.15.45:0/3930380004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a980aa750 con 0x7f5a9c15c060 2023-07-09T02:22:40.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa0bb3640 1 -- 172.21.15.45:0/3930380004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980aaae0 con 0x7f5a9c15c060 2023-07-09T02:22:40.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa3e19640 1 -- 172.21.15.45:0/3930380004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15c060 msgr2=0x7f5a9c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/3930380004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15c060 0x7f5a9c0b4ed0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c08bca0 tx=0x7f5a9801c490 comp rx=0 tx=0).stop 2023-07-09T02:22:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa3e19640 1 -- 172.21.15.45:0/3930380004 shutdown_connections 2023-07-09T02:22:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/3930380004 >> v2:172.21.15.155:3300/0 conn(0x7f5a9c0d2620 0x7f5a9c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/3930380004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15c060 0x7f5a9c0b4ed0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa3e19640 1 -- 172.21.15.45:0/3930380004 >> 172.21.15.45:0/3930380004 conn(0x7f5a9c0698e0 msgr2=0x7f5a9c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa3e19640 1 -- 172.21.15.45:0/3930380004 shutdown_connections 2023-07-09T02:22:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.272+0000 7f5aa3e19640 1 -- 172.21.15.45:0/3930380004 wait complete. 2023-07-09T02:22:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 Processor -- start 2023-07-09T02:22:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 -- start start 2023-07-09T02:22:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c0cd120 0x7f5a9c15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a9c0d2620 0x7f5a9c1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a9c15c060 0x7f5a9c153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c152600 con 0x7f5a9c0cd120 2023-07-09T02:22:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c154040 con 0x7f5a9c0d2620 2023-07-09T02:22:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c153670 con 0x7f5a9c15c060 2023-07-09T02:22:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c0cd120 0x7f5a9c15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c0cd120 0x7f5a9c15ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32956/0 (socket says 172.21.15.45:32956) 2023-07-09T02:22:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 -- 172.21.15.45:0/2012742261 learned_addr learned my addr 172.21.15.45:0/2012742261 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa13b4640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a9c0d2620 0x7f5a9c1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa23b6640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a9c15c060 0x7f5a9c153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 -- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a9c15c060 msgr2=0x7f5a9c153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a9c15c060 0x7f5a9c153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 -- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a9c0d2620 msgr2=0x7f5a9c1520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a9c0d2620 0x7f5a9c1520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 -- 172.21.15.45:0/2012742261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980094d0 con 0x7f5a9c0cd120 2023-07-09T02:22:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa1bb5640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c0cd120 0x7f5a9c15ab30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f5a9801a0c0 tx=0x7f5a9801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5a927fc640 1 -- 172.21.15.45:0/2012742261 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980b3800 con 0x7f5a9c0cd120 2023-07-09T02:22:40.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5a927fc640 1 -- 172.21.15.45:0/2012742261 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a980b3980 con 0x7f5a9c0cd120 2023-07-09T02:22:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5a927fc640 1 -- 172.21.15.45:0/2012742261 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980b3d30 con 0x7f5a9c0cd120 2023-07-09T02:22:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c0b59f0 con 0x7f5a9c0cd120 2023-07-09T02:22:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.276+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c152a60 con 0x7f5a9c0cd120 2023-07-09T02:22:40.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.280+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c04d7d0 con 0x7f5a9c0cd120 2023-07-09T02:22:40.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.280+0000 7f5a927fc640 1 -- 172.21.15.45:0/2012742261 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a980b2380 con 0x7f5a9c0cd120 2023-07-09T02:22:40.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.280+0000 7f5a927fc640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a80066280 0x7f5a80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.280+0000 7f5a927fc640 1 -- 172.21.15.45:0/2012742261 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a980a7070 con 0x7f5a9c0cd120 2023-07-09T02:22:40.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.280+0000 7f5aa13b4640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a80066280 0x7f5a80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.280+0000 7f5aa13b4640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a80066280 0x7f5a80068730 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c1548a0 tx=0x7f5a8c007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:40.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.284+0000 7f5a927fc640 1 -- 172.21.15.45:0/2012742261 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a980eb960 con 0x7f5a9c0cd120 2023-07-09T02:22:40.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.440+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a9c06baa0 con 0x7f5a9c0cd120 2023-07-09T02:22:40.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.440+0000 7f5a927fc640 1 -- 172.21.15.45:0/2012742261 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+18308 (secure 0 0 0) 0x7f5a980eef80 con 0x7f5a9c0cd120 2023-07-09T02:22:40.442 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:40.443 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":181,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:39.125004+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:22:37.645121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T02:22:38.115103+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:40.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a80066280 msgr2=0x7f5a80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a80066280 0x7f5a80068730 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c1548a0 tx=0x7f5a8c007e40 comp rx=0 tx=0).stop 2023-07-09T02:22:40.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c0cd120 msgr2=0x7f5a9c15ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c0cd120 0x7f5a9c15ab30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f5a9801a0c0 tx=0x7f5a9801acd0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 shutdown_connections 2023-07-09T02:22:40.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5a80066280 0x7f5a80068730 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a9c15c060 0x7f5a9c153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a9c0d2620 0x7f5a9c1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 --2- 172.21.15.45:0/2012742261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c0cd120 0x7f5a9c15ab30 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 >> 172.21.15.45:0/2012742261 conn(0x7f5a9c0698e0 msgr2=0x7f5a9c157ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 shutdown_connections 2023-07-09T02:22:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.444+0000 7f5aa3e19640 1 -- 172.21.15.45:0/2012742261 wait complete. 2023-07-09T02:22:40.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T02:22:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f69c48640 1 Processor -- start 2023-07-09T02:22:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f69c48640 1 -- start start 2023-07-09T02:22:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f69c48640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7f6415c060 0x7f7f640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f69c48640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7f640cd120 0x7f7f640d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f69c48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f640d2450 0x7f7f640d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f69c48640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f640d28f0 con 0x7f7f6415c060 2023-07-09T02:22:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f69c48640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f64160a50 con 0x7f7f640cd120 2023-07-09T02:22:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f69c48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415c430 con 0x7f7f640d2450 2023-07-09T02:22:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7f6415c060 0x7f7f640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7f6415c060 0x7f7f640b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32960/0 (socket says 172.21.15.45:32960) 2023-07-09T02:22:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f637fe640 1 -- 172.21.15.45:0/2229967456 learned_addr learned my addr 172.21.15.45:0/2229967456 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f62ffd640 1 --2- 172.21.15.45:0/2229967456 >> v2:172.21.15.155:3300/0 conn(0x7f7f640cd120 0x7f7f640d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f63fff640 1 --2- 172.21.15.45:0/2229967456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f640d2450 0x7f7f640d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f637fe640 1 -- 172.21.15.45:0/2229967456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f640d2450 msgr2=0x7f7f640d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f637fe640 1 --2- 172.21.15.45:0/2229967456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f640d2450 0x7f7f640d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f637fe640 1 -- 172.21.15.45:0/2229967456 >> v2:172.21.15.155:3300/0 conn(0x7f7f640cd120 msgr2=0x7f7f640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f637fe640 1 --2- 172.21.15.45:0/2229967456 >> v2:172.21.15.155:3300/0 conn(0x7f7f640cd120 0x7f7f640d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.612+0000 7f7f637fe640 1 -- 172.21.15.45:0/2229967456 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6415fb60 con 0x7f7f6415c060 2023-07-09T02:22:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f637fe640 1 --2- 172.21.15.45:0/2229967456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f6415c060 0x7f7f640b4ed0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f7f6415fac0 tx=0x7f7f5401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b553dd5ad486547e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f627fc640 1 -- 172.21.15.45:0/2229967456 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540ab600 con 0x7f7f6415c060 2023-07-09T02:22:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f627fc640 1 -- 172.21.15.45:0/2229967456 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540a7050 con 0x7f7f6415c060 2023-07-09T02:22:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f627fc640 1 -- 172.21.15.45:0/2229967456 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540ab980 con 0x7f7f6415c060 2023-07-09T02:22:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 -- 172.21.15.45:0/2229967456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f6415c060 msgr2=0x7f7f640b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 --2- 172.21.15.45:0/2229967456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f6415c060 0x7f7f640b4ed0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f7f6415fac0 tx=0x7f7f5401c210 comp rx=0 tx=0).stop 2023-07-09T02:22:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 -- 172.21.15.45:0/2229967456 shutdown_connections 2023-07-09T02:22:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 --2- 172.21.15.45:0/2229967456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f640d2450 0x7f7f640d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 --2- 172.21.15.45:0/2229967456 >> v2:172.21.15.155:3300/0 conn(0x7f7f640cd120 0x7f7f640d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 --2- 172.21.15.45:0/2229967456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f6415c060 0x7f7f640b4ed0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 -- 172.21.15.45:0/2229967456 >> 172.21.15.45:0/2229967456 conn(0x7f7f640698e0 msgr2=0x7f7f64069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 -- 172.21.15.45:0/2229967456 shutdown_connections 2023-07-09T02:22:40.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.616+0000 7f7f69c48640 1 -- 172.21.15.45:0/2229967456 wait complete. 2023-07-09T02:22:40.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 Processor -- start 2023-07-09T02:22:40.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 -- start start 2023-07-09T02:22:40.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f640cd120 0x7f7f64159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f640d2450 0x7f7f640b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6415c060 0x7f7f6415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640b7250 con 0x7f7f640cd120 2023-07-09T02:22:40.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415a6a0 con 0x7f7f640d2450 2023-07-09T02:22:40.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415a3c0 con 0x7f7f6415c060 2023-07-09T02:22:40.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f640cd120 0x7f7f64159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f640cd120 0x7f7f64159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32966/0 (socket says 172.21.15.45:32966) 2023-07-09T02:22:40.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 -- 172.21.15.45:0/1736246151 learned_addr learned my addr 172.21.15.45:0/1736246151 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 -- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6415c060 msgr2=0x7f7f6415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6415c060 0x7f7f6415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 -- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f640d2450 msgr2=0x7f7f640b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f62ffd640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f640d2450 0x7f7f640b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f640d2450 0x7f7f640b7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 -- 172.21.15.45:0/1736246151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f540094d0 con 0x7f7f640cd120 2023-07-09T02:22:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f62ffd640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f640d2450 0x7f7f640b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:40.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f637fe640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f640cd120 0x7f7f64159d90 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f7f540ae040 tx=0x7f7f5401aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:40.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f4bfff640 1 -- 172.21.15.45:0/1736246151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540b6620 con 0x7f7f640cd120 2023-07-09T02:22:40.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f4bfff640 1 -- 172.21.15.45:0/1736246151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540abe90 con 0x7f7f640cd120 2023-07-09T02:22:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f4bfff640 1 -- 172.21.15.45:0/1736246151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540b69e0 con 0x7f7f640cd120 2023-07-09T02:22:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f640b6b90 con 0x7f7f640cd120 2023-07-09T02:22:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.620+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f64159650 con 0x7f7f640cd120 2023-07-09T02:22:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.624+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f640b69f0 con 0x7f7f640cd120 2023-07-09T02:22:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.624+0000 7f7f4bfff640 1 -- 172.21.15.45:0/1736246151 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f540b2040 con 0x7f7f640cd120 2023-07-09T02:22:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.624+0000 7f7f4bfff640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f500662b0 0x7f7f50068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.624+0000 7f7f4bfff640 1 -- 172.21.15.45:0/1736246151 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f5411dee0 con 0x7f7f640cd120 2023-07-09T02:22:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.624+0000 7f7f62ffd640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f500662b0 0x7f7f50068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.624+0000 7f7f62ffd640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f500662b0 0x7f7f50068760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7f640b8a10 tx=0x7f7f58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:40.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.628+0000 7f7f4bfff640 1 -- 172.21.15.45:0/1736246151 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f640b69f0 con 0x7f7f640cd120 2023-07-09T02:22:40.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:40.824+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7f640b69f0 con 0x7f7f640cd120 2023-07-09T02:22:41.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.768+0000 7f7f4bfff640 1 -- 172.21.15.45:0/1736246151 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v90) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7f640b69f0 con 0x7f7f640cd120 2023-07-09T02:22:41.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f500662b0 msgr2=0x7f7f50068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f500662b0 0x7f7f50068760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7f640b8a10 tx=0x7f7f58008040 comp rx=0 tx=0).stop 2023-07-09T02:22:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f640cd120 msgr2=0x7f7f64159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f640cd120 0x7f7f64159d90 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f7f540ae040 tx=0x7f7f5401aa50 comp rx=0 tx=0).stop 2023-07-09T02:22:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 shutdown_connections 2023-07-09T02:22:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7f500662b0 0x7f7f50068760 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6415c060 0x7f7f6415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f640d2450 0x7f7f640b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 --2- 172.21.15.45:0/1736246151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f640cd120 0x7f7f64159d90 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 >> 172.21.15.45:0/1736246151 conn(0x7f7f640698e0 msgr2=0x7f7f64151670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:41.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 shutdown_connections 2023-07-09T02:22:41.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.772+0000 7f7f69c48640 1 -- 172.21.15.45:0/1736246151 wait complete. 2023-07-09T02:22:41.796 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T02:22:41.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T02:22:41.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b50940640 1 Processor -- start 2023-07-09T02:22:41.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b50940640 1 -- start start 2023-07-09T02:22:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b50940640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0b4c15c060 0x7f0b4c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b50940640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c160a50 con 0x7f0b4c0d2620 2023-07-09T02:22:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b50940640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c15c430 con 0x7f0b4c0cd120 2023-07-09T02:22:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b50940640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c15fb60 con 0x7f0b4c15c060 2023-07-09T02:22:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b4ad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0b4c0d2620 0x7f0b4c0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38322/0 (socket says 172.21.15.45:38322) 2023-07-09T02:22:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b4ad9d640 1 -- 172.21.15.45:0/627567952 learned_addr learned my addr 172.21.15.45:0/627567952 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:41.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b4a59c640 1 --2- 172.21.15.45:0/627567952 >> v2:172.21.15.155:3300/0 conn(0x7f0b4c15c060 0x7f0b4c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:41.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359761109 0 0) 0x7f0b4c160a50 con 0x7f0b4c0d2620 2023-07-09T02:22:41.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b38003530 con 0x7f0b4c0d2620 2023-07-09T02:22:41.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827217998 0 0) 0x7f0b4c15c430 con 0x7f0b4c0cd120 2023-07-09T02:22:41.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b4c160a50 con 0x7f0b4c0cd120 2023-07-09T02:22:41.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1095593024 0 0) 0x7f0b38003530 con 0x7f0b4c0d2620 2023-07-09T02:22:41.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 >> v2:172.21.15.155:3300/0 conn(0x7f0b4c15c060 msgr2=0x7f0b4c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:41.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 --2- 172.21.15.45:0/627567952 >> v2:172.21.15.155:3300/0 conn(0x7f0b4c15c060 0x7f0b4c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 >> v1:172.21.15.155:6789/0 conn(0x7f0b4c0cd120 legacy=0x7f0b4c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:41.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c15fe40 con 0x7f0b4c0d2620 2023-07-09T02:22:41.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f0b44001a00 con 0x7f0b4c0d2620 2023-07-09T02:22:41.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 >> v1:172.21.15.45:6789/0 conn(0x7f0b4c0d2620 legacy=0x7f0b4c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:41.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b38003b10 0x7f0b38003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:41.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b380047d0 0x7f0b38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:41.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c15fb60 con 0x7f0b38005180 2023-07-09T02:22:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3800bfe0 con 0x7f0b380047d0 2023-07-09T02:22:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3800c1a0 con 0x7f0b38003b10 2023-07-09T02:22:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b4a59c640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b38003b10 0x7f0b38003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b4ad9d640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.948+0000 7f0b43fff640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b380047d0 0x7f0b38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b4ad9d640 1 -- 172.21.15.45:0/627567952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b38003b10 msgr2=0x7f0b38003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:41.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b4ad9d640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b38003b10 0x7f0b38003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b4ad9d640 1 -- 172.21.15.45:0/627567952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b380047d0 msgr2=0x7f0b38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:41.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b4ad9d640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b380047d0 0x7f0b38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b4ad9d640 1 -- 172.21.15.45:0/627567952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38003530 con 0x7f0b38005180 2023-07-09T02:22:41.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b4ad9d640 1 -- 172.21.15.45:0/627567952 reap_dead start 2023-07-09T02:22:41.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b4ad9d640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c06b140 tx=0x7f0b4401f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b200e819ec4c3a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:41.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b440ac650 con 0x7f0b38005180 2023-07-09T02:22:41.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b440ac7d0 con 0x7f0b38005180 2023-07-09T02:22:41.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.952+0000 7f0b49d9b640 1 -- 172.21.15.45:0/627567952 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b440acb80 con 0x7f0b38005180 2023-07-09T02:22:41.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- 172.21.15.45:0/627567952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b38005180 msgr2=0x7f0b3800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:41.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c06b140 tx=0x7f0b4401f9a0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- 172.21.15.45:0/627567952 shutdown_connections 2023-07-09T02:22:41.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 --2- 172.21.15.45:0/627567952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- 172.21.15.45:0/627567952 >> 172.21.15.45:0/627567952 conn(0x7f0b4c0698e0 msgr2=0x7f0b4c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:41.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- 172.21.15.45:0/627567952 shutdown_connections 2023-07-09T02:22:41.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- 172.21.15.45:0/627567952 wait complete. 2023-07-09T02:22:41.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 Processor -- start 2023-07-09T02:22:41.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- start start 2023-07-09T02:22:41.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b38005180 0x7f0b4c14b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:41.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c15f0c0 0x7f0b4c1f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:41.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b4c14a6a0 0x7f0b4c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:41.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c15dd50 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c14b050 con 0x7f0b38005180 2023-07-09T02:22:41.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b50940640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c15d0d0 con 0x7f0b4c14a6a0 2023-07-09T02:22:41.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c15f0c0 0x7f0b4c1f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:41.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b43fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c15f0c0 0x7f0b4c1f1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46318/0 (socket says 172.21.15.45:46318) 2023-07-09T02:22:41.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b43fff640 1 -- 172.21.15.45:0/2226092752 learned_addr learned my addr 172.21.15.45:0/2226092752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:41.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b4a59c640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b38005180 0x7f0b4c14b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:41.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b4ad9d640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b4c14a6a0 0x7f0b4c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:41.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b43fff640 1 -- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b4c14a6a0 msgr2=0x7f0b4c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:41.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b43fff640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b4c14a6a0 0x7f0b4c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b43fff640 1 -- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b38005180 msgr2=0x7f0b4c14b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:41.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b43fff640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b38005180 0x7f0b4c14b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b43fff640 1 -- 172.21.15.45:0/2226092752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c15d3b0 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b4a59c640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b38005180 0x7f0b4c14b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.956+0000 7f0b4ad9d640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b4c14a6a0 0x7f0b4c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b43fff640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c15f0c0 0x7f0b4c1f1020 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400f7a0 tx=0x7f0b3400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b42ffd640 1 -- 172.21.15.45:0/2226092752 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34005110 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b42ffd640 1 -- 172.21.15.45:0/2226092752 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34005270 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b42ffd640 1 -- 172.21.15.45:0/2226092752 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b340067e0 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c15d690 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c15f530 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c15de90 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b42ffd640 1 -- 172.21.15.45:0/2226092752 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b34006940 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b42ffd640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b2c066280 0x7f0b2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:41.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b42ffd640 1 -- 172.21.15.45:0/2226092752 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b340834a0 con 0x7f0b4c15f0c0 2023-07-09T02:22:41.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.960+0000 7f0b4a59c640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b2c066280 0x7f0b2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:41.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.964+0000 7f0b4a59c640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b2c066280 0x7f0b2c068730 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009a60 tx=0x7f0b3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:41.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:41.964+0000 7f0b42ffd640 1 -- 172.21.15.45:0/2226092752 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b4c15de90 con 0x7f0b4c15f0c0 2023-07-09T02:22:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.152+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0b4c15de90 con 0x7f0b4c15f0c0 2023-07-09T02:22:42.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.776+0000 7f0b42ffd640 1 -- 172.21.15.45:0/2226092752 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v91) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0b4c15de90 con 0x7f0b4c15f0c0 2023-07-09T02:22:42.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b2c066280 msgr2=0x7f0b2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:42.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b2c066280 0x7f0b2c068730 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009a60 tx=0x7f0b3c008040 comp rx=0 tx=0).stop 2023-07-09T02:22:42.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c15f0c0 msgr2=0x7f0b4c1f1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:42.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c15f0c0 0x7f0b4c1f1020 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400f7a0 tx=0x7f0b3400fc60 comp rx=0 tx=0).stop 2023-07-09T02:22:42.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 shutdown_connections 2023-07-09T02:22:42.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0b2c066280 0x7f0b2c068730 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:42.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b4c14a6a0 0x7f0b4c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:42.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c15f0c0 0x7f0b4c1f1020 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:42.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 --2- 172.21.15.45:0/2226092752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b38005180 0x7f0b4c14b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:42.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 >> 172.21.15.45:0/2226092752 conn(0x7f0b4c0698e0 msgr2=0x7f0b4c0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:42.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 shutdown_connections 2023-07-09T02:22:42.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.780+0000 7f0b50940640 1 -- 172.21.15.45:0/2226092752 wait complete. 2023-07-09T02:22:42.802 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T02:22:42.803 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.948+0000 7f9ac812c640 1 Processor -- start 2023-07-09T02:22:42.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac812c640 1 -- start start 2023-07-09T02:22:42.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac812c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ac00d2620 0x7f9ac00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac812c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac0160a50 con 0x7f9ac00cd120 2023-07-09T02:22:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac812c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac015c430 con 0x7f9ac015c060 2023-07-09T02:22:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac812c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac015fb60 con 0x7f9ac00d2620 2023-07-09T02:22:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac66c9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9ac00cd120 0x7f9ac00cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38328/0 (socket says 172.21.15.45:38328) 2023-07-09T02:22:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac66c9640 1 -- 172.21.15.45:0/2303995822 learned_addr learned my addr 172.21.15.45:0/2303995822 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:42.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac56c7640 1 --2- 172.21.15.45:0/2303995822 >> v2:172.21.15.155:3300/0 conn(0x7f9ac00d2620 0x7f9ac00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac4ec6640 1 -- 172.21.15.45:0/2303995822 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347205361 0 0) 0x7f9ac0160a50 con 0x7f9ac00cd120 2023-07-09T02:22:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac4ec6640 1 -- 172.21.15.45:0/2303995822 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aac003530 con 0x7f9ac00cd120 2023-07-09T02:22:42.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac56c7640 1 -- 172.21.15.45:0/2303995822 >> v1:172.21.15.155:6789/0 conn(0x7f9ac015c060 legacy=0x7f9ac00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac4ec6640 1 -- 172.21.15.45:0/2303995822 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234667772 0 0) 0x7f9ac015c430 con 0x7f9ac015c060 2023-07-09T02:22:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac56c7640 1 -- 172.21.15.45:0/2303995822 >> v1:172.21.15.45:6789/0 conn(0x7f9ac00cd120 legacy=0x7f9ac00cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:42.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.952+0000 7f9ac56c7640 1 -- 172.21.15.45:0/2303995822 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac015fe40 con 0x7f9ac00d2620 2023-07-09T02:22:42.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac56c7640 1 --2- 172.21.15.45:0/2303995822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 0x7f9ac00b4ed0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00097c0 tx=0x7f9ab001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f92f49253a20be3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac4ec6640 1 -- 172.21.15.45:0/2303995822 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00ab650 con 0x7f9ac00d2620 2023-07-09T02:22:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac4ec6640 1 -- 172.21.15.45:0/2303995822 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab00ab7b0 con 0x7f9ac00d2620 2023-07-09T02:22:42.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac4ec6640 1 -- 172.21.15.45:0/2303995822 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00abb40 con 0x7f9ac00d2620 2023-07-09T02:22:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac812c640 1 -- 172.21.15.45:0/2303995822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 msgr2=0x7f9ac00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac812c640 1 --2- 172.21.15.45:0/2303995822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 0x7f9ac00b4ed0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00097c0 tx=0x7f9ab001c450 comp rx=0 tx=0).stop 2023-07-09T02:22:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac812c640 1 -- 172.21.15.45:0/2303995822 shutdown_connections 2023-07-09T02:22:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac812c640 1 --2- 172.21.15.45:0/2303995822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 0x7f9ac00b4ed0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:42.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac812c640 1 -- 172.21.15.45:0/2303995822 >> 172.21.15.45:0/2303995822 conn(0x7f9ac00698e0 msgr2=0x7f9ac0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac812c640 1 -- 172.21.15.45:0/2303995822 shutdown_connections 2023-07-09T02:22:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.956+0000 7f9ac812c640 1 -- 172.21.15.45:0/2303995822 wait complete. 2023-07-09T02:22:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 Processor -- start 2023-07-09T02:22:42.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 -- start start 2023-07-09T02:22:42.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ac00cd120 0x7f9ac0151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 0x7f9ac0154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac015c060 0x7f9ac01547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac01594b0 con 0x7f9ac015c060 2023-07-09T02:22:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac015a310 con 0x7f9ac00d2620 2023-07-09T02:22:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0159700 con 0x7f9ac00cd120 2023-07-09T02:22:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac015c060 0x7f9ac01547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:42.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac015c060 0x7f9ac01547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46328/0 (socket says 172.21.15.45:46328) 2023-07-09T02:22:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 -- 172.21.15.45:0/2424687653 learned_addr learned my addr 172.21.15.45:0/2424687653 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac5ec8640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ac00cd120 0x7f9ac0151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:42.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac56c7640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 0x7f9ac0154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 -- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ac00cd120 msgr2=0x7f9ac0151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ac00cd120 0x7f9ac0151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 -- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 msgr2=0x7f9ac0154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:42.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 0x7f9ac0154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 -- 172.21.15.45:0/2424687653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0009420 con 0x7f9ac015c060 2023-07-09T02:22:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac66c9640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac015c060 0x7f9ac01547b0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800cb40 tx=0x7f9ab800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ab67fc640 1 -- 172.21.15.45:0/2424687653 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800aca0 con 0x7f9ac015c060 2023-07-09T02:22:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ab67fc640 1 -- 172.21.15.45:0/2424687653 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800ae00 con 0x7f9ac015c060 2023-07-09T02:22:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ab67fc640 1 -- 172.21.15.45:0/2424687653 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8012620 con 0x7f9ac015c060 2023-07-09T02:22:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac00b59f0 con 0x7f9ac015c060 2023-07-09T02:22:42.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac0159cc0 con 0x7f9ac015c060 2023-07-09T02:22:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.960+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac015a480 con 0x7f9ac015c060 2023-07-09T02:22:42.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.964+0000 7f9ab67fc640 1 -- 172.21.15.45:0/2424687653 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ab8007070 con 0x7f9ac015c060 2023-07-09T02:22:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.964+0000 7f9ab67fc640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9aa40662b0 0x7f9aa4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.964+0000 7f9ab67fc640 1 -- 172.21.15.45:0/2424687653 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ab8083d10 con 0x7f9ac015c060 2023-07-09T02:22:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.964+0000 7f9ac5ec8640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9aa40662b0 0x7f9aa4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:42.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.964+0000 7f9ac5ec8640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9aa40662b0 0x7f9aa4068760 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007fd0 tx=0x7f9abc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:42.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:42.968+0000 7f9ab67fc640 1 -- 172.21.15.45:0/2424687653 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ab8089020 con 0x7f9ac015c060 2023-07-09T02:22:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.152+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ac004d7d0 con 0x7f9ac015c060 2023-07-09T02:22:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.152+0000 7f9ab67fc640 1 -- 172.21.15.45:0/2424687653 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f9ab80511a0 con 0x7f9ac015c060 2023-07-09T02:22:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:43.154 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:22:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:22:43.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.152+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9aa40662b0 msgr2=0x7f9aa4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.152+0000 7f9ac812c640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9aa40662b0 0x7f9aa4068760 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007fd0 tx=0x7f9abc009040 comp rx=0 tx=0).stop 2023-07-09T02:22:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.152+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac015c060 msgr2=0x7f9ac01547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.152+0000 7f9ac812c640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac015c060 0x7f9ac01547b0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800cb40 tx=0x7f9ab800a060 comp rx=0 tx=0).stop 2023-07-09T02:22:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.156+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 shutdown_connections 2023-07-09T02:22:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.156+0000 7f9ac812c640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac015c060 0x7f9ac01547b0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.156+0000 7f9ac812c640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ac00d2620 0x7f9ac0154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.156+0000 7f9ac812c640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9aa40662b0 0x7f9aa4068760 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.156+0000 7f9ac812c640 1 --2- 172.21.15.45:0/2424687653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ac00cd120 0x7f9ac0151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.156+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 >> 172.21.15.45:0/2424687653 conn(0x7f9ac00698e0 msgr2=0x7f9ac00b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.156+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 shutdown_connections 2023-07-09T02:22:43.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.156+0000 7f9ac812c640 1 -- 172.21.15.45:0/2424687653 wait complete. 2023-07-09T02:22:43.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:22:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.316+0000 7fdfc9ffa640 1 Processor -- start 2023-07-09T02:22:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.316+0000 7fdfc9ffa640 1 -- start start 2023-07-09T02:22:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc9ffa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdfc406c110 0x7fdfc406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc9ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40caec0 0x7fdfc40cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc9ffa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc406caa0 con 0x7fdfc4158e30 2023-07-09T02:22:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc9ffa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc40ccf80 con 0x7fdfc406c110 2023-07-09T02:22:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc9ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40cd540 con 0x7fdfc40caec0 2023-07-09T02:22:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdfc406c110 0x7fdfc406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdfc406c110 0x7fdfc406c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46336/0 (socket says 172.21.15.45:46336) 2023-07-09T02:22:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc2ffd640 1 -- 172.21.15.45:0/2119274175 learned_addr learned my addr 172.21.15.45:0/2119274175 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc3fff640 1 --2- 172.21.15.45:0/2119274175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40caec0 0x7fdfc40cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc2ffd640 1 -- 172.21.15.45:0/2119274175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40caec0 msgr2=0x7fdfc40cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc2ffd640 1 --2- 172.21.15.45:0/2119274175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40caec0 0x7fdfc40cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc2ffd640 1 -- 172.21.15.45:0/2119274175 >> v1:172.21.15.155:6789/0 conn(0x7fdfc4158e30 legacy=0x7fdfc406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc2ffd640 1 -- 172.21.15.45:0/2119274175 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40cb880 con 0x7fdfc406c110 2023-07-09T02:22:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc3fff640 1 --2- 172.21.15.45:0/2119274175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40caec0 0x7fdfc40cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.320+0000 7fdfc2ffd640 1 --2- 172.21.15.45:0/2119274175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc406c110 0x7fdfc406c560 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009870 tx=0x7fdfb801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aad67bd123662b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc27fc640 1 -- 172.21.15.45:0/2119274175 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80ab680 con 0x7fdfc406c110 2023-07-09T02:22:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc27fc640 1 -- 172.21.15.45:0/2119274175 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80ab7e0 con 0x7fdfc406c110 2023-07-09T02:22:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc27fc640 1 -- 172.21.15.45:0/2119274175 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80abb70 con 0x7fdfc406c110 2023-07-09T02:22:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2119274175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc406c110 msgr2=0x7fdfc406c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2119274175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc406c110 0x7fdfc406c560 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009870 tx=0x7fdfb801c480 comp rx=0 tx=0).stop 2023-07-09T02:22:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2119274175 shutdown_connections 2023-07-09T02:22:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2119274175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc40caec0 0x7fdfc40cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2119274175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc406c110 0x7fdfc406c560 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2119274175 >> 172.21.15.45:0/2119274175 conn(0x7fdfc40694b0 msgr2=0x7fdfc40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2119274175 shutdown_connections 2023-07-09T02:22:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2119274175 wait complete. 2023-07-09T02:22:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 Processor -- start 2023-07-09T02:22:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- start start 2023-07-09T02:22:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc406c110 0x7fdfc4157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc40caec0 0x7fdfc40c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4158e30 0x7fdfc4149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41fd0b0 con 0x7fdfc40caec0 2023-07-09T02:22:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4157580 con 0x7fdfc4158e30 2023-07-09T02:22:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.324+0000 7fdfc9ffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41577e0 con 0x7fdfc406c110 2023-07-09T02:22:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc40caec0 0x7fdfc40c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc40caec0 0x7fdfc40c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46352/0 (socket says 172.21.15.45:46352) 2023-07-09T02:22:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 -- 172.21.15.45:0/2589933326 learned_addr learned my addr 172.21.15.45:0/2589933326 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc37fe640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc406c110 0x7fdfc4157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc3fff640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4158e30 0x7fdfc4149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 -- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc406c110 msgr2=0x7fdfc4157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc406c110 0x7fdfc4157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 -- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4158e30 msgr2=0x7fdfc4149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4158e30 0x7fdfc4149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 -- 172.21.15.45:0/2589933326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb80094d0 con 0x7fdfc40caec0 2023-07-09T02:22:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc2ffd640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc40caec0 0x7fdfc40c7180 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fdfb801a0b0 tx=0x7fdfb801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfabfff640 1 -- 172.21.15.45:0/2589933326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80b48c0 con 0x7fdfc40caec0 2023-07-09T02:22:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfabfff640 1 -- 172.21.15.45:0/2589933326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80b4a40 con 0x7fdfc40caec0 2023-07-09T02:22:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfabfff640 1 -- 172.21.15.45:0/2589933326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80b4df0 con 0x7fdfc40caec0 2023-07-09T02:22:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc41fc780 con 0x7fdfc40caec0 2023-07-09T02:22:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc41fcd40 con 0x7fdfc40caec0 2023-07-09T02:22:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc404d7d0 con 0x7fdfc40caec0 2023-07-09T02:22:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.328+0000 7fdfabfff640 1 -- 172.21.15.45:0/2589933326 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdfb80aa460 con 0x7fdfc40caec0 2023-07-09T02:22:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.332+0000 7fdfabfff640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfb0066280 0x7fdfb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.332+0000 7fdfabfff640 1 -- 172.21.15.45:0/2589933326 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfb811e920 con 0x7fdfc40caec0 2023-07-09T02:22:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.332+0000 7fdfc37fe640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfb0066280 0x7fdfb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.332+0000 7fdfc37fe640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfb0066280 0x7fdfb0068730 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4007fd0 tx=0x7fdfb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:43.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.336+0000 7fdfabfff640 1 -- 172.21.15.45:0/2589933326 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfb80ebe40 con 0x7fdfc40caec0 2023-07-09T02:22:43.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfc40ccb30 con 0x7fdfc40caec0 2023-07-09T02:22:43.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfabfff640 1 -- 172.21.15.45:0/2589933326 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+18295 (secure 0 0 0) 0x7fdfb80ef460 con 0x7fdfc40caec0 2023-07-09T02:22:43.493 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:43.493 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":182,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:22:40.474244+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:22:37.645121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T02:22:38.115103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:22:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfb0066280 msgr2=0x7fdfb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfb0066280 0x7fdfb0068730 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4007fd0 tx=0x7fdfb4009040 comp rx=0 tx=0).stop 2023-07-09T02:22:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc40caec0 msgr2=0x7fdfc40c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc40caec0 0x7fdfc40c7180 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fdfb801a0b0 tx=0x7fdfb801acc0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 shutdown_connections 2023-07-09T02:22:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4158e30 0x7fdfc4149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc40caec0 0x7fdfc40c7180 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdfb0066280 0x7fdfb0068730 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 --2- 172.21.15.45:0/2589933326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfc406c110 0x7fdfc4157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.492+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 >> 172.21.15.45:0/2589933326 conn(0x7fdfc40694b0 msgr2=0x7fdfc406f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.496+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 shutdown_connections 2023-07-09T02:22:43.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.496+0000 7fdfc9ffa640 1 -- 172.21.15.45:0/2589933326 wait complete. 2023-07-09T02:22:43.514 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T02:22:43.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:22:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.656+0000 7fe2fe182640 1 Processor -- start 2023-07-09T02:22:43.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.656+0000 7fe2fe182640 1 -- start start 2023-07-09T02:22:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2fe182640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2f80d2620 0x7fe2f80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2fe182640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f80cd120 0x7fe2f80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2fe182640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f8160a50 con 0x7fe2f815c060 2023-07-09T02:22:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2fe182640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f815c430 con 0x7fe2f80d2620 2023-07-09T02:22:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2fe182640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f815fb60 con 0x7fe2f80cd120 2023-07-09T02:22:43.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f6ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2f80d2620 0x7fe2f80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f7fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f80cd120 0x7fe2f80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f6ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2f80d2620 0x7fe2f80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:50708/0 (socket says 172.21.15.45:50708) 2023-07-09T02:22:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f6ffd640 1 -- 172.21.15.45:0/3855881304 learned_addr learned my addr 172.21.15.45:0/3855881304 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f7fff640 1 --2- 172.21.15.45:0/3855881304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f80cd120 0x7fe2f80cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:60860/0 (socket says 172.21.15.45:60860) 2023-07-09T02:22:43.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f7fff640 1 -- 172.21.15.45:0/3855881304 >> v2:172.21.15.155:3300/0 conn(0x7fe2f80d2620 msgr2=0x7fe2f80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f7fff640 1 --2- 172.21.15.45:0/3855881304 >> v2:172.21.15.155:3300/0 conn(0x7fe2f80d2620 0x7fe2f80b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f7fff640 1 -- 172.21.15.45:0/3855881304 >> v1:172.21.15.155:6789/0 conn(0x7fe2f815c060 legacy=0x7fe2f80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.660+0000 7fe2f7fff640 1 -- 172.21.15.45:0/3855881304 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f815fe40 con 0x7fe2f80cd120 2023-07-09T02:22:43.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2f7fff640 1 --2- 172.21.15.45:0/3855881304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f80cd120 0x7fe2f80cee30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009d90 tx=0x7fe2f001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a764a0e8e32d22 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:43.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2f67fc640 1 -- 172.21.15.45:0/3855881304 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00a59e0 con 0x7fe2f80cd120 2023-07-09T02:22:43.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2f67fc640 1 -- 172.21.15.45:0/3855881304 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f00a5b40 con 0x7fe2f80cd120 2023-07-09T02:22:43.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2f67fc640 1 -- 172.21.15.45:0/3855881304 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00ad440 con 0x7fe2f80cd120 2023-07-09T02:22:43.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 -- 172.21.15.45:0/3855881304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f80cd120 msgr2=0x7fe2f80cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3855881304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f80cd120 0x7fe2f80cee30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009d90 tx=0x7fe2f001c920 comp rx=0 tx=0).stop 2023-07-09T02:22:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 -- 172.21.15.45:0/3855881304 shutdown_connections 2023-07-09T02:22:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3855881304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f80cd120 0x7fe2f80cee30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3855881304 >> v2:172.21.15.155:3300/0 conn(0x7fe2f80d2620 0x7fe2f80b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 -- 172.21.15.45:0/3855881304 >> 172.21.15.45:0/3855881304 conn(0x7fe2f80698e0 msgr2=0x7fe2f8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:43.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 -- 172.21.15.45:0/3855881304 shutdown_connections 2023-07-09T02:22:43.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 -- 172.21.15.45:0/3855881304 wait complete. 2023-07-09T02:22:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 Processor -- start 2023-07-09T02:22:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.664+0000 7fe2fe182640 1 -- start start 2023-07-09T02:22:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f80cd120 0x7fe2f8153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2f80d2620 0x7fe2f815ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f815c060 0x7fe2f8159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80cc730 con 0x7fe2f80cd120 2023-07-09T02:22:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f8154420 con 0x7fe2f80d2620 2023-07-09T02:22:43.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f815ca30 con 0x7fe2f815c060 2023-07-09T02:22:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f80cd120 0x7fe2f8153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f80cd120 0x7fe2f8153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46354/0 (socket says 172.21.15.45:46354) 2023-07-09T02:22:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 -- 172.21.15.45:0/3839505123 learned_addr learned my addr 172.21.15.45:0/3839505123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f7fff640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f815c060 0x7fe2f8159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f6ffd640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2f80d2620 0x7fe2f815ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 -- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f815c060 msgr2=0x7fe2f8159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f815c060 0x7fe2f8159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 -- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2f80d2620 msgr2=0x7fe2f815ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2f80d2620 0x7fe2f815ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 -- 172.21.15.45:0/3839505123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009a70 con 0x7fe2f80cd120 2023-07-09T02:22:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f7fff640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f815c060 0x7fe2f8159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2f77fe640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f80cd120 0x7fe2f8153ee0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c3c0 tx=0x7fe2e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2dffff640 1 -- 172.21.15.45:0/3839505123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e80052d0 con 0x7fe2f80cd120 2023-07-09T02:22:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2dffff640 1 -- 172.21.15.45:0/3839505123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e8005430 con 0x7fe2f80cd120 2023-07-09T02:22:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2dffff640 1 -- 172.21.15.45:0/3839505123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8003840 con 0x7fe2f80cd120 2023-07-09T02:22:43.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f80b59f0 con 0x7fe2f80cd120 2023-07-09T02:22:43.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f815cff0 con 0x7fe2f80cd120 2023-07-09T02:22:43.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f804d7d0 con 0x7fe2f80cd120 2023-07-09T02:22:43.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.668+0000 7fe2dffff640 1 -- 172.21.15.45:0/3839505123 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2e80039a0 con 0x7fe2f80cd120 2023-07-09T02:22:43.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.672+0000 7fe2dffff640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2e4066280 0x7fe2e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:43.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.672+0000 7fe2dffff640 1 -- 172.21.15.45:0/3839505123 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2e8083300 con 0x7fe2f80cd120 2023-07-09T02:22:43.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.672+0000 7fe2f6ffd640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2e4066280 0x7fe2e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:43.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.672+0000 7fe2f6ffd640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2e4066280 0x7fe2e4068730 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe2f81f81c0 tx=0x7fe2ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:43.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.676+0000 7fe2dffff640 1 -- 172.21.15.45:0/3839505123 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2e80506e0 con 0x7fe2f80cd120 2023-07-09T02:22:43.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.828+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2f81606e0 con 0x7fe2e4066280 2023-07-09T02:22:43.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.836+0000 7fe2dffff640 1 -- 172.21.15.45:0/3839505123 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305749 (secure 0 0 0) 0x7fe2ec011970 con 0x7fe2e4066280 2023-07-09T02:22:43.840 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:43.841 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:22:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2e4066280 msgr2=0x7fe2e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2e4066280 0x7fe2e4068730 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe2f81f81c0 tx=0x7fe2ec008040 comp rx=0 tx=0).stop 2023-07-09T02:22:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f80cd120 msgr2=0x7fe2f8153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f80cd120 0x7fe2f8153ee0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c3c0 tx=0x7fe2e800c880 comp rx=0 tx=0).stop 2023-07-09T02:22:43.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 shutdown_connections 2023-07-09T02:22:43.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe2e4066280 0x7fe2e4068730 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2f815c060 0x7fe2f8159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2f80d2620 0x7fe2f815ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 --2- 172.21.15.45:0/3839505123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2f80cd120 0x7fe2f8153ee0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:43.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 >> 172.21.15.45:0/3839505123 conn(0x7fe2f80698e0 msgr2=0x7fe2f8069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:43.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 shutdown_connections 2023-07-09T02:22:43.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:43.840+0000 7fe2fe182640 1 -- 172.21.15.45:0/3839505123 wait complete. 2023-07-09T02:22:43.861 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2023-07-09T02:22:42.698988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9608,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552891,"statfs":{"total":1600000000,"available":1590160452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970634"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480539+0000","last_change":"2023-07-09T02:22:39.487748+0000","last_active":"2023-07-09T02:22:40.480539+0000","last_peered":"2023-07-09T02:22:40.480539+0000","last_clean":"2023-07-09T02:22:40.480539+0000","last_became_active":"2023-07-09T02:22:39.486558+0000","last_became_peered":"2023-07-09T02:22:39.486558+0000","last_unstale":"2023-07-09T02:22:40.480539+0000","last_undegraded":"2023-07-09T02:22:40.480539+0000","last_fullsized":"2023-07-09T02:22:40.480539+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:53:41.306217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.496509+0000","last_change":"2023-07-09T02:22:39.496415+0000","last_active":"2023-07-09T02:22:39.496509+0000","last_peered":"2023-07-09T02:22:39.496509+0000","last_clean":"2023-07-09T02:22:39.496509+0000","last_became_active":"2023-07-09T02:22:39.494244+0000","last_became_peered":"2023-07-09T02:22:39.494244+0000","last_unstale":"2023-07-09T02:22:39.496509+0000","last_undegraded":"2023-07-09T02:22:39.496509+0000","last_fullsized":"2023-07-09T02:22:39.496509+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:41:12.711524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479582+0000","last_change":"2023-07-09T02:22:39.487148+0000","last_active":"2023-07-09T02:22:40.479582+0000","last_peered":"2023-07-09T02:22:40.479582+0000","last_clean":"2023-07-09T02:22:40.479582+0000","last_became_active":"2023-07-09T02:22:39.486881+0000","last_became_peered":"2023-07-09T02:22:39.486881+0000","last_unstale":"2023-07-09T02:22:40.479582+0000","last_undegraded":"2023-07-09T02:22:40.479582+0000","last_fullsized":"2023-07-09T02:22:40.479582+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:47:53.586283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479495+0000","last_change":"2023-07-09T02:22:39.489464+0000","last_active":"2023-07-09T02:22:40.479495+0000","last_peered":"2023-07-09T02:22:40.479495+0000","last_clean":"2023-07-09T02:22:40.479495+0000","last_became_active":"2023-07-09T02:22:39.489044+0000","last_became_peered":"2023-07-09T02:22:39.489044+0000","last_unstale":"2023-07-09T02:22:40.479495+0000","last_undegraded":"2023-07-09T02:22:40.479495+0000","last_fullsized":"2023-07-09T02:22:40.479495+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:26:47.023096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479305+0000","last_change":"2023-07-09T02:22:39.484777+0000","last_active":"2023-07-09T02:22:40.479305+0000","last_peered":"2023-07-09T02:22:40.479305+0000","last_clean":"2023-07-09T02:22:40.479305+0000","last_became_active":"2023-07-09T02:22:39.482544+0000","last_became_peered":"2023-07-09T02:22:39.482544+0000","last_unstale":"2023-07-09T02:22:40.479305+0000","last_undegraded":"2023-07-09T02:22:40.479305+0000","last_fullsized":"2023-07-09T02:22:40.479305+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:15:33.904084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491954+0000","last_change":"2023-07-09T02:22:39.489866+0000","last_active":"2023-07-09T02:22:39.491954+0000","last_peered":"2023-07-09T02:22:39.491954+0000","last_clean":"2023-07-09T02:22:39.491954+0000","last_became_active":"2023-07-09T02:22:39.489607+0000","last_became_peered":"2023-07-09T02:22:39.489607+0000","last_unstale":"2023-07-09T02:22:39.491954+0000","last_undegraded":"2023-07-09T02:22:39.491954+0000","last_fullsized":"2023-07-09T02:22:39.491954+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:19:59.829378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.483492+0000","last_change":"2023-07-09T02:22:39.483033+0000","last_active":"2023-07-09T02:22:39.483492+0000","last_peered":"2023-07-09T02:22:39.483492+0000","last_clean":"2023-07-09T02:22:39.483492+0000","last_became_active":"2023-07-09T02:22:39.482646+0000","last_became_peered":"2023-07-09T02:22:39.482646+0000","last_unstale":"2023-07-09T02:22:39.483492+0000","last_undegraded":"2023-07-09T02:22:39.483492+0000","last_fullsized":"2023-07-09T02:22:39.483492+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:52:20.682821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.484296+0000","last_change":"2023-07-09T02:22:39.484230+0000","last_active":"2023-07-09T02:22:39.484296+0000","last_peered":"2023-07-09T02:22:39.484296+0000","last_clean":"2023-07-09T02:22:39.484296+0000","last_became_active":"2023-07-09T02:22:39.484003+0000","last_became_peered":"2023-07-09T02:22:39.484003+0000","last_unstale":"2023-07-09T02:22:39.484296+0000","last_undegraded":"2023-07-09T02:22:39.484296+0000","last_fullsized":"2023-07-09T02:22:39.484296+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:30:45.145239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493995+0000","last_change":"2023-07-09T02:22:39.493911+0000","last_active":"2023-07-09T02:22:39.493995+0000","last_peered":"2023-07-09T02:22:39.493995+0000","last_clean":"2023-07-09T02:22:39.493995+0000","last_became_active":"2023-07-09T02:22:39.493312+0000","last_became_peered":"2023-07-09T02:22:39.493312+0000","last_unstale":"2023-07-09T02:22:39.493995+0000","last_undegraded":"2023-07-09T02:22:39.493995+0000","last_fullsized":"2023-07-09T02:22:39.493995+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:07:11.735678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.490356+0000","last_change":"2023-07-09T02:22:39.489846+0000","last_active":"2023-07-09T02:22:39.490356+0000","last_peered":"2023-07-09T02:22:39.490356+0000","last_clean":"2023-07-09T02:22:39.490356+0000","last_became_active":"2023-07-09T02:22:39.489629+0000","last_became_peered":"2023-07-09T02:22:39.489629+0000","last_unstale":"2023-07-09T02:22:39.490356+0000","last_undegraded":"2023-07-09T02:22:39.490356+0000","last_fullsized":"2023-07-09T02:22:39.490356+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:23:47.146778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481015+0000","last_change":"2023-07-09T02:22:39.492290+0000","last_active":"2023-07-09T02:22:40.481015+0000","last_peered":"2023-07-09T02:22:40.481015+0000","last_clean":"2023-07-09T02:22:40.481015+0000","last_became_active":"2023-07-09T02:22:39.488293+0000","last_became_peered":"2023-07-09T02:22:39.488293+0000","last_unstale":"2023-07-09T02:22:40.481015+0000","last_undegraded":"2023-07-09T02:22:40.481015+0000","last_fullsized":"2023-07-09T02:22:40.481015+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:59:20.961468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493369+0000","last_change":"2023-07-09T02:22:39.493155+0000","last_active":"2023-07-09T02:22:39.493369+0000","last_peered":"2023-07-09T02:22:39.493369+0000","last_clean":"2023-07-09T02:22:39.493369+0000","last_became_active":"2023-07-09T02:22:39.492584+0000","last_became_peered":"2023-07-09T02:22:39.492584+0000","last_unstale":"2023-07-09T02:22:39.493369+0000","last_undegraded":"2023-07-09T02:22:39.493369+0000","last_fullsized":"2023-07-09T02:22:39.493369+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:24:42.235900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491808+0000","last_change":"2023-07-09T02:22:39.491718+0000","last_active":"2023-07-09T02:22:39.491808+0000","last_peered":"2023-07-09T02:22:39.491808+0000","last_clean":"2023-07-09T02:22:39.491808+0000","last_became_active":"2023-07-09T02:22:39.491485+0000","last_became_peered":"2023-07-09T02:22:39.491485+0000","last_unstale":"2023-07-09T02:22:39.491808+0000","last_undegraded":"2023-07-09T02:22:39.491808+0000","last_fullsized":"2023-07-09T02:22:39.491808+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:06:18.754803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.478856+0000","last_change":"2023-07-09T02:22:39.483614+0000","last_active":"2023-07-09T02:22:40.478856+0000","last_peered":"2023-07-09T02:22:40.478856+0000","last_clean":"2023-07-09T02:22:40.478856+0000","last_became_active":"2023-07-09T02:22:39.483258+0000","last_became_peered":"2023-07-09T02:22:39.483258+0000","last_unstale":"2023-07-09T02:22:40.478856+0000","last_undegraded":"2023-07-09T02:22:40.478856+0000","last_fullsized":"2023-07-09T02:22:40.478856+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:06:33.465792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481329+0000","last_change":"2023-07-09T02:22:39.485720+0000","last_active":"2023-07-09T02:22:40.481329+0000","last_peered":"2023-07-09T02:22:40.481329+0000","last_clean":"2023-07-09T02:22:40.481329+0000","last_became_active":"2023-07-09T02:22:39.485442+0000","last_became_peered":"2023-07-09T02:22:39.485442+0000","last_unstale":"2023-07-09T02:22:40.481329+0000","last_undegraded":"2023-07-09T02:22:40.481329+0000","last_fullsized":"2023-07-09T02:22:40.481329+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:42:17.333391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480293+0000","last_change":"2023-07-09T02:22:39.488241+0000","last_active":"2023-07-09T02:22:40.480293+0000","last_peered":"2023-07-09T02:22:40.480293+0000","last_clean":"2023-07-09T02:22:40.480293+0000","last_became_active":"2023-07-09T02:22:39.487978+0000","last_became_peered":"2023-07-09T02:22:39.487978+0000","last_unstale":"2023-07-09T02:22:40.480293+0000","last_undegraded":"2023-07-09T02:22:40.480293+0000","last_fullsized":"2023-07-09T02:22:40.480293+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:30:48.704569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.483475+0000","last_change":"2023-07-09T02:22:39.482876+0000","last_active":"2023-07-09T02:22:39.483475+0000","last_peered":"2023-07-09T02:22:39.483475+0000","last_clean":"2023-07-09T02:22:39.483475+0000","last_became_active":"2023-07-09T02:22:39.482322+0000","last_became_peered":"2023-07-09T02:22:39.482322+0000","last_unstale":"2023-07-09T02:22:39.483475+0000","last_undegraded":"2023-07-09T02:22:39.483475+0000","last_fullsized":"2023-07-09T02:22:39.483475+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:01:10.578983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.492160+0000","last_change":"2023-07-09T02:22:39.491991+0000","last_active":"2023-07-09T02:22:39.492160+0000","last_peered":"2023-07-09T02:22:39.492160+0000","last_clean":"2023-07-09T02:22:39.492160+0000","last_became_active":"2023-07-09T02:22:39.491768+0000","last_became_peered":"2023-07-09T02:22:39.491768+0000","last_unstale":"2023-07-09T02:22:39.492160+0000","last_undegraded":"2023-07-09T02:22:39.492160+0000","last_fullsized":"2023-07-09T02:22:39.492160+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:25:42.151824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480521+0000","last_change":"2023-07-09T02:22:39.490239+0000","last_active":"2023-07-09T02:22:40.480521+0000","last_peered":"2023-07-09T02:22:40.480521+0000","last_clean":"2023-07-09T02:22:40.480521+0000","last_became_active":"2023-07-09T02:22:39.489998+0000","last_became_peered":"2023-07-09T02:22:39.489998+0000","last_unstale":"2023-07-09T02:22:40.480521+0000","last_undegraded":"2023-07-09T02:22:40.480521+0000","last_fullsized":"2023-07-09T02:22:40.480521+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:50:04.058973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489244+0000","last_change":"2023-07-09T02:22:39.489027+0000","last_active":"2023-07-09T02:22:39.489244+0000","last_peered":"2023-07-09T02:22:39.489244+0000","last_clean":"2023-07-09T02:22:39.489244+0000","last_became_active":"2023-07-09T02:22:39.488784+0000","last_became_peered":"2023-07-09T02:22:39.488784+0000","last_unstale":"2023-07-09T02:22:39.489244+0000","last_undegraded":"2023-07-09T02:22:39.489244+0000","last_fullsized":"2023-07-09T02:22:39.489244+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:16:29.937309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.488254+0000","last_change":"2023-07-09T02:22:39.488177+0000","last_active":"2023-07-09T02:22:39.488254+0000","last_peered":"2023-07-09T02:22:39.488254+0000","last_clean":"2023-07-09T02:22:39.488254+0000","last_became_active":"2023-07-09T02:22:39.487947+0000","last_became_peered":"2023-07-09T02:22:39.487947+0000","last_unstale":"2023-07-09T02:22:39.488254+0000","last_undegraded":"2023-07-09T02:22:39.488254+0000","last_fullsized":"2023-07-09T02:22:39.488254+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:05:52.907426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493082+0000","last_change":"2023-07-09T02:22:39.492843+0000","last_active":"2023-07-09T02:22:39.493082+0000","last_peered":"2023-07-09T02:22:39.493082+0000","last_clean":"2023-07-09T02:22:39.493082+0000","last_became_active":"2023-07-09T02:22:39.489762+0000","last_became_peered":"2023-07-09T02:22:39.489762+0000","last_unstale":"2023-07-09T02:22:39.493082+0000","last_undegraded":"2023-07-09T02:22:39.493082+0000","last_fullsized":"2023-07-09T02:22:39.493082+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:42:07.353314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.478956+0000","last_change":"2023-07-09T02:22:39.487207+0000","last_active":"2023-07-09T02:22:40.478956+0000","last_peered":"2023-07-09T02:22:40.478956+0000","last_clean":"2023-07-09T02:22:40.478956+0000","last_became_active":"2023-07-09T02:22:39.486914+0000","last_became_peered":"2023-07-09T02:22:39.486914+0000","last_unstale":"2023-07-09T02:22:40.478956+0000","last_undegraded":"2023-07-09T02:22:40.478956+0000","last_fullsized":"2023-07-09T02:22:40.478956+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:23.675860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479672+0000","last_change":"2023-07-09T02:22:39.489296+0000","last_active":"2023-07-09T02:22:40.479672+0000","last_peered":"2023-07-09T02:22:40.479672+0000","last_clean":"2023-07-09T02:22:40.479672+0000","last_became_active":"2023-07-09T02:22:39.488707+0000","last_became_peered":"2023-07-09T02:22:39.488707+0000","last_unstale":"2023-07-09T02:22:40.479672+0000","last_undegraded":"2023-07-09T02:22:40.479672+0000","last_fullsized":"2023-07-09T02:22:40.479672+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:04:42.913735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491792+0000","last_change":"2023-07-09T02:22:39.491402+0000","last_active":"2023-07-09T02:22:39.491792+0000","last_peered":"2023-07-09T02:22:39.491792+0000","last_clean":"2023-07-09T02:22:39.491792+0000","last_became_active":"2023-07-09T02:22:39.491179+0000","last_became_peered":"2023-07-09T02:22:39.491179+0000","last_unstale":"2023-07-09T02:22:39.491792+0000","last_undegraded":"2023-07-09T02:22:39.491792+0000","last_fullsized":"2023-07-09T02:22:39.491792+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:25:42.151824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.487368+0000","last_change":"2023-07-09T02:22:39.487297+0000","last_active":"2023-07-09T02:22:39.487368+0000","last_peered":"2023-07-09T02:22:39.487368+0000","last_clean":"2023-07-09T02:22:39.487368+0000","last_became_active":"2023-07-09T02:22:39.487077+0000","last_became_peered":"2023-07-09T02:22:39.487077+0000","last_unstale":"2023-07-09T02:22:39.487368+0000","last_undegraded":"2023-07-09T02:22:39.487368+0000","last_fullsized":"2023-07-09T02:22:39.487368+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:17:46.033664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493100+0000","last_change":"2023-07-09T02:22:39.493018+0000","last_active":"2023-07-09T02:22:39.493100+0000","last_peered":"2023-07-09T02:22:39.493100+0000","last_clean":"2023-07-09T02:22:39.493100+0000","last_became_active":"2023-07-09T02:22:39.492132+0000","last_became_peered":"2023-07-09T02:22:39.492132+0000","last_unstale":"2023-07-09T02:22:39.493100+0000","last_undegraded":"2023-07-09T02:22:39.493100+0000","last_fullsized":"2023-07-09T02:22:39.493100+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:53:36.757125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.486178+0000","last_change":"2023-07-09T02:22:39.485927+0000","last_active":"2023-07-09T02:22:39.486178+0000","last_peered":"2023-07-09T02:22:39.486178+0000","last_clean":"2023-07-09T02:22:39.486178+0000","last_became_active":"2023-07-09T02:22:39.485402+0000","last_became_peered":"2023-07-09T02:22:39.485402+0000","last_unstale":"2023-07-09T02:22:39.486178+0000","last_undegraded":"2023-07-09T02:22:39.486178+0000","last_fullsized":"2023-07-09T02:22:39.486178+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:52:42.084018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.495829+0000","last_change":"2023-07-09T02:22:39.495736+0000","last_active":"2023-07-09T02:22:39.495829+0000","last_peered":"2023-07-09T02:22:39.495829+0000","last_clean":"2023-07-09T02:22:39.495829+0000","last_became_active":"2023-07-09T02:22:39.494170+0000","last_became_peered":"2023-07-09T02:22:39.494170+0000","last_unstale":"2023-07-09T02:22:39.495829+0000","last_undegraded":"2023-07-09T02:22:39.495829+0000","last_fullsized":"2023-07-09T02:22:39.495829+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:04:51.406237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491636+0000","last_change":"2023-07-09T02:22:39.491551+0000","last_active":"2023-07-09T02:22:39.491636+0000","last_peered":"2023-07-09T02:22:39.491636+0000","last_clean":"2023-07-09T02:22:39.491636+0000","last_became_active":"2023-07-09T02:22:39.491222+0000","last_became_peered":"2023-07-09T02:22:39.491222+0000","last_unstale":"2023-07-09T02:22:39.491636+0000","last_undegraded":"2023-07-09T02:22:39.491636+0000","last_fullsized":"2023-07-09T02:22:39.491636+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:02:38.890881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481161+0000","last_change":"2023-07-09T02:22:39.493927+0000","last_active":"2023-07-09T02:22:40.481161+0000","last_peered":"2023-07-09T02:22:40.481161+0000","last_clean":"2023-07-09T02:22:40.481161+0000","last_became_active":"2023-07-09T02:22:39.488902+0000","last_became_peered":"2023-07-09T02:22:39.488902+0000","last_unstale":"2023-07-09T02:22:40.481161+0000","last_undegraded":"2023-07-09T02:22:40.481161+0000","last_fullsized":"2023-07-09T02:22:40.481161+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:07:11.735678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493346+0000","last_change":"2023-07-09T02:22:39.493236+0000","last_active":"2023-07-09T02:22:39.493346+0000","last_peered":"2023-07-09T02:22:39.493346+0000","last_clean":"2023-07-09T02:22:39.493346+0000","last_became_active":"2023-07-09T02:22:39.493019+0000","last_became_peered":"2023-07-09T02:22:39.493019+0000","last_unstale":"2023-07-09T02:22:39.493346+0000","last_undegraded":"2023-07-09T02:22:39.493346+0000","last_fullsized":"2023-07-09T02:22:39.493346+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:10.477218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.496390+0000","last_change":"2023-07-09T02:22:39.496282+0000","last_active":"2023-07-09T02:22:39.496390+0000","last_peered":"2023-07-09T02:22:39.496390+0000","last_clean":"2023-07-09T02:22:39.496390+0000","last_became_active":"2023-07-09T02:22:39.495959+0000","last_became_peered":"2023-07-09T02:22:39.495959+0000","last_unstale":"2023-07-09T02:22:39.496390+0000","last_undegraded":"2023-07-09T02:22:39.496390+0000","last_fullsized":"2023-07-09T02:22:39.496390+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:46:57.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"181'4","reported_seq":17,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479966+0000","last_change":"2023-07-09T02:22:38.737955+0000","last_active":"2023-07-09T02:22:40.479966+0000","last_peered":"2023-07-09T02:22:40.479966+0000","last_clean":"2023-07-09T02:22:40.479966+0000","last_became_active":"2023-07-09T02:22:38.737708+0000","last_became_peered":"2023-07-09T02:22:38.737708+0000","last_unstale":"2023-07-09T02:22:40.479966+0000","last_undegraded":"2023-07-09T02:22:40.479966+0000","last_fullsized":"2023-07-09T02:22:40.479966+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:57:33.269940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489115+0000","last_change":"2023-07-09T02:22:39.488960+0000","last_active":"2023-07-09T02:22:39.489115+0000","last_peered":"2023-07-09T02:22:39.489115+0000","last_clean":"2023-07-09T02:22:39.489115+0000","last_became_active":"2023-07-09T02:22:39.488711+0000","last_became_peered":"2023-07-09T02:22:39.488711+0000","last_unstale":"2023-07-09T02:22:39.489115+0000","last_undegraded":"2023-07-09T02:22:39.489115+0000","last_fullsized":"2023-07-09T02:22:39.489115+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:51:14.779144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"181'1","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479111+0000","last_change":"2023-07-09T02:22:38.739619+0000","last_active":"2023-07-09T02:22:40.479111+0000","last_peered":"2023-07-09T02:22:40.479111+0000","last_clean":"2023-07-09T02:22:40.479111+0000","last_became_active":"2023-07-09T02:22:38.739126+0000","last_became_peered":"2023-07-09T02:22:38.739126+0000","last_unstale":"2023-07-09T02:22:40.479111+0000","last_undegraded":"2023-07-09T02:22:40.479111+0000","last_fullsized":"2023-07-09T02:22:40.479111+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:42:55.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479227+0000","last_change":"2023-07-09T02:22:39.482411+0000","last_active":"2023-07-09T02:22:40.479227+0000","last_peered":"2023-07-09T02:22:40.479227+0000","last_clean":"2023-07-09T02:22:40.479227+0000","last_became_active":"2023-07-09T02:22:39.482182+0000","last_became_peered":"2023-07-09T02:22:39.482182+0000","last_unstale":"2023-07-09T02:22:40.479227+0000","last_undegraded":"2023-07-09T02:22:40.479227+0000","last_fullsized":"2023-07-09T02:22:40.479227+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:27:16.012508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"181'2","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481469+0000","last_change":"2023-07-09T02:22:38.736296+0000","last_active":"2023-07-09T02:22:40.481469+0000","last_peered":"2023-07-09T02:22:40.481469+0000","last_clean":"2023-07-09T02:22:40.481469+0000","last_became_active":"2023-07-09T02:22:38.736081+0000","last_became_peered":"2023-07-09T02:22:38.736081+0000","last_unstale":"2023-07-09T02:22:40.481469+0000","last_undegraded":"2023-07-09T02:22:40.481469+0000","last_fullsized":"2023-07-09T02:22:40.481469+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:27:47.310826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493584+0000","last_change":"2023-07-09T02:22:39.493469+0000","last_active":"2023-07-09T02:22:39.493584+0000","last_peered":"2023-07-09T02:22:39.493584+0000","last_clean":"2023-07-09T02:22:39.493584+0000","last_became_active":"2023-07-09T02:22:39.492945+0000","last_became_peered":"2023-07-09T02:22:39.492945+0000","last_unstale":"2023-07-09T02:22:39.493584+0000","last_undegraded":"2023-07-09T02:22:39.493584+0000","last_fullsized":"2023-07-09T02:22:39.493584+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:43:13.777846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"181'2","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.766749+0000","last_change":"2023-07-09T02:22:38.738500+0000","last_active":"2023-07-09T02:22:39.766749+0000","last_peered":"2023-07-09T02:22:39.766749+0000","last_clean":"2023-07-09T02:22:39.766749+0000","last_became_active":"2023-07-09T02:22:38.738209+0000","last_became_peered":"2023-07-09T02:22:38.738209+0000","last_unstale":"2023-07-09T02:22:39.766749+0000","last_undegraded":"2023-07-09T02:22:39.766749+0000","last_fullsized":"2023-07-09T02:22:39.766749+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:13:39.874847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491643+0000","last_change":"2023-07-09T02:22:39.491487+0000","last_active":"2023-07-09T02:22:39.491643+0000","last_peered":"2023-07-09T02:22:39.491643+0000","last_clean":"2023-07-09T02:22:39.491643+0000","last_became_active":"2023-07-09T02:22:39.490822+0000","last_became_peered":"2023-07-09T02:22:39.490822+0000","last_unstale":"2023-07-09T02:22:39.491643+0000","last_undegraded":"2023-07-09T02:22:39.491643+0000","last_fullsized":"2023-07-09T02:22:39.491643+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:16:00.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"181'1","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.765328+0000","last_change":"2023-07-09T02:22:38.737217+0000","last_active":"2023-07-09T02:22:39.765328+0000","last_peered":"2023-07-09T02:22:39.765328+0000","last_clean":"2023-07-09T02:22:39.765328+0000","last_became_active":"2023-07-09T02:22:38.736579+0000","last_became_peered":"2023-07-09T02:22:38.736579+0000","last_unstale":"2023-07-09T02:22:39.765328+0000","last_undegraded":"2023-07-09T02:22:39.765328+0000","last_fullsized":"2023-07-09T02:22:39.765328+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:11:18.794253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.492500+0000","last_change":"2023-07-09T02:22:39.492432+0000","last_active":"2023-07-09T02:22:39.492500+0000","last_peered":"2023-07-09T02:22:39.492500+0000","last_clean":"2023-07-09T02:22:39.492500+0000","last_became_active":"2023-07-09T02:22:39.492217+0000","last_became_peered":"2023-07-09T02:22:39.492217+0000","last_unstale":"2023-07-09T02:22:39.492500+0000","last_undegraded":"2023-07-09T02:22:39.492500+0000","last_fullsized":"2023-07-09T02:22:39.492500+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:15:38.048781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"181'1","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479233+0000","last_change":"2023-07-09T02:22:38.739755+0000","last_active":"2023-07-09T02:22:40.479233+0000","last_peered":"2023-07-09T02:22:40.479233+0000","last_clean":"2023-07-09T02:22:40.479233+0000","last_became_active":"2023-07-09T02:22:38.739527+0000","last_became_peered":"2023-07-09T02:22:38.739527+0000","last_unstale":"2023-07-09T02:22:40.479233+0000","last_undegraded":"2023-07-09T02:22:40.479233+0000","last_fullsized":"2023-07-09T02:22:40.479233+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:39:12.161898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489187+0000","last_change":"2023-07-09T02:22:39.488607+0000","last_active":"2023-07-09T02:22:39.489187+0000","last_peered":"2023-07-09T02:22:39.489187+0000","last_clean":"2023-07-09T02:22:39.489187+0000","last_became_active":"2023-07-09T02:22:39.488055+0000","last_became_peered":"2023-07-09T02:22:39.488055+0000","last_unstale":"2023-07-09T02:22:39.489187+0000","last_undegraded":"2023-07-09T02:22:39.489187+0000","last_fullsized":"2023-07-09T02:22:39.489187+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:22:02.594346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.481816+0000","last_change":"2023-07-09T02:22:38.740309+0000","last_active":"2023-07-09T02:22:39.481816+0000","last_peered":"2023-07-09T02:22:39.481816+0000","last_clean":"2023-07-09T02:22:39.481816+0000","last_became_active":"2023-07-09T02:22:38.740070+0000","last_became_peered":"2023-07-09T02:22:38.740070+0000","last_unstale":"2023-07-09T02:22:39.481816+0000","last_undegraded":"2023-07-09T02:22:39.481816+0000","last_fullsized":"2023-07-09T02:22:39.481816+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:47:25.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480421+0000","last_change":"2023-07-09T02:22:39.485332+0000","last_active":"2023-07-09T02:22:40.480421+0000","last_peered":"2023-07-09T02:22:40.480421+0000","last_clean":"2023-07-09T02:22:40.480421+0000","last_became_active":"2023-07-09T02:22:39.483093+0000","last_became_peered":"2023-07-09T02:22:39.483093+0000","last_unstale":"2023-07-09T02:22:40.480421+0000","last_undegraded":"2023-07-09T02:22:40.480421+0000","last_fullsized":"2023-07-09T02:22:40.480421+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:08:41.555983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480236+0000","last_change":"2023-07-09T02:22:38.741006+0000","last_active":"2023-07-09T02:22:39.480236+0000","last_peered":"2023-07-09T02:22:39.480236+0000","last_clean":"2023-07-09T02:22:39.480236+0000","last_became_active":"2023-07-09T02:22:38.740260+0000","last_became_peered":"2023-07-09T02:22:38.740260+0000","last_unstale":"2023-07-09T02:22:39.480236+0000","last_undegraded":"2023-07-09T02:22:39.480236+0000","last_fullsized":"2023-07-09T02:22:39.480236+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:15.683628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493765+0000","last_change":"2023-07-09T02:22:39.493699+0000","last_active":"2023-07-09T02:22:39.493765+0000","last_peered":"2023-07-09T02:22:39.493765+0000","last_clean":"2023-07-09T02:22:39.493765+0000","last_became_active":"2023-07-09T02:22:39.492888+0000","last_became_peered":"2023-07-09T02:22:39.492888+0000","last_unstale":"2023-07-09T02:22:39.493765+0000","last_undegraded":"2023-07-09T02:22:39.493765+0000","last_fullsized":"2023-07-09T02:22:39.493765+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:44.306240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"181'1","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.764837+0000","last_change":"2023-07-09T02:22:38.737467+0000","last_active":"2023-07-09T02:22:39.764837+0000","last_peered":"2023-07-09T02:22:39.764837+0000","last_clean":"2023-07-09T02:22:39.764837+0000","last_became_active":"2023-07-09T02:22:38.737246+0000","last_became_peered":"2023-07-09T02:22:38.737246+0000","last_unstale":"2023-07-09T02:22:39.764837+0000","last_undegraded":"2023-07-09T02:22:39.764837+0000","last_fullsized":"2023-07-09T02:22:39.764837+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:51:25.220917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489977+0000","last_change":"2023-07-09T02:22:39.489669+0000","last_active":"2023-07-09T02:22:39.489977+0000","last_peered":"2023-07-09T02:22:39.489977+0000","last_clean":"2023-07-09T02:22:39.489977+0000","last_became_active":"2023-07-09T02:22:39.489432+0000","last_became_peered":"2023-07-09T02:22:39.489432+0000","last_unstale":"2023-07-09T02:22:39.489977+0000","last_undegraded":"2023-07-09T02:22:39.489977+0000","last_fullsized":"2023-07-09T02:22:39.489977+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:33:02.615795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"181'2","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.766469+0000","last_change":"2023-07-09T02:22:38.744591+0000","last_active":"2023-07-09T02:22:39.766469+0000","last_peered":"2023-07-09T02:22:39.766469+0000","last_clean":"2023-07-09T02:22:39.766469+0000","last_became_active":"2023-07-09T02:22:38.744199+0000","last_became_peered":"2023-07-09T02:22:38.744199+0000","last_unstale":"2023-07-09T02:22:39.766469+0000","last_undegraded":"2023-07-09T02:22:39.766469+0000","last_fullsized":"2023-07-09T02:22:39.766469+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:50:03.056344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481240+0000","last_change":"2023-07-09T02:22:39.482000+0000","last_active":"2023-07-09T02:22:40.481240+0000","last_peered":"2023-07-09T02:22:40.481240+0000","last_clean":"2023-07-09T02:22:40.481240+0000","last_became_active":"2023-07-09T02:22:39.481765+0000","last_became_peered":"2023-07-09T02:22:39.481765+0000","last_unstale":"2023-07-09T02:22:40.481240+0000","last_undegraded":"2023-07-09T02:22:40.481240+0000","last_fullsized":"2023-07-09T02:22:40.481240+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:16:00.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"181'1","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479428+0000","last_change":"2023-07-09T02:22:38.738991+0000","last_active":"2023-07-09T02:22:40.479428+0000","last_peered":"2023-07-09T02:22:40.479428+0000","last_clean":"2023-07-09T02:22:40.479428+0000","last_became_active":"2023-07-09T02:22:38.738726+0000","last_became_peered":"2023-07-09T02:22:38.738726+0000","last_unstale":"2023-07-09T02:22:40.479428+0000","last_undegraded":"2023-07-09T02:22:40.479428+0000","last_fullsized":"2023-07-09T02:22:40.479428+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:02:32.836215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481452+0000","last_change":"2023-07-09T02:22:39.489152+0000","last_active":"2023-07-09T02:22:40.481452+0000","last_peered":"2023-07-09T02:22:40.481452+0000","last_clean":"2023-07-09T02:22:40.481452+0000","last_became_active":"2023-07-09T02:22:39.487967+0000","last_became_peered":"2023-07-09T02:22:39.487967+0000","last_unstale":"2023-07-09T02:22:40.481452+0000","last_undegraded":"2023-07-09T02:22:40.481452+0000","last_fullsized":"2023-07-09T02:22:40.481452+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:55:19.383399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480642+0000","last_change":"2023-07-09T02:22:38.737363+0000","last_active":"2023-07-09T02:22:39.480642+0000","last_peered":"2023-07-09T02:22:39.480642+0000","last_clean":"2023-07-09T02:22:39.480642+0000","last_became_active":"2023-07-09T02:22:38.736986+0000","last_became_peered":"2023-07-09T02:22:38.736986+0000","last_unstale":"2023-07-09T02:22:39.480642+0000","last_undegraded":"2023-07-09T02:22:39.480642+0000","last_fullsized":"2023-07-09T02:22:39.480642+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:59:19.958839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485116+0000","last_change":"2023-07-09T02:22:39.484927+0000","last_active":"2023-07-09T02:22:39.485116+0000","last_peered":"2023-07-09T02:22:39.485116+0000","last_clean":"2023-07-09T02:22:39.485116+0000","last_became_active":"2023-07-09T02:22:39.484380+0000","last_became_peered":"2023-07-09T02:22:39.484380+0000","last_unstale":"2023-07-09T02:22:39.485116+0000","last_undegraded":"2023-07-09T02:22:39.485116+0000","last_fullsized":"2023-07-09T02:22:39.485116+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:54:02.746594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"181'2","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479370+0000","last_change":"2023-07-09T02:22:38.733850+0000","last_active":"2023-07-09T02:22:40.479370+0000","last_peered":"2023-07-09T02:22:40.479370+0000","last_clean":"2023-07-09T02:22:40.479370+0000","last_became_active":"2023-07-09T02:22:38.733623+0000","last_became_peered":"2023-07-09T02:22:38.733623+0000","last_unstale":"2023-07-09T02:22:40.479370+0000","last_undegraded":"2023-07-09T02:22:40.479370+0000","last_fullsized":"2023-07-09T02:22:40.479370+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:31:17.156255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.478970+0000","last_change":"2023-07-09T02:22:39.491077+0000","last_active":"2023-07-09T02:22:40.478970+0000","last_peered":"2023-07-09T02:22:40.478970+0000","last_clean":"2023-07-09T02:22:40.478970+0000","last_became_active":"2023-07-09T02:22:39.490305+0000","last_became_peered":"2023-07-09T02:22:39.490305+0000","last_unstale":"2023-07-09T02:22:40.478970+0000","last_undegraded":"2023-07-09T02:22:40.478970+0000","last_fullsized":"2023-07-09T02:22:40.478970+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:06:05.313236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480778+0000","last_change":"2023-07-09T02:22:38.740542+0000","last_active":"2023-07-09T02:22:40.480778+0000","last_peered":"2023-07-09T02:22:40.480778+0000","last_clean":"2023-07-09T02:22:40.480778+0000","last_became_active":"2023-07-09T02:22:38.740270+0000","last_became_peered":"2023-07-09T02:22:38.740270+0000","last_unstale":"2023-07-09T02:22:40.480778+0000","last_undegraded":"2023-07-09T02:22:40.480778+0000","last_fullsized":"2023-07-09T02:22:40.480778+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:15:03.572576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479091+0000","last_change":"2023-07-09T02:22:39.485671+0000","last_active":"2023-07-09T02:22:40.479091+0000","last_peered":"2023-07-09T02:22:40.479091+0000","last_clean":"2023-07-09T02:22:40.479091+0000","last_became_active":"2023-07-09T02:22:39.482612+0000","last_became_peered":"2023-07-09T02:22:39.482612+0000","last_unstale":"2023-07-09T02:22:40.479091+0000","last_undegraded":"2023-07-09T02:22:40.479091+0000","last_fullsized":"2023-07-09T02:22:40.479091+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:55.734051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.481406+0000","last_change":"2023-07-09T02:22:38.738980+0000","last_active":"2023-07-09T02:22:39.481406+0000","last_peered":"2023-07-09T02:22:39.481406+0000","last_clean":"2023-07-09T02:22:39.481406+0000","last_became_active":"2023-07-09T02:22:38.738724+0000","last_became_peered":"2023-07-09T02:22:38.738724+0000","last_unstale":"2023-07-09T02:22:39.481406+0000","last_undegraded":"2023-07-09T02:22:39.481406+0000","last_fullsized":"2023-07-09T02:22:39.481406+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:49:36.491910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.496805+0000","last_change":"2023-07-09T02:22:39.496736+0000","last_active":"2023-07-09T02:22:39.496805+0000","last_peered":"2023-07-09T02:22:39.496805+0000","last_clean":"2023-07-09T02:22:39.496805+0000","last_became_active":"2023-07-09T02:22:39.495941+0000","last_became_peered":"2023-07-09T02:22:39.495941+0000","last_unstale":"2023-07-09T02:22:39.496805+0000","last_undegraded":"2023-07-09T02:22:39.496805+0000","last_fullsized":"2023-07-09T02:22:39.496805+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:27:59.579113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.484671+0000","last_change":"2023-07-09T02:22:38.736083+0000","last_active":"2023-07-09T02:22:39.484671+0000","last_peered":"2023-07-09T02:22:39.484671+0000","last_clean":"2023-07-09T02:22:39.484671+0000","last_became_active":"2023-07-09T02:22:38.735785+0000","last_became_peered":"2023-07-09T02:22:38.735785+0000","last_unstale":"2023-07-09T02:22:39.484671+0000","last_undegraded":"2023-07-09T02:22:39.484671+0000","last_fullsized":"2023-07-09T02:22:39.484671+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:26:07.854651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481297+0000","last_change":"2023-07-09T02:22:39.493599+0000","last_active":"2023-07-09T02:22:40.481297+0000","last_peered":"2023-07-09T02:22:40.481297+0000","last_clean":"2023-07-09T02:22:40.481297+0000","last_became_active":"2023-07-09T02:22:39.488610+0000","last_became_peered":"2023-07-09T02:22:39.488610+0000","last_unstale":"2023-07-09T02:22:40.481297+0000","last_undegraded":"2023-07-09T02:22:40.481297+0000","last_fullsized":"2023-07-09T02:22:40.481297+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:44.306240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"181'2","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479727+0000","last_change":"2023-07-09T02:22:38.737557+0000","last_active":"2023-07-09T02:22:40.479727+0000","last_peered":"2023-07-09T02:22:40.479727+0000","last_clean":"2023-07-09T02:22:40.479727+0000","last_became_active":"2023-07-09T02:22:38.737280+0000","last_became_peered":"2023-07-09T02:22:38.737280+0000","last_unstale":"2023-07-09T02:22:40.479727+0000","last_undegraded":"2023-07-09T02:22:40.479727+0000","last_fullsized":"2023-07-09T02:22:40.479727+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:17:33.873105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.483506+0000","last_change":"2023-07-09T02:22:39.483414+0000","last_active":"2023-07-09T02:22:39.483506+0000","last_peered":"2023-07-09T02:22:39.483506+0000","last_clean":"2023-07-09T02:22:39.483506+0000","last_became_active":"2023-07-09T02:22:39.483179+0000","last_became_peered":"2023-07-09T02:22:39.483179+0000","last_unstale":"2023-07-09T02:22:39.483506+0000","last_undegraded":"2023-07-09T02:22:39.483506+0000","last_fullsized":"2023-07-09T02:22:39.483506+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:10:23.479926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485006+0000","last_change":"2023-07-09T02:22:38.743110+0000","last_active":"2023-07-09T02:22:39.485006+0000","last_peered":"2023-07-09T02:22:39.485006+0000","last_clean":"2023-07-09T02:22:39.485006+0000","last_became_active":"2023-07-09T02:22:38.742730+0000","last_became_peered":"2023-07-09T02:22:38.742730+0000","last_unstale":"2023-07-09T02:22:39.485006+0000","last_undegraded":"2023-07-09T02:22:39.485006+0000","last_fullsized":"2023-07-09T02:22:39.485006+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:09:39.758232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489170+0000","last_change":"2023-07-09T02:22:39.487983+0000","last_active":"2023-07-09T02:22:39.489170+0000","last_peered":"2023-07-09T02:22:39.489170+0000","last_clean":"2023-07-09T02:22:39.489170+0000","last_became_active":"2023-07-09T02:22:39.487771+0000","last_became_peered":"2023-07-09T02:22:39.487771+0000","last_unstale":"2023-07-09T02:22:39.489170+0000","last_undegraded":"2023-07-09T02:22:39.489170+0000","last_fullsized":"2023-07-09T02:22:39.489170+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:38.626546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485027+0000","last_change":"2023-07-09T02:22:38.742710+0000","last_active":"2023-07-09T02:22:39.485027+0000","last_peered":"2023-07-09T02:22:39.485027+0000","last_clean":"2023-07-09T02:22:39.485027+0000","last_became_active":"2023-07-09T02:22:38.742072+0000","last_became_peered":"2023-07-09T02:22:38.742072+0000","last_unstale":"2023-07-09T02:22:39.485027+0000","last_undegraded":"2023-07-09T02:22:39.485027+0000","last_fullsized":"2023-07-09T02:22:39.485027+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:20.880040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.490372+0000","last_change":"2023-07-09T02:22:39.490295+0000","last_active":"2023-07-09T02:22:39.490372+0000","last_peered":"2023-07-09T02:22:39.490372+0000","last_clean":"2023-07-09T02:22:39.490372+0000","last_became_active":"2023-07-09T02:22:39.490079+0000","last_became_peered":"2023-07-09T02:22:39.490079+0000","last_unstale":"2023-07-09T02:22:39.490372+0000","last_undegraded":"2023-07-09T02:22:39.490372+0000","last_fullsized":"2023-07-09T02:22:39.490372+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:50:07.910762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.481536+0000","last_change":"2023-07-09T02:22:38.743509+0000","last_active":"2023-07-09T02:22:39.481536+0000","last_peered":"2023-07-09T02:22:39.481536+0000","last_clean":"2023-07-09T02:22:39.481536+0000","last_became_active":"2023-07-09T02:22:38.743295+0000","last_became_peered":"2023-07-09T02:22:38.743295+0000","last_unstale":"2023-07-09T02:22:39.481536+0000","last_undegraded":"2023-07-09T02:22:39.481536+0000","last_fullsized":"2023-07-09T02:22:39.481536+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:14:51.708873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479674+0000","last_change":"2023-07-09T02:22:39.481176+0000","last_active":"2023-07-09T02:22:40.479674+0000","last_peered":"2023-07-09T02:22:40.479674+0000","last_clean":"2023-07-09T02:22:40.479674+0000","last_became_active":"2023-07-09T02:22:39.480435+0000","last_became_peered":"2023-07-09T02:22:39.480435+0000","last_unstale":"2023-07-09T02:22:40.479674+0000","last_undegraded":"2023-07-09T02:22:40.479674+0000","last_fullsized":"2023-07-09T02:22:40.479674+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:46:23.917342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480733+0000","last_change":"2023-07-09T02:22:38.736905+0000","last_active":"2023-07-09T02:22:40.480733+0000","last_peered":"2023-07-09T02:22:40.480733+0000","last_clean":"2023-07-09T02:22:40.480733+0000","last_became_active":"2023-07-09T02:22:38.734940+0000","last_became_peered":"2023-07-09T02:22:38.734940+0000","last_unstale":"2023-07-09T02:22:40.480733+0000","last_undegraded":"2023-07-09T02:22:40.480733+0000","last_fullsized":"2023-07-09T02:22:40.480733+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:00:53.143296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493116+0000","last_change":"2023-07-09T02:22:39.493060+0000","last_active":"2023-07-09T02:22:39.493116+0000","last_peered":"2023-07-09T02:22:39.493116+0000","last_clean":"2023-07-09T02:22:39.493116+0000","last_became_active":"2023-07-09T02:22:39.492809+0000","last_became_peered":"2023-07-09T02:22:39.492809+0000","last_unstale":"2023-07-09T02:22:39.493116+0000","last_undegraded":"2023-07-09T02:22:39.493116+0000","last_fullsized":"2023-07-09T02:22:39.493116+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:49:34.534378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480073+0000","last_change":"2023-07-09T02:22:38.741294+0000","last_active":"2023-07-09T02:22:39.480073+0000","last_peered":"2023-07-09T02:22:39.480073+0000","last_clean":"2023-07-09T02:22:39.480073+0000","last_became_active":"2023-07-09T02:22:38.741055+0000","last_became_peered":"2023-07-09T02:22:38.741055+0000","last_unstale":"2023-07-09T02:22:39.480073+0000","last_undegraded":"2023-07-09T02:22:39.480073+0000","last_fullsized":"2023-07-09T02:22:39.480073+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:09.474589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485239+0000","last_change":"2023-07-09T02:22:39.485097+0000","last_active":"2023-07-09T02:22:39.485239+0000","last_peered":"2023-07-09T02:22:39.485239+0000","last_clean":"2023-07-09T02:22:39.485239+0000","last_became_active":"2023-07-09T02:22:39.484686+0000","last_became_peered":"2023-07-09T02:22:39.484686+0000","last_unstale":"2023-07-09T02:22:39.485239+0000","last_undegraded":"2023-07-09T02:22:39.485239+0000","last_fullsized":"2023-07-09T02:22:39.485239+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:00.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480667+0000","last_change":"2023-07-09T02:22:38.736712+0000","last_active":"2023-07-09T02:22:40.480667+0000","last_peered":"2023-07-09T02:22:40.480667+0000","last_clean":"2023-07-09T02:22:40.480667+0000","last_became_active":"2023-07-09T02:22:38.736284+0000","last_became_peered":"2023-07-09T02:22:38.736284+0000","last_unstale":"2023-07-09T02:22:40.480667+0000","last_undegraded":"2023-07-09T02:22:40.480667+0000","last_fullsized":"2023-07-09T02:22:40.480667+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:06:55.242709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.487846+0000","last_change":"2023-07-09T02:22:39.487556+0000","last_active":"2023-07-09T02:22:39.487846+0000","last_peered":"2023-07-09T02:22:39.487846+0000","last_clean":"2023-07-09T02:22:39.487846+0000","last_became_active":"2023-07-09T02:22:39.487231+0000","last_became_peered":"2023-07-09T02:22:39.487231+0000","last_unstale":"2023-07-09T02:22:39.487846+0000","last_undegraded":"2023-07-09T02:22:39.487846+0000","last_fullsized":"2023-07-09T02:22:39.487846+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:16:42.130472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479310+0000","last_change":"2023-07-09T02:22:38.734688+0000","last_active":"2023-07-09T02:22:40.479310+0000","last_peered":"2023-07-09T02:22:40.479310+0000","last_clean":"2023-07-09T02:22:40.479310+0000","last_became_active":"2023-07-09T02:22:38.734434+0000","last_became_peered":"2023-07-09T02:22:38.734434+0000","last_unstale":"2023-07-09T02:22:40.479310+0000","last_undegraded":"2023-07-09T02:22:40.479310+0000","last_fullsized":"2023-07-09T02:22:40.479310+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:02:46.302753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.492505+0000","last_change":"2023-07-09T02:22:39.492271+0000","last_active":"2023-07-09T02:22:39.492505+0000","last_peered":"2023-07-09T02:22:39.492505+0000","last_clean":"2023-07-09T02:22:39.492505+0000","last_became_active":"2023-07-09T02:22:39.489433+0000","last_became_peered":"2023-07-09T02:22:39.489433+0000","last_unstale":"2023-07-09T02:22:39.492505+0000","last_undegraded":"2023-07-09T02:22:39.492505+0000","last_fullsized":"2023-07-09T02:22:39.492505+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:57:30.514601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.479951+0000","last_change":"2023-07-09T02:22:38.742570+0000","last_active":"2023-07-09T02:22:39.479951+0000","last_peered":"2023-07-09T02:22:39.479951+0000","last_clean":"2023-07-09T02:22:39.479951+0000","last_became_active":"2023-07-09T02:22:38.742317+0000","last_became_peered":"2023-07-09T02:22:38.742317+0000","last_unstale":"2023-07-09T02:22:39.479951+0000","last_undegraded":"2023-07-09T02:22:39.479951+0000","last_fullsized":"2023-07-09T02:22:39.479951+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:02:37.888252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":444,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485951+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:22:39.485951+0000","last_peered":"2023-07-09T02:22:39.485951+0000","last_clean":"2023-07-09T02:22:39.485951+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:22:39.485951+0000","last_undegraded":"2023-07-09T02:22:39.485951+0000","last_fullsized":"2023-07-09T02:22:39.485951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:11:42.556090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":334,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481539+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:22:40.481539+0000","last_peered":"2023-07-09T02:22:40.481539+0000","last_clean":"2023-07-09T02:22:40.481539+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:22:40.481539+0000","last_undegraded":"2023-07-09T02:22:40.481539+0000","last_fullsized":"2023-07-09T02:22:40.481539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:35:52.624721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.486197+0000","last_change":"2023-07-09T02:22:39.486078+0000","last_active":"2023-07-09T02:22:39.486197+0000","last_peered":"2023-07-09T02:22:39.486197+0000","last_clean":"2023-07-09T02:22:39.486197+0000","last_became_active":"2023-07-09T02:22:39.485719+0000","last_became_peered":"2023-07-09T02:22:39.485719+0000","last_unstale":"2023-07-09T02:22:39.486197+0000","last_undegraded":"2023-07-09T02:22:39.486197+0000","last_fullsized":"2023-07-09T02:22:39.486197+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:56:15.902790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"181'3","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480105+0000","last_change":"2023-07-09T02:22:38.730281+0000","last_active":"2023-07-09T02:22:40.480105+0000","last_peered":"2023-07-09T02:22:40.480105+0000","last_clean":"2023-07-09T02:22:40.480105+0000","last_became_active":"2023-07-09T02:22:38.730020+0000","last_became_peered":"2023-07-09T02:22:38.730020+0000","last_unstale":"2023-07-09T02:22:40.480105+0000","last_undegraded":"2023-07-09T02:22:40.480105+0000","last_fullsized":"2023-07-09T02:22:40.480105+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:44:10.926277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":290,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485467+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:22:39.485467+0000","last_peered":"2023-07-09T02:22:39.485467+0000","last_clean":"2023-07-09T02:22:39.485467+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:22:39.485467+0000","last_undegraded":"2023-07-09T02:22:39.485467+0000","last_fullsized":"2023-07-09T02:22:39.485467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:01:00.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489261+0000","last_change":"2023-07-09T02:22:39.489111+0000","last_active":"2023-07-09T02:22:39.489261+0000","last_peered":"2023-07-09T02:22:39.489261+0000","last_clean":"2023-07-09T02:22:39.489261+0000","last_became_active":"2023-07-09T02:22:39.488387+0000","last_became_peered":"2023-07-09T02:22:39.488387+0000","last_unstale":"2023-07-09T02:22:39.489261+0000","last_undegraded":"2023-07-09T02:22:39.489261+0000","last_fullsized":"2023-07-09T02:22:39.489261+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:44.117292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"181'6","reported_seq":17,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.768662+0000","last_change":"2023-07-09T02:22:38.742865+0000","last_active":"2023-07-09T02:22:39.768662+0000","last_peered":"2023-07-09T02:22:39.768662+0000","last_clean":"2023-07-09T02:22:39.768662+0000","last_became_active":"2023-07-09T02:22:38.742480+0000","last_became_peered":"2023-07-09T02:22:38.742480+0000","last_unstale":"2023-07-09T02:22:39.768662+0000","last_undegraded":"2023-07-09T02:22:39.768662+0000","last_fullsized":"2023-07-09T02:22:39.768662+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:08:12.351497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.483616+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:22:39.483616+0000","last_peered":"2023-07-09T02:22:39.483616+0000","last_clean":"2023-07-09T02:22:39.483616+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:22:39.483616+0000","last_undegraded":"2023-07-09T02:22:39.483616+0000","last_fullsized":"2023-07-09T02:22:39.483616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:41:11.465565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493387+0000","last_change":"2023-07-09T02:22:39.493159+0000","last_active":"2023-07-09T02:22:39.493387+0000","last_peered":"2023-07-09T02:22:39.493387+0000","last_clean":"2023-07-09T02:22:39.493387+0000","last_became_active":"2023-07-09T02:22:39.492629+0000","last_became_peered":"2023-07-09T02:22:39.492629+0000","last_unstale":"2023-07-09T02:22:39.493387+0000","last_undegraded":"2023-07-09T02:22:39.493387+0000","last_fullsized":"2023-07-09T02:22:39.493387+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:34:28.587161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480264+0000","last_change":"2023-07-09T02:22:38.742354+0000","last_active":"2023-07-09T02:22:39.480264+0000","last_peered":"2023-07-09T02:22:39.480264+0000","last_clean":"2023-07-09T02:22:39.480264+0000","last_became_active":"2023-07-09T02:22:38.742063+0000","last_became_peered":"2023-07-09T02:22:38.742063+0000","last_unstale":"2023-07-09T02:22:39.480264+0000","last_undegraded":"2023-07-09T02:22:39.480264+0000","last_fullsized":"2023-07-09T02:22:39.480264+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:33:01.613166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":334,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481373+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:22:40.481373+0000","last_peered":"2023-07-09T02:22:40.481373+0000","last_clean":"2023-07-09T02:22:40.481373+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:22:40.481373+0000","last_undegraded":"2023-07-09T02:22:40.481373+0000","last_fullsized":"2023-07-09T02:22:40.481373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:10:07.443017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480654+0000","last_change":"2023-07-09T02:22:39.492027+0000","last_active":"2023-07-09T02:22:40.480654+0000","last_peered":"2023-07-09T02:22:40.480654+0000","last_clean":"2023-07-09T02:22:40.480654+0000","last_became_active":"2023-07-09T02:22:39.491741+0000","last_became_peered":"2023-07-09T02:22:39.491741+0000","last_unstale":"2023-07-09T02:22:40.480654+0000","last_undegraded":"2023-07-09T02:22:40.480654+0000","last_fullsized":"2023-07-09T02:22:40.480654+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:11:19.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481088+0000","last_change":"2023-07-09T02:22:38.731763+0000","last_active":"2023-07-09T02:22:40.481088+0000","last_peered":"2023-07-09T02:22:40.481088+0000","last_clean":"2023-07-09T02:22:40.481088+0000","last_became_active":"2023-07-09T02:22:38.731544+0000","last_became_peered":"2023-07-09T02:22:38.731544+0000","last_unstale":"2023-07-09T02:22:40.481088+0000","last_undegraded":"2023-07-09T02:22:40.481088+0000","last_fullsized":"2023-07-09T02:22:40.481088+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:55:59.449654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":310,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480501+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:22:39.480501+0000","last_peered":"2023-07-09T02:22:39.480501+0000","last_clean":"2023-07-09T02:22:39.480501+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:22:39.480501+0000","last_undegraded":"2023-07-09T02:22:39.480501+0000","last_fullsized":"2023-07-09T02:22:39.480501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:55:28.628554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.486918+0000","last_change":"2023-07-09T02:22:39.486743+0000","last_active":"2023-07-09T02:22:39.486918+0000","last_peered":"2023-07-09T02:22:39.486918+0000","last_clean":"2023-07-09T02:22:39.486918+0000","last_became_active":"2023-07-09T02:22:39.486517+0000","last_became_peered":"2023-07-09T02:22:39.486517+0000","last_unstale":"2023-07-09T02:22:39.486918+0000","last_undegraded":"2023-07-09T02:22:39.486918+0000","last_fullsized":"2023-07-09T02:22:39.486918+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:24:05.317397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"181'8","reported_seq":19,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.767519+0000","last_change":"2023-07-09T02:22:38.732949+0000","last_active":"2023-07-09T02:22:39.767519+0000","last_peered":"2023-07-09T02:22:39.767519+0000","last_clean":"2023-07-09T02:22:39.767519+0000","last_became_active":"2023-07-09T02:22:38.732716+0000","last_became_peered":"2023-07-09T02:22:38.732716+0000","last_unstale":"2023-07-09T02:22:39.767519+0000","last_undegraded":"2023-07-09T02:22:39.767519+0000","last_fullsized":"2023-07-09T02:22:39.767519+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:15:03.572576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":292,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485346+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:22:39.485346+0000","last_peered":"2023-07-09T02:22:39.485346+0000","last_clean":"2023-07-09T02:22:39.485346+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:22:39.485346+0000","last_undegraded":"2023-07-09T02:22:39.485346+0000","last_fullsized":"2023-07-09T02:22:39.485346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:49:49.484566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.487990+0000","last_change":"2023-07-09T02:22:39.487810+0000","last_active":"2023-07-09T02:22:39.487990+0000","last_peered":"2023-07-09T02:22:39.487990+0000","last_clean":"2023-07-09T02:22:39.487990+0000","last_became_active":"2023-07-09T02:22:39.487583+0000","last_became_peered":"2023-07-09T02:22:39.487583+0000","last_unstale":"2023-07-09T02:22:39.487990+0000","last_undegraded":"2023-07-09T02:22:39.487990+0000","last_fullsized":"2023-07-09T02:22:39.487990+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:00.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"181'2","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479482+0000","last_change":"2023-07-09T02:22:38.733660+0000","last_active":"2023-07-09T02:22:40.479482+0000","last_peered":"2023-07-09T02:22:40.479482+0000","last_clean":"2023-07-09T02:22:40.479482+0000","last_became_active":"2023-07-09T02:22:38.733310+0000","last_became_peered":"2023-07-09T02:22:38.733310+0000","last_unstale":"2023-07-09T02:22:40.479482+0000","last_undegraded":"2023-07-09T02:22:40.479482+0000","last_fullsized":"2023-07-09T02:22:40.479482+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:02:07.345221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":310,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480717+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:22:39.480717+0000","last_peered":"2023-07-09T02:22:39.480717+0000","last_clean":"2023-07-09T02:22:39.480717+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:22:39.480717+0000","last_undegraded":"2023-07-09T02:22:39.480717+0000","last_fullsized":"2023-07-09T02:22:39.480717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:44:32.835498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.488894+0000","last_change":"2023-07-09T02:22:39.488640+0000","last_active":"2023-07-09T02:22:39.488894+0000","last_peered":"2023-07-09T02:22:39.488894+0000","last_clean":"2023-07-09T02:22:39.488894+0000","last_became_active":"2023-07-09T02:22:39.488302+0000","last_became_peered":"2023-07-09T02:22:39.488302+0000","last_unstale":"2023-07-09T02:22:39.488894+0000","last_undegraded":"2023-07-09T02:22:39.488894+0000","last_fullsized":"2023-07-09T02:22:39.488894+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:13:27.272990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480379+0000","last_change":"2023-07-09T02:22:38.735951+0000","last_active":"2023-07-09T02:22:39.480379+0000","last_peered":"2023-07-09T02:22:39.480379+0000","last_clean":"2023-07-09T02:22:39.480379+0000","last_became_active":"2023-07-09T02:22:38.735698+0000","last_became_peered":"2023-07-09T02:22:38.735698+0000","last_unstale":"2023-07-09T02:22:39.480379+0000","last_undegraded":"2023-07-09T02:22:39.480379+0000","last_fullsized":"2023-07-09T02:22:39.480379+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:24:57.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":288,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485737+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:22:39.485737+0000","last_peered":"2023-07-09T02:22:39.485737+0000","last_clean":"2023-07-09T02:22:39.485737+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:22:39.485737+0000","last_undegraded":"2023-07-09T02:22:39.485737+0000","last_fullsized":"2023-07-09T02:22:39.485737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:54:25.290642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574989,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193679,"statfs":{"total":200000000,"available":198327871,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.66500000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94499999999999995,"5min":0.97399999999999998,"15min":1.4950000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.623,"5min":0.435,"15min":0.35599999999999998},"max":{"1min":0.95399999999999996,"5min":1.0049999999999999,"15min":1.2110000000000001},"last":0.65000000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54100000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.423},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.70099999999999996,"15min":0.80400000000000005},"min":{"1min":0.55900000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":29.498999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":5.0460000000000003},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.81200000000000006},"min":{"1min":0.61499999999999999,"5min":0.45900000000000002,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":26.524000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.70799999999999996},"min":{"1min":0.54600000000000004,"5min":0.438,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":4.3789999999999996},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":10.609999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.38100000000000001},"max":{"1min":0.873,"5min":0.93799999999999994,"15min":1.032},"last":0.79800000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.92600000000000005,"15min":1.048},"last":0.91700000000000004}]},{"osd":6,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.087},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.81899999999999995,"5min":0.91900000000000004,"15min":1.1639999999999999},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574989,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1056,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194256,"statfs":{"total":200000000,"available":198918239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71199999999999997,"15min":0.68200000000000005},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.58399999999999996,"5min":0.49299999999999999,"15min":0.36199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0269999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.4379999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.036,"15min":1.165},"last":0.72099999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":1.002,"5min":1.01,"15min":1.01},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.66600000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.0740000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48799999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.45},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.70799999999999996},"min":{"1min":0.60799999999999998,"5min":0.498,"15min":0.45700000000000002},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68100000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":1.6499999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.117},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.6060000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65500000000000003,"15min":0.68000000000000005},"min":{"1min":0.48499999999999999,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":0.85599999999999998,"5min":0.94199999999999995,"15min":1.4059999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":1.0289999999999999},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574989,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1056,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194255,"statfs":{"total":200000000,"available":198918115,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.66500000000000004},"min":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.40699999999999997},"max":{"1min":0.90300000000000002,"5min":0.92000000000000004,"15min":1.248},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.32800000000000001},"max":{"1min":0.88200000000000001,"5min":0.95999999999999996,"15min":1.179},"last":0.77800000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69799999999999995,"15min":0.67400000000000004},"min":{"1min":0.55300000000000005,"5min":0.44,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.68100000000000005},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97299999999999998},"last":0.745}]},{"osd":2,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72499999999999998,"15min":0.70999999999999996},"min":{"1min":0.56100000000000005,"5min":0.47199999999999998,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.96099999999999997,"15min":1.103},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.57199999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":0.95799999999999996,"5min":0.98999999999999999,"15min":5.1989999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":0.97999999999999998,"15min":0.98399999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58799999999999997},"min":{"1min":0.39100000000000001,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.80200000000000005,"5min":0.86499999999999999,"15min":1.008},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":0.94099999999999995,"15min":1.0720000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":1.042,"15min":1.054},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.46000000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.79900000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89600000000000002,"5min":1.0049999999999999,"15min":1.1619999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.50900000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.91600000000000004,"5min":1.0840000000000001,"15min":1.091},"last":0.76100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1057,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194255,"statfs":{"total":200000000,"available":198917475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.86199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.27300000000000002},"max":{"1min":0.89900000000000002,"5min":0.93799999999999994,"15min":50.508000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.51900000000000002,"5min":0.39800000000000002,"15min":0.376},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.874}]},{"osd":1,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69299999999999995,"15min":0.68200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.34100000000000003},"max":{"1min":0.92100000000000004,"5min":1.024,"15min":8.6039999999999992},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.89200000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71999999999999997,"15min":0.68999999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.502,"15min":0.39500000000000002},"max":{"1min":0.89000000000000001,"5min":0.997,"15min":1.323},"last":0.83799999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.71199999999999997},"min":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.97299999999999998},"min":{"1min":0.46400000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96499999999999997,"5min":1.073,"15min":71.909000000000006},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60799999999999998},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.317},"max":{"1min":0.88,"5min":0.88,"15min":1.0169999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80500000000000005,"5min":0.92100000000000004,"15min":0.95399999999999996},"last":0.65100000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59699999999999998,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90900000000000003,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.75700000000000001,"5min":0.94099999999999995,"15min":1.0529999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":0.93100000000000005,"15min":1.0329999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.72099999999999997},"min":{"1min":0.434,"5min":0.40300000000000002,"15min":0.33200000000000002},"max":{"1min":0.90500000000000003,"5min":0.995,"15min":8.0359999999999996},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1058,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194253,"statfs":{"total":200000000,"available":198916071,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.32900000000000001,"5min":0.217,"15min":0.216},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.96499999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.28499999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.198},"last":0.378}]},{"osd":1,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":1.048},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69899999999999995,"5min":0.76000000000000001,"15min":0.85299999999999998},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":1.155},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":1.1040000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.65200000000000002,"5min":0.502,"15min":0.45300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.466},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.3560000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.61799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.155,"15min":1.3420000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.008,"5min":1.054,"15min":1.2909999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.71199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.4350000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.5569999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0229999999999999,"5min":1.131,"15min":1.367},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.63300000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98399999999999999,"5min":1.0980000000000001,"15min":1.2569999999999999},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574989,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1056,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194256,"statfs":{"total":200000000,"available":198918239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58199999999999996,"5min":0.84299999999999997,"15min":7.7450000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48299999999999998,"15min":0.45100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.255},"max":{"1min":0.75600000000000001,"5min":0.78700000000000003,"15min":1.127},"last":0.443}]},{"osd":1,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":2.8879999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58299999999999996,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":2.0600000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53700000000000003,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.29999999999999999},"max":{"1min":0.70799999999999996,"5min":0.875,"15min":7.8710000000000004},"last":0.39900000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.0940000000000001,"5min":1.218,"15min":7.7990000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.755},"min":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.47899999999999998},"max":{"1min":1.034,"5min":1.046,"15min":1.821},"last":0.65100000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.79000000000000004,"15min":0.748},"min":{"1min":0.626,"5min":0.51000000000000001,"15min":0.496},"max":{"1min":1.0920000000000001,"5min":1.103,"15min":1.319},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.52900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.093,"5min":1.093,"15min":7.8369999999999997},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.80900000000000005,"15min":0.78900000000000003},"min":{"1min":0.59799999999999998,"5min":0.53900000000000003,"15min":0.48299999999999998},"max":{"1min":1.087,"5min":1.3029999999999999,"15min":1.9790000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.66800000000000004,"5min":0.56000000000000005,"15min":0.51500000000000001},"max":{"1min":1.145,"5min":1.2749999999999999,"15min":1.452},"last":0.77400000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80300000000000005,"15min":0.75800000000000001},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.51700000000000002},"max":{"1min":1.101,"5min":1.165,"15min":1.9379999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.80500000000000005,"15min":0.78000000000000003},"min":{"1min":0.58099999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.351},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574989,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1057,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194254,"statfs":{"total":200000000,"available":198916675,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.436,"15min":0.44500000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.64000000000000001,"15min":0.80300000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.86899999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":1.1080000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85099999999999998},"last":0.626},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.163},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78500000000000003,"15min":0.76500000000000001},"min":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.93500000000000005}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76400000000000001,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.1599999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.75900000000000001,"15min":0.74399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0840000000000001,"5min":1.131,"15min":1.131},"last":0.90800000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82599999999999996,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.123,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.94799999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79500000000000004,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.57599999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1699999999999999,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.82899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1633,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193679,"statfs":{"total":200000000,"available":198327767,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.22700000000000001},"max":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.94999999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53500000000000003,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.3240000000000001},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.29899999999999999},"max":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.78300000000000003,"15min":1.4139999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74099999999999999,"5min":0.754,"15min":1.0189999999999999},"last":0.375},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.53600000000000003},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80200000000000005,"5min":0.879,"15min":3.8929999999999998},"last":0.53600000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80800000000000005,"15min":0.77600000000000002},"min":{"1min":0.65700000000000003,"5min":0.47299999999999998,"15min":0.46600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.63300000000000001,"5min":0.54400000000000004,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.1240000000000001,"15min":1.153},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.79800000000000004},"min":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.1040000000000001,"15min":1.4350000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.79600000000000004},"min":{"1min":0.63800000000000001,"5min":0.51000000000000001,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.238},"last":0.76000000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.47799999999999998},"max":{"1min":1.0529999999999999,"5min":1.117,"15min":1.117},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.46899999999999997},"max":{"1min":1.034,"5min":1.1200000000000001,"15min":1.7789999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.49099999999999999},"max":{"1min":1.034,"5min":1.079,"15min":1.8149999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78000000000000003,"15min":0.749},"min":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.1060000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.67500000000000004}]}]}],"pool_statfs":[]}} 2023-07-09T02:22:43.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:22:44.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7d248640 1 Processor -- start 2023-07-09T02:22:44.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7d248640 1 -- start start 2023-07-09T02:22:44.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7d248640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f7815c060 0x7f4f780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7d248640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f780d2620 0x7f4f780cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7d248640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f78160a50 con 0x7f4f780cd120 2023-07-09T02:22:44.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7d248640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7815c430 con 0x7f4f7815c060 2023-07-09T02:22:44.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7d248640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7815fb60 con 0x7f4f780d2620 2023-07-09T02:22:44.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f76d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f7815c060 0x7f4f780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f76d9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f7815c060 0x7f4f780b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46370/0 (socket says 172.21.15.45:46370) 2023-07-09T02:22:44.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f76d9d640 1 -- 172.21.15.45:0/2463970227 learned_addr learned my addr 172.21.15.45:0/2463970227 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:44.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7759e640 1 --2- 172.21.15.45:0/2463970227 >> v2:172.21.15.155:3300/0 conn(0x7f4f780d2620 0x7f4f780cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f76d9d640 1 -- 172.21.15.45:0/2463970227 >> v2:172.21.15.155:3300/0 conn(0x7f4f780d2620 msgr2=0x7f4f780cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:44.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f76d9d640 1 --2- 172.21.15.45:0/2463970227 >> v2:172.21.15.155:3300/0 conn(0x7f4f780d2620 0x7f4f780cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f76d9d640 1 -- 172.21.15.45:0/2463970227 >> v1:172.21.15.45:6789/0 conn(0x7f4f780cd120 legacy=0x7f4f780d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f76d9d640 1 -- 172.21.15.45:0/2463970227 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7815fe40 con 0x7f4f7815c060 2023-07-09T02:22:44.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.044+0000 7f4f7659c640 1 -- 172.21.15.45:0/2463970227 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598576121 0 0) 0x7f4f78160a50 con 0x7f4f780cd120 2023-07-09T02:22:44.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f76d9d640 1 --2- 172.21.15.45:0/2463970227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f7815c060 0x7f4f780b4ed0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f4f7808bca0 tx=0x7f4f6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a072e5f5ace5cb3c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7659c640 1 -- 172.21.15.45:0/2463970227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680aa430 con 0x7f4f7815c060 2023-07-09T02:22:44.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7659c640 1 -- 172.21.15.45:0/2463970227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f680aa590 con 0x7f4f7815c060 2023-07-09T02:22:44.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7659c640 1 -- 172.21.15.45:0/2463970227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680aa920 con 0x7f4f7815c060 2023-07-09T02:22:44.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7d248640 1 -- 172.21.15.45:0/2463970227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f7815c060 msgr2=0x7f4f780b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2463970227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f7815c060 0x7f4f780b4ed0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f4f7808bca0 tx=0x7f4f6801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7d248640 1 -- 172.21.15.45:0/2463970227 shutdown_connections 2023-07-09T02:22:44.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2463970227 >> v2:172.21.15.155:3300/0 conn(0x7f4f780d2620 0x7f4f780cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2463970227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f7815c060 0x7f4f780b4ed0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7d248640 1 -- 172.21.15.45:0/2463970227 >> 172.21.15.45:0/2463970227 conn(0x7f4f780698e0 msgr2=0x7f4f78069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:44.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7d248640 1 -- 172.21.15.45:0/2463970227 shutdown_connections 2023-07-09T02:22:44.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.048+0000 7f4f7d248640 1 -- 172.21.15.45:0/2463970227 wait complete. 2023-07-09T02:22:44.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 Processor -- start 2023-07-09T02:22:44.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 -- start start 2023-07-09T02:22:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f780cd120 0x7f4f780c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f780d2620 0x7f4f78153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7815c060 0x7f4f780b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815b240 con 0x7f4f780cd120 2023-07-09T02:22:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815b6d0 con 0x7f4f780d2620 2023-07-09T02:22:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815a630 con 0x7f4f7815c060 2023-07-09T02:22:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f780cd120 0x7f4f780c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f780cd120 0x7f4f780c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46384/0 (socket says 172.21.15.45:46384) 2023-07-09T02:22:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 -- 172.21.15.45:0/2114172304 learned_addr learned my addr 172.21.15.45:0/2114172304 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:44.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f6ffff640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f780d2620 0x7f4f78153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7759e640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7815c060 0x7f4f780b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 -- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7815c060 msgr2=0x7f4f780b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7815c060 0x7f4f780b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 -- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f780d2620 msgr2=0x7f4f78153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f780d2620 0x7f4f78153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 -- 172.21.15.45:0/2114172304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680094d0 con 0x7f4f780cd120 2023-07-09T02:22:44.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7759e640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7815c060 0x7f4f780b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:44.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f6ffff640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f780d2620 0x7f4f78153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:44.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f76d9d640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f780cd120 0x7f4f780c8750 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f4f680190e0 tx=0x7f4f6801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f6f7fe640 1 -- 172.21.15.45:0/2114172304 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680b3800 con 0x7f4f780cd120 2023-07-09T02:22:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f6f7fe640 1 -- 172.21.15.45:0/2114172304 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f680b3980 con 0x7f4f780cd120 2023-07-09T02:22:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f6f7fe640 1 -- 172.21.15.45:0/2114172304 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680b3d30 con 0x7f4f780cd120 2023-07-09T02:22:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f780b59f0 con 0x7f4f780cd120 2023-07-09T02:22:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.052+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7815abf0 con 0x7f4f780cd120 2023-07-09T02:22:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.056+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7804d7d0 con 0x7f4f780cd120 2023-07-09T02:22:44.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.056+0000 7f4f6f7fe640 1 -- 172.21.15.45:0/2114172304 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f680b2380 con 0x7f4f780cd120 2023-07-09T02:22:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.056+0000 7f4f6f7fe640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4f58066280 0x7f4f58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.056+0000 7f4f6f7fe640 1 -- 172.21.15.45:0/2114172304 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f6811e220 con 0x7f4f780cd120 2023-07-09T02:22:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.056+0000 7f4f6ffff640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4f58066280 0x7f4f58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.056+0000 7f4f6ffff640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4f58066280 0x7f4f58068730 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4f780b8970 tx=0x7f4f60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.060+0000 7f4f6f7fe640 1 -- 172.21.15.45:0/2114172304 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f680eb740 con 0x7f4f780cd120 2023-07-09T02:22:44.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.212+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f780b5870 con 0x7f4f58066280 2023-07-09T02:22:44.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.220+0000 7f4f6f7fe640 1 -- 172.21.15.45:0/2114172304 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305749 (secure 0 0 0) 0x7f4f60001d60 con 0x7f4f58066280 2023-07-09T02:22:44.224 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:44.226 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:22:44.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4f58066280 msgr2=0x7f4f58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4f58066280 0x7f4f58068730 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4f780b8970 tx=0x7f4f60009040 comp rx=0 tx=0).stop 2023-07-09T02:22:44.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f780cd120 msgr2=0x7f4f780c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f780cd120 0x7f4f780c8750 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f4f680190e0 tx=0x7f4f6801ad10 comp rx=0 tx=0).stop 2023-07-09T02:22:44.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 shutdown_connections 2023-07-09T02:22:44.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4f58066280 0x7f4f58068730 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f7815c060 0x7f4f780b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f780d2620 0x7f4f78153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 --2- 172.21.15.45:0/2114172304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f780cd120 0x7f4f780c8750 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 >> 172.21.15.45:0/2114172304 conn(0x7f4f780698e0 msgr2=0x7f4f780b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:44.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 shutdown_connections 2023-07-09T02:22:44.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.224+0000 7f4f7d248640 1 -- 172.21.15.45:0/2114172304 wait complete. 2023-07-09T02:22:44.244 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2023-07-09T02:22:42.698988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9608,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552891,"statfs":{"total":1600000000,"available":1590160452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970634"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480539+0000","last_change":"2023-07-09T02:22:39.487748+0000","last_active":"2023-07-09T02:22:40.480539+0000","last_peered":"2023-07-09T02:22:40.480539+0000","last_clean":"2023-07-09T02:22:40.480539+0000","last_became_active":"2023-07-09T02:22:39.486558+0000","last_became_peered":"2023-07-09T02:22:39.486558+0000","last_unstale":"2023-07-09T02:22:40.480539+0000","last_undegraded":"2023-07-09T02:22:40.480539+0000","last_fullsized":"2023-07-09T02:22:40.480539+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:53:41.306217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.496509+0000","last_change":"2023-07-09T02:22:39.496415+0000","last_active":"2023-07-09T02:22:39.496509+0000","last_peered":"2023-07-09T02:22:39.496509+0000","last_clean":"2023-07-09T02:22:39.496509+0000","last_became_active":"2023-07-09T02:22:39.494244+0000","last_became_peered":"2023-07-09T02:22:39.494244+0000","last_unstale":"2023-07-09T02:22:39.496509+0000","last_undegraded":"2023-07-09T02:22:39.496509+0000","last_fullsized":"2023-07-09T02:22:39.496509+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:41:12.711524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479582+0000","last_change":"2023-07-09T02:22:39.487148+0000","last_active":"2023-07-09T02:22:40.479582+0000","last_peered":"2023-07-09T02:22:40.479582+0000","last_clean":"2023-07-09T02:22:40.479582+0000","last_became_active":"2023-07-09T02:22:39.486881+0000","last_became_peered":"2023-07-09T02:22:39.486881+0000","last_unstale":"2023-07-09T02:22:40.479582+0000","last_undegraded":"2023-07-09T02:22:40.479582+0000","last_fullsized":"2023-07-09T02:22:40.479582+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:47:53.586283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479495+0000","last_change":"2023-07-09T02:22:39.489464+0000","last_active":"2023-07-09T02:22:40.479495+0000","last_peered":"2023-07-09T02:22:40.479495+0000","last_clean":"2023-07-09T02:22:40.479495+0000","last_became_active":"2023-07-09T02:22:39.489044+0000","last_became_peered":"2023-07-09T02:22:39.489044+0000","last_unstale":"2023-07-09T02:22:40.479495+0000","last_undegraded":"2023-07-09T02:22:40.479495+0000","last_fullsized":"2023-07-09T02:22:40.479495+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:26:47.023096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479305+0000","last_change":"2023-07-09T02:22:39.484777+0000","last_active":"2023-07-09T02:22:40.479305+0000","last_peered":"2023-07-09T02:22:40.479305+0000","last_clean":"2023-07-09T02:22:40.479305+0000","last_became_active":"2023-07-09T02:22:39.482544+0000","last_became_peered":"2023-07-09T02:22:39.482544+0000","last_unstale":"2023-07-09T02:22:40.479305+0000","last_undegraded":"2023-07-09T02:22:40.479305+0000","last_fullsized":"2023-07-09T02:22:40.479305+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:15:33.904084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491954+0000","last_change":"2023-07-09T02:22:39.489866+0000","last_active":"2023-07-09T02:22:39.491954+0000","last_peered":"2023-07-09T02:22:39.491954+0000","last_clean":"2023-07-09T02:22:39.491954+0000","last_became_active":"2023-07-09T02:22:39.489607+0000","last_became_peered":"2023-07-09T02:22:39.489607+0000","last_unstale":"2023-07-09T02:22:39.491954+0000","last_undegraded":"2023-07-09T02:22:39.491954+0000","last_fullsized":"2023-07-09T02:22:39.491954+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:19:59.829378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.483492+0000","last_change":"2023-07-09T02:22:39.483033+0000","last_active":"2023-07-09T02:22:39.483492+0000","last_peered":"2023-07-09T02:22:39.483492+0000","last_clean":"2023-07-09T02:22:39.483492+0000","last_became_active":"2023-07-09T02:22:39.482646+0000","last_became_peered":"2023-07-09T02:22:39.482646+0000","last_unstale":"2023-07-09T02:22:39.483492+0000","last_undegraded":"2023-07-09T02:22:39.483492+0000","last_fullsized":"2023-07-09T02:22:39.483492+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:52:20.682821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.484296+0000","last_change":"2023-07-09T02:22:39.484230+0000","last_active":"2023-07-09T02:22:39.484296+0000","last_peered":"2023-07-09T02:22:39.484296+0000","last_clean":"2023-07-09T02:22:39.484296+0000","last_became_active":"2023-07-09T02:22:39.484003+0000","last_became_peered":"2023-07-09T02:22:39.484003+0000","last_unstale":"2023-07-09T02:22:39.484296+0000","last_undegraded":"2023-07-09T02:22:39.484296+0000","last_fullsized":"2023-07-09T02:22:39.484296+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:30:45.145239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493995+0000","last_change":"2023-07-09T02:22:39.493911+0000","last_active":"2023-07-09T02:22:39.493995+0000","last_peered":"2023-07-09T02:22:39.493995+0000","last_clean":"2023-07-09T02:22:39.493995+0000","last_became_active":"2023-07-09T02:22:39.493312+0000","last_became_peered":"2023-07-09T02:22:39.493312+0000","last_unstale":"2023-07-09T02:22:39.493995+0000","last_undegraded":"2023-07-09T02:22:39.493995+0000","last_fullsized":"2023-07-09T02:22:39.493995+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:07:11.735678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.490356+0000","last_change":"2023-07-09T02:22:39.489846+0000","last_active":"2023-07-09T02:22:39.490356+0000","last_peered":"2023-07-09T02:22:39.490356+0000","last_clean":"2023-07-09T02:22:39.490356+0000","last_became_active":"2023-07-09T02:22:39.489629+0000","last_became_peered":"2023-07-09T02:22:39.489629+0000","last_unstale":"2023-07-09T02:22:39.490356+0000","last_undegraded":"2023-07-09T02:22:39.490356+0000","last_fullsized":"2023-07-09T02:22:39.490356+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:23:47.146778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481015+0000","last_change":"2023-07-09T02:22:39.492290+0000","last_active":"2023-07-09T02:22:40.481015+0000","last_peered":"2023-07-09T02:22:40.481015+0000","last_clean":"2023-07-09T02:22:40.481015+0000","last_became_active":"2023-07-09T02:22:39.488293+0000","last_became_peered":"2023-07-09T02:22:39.488293+0000","last_unstale":"2023-07-09T02:22:40.481015+0000","last_undegraded":"2023-07-09T02:22:40.481015+0000","last_fullsized":"2023-07-09T02:22:40.481015+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:59:20.961468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493369+0000","last_change":"2023-07-09T02:22:39.493155+0000","last_active":"2023-07-09T02:22:39.493369+0000","last_peered":"2023-07-09T02:22:39.493369+0000","last_clean":"2023-07-09T02:22:39.493369+0000","last_became_active":"2023-07-09T02:22:39.492584+0000","last_became_peered":"2023-07-09T02:22:39.492584+0000","last_unstale":"2023-07-09T02:22:39.493369+0000","last_undegraded":"2023-07-09T02:22:39.493369+0000","last_fullsized":"2023-07-09T02:22:39.493369+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:24:42.235900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491808+0000","last_change":"2023-07-09T02:22:39.491718+0000","last_active":"2023-07-09T02:22:39.491808+0000","last_peered":"2023-07-09T02:22:39.491808+0000","last_clean":"2023-07-09T02:22:39.491808+0000","last_became_active":"2023-07-09T02:22:39.491485+0000","last_became_peered":"2023-07-09T02:22:39.491485+0000","last_unstale":"2023-07-09T02:22:39.491808+0000","last_undegraded":"2023-07-09T02:22:39.491808+0000","last_fullsized":"2023-07-09T02:22:39.491808+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:06:18.754803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.478856+0000","last_change":"2023-07-09T02:22:39.483614+0000","last_active":"2023-07-09T02:22:40.478856+0000","last_peered":"2023-07-09T02:22:40.478856+0000","last_clean":"2023-07-09T02:22:40.478856+0000","last_became_active":"2023-07-09T02:22:39.483258+0000","last_became_peered":"2023-07-09T02:22:39.483258+0000","last_unstale":"2023-07-09T02:22:40.478856+0000","last_undegraded":"2023-07-09T02:22:40.478856+0000","last_fullsized":"2023-07-09T02:22:40.478856+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:06:33.465792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481329+0000","last_change":"2023-07-09T02:22:39.485720+0000","last_active":"2023-07-09T02:22:40.481329+0000","last_peered":"2023-07-09T02:22:40.481329+0000","last_clean":"2023-07-09T02:22:40.481329+0000","last_became_active":"2023-07-09T02:22:39.485442+0000","last_became_peered":"2023-07-09T02:22:39.485442+0000","last_unstale":"2023-07-09T02:22:40.481329+0000","last_undegraded":"2023-07-09T02:22:40.481329+0000","last_fullsized":"2023-07-09T02:22:40.481329+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:42:17.333391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480293+0000","last_change":"2023-07-09T02:22:39.488241+0000","last_active":"2023-07-09T02:22:40.480293+0000","last_peered":"2023-07-09T02:22:40.480293+0000","last_clean":"2023-07-09T02:22:40.480293+0000","last_became_active":"2023-07-09T02:22:39.487978+0000","last_became_peered":"2023-07-09T02:22:39.487978+0000","last_unstale":"2023-07-09T02:22:40.480293+0000","last_undegraded":"2023-07-09T02:22:40.480293+0000","last_fullsized":"2023-07-09T02:22:40.480293+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:30:48.704569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.483475+0000","last_change":"2023-07-09T02:22:39.482876+0000","last_active":"2023-07-09T02:22:39.483475+0000","last_peered":"2023-07-09T02:22:39.483475+0000","last_clean":"2023-07-09T02:22:39.483475+0000","last_became_active":"2023-07-09T02:22:39.482322+0000","last_became_peered":"2023-07-09T02:22:39.482322+0000","last_unstale":"2023-07-09T02:22:39.483475+0000","last_undegraded":"2023-07-09T02:22:39.483475+0000","last_fullsized":"2023-07-09T02:22:39.483475+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:01:10.578983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.492160+0000","last_change":"2023-07-09T02:22:39.491991+0000","last_active":"2023-07-09T02:22:39.492160+0000","last_peered":"2023-07-09T02:22:39.492160+0000","last_clean":"2023-07-09T02:22:39.492160+0000","last_became_active":"2023-07-09T02:22:39.491768+0000","last_became_peered":"2023-07-09T02:22:39.491768+0000","last_unstale":"2023-07-09T02:22:39.492160+0000","last_undegraded":"2023-07-09T02:22:39.492160+0000","last_fullsized":"2023-07-09T02:22:39.492160+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:25:42.151824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480521+0000","last_change":"2023-07-09T02:22:39.490239+0000","last_active":"2023-07-09T02:22:40.480521+0000","last_peered":"2023-07-09T02:22:40.480521+0000","last_clean":"2023-07-09T02:22:40.480521+0000","last_became_active":"2023-07-09T02:22:39.489998+0000","last_became_peered":"2023-07-09T02:22:39.489998+0000","last_unstale":"2023-07-09T02:22:40.480521+0000","last_undegraded":"2023-07-09T02:22:40.480521+0000","last_fullsized":"2023-07-09T02:22:40.480521+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:50:04.058973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489244+0000","last_change":"2023-07-09T02:22:39.489027+0000","last_active":"2023-07-09T02:22:39.489244+0000","last_peered":"2023-07-09T02:22:39.489244+0000","last_clean":"2023-07-09T02:22:39.489244+0000","last_became_active":"2023-07-09T02:22:39.488784+0000","last_became_peered":"2023-07-09T02:22:39.488784+0000","last_unstale":"2023-07-09T02:22:39.489244+0000","last_undegraded":"2023-07-09T02:22:39.489244+0000","last_fullsized":"2023-07-09T02:22:39.489244+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:16:29.937309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.488254+0000","last_change":"2023-07-09T02:22:39.488177+0000","last_active":"2023-07-09T02:22:39.488254+0000","last_peered":"2023-07-09T02:22:39.488254+0000","last_clean":"2023-07-09T02:22:39.488254+0000","last_became_active":"2023-07-09T02:22:39.487947+0000","last_became_peered":"2023-07-09T02:22:39.487947+0000","last_unstale":"2023-07-09T02:22:39.488254+0000","last_undegraded":"2023-07-09T02:22:39.488254+0000","last_fullsized":"2023-07-09T02:22:39.488254+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:05:52.907426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493082+0000","last_change":"2023-07-09T02:22:39.492843+0000","last_active":"2023-07-09T02:22:39.493082+0000","last_peered":"2023-07-09T02:22:39.493082+0000","last_clean":"2023-07-09T02:22:39.493082+0000","last_became_active":"2023-07-09T02:22:39.489762+0000","last_became_peered":"2023-07-09T02:22:39.489762+0000","last_unstale":"2023-07-09T02:22:39.493082+0000","last_undegraded":"2023-07-09T02:22:39.493082+0000","last_fullsized":"2023-07-09T02:22:39.493082+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:42:07.353314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.478956+0000","last_change":"2023-07-09T02:22:39.487207+0000","last_active":"2023-07-09T02:22:40.478956+0000","last_peered":"2023-07-09T02:22:40.478956+0000","last_clean":"2023-07-09T02:22:40.478956+0000","last_became_active":"2023-07-09T02:22:39.486914+0000","last_became_peered":"2023-07-09T02:22:39.486914+0000","last_unstale":"2023-07-09T02:22:40.478956+0000","last_undegraded":"2023-07-09T02:22:40.478956+0000","last_fullsized":"2023-07-09T02:22:40.478956+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:01:23.675860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479672+0000","last_change":"2023-07-09T02:22:39.489296+0000","last_active":"2023-07-09T02:22:40.479672+0000","last_peered":"2023-07-09T02:22:40.479672+0000","last_clean":"2023-07-09T02:22:40.479672+0000","last_became_active":"2023-07-09T02:22:39.488707+0000","last_became_peered":"2023-07-09T02:22:39.488707+0000","last_unstale":"2023-07-09T02:22:40.479672+0000","last_undegraded":"2023-07-09T02:22:40.479672+0000","last_fullsized":"2023-07-09T02:22:40.479672+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:04:42.913735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491792+0000","last_change":"2023-07-09T02:22:39.491402+0000","last_active":"2023-07-09T02:22:39.491792+0000","last_peered":"2023-07-09T02:22:39.491792+0000","last_clean":"2023-07-09T02:22:39.491792+0000","last_became_active":"2023-07-09T02:22:39.491179+0000","last_became_peered":"2023-07-09T02:22:39.491179+0000","last_unstale":"2023-07-09T02:22:39.491792+0000","last_undegraded":"2023-07-09T02:22:39.491792+0000","last_fullsized":"2023-07-09T02:22:39.491792+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:25:42.151824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.487368+0000","last_change":"2023-07-09T02:22:39.487297+0000","last_active":"2023-07-09T02:22:39.487368+0000","last_peered":"2023-07-09T02:22:39.487368+0000","last_clean":"2023-07-09T02:22:39.487368+0000","last_became_active":"2023-07-09T02:22:39.487077+0000","last_became_peered":"2023-07-09T02:22:39.487077+0000","last_unstale":"2023-07-09T02:22:39.487368+0000","last_undegraded":"2023-07-09T02:22:39.487368+0000","last_fullsized":"2023-07-09T02:22:39.487368+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:17:46.033664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493100+0000","last_change":"2023-07-09T02:22:39.493018+0000","last_active":"2023-07-09T02:22:39.493100+0000","last_peered":"2023-07-09T02:22:39.493100+0000","last_clean":"2023-07-09T02:22:39.493100+0000","last_became_active":"2023-07-09T02:22:39.492132+0000","last_became_peered":"2023-07-09T02:22:39.492132+0000","last_unstale":"2023-07-09T02:22:39.493100+0000","last_undegraded":"2023-07-09T02:22:39.493100+0000","last_fullsized":"2023-07-09T02:22:39.493100+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:53:36.757125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.486178+0000","last_change":"2023-07-09T02:22:39.485927+0000","last_active":"2023-07-09T02:22:39.486178+0000","last_peered":"2023-07-09T02:22:39.486178+0000","last_clean":"2023-07-09T02:22:39.486178+0000","last_became_active":"2023-07-09T02:22:39.485402+0000","last_became_peered":"2023-07-09T02:22:39.485402+0000","last_unstale":"2023-07-09T02:22:39.486178+0000","last_undegraded":"2023-07-09T02:22:39.486178+0000","last_fullsized":"2023-07-09T02:22:39.486178+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:52:42.084018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.495829+0000","last_change":"2023-07-09T02:22:39.495736+0000","last_active":"2023-07-09T02:22:39.495829+0000","last_peered":"2023-07-09T02:22:39.495829+0000","last_clean":"2023-07-09T02:22:39.495829+0000","last_became_active":"2023-07-09T02:22:39.494170+0000","last_became_peered":"2023-07-09T02:22:39.494170+0000","last_unstale":"2023-07-09T02:22:39.495829+0000","last_undegraded":"2023-07-09T02:22:39.495829+0000","last_fullsized":"2023-07-09T02:22:39.495829+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:04:51.406237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491636+0000","last_change":"2023-07-09T02:22:39.491551+0000","last_active":"2023-07-09T02:22:39.491636+0000","last_peered":"2023-07-09T02:22:39.491636+0000","last_clean":"2023-07-09T02:22:39.491636+0000","last_became_active":"2023-07-09T02:22:39.491222+0000","last_became_peered":"2023-07-09T02:22:39.491222+0000","last_unstale":"2023-07-09T02:22:39.491636+0000","last_undegraded":"2023-07-09T02:22:39.491636+0000","last_fullsized":"2023-07-09T02:22:39.491636+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:02:38.890881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481161+0000","last_change":"2023-07-09T02:22:39.493927+0000","last_active":"2023-07-09T02:22:40.481161+0000","last_peered":"2023-07-09T02:22:40.481161+0000","last_clean":"2023-07-09T02:22:40.481161+0000","last_became_active":"2023-07-09T02:22:39.488902+0000","last_became_peered":"2023-07-09T02:22:39.488902+0000","last_unstale":"2023-07-09T02:22:40.481161+0000","last_undegraded":"2023-07-09T02:22:40.481161+0000","last_fullsized":"2023-07-09T02:22:40.481161+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:07:11.735678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493346+0000","last_change":"2023-07-09T02:22:39.493236+0000","last_active":"2023-07-09T02:22:39.493346+0000","last_peered":"2023-07-09T02:22:39.493346+0000","last_clean":"2023-07-09T02:22:39.493346+0000","last_became_active":"2023-07-09T02:22:39.493019+0000","last_became_peered":"2023-07-09T02:22:39.493019+0000","last_unstale":"2023-07-09T02:22:39.493346+0000","last_undegraded":"2023-07-09T02:22:39.493346+0000","last_fullsized":"2023-07-09T02:22:39.493346+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:10.477218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.496390+0000","last_change":"2023-07-09T02:22:39.496282+0000","last_active":"2023-07-09T02:22:39.496390+0000","last_peered":"2023-07-09T02:22:39.496390+0000","last_clean":"2023-07-09T02:22:39.496390+0000","last_became_active":"2023-07-09T02:22:39.495959+0000","last_became_peered":"2023-07-09T02:22:39.495959+0000","last_unstale":"2023-07-09T02:22:39.496390+0000","last_undegraded":"2023-07-09T02:22:39.496390+0000","last_fullsized":"2023-07-09T02:22:39.496390+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:46:57.957414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"181'4","reported_seq":17,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479966+0000","last_change":"2023-07-09T02:22:38.737955+0000","last_active":"2023-07-09T02:22:40.479966+0000","last_peered":"2023-07-09T02:22:40.479966+0000","last_clean":"2023-07-09T02:22:40.479966+0000","last_became_active":"2023-07-09T02:22:38.737708+0000","last_became_peered":"2023-07-09T02:22:38.737708+0000","last_unstale":"2023-07-09T02:22:40.479966+0000","last_undegraded":"2023-07-09T02:22:40.479966+0000","last_fullsized":"2023-07-09T02:22:40.479966+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:57:33.269940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489115+0000","last_change":"2023-07-09T02:22:39.488960+0000","last_active":"2023-07-09T02:22:39.489115+0000","last_peered":"2023-07-09T02:22:39.489115+0000","last_clean":"2023-07-09T02:22:39.489115+0000","last_became_active":"2023-07-09T02:22:39.488711+0000","last_became_peered":"2023-07-09T02:22:39.488711+0000","last_unstale":"2023-07-09T02:22:39.489115+0000","last_undegraded":"2023-07-09T02:22:39.489115+0000","last_fullsized":"2023-07-09T02:22:39.489115+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:51:14.779144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"181'1","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479111+0000","last_change":"2023-07-09T02:22:38.739619+0000","last_active":"2023-07-09T02:22:40.479111+0000","last_peered":"2023-07-09T02:22:40.479111+0000","last_clean":"2023-07-09T02:22:40.479111+0000","last_became_active":"2023-07-09T02:22:38.739126+0000","last_became_peered":"2023-07-09T02:22:38.739126+0000","last_unstale":"2023-07-09T02:22:40.479111+0000","last_undegraded":"2023-07-09T02:22:40.479111+0000","last_fullsized":"2023-07-09T02:22:40.479111+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:42:55.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479227+0000","last_change":"2023-07-09T02:22:39.482411+0000","last_active":"2023-07-09T02:22:40.479227+0000","last_peered":"2023-07-09T02:22:40.479227+0000","last_clean":"2023-07-09T02:22:40.479227+0000","last_became_active":"2023-07-09T02:22:39.482182+0000","last_became_peered":"2023-07-09T02:22:39.482182+0000","last_unstale":"2023-07-09T02:22:40.479227+0000","last_undegraded":"2023-07-09T02:22:40.479227+0000","last_fullsized":"2023-07-09T02:22:40.479227+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:27:16.012508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"181'2","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481469+0000","last_change":"2023-07-09T02:22:38.736296+0000","last_active":"2023-07-09T02:22:40.481469+0000","last_peered":"2023-07-09T02:22:40.481469+0000","last_clean":"2023-07-09T02:22:40.481469+0000","last_became_active":"2023-07-09T02:22:38.736081+0000","last_became_peered":"2023-07-09T02:22:38.736081+0000","last_unstale":"2023-07-09T02:22:40.481469+0000","last_undegraded":"2023-07-09T02:22:40.481469+0000","last_fullsized":"2023-07-09T02:22:40.481469+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:27:47.310826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493584+0000","last_change":"2023-07-09T02:22:39.493469+0000","last_active":"2023-07-09T02:22:39.493584+0000","last_peered":"2023-07-09T02:22:39.493584+0000","last_clean":"2023-07-09T02:22:39.493584+0000","last_became_active":"2023-07-09T02:22:39.492945+0000","last_became_peered":"2023-07-09T02:22:39.492945+0000","last_unstale":"2023-07-09T02:22:39.493584+0000","last_undegraded":"2023-07-09T02:22:39.493584+0000","last_fullsized":"2023-07-09T02:22:39.493584+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:43:13.777846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"181'2","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.766749+0000","last_change":"2023-07-09T02:22:38.738500+0000","last_active":"2023-07-09T02:22:39.766749+0000","last_peered":"2023-07-09T02:22:39.766749+0000","last_clean":"2023-07-09T02:22:39.766749+0000","last_became_active":"2023-07-09T02:22:38.738209+0000","last_became_peered":"2023-07-09T02:22:38.738209+0000","last_unstale":"2023-07-09T02:22:39.766749+0000","last_undegraded":"2023-07-09T02:22:39.766749+0000","last_fullsized":"2023-07-09T02:22:39.766749+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:13:39.874847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.491643+0000","last_change":"2023-07-09T02:22:39.491487+0000","last_active":"2023-07-09T02:22:39.491643+0000","last_peered":"2023-07-09T02:22:39.491643+0000","last_clean":"2023-07-09T02:22:39.491643+0000","last_became_active":"2023-07-09T02:22:39.490822+0000","last_became_peered":"2023-07-09T02:22:39.490822+0000","last_unstale":"2023-07-09T02:22:39.491643+0000","last_undegraded":"2023-07-09T02:22:39.491643+0000","last_fullsized":"2023-07-09T02:22:39.491643+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:16:00.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"181'1","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.765328+0000","last_change":"2023-07-09T02:22:38.737217+0000","last_active":"2023-07-09T02:22:39.765328+0000","last_peered":"2023-07-09T02:22:39.765328+0000","last_clean":"2023-07-09T02:22:39.765328+0000","last_became_active":"2023-07-09T02:22:38.736579+0000","last_became_peered":"2023-07-09T02:22:38.736579+0000","last_unstale":"2023-07-09T02:22:39.765328+0000","last_undegraded":"2023-07-09T02:22:39.765328+0000","last_fullsized":"2023-07-09T02:22:39.765328+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:11:18.794253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.492500+0000","last_change":"2023-07-09T02:22:39.492432+0000","last_active":"2023-07-09T02:22:39.492500+0000","last_peered":"2023-07-09T02:22:39.492500+0000","last_clean":"2023-07-09T02:22:39.492500+0000","last_became_active":"2023-07-09T02:22:39.492217+0000","last_became_peered":"2023-07-09T02:22:39.492217+0000","last_unstale":"2023-07-09T02:22:39.492500+0000","last_undegraded":"2023-07-09T02:22:39.492500+0000","last_fullsized":"2023-07-09T02:22:39.492500+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:15:38.048781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"181'1","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479233+0000","last_change":"2023-07-09T02:22:38.739755+0000","last_active":"2023-07-09T02:22:40.479233+0000","last_peered":"2023-07-09T02:22:40.479233+0000","last_clean":"2023-07-09T02:22:40.479233+0000","last_became_active":"2023-07-09T02:22:38.739527+0000","last_became_peered":"2023-07-09T02:22:38.739527+0000","last_unstale":"2023-07-09T02:22:40.479233+0000","last_undegraded":"2023-07-09T02:22:40.479233+0000","last_fullsized":"2023-07-09T02:22:40.479233+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:39:12.161898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489187+0000","last_change":"2023-07-09T02:22:39.488607+0000","last_active":"2023-07-09T02:22:39.489187+0000","last_peered":"2023-07-09T02:22:39.489187+0000","last_clean":"2023-07-09T02:22:39.489187+0000","last_became_active":"2023-07-09T02:22:39.488055+0000","last_became_peered":"2023-07-09T02:22:39.488055+0000","last_unstale":"2023-07-09T02:22:39.489187+0000","last_undegraded":"2023-07-09T02:22:39.489187+0000","last_fullsized":"2023-07-09T02:22:39.489187+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:22:02.594346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.481816+0000","last_change":"2023-07-09T02:22:38.740309+0000","last_active":"2023-07-09T02:22:39.481816+0000","last_peered":"2023-07-09T02:22:39.481816+0000","last_clean":"2023-07-09T02:22:39.481816+0000","last_became_active":"2023-07-09T02:22:38.740070+0000","last_became_peered":"2023-07-09T02:22:38.740070+0000","last_unstale":"2023-07-09T02:22:39.481816+0000","last_undegraded":"2023-07-09T02:22:39.481816+0000","last_fullsized":"2023-07-09T02:22:39.481816+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:47:25.610601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480421+0000","last_change":"2023-07-09T02:22:39.485332+0000","last_active":"2023-07-09T02:22:40.480421+0000","last_peered":"2023-07-09T02:22:40.480421+0000","last_clean":"2023-07-09T02:22:40.480421+0000","last_became_active":"2023-07-09T02:22:39.483093+0000","last_became_peered":"2023-07-09T02:22:39.483093+0000","last_unstale":"2023-07-09T02:22:40.480421+0000","last_undegraded":"2023-07-09T02:22:40.480421+0000","last_fullsized":"2023-07-09T02:22:40.480421+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:08:41.555983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480236+0000","last_change":"2023-07-09T02:22:38.741006+0000","last_active":"2023-07-09T02:22:39.480236+0000","last_peered":"2023-07-09T02:22:39.480236+0000","last_clean":"2023-07-09T02:22:39.480236+0000","last_became_active":"2023-07-09T02:22:38.740260+0000","last_became_peered":"2023-07-09T02:22:38.740260+0000","last_unstale":"2023-07-09T02:22:39.480236+0000","last_undegraded":"2023-07-09T02:22:39.480236+0000","last_fullsized":"2023-07-09T02:22:39.480236+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:15.683628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493765+0000","last_change":"2023-07-09T02:22:39.493699+0000","last_active":"2023-07-09T02:22:39.493765+0000","last_peered":"2023-07-09T02:22:39.493765+0000","last_clean":"2023-07-09T02:22:39.493765+0000","last_became_active":"2023-07-09T02:22:39.492888+0000","last_became_peered":"2023-07-09T02:22:39.492888+0000","last_unstale":"2023-07-09T02:22:39.493765+0000","last_undegraded":"2023-07-09T02:22:39.493765+0000","last_fullsized":"2023-07-09T02:22:39.493765+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:44.306240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"181'1","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.764837+0000","last_change":"2023-07-09T02:22:38.737467+0000","last_active":"2023-07-09T02:22:39.764837+0000","last_peered":"2023-07-09T02:22:39.764837+0000","last_clean":"2023-07-09T02:22:39.764837+0000","last_became_active":"2023-07-09T02:22:38.737246+0000","last_became_peered":"2023-07-09T02:22:38.737246+0000","last_unstale":"2023-07-09T02:22:39.764837+0000","last_undegraded":"2023-07-09T02:22:39.764837+0000","last_fullsized":"2023-07-09T02:22:39.764837+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:51:25.220917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489977+0000","last_change":"2023-07-09T02:22:39.489669+0000","last_active":"2023-07-09T02:22:39.489977+0000","last_peered":"2023-07-09T02:22:39.489977+0000","last_clean":"2023-07-09T02:22:39.489977+0000","last_became_active":"2023-07-09T02:22:39.489432+0000","last_became_peered":"2023-07-09T02:22:39.489432+0000","last_unstale":"2023-07-09T02:22:39.489977+0000","last_undegraded":"2023-07-09T02:22:39.489977+0000","last_fullsized":"2023-07-09T02:22:39.489977+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:33:02.615795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"181'2","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.766469+0000","last_change":"2023-07-09T02:22:38.744591+0000","last_active":"2023-07-09T02:22:39.766469+0000","last_peered":"2023-07-09T02:22:39.766469+0000","last_clean":"2023-07-09T02:22:39.766469+0000","last_became_active":"2023-07-09T02:22:38.744199+0000","last_became_peered":"2023-07-09T02:22:38.744199+0000","last_unstale":"2023-07-09T02:22:39.766469+0000","last_undegraded":"2023-07-09T02:22:39.766469+0000","last_fullsized":"2023-07-09T02:22:39.766469+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:50:03.056344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481240+0000","last_change":"2023-07-09T02:22:39.482000+0000","last_active":"2023-07-09T02:22:40.481240+0000","last_peered":"2023-07-09T02:22:40.481240+0000","last_clean":"2023-07-09T02:22:40.481240+0000","last_became_active":"2023-07-09T02:22:39.481765+0000","last_became_peered":"2023-07-09T02:22:39.481765+0000","last_unstale":"2023-07-09T02:22:40.481240+0000","last_undegraded":"2023-07-09T02:22:40.481240+0000","last_fullsized":"2023-07-09T02:22:40.481240+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:16:00.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"181'1","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479428+0000","last_change":"2023-07-09T02:22:38.738991+0000","last_active":"2023-07-09T02:22:40.479428+0000","last_peered":"2023-07-09T02:22:40.479428+0000","last_clean":"2023-07-09T02:22:40.479428+0000","last_became_active":"2023-07-09T02:22:38.738726+0000","last_became_peered":"2023-07-09T02:22:38.738726+0000","last_unstale":"2023-07-09T02:22:40.479428+0000","last_undegraded":"2023-07-09T02:22:40.479428+0000","last_fullsized":"2023-07-09T02:22:40.479428+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:02:32.836215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481452+0000","last_change":"2023-07-09T02:22:39.489152+0000","last_active":"2023-07-09T02:22:40.481452+0000","last_peered":"2023-07-09T02:22:40.481452+0000","last_clean":"2023-07-09T02:22:40.481452+0000","last_became_active":"2023-07-09T02:22:39.487967+0000","last_became_peered":"2023-07-09T02:22:39.487967+0000","last_unstale":"2023-07-09T02:22:40.481452+0000","last_undegraded":"2023-07-09T02:22:40.481452+0000","last_fullsized":"2023-07-09T02:22:40.481452+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:55:19.383399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480642+0000","last_change":"2023-07-09T02:22:38.737363+0000","last_active":"2023-07-09T02:22:39.480642+0000","last_peered":"2023-07-09T02:22:39.480642+0000","last_clean":"2023-07-09T02:22:39.480642+0000","last_became_active":"2023-07-09T02:22:38.736986+0000","last_became_peered":"2023-07-09T02:22:38.736986+0000","last_unstale":"2023-07-09T02:22:39.480642+0000","last_undegraded":"2023-07-09T02:22:39.480642+0000","last_fullsized":"2023-07-09T02:22:39.480642+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:59:19.958839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485116+0000","last_change":"2023-07-09T02:22:39.484927+0000","last_active":"2023-07-09T02:22:39.485116+0000","last_peered":"2023-07-09T02:22:39.485116+0000","last_clean":"2023-07-09T02:22:39.485116+0000","last_became_active":"2023-07-09T02:22:39.484380+0000","last_became_peered":"2023-07-09T02:22:39.484380+0000","last_unstale":"2023-07-09T02:22:39.485116+0000","last_undegraded":"2023-07-09T02:22:39.485116+0000","last_fullsized":"2023-07-09T02:22:39.485116+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:54:02.746594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"181'2","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479370+0000","last_change":"2023-07-09T02:22:38.733850+0000","last_active":"2023-07-09T02:22:40.479370+0000","last_peered":"2023-07-09T02:22:40.479370+0000","last_clean":"2023-07-09T02:22:40.479370+0000","last_became_active":"2023-07-09T02:22:38.733623+0000","last_became_peered":"2023-07-09T02:22:38.733623+0000","last_unstale":"2023-07-09T02:22:40.479370+0000","last_undegraded":"2023-07-09T02:22:40.479370+0000","last_fullsized":"2023-07-09T02:22:40.479370+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:31:17.156255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.478970+0000","last_change":"2023-07-09T02:22:39.491077+0000","last_active":"2023-07-09T02:22:40.478970+0000","last_peered":"2023-07-09T02:22:40.478970+0000","last_clean":"2023-07-09T02:22:40.478970+0000","last_became_active":"2023-07-09T02:22:39.490305+0000","last_became_peered":"2023-07-09T02:22:39.490305+0000","last_unstale":"2023-07-09T02:22:40.478970+0000","last_undegraded":"2023-07-09T02:22:40.478970+0000","last_fullsized":"2023-07-09T02:22:40.478970+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:06:05.313236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480778+0000","last_change":"2023-07-09T02:22:38.740542+0000","last_active":"2023-07-09T02:22:40.480778+0000","last_peered":"2023-07-09T02:22:40.480778+0000","last_clean":"2023-07-09T02:22:40.480778+0000","last_became_active":"2023-07-09T02:22:38.740270+0000","last_became_peered":"2023-07-09T02:22:38.740270+0000","last_unstale":"2023-07-09T02:22:40.480778+0000","last_undegraded":"2023-07-09T02:22:40.480778+0000","last_fullsized":"2023-07-09T02:22:40.480778+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:15:03.572576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479091+0000","last_change":"2023-07-09T02:22:39.485671+0000","last_active":"2023-07-09T02:22:40.479091+0000","last_peered":"2023-07-09T02:22:40.479091+0000","last_clean":"2023-07-09T02:22:40.479091+0000","last_became_active":"2023-07-09T02:22:39.482612+0000","last_became_peered":"2023-07-09T02:22:39.482612+0000","last_unstale":"2023-07-09T02:22:40.479091+0000","last_undegraded":"2023-07-09T02:22:40.479091+0000","last_fullsized":"2023-07-09T02:22:40.479091+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:54:55.734051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.481406+0000","last_change":"2023-07-09T02:22:38.738980+0000","last_active":"2023-07-09T02:22:39.481406+0000","last_peered":"2023-07-09T02:22:39.481406+0000","last_clean":"2023-07-09T02:22:39.481406+0000","last_became_active":"2023-07-09T02:22:38.738724+0000","last_became_peered":"2023-07-09T02:22:38.738724+0000","last_unstale":"2023-07-09T02:22:39.481406+0000","last_undegraded":"2023-07-09T02:22:39.481406+0000","last_fullsized":"2023-07-09T02:22:39.481406+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:49:36.491910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.496805+0000","last_change":"2023-07-09T02:22:39.496736+0000","last_active":"2023-07-09T02:22:39.496805+0000","last_peered":"2023-07-09T02:22:39.496805+0000","last_clean":"2023-07-09T02:22:39.496805+0000","last_became_active":"2023-07-09T02:22:39.495941+0000","last_became_peered":"2023-07-09T02:22:39.495941+0000","last_unstale":"2023-07-09T02:22:39.496805+0000","last_undegraded":"2023-07-09T02:22:39.496805+0000","last_fullsized":"2023-07-09T02:22:39.496805+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:27:59.579113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.484671+0000","last_change":"2023-07-09T02:22:38.736083+0000","last_active":"2023-07-09T02:22:39.484671+0000","last_peered":"2023-07-09T02:22:39.484671+0000","last_clean":"2023-07-09T02:22:39.484671+0000","last_became_active":"2023-07-09T02:22:38.735785+0000","last_became_peered":"2023-07-09T02:22:38.735785+0000","last_unstale":"2023-07-09T02:22:39.484671+0000","last_undegraded":"2023-07-09T02:22:39.484671+0000","last_fullsized":"2023-07-09T02:22:39.484671+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:26:07.854651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481297+0000","last_change":"2023-07-09T02:22:39.493599+0000","last_active":"2023-07-09T02:22:40.481297+0000","last_peered":"2023-07-09T02:22:40.481297+0000","last_clean":"2023-07-09T02:22:40.481297+0000","last_became_active":"2023-07-09T02:22:39.488610+0000","last_became_peered":"2023-07-09T02:22:39.488610+0000","last_unstale":"2023-07-09T02:22:40.481297+0000","last_undegraded":"2023-07-09T02:22:40.481297+0000","last_fullsized":"2023-07-09T02:22:40.481297+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:14:44.306240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"181'2","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479727+0000","last_change":"2023-07-09T02:22:38.737557+0000","last_active":"2023-07-09T02:22:40.479727+0000","last_peered":"2023-07-09T02:22:40.479727+0000","last_clean":"2023-07-09T02:22:40.479727+0000","last_became_active":"2023-07-09T02:22:38.737280+0000","last_became_peered":"2023-07-09T02:22:38.737280+0000","last_unstale":"2023-07-09T02:22:40.479727+0000","last_undegraded":"2023-07-09T02:22:40.479727+0000","last_fullsized":"2023-07-09T02:22:40.479727+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:17:33.873105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.483506+0000","last_change":"2023-07-09T02:22:39.483414+0000","last_active":"2023-07-09T02:22:39.483506+0000","last_peered":"2023-07-09T02:22:39.483506+0000","last_clean":"2023-07-09T02:22:39.483506+0000","last_became_active":"2023-07-09T02:22:39.483179+0000","last_became_peered":"2023-07-09T02:22:39.483179+0000","last_unstale":"2023-07-09T02:22:39.483506+0000","last_undegraded":"2023-07-09T02:22:39.483506+0000","last_fullsized":"2023-07-09T02:22:39.483506+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:10:23.479926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485006+0000","last_change":"2023-07-09T02:22:38.743110+0000","last_active":"2023-07-09T02:22:39.485006+0000","last_peered":"2023-07-09T02:22:39.485006+0000","last_clean":"2023-07-09T02:22:39.485006+0000","last_became_active":"2023-07-09T02:22:38.742730+0000","last_became_peered":"2023-07-09T02:22:38.742730+0000","last_unstale":"2023-07-09T02:22:39.485006+0000","last_undegraded":"2023-07-09T02:22:39.485006+0000","last_fullsized":"2023-07-09T02:22:39.485006+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:09:39.758232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489170+0000","last_change":"2023-07-09T02:22:39.487983+0000","last_active":"2023-07-09T02:22:39.489170+0000","last_peered":"2023-07-09T02:22:39.489170+0000","last_clean":"2023-07-09T02:22:39.489170+0000","last_became_active":"2023-07-09T02:22:39.487771+0000","last_became_peered":"2023-07-09T02:22:39.487771+0000","last_unstale":"2023-07-09T02:22:39.489170+0000","last_undegraded":"2023-07-09T02:22:39.489170+0000","last_fullsized":"2023-07-09T02:22:39.489170+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:17:38.626546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485027+0000","last_change":"2023-07-09T02:22:38.742710+0000","last_active":"2023-07-09T02:22:39.485027+0000","last_peered":"2023-07-09T02:22:39.485027+0000","last_clean":"2023-07-09T02:22:39.485027+0000","last_became_active":"2023-07-09T02:22:38.742072+0000","last_became_peered":"2023-07-09T02:22:38.742072+0000","last_unstale":"2023-07-09T02:22:39.485027+0000","last_undegraded":"2023-07-09T02:22:39.485027+0000","last_fullsized":"2023-07-09T02:22:39.485027+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:52:20.880040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.490372+0000","last_change":"2023-07-09T02:22:39.490295+0000","last_active":"2023-07-09T02:22:39.490372+0000","last_peered":"2023-07-09T02:22:39.490372+0000","last_clean":"2023-07-09T02:22:39.490372+0000","last_became_active":"2023-07-09T02:22:39.490079+0000","last_became_peered":"2023-07-09T02:22:39.490079+0000","last_unstale":"2023-07-09T02:22:39.490372+0000","last_undegraded":"2023-07-09T02:22:39.490372+0000","last_fullsized":"2023-07-09T02:22:39.490372+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:50:07.910762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.481536+0000","last_change":"2023-07-09T02:22:38.743509+0000","last_active":"2023-07-09T02:22:39.481536+0000","last_peered":"2023-07-09T02:22:39.481536+0000","last_clean":"2023-07-09T02:22:39.481536+0000","last_became_active":"2023-07-09T02:22:38.743295+0000","last_became_peered":"2023-07-09T02:22:38.743295+0000","last_unstale":"2023-07-09T02:22:39.481536+0000","last_undegraded":"2023-07-09T02:22:39.481536+0000","last_fullsized":"2023-07-09T02:22:39.481536+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:14:51.708873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479674+0000","last_change":"2023-07-09T02:22:39.481176+0000","last_active":"2023-07-09T02:22:40.479674+0000","last_peered":"2023-07-09T02:22:40.479674+0000","last_clean":"2023-07-09T02:22:40.479674+0000","last_became_active":"2023-07-09T02:22:39.480435+0000","last_became_peered":"2023-07-09T02:22:39.480435+0000","last_unstale":"2023-07-09T02:22:40.479674+0000","last_undegraded":"2023-07-09T02:22:40.479674+0000","last_fullsized":"2023-07-09T02:22:40.479674+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:46:23.917342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480733+0000","last_change":"2023-07-09T02:22:38.736905+0000","last_active":"2023-07-09T02:22:40.480733+0000","last_peered":"2023-07-09T02:22:40.480733+0000","last_clean":"2023-07-09T02:22:40.480733+0000","last_became_active":"2023-07-09T02:22:38.734940+0000","last_became_peered":"2023-07-09T02:22:38.734940+0000","last_unstale":"2023-07-09T02:22:40.480733+0000","last_undegraded":"2023-07-09T02:22:40.480733+0000","last_fullsized":"2023-07-09T02:22:40.480733+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:00:53.143296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493116+0000","last_change":"2023-07-09T02:22:39.493060+0000","last_active":"2023-07-09T02:22:39.493116+0000","last_peered":"2023-07-09T02:22:39.493116+0000","last_clean":"2023-07-09T02:22:39.493116+0000","last_became_active":"2023-07-09T02:22:39.492809+0000","last_became_peered":"2023-07-09T02:22:39.492809+0000","last_unstale":"2023-07-09T02:22:39.493116+0000","last_undegraded":"2023-07-09T02:22:39.493116+0000","last_fullsized":"2023-07-09T02:22:39.493116+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:49:34.534378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480073+0000","last_change":"2023-07-09T02:22:38.741294+0000","last_active":"2023-07-09T02:22:39.480073+0000","last_peered":"2023-07-09T02:22:39.480073+0000","last_clean":"2023-07-09T02:22:39.480073+0000","last_became_active":"2023-07-09T02:22:38.741055+0000","last_became_peered":"2023-07-09T02:22:38.741055+0000","last_unstale":"2023-07-09T02:22:39.480073+0000","last_undegraded":"2023-07-09T02:22:39.480073+0000","last_fullsized":"2023-07-09T02:22:39.480073+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:57:09.474589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485239+0000","last_change":"2023-07-09T02:22:39.485097+0000","last_active":"2023-07-09T02:22:39.485239+0000","last_peered":"2023-07-09T02:22:39.485239+0000","last_clean":"2023-07-09T02:22:39.485239+0000","last_became_active":"2023-07-09T02:22:39.484686+0000","last_became_peered":"2023-07-09T02:22:39.484686+0000","last_unstale":"2023-07-09T02:22:39.485239+0000","last_undegraded":"2023-07-09T02:22:39.485239+0000","last_fullsized":"2023-07-09T02:22:39.485239+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:00.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480667+0000","last_change":"2023-07-09T02:22:38.736712+0000","last_active":"2023-07-09T02:22:40.480667+0000","last_peered":"2023-07-09T02:22:40.480667+0000","last_clean":"2023-07-09T02:22:40.480667+0000","last_became_active":"2023-07-09T02:22:38.736284+0000","last_became_peered":"2023-07-09T02:22:38.736284+0000","last_unstale":"2023-07-09T02:22:40.480667+0000","last_undegraded":"2023-07-09T02:22:40.480667+0000","last_fullsized":"2023-07-09T02:22:40.480667+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:06:55.242709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.487846+0000","last_change":"2023-07-09T02:22:39.487556+0000","last_active":"2023-07-09T02:22:39.487846+0000","last_peered":"2023-07-09T02:22:39.487846+0000","last_clean":"2023-07-09T02:22:39.487846+0000","last_became_active":"2023-07-09T02:22:39.487231+0000","last_became_peered":"2023-07-09T02:22:39.487231+0000","last_unstale":"2023-07-09T02:22:39.487846+0000","last_undegraded":"2023-07-09T02:22:39.487846+0000","last_fullsized":"2023-07-09T02:22:39.487846+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:16:42.130472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479310+0000","last_change":"2023-07-09T02:22:38.734688+0000","last_active":"2023-07-09T02:22:40.479310+0000","last_peered":"2023-07-09T02:22:40.479310+0000","last_clean":"2023-07-09T02:22:40.479310+0000","last_became_active":"2023-07-09T02:22:38.734434+0000","last_became_peered":"2023-07-09T02:22:38.734434+0000","last_unstale":"2023-07-09T02:22:40.479310+0000","last_undegraded":"2023-07-09T02:22:40.479310+0000","last_fullsized":"2023-07-09T02:22:40.479310+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:02:46.302753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.492505+0000","last_change":"2023-07-09T02:22:39.492271+0000","last_active":"2023-07-09T02:22:39.492505+0000","last_peered":"2023-07-09T02:22:39.492505+0000","last_clean":"2023-07-09T02:22:39.492505+0000","last_became_active":"2023-07-09T02:22:39.489433+0000","last_became_peered":"2023-07-09T02:22:39.489433+0000","last_unstale":"2023-07-09T02:22:39.492505+0000","last_undegraded":"2023-07-09T02:22:39.492505+0000","last_fullsized":"2023-07-09T02:22:39.492505+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T05:57:30.514601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.479951+0000","last_change":"2023-07-09T02:22:38.742570+0000","last_active":"2023-07-09T02:22:39.479951+0000","last_peered":"2023-07-09T02:22:39.479951+0000","last_clean":"2023-07-09T02:22:39.479951+0000","last_became_active":"2023-07-09T02:22:38.742317+0000","last_became_peered":"2023-07-09T02:22:38.742317+0000","last_unstale":"2023-07-09T02:22:39.479951+0000","last_undegraded":"2023-07-09T02:22:39.479951+0000","last_fullsized":"2023-07-09T02:22:39.479951+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:02:37.888252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":444,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485951+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:22:39.485951+0000","last_peered":"2023-07-09T02:22:39.485951+0000","last_clean":"2023-07-09T02:22:39.485951+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:22:39.485951+0000","last_undegraded":"2023-07-09T02:22:39.485951+0000","last_fullsized":"2023-07-09T02:22:39.485951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:11:42.556090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":334,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481539+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:22:40.481539+0000","last_peered":"2023-07-09T02:22:40.481539+0000","last_clean":"2023-07-09T02:22:40.481539+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:22:40.481539+0000","last_undegraded":"2023-07-09T02:22:40.481539+0000","last_fullsized":"2023-07-09T02:22:40.481539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:35:52.624721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.486197+0000","last_change":"2023-07-09T02:22:39.486078+0000","last_active":"2023-07-09T02:22:39.486197+0000","last_peered":"2023-07-09T02:22:39.486197+0000","last_clean":"2023-07-09T02:22:39.486197+0000","last_became_active":"2023-07-09T02:22:39.485719+0000","last_became_peered":"2023-07-09T02:22:39.485719+0000","last_unstale":"2023-07-09T02:22:39.486197+0000","last_undegraded":"2023-07-09T02:22:39.486197+0000","last_fullsized":"2023-07-09T02:22:39.486197+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:56:15.902790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"181'3","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480105+0000","last_change":"2023-07-09T02:22:38.730281+0000","last_active":"2023-07-09T02:22:40.480105+0000","last_peered":"2023-07-09T02:22:40.480105+0000","last_clean":"2023-07-09T02:22:40.480105+0000","last_became_active":"2023-07-09T02:22:38.730020+0000","last_became_peered":"2023-07-09T02:22:38.730020+0000","last_unstale":"2023-07-09T02:22:40.480105+0000","last_undegraded":"2023-07-09T02:22:40.480105+0000","last_fullsized":"2023-07-09T02:22:40.480105+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:44:10.926277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":290,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485467+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:22:39.485467+0000","last_peered":"2023-07-09T02:22:39.485467+0000","last_clean":"2023-07-09T02:22:39.485467+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:22:39.485467+0000","last_undegraded":"2023-07-09T02:22:39.485467+0000","last_fullsized":"2023-07-09T02:22:39.485467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:01:00.974188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.489261+0000","last_change":"2023-07-09T02:22:39.489111+0000","last_active":"2023-07-09T02:22:39.489261+0000","last_peered":"2023-07-09T02:22:39.489261+0000","last_clean":"2023-07-09T02:22:39.489261+0000","last_became_active":"2023-07-09T02:22:39.488387+0000","last_became_peered":"2023-07-09T02:22:39.488387+0000","last_unstale":"2023-07-09T02:22:39.489261+0000","last_undegraded":"2023-07-09T02:22:39.489261+0000","last_fullsized":"2023-07-09T02:22:39.489261+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:05:44.117292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"181'6","reported_seq":17,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.768662+0000","last_change":"2023-07-09T02:22:38.742865+0000","last_active":"2023-07-09T02:22:39.768662+0000","last_peered":"2023-07-09T02:22:39.768662+0000","last_clean":"2023-07-09T02:22:39.768662+0000","last_became_active":"2023-07-09T02:22:38.742480+0000","last_became_peered":"2023-07-09T02:22:38.742480+0000","last_unstale":"2023-07-09T02:22:39.768662+0000","last_undegraded":"2023-07-09T02:22:39.768662+0000","last_fullsized":"2023-07-09T02:22:39.768662+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:08:12.351497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.483616+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:22:39.483616+0000","last_peered":"2023-07-09T02:22:39.483616+0000","last_clean":"2023-07-09T02:22:39.483616+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:22:39.483616+0000","last_undegraded":"2023-07-09T02:22:39.483616+0000","last_fullsized":"2023-07-09T02:22:39.483616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:41:11.465565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.493387+0000","last_change":"2023-07-09T02:22:39.493159+0000","last_active":"2023-07-09T02:22:39.493387+0000","last_peered":"2023-07-09T02:22:39.493387+0000","last_clean":"2023-07-09T02:22:39.493387+0000","last_became_active":"2023-07-09T02:22:39.492629+0000","last_became_peered":"2023-07-09T02:22:39.492629+0000","last_unstale":"2023-07-09T02:22:39.493387+0000","last_undegraded":"2023-07-09T02:22:39.493387+0000","last_fullsized":"2023-07-09T02:22:39.493387+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:34:28.587161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480264+0000","last_change":"2023-07-09T02:22:38.742354+0000","last_active":"2023-07-09T02:22:39.480264+0000","last_peered":"2023-07-09T02:22:39.480264+0000","last_clean":"2023-07-09T02:22:39.480264+0000","last_became_active":"2023-07-09T02:22:38.742063+0000","last_became_peered":"2023-07-09T02:22:38.742063+0000","last_unstale":"2023-07-09T02:22:39.480264+0000","last_undegraded":"2023-07-09T02:22:39.480264+0000","last_fullsized":"2023-07-09T02:22:39.480264+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:33:01.613166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":334,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481373+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:22:40.481373+0000","last_peered":"2023-07-09T02:22:40.481373+0000","last_clean":"2023-07-09T02:22:40.481373+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:22:40.481373+0000","last_undegraded":"2023-07-09T02:22:40.481373+0000","last_fullsized":"2023-07-09T02:22:40.481373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T14:10:07.443017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.480654+0000","last_change":"2023-07-09T02:22:39.492027+0000","last_active":"2023-07-09T02:22:40.480654+0000","last_peered":"2023-07-09T02:22:40.480654+0000","last_clean":"2023-07-09T02:22:40.480654+0000","last_became_active":"2023-07-09T02:22:39.491741+0000","last_became_peered":"2023-07-09T02:22:39.491741+0000","last_unstale":"2023-07-09T02:22:40.480654+0000","last_undegraded":"2023-07-09T02:22:40.480654+0000","last_fullsized":"2023-07-09T02:22:40.480654+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:11:19.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.481088+0000","last_change":"2023-07-09T02:22:38.731763+0000","last_active":"2023-07-09T02:22:40.481088+0000","last_peered":"2023-07-09T02:22:40.481088+0000","last_clean":"2023-07-09T02:22:40.481088+0000","last_became_active":"2023-07-09T02:22:38.731544+0000","last_became_peered":"2023-07-09T02:22:38.731544+0000","last_unstale":"2023-07-09T02:22:40.481088+0000","last_undegraded":"2023-07-09T02:22:40.481088+0000","last_fullsized":"2023-07-09T02:22:40.481088+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:55:59.449654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":310,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480501+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:22:39.480501+0000","last_peered":"2023-07-09T02:22:39.480501+0000","last_clean":"2023-07-09T02:22:39.480501+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:22:39.480501+0000","last_undegraded":"2023-07-09T02:22:39.480501+0000","last_fullsized":"2023-07-09T02:22:39.480501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:55:28.628554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.486918+0000","last_change":"2023-07-09T02:22:39.486743+0000","last_active":"2023-07-09T02:22:39.486918+0000","last_peered":"2023-07-09T02:22:39.486918+0000","last_clean":"2023-07-09T02:22:39.486918+0000","last_became_active":"2023-07-09T02:22:39.486517+0000","last_became_peered":"2023-07-09T02:22:39.486517+0000","last_unstale":"2023-07-09T02:22:39.486918+0000","last_undegraded":"2023-07-09T02:22:39.486918+0000","last_fullsized":"2023-07-09T02:22:39.486918+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:24:05.317397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"181'8","reported_seq":19,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.767519+0000","last_change":"2023-07-09T02:22:38.732949+0000","last_active":"2023-07-09T02:22:39.767519+0000","last_peered":"2023-07-09T02:22:39.767519+0000","last_clean":"2023-07-09T02:22:39.767519+0000","last_became_active":"2023-07-09T02:22:38.732716+0000","last_became_peered":"2023-07-09T02:22:38.732716+0000","last_unstale":"2023-07-09T02:22:39.767519+0000","last_undegraded":"2023-07-09T02:22:39.767519+0000","last_fullsized":"2023-07-09T02:22:39.767519+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:15:03.572576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":292,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485346+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:22:39.485346+0000","last_peered":"2023-07-09T02:22:39.485346+0000","last_clean":"2023-07-09T02:22:39.485346+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:22:39.485346+0000","last_undegraded":"2023-07-09T02:22:39.485346+0000","last_fullsized":"2023-07-09T02:22:39.485346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:49:49.484566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.487990+0000","last_change":"2023-07-09T02:22:39.487810+0000","last_active":"2023-07-09T02:22:39.487990+0000","last_peered":"2023-07-09T02:22:39.487990+0000","last_clean":"2023-07-09T02:22:39.487990+0000","last_became_active":"2023-07-09T02:22:39.487583+0000","last_became_peered":"2023-07-09T02:22:39.487583+0000","last_unstale":"2023-07-09T02:22:39.487990+0000","last_undegraded":"2023-07-09T02:22:39.487990+0000","last_fullsized":"2023-07-09T02:22:39.487990+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:02:00.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"181'2","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-07-09T02:22:40.479482+0000","last_change":"2023-07-09T02:22:38.733660+0000","last_active":"2023-07-09T02:22:40.479482+0000","last_peered":"2023-07-09T02:22:40.479482+0000","last_clean":"2023-07-09T02:22:40.479482+0000","last_became_active":"2023-07-09T02:22:38.733310+0000","last_became_peered":"2023-07-09T02:22:38.733310+0000","last_unstale":"2023-07-09T02:22:40.479482+0000","last_undegraded":"2023-07-09T02:22:40.479482+0000","last_fullsized":"2023-07-09T02:22:40.479482+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:02:07.345221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":310,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480717+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:22:39.480717+0000","last_peered":"2023-07-09T02:22:39.480717+0000","last_clean":"2023-07-09T02:22:39.480717+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:22:39.480717+0000","last_undegraded":"2023-07-09T02:22:39.480717+0000","last_fullsized":"2023-07-09T02:22:39.480717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:44:32.835498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.488894+0000","last_change":"2023-07-09T02:22:39.488640+0000","last_active":"2023-07-09T02:22:39.488894+0000","last_peered":"2023-07-09T02:22:39.488894+0000","last_clean":"2023-07-09T02:22:39.488894+0000","last_became_active":"2023-07-09T02:22:39.488302+0000","last_became_peered":"2023-07-09T02:22:39.488302+0000","last_unstale":"2023-07-09T02:22:39.488894+0000","last_undegraded":"2023-07-09T02:22:39.488894+0000","last_fullsized":"2023-07-09T02:22:39.488894+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:38.720248+0000","last_clean_scrub_stamp":"2023-07-09T02:22:38.720248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:13:27.272990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.480379+0000","last_change":"2023-07-09T02:22:38.735951+0000","last_active":"2023-07-09T02:22:39.480379+0000","last_peered":"2023-07-09T02:22:39.480379+0000","last_clean":"2023-07-09T02:22:39.480379+0000","last_became_active":"2023-07-09T02:22:38.735698+0000","last_became_peered":"2023-07-09T02:22:38.735698+0000","last_unstale":"2023-07-09T02:22:39.480379+0000","last_undegraded":"2023-07-09T02:22:39.480379+0000","last_fullsized":"2023-07-09T02:22:39.480379+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:22:37.717620+0000","last_clean_scrub_stamp":"2023-07-09T02:22:37.717620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:24:57.571374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":288,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-07-09T02:22:39.485737+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:22:39.485737+0000","last_peered":"2023-07-09T02:22:39.485737+0000","last_clean":"2023-07-09T02:22:39.485737+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:22:39.485737+0000","last_undegraded":"2023-07-09T02:22:39.485737+0000","last_fullsized":"2023-07-09T02:22:39.485737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:54:25.290642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574989,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1632,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193679,"statfs":{"total":200000000,"available":198327871,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.66500000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94499999999999995,"5min":0.97399999999999998,"15min":1.4950000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.623,"5min":0.435,"15min":0.35599999999999998},"max":{"1min":0.95399999999999996,"5min":1.0049999999999999,"15min":1.2110000000000001},"last":0.65000000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54100000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.423},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.70099999999999996,"15min":0.80400000000000005},"min":{"1min":0.55900000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":29.498999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":5.0460000000000003},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.81200000000000006},"min":{"1min":0.61499999999999999,"5min":0.45900000000000002,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":26.524000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.70799999999999996},"min":{"1min":0.54600000000000004,"5min":0.438,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":4.3789999999999996},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":10.609999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.38100000000000001},"max":{"1min":0.873,"5min":0.93799999999999994,"15min":1.032},"last":0.79800000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.92600000000000005,"15min":1.048},"last":0.91700000000000004}]},{"osd":6,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.087},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.81899999999999995,"5min":0.91900000000000004,"15min":1.1639999999999999},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574989,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1056,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194256,"statfs":{"total":200000000,"available":198918239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71199999999999997,"15min":0.68200000000000005},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.58399999999999996,"5min":0.49299999999999999,"15min":0.36199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0269999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.4379999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.036,"15min":1.165},"last":0.72099999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":1.002,"5min":1.01,"15min":1.01},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.66600000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.0740000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48799999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.45},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.70799999999999996},"min":{"1min":0.60799999999999998,"5min":0.498,"15min":0.45700000000000002},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68100000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":1.6499999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.117},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.6060000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65500000000000003,"15min":0.68000000000000005},"min":{"1min":0.48499999999999999,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":0.85599999999999998,"5min":0.94199999999999995,"15min":1.4059999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":1.0289999999999999},"last":0.623}]}]},{"osd":5,"up_from":13,"seq":55834574989,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1056,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194255,"statfs":{"total":200000000,"available":198918115,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.66500000000000004},"min":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.40699999999999997},"max":{"1min":0.90300000000000002,"5min":0.92000000000000004,"15min":1.248},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.32800000000000001},"max":{"1min":0.88200000000000001,"5min":0.95999999999999996,"15min":1.179},"last":0.77800000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69799999999999995,"15min":0.67400000000000004},"min":{"1min":0.55300000000000005,"5min":0.44,"15min":0.39900000000000002},"max":{"1min":0.92700000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.68100000000000005},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.39800000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97299999999999998},"last":0.745}]},{"osd":2,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72499999999999998,"15min":0.70999999999999996},"min":{"1min":0.56100000000000005,"5min":0.47199999999999998,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.96099999999999997,"15min":1.103},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.57199999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":0.95799999999999996,"5min":0.98999999999999999,"15min":5.1989999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.754,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":0.97999999999999998,"15min":0.98399999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58799999999999997},"min":{"1min":0.39100000000000001,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.80200000000000005,"5min":0.86499999999999999,"15min":1.008},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.61299999999999999},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":0.94099999999999995,"15min":1.0720000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.745,"5min":1.042,"15min":1.054},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.46000000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83799999999999997,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.79900000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:22:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.48499999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89600000000000002,"5min":1.0049999999999999,"15min":1.1619999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.50900000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.91600000000000004,"5min":1.0840000000000001,"15min":1.091},"last":0.76100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1057,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194255,"statfs":{"total":200000000,"available":198917475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.86199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.27300000000000002},"max":{"1min":0.89900000000000002,"5min":0.93799999999999994,"15min":50.508000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.51900000000000002,"5min":0.39800000000000002,"15min":0.376},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.874}]},{"osd":1,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69299999999999995,"15min":0.68200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.34100000000000003},"max":{"1min":0.92100000000000004,"5min":1.024,"15min":8.6039999999999992},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.89200000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71999999999999997,"15min":0.68999999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.502,"15min":0.39500000000000002},"max":{"1min":0.89000000000000001,"5min":0.997,"15min":1.323},"last":0.83799999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.71199999999999997},"min":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.97299999999999998},"min":{"1min":0.46400000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96499999999999997,"5min":1.073,"15min":71.909000000000006},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60799999999999998},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.317},"max":{"1min":0.88,"5min":0.88,"15min":1.0169999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80500000000000005,"5min":0.92100000000000004,"15min":0.95399999999999996},"last":0.65100000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59699999999999998,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90900000000000003,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.75700000000000001,"5min":0.94099999999999995,"15min":1.0529999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":0.93100000000000005,"15min":1.0329999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.72099999999999997},"min":{"1min":0.434,"5min":0.40300000000000002,"15min":0.33200000000000002},"max":{"1min":0.90500000000000003,"5min":0.995,"15min":8.0359999999999996},"last":0.60799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1058,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194253,"statfs":{"total":200000000,"available":198916071,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.32900000000000001,"5min":0.217,"15min":0.216},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.96499999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.28499999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.198},"last":0.378}]},{"osd":1,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":1.048},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69899999999999995,"5min":0.76000000000000001,"15min":0.85299999999999998},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":1.155},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":1.1040000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.65200000000000002,"5min":0.502,"15min":0.45300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.466},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.3560000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.61799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.155,"15min":1.3420000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.008,"5min":1.054,"15min":1.2909999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.71199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.4350000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.5569999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0229999999999999,"5min":1.131,"15min":1.367},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.63300000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98399999999999999,"5min":1.0980000000000001,"15min":1.2569999999999999},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574989,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1056,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194256,"statfs":{"total":200000000,"available":198918239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58199999999999996,"5min":0.84299999999999997,"15min":7.7450000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48299999999999998,"15min":0.45100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.255},"max":{"1min":0.75600000000000001,"5min":0.78700000000000003,"15min":1.127},"last":0.443}]},{"osd":1,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.26800000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":2.8879999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58299999999999996,"15min":0.55000000000000004},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38700000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":2.0600000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53700000000000003,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.29999999999999999},"max":{"1min":0.70799999999999996,"5min":0.875,"15min":7.8710000000000004},"last":0.39900000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.0940000000000001,"5min":1.218,"15min":7.7990000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.755},"min":{"1min":0.56299999999999994,"5min":0.53500000000000003,"15min":0.47899999999999998},"max":{"1min":1.034,"5min":1.046,"15min":1.821},"last":0.65100000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.79000000000000004,"15min":0.748},"min":{"1min":0.626,"5min":0.51000000000000001,"15min":0.496},"max":{"1min":1.0920000000000001,"5min":1.103,"15min":1.319},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.52900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.093,"5min":1.093,"15min":7.8369999999999997},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.80900000000000005,"15min":0.78900000000000003},"min":{"1min":0.59799999999999998,"5min":0.53900000000000003,"15min":0.48299999999999998},"max":{"1min":1.087,"5min":1.3029999999999999,"15min":1.9790000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.66800000000000004,"5min":0.56000000000000005,"15min":0.51500000000000001},"max":{"1min":1.145,"5min":1.2749999999999999,"15min":1.452},"last":0.77400000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80300000000000005,"15min":0.75800000000000001},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.51700000000000002},"max":{"1min":1.101,"5min":1.165,"15min":1.9379999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.80500000000000005,"15min":0.78000000000000003},"min":{"1min":0.58099999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.351},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574989,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1057,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194254,"statfs":{"total":200000000,"available":198916675,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.436,"15min":0.44500000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.64000000000000001,"15min":0.80300000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.86899999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":1.1080000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85099999999999998},"last":0.626},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.163},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78500000000000003,"15min":0.76500000000000001},"min":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.93500000000000005}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76400000000000001,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.1599999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.75900000000000001,"15min":0.74399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0840000000000001,"5min":1.131,"15min":1.131},"last":0.90800000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82599999999999996,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.123,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.94799999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79500000000000004,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.57599999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1699999999999999,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.82899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1633,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193679,"statfs":{"total":200000000,"available":198327767,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.22700000000000001},"max":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.94999999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53500000000000003,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.3240000000000001},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.29899999999999999},"max":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.78300000000000003,"15min":1.4139999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74099999999999999,"5min":0.754,"15min":1.0189999999999999},"last":0.375},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.53600000000000003},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80200000000000005,"5min":0.879,"15min":3.8929999999999998},"last":0.53600000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80800000000000005,"15min":0.77600000000000002},"min":{"1min":0.65700000000000003,"5min":0.47299999999999998,"15min":0.46600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.63300000000000001,"5min":0.54400000000000004,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.1240000000000001,"15min":1.153},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.79800000000000004},"min":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.1040000000000001,"15min":1.4350000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.79600000000000004},"min":{"1min":0.63800000000000001,"5min":0.51000000000000001,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.238},"last":0.76000000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.47799999999999998},"max":{"1min":1.0529999999999999,"5min":1.117,"15min":1.117},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.46899999999999997},"max":{"1min":1.034,"5min":1.1200000000000001,"15min":1.7789999999999999},"last":0.72399999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.49099999999999999},"max":{"1min":1.034,"5min":1.079,"15min":1.8149999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78000000000000003,"15min":0.749},"min":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.1060000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.67500000000000004}]}]}],"pool_statfs":[]}} 2023-07-09T02:22:44.251 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T02:22:44.251 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T02:22:44.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.440+0000 7fb5796cb640 1 Processor -- start 2023-07-09T02:22:44.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.440+0000 7fb5796cb640 1 -- start start 2023-07-09T02:22:44.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb5796cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5741608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb5796cb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5740ced10 con 0x7fb5740b59b0 2023-07-09T02:22:44.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb5796cb640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57415c7e0 con 0x7fb5740b4cf0 2023-07-09T02:22:44.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb5796cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740cd1b0 con 0x7fb57415c410 2023-07-09T02:22:44.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb56bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb5740b59b0 0x7fb5740b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38352/0 (socket says 172.21.15.45:38352) 2023-07-09T02:22:44.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb56bfff640 1 -- 172.21.15.45:0/2305937734 learned_addr learned my addr 172.21.15.45:0/2305937734 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:44.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb572ffd640 1 --2- 172.21.15.45:0/2305937734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5741608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb5727fc640 1 -- 172.21.15.45:0/2305937734 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737098797 0 0) 0x7fb5740ced10 con 0x7fb5740b59b0 2023-07-09T02:22:44.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb5727fc640 1 -- 172.21.15.45:0/2305937734 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb560003530 con 0x7fb5740b59b0 2023-07-09T02:22:44.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb5727fc640 1 -- 172.21.15.45:0/2305937734 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261703796 0 0) 0x7fb57415c7e0 con 0x7fb5740b4cf0 2023-07-09T02:22:44.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb5727fc640 1 -- 172.21.15.45:0/2305937734 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5740ced10 con 0x7fb5740b4cf0 2023-07-09T02:22:44.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb572ffd640 1 -- 172.21.15.45:0/2305937734 >> v1:172.21.15.155:6789/0 conn(0x7fb5740b4cf0 legacy=0x7fb5740d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb572ffd640 1 -- 172.21.15.45:0/2305937734 >> v1:172.21.15.45:6789/0 conn(0x7fb5740b59b0 legacy=0x7fb5740b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.444+0000 7fb572ffd640 1 -- 172.21.15.45:0/2305937734 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574160de0 con 0x7fb57415c410 2023-07-09T02:22:44.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb572ffd640 1 --2- 172.21.15.45:0/2305937734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5741608a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb5640097f0 tx=0x7fb56401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1902dd47b23afd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5727fc640 1 -- 172.21.15.45:0/2305937734 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640ab660 con 0x7fb57415c410 2023-07-09T02:22:44.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5727fc640 1 -- 172.21.15.45:0/2305937734 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5640ab7c0 con 0x7fb57415c410 2023-07-09T02:22:44.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5727fc640 1 -- 172.21.15.45:0/2305937734 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640abb30 con 0x7fb57415c410 2023-07-09T02:22:44.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- 172.21.15.45:0/2305937734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 msgr2=0x7fb5741608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 --2- 172.21.15.45:0/2305937734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5741608a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb5640097f0 tx=0x7fb56401c490 comp rx=0 tx=0).stop 2023-07-09T02:22:44.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- 172.21.15.45:0/2305937734 shutdown_connections 2023-07-09T02:22:44.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 --2- 172.21.15.45:0/2305937734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5741608a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- 172.21.15.45:0/2305937734 >> 172.21.15.45:0/2305937734 conn(0x7fb57406a590 msgr2=0x7fb5740cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:44.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- 172.21.15.45:0/2305937734 shutdown_connections 2023-07-09T02:22:44.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- 172.21.15.45:0/2305937734 wait complete. 2023-07-09T02:22:44.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 Processor -- start 2023-07-09T02:22:44.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- start start 2023-07-09T02:22:44.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5740b4cf0 0x7fb57414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5740b59b0 0x7fb5740c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5740bf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740bfac0 con 0x7fb5740b59b0 2023-07-09T02:22:44.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5741479b0 con 0x7fb5740b4cf0 2023-07-09T02:22:44.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.448+0000 7fb5796cb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740c2330 con 0x7fb57415c410 2023-07-09T02:22:44.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5740b59b0 0x7fb5740c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5740b59b0 0x7fb5740c1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46396/0 (socket says 172.21.15.45:46396) 2023-07-09T02:22:44.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 -- 172.21.15.45:0/2419516138 learned_addr learned my addr 172.21.15.45:0/2419516138 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:44.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb5737fe640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5740bf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb572ffd640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5740b4cf0 0x7fb57414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 -- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 msgr2=0x7fb5740bf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5740bf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 -- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5740b4cf0 msgr2=0x7fb57414b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5740b4cf0 0x7fb57414b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 -- 172.21.15.45:0/2419516138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564009420 con 0x7fb5740b59b0 2023-07-09T02:22:44.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb572ffd640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5740b4cf0 0x7fb57414b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:44.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56bfff640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5740b59b0 0x7fb5740c1b00 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c420 tx=0x7fb55c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56b7fe640 1 -- 172.21.15.45:0/2419516138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c005cf0 con 0x7fb5740b59b0 2023-07-09T02:22:44.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56b7fe640 1 -- 172.21.15.45:0/2419516138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c005e50 con 0x7fb5740b59b0 2023-07-09T02:22:44.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5740c2610 con 0x7fb5740b59b0 2023-07-09T02:22:44.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56b7fe640 1 -- 172.21.15.45:0/2419516138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0072d0 con 0x7fb5740b59b0 2023-07-09T02:22:44.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5740bfcd0 con 0x7fb5740b59b0 2023-07-09T02:22:44.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5740bfef0 con 0x7fb5740b59b0 2023-07-09T02:22:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.452+0000 7fb56b7fe640 1 -- 172.21.15.45:0/2419516138 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb55c007430 con 0x7fb5740b59b0 2023-07-09T02:22:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.456+0000 7fb56b7fe640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5540662b0 0x7fb554068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.456+0000 7fb56b7fe640 1 -- 172.21.15.45:0/2419516138 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb55c0832b0 con 0x7fb5740b59b0 2023-07-09T02:22:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.456+0000 7fb572ffd640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5540662b0 0x7fb554068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.456+0000 7fb572ffd640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5540662b0 0x7fb554068760 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb5640af000 tx=0x7fb5640b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.460+0000 7fb56b7fe640 1 -- 172.21.15.45:0/2419516138 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb55c0506b0 con 0x7fb5740b59b0 2023-07-09T02:22:44.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.676+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb57404d7d0 con 0x7fb5740b59b0 2023-07-09T02:22:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.680+0000 7fb56b7fe640 1 -- 172.21.15.45:0/2419516138 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb55c0170e0 con 0x7fb5740b59b0 2023-07-09T02:22:44.682 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-07-09T02:22:44.682 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAqF6pk2Y5ZKBAAt+cvqNm605pMFl7i4VLFcg== 2023-07-09T02:22:44.682 INFO:teuthology.orchestra.run.smithi045.stdout: caps mds = "allow" 2023-07-09T02:22:44.682 INFO:teuthology.orchestra.run.smithi045.stdout: caps mon = "allow r" 2023-07-09T02:22:44.683 INFO:teuthology.orchestra.run.smithi045.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T02:22:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-07-09T02:22:44.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5540662b0 msgr2=0x7fb554068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5540662b0 0x7fb554068760 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb5640af000 tx=0x7fb5640b6040 comp rx=0 tx=0).stop 2023-07-09T02:22:44.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5740b59b0 msgr2=0x7fb5740c1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5740b59b0 0x7fb5740c1b00 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c420 tx=0x7fb55c00c8e0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 shutdown_connections 2023-07-09T02:22:44.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb5540662b0 0x7fb554068760 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb57415c410 0x7fb5740bf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5740b59b0 0x7fb5740c1b00 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 --2- 172.21.15.45:0/2419516138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5740b4cf0 0x7fb57414b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 >> 172.21.15.45:0/2419516138 conn(0x7fb57406a590 msgr2=0x7fb5740b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 shutdown_connections 2023-07-09T02:22:44.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.684+0000 7fb5796cb640 1 -- 172.21.15.45:0/2419516138 wait complete. 2023-07-09T02:22:44.701 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-07-09T02:22:44.700+0000 7fdcfac74640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:22:44.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:44.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.844+0000 7f1d68c0b640 1 Processor -- start 2023-07-09T02:22:44.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.844+0000 7f1d68c0b640 1 -- start start 2023-07-09T02:22:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d68c0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d64158e30 0x7f1d6406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d68c0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1d6406fd10 0x7f1d6406c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d68c0b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640ccf80 con 0x7f1d6406c650 2023-07-09T02:22:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d68c0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640cd540 con 0x7f1d64158e30 2023-07-09T02:22:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d68c0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6406ca90 con 0x7f1d6406fd10 2023-07-09T02:22:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d6259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d64158e30 0x7f1d6406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d6259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d64158e30 0x7f1d6406f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46412/0 (socket says 172.21.15.45:46412) 2023-07-09T02:22:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d6259c640 1 -- 172.21.15.45:0/3869226621 learned_addr learned my addr 172.21.15.45:0/3869226621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d5bfff640 1 --2- 172.21.15.45:0/3869226621 >> v2:172.21.15.155:3300/0 conn(0x7f1d6406fd10 0x7f1d6406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d6259c640 1 -- 172.21.15.45:0/3869226621 >> v2:172.21.15.155:3300/0 conn(0x7f1d6406fd10 msgr2=0x7f1d6406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:44.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d6259c640 1 --2- 172.21.15.45:0/3869226621 >> v2:172.21.15.155:3300/0 conn(0x7f1d6406fd10 0x7f1d6406c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d6259c640 1 -- 172.21.15.45:0/3869226621 >> v1:172.21.15.155:6789/0 conn(0x7f1d6406c650 legacy=0x7f1d640caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:44.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.848+0000 7f1d6259c640 1 -- 172.21.15.45:0/3869226621 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640c8fb0 con 0x7f1d64158e30 2023-07-09T02:22:44.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d6259c640 1 --2- 172.21.15.45:0/3869226621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d64158e30 0x7f1d6406f7d0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f1d6406f260 tx=0x7f1d5401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d2aeb808526817 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d61d9b640 1 -- 172.21.15.45:0/3869226621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540ab600 con 0x7f1d64158e30 2023-07-09T02:22:44.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d61d9b640 1 -- 172.21.15.45:0/3869226621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d540ab760 con 0x7f1d64158e30 2023-07-09T02:22:44.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d61d9b640 1 -- 172.21.15.45:0/3869226621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540abaf0 con 0x7f1d64158e30 2023-07-09T02:22:44.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 -- 172.21.15.45:0/3869226621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d64158e30 msgr2=0x7f1d6406f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/3869226621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d64158e30 0x7f1d6406f7d0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f1d6406f260 tx=0x7f1d5401c400 comp rx=0 tx=0).stop 2023-07-09T02:22:44.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 -- 172.21.15.45:0/3869226621 shutdown_connections 2023-07-09T02:22:44.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/3869226621 >> v2:172.21.15.155:3300/0 conn(0x7f1d6406fd10 0x7f1d6406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/3869226621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d64158e30 0x7f1d6406f7d0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 -- 172.21.15.45:0/3869226621 >> 172.21.15.45:0/3869226621 conn(0x7f1d640694b0 msgr2=0x7f1d640698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 -- 172.21.15.45:0/3869226621 shutdown_connections 2023-07-09T02:22:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 -- 172.21.15.45:0/3869226621 wait complete. 2023-07-09T02:22:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 Processor -- start 2023-07-09T02:22:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.852+0000 7f1d68c0b640 1 -- start start 2023-07-09T02:22:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6406c650 0x7f1d640c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d6406fd10 0x7f1d6415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d64158e30 0x7f1d64147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640c6dc0 con 0x7f1d6406c650 2023-07-09T02:22:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415aa30 con 0x7f1d64158e30 2023-07-09T02:22:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d641479c0 con 0x7f1d6406fd10 2023-07-09T02:22:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6406c650 0x7f1d640c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6406c650 0x7f1d640c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46416/0 (socket says 172.21.15.45:46416) 2023-07-09T02:22:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 -- 172.21.15.45:0/2780231492 learned_addr learned my addr 172.21.15.45:0/2780231492 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d5bfff640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d6406fd10 0x7f1d6415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d62d9d640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d64158e30 0x7f1d64147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 -- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d6406fd10 msgr2=0x7f1d6415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d6406fd10 0x7f1d6415a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 -- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d64158e30 msgr2=0x7f1d64147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d64158e30 0x7f1d64147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 -- 172.21.15.45:0/2780231492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540094d0 con 0x7f1d6406c650 2023-07-09T02:22:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d6259c640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6406c650 0x7f1d640c6880 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f1d5401a030 tx=0x7f1d5401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d5affd640 1 -- 172.21.15.45:0/2780231492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540b4800 con 0x7f1d6406c650 2023-07-09T02:22:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d5affd640 1 -- 172.21.15.45:0/2780231492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d540b4980 con 0x7f1d6406c650 2023-07-09T02:22:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d640c6fd0 con 0x7f1d6406c650 2023-07-09T02:22:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d5affd640 1 -- 172.21.15.45:0/2780231492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540b4d30 con 0x7f1d6406c650 2023-07-09T02:22:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d640c7590 con 0x7f1d6406c650 2023-07-09T02:22:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.856+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6404d7d0 con 0x7f1d6406c650 2023-07-09T02:22:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.860+0000 7f1d5affd640 1 -- 172.21.15.45:0/2780231492 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d540c7390 con 0x7f1d6406c650 2023-07-09T02:22:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.860+0000 7f1d5affd640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d44066280 0x7f1d44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.860+0000 7f1d5affd640 1 -- 172.21.15.45:0/2780231492 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d5411e6e0 con 0x7f1d6406c650 2023-07-09T02:22:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.860+0000 7f1d5bfff640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d44066280 0x7f1d44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.860+0000 7f1d5bfff640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d44066280 0x7f1d44068730 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1d64151cf0 tx=0x7f1d4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:44.864+0000 7f1d5affd640 1 -- 172.21.15.45:0/2780231492 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d540ebbd0 con 0x7f1d6406c650 2023-07-09T02:22:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d64069ea0 con 0x7f1d6406c650 2023-07-09T02:22:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d5affd640 1 -- 172.21.15.45:0/2780231492 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f1d540ef1f0 con 0x7f1d6406c650 2023-07-09T02:22:45.053 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:45.054 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:22:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:22:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d44066280 msgr2=0x7f1d44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d44066280 0x7f1d44068730 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1d64151cf0 tx=0x7f1d4c008040 comp rx=0 tx=0).stop 2023-07-09T02:22:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6406c650 msgr2=0x7f1d640c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6406c650 0x7f1d640c6880 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f1d5401a030 tx=0x7f1d5401ac40 comp rx=0 tx=0).stop 2023-07-09T02:22:45.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 shutdown_connections 2023-07-09T02:22:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d64158e30 0x7f1d64147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1d44066280 0x7f1d44068730 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d6406fd10 0x7f1d6415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 --2- 172.21.15.45:0/2780231492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6406c650 0x7f1d640c6880 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.052+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 >> 172.21.15.45:0/2780231492 conn(0x7f1d640694b0 msgr2=0x7f1d640c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.056+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 shutdown_connections 2023-07-09T02:22:45.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.056+0000 7f1d68c0b640 1 -- 172.21.15.45:0/2780231492 wait complete. 2023-07-09T02:22:45.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T02:22:39.125328+0000', 'modified': '2023-07-09T02:22:42.771279+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9105}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9105': {'gid': 9105, 'name': 'a', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/1522094826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 1522094826}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1522094826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T02:22:45.476 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T02:22:45.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-09T02:22:45.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9f5d5640 1 Processor -- start 2023-07-09T02:22:45.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9f5d5640 1 -- start start 2023-07-09T02:22:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9f5d5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3c981604a0 0x7f3c98164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9f5d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c980c8dc0 0x7f3c980cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9f5d5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c980cde40 0x7f3c980cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9f5d5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9806be90 con 0x7f3c980cde40 2023-07-09T02:22:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9f5d5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9806b000 con 0x7f3c981604a0 2023-07-09T02:22:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9f5d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980ce2c0 con 0x7f3c980c8dc0 2023-07-09T02:22:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9db72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c980cde40 0x7f3c980cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9db72640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c980cde40 0x7f3c980cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46428/0 (socket says 172.21.15.45:46428) 2023-07-09T02:22:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9db72640 1 -- 172.21.15.45:0/634238587 learned_addr learned my addr 172.21.15.45:0/634238587 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9d371640 1 --2- 172.21.15.45:0/634238587 >> v2:172.21.15.155:3300/0 conn(0x7f3c981604a0 0x7f3c98164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/634238587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c980c8dc0 0x7f3c980cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9db72640 1 -- 172.21.15.45:0/634238587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c980c8dc0 msgr2=0x7f3c980cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9db72640 1 --2- 172.21.15.45:0/634238587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c980c8dc0 0x7f3c980cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9db72640 1 -- 172.21.15.45:0/634238587 >> v2:172.21.15.155:3300/0 conn(0x7f3c981604a0 msgr2=0x7f3c98164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9db72640 1 --2- 172.21.15.45:0/634238587 >> v2:172.21.15.155:3300/0 conn(0x7f3c981604a0 0x7f3c98164b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.624+0000 7f3c9db72640 1 -- 172.21.15.45:0/634238587 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9806ef30 con 0x7f3c980cde40 2023-07-09T02:22:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9db72640 1 --2- 172.21.15.45:0/634238587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c980cc290 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f3c9806d440 tx=0x7f3c9001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6347b40663dac9d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c8ffff640 1 -- 172.21.15.45:0/634238587 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c900a5590 con 0x7f3c980cde40 2023-07-09T02:22:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c8ffff640 1 -- 172.21.15.45:0/634238587 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c900a56f0 con 0x7f3c980cde40 2023-07-09T02:22:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c8ffff640 1 -- 172.21.15.45:0/634238587 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c900a5a80 con 0x7f3c980cde40 2023-07-09T02:22:45.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/634238587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 msgr2=0x7f3c980cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/634238587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c980cc290 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f3c9806d440 tx=0x7f3c9001c710 comp rx=0 tx=0).stop 2023-07-09T02:22:45.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/634238587 shutdown_connections 2023-07-09T02:22:45.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/634238587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c980cc290 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/634238587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c980c8dc0 0x7f3c980cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/634238587 >> v2:172.21.15.155:3300/0 conn(0x7f3c981604a0 0x7f3c98164b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/634238587 >> 172.21.15.45:0/634238587 conn(0x7f3c980694b0 msgr2=0x7f3c980698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/634238587 shutdown_connections 2023-07-09T02:22:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.628+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/634238587 wait complete. 2023-07-09T02:22:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 Processor -- start 2023-07-09T02:22:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 -- start start 2023-07-09T02:22:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c980c8dc0 0x7f3c98151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c9814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c981604a0 0x7f3c9814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9814cf80 con 0x7f3c980cde40 2023-07-09T02:22:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c98153fb0 con 0x7f3c980c8dc0 2023-07-09T02:22:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c98154290 con 0x7f3c981604a0 2023-07-09T02:22:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c9814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c9814c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46432/0 (socket says 172.21.15.45:46432) 2023-07-09T02:22:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 -- 172.21.15.45:0/2363587079 learned_addr learned my addr 172.21.15.45:0/2363587079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9d371640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c980c8dc0 0x7f3c98151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9db72640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c981604a0 0x7f3c9814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 -- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c981604a0 msgr2=0x7f3c9814ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c981604a0 0x7f3c9814ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 -- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c980c8dc0 msgr2=0x7f3c98151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c980c8dc0 0x7f3c98151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 -- 172.21.15.45:0/2363587079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c90009b30 con 0x7f3c980cde40 2023-07-09T02:22:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9d371640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c980c8dc0 0x7f3c98151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c9814c500 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800e930 tx=0x7f3c8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c8dffb640 1 -- 172.21.15.45:0/2363587079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88009690 con 0x7f3c980cde40 2023-07-09T02:22:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c8dffb640 1 -- 172.21.15.45:0/2363587079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8800ca00 con 0x7f3c980cde40 2023-07-09T02:22:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/2363587079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c98154570 con 0x7f3c980cde40 2023-07-09T02:22:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c8dffb640 1 -- 172.21.15.45:0/2363587079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8800cd70 con 0x7f3c980cde40 2023-07-09T02:22:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.632+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/2363587079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c98152260 con 0x7f3c980cde40 2023-07-09T02:22:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c8dffb640 1 -- 172.21.15.45:0/2363587079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c88013470 con 0x7f3c980cde40 2023-07-09T02:22:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c8dffb640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3c7c066280 0x7f3c7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c8dffb640 1 -- 172.21.15.45:0/2363587079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c88083f50 con 0x7f3c980cde40 2023-07-09T02:22:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c9d371640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3c7c066280 0x7f3c7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3ca2949000 1 Processor -- start 2023-07-09T02:22:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3ca2949000 1 -- start start 2023-07-09T02:22:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c9d371640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3c7c066280 0x7f3c7c068730 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3c981556b0 tx=0x7f3c94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd8a1110 0x55dafd856a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd856f90 0x55dafd857360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3ca2949000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafd71df80 con 0x55dafd8a0800 2023-07-09T02:22:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3ca2949000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafd657c60 con 0x55dafd856f90 2023-07-09T02:22:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3ca2949000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dafd6ab700 con 0x55dafd8a1110 2023-07-09T02:22:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c9d371640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c9d371640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46438/0 (socket says 172.21.15.45:46438) 2023-07-09T02:22:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c9d371640 1 -- 172.21.15.45:0/3030436668 learned_addr learned my addr 172.21.15.45:0/3030436668 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:45.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c9db72640 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd856f90 0x55dafd857360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.636+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd8a1110 0x55dafd856a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9d371640 1 -- 172.21.15.45:0/3030436668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd8a1110 msgr2=0x55dafd856a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9d371640 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd8a1110 0x55dafd856a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9d371640 1 -- 172.21.15.45:0/3030436668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd856f90 msgr2=0x55dafd857360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9d371640 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd856f90 0x55dafd857360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9d371640 1 -- 172.21.15.45:0/3030436668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dafd3a0890 con 0x55dafd8a0800 2023-07-09T02:22:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9d371640 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8a0bd0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f3c94011d20 tx=0x7f3c94014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1870491585db7b6f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c82ffd640 1 -- 172.21.15.45:0/3030436668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94011d50 con 0x55dafd8a0800 2023-07-09T02:22:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c82ffd640 1 -- 172.21.15.45:0/3030436668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94011eb0 con 0x55dafd8a0800 2023-07-09T02:22:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c82ffd640 1 -- 172.21.15.45:0/3030436668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94021640 con 0x55dafd8a0800 2023-07-09T02:22:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- 172.21.15.45:0/3030436668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 msgr2=0x55dafd8a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8a0bd0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f3c94011d20 tx=0x7f3c94014000 comp rx=0 tx=0).stop 2023-07-09T02:22:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- 172.21.15.45:0/3030436668 shutdown_connections 2023-07-09T02:22:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd856f90 0x55dafd857360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd8a1110 0x55dafd856a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3030436668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8a0bd0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- 172.21.15.45:0/3030436668 >> 172.21.15.45:0/3030436668 conn(0x55dafd719a70 msgr2=0x55dafd855330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- 172.21.15.45:0/3030436668 shutdown_connections 2023-07-09T02:22:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- 172.21.15.45:0/3030436668 wait complete. 2023-07-09T02:22:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- start start 2023-07-09T02:22:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 Processor -- start 2023-07-09T02:22:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd861fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd862510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd862a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafd6a47a0 con 0x55dafd8a0800 2023-07-09T02:22:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafd660f00 con 0x55dafd8a1110 2023-07-09T02:22:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dafd660ba0 con 0x55dafd856f90 2023-07-09T02:22:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3ca2949000 10 client.0 _ll_register_callbacks cb 0x55dafd842930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:22:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9cb70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd862510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9cb70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd862510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46446/0 (socket says 172.21.15.45:46446) 2023-07-09T02:22:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9cb70640 1 -- 172.21.15.45:0/3222860000 learned_addr learned my addr 172.21.15.45:0/3222860000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9d371640 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd861fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9db72640 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd862a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9cb70640 1 -- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 msgr2=0x55dafd861fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd861fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9cb70640 1 -- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 msgr2=0x55dafd862a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd862a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9cb70640 1 -- 172.21.15.45:0/3222860000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c94011a00 con 0x55dafd8a0800 2023-07-09T02:22:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.640+0000 7f3c9db72640 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd862a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd862510 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3c880516f0 tx=0x7f3c8805d5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c23d1a4b6a2c9af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:22:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 1 -- 172.21.15.45:0/3222860000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88054350 con 0x55dafd8a0800 2023-07-09T02:22:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 -- 172.21.15.45:0/3222860000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dafd6a30f0 con 0x55dafd8a0800 2023-07-09T02:22:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 1 -- 172.21.15.45:0/3222860000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c88051330 con 0x55dafd8a0800 2023-07-09T02:22:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 1 -- 172.21.15.45:0/3222860000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c880544b0 con 0x55dafd8a0800 2023-07-09T02:22:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 10 client.9237 fetch_fsmap learned FSMap version 91 2023-07-09T02:22:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 -- 172.21.15.45:0/3222860000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55dafd669130 con 0x55dafd8a0800 2023-07-09T02:22:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 1 -- 172.21.15.45:0/3222860000 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dafd6a30f0 con 0x55dafd8a0800 2023-07-09T02:22:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 1 -- 172.21.15.45:0/3222860000 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3c88011070 con 0x55dafd8a0800 2023-07-09T02:22:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 10 client.9237 fetch_fsmap finished waiting for FSMap version 91 2023-07-09T02:22:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 10 client.9237 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T02:22:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 20 client.9237 populate_metadata read hostname 'smithi045' 2023-07-09T02:22:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] conn(0x55dafd863320 0x55dafd8b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 4 client.9237 mds_command: new command op to 9105 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T02:22:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 -- 172.21.15.45:0/3222860000 --> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dafd66be40 con 0x55dafd863320 2023-07-09T02:22:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c9d371640 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] conn(0x55dafd863320 0x55dafd8b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 10 client.9237 ms_handle_connect on v2:172.21.15.45:6833/1522094826 2023-07-09T02:22:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c9d371640 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] conn(0x55dafd863320 0x55dafd8b1d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59d3b432cc69927b server_cookie=ab8e4f08e99730c4 in_seq=0 out_seq=0 2023-07-09T02:22:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 1 -- 172.21.15.45:0/3222860000 <== mds.0 v2:172.21.15.45:6833/1522094826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dafd66be40 con 0x55dafd863320 2023-07-09T02:22:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 10 client.9237 handle_command_reply: tid=0 2023-07-09T02:22:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 client.9237 shutdown 2023-07-09T02:22:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 -- 172.21.15.45:0/3222860000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 msgr2=0x55dafd862510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd862510 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3c880516f0 tx=0x7f3c8805d5d0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 -- 172.21.15.45:0/3222860000 shutdown_connections 2023-07-09T02:22:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] conn(0x55dafd863320 0x55dafd8b1d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd862a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd862510 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 --2- 172.21.15.45:0/3222860000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd861fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3c77fff640 0 client.9237 ms_handle_reset on v2:172.21.15.45:6833/1522094826 2023-07-09T02:22:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 -- 172.21.15.45:0/3222860000 >> 172.21.15.45:0/3222860000 conn(0x55dafd719a70 msgr2=0x55dafd855a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 -- 172.21.15.45:0/3222860000 shutdown_connections 2023-07-09T02:22:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 1 -- 172.21.15.45:0/3222860000 wait complete. 2023-07-09T02:22:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.644+0000 7f3ca2949000 20 client.9237 trim_cache size 0 max 16384 2023-07-09T02:22:45.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.660+0000 7f3ca2949000 1 Processor -- start 2023-07-09T02:22:45.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.660+0000 7f3ca2949000 1 -- start start 2023-07-09T02:22:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.660+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.660+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a0800 0x55dafd8b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.660+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a1110 0x55dafd89b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.660+0000 7f3ca2949000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafd361940 con 0x55dafd8a1110 2023-07-09T02:22:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.660+0000 7f3ca2949000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafd6e7c80 con 0x55dafd8a0800 2023-07-09T02:22:45.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.660+0000 7f3ca2949000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dafd673230 con 0x55dafd856f90 2023-07-09T02:22:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9db72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a1110 0x55dafd89b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.45:60948/0 (socket says 172.21.15.45:60948) 2023-07-09T02:22:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9db72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a1110 0x55dafd89b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46454/0 (socket says 172.21.15.45:46454) 2023-07-09T02:22:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9cb70640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a0800 0x55dafd8b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 -- 172.21.15.45:0/382840819 learned_addr learned my addr 172.21.15.45:0/382840819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 -- 172.21.15.45:0/382840819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a0800 msgr2=0x55dafd8b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 --2- 172.21.15.45:0/382840819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a0800 0x55dafd8b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 -- 172.21.15.45:0/382840819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a1110 msgr2=0x55dafd89b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 --2- 172.21.15.45:0/382840819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a1110 0x55dafd89b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 -- 172.21.15.45:0/382840819 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dafd64f3c0 con 0x55dafd856f90 2023-07-09T02:22:45.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9db72640 1 --2- 172.21.15.45:0/382840819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a1110 0x55dafd89b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:22:45.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c9d371640 1 --2- 172.21.15.45:0/382840819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8b3470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c94008010 tx=0x7f3c94016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13db99f19d416a54 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c837fe640 1 -- 172.21.15.45:0/382840819 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94030040 con 0x55dafd856f90 2023-07-09T02:22:45.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c837fe640 1 -- 172.21.15.45:0/382840819 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94032040 con 0x55dafd856f90 2023-07-09T02:22:45.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3c837fe640 1 -- 172.21.15.45:0/382840819 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94009280 con 0x55dafd856f90 2023-07-09T02:22:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 -- 172.21.15.45:0/382840819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 msgr2=0x55dafd8b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 --2- 172.21.15.45:0/382840819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8b3470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c94008010 tx=0x7f3c94016000 comp rx=0 tx=0).stop 2023-07-09T02:22:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 -- 172.21.15.45:0/382840819 shutdown_connections 2023-07-09T02:22:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 --2- 172.21.15.45:0/382840819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a1110 0x55dafd89b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 --2- 172.21.15.45:0/382840819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a0800 0x55dafd8b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 --2- 172.21.15.45:0/382840819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8b3470 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 -- 172.21.15.45:0/382840819 >> 172.21.15.45:0/382840819 conn(0x55dafd719a70 msgr2=0x55dafd8b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 -- 172.21.15.45:0/382840819 shutdown_connections 2023-07-09T02:22:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 -- 172.21.15.45:0/382840819 wait complete. 2023-07-09T02:22:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 -- start start 2023-07-09T02:22:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 Processor -- start 2023-07-09T02:22:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.664+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8fe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd89e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafd6ac990 con 0x55dafd8a0800 2023-07-09T02:22:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafd6a3290 con 0x55dafd8a1110 2023-07-09T02:22:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dafd69eaa0 con 0x55dafd856f90 2023-07-09T02:22:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 10 client.0 _ll_register_callbacks cb 0x55dafd8234d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T02:22:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8fe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8fe400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46460/0 (socket says 172.21.15.45:46460) 2023-07-09T02:22:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 -- 172.21.15.45:0/1742534565 learned_addr learned my addr 172.21.15.45:0/1742534565 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9d371640 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9db72640 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd89e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 -- 172.21.15.45:0/1742534565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 msgr2=0x55dafd8fdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8fdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 -- 172.21.15.45:0/1742534565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 msgr2=0x55dafd89e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd89e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 -- 172.21.15.45:0/1742534565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9806ef30 con 0x55dafd8a0800 2023-07-09T02:22:45.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9cb70640 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8fe400 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3c88051c10 tx=0x7f3c88058070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b135ea8bd0b3bdf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-07-09T02:22:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 1 -- 172.21.15.45:0/1742534565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88054fc0 con 0x55dafd8a0800 2023-07-09T02:22:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 1 -- 172.21.15.45:0/1742534565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c88051330 con 0x55dafd8a0800 2023-07-09T02:22:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- 172.21.15.45:0/1742534565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dafd85a920 con 0x55dafd8a0800 2023-07-09T02:22:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 1 -- 172.21.15.45:0/1742534565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c8805d490 con 0x55dafd8a0800 2023-07-09T02:22:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 10 client.9243 fetch_fsmap learned FSMap version 91 2023-07-09T02:22:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- 172.21.15.45:0/1742534565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55dafd3a0890 con 0x55dafd8a0800 2023-07-09T02:22:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 1 -- 172.21.15.45:0/1742534565 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dafd85a920 con 0x55dafd8a0800 2023-07-09T02:22:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 1 -- 172.21.15.45:0/1742534565 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3c8807b070 con 0x55dafd8a0800 2023-07-09T02:22:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 10 client.9243 fetch_fsmap finished waiting for FSMap version 91 2023-07-09T02:22:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 10 client.9243 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T02:22:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 20 client.9243 populate_metadata read hostname 'smithi045' 2023-07-09T02:22:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] conn(0x55dafd89ef30 0x55dafd89f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 4 client.9243 mds_command: new command op to 9105 tid=0[{"prefix": "status"}] 2023-07-09T02:22:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- 172.21.15.45:0/1742534565 --> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dafd65d6f0 con 0x55dafd89ef30 2023-07-09T02:22:45.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9d371640 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] conn(0x55dafd89ef30 0x55dafd89f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 10 client.9243 ms_handle_connect on v2:172.21.15.45:6833/1522094826 2023-07-09T02:22:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c9d371640 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] conn(0x55dafd89ef30 0x55dafd89f300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cad72f48bf8c46e server_cookie=913f07aa3d26d751 in_seq=0 out_seq=0 2023-07-09T02:22:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 1 -- 172.21.15.45:0/1742534565 <== mds.0 v2:172.21.15.45:6833/1522094826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55dafd65d6f0 con 0x55dafd89ef30 2023-07-09T02:22:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 10 client.9243 handle_command_reply: tid=0 2023-07-09T02:22:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 client.9243 shutdown 2023-07-09T02:22:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- 172.21.15.45:0/1742534565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 msgr2=0x55dafd8fe400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8fe400 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3c88051c10 tx=0x7f3c88058070 comp rx=0 tx=0).stop 2023-07-09T02:22:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- 172.21.15.45:0/1742534565 shutdown_connections 2023-07-09T02:22:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.45:6833/1522094826,v1:172.21.15.45:6835/1522094826] conn(0x55dafd89ef30 0x55dafd89f300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dafd8a1110 0x55dafd89e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dafd8a0800 0x55dafd8fe400 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3c77fff640 0 client.9243 ms_handle_reset on v2:172.21.15.45:6833/1522094826 2023-07-09T02:22:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 --2- 172.21.15.45:0/1742534565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55dafd856f90 0x55dafd8fdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- 172.21.15.45:0/1742534565 >> 172.21.15.45:0/1742534565 conn(0x55dafd719a70 msgr2=0x55dafd8b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- 172.21.15.45:0/1742534565 shutdown_connections 2023-07-09T02:22:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 1 -- 172.21.15.45:0/1742534565 wait complete. 2023-07-09T02:22:45.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.668+0000 7f3ca2949000 20 client.9243 trim_cache size 0 max 16384 2023-07-09T02:22:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:22:45.678 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:22:45.678 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-07-09T02:22:45.679 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 9105, 2023-07-09T02:22:45.679 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-07-09T02:22:45.679 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-07-09T02:22:45.679 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-07-09T02:22:45.679 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 5.9170430420000004, 2023-07-09T02:22:45.679 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 91, 2023-07-09T02:22:45.679 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 182, 2023-07-09T02:22:45.679 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 182, 2023-07-09T02:22:45.680 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.892873277 2023-07-09T02:22:45.680 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:22:45.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3c7c066280 msgr2=0x7f3c7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3c7c066280 0x7f3c7c068730 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f3c981556b0 tx=0x7f3c94008040 comp rx=0 tx=0).stop 2023-07-09T02:22:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/2363587079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 msgr2=0x7f3c9814c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c9814c500 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800e930 tx=0x7f3c8800edf0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/2363587079 shutdown_connections 2023-07-09T02:22:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3c7c066280 0x7f3c7c068730 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c981604a0 0x7f3c9814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c980cde40 0x7f3c9814c500 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 --2- 172.21.15.45:0/2363587079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c980c8dc0 0x7f3c98151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/2363587079 >> 172.21.15.45:0/2363587079 conn(0x7f3c980694b0 msgr2=0x7f3c98155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:45.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/2363587079 shutdown_connections 2023-07-09T02:22:45.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.672+0000 7f3c9f5d5640 1 -- 172.21.15.45:0/2363587079 wait complete. 2023-07-09T02:22:45.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:22:45.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.832+0000 7f75f3e93640 1 Processor -- start 2023-07-09T02:22:45.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.832+0000 7f75f3e93640 1 -- start start 2023-07-09T02:22:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.832+0000 7f75f3e93640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f75ec0afed0 0x7f75ec15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.832+0000 7f75f3e93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0cd040 0x7f75ec0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.832+0000 7f75f3e93640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec071550 con 0x7f75ec15b270 2023-07-09T02:22:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.832+0000 7f75f3e93640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec0cda00 con 0x7f75ec0afed0 2023-07-09T02:22:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.832+0000 7f75f3e93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0720f0 con 0x7f75ec0cd040 2023-07-09T02:22:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f142e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f75ec15b270 0x7f75ec0719e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38362/0 (socket says 172.21.15.45:38362) 2023-07-09T02:22:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f142e640 1 -- 172.21.15.45:0/3196874234 learned_addr learned my addr 172.21.15.45:0/3196874234 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f2430640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0cd040 0x7f75ec0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f1c2f640 1 --2- 172.21.15.45:0/3196874234 >> v2:172.21.15.155:3300/0 conn(0x7f75ec0afed0 0x7f75ec15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972902352 0 0) 0x7f75ec071550 con 0x7f75ec15b270 2023-07-09T02:22:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d8003530 con 0x7f75ec15b270 2023-07-09T02:22:45.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1704351154 0 0) 0x7f75d8003530 con 0x7f75ec15b270 2023-07-09T02:22:45.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0cd040 msgr2=0x7f75ec0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0cd040 0x7f75ec0cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 >> v2:172.21.15.155:3300/0 conn(0x7f75ec0afed0 msgr2=0x7f75ec15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 --2- 172.21.15.45:0/3196874234 >> v2:172.21.15.155:3300/0 conn(0x7f75ec0afed0 0x7f75ec15db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec15e440 con 0x7f75ec15b270 2023-07-09T02:22:45.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f75dc001680 con 0x7f75ec15b270 2023-07-09T02:22:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 >> v1:172.21.15.45:6789/0 conn(0x7f75ec15b270 legacy=0x7f75ec0719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0cd040 0x7f75d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8004d10 0x7f75d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0cda00 con 0x7f75d8003980 2023-07-09T02:22:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0720f0 con 0x7f75d8004d10 2023-07-09T02:22:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d800b990 con 0x7f75ec0cd040 2023-07-09T02:22:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f1c2f640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f142e640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0cd040 0x7f75d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f2430640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8004d10 0x7f75d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f1c2f640 1 -- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0cd040 msgr2=0x7f75d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f1c2f640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0cd040 0x7f75d80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f1c2f640 1 -- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8004d10 msgr2=0x7f75d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f1c2f640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8004d10 0x7f75d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.836+0000 7f75f1c2f640 1 -- 172.21.15.45:0/3196874234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8003530 con 0x7f75d8003980 2023-07-09T02:22:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f1c2f640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75d8003d90 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009ae0 tx=0x7f75e801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f440bf2bc03132 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80a5540 con 0x7f75d8003980 2023-07-09T02:22:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e80a56a0 con 0x7f75d8003980 2023-07-09T02:22:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f0c2d640 1 -- 172.21.15.45:0/3196874234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80a5a50 con 0x7f75d8003980 2023-07-09T02:22:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f3e93640 1 -- 172.21.15.45:0/3196874234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 msgr2=0x7f75d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f3e93640 1 --2- 172.21.15.45:0/3196874234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75d8003d90 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009ae0 tx=0x7f75e801ca00 comp rx=0 tx=0).stop 2023-07-09T02:22:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f2430640 1 -- 172.21.15.45:0/3196874234 reap_dead start 2023-07-09T02:22:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f3e93640 1 -- 172.21.15.45:0/3196874234 shutdown_connections 2023-07-09T02:22:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f3e93640 1 -- 172.21.15.45:0/3196874234 >> 172.21.15.45:0/3196874234 conn(0x7f75ec06d140 msgr2=0x7f75ec06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f3e93640 1 -- 172.21.15.45:0/3196874234 shutdown_connections 2023-07-09T02:22:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f3e93640 1 -- 172.21.15.45:0/3196874234 wait complete. 2023-07-09T02:22:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f3e93640 1 Processor -- start 2023-07-09T02:22:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.840+0000 7f75f3e93640 1 -- start start 2023-07-09T02:22:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75ec154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75ec06b340 0x7f75ec06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0adc00 0x7f75ec0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0ae5b0 con 0x7f75d8003980 2023-07-09T02:22:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0b5660 con 0x7f75ec06b340 2023-07-09T02:22:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0b64c0 con 0x7f75ec0adc00 2023-07-09T02:22:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75ec154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75ec154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46474/0 (socket says 172.21.15.45:46474) 2023-07-09T02:22:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 -- 172.21.15.45:0/43154845 learned_addr learned my addr 172.21.15.45:0/43154845 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f2430640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0adc00 0x7f75ec0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f142e640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75ec06b340 0x7f75ec06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 -- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0adc00 msgr2=0x7f75ec0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0adc00 0x7f75ec0ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 -- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75ec06b340 msgr2=0x7f75ec06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75ec06b340 0x7f75ec06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 -- 172.21.15.45:0/43154845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec06c280 con 0x7f75d8003980 2023-07-09T02:22:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f142e640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75ec06b340 0x7f75ec06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f1c2f640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75ec154d00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f75e801d2a0 tx=0x7f75d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75e27fc640 1 -- 172.21.15.45:0/43154845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80a5db0 con 0x7f75d8003980 2023-07-09T02:22:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75e27fc640 1 -- 172.21.15.45:0/43154845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8004020 con 0x7f75d8003980 2023-07-09T02:22:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec0b58b0 con 0x7f75d8003980 2023-07-09T02:22:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75e27fc640 1 -- 172.21.15.45:0/43154845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80043d0 con 0x7f75d8003980 2023-07-09T02:22:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec0b5e70 con 0x7f75d8003980 2023-07-09T02:22:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec04d7d0 con 0x7f75d8003980 2023-07-09T02:22:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.844+0000 7f75e27fc640 1 -- 172.21.15.45:0/43154845 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75e80b4040 con 0x7f75d8003980 2023-07-09T02:22:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.848+0000 7f75e27fc640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75d00662b0 0x7f75d0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.848+0000 7f75e27fc640 1 -- 172.21.15.45:0/43154845 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75e811d780 con 0x7f75d8003980 2023-07-09T02:22:45.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.848+0000 7f75f142e640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75d00662b0 0x7f75d0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:45.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.848+0000 7f75f142e640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75d00662b0 0x7f75d0068760 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000c10 tx=0x7f75dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:45.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:45.852+0000 7f75e27fc640 1 -- 172.21.15.45:0/43154845 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75e80eace0 con 0x7f75d8003980 2023-07-09T02:22:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.036+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f75ec06f3a0 con 0x7f75d8003980 2023-07-09T02:22:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.036+0000 7f75e27fc640 1 -- 172.21.15.45:0/43154845 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7f75e80ee300 con 0x7f75d8003980 2023-07-09T02:22:46.039 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:22:46.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75d00662b0 msgr2=0x7f75d0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:46.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75d00662b0 0x7f75d0068760 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f75dc000c10 tx=0x7f75dc009040 comp rx=0 tx=0).stop 2023-07-09T02:22:46.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 msgr2=0x7f75ec154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:46.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75ec154d00 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f75e801d2a0 tx=0x7f75d8005800 comp rx=0 tx=0).stop 2023-07-09T02:22:46.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 shutdown_connections 2023-07-09T02:22:46.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f75d00662b0 0x7f75d0068760 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75ec0adc00 0x7f75ec0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75ec06b340 0x7f75ec06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 --2- 172.21.15.45:0/43154845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75d8003980 0x7f75ec154d00 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 >> 172.21.15.45:0/43154845 conn(0x7f75ec06d140 msgr2=0x7f75ec15a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:46.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 shutdown_connections 2023-07-09T02:22:46.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.040+0000 7f75f3e93640 1 -- 172.21.15.45:0/43154845 wait complete. 2023-07-09T02:22:46.059 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:22:46.060 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:22:46.060 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-07-09T02:22:46.060 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T02:22:46.060 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T02:22:46.061 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:22:46.061 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:22:46.061 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:22:46.061 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:22:46.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.062 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-07-09T02:22:46.071 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:22:46.072 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:22:46.072 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:22:46.072 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:46.072 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-07-09T02:22:46.072 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:46.072 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:22:46.073 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:46.073 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-07-09T02:22:46.073 INFO:teuthology.orchestra.run.smithi045.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:22:46.073 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:46.073 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-07-09T02:22:46.073 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T02:22:46.073 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41761sec preferred_lft 41761sec 2023-07-09T02:22:46.074 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-07-09T02:22:46.074 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:46.074 INFO:teuthology.orchestra.run.smithi045.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:22:46.074 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:46.074 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-07-09T02:22:46.074 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:22:46.074 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:46.075 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-07-09T02:22:46.075 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:22:46.075 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:d8:63:ee:38 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:46.075 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:22:46.075 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:46.075 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:22:46.075 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:46.075 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:22:46.076 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:46.076 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:22:46.076 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:46.076 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:22:46.076 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:22:46.076 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:22:46.076 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:46.077 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:22:46.077 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:22:46.077 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:22:46.077 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:46.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.078 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:22:46.142 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-07-09T02:22:46.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.145 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-07-09T02:22:46.200 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-07-09T02:22:46.200 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:22:46.200 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T02:22:46.201 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:22:46.201 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T02:22:46.201 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:22:46.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.202 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-07-09T02:22:46.202 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-07-09T02:22:46.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T02:22:46.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T02:22:46.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T02:22:46.203 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-07-09T02:22:46.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.297 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:22:46.306 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:22:46.306 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:22:46.307 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:22:46.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-07-09T02:22:46.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:22:46.372 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T02:22:46.423 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T02:22:46.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:22:46.424 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:22:46.474 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-09T02:22:46.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:22:46.571 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:22:46.571 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:22:46.583 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:22:46.583 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:22:46.584 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:22:46.584 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:22:46.584 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:22:46.588 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:22:46.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.589 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T02:22:46.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:46.610 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:22:46.670 INFO:teuthology.orchestra.run.smithi045.stdout:client8698 2023-07-09T02:22:46.670 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:46.671 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:46.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T02:22:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.908+0000 7f0054c0b640 1 Processor -- start 2023-07-09T02:22:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.908+0000 7f0054c0b640 1 -- start start 2023-07-09T02:22:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f0054c0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500ca0f0 0x7f00500cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f0054c0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f005015db00 0x7f005015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f0054c0b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005006bf30 con 0x7f00500cbbb0 2023-07-09T02:22:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f0054c0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005015e4c0 con 0x7f005015db00 2023-07-09T02:22:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f0054c0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005006bc50 con 0x7f00500ca0f0 2023-07-09T02:22:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f004ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f005015db00 0x7f005015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f0047fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f00500cbbb0 0x7f00500c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38370/0 (socket says 172.21.15.45:38370) 2023-07-09T02:22:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f004ed9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f005015db00 0x7f005015df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46482/0 (socket says 172.21.15.45:46482) 2023-07-09T02:22:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f0047fff640 1 -- 172.21.15.45:0/1259277407 learned_addr learned my addr 172.21.15.45:0/1259277407 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f004e59c640 1 --2- 172.21.15.45:0/1259277407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500ca0f0 0x7f00500cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f004ed9d640 1 -- 172.21.15.45:0/1259277407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500ca0f0 msgr2=0x7f00500cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f004ed9d640 1 --2- 172.21.15.45:0/1259277407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500ca0f0 0x7f00500cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f004ed9d640 1 -- 172.21.15.45:0/1259277407 >> v1:172.21.15.45:6789/0 conn(0x7f00500cbbb0 legacy=0x7f00500c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f004ed9d640 1 -- 172.21.15.45:0/1259277407 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500cab90 con 0x7f005015db00 2023-07-09T02:22:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.912+0000 7f004ed9d640 1 --2- 172.21.15.45:0/1259277407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005015db00 0x7f005015df80 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0048009d90 tx=0x7f004801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22ef41e6881a4d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f004dd9b640 1 -- 172.21.15.45:0/1259277407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480a5890 con 0x7f005015db00 2023-07-09T02:22:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f004dd9b640 1 -- 172.21.15.45:0/1259277407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00480a59f0 con 0x7f005015db00 2023-07-09T02:22:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f004dd9b640 1 -- 172.21.15.45:0/1259277407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480a5d80 con 0x7f005015db00 2023-07-09T02:22:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- 172.21.15.45:0/1259277407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005015db00 msgr2=0x7f005015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 --2- 172.21.15.45:0/1259277407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005015db00 0x7f005015df80 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0048009d90 tx=0x7f004801c8c0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- 172.21.15.45:0/1259277407 shutdown_connections 2023-07-09T02:22:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 --2- 172.21.15.45:0/1259277407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005015db00 0x7f005015df80 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 --2- 172.21.15.45:0/1259277407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500ca0f0 0x7f00500cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- 172.21.15.45:0/1259277407 >> 172.21.15.45:0/1259277407 conn(0x7f00500694b0 msgr2=0x7f00500698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- 172.21.15.45:0/1259277407 shutdown_connections 2023-07-09T02:22:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- 172.21.15.45:0/1259277407 wait complete. 2023-07-09T02:22:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 Processor -- start 2023-07-09T02:22:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- start start 2023-07-09T02:22:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00500ca0f0 0x7f005014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500cbbb0 0x7f005014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005015db00 0x7f00500c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00500b44c0 con 0x7f00500ca0f0 2023-07-09T02:22:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005014c740 con 0x7f005015db00 2023-07-09T02:22:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.916+0000 7f0054c0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00500b3940 con 0x7f00500cbbb0 2023-07-09T02:22:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00500ca0f0 0x7f005014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00500ca0f0 0x7f005014c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46488/0 (socket says 172.21.15.45:46488) 2023-07-09T02:22:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 -- 172.21.15.45:0/2776927802 learned_addr learned my addr 172.21.15.45:0/2776927802 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f0047fff640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500cbbb0 0x7f005014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004ed9d640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005015db00 0x7f00500c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 -- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500cbbb0 msgr2=0x7f005014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:46.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500cbbb0 0x7f005014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 -- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005015db00 msgr2=0x7f00500c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:46.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005015db00 0x7f00500c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:46.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 -- 172.21.15.45:0/2776927802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048009a70 con 0x7f00500ca0f0 2023-07-09T02:22:46.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f004e59c640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00500ca0f0 0x7f005014c200 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f004000d800 tx=0x7f004000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:46.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f0046ffd640 1 -- 172.21.15.45:0/2776927802 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000b6c0 con 0x7f00500ca0f0 2023-07-09T02:22:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f0046ffd640 1 -- 172.21.15.45:0/2776927802 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004000b820 con 0x7f00500ca0f0 2023-07-09T02:22:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f0046ffd640 1 -- 172.21.15.45:0/2776927802 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000bb90 con 0x7f00500ca0f0 2023-07-09T02:22:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00500b3c20 con 0x7f00500ca0f0 2023-07-09T02:22:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00500b41e0 con 0x7f00500ca0f0 2023-07-09T02:22:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005004d7d0 con 0x7f00500ca0f0 2023-07-09T02:22:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.920+0000 7f0046ffd640 1 -- 172.21.15.45:0/2776927802 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f004000bcf0 con 0x7f00500ca0f0 2023-07-09T02:22:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.924+0000 7f0046ffd640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0030066280 0x7f0030068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.924+0000 7f0046ffd640 1 -- 172.21.15.45:0/2776927802 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00400841f0 con 0x7f00500ca0f0 2023-07-09T02:22:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.924+0000 7f0047fff640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0030066280 0x7f0030068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.924+0000 7f0047fff640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0030066280 0x7f0030068730 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0050154860 tx=0x7f0038009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:46.924+0000 7f0046ffd640 1 -- 172.21.15.45:0/2776927802 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0040055110 con 0x7f00500ca0f0 2023-07-09T02:22:47.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.116+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f005006c540 con 0x7f00500ca0f0 2023-07-09T02:22:47.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.116+0000 7f0046ffd640 1 -- 172.21.15.45:0/2776927802 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0040054ca0 con 0x7f00500ca0f0 2023-07-09T02:22:47.118 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T02:22:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.116+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0030066280 msgr2=0x7f0030068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.116+0000 7f0054c0b640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0030066280 0x7f0030068730 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0050154860 tx=0x7f0038009040 comp rx=0 tx=0).stop 2023-07-09T02:22:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00500ca0f0 msgr2=0x7f005014c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:47.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00500ca0f0 0x7f005014c200 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f004000d800 tx=0x7f004000dcc0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 shutdown_connections 2023-07-09T02:22:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005015db00 0x7f00500c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0030066280 0x7f0030068730 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f00500cbbb0 0x7f005014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 --2- 172.21.15.45:0/2776927802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00500ca0f0 0x7f005014c200 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 >> 172.21.15.45:0/2776927802 conn(0x7f00500694b0 msgr2=0x7f0050158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:47.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 shutdown_connections 2023-07-09T02:22:47.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.120+0000 7f0054c0b640 1 -- 172.21.15.45:0/2776927802 wait complete. 2023-07-09T02:22:47.138 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-09T02:22:47.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T02:22:47.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2023-07-09T02:22:47.139 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T02:22:47.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T02:22:47.140 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-09T02:22:47.140 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-09T02:22:47.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T02:22:47.140 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:22:47.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.141 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2023-07-09T02:22:47.152 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T02:22:47.152 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T02:22:47.152 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T02:22:47.153 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:47.153 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2023-07-09T02:22:47.153 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:47.153 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:22:47.153 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:47.153 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2023-07-09T02:22:47.153 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:22:47.154 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:47.154 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2023-07-09T02:22:47.154 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T02:22:47.154 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:47.154 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T02:22:47.154 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:47.154 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T02:22:47.154 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 41767sec preferred_lft 41767sec 2023-07-09T02:22:47.155 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2023-07-09T02:22:47.155 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:47.155 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T02:22:47.155 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:e2:83:12:26 brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:47.155 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T02:22:47.156 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:47.156 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T02:22:47.156 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T02:22:47.156 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T02:22:47.156 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:47.156 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T02:22:47.156 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:47.156 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:22:47.157 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:22:47.157 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T02:22:47.157 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:47.157 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T02:22:47.157 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:22:47.157 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T02:22:47.157 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2023-07-09T02:22:47.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.159 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T02:22:47.220 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-07-09T02:22:47.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.223 DEBUG:teuthology.orchestra.run.smithi155:> route 2023-07-09T02:22:47.275 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2023-07-09T02:22:47.275 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T02:22:47.275 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T02:22:47.275 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T02:22:47.275 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T02:22:47.275 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T02:22:47.276 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:22:47.276 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:22:47.276 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T02:22:47.276 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T02:22:47.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.277 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec bash -c ' 2023-07-09T02:22:47.277 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2023-07-09T02:22:47.277 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T02:22:47.278 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T02:22:47.278 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T02:22:47.278 DEBUG:teuthology.orchestra.run.smithi155:> ') 2023-07-09T02:22:47.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.371 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:22:47.380 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:22:47.380 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:22:47.381 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:22:47.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.382 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2023-07-09T02:22:47.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:22:47.445 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T02:22:47.500 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T02:22:47.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T02:22:47.501 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:22:47.555 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-09T02:22:47.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.556 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:22:47.651 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:22:47.652 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:22:47.663 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-09T02:22:47.663 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-09T02:22:47.664 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-07-09T02:22:47.664 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@baf8f4e1-db15-4e56-a3ea-d65b4f02f49e.cephfs=/ 2023-07-09T02:22:47.664 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2023-07-09T02:22:47.667 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-09T02:22:47.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.668 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T02:22:47.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:47.688 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-09T02:22:47.748 INFO:teuthology.orchestra.run.smithi155.stdout:client7505 2023-07-09T02:22:47.748 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:22:47.749 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:47.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:47.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7fb40640 1 Processor -- start 2023-07-09T02:22:47.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7fb40640 1 -- start start 2023-07-09T02:22:47.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7fb40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1c780d2620 0x7f1c780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:47.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7fb40640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1c780cd120 0x7f1c780cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:47.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7fb40640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c78160a50 con 0x7f1c7815c060 2023-07-09T02:22:47.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7fb40640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7815c430 con 0x7f1c780cd120 2023-07-09T02:22:47.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7fb40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7815fb60 con 0x7f1c780d2620 2023-07-09T02:22:47.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7d8dc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1c7815c060 0x7f1c780d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38382/0 (socket says 172.21.15.45:38382) 2023-07-09T02:22:47.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7d8dc640 1 -- 172.21.15.45:0/1293627714 learned_addr learned my addr 172.21.15.45:0/1293627714 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:47.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7e0dd640 1 --2- 172.21.15.45:0/1293627714 >> v2:172.21.15.45:3300/0 conn(0x7f1c780cd120 0x7f1c780cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:47.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7d0db640 1 --2- 172.21.15.45:0/1293627714 >> v2:172.21.15.155:3300/0 conn(0x7f1c780d2620 0x7f1c780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:47.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7c8da640 1 -- 172.21.15.45:0/1293627714 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968379919 0 0) 0x7f1c78160a50 con 0x7f1c7815c060 2023-07-09T02:22:47.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7e0dd640 1 -- 172.21.15.45:0/1293627714 >> v2:172.21.15.155:3300/0 conn(0x7f1c780d2620 msgr2=0x7f1c780b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:47.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7e0dd640 1 --2- 172.21.15.45:0/1293627714 >> v2:172.21.15.155:3300/0 conn(0x7f1c780d2620 0x7f1c780b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7e0dd640 1 -- 172.21.15.45:0/1293627714 >> v1:172.21.15.45:6789/0 conn(0x7f1c7815c060 legacy=0x7f1c780d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:47.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7e0dd640 1 -- 172.21.15.45:0/1293627714 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7815fe40 con 0x7f1c780cd120 2023-07-09T02:22:47.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.952+0000 7f1c7d0db640 1 --2- 172.21.15.45:0/1293627714 >> v2:172.21.15.155:3300/0 conn(0x7f1c780d2620 0x7f1c780b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:47.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7e0dd640 1 --2- 172.21.15.45:0/1293627714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c780cd120 0x7f1c780cee30 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f1c7815fac0 tx=0x7f1c7001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d14b1cfdf0da92 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:47.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7c8da640 1 -- 172.21.15.45:0/1293627714 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700a59a0 con 0x7f1c780cd120 2023-07-09T02:22:47.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7c8da640 1 -- 172.21.15.45:0/1293627714 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c700a5b00 con 0x7f1c780cd120 2023-07-09T02:22:47.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7c8da640 1 -- 172.21.15.45:0/1293627714 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700a5e90 con 0x7f1c780cd120 2023-07-09T02:22:47.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7fb40640 1 -- 172.21.15.45:0/1293627714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c780cd120 msgr2=0x7f1c780cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/1293627714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c780cd120 0x7f1c780cee30 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f1c7815fac0 tx=0x7f1c7001c8e0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7fb40640 1 -- 172.21.15.45:0/1293627714 shutdown_connections 2023-07-09T02:22:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/1293627714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c780cd120 0x7f1c780cee30 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/1293627714 >> v2:172.21.15.155:3300/0 conn(0x7f1c780d2620 0x7f1c780b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7fb40640 1 -- 172.21.15.45:0/1293627714 >> 172.21.15.45:0/1293627714 conn(0x7f1c780698e0 msgr2=0x7f1c78069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7fb40640 1 -- 172.21.15.45:0/1293627714 shutdown_connections 2023-07-09T02:22:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.956+0000 7f1c7fb40640 1 -- 172.21.15.45:0/1293627714 wait complete. 2023-07-09T02:22:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 Processor -- start 2023-07-09T02:22:47.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 -- start start 2023-07-09T02:22:47.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c780cd120 0x7f1c780b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:47.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c780d2620 0x7f1c781f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:47.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c7815c060 0x7f1c781f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:47.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781596b0 con 0x7f1c7815c060 2023-07-09T02:22:47.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78159990 con 0x7f1c780d2620 2023-07-09T02:22:47.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78159c70 con 0x7f1c780cd120 2023-07-09T02:22:47.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c7815c060 0x7f1c781f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:47.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c7815c060 0x7f1c781f85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46516/0 (socket says 172.21.15.45:46516) 2023-07-09T02:22:47.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 -- 172.21.15.45:0/795810913 learned_addr learned my addr 172.21.15.45:0/795810913 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:47.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7d8dc640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c780cd120 0x7f1c780b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:47.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7d0db640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c780d2620 0x7f1c781f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:47.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 -- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c780cd120 msgr2=0x7f1c780b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:47.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c780cd120 0x7f1c780b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 -- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c780d2620 msgr2=0x7f1c781f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:47.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c780d2620 0x7f1c781f8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:47.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 -- 172.21.15.45:0/795810913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70009a70 con 0x7f1c7815c060 2023-07-09T02:22:47.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7d0db640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c780d2620 0x7f1c781f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:47.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7e0dd640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c7815c060 0x7f1c781f85c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f1c700b0040 tx=0x7f1c70019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:47.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c6e7fc640 1 -- 172.21.15.45:0/795810913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700ade20 con 0x7f1c7815c060 2023-07-09T02:22:47.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c6e7fc640 1 -- 172.21.15.45:0/795810913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70009450 con 0x7f1c7815c060 2023-07-09T02:22:47.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c6e7fc640 1 -- 172.21.15.45:0/795810913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700b9690 con 0x7f1c7815c060 2023-07-09T02:22:47.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780b59f0 con 0x7f1c7815c060 2023-07-09T02:22:47.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.960+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7815a230 con 0x7f1c7815c060 2023-07-09T02:22:47.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.964+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7804d7d0 con 0x7f1c7815c060 2023-07-09T02:22:47.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.964+0000 7f1c6e7fc640 1 -- 172.21.15.45:0/795810913 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c700b97f0 con 0x7f1c7815c060 2023-07-09T02:22:47.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.964+0000 7f1c6e7fc640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1c5c0662b0 0x7f1c5c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:47.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.964+0000 7f1c6e7fc640 1 -- 172.21.15.45:0/795810913 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c7011f0c0 con 0x7f1c7815c060 2023-07-09T02:22:47.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.964+0000 7f1c7d8dc640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1c5c0662b0 0x7f1c5c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:47.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.964+0000 7f1c7d8dc640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1c5c0662b0 0x7f1c5c068760 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1c74000f70 tx=0x7f1c74007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:47.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:47.968+0000 7f1c6e7fc640 1 -- 172.21.15.45:0/795810913 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c700ec660 con 0x7f1c7815c060 2023-07-09T02:22:48.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c780d34e0 con 0x7f1c7815c060 2023-07-09T02:22:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c6e7fc640 1 -- 172.21.15.45:0/795810913 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f1c700efc80 con 0x7f1c7815c060 2023-07-09T02:22:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:48.157 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:22:48.157 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:22:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1c5c0662b0 msgr2=0x7f1c5c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1c5c0662b0 0x7f1c5c068760 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1c74000f70 tx=0x7f1c74007df0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c7815c060 msgr2=0x7f1c781f85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c7815c060 0x7f1c781f85c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f1c700b0040 tx=0x7f1c70019680 comp rx=0 tx=0).stop 2023-07-09T02:22:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 shutdown_connections 2023-07-09T02:22:48.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c7815c060 0x7f1c781f85c0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c780d2620 0x7f1c781f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1c5c0662b0 0x7f1c5c068760 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 --2- 172.21.15.45:0/795810913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c780cd120 0x7f1c780b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 >> 172.21.15.45:0/795810913 conn(0x7f1c780698e0 msgr2=0x7f1c78069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:48.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 shutdown_connections 2023-07-09T02:22:48.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.156+0000 7f1c7fb40640 1 -- 172.21.15.45:0/795810913 wait complete. 2023-07-09T02:22:48.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-07-09T02:22:48.341 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":9105,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.5729467229999994,"mdsmap_epoch":91,"osdmap_epoch":182,"osdmap_epoch_barrier":182,"uptime":14.548762375000001} 2023-07-09T02:22:48.342 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 9105, "mdsmap_epoch": 91, "osdmap_epoch": 182, "osdmap_epoch_barrier": 182, "rank_uptime": 8.572946723, "state": "up:active", "uptime": 14.548762375, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:22:48.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-07-09T02:22:48.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85d12d8640 1 Processor -- start 2023-07-09T02:22:48.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85d12d8640 1 -- start start 2023-07-09T02:22:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85d12d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc15c2a0 0x7f85cc160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85d12d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85cc0ceaf0 0x7f85cc0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85d12d8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85cc069980 0x7f85cc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85d12d8640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc0d05a0 con 0x7f85cc069980 2023-07-09T02:22:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85d12d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc06a340 con 0x7f85cc0ceaf0 2023-07-09T02:22:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85d12d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc160b60 con 0x7f85cc15c2a0 2023-07-09T02:22:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85cb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85cc069980 0x7f85cc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:48.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85cb7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85cc069980 0x7f85cc069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46520/0 (socket says 172.21.15.45:46520) 2023-07-09T02:22:48.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85caffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc15c2a0 0x7f85cc160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:48.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85cb7fe640 1 -- 172.21.15.45:0/1335944152 learned_addr learned my addr 172.21.15.45:0/1335944152 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:48.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.488+0000 7f85ca7fc640 1 --2- 172.21.15.45:0/1335944152 >> v2:172.21.15.155:3300/0 conn(0x7f85cc0ceaf0 0x7f85cc0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:48.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85caffd640 1 -- 172.21.15.45:0/1335944152 >> v2:172.21.15.155:3300/0 conn(0x7f85cc0ceaf0 msgr2=0x7f85cc0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:48.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85caffd640 1 --2- 172.21.15.45:0/1335944152 >> v2:172.21.15.155:3300/0 conn(0x7f85cc0ceaf0 0x7f85cc0b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85caffd640 1 -- 172.21.15.45:0/1335944152 >> v2:172.21.15.45:3300/0 conn(0x7f85cc069980 msgr2=0x7f85cc069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:48.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85caffd640 1 --2- 172.21.15.45:0/1335944152 >> v2:172.21.15.45:3300/0 conn(0x7f85cc069980 0x7f85cc069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85caffd640 1 -- 172.21.15.45:0/1335944152 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0ccf90 con 0x7f85cc15c2a0 2023-07-09T02:22:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85cb7fe640 1 --2- 172.21.15.45:0/1335944152 >> v2:172.21.15.45:3300/0 conn(0x7f85cc069980 0x7f85cc069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:22:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85caffd640 1 --2- 172.21.15.45:0/1335944152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc15c2a0 0x7f85cc160620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f85cc069530 tx=0x7f85bc01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b11b5914307fbeb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85c9ffb640 1 -- 172.21.15.45:0/1335944152 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0ab610 con 0x7f85cc15c2a0 2023-07-09T02:22:48.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85c9ffb640 1 -- 172.21.15.45:0/1335944152 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc0ab770 con 0x7f85cc15c2a0 2023-07-09T02:22:48.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85c9ffb640 1 -- 172.21.15.45:0/1335944152 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0abb00 con 0x7f85cc15c2a0 2023-07-09T02:22:48.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.492+0000 7f85d12d8640 1 -- 172.21.15.45:0/1335944152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc15c2a0 msgr2=0x7f85cc160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/1335944152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc15c2a0 0x7f85cc160620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f85cc069530 tx=0x7f85bc01c430 comp rx=0 tx=0).stop 2023-07-09T02:22:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/1335944152 shutdown_connections 2023-07-09T02:22:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/1335944152 >> v2:172.21.15.45:3300/0 conn(0x7f85cc069980 0x7f85cc069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/1335944152 >> v2:172.21.15.155:3300/0 conn(0x7f85cc0ceaf0 0x7f85cc0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/1335944152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc15c2a0 0x7f85cc160620 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/1335944152 >> 172.21.15.45:0/1335944152 conn(0x7f85cc0cffb0 msgr2=0x7f85cc0d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/1335944152 shutdown_connections 2023-07-09T02:22:48.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/1335944152 wait complete. 2023-07-09T02:22:48.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 Processor -- start 2023-07-09T02:22:48.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 -- start start 2023-07-09T02:22:48.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85cc069980 0x7f85cc0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:48.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc0ceaf0 0x7f85cc151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:48.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85cc15c2a0 0x7f85cc15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:48.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc15c8a0 con 0x7f85cc15c2a0 2023-07-09T02:22:48.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc151ea0 con 0x7f85cc069980 2023-07-09T02:22:48.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85d12d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0c9240 con 0x7f85cc0ceaf0 2023-07-09T02:22:48.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85cc15c2a0 0x7f85cc15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:48.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85cc15c2a0 0x7f85cc15ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46534/0 (socket says 172.21.15.45:46534) 2023-07-09T02:22:48.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85cb7fe640 1 -- 172.21.15.45:0/4070168278 learned_addr learned my addr 172.21.15.45:0/4070168278 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:48.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85caffd640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85cc069980 0x7f85cc0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:48.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85ca7fc640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc0ceaf0 0x7f85cc151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:48.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85cb7fe640 1 -- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc0ceaf0 msgr2=0x7f85cc151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:48.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85cb7fe640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc0ceaf0 0x7f85cc151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85cb7fe640 1 -- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85cc069980 msgr2=0x7f85cc0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:48.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85cb7fe640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85cc069980 0x7f85cc0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:48.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85cb7fe640 1 -- 172.21.15.45:0/4070168278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4009b30 con 0x7f85cc15c2a0 2023-07-09T02:22:48.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.496+0000 7f85ca7fc640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc0ceaf0 0x7f85cc151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:48.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85cb7fe640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85cc15c2a0 0x7f85cc15ad00 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f85c400eed0 tx=0x7f85c400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:48.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85b37fe640 1 -- 172.21.15.45:0/4070168278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4018070 con 0x7f85cc15c2a0 2023-07-09T02:22:48.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85b37fe640 1 -- 172.21.15.45:0/4070168278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c40092e0 con 0x7f85cc15c2a0 2023-07-09T02:22:48.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85b37fe640 1 -- 172.21.15.45:0/4070168278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4010040 con 0x7f85cc15c2a0 2023-07-09T02:22:48.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc009420 con 0x7f85cc15c2a0 2023-07-09T02:22:48.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc0c8c80 con 0x7f85cc15c2a0 2023-07-09T02:22:48.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc15c9e0 con 0x7f85cc15c2a0 2023-07-09T02:22:48.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85b37fe640 1 -- 172.21.15.45:0/4070168278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85c400bd10 con 0x7f85cc15c2a0 2023-07-09T02:22:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.500+0000 7f85b37fe640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85b8066280 0x7f85b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.504+0000 7f85b37fe640 1 -- 172.21.15.45:0/4070168278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85c4083ad0 con 0x7f85cc15c2a0 2023-07-09T02:22:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.504+0000 7f85caffd640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85b8066280 0x7f85b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.504+0000 7f85caffd640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85b8066280 0x7f85b8068730 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0af000 tx=0x7f85bc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:48.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.504+0000 7f85b37fe640 1 -- 172.21.15.45:0/4070168278 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85cc15c9e0 con 0x7f85cc15c2a0 2023-07-09T02:22:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:48.664+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f85cc15c9e0 con 0x7f85cc15c2a0 2023-07-09T02:22:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.492+0000 7f85b37fe640 1 -- 172.21.15.45:0/4070168278 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v183) v1 ==== 181+0+0 (secure 0 0 0) 0x7f85cc15c9e0 con 0x7f85cc15c2a0 2023-07-09T02:22:49.493 INFO:teuthology.orchestra.run.smithi045.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-07-09T02:22:49.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.492+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85b8066280 msgr2=0x7f85b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:49.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.492+0000 7f85d12d8640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85b8066280 0x7f85b8068730 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0af000 tx=0x7f85bc0a7000 comp rx=0 tx=0).stop 2023-07-09T02:22:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85cc15c2a0 msgr2=0x7f85cc15ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85cc15c2a0 0x7f85cc15ad00 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f85c400eed0 tx=0x7f85c400b480 comp rx=0 tx=0).stop 2023-07-09T02:22:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 shutdown_connections 2023-07-09T02:22:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85cc15c2a0 0x7f85cc15ad00 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f85b8066280 0x7f85b8068730 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85cc0ceaf0 0x7f85cc151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 --2- 172.21.15.45:0/4070168278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85cc069980 0x7f85cc0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 >> 172.21.15.45:0/4070168278 conn(0x7f85cc0cffb0 msgr2=0x7f85cc0b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 shutdown_connections 2023-07-09T02:22:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:49.496+0000 7f85d12d8640 1 -- 172.21.15.45:0/4070168278 wait complete. 2023-07-09T02:22:49.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-07-09T02:22:49.682 INFO:teuthology.orchestra.run.smithi045.stdout:{"osd_mon_report_interval":"5"} 2023-07-09T02:22:49.683 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-07-09T02:22:49.683 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-07-09T02:22:49.684 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:49.684 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:49.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:49.693 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-07-09T02:22:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:16+0 records in 2023-07-09T02:22:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:16+0 records out 2023-07-09T02:22:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.122403 s, 137 MB/s 2023-07-09T02:22:49.876 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:49.876 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:49.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:49.886 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-07-09T02:22:50.095 INFO:teuthology.orchestra.run.smithi045.stderr:17+0 records in 2023-07-09T02:22:50.096 INFO:teuthology.orchestra.run.smithi045.stderr:17+0 records out 2023-07-09T02:22:50.096 INFO:teuthology.orchestra.run.smithi045.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.159237 s, 112 MB/s 2023-07-09T02:22:50.097 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-07-09T02:22:50.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:22:50.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:22:50.145 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:22:50.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.240+0000 7facfa38f640 1 Processor -- start 2023-07-09T02:22:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.240+0000 7facfa38f640 1 -- start start 2023-07-09T02:22:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.240+0000 7facfa38f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7facf40cd120 0x7facf40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.240+0000 7facfa38f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf4160a50 con 0x7facf415c060 2023-07-09T02:22:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.240+0000 7facfa38f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf415c430 con 0x7facf40d2620 2023-07-09T02:22:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.240+0000 7facfa38f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf415fb60 con 0x7facf40cd120 2023-07-09T02:22:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.240+0000 7facf3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7facf415c060 0x7facf40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38384/0 (socket says 172.21.15.45:38384) 2023-07-09T02:22:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.240+0000 7facf3fff640 1 -- 172.21.15.45:0/1635938930 learned_addr learned my addr 172.21.15.45:0/1635938930 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:22:50.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf892c640 1 --2- 172.21.15.45:0/1635938930 >> v2:172.21.15.155:3300/0 conn(0x7facf40cd120 0x7facf40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:50.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248667368 0 0) 0x7facf4160a50 con 0x7facf415c060 2023-07-09T02:22:50.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face0003530 con 0x7facf415c060 2023-07-09T02:22:50.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028210995 0 0) 0x7facf415c430 con 0x7facf40d2620 2023-07-09T02:22:50.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf4160a50 con 0x7facf40d2620 2023-07-09T02:22:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2266848099 0 0) 0x7face0003530 con 0x7facf415c060 2023-07-09T02:22:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 >> v2:172.21.15.155:3300/0 conn(0x7facf40cd120 msgr2=0x7facf40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 --2- 172.21.15.45:0/1635938930 >> v2:172.21.15.155:3300/0 conn(0x7facf40cd120 0x7facf40b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 >> v1:172.21.15.155:6789/0 conn(0x7facf40d2620 legacy=0x7facf40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf415fe40 con 0x7facf415c060 2023-07-09T02:22:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7face4001680 con 0x7facf415c060 2023-07-09T02:22:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 >> v1:172.21.15.45:6789/0 conn(0x7facf415c060 legacy=0x7facf40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0003b10 0x7face0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face00047d0 0x7face0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7face0005180 0x7face000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf415fb60 con 0x7face0005180 2023-07-09T02:22:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face000bfe0 con 0x7face00047d0 2023-07-09T02:22:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face000c1a0 con 0x7face0003b10 2023-07-09T02:22:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facebfff640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face00047d0 0x7face0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf892c640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7face0005180 0x7face000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf3fff640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0003b10 0x7face0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:50.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf892c640 1 -- 172.21.15.45:0/1635938930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0003b10 msgr2=0x7face0003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:50.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf892c640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0003b10 0x7face0003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf892c640 1 -- 172.21.15.45:0/1635938930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face00047d0 msgr2=0x7face0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:50.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf892c640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face00047d0 0x7face0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.244+0000 7facf892c640 1 -- 172.21.15.45:0/1635938930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0003530 con 0x7face0005180 2023-07-09T02:22:50.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facf892c640 1 -- 172.21.15.45:0/1635938930 reap_dead start 2023-07-09T02:22:50.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facf892c640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7face0005180 0x7face000b990 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7facec009fc0 tx=0x7facec01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571e1bfb97072928 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:50.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4007ea0 con 0x7face0005180 2023-07-09T02:22:50.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec00f040 con 0x7face0005180 2023-07-09T02:22:50.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facf37fe640 1 -- 172.21.15.45:0/1635938930 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec003e20 con 0x7face0005180 2023-07-09T02:22:50.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 -- 172.21.15.45:0/1635938930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7face0005180 msgr2=0x7face000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:50.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7face0005180 0x7face000b990 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7facec009fc0 tx=0x7facec01cca0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 -- 172.21.15.45:0/1635938930 shutdown_connections 2023-07-09T02:22:50.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 --2- 172.21.15.45:0/1635938930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7face0005180 0x7face000b990 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 -- 172.21.15.45:0/1635938930 >> 172.21.15.45:0/1635938930 conn(0x7facf40698e0 msgr2=0x7facf4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:50.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 -- 172.21.15.45:0/1635938930 shutdown_connections 2023-07-09T02:22:50.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 -- 172.21.15.45:0/1635938930 wait complete. 2023-07-09T02:22:50.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 Processor -- start 2023-07-09T02:22:50.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.248+0000 7facfa38f640 1 -- start start 2023-07-09T02:22:50.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0005180 0x7facf415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:50.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf415ce20 0x7facf40cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf41f1f10 0x7facf40c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf40cc640 con 0x7facf41f1f10 2023-07-09T02:22:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf415f280 con 0x7facf415ce20 2023-07-09T02:22:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40ccfa0 con 0x7face0005180 2023-07-09T02:22:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf41f1f10 0x7facf40c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf41f1f10 0x7facf40c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46546/0 (socket says 172.21.15.45:46546) 2023-07-09T02:22:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 -- 172.21.15.45:0/1632980883 learned_addr learned my addr 172.21.15.45:0/1632980883 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:50.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf3fff640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0005180 0x7facf415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:50.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facebfff640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf415ce20 0x7facf40cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:50.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 -- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0005180 msgr2=0x7facf415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:50.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0005180 0x7facf415ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 -- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf415ce20 msgr2=0x7facf40cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:50.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf415ce20 0x7facf40cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 -- 172.21.15.45:0/1632980883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf414c5d0 con 0x7facf41f1f10 2023-07-09T02:22:50.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facebfff640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf415ce20 0x7facf40cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf892c640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf41f1f10 0x7facf40c9b10 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7facec0986c0 tx=0x7facec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf17fa640 1 -- 172.21.15.45:0/1632980883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0a5db0 con 0x7facf41f1f10 2023-07-09T02:22:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf17fa640 1 -- 172.21.15.45:0/1632980883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec0b6480 con 0x7facf41f1f10 2023-07-09T02:22:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf40cbca0 con 0x7facf41f1f10 2023-07-09T02:22:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf17fa640 1 -- 172.21.15.45:0/1632980883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0b67f0 con 0x7facf41f1f10 2023-07-09T02:22:50.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf40cc260 con 0x7facf41f1f10 2023-07-09T02:22:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf40cc780 con 0x7facf41f1f10 2023-07-09T02:22:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.252+0000 7facf17fa640 1 -- 172.21.15.45:0/1632980883 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7facec0b6950 con 0x7facf41f1f10 2023-07-09T02:22:50.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.256+0000 7facf17fa640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd4066280 0x7facd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:50.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.256+0000 7facf17fa640 1 -- 172.21.15.45:0/1632980883 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6062+0+0 (secure 0 0 0) 0x7facec11eb00 con 0x7facf41f1f10 2023-07-09T02:22:50.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.256+0000 7facf3fff640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd4066280 0x7facd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:50.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.256+0000 7facf3fff640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd4066280 0x7facd4068730 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7face4000c10 tx=0x7face4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:50.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.260+0000 7facf17fa640 1 -- 172.21.15.45:0/1632980883 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7facec120e60 con 0x7facf41f1f10 2023-07-09T02:22:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.412+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7facf41600f0 con 0x7facf41f1f10 2023-07-09T02:22:50.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facf17fa640 1 -- 172.21.15.45:0/1632980883 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v183) v1 ==== 81+0+36949 (secure 0 0 0) 0x7facec0ec090 con 0x7facf41f1f10 2023-07-09T02:22:50.416 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:50.416 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:22:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 183, 2023-07-09T02:22:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:22:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:22:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:22:49.486640+0000", 2023-07-09T02:22:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:22:50.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:22:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:22:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:22:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:22:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:22:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:22:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:22:50.418 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:22:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:22:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:22:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:22:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:22:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:22:50.419 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 24, 2023-07-09T02:22:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:22:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:22:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:22:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:22:50.420 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:22:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:22:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:22:50.421 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:22:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:22:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:50.422 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:50.423 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:50.424 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:22:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:22:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:22:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:22:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:22:50.426 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:50.427 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:22:50.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:50.430 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:50.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:50.432 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:50.433 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:22:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:22:50.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:22:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:22:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:22:50.435 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:22:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:22:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:22:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:50.436 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:22:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:22:50.437 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:22:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:50.438 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:22:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:22:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:22:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:22:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:22:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:50.440 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:22:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:50.441 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:50.442 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:50.443 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:50.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:50.445 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:22:50.446 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:22:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:22:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:22:50.447 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:22:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:22:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:22:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.448 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 23, 2023-07-09T02:22:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:22:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:37.645121+0000", 2023-07-09T02:22:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:50.449 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:50.450 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:22:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:22:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:22:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:22:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:22:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:50.451 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.452 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "181", 2023-07-09T02:22:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:50.453 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:50.454 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:50.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:50.456 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:50.457 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:22:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:22:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:22:50.458 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:22:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:22:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2, 2023-07-09T02:22:50.459 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2, 2023-07-09T02:22:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:22:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:22:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:22:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:50.460 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 24, 2023-07-09T02:22:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:22:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:38.115103+0000", 2023-07-09T02:22:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:50.461 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:50.462 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:22:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:22:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:22:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:22:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:22:50.463 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:50.464 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "183", 2023-07-09T02:22:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:50.465 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:22:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:50.466 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:50.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:50.469 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:22:50.470 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:22:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:22:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:22:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:50.471 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:22:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:22:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:22:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:22:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:22:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:50.472 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:22:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:22:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:50.473 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:50.474 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:22:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:50.475 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:22:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:22:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.478 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:22:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.480 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:22:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.481 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:22:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.482 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:22:50.483 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.484 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:22:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.485 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:22:50.486 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:22:50.486 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:22:50.486 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:22:50.486 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:50.486 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.487 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:22:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:50.488 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:50.489 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:50.489 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:50.489 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:50.490 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:50.490 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:50.490 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:50.490 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:50.490 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:50.491 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.491 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.491 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.491 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:22:50.491 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:50.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.492 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.492 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.492 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:22:50.492 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:50.493 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.493 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.493 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:50.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.493 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:22:50.494 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:50.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.494 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.494 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:22:50.494 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:50.495 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.495 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.495 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:50.495 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.495 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.495 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:22:50.496 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:50.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.496 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.496 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.496 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:22:50.496 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:50.496 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.497 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.497 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:50.497 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.497 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.497 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:22:50.497 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:22:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.498 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.499 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:22:50.499 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:22:50.499 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:22:50.499 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:22:50.499 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:50.499 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:50.499 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:50.500 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.500 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.500 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:22:50.500 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:50.500 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:50.500 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:50.501 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:50.501 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:50.501 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:50.501 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:50.501 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:50.501 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:50.501 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:50.501 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:50.502 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:50.502 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.502 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.502 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:22:50.502 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:50.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.503 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.503 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:22:50.503 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:50.503 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.503 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.504 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:50.504 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.504 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.504 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.504 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:22:50.504 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:50.504 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.505 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.505 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.505 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:22:50.505 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:50.505 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.505 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.506 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:50.506 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.506 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.506 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:22:50.506 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:50.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.507 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.507 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:22:50.507 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:50.507 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.507 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.507 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:50.507 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.508 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.508 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.508 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:22:50.508 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:50.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.508 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.508 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:22:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:22:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:22:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:22:50.510 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:22:50.510 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:50.510 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:50.510 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:50.510 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.510 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.510 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:22:50.511 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:50.511 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:50.511 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:50.511 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:50.511 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:50.511 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:50.511 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:50.511 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:50.512 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:50.512 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:50.512 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:50.512 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:50.512 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.512 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.512 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.513 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:22:50.513 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:50.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.513 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.513 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.513 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:22:50.513 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:50.513 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.514 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.514 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:50.514 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.514 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.514 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.514 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:22:50.514 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:50.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.515 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.515 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.515 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:22:50.515 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:50.515 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.515 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.516 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:50.516 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.516 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.516 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.516 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:22:50.516 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:50.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.517 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.517 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:22:50.517 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:50.517 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.517 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.518 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:50.518 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.518 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.518 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.518 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:22:50.519 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:50.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.519 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.519 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.519 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:22:50.519 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:50.519 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.520 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.520 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:22:50.520 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:22:50.520 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:22:50.520 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:22:50.520 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:50.521 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:50.521 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:50.521 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.521 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.521 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:22:50.521 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:50.522 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:50.522 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:50.522 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:50.522 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:50.522 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:50.522 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:50.522 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:50.522 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:50.523 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:50.523 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:50.523 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:50.523 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.523 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.523 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.523 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:22:50.523 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:50.524 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.524 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.524 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.524 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:22:50.524 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:50.524 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.524 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.525 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:50.525 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.525 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.525 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.525 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:22:50.525 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:50.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.526 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.526 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.526 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:22:50.526 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:50.526 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.526 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.526 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.527 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:50.527 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.527 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.527 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.527 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:22:50.527 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:50.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.527 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.528 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.528 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:22:50.528 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:50.528 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.528 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.528 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.528 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:50.529 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.529 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.529 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.529 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:22:50.529 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:50.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.529 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.529 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.530 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:22:50.530 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:50.530 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.530 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.530 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.530 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:22:50.530 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:22:50.530 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:22:50.531 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:22:50.531 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:50.531 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:50.531 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:50.531 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.531 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.532 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:22:50.532 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:50.532 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:50.532 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:50.532 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:50.532 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:50.532 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:50.533 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:50.533 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:50.533 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:50.533 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:50.533 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:50.533 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:50.533 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.533 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.534 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.534 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:22:50.534 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:50.534 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.534 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.534 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.534 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:22:50.534 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:50.535 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.535 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.535 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:50.535 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.535 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.536 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.536 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:22:50.536 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:50.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.536 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.536 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:22:50.537 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:50.537 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.537 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.537 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.537 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:50.537 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.537 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.538 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.538 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:22:50.538 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:50.538 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.538 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.538 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:22:50.538 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:50.539 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.539 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.539 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:50.539 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.539 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.539 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.539 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:22:50.540 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:50.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.540 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.540 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:22:50.540 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:50.540 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.541 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.541 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:22:50.541 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:22:50.541 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:22:50.541 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:22:50.541 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:50.541 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:50.542 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:50.542 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.542 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:22:50.542 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:50.542 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:50.542 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:50.543 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:50.543 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:50.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:50.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:50.543 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:50.543 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:50.543 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:50.544 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:50.544 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:50.544 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.544 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.544 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.544 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:22:50.544 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:50.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.545 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.545 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.545 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:22:50.545 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:50.545 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.546 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.546 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:50.546 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.546 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.546 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.546 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:22:50.546 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:50.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.547 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.547 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.547 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:22:50.547 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:50.547 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.547 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.548 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:50.548 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.548 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.548 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:22:50.548 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:50.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.549 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.549 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.549 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:22:50.549 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:50.549 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.549 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.550 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:50.550 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.550 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.550 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:22:50.550 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:50.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.551 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.551 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:22:50.551 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:50.551 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.551 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.551 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:22:50.551 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:22:50.552 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:22:50.552 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:22:50.552 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:50.552 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:50.552 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:50.552 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.553 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.553 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:22:50.553 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:50.553 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:50.553 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:50.553 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:50.553 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:50.553 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:50.554 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:50.554 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:50.554 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:50.554 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:50.554 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:50.554 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:50.554 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.555 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.555 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.555 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:22:50.555 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:50.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.555 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.555 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.556 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:22:50.556 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:50.556 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.556 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.556 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:50.556 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.557 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.557 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.557 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:22:50.557 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:50.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.557 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.557 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.557 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:22:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.558 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.559 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:22:50.559 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:50.559 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.559 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.559 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.559 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:22:50.559 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:50.559 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.560 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.560 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.560 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:50.560 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:50.560 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.560 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:50.560 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:22:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:22:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.561 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.562 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.562 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:22:50.562 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:22:50.562 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:22:50.562 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:22:50.562 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:50.562 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:50.562 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:50.563 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:50.563 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.563 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:50.563 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:22:50.563 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.563 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:22:50.563 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:50.564 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:50.564 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:50.564 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:50.564 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:50.564 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:22:50.564 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:50.564 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.565 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.565 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:22:50.565 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:50.565 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:50.566 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:50.566 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:50.566 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:50.566 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:22:50.567 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:50.567 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.567 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.567 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:22:50.568 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:50.568 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:50.568 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:50.569 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:50.569 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:50.569 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:22:50.569 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:50.570 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.570 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.570 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:22:50.570 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:50.571 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:50.571 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:50.571 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:50.571 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:50.571 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:22:50.572 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:50.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.572 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.572 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:22:50.572 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:50.572 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:50.572 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:50.572 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:50.573 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:50.573 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:22:50.573 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:50.573 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.573 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.573 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:22:50.573 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:50.573 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:50.574 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:50.574 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:50.574 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:50.574 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:22:50.574 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:50.574 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.574 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.574 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:22:50.575 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:50.575 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:50.575 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:50.575 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:50.575 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:50.575 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:22:50.575 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:50.576 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.576 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:50.576 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:22:50.576 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:50.576 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:50.576 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:50.576 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:50.577 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:50.577 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:22:50.577 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:50.577 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.577 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:50.578 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:22:50.578 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:22:50.578 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:22:50.578 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:22:50.579 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:22:50.579 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:22:50.579 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:22:50.579 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:22:50.580 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:22:50.580 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:22:50.580 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:22:50.581 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:22:50.581 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:22:50.581 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:22:50.581 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.582 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:50.582 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:22:50.582 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:22:50.582 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:22:50.582 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:22:50.583 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:22:50.583 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:22:50.584 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:22:50.584 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:22:50.584 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:22:50.584 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:22:50.585 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:22:50.585 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:50.585 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:22:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd4066280 msgr2=0x7facd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd4066280 0x7facd4068730 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7face4000c10 tx=0x7face4009040 comp rx=0 tx=0).stop 2023-07-09T02:22:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf41f1f10 msgr2=0x7facf40c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf41f1f10 0x7facf40c9b10 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7facec0986c0 tx=0x7facec009750 comp rx=0 tx=0).stop 2023-07-09T02:22:50.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 shutdown_connections 2023-07-09T02:22:50.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facf41f1f10 0x7facf40c9b10 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf415ce20 0x7facf40cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7facd4066280 0x7facd4068730 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 --2- 172.21.15.45:0/1632980883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7face0005180 0x7facf415ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 >> 172.21.15.45:0/1632980883 conn(0x7facf40698e0 msgr2=0x7facf40b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 shutdown_connections 2023-07-09T02:22:50.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:50.416+0000 7facfa38f640 1 -- 172.21.15.45:0/1632980883 wait complete. 2023-07-09T02:22:50.591 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:22:55.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:22:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.748+0000 7f7d7dd74640 1 Processor -- start 2023-07-09T02:22:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.748+0000 7f7d7dd74640 1 -- start start 2023-07-09T02:22:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d7dd74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d7815c060 0x7f7d780b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d7dd74640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d78160a50 con 0x7f7d780cd120 2023-07-09T02:22:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d7dd74640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7815c430 con 0x7f7d780d2620 2023-07-09T02:22:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d7dd74640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7815fb60 con 0x7f7d7815c060 2023-07-09T02:22:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d777fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d7815c060 0x7f7d780b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d777fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d7815c060 0x7f7d780b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41980/0 (socket says 172.21.15.45:41980) 2023-07-09T02:22:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d777fe640 1 -- 172.21.15.45:0/3511883675 learned_addr learned my addr 172.21.15.45:0/3511883675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d76ffd640 1 --1- 172.21.15.45:0/3511883675 >> v1:172.21.15.45:6789/0 conn(0x7f7d780cd120 0x7f7d780d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34542/0 (socket says 172.21.15.45:34542) 2023-07-09T02:22:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d777fe640 1 -- 172.21.15.45:0/3511883675 >> v1:172.21.15.155:6789/0 conn(0x7f7d780d2620 legacy=0x7f7d780cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d777fe640 1 -- 172.21.15.45:0/3511883675 >> v1:172.21.15.45:6789/0 conn(0x7f7d780cd120 legacy=0x7f7d780d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:55.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.752+0000 7f7d777fe640 1 -- 172.21.15.45:0/3511883675 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7815fe40 con 0x7f7d7815c060 2023-07-09T02:22:55.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d777fe640 1 --2- 172.21.15.45:0/3511883675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d7815c060 0x7f7d780b4ed0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009870 tx=0x7f7d6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4e6846e407cd5e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:55.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d767fc640 1 -- 172.21.15.45:0/3511883675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680aa430 con 0x7f7d7815c060 2023-07-09T02:22:55.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d767fc640 1 -- 172.21.15.45:0/3511883675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680aa590 con 0x7f7d7815c060 2023-07-09T02:22:55.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d767fc640 1 -- 172.21.15.45:0/3511883675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680aa920 con 0x7f7d7815c060 2023-07-09T02:22:55.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 -- 172.21.15.45:0/3511883675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d7815c060 msgr2=0x7f7d780b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:55.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 --2- 172.21.15.45:0/3511883675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d7815c060 0x7f7d780b4ed0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009870 tx=0x7f7d6801c4d0 comp rx=0 tx=0).stop 2023-07-09T02:22:55.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 -- 172.21.15.45:0/3511883675 shutdown_connections 2023-07-09T02:22:55.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 --2- 172.21.15.45:0/3511883675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d7815c060 0x7f7d780b4ed0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:55.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 -- 172.21.15.45:0/3511883675 >> 172.21.15.45:0/3511883675 conn(0x7f7d780698e0 msgr2=0x7f7d78069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:55.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 -- 172.21.15.45:0/3511883675 shutdown_connections 2023-07-09T02:22:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 -- 172.21.15.45:0/3511883675 wait complete. 2023-07-09T02:22:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 Processor -- start 2023-07-09T02:22:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 -- start start 2023-07-09T02:22:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.756+0000 7f7d7dd74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d780cd120 0x7f7d78152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d7dd74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d780d2620 0x7f7d78155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d7dd74640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d7815c060 0x7f7d7815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d7dd74640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78151bd0 con 0x7f7d780cd120 2023-07-09T02:22:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d7dd74640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7815ec30 con 0x7f7d7815c060 2023-07-09T02:22:55.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d7dd74640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78151880 con 0x7f7d780d2620 2023-07-09T02:22:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d780cd120 0x7f7d78152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d780cd120 0x7f7d78152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41994/0 (socket says 172.21.15.45:41994) 2023-07-09T02:22:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 -- 172.21.15.45:0/1439173116 learned_addr learned my addr 172.21.15.45:0/1439173116 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d76ffd640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d780d2620 0x7f7d78155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d77fff640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d7815c060 0x7f7d7815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 -- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d780d2620 msgr2=0x7f7d78155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d780d2620 0x7f7d78155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 -- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d7815c060 msgr2=0x7f7d7815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d7815c060 0x7f7d7815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 -- 172.21.15.45:0/1439173116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d680094d0 con 0x7f7d780cd120 2023-07-09T02:22:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d777fe640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d780cd120 0x7f7d78152060 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f7d680ac040 tx=0x7f7d6801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d5ffff640 1 -- 172.21.15.45:0/1439173116 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680b3800 con 0x7f7d780cd120 2023-07-09T02:22:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d5ffff640 1 -- 172.21.15.45:0/1439173116 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680b3980 con 0x7f7d780cd120 2023-07-09T02:22:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d5ffff640 1 -- 172.21.15.45:0/1439173116 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680b3d30 con 0x7f7d780cd120 2023-07-09T02:22:55.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d780b59f0 con 0x7f7d780cd120 2023-07-09T02:22:55.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7815e950 con 0x7f7d780cd120 2023-07-09T02:22:55.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7804d7d0 con 0x7f7d780cd120 2023-07-09T02:22:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.760+0000 7f7d5ffff640 1 -- 172.21.15.45:0/1439173116 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d680b2380 con 0x7f7d780cd120 2023-07-09T02:22:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.764+0000 7f7d5ffff640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d64066280 0x7f7d64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.764+0000 7f7d5ffff640 1 -- 172.21.15.45:0/1439173116 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d6811e270 con 0x7f7d780cd120 2023-07-09T02:22:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.764+0000 7f7d5ffff640 1 -- 172.21.15.45:0/1439173116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f7d6406e3c0 con 0x7f7d780cd120 2023-07-09T02:22:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.764+0000 7f7d76ffd640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d64066280 0x7f7d64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:55.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.764+0000 7f7d76ffd640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d64066280 0x7f7d64068730 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7d780d0510 tx=0x7f7d6c007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:55.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.768+0000 7f7d5ffff640 1 -- 172.21.15.45:0/1439173116 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d680eb830 con 0x7f7d780cd120 2023-07-09T02:22:55.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.924+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7d781519c0 con 0x7f7d780cd120 2023-07-09T02:22:55.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.924+0000 7f7d5ffff640 1 -- 172.21.15.45:0/1439173116 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) v1 ==== 81+0+36968 (secure 0 0 0) 0x7f7d680c3020 con 0x7f7d780cd120 2023-07-09T02:22:55.927 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:55.927 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:22:55.927 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 184, 2023-07-09T02:22:55.927 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:22:55.927 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:22:55.927 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:22:54.475364+0000", 2023-07-09T02:22:55.928 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:22:55.928 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:22:55.928 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:22:55.928 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:22:55.928 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:22:55.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:22:55.929 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:22:55.929 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:22:55.929 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:22:55.929 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:55.929 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:22:55.929 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:22:55.929 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:22:55.929 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:22:55.930 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:22:55.930 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 24, 2023-07-09T02:22:55.930 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:22:55.930 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:22:55.930 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:22:55.930 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:22:55.931 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:22:55.931 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:22:55.931 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.931 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:22:55.931 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:22:55.931 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:22:55.931 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:55.931 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:55.932 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:55.932 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:55.932 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:55.932 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:55.932 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:55.932 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:55.932 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:55.933 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:55.933 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:55.933 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:55.933 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:22:55.933 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:22:55.933 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:22:55.933 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:22:55.933 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:22:55.934 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:55.934 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:55.934 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:55.934 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:55.934 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:55.934 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:55.934 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:55.934 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.935 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:22:55.935 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:55.935 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:55.935 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:55.935 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:55.935 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:55.935 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:55.935 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:55.936 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:55.936 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:55.936 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:55.936 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:55.936 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:55.936 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:55.936 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:55.936 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:55.937 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:55.939 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:22:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:22:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:22:55.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:22:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:22:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:22:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:22:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:22:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:55.941 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:22:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:22:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:22:55.942 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:55.943 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:22:55.944 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:22:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:22:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:22:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:22:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:55.945 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:55.946 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:55.946 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:55.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.946 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:22:55.946 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:55.946 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:55.946 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:55.946 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:55.947 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:55.947 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:55.947 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:55.947 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:55.947 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:55.947 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:55.947 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:55.947 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:55.948 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:55.948 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:55.948 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:55.948 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:55.948 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:55.948 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:55.948 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:55.949 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:55.949 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:55.949 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:55.949 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:55.949 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:55.949 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:55.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:55.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.950 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:55.950 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:55.950 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:55.950 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:55.950 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:55.950 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:55.950 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:55.951 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:55.951 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:55.951 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:55.951 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:55.951 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:22:55.951 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:55.951 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:22:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:22:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:22:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:22:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:22:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:22:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:55.953 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:55.953 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:55.953 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.953 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.953 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 23, 2023-07-09T02:22:55.953 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:22:55.953 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:37.645121+0000", 2023-07-09T02:22:55.954 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:55.954 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:55.954 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:55.954 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:55.954 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:55.954 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:55.954 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:55.955 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:55.955 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:55.955 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:55.955 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:55.955 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:55.955 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:22:55.955 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:22:55.955 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:22:55.956 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:22:55.956 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:22:55.956 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:55.956 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:55.956 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:55.956 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:55.956 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:55.956 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:55.957 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:55.957 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.957 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "181", 2023-07-09T02:22:55.957 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:55.957 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:55.957 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:55.957 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:55.958 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:55.958 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:55.958 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:55.958 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:55.958 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:55.958 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:55.958 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:55.960 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:55.960 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:55.960 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:55.960 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:55.960 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:55.960 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:55.960 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:55.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.961 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:55.961 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:55.961 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:55.961 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:55.961 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:55.961 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:55.961 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:55.962 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:55.962 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:55.962 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:55.962 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:55.962 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:55.962 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:22:55.962 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:22:55.962 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:22:55.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.963 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:55.963 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:22:55.963 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:22:55.963 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.963 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:55.963 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2, 2023-07-09T02:22:55.964 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2, 2023-07-09T02:22:55.964 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:22:55.964 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:22:55.964 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:22:55.964 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:55.964 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:55.964 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:55.965 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.965 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.965 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 24, 2023-07-09T02:22:55.965 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:22:55.965 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:38.115103+0000", 2023-07-09T02:22:55.965 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:22:55.965 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:22:55.966 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:55.966 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:55.966 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:55.966 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:55.966 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:55.966 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:55.966 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:55.967 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:55.967 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:55.967 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:55.967 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:22:55.967 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:22:55.967 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:22:55.967 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:22:55.968 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:22:55.968 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:55.968 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:55.968 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:55.968 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:55.968 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:55.968 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:55.969 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:55.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.969 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "184", 2023-07-09T02:22:55.969 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:55.969 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:55.969 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:55.969 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:55.969 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:55.970 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:55.970 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:55.970 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:55.970 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:55.970 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:22:55.970 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:55.970 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:55.971 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:55.971 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:55.971 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:55.971 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:55.971 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:55.971 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:55.971 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:55.972 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:55.972 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:55.972 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:55.972 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:55.972 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:55.972 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:55.973 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:55.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.973 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:55.973 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:55.973 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:55.973 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:55.973 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:55.973 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:55.974 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:55.974 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:55.974 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:55.974 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:55.974 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:55.974 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:55.974 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:22:55.975 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:22:55.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.975 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:55.975 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:22:55.975 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:22:55.975 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.976 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:55.976 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:22:55.976 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:22:55.976 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:22:55.976 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:22:55.976 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:22:55.976 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:55.977 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:55.977 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:55.977 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.977 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.977 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:55.978 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:22:55.978 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.978 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:22:55.978 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:55.979 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:55.979 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:55.979 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:55.980 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:55.980 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:55.980 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:55.981 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:55.981 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:55.981 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:55.982 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:55.982 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:55.982 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:55.982 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.983 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:55.983 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:22:55.983 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:55.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.984 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.984 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:55.984 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:22:55.985 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:55.985 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.985 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:55.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.985 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:55.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:55.986 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.986 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:55.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:22:55.987 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:55.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.987 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:55.988 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:22:55.988 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:55.988 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.988 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:55.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.988 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:55.988 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:55.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:55.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:22:55.989 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:55.989 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:22:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:55.990 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.991 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:55.991 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:22:55.991 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:55.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.991 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.991 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:55.991 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:22:55.991 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:55.992 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.992 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:55.992 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.992 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:22:55.992 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:22:55.992 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:22:55.992 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:22:55.993 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:55.993 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:55.993 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:55.993 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:55.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.993 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.993 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:22:55.993 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:55.994 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:55.994 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:55.994 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:55.994 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:55.994 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:55.994 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:55.994 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:55.995 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:55.995 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:55.995 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:55.995 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:55.995 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:55.995 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:55.996 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:22:55.996 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:55.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.996 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.996 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:55.996 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:22:55.996 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:55.997 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.997 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:55.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.997 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:55.997 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:55.997 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:55.998 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:22:55.998 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:55.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.998 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.998 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:55.998 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:22:55.998 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:55.998 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:55.999 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:55.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:55.999 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:55.999 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:55.999 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:55.999 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.000 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:22:56.000 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.000 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.000 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.000 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:22:56.000 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.001 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.001 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.001 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.001 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.001 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.001 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.001 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:22:56.002 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.002 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.002 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.002 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:22:56.002 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.002 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.003 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.003 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:22:56.003 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:22:56.003 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:22:56.003 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:22:56.003 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.004 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.004 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.004 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.004 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.004 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:22:56.004 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.004 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.005 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.005 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.005 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.005 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.005 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.005 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.005 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.006 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.006 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.006 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.006 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.006 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.006 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.007 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:22:56.007 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.007 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.007 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.007 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:22:56.007 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.008 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.008 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.008 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.010 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:22:56.010 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.010 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.011 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.011 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:22:56.011 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.011 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.012 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.012 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.012 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.013 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.013 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.013 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.014 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:22:56.014 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.014 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.014 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.015 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.015 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:22:56.015 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.016 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.016 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.016 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.016 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.016 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.017 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.017 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.017 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:22:56.017 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.018 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.018 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.018 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.019 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:22:56.019 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.019 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.019 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.019 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.019 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:22:56.020 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:22:56.020 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:22:56.020 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:22:56.020 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.020 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.020 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.020 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.021 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.021 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.021 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:22:56.021 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.021 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.021 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.021 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.021 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.022 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.022 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.022 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.022 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.022 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.022 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.022 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.022 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:22:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.023 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:22:56.024 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.024 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.024 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.024 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.024 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.024 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.025 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.025 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.025 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:22:56.025 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.025 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.025 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.025 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.026 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:22:56.026 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.026 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.026 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.026 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.026 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.026 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.027 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.027 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.027 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:22:56.027 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.027 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.027 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.027 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.027 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:22:56.028 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.028 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.028 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.028 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.028 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.028 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.029 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.029 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.029 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:22:56.029 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.029 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.029 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.029 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.030 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:22:56.030 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.030 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.030 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.030 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.030 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:22:56.030 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:22:56.030 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:22:56.031 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:22:56.031 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.031 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.031 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.031 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.031 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.032 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.032 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:22:56.032 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.032 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.032 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.032 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.032 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.033 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.033 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.033 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.033 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.033 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.033 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.033 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.033 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.034 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.034 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.034 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:22:56.034 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.034 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.034 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.034 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.034 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:22:56.035 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.035 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.035 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.035 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.035 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.035 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.035 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.035 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.036 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:22:56.036 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.036 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.036 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.036 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.037 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:22:56.037 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.037 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.038 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.038 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.038 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.038 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.039 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.039 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.039 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:22:56.039 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.040 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.040 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.041 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:22:56.041 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.041 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.041 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.042 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.042 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.042 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.043 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.043 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:22:56.043 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.043 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.043 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.043 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:22:56.043 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.044 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.044 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.044 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.044 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:22:56.044 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:22:56.044 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:22:56.044 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:22:56.045 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.045 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.045 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.045 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.045 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.045 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.045 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:22:56.046 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.046 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.046 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.046 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.046 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.046 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.046 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.048 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:22:56.048 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.048 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.048 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.048 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.048 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:22:56.049 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.049 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.049 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.049 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.049 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.049 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.049 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.050 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.050 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:22:56.050 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.050 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.050 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.050 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.050 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:22:56.051 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.051 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.051 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.051 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.051 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.051 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.051 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.051 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.052 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:22:56.052 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.052 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.052 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.052 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.052 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:22:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.053 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:22:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:22:56.054 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:22:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:22:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:22:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:22:56.055 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:22:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.056 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.057 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.058 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:22:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:22:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.059 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:22:56.060 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:22:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.061 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.062 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.062 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.062 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.062 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.062 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:22:56.062 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.062 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.063 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.063 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.063 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:22:56.063 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.063 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.063 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.063 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.063 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.064 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.064 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.064 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.064 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:22:56.064 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.064 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.064 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.065 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.065 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:22:56.065 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.065 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.065 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.066 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.066 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:22:56.066 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:22:56.066 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:22:56.066 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:22:56.066 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.067 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:22:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.068 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.069 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:22:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.070 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:22:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:22:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.072 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:22:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.073 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:22:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.074 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:22:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:22:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.076 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:22:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:22:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:22:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:22:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:22:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:22:56.079 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:22:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.080 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:22:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:22:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.081 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.082 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:22:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:22:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:22:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.084 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:22:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.085 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:22:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.086 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.087 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.087 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:22:56.087 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.087 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.088 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.088 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.088 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.088 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:22:56.089 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.089 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.089 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.089 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:22:56.090 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.090 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.090 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.090 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.090 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.090 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:22:56.091 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.091 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.091 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.091 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:22:56.091 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.091 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.091 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.091 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:22:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:22:56.092 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:22:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.093 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:22:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:22:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:22:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:22:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:22:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:22:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:22:56.094 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:22:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:22:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:22:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:22:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:22:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:22:56.095 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:22:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:22:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:22:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:22:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:22:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:22:56.096 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:22:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:22:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:22:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:22:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:22:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:22:56.097 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.097 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:22:56.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d64066280 msgr2=0x7f7d64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:56.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d64066280 0x7f7d64068730 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7d780d0510 tx=0x7f7d6c007c90 comp rx=0 tx=0).stop 2023-07-09T02:22:56.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d780cd120 msgr2=0x7f7d78152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:56.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d780cd120 0x7f7d78152060 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f7d680ac040 tx=0x7f7d6801ad10 comp rx=0 tx=0).stop 2023-07-09T02:22:56.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 shutdown_connections 2023-07-09T02:22:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d7815c060 0x7f7d7815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7d64066280 0x7f7d64068730 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d780d2620 0x7f7d78155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 --2- 172.21.15.45:0/1439173116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d780cd120 0x7f7d78152060 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 >> 172.21.15.45:0/1439173116 conn(0x7f7d780698e0 msgr2=0x7f7d780b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 shutdown_connections 2023-07-09T02:22:56.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:55.928+0000 7f7d7dd74640 1 -- 172.21.15.45:0/1439173116 wait complete. 2023-07-09T02:22:56.101 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-07-09T02:22:56.102 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:22:56.102 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:22:56.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:56.111 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-07-09T02:22:56.461 INFO:teuthology.orchestra.run.smithi045.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-07-09T02:22:56.462 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records in 2023-07-09T02:22:56.462 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records out 2023-07-09T02:22:56.462 INFO:teuthology.orchestra.run.smithi045.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.295356 s, 178 MB/s 2023-07-09T02:22:56.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:22:56.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:22:56.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d4656640 1 Processor -- start 2023-07-09T02:22:56.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d4656640 1 -- start start 2023-07-09T02:22:56.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d4656640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 0x7fb6cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:56.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d4656640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb6cc0cd120 0x7fb6cc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:56.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d4656640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb6cc0d2450 0x7fb6cc0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:56.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d4656640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc0d28f0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d4656640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc160a50 con 0x7fb6cc0cd120 2023-07-09T02:22:56.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d4656640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc15c430 con 0x7fb6cc15c060 2023-07-09T02:22:56.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d2bf3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb6cc0d2450 0x7fb6cc0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:56.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d2bf3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb6cc0d2450 0x7fb6cc0d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42008/0 (socket says 172.21.15.45:42008) 2023-07-09T02:22:56.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d2bf3640 1 -- 172.21.15.45:0/2724632994 learned_addr learned my addr 172.21.15.45:0/2724632994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:56.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d23f2640 1 --2- 172.21.15.45:0/2724632994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 0x7fb6cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:56.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d1bf1640 1 --2- 172.21.15.45:0/2724632994 >> v2:172.21.15.155:3300/0 conn(0x7fb6cc0cd120 0x7fb6cc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:56.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d2bf3640 1 -- 172.21.15.45:0/2724632994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 msgr2=0x7fb6cc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:56.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d2bf3640 1 --2- 172.21.15.45:0/2724632994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 0x7fb6cc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d2bf3640 1 -- 172.21.15.45:0/2724632994 >> v2:172.21.15.155:3300/0 conn(0x7fb6cc0cd120 msgr2=0x7fb6cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:56.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d2bf3640 1 --2- 172.21.15.45:0/2724632994 >> v2:172.21.15.155:3300/0 conn(0x7fb6cc0cd120 0x7fb6cc0d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.608+0000 7fb6d2bf3640 1 -- 172.21.15.45:0/2724632994 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc15fb60 con 0x7fb6cc0d2450 2023-07-09T02:22:56.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d2bf3640 1 --2- 172.21.15.45:0/2724632994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0d0610 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0b5600 tx=0x7fb6c401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8219360101ee7048 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:56.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d13f0640 1 -- 172.21.15.45:0/2724632994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40a5560 con 0x7fb6cc0d2450 2023-07-09T02:22:56.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d13f0640 1 -- 172.21.15.45:0/2724632994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c40a56c0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d13f0640 1 -- 172.21.15.45:0/2724632994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40a5a50 con 0x7fb6cc0d2450 2023-07-09T02:22:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 -- 172.21.15.45:0/2724632994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 msgr2=0x7fb6cc0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 --2- 172.21.15.45:0/2724632994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0d0610 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0b5600 tx=0x7fb6c401c6e0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 -- 172.21.15.45:0/2724632994 shutdown_connections 2023-07-09T02:22:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 --2- 172.21.15.45:0/2724632994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0d0610 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 --2- 172.21.15.45:0/2724632994 >> v2:172.21.15.155:3300/0 conn(0x7fb6cc0cd120 0x7fb6cc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 --2- 172.21.15.45:0/2724632994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 0x7fb6cc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 -- 172.21.15.45:0/2724632994 >> 172.21.15.45:0/2724632994 conn(0x7fb6cc0698e0 msgr2=0x7fb6cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:56.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 -- 172.21.15.45:0/2724632994 shutdown_connections 2023-07-09T02:22:56.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.612+0000 7fb6d4656640 1 -- 172.21.15.45:0/2724632994 wait complete. 2023-07-09T02:22:56.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 Processor -- start 2023-07-09T02:22:56.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 -- start start 2023-07-09T02:22:56.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0cd120 0x7fb6cc151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 0x7fb6cc15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1f4fe0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc151fb0 con 0x7fb6cc0cd120 2023-07-09T02:22:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1f4680 con 0x7fb6cc15c060 2023-07-09T02:22:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42016/0 (socket says 172.21.15.45:42016) 2023-07-09T02:22:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 -- 172.21.15.45:0/488174935 learned_addr learned my addr 172.21.15.45:0/488174935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d23f2640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0cd120 0x7fb6cc151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d2bf3640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 0x7fb6cc15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 -- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 msgr2=0x7fb6cc15ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 0x7fb6cc15ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 -- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0cd120 msgr2=0x7fb6cc151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0cd120 0x7fb6cc151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 -- 172.21.15.45:0/488174935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009b30 con 0x7fb6cc0d2450 2023-07-09T02:22:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d1bf1640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0ca7e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00e8b0 tx=0x7fb6bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6c2ffd640 1 -- 172.21.15.45:0/488174935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00c940 con 0x7fb6cc0d2450 2023-07-09T02:22:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6c2ffd640 1 -- 172.21.15.45:0/488174935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc00caa0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6c2ffd640 1 -- 172.21.15.45:0/488174935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00ce30 con 0x7fb6cc0d2450 2023-07-09T02:22:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc1f4920 con 0x7fb6cc0d2450 2023-07-09T02:22:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.616+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc1f5400 con 0x7fb6cc0d2450 2023-07-09T02:22:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.620+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc04d7d0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.620+0000 7fb6c2ffd640 1 -- 172.21.15.45:0/488174935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6bc013470 con 0x7fb6cc0d2450 2023-07-09T02:22:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.620+0000 7fb6c2ffd640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6b0066280 0x7fb6b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.620+0000 7fb6c2ffd640 1 -- 172.21.15.45:0/488174935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6bc083ab0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.620+0000 7fb6c2ffd640 1 -- 172.21.15.45:0/488174935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7fb6b006e3c0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.620+0000 7fb6d23f2640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6b0066280 0x7fb6b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:56.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.620+0000 7fb6d23f2640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6b0066280 0x7fb6b0068730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc158a80 tx=0x7fb6c8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:56.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.624+0000 7fb6c2ffd640 1 -- 172.21.15.45:0/488174935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6bc050fe0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.780+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb6cc06baa0 con 0x7fb6cc0d2450 2023-07-09T02:22:56.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.780+0000 7fb6c2ffd640 1 -- 172.21.15.45:0/488174935 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) v1 ==== 81+0+36968 (secure 0 0 0) 0x7fb6bc021090 con 0x7fb6cc0d2450 2023-07-09T02:22:56.783 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:56.783 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:22:56.784 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 184, 2023-07-09T02:22:56.784 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:22:56.784 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:22:56.784 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:22:54.475364+0000", 2023-07-09T02:22:56.784 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:22:56.784 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:22:56.784 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:22:56.785 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:22:56.785 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:22:56.785 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:22:56.785 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:22:56.785 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:22:56.785 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:22:56.785 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:56.785 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:22:56.786 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:22:56.786 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:22:56.786 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:22:56.786 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:22:56.786 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 24, 2023-07-09T02:22:56.786 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:22:56.786 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:22:56.786 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:22:56.787 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:22:56.787 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:22:56.787 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:22:56.787 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.787 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:22:56.787 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:22:56.787 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:22:56.788 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:56.788 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:56.788 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:56.788 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:56.788 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:56.789 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:56.789 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:56.789 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:56.789 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:56.789 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:56.789 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:56.789 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:22:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:22:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:22:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:22:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:22:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:56.791 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:56.791 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:56.791 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:56.791 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:56.791 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.791 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:22:56.792 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:56.792 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:56.792 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:56.792 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:56.792 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:56.792 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:56.792 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:56.793 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:56.793 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:56.793 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:56.793 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:56.793 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:56.793 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:56.793 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:56.794 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:56.794 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:56.794 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:56.794 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:56.794 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:56.794 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:56.794 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:56.794 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:56.795 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:56.795 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:56.795 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:56.795 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:56.795 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.795 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:56.795 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:56.795 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:56.796 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:56.796 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:56.796 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:56.796 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:56.796 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:56.796 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:56.796 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:56.797 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:56.797 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:56.797 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:22:56.797 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:22:56.797 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.797 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:56.797 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:22:56.797 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.798 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:56.798 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:22:56.798 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:22:56.798 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:22:56.798 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:22:56.799 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:22:56.799 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:56.799 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:56.799 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:56.800 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.800 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.800 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.801 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:22:56.801 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:22:56.801 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:22:56.801 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:56.802 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:56.802 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:56.802 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:56.802 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:56.803 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:56.803 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:56.803 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:56.804 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:56.804 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:56.804 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:56.805 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:56.805 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:22:56.805 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:22:56.806 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:22:56.806 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:22:56.806 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:22:56.806 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:56.806 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:56.807 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:56.807 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:56.807 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:56.807 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:56.808 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:56.808 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.808 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:22:56.808 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:56.809 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:56.809 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:56.809 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:56.809 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:56.809 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:56.809 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:56.810 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:56.810 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:56.810 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:56.810 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:56.810 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:56.810 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:56.810 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:56.811 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:56.811 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:56.811 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:56.811 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:56.811 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:56.811 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:56.811 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:56.811 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:56.812 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:56.812 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:56.812 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:56.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:56.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.812 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:56.812 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:56.813 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:56.813 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:56.813 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:56.813 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:56.813 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:56.813 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:56.813 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:56.813 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:56.814 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:56.814 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:22:56.814 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:56.814 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:22:56.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.814 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:56.814 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:22:56.815 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:22:56.815 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:22:56.815 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:22:56.815 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:22:56.815 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:56.815 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:56.815 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:56.815 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.816 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.816 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 23, 2023-07-09T02:22:56.816 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:22:56.816 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:37.645121+0000", 2023-07-09T02:22:56.816 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:56.816 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:56.816 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:56.817 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:56.817 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:56.817 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:56.817 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:56.817 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:56.817 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:56.817 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:56.818 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:56.818 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:56.818 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:22:56.818 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:22:56.818 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:22:56.818 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:22:56.818 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:22:56.818 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:56.819 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:56.819 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:56.819 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:56.819 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:56.819 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:56.819 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:56.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.819 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "181", 2023-07-09T02:22:56.820 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:56.820 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:56.820 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:56.820 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:56.820 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:56.821 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:56.821 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:56.821 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:56.821 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:56.821 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:56.821 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:56.821 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:56.821 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:56.822 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:56.822 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:56.822 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:56.822 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:56.822 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:56.823 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:56.823 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:56.823 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:56.823 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:56.823 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:56.823 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:56.824 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:56.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:56.824 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.824 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:56.824 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:56.824 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:56.824 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:56.824 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:56.825 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:56.825 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:56.825 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:56.825 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:56.825 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:56.825 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:56.825 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:56.825 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:22:56.826 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:22:56.826 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:22:56.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.826 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:56.826 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:22:56.826 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:22:56.826 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.827 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.827 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:56.827 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2, 2023-07-09T02:22:56.827 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2, 2023-07-09T02:22:56.827 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:22:56.827 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:22:56.827 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:22:56.827 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:56.828 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:56.828 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:56.828 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.828 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.828 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 24, 2023-07-09T02:22:56.828 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:22:56.829 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:38.115103+0000", 2023-07-09T02:22:56.829 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:22:56.829 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:22:56.829 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:56.829 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:56.829 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:56.829 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:56.829 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:56.830 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:56.830 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:56.830 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:56.830 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:56.830 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:56.830 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:22:56.830 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:22:56.830 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:22:56.831 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:22:56.831 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:22:56.831 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:56.831 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:56.831 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:56.831 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:56.831 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:56.832 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:56.832 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:56.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.832 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "184", 2023-07-09T02:22:56.832 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:56.832 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:56.832 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:56.832 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:56.833 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:56.833 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:56.833 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:56.833 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:56.833 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:56.833 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:22:56.833 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.836 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:56.836 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:56.836 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:56.836 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:56.836 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:56.836 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:56.836 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:56.837 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:56.837 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:56.837 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:56.837 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:56.837 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:56.837 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:22:56.837 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:22:56.837 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:22:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:22:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:22:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:22:56.839 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:22:56.839 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:22:56.839 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:22:56.839 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:56.839 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:56.839 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:56.839 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.840 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.840 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:56.840 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:22:56.840 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.840 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:22:56.840 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.840 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.840 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.841 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.841 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.841 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.841 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.841 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.841 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.841 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.841 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.842 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.842 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.842 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.842 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.842 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:22:56.842 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:56.842 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.842 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:22:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.843 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.844 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.844 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.844 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:22:56.844 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:56.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.844 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.844 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.844 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:22:56.845 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:56.845 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.845 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.845 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.845 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.845 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.845 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.846 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.846 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:22:56.846 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:56.846 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.846 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.846 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.846 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:22:56.846 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:56.847 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.847 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.847 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.847 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.847 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.847 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.847 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:22:56.848 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:56.848 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.848 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.848 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.848 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:22:56.848 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:56.848 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.849 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.849 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.849 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:22:56.849 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:22:56.849 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:22:56.849 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:22:56.849 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.850 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.850 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.850 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.850 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.850 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.850 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:22:56.850 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.850 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.851 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.851 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.851 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.851 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.851 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.851 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.851 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.851 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.852 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.852 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.852 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.852 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.852 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.852 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:22:56.852 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:22:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.853 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:22:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.855 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:22:56.855 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.855 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.855 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.855 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.856 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.856 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.856 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.856 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:22:56.856 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.856 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.857 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.857 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:22:56.857 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.857 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.857 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.857 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.857 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.857 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.858 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.858 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.858 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:22:56.858 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.858 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.858 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.858 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:22:56.859 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:56.859 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.859 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.859 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:22:56.859 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:22:56.859 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:22:56.860 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:22:56.860 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.860 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.860 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.860 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.860 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:22:56.861 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.861 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.861 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.861 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.861 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.861 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.861 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.862 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.862 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.862 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.862 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.862 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.862 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.862 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.862 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.863 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:22:56.863 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.863 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.863 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.863 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:22:56.863 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.863 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.864 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.864 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.864 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.864 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.864 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.864 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.864 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:22:56.865 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.865 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.865 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.865 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.865 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:22:56.865 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.865 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.865 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.866 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.866 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.866 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.866 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.866 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:22:56.866 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.867 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.867 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:22:56.867 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.867 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.867 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.868 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.868 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.868 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.868 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.868 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:22:56.868 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.868 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.869 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.869 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:22:56.869 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:56.869 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.869 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.869 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:22:56.869 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:22:56.870 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:22:56.870 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:22:56.870 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.870 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.870 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.870 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.871 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.871 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:22:56.871 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.871 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.871 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.871 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.871 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.871 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.872 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.872 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.872 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.872 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.872 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.872 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.872 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.873 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.873 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.873 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:22:56.873 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.873 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.873 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.873 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.873 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:22:56.874 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.874 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.874 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.874 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.874 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.874 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.874 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.875 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:22:56.875 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.875 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.875 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.875 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.875 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:22:56.875 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.875 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:22:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:22:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:22:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.879 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.879 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:22:56.879 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:56.879 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.879 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.879 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:22:56.880 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:22:56.880 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:22:56.880 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:22:56.880 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.880 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.880 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.880 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.880 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.881 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.881 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:22:56.881 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.881 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.881 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.881 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.881 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.881 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.882 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.882 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.882 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.882 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.882 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.882 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.882 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.882 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.883 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:22:56.883 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.883 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.883 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:22:56.883 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.884 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.884 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.884 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.884 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.884 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.884 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.884 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.885 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:22:56.885 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.885 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.885 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.885 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:22:56.885 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.885 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.886 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.886 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.886 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.886 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.886 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.886 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:22:56.886 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.887 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.887 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.887 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:22:56.887 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.887 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.887 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.888 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.888 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.888 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.888 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.888 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:22:56.888 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.888 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:22:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:22:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:22:56.890 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:22:56.890 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:22:56.890 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.890 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.890 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.890 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.891 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.891 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:22:56.891 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.891 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.891 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.891 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.891 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.891 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.892 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.892 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.892 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.892 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.892 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.892 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.892 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.892 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.893 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.893 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:22:56.893 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.893 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.893 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.893 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:22:56.893 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.894 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.894 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.894 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.894 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.894 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.894 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.895 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:22:56.895 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.895 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.895 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.895 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:22:56.895 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.895 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.896 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.896 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.896 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.896 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.896 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.896 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:22:56.896 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.897 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.897 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.897 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:22:56.897 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.897 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.897 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.898 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.898 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.898 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.898 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.898 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:22:56.898 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.899 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.899 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.899 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:22:56.899 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:56.899 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.899 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.899 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:22:56.900 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:22:56.900 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:22:56.900 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:22:56.900 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.900 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.900 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.900 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.901 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.901 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:22:56.901 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.901 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.901 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.901 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.901 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.901 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.902 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.902 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.902 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.902 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.902 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.902 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.902 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.902 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:22:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:22:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.904 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.904 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.904 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.904 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.904 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.904 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.904 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.905 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:22:56.905 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.905 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.905 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.905 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:22:56.905 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.905 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.906 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.906 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.906 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.906 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.906 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.906 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:22:56.906 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.907 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.907 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.907 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.907 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:22:56.907 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.907 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.907 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.908 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.908 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.908 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.908 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.908 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:22:56.908 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.909 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.909 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.909 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:22:56.909 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:56.909 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.909 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.909 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:22:56.910 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:22:56.910 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:22:56.910 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:22:56.910 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.910 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.910 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.910 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.910 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.911 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.911 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:22:56.911 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:56.911 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:56.911 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:56.911 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:56.911 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:56.911 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:56.912 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:56.912 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:56.912 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:56.912 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:56.912 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:56.912 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:56.912 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:22:56.913 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.913 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.913 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:22:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.914 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:22:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:22:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.915 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.916 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.916 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:56.916 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.916 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.916 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.916 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:22:56.916 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.917 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.917 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.917 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:22:56.917 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.917 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.917 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.918 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:56.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:56.918 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:56.918 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:22:56.918 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.919 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.919 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:56.919 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:22:56.919 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:56.919 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.919 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.919 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:22:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:22:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:22:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:22:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:56.921 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.921 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:56.921 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:22:56.921 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.921 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:22:56.921 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.921 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.921 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.922 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.922 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.922 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:22:56.922 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.922 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.922 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:22:56.923 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.923 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.923 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.923 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.923 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.923 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:22:56.923 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.924 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.924 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:22:56.924 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.924 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.924 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.924 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.924 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.925 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:22:56.925 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.925 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.925 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.925 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:22:56.925 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.925 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.925 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.926 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.926 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.926 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:22:56.926 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.926 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.926 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:22:56.926 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.927 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.927 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.927 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.927 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.927 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:22:56.927 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.927 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.928 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:22:56.928 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.928 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.928 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.928 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.928 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.928 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:22:56.929 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.929 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.929 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:22:56.929 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.929 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.929 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.929 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.930 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.930 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:22:56.930 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.930 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.930 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:56.930 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:22:56.930 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:56.930 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:56.931 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:56.931 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:56.931 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:56.931 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:22:56.931 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:56.931 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.931 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:56.931 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:22:56.932 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:22:56.932 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:22:56.932 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:22:56.932 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:22:56.932 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:22:56.932 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:22:56.932 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:22:56.932 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:22:56.933 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:22:56.933 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:22:56.933 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:22:56.933 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:22:56.933 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:22:56.933 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:56.933 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:22:56.934 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:22:56.934 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:22:56.934 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:22:56.934 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:22:56.934 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:22:56.934 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:22:56.934 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:22:56.934 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:22:56.935 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:22:56.935 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:22:56.935 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:56.935 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:22:56.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6b0066280 msgr2=0x7fb6b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6b0066280 0x7fb6b0068730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc158a80 tx=0x7fb6c8009190 comp rx=0 tx=0).stop 2023-07-09T02:22:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 msgr2=0x7fb6cc0ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0ca7e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00e8b0 tx=0x7fb6bc00ed70 comp rx=0 tx=0).stop 2023-07-09T02:22:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 shutdown_connections 2023-07-09T02:22:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fb6b0066280 0x7fb6b0068730 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15c060 0x7fb6cc15ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6cc0d2450 0x7fb6cc0ca7e0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 --2- 172.21.15.45:0/488174935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0cd120 0x7fb6cc151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 >> 172.21.15.45:0/488174935 conn(0x7fb6cc0698e0 msgr2=0x7fb6cc0b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 shutdown_connections 2023-07-09T02:22:56.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:56.784+0000 7fb6d4656640 1 -- 172.21.15.45:0/488174935 wait complete. 2023-07-09T02:22:56.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:22:57.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f281649c640 1 Processor -- start 2023-07-09T02:22:57.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f281649c640 1 -- start start 2023-07-09T02:22:57.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f281649c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28100d2620 0x7f28100b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f281649c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f28100cd120 0x7f28100cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f281649c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2810160a50 con 0x7f281015c060 2023-07-09T02:22:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f281649c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281015c430 con 0x7f28100d2620 2023-07-09T02:22:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f281649c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281015fb60 con 0x7f28100cd120 2023-07-09T02:22:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f280f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28100d2620 0x7f28100b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f280f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28100d2620 0x7f28100b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42026/0 (socket says 172.21.15.45:42026) 2023-07-09T02:22:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f280f7fe640 1 -- 172.21.15.45:0/3763548727 learned_addr learned my addr 172.21.15.45:0/3763548727 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f2814a39640 1 --2- 172.21.15.45:0/3763548727 >> v2:172.21.15.155:3300/0 conn(0x7f28100cd120 0x7f28100cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f280f7fe640 1 -- 172.21.15.45:0/3763548727 >> v2:172.21.15.155:3300/0 conn(0x7f28100cd120 msgr2=0x7f28100cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f280f7fe640 1 --2- 172.21.15.45:0/3763548727 >> v2:172.21.15.155:3300/0 conn(0x7f28100cd120 0x7f28100cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f280f7fe640 1 -- 172.21.15.45:0/3763548727 >> v1:172.21.15.45:6789/0 conn(0x7f281015c060 legacy=0x7f28100d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f280f7fe640 1 -- 172.21.15.45:0/3763548727 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281015fe40 con 0x7f28100d2620 2023-07-09T02:22:57.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.084+0000 7f280effd640 1 -- 172.21.15.45:0/3763548727 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534777191 0 0) 0x7f2810160a50 con 0x7f281015c060 2023-07-09T02:22:57.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f280f7fe640 1 --2- 172.21.15.45:0/3763548727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100d2620 0x7f28100b4ed0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f281006b120 tx=0x7f280401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aec96eab9d928f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:57.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f280effd640 1 -- 172.21.15.45:0/3763548727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28040aa430 con 0x7f28100d2620 2023-07-09T02:22:57.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f280effd640 1 -- 172.21.15.45:0/3763548727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28040aa590 con 0x7f28100d2620 2023-07-09T02:22:57.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f280effd640 1 -- 172.21.15.45:0/3763548727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28040aa920 con 0x7f28100d2620 2023-07-09T02:22:57.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 -- 172.21.15.45:0/3763548727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100d2620 msgr2=0x7f28100b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 --2- 172.21.15.45:0/3763548727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100d2620 0x7f28100b4ed0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f281006b120 tx=0x7f280401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 -- 172.21.15.45:0/3763548727 shutdown_connections 2023-07-09T02:22:57.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 --2- 172.21.15.45:0/3763548727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100d2620 0x7f28100b4ed0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 --2- 172.21.15.45:0/3763548727 >> v2:172.21.15.155:3300/0 conn(0x7f28100cd120 0x7f28100cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 -- 172.21.15.45:0/3763548727 >> 172.21.15.45:0/3763548727 conn(0x7f28100698e0 msgr2=0x7f2810069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:57.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 -- 172.21.15.45:0/3763548727 shutdown_connections 2023-07-09T02:22:57.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 -- 172.21.15.45:0/3763548727 wait complete. 2023-07-09T02:22:57.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.088+0000 7f281649c640 1 Processor -- start 2023-07-09T02:22:57.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 -- start start 2023-07-09T02:22:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100cd120 0x7f281014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28100d2620 0x7f2810152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f281015c060 0x7f2810150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101508a0 con 0x7f28100cd120 2023-07-09T02:22:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2810151ce0 con 0x7f281015c060 2023-07-09T02:22:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281014f750 con 0x7f28100d2620 2023-07-09T02:22:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100cd120 0x7f281014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100cd120 0x7f281014da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42034/0 (socket says 172.21.15.45:42034) 2023-07-09T02:22:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 -- 172.21.15.45:0/3772418807 learned_addr learned my addr 172.21.15.45:0/3772418807 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280f7fe640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28100d2620 0x7f2810152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f2814a39640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f281015c060 0x7f2810150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 -- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28100d2620 msgr2=0x7f2810152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28100d2620 0x7f2810152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 -- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f281015c060 msgr2=0x7f2810150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f281015c060 0x7f2810150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 -- 172.21.15.45:0/3772418807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040094d0 con 0x7f28100cd120 2023-07-09T02:22:57.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280ffff640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100cd120 0x7f281014da70 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f2800001ec0 tx=0x7f280000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280cff9640 1 -- 172.21.15.45:0/3772418807 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000054e0 con 0x7f28100cd120 2023-07-09T02:22:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280cff9640 1 -- 172.21.15.45:0/3772418807 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800003600 con 0x7f28100cd120 2023-07-09T02:22:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28100b59f0 con 0x7f28100cd120 2023-07-09T02:22:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f280cff9640 1 -- 172.21.15.45:0/3772418807 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000039b0 con 0x7f28100cd120 2023-07-09T02:22:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28100c8bf0 con 0x7f28100cd120 2023-07-09T02:22:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.092+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281004d7d0 con 0x7f28100cd120 2023-07-09T02:22:57.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.096+0000 7f280cff9640 1 -- 172.21.15.45:0/3772418807 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2800003b10 con 0x7f28100cd120 2023-07-09T02:22:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.096+0000 7f280cff9640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27fc066280 0x7f27fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.096+0000 7f280cff9640 1 -- 172.21.15.45:0/3772418807 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28000832c0 con 0x7f28100cd120 2023-07-09T02:22:57.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.096+0000 7f280cff9640 1 -- 172.21.15.45:0/3772418807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f27fc06e3c0 con 0x7f28100cd120 2023-07-09T02:22:57.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.096+0000 7f280f7fe640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27fc066280 0x7f27fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.096+0000 7f280f7fe640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27fc066280 0x7f27fc068730 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f28040ae000 tx=0x7f28040b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:57.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.100+0000 7f280cff9640 1 -- 172.21.15.45:0/3772418807 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2800017060 con 0x7f28100cd120 2023-07-09T02:22:57.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f281006baa0 con 0x7f28100cd120 2023-07-09T02:22:57.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f280cff9640 1 -- 172.21.15.45:0/3772418807 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f28000507e0 con 0x7f28100cd120 2023-07-09T02:22:57.293 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:57.293 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:22:57.294 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:22:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27fc066280 msgr2=0x7f27fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27fc066280 0x7f27fc068730 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f28040ae000 tx=0x7f28040b5040 comp rx=0 tx=0).stop 2023-07-09T02:22:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100cd120 msgr2=0x7f281014da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100cd120 0x7f281014da70 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f2800001ec0 tx=0x7f280000c8e0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 shutdown_connections 2023-07-09T02:22:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f281015c060 0x7f2810150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f27fc066280 0x7f27fc068730 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28100d2620 0x7f2810152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 --2- 172.21.15.45:0/3772418807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28100cd120 0x7f281014da70 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.292+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 >> 172.21.15.45:0/3772418807 conn(0x7f28100698e0 msgr2=0x7f28100b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:57.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.296+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 shutdown_connections 2023-07-09T02:22:57.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.296+0000 7f281649c640 1 -- 172.21.15.45:0/3772418807 wait complete. 2023-07-09T02:22:57.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-07-09T02:22:57.477 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":9105,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":17.708995989000002,"mdsmap_epoch":91,"osdmap_epoch":184,"osdmap_epoch_barrier":184,"uptime":23.684812092000001} 2023-07-09T02:22:57.478 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 9105, "mdsmap_epoch": 91, "osdmap_epoch": 184, "osdmap_epoch_barrier": 184, "rank_uptime": 17.708995989, "state": "up:active", "uptime": 23.684812092, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:22:57.478 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:22:57.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:57.479 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-07-09T02:22:57.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:22:57.490 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-07-09T02:22:57.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:22:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.736+0000 7f5cb3774640 1 Processor -- start 2023-07-09T02:22:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.736+0000 7f5cb3774640 1 -- start start 2023-07-09T02:22:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb3774640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0afed0 0x7f5cac15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb3774640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5cac0cd040 0x7f5cac0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb3774640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac071550 con 0x7f5cac15b270 2023-07-09T02:22:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb3774640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac0cda00 con 0x7f5cac0cd040 2023-07-09T02:22:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb3774640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0720f0 con 0x7f5cac0afed0 2023-07-09T02:22:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1d11640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5cac0cd040 0x7f5cac0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1d11640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5cac0cd040 0x7f5cac0cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42044/0 (socket says 172.21.15.45:42044) 2023-07-09T02:22:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1d11640 1 -- 172.21.15.45:0/1182014955 learned_addr learned my addr 172.21.15.45:0/1182014955 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1510640 1 --2- 172.21.15.45:0/1182014955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0afed0 0x7f5cac15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1d11640 1 -- 172.21.15.45:0/1182014955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0afed0 msgr2=0x7f5cac15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1d11640 1 --2- 172.21.15.45:0/1182014955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0afed0 0x7f5cac15db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1d11640 1 -- 172.21.15.45:0/1182014955 >> v1:172.21.15.155:6789/0 conn(0x7f5cac15b270 legacy=0x7f5cac0719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:22:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1d11640 1 -- 172.21.15.45:0/1182014955 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac15e440 con 0x7f5cac0cd040 2023-07-09T02:22:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.740+0000 7f5cb1510640 1 --2- 172.21.15.45:0/1182014955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0afed0 0x7f5cac15db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:22:57.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb1d11640 1 --2- 172.21.15.45:0/1182014955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac0cd040 0x7f5cac0cd4c0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4009e50 tx=0x7f5ca401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d64e93322833061 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5ca3fff640 1 -- 172.21.15.45:0/1182014955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40a5820 con 0x7f5cac0cd040 2023-07-09T02:22:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5ca3fff640 1 -- 172.21.15.45:0/1182014955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca40a5980 con 0x7f5cac0cd040 2023-07-09T02:22:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5ca3fff640 1 -- 172.21.15.45:0/1182014955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40a5d10 con 0x7f5cac0cd040 2023-07-09T02:22:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- 172.21.15.45:0/1182014955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac0cd040 msgr2=0x7f5cac0cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 --2- 172.21.15.45:0/1182014955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac0cd040 0x7f5cac0cd4c0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4009e50 tx=0x7f5ca401c9a0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- 172.21.15.45:0/1182014955 shutdown_connections 2023-07-09T02:22:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 --2- 172.21.15.45:0/1182014955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac0cd040 0x7f5cac0cd4c0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 --2- 172.21.15.45:0/1182014955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0afed0 0x7f5cac15db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- 172.21.15.45:0/1182014955 >> 172.21.15.45:0/1182014955 conn(0x7f5cac06d140 msgr2=0x7f5cac06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- 172.21.15.45:0/1182014955 shutdown_connections 2023-07-09T02:22:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- 172.21.15.45:0/1182014955 wait complete. 2023-07-09T02:22:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 Processor -- start 2023-07-09T02:22:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- start start 2023-07-09T02:22:57.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cac0afed0 0x7f5cac148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0cd040 0x7f5cac15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac15b270 0x7f5cac15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac149730 con 0x7f5cac15b270 2023-07-09T02:22:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac149a10 con 0x7f5cac0afed0 2023-07-09T02:22:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb3774640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac149cf0 con 0x7f5cac0cd040 2023-07-09T02:22:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.744+0000 7f5cb1d11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac15b270 0x7f5cac15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1d11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac15b270 0x7f5cac15ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42054/0 (socket says 172.21.15.45:42054) 2023-07-09T02:22:57.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1d11640 1 -- 172.21.15.45:0/2435452810 learned_addr learned my addr 172.21.15.45:0/2435452810 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:22:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1510640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cac0afed0 0x7f5cac148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb0d0f640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0cd040 0x7f5cac15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1d11640 1 -- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0cd040 msgr2=0x7f5cac15a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1d11640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0cd040 0x7f5cac15a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1d11640 1 -- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cac0afed0 msgr2=0x7f5cac148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1d11640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cac0afed0 0x7f5cac148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1d11640 1 -- 172.21.15.45:0/2435452810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4009b30 con 0x7f5cac15b270 2023-07-09T02:22:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb0d0f640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0cd040 0x7f5cac15a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:22:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb1d11640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac15b270 0x7f5cac15ab30 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f5ca401b050 tx=0x7f5ca4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5ca1ffb640 1 -- 172.21.15.45:0/2435452810 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40b8670 con 0x7f5cac15b270 2023-07-09T02:22:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5ca1ffb640 1 -- 172.21.15.45:0/2435452810 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca40b87d0 con 0x7f5cac15b270 2023-07-09T02:22:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5ca1ffb640 1 -- 172.21.15.45:0/2435452810 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40b8b80 con 0x7f5cac15b270 2023-07-09T02:22:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac149fd0 con 0x7f5cac15b270 2023-07-09T02:22:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac149410 con 0x7f5cac15b270 2023-07-09T02:22:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac04d7d0 con 0x7f5cac15b270 2023-07-09T02:22:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.748+0000 7f5ca1ffb640 1 -- 172.21.15.45:0/2435452810 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ca40b8ce0 con 0x7f5cac15b270 2023-07-09T02:22:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.752+0000 7f5ca1ffb640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c90066280 0x7f5c90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:22:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.752+0000 7f5ca1ffb640 1 -- 172.21.15.45:0/2435452810 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ca411f450 con 0x7f5cac15b270 2023-07-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.752+0000 7f5ca1ffb640 1 -- 172.21.15.45:0/2435452810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f5c9006e3c0 con 0x7f5cac15b270 2023-07-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.752+0000 7f5cb1510640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c90066280 0x7f5c90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:22:57.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.752+0000 7f5cb1510640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c90066280 0x7f5c90068730 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800ab60 tx=0x7f5ca8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:22:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.756+0000 7f5ca1ffb640 1 -- 172.21.15.45:0/2435452810 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ca40ec980 con 0x7f5cac15b270 2023-07-09T02:22:57.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5cac149e30 con 0x7f5cac15b270 2023-07-09T02:22:57.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5ca1ffb640 1 -- 172.21.15.45:0/2435452810 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) v1 ==== 81+0+36968 (secure 0 0 0) 0x7f5cac149e30 con 0x7f5cac15b270 2023-07-09T02:22:57.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:22:57.918 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:22:57.918 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 184, 2023-07-09T02:22:57.918 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:22:57.918 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:22:57.918 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:22:54.475364+0000", 2023-07-09T02:22:57.918 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:22:57.918 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:22:57.919 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:22:57.919 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:22:57.919 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:22:57.919 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:22:57.919 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:22:57.920 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:22:57.920 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:22:57.920 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:57.920 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:22:57.920 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:22:57.920 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:22:57.920 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:22:57.921 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:22:57.921 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 24, 2023-07-09T02:22:57.921 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:22:57.921 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:22:57.921 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:22:57.921 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:22:57.921 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:22:57.921 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:22:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:22:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:22:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:22:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:57.923 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:57.923 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:57.923 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:57.923 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:57.923 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:57.923 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:57.924 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:57.924 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:57.924 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:22:57.924 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:22:57.924 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:22:57.925 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:22:57.925 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:22:57.925 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:57.925 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:57.925 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:57.925 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:57.925 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:57.926 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:57.926 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:57.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.926 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:22:57.926 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:57.926 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:57.926 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:57.926 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:57.927 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:57.927 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:57.927 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:57.927 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:57.927 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:57.927 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:57.927 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:57.927 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:57.928 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:57.928 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:57.928 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:57.928 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:57.928 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:57.928 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:57.928 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:57.928 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:57.929 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:57.929 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:57.929 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:57.929 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:57.929 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:57.929 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:57.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.930 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:57.930 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:57.930 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:57.930 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:57.930 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:57.930 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:57.930 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:57.930 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:57.931 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:57.931 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:57.931 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:57.931 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:57.931 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:22:57.931 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:22:57.931 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.931 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:57.932 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:22:57.932 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.932 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:57.932 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:22:57.932 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:22:57.932 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:22:57.933 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:22:57.933 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:22:57.933 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:57.933 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:57.933 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:57.933 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.933 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.934 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:22:57.934 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:22:57.934 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:22:57.934 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:57.934 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:57.934 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:57.934 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:57.934 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:57.935 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:22:57.936 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:22:57.936 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:22:57.936 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:22:57.936 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:22:57.936 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:57.936 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:57.936 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:57.937 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:57.937 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:57.937 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:57.937 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:57.937 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.937 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:22:57.937 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:57.938 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:57.939 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:57.940 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:57.941 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:57.942 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:22:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:22:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:22:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:22:57.943 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:22:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:22:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:22:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.945 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.945 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 23, 2023-07-09T02:22:57.945 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:22:57.945 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:37.645121+0000", 2023-07-09T02:22:57.945 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:22:57.945 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:22:57.945 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:57.946 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:57.946 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:57.946 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:57.946 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:57.946 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:57.946 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:57.946 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:57.946 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:57.947 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:57.947 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:22:57.947 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:22:57.947 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:22:57.947 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:22:57.947 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:22:57.947 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:57.948 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:57.948 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:57.948 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:57.948 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:57.948 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:57.948 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:57.948 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.949 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "181", 2023-07-09T02:22:57.949 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:57.949 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:57.949 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:57.949 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:57.949 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:57.949 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:57.950 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:57.950 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:57.950 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:57.950 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:22:57.950 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:57.950 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:57.950 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:57.951 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:57.951 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:57.951 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:57.951 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:57.951 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:57.951 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:57.951 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:57.951 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:57.952 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:57.952 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:57.952 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:57.952 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:57.952 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:57.952 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.953 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:57.953 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:57.953 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:57.953 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:57.953 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:57.953 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:57.953 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:57.954 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:57.954 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:57.954 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:57.954 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:57.954 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:57.954 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:22:57.954 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:22:57.955 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:22:57.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.955 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:57.955 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:22:57.955 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:22:57.955 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.956 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:57.956 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2, 2023-07-09T02:22:57.956 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2, 2023-07-09T02:22:57.956 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:22:57.956 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:22:57.956 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:22:57.957 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:57.957 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:57.957 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:57.957 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.957 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.957 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.957 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 24, 2023-07-09T02:22:57.958 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:22:57.958 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:38.115103+0000", 2023-07-09T02:22:57.958 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:22:57.958 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:22:57.958 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:22:57.958 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:22:57.958 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:22:57.958 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:22:57.959 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:22:57.959 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:22:57.959 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:22:57.959 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:22:57.959 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:22:57.959 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:22:57.959 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:22:57.960 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:22:57.960 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:22:57.960 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:22:57.960 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:22:57.960 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:22:57.960 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:22:57.960 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:22:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:22:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:22:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:22:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:22:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "184", 2023-07-09T02:22:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:22:57.962 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:22:57.962 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:22:57.962 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:22:57.962 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:22:57.962 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:22:57.962 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:22:57.962 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:22:57.962 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:22:57.963 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:22:57.963 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:22:57.963 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:22:57.963 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:22:57.963 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:22:57.963 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:22:57.964 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:22:57.964 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:22:57.964 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:22:57.964 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:22:57.964 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:22:57.964 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:22:57.965 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:22:57.965 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:22:57.965 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:22:57.965 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:22:57.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:22:57.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.965 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:22:57.966 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:22:57.966 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:22:57.966 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:22:57.966 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:22:57.966 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:22:57.966 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:22:57.966 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:22:57.967 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:22:57.967 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:22:57.967 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:22:57.967 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:22:57.967 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:22:57.967 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:22:57.967 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.967 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:22:57.968 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:22:57.968 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:22:57.968 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.968 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:22:57.968 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:22:57.968 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:22:57.969 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:22:57.969 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:22:57.969 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:22:57.969 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:22:57.969 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:22:57.969 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:22:57.970 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.970 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.970 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:57.970 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:22:57.970 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.970 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:22:57.970 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:57.970 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:57.971 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.972 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:22:57.973 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.974 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:22:57.975 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:57.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.975 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:22:57.975 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:57.975 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.976 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.976 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:57.976 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.976 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.976 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.976 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:22:57.976 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:57.977 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.977 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.977 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.977 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:22:57.977 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:57.977 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.977 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:22:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:57.978 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.979 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.979 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.979 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:22:57.979 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:22:57.979 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.979 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.979 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:22:57.980 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:22:57.980 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:22:57.980 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:22:57.980 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:57.980 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:57.980 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:57.980 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.981 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.981 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:22:57.981 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:57.981 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:57.981 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:57.981 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:57.982 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:57.982 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:57.982 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:57.982 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:57.982 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:57.982 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:57.982 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:57.983 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:57.983 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.983 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.983 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.983 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:22:57.983 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:57.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.983 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.984 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.984 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:22:57.984 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:57.984 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.984 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.984 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:57.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:22:57.985 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:57.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:22:57.986 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:57.986 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.986 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.986 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:57.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.986 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:22:57.987 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:57.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.987 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:22:57.987 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:57.988 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.988 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.988 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:57.988 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.988 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.988 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:22:57.989 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:57.989 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:22:57.989 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:22:57.989 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.990 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.990 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:22:57.990 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:22:57.990 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:22:57.990 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:22:57.990 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:57.990 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:57.991 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:57.991 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.991 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.991 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:22:57.991 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:57.991 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:57.991 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:57.992 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:57.992 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:57.992 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:57.992 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:57.992 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:57.992 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:57.992 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:57.992 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:57.993 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:57.993 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.993 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.993 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.993 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:22:57.993 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:57.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.993 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.994 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.994 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:22:57.994 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:57.994 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.994 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.994 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:57.994 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.995 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.995 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:22:57.995 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:57.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.995 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.996 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:22:57.996 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:57.996 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.996 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.996 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:57.996 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.996 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.997 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:22:57.997 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:57.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.997 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.997 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:22:57.997 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:57.998 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:57.998 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:57.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.998 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:57.998 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:57.998 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.998 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:57.998 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:22:57.999 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:57.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:57.999 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:57.999 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:57.999 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:22:57.999 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:22:57.999 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.000 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.000 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:22:58.000 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:22:58.000 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:22:58.000 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:22:58.000 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:58.000 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:58.001 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:58.001 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.001 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.001 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:22:58.001 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:58.001 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:58.001 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:58.002 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:58.002 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:58.002 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:58.002 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:58.002 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:58.002 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:58.002 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:58.002 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:58.003 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:58.003 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.003 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.003 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.003 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:22:58.003 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:58.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.003 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.004 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.004 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:22:58.004 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:58.004 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.004 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.004 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:22:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.005 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:22:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.007 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.007 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:22:58.007 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:58.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.007 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.007 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.007 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:22:58.008 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:58.008 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.008 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.008 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:58.008 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.008 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.008 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:22:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:22:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:22:58.009 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.010 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.010 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:22:58.010 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:22:58.010 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:22:58.010 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:22:58.010 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:58.010 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:58.011 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:58.011 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.011 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.011 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.011 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:22:58.011 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:58.011 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:58.011 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:58.012 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:58.012 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:58.012 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:58.012 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:58.012 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:58.012 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:58.012 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:22:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.014 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.014 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.014 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:22:58.014 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:58.014 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.014 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.014 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.014 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:58.015 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.015 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.015 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.015 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:22:58.015 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:58.015 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.015 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.015 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.016 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:22:58.016 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:58.016 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.016 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.016 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.016 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:58.016 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.017 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.017 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.017 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:22:58.017 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:58.017 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.017 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.017 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.017 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:22:58.018 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:58.018 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.018 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.018 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.018 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:58.018 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.018 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.018 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.019 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:22:58.019 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:58.019 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.019 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.019 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.019 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:22:58.019 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:22:58.019 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.020 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.020 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.020 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:22:58.020 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:22:58.020 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:22:58.020 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:22:58.020 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:58.021 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:58.021 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:58.021 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.021 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.021 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.021 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:22:58.021 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:58.021 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:58.023 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:58.023 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:58.023 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.023 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.023 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.023 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:22:58.023 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:58.023 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.024 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.024 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.024 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:22:58.024 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:58.024 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.024 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.024 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.025 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:58.025 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.025 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.025 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.025 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:22:58.025 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:58.025 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.025 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.026 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.026 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:22:58.026 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:58.026 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.026 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.026 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.026 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:58.026 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.027 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.027 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.027 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:22:58.027 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:58.027 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.027 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.027 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.027 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:22:58.028 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:58.028 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.028 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.028 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.028 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:58.028 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.028 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.028 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.029 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:22:58.029 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:58.029 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.029 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.029 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.029 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:22:58.029 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:22:58.030 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.030 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.030 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.030 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:22:58.030 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:22:58.030 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:22:58.030 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:22:58.030 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:22:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:58.032 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:58.032 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:58.032 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:58.032 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:58.032 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:58.032 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:58.032 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:58.032 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:58.033 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:58.033 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:58.033 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.033 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.033 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.033 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:22:58.033 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:58.033 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.034 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.034 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.034 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:22:58.034 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:58.034 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.034 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.034 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.035 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:58.035 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.035 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.035 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.035 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:22:58.035 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:58.035 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.035 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.036 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.036 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:22:58.036 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:58.036 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.036 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.036 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.036 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:58.036 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.037 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.037 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.037 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:22:58.037 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:58.037 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.037 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.037 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.038 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:22:58.038 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:58.038 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.038 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.038 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.038 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:58.038 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.038 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.039 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.039 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:22:58.039 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:58.039 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.039 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.039 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.039 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:22:58.039 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:22:58.040 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.040 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.040 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:22:58.040 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:22:58.040 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:22:58.040 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:22:58.040 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:58.041 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:58.041 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:58.041 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.041 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.041 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.041 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:22:58.041 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:22:58.041 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:22:58.042 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:22:58.042 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:22:58.042 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:22:58.042 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:22:58.042 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:22:58.042 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:22:58.042 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:22:58.042 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:22:58.043 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:22:58.043 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:22:58.043 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.043 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.043 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.043 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:22:58.043 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:58.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.044 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.044 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.044 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:22:58.044 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:58.044 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.044 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.044 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.045 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:22:58.045 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.045 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.045 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.045 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:22:58.045 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:58.045 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.045 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.046 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.046 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:22:58.046 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:58.046 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.046 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.046 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.046 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:22:58.046 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:22:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.047 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:22:58.048 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:58.048 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.048 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.048 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.048 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:22:58.048 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:22:58.048 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.049 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:22:58.049 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:22:58.049 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:58.049 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.049 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.049 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:22:58.049 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:22:58.049 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:22:58.050 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.050 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.050 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.050 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:22:58.050 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:22:58.050 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:22:58.050 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:22:58.050 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:22:58.051 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:22:58.051 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:22:58.051 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:22:58.051 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.051 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:58.051 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:22:58.051 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.051 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:22:58.052 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:58.052 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:58.052 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:58.052 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:58.052 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:58.052 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:22:58.052 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:58.053 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.053 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.053 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:22:58.053 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:58.053 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:58.053 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:58.053 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:58.053 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:58.054 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:22:58.054 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:58.054 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.054 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.054 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:22:58.054 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:58.054 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:58.054 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:58.055 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:58.055 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:58.055 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:22:58.055 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:58.055 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.055 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.055 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:22:58.055 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:58.056 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:58.056 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:58.056 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:58.056 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:58.056 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:22:58.056 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:58.056 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.056 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.057 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:22:58.057 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:58.057 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:58.057 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:58.057 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:58.057 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:58.057 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:22:58.057 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:22:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:22:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:22:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:58.059 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:22:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:22:58.060 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:22:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:22:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:22:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:22:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:22:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:22:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:22:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:22:58.061 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:22:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:22:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:22:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:22:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:22:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:22:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:22:58.062 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:22:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:22:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:22:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:22:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:22:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:22:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:22:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:22:58.063 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:22:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:22:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:22:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:22:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:22:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:22:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:22:58.064 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:22:58.065 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:22:58.065 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:22:58.065 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:22:58.065 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:22:58.065 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:22:58.065 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:22:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c90066280 msgr2=0x7f5c90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c90066280 0x7f5c90068730 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800ab60 tx=0x7f5ca8008040 comp rx=0 tx=0).stop 2023-07-09T02:22:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac15b270 msgr2=0x7f5cac15ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:22:58.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac15b270 0x7f5cac15ab30 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f5ca401b050 tx=0x7f5ca4019740 comp rx=0 tx=0).stop 2023-07-09T02:22:58.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 shutdown_connections 2023-07-09T02:22:58.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cac15b270 0x7f5cac15ab30 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:58.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5c90066280 0x7f5c90068730 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:58.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cac0cd040 0x7f5cac15a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:58.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.916+0000 7f5cb3774640 1 --2- 172.21.15.45:0/2435452810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cac0afed0 0x7f5cac148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:22:58.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.920+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 >> 172.21.15.45:0/2435452810 conn(0x7f5cac06d140 msgr2=0x7f5cac0719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:22:58.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.920+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 shutdown_connections 2023-07-09T02:22:58.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:22:57.920+0000 7f5cb3774640 1 -- 172.21.15.45:0/2435452810 wait complete. 2023-07-09T02:22:58.069 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:23:03.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:23:03.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.224+0000 7f529d111640 1 Processor -- start 2023-07-09T02:23:03.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.224+0000 7f529d111640 1 -- start start 2023-07-09T02:23:03.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529d111640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5298158e30 0x7f529806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:03.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529d111640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806c820 0x7f52980caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:03.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529d111640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52980ccf80 con 0x7f529806fd10 2023-07-09T02:23:03.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529d111640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52980cd540 con 0x7f5298158e30 2023-07-09T02:23:03.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529d111640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52980c8fb0 con 0x7f529806c820 2023-07-09T02:23:03.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806c820 0x7f52980caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:03.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f5296d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5298158e30 0x7f529806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:03.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f5296d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5298158e30 0x7f529806f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:40564/0 (socket says 172.21.15.45:40564) 2023-07-09T02:23:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f5296d9d640 1 -- 172.21.15.45:0/736927719 learned_addr learned my addr 172.21.15.45:0/736927719 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529759e640 1 -- 172.21.15.45:0/736927719 >> v2:172.21.15.155:3300/0 conn(0x7f5298158e30 msgr2=0x7f529806f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529759e640 1 --2- 172.21.15.45:0/736927719 >> v2:172.21.15.155:3300/0 conn(0x7f5298158e30 0x7f529806f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529759e640 1 -- 172.21.15.45:0/736927719 >> v1:172.21.15.155:6789/0 conn(0x7f529806fd10 legacy=0x7f529806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f529759e640 1 -- 172.21.15.45:0/736927719 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980cbad0 con 0x7f529806c820 2023-07-09T02:23:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.228+0000 7f5296d9d640 1 --2- 172.21.15.45:0/736927719 >> v2:172.21.15.155:3300/0 conn(0x7f5298158e30 0x7f529806f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:23:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529759e640 1 --2- 172.21.15.45:0/736927719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806c820 0x7f52980caec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5290009d90 tx=0x7f529001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9295848ae23ab39 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529659c640 1 -- 172.21.15.45:0/736927719 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900a5970 con 0x7f529806c820 2023-07-09T02:23:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529659c640 1 -- 172.21.15.45:0/736927719 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52900a5ad0 con 0x7f529806c820 2023-07-09T02:23:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529659c640 1 -- 172.21.15.45:0/736927719 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900a5e60 con 0x7f529806c820 2023-07-09T02:23:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 -- 172.21.15.45:0/736927719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806c820 msgr2=0x7f52980caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 --2- 172.21.15.45:0/736927719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806c820 0x7f52980caec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5290009d90 tx=0x7f529001c890 comp rx=0 tx=0).stop 2023-07-09T02:23:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 -- 172.21.15.45:0/736927719 shutdown_connections 2023-07-09T02:23:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 --2- 172.21.15.45:0/736927719 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806c820 0x7f52980caec0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 --2- 172.21.15.45:0/736927719 >> v2:172.21.15.155:3300/0 conn(0x7f5298158e30 0x7f529806f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 -- 172.21.15.45:0/736927719 >> 172.21.15.45:0/736927719 conn(0x7f52980694b0 msgr2=0x7f52980698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 -- 172.21.15.45:0/736927719 shutdown_connections 2023-07-09T02:23:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 -- 172.21.15.45:0/736927719 wait complete. 2023-07-09T02:23:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.232+0000 7f529d111640 1 Processor -- start 2023-07-09T02:23:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 -- start start 2023-07-09T02:23:03.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f529806c820 0x7f5298144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:03.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806fd10 0x7f52981447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:03.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5298158e30 0x7f52980c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529814b560 con 0x7f5298158e30 2023-07-09T02:23:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52980ae0c0 con 0x7f529806c820 2023-07-09T02:23:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52980ae3a0 con 0x7f529806fd10 2023-07-09T02:23:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5298158e30 0x7f52980c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:03.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5298158e30 0x7f52980c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38924/0 (socket says 172.21.15.45:38924) 2023-07-09T02:23:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 -- 172.21.15.45:0/871475573 learned_addr learned my addr 172.21.15.45:0/871475573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f528ffff640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806fd10 0x7f52981447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f5296d9d640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f529806c820 0x7f5298144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:03.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 -- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806fd10 msgr2=0x7f52981447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806fd10 0x7f52981447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 -- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f529806c820 msgr2=0x7f5298144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f529806c820 0x7f5298144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 -- 172.21.15.45:0/871475573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880094d0 con 0x7f5298158e30 2023-07-09T02:23:03.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529759e640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5298158e30 0x7f52980c7ba0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f529001af40 tx=0x7f5290019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f528f7fe640 1 -- 172.21.15.45:0/871475573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900a5970 con 0x7f5298158e30 2023-07-09T02:23:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f528f7fe640 1 -- 172.21.15.45:0/871475573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290009450 con 0x7f5298158e30 2023-07-09T02:23:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5290009a70 con 0x7f5298158e30 2023-07-09T02:23:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f528f7fe640 1 -- 172.21.15.45:0/871475573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900b9670 con 0x7f5298158e30 2023-07-09T02:23:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52980ae960 con 0x7f5298158e30 2023-07-09T02:23:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.236+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52980aeb50 con 0x7f5298158e30 2023-07-09T02:23:03.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.240+0000 7f528f7fe640 1 -- 172.21.15.45:0/871475573 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52900b97d0 con 0x7f5298158e30 2023-07-09T02:23:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.240+0000 7f528f7fe640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5278066280 0x7f5278068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:03.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.240+0000 7f528f7fe640 1 -- 172.21.15.45:0/871475573 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f529011f820 con 0x7f5298158e30 2023-07-09T02:23:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.240+0000 7f528f7fe640 1 -- 172.21.15.45:0/871475573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f527806e3c0 con 0x7f5298158e30 2023-07-09T02:23:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.240+0000 7f5296d9d640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5278066280 0x7f5278068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.240+0000 7f5296d9d640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5278066280 0x7f5278068730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5288009bd0 tx=0x7f5288008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:03.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.244+0000 7f528f7fe640 1 -- 172.21.15.45:0/871475573 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52900ecd20 con 0x7f5298158e30 2023-07-09T02:23:03.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.404+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f529804d7d0 con 0x7f5298158e30 2023-07-09T02:23:03.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.404+0000 7f528f7fe640 1 -- 172.21.15.45:0/871475573 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) v1 ==== 81+0+36968 (secure 0 0 0) 0x7f52900bd090 con 0x7f5298158e30 2023-07-09T02:23:03.407 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:03.408 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:03.408 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 184, 2023-07-09T02:23:03.408 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:23:03.408 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:23:03.409 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:22:54.475364+0000", 2023-07-09T02:23:03.409 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:23:03.409 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:23:03.409 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:23:03.409 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:23:03.410 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:23:03.410 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:23:03.410 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:23:03.411 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:23:03.411 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:23:03.411 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:03.411 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:23:03.411 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:23:03.412 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:23:03.412 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:23:03.412 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:23:03.412 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 24, 2023-07-09T02:23:03.412 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:23:03.412 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:23:03.412 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:23:03.413 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:23:03.413 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:23:03.413 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:23:03.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.413 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:23:03.413 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:23:03.413 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:23:03.413 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:03.414 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:03.414 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:03.414 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:03.414 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:03.414 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:03.414 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:03.414 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:03.415 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:03.415 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:03.415 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:03.415 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:03.415 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:23:03.415 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:23:03.415 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:23:03.415 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:23:03.416 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:23:03.416 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:03.416 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:03.416 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:03.416 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:03.416 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:03.417 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:03.417 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:03.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:23:03.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:03.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:03.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:03.417 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:03.418 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:03.418 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:03.418 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:03.418 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:03.418 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:03.418 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:03.418 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:03.419 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:03.419 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:03.419 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:03.419 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:03.419 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:03.419 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:03.419 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:03.419 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:03.420 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:03.420 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:03.420 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:03.420 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:03.420 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:03.420 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:03.420 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:03.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.421 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:03.421 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:03.421 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:03.421 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:03.421 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:03.421 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:03.422 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:03.422 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:03.422 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:03.422 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:03.422 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:03.422 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:03.422 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:23:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:23:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:23:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:23:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:23:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:23:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:23:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:23:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:23:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:23:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:23:03.425 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:03.426 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:23:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:23:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:23:03.427 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:23:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:23:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:03.428 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:23:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:03.429 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:03.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:03.431 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:03.432 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:03.433 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:03.433 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:03.433 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:03.433 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:03.433 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:03.433 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:03.433 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:03.434 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:03.434 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:03.434 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:23:03.434 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:03.434 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:23:03.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.434 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:03.434 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:23:03.435 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:23:03.435 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:23:03.435 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:23:03.435 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:23:03.435 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:03.435 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:03.435 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:03.435 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.436 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.436 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 23, 2023-07-09T02:23:03.436 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:23:03.436 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:37.645121+0000", 2023-07-09T02:23:03.436 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:03.436 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:03.436 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:03.437 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:03.437 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:03.437 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:03.437 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:03.437 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:03.437 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:03.437 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:03.438 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:03.438 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:03.438 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:23:03.438 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:23:03.438 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:23:03.438 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:23:03.438 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:23:03.438 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:03.439 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:03.439 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:03.439 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:03.439 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:03.439 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:03.439 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:03.439 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.439 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "181", 2023-07-09T02:23:03.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:03.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:03.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:03.440 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:03.440 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:03.440 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:03.440 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:03.441 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:03.441 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:03.441 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:03.441 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:03.441 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:03.441 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:03.441 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:03.441 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:03.442 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:03.442 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:03.442 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:03.442 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:03.442 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:03.442 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:03.442 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:03.442 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:03.443 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:03.443 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:03.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:03.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.443 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:03.443 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:03.443 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:03.444 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:03.444 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:03.444 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:03.444 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:03.444 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:03.444 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:03.444 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:03.445 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:03.445 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:03.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:23:03.445 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:23:03.445 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:23:03.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.445 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:03.446 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:23:03.446 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:23:03.446 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.446 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:03.446 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2, 2023-07-09T02:23:03.446 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2, 2023-07-09T02:23:03.446 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:23:03.447 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:23:03.447 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:23:03.447 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:03.447 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:03.447 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:03.447 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.448 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.448 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 24, 2023-07-09T02:23:03.448 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:23:03.448 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:38.115103+0000", 2023-07-09T02:23:03.448 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:23:03.448 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:23:03.449 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:03.449 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:03.449 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:03.449 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:03.449 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:03.449 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:03.449 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:03.450 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:03.450 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:03.450 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:03.450 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:23:03.450 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:23:03.450 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:23:03.450 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:23:03.450 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:23:03.451 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:03.451 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:03.451 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:03.451 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:03.451 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:03.451 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:03.451 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:03.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.452 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "184", 2023-07-09T02:23:03.452 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:03.452 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:03.452 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:03.452 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:03.452 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:03.452 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:03.453 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:03.453 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:03.453 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:03.453 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:23:03.453 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:03.453 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:03.453 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:03.454 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:03.454 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:03.454 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:03.454 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:03.454 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:03.454 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:03.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:03.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:03.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:03.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:03.455 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:03.455 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:03.455 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:03.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.456 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:03.456 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:03.456 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:03.456 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:03.456 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:03.456 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:03.456 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:03.457 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:03.457 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:03.457 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:03.457 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:03.457 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:03.457 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:23:03.457 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:23:03.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.458 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:03.458 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:23:03.458 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:23:03.458 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.458 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.458 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:03.458 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:23:03.459 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:23:03.459 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:23:03.459 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:23:03.459 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:23:03.459 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:03.459 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:03.459 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:03.459 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.460 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.460 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:03.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:23:03.460 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.460 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:23:03.460 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:03.460 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:03.461 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:03.461 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:03.461 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:03.461 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:03.461 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:03.461 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:03.461 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:03.462 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:03.462 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:03.462 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:03.462 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.462 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.462 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.462 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:23:03.462 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:03.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.463 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.463 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.463 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:23:03.463 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:03.463 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.463 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.464 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:03.464 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.464 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.464 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:23:03.464 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:03.464 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.465 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.465 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.465 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:23:03.465 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:03.465 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.465 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.466 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:03.466 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.466 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.466 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.466 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:23:03.466 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:03.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.466 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.467 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.467 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:23:03.467 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:03.467 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.467 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.467 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.467 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:03.467 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.468 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.468 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.468 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:23:03.468 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:03.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.469 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.469 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.469 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:23:03.469 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:03.469 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.469 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.469 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.470 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:23:03.470 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:23:03.470 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:23:03.470 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:23:03.470 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:03.470 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:03.470 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:03.470 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.471 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.471 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:23:03.471 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:03.471 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:03.471 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:03.471 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:03.472 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:03.472 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:03.472 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:03.472 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:03.472 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:03.472 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:03.472 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:03.472 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:03.473 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.473 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.473 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.473 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:23:03.473 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:03.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.473 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.474 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.474 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:23:03.474 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:03.474 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.474 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.474 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.474 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:03.474 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.475 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.475 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:23:03.475 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:03.475 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.475 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.475 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:23:03.476 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:03.476 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.476 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.476 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:03.476 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.476 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.476 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.477 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:23:03.477 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:03.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.477 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.477 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:23:03.477 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:03.477 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.478 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.478 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:03.478 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.478 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.478 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.478 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:23:03.478 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:03.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.479 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.479 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.479 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:23:03.479 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:03.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.479 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.480 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.480 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:23:03.480 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:23:03.480 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:23:03.480 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:23:03.480 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:03.481 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:03.481 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:03.481 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.481 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.481 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.482 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:23:03.482 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:03.482 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:03.482 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:03.483 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:03.483 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:03.483 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:03.483 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:03.484 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:03.484 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:03.484 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:03.485 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:03.485 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:03.485 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.485 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.486 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.486 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:23:03.486 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:03.486 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.487 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.487 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.487 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:23:03.487 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:03.488 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.488 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.488 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.488 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:03.489 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.489 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.489 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.489 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:23:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.490 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:23:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.491 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.492 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:23:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:03.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:23:03.494 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.495 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:03.496 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.496 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.496 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.497 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:23:03.497 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:03.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.498 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.498 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:23:03.498 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:03.498 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.499 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.499 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.499 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:23:03.499 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:23:03.500 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:23:03.500 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:23:03.500 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:03.500 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:03.501 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:03.501 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.501 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.502 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:23:03.502 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:03.502 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:03.503 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:03.503 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:03.503 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:03.503 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:03.504 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:03.504 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:03.504 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:03.504 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:03.505 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:03.505 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:03.505 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.505 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.506 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.506 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:23:03.506 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:03.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.507 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.507 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.507 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:23:03.508 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:03.508 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.508 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.509 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:03.509 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.509 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.509 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.510 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:23:03.510 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:03.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.510 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.511 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.511 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:23:03.511 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:03.511 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.512 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.512 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:03.512 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.513 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.513 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.513 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:23:03.513 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:03.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.514 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.514 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.514 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:23:03.515 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:03.515 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.515 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.516 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:03.516 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.516 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.517 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.517 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:23:03.517 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:03.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.518 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.518 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.518 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:23:03.518 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:03.519 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.519 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.519 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:23:03.520 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:23:03.520 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:23:03.520 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:23:03.520 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:03.521 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:03.521 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:03.521 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.522 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.522 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:23:03.522 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:03.522 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:03.523 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:03.523 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:03.523 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:03.523 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:03.523 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:03.523 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:03.523 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:03.523 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:03.524 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:03.524 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:03.524 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.524 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.524 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.524 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:23:03.524 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:03.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.525 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.525 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.525 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:23:03.525 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:03.525 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.525 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.526 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:03.526 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.526 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.526 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.526 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:23:03.526 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:03.526 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.526 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.527 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.527 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:23:03.527 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:03.527 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.527 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.527 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:03.527 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.528 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.528 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.528 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:23:03.528 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:03.528 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.528 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.528 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.529 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:23:03.529 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:03.529 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.529 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.529 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:03.529 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.529 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.530 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.530 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:23:03.530 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:03.530 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.530 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.530 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.530 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:23:03.530 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:03.531 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.531 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.531 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:23:03.531 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:23:03.531 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:23:03.531 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:23:03.531 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:03.532 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:03.532 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:03.532 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.532 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.532 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.532 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:23:03.532 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:03.532 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:03.533 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:03.533 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:03.533 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:03.533 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:03.533 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:03.533 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:03.533 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:03.534 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:03.534 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:03.534 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:03.534 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.534 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.534 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.534 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:23:03.534 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:03.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.535 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.535 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.535 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:23:03.535 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:03.535 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.535 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:23:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:23:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:03.537 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.538 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.538 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:23:03.538 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:03.538 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.538 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.538 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:23:03.539 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:03.539 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.539 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.539 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:03.539 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.539 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.539 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.540 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:23:03.540 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:03.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.540 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.540 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:23:03.540 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:23:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:23:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:23:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:23:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:03.542 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:03.542 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:03.542 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.542 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:23:03.542 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:03.542 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:03.543 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:03.543 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:03.543 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:03.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:03.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:03.543 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:03.543 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:03.543 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:03.544 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:03.544 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:03.544 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.544 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.544 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.544 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:23:03.544 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:03.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.545 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.545 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.545 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:23:03.545 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:03.545 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.545 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.545 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:03.546 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.546 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.546 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.546 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:23:03.546 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:03.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.546 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.546 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:23:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.548 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:23:03.548 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:03.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.548 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.548 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:23:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.549 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.550 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:23:03.550 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:03.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.550 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.550 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:23:03.550 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:03.550 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:23:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:23:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:23:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:23:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:03.551 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:23:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:03.552 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:03.553 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:23:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.554 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:23:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:03.555 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:23:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.556 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:23:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.557 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:23:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:23:03.558 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:03.559 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.559 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.559 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.559 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:03.559 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:03.559 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.559 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:03.559 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:23:03.560 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:03.560 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.560 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.560 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:03.560 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:23:03.560 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:03.560 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.560 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.561 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.561 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:23:03.561 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:23:03.561 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:23:03.561 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:23:03.561 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:03.561 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:03.561 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:23:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:23:03.562 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:23:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:23:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:23:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:23:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:03.565 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:23:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:23:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:03.566 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:23:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:23:03.567 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:23:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.568 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:23:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:23:03.569 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:03.570 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.570 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.570 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:23:03.570 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:03.570 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:03.570 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:03.570 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:03.570 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:03.571 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:23:03.571 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:03.571 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.571 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:03.571 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:23:03.571 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:03.571 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:03.571 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:03.572 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:03.572 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:03.572 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:23:03.572 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:03.572 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.572 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:03.572 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:23:03.572 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:23:03.573 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:23:03.573 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:23:03.573 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:23:03.573 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:23:03.573 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:23:03.573 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:23:03.573 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:23:03.574 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:23:03.574 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:23:03.574 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:23:03.574 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:23:03.574 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:23:03.574 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.574 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:03.574 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:23:03.575 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:23:03.575 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:23:03.575 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:23:03.575 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:23:03.575 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:23:03.575 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:23:03.575 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:23:03.575 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:23:03.576 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:23:03.576 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:23:03.576 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:03.576 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5278066280 msgr2=0x7f5278068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5278066280 0x7f5278068730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5288009bd0 tx=0x7f5288008040 comp rx=0 tx=0).stop 2023-07-09T02:23:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5298158e30 msgr2=0x7f52980c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5298158e30 0x7f52980c7ba0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f529001af40 tx=0x7f5290019630 comp rx=0 tx=0).stop 2023-07-09T02:23:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 shutdown_connections 2023-07-09T02:23:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5298158e30 0x7f52980c7ba0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5278066280 0x7f5278068730 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f529806fd10 0x7f52981447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 --2- 172.21.15.45:0/871475573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f529806c820 0x7f5298144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 >> 172.21.15.45:0/871475573 conn(0x7f52980694b0 msgr2=0x7f529806b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 shutdown_connections 2023-07-09T02:23:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:03.408+0000 7f529d111640 1 -- 172.21.15.45:0/871475573 wait complete. 2023-07-09T02:23:03.580 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:23:08.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:23:08.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.731+0000 7ff1e4b37640 1 Processor -- start 2023-07-09T02:23:08.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.731+0000 7ff1e4b37640 1 -- start start 2023-07-09T02:23:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.731+0000 7ff1e4b37640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1e006c110 0x7ff1e006c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.731+0000 7ff1e4b37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e00cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1e4b37640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e006caa0 con 0x7ff1e0158e30 2023-07-09T02:23:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1e4b37640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e00ccf80 con 0x7ff1e006c110 2023-07-09T02:23:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1e4b37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00cd540 con 0x7ff1e00caec0 2023-07-09T02:23:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1d7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1e006c110 0x7ff1e006c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1de59c640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff1e0158e30 0x7ff1e006f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:52588/0 (socket says 172.21.15.45:52588) 2023-07-09T02:23:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1de59c640 1 -- 172.21.15.45:0/459163020 learned_addr learned my addr 172.21.15.45:0/459163020 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1ded9d640 1 --2- 172.21.15.45:0/459163020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e00cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1d7fff640 1 -- 172.21.15.45:0/459163020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 msgr2=0x7ff1e00cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1d7fff640 1 --2- 172.21.15.45:0/459163020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e00cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1d7fff640 1 -- 172.21.15.45:0/459163020 >> v1:172.21.15.155:6789/0 conn(0x7ff1e0158e30 legacy=0x7ff1e006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1ddd9b640 1 -- 172.21.15.45:0/459163020 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087830707 0 0) 0x7ff1d0001120 con 0x7ff1e0158e30 2023-07-09T02:23:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.735+0000 7ff1d7fff640 1 -- 172.21.15.45:0/459163020 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e00cb880 con 0x7ff1e006c110 2023-07-09T02:23:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1d7fff640 1 --2- 172.21.15.45:0/459163020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e006c110 0x7ff1e006c560 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80097c0 tx=0x7ff1c801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f21e532581579af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1ddd9b640 1 -- 172.21.15.45:0/459163020 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80ac620 con 0x7ff1e006c110 2023-07-09T02:23:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1ddd9b640 1 -- 172.21.15.45:0/459163020 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c80ac780 con 0x7ff1e006c110 2023-07-09T02:23:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1ddd9b640 1 -- 172.21.15.45:0/459163020 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80acb10 con 0x7ff1e006c110 2023-07-09T02:23:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 -- 172.21.15.45:0/459163020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e006c110 msgr2=0x7ff1e006c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/459163020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e006c110 0x7ff1e006c560 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80097c0 tx=0x7ff1c801c3c0 comp rx=0 tx=0).stop 2023-07-09T02:23:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 -- 172.21.15.45:0/459163020 shutdown_connections 2023-07-09T02:23:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/459163020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e00cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/459163020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e006c110 0x7ff1e006c560 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 -- 172.21.15.45:0/459163020 >> 172.21.15.45:0/459163020 conn(0x7ff1e00694b0 msgr2=0x7ff1e00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 -- 172.21.15.45:0/459163020 shutdown_connections 2023-07-09T02:23:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 -- 172.21.15.45:0/459163020 wait complete. 2023-07-09T02:23:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 Processor -- start 2023-07-09T02:23:08.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 -- start start 2023-07-09T02:23:08.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e006c110 0x7ff1e0152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:08.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.739+0000 7ff1e4b37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:08.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1e4b37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e0158e30 0x7ff1e014d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1e4b37640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e015a450 con 0x7ff1e006c110 2023-07-09T02:23:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1e4b37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0153010 con 0x7ff1e0158e30 2023-07-09T02:23:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1e4b37640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0159840 con 0x7ff1e00caec0 2023-07-09T02:23:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e006c110 0x7ff1e0152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e006c110 0x7ff1e0152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38928/0 (socket says 172.21.15.45:38928) 2023-07-09T02:23:08.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 -- 172.21.15.45:0/331703273 learned_addr learned my addr 172.21.15.45:0/331703273 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1d7fff640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:08.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1ded9d640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e0158e30 0x7ff1e014d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 -- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 msgr2=0x7ff1e014a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e014a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:08.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 -- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e0158e30 msgr2=0x7ff1e014d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e0158e30 0x7ff1e014d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 -- 172.21.15.45:0/331703273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c8009420 con 0x7ff1e006c110 2023-07-09T02:23:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1ded9d640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e0158e30 0x7ff1e014d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1d7fff640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1de59c640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e006c110 0x7ff1e0152ad0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000c480 tx=0x7ff1d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1d6ffd640 1 -- 172.21.15.45:0/331703273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00074e0 con 0x7ff1e006c110 2023-07-09T02:23:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1d6ffd640 1 -- 172.21.15.45:0/331703273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d0007660 con 0x7ff1e006c110 2023-07-09T02:23:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1d6ffd640 1 -- 172.21.15.45:0/331703273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0004a30 con 0x7ff1e006c110 2023-07-09T02:23:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e0159b20 con 0x7ff1e006c110 2023-07-09T02:23:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e015a0e0 con 0x7ff1e006c110 2023-07-09T02:23:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e004d7d0 con 0x7ff1e006c110 2023-07-09T02:23:08.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.743+0000 7ff1d6ffd640 1 -- 172.21.15.45:0/331703273 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1d0004b90 con 0x7ff1e006c110 2023-07-09T02:23:08.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.747+0000 7ff1d6ffd640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1c00662b0 0x7ff1c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:08.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.747+0000 7ff1d6ffd640 1 -- 172.21.15.45:0/331703273 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1d0082d20 con 0x7ff1e006c110 2023-07-09T02:23:08.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.747+0000 7ff1d6ffd640 1 -- 172.21.15.45:0/331703273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7ff1c006e3f0 con 0x7ff1e006c110 2023-07-09T02:23:08.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.747+0000 7ff1d7fff640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1c00662b0 0x7ff1c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:08.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.747+0000 7ff1d7fff640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1c00662b0 0x7ff1c0068760 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80ae000 tx=0x7ff1c80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:08.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.751+0000 7ff1d6ffd640 1 -- 172.21.15.45:0/331703273 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1d0018020 con 0x7ff1e006c110 2023-07-09T02:23:08.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.907+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff1e006caa0 con 0x7ff1e006c110 2023-07-09T02:23:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.907+0000 7ff1d6ffd640 1 -- 172.21.15.45:0/331703273 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) v1 ==== 81+0+36968 (secure 0 0 0) 0x7ff1e006caa0 con 0x7ff1e006c110 2023-07-09T02:23:08.910 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:08.911 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:08.911 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 184, 2023-07-09T02:23:08.911 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:23:08.911 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:23:08.911 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:22:54.475364+0000", 2023-07-09T02:23:08.911 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:23:08.911 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:23:08.912 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:23:08.912 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:23:08.912 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:23:08.912 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:23:08.912 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:23:08.912 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:23:08.912 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:23:08.913 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:08.913 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:23:08.913 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:23:08.913 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:23:08.913 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:23:08.913 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:23:08.913 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 24, 2023-07-09T02:23:08.913 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:23:08.914 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:23:08.914 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:23:08.914 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:23:08.914 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:23:08.914 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:23:08.914 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.914 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:23:08.915 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:23:08.915 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:23:08.915 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:08.915 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:08.915 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:08.915 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:08.915 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:08.916 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:08.916 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:08.916 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:08.916 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:08.916 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:08.916 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:08.916 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:08.917 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:23:08.917 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:23:08.917 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:23:08.917 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:23:08.917 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:23:08.917 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:08.917 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:08.918 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:08.918 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:08.918 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:08.918 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:08.918 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:08.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.918 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:23:08.918 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:08.919 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:08.919 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:08.919 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:08.919 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:08.919 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:08.919 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:08.919 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:08.919 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:08.920 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:08.920 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:08.920 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:08.920 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:08.920 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:08.920 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:08.920 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:08.920 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:08.921 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:08.921 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:08.921 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:08.921 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:08.921 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:08.921 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:08.921 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:08.921 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:08.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:08.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.922 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:08.922 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:08.922 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:08.922 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:08.922 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:08.923 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:08.923 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:08.923 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:08.923 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:08.923 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:08.923 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:08.923 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:08.923 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:23:08.924 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:23:08.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.924 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:08.924 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:23:08.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.924 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:08.924 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:23:08.925 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:23:08.925 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:23:08.925 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:23:08.925 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:23:08.925 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:08.925 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:08.925 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:08.925 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.926 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.926 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:23:08.926 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:23:08.926 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:23:08.926 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:08.926 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:08.927 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:08.927 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:08.927 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:08.927 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:08.927 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:08.927 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:08.927 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:08.928 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:08.928 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:08.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:08.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:23:08.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:23:08.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:23:08.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:23:08.928 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:23:08.929 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:08.929 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:08.929 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:08.929 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:08.929 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:08.929 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:08.929 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:08.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.930 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:23:08.930 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:08.930 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:08.930 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:08.930 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:08.930 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:08.930 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:08.931 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:08.931 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:08.931 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:08.931 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:08.931 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:08.931 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:08.931 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:08.931 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:08.932 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:08.932 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:08.932 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:08.932 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:08.932 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:08.932 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:08.932 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:08.932 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:08.933 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:08.933 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:08.933 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:08.933 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:08.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.933 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:08.933 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:08.934 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:23:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:23:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:23:08.935 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:23:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:23:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:23:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:23:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.937 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.937 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.937 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 23, 2023-07-09T02:23:08.937 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:23:08.937 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:37.645121+0000", 2023-07-09T02:23:08.937 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:08.937 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:08.937 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:23:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:23:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:23:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:23:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:23:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.940 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "181", 2023-07-09T02:23:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:08.941 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:08.942 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:08.943 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:08.943 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:08.943 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:08.943 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:08.943 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:08.943 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:08.943 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:08.944 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:08.944 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:08.944 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:08.944 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:08.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.944 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:08.944 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:08.944 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:08.945 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:08.945 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:08.945 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:08.945 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:08.945 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:08.945 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:08.945 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:08.945 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:08.946 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:08.946 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:23:08.946 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:23:08.946 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:23:08.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.946 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:08.946 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:23:08.946 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:23:08.947 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.947 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:08.947 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2, 2023-07-09T02:23:08.947 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2, 2023-07-09T02:23:08.947 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:23:08.947 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:23:08.947 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:23:08.948 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:08.948 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:08.948 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:08.948 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.948 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.948 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.948 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 24, 2023-07-09T02:23:08.949 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:23:08.949 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:38.115103+0000", 2023-07-09T02:23:08.949 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1027, 2023-07-09T02:23:08.949 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool,full,full_quota", 2023-07-09T02:23:08.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:08.949 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:08.949 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:08.949 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:08.950 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:08.950 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:08.950 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:08.950 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:08.950 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:08.950 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:08.950 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:23:08.950 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:23:08.951 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:23:08.951 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:23:08.951 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:23:08.951 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:08.951 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:08.951 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:08.951 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:08.951 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:08.952 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:08.952 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:08.952 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.952 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "184", 2023-07-09T02:23:08.952 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:08.952 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:08.952 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:08.953 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:08.953 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:08.953 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:08.953 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:08.953 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:08.953 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:08.953 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:23:08.953 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:08.954 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:08.954 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:08.954 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:08.954 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:08.954 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:08.954 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:08.954 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:08.954 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.956 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:08.956 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:08.956 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:08.956 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:08.956 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:08.956 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:08.956 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:08.957 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:08.957 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:08.957 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:08.957 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:08.957 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:08.957 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:23:08.957 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:23:08.957 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.958 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:08.958 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:23:08.958 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:23:08.958 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.958 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.958 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:08.958 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:23:08.958 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:23:08.959 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:23:08.959 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:23:08.959 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:23:08.959 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:08.959 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:08.959 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:08.959 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.959 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.960 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:08.960 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:23:08.960 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.960 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:23:08.960 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:08.960 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:08.960 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:08.960 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:08.961 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:08.961 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:08.961 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:08.961 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:08.961 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:08.961 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:08.961 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:08.961 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:08.962 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.962 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.962 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.962 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:23:08.962 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:08.962 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.962 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.963 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.963 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:23:08.963 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:08.963 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.963 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.963 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:08.963 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.964 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.964 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.964 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:23:08.964 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:08.964 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.964 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.964 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.964 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:23:08.965 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:08.965 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.965 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.965 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:08.965 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.965 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.966 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:23:08.966 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:08.966 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.966 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.966 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.966 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:23:08.966 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:08.966 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.967 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.967 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.967 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:08.967 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.967 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.967 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.967 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:23:08.967 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:08.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.968 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.968 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.968 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:23:08.968 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:08.968 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.968 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.969 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:23:08.969 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:23:08.969 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:23:08.969 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:23:08.969 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:08.969 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:08.969 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:08.969 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.970 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.970 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.970 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:23:08.970 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:08.970 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:08.970 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:08.970 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:08.970 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:08.971 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:08.971 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:08.971 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:08.971 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:08.971 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:08.971 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:08.971 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:08.972 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.972 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.972 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.972 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:23:08.972 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:08.972 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.972 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.972 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.973 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:23:08.973 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:08.973 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.973 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.973 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:08.973 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.973 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.974 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.974 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:23:08.974 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:08.974 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.974 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.974 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.974 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:23:08.974 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:08.975 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.975 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.975 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:08.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.975 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:23:08.976 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:08.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.976 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.976 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.976 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:23:08.976 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:08.976 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.977 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.977 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.977 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:08.977 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.977 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.977 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.977 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:23:08.977 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:08.978 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.978 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.978 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.978 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:23:08.978 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:08.978 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.978 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.978 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.979 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:23:08.979 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:23:08.979 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:23:08.979 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:23:08.979 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:08.979 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:08.979 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:08.979 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.980 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.980 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:23:08.980 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:08.980 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:08.980 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:08.980 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:08.980 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:08.981 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:08.981 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:08.981 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:08.981 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:08.981 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:08.981 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:08.981 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:08.981 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.982 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.982 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.982 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:23:08.982 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:08.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.982 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.982 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.982 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:23:08.983 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:08.983 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.983 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.983 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:08.983 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.983 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.983 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:23:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:23:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:23:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:23:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.987 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:08.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.987 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:23:08.987 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:08.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.988 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.988 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.988 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:23:08.988 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:08.988 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.988 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.988 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:23:08.989 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:23:08.989 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:23:08.989 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:23:08.989 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:08.989 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:08.989 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:08.989 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.990 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.990 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:23:08.990 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:08.990 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:08.990 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:08.990 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:08.990 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:08.991 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:08.991 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:08.991 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:08.991 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:08.991 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:08.991 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:08.991 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:08.991 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.992 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.992 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.992 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:23:08.992 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:08.992 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.992 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.992 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.993 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:23:08.993 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:08.993 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.993 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.993 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:08.993 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.993 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.994 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.994 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:23:08.994 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:08.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.994 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.994 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.994 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:23:08.994 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.995 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:23:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:23:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.996 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:23:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:08.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:23:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:08.998 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:23:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:23:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:23:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:23:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:08.999 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:23:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:09.000 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:09.001 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:23:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.002 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:23:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.003 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:23:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:23:09.004 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:09.005 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.005 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.005 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:09.005 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.005 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.005 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.005 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:23:09.006 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:09.006 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.006 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.006 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.006 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:23:09.006 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:09.006 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.006 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.007 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:09.007 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.007 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.007 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.007 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:23:09.007 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:09.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.008 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.008 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.008 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:23:09.008 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:09.008 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.008 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.008 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:23:09.009 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:23:09.009 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:23:09.009 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:23:09.009 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:09.009 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:09.009 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:09.009 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.009 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.010 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.010 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:23:09.010 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:09.010 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:09.010 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:09.010 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:09.010 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:09.011 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:09.011 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:09.011 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:09.011 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:09.011 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:09.011 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:09.011 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:09.011 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.012 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.012 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.012 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:23:09.012 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:09.012 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.012 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.012 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.012 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:23:09.013 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:09.013 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.013 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.013 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.013 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:09.013 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.013 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.013 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.014 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:23:09.014 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:09.014 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.014 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.014 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.014 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:23:09.014 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:09.014 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.015 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.015 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.015 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:09.015 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.015 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.015 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.015 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:23:09.016 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:09.016 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.016 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.016 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.016 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:23:09.016 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:09.016 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.016 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.017 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.017 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:09.017 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.017 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.017 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.017 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:23:09.017 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:09.017 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.018 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.018 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.018 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:23:09.018 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:09.018 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.018 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.018 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.018 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:23:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:23:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:23:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:23:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.019 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:23:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:09.020 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:09.021 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:23:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.022 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:23:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.023 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:23:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:23:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:09.024 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:23:09.025 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:23:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.026 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:23:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.027 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.028 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.028 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:23:09.028 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:09.028 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.028 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.028 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.028 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:23:09.029 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:23:09.029 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:23:09.029 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:23:09.029 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:09.029 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:09.029 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:09.029 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.029 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.030 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.030 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:23:09.030 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:09.030 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:09.030 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:09.030 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:09.030 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:09.030 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:09.031 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:09.031 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:09.031 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:09.031 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:09.031 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:09.031 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:09.031 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.031 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.032 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.032 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:23:09.032 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:09.032 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.032 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.032 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.032 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:23:09.032 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:09.033 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.033 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.033 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.033 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:09.033 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.033 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.033 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.034 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:23:09.034 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:09.034 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.034 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.034 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.034 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:23:09.034 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:09.034 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.035 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.035 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.035 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:09.035 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.035 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.035 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.035 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:23:09.035 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:09.036 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.036 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.036 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.036 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:23:09.036 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:09.036 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.036 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.036 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.037 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:09.037 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:09.037 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.037 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:09.037 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:23:09.037 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:09.037 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.037 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.038 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:09.038 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:23:09.038 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:09.038 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.038 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.038 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.038 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:23:09.039 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:23:09.039 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:23:09.039 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:23:09.039 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:09.039 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:09.039 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:09.039 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:09.039 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.040 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:09.040 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:23:09.040 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.040 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:23:09.040 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:09.040 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:09.040 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:09.040 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:09.041 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:09.041 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:23:09.041 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:09.041 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.041 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.041 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:23:09.041 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:09.041 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:09.042 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:09.042 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:09.042 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:09.042 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:23:09.042 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:09.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.042 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.042 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:23:09.043 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:09.043 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:09.043 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:09.043 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:09.043 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:09.043 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:23:09.043 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:09.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.044 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.044 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:23:09.044 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:09.044 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:09.044 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:09.044 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:09.044 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:09.045 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:23:09.045 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:09.045 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.045 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.045 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:23:09.045 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:09.045 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:09.045 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:09.046 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:09.046 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:09.046 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:23:09.046 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:09.046 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.046 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.046 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:23:09.046 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:09.047 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:09.047 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:09.047 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:09.047 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:09.047 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:23:09.047 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:09.047 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.047 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.048 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:23:09.048 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:09.048 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:09.048 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:09.048 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:09.048 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:09.048 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:23:09.048 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:09.049 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.049 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:09.049 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:23:09.049 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:09.049 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:09.049 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:09.049 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:09.050 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:09.050 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:23:09.050 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:09.050 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.050 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:09.050 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:23:09.050 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:23:09.050 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:23:09.051 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:23:09.051 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:23:09.051 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:23:09.051 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:23:09.051 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:23:09.051 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:23:09.051 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:23:09.051 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:23:09.052 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:23:09.052 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:23:09.052 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:23:09.052 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.052 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:09.052 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:23:09.052 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:23:09.052 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:23:09.053 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:23:09.053 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:23:09.053 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:23:09.053 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:23:09.053 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:23:09.053 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:23:09.053 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:23:09.053 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:23:09.054 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:09.054 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1c00662b0 msgr2=0x7ff1c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1c00662b0 0x7ff1c0068760 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80ae000 tx=0x7ff1c80a7000 comp rx=0 tx=0).stop 2023-07-09T02:23:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e006c110 msgr2=0x7ff1e0152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e006c110 0x7ff1e0152ad0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000c480 tx=0x7ff1d000c940 comp rx=0 tx=0).stop 2023-07-09T02:23:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 shutdown_connections 2023-07-09T02:23:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e0158e30 0x7ff1e014d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff1c00662b0 0x7ff1c0068760 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e00caec0 0x7ff1e014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 --2- 172.21.15.45:0/331703273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1e006c110 0x7ff1e0152ad0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 >> 172.21.15.45:0/331703273 conn(0x7ff1e00694b0 msgr2=0x7ff1e0152320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 shutdown_connections 2023-07-09T02:23:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:08.911+0000 7ff1e4b37640 1 -- 172.21.15.45:0/331703273 wait complete. 2023-07-09T02:23:09.057 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-07-09T02:23:14.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:23:14.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983438f640 1 Processor -- start 2023-07-09T02:23:14.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983438f640 1 -- start start 2023-07-09T02:23:14.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983438f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 0x7f982c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983438f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f982c0cbbb0 0x7f982c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983438f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c06bf30 con 0x7f982c0c9250 2023-07-09T02:23:14.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983438f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c06bc50 con 0x7f982c0cbbb0 2023-07-09T02:23:14.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983438f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0cab90 con 0x7f982c0ca0f0 2023-07-09T02:23:14.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983292c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f982c0c9250 0x7f982c15db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42896/0 (socket says 172.21.15.45:42896) 2023-07-09T02:23:14.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983292c640 1 -- 172.21.15.45:0/1510418854 learned_addr learned my addr 172.21.15.45:0/1510418854 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:14.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983192a640 1 --2- 172.21.15.45:0/1510418854 >> v2:172.21.15.155:3300/0 conn(0x7f982c0cbbb0 0x7f982c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983212b640 1 --2- 172.21.15.45:0/1510418854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 0x7f982c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f9831129640 1 -- 172.21.15.45:0/1510418854 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725630506 0 0) 0x7f982c06bf30 con 0x7f982c0c9250 2023-07-09T02:23:14.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f9831129640 1 -- 172.21.15.45:0/1510418854 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9818003530 con 0x7f982c0c9250 2023-07-09T02:23:14.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983192a640 1 -- 172.21.15.45:0/1510418854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 msgr2=0x7f982c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:14.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983192a640 1 --2- 172.21.15.45:0/1510418854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 0x7f982c0cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983192a640 1 -- 172.21.15.45:0/1510418854 >> v1:172.21.15.45:6789/0 conn(0x7f982c0c9250 legacy=0x7f982c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.211+0000 7f983192a640 1 -- 172.21.15.45:0/1510418854 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0cae70 con 0x7f982c0cbbb0 2023-07-09T02:23:14.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.215+0000 7f983192a640 1 --2- 172.21.15.45:0/1510418854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0cbbb0 0x7f982c0c8d10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097c0 tx=0x7f981c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d87a90174b40578 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:14.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.215+0000 7f9831129640 1 -- 172.21.15.45:0/1510418854 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0ab600 con 0x7f982c0cbbb0 2023-07-09T02:23:14.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.215+0000 7f9831129640 1 -- 172.21.15.45:0/1510418854 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c0a7050 con 0x7f982c0cbbb0 2023-07-09T02:23:14.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.215+0000 7f9831129640 1 -- 172.21.15.45:0/1510418854 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0ab980 con 0x7f982c0cbbb0 2023-07-09T02:23:14.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.215+0000 7f983438f640 1 -- 172.21.15.45:0/1510418854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0cbbb0 msgr2=0x7f982c0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.215+0000 7f983438f640 1 --2- 172.21.15.45:0/1510418854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0cbbb0 0x7f982c0c8d10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097c0 tx=0x7f981c01c3f0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 -- 172.21.15.45:0/1510418854 shutdown_connections 2023-07-09T02:23:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 --2- 172.21.15.45:0/1510418854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0cbbb0 0x7f982c0c8d10 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 --2- 172.21.15.45:0/1510418854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 0x7f982c0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 -- 172.21.15.45:0/1510418854 >> 172.21.15.45:0/1510418854 conn(0x7f982c0694b0 msgr2=0x7f982c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 -- 172.21.15.45:0/1510418854 shutdown_connections 2023-07-09T02:23:14.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 -- 172.21.15.45:0/1510418854 wait complete. 2023-07-09T02:23:14.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 Processor -- start 2023-07-09T02:23:14.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 -- start start 2023-07-09T02:23:14.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982c0c9250 0x7f982c0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 0x7f982c159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0cbbb0 0x7f982c14a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0cc350 con 0x7f982c0c9250 2023-07-09T02:23:14.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c159ba0 con 0x7f982c0cbbb0 2023-07-09T02:23:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983438f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0b3ae0 con 0x7f982c0ca0f0 2023-07-09T02:23:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982c0c9250 0x7f982c0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982c0c9250 0x7f982c0b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38886/0 (socket says 172.21.15.45:38886) 2023-07-09T02:23:14.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 -- 172.21.15.45:0/1801970265 learned_addr learned my addr 172.21.15.45:0/1801970265 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 -- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 msgr2=0x7f982c159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 0x7f982c159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 -- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0cbbb0 msgr2=0x7f982c14a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0cbbb0 0x7f982c14a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 -- 172.21.15.45:0/1801970265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c009420 con 0x7f982c0c9250 2023-07-09T02:23:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f983212b640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982c0c9250 0x7f982c0b3500 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f982800e930 tx=0x7f982800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.219+0000 7f9822ffd640 1 -- 172.21.15.45:0/1801970265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800ca00 con 0x7f982c0c9250 2023-07-09T02:23:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f9822ffd640 1 -- 172.21.15.45:0/1801970265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982800cb60 con 0x7f982c0c9250 2023-07-09T02:23:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f9822ffd640 1 -- 172.21.15.45:0/1801970265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828013470 con 0x7f982c0c9250 2023-07-09T02:23:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c0b3dc0 con 0x7f982c0c9250 2023-07-09T02:23:14.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c14a760 con 0x7f982c0c9250 2023-07-09T02:23:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c04d7d0 con 0x7f982c0c9250 2023-07-09T02:23:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f9822ffd640 1 -- 172.21.15.45:0/1801970265 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98280135d0 con 0x7f982c0c9250 2023-07-09T02:23:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f9822ffd640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9810066280 0x7f9810068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f9822ffd640 1 -- 172.21.15.45:0/1801970265 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9828084020 con 0x7f982c0c9250 2023-07-09T02:23:14.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.223+0000 7f983192a640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9810066280 0x7f9810068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.227+0000 7f983192a640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9810066280 0x7f9810068730 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ad000 tx=0x7f981c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:14.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.227+0000 7f9822ffd640 1 -- 172.21.15.45:0/1801970265 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9828051560 con 0x7f982c0c9250 2023-07-09T02:23:14.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.383+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f982c06c540 con 0x7f982c0c9250 2023-07-09T02:23:14.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.383+0000 7f9822ffd640 1 -- 172.21.15.45:0/1801970265 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) v1 ==== 81+0+36949 (secure 0 0 0) 0x7f9828054b80 con 0x7f982c0c9250 2023-07-09T02:23:14.387 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:14.387 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:14.388 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 185, 2023-07-09T02:23:14.388 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:23:14.388 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:23:14.388 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:23:09.480700+0000", 2023-07-09T02:23:14.388 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:23:14.388 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:23:14.389 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:23:14.389 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:23:14.389 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:23:14.389 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:23:14.389 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:23:14.389 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:23:14.389 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:23:14.389 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:14.390 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:23:14.390 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:23:14.390 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:23:14.390 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:23:14.390 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:23:14.390 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 24, 2023-07-09T02:23:14.390 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:23:14.391 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:23:14.391 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:23:14.391 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:23:14.391 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:23:14.391 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:23:14.391 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.391 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:23:14.391 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:23:14.392 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:23:14.392 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:14.392 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:14.392 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:14.392 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:14.392 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:14.392 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:14.393 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:14.393 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:14.393 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:14.393 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:14.393 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:14.393 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:14.393 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:23:14.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:23:14.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:23:14.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:23:14.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:23:14.394 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:14.394 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:14.394 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:14.394 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:14.395 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:14.395 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:14.395 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:14.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.395 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:23:14.395 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:14.395 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:14.395 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:14.396 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:14.396 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:14.396 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:14.396 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:14.396 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:14.396 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:14.396 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:14.397 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:14.397 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:14.397 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:14.397 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:14.397 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:14.397 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:14.397 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:14.398 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:23:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:23:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:23:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:23:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:23:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:23:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:23:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:23:14.402 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:23:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:23:14.403 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:23:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:14.404 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:23:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:23:14.405 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:23:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:23:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:23:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:14.406 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:23:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:14.407 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:14.408 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:14.409 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:14.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:14.411 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:23:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:14.412 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:23:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:23:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:23:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:23:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:23:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:23:14.413 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 23, 2023-07-09T02:23:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:23:14.414 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:37.645121+0000", 2023-07-09T02:23:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:23:14.416 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:23:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:23:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:23:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:23:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:14.417 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:14.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:14.418 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:14.418 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:14.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "181", 2023-07-09T02:23:14.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:14.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:14.418 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:14.419 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:14.419 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:14.419 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:14.419 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:14.419 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:14.420 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:14.420 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:14.420 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:14.420 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:14.420 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:14.420 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:14.420 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:14.420 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:14.421 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:14.421 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:14.421 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:14.421 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:14.421 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:14.421 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:14.421 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:14.422 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:14.422 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:14.422 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:14.422 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.422 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:14.422 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:14.422 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:14.423 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:14.423 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:14.423 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:14.423 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:14.423 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:14.423 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:14.423 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:14.423 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:14.424 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:14.424 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:23:14.424 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:23:14.424 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:23:14.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.424 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:14.424 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:23:14.425 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:23:14.425 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.425 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.425 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:14.425 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2, 2023-07-09T02:23:14.425 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2, 2023-07-09T02:23:14.425 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:23:14.426 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:23:14.426 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:23:14.426 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:14.426 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:14.426 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:14.426 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.426 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.426 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.427 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 24, 2023-07-09T02:23:14.427 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:23:14.427 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:38.115103+0000", 2023-07-09T02:23:14.427 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:14.427 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:14.427 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:14.427 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:14.428 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:14.428 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:14.428 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:14.428 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:14.428 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:14.428 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:14.428 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:14.428 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:14.429 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:23:14.429 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:23:14.429 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:23:14.429 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:23:14.429 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:23:14.429 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:14.430 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:14.430 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:14.430 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:14.430 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:14.430 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:14.430 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:14.430 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.431 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "185", 2023-07-09T02:23:14.431 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:14.431 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:14.431 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:14.431 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:14.431 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:14.431 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:14.431 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:14.432 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:14.432 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:14.432 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:23:14.432 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:14.432 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:14.432 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:14.432 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:14.432 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:14.433 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:14.433 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:14.433 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:14.433 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:14.433 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:14.433 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:14.433 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:14.433 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:14.434 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:14.434 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:14.434 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:14.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.434 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:14.434 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:14.434 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:14.435 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:14.435 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:14.435 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:14.435 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:14.435 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:14.435 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:14.435 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:14.436 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:14.436 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:14.436 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:23:14.436 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:23:14.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.436 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:14.436 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:23:14.437 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:23:14.437 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.437 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:14.437 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:23:14.437 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:23:14.437 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:23:14.437 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:23:14.438 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:23:14.438 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:14.438 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:14.438 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:14.438 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.438 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.438 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:14.438 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:23:14.439 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.439 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:23:14.439 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.439 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.439 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.439 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.439 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.440 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.440 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.440 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.440 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.440 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.441 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.441 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.441 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.441 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.441 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:23:14.441 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.441 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.442 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.442 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:23:14.442 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.442 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.442 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.442 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.442 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.443 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.443 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:23:14.443 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.443 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.443 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:23:14.444 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.444 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.444 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.444 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.444 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.444 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.445 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.445 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:23:14.445 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.445 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.445 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:23:14.445 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.446 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.446 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.446 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.446 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.446 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.446 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.446 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:23:14.447 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.447 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.447 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.447 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:23:14.447 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.447 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.447 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.448 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:23:14.448 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:23:14.448 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:23:14.448 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:23:14.448 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.448 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.448 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.449 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.449 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.449 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:23:14.449 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.449 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.449 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.449 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.450 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.450 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.450 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.450 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.450 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.450 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.451 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.451 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.451 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.451 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.451 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.451 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:23:14.451 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.452 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.452 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.452 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:23:14.452 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.452 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.452 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.453 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.453 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.453 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.453 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.453 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:23:14.453 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.453 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.454 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.454 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:23:14.454 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.454 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.454 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.455 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.455 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.455 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.455 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:23:14.455 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.456 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.456 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.456 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:23:14.456 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.457 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.457 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.458 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.458 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.458 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.458 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.459 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:23:14.459 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.459 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.460 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.460 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.460 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:23:14.460 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.461 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.461 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.461 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.461 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:23:14.461 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:23:14.461 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:23:14.461 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:23:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:23:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.464 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.464 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.464 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.464 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.464 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.464 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:23:14.465 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.465 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.465 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.465 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:23:14.465 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.465 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.465 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.466 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.466 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.466 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.466 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.466 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:23:14.466 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.467 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.467 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.467 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:23:14.467 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.467 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.467 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.467 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.468 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.468 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.468 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.468 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.468 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:23:14.468 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.469 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.469 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.469 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:23:14.469 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.469 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.469 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.469 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.469 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.470 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.470 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.470 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.470 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:23:14.470 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.470 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.470 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.470 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.471 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:23:14.471 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.471 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.471 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.471 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:23:14.471 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:23:14.471 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:23:14.472 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:23:14.472 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.472 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.472 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.472 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.472 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.472 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.473 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:23:14.473 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.473 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.473 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.473 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.473 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.473 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.473 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.474 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.474 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.474 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.474 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.474 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.474 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.475 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.475 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:23:14.475 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.475 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.475 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.475 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:23:14.476 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.476 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.476 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.476 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.476 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.476 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.477 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:23:14.477 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.477 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.477 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:23:14.477 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.478 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.478 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.478 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.478 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.478 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.478 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.478 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:23:14.479 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.479 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.479 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.479 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:23:14.479 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.479 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.480 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.480 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.480 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.480 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.480 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.480 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:23:14.481 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.481 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.481 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.481 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.481 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:23:14.481 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.482 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.482 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.482 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.482 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:23:14.482 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:23:14.482 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:23:14.482 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:23:14.482 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.483 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.483 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.483 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.483 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.483 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.483 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:23:14.483 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.484 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.484 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.484 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.484 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.484 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.484 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.484 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.485 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.485 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.485 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.485 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.485 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.485 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.485 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.486 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:23:14.486 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.486 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.486 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.487 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.487 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:23:14.487 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.487 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.488 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.488 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.488 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.488 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.489 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.489 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.489 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:23:14.490 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.490 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.490 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.491 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:23:14.491 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.491 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.491 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.492 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:23:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.493 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:23:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.494 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:23:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.495 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:23:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:23:14.496 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:23:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:23:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:23:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:23:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.498 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.499 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.499 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.499 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.499 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.499 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.499 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.500 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.500 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.500 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.500 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:23:14.500 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.500 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.501 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.501 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:23:14.501 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.501 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.501 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.501 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.501 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.501 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.502 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.502 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:23:14.502 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.502 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.502 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:23:14.503 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.503 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.503 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.503 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.503 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.504 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.504 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.504 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:23:14.504 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.504 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.504 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.504 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.505 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:23:14.505 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.505 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.505 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.505 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.505 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.505 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.506 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:23:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:23:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:23:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:23:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:23:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.509 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.510 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:23:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:23:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.512 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.512 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.512 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.512 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.512 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.512 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:23:14.513 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.513 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.513 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.513 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:23:14.513 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.514 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.514 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.514 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.514 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.514 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.514 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.515 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:23:14.515 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.515 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.515 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.515 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:23:14.515 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.515 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.516 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.516 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.516 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.516 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.516 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.516 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:23:14.517 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.517 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.517 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:23:14.517 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.517 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.517 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.518 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:23:14.518 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:23:14.518 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:23:14.518 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:23:14.518 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.518 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.518 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.519 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.519 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.519 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:23:14.519 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.519 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.519 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.520 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.520 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.520 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.520 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.520 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.520 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.521 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.521 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.521 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.521 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.521 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.521 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.521 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:23:14.521 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.522 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.522 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.522 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:23:14.522 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.522 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.522 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.523 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.523 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.523 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.523 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.523 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:23:14.523 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.523 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.523 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.524 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.524 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:23:14.524 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.524 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.524 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.525 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.525 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.525 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.525 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.525 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:23:14.525 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.526 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.526 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.526 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:23:14.526 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.526 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.526 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.527 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.527 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.527 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.527 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.527 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:23:14.527 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.528 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.528 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.528 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:23:14.528 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.528 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.529 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.529 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:23:14.529 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:23:14.530 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:23:14.530 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:23:14.530 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.530 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.530 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.531 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.531 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.531 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:14.531 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:23:14.531 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.531 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:23:14.532 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:14.532 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:14.532 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:14.533 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:14.533 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:14.533 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:23:14.534 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:14.534 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.534 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.534 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:23:14.534 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:14.535 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:14.535 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:14.535 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:14.535 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:14.536 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:23:14.536 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:14.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.537 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:23:14.537 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:14.537 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:14.537 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:14.537 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:14.537 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:14.537 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:23:14.538 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:14.538 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.538 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:23:14.538 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:14.538 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:14.538 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:14.538 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:14.539 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:14.539 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:23:14.539 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:14.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.539 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.539 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:23:14.539 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:14.539 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:14.540 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:14.540 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:14.540 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:14.540 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:23:14.540 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:14.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.541 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:23:14.541 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:14.541 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:14.541 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:14.541 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:14.541 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:14.541 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:23:14.541 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:14.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.542 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:23:14.542 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:14.542 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:14.542 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:14.542 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:14.543 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:14.543 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:23:14.543 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:14.543 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.543 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.543 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:23:14.543 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:14.543 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:14.544 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:14.544 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:14.544 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:14.544 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:23:14.544 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:14.544 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.544 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:14.545 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:23:14.545 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:23:14.545 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:23:14.545 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:23:14.545 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:23:14.545 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:23:14.545 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:23:14.545 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:23:14.546 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:23:14.546 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:23:14.546 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:23:14.546 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:23:14.546 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:23:14.546 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:23:14.546 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.547 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:23:14.547 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:23:14.547 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:23:14.547 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:23:14.547 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:23:14.548 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:23:14.548 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:23:14.548 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:23:14.548 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:23:14.548 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:23:14.548 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:23:14.548 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.549 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9810066280 msgr2=0x7f9810068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9810066280 0x7f9810068730 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ad000 tx=0x7f981c004740 comp rx=0 tx=0).stop 2023-07-09T02:23:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982c0c9250 msgr2=0x7f982c0b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982c0c9250 0x7f982c0b3500 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f982800e930 tx=0x7f982800edf0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 shutdown_connections 2023-07-09T02:23:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0cbbb0 0x7f982c14a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9810066280 0x7f9810068730 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f982c0ca0f0 0x7f982c159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 --2- 172.21.15.45:0/1801970265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f982c0c9250 0x7f982c0b3500 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 >> 172.21.15.45:0/1801970265 conn(0x7f982c0694b0 msgr2=0x7f982c153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 shutdown_connections 2023-07-09T02:23:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.387+0000 7f983438f640 1 -- 172.21.15.45:0/1801970265 wait complete. 2023-07-09T02:23:14.552 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-07-09T02:23:14.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-07-09T02:23:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f09169d2640 1 Processor -- start 2023-07-09T02:23:14.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f09169d2640 1 -- start start 2023-07-09T02:23:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f09169d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0910158e30 0x7f091006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f09169d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f091006fd10 0x7f091006c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f09169d2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100ccf80 con 0x7f091006c650 2023-07-09T02:23:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f09169d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100cd540 con 0x7f0910158e30 2023-07-09T02:23:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f09169d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091006ca90 con 0x7f091006fd10 2023-07-09T02:23:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f090ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0910158e30 0x7f091006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f090ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0910158e30 0x7f091006f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38890/0 (socket says 172.21.15.45:38890) 2023-07-09T02:23:14.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f090ffff640 1 -- 172.21.15.45:0/3007354495 learned_addr learned my addr 172.21.15.45:0/3007354495 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:14.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f0914f6f640 1 --1- 172.21.15.45:0/3007354495 >> v1:172.21.15.45:6789/0 conn(0x7f091006c650 0x7f09100caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42902/0 (socket says 172.21.15.45:42902) 2023-07-09T02:23:14.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.695+0000 7f090f7fe640 1 --2- 172.21.15.45:0/3007354495 >> v2:172.21.15.155:3300/0 conn(0x7f091006fd10 0x7f091006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090ffff640 1 -- 172.21.15.45:0/3007354495 >> v2:172.21.15.155:3300/0 conn(0x7f091006fd10 msgr2=0x7f091006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:14.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090ffff640 1 --2- 172.21.15.45:0/3007354495 >> v2:172.21.15.155:3300/0 conn(0x7f091006fd10 0x7f091006c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090ffff640 1 -- 172.21.15.45:0/3007354495 >> v1:172.21.15.45:6789/0 conn(0x7f091006c650 legacy=0x7f09100caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090ffff640 1 -- 172.21.15.45:0/3007354495 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100c8fb0 con 0x7f0910158e30 2023-07-09T02:23:14.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090effd640 1 -- 172.21.15.45:0/3007354495 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142431244 0 0) 0x7f09100ccf80 con 0x7f091006c650 2023-07-09T02:23:14.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090ffff640 1 --2- 172.21.15.45:0/3007354495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0910158e30 0x7f091006f7d0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f091006f260 tx=0x7f090001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7749fc8357d996c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:14.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090effd640 1 -- 172.21.15.45:0/3007354495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000a7be0 con 0x7f0910158e30 2023-07-09T02:23:14.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090effd640 1 -- 172.21.15.45:0/3007354495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09000a7d40 con 0x7f0910158e30 2023-07-09T02:23:14.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f090effd640 1 -- 172.21.15.45:0/3007354495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000af660 con 0x7f0910158e30 2023-07-09T02:23:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f09169d2640 1 -- 172.21.15.45:0/3007354495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0910158e30 msgr2=0x7f091006f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f09169d2640 1 --2- 172.21.15.45:0/3007354495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0910158e30 0x7f091006f7d0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f091006f260 tx=0x7f090001eb10 comp rx=0 tx=0).stop 2023-07-09T02:23:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f09169d2640 1 -- 172.21.15.45:0/3007354495 shutdown_connections 2023-07-09T02:23:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f09169d2640 1 --2- 172.21.15.45:0/3007354495 >> v2:172.21.15.155:3300/0 conn(0x7f091006fd10 0x7f091006c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f09169d2640 1 --2- 172.21.15.45:0/3007354495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0910158e30 0x7f091006f7d0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.699+0000 7f09169d2640 1 -- 172.21.15.45:0/3007354495 >> 172.21.15.45:0/3007354495 conn(0x7f09100694b0 msgr2=0x7f09100698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 -- 172.21.15.45:0/3007354495 shutdown_connections 2023-07-09T02:23:14.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 -- 172.21.15.45:0/3007354495 wait complete. 2023-07-09T02:23:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 Processor -- start 2023-07-09T02:23:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 -- start start 2023-07-09T02:23:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091006c650 0x7f09100b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f091006fd10 0x7f09100b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0910158e30 0x7f0910143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b3480 con 0x7f091006c650 2023-07-09T02:23:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910157080 con 0x7f091006fd10 2023-07-09T02:23:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f09169d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b36b0 con 0x7f0910158e30 2023-07-09T02:23:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091006c650 0x7f09100b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091006c650 0x7f09100b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38896/0 (socket says 172.21.15.45:38896) 2023-07-09T02:23:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 -- 172.21.15.45:0/1846662395 learned_addr learned my addr 172.21.15.45:0/1846662395 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f0914f6f640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0910158e30 0x7f0910143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090f7fe640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f091006fd10 0x7f09100b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 -- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0910158e30 msgr2=0x7f0910143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0910158e30 0x7f0910143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 -- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f091006fd10 msgr2=0x7f09100b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f091006fd10 0x7f09100b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 -- 172.21.15.45:0/1846662395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090000b770 con 0x7f091006c650 2023-07-09T02:23:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.703+0000 7f090ffff640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091006c650 0x7f09100b4060 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f090001b720 tx=0x7f090001b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f090cff9640 1 -- 172.21.15.45:0/1846662395 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000afdf0 con 0x7f091006c650 2023-07-09T02:23:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f090cff9640 1 -- 172.21.15.45:0/1846662395 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0900004030 con 0x7f091006c650 2023-07-09T02:23:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f090cff9640 1 -- 172.21.15.45:0/1846662395 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000043a0 con 0x7f091006c650 2023-07-09T02:23:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09101572d0 con 0x7f091006c650 2023-07-09T02:23:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0910157890 con 0x7f091006c650 2023-07-09T02:23:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091004d7d0 con 0x7f091006c650 2023-07-09T02:23:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f090cff9640 1 -- 172.21.15.45:0/1846662395 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09000b6050 con 0x7f091006c650 2023-07-09T02:23:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f090cff9640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08fc066280 0x7f08fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f090cff9640 1 -- 172.21.15.45:0/1846662395 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0900120e80 con 0x7f091006c650 2023-07-09T02:23:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.707+0000 7f090f7fe640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08fc066280 0x7f08fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.711+0000 7f090f7fe640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08fc066280 0x7f08fc068730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f09100ad7c0 tx=0x7f0904008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:14.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.711+0000 7f090cff9640 1 -- 172.21.15.45:0/1846662395 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09000ee380 con 0x7f091006c650 2023-07-09T02:23:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.867+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f09100ccb30 con 0x7f091006c650 2023-07-09T02:23:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.867+0000 7f090cff9640 1 -- 172.21.15.45:0/1846662395 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) v1 ==== 81+0+36949 (secure 0 0 0) 0x7f09000c8020 con 0x7f091006c650 2023-07-09T02:23:14.871 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:14.872 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:14.872 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 185, 2023-07-09T02:23:14.872 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", 2023-07-09T02:23:14.872 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-07-09T02:10:59.500581+0000", 2023-07-09T02:23:14.872 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-07-09T02:23:09.480700+0000", 2023-07-09T02:23:14.872 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-07-09T02:11:05.049008+0000", 2023-07-09T02:23:14.872 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-07-09T02:11:02.034459+0000", 2023-07-09T02:23:14.873 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-07-09T02:23:14.873 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-07-09T02:23:14.873 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-07-09T02:23:14.873 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-07-09T02:23:14.873 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-07-09T02:23:14.873 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-07-09T02:23:14.873 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-07-09T02:23:14.874 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:14.874 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-07-09T02:23:14.874 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.69999998807907104, 2023-07-09T02:23:14.874 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-07-09T02:23:14.874 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.60000002384185791, 2023-07-09T02:23:14.874 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-07-09T02:23:14.874 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 24, 2023-07-09T02:23:14.874 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-07-09T02:23:14.875 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-07-09T02:23:14.875 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-07-09T02:23:14.875 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "reef", 2023-07-09T02:23:14.875 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_crimson": false, 2023-07-09T02:23:14.875 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-07-09T02:23:14.875 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.875 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-07-09T02:23:14.876 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": ".mgr", 2023-07-09T02:23:14.876 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:06.582752+0000", 2023-07-09T02:23:14.876 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:14.876 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:14.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:14.876 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:14.876 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:14.876 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:14.877 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:14.877 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:14.877 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:14.877 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:14.877 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:14.877 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:14.877 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-07-09T02:23:14.877 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-07-09T02:23:14.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-07-09T02:23:14.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-07-09T02:23:14.878 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-07-09T02:23:14.878 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:14.878 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:14.878 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:14.878 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:14.879 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:14.879 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:14.879 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:14.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.879 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:23:14.879 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:14.879 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:14.879 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:14.880 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:14.880 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:14.880 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:14.880 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:14.880 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:14.880 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:14.881 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:14.881 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:14.881 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:14.881 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:14.881 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:14.881 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:14.881 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:14.882 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:14.882 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:14.882 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:14.882 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:14.882 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:14.882 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:14.882 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:14.882 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:14.883 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:14.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:14.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.883 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:14.883 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:14.883 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:14.883 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:14.883 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:14.884 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:14.884 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:14.884 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:14.884 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:14.884 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:14.884 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:14.884 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:14.885 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-07-09T02:23:14.885 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-07-09T02:23:14.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.885 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:14.885 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": {} 2023-07-09T02:23:14.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.885 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:14.886 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 8, 2023-07-09T02:23:14.886 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 8, 2023-07-09T02:23:14.886 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.25, 2023-07-09T02:23:14.886 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:23:14.886 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:23:14.886 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:14.886 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:14.886 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:14.887 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.887 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.887 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-07-09T02:23:14.887 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-07-09T02:23:14.887 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:11:10.951834+0000", 2023-07-09T02:23:14.887 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:14.888 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:14.888 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:14.888 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:14.888 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:14.888 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:14.888 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:14.888 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:14.888 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:14.889 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:14.889 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:14.889 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:14.889 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-07-09T02:23:14.889 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-07-09T02:23:14.889 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-07-09T02:23:14.889 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-07-09T02:23:14.890 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-07-09T02:23:14.890 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:14.890 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:14.890 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:14.890 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:14.890 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:14.890 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:14.890 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:14.891 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.891 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "111", 2023-07-09T02:23:14.891 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:14.891 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:14.891 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:14.891 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:14.891 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:14.891 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:14.892 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:14.892 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:14.892 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:14.892 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:14.892 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:14.892 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:14.892 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:14.892 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:14.893 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:14.893 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:14.893 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:14.893 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:14.893 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:14.893 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:14.893 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:14.893 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:14.894 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:14.894 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:14.894 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:14.894 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:14.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.894 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:14.894 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:14.895 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:14.896 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:14.896 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-07-09T02:23:14.896 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:14.896 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-07-09T02:23:14.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.896 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:14.896 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.9900000095367432, 2023-07-09T02:23:14.896 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.9900000095367432, 2023-07-09T02:23:14.897 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 0.87999999523162842, 2023-07-09T02:23:14.897 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.75, 2023-07-09T02:23:14.897 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.75, 2023-07-09T02:23:14.897 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:14.897 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:14.897 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:14.897 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.898 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 23, 2023-07-09T02:23:14.898 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_metadata", 2023-07-09T02:23:14.898 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:37.645121+0000", 2023-07-09T02:23:14.898 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:14.898 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:14.898 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:14.899 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:14.899 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:14.899 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:14.899 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:14.899 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:14.899 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:14.899 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:14.899 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:14.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:14.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 32, 2023-07-09T02:23:14.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 32, 2023-07-09T02:23:14.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 32, 2023-07-09T02:23:14.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 32, 2023-07-09T02:23:14.900 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 32, 2023-07-09T02:23:14.900 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:14.900 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:14.901 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:14.901 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:14.901 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:14.901 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:14.901 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:14.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.901 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "181", 2023-07-09T02:23:14.901 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:14.902 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:14.902 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:14.902 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:14.902 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:14.902 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:14.902 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:14.902 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:14.903 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:14.903 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-07-09T02:23:14.903 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:14.903 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:14.903 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:14.903 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:14.903 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:14.903 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:14.904 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:14.904 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:14.904 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:14.904 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:14.904 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:14.904 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:14.904 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:14.904 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:14.905 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:14.905 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:14.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.905 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:14.905 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:14.905 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:14.905 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:14.905 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:14.906 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:14.906 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:14.906 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:14.906 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:14.906 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:14.906 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:14.906 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_bias": 4, 2023-07-09T02:23:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 16, 2023-07-09T02:23:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_priority": 5 2023-07-09T02:23:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:23:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": "cephfs" 2023-07-09T02:23:14.907 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 2, 2023-07-09T02:23:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 2, 2023-07-09T02:23:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:23:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 2, 2023-07-09T02:23:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 2, 2023-07-09T02:23:14.908 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 24, 2023-07-09T02:23:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "cephfs_data", 2023-07-09T02:23:14.909 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-07-09T02:22:38.115103+0000", 2023-07-09T02:23:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-07-09T02:23:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-07-09T02:23:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-07-09T02:23:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-07-09T02:23:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-07-09T02:23:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-07-09T02:23:14.910 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-07-09T02:23:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-07-09T02:23:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-07-09T02:23:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-07-09T02:23:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-07-09T02:23:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-07-09T02:23:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 64, 2023-07-09T02:23:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 64, 2023-07-09T02:23:14.911 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 64, 2023-07-09T02:23:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 64, 2023-07-09T02:23:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 64, 2023-07-09T02:23:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-07-09T02:23:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-07-09T02:23:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-07-09T02:23:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-07-09T02:23:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-07-09T02:23:14.912 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-07-09T02:23:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-07-09T02:23:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "185", 2023-07-09T02:23:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-07-09T02:23:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-07-09T02:23:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-07-09T02:23:14.913 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-07-09T02:23:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-07-09T02:23:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-07-09T02:23:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-07-09T02:23:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-07-09T02:23:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-07-09T02:23:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 33554432, 2023-07-09T02:23:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-07-09T02:23:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-07-09T02:23:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-07-09T02:23:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-07-09T02:23:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-07-09T02:23:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-07-09T02:23:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-07-09T02:23:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-07-09T02:23:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-07-09T02:23:14.915 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-07-09T02:23:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-07-09T02:23:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-07-09T02:23:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-07-09T02:23:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-07-09T02:23:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-07-09T02:23:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-07-09T02:23:14.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-07-09T02:23:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-07-09T02:23:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-07-09T02:23:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-07-09T02:23:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-07-09T02:23:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-07-09T02:23:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-07-09T02:23:14.917 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-07-09T02:23:14.918 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-07-09T02:23:14.918 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-07-09T02:23:14.918 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-07-09T02:23:14.918 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-07-09T02:23:14.918 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 64, 2023-07-09T02:23:14.918 INFO:teuthology.orchestra.run.smithi045.stdout: "target_size_ratio": 0.89999997615814209 2023-07-09T02:23:14.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.918 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-07-09T02:23:14.919 INFO:teuthology.orchestra.run.smithi045.stdout: "cephfs": { 2023-07-09T02:23:14.919 INFO:teuthology.orchestra.run.smithi045.stdout: "data": "cephfs" 2023-07-09T02:23:14.919 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.919 INFO:teuthology.orchestra.run.smithi045.stdout: "read_balance": { 2023-07-09T02:23:14.919 INFO:teuthology.orchestra.run.smithi045.stdout: "score_acting": 1.5, 2023-07-09T02:23:14.919 INFO:teuthology.orchestra.run.smithi045.stdout: "score_stable": 1.5, 2023-07-09T02:23:14.919 INFO:teuthology.orchestra.run.smithi045.stdout: "optimal_score": 1, 2023-07-09T02:23:14.920 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_acting": 1.5, 2023-07-09T02:23:14.920 INFO:teuthology.orchestra.run.smithi045.stdout: "raw_score_stable": 1.5, 2023-07-09T02:23:14.920 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity_weighted": 1, 2023-07-09T02:23:14.920 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity": 1, 2023-07-09T02:23:14.920 INFO:teuthology.orchestra.run.smithi045.stdout: "average_primary_affinity_weighted": 1 2023-07-09T02:23:14.920 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.920 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.921 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:14.921 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-07-09T02:23:14.921 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.921 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:23:14.921 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.921 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.921 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.921 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.922 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.922 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.922 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.922 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.922 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.922 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.922 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.922 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.923 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.923 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.923 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.923 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-07-09T02:23:14.923 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.923 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.923 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.924 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-07-09T02:23:14.924 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.924 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.924 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.924 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.924 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.924 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.925 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.925 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-07-09T02:23:14.925 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.925 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.925 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.925 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.925 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-07-09T02:23:14.925 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.926 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.926 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.926 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.926 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.926 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.926 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.927 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-07-09T02:23:14.927 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.927 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.927 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.927 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-07-09T02:23:14.927 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.927 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.928 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.928 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.928 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.928 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.928 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.928 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.928 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-07-09T02:23:14.928 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-07-09T02:23:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 101265301 2023-07-09T02:23:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.930 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/101265301", 2023-07-09T02:23:14.930 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/101265301", 2023-07-09T02:23:14.930 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6819/101265301", 2023-07-09T02:23:14.930 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/101265301", 2023-07-09T02:23:14.930 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.930 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.930 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.930 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.931 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.931 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.931 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:23:14.931 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.931 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.931 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.931 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.931 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-07-09T02:23:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.933 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.934 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-07-09T02:23:14.934 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.934 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.934 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.934 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.934 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.934 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.934 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.935 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.935 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-07-09T02:23:14.935 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.935 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.935 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.935 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.935 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-07-09T02:23:14.935 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.936 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.936 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.936 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.936 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.936 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.936 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.937 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-07-09T02:23:14.937 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.937 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.937 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.937 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.937 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-07-09T02:23:14.937 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.937 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.938 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.938 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.938 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.938 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.938 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.938 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.938 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-07-09T02:23:14.938 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.939 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.939 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.939 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-07-09T02:23:14.939 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3315000466 2023-07-09T02:23:14.939 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.939 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.940 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/3315000466", 2023-07-09T02:23:14.940 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/3315000466", 2023-07-09T02:23:14.940 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/3315000466", 2023-07-09T02:23:14.940 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/3315000466", 2023-07-09T02:23:14.940 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.940 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.940 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.940 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:23:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.942 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.942 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.942 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.942 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.942 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.942 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.942 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.943 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.943 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.943 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.943 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-07-09T02:23:14.943 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.943 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.943 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.944 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-07-09T02:23:14.944 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.944 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.944 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.944 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.944 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.944 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.945 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-07-09T02:23:14.945 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.945 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.945 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.945 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-07-09T02:23:14.945 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.946 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.946 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.946 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.946 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.946 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.946 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.947 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-07-09T02:23:14.947 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.947 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.947 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.947 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-07-09T02:23:14.947 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.947 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.948 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.948 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.948 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.948 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.948 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.948 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.948 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-07-09T02:23:14.948 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.949 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.949 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-07-09T02:23:14.949 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1123173164 2023-07-09T02:23:14.949 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.949 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.950 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6823/1123173164", 2023-07-09T02:23:14.950 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6827/1123173164", 2023-07-09T02:23:14.950 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/1123173164", 2023-07-09T02:23:14.950 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6829/1123173164", 2023-07-09T02:23:14.950 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.950 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.950 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:23:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.952 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.952 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.952 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.952 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.952 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.952 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.952 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.952 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.953 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.953 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.953 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.953 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-07-09T02:23:14.953 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.953 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.953 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.954 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-07-09T02:23:14.954 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.954 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.954 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.954 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.954 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.954 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.954 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.955 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.955 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-07-09T02:23:14.955 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.955 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.955 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.955 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-07-09T02:23:14.955 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.956 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.956 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.956 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.956 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.956 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.956 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.956 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.957 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-07-09T02:23:14.957 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.957 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.957 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.957 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.957 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-07-09T02:23:14.957 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.957 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.958 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.958 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.958 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.958 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.958 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.958 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.958 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-07-09T02:23:14.958 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.959 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.959 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.959 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-07-09T02:23:14.959 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2399948348 2023-07-09T02:23:14.959 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.959 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.960 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6815/2399948348", 2023-07-09T02:23:14.960 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6818/2399948348", 2023-07-09T02:23:14.960 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6826/2399948348", 2023-07-09T02:23:14.960 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6822/2399948348", 2023-07-09T02:23:14.960 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.960 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.960 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.961 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.961 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.961 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:23:14.961 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.961 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.961 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.961 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.962 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.962 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.962 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.962 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.962 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.962 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.962 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.962 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.963 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.963 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.963 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.963 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6808", 2023-07-09T02:23:14.963 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.963 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.963 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.964 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6809", 2023-07-09T02:23:14.964 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.964 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.964 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.964 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.964 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.964 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.964 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.965 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6810", 2023-07-09T02:23:14.965 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.965 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.965 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6811", 2023-07-09T02:23:14.965 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.966 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.966 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.966 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.966 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.966 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.966 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.966 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.967 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6814", 2023-07-09T02:23:14.967 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.967 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.967 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.967 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.967 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6815", 2023-07-09T02:23:14.967 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.967 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.968 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.968 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.968 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.968 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.968 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.968 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6812", 2023-07-09T02:23:14.968 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.969 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.969 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.969 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6813", 2023-07-09T02:23:14.969 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3680660905 2023-07-09T02:23:14.969 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.969 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.970 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6809/3680660905", 2023-07-09T02:23:14.970 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6811/3680660905", 2023-07-09T02:23:14.970 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6815/3680660905", 2023-07-09T02:23:14.970 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6813/3680660905", 2023-07-09T02:23:14.970 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.970 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.970 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.971 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.971 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.971 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.971 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:23:14.971 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.971 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.971 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.971 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.972 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.972 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.972 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.972 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.972 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.972 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.972 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.972 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.973 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.973 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.973 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.973 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6819", 2023-07-09T02:23:14.973 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.973 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6822", 2023-07-09T02:23:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.974 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.975 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6824", 2023-07-09T02:23:14.975 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.975 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.975 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6826", 2023-07-09T02:23:14.976 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.976 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.976 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.976 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.976 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.976 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.976 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.977 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6830", 2023-07-09T02:23:14.977 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.977 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.977 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.977 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.977 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6831", 2023-07-09T02:23:14.977 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.977 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.978 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.978 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.978 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.978 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.978 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.978 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.978 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6828", 2023-07-09T02:23:14.978 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.979 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.979 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.979 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6829", 2023-07-09T02:23:14.979 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1199637530 2023-07-09T02:23:14.979 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.979 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.980 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6822/1199637530", 2023-07-09T02:23:14.980 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6826/1199637530", 2023-07-09T02:23:14.980 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6831/1199637530", 2023-07-09T02:23:14.980 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6829/1199637530", 2023-07-09T02:23:14.980 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.980 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.981 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.981 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.981 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.981 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.981 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:23:14.981 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.981 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.981 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.982 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.982 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.982 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.982 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.982 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.982 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.982 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.982 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.983 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.983 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.983 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.983 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.983 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6800", 2023-07-09T02:23:14.983 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.983 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.984 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.984 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6801", 2023-07-09T02:23:14.984 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.984 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.984 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.984 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6802", 2023-07-09T02:23:14.985 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6803", 2023-07-09T02:23:14.986 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.986 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.986 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.986 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.986 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6806", 2023-07-09T02:23:14.987 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.987 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6807", 2023-07-09T02:23:14.987 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.988 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.988 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.988 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.988 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.988 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.988 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6804", 2023-07-09T02:23:14.989 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.989 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.989 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.989 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6805", 2023-07-09T02:23:14.989 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4095749246 2023-07-09T02:23:14.989 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.990 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.990 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6801/4095749246", 2023-07-09T02:23:14.990 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6803/4095749246", 2023-07-09T02:23:14.990 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6807/4095749246", 2023-07-09T02:23:14.990 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6805/4095749246", 2023-07-09T02:23:14.990 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:14.990 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:14.991 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:14.991 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.991 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.991 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:23:14.991 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-07-09T02:23:14.991 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-07-09T02:23:14.991 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-07-09T02:23:14.992 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-07-09T02:23:14.992 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-07-09T02:23:14.992 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-07-09T02:23:14.992 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-07-09T02:23:14.992 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-07-09T02:23:14.992 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 180, 2023-07-09T02:23:14.992 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-07-09T02:23:14.993 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-07-09T02:23:14.993 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-07-09T02:23:14.993 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.993 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.993 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.993 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6816", 2023-07-09T02:23:14.993 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.994 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.994 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.994 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6817", 2023-07-09T02:23:14.994 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.994 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.994 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.994 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-07-09T02:23:14.995 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.995 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.995 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6818", 2023-07-09T02:23:14.995 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.995 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.996 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6820", 2023-07-09T02:23:14.996 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.996 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.996 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.996 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-07-09T02:23:14.996 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.997 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.997 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6825", 2023-07-09T02:23:14.997 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.997 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6827", 2023-07-09T02:23:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-07-09T02:23:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-07-09T02:23:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.999 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-07-09T02:23:14.999 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6821", 2023-07-09T02:23:14.999 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:14.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:14.999 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:14.999 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-07-09T02:23:14.999 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.155:6823", 2023-07-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3747873244 2023-07-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.155:6817/3747873244", 2023-07-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.155:6820/3747873244", 2023-07-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.155:6827/3747873244", 2023-07-09T02:23:15.000 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.155:6823/3747873244", 2023-07-09T02:23:15.001 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-07-09T02:23:15.001 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-07-09T02:23:15.001 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-07-09T02:23:15.001 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-07-09T02:23:15.001 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:15.001 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:15.001 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-07-09T02:23:15.001 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:15.002 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-07-09T02:23:15.002 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:15.002 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:15.002 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:15.002 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:15.002 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:15.002 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.247213+0000", 2023-07-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-07-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:15.003 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.275058+0000", 2023-07-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-07-09T02:23:15.004 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.230519+0000", 2023-07-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.005 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-07-09T02:23:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.283689+0000", 2023-07-09T02:23:15.006 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-07-09T02:23:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:15.007 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.261718+0000", 2023-07-09T02:23:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-07-09T02:23:15.008 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.284069+0000", 2023-07-09T02:23:15.009 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-07-09T02:23:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:15.010 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.218964+0000", 2023-07-09T02:23:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-07-09T02:23:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-07-09T02:23:15.011 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-07-09T02:23:15.012 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-07-09T02:23:15.012 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-07-09T02:23:15.012 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138322906710015, 2023-07-09T02:23:15.012 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-07-09T02:23:15.012 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-07-09T02:11:03.299132+0000", 2023-07-09T02:23:15.012 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-07-09T02:23:15.012 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:15.013 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-07-09T02:23:15.013 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-07-09T02:23:15.013 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-07-09T02:23:15.013 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_primaries": [], 2023-07-09T02:23:15.013 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-07-09T02:23:15.013 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-07-09T02:23:15.013 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": {}, 2023-07-09T02:23:15.013 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-07-09T02:23:15.014 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-07-09T02:23:15.014 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-07-09T02:23:15.014 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-07-09T02:23:15.014 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-07-09T02:23:15.014 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-07-09T02:23:15.014 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-07-09T02:23:15.014 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-07-09T02:23:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-07-09T02:23:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-07-09T02:23:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-07-09T02:23:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-07-09T02:23:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-07-09T02:23:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-07-09T02:23:15.015 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-07-09T02:23:15.016 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-07-09T02:23:15.016 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-07-09T02:23:15.016 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-07-09T02:23:15.016 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-07-09T02:23:15.016 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-07-09T02:23:15.016 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-07-09T02:23:15.016 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:15.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08fc066280 msgr2=0x7f08fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:15.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08fc066280 0x7f08fc068730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f09100ad7c0 tx=0x7f0904008040 comp rx=0 tx=0).stop 2023-07-09T02:23:15.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091006c650 msgr2=0x7f09100b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:15.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091006c650 0x7f09100b4060 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f090001b720 tx=0x7f090001b8b0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 shutdown_connections 2023-07-09T02:23:15.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f08fc066280 0x7f08fc068730 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0910158e30 0x7f0910143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f091006fd10 0x7f09100b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 --2- 172.21.15.45:0/1846662395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091006c650 0x7f09100b4060 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 >> 172.21.15.45:0/1846662395 conn(0x7f09100694b0 msgr2=0x7f09100cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:15.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 shutdown_connections 2023-07-09T02:23:15.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:14.871+0000 7f09169d2640 1 -- 172.21.15.45:0/1846662395 wait complete. 2023-07-09T02:23:15.020 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:23:15.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34d0c0b640 1 Processor -- start 2023-07-09T02:23:15.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34d0c0b640 1 -- start start 2023-07-09T02:23:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34d0c0b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34cc15c060 0x7f34cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34d0c0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34cc0cd120 0x7f34cc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34d0c0b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f34cc0d2450 0x7f34cc0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:15.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34d0c0b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34cc0d28f0 con 0x7f34cc15c060 2023-07-09T02:23:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34d0c0b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34cc160a50 con 0x7f34cc0d2450 2023-07-09T02:23:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34d0c0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc15c430 con 0x7f34cc0cd120 2023-07-09T02:23:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34ca59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34cc15c060 0x7f34cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34ca59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34cc15c060 0x7f34cc0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38898/0 (socket says 172.21.15.45:38898) 2023-07-09T02:23:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34ca59c640 1 -- 172.21.15.45:0/2037849107 learned_addr learned my addr 172.21.15.45:0/2037849107 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34ca59c640 1 -- 172.21.15.45:0/2037849107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34cc0cd120 msgr2=0x7f34cc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:15.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34ca59c640 1 --2- 172.21.15.45:0/2037849107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34cc0cd120 0x7f34cc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34ca59c640 1 -- 172.21.15.45:0/2037849107 >> v2:172.21.15.155:3300/0 conn(0x7f34cc0d2450 msgr2=0x7f34cc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34ca59c640 1 --2- 172.21.15.45:0/2037849107 >> v2:172.21.15.155:3300/0 conn(0x7f34cc0d2450 0x7f34cc0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.163+0000 7f34ca59c640 1 -- 172.21.15.45:0/2037849107 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc15fb60 con 0x7f34cc15c060 2023-07-09T02:23:15.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34ca59c640 1 --2- 172.21.15.45:0/2037849107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc15c060 0x7f34cc0b4ed0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f34cc06b120 tx=0x7f34bc01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1146a62925735639 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:15.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34c9d9b640 1 -- 172.21.15.45:0/2037849107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0ab600 con 0x7f34cc15c060 2023-07-09T02:23:15.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34c9d9b640 1 -- 172.21.15.45:0/2037849107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc0a7050 con 0x7f34cc15c060 2023-07-09T02:23:15.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34c9d9b640 1 -- 172.21.15.45:0/2037849107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0ab980 con 0x7f34cc15c060 2023-07-09T02:23:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 -- 172.21.15.45:0/2037849107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc15c060 msgr2=0x7f34cc0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/2037849107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc15c060 0x7f34cc0b4ed0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f34cc06b120 tx=0x7f34bc01c210 comp rx=0 tx=0).stop 2023-07-09T02:23:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 -- 172.21.15.45:0/2037849107 shutdown_connections 2023-07-09T02:23:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/2037849107 >> v2:172.21.15.155:3300/0 conn(0x7f34cc0d2450 0x7f34cc0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/2037849107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34cc0cd120 0x7f34cc0d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/2037849107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc15c060 0x7f34cc0b4ed0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 -- 172.21.15.45:0/2037849107 >> 172.21.15.45:0/2037849107 conn(0x7f34cc0698e0 msgr2=0x7f34cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 -- 172.21.15.45:0/2037849107 shutdown_connections 2023-07-09T02:23:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.167+0000 7f34d0c0b640 1 -- 172.21.15.45:0/2037849107 wait complete. 2023-07-09T02:23:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 Processor -- start 2023-07-09T02:23:15.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 -- start start 2023-07-09T02:23:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc0cd120 0x7f34cc0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34cc0d2450 0x7f34cc0b8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34cc15c060 0x7f34cc151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc15b490 con 0x7f34cc0cd120 2023-07-09T02:23:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc159b90 con 0x7f34cc0d2450 2023-07-09T02:23:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc15a430 con 0x7f34cc15c060 2023-07-09T02:23:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc0cd120 0x7f34cc0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc0cd120 0x7f34cc0b7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38908/0 (socket says 172.21.15.45:38908) 2023-07-09T02:23:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 -- 172.21.15.45:0/1076149659 learned_addr learned my addr 172.21.15.45:0/1076149659 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:15.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 -- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34cc15c060 msgr2=0x7f34cc151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:15.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34cc15c060 0x7f34cc151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 -- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34cc0d2450 msgr2=0x7f34cc0b8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:15.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34cc0d2450 0x7f34cc0b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 -- 172.21.15.45:0/1076149659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0094d0 con 0x7f34cc0cd120 2023-07-09T02:23:15.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34ca59c640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc0cd120 0x7f34cc0b7990 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f34bc01cab0 tx=0x7f34bc01aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:15.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34c2ffd640 1 -- 172.21.15.45:0/1076149659 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0b6620 con 0x7f34cc0cd120 2023-07-09T02:23:15.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34c2ffd640 1 -- 172.21.15.45:0/1076149659 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc0b67a0 con 0x7f34cc0cd120 2023-07-09T02:23:15.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34cc15b6e0 con 0x7f34cc0cd120 2023-07-09T02:23:15.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34c2ffd640 1 -- 172.21.15.45:0/1076149659 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0b6b50 con 0x7f34cc0cd120 2023-07-09T02:23:15.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.171+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34cc15a0c0 con 0x7f34cc0cd120 2023-07-09T02:23:15.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.175+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34cc1603e0 con 0x7f34cc0cd120 2023-07-09T02:23:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.175+0000 7f34c2ffd640 1 -- 172.21.15.45:0/1076149659 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34bc0b2040 con 0x7f34cc0cd120 2023-07-09T02:23:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.175+0000 7f34c2ffd640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f34ac066280 0x7f34ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.175+0000 7f34c2ffd640 1 -- 172.21.15.45:0/1076149659 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34bc11e120 con 0x7f34cc0cd120 2023-07-09T02:23:15.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.175+0000 7f34c3fff640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f34ac066280 0x7f34ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:15.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.175+0000 7f34c3fff640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f34ac066280 0x7f34ac068730 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0b7ed0 tx=0x7f34b4006ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:15.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.179+0000 7f34c2ffd640 1 -- 172.21.15.45:0/1076149659 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34cc1603e0 con 0x7f34cc0cd120 2023-07-09T02:23:15.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.367+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34cc1603b0 con 0x7f34cc0cd120 2023-07-09T02:23:15.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.367+0000 7f34c2ffd640 1 -- 172.21.15.45:0/1076149659 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f34bc0eb590 con 0x7f34cc0cd120 2023-07-09T02:23:15.371 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:15.371 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:23:15.371 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:23:15.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f34ac066280 msgr2=0x7f34ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:15.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f34ac066280 0x7f34ac068730 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0b7ed0 tx=0x7f34b4006ca0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc0cd120 msgr2=0x7f34cc0b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:15.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc0cd120 0x7f34cc0b7990 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f34bc01cab0 tx=0x7f34bc01aa50 comp rx=0 tx=0).stop 2023-07-09T02:23:15.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 shutdown_connections 2023-07-09T02:23:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f34ac066280 0x7f34ac068730 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34cc15c060 0x7f34cc151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34cc0d2450 0x7f34cc0b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 --2- 172.21.15.45:0/1076149659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34cc0cd120 0x7f34cc0b7990 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 >> 172.21.15.45:0/1076149659 conn(0x7f34cc0698e0 msgr2=0x7f34cc0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 shutdown_connections 2023-07-09T02:23:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:15.371+0000 7f34d0c0b640 1 -- 172.21.15.45:0/1076149659 wait complete. 2023-07-09T02:23:15.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-07-09T02:23:15.553 INFO:teuthology.orchestra.run.smithi045.stdout:{"cluster_fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","whoami":0,"id":9105,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.785003693999997,"mdsmap_epoch":91,"osdmap_epoch":185,"osdmap_epoch_barrier":184,"uptime":41.760820672000001} 2023-07-09T02:23:15.554 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "baf8f4e1-db15-4e56-a3ea-d65b4f02f49e", "fs_name": "cephfs", "id": 9105, "mdsmap_epoch": 91, "osdmap_epoch": 185, "osdmap_epoch_barrier": 184, "rank_uptime": 35.785003694, "state": "up:active", "uptime": 41.760820672, "want_state": "up:active", "whoami": 0 } 2023-07-09T02:23:15.554 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-07-09T02:23:15.555 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:23:15.555 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:15.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:15.565 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-07-09T02:23:16.003 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records in 2023-07-09T02:23:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:50+0 records out 2023-07-09T02:23:16.004 INFO:teuthology.orchestra.run.smithi045.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.387282 s, 135 MB/s 2023-07-09T02:23:16.005 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T02:23:16.005 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:23:16.058 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T02:23:16.118 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T02:23:16.119 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:23:16.119 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:16.128 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:23:16.128 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:16.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:23:16.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.367+0000 7f0a01656640 1 Processor -- start 2023-07-09T02:23:16.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.367+0000 7f0a01656640 1 -- start start 2023-07-09T02:23:16.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.367+0000 7f0a01656640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f09fc15c060 0x7f09fc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.367+0000 7f0a01656640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09fc0cd120 0x7f09fc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.367+0000 7f0a01656640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc160a50 con 0x7f09fc0d2450 2023-07-09T02:23:16.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.367+0000 7f0a01656640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc0d28d0 con 0x7f09fc0cd120 2023-07-09T02:23:16.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.367+0000 7f0a01656640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc0cfe40 con 0x7f09fc15c060 2023-07-09T02:23:16.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09fc0cd120 0x7f09fc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09fc0cd120 0x7f09fc0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38910/0 (socket says 172.21.15.45:38910) 2023-07-09T02:23:16.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09f3fff640 1 -- 172.21.15.45:0/4093309874 learned_addr learned my addr 172.21.15.45:0/4093309874 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:16.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09faffd640 1 --2- 172.21.15.45:0/4093309874 >> v2:172.21.15.155:3300/0 conn(0x7f09fc15c060 0x7f09fc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09f3fff640 1 -- 172.21.15.45:0/4093309874 >> v2:172.21.15.155:3300/0 conn(0x7f09fc15c060 msgr2=0x7f09fc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:16.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09f3fff640 1 --2- 172.21.15.45:0/4093309874 >> v2:172.21.15.155:3300/0 conn(0x7f09fc15c060 0x7f09fc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09f3fff640 1 -- 172.21.15.45:0/4093309874 >> v1:172.21.15.155:6789/0 conn(0x7f09fc0d2450 legacy=0x7f09fc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09f3fff640 1 -- 172.21.15.45:0/4093309874 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc15c430 con 0x7f09fc0cd120 2023-07-09T02:23:16.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09f3fff640 1 --2- 172.21.15.45:0/4093309874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc0d1f10 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0d3ad0 tx=0x7f09e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216830b9f91079e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:16.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09fa7fc640 1 -- 172.21.15.45:0/4093309874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40ab5f0 con 0x7f09fc0cd120 2023-07-09T02:23:16.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09fa7fc640 1 -- 172.21.15.45:0/4093309874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40ab750 con 0x7f09fc0cd120 2023-07-09T02:23:16.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.371+0000 7f09fa7fc640 1 -- 172.21.15.45:0/4093309874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40abae0 con 0x7f09fc0cd120 2023-07-09T02:23:16.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- 172.21.15.45:0/4093309874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 msgr2=0x7f09fc0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 --2- 172.21.15.45:0/4093309874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc0d1f10 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0d3ad0 tx=0x7f09e401c4d0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- 172.21.15.45:0/4093309874 shutdown_connections 2023-07-09T02:23:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 --2- 172.21.15.45:0/4093309874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc0d1f10 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 --2- 172.21.15.45:0/4093309874 >> v2:172.21.15.155:3300/0 conn(0x7f09fc15c060 0x7f09fc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- 172.21.15.45:0/4093309874 >> 172.21.15.45:0/4093309874 conn(0x7f09fc0698e0 msgr2=0x7f09fc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- 172.21.15.45:0/4093309874 shutdown_connections 2023-07-09T02:23:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- 172.21.15.45:0/4093309874 wait complete. 2023-07-09T02:23:16.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 Processor -- start 2023-07-09T02:23:16.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- start start 2023-07-09T02:23:16.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09fc0d2450 0x7f09fc0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09fc15c060 0x7f09fc0b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0b39c0 con 0x7f09fc0cd120 2023-07-09T02:23:16.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc151d80 con 0x7f09fc0d2450 2023-07-09T02:23:16.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f0a01656640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0b2db0 con 0x7f09fc15c060 2023-07-09T02:23:16.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38920/0 (socket says 172.21.15.45:38920) 2023-07-09T02:23:16.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09faffd640 1 -- 172.21.15.45:0/4029156751 learned_addr learned my addr 172.21.15.45:0/4029156751 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:16.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09f3fff640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09fc0d2450 0x7f09fc0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09fb7fe640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09fc15c060 0x7f09fc0b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09faffd640 1 -- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09fc15c060 msgr2=0x7f09fc0b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09faffd640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09fc15c060 0x7f09fc0b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09faffd640 1 -- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09fc0d2450 msgr2=0x7f09fc0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09faffd640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09fc0d2450 0x7f09fc0b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.375+0000 7f09faffd640 1 -- 172.21.15.45:0/4029156751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40094d0 con 0x7f09fc0cd120 2023-07-09T02:23:16.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f09faffd640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc151840 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00d620 tx=0x7f09ec00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:16.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f09f37fe640 1 -- 172.21.15.45:0/4029156751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00b620 con 0x7f09fc0cd120 2023-07-09T02:23:16.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f09f37fe640 1 -- 172.21.15.45:0/4029156751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec00b780 con 0x7f09fc0cd120 2023-07-09T02:23:16.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc0b3090 con 0x7f09fc0cd120 2023-07-09T02:23:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f09f37fe640 1 -- 172.21.15.45:0/4029156751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00bb10 con 0x7f09fc0cd120 2023-07-09T02:23:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0b3650 con 0x7f09fc0cd120 2023-07-09T02:23:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc04d7d0 con 0x7f09fc0cd120 2023-07-09T02:23:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f09f37fe640 1 -- 172.21.15.45:0/4029156751 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09ec00bc70 con 0x7f09fc0cd120 2023-07-09T02:23:16.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f09f37fe640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09dc066280 0x7f09dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.379+0000 7f09f37fe640 1 -- 172.21.15.45:0/4029156751 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09ec0840f0 con 0x7f09fc0cd120 2023-07-09T02:23:16.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.383+0000 7f09f3fff640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09dc066280 0x7f09dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.383+0000 7f09f3fff640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09dc066280 0x7f09dc068730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f09e40af000 tx=0x7f09e40b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:16.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.383+0000 7f09f37fe640 1 -- 172.21.15.45:0/4029156751 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09ec051620 con 0x7f09fc0cd120 2023-07-09T02:23:16.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.539+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09fc1606b0 con 0x7f09fc0cd120 2023-07-09T02:23:16.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.539+0000 7f09f37fe640 1 -- 172.21.15.45:0/4029156751 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f09ec007380 con 0x7f09fc0cd120 2023-07-09T02:23:16.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:16.542 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":185,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:23:09.480700+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:22:37.645121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T02:22:38.115103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:23:16.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09dc066280 msgr2=0x7f09dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09dc066280 0x7f09dc068730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f09e40af000 tx=0x7f09e40b6040 comp rx=0 tx=0).stop 2023-07-09T02:23:16.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 msgr2=0x7f09fc151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc151840 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00d620 tx=0x7f09ec00dae0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 shutdown_connections 2023-07-09T02:23:16.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f09dc066280 0x7f09dc068730 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09fc15c060 0x7f09fc0b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f09fc0d2450 0x7f09fc0b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 --2- 172.21.15.45:0/4029156751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09fc0cd120 0x7f09fc151840 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 >> 172.21.15.45:0/4029156751 conn(0x7f09fc0698e0 msgr2=0x7f09fc157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:16.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 shutdown_connections 2023-07-09T02:23:16.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.543+0000 7f0a01656640 1 -- 172.21.15.45:0/4029156751 wait complete. 2023-07-09T02:23:16.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:22:37.645121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:22:38.115103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:23:16.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:23:16.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ec053a640 1 Processor -- start 2023-07-09T02:23:16.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ec053a640 1 -- start start 2023-07-09T02:23:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ec053a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8eb815c060 0x7f8eb80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ec053a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80cd120 0x7f8eb80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ec053a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8eb80d2450 0x7f8eb80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ec053a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb80d28f0 con 0x7f8eb815c060 2023-07-09T02:23:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ec053a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb8160a50 con 0x7f8eb80d2450 2023-07-09T02:23:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ec053a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb815c430 con 0x7f8eb80cd120 2023-07-09T02:23:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebe2d6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8eb815c060 0x7f8eb80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebe2d6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8eb815c060 0x7f8eb80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38932/0 (socket says 172.21.15.45:38932) 2023-07-09T02:23:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebe2d6640 1 -- 172.21.15.45:0/2240080673 learned_addr learned my addr 172.21.15.45:0/2240080673 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebead7640 1 --2- 172.21.15.45:0/2240080673 >> v2:172.21.15.155:3300/0 conn(0x7f8eb80d2450 0x7f8eb80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebdad5640 1 --2- 172.21.15.45:0/2240080673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80cd120 0x7f8eb80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebe2d6640 1 -- 172.21.15.45:0/2240080673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80cd120 msgr2=0x7f8eb80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebe2d6640 1 --2- 172.21.15.45:0/2240080673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80cd120 0x7f8eb80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebe2d6640 1 -- 172.21.15.45:0/2240080673 >> v2:172.21.15.155:3300/0 conn(0x7f8eb80d2450 msgr2=0x7f8eb80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebe2d6640 1 --2- 172.21.15.45:0/2240080673 >> v2:172.21.15.155:3300/0 conn(0x7f8eb80d2450 0x7f8eb80d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebe2d6640 1 -- 172.21.15.45:0/2240080673 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb815fb60 con 0x7f8eb815c060 2023-07-09T02:23:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.707+0000 7f8ebead7640 1 --2- 172.21.15.45:0/2240080673 >> v2:172.21.15.155:3300/0 conn(0x7f8eb80d2450 0x7f8eb80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ebe2d6640 1 --2- 172.21.15.45:0/2240080673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb80b4ed0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f8eb806b120 tx=0x7f8eb401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f67db65b96cd90 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ebd2d4640 1 -- 172.21.15.45:0/2240080673 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40ab600 con 0x7f8eb815c060 2023-07-09T02:23:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ebd2d4640 1 -- 172.21.15.45:0/2240080673 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb40a7050 con 0x7f8eb815c060 2023-07-09T02:23:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ebd2d4640 1 -- 172.21.15.45:0/2240080673 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40ab980 con 0x7f8eb815c060 2023-07-09T02:23:16.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 -- 172.21.15.45:0/2240080673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 msgr2=0x7f8eb80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 --2- 172.21.15.45:0/2240080673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb80b4ed0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f8eb806b120 tx=0x7f8eb401c210 comp rx=0 tx=0).stop 2023-07-09T02:23:16.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 -- 172.21.15.45:0/2240080673 shutdown_connections 2023-07-09T02:23:16.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 --2- 172.21.15.45:0/2240080673 >> v2:172.21.15.155:3300/0 conn(0x7f8eb80d2450 0x7f8eb80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 --2- 172.21.15.45:0/2240080673 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80cd120 0x7f8eb80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 --2- 172.21.15.45:0/2240080673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb80b4ed0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 -- 172.21.15.45:0/2240080673 >> 172.21.15.45:0/2240080673 conn(0x7f8eb80698e0 msgr2=0x7f8eb8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 -- 172.21.15.45:0/2240080673 shutdown_connections 2023-07-09T02:23:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.711+0000 7f8ec053a640 1 -- 172.21.15.45:0/2240080673 wait complete. 2023-07-09T02:23:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 Processor -- start 2023-07-09T02:23:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 -- start start 2023-07-09T02:23:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb80cd120 0x7f8eb8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80d2450 0x7f8eb815eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb8151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8153610 con 0x7f8eb815c060 2023-07-09T02:23:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8152a00 con 0x7f8eb80cd120 2023-07-09T02:23:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8152ce0 con 0x7f8eb80d2450 2023-07-09T02:23:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb8151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb8151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38940/0 (socket says 172.21.15.45:38940) 2023-07-09T02:23:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 -- 172.21.15.45:0/710714086 learned_addr learned my addr 172.21.15.45:0/710714086 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebe2d6640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb80cd120 0x7f8eb8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebdad5640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80d2450 0x7f8eb815eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 -- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80d2450 msgr2=0x7f8eb815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80d2450 0x7f8eb815eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 -- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb80cd120 msgr2=0x7f8eb8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb80cd120 0x7f8eb8156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 -- 172.21.15.45:0/710714086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40094d0 con 0x7f8eb815c060 2023-07-09T02:23:16.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ebead7640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb8151c60 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0007ef0 tx=0x7f8eb000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:16.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8eaeffd640 1 -- 172.21.15.45:0/710714086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0003ba0 con 0x7f8eb815c060 2023-07-09T02:23:16.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8eaeffd640 1 -- 172.21.15.45:0/710714086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb000f040 con 0x7f8eb815c060 2023-07-09T02:23:16.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8eaeffd640 1 -- 172.21.15.45:0/710714086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000de80 con 0x7f8eb815c060 2023-07-09T02:23:16.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb8152fc0 con 0x7f8eb815c060 2023-07-09T02:23:16.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.715+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb8157090 con 0x7f8eb815c060 2023-07-09T02:23:16.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.719+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb8153780 con 0x7f8eb815c060 2023-07-09T02:23:16.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.719+0000 7f8eaeffd640 1 -- 172.21.15.45:0/710714086 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8eb0004030 con 0x7f8eb815c060 2023-07-09T02:23:16.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.719+0000 7f8eaeffd640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e9c066280 0x7f8e9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:16.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.719+0000 7f8eaeffd640 1 -- 172.21.15.45:0/710714086 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8eb0083fe0 con 0x7f8eb815c060 2023-07-09T02:23:16.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.719+0000 7f8ebe2d6640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e9c066280 0x7f8e9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:16.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.719+0000 7f8ebe2d6640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e9c066280 0x7f8e9c068730 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40ad000 tx=0x7f8eb40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:16.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.723+0000 7f8eaeffd640 1 -- 172.21.15.45:0/710714086 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8eb0051500 con 0x7f8eb815c060 2023-07-09T02:23:16.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.879+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8eb804d7d0 con 0x7f8eb815c060 2023-07-09T02:23:16.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.879+0000 7f8eaeffd640 1 -- 172.21.15.45:0/710714086 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v185) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8eb001a0a0 con 0x7f8eb815c060 2023-07-09T02:23:16.882 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:23:16.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.879+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e9c066280 msgr2=0x7f8e9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.879+0000 7f8ec053a640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e9c066280 0x7f8e9c068730 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40ad000 tx=0x7f8eb40a6000 comp rx=0 tx=0).stop 2023-07-09T02:23:16.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 msgr2=0x7f8eb8151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb8151c60 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0007ef0 tx=0x7f8eb000d4a0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 shutdown_connections 2023-07-09T02:23:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8eb815c060 0x7f8eb8151c60 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8e9c066280 0x7f8e9c068730 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80d2450 0x7f8eb815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 --2- 172.21.15.45:0/710714086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb80cd120 0x7f8eb8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 >> 172.21.15.45:0/710714086 conn(0x7f8eb80698e0 msgr2=0x7f8eb80cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 shutdown_connections 2023-07-09T02:23:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:16.883+0000 7f8ec053a640 1 -- 172.21.15.45:0/710714086 wait complete. 2023-07-09T02:23:16.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:23:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.047+0000 7f5148abd640 1 Processor -- start 2023-07-09T02:23:17.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.047+0000 7f5148abd640 1 -- start start 2023-07-09T02:23:17.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.047+0000 7f5148abd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440d2620 0x7f51440b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.047+0000 7f5148abd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5144160a50 con 0x7f51440cd120 2023-07-09T02:23:17.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.047+0000 7f5148abd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514415c430 con 0x7f514415c060 2023-07-09T02:23:17.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.047+0000 7f5148abd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514415fb60 con 0x7f51440d2620 2023-07-09T02:23:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f5142d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f51440cd120 0x7f51440cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42910/0 (socket says 172.21.15.45:42910) 2023-07-09T02:23:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f5142d9d640 1 -- 172.21.15.45:0/355386988 learned_addr learned my addr 172.21.15.45:0/355386988 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f513bfff640 1 --2- 172.21.15.45:0/355386988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440d2620 0x7f51440b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f5141d9b640 1 -- 172.21.15.45:0/355386988 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144514340 0 0) 0x7f5144160a50 con 0x7f51440cd120 2023-07-09T02:23:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f5141d9b640 1 -- 172.21.15.45:0/355386988 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5130003530 con 0x7f51440cd120 2023-07-09T02:23:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f5141d9b640 1 -- 172.21.15.45:0/355386988 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813117516 0 0) 0x7f514415c430 con 0x7f514415c060 2023-07-09T02:23:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f5141d9b640 1 -- 172.21.15.45:0/355386988 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5144160a50 con 0x7f514415c060 2023-07-09T02:23:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f513bfff640 1 -- 172.21.15.45:0/355386988 >> v1:172.21.15.155:6789/0 conn(0x7f514415c060 legacy=0x7f51440d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f513bfff640 1 -- 172.21.15.45:0/355386988 >> v1:172.21.15.45:6789/0 conn(0x7f51440cd120 legacy=0x7f51440cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.051+0000 7f513bfff640 1 -- 172.21.15.45:0/355386988 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514415fe40 con 0x7f51440d2620 2023-07-09T02:23:17.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f513bfff640 1 --2- 172.21.15.45:0/355386988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440d2620 0x7f51440b4ed0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f512c0097f0 tx=0x7f512c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6de142bc09cccd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5141d9b640 1 -- 172.21.15.45:0/355386988 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0aa5f0 con 0x7f51440d2620 2023-07-09T02:23:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5141d9b640 1 -- 172.21.15.45:0/355386988 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c0aa750 con 0x7f51440d2620 2023-07-09T02:23:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5141d9b640 1 -- 172.21.15.45:0/355386988 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0aaae0 con 0x7f51440d2620 2023-07-09T02:23:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- 172.21.15.45:0/355386988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440d2620 msgr2=0x7f51440b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 --2- 172.21.15.45:0/355386988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440d2620 0x7f51440b4ed0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f512c0097f0 tx=0x7f512c01c490 comp rx=0 tx=0).stop 2023-07-09T02:23:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- 172.21.15.45:0/355386988 shutdown_connections 2023-07-09T02:23:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 --2- 172.21.15.45:0/355386988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440d2620 0x7f51440b4ed0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- 172.21.15.45:0/355386988 >> 172.21.15.45:0/355386988 conn(0x7f51440698e0 msgr2=0x7f5144069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- 172.21.15.45:0/355386988 shutdown_connections 2023-07-09T02:23:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- 172.21.15.45:0/355386988 wait complete. 2023-07-09T02:23:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 Processor -- start 2023-07-09T02:23:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- start start 2023-07-09T02:23:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440cd120 0x7f51441542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51440d2620 0x7f51440ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f514415c060 0x7f5144151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51441582f0 con 0x7f51440d2620 2023-07-09T02:23:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440caa60 con 0x7f514415c060 2023-07-09T02:23:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.055+0000 7f5148abd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440cb240 con 0x7f51440cd120 2023-07-09T02:23:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51440d2620 0x7f51440ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51440d2620 0x7f51440ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38946/0 (socket says 172.21.15.45:38946) 2023-07-09T02:23:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 -- 172.21.15.45:0/1315093895 learned_addr learned my addr 172.21.15.45:0/1315093895 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f5142d9d640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f514415c060 0x7f5144151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f514259c640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440cd120 0x7f51441542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 -- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440cd120 msgr2=0x7f51441542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440cd120 0x7f51441542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 -- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f514415c060 msgr2=0x7f5144151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f514415c060 0x7f5144151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 -- 172.21.15.45:0/1315093895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c009420 con 0x7f51440d2620 2023-07-09T02:23:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f5142d9d640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f514415c060 0x7f5144151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513bfff640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51440d2620 0x7f51440ca520 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f512c0ac040 tx=0x7f512c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513affd640 1 -- 172.21.15.45:0/1315093895 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0be610 con 0x7f51440d2620 2023-07-09T02:23:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513affd640 1 -- 172.21.15.45:0/1315093895 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c0be7b0 con 0x7f51440d2620 2023-07-09T02:23:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513affd640 1 -- 172.21.15.45:0/1315093895 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0beb60 con 0x7f51440d2620 2023-07-09T02:23:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51440b59f0 con 0x7f51440d2620 2023-07-09T02:23:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51440cac90 con 0x7f51440d2620 2023-07-09T02:23:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514404d7d0 con 0x7f51440d2620 2023-07-09T02:23:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.059+0000 7f513affd640 1 -- 172.21.15.45:0/1315093895 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f512c0b4400 con 0x7f51440d2620 2023-07-09T02:23:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.063+0000 7f513affd640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5124066280 0x7f5124068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.063+0000 7f513affd640 1 -- 172.21.15.45:0/1315093895 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f512c0a7070 con 0x7f51440d2620 2023-07-09T02:23:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.063+0000 7f514259c640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5124066280 0x7f5124068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.063+0000 7f514259c640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5124066280 0x7f5124068730 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f51340011f0 tx=0x7f5134009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.063+0000 7f513affd640 1 -- 172.21.15.45:0/1315093895 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f512c0eba20 con 0x7f51440d2620 2023-07-09T02:23:17.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.223+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51440b5d00 con 0x7f51440d2620 2023-07-09T02:23:17.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.223+0000 7f513affd640 1 -- 172.21.15.45:0/1315093895 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v185) v1 ==== 92+0+10 (secure 0 0 0) 0x7f512c0ef040 con 0x7f51440d2620 2023-07-09T02:23:17.226 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:23:17.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5124066280 msgr2=0x7f5124068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5124066280 0x7f5124068730 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f51340011f0 tx=0x7f5134009040 comp rx=0 tx=0).stop 2023-07-09T02:23:17.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51440d2620 msgr2=0x7f51440ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51440d2620 0x7f51440ca520 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f512c0ac040 tx=0x7f512c01acd0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 shutdown_connections 2023-07-09T02:23:17.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f514415c060 0x7f5144151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51440d2620 0x7f51440ca520 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5124066280 0x7f5124068730 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 --2- 172.21.15.45:0/1315093895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51440cd120 0x7f51441542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 >> 172.21.15.45:0/1315093895 conn(0x7f51440698e0 msgr2=0x7f51440b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:17.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 shutdown_connections 2023-07-09T02:23:17.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.227+0000 7f5148abd640 1 -- 172.21.15.45:0/1315093895 wait complete. 2023-07-09T02:23:17.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:23:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553c2bd640 1 Processor -- start 2023-07-09T02:23:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553c2bd640 1 -- start start 2023-07-09T02:23:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553c2bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f553415c060 0x7f55340b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553c2bd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f55340cd120 0x7f55340d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553c2bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f55340d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553c2bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55340d28f0 con 0x7f553415c060 2023-07-09T02:23:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553c2bd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5534160a50 con 0x7f55340cd120 2023-07-09T02:23:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553c2bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553415c430 con 0x7f55340d2450 2023-07-09T02:23:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a059640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f553415c060 0x7f55340b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a059640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f553415c060 0x7f55340b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38948/0 (socket says 172.21.15.45:38948) 2023-07-09T02:23:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a059640 1 -- 172.21.15.45:0/669765071 learned_addr learned my addr 172.21.15.45:0/669765071 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a85a640 1 --2- 172.21.15.45:0/669765071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f55340d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a059640 1 -- 172.21.15.45:0/669765071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 msgr2=0x7f55340d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f5539858640 1 --2- 172.21.15.45:0/669765071 >> v2:172.21.15.155:3300/0 conn(0x7f55340cd120 0x7f55340d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a059640 1 --2- 172.21.15.45:0/669765071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f55340d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a059640 1 -- 172.21.15.45:0/669765071 >> v2:172.21.15.155:3300/0 conn(0x7f55340cd120 msgr2=0x7f55340d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a059640 1 --2- 172.21.15.45:0/669765071 >> v2:172.21.15.155:3300/0 conn(0x7f55340cd120 0x7f55340d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a059640 1 -- 172.21.15.45:0/669765071 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553415fb60 con 0x7f553415c060 2023-07-09T02:23:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f553a85a640 1 --2- 172.21.15.45:0/669765071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f55340d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.391+0000 7f5539858640 1 --2- 172.21.15.45:0/669765071 >> v2:172.21.15.155:3300/0 conn(0x7f55340cd120 0x7f55340d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553a059640 1 --2- 172.21.15.45:0/669765071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553415c060 0x7f55340b4ed0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f553415fac0 tx=0x7f553001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b44f7ec2cce0d7d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f5539057640 1 -- 172.21.15.45:0/669765071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300ab600 con 0x7f553415c060 2023-07-09T02:23:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f5539057640 1 -- 172.21.15.45:0/669765071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55300a7050 con 0x7f553415c060 2023-07-09T02:23:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f5539057640 1 -- 172.21.15.45:0/669765071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300ab980 con 0x7f553415c060 2023-07-09T02:23:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 -- 172.21.15.45:0/669765071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553415c060 msgr2=0x7f55340b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 --2- 172.21.15.45:0/669765071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553415c060 0x7f55340b4ed0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f553415fac0 tx=0x7f553001c210 comp rx=0 tx=0).stop 2023-07-09T02:23:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 -- 172.21.15.45:0/669765071 shutdown_connections 2023-07-09T02:23:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 --2- 172.21.15.45:0/669765071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f55340d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 --2- 172.21.15.45:0/669765071 >> v2:172.21.15.155:3300/0 conn(0x7f55340cd120 0x7f55340d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 --2- 172.21.15.45:0/669765071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f553415c060 0x7f55340b4ed0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 -- 172.21.15.45:0/669765071 >> 172.21.15.45:0/669765071 conn(0x7f55340698e0 msgr2=0x7f5534069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 -- 172.21.15.45:0/669765071 shutdown_connections 2023-07-09T02:23:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.395+0000 7f553c2bd640 1 -- 172.21.15.45:0/669765071 wait complete. 2023-07-09T02:23:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 Processor -- start 2023-07-09T02:23:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 -- start start 2023-07-09T02:23:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55340cd120 0x7f55340b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f5534151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553415c060 0x7f55340b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55340b6f40 con 0x7f55340cd120 2023-07-09T02:23:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55340b7290 con 0x7f553415c060 2023-07-09T02:23:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5534152490 con 0x7f55340d2450 2023-07-09T02:23:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55340cd120 0x7f55340b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55340cd120 0x7f55340b6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38950/0 (socket says 172.21.15.45:38950) 2023-07-09T02:23:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 -- 172.21.15.45:0/3628087284 learned_addr learned my addr 172.21.15.45:0/3628087284 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f5539858640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f5534151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a85a640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553415c060 0x7f55340b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 -- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 msgr2=0x7f5534151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f5534151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 -- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553415c060 msgr2=0x7f55340b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553415c060 0x7f55340b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 -- 172.21.15.45:0/3628087284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55300094d0 con 0x7f55340cd120 2023-07-09T02:23:17.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553a059640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55340cd120 0x7f55340b6a00 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f553001cab0 tx=0x7f553001aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f552affd640 1 -- 172.21.15.45:0/3628087284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300b6620 con 0x7f55340cd120 2023-07-09T02:23:17.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f552affd640 1 -- 172.21.15.45:0/3628087284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55300b67a0 con 0x7f55340cd120 2023-07-09T02:23:17.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f552affd640 1 -- 172.21.15.45:0/3628087284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300b6b50 con 0x7f55340cd120 2023-07-09T02:23:17.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55341f7d80 con 0x7f55340cd120 2023-07-09T02:23:17.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.399+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55341f8340 con 0x7f55340cd120 2023-07-09T02:23:17.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.403+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55340cae70 con 0x7f55340cd120 2023-07-09T02:23:17.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.403+0000 7f552affd640 1 -- 172.21.15.45:0/3628087284 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55300b2040 con 0x7f55340cd120 2023-07-09T02:23:17.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.403+0000 7f552affd640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5518066280 0x7f5518068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.403+0000 7f552affd640 1 -- 172.21.15.45:0/3628087284 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f553011dde0 con 0x7f55340cd120 2023-07-09T02:23:17.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.403+0000 7f5539858640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5518066280 0x7f5518068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.403+0000 7f5539858640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5518066280 0x7f5518068730 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f55341f5790 tx=0x7f5524008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.407+0000 7f552affd640 1 -- 172.21.15.45:0/3628087284 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55300eb2f0 con 0x7f55340cd120 2023-07-09T02:23:17.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f553404d7d0 con 0x7f55340cd120 2023-07-09T02:23:17.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f552affd640 1 -- 172.21.15.45:0/3628087284 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v185) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55300ee910 con 0x7f55340cd120 2023-07-09T02:23:17.561 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:23:17.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5518066280 msgr2=0x7f5518068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5518066280 0x7f5518068730 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f55341f5790 tx=0x7f5524008040 comp rx=0 tx=0).stop 2023-07-09T02:23:17.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55340cd120 msgr2=0x7f55340b6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55340cd120 0x7f55340b6a00 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f553001cab0 tx=0x7f553001aa50 comp rx=0 tx=0).stop 2023-07-09T02:23:17.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 shutdown_connections 2023-07-09T02:23:17.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f553415c060 0x7f55340b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5518066280 0x7f5518068730 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f55340d2450 0x7f5534151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 --2- 172.21.15.45:0/3628087284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55340cd120 0x7f55340b6a00 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 >> 172.21.15.45:0/3628087284 conn(0x7f55340698e0 msgr2=0x7f55341576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:17.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 shutdown_connections 2023-07-09T02:23:17.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.559+0000 7f553c2bd640 1 -- 172.21.15.45:0/3628087284 wait complete. 2023-07-09T02:23:17.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:23:17.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136f1d5640 1 Processor -- start 2023-07-09T02:23:17.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136f1d5640 1 -- start start 2023-07-09T02:23:17.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136f1d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f136815c060 0x7f13680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136f1d5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13680cd120 0x7f13680d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136f1d5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f13680d2450 0x7f13680d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136f1d5640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680d28f0 con 0x7f13680cd120 2023-07-09T02:23:17.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136f1d5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1368160a50 con 0x7f13680d2450 2023-07-09T02:23:17.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136f1d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136815c430 con 0x7f136815c060 2023-07-09T02:23:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f1367fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13680cd120 0x7f13680d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f1367fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13680cd120 0x7f13680d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38966/0 (socket says 172.21.15.45:38966) 2023-07-09T02:23:17.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f1367fff640 1 -- 172.21.15.45:0/1848858942 learned_addr learned my addr 172.21.15.45:0/1848858942 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:17.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136d772640 1 --2- 172.21.15.45:0/1848858942 >> v2:172.21.15.155:3300/0 conn(0x7f13680d2450 0x7f13680d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f136cf71640 1 --2- 172.21.15.45:0/1848858942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f136815c060 0x7f13680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f1367fff640 1 -- 172.21.15.45:0/1848858942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f136815c060 msgr2=0x7f13680b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:17.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f1367fff640 1 --2- 172.21.15.45:0/1848858942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f136815c060 0x7f13680b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f1367fff640 1 -- 172.21.15.45:0/1848858942 >> v2:172.21.15.155:3300/0 conn(0x7f13680d2450 msgr2=0x7f13680d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:17.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f1367fff640 1 --2- 172.21.15.45:0/1848858942 >> v2:172.21.15.155:3300/0 conn(0x7f13680d2450 0x7f13680d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.727+0000 7f1367fff640 1 -- 172.21.15.45:0/1848858942 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136815fb60 con 0x7f13680cd120 2023-07-09T02:23:17.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f1367fff640 1 --2- 172.21.15.45:0/1848858942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13680cd120 0x7f13680d1f10 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f136806b120 tx=0x7f135401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae72d375af690098 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f13677fe640 1 -- 172.21.15.45:0/1848858942 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540ab600 con 0x7f13680cd120 2023-07-09T02:23:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f13677fe640 1 -- 172.21.15.45:0/1848858942 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13540a7050 con 0x7f13680cd120 2023-07-09T02:23:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f13677fe640 1 -- 172.21.15.45:0/1848858942 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540ab980 con 0x7f13680cd120 2023-07-09T02:23:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 -- 172.21.15.45:0/1848858942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13680cd120 msgr2=0x7f13680d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 --2- 172.21.15.45:0/1848858942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13680cd120 0x7f13680d1f10 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f136806b120 tx=0x7f135401c210 comp rx=0 tx=0).stop 2023-07-09T02:23:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 -- 172.21.15.45:0/1848858942 shutdown_connections 2023-07-09T02:23:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 --2- 172.21.15.45:0/1848858942 >> v2:172.21.15.155:3300/0 conn(0x7f13680d2450 0x7f13680d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 --2- 172.21.15.45:0/1848858942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13680cd120 0x7f13680d1f10 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 --2- 172.21.15.45:0/1848858942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f136815c060 0x7f13680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 -- 172.21.15.45:0/1848858942 >> 172.21.15.45:0/1848858942 conn(0x7f13680698e0 msgr2=0x7f1368069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 -- 172.21.15.45:0/1848858942 shutdown_connections 2023-07-09T02:23:17.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.731+0000 7f136f1d5640 1 -- 172.21.15.45:0/1848858942 wait complete. 2023-07-09T02:23:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 Processor -- start 2023-07-09T02:23:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 -- start start 2023-07-09T02:23:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13680cd120 0x7f13680c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13680d2450 0x7f1368141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136815c060 0x7f136815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680c8d90 con 0x7f136815c060 2023-07-09T02:23:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680b72d0 con 0x7f13680cd120 2023-07-09T02:23:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136815d100 con 0x7f13680d2450 2023-07-09T02:23:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136815c060 0x7f136815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136815c060 0x7f136815c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38968/0 (socket says 172.21.15.45:38968) 2023-07-09T02:23:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 -- 172.21.15.45:0/636218415 learned_addr learned my addr 172.21.15.45:0/636218415 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136cf71640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13680cd120 0x7f13680c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f1367fff640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13680d2450 0x7f1368141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 -- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13680d2450 msgr2=0x7f1368141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13680d2450 0x7f1368141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 -- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13680cd120 msgr2=0x7f13680c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13680cd120 0x7f13680c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 -- 172.21.15.45:0/636218415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540094d0 con 0x7f136815c060 2023-07-09T02:23:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136d772640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136815c060 0x7f136815c660 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f1360007e60 tx=0x7f136000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f13657fa640 1 -- 172.21.15.45:0/636218415 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360014620 con 0x7f136815c060 2023-07-09T02:23:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f13657fa640 1 -- 172.21.15.45:0/636218415 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136000ee90 con 0x7f136815c060 2023-07-09T02:23:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136815d3e0 con 0x7f136815c060 2023-07-09T02:23:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f13657fa640 1 -- 172.21.15.45:0/636218415 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600149e0 con 0x7f136815c060 2023-07-09T02:23:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.735+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13680b7870 con 0x7f136815c060 2023-07-09T02:23:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.739+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13680b7a60 con 0x7f136815c060 2023-07-09T02:23:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.739+0000 7f13657fa640 1 -- 172.21.15.45:0/636218415 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1360014b40 con 0x7f136815c060 2023-07-09T02:23:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.739+0000 7f13657fa640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f134c066280 0x7f134c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.739+0000 7f13657fa640 1 -- 172.21.15.45:0/636218415 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13600845a0 con 0x7f136815c060 2023-07-09T02:23:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.739+0000 7f136cf71640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f134c066280 0x7f134c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.739+0000 7f136cf71640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f134c066280 0x7f134c068730 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f135c0079c0 tx=0x7f135c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.743+0000 7f13657fa640 1 -- 172.21.15.45:0/636218415 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1360051a30 con 0x7f136815c060 2023-07-09T02:23:17.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.895+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f136804d7d0 con 0x7f136815c060 2023-07-09T02:23:17.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f13657fa640 1 -- 172.21.15.45:0/636218415 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v185) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1360055050 con 0x7f136815c060 2023-07-09T02:23:17.900 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:23:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f134c066280 msgr2=0x7f134c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f134c066280 0x7f134c068730 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f135c0079c0 tx=0x7f135c008040 comp rx=0 tx=0).stop 2023-07-09T02:23:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136815c060 msgr2=0x7f136815c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136815c060 0x7f136815c660 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f1360007e60 tx=0x7f136000e4b0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 shutdown_connections 2023-07-09T02:23:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136815c060 0x7f136815c660 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f134c066280 0x7f134c068730 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13680d2450 0x7f1368141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 --2- 172.21.15.45:0/636218415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13680cd120 0x7f13680c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 >> 172.21.15.45:0/636218415 conn(0x7f13680698e0 msgr2=0x7f13680b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 shutdown_connections 2023-07-09T02:23:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:17.899+0000 7f136f1d5640 1 -- 172.21.15.45:0/636218415 wait complete. 2023-07-09T02:23:17.921 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:23:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd6d540640 1 Processor -- start 2023-07-09T02:23:18.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd6d540640 1 -- start start 2023-07-09T02:23:18.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd6d540640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd6815c060 0x7fcd680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd6d540640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 0x7fcd680d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd6d540640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcd680d2450 0x7fcd680d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd6d540640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd680d28f0 con 0x7fcd6815c060 2023-07-09T02:23:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd6d540640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd68160a50 con 0x7fcd680d2450 2023-07-09T02:23:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd6d540640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6815c430 con 0x7fcd680cd120 2023-07-09T02:23:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd66ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd6815c060 0x7fcd680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd66ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd6815c060 0x7fcd680b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38984/0 (socket says 172.21.15.45:38984) 2023-07-09T02:23:18.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd66ffd640 1 -- 172.21.15.45:0/3938901266 learned_addr learned my addr 172.21.15.45:0/3938901266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:18.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd677fe640 1 --2- 172.21.15.45:0/3938901266 >> v2:172.21.15.155:3300/0 conn(0x7fcd680d2450 0x7fcd680d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd667fc640 1 --2- 172.21.15.45:0/3938901266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 0x7fcd680d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd66ffd640 1 -- 172.21.15.45:0/3938901266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 msgr2=0x7fcd680d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:18.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd66ffd640 1 --2- 172.21.15.45:0/3938901266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 0x7fcd680d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd66ffd640 1 -- 172.21.15.45:0/3938901266 >> v2:172.21.15.155:3300/0 conn(0x7fcd680d2450 msgr2=0x7fcd680d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:18.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd66ffd640 1 --2- 172.21.15.45:0/3938901266 >> v2:172.21.15.155:3300/0 conn(0x7fcd680d2450 0x7fcd680d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd66ffd640 1 -- 172.21.15.45:0/3938901266 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6815fb60 con 0x7fcd6815c060 2023-07-09T02:23:18.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.063+0000 7fcd677fe640 1 --2- 172.21.15.45:0/3938901266 >> v2:172.21.15.155:3300/0 conn(0x7fcd680d2450 0x7fcd680d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd66ffd640 1 --2- 172.21.15.45:0/3938901266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6815c060 0x7fcd680b4ed0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fcd6806b120 tx=0x7fcd5801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b646976d4fe79650 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd65ffb640 1 -- 172.21.15.45:0/3938901266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580ab600 con 0x7fcd6815c060 2023-07-09T02:23:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd65ffb640 1 -- 172.21.15.45:0/3938901266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd580a7050 con 0x7fcd6815c060 2023-07-09T02:23:18.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd65ffb640 1 -- 172.21.15.45:0/3938901266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580ab980 con 0x7fcd6815c060 2023-07-09T02:23:18.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 -- 172.21.15.45:0/3938901266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6815c060 msgr2=0x7fcd680b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 --2- 172.21.15.45:0/3938901266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6815c060 0x7fcd680b4ed0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fcd6806b120 tx=0x7fcd5801c210 comp rx=0 tx=0).stop 2023-07-09T02:23:18.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 -- 172.21.15.45:0/3938901266 shutdown_connections 2023-07-09T02:23:18.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 --2- 172.21.15.45:0/3938901266 >> v2:172.21.15.155:3300/0 conn(0x7fcd680d2450 0x7fcd680d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 --2- 172.21.15.45:0/3938901266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 0x7fcd680d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 --2- 172.21.15.45:0/3938901266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd6815c060 0x7fcd680b4ed0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 -- 172.21.15.45:0/3938901266 >> 172.21.15.45:0/3938901266 conn(0x7fcd680698e0 msgr2=0x7fcd68069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:18.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 -- 172.21.15.45:0/3938901266 shutdown_connections 2023-07-09T02:23:18.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.067+0000 7fcd6d540640 1 -- 172.21.15.45:0/3938901266 wait complete. 2023-07-09T02:23:18.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 Processor -- start 2023-07-09T02:23:18.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 -- start start 2023-07-09T02:23:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 0x7fcd6815f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd680d2450 0x7fcd680b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd6815c060 0x7fcd6815c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680b3830 con 0x7fcd680d2450 2023-07-09T02:23:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680b29a0 con 0x7fcd6815c060 2023-07-09T02:23:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680b2c20 con 0x7fcd680cd120 2023-07-09T02:23:18.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd680d2450 0x7fcd680b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd680d2450 0x7fcd680b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38988/0 (socket says 172.21.15.45:38988) 2023-07-09T02:23:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 -- 172.21.15.45:0/1935134084 learned_addr learned my addr 172.21.15.45:0/1935134084 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd66ffd640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 0x7fcd6815f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd677fe640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd6815c060 0x7fcd6815c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 -- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 msgr2=0x7fcd6815f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 0x7fcd6815f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 -- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd6815c060 msgr2=0x7fcd6815c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd6815c060 0x7fcd6815c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 -- 172.21.15.45:0/1935134084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580094d0 con 0x7fcd680d2450 2023-07-09T02:23:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd667fc640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd680d2450 0x7fcd680b2460 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00d7d0 tx=0x7fcd5c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd4f7fe640 1 -- 172.21.15.45:0/1935134084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c004020 con 0x7fcd680d2450 2023-07-09T02:23:18.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd4f7fe640 1 -- 172.21.15.45:0/1935134084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c004180 con 0x7fcd680d2450 2023-07-09T02:23:18.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd680b2f00 con 0x7fcd680d2450 2023-07-09T02:23:18.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd4f7fe640 1 -- 172.21.15.45:0/1935134084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c004330 con 0x7fcd680d2450 2023-07-09T02:23:18.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.071+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd680b34c0 con 0x7fcd680d2450 2023-07-09T02:23:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.075+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd680b39a0 con 0x7fcd680d2450 2023-07-09T02:23:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.075+0000 7fcd4f7fe640 1 -- 172.21.15.45:0/1935134084 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd5c0096a0 con 0x7fcd680d2450 2023-07-09T02:23:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.075+0000 7fcd4f7fe640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd540662b0 0x7fcd54068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.075+0000 7fcd4f7fe640 1 -- 172.21.15.45:0/1935134084 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd5c083fb0 con 0x7fcd680d2450 2023-07-09T02:23:18.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.075+0000 7fcd66ffd640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd540662b0 0x7fcd54068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.075+0000 7fcd66ffd640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd540662b0 0x7fcd54068760 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcd580ad000 tx=0x7fcd580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.079+0000 7fcd4f7fe640 1 -- 172.21.15.45:0/1935134084 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd5c051440 con 0x7fcd680d2450 2023-07-09T02:23:18.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.243+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcd6804d7d0 con 0x7fcd680d2450 2023-07-09T02:23:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.243+0000 7fcd4f7fe640 1 -- 172.21.15.45:0/1935134084 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v185) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcd5c018080 con 0x7fcd680d2450 2023-07-09T02:23:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:23:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd540662b0 msgr2=0x7fcd54068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd540662b0 0x7fcd54068760 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcd580ad000 tx=0x7fcd580a6000 comp rx=0 tx=0).stop 2023-07-09T02:23:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd680d2450 msgr2=0x7fcd680b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd680d2450 0x7fcd680b2460 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00d7d0 tx=0x7fcd5c00dc90 comp rx=0 tx=0).stop 2023-07-09T02:23:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 shutdown_connections 2023-07-09T02:23:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd6815c060 0x7fcd6815c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd680d2450 0x7fcd680b2460 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcd540662b0 0x7fcd54068760 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 --2- 172.21.15.45:0/1935134084 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd680cd120 0x7fcd6815f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 >> 172.21.15.45:0/1935134084 conn(0x7fcd680698e0 msgr2=0x7fcd68154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 shutdown_connections 2023-07-09T02:23:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.247+0000 7fcd6d540640 1 -- 172.21.15.45:0/1935134084 wait complete. 2023-07-09T02:23:18.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-09T02:23:18.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:18.269 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-09T02:23:18.380 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:23:18.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:18.381 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T02:23:18.392 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:23:18.392 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:18.402 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:23:18.403 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:18.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:23:18.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.591+0000 7f8ad4be2640 1 Processor -- start 2023-07-09T02:23:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.591+0000 7f8ad4be2640 1 -- start start 2023-07-09T02:23:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ad4be2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ad015c060 0x7f8ad00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ad4be2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ad00cd120 0x7f8ad00d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ad4be2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad0160a50 con 0x7f8ad00d2450 2023-07-09T02:23:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ad4be2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00d28d0 con 0x7f8ad015c060 2023-07-09T02:23:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ad4be2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00cfe40 con 0x7f8ad00cd120 2023-07-09T02:23:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ace59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ad015c060 0x7f8ad00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ace59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ad015c060 0x7f8ad00b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38998/0 (socket says 172.21.15.45:38998) 2023-07-09T02:23:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ace59c640 1 -- 172.21.15.45:0/1710718431 learned_addr learned my addr 172.21.15.45:0/1710718431 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:18.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ac7fff640 1 --2- 172.21.15.45:0/1710718431 >> v2:172.21.15.155:3300/0 conn(0x7f8ad00cd120 0x7f8ad00d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ace59c640 1 -- 172.21.15.45:0/1710718431 >> v2:172.21.15.155:3300/0 conn(0x7f8ad00cd120 msgr2=0x7f8ad00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:18.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ace59c640 1 --2- 172.21.15.45:0/1710718431 >> v2:172.21.15.155:3300/0 conn(0x7f8ad00cd120 0x7f8ad00d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ace59c640 1 -- 172.21.15.45:0/1710718431 >> v1:172.21.15.155:6789/0 conn(0x7f8ad00d2450 legacy=0x7f8ad00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.595+0000 7f8ace59c640 1 -- 172.21.15.45:0/1710718431 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad015c430 con 0x7f8ad015c060 2023-07-09T02:23:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ace59c640 1 --2- 172.21.15.45:0/1710718431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad015c060 0x7f8ad00b4ed0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f8ad015fac0 tx=0x7f8ac001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd347db62d83db96 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8acdd9b640 1 -- 172.21.15.45:0/1710718431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00ab5f0 con 0x7f8ad015c060 2023-07-09T02:23:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8acdd9b640 1 -- 172.21.15.45:0/1710718431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac00ab750 con 0x7f8ad015c060 2023-07-09T02:23:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8acdd9b640 1 -- 172.21.15.45:0/1710718431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00abae0 con 0x7f8ad015c060 2023-07-09T02:23:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 -- 172.21.15.45:0/1710718431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad015c060 msgr2=0x7f8ad00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/1710718431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad015c060 0x7f8ad00b4ed0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f8ad015fac0 tx=0x7f8ac001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 -- 172.21.15.45:0/1710718431 shutdown_connections 2023-07-09T02:23:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/1710718431 >> v2:172.21.15.155:3300/0 conn(0x7f8ad00cd120 0x7f8ad00d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/1710718431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad015c060 0x7f8ad00b4ed0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 -- 172.21.15.45:0/1710718431 >> 172.21.15.45:0/1710718431 conn(0x7f8ad00698e0 msgr2=0x7f8ad0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 -- 172.21.15.45:0/1710718431 shutdown_connections 2023-07-09T02:23:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 -- 172.21.15.45:0/1710718431 wait complete. 2023-07-09T02:23:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 Processor -- start 2023-07-09T02:23:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 -- start start 2023-07-09T02:23:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad00cd120 0x7f8ad0153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.599+0000 7f8ad4be2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad00d2450 0x7f8ad00c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ad4be2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ad015c060 0x7f8ad00b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ad4be2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00ca440 con 0x7f8ad00d2450 2023-07-09T02:23:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ad4be2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00ca720 con 0x7f8ad00cd120 2023-07-09T02:23:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ad4be2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00caa00 con 0x7f8ad015c060 2023-07-09T02:23:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad00d2450 0x7f8ad00c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad00d2450 0x7f8ad00c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39004/0 (socket says 172.21.15.45:39004) 2023-07-09T02:23:18.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 -- 172.21.15.45:0/2043329540 learned_addr learned my addr 172.21.15.45:0/2043329540 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:18.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ace59c640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad00cd120 0x7f8ad0153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8aced9d640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ad015c060 0x7f8ad00b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 -- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ad015c060 msgr2=0x7f8ad00b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ad015c060 0x7f8ad00b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 -- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad00cd120 msgr2=0x7f8ad0153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad00cd120 0x7f8ad0153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 -- 172.21.15.45:0/2043329540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00094d0 con 0x7f8ad00d2450 2023-07-09T02:23:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac7fff640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad00d2450 0x7f8ad00c9b10 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800e900 tx=0x7f8ab800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac6ffd640 1 -- 172.21.15.45:0/2043329540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8009690 con 0x7f8ad00d2450 2023-07-09T02:23:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac6ffd640 1 -- 172.21.15.45:0/2043329540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab800ca00 con 0x7f8ad00d2450 2023-07-09T02:23:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac6ffd640 1 -- 172.21.15.45:0/2043329540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800cd90 con 0x7f8ad00d2450 2023-07-09T02:23:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad00cace0 con 0x7f8ad00d2450 2023-07-09T02:23:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad0154260 con 0x7f8ad00d2450 2023-07-09T02:23:18.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad004d7d0 con 0x7f8ad00d2450 2023-07-09T02:23:18.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.603+0000 7f8ac6ffd640 1 -- 172.21.15.45:0/2043329540 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ab8013470 con 0x7f8ad00d2450 2023-07-09T02:23:18.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.607+0000 7f8ac6ffd640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ab0066280 0x7f8ab0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.607+0000 7f8ac6ffd640 1 -- 172.21.15.45:0/2043329540 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ab8083e80 con 0x7f8ad00d2450 2023-07-09T02:23:18.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.607+0000 7f8ace59c640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ab0066280 0x7f8ab0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.607+0000 7f8ace59c640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ab0066280 0x7f8ab0068730 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00af000 tx=0x7f8ac00b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.611+0000 7f8ac6ffd640 1 -- 172.21.15.45:0/2043329540 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ab80513a0 con 0x7f8ad00d2450 2023-07-09T02:23:18.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.767+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ad006baa0 con 0x7f8ad00d2450 2023-07-09T02:23:18.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.767+0000 7f8ac6ffd640 1 -- 172.21.15.45:0/2043329540 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f8ab8017090 con 0x7f8ad00d2450 2023-07-09T02:23:18.771 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:18.771 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":185,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:23:09.480700+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:22:37.645121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T02:22:38.115103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:23:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ab0066280 msgr2=0x7f8ab0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ab0066280 0x7f8ab0068730 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00af000 tx=0x7f8ac00b6040 comp rx=0 tx=0).stop 2023-07-09T02:23:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad00d2450 msgr2=0x7f8ad00c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad00d2450 0x7f8ad00c9b10 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800e900 tx=0x7f8ab800edc0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 shutdown_connections 2023-07-09T02:23:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8ab0066280 0x7f8ab0068730 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ad015c060 0x7f8ad00b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ad00d2450 0x7f8ad00c9b10 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 --2- 172.21.15.45:0/2043329540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad00cd120 0x7f8ad0153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 >> 172.21.15.45:0/2043329540 conn(0x7f8ad00698e0 msgr2=0x7f8ad00b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 shutdown_connections 2023-07-09T02:23:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.771+0000 7f8ad4be2640 1 -- 172.21.15.45:0/2043329540 wait complete. 2023-07-09T02:23:18.793 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:22:37.645121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:22:38.115103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:23:18.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:23:18.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4ee9e640 1 Processor -- start 2023-07-09T02:23:18.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4ee9e640 1 -- start start 2023-07-09T02:23:18.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4ee9e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d4806a5c0 0x7f5d4815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4ee9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806aa40 0x7f5d48160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4ee9e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d48071140 con 0x7f5d480cd290 2023-07-09T02:23:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4ee9e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4806b010 con 0x7f5d4806a5c0 2023-07-09T02:23:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4ee9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4815c970 con 0x7f5d4806aa40 2023-07-09T02:23:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d47fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d4806a5c0 0x7f5d4815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4cc3a640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d480cd290 0x7f5d480cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42912/0 (socket says 172.21.15.45:42912) 2023-07-09T02:23:18.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4cc3a640 1 -- 172.21.15.45:0/239927578 learned_addr learned my addr 172.21.15.45:0/239927578 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:18.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4d43b640 1 --2- 172.21.15.45:0/239927578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806aa40 0x7f5d48160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d477fe640 1 -- 172.21.15.45:0/239927578 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756131188 0 0) 0x7f5d48071140 con 0x7f5d480cd290 2023-07-09T02:23:18.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d477fe640 1 -- 172.21.15.45:0/239927578 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d38003530 con 0x7f5d480cd290 2023-07-09T02:23:18.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d47fff640 1 -- 172.21.15.45:0/239927578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806aa40 msgr2=0x7f5d48160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:18.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d47fff640 1 --2- 172.21.15.45:0/239927578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806aa40 0x7f5d48160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d47fff640 1 -- 172.21.15.45:0/239927578 >> v1:172.21.15.45:6789/0 conn(0x7f5d480cd290 legacy=0x7f5d480cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d47fff640 1 -- 172.21.15.45:0/239927578 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4815cc50 con 0x7f5d4806a5c0 2023-07-09T02:23:18.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.939+0000 7f5d4d43b640 1 --2- 172.21.15.45:0/239927578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806aa40 0x7f5d48160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:18.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d47fff640 1 --2- 172.21.15.45:0/239927578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4806a5c0 0x7f5d4815fdd0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5d340097c0 tx=0x7f5d3401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafc8b1a283246b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d477fe640 1 -- 172.21.15.45:0/239927578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d340ab600 con 0x7f5d4806a5c0 2023-07-09T02:23:18.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d477fe640 1 -- 172.21.15.45:0/239927578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d340a7050 con 0x7f5d4806a5c0 2023-07-09T02:23:18.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d477fe640 1 -- 172.21.15.45:0/239927578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d340ab960 con 0x7f5d4806a5c0 2023-07-09T02:23:18.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/239927578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4806a5c0 msgr2=0x7f5d4815fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/239927578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4806a5c0 0x7f5d4815fdd0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5d340097c0 tx=0x7f5d3401c480 comp rx=0 tx=0).stop 2023-07-09T02:23:18.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/239927578 shutdown_connections 2023-07-09T02:23:18.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/239927578 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806aa40 0x7f5d48160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/239927578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d4806a5c0 0x7f5d4815fdd0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/239927578 >> 172.21.15.45:0/239927578 conn(0x7f5d4806d140 msgr2=0x7f5d4806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:18.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/239927578 shutdown_connections 2023-07-09T02:23:18.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.943+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/239927578 wait complete. 2023-07-09T02:23:18.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 Processor -- start 2023-07-09T02:23:18.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 -- start start 2023-07-09T02:23:18.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806a5c0 0x7f5d480ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4806aa40 0x7f5d48151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d480cd290 0x7f5d480ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480ad250 con 0x7f5d480cd290 2023-07-09T02:23:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480ad530 con 0x7f5d4806aa40 2023-07-09T02:23:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480ad810 con 0x7f5d4806a5c0 2023-07-09T02:23:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d480cd290 0x7f5d480ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d480cd290 0x7f5d480ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39024/0 (socket says 172.21.15.45:39024) 2023-07-09T02:23:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 -- 172.21.15.45:0/1572370255 learned_addr learned my addr 172.21.15.45:0/1572370255 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4cc3a640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806a5c0 0x7f5d480ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 -- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806a5c0 msgr2=0x7f5d480ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d47fff640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4806aa40 0x7f5d48151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806a5c0 0x7f5d480ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 -- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4806aa40 msgr2=0x7f5d48151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:18.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4806aa40 0x7f5d48151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:18.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 -- 172.21.15.45:0/1572370255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34009420 con 0x7f5d480cd290 2023-07-09T02:23:18.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4cc3a640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806a5c0 0x7f5d480ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:18.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d47fff640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4806aa40 0x7f5d48151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:18.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4d43b640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d480cd290 0x7f5d480ac870 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5d40007ef0 tx=0x7f5d4000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d457fa640 1 -- 172.21.15.45:0/1572370255 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40003ba0 con 0x7f5d480cd290 2023-07-09T02:23:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d457fa640 1 -- 172.21.15.45:0/1572370255 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4000f040 con 0x7f5d480cd290 2023-07-09T02:23:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d457fa640 1 -- 172.21.15.45:0/1572370255 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000de80 con 0x7f5d480cd290 2023-07-09T02:23:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d480adaf0 con 0x7f5d480cd290 2023-07-09T02:23:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d481522a0 con 0x7f5d480cd290 2023-07-09T02:23:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.947+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d480ae010 con 0x7f5d480cd290 2023-07-09T02:23:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.951+0000 7f5d457fa640 1 -- 172.21.15.45:0/1572370255 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d40004030 con 0x7f5d480cd290 2023-07-09T02:23:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.951+0000 7f5d457fa640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d2c066280 0x7f5d2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.951+0000 7f5d457fa640 1 -- 172.21.15.45:0/1572370255 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d400840b0 con 0x7f5d480cd290 2023-07-09T02:23:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.951+0000 7f5d4cc3a640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d2c066280 0x7f5d2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:18.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.951+0000 7f5d4cc3a640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d2c066280 0x7f5d2c068730 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c005890 tx=0x7f5d3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:18.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:18.955+0000 7f5d457fa640 1 -- 172.21.15.45:0/1572370255 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d480ae010 con 0x7f5d480cd290 2023-07-09T02:23:19.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.107+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d480ae010 con 0x7f5d480cd290 2023-07-09T02:23:19.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.107+0000 7f5d457fa640 1 -- 172.21.15.45:0/1572370255 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v185) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d4001a020 con 0x7f5d480cd290 2023-07-09T02:23:19.112 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:23:19.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d2c066280 msgr2=0x7f5d2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d2c066280 0x7f5d2c068730 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c005890 tx=0x7f5d3c009040 comp rx=0 tx=0).stop 2023-07-09T02:23:19.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d480cd290 msgr2=0x7f5d480ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d480cd290 0x7f5d480ac870 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5d40007ef0 tx=0x7f5d4000d4a0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 shutdown_connections 2023-07-09T02:23:19.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d480cd290 0x7f5d480ac870 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d4806aa40 0x7f5d48151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5d2c066280 0x7f5d2c068730 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 --2- 172.21.15.45:0/1572370255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d4806a5c0 0x7f5d480ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 >> 172.21.15.45:0/1572370255 conn(0x7f5d4806d140 msgr2=0x7f5d4815a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:19.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 shutdown_connections 2023-07-09T02:23:19.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.111+0000 7f5d4ee9e640 1 -- 172.21.15.45:0/1572370255 wait complete. 2023-07-09T02:23:19.132 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:23:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.275+0000 7f625b66d640 1 Processor -- start 2023-07-09T02:23:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.275+0000 7f625b66d640 1 -- start start 2023-07-09T02:23:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f625b66d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f62540d2620 0x7f62540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f625b66d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6254160a50 con 0x7f625415c060 2023-07-09T02:23:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f625b66d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625415c430 con 0x7f62540cd120 2023-07-09T02:23:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f625b66d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625415fb60 con 0x7f62540d2620 2023-07-09T02:23:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f6258c08640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f62540d2620 0x7f62540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f6258c08640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f62540d2620 0x7f62540b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39038/0 (socket says 172.21.15.45:39038) 2023-07-09T02:23:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f6258c08640 1 -- 172.21.15.45:0/2611464968 learned_addr learned my addr 172.21.15.45:0/2611464968 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:19.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f6259409640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f625415c060 0x7f62540d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42928/0 (socket says 172.21.15.45:42928) 2023-07-09T02:23:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f6258c08640 1 -- 172.21.15.45:0/2611464968 >> v1:172.21.15.155:6789/0 conn(0x7f62540cd120 legacy=0x7f62540cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f6258c08640 1 -- 172.21.15.45:0/2611464968 >> v1:172.21.15.45:6789/0 conn(0x7f625415c060 legacy=0x7f62540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f6258c08640 1 -- 172.21.15.45:0/2611464968 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625415fe40 con 0x7f62540d2620 2023-07-09T02:23:19.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.279+0000 7f624bfff640 1 -- 172.21.15.45:0/2611464968 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674731018 0 0) 0x7f6254160a50 con 0x7f625415c060 2023-07-09T02:23:19.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f6258c08640 1 --2- 172.21.15.45:0/2611464968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540b4ed0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f6244009870 tx=0x7f624401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f33faff9e78f641 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f624bfff640 1 -- 172.21.15.45:0/2611464968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440aa670 con 0x7f62540d2620 2023-07-09T02:23:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f624bfff640 1 -- 172.21.15.45:0/2611464968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62440aa7d0 con 0x7f62540d2620 2023-07-09T02:23:19.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f624bfff640 1 -- 172.21.15.45:0/2611464968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440aab60 con 0x7f62540d2620 2023-07-09T02:23:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 -- 172.21.15.45:0/2611464968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 msgr2=0x7f62540b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 --2- 172.21.15.45:0/2611464968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540b4ed0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f6244009870 tx=0x7f624401c510 comp rx=0 tx=0).stop 2023-07-09T02:23:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 -- 172.21.15.45:0/2611464968 shutdown_connections 2023-07-09T02:23:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 --2- 172.21.15.45:0/2611464968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540b4ed0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 -- 172.21.15.45:0/2611464968 >> 172.21.15.45:0/2611464968 conn(0x7f62540698e0 msgr2=0x7f6254069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:19.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 -- 172.21.15.45:0/2611464968 shutdown_connections 2023-07-09T02:23:19.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 -- 172.21.15.45:0/2611464968 wait complete. 2023-07-09T02:23:19.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 Processor -- start 2023-07-09T02:23:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.283+0000 7f625b66d640 1 -- start start 2023-07-09T02:23:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62540cd120 0x7f6254161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625415c060 0x7f6254163800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540cba30 con 0x7f62540d2620 2023-07-09T02:23:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6254165ce0 con 0x7f625415c060 2023-07-09T02:23:19.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62540caef0 con 0x7f62540cd120 2023-07-09T02:23:19.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39044/0 (socket says 172.21.15.45:39044) 2023-07-09T02:23:19.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 -- 172.21.15.45:0/1125841607 learned_addr learned my addr 172.21.15.45:0/1125841607 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:19.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6259409640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62540cd120 0x7f6254161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6259c0a640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625415c060 0x7f6254163800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 -- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62540cd120 msgr2=0x7f6254161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62540cd120 0x7f6254161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 -- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625415c060 msgr2=0x7f6254163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625415c060 0x7f6254163800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 -- 172.21.15.45:0/1125841607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440094d0 con 0x7f62540d2620 2023-07-09T02:23:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6259c0a640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625415c060 0x7f6254163800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6258c08640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540ca9b0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f6244019120 tx=0x7f624401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6249ffb640 1 -- 172.21.15.45:0/1125841607 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440b38c0 con 0x7f62540d2620 2023-07-09T02:23:19.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6249ffb640 1 -- 172.21.15.45:0/1125841607 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62440b3a20 con 0x7f62540d2620 2023-07-09T02:23:19.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6249ffb640 1 -- 172.21.15.45:0/1125841607 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440b3dd0 con 0x7f62540d2620 2023-07-09T02:23:19.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62540b59f0 con 0x7f62540d2620 2023-07-09T02:23:19.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62540cb470 con 0x7f62540d2620 2023-07-09T02:23:19.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6254165e20 con 0x7f62540d2620 2023-07-09T02:23:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.287+0000 7f6249ffb640 1 -- 172.21.15.45:0/1125841607 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62440c6440 con 0x7f62540d2620 2023-07-09T02:23:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.291+0000 7f6249ffb640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6238066280 0x7f6238068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.291+0000 7f6249ffb640 1 -- 172.21.15.45:0/1125841607 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f624411ebb0 con 0x7f62540d2620 2023-07-09T02:23:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.291+0000 7f6259409640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6238066280 0x7f6238068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.291+0000 7f6259409640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6238066280 0x7f6238068730 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6250007bc0 tx=0x7f6250007b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.295+0000 7f6249ffb640 1 -- 172.21.15.45:0/1125841607 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6254165e20 con 0x7f62540d2620 2023-07-09T02:23:19.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.447+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6254165e20 con 0x7f62540d2620 2023-07-09T02:23:19.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.447+0000 7f6249ffb640 1 -- 172.21.15.45:0/1125841607 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v185) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6254165e20 con 0x7f62540d2620 2023-07-09T02:23:19.450 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:23:19.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6238066280 msgr2=0x7f6238068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6238066280 0x7f6238068730 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6250007bc0 tx=0x7f6250007b10 comp rx=0 tx=0).stop 2023-07-09T02:23:19.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 msgr2=0x7f62540ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540ca9b0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f6244019120 tx=0x7f624401ad50 comp rx=0 tx=0).stop 2023-07-09T02:23:19.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 shutdown_connections 2023-07-09T02:23:19.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f625415c060 0x7f6254163800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62540d2620 0x7f62540ca9b0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f6238066280 0x7f6238068730 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 --2- 172.21.15.45:0/1125841607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62540cd120 0x7f6254161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 >> 172.21.15.45:0/1125841607 conn(0x7f62540698e0 msgr2=0x7f625415e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:19.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 shutdown_connections 2023-07-09T02:23:19.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.451+0000 7f625b66d640 1 -- 172.21.15.45:0/1125841607 wait complete. 2023-07-09T02:23:19.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:23:19.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f289ce8a640 1 Processor -- start 2023-07-09T02:23:19.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f289ce8a640 1 -- start start 2023-07-09T02:23:19.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f289ce8a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28980b1bc0 0x7f2898069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f289ce8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980d2400 0x7f2898069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f289ce8a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f28980ccf10 0x7f2898070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f289ce8a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28980cea70 con 0x7f28980b1bc0 2023-07-09T02:23:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f289ce8a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28980b1f90 con 0x7f28980ccf10 2023-07-09T02:23:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f289ce8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28980ceff0 con 0x7f28980d2400 2023-07-09T02:23:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f28977fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28980b1bc0 0x7f2898069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f28977fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28980b1bc0 0x7f2898069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39060/0 (socket says 172.21.15.45:39060) 2023-07-09T02:23:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f28977fe640 1 -- 172.21.15.45:0/4111375539 learned_addr learned my addr 172.21.15.45:0/4111375539 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f28977fe640 1 -- 172.21.15.45:0/4111375539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980d2400 msgr2=0x7f2898069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f28977fe640 1 --2- 172.21.15.45:0/4111375539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980d2400 0x7f2898069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f28977fe640 1 -- 172.21.15.45:0/4111375539 >> v2:172.21.15.155:3300/0 conn(0x7f28980ccf10 msgr2=0x7f2898070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f28977fe640 1 --2- 172.21.15.45:0/4111375539 >> v2:172.21.15.155:3300/0 conn(0x7f28980ccf10 0x7f2898070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.619+0000 7f28977fe640 1 -- 172.21.15.45:0/4111375539 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980d1500 con 0x7f28980b1bc0 2023-07-09T02:23:19.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f28977fe640 1 --2- 172.21.15.45:0/4111375539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980b1bc0 0x7f2898069870 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f28980c9920 tx=0x7f288801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185269f9340da939 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f28967fc640 1 -- 172.21.15.45:0/4111375539 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28880ab600 con 0x7f28980b1bc0 2023-07-09T02:23:19.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f28967fc640 1 -- 172.21.15.45:0/4111375539 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28880a7050 con 0x7f28980b1bc0 2023-07-09T02:23:19.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f28967fc640 1 -- 172.21.15.45:0/4111375539 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28880ab980 con 0x7f28980b1bc0 2023-07-09T02:23:19.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 -- 172.21.15.45:0/4111375539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980b1bc0 msgr2=0x7f2898069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 --2- 172.21.15.45:0/4111375539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980b1bc0 0x7f2898069870 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f28980c9920 tx=0x7f288801c210 comp rx=0 tx=0).stop 2023-07-09T02:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 -- 172.21.15.45:0/4111375539 shutdown_connections 2023-07-09T02:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 --2- 172.21.15.45:0/4111375539 >> v2:172.21.15.155:3300/0 conn(0x7f28980ccf10 0x7f2898070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 --2- 172.21.15.45:0/4111375539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980d2400 0x7f2898069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 --2- 172.21.15.45:0/4111375539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980b1bc0 0x7f2898069870 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 -- 172.21.15.45:0/4111375539 >> 172.21.15.45:0/4111375539 conn(0x7f28980d35b0 msgr2=0x7f28980cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 -- 172.21.15.45:0/4111375539 shutdown_connections 2023-07-09T02:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.623+0000 7f289ce8a640 1 -- 172.21.15.45:0/4111375539 wait complete. 2023-07-09T02:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 Processor -- start 2023-07-09T02:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 -- start start 2023-07-09T02:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28980b1bc0 0x7f289814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980ccf10 0x7f28980c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980d2400 0x7f2898159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289814c660 con 0x7f28980d2400 2023-07-09T02:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28980c5a20 con 0x7f28980b1bc0 2023-07-09T02:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289815a9d0 con 0x7f28980ccf10 2023-07-09T02:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980d2400 0x7f2898159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980d2400 0x7f2898159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39076/0 (socket says 172.21.15.45:39076) 2023-07-09T02:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 -- 172.21.15.45:0/1168354438 learned_addr learned my addr 172.21.15.45:0/1168354438 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2896ffd640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980ccf10 0x7f28980c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f28977fe640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28980b1bc0 0x7f289814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 -- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980ccf10 msgr2=0x7f28980c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980ccf10 0x7f28980c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 -- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28980b1bc0 msgr2=0x7f289814c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28980b1bc0 0x7f289814c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 -- 172.21.15.45:0/1168354438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880094d0 con 0x7f28980d2400 2023-07-09T02:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f2897fff640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980d2400 0x7f2898159e60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f289000b970 tx=0x7f289000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f287ffff640 1 -- 172.21.15.45:0/1168354438 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289000cb40 con 0x7f28980d2400 2023-07-09T02:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f287ffff640 1 -- 172.21.15.45:0/1168354438 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289000ccc0 con 0x7f28980d2400 2023-07-09T02:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f287ffff640 1 -- 172.21.15.45:0/1168354438 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890014680 con 0x7f28980d2400 2023-07-09T02:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289815cba0 con 0x7f28980d2400 2023-07-09T02:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.627+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289815d160 con 0x7f28980d2400 2023-07-09T02:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.631+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289804e020 con 0x7f28980d2400 2023-07-09T02:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.631+0000 7f287ffff640 1 -- 172.21.15.45:0/1168354438 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f289001d3b0 con 0x7f28980d2400 2023-07-09T02:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.631+0000 7f287ffff640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2884066280 0x7f2884068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.631+0000 7f287ffff640 1 -- 172.21.15.45:0/1168354438 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2890083d90 con 0x7f28980d2400 2023-07-09T02:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.631+0000 7f28977fe640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2884066280 0x7f2884068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.631+0000 7f28977fe640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2884066280 0x7f2884068730 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f28880ad000 tx=0x7f28880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.635+0000 7f287ffff640 1 -- 172.21.15.45:0/1168354438 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2890051190 con 0x7f28980d2400 2023-07-09T02:23:19.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f289815f8e0 con 0x7f28980d2400 2023-07-09T02:23:19.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f287ffff640 1 -- 172.21.15.45:0/1168354438 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v185) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2890019020 con 0x7f28980d2400 2023-07-09T02:23:19.796 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:23:19.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2884066280 msgr2=0x7f2884068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2884066280 0x7f2884068730 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f28880ad000 tx=0x7f28880a6000 comp rx=0 tx=0).stop 2023-07-09T02:23:19.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980d2400 msgr2=0x7f2898159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980d2400 0x7f2898159e60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f289000b970 tx=0x7f289000be30 comp rx=0 tx=0).stop 2023-07-09T02:23:19.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 shutdown_connections 2023-07-09T02:23:19.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28980d2400 0x7f2898159e60 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2884066280 0x7f2884068730 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28980ccf10 0x7f28980c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 --2- 172.21.15.45:0/1168354438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28980b1bc0 0x7f289814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 >> 172.21.15.45:0/1168354438 conn(0x7f28980d35b0 msgr2=0x7f2898155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:19.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 shutdown_connections 2023-07-09T02:23:19.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.795+0000 7f289ce8a640 1 -- 172.21.15.45:0/1168354438 wait complete. 2023-07-09T02:23:19.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:23:19.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.959+0000 7f76429fa640 1 Processor -- start 2023-07-09T02:23:19.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.959+0000 7f76429fa640 1 -- start start 2023-07-09T02:23:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76429fa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f763c0b1bc0 0x7f763c069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76429fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76429fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0ceff0 con 0x7f763c0ccf10 2023-07-09T02:23:19.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76429fa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0cea70 con 0x7f763c0b1bc0 2023-07-09T02:23:19.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76429fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0b1f90 con 0x7f763c0d2400 2023-07-09T02:23:19.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76419f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f763c0b1bc0 0x7f763c069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76419f8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f763c0b1bc0 0x7f763c069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39078/0 (socket says 172.21.15.45:39078) 2023-07-09T02:23:19.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76419f8640 1 -- 172.21.15.45:0/1837731622 learned_addr learned my addr 172.21.15.45:0/1837731622 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:19.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76411f7640 1 --2- 172.21.15.45:0/1837731622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76419f8640 1 -- 172.21.15.45:0/1837731622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 msgr2=0x7f763c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:19.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76419f8640 1 --2- 172.21.15.45:0/1837731622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76419f8640 1 -- 172.21.15.45:0/1837731622 >> v1:172.21.15.155:6789/0 conn(0x7f763c0ccf10 legacy=0x7f763c070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.963+0000 7f76419f8640 1 -- 172.21.15.45:0/1837731622 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0d1500 con 0x7f763c0b1bc0 2023-07-09T02:23:19.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76419f8640 1 --2- 172.21.15.45:0/1837731622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0b1bc0 0x7f763c069870 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f763c0cebb0 tx=0x7f763801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14446bda5ef8531a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76409f6640 1 -- 172.21.15.45:0/1837731622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380aa650 con 0x7f763c0b1bc0 2023-07-09T02:23:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76409f6640 1 -- 172.21.15.45:0/1837731622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76380aa7b0 con 0x7f763c0b1bc0 2023-07-09T02:23:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76409f6640 1 -- 172.21.15.45:0/1837731622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380aab40 con 0x7f763c0b1bc0 2023-07-09T02:23:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 -- 172.21.15.45:0/1837731622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0b1bc0 msgr2=0x7f763c069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 --2- 172.21.15.45:0/1837731622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0b1bc0 0x7f763c069870 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f763c0cebb0 tx=0x7f763801c4f0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 -- 172.21.15.45:0/1837731622 shutdown_connections 2023-07-09T02:23:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 --2- 172.21.15.45:0/1837731622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 --2- 172.21.15.45:0/1837731622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0b1bc0 0x7f763c069870 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 -- 172.21.15.45:0/1837731622 >> 172.21.15.45:0/1837731622 conn(0x7f763c0d35b0 msgr2=0x7f763c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 -- 172.21.15.45:0/1837731622 shutdown_connections 2023-07-09T02:23:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 -- 172.21.15.45:0/1837731622 wait complete. 2023-07-09T02:23:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 Processor -- start 2023-07-09T02:23:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.967+0000 7f76429fa640 1 -- start start 2023-07-09T02:23:19.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f763c0b1bc0 0x7f763c0c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0ccf10 0x7f763c158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c156a00 con 0x7f763c0ccf10 2023-07-09T02:23:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c158c40 con 0x7f763c0b1bc0 2023-07-09T02:23:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c154420 con 0x7f763c0d2400 2023-07-09T02:23:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0ccf10 0x7f763c158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0ccf10 0x7f763c158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39090/0 (socket says 172.21.15.45:39090) 2023-07-09T02:23:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 -- 172.21.15.45:0/2324640420 learned_addr learned my addr 172.21.15.45:0/2324640420 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76419f8640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f763c0b1bc0 0x7f763c0c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76421f9640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 -- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 msgr2=0x7f763c148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 -- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f763c0b1bc0 msgr2=0x7f763c0c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f763c0b1bc0 0x7f763c0c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 -- 172.21.15.45:0/2324640420 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380094d0 con 0x7f763c0ccf10 2023-07-09T02:23:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76421f9640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:19.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76411f7640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0ccf10 0x7f763c158700 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f762c00d620 tx=0x7f762c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76327fc640 1 -- 172.21.15.45:0/2324640420 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0125f0 con 0x7f763c0ccf10 2023-07-09T02:23:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76327fc640 1 -- 172.21.15.45:0/2324640420 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c012750 con 0x7f763c0ccf10 2023-07-09T02:23:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76327fc640 1 -- 172.21.15.45:0/2324640420 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c012ae0 con 0x7f763c0ccf10 2023-07-09T02:23:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c156ca0 con 0x7f763c0ccf10 2023-07-09T02:23:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c1530a0 con 0x7f763c0ccf10 2023-07-09T02:23:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c153260 con 0x7f763c0ccf10 2023-07-09T02:23:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.971+0000 7f76327fc640 1 -- 172.21.15.45:0/2324640420 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f762c012c40 con 0x7f763c0ccf10 2023-07-09T02:23:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.975+0000 7f76327fc640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7620066280 0x7f7620068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.975+0000 7f76327fc640 1 -- 172.21.15.45:0/2324640420 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f762c084130 con 0x7f763c0ccf10 2023-07-09T02:23:19.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.975+0000 7f76419f8640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7620066280 0x7f7620068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:19.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.975+0000 7f76419f8640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7620066280 0x7f7620068730 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f76380ae000 tx=0x7f76380b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:19.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:19.979+0000 7f76327fc640 1 -- 172.21.15.45:0/2324640420 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f762c0515a0 con 0x7f763c0ccf10 2023-07-09T02:23:20.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f763c04e020 con 0x7f763c0ccf10 2023-07-09T02:23:20.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76327fc640 1 -- 172.21.15.45:0/2324640420 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v185) v1 ==== 100+0+11 (secure 0 0 0) 0x7f762c054bc0 con 0x7f763c0ccf10 2023-07-09T02:23:20.133 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:23:20.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7620066280 msgr2=0x7f7620068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7620066280 0x7f7620068730 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f76380ae000 tx=0x7f76380b5040 comp rx=0 tx=0).stop 2023-07-09T02:23:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0ccf10 msgr2=0x7f763c158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0ccf10 0x7f763c158700 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f762c00d620 tx=0x7f762c00dae0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 shutdown_connections 2023-07-09T02:23:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7620066280 0x7f7620068730 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f763c0d2400 0x7f763c148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f763c0ccf10 0x7f763c158700 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 --2- 172.21.15.45:0/2324640420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f763c0b1bc0 0x7f763c0c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 >> 172.21.15.45:0/2324640420 conn(0x7f763c0d35b0 msgr2=0x7f763c159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:20.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 shutdown_connections 2023-07-09T02:23:20.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.131+0000 7f76429fa640 1 -- 172.21.15.45:0/2324640420 wait complete. 2023-07-09T02:23:20.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T02:23:20.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:23:20.269 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:23:20.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96c5d2640 1 Processor -- start 2023-07-09T02:23:20.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96c5d2640 1 -- start start 2023-07-09T02:23:20.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96c5d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9640d2620 0x7ff9640b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96c5d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640cd120 0x7ff9640cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96c5d2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff964160a50 con 0x7ff96415c060 2023-07-09T02:23:20.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96c5d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96415c430 con 0x7ff9640d2620 2023-07-09T02:23:20.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96c5d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96415fb60 con 0x7ff9640cd120 2023-07-09T02:23:20.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96a36e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff96415c060 0x7ff9640d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42934/0 (socket says 172.21.15.45:42934) 2023-07-09T02:23:20.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.299+0000 7ff96a36e640 1 -- 172.21.15.45:0/1014111521 learned_addr learned my addr 172.21.15.45:0/1014111521 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:20.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96ab6f640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640cd120 0x7ff9640cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044560281 0 0) 0x7ff964160a50 con 0x7ff96415c060 2023-07-09T02:23:20.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff969b6d640 1 --2- 172.21.15.45:0/1014111521 >> v2:172.21.15.155:3300/0 conn(0x7ff9640d2620 0x7ff9640b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff950003530 con 0x7ff96415c060 2023-07-09T02:23:20.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96998743 0 0) 0x7ff950003530 con 0x7ff96415c060 2023-07-09T02:23:20.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640cd120 msgr2=0x7ff9640cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:20.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640cd120 0x7ff9640cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 >> v2:172.21.15.155:3300/0 conn(0x7ff9640d2620 msgr2=0x7ff9640b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 --2- 172.21.15.45:0/1014111521 >> v2:172.21.15.155:3300/0 conn(0x7ff9640d2620 0x7ff9640b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96415fe40 con 0x7ff96415c060 2023-07-09T02:23:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7ff960001680 con 0x7ff96415c060 2023-07-09T02:23:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 >> v1:172.21.15.45:6789/0 conn(0x7ff96415c060 legacy=0x7ff9640d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640cd120 0x7ff950003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff950003f00 0x7ff9500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950004d10 0x7ff950005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96415c430 con 0x7ff950003f00 2023-07-09T02:23:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96415fb60 con 0x7ff950004d10 2023-07-09T02:23:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95000b990 con 0x7ff9640cd120 2023-07-09T02:23:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff969b6d640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff950003f00 0x7ff9500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96a36e640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640cd120 0x7ff950003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff96ab6f640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950004d10 0x7ff950005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff969b6d640 1 -- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640cd120 msgr2=0x7ff950003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff969b6d640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640cd120 0x7ff950003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff969b6d640 1 -- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950004d10 msgr2=0x7ff950005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff969b6d640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950004d10 0x7ff950005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.303+0000 7ff969b6d640 1 -- 172.21.15.45:0/1014111521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff950003530 con 0x7ff950003f00 2023-07-09T02:23:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff969b6d640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff950003f00 0x7ff9500047d0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff954009ab0 tx=0x7ff95401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e381a57f1ceb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540a5660 con 0x7ff950003f00 2023-07-09T02:23:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9540a57c0 con 0x7ff950003f00 2023-07-09T02:23:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96936c640 1 -- 172.21.15.45:0/1014111521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540a5b70 con 0x7ff950003f00 2023-07-09T02:23:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96c5d2640 1 -- 172.21.15.45:0/1014111521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff950003f00 msgr2=0x7ff9500047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96c5d2640 1 --2- 172.21.15.45:0/1014111521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff950003f00 0x7ff9500047d0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff954009ab0 tx=0x7ff95401ca70 comp rx=0 tx=0).stop 2023-07-09T02:23:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96ab6f640 1 -- 172.21.15.45:0/1014111521 reap_dead start 2023-07-09T02:23:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96c5d2640 1 -- 172.21.15.45:0/1014111521 shutdown_connections 2023-07-09T02:23:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96c5d2640 1 -- 172.21.15.45:0/1014111521 >> 172.21.15.45:0/1014111521 conn(0x7ff9640698e0 msgr2=0x7ff964069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96c5d2640 1 -- 172.21.15.45:0/1014111521 shutdown_connections 2023-07-09T02:23:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96c5d2640 1 -- 172.21.15.45:0/1014111521 wait complete. 2023-07-09T02:23:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96c5d2640 1 Processor -- start 2023-07-09T02:23:20.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.307+0000 7ff96c5d2640 1 -- start start 2023-07-09T02:23:20.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950003f00 0x7ff964159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640caba0 0x7ff9640cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff96415e660 0x7ff96415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96415d5c0 con 0x7ff96415e660 2023-07-09T02:23:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96415d8a0 con 0x7ff950003f00 2023-07-09T02:23:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96415db80 con 0x7ff9640caba0 2023-07-09T02:23:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff96415e660 0x7ff96415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff96415e660 0x7ff96415ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39094/0 (socket says 172.21.15.45:39094) 2023-07-09T02:23:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 -- 172.21.15.45:0/2695610946 learned_addr learned my addr 172.21.15.45:0/2695610946 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96a36e640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950003f00 0x7ff964159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff969b6d640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640caba0 0x7ff9640cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 -- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640caba0 msgr2=0x7ff9640cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640caba0 0x7ff9640cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 -- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950003f00 msgr2=0x7ff964159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950003f00 0x7ff964159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 -- 172.21.15.45:0/2695610946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96415de60 con 0x7ff96415e660 2023-07-09T02:23:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff969b6d640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640caba0 0x7ff9640cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96ab6f640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff96415e660 0x7ff96415ead0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7ff96406ba70 tx=0x7ff95c011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff95affd640 1 -- 172.21.15.45:0/2695610946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00e040 con 0x7ff96415e660 2023-07-09T02:23:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff95affd640 1 -- 172.21.15.45:0/2695610946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c00f040 con 0x7ff96415e660 2023-07-09T02:23:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff95affd640 1 -- 172.21.15.45:0/2695610946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c015a80 con 0x7ff96415e660 2023-07-09T02:23:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96415e140 con 0x7ff96415e660 2023-07-09T02:23:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9641f1840 con 0x7ff96415e660 2023-07-09T02:23:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9641603e0 con 0x7ff96415e660 2023-07-09T02:23:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.311+0000 7ff95affd640 1 -- 172.21.15.45:0/2695610946 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff95c015be0 con 0x7ff96415e660 2023-07-09T02:23:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.315+0000 7ff95affd640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff948066280 0x7ff948068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.315+0000 7ff95affd640 1 -- 172.21.15.45:0/2695610946 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff95c083ca0 con 0x7ff96415e660 2023-07-09T02:23:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.315+0000 7ff96a36e640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff948066280 0x7ff948068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.315+0000 7ff96a36e640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff948066280 0x7ff948068730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff960001cd0 tx=0x7ff960007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.319+0000 7ff95affd640 1 -- 172.21.15.45:0/2695610946 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9641603e0 con 0x7ff96415e660 2023-07-09T02:23:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff9641603e0 con 0x7ff96415e660 2023-07-09T02:23:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff95affd640 1 -- 172.21.15.45:0/2695610946 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v185) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff9641603e0 con 0x7ff96415e660 2023-07-09T02:23:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-07-09T02:23:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff948066280 msgr2=0x7ff948068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff948066280 0x7ff948068730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff960001cd0 tx=0x7ff960007900 comp rx=0 tx=0).stop 2023-07-09T02:23:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff96415e660 msgr2=0x7ff96415ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff96415e660 0x7ff96415ead0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7ff96406ba70 tx=0x7ff95c011cb0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 shutdown_connections 2023-07-09T02:23:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff96415e660 0x7ff96415ead0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff948066280 0x7ff948068730 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9640caba0 0x7ff9640cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 --2- 172.21.15.45:0/2695610946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff950003f00 0x7ff964159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 >> 172.21.15.45:0/2695610946 conn(0x7ff9640698e0 msgr2=0x7ff96415b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 shutdown_connections 2023-07-09T02:23:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.487+0000 7ff96c5d2640 1 -- 172.21.15.45:0/2695610946 wait complete. 2023-07-09T02:23:20.508 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-09T02:23:20.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:20.509 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-09T02:23:20.576 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:23:20.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:20.577 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T02:23:20.589 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:23:20.589 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:20.600 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:23:20.601 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:23:20.601 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:20.640 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:23:20.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:23:20.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.783+0000 7fc23d79f640 1 Processor -- start 2023-07-09T02:23:20.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.783+0000 7fc23d79f640 1 -- start start 2023-07-09T02:23:20.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc23d79f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc23815c060 0x7fc2380b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc23d79f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380cd120 0x7fc2380d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc23d79f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc238160a50 con 0x7fc2380d2450 2023-07-09T02:23:20.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc23d79f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2380d28f0 con 0x7fc23815c060 2023-07-09T02:23:20.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc23d79f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380cfe40 con 0x7fc2380cd120 2023-07-09T02:23:20.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc2377fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc2380d2450 0x7fc2380d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42942/0 (socket says 172.21.15.45:42942) 2023-07-09T02:23:20.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc2377fe640 1 -- 172.21.15.45:0/54159607 learned_addr learned my addr 172.21.15.45:0/54159607 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc22ffff640 1 --2- 172.21.15.45:0/54159607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380cd120 0x7fc2380d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc236ffd640 1 --2- 172.21.15.45:0/54159607 >> v2:172.21.15.155:3300/0 conn(0x7fc23815c060 0x7fc2380b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc2367fc640 1 -- 172.21.15.45:0/54159607 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771871175 0 0) 0x7fc238160a50 con 0x7fc2380d2450 2023-07-09T02:23:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc2367fc640 1 -- 172.21.15.45:0/54159607 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc224003530 con 0x7fc2380d2450 2023-07-09T02:23:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc2367fc640 1 -- 172.21.15.45:0/54159607 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3346905598 0 0) 0x7fc224003530 con 0x7fc2380d2450 2023-07-09T02:23:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc22ffff640 1 -- 172.21.15.45:0/54159607 >> v2:172.21.15.155:3300/0 conn(0x7fc23815c060 msgr2=0x7fc2380b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc22ffff640 1 --2- 172.21.15.45:0/54159607 >> v2:172.21.15.155:3300/0 conn(0x7fc23815c060 0x7fc2380b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc22ffff640 1 -- 172.21.15.45:0/54159607 >> v1:172.21.15.45:6789/0 conn(0x7fc2380d2450 legacy=0x7fc2380d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.787+0000 7fc22ffff640 1 -- 172.21.15.45:0/54159607 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23815c430 con 0x7fc2380cd120 2023-07-09T02:23:20.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc22ffff640 1 --2- 172.21.15.45:0/54159607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380cd120 0x7fc2380d1f10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097c0 tx=0x7fc22001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ce7f622ee19790 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc2367fc640 1 -- 172.21.15.45:0/54159607 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230001a00 con 0x7fc2380cd120 2023-07-09T02:23:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc2367fc640 1 -- 172.21.15.45:0/54159607 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2200a7050 con 0x7fc2380cd120 2023-07-09T02:23:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc2367fc640 1 -- 172.21.15.45:0/54159607 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200ab620 con 0x7fc2380cd120 2023-07-09T02:23:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 -- 172.21.15.45:0/54159607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380cd120 msgr2=0x7fc2380d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 --2- 172.21.15.45:0/54159607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380cd120 0x7fc2380d1f10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2200097c0 tx=0x7fc22001c370 comp rx=0 tx=0).stop 2023-07-09T02:23:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 -- 172.21.15.45:0/54159607 shutdown_connections 2023-07-09T02:23:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 --2- 172.21.15.45:0/54159607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380cd120 0x7fc2380d1f10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 --2- 172.21.15.45:0/54159607 >> v2:172.21.15.155:3300/0 conn(0x7fc23815c060 0x7fc2380b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 -- 172.21.15.45:0/54159607 >> 172.21.15.45:0/54159607 conn(0x7fc2380698e0 msgr2=0x7fc238069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 -- 172.21.15.45:0/54159607 shutdown_connections 2023-07-09T02:23:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 -- 172.21.15.45:0/54159607 wait complete. 2023-07-09T02:23:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 Processor -- start 2023-07-09T02:23:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.791+0000 7fc23d79f640 1 -- start start 2023-07-09T02:23:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2380cd120 0x7fc2380cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380d2450 0x7fc2380b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23815c060 0x7fc238151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238152550 con 0x7fc23815c060 2023-07-09T02:23:20.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238152830 con 0x7fc2380cd120 2023-07-09T02:23:20.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc238152b10 con 0x7fc2380d2450 2023-07-09T02:23:20.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23815c060 0x7fc238151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23815c060 0x7fc238151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39106/0 (socket says 172.21.15.45:39106) 2023-07-09T02:23:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 -- 172.21.15.45:0/1163047207 learned_addr learned my addr 172.21.15.45:0/1163047207 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc22ffff640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380d2450 0x7fc2380b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc236ffd640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2380cd120 0x7fc2380cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 -- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380d2450 msgr2=0x7fc2380b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380d2450 0x7fc2380b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 -- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2380cd120 msgr2=0x7fc2380cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2380cd120 0x7fc2380cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 -- 172.21.15.45:0/1163047207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc220009420 con 0x7fc23815c060 2023-07-09T02:23:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc2377fe640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23815c060 0x7fc238151880 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fc2300018a0 tx=0x7fc23000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc22f7fe640 1 -- 172.21.15.45:0/1163047207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230012400 con 0x7fc23815c060 2023-07-09T02:23:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc22f7fe640 1 -- 172.21.15.45:0/1163047207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230012560 con 0x7fc23815c060 2023-07-09T02:23:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc22f7fe640 1 -- 172.21.15.45:0/1163047207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230012910 con 0x7fc23815c060 2023-07-09T02:23:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc238152df0 con 0x7fc23815c060 2023-07-09T02:23:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2381535f0 con 0x7fc23815c060 2023-07-09T02:23:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23804d7d0 con 0x7fc23815c060 2023-07-09T02:23:20.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.795+0000 7fc22f7fe640 1 -- 172.21.15.45:0/1163047207 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc230012a70 con 0x7fc23815c060 2023-07-09T02:23:20.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.799+0000 7fc22f7fe640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc218066280 0x7fc218068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:20.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.799+0000 7fc22f7fe640 1 -- 172.21.15.45:0/1163047207 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2300844d0 con 0x7fc23815c060 2023-07-09T02:23:20.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.799+0000 7fc236ffd640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc218066280 0x7fc218068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:20.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.799+0000 7fc236ffd640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc218066280 0x7fc218068730 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc228009ac0 tx=0x7fc228009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:20.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.803+0000 7fc22f7fe640 1 -- 172.21.15.45:0/1163047207 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc230051960 con 0x7fc23815c060 2023-07-09T02:23:20.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.987+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2381532a0 con 0x7fc23815c060 2023-07-09T02:23:20.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.987+0000 7fc22f7fe640 1 -- 172.21.15.45:0/1163047207 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7fc230054f80 con 0x7fc23815c060 2023-07-09T02:23:20.990 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:20.990 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:23:20.990 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:23:20.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc218066280 msgr2=0x7fc218068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc218066280 0x7fc218068730 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc228009ac0 tx=0x7fc228009190 comp rx=0 tx=0).stop 2023-07-09T02:23:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23815c060 msgr2=0x7fc238151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23815c060 0x7fc238151880 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fc2300018a0 tx=0x7fc23000a430 comp rx=0 tx=0).stop 2023-07-09T02:23:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 shutdown_connections 2023-07-09T02:23:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc23815c060 0x7fc238151880 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc218066280 0x7fc218068730 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2380d2450 0x7fc2380b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 --2- 172.21.15.45:0/1163047207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2380cd120 0x7fc2380cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 >> 172.21.15.45:0/1163047207 conn(0x7fc2380698e0 msgr2=0x7fc2380b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 shutdown_connections 2023-07-09T02:23:20.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:20.991+0000 7fc23d79f640 1 -- 172.21.15.45:0/1163047207 wait complete. 2023-07-09T02:23:21.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:23:21.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0fd1e640 1 Processor -- start 2023-07-09T02:23:21.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0fd1e640 1 -- start start 2023-07-09T02:23:21.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0fd1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c080ca0f0 0x7f5c080cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0fd1e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5c0815db00 0x7f5c0815df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0fd1e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0806bf30 con 0x7f5c080cbbb0 2023-07-09T02:23:21.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0fd1e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0815e480 con 0x7f5c080ca0f0 2023-07-09T02:23:21.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0fd1e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0806bc50 con 0x7f5c0815db00 2023-07-09T02:23:21.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0daba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c080ca0f0 0x7f5c080cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0daba640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c080ca0f0 0x7f5c080cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39112/0 (socket says 172.21.15.45:39112) 2023-07-09T02:23:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0daba640 1 -- 172.21.15.45:0/1332928730 learned_addr learned my addr 172.21.15.45:0/1332928730 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.151+0000 7f5c0e2bb640 1 --2- 172.21.15.45:0/1332928730 >> v2:172.21.15.155:3300/0 conn(0x7f5c0815db00 0x7f5c0815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0daba640 1 -- 172.21.15.45:0/1332928730 >> v2:172.21.15.155:3300/0 conn(0x7f5c0815db00 msgr2=0x7f5c0815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0daba640 1 --2- 172.21.15.45:0/1332928730 >> v2:172.21.15.155:3300/0 conn(0x7f5c0815db00 0x7f5c0815df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0daba640 1 -- 172.21.15.45:0/1332928730 >> v1:172.21.15.155:6789/0 conn(0x7f5c080cbbb0 legacy=0x7f5c080c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0daba640 1 -- 172.21.15.45:0/1332928730 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c080cab90 con 0x7f5c080ca0f0 2023-07-09T02:23:21.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0daba640 1 --2- 172.21.15.45:0/1332928730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c080ca0f0 0x7f5c080cb670 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5c0806eec0 tx=0x7f5c0401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0bc7f52ebc643 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0cab8640 1 -- 172.21.15.45:0/1332928730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040ad680 con 0x7f5c080ca0f0 2023-07-09T02:23:21.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0cab8640 1 -- 172.21.15.45:0/1332928730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c040ad7e0 con 0x7f5c080ca0f0 2023-07-09T02:23:21.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0cab8640 1 -- 172.21.15.45:0/1332928730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040adb70 con 0x7f5c080ca0f0 2023-07-09T02:23:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1332928730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c080ca0f0 msgr2=0x7f5c080cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1332928730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c080ca0f0 0x7f5c080cb670 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5c0806eec0 tx=0x7f5c0401c470 comp rx=0 tx=0).stop 2023-07-09T02:23:21.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1332928730 shutdown_connections 2023-07-09T02:23:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1332928730 >> v2:172.21.15.155:3300/0 conn(0x7f5c0815db00 0x7f5c0815df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1332928730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c080ca0f0 0x7f5c080cb670 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.155+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1332928730 >> 172.21.15.45:0/1332928730 conn(0x7f5c080694b0 msgr2=0x7f5c080698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1332928730 shutdown_connections 2023-07-09T02:23:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1332928730 wait complete. 2023-07-09T02:23:21.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 Processor -- start 2023-07-09T02:23:21.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 -- start start 2023-07-09T02:23:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c080ca0f0 0x7f5c0814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c080cbbb0 0x7f5c080c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c0815db00 0x7f5c080cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0815ccf0 con 0x7f5c0815db00 2023-07-09T02:23:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080cddf0 con 0x7f5c080cbbb0 2023-07-09T02:23:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c080ce0b0 con 0x7f5c080ca0f0 2023-07-09T02:23:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c0815db00 0x7f5c080cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c0815db00 0x7f5c080cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39126/0 (socket says 172.21.15.45:39126) 2023-07-09T02:23:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 -- 172.21.15.45:0/1483202287 learned_addr learned my addr 172.21.15.45:0/1483202287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0daba640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c080ca0f0 0x7f5c0814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0d2b9640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c080cbbb0 0x7f5c080c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 -- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c080ca0f0 msgr2=0x7f5c0814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c080ca0f0 0x7f5c0814edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 -- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c080cbbb0 msgr2=0x7f5c080c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c080cbbb0 0x7f5c080c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 -- 172.21.15.45:0/1483202287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c040094d0 con 0x7f5c0815db00 2023-07-09T02:23:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0e2bb640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c0815db00 0x7f5c080cc290 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000efc0 tx=0x7f5c0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5bfe7fc640 1 -- 172.21.15.45:0/1483202287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00009ba0 con 0x7f5c0815db00 2023-07-09T02:23:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5bfe7fc640 1 -- 172.21.15.45:0/1483202287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0000f040 con 0x7f5c0815db00 2023-07-09T02:23:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.159+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0815cf20 con 0x7f5c0815db00 2023-07-09T02:23:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.163+0000 7f5bfe7fc640 1 -- 172.21.15.45:0/1483202287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c000146c0 con 0x7f5c0815db00 2023-07-09T02:23:21.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.163+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c080c46d0 con 0x7f5c0815db00 2023-07-09T02:23:21.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.163+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0804d7d0 con 0x7f5c0815db00 2023-07-09T02:23:21.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.163+0000 7f5bfe7fc640 1 -- 172.21.15.45:0/1483202287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c00014820 con 0x7f5c0815db00 2023-07-09T02:23:21.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.163+0000 7f5bfe7fc640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5bec066280 0x7f5bec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.163+0000 7f5bfe7fc640 1 -- 172.21.15.45:0/1483202287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c00084750 con 0x7f5c0815db00 2023-07-09T02:23:21.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.163+0000 7f5c0daba640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5bec066280 0x7f5bec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.167+0000 7f5c0daba640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5bec066280 0x7f5bec068730 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5c040af000 tx=0x7f5c040a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.167+0000 7f5bfe7fc640 1 -- 172.21.15.45:0/1483202287 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c00051be0 con 0x7f5c0815db00 2023-07-09T02:23:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.323+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c080c4950 con 0x7f5c0815db00 2023-07-09T02:23:21.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5bfe7fc640 1 -- 172.21.15.45:0/1483202287 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f5c00055200 con 0x7f5c0815db00 2023-07-09T02:23:21.328 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:21.329 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":185,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:23:09.480700+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:22:37.645121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T02:22:38.115103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:23:21.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5bec066280 msgr2=0x7f5bec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5bec066280 0x7f5bec068730 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5c040af000 tx=0x7f5c040a7000 comp rx=0 tx=0).stop 2023-07-09T02:23:21.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c0815db00 msgr2=0x7f5c080cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c0815db00 0x7f5c080cc290 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000efc0 tx=0x7f5c0000c490 comp rx=0 tx=0).stop 2023-07-09T02:23:21.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 shutdown_connections 2023-07-09T02:23:21.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c0815db00 0x7f5c080cc290 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c080cbbb0 0x7f5c080c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5bec066280 0x7f5bec068730 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 --2- 172.21.15.45:0/1483202287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c080ca0f0 0x7f5c0814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 >> 172.21.15.45:0/1483202287 conn(0x7f5c080694b0 msgr2=0x7f5c08069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:21.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 shutdown_connections 2023-07-09T02:23:21.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.327+0000 7f5c0fd1e640 1 -- 172.21.15.45:0/1483202287 wait complete. 2023-07-09T02:23:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T02:11:06.582752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T02:11:10.951834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T02:22:37.645121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '181', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T02:22:38.115103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T02:23:21.351 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T02:23:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.495+0000 7f8b58e19640 1 Processor -- start 2023-07-09T02:23:21.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.495+0000 7f8b58e19640 1 -- start start 2023-07-09T02:23:21.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.495+0000 7f8b58e19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b540cd120 0x7f8b540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.495+0000 7f8b58e19640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b54160a50 con 0x7f8b5415c060 2023-07-09T02:23:21.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.495+0000 7f8b58e19640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5415c430 con 0x7f8b540d2620 2023-07-09T02:23:21.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.495+0000 7f8b58e19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5415fb60 con 0x7f8b540cd120 2023-07-09T02:23:21.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b5259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8b5415c060 0x7f8b540d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42954/0 (socket says 172.21.15.45:42954) 2023-07-09T02:23:21.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b5259c640 1 -- 172.21.15.45:0/2487126313 learned_addr learned my addr 172.21.15.45:0/2487126313 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:21.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b52d9d640 1 --2- 172.21.15.45:0/2487126313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b540cd120 0x7f8b540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b5159a640 1 -- 172.21.15.45:0/2487126313 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013355832 0 0) 0x7f8b54160a50 con 0x7f8b5415c060 2023-07-09T02:23:21.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b5159a640 1 -- 172.21.15.45:0/2487126313 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b3c003530 con 0x7f8b5415c060 2023-07-09T02:23:21.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b52d9d640 1 -- 172.21.15.45:0/2487126313 >> v1:172.21.15.155:6789/0 conn(0x7f8b540d2620 legacy=0x7f8b540cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b5159a640 1 -- 172.21.15.45:0/2487126313 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791830491 0 0) 0x7f8b5415c430 con 0x7f8b540d2620 2023-07-09T02:23:21.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b52d9d640 1 -- 172.21.15.45:0/2487126313 >> v1:172.21.15.45:6789/0 conn(0x7f8b5415c060 legacy=0x7f8b540d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b52d9d640 1 -- 172.21.15.45:0/2487126313 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5415fe40 con 0x7f8b540cd120 2023-07-09T02:23:21.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.499+0000 7f8b52d9d640 1 --2- 172.21.15.45:0/2487126313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b540cd120 0x7f8b540b4ed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009dc0 tx=0x7f8b4c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6307d85ba3fd0ac6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b5159a640 1 -- 172.21.15.45:0/2487126313 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c0a5a00 con 0x7f8b540cd120 2023-07-09T02:23:21.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b5159a640 1 -- 172.21.15.45:0/2487126313 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c0a5b60 con 0x7f8b540cd120 2023-07-09T02:23:21.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b5159a640 1 -- 172.21.15.45:0/2487126313 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c0ad440 con 0x7f8b540cd120 2023-07-09T02:23:21.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- 172.21.15.45:0/2487126313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b540cd120 msgr2=0x7f8b540b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 --2- 172.21.15.45:0/2487126313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b540cd120 0x7f8b540b4ed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009dc0 tx=0x7f8b4c01c940 comp rx=0 tx=0).stop 2023-07-09T02:23:21.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- 172.21.15.45:0/2487126313 shutdown_connections 2023-07-09T02:23:21.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 --2- 172.21.15.45:0/2487126313 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b540cd120 0x7f8b540b4ed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- 172.21.15.45:0/2487126313 >> 172.21.15.45:0/2487126313 conn(0x7f8b540698e0 msgr2=0x7f8b54069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:21.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- 172.21.15.45:0/2487126313 shutdown_connections 2023-07-09T02:23:21.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- 172.21.15.45:0/2487126313 wait complete. 2023-07-09T02:23:21.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 Processor -- start 2023-07-09T02:23:21.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- start start 2023-07-09T02:23:21.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b540cd120 0x7f8b5414bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b540d2620 0x7f8b54157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b5415c060 0x7f8b5415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5415b920 con 0x7f8b540d2620 2023-07-09T02:23:21.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5415e3b0 con 0x7f8b540cd120 2023-07-09T02:23:21.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.503+0000 7f8b58e19640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5415b360 con 0x7f8b5415c060 2023-07-09T02:23:21.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b540d2620 0x7f8b54157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b540d2620 0x7f8b54157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39142/0 (socket says 172.21.15.45:39142) 2023-07-09T02:23:21.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 -- 172.21.15.45:0/1589202807 learned_addr learned my addr 172.21.15.45:0/1589202807 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:21.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b5259c640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b540cd120 0x7f8b5414bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b52d9d640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b5415c060 0x7f8b5415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 -- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b5415c060 msgr2=0x7f8b5415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b5415c060 0x7f8b5415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 -- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b540cd120 msgr2=0x7f8b5414bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b540cd120 0x7f8b5414bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 -- 172.21.15.45:0/1589202807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c009a70 con 0x7f8b540d2620 2023-07-09T02:23:21.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b5259c640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b540cd120 0x7f8b5414bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:21.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b51d9b640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b540d2620 0x7f8b54157cf0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c520 tx=0x7f8b4800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b42ffd640 1 -- 172.21.15.45:0/1589202807 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48003600 con 0x7f8b540d2620 2023-07-09T02:23:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b42ffd640 1 -- 172.21.15.45:0/1589202807 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48003780 con 0x7f8b540d2620 2023-07-09T02:23:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b42ffd640 1 -- 172.21.15.45:0/1589202807 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48003b30 con 0x7f8b540d2620 2023-07-09T02:23:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b540b59f0 con 0x7f8b540d2620 2023-07-09T02:23:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5415e650 con 0x7f8b540d2620 2023-07-09T02:23:21.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5404d7d0 con 0x7f8b540d2620 2023-07-09T02:23:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.507+0000 7f8b42ffd640 1 -- 172.21.15.45:0/1589202807 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b48003c90 con 0x7f8b540d2620 2023-07-09T02:23:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.511+0000 7f8b42ffd640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8b34066280 0x7f8b34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.511+0000 7f8b42ffd640 1 -- 172.21.15.45:0/1589202807 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b480832c0 con 0x7f8b540d2620 2023-07-09T02:23:21.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.511+0000 7f8b5259c640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8b34066280 0x7f8b34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.511+0000 7f8b5259c640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8b34066280 0x7f8b34068730 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005890 tx=0x7f8b44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.515+0000 7f8b42ffd640 1 -- 172.21.15.45:0/1589202807 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b480507e0 con 0x7f8b540d2620 2023-07-09T02:23:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b540b89c0 con 0x7f8b540d2620 2023-07-09T02:23:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b42ffd640 1 -- 172.21.15.45:0/1589202807 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v185) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b48017020 con 0x7f8b540d2620 2023-07-09T02:23:21.673 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-07-09T02:23:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8b34066280 msgr2=0x7f8b34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8b34066280 0x7f8b34068730 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8b44005890 tx=0x7f8b44009040 comp rx=0 tx=0).stop 2023-07-09T02:23:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b540d2620 msgr2=0x7f8b54157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b540d2620 0x7f8b54157cf0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c520 tx=0x7f8b4800c9e0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 shutdown_connections 2023-07-09T02:23:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8b34066280 0x7f8b34068730 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b5415c060 0x7f8b5415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b540d2620 0x7f8b54157cf0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 --2- 172.21.15.45:0/1589202807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b540cd120 0x7f8b5414bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 >> 172.21.15.45:0/1589202807 conn(0x7f8b540698e0 msgr2=0x7f8b540b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:21.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 shutdown_connections 2023-07-09T02:23:21.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.671+0000 7f8b58e19640 1 -- 172.21.15.45:0/1589202807 wait complete. 2023-07-09T02:23:21.694 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T02:23:21.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8aa9fa640 1 Processor -- start 2023-07-09T02:23:21.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8aa9fa640 1 -- start start 2023-07-09T02:23:21.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8aa9fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 0x7fe8a406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8aa9fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe8a406fd10 0x7fe8a406c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8aa9fa640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40ccf80 con 0x7fe8a406c650 2023-07-09T02:23:21.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8aa9fa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a406cad0 con 0x7fe8a406fd10 2023-07-09T02:23:21.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8aa9fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40cd540 con 0x7fe8a4158e30 2023-07-09T02:23:21.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a8f97640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe8a406c650 0x7fe8a40caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49534/0 (socket says 172.21.15.45:49534) 2023-07-09T02:23:21.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a8f97640 1 -- 172.21.15.45:0/214154046 learned_addr learned my addr 172.21.15.45:0/214154046 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a37fe640 1 --2- 172.21.15.45:0/214154046 >> v2:172.21.15.155:3300/0 conn(0x7fe8a406fd10 0x7fe8a406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a3fff640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 0x7fe8a406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024504156 0 0) 0x7fe8a40ccf80 con 0x7fe8a406c650 2023-07-09T02:23:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe88c005740 con 0x7fe8a406c650 2023-07-09T02:23:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3125178344 0 0) 0x7fe88c005740 con 0x7fe8a406c650 2023-07-09T02:23:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 msgr2=0x7fe8a406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 0x7fe8a406f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 >> v2:172.21.15.155:3300/0 conn(0x7fe8a406fd10 msgr2=0x7fe8a406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 --2- 172.21.15.45:0/214154046 >> v2:172.21.15.155:3300/0 conn(0x7fe8a406fd10 0x7fe8a406c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40c8fb0 con 0x7fe8a406c650 2023-07-09T02:23:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fe89c001a00 con 0x7fe8a406c650 2023-07-09T02:23:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 >> v1:172.21.15.45:6789/0 conn(0x7fe8a406c650 legacy=0x7fe8a40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe88c005b90 0x7fe88c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 0x7fe88c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c006f20 0x7fe88c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a406cad0 con 0x7fe88c005b90 2023-07-09T02:23:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40cd540 con 0x7fe88c006f20 2023-07-09T02:23:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c00dba0 con 0x7fe8a4158e30 2023-07-09T02:23:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.839+0000 7fe8a3fff640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe88c005b90 0x7fe88c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a37fe640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 0x7fe88c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a8f97640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c006f20 0x7fe88c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a3fff640 1 -- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 msgr2=0x7fe88c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a3fff640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 0x7fe88c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a3fff640 1 -- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c006f20 msgr2=0x7fe88c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a3fff640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c006f20 0x7fe88c007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a3fff640 1 -- 172.21.15.45:0/214154046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c005740 con 0x7fe88c005b90 2023-07-09T02:23:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a37fe640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a4158e30 0x7fe88c0069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:23:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a3fff640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe88c005b90 0x7fe88c005fa0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe894009ae0 tx=0x7fe89401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8897cf86ab162808 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940a55f0 con 0x7fe88c005b90 2023-07-09T02:23:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8940a5750 con 0x7fe88c005b90 2023-07-09T02:23:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.843+0000 7fe8a2ffd640 1 -- 172.21.15.45:0/214154046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940a5b00 con 0x7fe88c005b90 2023-07-09T02:23:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/214154046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe88c005b90 msgr2=0x7fe88c005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 --2- 172.21.15.45:0/214154046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe88c005b90 0x7fe88c005fa0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe894009ae0 tx=0x7fe89401ca20 comp rx=0 tx=0).stop 2023-07-09T02:23:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8a8f97640 1 -- 172.21.15.45:0/214154046 reap_dead start 2023-07-09T02:23:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/214154046 shutdown_connections 2023-07-09T02:23:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/214154046 >> 172.21.15.45:0/214154046 conn(0x7fe8a40694b0 msgr2=0x7fe8a40698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/214154046 shutdown_connections 2023-07-09T02:23:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/214154046 wait complete. 2023-07-09T02:23:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 Processor -- start 2023-07-09T02:23:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- start start 2023-07-09T02:23:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c005b90 0x7fe8a40b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a414e210 0x7fe8a4140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a415ba70 0x7fe8a415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a415a780 con 0x7fe8a415ba70 2023-07-09T02:23:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a415a9d0 con 0x7fe88c005b90 2023-07-09T02:23:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8aa9fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a415acb0 con 0x7fe8a414e210 2023-07-09T02:23:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8a8f97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a415ba70 0x7fe8a415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8a8f97640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a415ba70 0x7fe8a415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49784/0 (socket says 172.21.15.45:49784) 2023-07-09T02:23:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8a8f97640 1 -- 172.21.15.45:0/320347345 learned_addr learned my addr 172.21.15.45:0/320347345 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8a3fff640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c005b90 0x7fe8a40b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8a37fe640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a414e210 0x7fe8a4140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8a8f97640 1 -- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a414e210 msgr2=0x7fe8a4140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.847+0000 7fe8a8f97640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a414e210 0x7fe8a4140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a8f97640 1 -- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c005b90 msgr2=0x7fe8a40b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a8f97640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c005b90 0x7fe8a40b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a8f97640 1 -- 172.21.15.45:0/320347345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a415af90 con 0x7fe8a415ba70 2023-07-09T02:23:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a8f97640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a415ba70 0x7fe8a415bee0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe8a406d440 tx=0x7fe89c007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a0ff9640 1 -- 172.21.15.45:0/320347345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0133f0 con 0x7fe8a415ba70 2023-07-09T02:23:21.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a0ff9640 1 -- 172.21.15.45:0/320347345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c013590 con 0x7fe8a415ba70 2023-07-09T02:23:21.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a0ff9640 1 -- 172.21.15.45:0/320347345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c013940 con 0x7fe8a415ba70 2023-07-09T02:23:21.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a415b270 con 0x7fe8a415ba70 2023-07-09T02:23:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a41414a0 con 0x7fe8a415ba70 2023-07-09T02:23:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a40c5320 con 0x7fe8a415ba70 2023-07-09T02:23:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a0ff9640 1 -- 172.21.15.45:0/320347345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe89c013aa0 con 0x7fe8a415ba70 2023-07-09T02:23:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a0ff9640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe890066280 0x7fe890068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a0ff9640 1 -- 172.21.15.45:0/320347345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe89c0839b0 con 0x7fe8a415ba70 2023-07-09T02:23:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.851+0000 7fe8a3fff640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe890066280 0x7fe890068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.855+0000 7fe8a3fff640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe890066280 0x7fe890068730 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe8940af000 tx=0x7fe8940046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:21.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:21.855+0000 7fe8a0ff9640 1 -- 172.21.15.45:0/320347345 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe89c054790 con 0x7fe8a415ba70 2023-07-09T02:23:22.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.015+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8a404d7d0 con 0x7fe8a415ba70 2023-07-09T02:23:22.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.015+0000 7fe8a0ff9640 1 -- 172.21.15.45:0/320347345 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v185) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe89c054320 con 0x7fe8a415ba70 2023-07-09T02:23:22.018 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-07-09T02:23:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe890066280 msgr2=0x7fe890068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe890066280 0x7fe890068730 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe8940af000 tx=0x7fe8940046d0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a415ba70 msgr2=0x7fe8a415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a415ba70 0x7fe8a415bee0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe8a406d440 tx=0x7fe89c007600 comp rx=0 tx=0).stop 2023-07-09T02:23:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 shutdown_connections 2023-07-09T02:23:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a415ba70 0x7fe8a415bee0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fe890066280 0x7fe890068730 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8a414e210 0x7fe8a4140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 --2- 172.21.15.45:0/320347345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe88c005b90 0x7fe8a40b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 >> 172.21.15.45:0/320347345 conn(0x7fe8a40694b0 msgr2=0x7fe8a415ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 shutdown_connections 2023-07-09T02:23:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.019+0000 7fe8aa9fa640 1 -- 172.21.15.45:0/320347345 wait complete. 2023-07-09T02:23:22.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T02:23:22.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53dcfdb640 1 Processor -- start 2023-07-09T02:23:22.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53dcfdb640 1 -- start start 2023-07-09T02:23:22.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53dcfdb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53d815c060 0x7f53d80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53dcfdb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 0x7f53d80d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53dcfdb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d8160a50 con 0x7f53d80d2450 2023-07-09T02:23:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53dcfdb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80d28f0 con 0x7f53d815c060 2023-07-09T02:23:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53dcfdb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80cfe40 con 0x7f53d80cd120 2023-07-09T02:23:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53d659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53d815c060 0x7f53d80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53d659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53d815c060 0x7f53d80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49794/0 (socket says 172.21.15.45:49794) 2023-07-09T02:23:22.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53d659c640 1 -- 172.21.15.45:0/2721186712 learned_addr learned my addr 172.21.15.45:0/2721186712 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:22.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53cffff640 1 --2- 172.21.15.45:0/2721186712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 0x7f53d80d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53d659c640 1 -- 172.21.15.45:0/2721186712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 msgr2=0x7f53d80d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:22.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53d659c640 1 --2- 172.21.15.45:0/2721186712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 0x7f53d80d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53d659c640 1 -- 172.21.15.45:0/2721186712 >> v1:172.21.15.45:6789/0 conn(0x7f53d80d2450 legacy=0x7f53d80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.183+0000 7f53d659c640 1 -- 172.21.15.45:0/2721186712 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d815c430 con 0x7f53d815c060 2023-07-09T02:23:22.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53d659c640 1 --2- 172.21.15.45:0/2721186712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d815c060 0x7f53d80b4ed0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009870 tx=0x7f53c801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ad924ae00c1760 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53d5d9b640 1 -- 172.21.15.45:0/2721186712 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80a7070 con 0x7f53d815c060 2023-07-09T02:23:22.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53d5d9b640 1 -- 172.21.15.45:0/2721186712 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c80ab430 con 0x7f53d815c060 2023-07-09T02:23:22.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53d5d9b640 1 -- 172.21.15.45:0/2721186712 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80ab7c0 con 0x7f53d815c060 2023-07-09T02:23:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2721186712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d815c060 msgr2=0x7f53d80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2721186712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d815c060 0x7f53d80b4ed0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009870 tx=0x7f53c801c510 comp rx=0 tx=0).stop 2023-07-09T02:23:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2721186712 shutdown_connections 2023-07-09T02:23:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2721186712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 0x7f53d80d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2721186712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d815c060 0x7f53d80b4ed0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2721186712 >> 172.21.15.45:0/2721186712 conn(0x7f53d80698e0 msgr2=0x7f53d8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:22.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2721186712 shutdown_connections 2023-07-09T02:23:22.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.187+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2721186712 wait complete. 2023-07-09T02:23:22.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 Processor -- start 2023-07-09T02:23:22.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 -- start start 2023-07-09T02:23:22.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 0x7f53d8158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80d2450 0x7f53d80cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53d815c060 0x7f53d8153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d81594e0 con 0x7f53d80d2450 2023-07-09T02:23:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d81597c0 con 0x7f53d815c060 2023-07-09T02:23:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8159aa0 con 0x7f53d80cd120 2023-07-09T02:23:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80d2450 0x7f53d80cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80d2450 0x7f53d80cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49800/0 (socket says 172.21.15.45:49800) 2023-07-09T02:23:22.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 -- 172.21.15.45:0/2081791435 learned_addr learned my addr 172.21.15.45:0/2081791435 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:22.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53d659c640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 0x7f53d8158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53d6d9d640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53d815c060 0x7f53d8153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 -- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 msgr2=0x7f53d8158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 0x7f53d8158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 -- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53d815c060 msgr2=0x7f53d8153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53d815c060 0x7f53d8153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 -- 172.21.15.45:0/2081791435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80094d0 con 0x7f53d80d2450 2023-07-09T02:23:22.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53cffff640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80d2450 0x7f53d80cbeb0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f53c000d5d0 tx=0x7f53c000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53ceffd640 1 -- 172.21.15.45:0/2081791435 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0004240 con 0x7f53d80d2450 2023-07-09T02:23:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53ceffd640 1 -- 172.21.15.45:0/2081791435 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c00043a0 con 0x7f53d80d2450 2023-07-09T02:23:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d8159d80 con 0x7f53d80d2450 2023-07-09T02:23:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53ceffd640 1 -- 172.21.15.45:0/2081791435 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0003840 con 0x7f53d80d2450 2023-07-09T02:23:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.191+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d80cc3f0 con 0x7f53d80d2450 2023-07-09T02:23:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.195+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d815d520 con 0x7f53d80d2450 2023-07-09T02:23:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.195+0000 7f53ceffd640 1 -- 172.21.15.45:0/2081791435 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53c00039a0 con 0x7f53d80d2450 2023-07-09T02:23:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.195+0000 7f53ceffd640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53b80662b0 0x7f53b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.195+0000 7f53ceffd640 1 -- 172.21.15.45:0/2081791435 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53c0083e20 con 0x7f53d80d2450 2023-07-09T02:23:22.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.195+0000 7f53d659c640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53b80662b0 0x7f53b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.195+0000 7f53d659c640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53b80662b0 0x7f53b8068760 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f53c80af000 tx=0x7f53c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.199+0000 7f53ceffd640 1 -- 172.21.15.45:0/2081791435 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53c0051290 con 0x7f53d80d2450 2023-07-09T02:23:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.351+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53d804d7d0 con 0x7f53d80d2450 2023-07-09T02:23:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53ceffd640 1 -- 172.21.15.45:0/2081791435 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v185) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53c005a020 con 0x7f53d80d2450 2023-07-09T02:23:22.355 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-07-09T02:23:22.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53b80662b0 msgr2=0x7f53b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53b80662b0 0x7f53b8068760 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f53c80af000 tx=0x7f53c8008040 comp rx=0 tx=0).stop 2023-07-09T02:23:22.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80d2450 msgr2=0x7f53d80cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80d2450 0x7f53d80cbeb0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f53c000d5d0 tx=0x7f53c000da90 comp rx=0 tx=0).stop 2023-07-09T02:23:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 shutdown_connections 2023-07-09T02:23:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53d815c060 0x7f53d8153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53d80d2450 0x7f53d80cbeb0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f53b80662b0 0x7f53b8068760 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 --2- 172.21.15.45:0/2081791435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53d80cd120 0x7f53d8158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 >> 172.21.15.45:0/2081791435 conn(0x7f53d80698e0 msgr2=0x7f53d80b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 shutdown_connections 2023-07-09T02:23:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.355+0000 7f53dcfdb640 1 -- 172.21.15.45:0/2081791435 wait complete. 2023-07-09T02:23:22.376 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T02:23:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.519+0000 7f0643a6d640 1 Processor -- start 2023-07-09T02:23:22.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.519+0000 7f0643a6d640 1 -- start start 2023-07-09T02:23:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0643a6d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f063c15c060 0x7f063c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0643a6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c0d2620 0x7f063c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0643a6d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c160a50 con 0x7f063c0cd120 2023-07-09T02:23:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0643a6d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c15c430 con 0x7f063c15c060 2023-07-09T02:23:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0643a6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c15fb60 con 0x7f063c0d2620 2023-07-09T02:23:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0641809640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f063c15c060 0x7f063c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0641809640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f063c15c060 0x7f063c0b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49810/0 (socket says 172.21.15.45:49810) 2023-07-09T02:23:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0641809640 1 -- 172.21.15.45:0/175703072 learned_addr learned my addr 172.21.15.45:0/175703072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0641008640 1 --1- 172.21.15.45:0/175703072 >> v1:172.21.15.45:6789/0 conn(0x7f063c0cd120 0x7f063c0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49554/0 (socket says 172.21.15.45:49554) 2023-07-09T02:23:22.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f064200a640 1 --2- 172.21.15.45:0/175703072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c0d2620 0x7f063c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0641809640 1 -- 172.21.15.45:0/175703072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c0d2620 msgr2=0x7f063c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0641809640 1 --2- 172.21.15.45:0/175703072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c0d2620 0x7f063c0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0641809640 1 -- 172.21.15.45:0/175703072 >> v1:172.21.15.45:6789/0 conn(0x7f063c0cd120 legacy=0x7f063c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0641809640 1 -- 172.21.15.45:0/175703072 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c15fe40 con 0x7f063c15c060 2023-07-09T02:23:22.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.523+0000 7f0640807640 1 -- 172.21.15.45:0/175703072 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293658972 0 0) 0x7f063c160a50 con 0x7f063c0cd120 2023-07-09T02:23:22.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0641809640 1 --2- 172.21.15.45:0/175703072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c15c060 0x7f063c0b4ed0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f0638009870 tx=0x7f063801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c3f3483e22cfb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0640807640 1 -- 172.21.15.45:0/175703072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380aa670 con 0x7f063c15c060 2023-07-09T02:23:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0640807640 1 -- 172.21.15.45:0/175703072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380aa7d0 con 0x7f063c15c060 2023-07-09T02:23:22.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0640807640 1 -- 172.21.15.45:0/175703072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380aab60 con 0x7f063c15c060 2023-07-09T02:23:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 -- 172.21.15.45:0/175703072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c15c060 msgr2=0x7f063c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 --2- 172.21.15.45:0/175703072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c15c060 0x7f063c0b4ed0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f0638009870 tx=0x7f063801c510 comp rx=0 tx=0).stop 2023-07-09T02:23:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 -- 172.21.15.45:0/175703072 shutdown_connections 2023-07-09T02:23:22.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 --2- 172.21.15.45:0/175703072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c0d2620 0x7f063c0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 --2- 172.21.15.45:0/175703072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c15c060 0x7f063c0b4ed0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 -- 172.21.15.45:0/175703072 >> 172.21.15.45:0/175703072 conn(0x7f063c0698e0 msgr2=0x7f063c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 -- 172.21.15.45:0/175703072 shutdown_connections 2023-07-09T02:23:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 -- 172.21.15.45:0/175703072 wait complete. 2023-07-09T02:23:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 Processor -- start 2023-07-09T02:23:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.527+0000 7f0643a6d640 1 -- start start 2023-07-09T02:23:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c0cd120 0x7f063c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f063c0d2620 0x7f063c15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c15c060 0x7f063c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c1586f0 con 0x7f063c0cd120 2023-07-09T02:23:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c15e270 con 0x7f063c0d2620 2023-07-09T02:23:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c158e50 con 0x7f063c15c060 2023-07-09T02:23:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c0cd120 0x7f063c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c0cd120 0x7f063c1581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49814/0 (socket says 172.21.15.45:49814) 2023-07-09T02:23:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 -- 172.21.15.45:0/1756655539 learned_addr learned my addr 172.21.15.45:0/1756655539 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f064200a640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c15c060 0x7f063c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641008640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f063c0d2620 0x7f063c15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 -- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c15c060 msgr2=0x7f063c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c15c060 0x7f063c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 -- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f063c0d2620 msgr2=0x7f063c15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f063c0d2620 0x7f063c15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 -- 172.21.15.45:0/1756655539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380094d0 con 0x7f063c0cd120 2023-07-09T02:23:22.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0641809640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c0cd120 0x7f063c1581b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f06380ac040 tx=0x7f063801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f06327fc640 1 -- 172.21.15.45:0/1756655539 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380b3800 con 0x7f063c0cd120 2023-07-09T02:23:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f06327fc640 1 -- 172.21.15.45:0/1756655539 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380b3980 con 0x7f063c0cd120 2023-07-09T02:23:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f06327fc640 1 -- 172.21.15.45:0/1756655539 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380b3d30 con 0x7f063c0cd120 2023-07-09T02:23:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c0b59f0 con 0x7f063c0cd120 2023-07-09T02:23:22.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c159130 con 0x7f063c0cd120 2023-07-09T02:23:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c04d7d0 con 0x7f063c0cd120 2023-07-09T02:23:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.531+0000 7f06327fc640 1 -- 172.21.15.45:0/1756655539 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06380c73a0 con 0x7f063c0cd120 2023-07-09T02:23:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.535+0000 7f06327fc640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0620066280 0x7f0620068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.535+0000 7f06327fc640 1 -- 172.21.15.45:0/1756655539 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f063811e930 con 0x7f063c0cd120 2023-07-09T02:23:22.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.535+0000 7f0641008640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0620066280 0x7f0620068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.535+0000 7f0641008640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0620066280 0x7f0620068730 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f063c166ec0 tx=0x7f062c007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.539+0000 7f06327fc640 1 -- 172.21.15.45:0/1756655539 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06380ebe50 con 0x7f063c0cd120 2023-07-09T02:23:22.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.691+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f063c06baa0 con 0x7f063c0cd120 2023-07-09T02:23:22.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.691+0000 7f06327fc640 1 -- 172.21.15.45:0/1756655539 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v185) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06380c30a0 con 0x7f063c0cd120 2023-07-09T02:23:22.694 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-07-09T02:23:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0620066280 msgr2=0x7f0620068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0620066280 0x7f0620068730 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f063c166ec0 tx=0x7f062c007b60 comp rx=0 tx=0).stop 2023-07-09T02:23:22.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c0cd120 msgr2=0x7f063c1581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c0cd120 0x7f063c1581b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f06380ac040 tx=0x7f063801ad50 comp rx=0 tx=0).stop 2023-07-09T02:23:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 shutdown_connections 2023-07-09T02:23:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0620066280 0x7f0620068730 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f063c15c060 0x7f063c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f063c0d2620 0x7f063c15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 --2- 172.21.15.45:0/1756655539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f063c0cd120 0x7f063c1581b0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 >> 172.21.15.45:0/1756655539 conn(0x7f063c0698e0 msgr2=0x7f063c0b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 shutdown_connections 2023-07-09T02:23:22.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.695+0000 7f0643a6d640 1 -- 172.21.15.45:0/1756655539 wait complete. 2023-07-09T02:23:22.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:23:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.855+0000 7f8c0272c640 1 Processor -- start 2023-07-09T02:23:22.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.855+0000 7f8c0272c640 1 -- start start 2023-07-09T02:23:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c0272c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc15c060 0x7f8bfc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c0272c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bfc0d2620 0x7f8bfc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c0272c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc160a50 con 0x7f8bfc0cd120 2023-07-09T02:23:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c0272c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc15c430 con 0x7f8bfc0d2620 2023-07-09T02:23:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c0272c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc15fb60 con 0x7f8bfc15c060 2023-07-09T02:23:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c00cc9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bfc0d2620 0x7f8bfc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8bfb7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8bfc0cd120 0x7f8bfc0d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49570/0 (socket says 172.21.15.45:49570) 2023-07-09T02:23:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c00cc9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8bfc0d2620 0x7f8bfc0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49826/0 (socket says 172.21.15.45:49826) 2023-07-09T02:23:22.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8bfb7fe640 1 -- 172.21.15.45:0/3091481838 learned_addr learned my addr 172.21.15.45:0/3091481838 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:22.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8bfbfff640 1 --2- 172.21.15.45:0/3091481838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc15c060 0x7f8bfc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c00cc9640 1 -- 172.21.15.45:0/3091481838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc15c060 msgr2=0x7f8bfc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c00cc9640 1 --2- 172.21.15.45:0/3091481838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc15c060 0x7f8bfc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c00cc9640 1 -- 172.21.15.45:0/3091481838 >> v1:172.21.15.45:6789/0 conn(0x7f8bfc0cd120 legacy=0x7f8bfc0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8c00cc9640 1 -- 172.21.15.45:0/3091481838 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc15fe40 con 0x7f8bfc0d2620 2023-07-09T02:23:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.859+0000 7f8bfaffd640 1 -- 172.21.15.45:0/3091481838 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552590324 0 0) 0x7f8bfc160a50 con 0x7f8bfc0cd120 2023-07-09T02:23:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c00cc9640 1 --2- 172.21.15.45:0/3091481838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc0d2620 0x7f8bfc0cee30 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009dc0 tx=0x7f8bf401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399d28a29339a4de server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8bfaffd640 1 -- 172.21.15.45:0/3091481838 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40a59c0 con 0x7f8bfc0d2620 2023-07-09T02:23:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8bfaffd640 1 -- 172.21.15.45:0/3091481838 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf40a5b20 con 0x7f8bfc0d2620 2023-07-09T02:23:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8bfaffd640 1 -- 172.21.15.45:0/3091481838 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40ad440 con 0x7f8bfc0d2620 2023-07-09T02:23:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 -- 172.21.15.45:0/3091481838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc0d2620 msgr2=0x7f8bfc0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 --2- 172.21.15.45:0/3091481838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc0d2620 0x7f8bfc0cee30 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009dc0 tx=0x7f8bf401c900 comp rx=0 tx=0).stop 2023-07-09T02:23:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 -- 172.21.15.45:0/3091481838 shutdown_connections 2023-07-09T02:23:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 --2- 172.21.15.45:0/3091481838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc0d2620 0x7f8bfc0cee30 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 --2- 172.21.15.45:0/3091481838 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc15c060 0x7f8bfc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 -- 172.21.15.45:0/3091481838 >> 172.21.15.45:0/3091481838 conn(0x7f8bfc0698e0 msgr2=0x7f8bfc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 -- 172.21.15.45:0/3091481838 shutdown_connections 2023-07-09T02:23:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 -- 172.21.15.45:0/3091481838 wait complete. 2023-07-09T02:23:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 Processor -- start 2023-07-09T02:23:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.863+0000 7f8c0272c640 1 -- start start 2023-07-09T02:23:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc0cd120 0x7f8bfc14af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bfc0d2620 0x7f8bfc1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc15c060 0x7f8bfc159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc1593b0 con 0x7f8bfc15c060 2023-07-09T02:23:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc14b4b0 con 0x7f8bfc0d2620 2023-07-09T02:23:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc158d10 con 0x7f8bfc0cd120 2023-07-09T02:23:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc15c060 0x7f8bfc159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc15c060 0x7f8bfc159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49832/0 (socket says 172.21.15.45:49832) 2023-07-09T02:23:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 -- 172.21.15.45:0/1894969525 learned_addr learned my addr 172.21.15.45:0/1894969525 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8bfb7fe640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bfc0d2620 0x7f8bfc1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8bfbfff640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc0cd120 0x7f8bfc14af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 -- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc0cd120 msgr2=0x7f8bfc14af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc0cd120 0x7f8bfc14af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 -- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bfc0d2620 msgr2=0x7f8bfc1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bfc0d2620 0x7f8bfc1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 -- 172.21.15.45:0/1894969525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4009a70 con 0x7f8bfc15c060 2023-07-09T02:23:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c00cc9640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc15c060 0x7f8bfc159d10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f8bf401a530 tx=0x7f8bf40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8bf8ff9640 1 -- 172.21.15.45:0/1894969525 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40ade20 con 0x7f8bfc15c060 2023-07-09T02:23:22.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8bf8ff9640 1 -- 172.21.15.45:0/1894969525 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4009450 con 0x7f8bfc15c060 2023-07-09T02:23:22.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8bf8ff9640 1 -- 172.21.15.45:0/1894969525 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40b9690 con 0x7f8bfc15c060 2023-07-09T02:23:22.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc0b59f0 con 0x7f8bfc15c060 2023-07-09T02:23:22.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc15b240 con 0x7f8bfc15c060 2023-07-09T02:23:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc1594f0 con 0x7f8bfc15c060 2023-07-09T02:23:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.867+0000 7f8bf8ff9640 1 -- 172.21.15.45:0/1894969525 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8bf40b97f0 con 0x7f8bfc15c060 2023-07-09T02:23:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.871+0000 7f8bf8ff9640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8be8066280 0x7f8be8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.871+0000 7f8bf8ff9640 1 -- 172.21.15.45:0/1894969525 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bf411f6d0 con 0x7f8bfc15c060 2023-07-09T02:23:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.871+0000 7f8bfbfff640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8be8066280 0x7f8be8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.871+0000 7f8bfbfff640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8be8066280 0x7f8be8068730 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b930 tx=0x7f8bec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:22.875+0000 7f8bf8ff9640 1 -- 172.21.15.45:0/1894969525 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8bfc1594f0 con 0x7f8bfc15c060 2023-07-09T02:23:23.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bfc1594f0 con 0x7f8bfc15c060 2023-07-09T02:23:23.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8bf8ff9640 1 -- 172.21.15.45:0/1894969525 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f8bfc1594f0 con 0x7f8bfc15c060 2023-07-09T02:23:23.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:23.069 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:23:23.069 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:23:23.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8be8066280 msgr2=0x7f8be8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8be8066280 0x7f8be8068730 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b930 tx=0x7f8bec008040 comp rx=0 tx=0).stop 2023-07-09T02:23:23.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc15c060 msgr2=0x7f8bfc159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc15c060 0x7f8bfc159d10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f8bf401a530 tx=0x7f8bf40196a0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 shutdown_connections 2023-07-09T02:23:23.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bfc15c060 0x7f8bfc159d10 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bfc0d2620 0x7f8bfc1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f8be8066280 0x7f8be8068730 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 --2- 172.21.15.45:0/1894969525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bfc0cd120 0x7f8bfc14af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 >> 172.21.15.45:0/1894969525 conn(0x7f8bfc0698e0 msgr2=0x7f8bfc0b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:23.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 shutdown_connections 2023-07-09T02:23:23.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.067+0000 7f8c0272c640 1 -- 172.21.15.45:0/1894969525 wait complete. 2023-07-09T02:23:23.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:23:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36abffa640 1 Processor -- start 2023-07-09T02:23:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36abffa640 1 -- start start 2023-07-09T02:23:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36abffa640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36a4158f90 0x7f36a40cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36abffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a406c040 0x7f36a40cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36abffa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a406d5e0 con 0x7f36a40cd390 2023-07-09T02:23:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36abffa640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a406c540 con 0x7f36a4158f90 2023-07-09T02:23:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36abffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a406c820 con 0x7f36a406c040 2023-07-09T02:23:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36a9d96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36a4158f90 0x7f36a40cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36a9d96640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36a4158f90 0x7f36a40cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49846/0 (socket says 172.21.15.45:49846) 2023-07-09T02:23:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36a9d96640 1 -- 172.21.15.45:0/3931423111 learned_addr learned my addr 172.21.15.45:0/3931423111 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36a9595640 1 --2- 172.21.15.45:0/3931423111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a406c040 0x7f36a40cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36a9d96640 1 -- 172.21.15.45:0/3931423111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a406c040 msgr2=0x7f36a40cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36a9d96640 1 --2- 172.21.15.45:0/3931423111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a406c040 0x7f36a40cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36a9d96640 1 -- 172.21.15.45:0/3931423111 >> v1:172.21.15.155:6789/0 conn(0x7f36a40cd390 legacy=0x7f36a415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.231+0000 7f36a9d96640 1 -- 172.21.15.45:0/3931423111 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a406cb00 con 0x7f36a4158f90 2023-07-09T02:23:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36a9d96640 1 --2- 172.21.15.45:0/3931423111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a4158f90 0x7f36a40cf840 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009870 tx=0x7f36a001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a672f830f3d11f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36a8d94640 1 -- 172.21.15.45:0/3931423111 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00ac410 con 0x7f36a4158f90 2023-07-09T02:23:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36a8d94640 1 -- 172.21.15.45:0/3931423111 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a00ac570 con 0x7f36a4158f90 2023-07-09T02:23:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36a8d94640 1 -- 172.21.15.45:0/3931423111 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00ac900 con 0x7f36a4158f90 2023-07-09T02:23:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36abffa640 1 -- 172.21.15.45:0/3931423111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a4158f90 msgr2=0x7f36a40cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36abffa640 1 --2- 172.21.15.45:0/3931423111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a4158f90 0x7f36a40cf840 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009870 tx=0x7f36a001c4d0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36abffa640 1 -- 172.21.15.45:0/3931423111 shutdown_connections 2023-07-09T02:23:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36abffa640 1 --2- 172.21.15.45:0/3931423111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a406c040 0x7f36a40cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36abffa640 1 --2- 172.21.15.45:0/3931423111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a4158f90 0x7f36a40cf840 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36abffa640 1 -- 172.21.15.45:0/3931423111 >> 172.21.15.45:0/3931423111 conn(0x7f36a40650b0 msgr2=0x7f36a40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36abffa640 1 -- 172.21.15.45:0/3931423111 shutdown_connections 2023-07-09T02:23:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.235+0000 7f36abffa640 1 -- 172.21.15.45:0/3931423111 wait complete. 2023-07-09T02:23:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 Processor -- start 2023-07-09T02:23:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 -- start start 2023-07-09T02:23:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a406c040 0x7f36a41f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a40cd390 0x7f36a415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36a415b4d0 0x7f36a41f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a415b040 con 0x7f36a406c040 2023-07-09T02:23:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a415a710 con 0x7f36a415b4d0 2023-07-09T02:23:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a415a9f0 con 0x7f36a40cd390 2023-07-09T02:23:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a406c040 0x7f36a41f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a406c040 0x7f36a41f89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49858/0 (socket says 172.21.15.45:49858) 2023-07-09T02:23:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 -- 172.21.15.45:0/2540296255 learned_addr learned my addr 172.21.15.45:0/2540296255 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36aa597640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36a415b4d0 0x7f36a41f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9595640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a40cd390 0x7f36a415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 -- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a40cd390 msgr2=0x7f36a415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a40cd390 0x7f36a415bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 -- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36a415b4d0 msgr2=0x7f36a41f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36a415b4d0 0x7f36a41f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 -- 172.21.15.45:0/2540296255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00094d0 con 0x7f36a406c040 2023-07-09T02:23:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9595640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a40cd390 0x7f36a415bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36a9d96640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a406c040 0x7f36a41f89b0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f36a00af040 tx=0x7f36a0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f369a7fc640 1 -- 172.21.15.45:0/2540296255 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00ac410 con 0x7f36a406c040 2023-07-09T02:23:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f369a7fc640 1 -- 172.21.15.45:0/2540296255 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a00b5630 con 0x7f36a406c040 2023-07-09T02:23:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f369a7fc640 1 -- 172.21.15.45:0/2540296255 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00b59e0 con 0x7f36a406c040 2023-07-09T02:23:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.239+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a415acd0 con 0x7f36a406c040 2023-07-09T02:23:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.243+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a415a3e0 con 0x7f36a406c040 2023-07-09T02:23:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.243+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a415ae60 con 0x7f36a406c040 2023-07-09T02:23:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.243+0000 7f369a7fc640 1 -- 172.21.15.45:0/2540296255 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36a00b3070 con 0x7f36a406c040 2023-07-09T02:23:23.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.243+0000 7f369a7fc640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3688066280 0x7f3688068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.243+0000 7f369a7fc640 1 -- 172.21.15.45:0/2540296255 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36a011e3a0 con 0x7f36a406c040 2023-07-09T02:23:23.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.243+0000 7f36a9595640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3688066280 0x7f3688068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.243+0000 7f36a9595640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3688066280 0x7f3688068730 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f36a41f7de0 tx=0x7f3694008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.247+0000 7f369a7fc640 1 -- 172.21.15.45:0/2540296255 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36a00eb810 con 0x7f36a406c040 2023-07-09T02:23:23.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.403+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36a404d7d0 con 0x7f36a406c040 2023-07-09T02:23:23.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.403+0000 7f369a7fc640 1 -- 172.21.15.45:0/2540296255 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f36a00eee30 con 0x7f36a406c040 2023-07-09T02:23:23.406 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:23.406 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":185,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:23:09.480700+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:22:37.645121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T02:22:38.115103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:23:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3688066280 msgr2=0x7f3688068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3688066280 0x7f3688068730 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f36a41f7de0 tx=0x7f3694008040 comp rx=0 tx=0).stop 2023-07-09T02:23:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a406c040 msgr2=0x7f36a41f89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a406c040 0x7f36a41f89b0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f36a00af040 tx=0x7f36a0019270 comp rx=0 tx=0).stop 2023-07-09T02:23:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 shutdown_connections 2023-07-09T02:23:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36a415b4d0 0x7f36a41f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3688066280 0x7f3688068730 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36a40cd390 0x7f36a415bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 --2- 172.21.15.45:0/2540296255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36a406c040 0x7f36a41f89b0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 >> 172.21.15.45:0/2540296255 conn(0x7f36a40650b0 msgr2=0x7f36a40cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 shutdown_connections 2023-07-09T02:23:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.407+0000 7f36abffa640 1 -- 172.21.15.45:0/2540296255 wait complete. 2023-07-09T02:23:23.427 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:23:23.428 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:23:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.567+0000 7f5b66b1f640 1 Processor -- start 2023-07-09T02:23:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.567+0000 7f5b66b1f640 1 -- start start 2023-07-09T02:23:23.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b66b1f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5b600d2620 0x7f5b600b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b66b1f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b60160a50 con 0x7f5b600cd120 2023-07-09T02:23:23.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b66b1f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6015c430 con 0x7f5b6015c060 2023-07-09T02:23:23.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b66b1f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6015fb60 con 0x7f5b600d2620 2023-07-09T02:23:23.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b650bc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5b600cd120 0x7f5b600cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49576/0 (socket says 172.21.15.45:49576) 2023-07-09T02:23:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b650bc640 1 -- 172.21.15.45:0/3109798538 learned_addr learned my addr 172.21.15.45:0/3109798538 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b5ffff640 1 --2- 172.21.15.45:0/3109798538 >> v2:172.21.15.155:3300/0 conn(0x7f5b600d2620 0x7f5b600b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b5f7fe640 1 -- 172.21.15.45:0/3109798538 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507388023 0 0) 0x7f5b60160a50 con 0x7f5b600cd120 2023-07-09T02:23:23.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b5f7fe640 1 -- 172.21.15.45:0/3109798538 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b50003530 con 0x7f5b600cd120 2023-07-09T02:23:23.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b5f7fe640 1 -- 172.21.15.45:0/3109798538 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636376970 0 0) 0x7f5b6015c430 con 0x7f5b6015c060 2023-07-09T02:23:23.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b5f7fe640 1 -- 172.21.15.45:0/3109798538 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b60160a50 con 0x7f5b6015c060 2023-07-09T02:23:23.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b5ffff640 1 -- 172.21.15.45:0/3109798538 >> v1:172.21.15.155:6789/0 conn(0x7f5b6015c060 legacy=0x7f5b600d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b5ffff640 1 -- 172.21.15.45:0/3109798538 >> v1:172.21.15.45:6789/0 conn(0x7f5b600cd120 legacy=0x7f5b600cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.571+0000 7f5b5ffff640 1 -- 172.21.15.45:0/3109798538 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6015fe40 con 0x7f5b600d2620 2023-07-09T02:23:23.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b5ffff640 1 --2- 172.21.15.45:0/3109798538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 0x7f5b600b4ed0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0097c0 tx=0x7f5b4c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1def907b3e2f568f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b5f7fe640 1 -- 172.21.15.45:0/3109798538 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0ab650 con 0x7f5b600d2620 2023-07-09T02:23:23.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b5f7fe640 1 -- 172.21.15.45:0/3109798538 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c0ab7b0 con 0x7f5b600d2620 2023-07-09T02:23:23.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b5f7fe640 1 -- 172.21.15.45:0/3109798538 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0abb40 con 0x7f5b600d2620 2023-07-09T02:23:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3109798538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 msgr2=0x7f5b600b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 --2- 172.21.15.45:0/3109798538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 0x7f5b600b4ed0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0097c0 tx=0x7f5b4c01c450 comp rx=0 tx=0).stop 2023-07-09T02:23:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3109798538 shutdown_connections 2023-07-09T02:23:23.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 --2- 172.21.15.45:0/3109798538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 0x7f5b600b4ed0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3109798538 >> 172.21.15.45:0/3109798538 conn(0x7f5b600698e0 msgr2=0x7f5b60069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3109798538 shutdown_connections 2023-07-09T02:23:23.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3109798538 wait complete. 2023-07-09T02:23:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 Processor -- start 2023-07-09T02:23:23.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.575+0000 7f5b66b1f640 1 -- start start 2023-07-09T02:23:23.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b600cd120 0x7f5b60151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 0x7f5b60153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6015c060 0x7f5b600cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600cc890 con 0x7f5b6015c060 2023-07-09T02:23:23.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600ca650 con 0x7f5b600d2620 2023-07-09T02:23:23.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600ca930 con 0x7f5b600cd120 2023-07-09T02:23:23.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6015c060 0x7f5b600cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6015c060 0x7f5b600cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49868/0 (socket says 172.21.15.45:49868) 2023-07-09T02:23:23.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 -- 172.21.15.45:0/3722665803 learned_addr learned my addr 172.21.15.45:0/3722665803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:23.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b648bb640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b600cd120 0x7f5b60151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b5ffff640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 0x7f5b60153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 -- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b600cd120 msgr2=0x7f5b60151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b600cd120 0x7f5b60151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 -- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 msgr2=0x7f5b60153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 0x7f5b60153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 -- 172.21.15.45:0/3722665803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c009420 con 0x7f5b6015c060 2023-07-09T02:23:23.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b648bb640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b600cd120 0x7f5b60151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:23.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b650bc640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6015c060 0x7f5b600cc350 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800cba0 tx=0x7f5b5800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b5d7fa640 1 -- 172.21.15.45:0/3722665803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800ace0 con 0x7f5b6015c060 2023-07-09T02:23:23.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b5d7fa640 1 -- 172.21.15.45:0/3722665803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5800ae40 con 0x7f5b6015c060 2023-07-09T02:23:23.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b600b59f0 con 0x7f5b6015c060 2023-07-09T02:23:23.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b5d7fa640 1 -- 172.21.15.45:0/3722665803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58012620 con 0x7f5b6015c060 2023-07-09T02:23:23.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b600caef0 con 0x7f5b6015c060 2023-07-09T02:23:23.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.579+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6004d7d0 con 0x7f5b6015c060 2023-07-09T02:23:23.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.583+0000 7f5b5d7fa640 1 -- 172.21.15.45:0/3722665803 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b58007070 con 0x7f5b6015c060 2023-07-09T02:23:23.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.583+0000 7f5b5d7fa640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5b44066280 0x7f5b44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.583+0000 7f5b5d7fa640 1 -- 172.21.15.45:0/3722665803 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b58083cb0 con 0x7f5b6015c060 2023-07-09T02:23:23.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.583+0000 7f5b648bb640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5b44066280 0x7f5b44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.583+0000 7f5b648bb640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5b44066280 0x7f5b44068730 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5b540011f0 tx=0x7f5b54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.587+0000 7f5b5d7fa640 1 -- 172.21.15.45:0/3722665803 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b58054c60 con 0x7f5b6015c060 2023-07-09T02:23:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.775+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b6006baa0 con 0x7f5b6015c060 2023-07-09T02:23:23.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.775+0000 7f5b5d7fa640 1 -- 172.21.15.45:0/3722665803 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f5b58017090 con 0x7f5b6015c060 2023-07-09T02:23:23.779 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:23.779 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:23:23.780 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:23:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5b44066280 msgr2=0x7f5b44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5b44066280 0x7f5b44068730 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5b540011f0 tx=0x7f5b54009040 comp rx=0 tx=0).stop 2023-07-09T02:23:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6015c060 msgr2=0x7f5b600cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6015c060 0x7f5b600cc350 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800cba0 tx=0x7f5b5800a430 comp rx=0 tx=0).stop 2023-07-09T02:23:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 shutdown_connections 2023-07-09T02:23:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b6015c060 0x7f5b600cc350 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b600d2620 0x7f5b60153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5b44066280 0x7f5b44068730 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 --2- 172.21.15.45:0/3722665803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b600cd120 0x7f5b60151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 >> 172.21.15.45:0/3722665803 conn(0x7f5b600698e0 msgr2=0x7f5b600b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 shutdown_connections 2023-07-09T02:23:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.779+0000 7f5b66b1f640 1 -- 172.21.15.45:0/3722665803 wait complete. 2023-07-09T02:23:23.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:23:23.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e8974640 1 Processor -- start 2023-07-09T02:23:23.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e8974640 1 -- start start 2023-07-09T02:23:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e8974640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06e415c060 0x7f06e40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e8974640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e8974640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e4160a50 con 0x7f06e40cd120 2023-07-09T02:23:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e8974640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e415c430 con 0x7f06e415c060 2023-07-09T02:23:23.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e8974640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e415fb60 con 0x7f06e40d2620 2023-07-09T02:23:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06e415c060 0x7f06e40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f06e415c060 0x7f06e40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49876/0 (socket says 172.21.15.45:49876) 2023-07-09T02:23:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e259c640 1 -- 172.21.15.45:0/3590265920 learned_addr learned my addr 172.21.15.45:0/3590265920 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e259c640 1 -- 172.21.15.45:0/3590265920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 msgr2=0x7f06e40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e2d9d640 1 --2- 172.21.15.45:0/3590265920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e259c640 1 --2- 172.21.15.45:0/3590265920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e259c640 1 -- 172.21.15.45:0/3590265920 >> v1:172.21.15.45:6789/0 conn(0x7f06e40cd120 legacy=0x7f06e40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e259c640 1 -- 172.21.15.45:0/3590265920 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e415fe40 con 0x7f06e415c060 2023-07-09T02:23:23.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e1d9b640 1 -- 172.21.15.45:0/3590265920 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313779787 0 0) 0x7f06e4160a50 con 0x7f06e40cd120 2023-07-09T02:23:23.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.943+0000 7f06e2d9d640 1 --2- 172.21.15.45:0/3590265920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:23.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e259c640 1 --2- 172.21.15.45:0/3590265920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40b4ed0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009870 tx=0x7f06d401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84a62fa562a9cbb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e1d9b640 1 -- 172.21.15.45:0/3590265920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40aa670 con 0x7f06e415c060 2023-07-09T02:23:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e1d9b640 1 -- 172.21.15.45:0/3590265920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40aa7d0 con 0x7f06e415c060 2023-07-09T02:23:23.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e1d9b640 1 -- 172.21.15.45:0/3590265920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40aab60 con 0x7f06e415c060 2023-07-09T02:23:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e8974640 1 -- 172.21.15.45:0/3590265920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 msgr2=0x7f06e40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e8974640 1 --2- 172.21.15.45:0/3590265920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40b4ed0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009870 tx=0x7f06d401c510 comp rx=0 tx=0).stop 2023-07-09T02:23:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e8974640 1 -- 172.21.15.45:0/3590265920 shutdown_connections 2023-07-09T02:23:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e8974640 1 --2- 172.21.15.45:0/3590265920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e8974640 1 --2- 172.21.15.45:0/3590265920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40b4ed0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e8974640 1 -- 172.21.15.45:0/3590265920 >> 172.21.15.45:0/3590265920 conn(0x7f06e40698e0 msgr2=0x7f06e4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:23.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e8974640 1 -- 172.21.15.45:0/3590265920 shutdown_connections 2023-07-09T02:23:23.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.947+0000 7f06e8974640 1 -- 172.21.15.45:0/3590265920 wait complete. 2023-07-09T02:23:23.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 Processor -- start 2023-07-09T02:23:23.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 -- start start 2023-07-09T02:23:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e40cd120 0x7f06e4153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e41f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4154520 con 0x7f06e415c060 2023-07-09T02:23:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4156660 con 0x7f06e40cd120 2023-07-09T02:23:23.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4155a50 con 0x7f06e40d2620 2023-07-09T02:23:23.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49888/0 (socket says 172.21.15.45:49888) 2023-07-09T02:23:23.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 -- 172.21.15.45:0/4253373601 learned_addr learned my addr 172.21.15.45:0/4253373601 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:23.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e259c640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e40cd120 0x7f06e4153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06dbfff640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e41f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 -- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 msgr2=0x7f06e41f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e41f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 -- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e40cd120 msgr2=0x7f06e4153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:23.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e40cd120 0x7f06e4153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:23.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 -- 172.21.15.45:0/4253373601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40094d0 con 0x7f06e415c060 2023-07-09T02:23:23.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e2d9d640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40d17b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00ce40 tx=0x7f06dc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06daffd640 1 -- 172.21.15.45:0/4253373601 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc003ba0 con 0x7f06e415c060 2023-07-09T02:23:23.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06daffd640 1 -- 172.21.15.45:0/4253373601 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc003d20 con 0x7f06e415c060 2023-07-09T02:23:23.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06daffd640 1 -- 172.21.15.45:0/4253373601 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00d880 con 0x7f06e415c060 2023-07-09T02:23:23.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.951+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e40b59f0 con 0x7f06e415c060 2023-07-09T02:23:23.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.955+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e4156010 con 0x7f06e415c060 2023-07-09T02:23:23.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.955+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4156810 con 0x7f06e415c060 2023-07-09T02:23:23.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.955+0000 7f06daffd640 1 -- 172.21.15.45:0/4253373601 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06dc00d9e0 con 0x7f06e415c060 2023-07-09T02:23:23.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.955+0000 7f06daffd640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06c4066280 0x7f06c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:23.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.955+0000 7f06daffd640 1 -- 172.21.15.45:0/4253373601 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06dc084560 con 0x7f06e415c060 2023-07-09T02:23:23.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.955+0000 7f06e259c640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06c4066280 0x7f06c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:23.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.959+0000 7f06e259c640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06c4066280 0x7f06c4068730 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f06d40ae000 tx=0x7f06d40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:23.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:23.959+0000 7f06daffd640 1 -- 172.21.15.45:0/4253373601 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06e4156810 con 0x7f06e415c060 2023-07-09T02:23:24.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.143+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06e41567d0 con 0x7f06e415c060 2023-07-09T02:23:24.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06daffd640 1 -- 172.21.15.45:0/4253373601 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f06dc051a80 con 0x7f06e415c060 2023-07-09T02:23:24.147 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:24.148 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T02:22:39.125328+0000","modified":"2023-07-09T02:22:42.771279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9105},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9105":{"gid":9105,"name":"a","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1522094826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1522094826},{"type":"v1","addr":"172.21.15.45:6835","nonce":1522094826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T02:23:24.148 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-07-09T02:23:24.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06c4066280 msgr2=0x7f06c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06c4066280 0x7f06c4068730 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f06d40ae000 tx=0x7f06d40b5040 comp rx=0 tx=0).stop 2023-07-09T02:23:24.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 msgr2=0x7f06e40d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40d17b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00ce40 tx=0x7f06dc00a710 comp rx=0 tx=0).stop 2023-07-09T02:23:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 shutdown_connections 2023-07-09T02:23:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e415c060 0x7f06e40d17b0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f06c4066280 0x7f06c4068730 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06e40d2620 0x7f06e41f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 --2- 172.21.15.45:0/4253373601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06e40cd120 0x7f06e4153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 >> 172.21.15.45:0/4253373601 conn(0x7f06e40698e0 msgr2=0x7f06e40b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 shutdown_connections 2023-07-09T02:23:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.147+0000 7f06e8974640 1 -- 172.21.15.45:0/4253373601 wait complete. 2023-07-09T02:23:24.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:23:24.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e15740640 1 Processor -- start 2023-07-09T02:23:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e15740640 1 -- start start 2023-07-09T02:23:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e15740640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4e1006b120 0x7f4e1006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e15740640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e100b5810 0x7f4e100b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e15740640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e100cd300 con 0x7f4e100d23e0 2023-07-09T02:23:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e15740640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e10071850 con 0x7f4e100b5810 2023-07-09T02:23:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e15740640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1006ba30 con 0x7f4e1006b120 2023-07-09T02:23:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e0f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e100b5810 0x7f4e100b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e0f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e100b5810 0x7f4e100b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49902/0 (socket says 172.21.15.45:49902) 2023-07-09T02:23:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e0f7fe640 1 -- 172.21.15.45:0/3191057090 learned_addr learned my addr 172.21.15.45:0/3191057090 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e0effd640 1 --2- 172.21.15.45:0/3191057090 >> v2:172.21.15.155:3300/0 conn(0x7f4e1006b120 0x7f4e1006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e0f7fe640 1 -- 172.21.15.45:0/3191057090 >> v2:172.21.15.155:3300/0 conn(0x7f4e1006b120 msgr2=0x7f4e1006b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e0f7fe640 1 --2- 172.21.15.45:0/3191057090 >> v2:172.21.15.155:3300/0 conn(0x7f4e1006b120 0x7f4e1006b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e0f7fe640 1 -- 172.21.15.45:0/3191057090 >> v1:172.21.15.155:6789/0 conn(0x7f4e100d23e0 legacy=0x7f4e100cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.311+0000 7f4e0f7fe640 1 -- 172.21.15.45:0/3191057090 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100d0e80 con 0x7f4e100b5810 2023-07-09T02:23:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e0f7fe640 1 --2- 172.21.15.45:0/3191057090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100b5810 0x7f4e100b5cb0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b5430 tx=0x7f4e0801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10226c8847c7ea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e0dffb640 1 -- 172.21.15.45:0/3191057090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080a5860 con 0x7f4e100b5810 2023-07-09T02:23:24.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e0dffb640 1 -- 172.21.15.45:0/3191057090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e080a59c0 con 0x7f4e100b5810 2023-07-09T02:23:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e0dffb640 1 -- 172.21.15.45:0/3191057090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080a5d50 con 0x7f4e100b5810 2023-07-09T02:23:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 -- 172.21.15.45:0/3191057090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100b5810 msgr2=0x7f4e100b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 --2- 172.21.15.45:0/3191057090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100b5810 0x7f4e100b5cb0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b5430 tx=0x7f4e0801c9a0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 -- 172.21.15.45:0/3191057090 shutdown_connections 2023-07-09T02:23:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 --2- 172.21.15.45:0/3191057090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100b5810 0x7f4e100b5cb0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 --2- 172.21.15.45:0/3191057090 >> v2:172.21.15.155:3300/0 conn(0x7f4e1006b120 0x7f4e1006b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 -- 172.21.15.45:0/3191057090 >> 172.21.15.45:0/3191057090 conn(0x7f4e100cf3b0 msgr2=0x7f4e100cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 -- 172.21.15.45:0/3191057090 shutdown_connections 2023-07-09T02:23:24.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 -- 172.21.15.45:0/3191057090 wait complete. 2023-07-09T02:23:24.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 Processor -- start 2023-07-09T02:23:24.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.315+0000 7f4e15740640 1 -- start start 2023-07-09T02:23:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1006b120 0x7f4e101665e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e100b5810 0x7f4e10156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100d23e0 0x7f4e10158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100c8f70 con 0x7f4e100d23e0 2023-07-09T02:23:24.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101429c0 con 0x7f4e100b5810 2023-07-09T02:23:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101573d0 con 0x7f4e1006b120 2023-07-09T02:23:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100d23e0 0x7f4e10158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100d23e0 0x7f4e10158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49918/0 (socket says 172.21.15.45:49918) 2023-07-09T02:23:24.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 -- 172.21.15.45:0/1869618585 learned_addr learned my addr 172.21.15.45:0/1869618585 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:24.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0e7fc640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e100b5810 0x7f4e10156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0effd640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1006b120 0x7f4e101665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 -- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1006b120 msgr2=0x7f4e101665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1006b120 0x7f4e101665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 -- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e100b5810 msgr2=0x7f4e10156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e100b5810 0x7f4e10156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 -- 172.21.15.45:0/1869618585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08009b30 con 0x7f4e100d23e0 2023-07-09T02:23:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0e7fc640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e100b5810 0x7f4e10156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0effd640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1006b120 0x7f4e101665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e0f7fe640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100d23e0 0x7f4e10158970 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f4e080195b0 tx=0x7f4e08019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:24.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4df77fe640 1 -- 172.21.15.45:0/1869618585 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080b8670 con 0x7f4e100d23e0 2023-07-09T02:23:24.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4df77fe640 1 -- 172.21.15.45:0/1869618585 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e080b87f0 con 0x7f4e100d23e0 2023-07-09T02:23:24.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e101576b0 con 0x7f4e100d23e0 2023-07-09T02:23:24.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4df77fe640 1 -- 172.21.15.45:0/1869618585 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080b8be0 con 0x7f4e100d23e0 2023-07-09T02:23:24.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e10157c70 con 0x7f4e100d23e0 2023-07-09T02:23:24.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.319+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e10157e60 con 0x7f4e100d23e0 2023-07-09T02:23:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.323+0000 7f4df77fe640 1 -- 172.21.15.45:0/1869618585 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e080b8d40 con 0x7f4e100d23e0 2023-07-09T02:23:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.323+0000 7f4df77fe640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dfc066280 0x7f4dfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.323+0000 7f4df77fe640 1 -- 172.21.15.45:0/1869618585 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e0811f4d0 con 0x7f4e100d23e0 2023-07-09T02:23:24.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.323+0000 7f4e0effd640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dfc066280 0x7f4dfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.323+0000 7f4e0effd640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dfc066280 0x7f4dfc068730 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4e100ceea0 tx=0x7f4e00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:24.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.327+0000 7f4df77fe640 1 -- 172.21.15.45:0/1869618585 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e080ec9e0 con 0x7f4e100d23e0 2023-07-09T02:23:24.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e1004e020 con 0x7f4e100d23e0 2023-07-09T02:23:24.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4df77fe640 1 -- 172.21.15.45:0/1869618585 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+18321 (secure 0 0 0) 0x7f4e080f0000 con 0x7f4e100d23e0 2023-07-09T02:23:24.491 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:24.491 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":186,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:23:24.484748+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T02:22:37.645121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T02:22:38.115103+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:23:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dfc066280 msgr2=0x7f4dfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dfc066280 0x7f4dfc068730 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4e100ceea0 tx=0x7f4e00008040 comp rx=0 tx=0).stop 2023-07-09T02:23:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100d23e0 msgr2=0x7f4e10158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100d23e0 0x7f4e10158970 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f4e080195b0 tx=0x7f4e08019740 comp rx=0 tx=0).stop 2023-07-09T02:23:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 shutdown_connections 2023-07-09T02:23:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e100d23e0 0x7f4e10158970 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e100b5810 0x7f4e10156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f4dfc066280 0x7f4dfc068730 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 --2- 172.21.15.45:0/1869618585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1006b120 0x7f4e101665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.487+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 >> 172.21.15.45:0/1869618585 conn(0x7f4e100cf3b0 msgr2=0x7f4e100b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.491+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 shutdown_connections 2023-07-09T02:23:24.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.491+0000 7f4e15740640 1 -- 172.21.15.45:0/1869618585 wait complete. 2023-07-09T02:23:24.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T02:23:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.651+0000 7f888099f640 1 Processor -- start 2023-07-09T02:23:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.651+0000 7f888099f640 1 -- start start 2023-07-09T02:23:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f888099f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f887c0d2620 0x7f887c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f888099f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c160a50 con 0x7f887c0cd120 2023-07-09T02:23:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f888099f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c15c430 con 0x7f887c15c060 2023-07-09T02:23:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f888099f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c15fb60 con 0x7f887c0d2620 2023-07-09T02:23:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f887ad9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f887c0cd120 0x7f887c0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49588/0 (socket says 172.21.15.45:49588) 2023-07-09T02:23:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f887ad9d640 1 -- 172.21.15.45:0/3984782290 learned_addr learned my addr 172.21.15.45:0/3984782290 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:24.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8873fff640 1 --2- 172.21.15.45:0/3984782290 >> v2:172.21.15.155:3300/0 conn(0x7f887c0d2620 0x7f887c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672185991 0 0) 0x7f887c160a50 con 0x7f887c0cd120 2023-07-09T02:23:24.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8868003530 con 0x7f887c0cd120 2023-07-09T02:23:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2713117580 0 0) 0x7f8868003530 con 0x7f887c0cd120 2023-07-09T02:23:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 >> v2:172.21.15.155:3300/0 conn(0x7f887c0d2620 msgr2=0x7f887c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 --2- 172.21.15.45:0/3984782290 >> v2:172.21.15.155:3300/0 conn(0x7f887c0d2620 0x7f887c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 >> v1:172.21.15.155:6789/0 conn(0x7f887c15c060 legacy=0x7f887c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c15fe40 con 0x7f887c0cd120 2023-07-09T02:23:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f8874001a00 con 0x7f887c0cd120 2023-07-09T02:23:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 >> v1:172.21.15.45:6789/0 conn(0x7f887c0cd120 legacy=0x7f887c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8868003980 0x7f8868003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f8868004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8868005180 0x7f886800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c15fb60 con 0x7f88680047d0 2023-07-09T02:23:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886800c000 con 0x7f8868003980 2023-07-09T02:23:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886800c1c0 con 0x7f8868005180 2023-07-09T02:23:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8873fff640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f8868004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f887a59c640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8868003980 0x7f8868003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f887ad9d640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8868005180 0x7f886800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8873fff640 1 -- 172.21.15.45:0/3984782290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8868005180 msgr2=0x7f886800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8873fff640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8868005180 0x7f886800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8873fff640 1 -- 172.21.15.45:0/3984782290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8868003980 msgr2=0x7f8868003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8873fff640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8868003980 0x7f8868003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f8873fff640 1 -- 172.21.15.45:0/3984782290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868003530 con 0x7f88680047d0 2023-07-09T02:23:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.655+0000 7f887ad9d640 1 -- 172.21.15.45:0/3984782290 reap_dead start 2023-07-09T02:23:24.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f8873fff640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f8868004c40 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f8864009ab0 tx=0x7f886401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b4be371b9a127 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640a6440 con 0x7f88680047d0 2023-07-09T02:23:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88640a65a0 con 0x7f88680047d0 2023-07-09T02:23:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f8879d9b640 1 -- 172.21.15.45:0/3984782290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640a6950 con 0x7f88680047d0 2023-07-09T02:23:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f888099f640 1 -- 172.21.15.45:0/3984782290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 msgr2=0x7f8868004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f888099f640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f8868004c40 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f8864009ab0 tx=0x7f886401ca30 comp rx=0 tx=0).stop 2023-07-09T02:23:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f888099f640 1 -- 172.21.15.45:0/3984782290 shutdown_connections 2023-07-09T02:23:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f888099f640 1 --2- 172.21.15.45:0/3984782290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f8868004c40 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f888099f640 1 -- 172.21.15.45:0/3984782290 >> 172.21.15.45:0/3984782290 conn(0x7f887c0698e0 msgr2=0x7f887c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f888099f640 1 -- 172.21.15.45:0/3984782290 shutdown_connections 2023-07-09T02:23:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.659+0000 7f888099f640 1 -- 172.21.15.45:0/3984782290 wait complete. 2023-07-09T02:23:24.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 Processor -- start 2023-07-09T02:23:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 -- start start 2023-07-09T02:23:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f887c1f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f887c1486c0 0x7f887c0cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c0cc160 0x7f887c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c1f27c0 con 0x7f88680047d0 2023-07-09T02:23:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c148c60 con 0x7f887c1486c0 2023-07-09T02:23:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c148f40 con 0x7f887c0cc160 2023-07-09T02:23:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f887c1f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f887c1f2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49936/0 (socket says 172.21.15.45:49936) 2023-07-09T02:23:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 -- 172.21.15.45:0/3819154716 learned_addr learned my addr 172.21.15.45:0/3819154716 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f8873fff640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f887c1486c0 0x7f887c0cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887ad9d640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c0cc160 0x7f887c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 -- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c0cc160 msgr2=0x7f887c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c0cc160 0x7f887c0b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 -- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f887c1486c0 msgr2=0x7f887c0cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f887c1486c0 0x7f887c0cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 -- 172.21.15.45:0/3819154716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c149220 con 0x7f88680047d0 2023-07-09T02:23:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887ad9d640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c0cc160 0x7f887c0b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f887a59c640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f887c1f2280 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f886c007820 tx=0x7f886c00f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0052e0 con 0x7f88680047d0 2023-07-09T02:23:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c005440 con 0x7f88680047d0 2023-07-09T02:23:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c003840 con 0x7f88680047d0 2023-07-09T02:23:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c1f4e50 con 0x7f88680047d0 2023-07-09T02:23:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c0b4b40 con 0x7f88680047d0 2023-07-09T02:23:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.663+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c04d7d0 con 0x7f88680047d0 2023-07-09T02:23:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.667+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f886c0039a0 con 0x7f88680047d0 2023-07-09T02:23:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.667+0000 7f8872ffd640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f885c0662b0 0x7f885c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.667+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f886c083850 con 0x7f88680047d0 2023-07-09T02:23:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.667+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=187}) v3 -- 0x7f885c06e3f0 con 0x7f88680047d0 2023-07-09T02:23:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.667+0000 7f8873fff640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f885c0662b0 0x7f885c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.667+0000 7f8873fff640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f885c0662b0 0x7f885c068760 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f88640ad000 tx=0x7f88640046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:24.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.671+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f886c050c30 con 0x7f88680047d0 2023-07-09T02:23:24.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.859+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f887c06baa0 con 0x7f88680047d0 2023-07-09T02:23:24.862 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-07-09T02:23:24.859+0000 7fa1e90d1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T02:23:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.863+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(187..187 src has 1..187) v4 ==== 374+0+0 (secure 0 0 0) 0x7f886c05cc40 con 0x7f88680047d0 2023-07-09T02:23:24.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.863+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f885c06eca0 con 0x7f88680047d0 2023-07-09T02:23:24.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.867+0000 7f8872ffd640 1 -- 172.21.15.45:0/3819154716 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) v1 ==== 161+0+0 (secure 0 0 0) 0x7f886c054250 con 0x7f88680047d0 2023-07-09T02:23:24.869 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T02:23:24.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f885c0662b0 msgr2=0x7f885c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f885c0662b0 0x7f885c068760 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f88640ad000 tx=0x7f88640046d0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 msgr2=0x7f887c1f2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:24.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f887c1f2280 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f886c007820 tx=0x7f886c00f830 comp rx=0 tx=0).stop 2023-07-09T02:23:24.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 shutdown_connections 2023-07-09T02:23:24.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f885c0662b0 0x7f885c068760 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c0cc160 0x7f887c0b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f887c1486c0 0x7f887c0cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 --2- 172.21.15.45:0/3819154716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88680047d0 0x7f887c1f2280 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:24.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 >> 172.21.15.45:0/3819154716 conn(0x7f887c0698e0 msgr2=0x7f887c0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:24.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 shutdown_connections 2023-07-09T02:23:24.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:24.871+0000 7f888099f640 1 -- 172.21.15.45:0/3819154716 wait complete. 2023-07-09T02:23:24.879 INFO:tasks.ceph.mds.a.smithi045.stderr: -9187> 2023-07-09T02:22:44.700+0000 7fdcfac74640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T02:23:24.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T02:23:24.935 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-07-09T02:23:25.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.035+0000 7f65e4cec640 1 Processor -- start 2023-07-09T02:23:25.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.035+0000 7f65e4cec640 1 -- start start 2023-07-09T02:23:25.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65e4cec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00ca0f0 0x7f65e00cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65e4cec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f65e00cbbb0 0x7f65e00c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65e4cec640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e006bf30 con 0x7f65e00c9250 2023-07-09T02:23:25.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65e4cec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e006bc50 con 0x7f65e00cbbb0 2023-07-09T02:23:25.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65e4cec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00cab90 con 0x7f65e00ca0f0 2023-07-09T02:23:25.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ded9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f65e00c9250 0x7f65e015db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49590/0 (socket says 172.21.15.45:49590) 2023-07-09T02:23:25.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ded9d640 1 -- 172.21.15.45:0/2817389067 learned_addr learned my addr 172.21.15.45:0/2817389067 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:25.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993257347 0 0) 0x7f65e006bf30 con 0x7f65e00c9250 2023-07-09T02:23:25.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65de59c640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00ca0f0 0x7f65e00cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65d7fff640 1 --2- 172.21.15.45:0/2817389067 >> v2:172.21.15.155:3300/0 conn(0x7f65e00cbbb0 0x7f65e00c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65cc003530 con 0x7f65e00c9250 2023-07-09T02:23:25.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 396179866 0 0) 0x7f65cc003530 con 0x7f65e00c9250 2023-07-09T02:23:25.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00ca0f0 msgr2=0x7f65e00cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:25.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00ca0f0 0x7f65e00cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 >> v2:172.21.15.155:3300/0 conn(0x7f65e00cbbb0 msgr2=0x7f65e00c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:25.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 --2- 172.21.15.45:0/2817389067 >> v2:172.21.15.155:3300/0 conn(0x7f65e00cbbb0 0x7f65e00c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00cae70 con 0x7f65e00c9250 2023-07-09T02:23:25.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f65d8001a00 con 0x7f65e00c9250 2023-07-09T02:23:25.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 >> v1:172.21.15.45:6789/0 conn(0x7f65e00c9250 legacy=0x7f65e015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:25.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc003980 0x7f65cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00ca0f0 0x7f65cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e006bc50 con 0x7f65cc004d10 2023-07-09T02:23:25.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00cab90 con 0x7f65cc003980 2023-07-09T02:23:25.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc00b990 con 0x7f65e00ca0f0 2023-07-09T02:23:25.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ded9d640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65d7fff640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00ca0f0 0x7f65cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65de59c640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc003980 0x7f65cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ded9d640 1 -- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00ca0f0 msgr2=0x7f65cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:25.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ded9d640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00ca0f0 0x7f65cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ded9d640 1 -- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc003980 msgr2=0x7f65cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:25.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ded9d640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc003980 0x7f65cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.039+0000 7f65ded9d640 1 -- 172.21.15.45:0/2817389067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc003530 con 0x7f65cc004d10 2023-07-09T02:23:25.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65ded9d640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65cc005180 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f65d800a8d0 tx=0x7f65d801fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171ff87e0b66a7cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:25.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80aa6e0 con 0x7f65cc004d10 2023-07-09T02:23:25.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d80aa840 con 0x7f65cc004d10 2023-07-09T02:23:25.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65ddd9b640 1 -- 172.21.15.45:0/2817389067 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80aabf0 con 0x7f65cc004d10 2023-07-09T02:23:25.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65e4cec640 1 -- 172.21.15.45:0/2817389067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 msgr2=0x7f65cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:25.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65e4cec640 1 --2- 172.21.15.45:0/2817389067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65cc005180 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f65d800a8d0 tx=0x7f65d801fb40 comp rx=0 tx=0).stop 2023-07-09T02:23:25.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65ded9d640 1 -- 172.21.15.45:0/2817389067 reap_dead start 2023-07-09T02:23:25.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65e4cec640 1 -- 172.21.15.45:0/2817389067 shutdown_connections 2023-07-09T02:23:25.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65e4cec640 1 -- 172.21.15.45:0/2817389067 >> 172.21.15.45:0/2817389067 conn(0x7f65e00694b0 msgr2=0x7f65e00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:25.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65e4cec640 1 -- 172.21.15.45:0/2817389067 shutdown_connections 2023-07-09T02:23:25.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.043+0000 7f65e4cec640 1 -- 172.21.15.45:0/2817389067 wait complete. 2023-07-09T02:23:25.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 Processor -- start 2023-07-09T02:23:25.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 -- start start 2023-07-09T02:23:25.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65e01f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e00c6660 0x7f65e00b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00c71f0 0x7f65e00b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00b1170 con 0x7f65cc004d10 2023-07-09T02:23:25.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00b0ef0 con 0x7f65e00c6660 2023-07-09T02:23:25.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00c58a0 con 0x7f65e00c71f0 2023-07-09T02:23:25.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65e01f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65e01f35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49984/0 (socket says 172.21.15.45:49984) 2023-07-09T02:23:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 -- 172.21.15.45:0/3119183697 learned_addr learned my addr 172.21.15.45:0/3119183697 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65ded9d640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00c71f0 0x7f65e00b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 -- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00c71f0 msgr2=0x7f65e00b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65d7fff640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e00c6660 0x7f65e00b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00c71f0 0x7f65e00b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 -- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e00c6660 msgr2=0x7f65e00b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:25.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e00c6660 0x7f65e00b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 -- 172.21.15.45:0/3119183697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00c5b80 con 0x7f65cc004d10 2023-07-09T02:23:25.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65ded9d640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00c71f0 0x7f65e00b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:25.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65d7fff640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e00c6660 0x7f65e00b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:25.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65de59c640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65e01f35d0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f65d0011960 tx=0x7f65d0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:25.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65d6ffd640 1 -- 172.21.15.45:0/3119183697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d000faf0 con 0x7f65cc004d10 2023-07-09T02:23:25.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65d6ffd640 1 -- 172.21.15.45:0/3119183697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d000fc50 con 0x7f65cc004d10 2023-07-09T02:23:25.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65d6ffd640 1 -- 172.21.15.45:0/3119183697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0014440 con 0x7f65cc004d10 2023-07-09T02:23:25.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e00c5e60 con 0x7f65cc004d10 2023-07-09T02:23:25.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e00c7650 con 0x7f65cc004d10 2023-07-09T02:23:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.047+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e00c78d0 con 0x7f65cc004d10 2023-07-09T02:23:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.051+0000 7f65d6ffd640 1 -- 172.21.15.45:0/3119183697 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f65d00145a0 con 0x7f65cc004d10 2023-07-09T02:23:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.051+0000 7f65d6ffd640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f65c0066280 0x7f65c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.051+0000 7f65d6ffd640 1 -- 172.21.15.45:0/3119183697 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f65d00846c0 con 0x7f65cc004d10 2023-07-09T02:23:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.051+0000 7f65d6ffd640 1 -- 172.21.15.45:0/3119183697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f65c006e4d0 con 0x7f65cc004d10 2023-07-09T02:23:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.051+0000 7f65d7fff640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f65c0066280 0x7f65c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.051+0000 7f65d7fff640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f65c0066280 0x7f65c0068730 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f65e00c6d10 tx=0x7f65c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:25.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.055+0000 7f65d6ffd640 1 -- 172.21.15.45:0/3119183697 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65d0051a40 con 0x7f65cc004d10 2023-07-09T02:23:25.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.243+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f65e004d7d0 con 0x7f65cc004d10 2023-07-09T02:23:25.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.867+0000 7f65d6ffd640 1 -- 172.21.15.45:0/3119183697 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) v1 ==== 104+0+0 (secure 0 0 0) 0x7f65d0022020 con 0x7f65cc004d10 2023-07-09T02:23:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.867+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f65c0066280 msgr2=0x7f65c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.867+0000 7f65e4cec640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f65c0066280 0x7f65c0068730 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f65e00c6d10 tx=0x7f65c8008040 comp rx=0 tx=0).stop 2023-07-09T02:23:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.867+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 msgr2=0x7f65e01f35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.867+0000 7f65e4cec640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65e01f35d0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f65d0011960 tx=0x7f65d0011e20 comp rx=0 tx=0).stop 2023-07-09T02:23:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.871+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 shutdown_connections 2023-07-09T02:23:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.871+0000 7f65e4cec640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f65c0066280 0x7f65c0068730 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.871+0000 7f65e4cec640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65e00c71f0 0x7f65e00b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.871+0000 7f65e4cec640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65e00c6660 0x7f65e00b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.871+0000 7f65e4cec640 1 --2- 172.21.15.45:0/3119183697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65cc004d10 0x7f65e01f35d0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.871+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 >> 172.21.15.45:0/3119183697 conn(0x7f65e00694b0 msgr2=0x7f65e006afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.871+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 shutdown_connections 2023-07-09T02:23:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:25.871+0000 7f65e4cec640 1 -- 172.21.15.45:0/3119183697 wait complete. 2023-07-09T02:23:25.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T02:23:26.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.079+0000 7f148f559640 1 Processor -- start 2023-07-09T02:23:26.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148f559640 1 -- start start 2023-07-09T02:23:26.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148f559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14880cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148f559640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14880d19c0 con 0x7f14880cecd0 2023-07-09T02:23:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148f559640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14880d1090 con 0x7f14880b4490 2023-07-09T02:23:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148f559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148815c850 con 0x7f148815c480 2023-07-09T02:23:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148caf4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f14880cecd0 0x7f14880d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49606/0 (socket says 172.21.15.45:49606) 2023-07-09T02:23:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148caf4640 1 -- 172.21.15.45:0/3368972041 learned_addr learned my addr 172.21.15.45:0/3368972041 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148d2f5640 1 --2- 172.21.15.45:0/3368972041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14880cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:26.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f147ffff640 1 -- 172.21.15.45:0/3368972041 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261919524 0 0) 0x7f14880d19c0 con 0x7f14880cecd0 2023-07-09T02:23:26.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f147ffff640 1 -- 172.21.15.45:0/3368972041 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474003530 con 0x7f14880cecd0 2023-07-09T02:23:26.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f147ffff640 1 -- 172.21.15.45:0/3368972041 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821201182 0 0) 0x7f14880d1090 con 0x7f14880b4490 2023-07-09T02:23:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148d2f5640 1 -- 172.21.15.45:0/3368972041 >> v1:172.21.15.155:6789/0 conn(0x7f14880b4490 legacy=0x7f14880b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148d2f5640 1 -- 172.21.15.45:0/3368972041 >> v1:172.21.15.45:6789/0 conn(0x7f14880cecd0 legacy=0x7f14880d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.083+0000 7f148d2f5640 1 -- 172.21.15.45:0/3368972041 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14880d1370 con 0x7f148815c480 2023-07-09T02:23:26.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148d2f5640 1 --2- 172.21.15.45:0/3368972041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14880cd060 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f14840097f0 tx=0x7f148401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ebbe47a4855651 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:26.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f147ffff640 1 -- 172.21.15.45:0/3368972041 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840ac630 con 0x7f148815c480 2023-07-09T02:23:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f147ffff640 1 -- 172.21.15.45:0/3368972041 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14840ac790 con 0x7f148815c480 2023-07-09T02:23:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f147ffff640 1 -- 172.21.15.45:0/3368972041 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840acb20 con 0x7f148815c480 2023-07-09T02:23:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148f559640 1 -- 172.21.15.45:0/3368972041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 msgr2=0x7f14880cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148f559640 1 --2- 172.21.15.45:0/3368972041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14880cd060 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f14840097f0 tx=0x7f148401c4c0 comp rx=0 tx=0).stop 2023-07-09T02:23:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148f559640 1 -- 172.21.15.45:0/3368972041 shutdown_connections 2023-07-09T02:23:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148f559640 1 --2- 172.21.15.45:0/3368972041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14880cd060 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148f559640 1 -- 172.21.15.45:0/3368972041 >> 172.21.15.45:0/3368972041 conn(0x7f14880cf490 msgr2=0x7f14880cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148f559640 1 -- 172.21.15.45:0/3368972041 shutdown_connections 2023-07-09T02:23:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148f559640 1 -- 172.21.15.45:0/3368972041 wait complete. 2023-07-09T02:23:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.087+0000 7f148f559640 1 Processor -- start 2023-07-09T02:23:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 -- start start 2023-07-09T02:23:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14880b4490 0x7f14881532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14880cecd0 0x7f148814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14881528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148814e420 con 0x7f14880b4490 2023-07-09T02:23:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1488152460 con 0x7f14880cecd0 2023-07-09T02:23:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148814de60 con 0x7f148815c480 2023-07-09T02:23:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14880b4490 0x7f14881532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14880b4490 0x7f14881532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49996/0 (socket says 172.21.15.45:49996) 2023-07-09T02:23:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 -- 172.21.15.45:0/4139036759 learned_addr learned my addr 172.21.15.45:0/4139036759 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 -- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 msgr2=0x7f14881528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148daf6640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14881528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148caf4640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14880cecd0 0x7f148814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14881528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 -- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14880cecd0 msgr2=0x7f148814d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14880cecd0 0x7f148814d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 -- 172.21.15.45:0/4139036759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484009420 con 0x7f14880b4490 2023-07-09T02:23:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148daf6640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14881528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148caf4640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14880cecd0 0x7f148814d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148d2f5640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14880b4490 0x7f14881532e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f14840097f0 tx=0x7f1484019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484004020 con 0x7f14880b4490 2023-07-09T02:23:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484004180 con 0x7f14880b4490 2023-07-09T02:23:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148814e140 con 0x7f14880b4490 2023-07-09T02:23:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840044f0 con 0x7f14880b4490 2023-07-09T02:23:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1488152e30 con 0x7f14880b4490 2023-07-09T02:23:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.091+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148804d7d0 con 0x7f14880b4490 2023-07-09T02:23:26.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.095+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14840b3040 con 0x7f14880b4490 2023-07-09T02:23:26.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.095+0000 7f147dffb640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f146c066280 0x7f146c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:26.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.095+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f148411dbf0 con 0x7f14880b4490 2023-07-09T02:23:26.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.095+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f146c06e4d0 con 0x7f14880b4490 2023-07-09T02:23:26.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.095+0000 7f148caf4640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f146c066280 0x7f146c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:26.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.095+0000 7f148caf4640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f146c066280 0x7f146c068730 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f148815bb50 tx=0x7f1478009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:26.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.099+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14840eb020 con 0x7f14880b4490 2023-07-09T02:23:26.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.251+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f14880d2260 con 0x7f14880b4490 2023-07-09T02:23:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.867+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(188..188 src has 1..188) v4 ==== 296+0+0 (secure 0 0 0) 0x7f14840f2ca0 con 0x7f14880b4490 2023-07-09T02:23:26.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.867+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7f146c06c900 con 0x7f14880b4490 2023-07-09T02:23:26.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.871+0000 7f147dffb640 1 -- 172.21.15.45:0/4139036759 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v188) v1 ==== 181+0+0 (secure 0 0 0) 0x7f14840bd030 con 0x7f14880b4490 2023-07-09T02:23:26.876 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-07-09T02:23:26.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f146c066280 msgr2=0x7f146c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f146c066280 0x7f146c068730 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f148815bb50 tx=0x7f1478009040 comp rx=0 tx=0).stop 2023-07-09T02:23:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14880b4490 msgr2=0x7f14881532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14880b4490 0x7f14881532e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f14840097f0 tx=0x7f1484019260 comp rx=0 tx=0).stop 2023-07-09T02:23:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 shutdown_connections 2023-07-09T02:23:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f146c066280 0x7f146c068730 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f148815c480 0x7f14881528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:26.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14880cecd0 0x7f148814d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:26.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 --2- 172.21.15.45:0/4139036759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14880b4490 0x7f14881532e0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:26.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 >> 172.21.15.45:0/4139036759 conn(0x7f14880cf490 msgr2=0x7f14880d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:26.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 shutdown_connections 2023-07-09T02:23:26.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:26.879+0000 7f148f559640 1 -- 172.21.15.45:0/4139036759 wait complete. 2023-07-09T02:23:26.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T02:23:27.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc84d8f640 1 Processor -- start 2023-07-09T02:23:27.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc84d8f640 1 -- start start 2023-07-09T02:23:27.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc84d8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd060 0x7fcc800cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc84d8f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcc800b4490 0x7fcc800b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc84d8f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800d19c0 con 0x7fcc8015c480 2023-07-09T02:23:27.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc84d8f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8015c850 con 0x7fcc800b4490 2023-07-09T02:23:27.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc84d8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800b4e50 con 0x7fcc800cd060 2023-07-09T02:23:27.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7e59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcc8015c480 0x7fcc800d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49612/0 (socket says 172.21.15.45:49612) 2023-07-09T02:23:27.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7e59c640 1 -- 172.21.15.45:0/3662970119 learned_addr learned my addr 172.21.15.45:0/3662970119 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051731981 0 0) 0x7fcc800d19c0 con 0x7fcc8015c480 2023-07-09T02:23:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6c003530 con 0x7fcc8015c480 2023-07-09T02:23:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7ed9d640 1 --2- 172.21.15.45:0/3662970119 >> v2:172.21.15.155:3300/0 conn(0x7fcc800b4490 0x7fcc800b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc77fff640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd060 0x7fcc800cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444823097 0 0) 0x7fcc6c003530 con 0x7fcc8015c480 2023-07-09T02:23:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd060 msgr2=0x7fcc800cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd060 0x7fcc800cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 >> v2:172.21.15.155:3300/0 conn(0x7fcc800b4490 msgr2=0x7fcc800b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 --2- 172.21.15.45:0/3662970119 >> v2:172.21.15.155:3300/0 conn(0x7fcc800b4490 0x7fcc800b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800cf210 con 0x7fcc8015c480 2023-07-09T02:23:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7fcc70001680 con 0x7fcc8015c480 2023-07-09T02:23:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 >> v1:172.21.15.45:6789/0 conn(0x7fcc8015c480 legacy=0x7fcc800d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c003980 0x7fcc6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.051+0000 7fcc7dd9b640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc6c0043b0 0x7fcc6c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7dd9b640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd060 0x7fcc6c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8015c850 con 0x7fcc6c0043b0 2023-07-09T02:23:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800b4e50 con 0x7fcc6c003980 2023-07-09T02:23:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c00b990 con 0x7fcc800cd060 2023-07-09T02:23:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc77fff640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc6c0043b0 0x7fcc6c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7e59c640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c003980 0x7fcc6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7ed9d640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd060 0x7fcc6c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc77fff640 1 -- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd060 msgr2=0x7fcc6c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc77fff640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc800cd060 0x7fcc6c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc77fff640 1 -- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c003980 msgr2=0x7fcc6c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc77fff640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c003980 0x7fcc6c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc77fff640 1 -- 172.21.15.45:0/3662970119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c003530 con 0x7fcc6c0043b0 2023-07-09T02:23:27.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc77fff640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc6c0043b0 0x7fcc6c004870 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009ae0 tx=0x7fcc6801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f59167f0644d5b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680a5640 con 0x7fcc6c0043b0 2023-07-09T02:23:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680a57a0 con 0x7fcc6c0043b0 2023-07-09T02:23:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.055+0000 7fcc7dd9b640 1 -- 172.21.15.45:0/3662970119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680a5b50 con 0x7fcc6c0043b0 2023-07-09T02:23:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3662970119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc6c0043b0 msgr2=0x7fcc6c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 --2- 172.21.15.45:0/3662970119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc6c0043b0 0x7fcc6c004870 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009ae0 tx=0x7fcc6801ca50 comp rx=0 tx=0).stop 2023-07-09T02:23:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc7ed9d640 1 -- 172.21.15.45:0/3662970119 reap_dead start 2023-07-09T02:23:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3662970119 shutdown_connections 2023-07-09T02:23:27.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3662970119 >> 172.21.15.45:0/3662970119 conn(0x7fcc800cf490 msgr2=0x7fcc800cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:27.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3662970119 shutdown_connections 2023-07-09T02:23:27.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3662970119 wait complete. 2023-07-09T02:23:27.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 Processor -- start 2023-07-09T02:23:27.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- start start 2023-07-09T02:23:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c0043b0 0x7fcc801f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc800cae90 0x7fcc8014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8014b1d0 0x7fcc80149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8014b640 con 0x7fcc800cae90 2023-07-09T02:23:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80148970 con 0x7fcc6c0043b0 2023-07-09T02:23:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc84d8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc801f19f0 con 0x7fcc8014b1d0 2023-07-09T02:23:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc800cae90 0x7fcc8014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc77fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc800cae90 0x7fcc8014ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50006/0 (socket says 172.21.15.45:50006) 2023-07-09T02:23:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc77fff640 1 -- 172.21.15.45:0/3058322248 learned_addr learned my addr 172.21.15.45:0/3058322248 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc7e59c640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c0043b0 0x7fcc801f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc7ed9d640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8014b1d0 0x7fcc80149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc77fff640 1 -- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8014b1d0 msgr2=0x7fcc80149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc77fff640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8014b1d0 0x7fcc80149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc77fff640 1 -- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c0043b0 msgr2=0x7fcc801f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:27.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc77fff640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c0043b0 0x7fcc801f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc77fff640 1 -- 172.21.15.45:0/3058322248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80148da0 con 0x7fcc800cae90 2023-07-09T02:23:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.059+0000 7fcc7ed9d640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8014b1d0 0x7fcc80149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc77fff640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc800cae90 0x7fcc8014ac90 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009a00 tx=0x7fcc6c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680bc070 con 0x7fcc800cae90 2023-07-09T02:23:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc68004020 con 0x7fcc800cae90 2023-07-09T02:23:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680a5640 con 0x7fcc800cae90 2023-07-09T02:23:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc80149080 con 0x7fcc800cae90 2023-07-09T02:23:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc80149640 con 0x7fcc800cae90 2023-07-09T02:23:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8004d7d0 con 0x7fcc800cae90 2023-07-09T02:23:27.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc680b4040 con 0x7fcc800cae90 2023-07-09T02:23:27.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc76ffd640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc600662b0 0x7fcc60068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:27.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fcc6811d3e0 con 0x7fcc800cae90 2023-07-09T02:23:27.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7fcc6006d690 con 0x7fcc800cae90 2023-07-09T02:23:27.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.063+0000 7fcc7e59c640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc600662b0 0x7fcc60068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:27.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.067+0000 7fcc7e59c640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc600662b0 0x7fcc60068760 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcc70001060 tx=0x7fcc70007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:27.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.067+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc680eaa60 con 0x7fcc800cae90 2023-07-09T02:23:27.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.223+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc800cfb50 con 0x7fcc800cae90 2023-07-09T02:23:27.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.871+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 <== mon.0 v2:172.21.15.45:3300/0 7 ==== osd_map(189..189 src has 1..189) v4 ==== 296+0+0 (secure 0 0 0) 0x7fcc680f2630 con 0x7fcc800cae90 2023-07-09T02:23:27.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.871+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=190}) v3 -- 0x7fcc6006c420 con 0x7fcc800cae90 2023-07-09T02:23:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.875+0000 7fcc76ffd640 1 -- 172.21.15.45:0/3058322248 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v189) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcc680b2030 con 0x7fcc800cae90 2023-07-09T02:23:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-07-09T02:23:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc600662b0 msgr2=0x7fcc60068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc600662b0 0x7fcc60068760 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcc70001060 tx=0x7fcc70007900 comp rx=0 tx=0).stop 2023-07-09T02:23:27.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc800cae90 msgr2=0x7fcc8014ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc800cae90 0x7fcc8014ac90 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009a00 tx=0x7fcc6c005800 comp rx=0 tx=0).stop 2023-07-09T02:23:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 shutdown_connections 2023-07-09T02:23:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fcc600662b0 0x7fcc60068760 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc8014b1d0 0x7fcc80149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc800cae90 0x7fcc8014ac90 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 --2- 172.21.15.45:0/3058322248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc6c0043b0 0x7fcc801f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 >> 172.21.15.45:0/3058322248 conn(0x7fcc800cf490 msgr2=0x7fcc800b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:27.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 shutdown_connections 2023-07-09T02:23:27.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:27.883+0000 7fcc84d8f640 1 -- 172.21.15.45:0/3058322248 wait complete. 2023-07-09T02:23:27.907 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T02:23:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02d1959640 1 Processor -- start 2023-07-09T02:23:28.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02d1959640 1 -- start start 2023-07-09T02:23:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02d1959640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc15c060 0x7f02cc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02d1959640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02cc0cd120 0x7f02cc0d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02d1959640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc160a50 con 0x7f02cc0d2450 2023-07-09T02:23:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02d1959640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02cc0d28f0 con 0x7f02cc0cd120 2023-07-09T02:23:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02d1959640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0cfe40 con 0x7f02cc15c060 2023-07-09T02:23:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02c3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02cc0cd120 0x7f02cc0d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02caffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc15c060 0x7f02cc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02c3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02cc0cd120 0x7f02cc0d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:53716/0 (socket says 172.21.15.45:53716) 2023-07-09T02:23:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02c3fff640 1 -- 172.21.15.45:0/2583815127 learned_addr learned my addr 172.21.15.45:0/2583815127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.051+0000 7f02cb7fe640 1 --1- 172.21.15.45:0/2583815127 >> v1:172.21.15.155:6789/0 conn(0x7f02cc0d2450 0x7f02cc0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:38772/0 (socket says 172.21.15.45:38772) 2023-07-09T02:23:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02c3fff640 1 -- 172.21.15.45:0/2583815127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc15c060 msgr2=0x7f02cc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:28.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02c3fff640 1 --2- 172.21.15.45:0/2583815127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc15c060 0x7f02cc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02c3fff640 1 -- 172.21.15.45:0/2583815127 >> v1:172.21.15.155:6789/0 conn(0x7f02cc0d2450 legacy=0x7f02cc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02c3fff640 1 -- 172.21.15.45:0/2583815127 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc15c430 con 0x7f02cc0cd120 2023-07-09T02:23:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02ca7fc640 1 -- 172.21.15.45:0/2583815127 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641090915 0 0) 0x7f02cc160a50 con 0x7f02cc0d2450 2023-07-09T02:23:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02caffd640 1 --2- 172.21.15.45:0/2583815127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc15c060 0x7f02cc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:23:28.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02c3fff640 1 --2- 172.21.15.45:0/2583815127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 0x7f02cc0d1f10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009870 tx=0x7f02b401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4d65d3877c0194 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:28.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02ca7fc640 1 -- 172.21.15.45:0/2583815127 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40a7070 con 0x7f02cc0cd120 2023-07-09T02:23:28.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02ca7fc640 1 -- 172.21.15.45:0/2583815127 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b40ab430 con 0x7f02cc0cd120 2023-07-09T02:23:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02ca7fc640 1 -- 172.21.15.45:0/2583815127 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40ab7c0 con 0x7f02cc0cd120 2023-07-09T02:23:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.055+0000 7f02d1959640 1 -- 172.21.15.45:0/2583815127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 msgr2=0x7f02cc0d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 --2- 172.21.15.45:0/2583815127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 0x7f02cc0d1f10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009870 tx=0x7f02b401c510 comp rx=0 tx=0).stop 2023-07-09T02:23:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 -- 172.21.15.45:0/2583815127 shutdown_connections 2023-07-09T02:23:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 --2- 172.21.15.45:0/2583815127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 0x7f02cc0d1f10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 --2- 172.21.15.45:0/2583815127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc15c060 0x7f02cc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 -- 172.21.15.45:0/2583815127 >> 172.21.15.45:0/2583815127 conn(0x7f02cc0698e0 msgr2=0x7f02cc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 -- 172.21.15.45:0/2583815127 shutdown_connections 2023-07-09T02:23:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 -- 172.21.15.45:0/2583815127 wait complete. 2023-07-09T02:23:28.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 Processor -- start 2023-07-09T02:23:28.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 -- start start 2023-07-09T02:23:28.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 0x7f02cc0b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc0d2450 0x7f02cc15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02cc15c060 0x7f02cc0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0b3280 con 0x7f02cc15c060 2023-07-09T02:23:28.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0b3560 con 0x7f02cc0cd120 2023-07-09T02:23:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02d1959640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc15dc00 con 0x7f02cc0d2450 2023-07-09T02:23:28.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02cc15c060 0x7f02cc0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02cb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02cc15c060 0x7f02cc0ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50020/0 (socket says 172.21.15.45:50020) 2023-07-09T02:23:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02cb7fe640 1 -- 172.21.15.45:0/438203936 learned_addr learned my addr 172.21.15.45:0/438203936 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02c3fff640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc0d2450 0x7f02cc15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02caffd640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 0x7f02cc0b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02cb7fe640 1 -- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc0d2450 msgr2=0x7f02cc15e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02cb7fe640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc0d2450 0x7f02cc15e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02cb7fe640 1 -- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 msgr2=0x7f02cc0b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02cb7fe640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 0x7f02cc0b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.059+0000 7f02cb7fe640 1 -- 172.21.15.45:0/438203936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc009420 con 0x7f02cc15c060 2023-07-09T02:23:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02cb7fe640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02cc15c060 0x7f02cc0ca6d0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f02c4001570 tx=0x7f02c400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02c8ff9640 1 -- 172.21.15.45:0/438203936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c400a640 con 0x7f02cc15c060 2023-07-09T02:23:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02c8ff9640 1 -- 172.21.15.45:0/438203936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c400a7c0 con 0x7f02cc15c060 2023-07-09T02:23:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02c8ff9640 1 -- 172.21.15.45:0/438203936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c400ab70 con 0x7f02cc15c060 2023-07-09T02:23:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b40094d0 con 0x7f02cc15c060 2023-07-09T02:23:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc15e1c0 con 0x7f02cc15c060 2023-07-09T02:23:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc04d7d0 con 0x7f02cc15c060 2023-07-09T02:23:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02c8ff9640 1 -- 172.21.15.45:0/438203936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02c400acd0 con 0x7f02cc15c060 2023-07-09T02:23:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02c8ff9640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02b0066280 0x7f02b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02c8ff9640 1 -- 172.21.15.45:0/438203936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f02c4082fc0 con 0x7f02cc15c060 2023-07-09T02:23:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.063+0000 7f02caffd640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02b0066280 0x7f02b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.067+0000 7f02caffd640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02b0066280 0x7f02b0068730 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009c50 tx=0x7f02bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:28.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.067+0000 7f02c8ff9640 1 -- 172.21.15.45:0/438203936 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02c4050770 con 0x7f02cc15c060 2023-07-09T02:23:28.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.223+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f02cc06baa0 con 0x7f02cc15c060 2023-07-09T02:23:28.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.227+0000 7f02c8ff9640 1 -- 172.21.15.45:0/438203936 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f02c40180a0 con 0x7f02cc15c060 2023-07-09T02:23:28.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02b0066280 msgr2=0x7f02b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02b0066280 0x7f02b0068730 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009c50 tx=0x7f02bc009190 comp rx=0 tx=0).stop 2023-07-09T02:23:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02cc15c060 msgr2=0x7f02cc0ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02cc15c060 0x7f02cc0ca6d0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f02c4001570 tx=0x7f02c400cca0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 shutdown_connections 2023-07-09T02:23:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02cc15c060 0x7f02cc0ca6d0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f02b0066280 0x7f02b0068730 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02cc0d2450 0x7f02cc15e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 --2- 172.21.15.45:0/438203936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02cc0cd120 0x7f02cc0b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 >> 172.21.15.45:0/438203936 conn(0x7f02cc0698e0 msgr2=0x7f02cc0b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:28.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 shutdown_connections 2023-07-09T02:23:28.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.231+0000 7f02d1959640 1 -- 172.21.15.45:0/438203936 wait complete. 2023-07-09T02:23:28.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-07-09T02:23:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f9073340640 1 Processor -- start 2023-07-09T02:23:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f9073340640 1 -- start start 2023-07-09T02:23:28.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f9073340640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f906c0c8d10 0x7f906c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f9073340640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c06bf30 con 0x7f906c15db00 2023-07-09T02:23:28.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f9073340640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c06bc50 con 0x7f906c0ca0f0 2023-07-09T02:23:28.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f9073340640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c0cab90 con 0x7f906c0c8d10 2023-07-09T02:23:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f90718dd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f906c15db00 0x7f906c06b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49620/0 (socket says 172.21.15.45:49620) 2023-07-09T02:23:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f90718dd640 1 -- 172.21.15.45:0/1892664324 learned_addr learned my addr 172.21.15.45:0/1892664324 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.395+0000 7f90708db640 1 --2- 172.21.15.45:0/1892664324 >> v2:172.21.15.155:3300/0 conn(0x7f906c0c8d10 0x7f906c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f9063fff640 1 -- 172.21.15.45:0/1892664324 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976316044 0 0) 0x7f906c06bf30 con 0x7f906c15db00 2023-07-09T02:23:28.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f9063fff640 1 -- 172.21.15.45:0/1892664324 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9058003530 con 0x7f906c15db00 2023-07-09T02:23:28.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f9063fff640 1 -- 172.21.15.45:0/1892664324 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033696123 0 0) 0x7f906c06bc50 con 0x7f906c0ca0f0 2023-07-09T02:23:28.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f9063fff640 1 -- 172.21.15.45:0/1892664324 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906c06bf30 con 0x7f906c0ca0f0 2023-07-09T02:23:28.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f90708db640 1 -- 172.21.15.45:0/1892664324 >> v1:172.21.15.155:6789/0 conn(0x7f906c0ca0f0 legacy=0x7f906c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f90708db640 1 -- 172.21.15.45:0/1892664324 >> v1:172.21.15.45:6789/0 conn(0x7f906c15db00 legacy=0x7f906c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f90708db640 1 -- 172.21.15.45:0/1892664324 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c0cae70 con 0x7f906c0c8d10 2023-07-09T02:23:28.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f90708db640 1 --2- 172.21.15.45:0/1892664324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c0c8d10 0x7f906c0c9160 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f905c0097c0 tx=0x7f905c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72f9e9a31f065ca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:28.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f9063fff640 1 -- 172.21.15.45:0/1892664324 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0ab610 con 0x7f906c0c8d10 2023-07-09T02:23:28.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f9063fff640 1 -- 172.21.15.45:0/1892664324 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c0ab770 con 0x7f906c0c8d10 2023-07-09T02:23:28.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.399+0000 7f9063fff640 1 -- 172.21.15.45:0/1892664324 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0abae0 con 0x7f906c0c8d10 2023-07-09T02:23:28.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- 172.21.15.45:0/1892664324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c0c8d10 msgr2=0x7f906c0c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 --2- 172.21.15.45:0/1892664324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c0c8d10 0x7f906c0c9160 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f905c0097c0 tx=0x7f905c01c3f0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- 172.21.15.45:0/1892664324 shutdown_connections 2023-07-09T02:23:28.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 --2- 172.21.15.45:0/1892664324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c0c8d10 0x7f906c0c9160 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- 172.21.15.45:0/1892664324 >> 172.21.15.45:0/1892664324 conn(0x7f906c0694b0 msgr2=0x7f906c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:28.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- 172.21.15.45:0/1892664324 shutdown_connections 2023-07-09T02:23:28.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- 172.21.15.45:0/1892664324 wait complete. 2023-07-09T02:23:28.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 Processor -- start 2023-07-09T02:23:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- start start 2023-07-09T02:23:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0c8d10 0x7f906c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c0ca0f0 0x7f906c14fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c15db00 0x7f906c14ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c0c7a30 con 0x7f906c0c8d10 2023-07-09T02:23:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c14f820 con 0x7f906c0ca0f0 2023-07-09T02:23:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f9073340640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c0c6eb0 con 0x7f906c15db00 2023-07-09T02:23:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f90710dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0c8d10 0x7f906c14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f90710dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0c8d10 0x7f906c14f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50022/0 (socket says 172.21.15.45:50022) 2023-07-09T02:23:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f90710dc640 1 -- 172.21.15.45:0/3933876762 learned_addr learned my addr 172.21.15.45:0/3933876762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f90710dc640 1 -- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c15db00 msgr2=0x7f906c14ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f90710dc640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c15db00 0x7f906c14ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f90710dc640 1 -- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c0ca0f0 msgr2=0x7f906c14fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f90710dc640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c0ca0f0 0x7f906c14fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.403+0000 7f90710dc640 1 -- 172.21.15.45:0/3933876762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c009420 con 0x7f906c0c8d10 2023-07-09T02:23:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f90710dc640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0c8d10 0x7f906c14f2e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f906800c500 tx=0x7f906800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f9061ffb640 1 -- 172.21.15.45:0/3933876762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680052d0 con 0x7f906c0c8d10 2023-07-09T02:23:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f9061ffb640 1 -- 172.21.15.45:0/3933876762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068005450 con 0x7f906c0c8d10 2023-07-09T02:23:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f9061ffb640 1 -- 172.21.15.45:0/3933876762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068012870 con 0x7f906c0c8d10 2023-07-09T02:23:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906c0c7190 con 0x7f906c0c8d10 2023-07-09T02:23:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906c0c7750 con 0x7f906c0c8d10 2023-07-09T02:23:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906c04d7d0 con 0x7f906c0c8d10 2023-07-09T02:23:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f9061ffb640 1 -- 172.21.15.45:0/3933876762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90680129d0 con 0x7f906c0c8d10 2023-07-09T02:23:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.407+0000 7f9061ffb640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f90500662b0 0x7f9050068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.411+0000 7f9061ffb640 1 -- 172.21.15.45:0/3933876762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9068083690 con 0x7f906c0c8d10 2023-07-09T02:23:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.411+0000 7f90708db640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f90500662b0 0x7f9050068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:28.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.411+0000 7f90708db640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f90500662b0 0x7f9050068760 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f905c0af000 tx=0x7f905c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.411+0000 7f9061ffb640 1 -- 172.21.15.45:0/3933876762 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9068050da0 con 0x7f906c0c8d10 2023-07-09T02:23:28.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.619+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f906c06b080 con 0x7f906c0c8d10 2023-07-09T02:23:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.887+0000 7f9061ffb640 1 -- 172.21.15.45:0/3933876762 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v591) v1 ==== 135+0+0 (secure 0 0 0) 0x7f90680543c0 con 0x7f906c0c8d10 2023-07-09T02:23:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f90500662b0 msgr2=0x7f9050068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f90500662b0 0x7f9050068760 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f905c0af000 tx=0x7f905c004740 comp rx=0 tx=0).stop 2023-07-09T02:23:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0c8d10 msgr2=0x7f906c14f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:28.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0c8d10 0x7f906c14f2e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f906800c500 tx=0x7f906800c9c0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 shutdown_connections 2023-07-09T02:23:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f90500662b0 0x7f9050068760 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f906c15db00 0x7f906c14ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f906c0ca0f0 0x7f906c14fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 --2- 172.21.15.45:0/3933876762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0c8d10 0x7f906c14f2e0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 >> 172.21.15.45:0/3933876762 conn(0x7f906c0694b0 msgr2=0x7f906c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 shutdown_connections 2023-07-09T02:23:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:28.891+0000 7f9073340640 1 -- 172.21.15.45:0/3933876762 wait complete. 2023-07-09T02:23:28.913 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-07-09T02:23:28.913 INFO:tasks.cephfs_test_runner: 2023-07-09T02:23:28.913 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-09T02:23:28.914 INFO:tasks.cephfs_test_runner:Ran 10 tests in 701.630s 2023-07-09T02:23:28.914 INFO:tasks.cephfs_test_runner: 2023-07-09T02:23:28.914 INFO:tasks.cephfs_test_runner:OK 2023-07-09T02:23:28.914 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-09T02:23:28.924 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-09T02:23:28.993 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-09T02:23:28.993 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:23:28.993 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:29.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:23:29.003 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-07-09T02:23:29.003 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:29.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357860k,nr_inodes=4089465,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T02:23:29.055 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:23:29.056 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:29.066 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:23:29.067 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-07-09T02:23:29.067 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T02:23:29.117 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354768k,nr_inodes=4088692,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17680 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T02:23:29.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.118 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:23:29.127 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T02:23:29.127 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T02:23:29.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.129 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T02:23:29.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.194 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T02:23:29.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-07-09T02:23:29.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.447 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-07-09T02:23:29.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-07-09T02:23:29.523 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-07-09T02:23:29.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:23:29.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.525 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:23:29.536 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T02:23:29.537 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T02:23:29.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T02:23:29.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.603 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T02:23:29.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.692 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-07-09T02:23:29.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.855 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2023-07-09T02:23:29.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T02:23:29.866 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2023-07-09T02:23:29.940 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2023-07-09T02:23:29.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:23:29.942 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-09T02:23:29.952 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-09T02:23:29.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:23:30.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.095+0000 7ff8e9759640 1 Processor -- start 2023-07-09T02:23:30.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.095+0000 7ff8e9759640 1 -- start start 2023-07-09T02:23:30.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e9759640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8e415c060 0x7ff8e40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e9759640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8e40d2620 0x7ff8e40cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e9759640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e4160a50 con 0x7ff8e40cd120 2023-07-09T02:23:30.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e9759640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e415c430 con 0x7ff8e415c060 2023-07-09T02:23:30.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e9759640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e415fb60 con 0x7ff8e40d2620 2023-07-09T02:23:30.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8e415c060 0x7ff8e40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8dbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff8e40cd120 0x7ff8e40d1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49622/0 (socket says 172.21.15.45:49622) 2023-07-09T02:23:30.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8dbfff640 1 -- 172.21.15.45:0/2171381566 learned_addr learned my addr 172.21.15.45:0/2171381566 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:30.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e37fe640 1 --2- 172.21.15.45:0/2171381566 >> v2:172.21.15.155:3300/0 conn(0x7ff8e40d2620 0x7ff8e40cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e2ffd640 1 -- 172.21.15.45:0/2171381566 >> v2:172.21.15.155:3300/0 conn(0x7ff8e40d2620 msgr2=0x7ff8e40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:30.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e2ffd640 1 --2- 172.21.15.45:0/2171381566 >> v2:172.21.15.155:3300/0 conn(0x7ff8e40d2620 0x7ff8e40cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e2ffd640 1 -- 172.21.15.45:0/2171381566 >> v1:172.21.15.45:6789/0 conn(0x7ff8e40cd120 legacy=0x7ff8e40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e2ffd640 1 -- 172.21.15.45:0/2171381566 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e415fe40 con 0x7ff8e415c060 2023-07-09T02:23:30.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e37fe640 1 --2- 172.21.15.45:0/2171381566 >> v2:172.21.15.155:3300/0 conn(0x7ff8e40d2620 0x7ff8e40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:30.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.099+0000 7ff8e2ffd640 1 --2- 172.21.15.45:0/2171381566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e415c060 0x7ff8e40b4ed0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7ff8e408bca0 tx=0x7ff8d401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155effa74a48f47e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e27fc640 1 -- 172.21.15.45:0/2171381566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40a7070 con 0x7ff8e415c060 2023-07-09T02:23:30.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e27fc640 1 -- 172.21.15.45:0/2171381566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d40ab430 con 0x7ff8e415c060 2023-07-09T02:23:30.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e27fc640 1 -- 172.21.15.45:0/2171381566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40ab7c0 con 0x7ff8e415c060 2023-07-09T02:23:30.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- 172.21.15.45:0/2171381566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e415c060 msgr2=0x7ff8e40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2171381566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e415c060 0x7ff8e40b4ed0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7ff8e408bca0 tx=0x7ff8d401c430 comp rx=0 tx=0).stop 2023-07-09T02:23:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- 172.21.15.45:0/2171381566 shutdown_connections 2023-07-09T02:23:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2171381566 >> v2:172.21.15.155:3300/0 conn(0x7ff8e40d2620 0x7ff8e40cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2171381566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e415c060 0x7ff8e40b4ed0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- 172.21.15.45:0/2171381566 >> 172.21.15.45:0/2171381566 conn(0x7ff8e40698e0 msgr2=0x7ff8e4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- 172.21.15.45:0/2171381566 shutdown_connections 2023-07-09T02:23:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- 172.21.15.45:0/2171381566 wait complete. 2023-07-09T02:23:30.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 Processor -- start 2023-07-09T02:23:30.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- start start 2023-07-09T02:23:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8e40cd120 0x7ff8e40cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40d2620 0x7ff8e4166950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e415c060 0x7ff8e415e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e415de20 con 0x7ff8e40d2620 2023-07-09T02:23:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40c98a0 con 0x7ff8e40cd120 2023-07-09T02:23:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8e9759640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e415d4f0 con 0x7ff8e415c060 2023-07-09T02:23:30.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8dbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40d2620 0x7ff8e4166950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8dbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40d2620 0x7ff8e4166950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50036/0 (socket says 172.21.15.45:50036) 2023-07-09T02:23:30.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.103+0000 7ff8dbfff640 1 -- 172.21.15.45:0/2592681275 learned_addr learned my addr 172.21.15.45:0/2592681275 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8e2ffd640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8e40cd120 0x7ff8e40cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8e37fe640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e415c060 0x7ff8e415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8dbfff640 1 -- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e415c060 msgr2=0x7ff8e415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8dbfff640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e415c060 0x7ff8e415e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8dbfff640 1 -- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8e40cd120 msgr2=0x7ff8e40cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8dbfff640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8e40cd120 0x7ff8e40cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8dbfff640 1 -- 172.21.15.45:0/2592681275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4009420 con 0x7ff8e40d2620 2023-07-09T02:23:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8dbfff640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40d2620 0x7ff8e4166950 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00c4d0 tx=0x7ff8cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8db7fe640 1 -- 172.21.15.45:0/2592681275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc005cf0 con 0x7ff8e40d2620 2023-07-09T02:23:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8db7fe640 1 -- 172.21.15.45:0/2592681275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc005e50 con 0x7ff8e40d2620 2023-07-09T02:23:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8db7fe640 1 -- 172.21.15.45:0/2592681275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc007270 con 0x7ff8e40d2620 2023-07-09T02:23:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e40b59f0 con 0x7ff8e40d2620 2023-07-09T02:23:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e415dab0 con 0x7ff8e40d2620 2023-07-09T02:23:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e404d7d0 con 0x7ff8e40d2620 2023-07-09T02:23:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8db7fe640 1 -- 172.21.15.45:0/2592681275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8cc0073d0 con 0x7ff8e40d2620 2023-07-09T02:23:30.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8db7fe640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8c40662b0 0x7ff8c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.107+0000 7ff8db7fe640 1 -- 172.21.15.45:0/2592681275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff8cc082eb0 con 0x7ff8e40d2620 2023-07-09T02:23:30.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.111+0000 7ff8e2ffd640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8c40662b0 0x7ff8c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.111+0000 7ff8e2ffd640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8c40662b0 0x7ff8c4068760 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40af000 tx=0x7ff8d40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.111+0000 7ff8db7fe640 1 -- 172.21.15.45:0/2592681275 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8cc050660 con 0x7ff8e40d2620 2023-07-09T02:23:30.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.263+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8e40b5870 con 0x7ff8c40662b0 2023-07-09T02:23:30.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8db7fe640 1 -- 172.21.15.45:0/2592681275 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70201 (secure 0 0 0) 0x7ff8d40aba00 con 0x7ff8c40662b0 2023-07-09T02:23:30.269 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:30.269 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:23:30.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8c40662b0 msgr2=0x7ff8c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8c40662b0 0x7ff8c4068760 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40af000 tx=0x7ff8d40a7000 comp rx=0 tx=0).stop 2023-07-09T02:23:30.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40d2620 msgr2=0x7ff8e4166950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40d2620 0x7ff8e4166950 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00c4d0 tx=0x7ff8cc00c990 comp rx=0 tx=0).stop 2023-07-09T02:23:30.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 shutdown_connections 2023-07-09T02:23:30.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff8c40662b0 0x7ff8c4068760 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8e415c060 0x7ff8e415e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40d2620 0x7ff8e4166950 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 --2- 172.21.15.45:0/2592681275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8e40cd120 0x7ff8e40cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 >> 172.21.15.45:0/2592681275 conn(0x7ff8e40698e0 msgr2=0x7ff8e4069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:30.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 shutdown_connections 2023-07-09T02:23:30.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.267+0000 7ff8e9759640 1 -- 172.21.15.45:0/2592681275 wait complete. 2023-07-09T02:23:30.289 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2023-07-09T02:23:28.709671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450086,"statfs":{"total":1600000000,"available":1484888872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489007,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.218702"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":457,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.875451+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:23:24.875451+0000","last_peered":"2023-07-09T02:23:24.875451+0000","last_clean":"2023-07-09T02:23:24.875451+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:23:24.875451+0000","last_undegraded":"2023-07-09T02:23:24.875451+0000","last_fullsized":"2023-07-09T02:23:24.875451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:06:13.823694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":344,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.873504+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:23:24.873504+0000","last_peered":"2023-07-09T02:23:24.873504+0000","last_clean":"2023-07-09T02:23:24.873504+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:23:24.873504+0000","last_undegraded":"2023-07-09T02:23:24.873504+0000","last_fullsized":"2023-07-09T02:23:24.873504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:24:38.386007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":303,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.875153+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:23:24.875153+0000","last_peered":"2023-07-09T02:23:24.875153+0000","last_clean":"2023-07-09T02:23:24.875153+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:23:24.875153+0000","last_undegraded":"2023-07-09T02:23:24.875153+0000","last_fullsized":"2023-07-09T02:23:24.875153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:15:44.413331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":304,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.869463+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:23:24.869463+0000","last_peered":"2023-07-09T02:23:24.869463+0000","last_clean":"2023-07-09T02:23:24.869463+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:23:24.869463+0000","last_undegraded":"2023-07-09T02:23:24.869463+0000","last_fullsized":"2023-07-09T02:23:24.869463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:20:36.224469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":344,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.875023+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:23:24.875023+0000","last_peered":"2023-07-09T02:23:24.875023+0000","last_clean":"2023-07-09T02:23:24.875023+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:23:24.875023+0000","last_undegraded":"2023-07-09T02:23:24.875023+0000","last_fullsized":"2023-07-09T02:23:24.875023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:36:26.325454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":322,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.871974+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:23:24.871974+0000","last_peered":"2023-07-09T02:23:24.871974+0000","last_clean":"2023-07-09T02:23:24.871974+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:23:24.871974+0000","last_undegraded":"2023-07-09T02:23:24.871974+0000","last_fullsized":"2023-07-09T02:23:24.871974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:22:43.810872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":304,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.875047+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:23:24.875047+0000","last_peered":"2023-07-09T02:23:24.875047+0000","last_clean":"2023-07-09T02:23:24.875047+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:23:24.875047+0000","last_undegraded":"2023-07-09T02:23:24.875047+0000","last_fullsized":"2023-07-09T02:23:24.875047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:05:17.334817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":322,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.870755+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:23:24.870755+0000","last_peered":"2023-07-09T02:23:24.870755+0000","last_clean":"2023-07-09T02:23:24.870755+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:23:24.870755+0000","last_undegraded":"2023-07-09T02:23:24.870755+0000","last_fullsized":"2023-07-09T02:23:24.870755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:07.328708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":300,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.873779+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:23:24.873779+0000","last_peered":"2023-07-09T02:23:24.873779+0000","last_clean":"2023-07-09T02:23:24.873779+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:23:24.873779+0000","last_undegraded":"2023-07-09T02:23:24.873779+0000","last_fullsized":"2023-07-09T02:23:24.873779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:54:14.947149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9857,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185455,"statfs":{"total":200000000,"available":189905998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.66500000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94499999999999995,"5min":0.97399999999999998,"15min":1.4950000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.623,"5min":0.435,"15min":0.35599999999999998},"max":{"1min":0.95399999999999996,"5min":1.0049999999999999,"15min":1.2110000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54100000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.423},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.70099999999999996,"15min":0.80400000000000005},"min":{"1min":0.55900000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":29.498999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":5.0460000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.81200000000000006},"min":{"1min":0.61499999999999999,"5min":0.45900000000000002,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":26.524000000000001},"last":0.622}]},{"osd":3,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.70799999999999996},"min":{"1min":0.54600000000000004,"5min":0.438,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":4.3789999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":10.609999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.38100000000000001},"max":{"1min":0.873,"5min":0.93799999999999994,"15min":1.032},"last":0.75900000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.92600000000000005,"15min":1.048},"last":0.84999999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.087},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.81899999999999995,"5min":0.91900000000000004,"15min":1.1639999999999999},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190121,"statfs":{"total":200000000,"available":194684236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71199999999999997,"15min":0.68200000000000005},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.58399999999999996,"5min":0.49299999999999999,"15min":0.36199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0269999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.4379999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.036,"15min":1.165},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":1.002,"5min":1.01,"15min":1.01},"last":0.754},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.66600000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.0740000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48799999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.45},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.70799999999999996},"min":{"1min":0.60799999999999998,"5min":0.498,"15min":0.45700000000000002},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":1.6499999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.117},"last":0.81299999999999994}]},{"osd":5,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.6060000000000001},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65500000000000003,"15min":0.68000000000000005},"min":{"1min":0.48499999999999999,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":0.85599999999999998,"5min":0.94199999999999995,"15min":1.4059999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":1.0289999999999999},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190121,"statfs":{"total":200000000,"available":194683910,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72399999999999998,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.49399999999999999,"15min":0.40699999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.248},"last":0.871},{"interface":"front","average":{"1min":0.749,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.32800000000000001},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.54300000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.39900000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.753},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.68700000000000006},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":0.97299999999999998},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.747,"15min":0.71599999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.432},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.56999999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.52000000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.522,"5min":1.522,"15min":5.1989999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.47399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.008},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61099999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.374},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.58899999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.38800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.66100000000000003},"min":{"1min":0.52400000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.497,"15min":0.437},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":27719,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":167592,"statfs":{"total":200000000,"available":171614800,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.86199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.27300000000000002},"max":{"1min":0.89900000000000002,"5min":0.93799999999999994,"15min":50.508000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.51900000000000002,"5min":0.39800000000000002,"15min":0.376},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69299999999999995,"15min":0.68200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.34100000000000003},"max":{"1min":0.92100000000000004,"5min":1.024,"15min":8.6039999999999992},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.753}]},{"osd":2,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71999999999999997,"15min":0.68999999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.502,"15min":0.39500000000000002},"max":{"1min":0.89000000000000001,"5min":0.997,"15min":1.323},"last":0.54200000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.71199999999999997},"min":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.97299999999999998},"min":{"1min":0.46400000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96499999999999997,"5min":1.073,"15min":71.909000000000006},"last":0.73799999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60799999999999998},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.317},"max":{"1min":0.88,"5min":0.88,"15min":1.0169999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80500000000000005,"5min":0.92100000000000004,"15min":0.95399999999999996},"last":0.50800000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59699999999999998,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90900000000000003,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.75700000000000001,"5min":0.94099999999999995,"15min":1.0529999999999999},"last":0.626}]},{"osd":7,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":0.93100000000000005,"15min":1.0329999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.72099999999999997},"min":{"1min":0.434,"5min":0.40300000000000002,"15min":0.33200000000000002},"max":{"1min":0.90500000000000003,"5min":0.995,"15min":8.0359999999999996},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574998,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21633,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173678,"statfs":{"total":200000000,"available":177847209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.32900000000000001,"5min":0.217,"15min":0.216},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.96499999999999997},"last":0.249},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.28499999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.198},"last":0.309}]},{"osd":1,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":1.048},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69899999999999995,"5min":0.76000000000000001,"15min":0.85299999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":1.155},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":1.1040000000000001},"last":0.432}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.65200000000000002,"5min":0.502,"15min":0.45300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.466},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.3560000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.61799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.155,"15min":1.3420000000000001},"last":0.879},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.008,"5min":1.054,"15min":1.2909999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.71199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.4350000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.5569999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0229999999999999,"5min":1.131,"15min":1.367},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.63300000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98399999999999999,"5min":1.0980000000000001,"15min":1.2569999999999999},"last":0.94199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574998,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181935,"statfs":{"total":200000000,"available":186301860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.624,"5min":0.84299999999999997,"15min":7.7450000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.49099999999999999,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.72599999999999998,"5min":0.78700000000000003,"15min":1.127},"last":0.34899999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":2.8879999999999999},"last":0.373},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58399999999999996,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72299999999999998,"5min":0.90500000000000003,"15min":2.0600000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.755,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.58199999999999996,"5min":0.875,"15min":7.8710000000000004},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1140000000000001,"5min":1.218,"15min":7.7990000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.75800000000000001},"min":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.47899999999999998},"max":{"1min":0.99199999999999999,"5min":1.046,"15min":1.821},"last":0.745}]},{"osd":5,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.496},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.046,"5min":1.093,"15min":7.8369999999999997},"last":0.72699999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.48299999999999998},"max":{"1min":1.0680000000000001,"5min":1.3029999999999999,"15min":1.9790000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.82199999999999995},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.51500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.452},"last":0.80600000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.165,"15min":1.9379999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81599999999999995,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.48699999999999999},"max":{"1min":1.1479999999999999,"5min":1.173,"15min":1.351},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179829,"statfs":{"total":200000000,"available":184145703,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.436,"15min":0.44500000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.64000000000000001,"15min":0.80300000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.86899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":1.1080000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85099999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.163},"last":0.46600000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78500000000000003,"15min":0.76500000000000001},"min":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.73999999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76400000000000001,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.1599999999999999},"last":0.752},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.75900000000000001,"15min":0.74399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0840000000000001,"5min":1.131,"15min":1.131},"last":0.76600000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82599999999999996,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.123,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.82099999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79500000000000004,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.57599999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1699999999999999,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.88600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181352,"statfs":{"total":200000000,"available":185705156,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.22700000000000001},"max":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.94999999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53500000000000003,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.3240000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.29899999999999999},"max":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.78300000000000003,"15min":1.4139999999999999},"last":0.28100000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74099999999999999,"5min":0.754,"15min":1.0189999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.53600000000000003},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80200000000000005,"5min":0.879,"15min":3.8929999999999998},"last":0.46300000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80800000000000005,"15min":0.77600000000000002},"min":{"1min":0.65700000000000003,"5min":0.47299999999999998,"15min":0.46600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.63300000000000001,"5min":0.54400000000000004,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.1240000000000001,"15min":1.153},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.79800000000000004},"min":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.1040000000000001,"15min":1.4350000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.79600000000000004},"min":{"1min":0.63800000000000001,"5min":0.51000000000000001,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.238},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.47799999999999998},"max":{"1min":1.0529999999999999,"5min":1.117,"15min":1.117},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.46899999999999997},"max":{"1min":1.034,"5min":1.1200000000000001,"15min":1.7789999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.49099999999999999},"max":{"1min":1.034,"5min":1.079,"15min":1.8149999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78000000000000003,"15min":0.749},"min":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.1060000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.746}]}]}],"pool_statfs":[]}} 2023-07-09T02:23:30.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:23:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.431+0000 7fc66a111640 1 Processor -- start 2023-07-09T02:23:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.431+0000 7fc66a111640 1 -- start start 2023-07-09T02:23:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.431+0000 7fc66a111640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc66415b270 0x7fc6640719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.431+0000 7fc66a111640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6640cd040 0x7fc6640cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.431+0000 7fc66a111640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640cd9e0 con 0x7fc6640afed0 2023-07-09T02:23:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.431+0000 7fc66a111640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc664071550 con 0x7fc6640cd040 2023-07-09T02:23:30.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.431+0000 7fc66a111640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66415e440 con 0x7fc66415b270 2023-07-09T02:23:30.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc663fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6640cd040 0x7fc6640cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc663fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6640cd040 0x7fc6640cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50048/0 (socket says 172.21.15.45:50048) 2023-07-09T02:23:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc663fff640 1 -- 172.21.15.45:0/1190761844 learned_addr learned my addr 172.21.15.45:0/1190761844 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc662ffd640 1 --2- 172.21.15.45:0/1190761844 >> v2:172.21.15.155:3300/0 conn(0x7fc66415b270 0x7fc6640719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc663fff640 1 -- 172.21.15.45:0/1190761844 >> v2:172.21.15.155:3300/0 conn(0x7fc66415b270 msgr2=0x7fc6640719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc663fff640 1 --2- 172.21.15.45:0/1190761844 >> v2:172.21.15.155:3300/0 conn(0x7fc66415b270 0x7fc6640719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc663fff640 1 -- 172.21.15.45:0/1190761844 >> v1:172.21.15.155:6789/0 conn(0x7fc6640afed0 legacy=0x7fc66415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc663fff640 1 -- 172.21.15.45:0/1190761844 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66415e720 con 0x7fc6640cd040 2023-07-09T02:23:30.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc663fff640 1 --2- 172.21.15.45:0/1190761844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6640cd040 0x7fc6640cd4a0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fc6640cde90 tx=0x7fc65c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1ad816a658a858 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc6627fc640 1 -- 172.21.15.45:0/1190761844 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0a5690 con 0x7fc6640cd040 2023-07-09T02:23:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc6627fc640 1 -- 172.21.15.45:0/1190761844 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c0a57f0 con 0x7fc6640cd040 2023-07-09T02:23:30.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.435+0000 7fc6627fc640 1 -- 172.21.15.45:0/1190761844 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0a5b80 con 0x7fc6640cd040 2023-07-09T02:23:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- 172.21.15.45:0/1190761844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6640cd040 msgr2=0x7fc6640cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 --2- 172.21.15.45:0/1190761844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6640cd040 0x7fc6640cd4a0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fc6640cde90 tx=0x7fc65c01c9d0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- 172.21.15.45:0/1190761844 shutdown_connections 2023-07-09T02:23:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 --2- 172.21.15.45:0/1190761844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6640cd040 0x7fc6640cd4a0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 --2- 172.21.15.45:0/1190761844 >> v2:172.21.15.155:3300/0 conn(0x7fc66415b270 0x7fc6640719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- 172.21.15.45:0/1190761844 >> 172.21.15.45:0/1190761844 conn(0x7fc66406d140 msgr2=0x7fc66406d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- 172.21.15.45:0/1190761844 shutdown_connections 2023-07-09T02:23:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- 172.21.15.45:0/1190761844 wait complete. 2023-07-09T02:23:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 Processor -- start 2023-07-09T02:23:30.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- start start 2023-07-09T02:23:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6640afed0 0x7fc664152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6640cd040 0x7fc6640ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66415b270 0x7fc6640c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640c86d0 con 0x7fc66415b270 2023-07-09T02:23:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66415a3f0 con 0x7fc6640cd040 2023-07-09T02:23:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc66a111640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc664153180 con 0x7fc6640afed0 2023-07-09T02:23:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc663fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66415b270 0x7fc6640c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc663fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66415b270 0x7fc6640c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50052/0 (socket says 172.21.15.45:50052) 2023-07-09T02:23:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc662ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6640cd040 0x7fc6640ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc663fff640 1 -- 172.21.15.45:0/2704841478 learned_addr learned my addr 172.21.15.45:0/2704841478 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:30.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc6637fe640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6640afed0 0x7fc664152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc663fff640 1 -- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6640afed0 msgr2=0x7fc664152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc663fff640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6640afed0 0x7fc664152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc663fff640 1 -- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6640cd040 msgr2=0x7fc6640ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc663fff640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6640cd040 0x7fc6640ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.439+0000 7fc663fff640 1 -- 172.21.15.45:0/2704841478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c009b30 con 0x7fc66415b270 2023-07-09T02:23:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.443+0000 7fc663fff640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66415b270 0x7fc6640c43b0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0af040 tx=0x7fc65c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.443+0000 7fc64bfff640 1 -- 172.21.15.45:0/2704841478 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0b8670 con 0x7fc66415b270 2023-07-09T02:23:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.443+0000 7fc64bfff640 1 -- 172.21.15.45:0/2704841478 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c0b87d0 con 0x7fc66415b270 2023-07-09T02:23:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.443+0000 7fc64bfff640 1 -- 172.21.15.45:0/2704841478 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0b8b80 con 0x7fc66415b270 2023-07-09T02:23:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.443+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66415a110 con 0x7fc66415b270 2023-07-09T02:23:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.443+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6640c75a0 con 0x7fc66415b270 2023-07-09T02:23:30.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.443+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6640c7120 con 0x7fc66415b270 2023-07-09T02:23:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.443+0000 7fc64bfff640 1 -- 172.21.15.45:0/2704841478 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc65c0b8ce0 con 0x7fc66415b270 2023-07-09T02:23:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.447+0000 7fc64bfff640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc650066280 0x7fc650068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.447+0000 7fc64bfff640 1 -- 172.21.15.45:0/2704841478 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc65c11f060 con 0x7fc66415b270 2023-07-09T02:23:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.447+0000 7fc6637fe640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc650066280 0x7fc650068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.447+0000 7fc6637fe640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc650066280 0x7fc650068730 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc654007fd0 tx=0x7fc654009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.451+0000 7fc64bfff640 1 -- 172.21.15.45:0/2704841478 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6640c7120 con 0x7fc66415b270 2023-07-09T02:23:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.603+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc664166f20 con 0x7fc650066280 2023-07-09T02:23:30.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.603+0000 7fc64bfff640 1 -- 172.21.15.45:0/2704841478 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70201 (secure 0 0 0) 0x7fc6540014f0 con 0x7fc650066280 2023-07-09T02:23:30.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:30.607 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:23:30.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc650066280 msgr2=0x7fc650068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc650066280 0x7fc650068730 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc654007fd0 tx=0x7fc654009040 comp rx=0 tx=0).stop 2023-07-09T02:23:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66415b270 msgr2=0x7fc6640c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66415b270 0x7fc6640c43b0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0af040 tx=0x7fc65c019770 comp rx=0 tx=0).stop 2023-07-09T02:23:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 shutdown_connections 2023-07-09T02:23:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc66415b270 0x7fc6640c43b0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6640cd040 0x7fc6640ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc650066280 0x7fc650068730 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 --2- 172.21.15.45:0/2704841478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6640afed0 0x7fc664152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 >> 172.21.15.45:0/2704841478 conn(0x7fc66406d140 msgr2=0x7fc66415c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 shutdown_connections 2023-07-09T02:23:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.607+0000 7fc66a111640 1 -- 172.21.15.45:0/2704841478 wait complete. 2023-07-09T02:23:30.628 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":552,"stamp":"2023-07-09T02:23:28.709671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450086,"statfs":{"total":1600000000,"available":1484888872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489007,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.218702"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":457,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.875451+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:23:24.875451+0000","last_peered":"2023-07-09T02:23:24.875451+0000","last_clean":"2023-07-09T02:23:24.875451+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:23:24.875451+0000","last_undegraded":"2023-07-09T02:23:24.875451+0000","last_fullsized":"2023-07-09T02:23:24.875451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:06:13.823694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":344,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.873504+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:23:24.873504+0000","last_peered":"2023-07-09T02:23:24.873504+0000","last_clean":"2023-07-09T02:23:24.873504+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:23:24.873504+0000","last_undegraded":"2023-07-09T02:23:24.873504+0000","last_fullsized":"2023-07-09T02:23:24.873504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:24:38.386007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":303,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.875153+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:23:24.875153+0000","last_peered":"2023-07-09T02:23:24.875153+0000","last_clean":"2023-07-09T02:23:24.875153+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:23:24.875153+0000","last_undegraded":"2023-07-09T02:23:24.875153+0000","last_fullsized":"2023-07-09T02:23:24.875153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:15:44.413331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":304,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.869463+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:23:24.869463+0000","last_peered":"2023-07-09T02:23:24.869463+0000","last_clean":"2023-07-09T02:23:24.869463+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:23:24.869463+0000","last_undegraded":"2023-07-09T02:23:24.869463+0000","last_fullsized":"2023-07-09T02:23:24.869463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:20:36.224469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":344,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.875023+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:23:24.875023+0000","last_peered":"2023-07-09T02:23:24.875023+0000","last_clean":"2023-07-09T02:23:24.875023+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:23:24.875023+0000","last_undegraded":"2023-07-09T02:23:24.875023+0000","last_fullsized":"2023-07-09T02:23:24.875023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:36:26.325454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":322,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.871974+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:23:24.871974+0000","last_peered":"2023-07-09T02:23:24.871974+0000","last_clean":"2023-07-09T02:23:24.871974+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:23:24.871974+0000","last_undegraded":"2023-07-09T02:23:24.871974+0000","last_fullsized":"2023-07-09T02:23:24.871974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:22:43.810872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":304,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.875047+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:23:24.875047+0000","last_peered":"2023-07-09T02:23:24.875047+0000","last_clean":"2023-07-09T02:23:24.875047+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:23:24.875047+0000","last_undegraded":"2023-07-09T02:23:24.875047+0000","last_fullsized":"2023-07-09T02:23:24.875047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:05:17.334817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":322,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.870755+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:23:24.870755+0000","last_peered":"2023-07-09T02:23:24.870755+0000","last_clean":"2023-07-09T02:23:24.870755+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:23:24.870755+0000","last_undegraded":"2023-07-09T02:23:24.870755+0000","last_fullsized":"2023-07-09T02:23:24.870755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:44:07.328708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":300,"reported_epoch":187,"state":"active+clean","last_fresh":"2023-07-09T02:23:24.873779+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:23:24.873779+0000","last_peered":"2023-07-09T02:23:24.873779+0000","last_clean":"2023-07-09T02:23:24.873779+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:23:24.873779+0000","last_undegraded":"2023-07-09T02:23:24.873779+0000","last_fullsized":"2023-07-09T02:23:24.873779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T12:54:14.947149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9857,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185455,"statfs":{"total":200000000,"available":189905998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.66500000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94499999999999995,"5min":0.97399999999999998,"15min":1.4950000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.623,"5min":0.435,"15min":0.35599999999999998},"max":{"1min":0.95399999999999996,"5min":1.0049999999999999,"15min":1.2110000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.54100000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.423},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.70099999999999996,"15min":0.80400000000000005},"min":{"1min":0.55900000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.997,"5min":0.997,"15min":29.498999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.48699999999999999,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":5.0460000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73899999999999999,"15min":0.81200000000000006},"min":{"1min":0.61499999999999999,"5min":0.45900000000000002,"15min":0.42799999999999999},"max":{"1min":0.90500000000000003,"5min":0.95099999999999996,"15min":26.524000000000001},"last":0.622}]},{"osd":3,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73699999999999999,"15min":0.70799999999999996},"min":{"1min":0.54600000000000004,"5min":0.438,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":4.3789999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.57699999999999996,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":10.609999999999999},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.38100000000000001},"max":{"1min":0.873,"5min":0.93799999999999994,"15min":1.032},"last":0.75900000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.622,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.46999999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.87,"5min":0.92600000000000005,"15min":1.048},"last":0.84999999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68400000000000005,"15min":0.71399999999999997},"min":{"1min":0.51100000000000001,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.087},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.81899999999999995,"5min":0.91900000000000004,"15min":1.1639999999999999},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190121,"statfs":{"total":200000000,"available":194684236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71199999999999997,"15min":0.68200000000000005},"min":{"1min":0.438,"5min":0.39700000000000002,"15min":0.36299999999999999},"max":{"1min":0.89100000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.58399999999999996,"5min":0.49299999999999999,"15min":0.36199999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0269999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.71499999999999997},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.88100000000000001,"5min":1.0009999999999999,"15min":1.4379999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.41999999999999998},"max":{"1min":0.88300000000000001,"5min":1.036,"15min":1.165},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.71199999999999997},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.46600000000000003},"max":{"1min":1.002,"5min":1.01,"15min":1.01},"last":0.754},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.66600000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.0740000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48799999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.45},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.70799999999999996},"min":{"1min":0.60799999999999998,"5min":0.498,"15min":0.45700000000000002},"max":{"1min":0.92400000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60099999999999998,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.35099999999999998},"max":{"1min":0.91300000000000003,"5min":0.92200000000000004,"15min":1.6499999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.47399999999999998,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.117},"last":0.81299999999999994}]},{"osd":5,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.78500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.47799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":1.6060000000000001},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65500000000000003,"15min":0.68000000000000005},"min":{"1min":0.48499999999999999,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":0.85599999999999998,"5min":0.94199999999999995,"15min":1.4059999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.67800000000000005},"min":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":1.0289999999999999},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5191,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190121,"statfs":{"total":200000000,"available":194683910,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72399999999999998,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.49399999999999999,"15min":0.40699999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.248},"last":0.871},{"interface":"front","average":{"1min":0.749,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.32800000000000001},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.54300000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.39900000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.753},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.68700000000000006},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":0.97299999999999998},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.747,"15min":0.71599999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.432},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.56999999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.52000000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.522,"5min":1.522,"15min":5.1989999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.47399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.008},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61099999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.374},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.58899999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.38800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.66100000000000003},"min":{"1min":0.52400000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.497,"15min":0.437},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":27719,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":167592,"statfs":{"total":200000000,"available":171614800,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.86199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.27300000000000002},"max":{"1min":0.89900000000000002,"5min":0.93799999999999994,"15min":50.508000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.51900000000000002,"5min":0.39800000000000002,"15min":0.376},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69299999999999995,"15min":0.68200000000000005},"min":{"1min":0.41299999999999998,"5min":0.38,"15min":0.34100000000000003},"max":{"1min":0.92100000000000004,"5min":1.024,"15min":8.6039999999999992},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.72599999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92400000000000004,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.753}]},{"osd":2,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71999999999999997,"15min":0.68999999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.502,"15min":0.39500000000000002},"max":{"1min":0.89000000000000001,"5min":0.997,"15min":1.323},"last":0.54200000000000004}]},{"osd":3,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.71199999999999997},"min":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":0.94099999999999995,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.97299999999999998},"min":{"1min":0.46400000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.96499999999999997,"5min":1.073,"15min":71.909000000000006},"last":0.73799999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58599999999999997,"15min":0.60799999999999998},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.317},"max":{"1min":0.88,"5min":0.88,"15min":1.0169999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59699999999999998,"15min":0.623},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80500000000000005,"5min":0.92100000000000004,"15min":0.95399999999999996},"last":0.50800000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59699999999999998,"15min":0.628},"min":{"1min":0.46400000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.90900000000000003,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.64800000000000002,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.75700000000000001,"5min":0.94099999999999995,"15min":1.0529999999999999},"last":0.626}]},{"osd":7,"last update":"Sun Jul 9 02:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67100000000000004,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85599999999999998,"5min":0.93100000000000005,"15min":1.0329999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.72099999999999997},"min":{"1min":0.434,"5min":0.40300000000000002,"15min":0.33200000000000002},"max":{"1min":0.90500000000000003,"5min":0.995,"15min":8.0359999999999996},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574998,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21633,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173678,"statfs":{"total":200000000,"available":177847209,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.32900000000000001,"5min":0.217,"15min":0.216},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.96499999999999997},"last":0.249},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.28499999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.198},"last":0.309}]},{"osd":1,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":1.048},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69899999999999995,"5min":0.76000000000000001,"15min":0.85299999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":1.155},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":1.1040000000000001},"last":0.432}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.65200000000000002,"5min":0.502,"15min":0.45300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.466},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.3560000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.61799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.155,"15min":1.3420000000000001},"last":0.879},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.008,"5min":1.054,"15min":1.2909999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.71199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.4350000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.5569999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0229999999999999,"5min":1.131,"15min":1.367},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.63300000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98399999999999999,"5min":1.0980000000000001,"15min":1.2569999999999999},"last":0.94199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574998,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181935,"statfs":{"total":200000000,"available":186301860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.624,"5min":0.84299999999999997,"15min":7.7450000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.49099999999999999,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.72599999999999998,"5min":0.78700000000000003,"15min":1.127},"last":0.34899999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":2.8879999999999999},"last":0.373},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58399999999999996,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72299999999999998,"5min":0.90500000000000003,"15min":2.0600000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.755,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.58199999999999996,"5min":0.875,"15min":7.8710000000000004},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1140000000000001,"5min":1.218,"15min":7.7990000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.75800000000000001},"min":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.47899999999999998},"max":{"1min":0.99199999999999999,"5min":1.046,"15min":1.821},"last":0.745}]},{"osd":5,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.496},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.046,"5min":1.093,"15min":7.8369999999999997},"last":0.72699999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.48299999999999998},"max":{"1min":1.0680000000000001,"5min":1.3029999999999999,"15min":1.9790000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.82199999999999995},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.51500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.452},"last":0.80600000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.165,"15min":1.9379999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81599999999999995,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.48699999999999999},"max":{"1min":1.1479999999999999,"5min":1.173,"15min":1.351},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":15482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":179829,"statfs":{"total":200000000,"available":184145703,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.436,"15min":0.44500000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.64000000000000001,"15min":0.80300000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.86899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":1.1080000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85099999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.163},"last":0.46600000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78500000000000003,"15min":0.76500000000000001},"min":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.73999999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76400000000000001,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.1599999999999999},"last":0.752},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.75900000000000001,"15min":0.74399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0840000000000001,"5min":1.131,"15min":1.131},"last":0.76600000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82599999999999996,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.123,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.82099999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79500000000000004,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.57599999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1699999999999999,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.88600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181352,"statfs":{"total":200000000,"available":185705156,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.22700000000000001},"max":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.94999999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53500000000000003,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.3240000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.29899999999999999},"max":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.78300000000000003,"15min":1.4139999999999999},"last":0.28100000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74099999999999999,"5min":0.754,"15min":1.0189999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.53600000000000003},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80200000000000005,"5min":0.879,"15min":3.8929999999999998},"last":0.46300000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80800000000000005,"15min":0.77600000000000002},"min":{"1min":0.65700000000000003,"5min":0.47299999999999998,"15min":0.46600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.63300000000000001,"5min":0.54400000000000004,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.1240000000000001,"15min":1.153},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.79800000000000004},"min":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.1040000000000001,"15min":1.4350000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.79600000000000004},"min":{"1min":0.63800000000000001,"5min":0.51000000000000001,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.238},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.47799999999999998},"max":{"1min":1.0529999999999999,"5min":1.117,"15min":1.117},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.46899999999999997},"max":{"1min":1.034,"5min":1.1200000000000001,"15min":1.7789999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.49099999999999999},"max":{"1min":1.034,"5min":1.079,"15min":1.8149999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78000000000000003,"15min":0.749},"min":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.1060000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.746}]}]}],"pool_statfs":[]}} 2023-07-09T02:23:30.630 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-09T02:23:30.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:23:30.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba83c56640 1 Processor -- start 2023-07-09T02:23:30.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba83c56640 1 -- start start 2023-07-09T02:23:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba83c56640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba7c0c8dc0 0x7fba7c0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba83c56640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c06ef30 con 0x7fba7c1604a0 2023-07-09T02:23:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba83c56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c06b210 con 0x7fba7c0cde40 2023-07-09T02:23:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba83c56640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c06be90 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba811f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba7c0c8dc0 0x7fba7c0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba819f2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba7c1604a0 0x7fba7c164b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49638/0 (socket says 172.21.15.45:49638) 2023-07-09T02:23:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.771+0000 7fba819f2640 1 -- 172.21.15.45:0/2337821501 learned_addr learned my addr 172.21.15.45:0/2337821501 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.775+0000 7fba811f1640 1 -- 172.21.15.45:0/2337821501 >> v1:172.21.15.155:6789/0 conn(0x7fba7c0cde40 legacy=0x7fba7c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.775+0000 7fba811f1640 1 -- 172.21.15.45:0/2337821501 >> v1:172.21.15.45:6789/0 conn(0x7fba7c1604a0 legacy=0x7fba7c164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.775+0000 7fba811f1640 1 -- 172.21.15.45:0/2337821501 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c06b4f0 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.775+0000 7fba809f0640 1 -- 172.21.15.45:0/2337821501 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904821307 0 0) 0x7fba7c06ef30 con 0x7fba7c1604a0 2023-07-09T02:23:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.775+0000 7fba811f1640 1 --2- 172.21.15.45:0/2337821501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0cd900 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0097c0 tx=0x7fba6c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e088a3ccd4cc25 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.775+0000 7fba809f0640 1 -- 172.21.15.45:0/2337821501 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0ab600 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.775+0000 7fba809f0640 1 -- 172.21.15.45:0/2337821501 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c0a7050 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.775+0000 7fba809f0640 1 -- 172.21.15.45:0/2337821501 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0ab980 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- 172.21.15.45:0/2337821501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 msgr2=0x7fba7c0cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 --2- 172.21.15.45:0/2337821501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0cd900 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0097c0 tx=0x7fba6c01c480 comp rx=0 tx=0).stop 2023-07-09T02:23:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- 172.21.15.45:0/2337821501 shutdown_connections 2023-07-09T02:23:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 --2- 172.21.15.45:0/2337821501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0cd900 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- 172.21.15.45:0/2337821501 >> 172.21.15.45:0/2337821501 conn(0x7fba7c0694b0 msgr2=0x7fba7c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:30.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- 172.21.15.45:0/2337821501 shutdown_connections 2023-07-09T02:23:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- 172.21.15.45:0/2337821501 wait complete. 2023-07-09T02:23:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 Processor -- start 2023-07-09T02:23:30.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- start start 2023-07-09T02:23:30.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba7c0cde40 0x7fba7c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba7c1604a0 0x7fba7c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0aee70 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c4e80 con 0x7fba7c0cde40 2023-07-09T02:23:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba83c56640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c15c930 con 0x7fba7c1604a0 2023-07-09T02:23:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba819f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba819f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50072/0 (socket says 172.21.15.45:50072) 2023-07-09T02:23:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba819f2640 1 -- 172.21.15.45:0/2070065277 learned_addr learned my addr 172.21.15.45:0/2070065277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba821f3640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba7c1604a0 0x7fba7c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba811f1640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba7c0cde40 0x7fba7c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba819f2640 1 -- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba7c1604a0 msgr2=0x7fba7c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba819f2640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba7c1604a0 0x7fba7c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba819f2640 1 -- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba7c0cde40 msgr2=0x7fba7c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba819f2640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba7c0cde40 0x7fba7c156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.779+0000 7fba819f2640 1 -- 172.21.15.45:0/2070065277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c009420 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba819f2640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0c3f50 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fba7800c4a0 tx=0x7fba7800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba727fc640 1 -- 172.21.15.45:0/2070065277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780074e0 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba727fc640 1 -- 172.21.15.45:0/2070065277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba78007640 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba727fc640 1 -- 172.21.15.45:0/2070065277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78004a30 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0c45e0 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c0c4ba0 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c04d7d0 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba727fc640 1 -- 172.21.15.45:0/2070065277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba78004b90 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.783+0000 7fba727fc640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fba60066280 0x7fba60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.787+0000 7fba727fc640 1 -- 172.21.15.45:0/2070065277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fba78082cb0 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.787+0000 7fba811f1640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fba60066280 0x7fba60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.787+0000 7fba811f1640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fba60066280 0x7fba60068730 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0ad000 tx=0x7fba6c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:30.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.791+0000 7fba727fc640 1 -- 172.21.15.45:0/2070065277 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba78050460 con 0x7fba7c0c8dc0 2023-07-09T02:23:30.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.943+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba7c16e4d0 con 0x7fba60066280 2023-07-09T02:23:30.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba727fc640 1 -- 172.21.15.45:0/2070065277 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70110 (secure 0 0 0) 0x7fba6c0bb070 con 0x7fba60066280 2023-07-09T02:23:30.950 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:30.951 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:23:30.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fba60066280 msgr2=0x7fba60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fba60066280 0x7fba60068730 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0ad000 tx=0x7fba6c0a6000 comp rx=0 tx=0).stop 2023-07-09T02:23:30.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 msgr2=0x7fba7c0c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:30.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0c3f50 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fba7800c4a0 tx=0x7fba7800c960 comp rx=0 tx=0).stop 2023-07-09T02:23:30.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 shutdown_connections 2023-07-09T02:23:30.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fba60066280 0x7fba60068730 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba7c1604a0 0x7fba7c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba7c0cde40 0x7fba7c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 --2- 172.21.15.45:0/2070065277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba7c0c8dc0 0x7fba7c0c3f50 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:30.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 >> 172.21.15.45:0/2070065277 conn(0x7fba7c0694b0 msgr2=0x7fba7c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:30.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 shutdown_connections 2023-07-09T02:23:30.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:30.947+0000 7fba83c56640 1 -- 172.21.15.45:0/2070065277 wait complete. 2023-07-09T02:23:30.971 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2023-07-09T02:23:30.710112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10010,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552489,"statfs":{"total":1600000000,"available":1589749392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52489007,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-126,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001500"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":461,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.887489+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:23:27.887489+0000","last_peered":"2023-07-09T02:23:27.887489+0000","last_clean":"2023-07-09T02:23:27.887489+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:23:27.887489+0000","last_undegraded":"2023-07-09T02:23:27.887489+0000","last_fullsized":"2023-07-09T02:23:27.887489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:30:03.628841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":348,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.885072+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:23:27.885072+0000","last_peered":"2023-07-09T02:23:27.885072+0000","last_clean":"2023-07-09T02:23:27.885072+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:23:27.885072+0000","last_undegraded":"2023-07-09T02:23:27.885072+0000","last_fullsized":"2023-07-09T02:23:27.885072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:34:39.785096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.886836+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:23:27.886836+0000","last_peered":"2023-07-09T02:23:27.886836+0000","last_clean":"2023-07-09T02:23:27.886836+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:23:27.886836+0000","last_undegraded":"2023-07-09T02:23:27.886836+0000","last_fullsized":"2023-07-09T02:23:27.886836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:36:06.541329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":308,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.881388+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:23:27.881388+0000","last_peered":"2023-07-09T02:23:27.881388+0000","last_clean":"2023-07-09T02:23:27.881388+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:23:27.881388+0000","last_undegraded":"2023-07-09T02:23:27.881388+0000","last_fullsized":"2023-07-09T02:23:27.881388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:51:47.706423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":348,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.881509+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:23:27.881509+0000","last_peered":"2023-07-09T02:23:27.881509+0000","last_clean":"2023-07-09T02:23:27.881509+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:23:27.881509+0000","last_undegraded":"2023-07-09T02:23:27.881509+0000","last_fullsized":"2023-07-09T02:23:27.881509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T07:10:28.012793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":326,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.880352+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:23:27.880352+0000","last_peered":"2023-07-09T02:23:27.880352+0000","last_clean":"2023-07-09T02:23:27.880352+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:23:27.880352+0000","last_undegraded":"2023-07-09T02:23:27.880352+0000","last_fullsized":"2023-07-09T02:23:27.880352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:55:48.160380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":308,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.886706+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:23:27.886706+0000","last_peered":"2023-07-09T02:23:27.886706+0000","last_clean":"2023-07-09T02:23:27.886706+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:23:27.886706+0000","last_undegraded":"2023-07-09T02:23:27.886706+0000","last_fullsized":"2023-07-09T02:23:27.886706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:02:48.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":326,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.880805+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:23:27.880805+0000","last_peered":"2023-07-09T02:23:27.880805+0000","last_clean":"2023-07-09T02:23:27.880805+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:23:27.880805+0000","last_undegraded":"2023-07-09T02:23:27.880805+0000","last_fullsized":"2023-07-09T02:23:27.880805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:05:53.916879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":304,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.881167+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:23:27.881167+0000","last_peered":"2023-07-09T02:23:27.881167+0000","last_clean":"2023-07-09T02:23:27.881167+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:23:27.881167+0000","last_undegraded":"2023-07-09T02:23:27.881167+0000","last_fullsized":"2023-07-09T02:23:27.881167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:46:38.610655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1683,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193628,"statfs":{"total":200000000,"available":198275898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97199999999999998,"5min":0.97399999999999998,"15min":1.4950000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.63600000000000001,"5min":0.435,"15min":0.35599999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.2110000000000001},"last":0.63600000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.91400000000000003,"15min":1.423},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.80700000000000005},"min":{"1min":0.502,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95099999999999996,"5min":0.997,"15min":29.498999999999999},"last":0.66900000000000004}]},{"osd":2,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.435},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":5.0460000000000003},"last":0.438},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.81100000000000005},"min":{"1min":0.54700000000000004,"5min":0.45900000000000002,"15min":0.42799999999999999},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":26.524000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.746,"15min":0.71499999999999997},"min":{"1min":0.496,"5min":0.438,"15min":0.374},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":4.3789999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73699999999999999,"15min":0.77200000000000002},"min":{"1min":0.56799999999999995,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.93500000000000005,"5min":0.97699999999999998,"15min":10.609999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.87,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.38100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.50600000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.63700000000000001,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.048},"last":0.52800000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.70699999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.91100000000000003,"5min":0.91800000000000004,"15min":1.1639999999999999},"last":0.57599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.68700000000000006},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.36299999999999999},"max":{"1min":0.94099999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.70999999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.36199999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0269999999999999},"last":0.72599999999999998}]},{"osd":1,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.55200000000000005,"5min":0.47099999999999997,"15min":0.42699999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.4379999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.73399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.036,"15min":1.165},"last":0.88300000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.752,"15min":0.71699999999999997},"min":{"1min":0.56499999999999995,"5min":0.51300000000000001,"15min":0.46600000000000003},"max":{"1min":0.91200000000000003,"5min":1.01,"15min":1.01},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.755,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.84199999999999997}]},{"osd":3,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.754,"15min":0.72799999999999998},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.48799999999999999},"max":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":1.45},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.71099999999999997},"min":{"1min":0.59799999999999998,"5min":0.501,"15min":0.45700000000000002},"max":{"1min":0.95799999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.77600000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.51800000000000002,"5min":0.42399999999999999,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.92200000000000004,"15min":1.6499999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.54900000000000004,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.89600000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59899999999999998,"15min":0.61799999999999999},"min":{"1min":0.47599999999999998,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.873,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.59799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93700000000000006,"5min":0.96399999999999997,"15min":1.6060000000000001},"last":0.754}]},{"osd":7,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.41599999999999998},"max":{"1min":0.88800000000000001,"5min":0.94199999999999995,"15min":1.4059999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.54000000000000004,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.93200000000000005,"15min":1.0289999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72399999999999998,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.49399999999999999,"15min":0.40699999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.248},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.32800000000000001},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.39900000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.68700000000000006},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":0.97299999999999998},"last":0.629}]},{"osd":2,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.747,"15min":0.71599999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.432},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.56999999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.64900000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.522,"5min":1.522,"15min":5.1989999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.47399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.71299999999999997}]},{"osd":4,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.008},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61099999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.374},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.38800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.66100000000000003},"min":{"1min":0.52400000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.497,"15min":0.437},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.85899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.86299999999999999},"min":{"1min":0.432,"5min":0.378,"15min":0.27300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":50.508000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69799999999999995,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.39800000000000002,"15min":0.376},"max":{"1min":0.88,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70199999999999996,"15min":0.68700000000000006},"min":{"1min":0.435,"5min":0.41299999999999998,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":1.024,"15min":8.6039999999999992},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89200000000000002,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.78900000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.46600000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93500000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.997,"15min":1.323},"last":0.747}]},{"osd":3,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.71299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":0.97299999999999998,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.97699999999999998},"min":{"1min":0.55600000000000005,"5min":0.46400000000000002,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.073,"15min":71.909000000000006},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.317},"max":{"1min":0.81799999999999995,"5min":0.88,"15min":1.0169999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.89100000000000001,"15min":0.95399999999999996},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.629},"min":{"1min":0.49199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84199999999999997,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.0529999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.70399999999999996},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.0329999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.54000000000000004,"5min":0.434,"15min":0.33200000000000002},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":8.0359999999999996},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42699999999999999},"min":{"1min":0.32900000000000001,"5min":0.217,"15min":0.216},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.96499999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.503,"15min":0.48799999999999999},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.28499999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":1.198},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45100000000000001,"15min":0.46200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.27100000000000002},"max":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":1.048},"last":0.44},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51200000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69899999999999995,"5min":0.76000000000000001,"15min":0.85299999999999998},"last":0.38}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":1.155},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.35599999999999998},"max":{"1min":0.75900000000000001,"5min":0.84799999999999998,"15min":1.1040000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.65200000000000002,"5min":0.502,"15min":0.45300000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.466},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.3560000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75800000000000001,"15min":0.746},"min":{"1min":0.61799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.155,"15min":1.3420000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.65200000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.008,"5min":1.054,"15min":1.2909999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.71199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.4350000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.5569999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.69599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0229999999999999,"5min":1.131,"15min":1.367},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.63300000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98399999999999999,"5min":1.0980000000000001,"15min":1.2569999999999999},"last":0.79700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.624,"5min":0.84299999999999997,"15min":7.7450000000000001},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.49099999999999999,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.72599999999999998,"5min":0.78700000000000003,"15min":1.127},"last":0.375}]},{"osd":1,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":2.8879999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58399999999999996,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72299999999999998,"5min":0.90500000000000003,"15min":2.0600000000000001},"last":0.40600000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.755,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.58199999999999996,"5min":0.875,"15min":7.8710000000000004},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1140000000000001,"5min":1.218,"15min":7.7990000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.75800000000000001},"min":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.47899999999999998},"max":{"1min":0.99199999999999999,"5min":1.046,"15min":1.821},"last":0.58099999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.496},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.046,"5min":1.093,"15min":7.8369999999999997},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.48299999999999998},"max":{"1min":1.0680000000000001,"5min":1.3029999999999999,"15min":1.9790000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.82199999999999995},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.51500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.452},"last":0.69699999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.165,"15min":1.9379999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81599999999999995,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.48699999999999999},"max":{"1min":1.1479999999999999,"5min":1.173,"15min":1.351},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.436,"15min":0.44500000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.64000000000000001,"15min":0.80300000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37}]},{"osd":2,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.86899999999999999},"last":0.436},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77300000000000002,"15min":1.1080000000000001},"last":0.501}]},{"osd":3,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.85099999999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.32600000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":1.163},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78500000000000003,"15min":0.76500000000000001},"min":{"1min":0.52900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.071,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81299999999999994}]},{"osd":5,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76400000000000001,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.1599999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.75900000000000001,"15min":0.74399999999999999},"min":{"1min":0.56100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0840000000000001,"5min":1.131,"15min":1.131},"last":0.70199999999999996}]},{"osd":6,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0329999999999999,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82599999999999996,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.123,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.83999999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:22:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79500000000000004,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.57599999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1699999999999999,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.72199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1683,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193628,"statfs":{"total":200000000,"available":198275898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.22700000000000001},"max":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.94999999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53500000000000003,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.3240000000000001},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.29899999999999999},"max":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.78300000000000003,"15min":1.4139999999999999},"last":0.42699999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74099999999999999,"5min":0.754,"15min":1.0189999999999999},"last":0.377},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.53600000000000003},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80200000000000005,"5min":0.879,"15min":3.8929999999999998},"last":0.48999999999999999}]},{"osd":4,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80800000000000005,"15min":0.77600000000000002},"min":{"1min":0.65700000000000003,"5min":0.47299999999999998,"15min":0.46600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.63300000000000001,"5min":0.54400000000000004,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.1240000000000001,"15min":1.153},"last":0.752}]},{"osd":5,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.79800000000000004},"min":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.1040000000000001,"15min":1.4350000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.79600000000000004},"min":{"1min":0.63800000000000001,"5min":0.51000000000000001,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.238},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.47799999999999998},"max":{"1min":1.0529999999999999,"5min":1.117,"15min":1.117},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.46899999999999997},"max":{"1min":1.034,"5min":1.1200000000000001,"15min":1.7789999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.49099999999999999},"max":{"1min":1.034,"5min":1.079,"15min":1.8149999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78000000000000003,"15min":0.749},"min":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.1060000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.57899999999999996}]}]}],"pool_statfs":[]}} 2023-07-09T02:23:30.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T02:23:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba6b9f640 1 Processor -- start 2023-07-09T02:23:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba6b9f640 1 -- start start 2023-07-09T02:23:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba6b9f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3ba015c060 0x7f3ba00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba6b9f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ba00d2620 0x7f3ba00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba6b9f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba0160a50 con 0x7f3ba00cd120 2023-07-09T02:23:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba6b9f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba015c430 con 0x7f3ba00d2620 2023-07-09T02:23:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba6b9f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba015fb60 con 0x7f3ba015c060 2023-07-09T02:23:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba513c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ba00d2620 0x7f3ba00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba513c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ba00d2620 0x7f3ba00cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50076/0 (socket says 172.21.15.45:50076) 2023-07-09T02:23:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba513c640 1 -- 172.21.15.45:0/3260039580 learned_addr learned my addr 172.21.15.45:0/3260039580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba493b640 1 --2- 172.21.15.45:0/3260039580 >> v2:172.21.15.155:3300/0 conn(0x7f3ba015c060 0x7f3ba00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba513c640 1 -- 172.21.15.45:0/3260039580 >> v2:172.21.15.155:3300/0 conn(0x7f3ba015c060 msgr2=0x7f3ba00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba513c640 1 --2- 172.21.15.45:0/3260039580 >> v2:172.21.15.155:3300/0 conn(0x7f3ba015c060 0x7f3ba00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba513c640 1 -- 172.21.15.45:0/3260039580 >> v1:172.21.15.155:6789/0 conn(0x7f3ba00cd120 legacy=0x7f3ba00d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba513c640 1 -- 172.21.15.45:0/3260039580 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba015fe40 con 0x7f3ba00d2620 2023-07-09T02:23:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.115+0000 7f3ba493b640 1 --2- 172.21.15.45:0/3260039580 >> v2:172.21.15.155:3300/0 conn(0x7f3ba015c060 0x7f3ba00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba513c640 1 --2- 172.21.15.45:0/3260039580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba00cee30 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00d3ad0 tx=0x7f3b9801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5f5a06bca3b7fc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3b9f7fe640 1 -- 172.21.15.45:0/3260039580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980a5860 con 0x7f3ba00d2620 2023-07-09T02:23:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3b9f7fe640 1 -- 172.21.15.45:0/3260039580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b980a59c0 con 0x7f3ba00d2620 2023-07-09T02:23:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3b9f7fe640 1 -- 172.21.15.45:0/3260039580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980a5d50 con 0x7f3ba00d2620 2023-07-09T02:23:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/3260039580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 msgr2=0x7f3ba00cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/3260039580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba00cee30 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00d3ad0 tx=0x7f3b9801c9a0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/3260039580 shutdown_connections 2023-07-09T02:23:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/3260039580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba00cee30 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/3260039580 >> v2:172.21.15.155:3300/0 conn(0x7f3ba015c060 0x7f3ba00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/3260039580 >> 172.21.15.45:0/3260039580 conn(0x7f3ba00698e0 msgr2=0x7f3ba0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/3260039580 shutdown_connections 2023-07-09T02:23:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.119+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/3260039580 wait complete. 2023-07-09T02:23:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 Processor -- start 2023-07-09T02:23:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 -- start start 2023-07-09T02:23:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ba00cd120 0x7f3ba00cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ba015c060 0x7f3ba00cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00c9b10 con 0x7f3ba00d2620 2023-07-09T02:23:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00c9df0 con 0x7f3ba00cd120 2023-07-09T02:23:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00ca0d0 con 0x7f3ba015c060 2023-07-09T02:23:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba015e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50080/0 (socket says 172.21.15.45:50080) 2023-07-09T02:23:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 -- 172.21.15.45:0/2559885371 learned_addr learned my addr 172.21.15.45:0/2559885371 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba493b640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ba00cd120 0x7f3ba00cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba513c640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ba015c060 0x7f3ba00cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 -- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ba015c060 msgr2=0x7f3ba00cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ba015c060 0x7f3ba00cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 -- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ba00cd120 msgr2=0x7f3ba00cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ba00cd120 0x7f3ba00cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 -- 172.21.15.45:0/2559885371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98009b30 con 0x7f3ba00d2620 2023-07-09T02:23:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9ffff640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba015e3a0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c4d0 tx=0x7f3b8c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9d7fa640 1 -- 172.21.15.45:0/2559885371 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0052d0 con 0x7f3ba00d2620 2023-07-09T02:23:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9d7fa640 1 -- 172.21.15.45:0/2559885371 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c005430 con 0x7f3ba00d2620 2023-07-09T02:23:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3b9d7fa640 1 -- 172.21.15.45:0/2559885371 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c012830 con 0x7f3ba00d2620 2023-07-09T02:23:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba00b59f0 con 0x7f3ba00d2620 2023-07-09T02:23:31.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.123+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba00ca970 con 0x7f3ba00d2620 2023-07-09T02:23:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.127+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba00cab90 con 0x7f3ba00d2620 2023-07-09T02:23:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.127+0000 7f3b9d7fa640 1 -- 172.21.15.45:0/2559885371 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b8c012990 con 0x7f3ba00d2620 2023-07-09T02:23:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.127+0000 7f3b9d7fa640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b84066280 0x7f3b84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.127+0000 7f3b9d7fa640 1 -- 172.21.15.45:0/2559885371 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3b8c083480 con 0x7f3ba00d2620 2023-07-09T02:23:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.127+0000 7f3ba493b640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b84066280 0x7f3b84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.127+0000 7f3ba493b640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b84066280 0x7f3b84068730 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3b940045f0 tx=0x7f3b94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.131+0000 7f3b9d7fa640 1 -- 172.21.15.45:0/2559885371 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b8c050c30 con 0x7f3ba00d2620 2023-07-09T02:23:31.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.287+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba004d7d0 con 0x7f3ba00d2620 2023-07-09T02:23:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.287+0000 7f3b9d7fa640 1 -- 172.21.15.45:0/2559885371 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+14780 (secure 0 0 0) 0x7f3b8c054250 con 0x7f3ba00d2620 2023-07-09T02:23:31.290 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:31.290 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":189,"fsid":"baf8f4e1-db15-4e56-a3ea-d65b4f02f49e","created":"2023-07-09T02:10:59.500581+0000","modified":"2023-07-09T02:23:27.871822+0000","last_up_change":"2023-07-09T02:11:05.049008+0000","last_in_change":"2023-07-09T02:11:02.034459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T02:11:06.582752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T02:11:10.951834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6809","nonce":101265301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6811","nonce":101265301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6819","nonce":101265301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":101265301},{"type":"v1","addr":"172.21.15.45:6813","nonce":101265301}]},"public_addr":"172.21.15.45:6809/101265301","cluster_addr":"172.21.15.45:6811/101265301","heartbeat_back_addr":"172.21.15.45:6819/101265301","heartbeat_front_addr":"172.21.15.45:6813/101265301","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6801","nonce":3315000466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6803","nonce":3315000466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6807","nonce":3315000466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3315000466},{"type":"v1","addr":"172.21.15.45:6805","nonce":3315000466}]},"public_addr":"172.21.15.45:6801/3315000466","cluster_addr":"172.21.15.45:6803/3315000466","heartbeat_back_addr":"172.21.15.45:6807/3315000466","heartbeat_front_addr":"172.21.15.45:6805/3315000466","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6823","nonce":1123173164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6827","nonce":1123173164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6831","nonce":1123173164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":1123173164},{"type":"v1","addr":"172.21.15.45:6829","nonce":1123173164}]},"public_addr":"172.21.15.45:6823/1123173164","cluster_addr":"172.21.15.45:6827/1123173164","heartbeat_back_addr":"172.21.15.45:6831/1123173164","heartbeat_front_addr":"172.21.15.45:6829/1123173164","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6815","nonce":2399948348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6818","nonce":2399948348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6826","nonce":2399948348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":2399948348},{"type":"v1","addr":"172.21.15.45:6822","nonce":2399948348}]},"public_addr":"172.21.15.45:6815/2399948348","cluster_addr":"172.21.15.45:6818/2399948348","heartbeat_back_addr":"172.21.15.45:6826/2399948348","heartbeat_front_addr":"172.21.15.45:6822/2399948348","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6809","nonce":3680660905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6811","nonce":3680660905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6815","nonce":3680660905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3680660905},{"type":"v1","addr":"172.21.15.155:6813","nonce":3680660905}]},"public_addr":"172.21.15.155:6809/3680660905","cluster_addr":"172.21.15.155:6811/3680660905","heartbeat_back_addr":"172.21.15.155:6815/3680660905","heartbeat_front_addr":"172.21.15.155:6813/3680660905","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6822","nonce":1199637530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6826","nonce":1199637530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6831","nonce":1199637530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1199637530},{"type":"v1","addr":"172.21.15.155:6829","nonce":1199637530}]},"public_addr":"172.21.15.155:6822/1199637530","cluster_addr":"172.21.15.155:6826/1199637530","heartbeat_back_addr":"172.21.15.155:6831/1199637530","heartbeat_front_addr":"172.21.15.155:6829/1199637530","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6801","nonce":4095749246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6803","nonce":4095749246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6807","nonce":4095749246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4095749246},{"type":"v1","addr":"172.21.15.155:6805","nonce":4095749246}]},"public_addr":"172.21.15.155:6801/4095749246","cluster_addr":"172.21.15.155:6803/4095749246","heartbeat_back_addr":"172.21.15.155:6807/4095749246","heartbeat_front_addr":"172.21.15.155:6805/4095749246","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6817","nonce":3747873244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6820","nonce":3747873244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6825","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6827","nonce":3747873244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":3747873244},{"type":"v1","addr":"172.21.15.155:6823","nonce":3747873244}]},"public_addr":"172.21.15.155:6817/3747873244","cluster_addr":"172.21.15.155:6820/3747873244","heartbeat_back_addr":"172.21.15.155:6827/3747873244","heartbeat_front_addr":"172.21.15.155:6823/3747873244","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.247213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.275058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.230519+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.283689+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.261718+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.284069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.218964+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T02:11:03.299132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1522094826":"2023-07-10T02:23:24.864876+0000","172.21.15.45:6833/1522094826":"2023-07-10T02:23:24.864876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T02:23:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b84066280 msgr2=0x7f3b84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b84066280 0x7f3b84068730 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3b940045f0 tx=0x7f3b94008040 comp rx=0 tx=0).stop 2023-07-09T02:23:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 msgr2=0x7f3ba015e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba015e3a0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c4d0 tx=0x7f3b8c00c990 comp rx=0 tx=0).stop 2023-07-09T02:23:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 shutdown_connections 2023-07-09T02:23:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f3b84066280 0x7f3b84068730 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ba015c060 0x7f3ba00cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba00d2620 0x7f3ba015e3a0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 --2- 172.21.15.45:0/2559885371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ba00cd120 0x7f3ba00cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 >> 172.21.15.45:0/2559885371 conn(0x7f3ba00698e0 msgr2=0x7f3ba0158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 shutdown_connections 2023-07-09T02:23:31.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:31.291+0000 7f3ba6b9f640 1 -- 172.21.15.45:0/2559885371 wait complete. 2023-07-09T02:23:32.312 INFO:tasks.ceph:Scrubbing osd.0 2023-07-09T02:23:32.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-09T02:23:32.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.467+0000 7f79d5537640 1 Processor -- start 2023-07-09T02:23:32.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.467+0000 7f79d5537640 1 -- start start 2023-07-09T02:23:32.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79d5537640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79d015c480 0x7f79d00cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79d5537640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79d00b4490 0x7f79d00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79d5537640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d00d19c0 con 0x7f79d00cecd0 2023-07-09T02:23:32.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79d5537640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d015c850 con 0x7f79d00b4490 2023-07-09T02:23:32.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79d5537640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d00b4e50 con 0x7f79d015c480 2023-07-09T02:23:32.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79cf7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79d00b4490 0x7f79d00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79cf7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79d00b4490 0x7f79d00b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40192/0 (socket says 172.21.15.45:40192) 2023-07-09T02:23:32.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79cf7fe640 1 -- 172.21.15.45:0/2612529929 learned_addr learned my addr 172.21.15.45:0/2612529929 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:32.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79ceffd640 1 --2- 172.21.15.45:0/2612529929 >> v2:172.21.15.155:3300/0 conn(0x7f79d015c480 0x7f79d00cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79cf7fe640 1 -- 172.21.15.45:0/2612529929 >> v2:172.21.15.155:3300/0 conn(0x7f79d015c480 msgr2=0x7f79d00cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:32.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79cf7fe640 1 --2- 172.21.15.45:0/2612529929 >> v2:172.21.15.155:3300/0 conn(0x7f79d015c480 0x7f79d00cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79cf7fe640 1 -- 172.21.15.45:0/2612529929 >> v1:172.21.15.155:6789/0 conn(0x7f79d00cecd0 legacy=0x7f79d00d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:32.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79cf7fe640 1 -- 172.21.15.45:0/2612529929 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00d1090 con 0x7f79d00b4490 2023-07-09T02:23:32.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.471+0000 7f79ceffd640 1 --2- 172.21.15.45:0/2612529929 >> v2:172.21.15.155:3300/0 conn(0x7f79d015c480 0x7f79d00cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:32.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79cf7fe640 1 --2- 172.21.15.45:0/2612529929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d00b4490 0x7f79d00b4910 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f79d0069ae0 tx=0x7f79c801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff451e6228e54d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:32.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79ce7fc640 1 -- 172.21.15.45:0/2612529929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80a57a0 con 0x7f79d00b4490 2023-07-09T02:23:32.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79ce7fc640 1 -- 172.21.15.45:0/2612529929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c80a5900 con 0x7f79d00b4490 2023-07-09T02:23:32.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79ce7fc640 1 -- 172.21.15.45:0/2612529929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80a5c90 con 0x7f79d00b4490 2023-07-09T02:23:32.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 -- 172.21.15.45:0/2612529929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d00b4490 msgr2=0x7f79d00b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 --2- 172.21.15.45:0/2612529929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d00b4490 0x7f79d00b4910 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f79d0069ae0 tx=0x7f79c801c9d0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 -- 172.21.15.45:0/2612529929 shutdown_connections 2023-07-09T02:23:32.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 --2- 172.21.15.45:0/2612529929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d00b4490 0x7f79d00b4910 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 --2- 172.21.15.45:0/2612529929 >> v2:172.21.15.155:3300/0 conn(0x7f79d015c480 0x7f79d00cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 -- 172.21.15.45:0/2612529929 >> 172.21.15.45:0/2612529929 conn(0x7f79d00cf490 msgr2=0x7f79d00cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:32.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 -- 172.21.15.45:0/2612529929 shutdown_connections 2023-07-09T02:23:32.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 -- 172.21.15.45:0/2612529929 wait complete. 2023-07-09T02:23:32.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 Processor -- start 2023-07-09T02:23:32.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.475+0000 7f79d5537640 1 -- start start 2023-07-09T02:23:32.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d00b4490 0x7f79d00c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d00cecd0 0x7f79d00b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d015c480 0x7f79d00c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00ca020 con 0x7f79d015c480 2023-07-09T02:23:32.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d015ae30 con 0x7f79d00cecd0 2023-07-09T02:23:32.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00b8890 con 0x7f79d00b4490 2023-07-09T02:23:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d015c480 0x7f79d00c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d015c480 0x7f79d00c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40206/0 (socket says 172.21.15.45:40206) 2023-07-09T02:23:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 -- 172.21.15.45:0/3080680698 learned_addr learned my addr 172.21.15.45:0/3080680698 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79ceffd640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d00b4490 0x7f79d00c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79c7fff640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d00cecd0 0x7f79d00b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 -- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d00b4490 msgr2=0x7f79d00c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d00b4490 0x7f79d00c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 -- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d00cecd0 msgr2=0x7f79d00b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d00cecd0 0x7f79d00b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 -- 172.21.15.45:0/3080680698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009b30 con 0x7f79d015c480 2023-07-09T02:23:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79cf7fe640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d015c480 0x7f79d00c8560 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f79c80af040 tx=0x7f79c8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80b8670 con 0x7f79d015c480 2023-07-09T02:23:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c80b87d0 con 0x7f79d015c480 2023-07-09T02:23:32.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d015a870 con 0x7f79d015c480 2023-07-09T02:23:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80b8b60 con 0x7f79d015c480 2023-07-09T02:23:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d00c8040 con 0x7f79d015c480 2023-07-09T02:23:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79d00cd760 con 0x7f79d015c480 2023-07-09T02:23:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.479+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79c80b8cc0 con 0x7f79d015c480 2023-07-09T02:23:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79c77fe640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f79b00662b0 0x7f79b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f79c811edd0 con 0x7f79d015c480 2023-07-09T02:23:32.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79c77fe640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f79b006c720 0x7f79b006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 --> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79b006f1e0 con 0x7f79b006c720 2023-07-09T02:23:32.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=189) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c8121470 con 0x7f79d015c480 2023-07-09T02:23:32.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79ceffd640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f79b00662b0 0x7f79b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79c7fff640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f79b006c720 0x7f79b006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79c7fff640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f79b006c720 0x7f79b006eb30 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79ceffd640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f79b00662b0 0x7f79b0068760 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f79c00045f0 tx=0x7f79c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:32.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.483+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 <== osd.0 v2:172.21.15.45:6808/101265301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f79b006f1e0 con 0x7f79b006c720 2023-07-09T02:23:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 --> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f79d0153600 con 0x7f79b006c720 2023-07-09T02:23:32.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79c77fe640 1 -- 172.21.15.45:0/3080680698 <== osd.0 v2:172.21.15.45:6808/101265301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f79d0153600 con 0x7f79b006c720 2023-07-09T02:23:32.497 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:32.497 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-07-09T02:23:32.497 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:32.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f79b006c720 msgr2=0x7f79b006eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.45:6808/101265301,v1:172.21.15.45:6809/101265301] conn(0x7f79b006c720 0x7f79b006eb30 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f79b00662b0 msgr2=0x7f79b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f79b00662b0 0x7f79b0068760 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f79c00045f0 tx=0x7f79c0008040 comp rx=0 tx=0).stop 2023-07-09T02:23:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d015c480 msgr2=0x7f79d00c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 --2- 172.21.15.45:0/3080680698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d015c480 0x7f79d00c8560 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f79c80af040 tx=0x7f79c8019770 comp rx=0 tx=0).stop 2023-07-09T02:23:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79cf7fe640 1 -- 172.21.15.45:0/3080680698 reap_dead start 2023-07-09T02:23:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 shutdown_connections 2023-07-09T02:23:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 >> 172.21.15.45:0/3080680698 conn(0x7f79d00cf490 msgr2=0x7f79d00d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 shutdown_connections 2023-07-09T02:23:32.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.495+0000 7f79d5537640 1 -- 172.21.15.45:0/3080680698 wait complete. 2023-07-09T02:23:32.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-09T02:23:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.655+0000 7f2e2819f640 1 Processor -- start 2023-07-09T02:23:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.655+0000 7f2e2819f640 1 -- start start 2023-07-09T02:23:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2819f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e2015c060 0x7f2e200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2819f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e200d2620 0x7f2e200cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2819f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e20160a50 con 0x7f2e200cd120 2023-07-09T02:23:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2819f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2015c430 con 0x7f2e200d2620 2023-07-09T02:23:32.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2819f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2015fb60 con 0x7f2e2015c060 2023-07-09T02:23:32.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2673c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e200d2620 0x7f2e200cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2673c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e200d2620 0x7f2e200cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40216/0 (socket says 172.21.15.45:40216) 2023-07-09T02:23:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2673c640 1 -- 172.21.15.45:0/3649268099 learned_addr learned my addr 172.21.15.45:0/3649268099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e25f3b640 1 --2- 172.21.15.45:0/3649268099 >> v2:172.21.15.155:3300/0 conn(0x7f2e2015c060 0x7f2e200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2673c640 1 -- 172.21.15.45:0/3649268099 >> v2:172.21.15.155:3300/0 conn(0x7f2e2015c060 msgr2=0x7f2e200b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2673c640 1 --2- 172.21.15.45:0/3649268099 >> v2:172.21.15.155:3300/0 conn(0x7f2e2015c060 0x7f2e200b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2673c640 1 -- 172.21.15.45:0/3649268099 >> v1:172.21.15.45:6789/0 conn(0x7f2e200cd120 legacy=0x7f2e200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.659+0000 7f2e2673c640 1 -- 172.21.15.45:0/3649268099 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2015fe40 con 0x7f2e200d2620 2023-07-09T02:23:32.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2673c640 1 --2- 172.21.15.45:0/3649268099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e200cee30 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f2e200d3ad0 tx=0x7f2e1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3798ff0f5cea38a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:32.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e24f39640 1 -- 172.21.15.45:0/3649268099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180a5860 con 0x7f2e200d2620 2023-07-09T02:23:32.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e24f39640 1 -- 172.21.15.45:0/3649268099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e180a59c0 con 0x7f2e200d2620 2023-07-09T02:23:32.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e24f39640 1 -- 172.21.15.45:0/3649268099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180a5d50 con 0x7f2e200d2620 2023-07-09T02:23:32.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 -- 172.21.15.45:0/3649268099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 msgr2=0x7f2e200cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 --2- 172.21.15.45:0/3649268099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e200cee30 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f2e200d3ad0 tx=0x7f2e1801c9a0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 -- 172.21.15.45:0/3649268099 shutdown_connections 2023-07-09T02:23:32.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 --2- 172.21.15.45:0/3649268099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e200cee30 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 --2- 172.21.15.45:0/3649268099 >> v2:172.21.15.155:3300/0 conn(0x7f2e2015c060 0x7f2e200b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 -- 172.21.15.45:0/3649268099 >> 172.21.15.45:0/3649268099 conn(0x7f2e200698e0 msgr2=0x7f2e20069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 -- 172.21.15.45:0/3649268099 shutdown_connections 2023-07-09T02:23:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 -- 172.21.15.45:0/3649268099 wait complete. 2023-07-09T02:23:32.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 Processor -- start 2023-07-09T02:23:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.663+0000 7f2e2819f640 1 -- start start 2023-07-09T02:23:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e200cd120 0x7f2e200cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e2015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e2015c060 0x7f2e200cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200c9b10 con 0x7f2e200d2620 2023-07-09T02:23:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200c9df0 con 0x7f2e200cd120 2023-07-09T02:23:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200ca0d0 con 0x7f2e2015c060 2023-07-09T02:23:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e2015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e2015e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40232/0 (socket says 172.21.15.45:40232) 2023-07-09T02:23:32.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 -- 172.21.15.45:0/1403783318 learned_addr learned my addr 172.21.15.45:0/1403783318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:32.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e25f3b640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e200cd120 0x7f2e200cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2673c640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e2015c060 0x7f2e200cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 -- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e2015c060 msgr2=0x7f2e200cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e2015c060 0x7f2e200cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 -- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e200cd120 msgr2=0x7f2e200cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e200cd120 0x7f2e200cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 -- 172.21.15.45:0/1403783318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18009b30 con 0x7f2e200d2620 2023-07-09T02:23:32.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2573a640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e2015e3a0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c4d0 tx=0x7f2e1000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:32.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e167fc640 1 -- 172.21.15.45:0/1403783318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100052d0 con 0x7f2e200d2620 2023-07-09T02:23:32.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e167fc640 1 -- 172.21.15.45:0/1403783318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e10005430 con 0x7f2e200d2620 2023-07-09T02:23:32.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e167fc640 1 -- 172.21.15.45:0/1403783318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10012830 con 0x7f2e200d2620 2023-07-09T02:23:32.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e200b59f0 con 0x7f2e200d2620 2023-07-09T02:23:32.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e200ca970 con 0x7f2e200d2620 2023-07-09T02:23:32.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e200ca4f0 con 0x7f2e200d2620 2023-07-09T02:23:32.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.667+0000 7f2e167fc640 1 -- 172.21.15.45:0/1403783318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e10012990 con 0x7f2e200d2620 2023-07-09T02:23:32.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.671+0000 7f2e167fc640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e04066280 0x7f2e04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:32.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.671+0000 7f2e167fc640 1 -- 172.21.15.45:0/1403783318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2e10083480 con 0x7f2e200d2620 2023-07-09T02:23:32.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.671+0000 7f2e25f3b640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e04066280 0x7f2e04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:32.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.671+0000 7f2e25f3b640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e04066280 0x7f2e04068730 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0079c0 tx=0x7f2e1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.675+0000 7f2e167fc640 1 -- 172.21.15.45:0/1403783318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e200ca4f0 con 0x7f2e200d2620 2023-07-09T02:23:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e201606e0 con 0x7f2e04066280 2023-07-09T02:23:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e167fc640 1 -- 172.21.15.45:0/1403783318 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2e1c0108d0 con 0x7f2e04066280 2023-07-09T02:23:32.832 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2023-07-09T02:23:32.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e04066280 msgr2=0x7f2e04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e04066280 0x7f2e04068730 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0079c0 tx=0x7f2e1c008040 comp rx=0 tx=0).stop 2023-07-09T02:23:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 msgr2=0x7f2e2015e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e2015e3a0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c4d0 tx=0x7f2e1000c990 comp rx=0 tx=0).stop 2023-07-09T02:23:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 shutdown_connections 2023-07-09T02:23:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2e04066280 0x7f2e04068730 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e2015c060 0x7f2e200cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e200d2620 0x7f2e2015e3a0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 --2- 172.21.15.45:0/1403783318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e200cd120 0x7f2e200cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:32.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 >> 172.21.15.45:0/1403783318 conn(0x7f2e200698e0 msgr2=0x7f2e20158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:32.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 shutdown_connections 2023-07-09T02:23:32.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.831+0000 7f2e2819f640 1 -- 172.21.15.45:0/1403783318 wait complete. 2023-07-09T02:23:32.854 INFO:tasks.ceph:Scrubbing osd.1 2023-07-09T02:23:32.854 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-09T02:23:33.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19c38f640 1 Processor -- start 2023-07-09T02:23:33.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19c38f640 1 -- start start 2023-07-09T02:23:33.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19c38f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1940cd060 0x7ff1940cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19c38f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 0x7ff1940b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19c38f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1940d19c0 con 0x7ff19415c480 2023-07-09T02:23:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19c38f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19415c850 con 0x7ff1940cd060 2023-07-09T02:23:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19c38f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1940b4e50 con 0x7ff1940b4490 2023-07-09T02:23:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19a12b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff19415c480 0x7ff1940d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51002/0 (socket says 172.21.15.45:51002) 2023-07-09T02:23:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19a12b640 1 -- 172.21.15.45:0/2651102319 learned_addr learned my addr 172.21.15.45:0/2651102319 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:33.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19992a640 1 --2- 172.21.15.45:0/2651102319 >> v2:172.21.15.155:3300/0 conn(0x7ff1940cd060 0x7ff1940cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19a92c640 1 --2- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 0x7ff1940b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff199129640 1 -- 172.21.15.45:0/2651102319 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715363870 0 0) 0x7ff1940d19c0 con 0x7ff19415c480 2023-07-09T02:23:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff199129640 1 -- 172.21.15.45:0/2651102319 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff180003530 con 0x7ff19415c480 2023-07-09T02:23:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19992a640 1 -- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 msgr2=0x7ff1940b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19992a640 1 --2- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 0x7ff1940b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19992a640 1 -- 172.21.15.45:0/2651102319 >> v1:172.21.15.45:6789/0 conn(0x7ff19415c480 legacy=0x7ff1940d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff199129640 1 -- 172.21.15.45:0/2651102319 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1731114270 0 0) 0x7ff180003530 con 0x7ff19415c480 2023-07-09T02:23:33.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19992a640 1 -- 172.21.15.45:0/2651102319 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1940cf210 con 0x7ff1940cd060 2023-07-09T02:23:33.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:32.999+0000 7ff19a92c640 1 --2- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 0x7ff1940b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:23:33.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.003+0000 7ff19992a640 1 --2- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1940cd060 0x7ff1940cecd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff1840097c0 tx=0x7ff18401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab520fa203bb27c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.003+0000 7ff199129640 1 -- 172.21.15.45:0/2651102319 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190001680 con 0x7ff1940cd060 2023-07-09T02:23:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.003+0000 7ff199129640 1 -- 172.21.15.45:0/2651102319 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1840a7050 con 0x7ff1940cd060 2023-07-09T02:23:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.003+0000 7ff199129640 1 -- 172.21.15.45:0/2651102319 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1840ab620 con 0x7ff1940cd060 2023-07-09T02:23:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.003+0000 7ff19c38f640 1 -- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1940cd060 msgr2=0x7ff1940cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.003+0000 7ff19c38f640 1 --2- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1940cd060 0x7ff1940cecd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff1840097c0 tx=0x7ff18401c3a0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 -- 172.21.15.45:0/2651102319 shutdown_connections 2023-07-09T02:23:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 --2- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 0x7ff1940b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 --2- 172.21.15.45:0/2651102319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1940cd060 0x7ff1940cecd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 -- 172.21.15.45:0/2651102319 >> 172.21.15.45:0/2651102319 conn(0x7ff1940cf490 msgr2=0x7ff1940cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 -- 172.21.15.45:0/2651102319 shutdown_connections 2023-07-09T02:23:33.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 -- 172.21.15.45:0/2651102319 wait complete. 2023-07-09T02:23:33.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 Processor -- start 2023-07-09T02:23:33.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 -- start start 2023-07-09T02:23:33.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 0x7ff1940c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1940cd060 0x7ff1941538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19415c480 0x7ff194153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19414cf50 con 0x7ff19415c480 2023-07-09T02:23:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19414b1a0 con 0x7ff1940cd060 2023-07-09T02:23:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19c38f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19414c620 con 0x7ff1940b4490 2023-07-09T02:23:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a92c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19415c480 0x7ff194153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a92c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19415c480 0x7ff194153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40246/0 (socket says 172.21.15.45:40246) 2023-07-09T02:23:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a92c640 1 -- 172.21.15.45:0/3405726385 learned_addr learned my addr 172.21.15.45:0/3405726385 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a12b640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 0x7ff1940c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19992a640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1940cd060 0x7ff1941538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a92c640 1 -- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 msgr2=0x7ff1940c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a92c640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1940b4490 0x7ff1940c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a92c640 1 -- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1940cd060 msgr2=0x7ff1941538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a92c640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1940cd060 0x7ff1941538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.007+0000 7ff19a92c640 1 -- 172.21.15.45:0/3405726385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c009a70 con 0x7ff19415c480 2023-07-09T02:23:33.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff19a92c640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19415c480 0x7ff194153de0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00efc0 tx=0x7ff18c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c009d70 con 0x7ff19415c480 2023-07-09T02:23:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c00f040 con 0x7ff19415c480 2023-07-09T02:23:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0039f0 con 0x7ff19415c480 2023-07-09T02:23:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff184009420 con 0x7ff19415c480 2023-07-09T02:23:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19414cbe0 con 0x7ff19415c480 2023-07-09T02:23:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1940cd760 con 0x7ff19415c480 2023-07-09T02:23:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff18c014480 con 0x7ff19415c480 2023-07-09T02:23:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff178066280 0x7ff178068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff18c0845c0 con 0x7ff19415c480 2023-07-09T02:23:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff19a12b640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff178066280 0x7ff178068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7ff17806c6f0 0x7ff17806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 --> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff17806f1b0 con 0x7ff17806c6f0 2023-07-09T02:23:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=189) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff18c086b20 con 0x7ff19415c480 2023-07-09T02:23:33.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.011+0000 7ff19992a640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7ff17806c6f0 0x7ff17806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.015+0000 7ff19a12b640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff178066280 0x7ff178068730 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff190001ec0 tx=0x7ff1900019c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.015+0000 7ff19992a640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7ff17806c6f0 0x7ff17806eb00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.015+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 <== osd.1 v2:172.21.15.45:6800/3315000466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7ff17806f1b0 con 0x7ff17806c6f0 2023-07-09T02:23:33.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.023+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 --> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff1940d1650 con 0x7ff17806c6f0 2023-07-09T02:23:33.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff18affd640 1 -- 172.21.15.45:0/3405726385 <== osd.1 v2:172.21.15.45:6800/3315000466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7ff1840ab640 con 0x7ff17806c6f0 2023-07-09T02:23:33.028 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:33.028 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-07-09T02:23:33.028 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:33.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7ff17806c6f0 msgr2=0x7ff17806eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.45:6800/3315000466,v1:172.21.15.45:6801/3315000466] conn(0x7ff17806c6f0 0x7ff17806eb00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff178066280 msgr2=0x7ff178068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7ff178066280 0x7ff178068730 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff190001ec0 tx=0x7ff1900019c0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19415c480 msgr2=0x7ff194153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 --2- 172.21.15.45:0/3405726385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff19415c480 0x7ff194153de0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00efc0 tx=0x7ff18c009f90 comp rx=0 tx=0).stop 2023-07-09T02:23:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19a92c640 1 -- 172.21.15.45:0/3405726385 reap_dead start 2023-07-09T02:23:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 shutdown_connections 2023-07-09T02:23:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 >> 172.21.15.45:0/3405726385 conn(0x7ff1940cf490 msgr2=0x7ff194155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 shutdown_connections 2023-07-09T02:23:33.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.027+0000 7ff19c38f640 1 -- 172.21.15.45:0/3405726385 wait complete. 2023-07-09T02:23:33.046 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-09T02:23:33.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391ef40640 1 Processor -- start 2023-07-09T02:23:33.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391ef40640 1 -- start start 2023-07-09T02:23:33.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391ef40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f391815c1c0 0x7f39181607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391ef40640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39180b58d0 0x7f39180d2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391ef40640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180cefe0 con 0x7f39180d0980 2023-07-09T02:23:33.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391ef40640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39180d2850 con 0x7f39180b58d0 2023-07-09T02:23:33.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391ef40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39180cd0d0 con 0x7f391815c1c0 2023-07-09T02:23:33.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f3917fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39180b58d0 0x7f39180d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f3917fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39180b58d0 0x7f39180d2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.45:50728/0 (socket says 172.21.15.45:50728) 2023-07-09T02:23:33.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f3917fff640 1 -- 172.21.15.45:0/1010690270 learned_addr learned my addr 172.21.15.45:0/1010690270 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:33.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391d4dd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f39180d0980 0x7f39180cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.45:53218/0 (socket says 172.21.15.45:53218) 2023-07-09T02:23:33.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f391ccdc640 1 --2- 172.21.15.45:0/1010690270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f391815c1c0 0x7f39181607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f3917fff640 1 -- 172.21.15.45:0/1010690270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f391815c1c0 msgr2=0x7f39181607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:33.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f3917fff640 1 --2- 172.21.15.45:0/1010690270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f391815c1c0 0x7f39181607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f3917fff640 1 -- 172.21.15.45:0/1010690270 >> v1:172.21.15.155:6789/0 conn(0x7f39180d0980 legacy=0x7f39180cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f3917fff640 1 -- 172.21.15.45:0/1010690270 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180cecd0 con 0x7f39180b58d0 2023-07-09T02:23:33.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.187+0000 7f39177fe640 1 -- 172.21.15.45:0/1010690270 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335087101 0 0) 0x7f39180cefe0 con 0x7f39180d0980 2023-07-09T02:23:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f3917fff640 1 --2- 172.21.15.45:0/1010690270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39180b58d0 0x7f39180d2310 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3904009870 tx=0x7f390401c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81cd1a6379ccdbf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f39177fe640 1 -- 172.21.15.45:0/1010690270 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040ab600 con 0x7f39180b58d0 2023-07-09T02:23:33.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f39177fe640 1 -- 172.21.15.45:0/1010690270 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040ab760 con 0x7f39180b58d0 2023-07-09T02:23:33.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f39177fe640 1 -- 172.21.15.45:0/1010690270 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040abaf0 con 0x7f39180b58d0 2023-07-09T02:23:33.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f391ef40640 1 -- 172.21.15.45:0/1010690270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39180b58d0 msgr2=0x7f39180d2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f391ef40640 1 --2- 172.21.15.45:0/1010690270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39180b58d0 0x7f39180d2310 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3904009870 tx=0x7f390401c400 comp rx=0 tx=0).stop 2023-07-09T02:23:33.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f391ef40640 1 -- 172.21.15.45:0/1010690270 shutdown_connections 2023-07-09T02:23:33.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f391ef40640 1 --2- 172.21.15.45:0/1010690270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39180b58d0 0x7f39180d2310 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f391ef40640 1 --2- 172.21.15.45:0/1010690270 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f391815c1c0 0x7f39181607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f391ef40640 1 -- 172.21.15.45:0/1010690270 >> 172.21.15.45:0/1010690270 conn(0x7f3918069980 msgr2=0x7f3918069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f391ef40640 1 -- 172.21.15.45:0/1010690270 shutdown_connections 2023-07-09T02:23:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.191+0000 7f391ef40640 1 -- 172.21.15.45:0/1010690270 wait complete. 2023-07-09T02:23:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 Processor -- start 2023-07-09T02:23:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 -- start start 2023-07-09T02:23:33.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39180b58d0 0x7f391814eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39180d0980 0x7f39180b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f391815c1c0 0x7f39180cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918159970 con 0x7f39180d0980 2023-07-09T02:23:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918159c50 con 0x7f391815c1c0 2023-07-09T02:23:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3918159f30 con 0x7f39180b58d0 2023-07-09T02:23:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39180d0980 0x7f39180b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39180d0980 0x7f39180b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40252/0 (socket says 172.21.15.45:40252) 2023-07-09T02:23:33.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 -- 172.21.15.45:0/1270289151 learned_addr learned my addr 172.21.15.45:0/1270289151 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:33.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ccdc640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39180b58d0 0x7f391814eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391d4dd640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f391815c1c0 0x7f39180cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 -- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39180b58d0 msgr2=0x7f391814eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39180b58d0 0x7f391814eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 -- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f391815c1c0 msgr2=0x7f39180cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f391815c1c0 0x7f39180cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 -- 172.21.15.45:0/1270289151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040094d0 con 0x7f39180d0980 2023-07-09T02:23:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ccdc640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39180b58d0 0x7f391814eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391d4dd640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f391815c1c0 0x7f39180cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f3917fff640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39180d0980 0x7f39180b4980 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f39040ad040 tx=0x7f390401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f39157fa640 1 -- 172.21.15.45:0/1270289151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040be5f0 con 0x7f39180d0980 2023-07-09T02:23:33.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f39157fa640 1 -- 172.21.15.45:0/1270289151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040be770 con 0x7f39180d0980 2023-07-09T02:23:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391815a210 con 0x7f39180d0980 2023-07-09T02:23:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.195+0000 7f39157fa640 1 -- 172.21.15.45:0/1270289151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040beb20 con 0x7f39180d0980 2023-07-09T02:23:33.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.199+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391814f1e0 con 0x7f39180d0980 2023-07-09T02:23:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.199+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391804d7d0 con 0x7f39180d0980 2023-07-09T02:23:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.199+0000 7f39157fa640 1 -- 172.21.15.45:0/1270289151 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39040b4600 con 0x7f39180d0980 2023-07-09T02:23:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.199+0000 7f39157fa640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38fc066280 0x7f38fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.199+0000 7f39157fa640 1 -- 172.21.15.45:0/1270289151 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f390411e9b0 con 0x7f39180d0980 2023-07-09T02:23:33.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.199+0000 7f391ccdc640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38fc066280 0x7f38fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.203+0000 7f391ccdc640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38fc066280 0x7f38fc068730 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f390c009ae0 tx=0x7f390c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.203+0000 7f39157fa640 1 -- 172.21.15.45:0/1270289151 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39040ec0c0 con 0x7f39180d0980 2023-07-09T02:23:33.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.355+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f39180d11d0 con 0x7f38fc066280 2023-07-09T02:23:33.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f39157fa640 1 -- 172.21.15.45:0/1270289151 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f390c004020 con 0x7f38fc066280 2023-07-09T02:23:33.359 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2023-07-09T02:23:33.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38fc066280 msgr2=0x7f38fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38fc066280 0x7f38fc068730 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f390c009ae0 tx=0x7f390c008040 comp rx=0 tx=0).stop 2023-07-09T02:23:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39180d0980 msgr2=0x7f39180b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39180d0980 0x7f39180b4980 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f39040ad040 tx=0x7f390401ac40 comp rx=0 tx=0).stop 2023-07-09T02:23:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 shutdown_connections 2023-07-09T02:23:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f391815c1c0 0x7f39180cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39180d0980 0x7f39180b4980 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f38fc066280 0x7f38fc068730 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 --2- 172.21.15.45:0/1270289151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39180b58d0 0x7f391814eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 >> 172.21.15.45:0/1270289151 conn(0x7f3918069980 msgr2=0x7f39180b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:33.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 shutdown_connections 2023-07-09T02:23:33.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.359+0000 7f391ef40640 1 -- 172.21.15.45:0/1270289151 wait complete. 2023-07-09T02:23:33.381 INFO:tasks.ceph:Scrubbing osd.2 2023-07-09T02:23:33.381 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-09T02:23:33.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e93ac640 1 Processor -- start 2023-07-09T02:23:33.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e93ac640 1 -- start start 2023-07-09T02:23:33.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e93ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40cd060 0x7f66e40cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e93ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e40d19c0 con 0x7f66e40b4490 2023-07-09T02:23:33.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e93ac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e40cf210 con 0x7f66e415c480 2023-07-09T02:23:33.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e93ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e415c850 con 0x7f66e40cd060 2023-07-09T02:23:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f66e40b4490 0x7f66e40b5860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51004/0 (socket says 172.21.15.45:51004) 2023-07-09T02:23:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e37fe640 1 -- 172.21.15.45:0/1070305811 learned_addr learned my addr 172.21.15.45:0/1070305811 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66da7fc640 1 --2- 172.21.15.45:0/1070305811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40cd060 0x7f66e40cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e27fc640 1 -- 172.21.15.45:0/1070305811 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356121642 0 0) 0x7f66e40d19c0 con 0x7f66e40b4490 2023-07-09T02:23:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e27fc640 1 -- 172.21.15.45:0/1070305811 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d0003530 con 0x7f66e40b4490 2023-07-09T02:23:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66da7fc640 1 -- 172.21.15.45:0/1070305811 >> v1:172.21.15.155:6789/0 conn(0x7f66e415c480 legacy=0x7f66e40d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66e27fc640 1 -- 172.21.15.45:0/1070305811 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2992198683 0 0) 0x7f66d0003530 con 0x7f66e40b4490 2023-07-09T02:23:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66da7fc640 1 -- 172.21.15.45:0/1070305811 >> v1:172.21.15.45:6789/0 conn(0x7f66e40b4490 legacy=0x7f66e40b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.527+0000 7f66da7fc640 1 -- 172.21.15.45:0/1070305811 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40cd4d0 con 0x7f66e40cd060 2023-07-09T02:23:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66da7fc640 1 --2- 172.21.15.45:0/1070305811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40cd060 0x7f66e40cecd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0097f0 tx=0x7f66cc01c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa636970bfb520a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e27fc640 1 -- 172.21.15.45:0/1070305811 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc001a50 con 0x7f66e40cd060 2023-07-09T02:23:33.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e27fc640 1 -- 172.21.15.45:0/1070305811 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc0a7050 con 0x7f66e40cd060 2023-07-09T02:23:33.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e27fc640 1 -- 172.21.15.45:0/1070305811 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0ab620 con 0x7f66e40cd060 2023-07-09T02:23:33.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e93ac640 1 -- 172.21.15.45:0/1070305811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40cd060 msgr2=0x7f66e40cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e93ac640 1 --2- 172.21.15.45:0/1070305811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40cd060 0x7f66e40cecd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0097f0 tx=0x7f66cc01c290 comp rx=0 tx=0).stop 2023-07-09T02:23:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e93ac640 1 -- 172.21.15.45:0/1070305811 shutdown_connections 2023-07-09T02:23:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e93ac640 1 --2- 172.21.15.45:0/1070305811 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40cd060 0x7f66e40cecd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e93ac640 1 -- 172.21.15.45:0/1070305811 >> 172.21.15.45:0/1070305811 conn(0x7f66e40cf490 msgr2=0x7f66e40cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:33.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e93ac640 1 -- 172.21.15.45:0/1070305811 shutdown_connections 2023-07-09T02:23:33.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.531+0000 7f66e93ac640 1 -- 172.21.15.45:0/1070305811 wait complete. 2023-07-09T02:23:33.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 Processor -- start 2023-07-09T02:23:33.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 -- start start 2023-07-09T02:23:33.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b4490 0x7f66e414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66e40cd060 0x7f66e414aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66e415c480 0x7f66e40c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40c9490 con 0x7f66e40cd060 2023-07-09T02:23:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e414d9c0 con 0x7f66e415c480 2023-07-09T02:23:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e414dca0 con 0x7f66e40b4490 2023-07-09T02:23:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66e40cd060 0x7f66e414aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66e40cd060 0x7f66e414aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40266/0 (socket says 172.21.15.45:40266) 2023-07-09T02:23:33.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 -- 172.21.15.45:0/885334529 learned_addr learned my addr 172.21.15.45:0/885334529 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e37fe640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66e415c480 0x7f66e40c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e2ffd640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b4490 0x7f66e414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 -- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b4490 msgr2=0x7f66e414a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b4490 0x7f66e414a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 -- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66e415c480 msgr2=0x7f66e40c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66e415c480 0x7f66e40c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 -- 172.21.15.45:0/885334529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc009420 con 0x7f66e40cd060 2023-07-09T02:23:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e37fe640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66e415c480 0x7f66e40c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e2ffd640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66e40b4490 0x7f66e414a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66da7fc640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66e40cd060 0x7f66e414aa00 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0ae040 tx=0x7f66cc01aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc004020 con 0x7f66e40cd060 2023-07-09T02:23:33.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc004180 con 0x7f66e40cd060 2023-07-09T02:23:33.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e414df80 con 0x7f66e40cd060 2023-07-09T02:23:33.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0044f0 con 0x7f66e40cd060 2023-07-09T02:23:33.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.535+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e414e540 con 0x7f66e40cd060 2023-07-09T02:23:33.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66e40b4d20 con 0x7f66e40cd060 2023-07-09T02:23:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66cc003620 con 0x7f66e40cd060 2023-07-09T02:23:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66dbfff640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f66c4066280 0x7f66c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f66cc11d470 con 0x7f66e40cd060 2023-07-09T02:23:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66dbfff640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f66c406c6f0 0x7f66c406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 --> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66c406f1b0 con 0x7f66c406c6f0 2023-07-09T02:23:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=189) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66cc11fa50 con 0x7f66e40cd060 2023-07-09T02:23:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66e2ffd640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f66c4066280 0x7f66c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66e37fe640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f66c406c6f0 0x7f66c406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66e37fe640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f66c406c6f0 0x7f66c406eb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.539+0000 7f66e2ffd640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f66c4066280 0x7f66c4068730 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f66e4070bb0 tx=0x7f66d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.543+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 <== osd.2 v2:172.21.15.45:6821/1123173164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f66c406f1b0 con 0x7f66c406c6f0 2023-07-09T02:23:33.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.551+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 --> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66e40d1650 con 0x7f66c406c6f0 2023-07-09T02:23:33.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.551+0000 7f66dbfff640 1 -- 172.21.15.45:0/885334529 <== osd.2 v2:172.21.15.45:6821/1123173164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f66dc004bc0 con 0x7f66c406c6f0 2023-07-09T02:23:33.555 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:33.555 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-07-09T02:23:33.555 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:33.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.551+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f66c406c6f0 msgr2=0x7f66c406eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.551+0000 7f66e93ac640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.45:6821/1123173164,v1:172.21.15.45:6823/1123173164] conn(0x7f66c406c6f0 0x7f66c406eb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.551+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f66c4066280 msgr2=0x7f66c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.555+0000 7f66e93ac640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f66c4066280 0x7f66c4068730 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f66e4070bb0 tx=0x7f66d4009040 comp rx=0 tx=0).stop 2023-07-09T02:23:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.555+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66e40cd060 msgr2=0x7f66e414aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.555+0000 7f66e93ac640 1 --2- 172.21.15.45:0/885334529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66e40cd060 0x7f66e414aa00 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0ae040 tx=0x7f66cc01aad0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.555+0000 7f66e37fe640 1 -- 172.21.15.45:0/885334529 reap_dead start 2023-07-09T02:23:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.555+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 shutdown_connections 2023-07-09T02:23:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.555+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 >> 172.21.15.45:0/885334529 conn(0x7f66e40cf490 msgr2=0x7f66e41553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.555+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 shutdown_connections 2023-07-09T02:23:33.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.555+0000 7f66e93ac640 1 -- 172.21.15.45:0/885334529 wait complete. 2023-07-09T02:23:33.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-09T02:23:33.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd739ac640 1 Processor -- start 2023-07-09T02:23:33.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd739ac640 1 -- start start 2023-07-09T02:23:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd739ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0d2620 0x7efd6c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd739ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd6c0cd120 0x7efd6c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd739ac640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c160a50 con 0x7efd6c15c060 2023-07-09T02:23:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd739ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c15c430 con 0x7efd6c0cd120 2023-07-09T02:23:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd739ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c15fb60 con 0x7efd6c0d2620 2023-07-09T02:23:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd71f49640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd6c0cd120 0x7efd6c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd71f49640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd6c0cd120 0x7efd6c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40280/0 (socket says 172.21.15.45:40280) 2023-07-09T02:23:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.715+0000 7efd71f49640 1 -- 172.21.15.45:0/544602507 learned_addr learned my addr 172.21.15.45:0/544602507 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd70f47640 1 --2- 172.21.15.45:0/544602507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0d2620 0x7efd6c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd71f49640 1 -- 172.21.15.45:0/544602507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0d2620 msgr2=0x7efd6c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd71f49640 1 --2- 172.21.15.45:0/544602507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0d2620 0x7efd6c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd71f49640 1 -- 172.21.15.45:0/544602507 >> v1:172.21.15.155:6789/0 conn(0x7efd6c15c060 legacy=0x7efd6c0d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd71f49640 1 -- 172.21.15.45:0/544602507 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c15fe40 con 0x7efd6c0cd120 2023-07-09T02:23:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd71f49640 1 --2- 172.21.15.45:0/544602507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0cd120 0x7efd6c0cee30 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7efd64009e50 tx=0x7efd6401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f133482af6d4cee server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd63fff640 1 -- 172.21.15.45:0/544602507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640a58a0 con 0x7efd6c0cd120 2023-07-09T02:23:33.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd63fff640 1 -- 172.21.15.45:0/544602507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd640a5a00 con 0x7efd6c0cd120 2023-07-09T02:23:33.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd63fff640 1 -- 172.21.15.45:0/544602507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640a5d90 con 0x7efd6c0cd120 2023-07-09T02:23:33.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd739ac640 1 -- 172.21.15.45:0/544602507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0cd120 msgr2=0x7efd6c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.719+0000 7efd739ac640 1 --2- 172.21.15.45:0/544602507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0cd120 0x7efd6c0cee30 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7efd64009e50 tx=0x7efd6401c9e0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 -- 172.21.15.45:0/544602507 shutdown_connections 2023-07-09T02:23:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 --2- 172.21.15.45:0/544602507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0cd120 0x7efd6c0cee30 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 --2- 172.21.15.45:0/544602507 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0d2620 0x7efd6c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 -- 172.21.15.45:0/544602507 >> 172.21.15.45:0/544602507 conn(0x7efd6c0698e0 msgr2=0x7efd6c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 -- 172.21.15.45:0/544602507 shutdown_connections 2023-07-09T02:23:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 -- 172.21.15.45:0/544602507 wait complete. 2023-07-09T02:23:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 Processor -- start 2023-07-09T02:23:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 -- start start 2023-07-09T02:23:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0cd120 0x7efd6c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0d2620 0x7efd6c0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6c15c060 0x7efd6c0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c9040 con 0x7efd6c0d2620 2023-07-09T02:23:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0b4ae0 con 0x7efd6c15c060 2023-07-09T02:23:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd739ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c8d60 con 0x7efd6c0cd120 2023-07-09T02:23:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0d2620 0x7efd6c0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0d2620 0x7efd6c0c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40286/0 (socket says 172.21.15.45:40286) 2023-07-09T02:23:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 -- 172.21.15.45:0/2606840327 learned_addr learned my addr 172.21.15.45:0/2606840327 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd71f49640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6c15c060 0x7efd6c0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd71748640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0cd120 0x7efd6c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 -- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0cd120 msgr2=0x7efd6c0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0cd120 0x7efd6c0b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 -- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6c15c060 msgr2=0x7efd6c0c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6c15c060 0x7efd6c0c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 -- 172.21.15.45:0/2606840327 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009b30 con 0x7efd6c0d2620 2023-07-09T02:23:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.723+0000 7efd70f47640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0d2620 0x7efd6c0c8240 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00e930 tx=0x7efd5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.727+0000 7efd61ffb640 1 -- 172.21.15.45:0/2606840327 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c009690 con 0x7efd6c0d2620 2023-07-09T02:23:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.727+0000 7efd61ffb640 1 -- 172.21.15.45:0/2606840327 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c00ca00 con 0x7efd6c0d2620 2023-07-09T02:23:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.727+0000 7efd61ffb640 1 -- 172.21.15.45:0/2606840327 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00cdb0 con 0x7efd6c0d2620 2023-07-09T02:23:33.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.727+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c0b59f0 con 0x7efd6c0d2620 2023-07-09T02:23:33.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.727+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c0c9810 con 0x7efd6c0d2620 2023-07-09T02:23:33.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.727+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c04d7d0 con 0x7efd6c0d2620 2023-07-09T02:23:33.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.727+0000 7efd61ffb640 1 -- 172.21.15.45:0/2606840327 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd5c013470 con 0x7efd6c0d2620 2023-07-09T02:23:33.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.731+0000 7efd61ffb640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efd50066280 0x7efd50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:33.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.731+0000 7efd61ffb640 1 -- 172.21.15.45:0/2606840327 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7efd5c083b00 con 0x7efd6c0d2620 2023-07-09T02:23:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.731+0000 7efd71748640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efd50066280 0x7efd50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:33.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.731+0000 7efd71748640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efd50066280 0x7efd50068730 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efd68007fd0 tx=0x7efd68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:33.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.731+0000 7efd61ffb640 1 -- 172.21.15.45:0/2606840327 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efd5c051480 con 0x7efd6c0d2620 2023-07-09T02:23:33.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.887+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7efd6c0b5870 con 0x7efd50066280 2023-07-09T02:23:33.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.887+0000 7efd61ffb640 1 -- 172.21.15.45:0/2606840327 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd68001450 con 0x7efd50066280 2023-07-09T02:23:33.889 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2023-07-09T02:23:33.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efd50066280 msgr2=0x7efd50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efd50066280 0x7efd50068730 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efd68007fd0 tx=0x7efd68009040 comp rx=0 tx=0).stop 2023-07-09T02:23:33.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0d2620 msgr2=0x7efd6c0c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:33.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0d2620 0x7efd6c0c8240 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00e930 tx=0x7efd5c00edf0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 shutdown_connections 2023-07-09T02:23:33.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd6c15c060 0x7efd6c0c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd6c0d2620 0x7efd6c0c8240 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7efd50066280 0x7efd50068730 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 --2- 172.21.15.45:0/2606840327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd6c0cd120 0x7efd6c0b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:33.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 >> 172.21.15.45:0/2606840327 conn(0x7efd6c0698e0 msgr2=0x7efd6c0b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:33.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 shutdown_connections 2023-07-09T02:23:33.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:33.891+0000 7efd739ac640 1 -- 172.21.15.45:0/2606840327 wait complete. 2023-07-09T02:23:33.911 INFO:tasks.ceph:Scrubbing osd.3 2023-07-09T02:23:33.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-09T02:23:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592c1e2640 1 Processor -- start 2023-07-09T02:23:34.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592c1e2640 1 -- start start 2023-07-09T02:23:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592c1e2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59240cd060 0x7f59240cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592c1e2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f59240b4490 0x7f59240b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592c1e2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59240d19c0 con 0x7f592415c480 2023-07-09T02:23:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592c1e2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592415c850 con 0x7f59240b4490 2023-07-09T02:23:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592c1e2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59240b4e50 con 0x7f59240cd060 2023-07-09T02:23:34.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5929f7e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f592415c480 0x7f59240d1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51006/0 (socket says 172.21.15.45:51006) 2023-07-09T02:23:34.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5929f7e640 1 -- 172.21.15.45:0/691832126 learned_addr learned my addr 172.21.15.45:0/691832126 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:34.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592a77f640 1 --2- 172.21.15.45:0/691832126 >> v2:172.21.15.155:3300/0 conn(0x7f59240b4490 0x7f59240b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f592977d640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59240cd060 0x7f59240cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131237979 0 0) 0x7f59240d19c0 con 0x7f592415c480 2023-07-09T02:23:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5910003530 con 0x7f592415c480 2023-07-09T02:23:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2693311537 0 0) 0x7f5910003530 con 0x7f592415c480 2023-07-09T02:23:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59240cd060 msgr2=0x7f59240cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5928f7c640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59240cd060 0x7f59240cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 >> v2:172.21.15.155:3300/0 conn(0x7f59240b4490 msgr2=0x7f59240b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:34.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.055+0000 7f5928f7c640 1 --2- 172.21.15.45:0/691832126 >> v2:172.21.15.155:3300/0 conn(0x7f59240b4490 0x7f59240b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59240cf210 con 0x7f592415c480 2023-07-09T02:23:34.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1547062834 0 0) 0x7f5920001680 con 0x7f592415c480 2023-07-09T02:23:34.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 >> v1:172.21.15.45:6789/0 conn(0x7f592415c480 legacy=0x7f59240d1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5910003980 0x7f5910003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59100043b0 0x7f5910004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5910004ee0 0x7f591000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592415c850 con 0x7f59100043b0 2023-07-09T02:23:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240b4e50 con 0x7f5910003980 2023-07-09T02:23:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591000bed0 con 0x7f5910004ee0 2023-07-09T02:23:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592977d640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59240cd060 0x7f59240cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:23:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592a77f640 1 --2- 172.21.15.45:0/691832126 >> v2:172.21.15.155:3300/0 conn(0x7f59240b4490 0x7f59240b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T02:23:34.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592977d640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59100043b0 0x7f5910004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f5929f7e640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5910003980 0x7f5910003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592a77f640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5910004ee0 0x7f591000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592977d640 1 -- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5910004ee0 msgr2=0x7f591000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592977d640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5910004ee0 0x7f591000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592977d640 1 -- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5910003980 msgr2=0x7f5910003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592977d640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5910003980 0x7f5910003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592977d640 1 -- 172.21.15.45:0/691832126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5910003530 con 0x7f59100043b0 2023-07-09T02:23:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.059+0000 7f592977d640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59100043b0 0x7f5910004870 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f59240b5600 tx=0x7f591401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49da5aee15e3ea3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914004030 con 0x7f59100043b0 2023-07-09T02:23:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914004190 con 0x7f59100043b0 2023-07-09T02:23:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f5928f7c640 1 -- 172.21.15.45:0/691832126 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914004520 con 0x7f59100043b0 2023-07-09T02:23:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- 172.21.15.45:0/691832126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59100043b0 msgr2=0x7f5910004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 --2- 172.21.15.45:0/691832126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59100043b0 0x7f5910004870 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f59240b5600 tx=0x7f591401ca90 comp rx=0 tx=0).stop 2023-07-09T02:23:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592a77f640 1 -- 172.21.15.45:0/691832126 reap_dead start 2023-07-09T02:23:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- 172.21.15.45:0/691832126 shutdown_connections 2023-07-09T02:23:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- 172.21.15.45:0/691832126 >> 172.21.15.45:0/691832126 conn(0x7f59240cf490 msgr2=0x7f59240cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- 172.21.15.45:0/691832126 shutdown_connections 2023-07-09T02:23:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- 172.21.15.45:0/691832126 wait complete. 2023-07-09T02:23:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 Processor -- start 2023-07-09T02:23:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- start start 2023-07-09T02:23:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59100043b0 0x7f59241504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59241f2da0 0x7f59240b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59240b80c0 0x7f592415e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240b8530 con 0x7f59240b80c0 2023-07-09T02:23:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c7280 con 0x7f59241f2da0 2023-07-09T02:23:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592c1e2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c6670 con 0x7f59100043b0 2023-07-09T02:23:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592a77f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59240b80c0 0x7f592415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592a77f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59240b80c0 0x7f592415e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40294/0 (socket says 172.21.15.45:40294) 2023-07-09T02:23:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.063+0000 7f592a77f640 1 -- 172.21.15.45:0/1488374138 learned_addr learned my addr 172.21.15.45:0/1488374138 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592a77f640 1 -- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59100043b0 msgr2=0x7f59241504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592a77f640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f59100043b0 0x7f59241504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592a77f640 1 -- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59241f2da0 msgr2=0x7f59240b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592977d640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59241f2da0 0x7f59240b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592a77f640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59241f2da0 0x7f59240b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592a77f640 1 -- 172.21.15.45:0/1488374138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59240c6950 con 0x7f59240b80c0 2023-07-09T02:23:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592977d640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59241f2da0 0x7f59240b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592a77f640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59240b80c0 0x7f592415e390 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f59240ce480 tx=0x7f591c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c01c070 con 0x7f59240b80c0 2023-07-09T02:23:34.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c00f040 con 0x7f59240b80c0 2023-07-09T02:23:34.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c00e040 con 0x7f59240b80c0 2023-07-09T02:23:34.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59240c6c30 con 0x7f59240b80c0 2023-07-09T02:23:34.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59241f31f0 con 0x7f59240b80c0 2023-07-09T02:23:34.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59240c70e0 con 0x7f59240b80c0 2023-07-09T02:23:34.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f591c015700 con 0x7f59240b80c0 2023-07-09T02:23:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5908066280 0x7f5908068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f591c0835d0 con 0x7f59240b80c0 2023-07-09T02:23:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f590806c6f0 0x7f590806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 --> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f590806f1b0 con 0x7f590806c6f0 2023-07-09T02:23:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=189) v2 ==== 24+0+0 (secure 0 0 0) 0x7f591c085c70 con 0x7f59240b80c0 2023-07-09T02:23:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.067+0000 7f5929f7e640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5908066280 0x7f5908068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.071+0000 7f592977d640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f590806c6f0 0x7f590806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.071+0000 7f5929f7e640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5908066280 0x7f5908068730 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f59200017c0 tx=0x7f5920001c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.071+0000 7f592977d640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f590806c6f0 0x7f590806eb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.071+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 <== osd.3 v2:172.21.15.45:6814/2399948348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f590806f1b0 con 0x7f590806c6f0 2023-07-09T02:23:34.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 --> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59240d1090 con 0x7f590806c6f0 2023-07-09T02:23:34.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f591a7fc640 1 -- 172.21.15.45:0/1488374138 <== osd.3 v2:172.21.15.45:6814/2399948348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f5914004390 con 0x7f590806c6f0 2023-07-09T02:23:34.084 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:34.084 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-07-09T02:23:34.085 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:34.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f590806c6f0 msgr2=0x7f590806eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.45:6814/2399948348,v1:172.21.15.45:6815/2399948348] conn(0x7f590806c6f0 0x7f590806eb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5908066280 msgr2=0x7f5908068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f5908066280 0x7f5908068730 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f59200017c0 tx=0x7f5920001c00 comp rx=0 tx=0).stop 2023-07-09T02:23:34.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59240b80c0 msgr2=0x7f592415e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 --2- 172.21.15.45:0/1488374138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59240b80c0 0x7f592415e390 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f59240ce480 tx=0x7f591c011ec0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592a77f640 1 -- 172.21.15.45:0/1488374138 reap_dead start 2023-07-09T02:23:34.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 shutdown_connections 2023-07-09T02:23:34.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 >> 172.21.15.45:0/1488374138 conn(0x7f59240cf490 msgr2=0x7f59240d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:34.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 shutdown_connections 2023-07-09T02:23:34.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.083+0000 7f592c1e2640 1 -- 172.21.15.45:0/1488374138 wait complete. 2023-07-09T02:23:34.102 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-09T02:23:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2bf8f640 1 Processor -- start 2023-07-09T02:23:34.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2bf8f640 1 -- start start 2023-07-09T02:23:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2bf8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a2415c060 0x7f0a240b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2bf8f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2bf8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 0x7f0a240d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2bf8f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a240d28f0 con 0x7f0a2415c060 2023-07-09T02:23:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2bf8f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a24160a50 con 0x7f0a240cd120 2023-07-09T02:23:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2bf8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415c430 con 0x7f0a240d2450 2023-07-09T02:23:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a29d2b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a2415c060 0x7f0a240b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a29d2b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a2415c060 0x7f0a240b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40300/0 (socket says 172.21.15.45:40300) 2023-07-09T02:23:34.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a29d2b640 1 -- 172.21.15.45:0/3204450366 learned_addr learned my addr 172.21.15.45:0/3204450366 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2a52c640 1 --2- 172.21.15.45:0/3204450366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 0x7f0a240d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.243+0000 7f0a2952a640 1 --2- 172.21.15.45:0/3204450366 >> v2:172.21.15.155:3300/0 conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a29d2b640 1 -- 172.21.15.45:0/3204450366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 msgr2=0x7f0a240d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a29d2b640 1 --2- 172.21.15.45:0/3204450366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 0x7f0a240d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a29d2b640 1 -- 172.21.15.45:0/3204450366 >> v2:172.21.15.155:3300/0 conn(0x7f0a240cd120 msgr2=0x7f0a240d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a29d2b640 1 --2- 172.21.15.45:0/3204450366 >> v2:172.21.15.155:3300/0 conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a29d2b640 1 -- 172.21.15.45:0/3204450366 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2415fb60 con 0x7f0a2415c060 2023-07-09T02:23:34.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a29d2b640 1 --2- 172.21.15.45:0/3204450366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a2415c060 0x7f0a240b4ed0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f0a2415fac0 tx=0x7f0a2001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9836be39032c8f27 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a28d29640 1 -- 172.21.15.45:0/3204450366 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200ab600 con 0x7f0a2415c060 2023-07-09T02:23:34.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a28d29640 1 -- 172.21.15.45:0/3204450366 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a200a7050 con 0x7f0a2415c060 2023-07-09T02:23:34.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a28d29640 1 -- 172.21.15.45:0/3204450366 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200ab980 con 0x7f0a2415c060 2023-07-09T02:23:34.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/3204450366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a2415c060 msgr2=0x7f0a240b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/3204450366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a2415c060 0x7f0a240b4ed0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f0a2415fac0 tx=0x7f0a2001c210 comp rx=0 tx=0).stop 2023-07-09T02:23:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/3204450366 shutdown_connections 2023-07-09T02:23:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/3204450366 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a240d2450 0x7f0a240d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/3204450366 >> v2:172.21.15.155:3300/0 conn(0x7f0a240cd120 0x7f0a240d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/3204450366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a2415c060 0x7f0a240b4ed0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/3204450366 >> 172.21.15.45:0/3204450366 conn(0x7f0a240698e0 msgr2=0x7f0a24069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.247+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/3204450366 shutdown_connections 2023-07-09T02:23:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/3204450366 wait complete. 2023-07-09T02:23:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 Processor -- start 2023-07-09T02:23:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 -- start start 2023-07-09T02:23:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240cd120 0x7f0a240cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240d2450 0x7f0a2415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a2415c060 0x7f0a24159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415b180 con 0x7f0a240d2450 2023-07-09T02:23:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415a7b0 con 0x7f0a240cd120 2023-07-09T02:23:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2bf8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241598d0 con 0x7f0a2415c060 2023-07-09T02:23:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240d2450 0x7f0a2415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240d2450 0x7f0a2415ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40306/0 (socket says 172.21.15.45:40306) 2023-07-09T02:23:34.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 -- 172.21.15.45:0/4279089205 learned_addr learned my addr 172.21.15.45:0/4279089205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:34.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a29d2b640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240cd120 0x7f0a240cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2a52c640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a2415c060 0x7f0a24159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 -- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a2415c060 msgr2=0x7f0a24159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a2415c060 0x7f0a24159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 -- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240cd120 msgr2=0x7f0a240cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240cd120 0x7f0a240cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 -- 172.21.15.45:0/4279089205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a200094d0 con 0x7f0a240d2450 2023-07-09T02:23:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2a52c640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a2415c060 0x7f0a24159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:34.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a2952a640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240d2450 0x7f0a2415ac40 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400d7d0 tx=0x7f0a1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.251+0000 7f0a1a7fc640 1 -- 172.21.15.45:0/4279089205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14004020 con 0x7f0a240d2450 2023-07-09T02:23:34.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a1a7fc640 1 -- 172.21.15.45:0/4279089205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14004180 con 0x7f0a240d2450 2023-07-09T02:23:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a1a7fc640 1 -- 172.21.15.45:0/4279089205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14004330 con 0x7f0a240d2450 2023-07-09T02:23:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a24159ba0 con 0x7f0a240d2450 2023-07-09T02:23:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2415a160 con 0x7f0a240d2450 2023-07-09T02:23:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2404d7d0 con 0x7f0a240d2450 2023-07-09T02:23:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a1a7fc640 1 -- 172.21.15.45:0/4279089205 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a140096a0 con 0x7f0a240d2450 2023-07-09T02:23:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a1a7fc640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a080662b0 0x7f0a08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a1a7fc640 1 -- 172.21.15.45:0/4279089205 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0a14083dd0 con 0x7f0a240d2450 2023-07-09T02:23:34.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.255+0000 7f0a29d2b640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a080662b0 0x7f0a08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.259+0000 7f0a29d2b640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a080662b0 0x7f0a08068760 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0a200ad000 tx=0x7f0a200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.259+0000 7f0a1a7fc640 1 -- 172.21.15.45:0/4279089205 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a14051440 con 0x7f0a240d2450 2023-07-09T02:23:34.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.411+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a241606e0 con 0x7f0a080662b0 2023-07-09T02:23:34.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.411+0000 7f0a1a7fc640 1 -- 172.21.15.45:0/4279089205 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0a200ab5a0 con 0x7f0a080662b0 2023-07-09T02:23:34.415 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2023-07-09T02:23:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a080662b0 msgr2=0x7f0a08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a080662b0 0x7f0a08068760 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0a200ad000 tx=0x7f0a200a6000 comp rx=0 tx=0).stop 2023-07-09T02:23:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240d2450 msgr2=0x7f0a2415ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240d2450 0x7f0a2415ac40 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400d7d0 tx=0x7f0a1400dc90 comp rx=0 tx=0).stop 2023-07-09T02:23:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 shutdown_connections 2023-07-09T02:23:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0a080662b0 0x7f0a08068760 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a2415c060 0x7f0a24159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a240d2450 0x7f0a2415ac40 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 --2- 172.21.15.45:0/4279089205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a240cd120 0x7f0a240cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 >> 172.21.15.45:0/4279089205 conn(0x7f0a240698e0 msgr2=0x7f0a240b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 shutdown_connections 2023-07-09T02:23:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.415+0000 7f0a2bf8f640 1 -- 172.21.15.45:0/4279089205 wait complete. 2023-07-09T02:23:34.436 INFO:tasks.ceph:Scrubbing osd.4 2023-07-09T02:23:34.437 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-09T02:23:34.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.587+0000 7f2a758ec640 1 Processor -- start 2023-07-09T02:23:34.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.587+0000 7f2a758ec640 1 -- start start 2023-07-09T02:23:34.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a758ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2a7015c2a0 0x7f2a70160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a758ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2a70069980 0x7f2a70069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a758ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a70160b60 con 0x7f2a700ceaf0 2023-07-09T02:23:34.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a758ec640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a700d05a0 con 0x7f2a70069980 2023-07-09T02:23:34.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a758ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7006a340 con 0x7f2a7015c2a0 2023-07-09T02:23:34.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2a70069980 0x7f2a70069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6f7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2a70069980 0x7f2a70069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40322/0 (socket says 172.21.15.45:40322) 2023-07-09T02:23:34.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6f7fe640 1 -- 172.21.15.45:0/2083843000 learned_addr learned my addr 172.21.15.45:0/2083843000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:34.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6effd640 1 --2- 172.21.15.45:0/2083843000 >> v2:172.21.15.155:3300/0 conn(0x7f2a7015c2a0 0x7f2a70160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6f7fe640 1 -- 172.21.15.45:0/2083843000 >> v2:172.21.15.155:3300/0 conn(0x7f2a7015c2a0 msgr2=0x7f2a70160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:34.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6f7fe640 1 --2- 172.21.15.45:0/2083843000 >> v2:172.21.15.155:3300/0 conn(0x7f2a7015c2a0 0x7f2a70160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6f7fe640 1 -- 172.21.15.45:0/2083843000 >> v1:172.21.15.155:6789/0 conn(0x7f2a700ceaf0 legacy=0x7f2a700b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6f7fe640 1 -- 172.21.15.45:0/2083843000 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a700ccf90 con 0x7f2a70069980 2023-07-09T02:23:34.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.591+0000 7f2a6f7fe640 1 --2- 172.21.15.45:0/2083843000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 0x7f2a70069e00 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f2a7008b480 tx=0x7f2a6801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba26974f8e98379d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a6e7fc640 1 -- 172.21.15.45:0/2083843000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680a5880 con 0x7f2a70069980 2023-07-09T02:23:34.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a6e7fc640 1 -- 172.21.15.45:0/2083843000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a680a59e0 con 0x7f2a70069980 2023-07-09T02:23:34.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a6e7fc640 1 -- 172.21.15.45:0/2083843000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680a5d70 con 0x7f2a70069980 2023-07-09T02:23:34.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- 172.21.15.45:0/2083843000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 msgr2=0x7f2a70069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 --2- 172.21.15.45:0/2083843000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 0x7f2a70069e00 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f2a7008b480 tx=0x7f2a6801c9a0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- 172.21.15.45:0/2083843000 shutdown_connections 2023-07-09T02:23:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 --2- 172.21.15.45:0/2083843000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 0x7f2a70069e00 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 --2- 172.21.15.45:0/2083843000 >> v2:172.21.15.155:3300/0 conn(0x7f2a7015c2a0 0x7f2a70160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- 172.21.15.45:0/2083843000 >> 172.21.15.45:0/2083843000 conn(0x7f2a700cffb0 msgr2=0x7f2a700d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- 172.21.15.45:0/2083843000 shutdown_connections 2023-07-09T02:23:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- 172.21.15.45:0/2083843000 wait complete. 2023-07-09T02:23:34.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 Processor -- start 2023-07-09T02:23:34.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- start start 2023-07-09T02:23:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 0x7f2a7014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a700ceaf0 0x7f2a70071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a7015c2a0 0x7f2a700716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7014f3a0 con 0x7f2a70069980 2023-07-09T02:23:34.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7014ed90 con 0x7f2a7015c2a0 2023-07-09T02:23:34.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.595+0000 7f2a758ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7015f200 con 0x7f2a700ceaf0 2023-07-09T02:23:34.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 0x7f2a7014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 0x7f2a7014a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40328/0 (socket says 172.21.15.45:40328) 2023-07-09T02:23:34.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 -- 172.21.15.45:0/3179508831 learned_addr learned my addr 172.21.15.45:0/3179508831 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:34.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a67fff640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a700ceaf0 0x7f2a70071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6f7fe640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a7015c2a0 0x7f2a700716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 -- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a700ceaf0 msgr2=0x7f2a70071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a700ceaf0 0x7f2a70071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 -- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a7015c2a0 msgr2=0x7f2a700716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a7015c2a0 0x7f2a700716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 -- 172.21.15.45:0/3179508831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a68009b30 con 0x7f2a70069980 2023-07-09T02:23:34.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a67fff640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a700ceaf0 0x7f2a70071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:34.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6effd640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 0x7f2a7014a900 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000e930 tx=0x7f2a6000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60009690 con 0x7f2a70069980 2023-07-09T02:23:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6000ca00 con 0x7f2a70069980 2023-07-09T02:23:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000cd70 con 0x7f2a70069980 2023-07-09T02:23:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7015f4e0 con 0x7f2a70069980 2023-07-09T02:23:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7014ae40 con 0x7f2a70069980 2023-07-09T02:23:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a700cf080 con 0x7f2a70069980 2023-07-09T02:23:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.599+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a60013470 con 0x7f2a70069980 2023-07-09T02:23:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a6cff9640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2a50066280 0x7f2a50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2a60083fe0 con 0x7f2a70069980 2023-07-09T02:23:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a6cff9640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2a5006c6f0 0x7f2a5006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 --> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a5006f1b0 con 0x7f2a5006c6f0 2023-07-09T02:23:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=189) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a60084370 con 0x7f2a70069980 2023-07-09T02:23:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a67fff640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2a50066280 0x7f2a50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a6f7fe640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2a5006c6f0 0x7f2a5006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a67fff640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2a50066280 0x7f2a50068730 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2a70155350 tx=0x7f2a58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a6f7fe640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2a5006c6f0 0x7f2a5006eb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.603+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 <== osd.4 v2:172.21.15.155:6808/3680660905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f2a5006f1b0 con 0x7f2a5006c6f0 2023-07-09T02:23:34.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 --> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2a7014f4e0 con 0x7f2a5006c6f0 2023-07-09T02:23:34.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a6cff9640 1 -- 172.21.15.45:0/3179508831 <== osd.4 v2:172.21.15.155:6808/3680660905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f2a680090d0 con 0x7f2a5006c6f0 2023-07-09T02:23:34.617 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:34.618 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-07-09T02:23:34.618 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:34.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2a5006c6f0 msgr2=0x7f2a5006eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6808/3680660905,v1:172.21.15.155:6809/3680660905] conn(0x7f2a5006c6f0 0x7f2a5006eb00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2a50066280 msgr2=0x7f2a50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2a50066280 0x7f2a50068730 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2a70155350 tx=0x7f2a58009040 comp rx=0 tx=0).stop 2023-07-09T02:23:34.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 msgr2=0x7f2a7014a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 --2- 172.21.15.45:0/3179508831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a70069980 0x7f2a7014a900 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000e930 tx=0x7f2a6000edf0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a6f7fe640 1 -- 172.21.15.45:0/3179508831 reap_dead start 2023-07-09T02:23:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 shutdown_connections 2023-07-09T02:23:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 >> 172.21.15.45:0/3179508831 conn(0x7f2a700cffb0 msgr2=0x7f2a700b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 shutdown_connections 2023-07-09T02:23:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.615+0000 7f2a758ec640 1 -- 172.21.15.45:0/3179508831 wait complete. 2023-07-09T02:23:34.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-09T02:23:34.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54ac5c5640 1 Processor -- start 2023-07-09T02:23:34.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54ac5c5640 1 -- start start 2023-07-09T02:23:34.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54ac5c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40cd120 0x7f54a40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54ac5c5640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a4160a50 con 0x7f54a40d2620 2023-07-09T02:23:34.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54ac5c5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a415c430 con 0x7f54a415c060 2023-07-09T02:23:34.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54ac5c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a415fb60 con 0x7f54a40cd120 2023-07-09T02:23:34.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54a9b60640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f54a40d2620 0x7f54a40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51022/0 (socket says 172.21.15.45:51022) 2023-07-09T02:23:34.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54a9b60640 1 -- 172.21.15.45:0/1429312223 learned_addr learned my addr 172.21.15.45:0/1429312223 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:34.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54aab62640 1 --2- 172.21.15.45:0/1429312223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40cd120 0x7f54a40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54a935f640 1 -- 172.21.15.45:0/1429312223 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221840072 0 0) 0x7f54a4160a50 con 0x7f54a40d2620 2023-07-09T02:23:34.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54a935f640 1 -- 172.21.15.45:0/1429312223 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5490003530 con 0x7f54a40d2620 2023-07-09T02:23:34.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54a935f640 1 -- 172.21.15.45:0/1429312223 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761286881 0 0) 0x7f54a415c430 con 0x7f54a415c060 2023-07-09T02:23:34.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54a935f640 1 -- 172.21.15.45:0/1429312223 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a4160a50 con 0x7f54a415c060 2023-07-09T02:23:34.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54aab62640 1 -- 172.21.15.45:0/1429312223 >> v1:172.21.15.155:6789/0 conn(0x7f54a415c060 legacy=0x7f54a40d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54aab62640 1 -- 172.21.15.45:0/1429312223 >> v1:172.21.15.45:6789/0 conn(0x7f54a40d2620 legacy=0x7f54a40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.779+0000 7f54aab62640 1 -- 172.21.15.45:0/1429312223 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a415fe40 con 0x7f54a40cd120 2023-07-09T02:23:34.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.783+0000 7f54aab62640 1 --2- 172.21.15.45:0/1429312223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40cd120 0x7f54a40b4ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f549c009dc0 tx=0x7f549c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca769cb2b87c0343 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.783+0000 7f54a935f640 1 -- 172.21.15.45:0/1429312223 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0a5a00 con 0x7f54a40cd120 2023-07-09T02:23:34.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.783+0000 7f54a935f640 1 -- 172.21.15.45:0/1429312223 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0a5b60 con 0x7f54a40cd120 2023-07-09T02:23:34.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.783+0000 7f54a935f640 1 -- 172.21.15.45:0/1429312223 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0ad440 con 0x7f54a40cd120 2023-07-09T02:23:34.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.783+0000 7f54ac5c5640 1 -- 172.21.15.45:0/1429312223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40cd120 msgr2=0x7f54a40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.783+0000 7f54ac5c5640 1 --2- 172.21.15.45:0/1429312223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40cd120 0x7f54a40b4ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f549c009dc0 tx=0x7f549c01c940 comp rx=0 tx=0).stop 2023-07-09T02:23:34.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 -- 172.21.15.45:0/1429312223 shutdown_connections 2023-07-09T02:23:34.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 --2- 172.21.15.45:0/1429312223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40cd120 0x7f54a40b4ed0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 -- 172.21.15.45:0/1429312223 >> 172.21.15.45:0/1429312223 conn(0x7f54a40698e0 msgr2=0x7f54a4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:34.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 -- 172.21.15.45:0/1429312223 shutdown_connections 2023-07-09T02:23:34.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 -- 172.21.15.45:0/1429312223 wait complete. 2023-07-09T02:23:34.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 Processor -- start 2023-07-09T02:23:34.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 -- start start 2023-07-09T02:23:34.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54a40cd120 0x7f54a4153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40d2620 0x7f54a40cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a415c060 0x7f54a415e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40ca8c0 con 0x7f54a415c060 2023-07-09T02:23:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4154840 con 0x7f54a40cd120 2023-07-09T02:23:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54ac5c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c9cb0 con 0x7f54a40d2620 2023-07-09T02:23:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54aab62640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a415c060 0x7f54a415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54aab62640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a415c060 0x7f54a415e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40336/0 (socket says 172.21.15.45:40336) 2023-07-09T02:23:34.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54aab62640 1 -- 172.21.15.45:0/3147256779 learned_addr learned my addr 172.21.15.45:0/3147256779 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:34.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54aab62640 1 -- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40d2620 msgr2=0x7f54a40cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54aab62640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40d2620 0x7f54a40cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54aab62640 1 -- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54a40cd120 msgr2=0x7f54a4153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54aab62640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54a40cd120 0x7f54a4153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.787+0000 7f54aab62640 1 -- 172.21.15.45:0/3147256779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c009a70 con 0x7f54a415c060 2023-07-09T02:23:34.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f54aab62640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a415c060 0x7f54a415e210 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f549c01a570 tx=0x7f549c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f549affd640 1 -- 172.21.15.45:0/3147256779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0adc80 con 0x7f54a415c060 2023-07-09T02:23:34.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f549affd640 1 -- 172.21.15.45:0/3147256779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0adde0 con 0x7f54a415c060 2023-07-09T02:23:34.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f549affd640 1 -- 172.21.15.45:0/3147256779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0b9690 con 0x7f54a415c060 2023-07-09T02:23:34.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a40b59f0 con 0x7f54a415c060 2023-07-09T02:23:34.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a40ca270 con 0x7f54a415c060 2023-07-09T02:23:34.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a404d7d0 con 0x7f54a415c060 2023-07-09T02:23:34.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f549affd640 1 -- 172.21.15.45:0/3147256779 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f549c0b97f0 con 0x7f54a415c060 2023-07-09T02:23:34.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f549affd640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54880662b0 0x7f5488068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:34.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f549affd640 1 -- 172.21.15.45:0/3147256779 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f549c11f110 con 0x7f54a415c060 2023-07-09T02:23:34.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.791+0000 7f54aa361640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54880662b0 0x7f5488068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:34.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.795+0000 7f54aa361640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54880662b0 0x7f5488068760 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f54a0007fd0 tx=0x7f54a0007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:34.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.795+0000 7f549affd640 1 -- 172.21.15.45:0/3147256779 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f549c0ec8a0 con 0x7f54a415c060 2023-07-09T02:23:34.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.951+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f54a40b5870 con 0x7f54880662b0 2023-07-09T02:23:34.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f549affd640 1 -- 172.21.15.45:0/3147256779 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f54a00050d0 con 0x7f54880662b0 2023-07-09T02:23:34.956 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2023-07-09T02:23:34.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54880662b0 msgr2=0x7f5488068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54880662b0 0x7f5488068760 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f54a0007fd0 tx=0x7f54a0007960 comp rx=0 tx=0).stop 2023-07-09T02:23:34.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a415c060 msgr2=0x7f54a415e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:34.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a415c060 0x7f54a415e210 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f549c01a570 tx=0x7f549c0196e0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 shutdown_connections 2023-07-09T02:23:34.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a415c060 0x7f54a415e210 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f54880662b0 0x7f5488068760 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54a40d2620 0x7f54a40cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 --2- 172.21.15.45:0/3147256779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54a40cd120 0x7f54a4153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:34.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 >> 172.21.15.45:0/3147256779 conn(0x7f54a40698e0 msgr2=0x7f54a40b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:34.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 shutdown_connections 2023-07-09T02:23:34.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:34.955+0000 7f54ac5c5640 1 -- 172.21.15.45:0/3147256779 wait complete. 2023-07-09T02:23:34.977 INFO:tasks.ceph:Scrubbing osd.5 2023-07-09T02:23:34.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-09T02:23:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88759e640 1 Processor -- start 2023-07-09T02:23:35.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88759e640 1 -- start start 2023-07-09T02:23:35.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc88815c280 0x7fc8880b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88759e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8880cead0 0x7fc888160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88759e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880cced0 con 0x7fc888069980 2023-07-09T02:23:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88759e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880cd6e0 con 0x7fc8880cead0 2023-07-09T02:23:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880d0450 con 0x7fc88815c280 2023-07-09T02:23:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc87ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8880cead0 0x7fc888160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc886d9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc888069980 0x7fc8880d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51032/0 (socket says 172.21.15.45:51032) 2023-07-09T02:23:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc886d9d640 1 -- 172.21.15.45:0/1964264427 learned_addr learned my addr 172.21.15.45:0/1964264427 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc87ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8880cead0 0x7fc888160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40338/0 (socket says 172.21.15.45:40338) 2023-07-09T02:23:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88659c640 1 --2- 172.21.15.45:0/1964264427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc88815c280 0x7fc8880b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc87ffff640 1 -- 172.21.15.45:0/1964264427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc88815c280 msgr2=0x7fc8880b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc87ffff640 1 --2- 172.21.15.45:0/1964264427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc88815c280 0x7fc8880b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc87ffff640 1 -- 172.21.15.45:0/1964264427 >> v1:172.21.15.45:6789/0 conn(0x7fc888069980 legacy=0x7fc8880d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc87ffff640 1 -- 172.21.15.45:0/1964264427 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888160b40 con 0x7fc8880cead0 2023-07-09T02:23:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc885d9b640 1 -- 172.21.15.45:0/1964264427 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441356881 0 0) 0x7fc8880cced0 con 0x7fc888069980 2023-07-09T02:23:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.123+0000 7fc88659c640 1 --2- 172.21.15.45:0/1964264427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc88815c280 0x7fc8880b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:35.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc87ffff640 1 --2- 172.21.15.45:0/1964264427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 0x7fc888160600 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fc8700097c0 tx=0x7fc87001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606f0f13b4d3014c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc885d9b640 1 -- 172.21.15.45:0/1964264427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700ab680 con 0x7fc8880cead0 2023-07-09T02:23:35.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc885d9b640 1 -- 172.21.15.45:0/1964264427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8700ab7e0 con 0x7fc8880cead0 2023-07-09T02:23:35.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc885d9b640 1 -- 172.21.15.45:0/1964264427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700abb70 con 0x7fc8880cead0 2023-07-09T02:23:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc88759e640 1 -- 172.21.15.45:0/1964264427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 msgr2=0x7fc888160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc88759e640 1 --2- 172.21.15.45:0/1964264427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 0x7fc888160600 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fc8700097c0 tx=0x7fc87001c480 comp rx=0 tx=0).stop 2023-07-09T02:23:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc88759e640 1 -- 172.21.15.45:0/1964264427 shutdown_connections 2023-07-09T02:23:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc88759e640 1 --2- 172.21.15.45:0/1964264427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 0x7fc888160600 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc88759e640 1 --2- 172.21.15.45:0/1964264427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc88815c280 0x7fc8880b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc88759e640 1 -- 172.21.15.45:0/1964264427 >> 172.21.15.45:0/1964264427 conn(0x7fc8880cff90 msgr2=0x7fc8880d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc88759e640 1 -- 172.21.15.45:0/1964264427 shutdown_connections 2023-07-09T02:23:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.127+0000 7fc88759e640 1 -- 172.21.15.45:0/1964264427 wait complete. 2023-07-09T02:23:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 Processor -- start 2023-07-09T02:23:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 -- start start 2023-07-09T02:23:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc888069980 0x7fc88814eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 0x7fc8880b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc88815c280 0x7fc88813da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88814bd50 con 0x7fc8880cead0 2023-07-09T02:23:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888152e90 con 0x7fc88815c280 2023-07-09T02:23:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc888157e30 con 0x7fc888069980 2023-07-09T02:23:35.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 0x7fc8880b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 0x7fc8880b6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40346/0 (socket says 172.21.15.45:40346) 2023-07-09T02:23:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 -- 172.21.15.45:0/1680771432 learned_addr learned my addr 172.21.15.45:0/1680771432 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88659c640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc888069980 0x7fc88814eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc886d9d640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc88815c280 0x7fc88813da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 -- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc888069980 msgr2=0x7fc88814eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc888069980 0x7fc88814eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 -- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc88815c280 msgr2=0x7fc88813da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc88815c280 0x7fc88813da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 -- 172.21.15.45:0/1680771432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870009420 con 0x7fc8880cead0 2023-07-09T02:23:35.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87ffff640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 0x7fc8880b6c90 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fc8700ad040 tx=0x7fc87001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700b5810 con 0x7fc8880cead0 2023-07-09T02:23:35.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8700b59b0 con 0x7fc8880cead0 2023-07-09T02:23:35.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8880b7ba0 con 0x7fc8880cead0 2023-07-09T02:23:35.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700b5d60 con 0x7fc8880cead0 2023-07-09T02:23:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8880b75e0 con 0x7fc8880cead0 2023-07-09T02:23:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.131+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc88806a1d0 con 0x7fc8880cead0 2023-07-09T02:23:35.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8700c83f0 con 0x7fc8880cead0 2023-07-09T02:23:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc87effd640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc868066280 0x7fc868068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc87011e9a0 con 0x7fc8880cead0 2023-07-09T02:23:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc87effd640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7fc86806c6f0 0x7fc86806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 --> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc86806f1b0 con 0x7fc86806c6f0 2023-07-09T02:23:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=189) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8701232a0 con 0x7fc8880cead0 2023-07-09T02:23:35.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc88659c640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc868066280 0x7fc868068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc886d9d640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7fc86806c6f0 0x7fc86806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc88659c640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc868066280 0x7fc868068730 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc8780045f0 tx=0x7fc878008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc886d9d640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7fc86806c6f0 0x7fc86806eb00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.135+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 <== osd.5 v2:172.21.15.155:6819/1199637530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fc86806f1b0 con 0x7fc86806c6f0 2023-07-09T02:23:35.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 --> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc8880cd400 con 0x7fc86806c6f0 2023-07-09T02:23:35.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc87effd640 1 -- 172.21.15.45:0/1680771432 <== osd.5 v2:172.21.15.155:6819/1199637530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fc880007570 con 0x7fc86806c6f0 2023-07-09T02:23:35.150 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:35.151 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-07-09T02:23:35.151 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7fc86806c6f0 msgr2=0x7fc86806eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6819/1199637530,v1:172.21.15.155:6822/1199637530] conn(0x7fc86806c6f0 0x7fc86806eb00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc868066280 msgr2=0x7fc868068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fc868066280 0x7fc868068730 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc8780045f0 tx=0x7fc878008040 comp rx=0 tx=0).stop 2023-07-09T02:23:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 msgr2=0x7fc8880b6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 --2- 172.21.15.45:0/1680771432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8880cead0 0x7fc8880b6c90 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fc8700ad040 tx=0x7fc87001acc0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc886d9d640 1 -- 172.21.15.45:0/1680771432 reap_dead start 2023-07-09T02:23:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 shutdown_connections 2023-07-09T02:23:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 >> 172.21.15.45:0/1680771432 conn(0x7fc8880cff90 msgr2=0x7fc88815b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 shutdown_connections 2023-07-09T02:23:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.147+0000 7fc88759e640 1 -- 172.21.15.45:0/1680771432 wait complete. 2023-07-09T02:23:35.171 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-09T02:23:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.311+0000 7f7183d8f640 1 Processor -- start 2023-07-09T02:23:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.311+0000 7f7183d8f640 1 -- start start 2023-07-09T02:23:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f7183d8f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f717c158e30 0x7f717c06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f7183d8f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f717c06fd10 0x7f717c06c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f7183d8f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0ccf80 con 0x7f717c06c650 2023-07-09T02:23:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f7183d8f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c0cd540 con 0x7f717c06fd10 2023-07-09T02:23:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f7183d8f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c06ca90 con 0x7f717c158e30 2023-07-09T02:23:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f718132a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f717c06fd10 0x7f717c06c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f718132a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f717c06fd10 0x7f717c06c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40358/0 (socket says 172.21.15.45:40358) 2023-07-09T02:23:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f718132a640 1 -- 172.21.15.45:0/2501903668 learned_addr learned my addr 172.21.15.45:0/2501903668 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f7181b2b640 1 --2- 172.21.15.45:0/2501903668 >> v2:172.21.15.155:3300/0 conn(0x7f717c158e30 0x7f717c06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f718132a640 1 -- 172.21.15.45:0/2501903668 >> v2:172.21.15.155:3300/0 conn(0x7f717c158e30 msgr2=0x7f717c06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f718132a640 1 --2- 172.21.15.45:0/2501903668 >> v2:172.21.15.155:3300/0 conn(0x7f717c158e30 0x7f717c06f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f718132a640 1 -- 172.21.15.45:0/2501903668 >> v1:172.21.15.155:6789/0 conn(0x7f717c06c650 legacy=0x7f717c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f718132a640 1 -- 172.21.15.45:0/2501903668 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0c8fb0 con 0x7f717c06fd10 2023-07-09T02:23:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.315+0000 7f718132a640 1 --2- 172.21.15.45:0/2501903668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c06fd10 0x7f717c06c110 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f717c0cc240 tx=0x7f716c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8711c419a27e11f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7180b29640 1 -- 172.21.15.45:0/2501903668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0ab600 con 0x7f717c06fd10 2023-07-09T02:23:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7180b29640 1 -- 172.21.15.45:0/2501903668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c0ab760 con 0x7f717c06fd10 2023-07-09T02:23:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7180b29640 1 -- 172.21.15.45:0/2501903668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0abaf0 con 0x7f717c06fd10 2023-07-09T02:23:35.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- 172.21.15.45:0/2501903668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c06fd10 msgr2=0x7f717c06c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 --2- 172.21.15.45:0/2501903668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c06fd10 0x7f717c06c110 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f717c0cc240 tx=0x7f716c01c400 comp rx=0 tx=0).stop 2023-07-09T02:23:35.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- 172.21.15.45:0/2501903668 shutdown_connections 2023-07-09T02:23:35.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 --2- 172.21.15.45:0/2501903668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c06fd10 0x7f717c06c110 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 --2- 172.21.15.45:0/2501903668 >> v2:172.21.15.155:3300/0 conn(0x7f717c158e30 0x7f717c06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- 172.21.15.45:0/2501903668 >> 172.21.15.45:0/2501903668 conn(0x7f717c0694b0 msgr2=0x7f717c0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:35.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- 172.21.15.45:0/2501903668 shutdown_connections 2023-07-09T02:23:35.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- 172.21.15.45:0/2501903668 wait complete. 2023-07-09T02:23:35.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 Processor -- start 2023-07-09T02:23:35.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- start start 2023-07-09T02:23:35.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c06c650 0x7f717c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c06fd10 0x7f717c0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c158e30 0x7f717c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c14d6d0 con 0x7f717c158e30 2023-07-09T02:23:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c14d920 con 0x7f717c06fd10 2023-07-09T02:23:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.319+0000 7f7183d8f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c14dc00 con 0x7f717c06c650 2023-07-09T02:23:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c158e30 0x7f717c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718132a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c06fd10 0x7f717c0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c158e30 0x7f717c14e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40362/0 (socket says 172.21.15.45:40362) 2023-07-09T02:23:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 -- 172.21.15.45:0/1773812074 learned_addr learned my addr 172.21.15.45:0/1773812074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:35.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f7181b2b640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c06c650 0x7f717c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 -- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c06c650 msgr2=0x7f717c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c06c650 0x7f717c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 -- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c06fd10 msgr2=0x7f717c0c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c06fd10 0x7f717c0c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 -- 172.21.15.45:0/1773812074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0094d0 con 0x7f717c158e30 2023-07-09T02:23:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f718232c640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c158e30 0x7f717c14e9c0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f717400c780 tx=0x7f717400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f71727fc640 1 -- 172.21.15.45:0/1773812074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174004b70 con 0x7f717c158e30 2023-07-09T02:23:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f71727fc640 1 -- 172.21.15.45:0/1773812074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717400ce90 con 0x7f717c158e30 2023-07-09T02:23:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c14dee0 con 0x7f717c158e30 2023-07-09T02:23:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f71727fc640 1 -- 172.21.15.45:0/1773812074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717400a850 con 0x7f717c158e30 2023-07-09T02:23:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c14e4a0 con 0x7f717c158e30 2023-07-09T02:23:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c14e690 con 0x7f717c158e30 2023-07-09T02:23:35.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.323+0000 7f71727fc640 1 -- 172.21.15.45:0/1773812074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f717400a9b0 con 0x7f717c158e30 2023-07-09T02:23:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.327+0000 7f71727fc640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7160066280 0x7f7160068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.327+0000 7f71727fc640 1 -- 172.21.15.45:0/1773812074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7174083a20 con 0x7f717c158e30 2023-07-09T02:23:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.327+0000 7f7181b2b640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7160066280 0x7f7160068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.327+0000 7f7181b2b640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7160066280 0x7f7160068730 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f71780079c0 tx=0x7f7178008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.331+0000 7f71727fc640 1 -- 172.21.15.45:0/1773812074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7174054d70 con 0x7f717c158e30 2023-07-09T02:23:35.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.483+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f717c14dd70 con 0x7f7160066280 2023-07-09T02:23:35.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.483+0000 7f71727fc640 1 -- 172.21.15.45:0/1773812074 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f717c14dd70 con 0x7f7160066280 2023-07-09T02:23:35.486 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2023-07-09T02:23:35.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7160066280 msgr2=0x7f7160068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7160066280 0x7f7160068730 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f71780079c0 tx=0x7f7178008040 comp rx=0 tx=0).stop 2023-07-09T02:23:35.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c158e30 msgr2=0x7f717c14e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c158e30 0x7f717c14e9c0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f717400c780 tx=0x7f717400cc40 comp rx=0 tx=0).stop 2023-07-09T02:23:35.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 shutdown_connections 2023-07-09T02:23:35.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717c158e30 0x7f717c14e9c0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f717c06fd10 0x7f717c0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f7160066280 0x7f7160068730 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 --2- 172.21.15.45:0/1773812074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f717c06c650 0x7f717c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 >> 172.21.15.45:0/1773812074 conn(0x7f717c0694b0 msgr2=0x7f717c0cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:35.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 shutdown_connections 2023-07-09T02:23:35.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.487+0000 7f7183d8f640 1 -- 172.21.15.45:0/1773812074 wait complete. 2023-07-09T02:23:35.508 INFO:tasks.ceph:Scrubbing osd.6 2023-07-09T02:23:35.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-09T02:23:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f1157f59640 1 Processor -- start 2023-07-09T02:23:35.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f1157f59640 1 -- start start 2023-07-09T02:23:35.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f1157f59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11500c52a0 0x7f11500694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f1157f59640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1150159320 con 0x7f11500adb80 2023-07-09T02:23:35.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f1157f59640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115015d860 con 0x7f1150158f50 2023-07-09T02:23:35.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f1157f59640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11500b16f0 con 0x7f11500c52a0 2023-07-09T02:23:35.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f11554f4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11500c52a0 0x7f11500694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f11554f4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11500c52a0 0x7f11500694b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40368/0 (socket says 172.21.15.45:40368) 2023-07-09T02:23:35.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f11554f4640 1 -- 172.21.15.45:0/879428143 learned_addr learned my addr 172.21.15.45:0/879428143 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:35.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f11564f6640 1 --1- 172.21.15.45:0/879428143 >> v1:172.21.15.45:6789/0 conn(0x7f11500adb80 0x7f11500ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51034/0 (socket says 172.21.15.45:51034) 2023-07-09T02:23:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f11554f4640 1 -- 172.21.15.45:0/879428143 >> v1:172.21.15.155:6789/0 conn(0x7f1150158f50 legacy=0x7f115015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f11554f4640 1 -- 172.21.15.45:0/879428143 >> v1:172.21.15.45:6789/0 conn(0x7f11500adb80 legacy=0x7f11500ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.655+0000 7f11554f4640 1 -- 172.21.15.45:0/879428143 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500c8fd0 con 0x7f11500c52a0 2023-07-09T02:23:35.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f11554f4640 1 --2- 172.21.15.45:0/879428143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11500c52a0 0x7f11500694b0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f1140009870 tx=0x7f114001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842e7be97edaa120 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1154cf3640 1 -- 172.21.15.45:0/879428143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11400ab5f0 con 0x7f11500c52a0 2023-07-09T02:23:35.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1154cf3640 1 -- 172.21.15.45:0/879428143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11400ab750 con 0x7f11500c52a0 2023-07-09T02:23:35.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1154cf3640 1 -- 172.21.15.45:0/879428143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11400abae0 con 0x7f11500c52a0 2023-07-09T02:23:35.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1157f59640 1 -- 172.21.15.45:0/879428143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11500c52a0 msgr2=0x7f11500694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1157f59640 1 --2- 172.21.15.45:0/879428143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11500c52a0 0x7f11500694b0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f1140009870 tx=0x7f114001c500 comp rx=0 tx=0).stop 2023-07-09T02:23:35.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1157f59640 1 -- 172.21.15.45:0/879428143 shutdown_connections 2023-07-09T02:23:35.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1157f59640 1 --2- 172.21.15.45:0/879428143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11500c52a0 0x7f11500694b0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1157f59640 1 -- 172.21.15.45:0/879428143 >> 172.21.15.45:0/879428143 conn(0x7f115006ae60 msgr2=0x7f115006b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1157f59640 1 -- 172.21.15.45:0/879428143 shutdown_connections 2023-07-09T02:23:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.659+0000 7f1157f59640 1 -- 172.21.15.45:0/879428143 wait complete. 2023-07-09T02:23:35.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 Processor -- start 2023-07-09T02:23:35.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 -- start start 2023-07-09T02:23:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11500adb80 0x7f115015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11500c52a0 0x7f115014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1150158f50 0x7f115015b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150159800 con 0x7f1150158f50 2023-07-09T02:23:35.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115015ab80 con 0x7f11500adb80 2023-07-09T02:23:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115015ae60 con 0x7f11500c52a0 2023-07-09T02:23:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1150158f50 0x7f115015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1150158f50 0x7f115015b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40372/0 (socket says 172.21.15.45:40372) 2023-07-09T02:23:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 -- 172.21.15.45:0/3400088172 learned_addr learned my addr 172.21.15.45:0/3400088172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11554f4640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11500c52a0 0x7f115014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1155cf5640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11500adb80 0x7f115015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 -- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11500c52a0 msgr2=0x7f115014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11500c52a0 0x7f115014fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 -- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11500adb80 msgr2=0x7f115015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11500adb80 0x7f115015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 -- 172.21.15.45:0/3400088172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400094d0 con 0x7f1150158f50 2023-07-09T02:23:35.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11554f4640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f11500c52a0 0x7f115014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1155cf5640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11500adb80 0x7f115015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11564f6640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1150158f50 0x7f115015b720 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f114800c700 tx=0x7f114800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800ce10 con 0x7f1150158f50 2023-07-09T02:23:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114800a640 con 0x7f1150158f50 2023-07-09T02:23:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11500c3a40 con 0x7f1150158f50 2023-07-09T02:23:35.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800a9b0 con 0x7f1150158f50 2023-07-09T02:23:35.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11501500e0 con 0x7f1150158f50 2023-07-09T02:23:35.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.663+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f115015cc30 con 0x7f1150158f50 2023-07-09T02:23:35.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f114800ab10 con 0x7f1150158f50 2023-07-09T02:23:35.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11467fc640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11340662b0 0x7f1134068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1148083110 con 0x7f1150158f50 2023-07-09T02:23:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11467fc640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f113406c720 0x7f113406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 --> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f113406f1e0 con 0x7f113406c720 2023-07-09T02:23:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=189) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11480857b0 con 0x7f1150158f50 2023-07-09T02:23:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f1155cf5640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11340662b0 0x7f1134068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11554f4640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f113406c720 0x7f113406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f1155cf5640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11340662b0 0x7f1134068760 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f114c003e40 tx=0x7f114c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11554f4640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f113406c720 0x7f113406eb30 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.667+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 <== osd.6 v2:172.21.15.155:6800/4095749246 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f113406f1e0 con 0x7f113406c720 2023-07-09T02:23:35.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 --> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1150069e00 con 0x7f113406c720 2023-07-09T02:23:35.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f11467fc640 1 -- 172.21.15.45:0/3400088172 <== osd.6 v2:172.21.15.155:6800/4095749246 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f1140004040 con 0x7f113406c720 2023-07-09T02:23:35.682 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:35.683 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-07-09T02:23:35.683 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f113406c720 msgr2=0x7f113406eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6800/4095749246,v1:172.21.15.155:6801/4095749246] conn(0x7f113406c720 0x7f113406eb30 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11340662b0 msgr2=0x7f1134068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f11340662b0 0x7f1134068760 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f114c003e40 tx=0x7f114c009040 comp rx=0 tx=0).stop 2023-07-09T02:23:35.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1150158f50 msgr2=0x7f115015b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 --2- 172.21.15.45:0/3400088172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1150158f50 0x7f115015b720 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f114800c700 tx=0x7f114800cbc0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f11564f6640 1 -- 172.21.15.45:0/3400088172 reap_dead start 2023-07-09T02:23:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 shutdown_connections 2023-07-09T02:23:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 >> 172.21.15.45:0/3400088172 conn(0x7f115006ae60 msgr2=0x7f1150154cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:35.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 shutdown_connections 2023-07-09T02:23:35.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.679+0000 7f1157f59640 1 -- 172.21.15.45:0/3400088172 wait complete. 2023-07-09T02:23:35.701 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-09T02:23:35.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.843+0000 7f2d89140640 1 Processor -- start 2023-07-09T02:23:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.843+0000 7f2d89140640 1 -- start start 2023-07-09T02:23:35.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.843+0000 7f2d89140640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c060 0x7f2d840b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.843+0000 7f2d89140640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d84160a50 con 0x7f2d840d2620 2023-07-09T02:23:35.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.843+0000 7f2d89140640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8415c430 con 0x7f2d840cd120 2023-07-09T02:23:35.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.843+0000 7f2d89140640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8415fb60 con 0x7f2d8415c060 2023-07-09T02:23:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.843+0000 7f2d8359e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2d840d2620 0x7f2d840cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51046/0 (socket says 172.21.15.45:51046) 2023-07-09T02:23:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.843+0000 7f2d8359e640 1 -- 172.21.15.45:0/4115086925 learned_addr learned my addr 172.21.15.45:0/4115086925 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d82d9d640 1 --2- 172.21.15.45:0/4115086925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c060 0x7f2d840b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d81d9b640 1 -- 172.21.15.45:0/4115086925 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710274706 0 0) 0x7f2d84160a50 con 0x7f2d840d2620 2023-07-09T02:23:35.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d81d9b640 1 -- 172.21.15.45:0/4115086925 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d6c003530 con 0x7f2d840d2620 2023-07-09T02:23:35.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d81d9b640 1 -- 172.21.15.45:0/4115086925 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396137734 0 0) 0x7f2d8415c430 con 0x7f2d840cd120 2023-07-09T02:23:35.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d82d9d640 1 -- 172.21.15.45:0/4115086925 >> v1:172.21.15.155:6789/0 conn(0x7f2d840cd120 legacy=0x7f2d840d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d82d9d640 1 -- 172.21.15.45:0/4115086925 >> v1:172.21.15.45:6789/0 conn(0x7f2d840d2620 legacy=0x7f2d840cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d82d9d640 1 -- 172.21.15.45:0/4115086925 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8415fe40 con 0x7f2d8415c060 2023-07-09T02:23:35.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d82d9d640 1 --2- 172.21.15.45:0/4115086925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c060 0x7f2d840b4ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009820 tx=0x7f2d7401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0d4f4c756eda21 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.847+0000 7f2d81d9b640 1 -- 172.21.15.45:0/4115086925 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740ab670 con 0x7f2d8415c060 2023-07-09T02:23:35.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d81d9b640 1 -- 172.21.15.45:0/4115086925 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d740ab7d0 con 0x7f2d8415c060 2023-07-09T02:23:35.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d81d9b640 1 -- 172.21.15.45:0/4115086925 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740abb60 con 0x7f2d8415c060 2023-07-09T02:23:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- 172.21.15.45:0/4115086925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c060 msgr2=0x7f2d840b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 --2- 172.21.15.45:0/4115086925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c060 0x7f2d840b4ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009820 tx=0x7f2d7401c470 comp rx=0 tx=0).stop 2023-07-09T02:23:35.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- 172.21.15.45:0/4115086925 shutdown_connections 2023-07-09T02:23:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 --2- 172.21.15.45:0/4115086925 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c060 0x7f2d840b4ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- 172.21.15.45:0/4115086925 >> 172.21.15.45:0/4115086925 conn(0x7f2d840698e0 msgr2=0x7f2d84069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- 172.21.15.45:0/4115086925 shutdown_connections 2023-07-09T02:23:35.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- 172.21.15.45:0/4115086925 wait complete. 2023-07-09T02:23:35.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 Processor -- start 2023-07-09T02:23:35.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- start start 2023-07-09T02:23:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d840cd120 0x7f2d8415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d840d2620 0x7f2d84151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8415c060 0x7f2d84154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841527e0 con 0x7f2d840cd120 2023-07-09T02:23:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84154580 con 0x7f2d8415c060 2023-07-09T02:23:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d89140640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8415b8b0 con 0x7f2d840d2620 2023-07-09T02:23:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.851+0000 7f2d82d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d840cd120 0x7f2d8415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d82d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d840cd120 0x7f2d8415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40380/0 (socket says 172.21.15.45:40380) 2023-07-09T02:23:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d82d9d640 1 -- 172.21.15.45:0/1723940282 learned_addr learned my addr 172.21.15.45:0/1723940282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d8259c640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d840d2620 0x7f2d84151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d8359e640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8415c060 0x7f2d84154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d82d9d640 1 -- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d840d2620 msgr2=0x7f2d84151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d82d9d640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d840d2620 0x7f2d84151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d82d9d640 1 -- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8415c060 msgr2=0x7f2d84154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d82d9d640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8415c060 0x7f2d84154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d82d9d640 1 -- 172.21.15.45:0/1723940282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74009420 con 0x7f2d840cd120 2023-07-09T02:23:35.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d8359e640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8415c060 0x7f2d84154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:35.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d82d9d640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d840cd120 0x7f2d8415b370 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f2d740ad040 tx=0x7f2d7401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d6b7fe640 1 -- 172.21.15.45:0/1723940282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740bf610 con 0x7f2d840cd120 2023-07-09T02:23:35.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d6b7fe640 1 -- 172.21.15.45:0/1723940282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d740bf770 con 0x7f2d840cd120 2023-07-09T02:23:35.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d6b7fe640 1 -- 172.21.15.45:0/1723940282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740bfb00 con 0x7f2d840cd120 2023-07-09T02:23:35.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d840b59f0 con 0x7f2d840cd120 2023-07-09T02:23:35.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84154820 con 0x7f2d840cd120 2023-07-09T02:23:35.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8404d7d0 con 0x7f2d840cd120 2023-07-09T02:23:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.855+0000 7f2d6b7fe640 1 -- 172.21.15.45:0/1723940282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d740b5400 con 0x7f2d840cd120 2023-07-09T02:23:35.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.859+0000 7f2d6b7fe640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2d70066280 0x7f2d70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:35.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.859+0000 7f2d6b7fe640 1 -- 172.21.15.45:0/1723940282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2d7411e430 con 0x7f2d840cd120 2023-07-09T02:23:35.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.859+0000 7f2d8259c640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2d70066280 0x7f2d70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:35.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.859+0000 7f2d8259c640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2d70066280 0x7f2d70068730 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2d840b4e90 tx=0x7f2d78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:35.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:35.859+0000 7f2d6b7fe640 1 -- 172.21.15.45:0/1723940282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d740ebc70 con 0x7f2d840cd120 2023-07-09T02:23:36.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.015+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d840b5870 con 0x7f2d70066280 2023-07-09T02:23:36.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d6b7fe640 1 -- 172.21.15.45:0/1723940282 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2d7800f820 con 0x7f2d70066280 2023-07-09T02:23:36.020 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2023-07-09T02:23:36.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2d70066280 msgr2=0x7f2d70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2d70066280 0x7f2d70068730 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2d840b4e90 tx=0x7f2d78009040 comp rx=0 tx=0).stop 2023-07-09T02:23:36.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d840cd120 msgr2=0x7f2d8415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d840cd120 0x7f2d8415b370 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f2d740ad040 tx=0x7f2d7401acb0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 shutdown_connections 2023-07-09T02:23:36.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8415c060 0x7f2d84154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f2d70066280 0x7f2d70068730 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d840d2620 0x7f2d84151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 --2- 172.21.15.45:0/1723940282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d840cd120 0x7f2d8415b370 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 >> 172.21.15.45:0/1723940282 conn(0x7f2d840698e0 msgr2=0x7f2d840cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:36.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 shutdown_connections 2023-07-09T02:23:36.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.019+0000 7f2d89140640 1 -- 172.21.15.45:0/1723940282 wait complete. 2023-07-09T02:23:36.041 INFO:tasks.ceph:Scrubbing osd.7 2023-07-09T02:23:36.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-09T02:23:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b693ac640 1 Processor -- start 2023-07-09T02:23:36.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b693ac640 1 -- start start 2023-07-09T02:23:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b693ac640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1b6415c400 0x7f1b640cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b693ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 0x7f1b640cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b693ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b64071ee0 0x7f1b640b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b693ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6415c7d0 con 0x7f1b64071ee0 2023-07-09T02:23:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b693ac640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6406a5c0 con 0x7f1b6415c400 2023-07-09T02:23:36.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b693ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64160340 con 0x7f1b6415feb0 2023-07-09T02:23:36.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b64071ee0 0x7f1b640b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b637fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b64071ee0 0x7f1b640b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40392/0 (socket says 172.21.15.45:40392) 2023-07-09T02:23:36.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b637fe640 1 -- 172.21.15.45:0/2498762834 learned_addr learned my addr 172.21.15.45:0/2498762834 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:36.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b5bfff640 1 --2- 172.21.15.45:0/2498762834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 0x7f1b640cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b62ffd640 1 --2- 172.21.15.45:0/2498762834 >> v2:172.21.15.155:3300/0 conn(0x7f1b6415c400 0x7f1b640cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b637fe640 1 -- 172.21.15.45:0/2498762834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 msgr2=0x7f1b640cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b637fe640 1 --2- 172.21.15.45:0/2498762834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 0x7f1b640cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b637fe640 1 -- 172.21.15.45:0/2498762834 >> v2:172.21.15.155:3300/0 conn(0x7f1b6415c400 msgr2=0x7f1b640cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b637fe640 1 --2- 172.21.15.45:0/2498762834 >> v2:172.21.15.155:3300/0 conn(0x7f1b6415c400 0x7f1b640cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.187+0000 7f1b637fe640 1 -- 172.21.15.45:0/2498762834 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64160620 con 0x7f1b64071ee0 2023-07-09T02:23:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b637fe640 1 --2- 172.21.15.45:0/2498762834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 0x7f1b640b22f0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f1b640d1970 tx=0x7f1b5c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64072acb14f9ee87 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b627fc640 1 -- 172.21.15.45:0/2498762834 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0a5820 con 0x7f1b64071ee0 2023-07-09T02:23:36.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b627fc640 1 -- 172.21.15.45:0/2498762834 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c0a5980 con 0x7f1b64071ee0 2023-07-09T02:23:36.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b627fc640 1 -- 172.21.15.45:0/2498762834 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0a5d10 con 0x7f1b64071ee0 2023-07-09T02:23:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 -- 172.21.15.45:0/2498762834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 msgr2=0x7f1b640b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 --2- 172.21.15.45:0/2498762834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 0x7f1b640b22f0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f1b640d1970 tx=0x7f1b5c01c9a0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 -- 172.21.15.45:0/2498762834 shutdown_connections 2023-07-09T02:23:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 --2- 172.21.15.45:0/2498762834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 0x7f1b640b22f0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 --2- 172.21.15.45:0/2498762834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 0x7f1b640cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 --2- 172.21.15.45:0/2498762834 >> v2:172.21.15.155:3300/0 conn(0x7f1b6415c400 0x7f1b640cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 -- 172.21.15.45:0/2498762834 >> 172.21.15.45:0/2498762834 conn(0x7f1b6406ec20 msgr2=0x7f1b6406f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 -- 172.21.15.45:0/2498762834 shutdown_connections 2023-07-09T02:23:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.191+0000 7f1b693ac640 1 -- 172.21.15.45:0/2498762834 wait complete. 2023-07-09T02:23:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 Processor -- start 2023-07-09T02:23:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 -- start start 2023-07-09T02:23:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 0x7f1b64150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b6415c400 0x7f1b640c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 0x7f1b640aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b641514d0 con 0x7f1b64071ee0 2023-07-09T02:23:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640ad9f0 con 0x7f1b6415c400 2023-07-09T02:23:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640acde0 con 0x7f1b6415feb0 2023-07-09T02:23:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 0x7f1b64150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 0x7f1b64150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40396/0 (socket says 172.21.15.45:40396) 2023-07-09T02:23:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 -- 172.21.15.45:0/1764757745 learned_addr learned my addr 172.21.15.45:0/1764757745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b637fe640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 0x7f1b640aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b5bfff640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b6415c400 0x7f1b640c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 -- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 msgr2=0x7f1b640aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b6415feb0 0x7f1b640aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 -- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b6415c400 msgr2=0x7f1b640c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b6415c400 0x7f1b640c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 -- 172.21.15.45:0/1764757745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009b30 con 0x7f1b64071ee0 2023-07-09T02:23:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b62ffd640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 0x7f1b64150f90 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e8b0 tx=0x7f1b5400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400c940 con 0x7f1b64071ee0 2023-07-09T02:23:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5400caa0 con 0x7f1b64071ee0 2023-07-09T02:23:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400ce30 con 0x7f1b64071ee0 2023-07-09T02:23:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640ad0c0 con 0x7f1b64071ee0 2023-07-09T02:23:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.195+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b640ad680 con 0x7f1b64071ee0 2023-07-09T02:23:36.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b640cef50 con 0x7f1b64071ee0 2023-07-09T02:23:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b54013470 con 0x7f1b64071ee0 2023-07-09T02:23:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b5b7fe640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b440662b0 0x7f1b44068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1b54083ae0 con 0x7f1b64071ee0 2023-07-09T02:23:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b5b7fe640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f1b4406c720 0x7f1b4406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 --> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b4406f1e0 con 0x7f1b4406c720 2023-07-09T02:23:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=189) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b540882a0 con 0x7f1b64071ee0 2023-07-09T02:23:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b5bfff640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b440662b0 0x7f1b44068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b637fe640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f1b4406c720 0x7f1b4406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b5bfff640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b440662b0 0x7f1b44068760 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1b6415b940 tx=0x7f1b4c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.199+0000 7f1b637fe640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f1b4406c720 0x7f1b4406eb30 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.203+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 <== osd.7 v2:172.21.15.155:6816/3747873244 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f1b4406f1e0 con 0x7f1b4406c720 2023-07-09T02:23:36.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 --> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1b640adb30 con 0x7f1b4406c720 2023-07-09T02:23:36.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b5b7fe640 1 -- 172.21.15.45:0/1764757745 <== osd.7 v2:172.21.15.155:6816/3747873244 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f1b5c009510 con 0x7f1b4406c720 2023-07-09T02:23:36.215 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-07-09T02:23:36.215 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-07-09T02:23:36.215 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-07-09T02:23:36.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f1b4406c720 msgr2=0x7f1b4406eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6816/3747873244,v1:172.21.15.155:6817/3747873244] conn(0x7f1b4406c720 0x7f1b4406eb30 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b440662b0 msgr2=0x7f1b44068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f1b440662b0 0x7f1b44068760 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1b6415b940 tx=0x7f1b4c009190 comp rx=0 tx=0).stop 2023-07-09T02:23:36.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 msgr2=0x7f1b64150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 --2- 172.21.15.45:0/1764757745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b64071ee0 0x7f1b64150f90 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e8b0 tx=0x7f1b5400ed70 comp rx=0 tx=0).stop 2023-07-09T02:23:36.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b637fe640 1 -- 172.21.15.45:0/1764757745 reap_dead start 2023-07-09T02:23:36.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 shutdown_connections 2023-07-09T02:23:36.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.211+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 >> 172.21.15.45:0/1764757745 conn(0x7f1b6406ec20 msgr2=0x7f1b640affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:36.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.215+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 shutdown_connections 2023-07-09T02:23:36.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.215+0000 7f1b693ac640 1 -- 172.21.15.45:0/1764757745 wait complete. 2023-07-09T02:23:36.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-09T02:23:36.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0448939640 1 Processor -- start 2023-07-09T02:23:36.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0448939640 1 -- start start 2023-07-09T02:23:36.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0448939640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440b4ae0 0x7f04440ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0448939640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440cd5d0 con 0x7f0444160670 2023-07-09T02:23:36.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0448939640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440d2050 con 0x7f04440c8d40 2023-07-09T02:23:36.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0448939640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440d27a0 con 0x7f04440b4ae0 2023-07-09T02:23:36.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f044359e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0444160670 0x7f04440d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51062/0 (socket says 172.21.15.45:51062) 2023-07-09T02:23:36.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f044359e640 1 -- 172.21.15.45:0/729472960 learned_addr learned my addr 172.21.15.45:0/729472960 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:36.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f044259c640 1 --2- 172.21.15.45:0/729472960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440b4ae0 0x7f04440ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0441d9b640 1 -- 172.21.15.45:0/729472960 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684730168 0 0) 0x7f04440cd5d0 con 0x7f0444160670 2023-07-09T02:23:36.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0441d9b640 1 -- 172.21.15.45:0/729472960 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f042c003530 con 0x7f0444160670 2023-07-09T02:23:36.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0441d9b640 1 -- 172.21.15.45:0/729472960 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981270235 0 0) 0x7f04440d2050 con 0x7f04440c8d40 2023-07-09T02:23:36.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f0441d9b640 1 -- 172.21.15.45:0/729472960 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04440cd5d0 con 0x7f04440c8d40 2023-07-09T02:23:36.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f044259c640 1 -- 172.21.15.45:0/729472960 >> v1:172.21.15.155:6789/0 conn(0x7f04440c8d40 legacy=0x7f04440b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f044259c640 1 -- 172.21.15.45:0/729472960 >> v1:172.21.15.45:6789/0 conn(0x7f0444160670 legacy=0x7f04440d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.375+0000 7f044259c640 1 -- 172.21.15.45:0/729472960 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04440ced30 con 0x7f04440b4ae0 2023-07-09T02:23:36.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f044259c640 1 --2- 172.21.15.45:0/729472960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440b4ae0 0x7f04440ccf10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04380097f0 tx=0x7f043801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c77b99d0697384e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0441d9b640 1 -- 172.21.15.45:0/729472960 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380a89b0 con 0x7f04440b4ae0 2023-07-09T02:23:36.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0441d9b640 1 -- 172.21.15.45:0/729472960 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380a8b10 con 0x7f04440b4ae0 2023-07-09T02:23:36.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0441d9b640 1 -- 172.21.15.45:0/729472960 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380a8ea0 con 0x7f04440b4ae0 2023-07-09T02:23:36.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0448939640 1 -- 172.21.15.45:0/729472960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440b4ae0 msgr2=0x7f04440ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0448939640 1 --2- 172.21.15.45:0/729472960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440b4ae0 0x7f04440ccf10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f04380097f0 tx=0x7f043801ecb0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0448939640 1 -- 172.21.15.45:0/729472960 shutdown_connections 2023-07-09T02:23:36.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0448939640 1 --2- 172.21.15.45:0/729472960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440b4ae0 0x7f04440ccf10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0448939640 1 -- 172.21.15.45:0/729472960 >> 172.21.15.45:0/729472960 conn(0x7f04440d2950 msgr2=0x7f04440d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:36.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0448939640 1 -- 172.21.15.45:0/729472960 shutdown_connections 2023-07-09T02:23:36.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.379+0000 7f0448939640 1 -- 172.21.15.45:0/729472960 wait complete. 2023-07-09T02:23:36.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 Processor -- start 2023-07-09T02:23:36.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 -- start start 2023-07-09T02:23:36.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04440b4ae0 0x7f044415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440c8d40 0x7f0444159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0444160670 0x7f0444159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04441f5140 con 0x7f04440b4ae0 2023-07-09T02:23:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04441f5420 con 0x7f0444160670 2023-07-09T02:23:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04441f5700 con 0x7f04440c8d40 2023-07-09T02:23:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04440b4ae0 0x7f044415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04440b4ae0 0x7f044415caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40398/0 (socket says 172.21.15.45:40398) 2023-07-09T02:23:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 -- 172.21.15.45:0/848019981 learned_addr learned my addr 172.21.15.45:0/848019981 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:36.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f044259c640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440c8d40 0x7f0444159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 -- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440c8d40 msgr2=0x7f0444159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f044359e640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0444160670 0x7f0444159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440c8d40 0x7f0444159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 -- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0444160670 msgr2=0x7f0444159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0444160670 0x7f0444159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 -- 172.21.15.45:0/848019981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0438009420 con 0x7f04440b4ae0 2023-07-09T02:23:36.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f044359e640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0444160670 0x7f0444159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:36.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0442d9d640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04440b4ae0 0x7f044415caf0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f043400c490 tx=0x7f043400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f042b7fe640 1 -- 172.21.15.45:0/848019981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340052d0 con 0x7f04440b4ae0 2023-07-09T02:23:36.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f042b7fe640 1 -- 172.21.15.45:0/848019981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434005430 con 0x7f04440b4ae0 2023-07-09T02:23:36.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f042b7fe640 1 -- 172.21.15.45:0/848019981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434012870 con 0x7f04440b4ae0 2023-07-09T02:23:36.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04441f59e0 con 0x7f04440b4ae0 2023-07-09T02:23:36.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.383+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044415d200 con 0x7f04440b4ae0 2023-07-09T02:23:36.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.387+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04441f5bd0 con 0x7f04440b4ae0 2023-07-09T02:23:36.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.387+0000 7f042b7fe640 1 -- 172.21.15.45:0/848019981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04340129d0 con 0x7f04440b4ae0 2023-07-09T02:23:36.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.387+0000 7f042b7fe640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0430066280 0x7f0430068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.387+0000 7f042b7fe640 1 -- 172.21.15.45:0/848019981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0434083680 con 0x7f04440b4ae0 2023-07-09T02:23:36.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.387+0000 7f044259c640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0430066280 0x7f0430068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.387+0000 7f044259c640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0430066280 0x7f0430068730 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f04380b2000 tx=0x7f0438008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.391+0000 7f042b7fe640 1 -- 172.21.15.45:0/848019981 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0434050d80 con 0x7f04440b4ae0 2023-07-09T02:23:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f04440d22a0 con 0x7f0430066280 2023-07-09T02:23:36.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f042b7fe640 1 -- 172.21.15.45:0/848019981 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f04380b0440 con 0x7f0430066280 2023-07-09T02:23:36.548 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2023-07-09T02:23:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0430066280 msgr2=0x7f0430068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0430066280 0x7f0430068730 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f04380b2000 tx=0x7f0438008040 comp rx=0 tx=0).stop 2023-07-09T02:23:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04440b4ae0 msgr2=0x7f044415caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04440b4ae0 0x7f044415caf0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f043400c490 tx=0x7f043400c950 comp rx=0 tx=0).stop 2023-07-09T02:23:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 shutdown_connections 2023-07-09T02:23:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0444160670 0x7f0444159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f0430066280 0x7f0430068730 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04440c8d40 0x7f0444159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 --2- 172.21.15.45:0/848019981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04440b4ae0 0x7f044415caf0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 >> 172.21.15.45:0/848019981 conn(0x7f04440d2950 msgr2=0x7f04440cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 shutdown_connections 2023-07-09T02:23:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.547+0000 7f0448939640 1 -- 172.21.15.45:0/848019981 wait complete. 2023-07-09T02:23:36.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:23:36.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d7b20b640 1 Processor -- start 2023-07-09T02:23:36.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d7b20b640 1 -- start start 2023-07-09T02:23:36.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d7b20b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d7415c060 0x7f9d740b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d7b20b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9d740cd120 0x7f9d740d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d7b20b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d74160a50 con 0x7f9d740d2450 2023-07-09T02:23:36.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d7b20b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d740d28f0 con 0x7f9d740cd120 2023-07-09T02:23:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d7b20b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740cfe40 con 0x7f9d7415c060 2023-07-09T02:23:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d73fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9d740cd120 0x7f9d740d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d797a8640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9d740d2450 0x7f9d740d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51076/0 (socket says 172.21.15.45:51076) 2023-07-09T02:23:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d797a8640 1 -- 172.21.15.45:0/211249568 learned_addr learned my addr 172.21.15.45:0/211249568 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d78fa7640 1 --2- 172.21.15.45:0/211249568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d7415c060 0x7f9d740b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d73fff640 1 -- 172.21.15.45:0/211249568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d7415c060 msgr2=0x7f9d740b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d73fff640 1 --2- 172.21.15.45:0/211249568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d7415c060 0x7f9d740b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d73fff640 1 -- 172.21.15.45:0/211249568 >> v1:172.21.15.45:6789/0 conn(0x7f9d740d2450 legacy=0x7f9d740d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d73fff640 1 -- 172.21.15.45:0/211249568 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7415c430 con 0x7f9d740cd120 2023-07-09T02:23:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.711+0000 7f9d737fe640 1 -- 172.21.15.45:0/211249568 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515218629 0 0) 0x7f9d74160a50 con 0x7f9d740d2450 2023-07-09T02:23:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d73fff640 1 --2- 172.21.15.45:0/211249568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740cd120 0x7f9d740d1f10 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097c0 tx=0x7f9d6001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4487e407d8f90d8f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d737fe640 1 -- 172.21.15.45:0/211249568 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600ab600 con 0x7f9d740cd120 2023-07-09T02:23:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d737fe640 1 -- 172.21.15.45:0/211249568 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d600a7050 con 0x7f9d740cd120 2023-07-09T02:23:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d737fe640 1 -- 172.21.15.45:0/211249568 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600ab980 con 0x7f9d740cd120 2023-07-09T02:23:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d7b20b640 1 -- 172.21.15.45:0/211249568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740cd120 msgr2=0x7f9d740d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/211249568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740cd120 0x7f9d740d1f10 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f9d600097c0 tx=0x7f9d6001c450 comp rx=0 tx=0).stop 2023-07-09T02:23:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d7b20b640 1 -- 172.21.15.45:0/211249568 shutdown_connections 2023-07-09T02:23:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/211249568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740cd120 0x7f9d740d1f10 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/211249568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d7415c060 0x7f9d740b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d7b20b640 1 -- 172.21.15.45:0/211249568 >> 172.21.15.45:0/211249568 conn(0x7f9d740698e0 msgr2=0x7f9d74069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d7b20b640 1 -- 172.21.15.45:0/211249568 shutdown_connections 2023-07-09T02:23:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.715+0000 7f9d7b20b640 1 -- 172.21.15.45:0/211249568 wait complete. 2023-07-09T02:23:36.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 Processor -- start 2023-07-09T02:23:36.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 -- start start 2023-07-09T02:23:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d740cd120 0x7f9d740b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740d2450 0x7f9d74153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d7415c060 0x7f9d74152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740cc990 con 0x7f9d740d2450 2023-07-09T02:23:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7415c9e0 con 0x7f9d7415c060 2023-07-09T02:23:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7415ccc0 con 0x7f9d740cd120 2023-07-09T02:23:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740d2450 0x7f9d74153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740d2450 0x7f9d74153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40422/0 (socket says 172.21.15.45:40422) 2023-07-09T02:23:36.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 -- 172.21.15.45:0/673723767 learned_addr learned my addr 172.21.15.45:0/673723767 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d78fa7640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d740cd120 0x7f9d740b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d797a8640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d7415c060 0x7f9d74152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 -- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d740cd120 msgr2=0x7f9d740b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d740cd120 0x7f9d740b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 -- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d7415c060 msgr2=0x7f9d74152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d7415c060 0x7f9d74152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 -- 172.21.15.45:0/673723767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60009420 con 0x7f9d740d2450 2023-07-09T02:23:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d73fff640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740d2450 0x7f9d74153e70 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ae040 tx=0x7f9d6001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d717fa640 1 -- 172.21.15.45:0/673723767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600b7450 con 0x7f9d740d2450 2023-07-09T02:23:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d717fa640 1 -- 172.21.15.45:0/673723767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d600b75b0 con 0x7f9d740d2450 2023-07-09T02:23:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7415cfa0 con 0x7f9d740d2450 2023-07-09T02:23:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.719+0000 7f9d717fa640 1 -- 172.21.15.45:0/673723767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600b7960 con 0x7f9d740d2450 2023-07-09T02:23:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.723+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7415d560 con 0x7f9d740d2450 2023-07-09T02:23:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.723+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7415d750 con 0x7f9d740d2450 2023-07-09T02:23:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.723+0000 7f9d717fa640 1 -- 172.21.15.45:0/673723767 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d600b7ac0 con 0x7f9d740d2450 2023-07-09T02:23:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.723+0000 7f9d717fa640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9d58066280 0x7f9d58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.723+0000 7f9d717fa640 1 -- 172.21.15.45:0/673723767 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9d6011e390 con 0x7f9d740d2450 2023-07-09T02:23:36.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.723+0000 7f9d78fa7640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9d58066280 0x7f9d58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:36.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.723+0000 7f9d78fa7640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9d58066280 0x7f9d58068730 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009a50 tx=0x7f9d68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.727+0000 7f9d717fa640 1 -- 172.21.15.45:0/673723767 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d600eba00 con 0x7f9d740d2450 2023-07-09T02:23:36.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.879+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d74160400 con 0x7f9d58066280 2023-07-09T02:23:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.883+0000 7f9d717fa640 1 -- 172.21.15.45:0/673723767 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69918 (secure 0 0 0) 0x7f9d680119a0 con 0x7f9d58066280 2023-07-09T02:23:36.886 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:36.887 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:23:36.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9d58066280 msgr2=0x7f9d58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9d58066280 0x7f9d58068730 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009a50 tx=0x7f9d68008040 comp rx=0 tx=0).stop 2023-07-09T02:23:36.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740d2450 msgr2=0x7f9d74153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740d2450 0x7f9d74153e70 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ae040 tx=0x7f9d6001ac90 comp rx=0 tx=0).stop 2023-07-09T02:23:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 shutdown_connections 2023-07-09T02:23:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d7415c060 0x7f9d74152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d740d2450 0x7f9d74153e70 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f9d58066280 0x7f9d58068730 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 --2- 172.21.15.45:0/673723767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d740cd120 0x7f9d740b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 >> 172.21.15.45:0/673723767 conn(0x7f9d740698e0 msgr2=0x7f9d741573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 shutdown_connections 2023-07-09T02:23:36.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:36.887+0000 7f9d7b20b640 1 -- 172.21.15.45:0/673723767 wait complete. 2023-07-09T02:23:36.907 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":556,"stamp":"2023-07-09T02:23:36.711342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10010,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552489,"statfs":{"total":1600000000,"available":1589749392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.833357"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":461,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.887489+0000","last_change":"2023-07-09T02:11:08.095021+0000","last_active":"2023-07-09T02:23:27.887489+0000","last_peered":"2023-07-09T02:23:27.887489+0000","last_clean":"2023-07-09T02:23:27.887489+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:23:27.887489+0000","last_undegraded":"2023-07-09T02:23:27.887489+0000","last_fullsized":"2023-07-09T02:23:27.887489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:07.076493+0000","last_clean_scrub_stamp":"2023-07-09T02:11:07.076493+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:30:03.628841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":349,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.885124+0000","last_change":"2023-07-09T02:11:12.121549+0000","last_active":"2023-07-09T02:23:27.885124+0000","last_peered":"2023-07-09T02:23:27.885124+0000","last_clean":"2023-07-09T02:23:27.885124+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:23:27.885124+0000","last_undegraded":"2023-07-09T02:23:27.885124+0000","last_fullsized":"2023-07-09T02:23:27.885124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.886836+0000","last_change":"2023-07-09T02:11:12.124376+0000","last_active":"2023-07-09T02:23:27.886836+0000","last_peered":"2023-07-09T02:23:27.886836+0000","last_clean":"2023-07-09T02:23:27.886836+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:23:27.886836+0000","last_undegraded":"2023-07-09T02:23:27.886836+0000","last_fullsized":"2023-07-09T02:23:27.886836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T03:36:06.541329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":309,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.881424+0000","last_change":"2023-07-09T02:11:12.283774+0000","last_active":"2023-07-09T02:23:27.881424+0000","last_peered":"2023-07-09T02:23:27.881424+0000","last_clean":"2023-07-09T02:23:27.881424+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:23:27.881424+0000","last_undegraded":"2023-07-09T02:23:27.881424+0000","last_fullsized":"2023-07-09T02:23:27.881424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":349,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.881566+0000","last_change":"2023-07-09T02:11:12.121896+0000","last_active":"2023-07-09T02:23:27.881566+0000","last_peered":"2023-07-09T02:23:27.881566+0000","last_clean":"2023-07-09T02:23:27.881566+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:23:27.881566+0000","last_undegraded":"2023-07-09T02:23:27.881566+0000","last_fullsized":"2023-07-09T02:23:27.881566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":327,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.880410+0000","last_change":"2023-07-09T02:11:12.120600+0000","last_active":"2023-07-09T02:23:27.880410+0000","last_peered":"2023-07-09T02:23:27.880410+0000","last_clean":"2023-07-09T02:23:27.880410+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:23:27.880410+0000","last_undegraded":"2023-07-09T02:23:27.880410+0000","last_fullsized":"2023-07-09T02:23:27.880410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":308,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.886706+0000","last_change":"2023-07-09T02:11:12.123858+0000","last_active":"2023-07-09T02:23:27.886706+0000","last_peered":"2023-07-09T02:23:27.886706+0000","last_clean":"2023-07-09T02:23:27.886706+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:23:27.886706+0000","last_undegraded":"2023-07-09T02:23:27.886706+0000","last_fullsized":"2023-07-09T02:23:27.886706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:02:48.880820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":327,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.880855+0000","last_change":"2023-07-09T02:11:12.122125+0000","last_active":"2023-07-09T02:23:27.880855+0000","last_peered":"2023-07-09T02:23:27.880855+0000","last_clean":"2023-07-09T02:23:27.880855+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:23:27.880855+0000","last_undegraded":"2023-07-09T02:23:27.880855+0000","last_fullsized":"2023-07-09T02:23:27.880855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":304,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:27.881167+0000","last_change":"2023-07-09T02:11:12.124197+0000","last_active":"2023-07-09T02:23:27.881167+0000","last_peered":"2023-07-09T02:23:27.881167+0000","last_clean":"2023-07-09T02:23:27.881167+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:23:27.881167+0000","last_undegraded":"2023-07-09T02:23:27.881167+0000","last_fullsized":"2023-07-09T02:23:27.881167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:11:11.103465+0000","last_clean_scrub_stamp":"2023-07-09T02:11:11.103465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T02:46:38.610655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1683,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193628,"statfs":{"total":200000000,"available":198275898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97199999999999998,"5min":0.97399999999999998,"15min":1.4950000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.63600000000000001,"5min":0.435,"15min":0.35599999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.2110000000000001},"last":0.60999999999999999}]},{"osd":1,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.91400000000000003,"15min":1.423},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.80700000000000005},"min":{"1min":0.502,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95099999999999996,"5min":0.997,"15min":29.498999999999999},"last":0.67800000000000005}]},{"osd":2,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.435},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":5.0460000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.81100000000000005},"min":{"1min":0.54700000000000004,"5min":0.45900000000000002,"15min":0.42799999999999999},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":26.524000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.746,"15min":0.71499999999999997},"min":{"1min":0.496,"5min":0.438,"15min":0.374},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":4.3789999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73699999999999999,"15min":0.77200000000000002},"min":{"1min":0.56799999999999995,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.93500000000000005,"5min":0.97699999999999998,"15min":10.609999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.87,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.38100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.65400000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63700000000000001,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.048},"last":0.629}]},{"osd":6,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.70699999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.91100000000000003,"5min":0.91800000000000004,"15min":1.1639999999999999},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.68700000000000006},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.36299999999999999},"max":{"1min":0.94099999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.70999999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.36199999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0269999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.55200000000000005,"5min":0.47099999999999997,"15min":0.42699999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.4379999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.73399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.036,"15min":1.165},"last":0.755}]},{"osd":2,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.752,"15min":0.71699999999999997},"min":{"1min":0.56499999999999995,"5min":0.51300000000000001,"15min":0.46600000000000003},"max":{"1min":0.91200000000000003,"5min":1.01,"15min":1.01},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.755,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70399999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.754,"15min":0.72799999999999998},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.48799999999999999},"max":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":1.45},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.71099999999999997},"min":{"1min":0.59799999999999998,"5min":0.501,"15min":0.45700000000000002},"max":{"1min":0.95799999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.51800000000000002,"5min":0.42399999999999999,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.92200000000000004,"15min":1.6499999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.54900000000000004,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.94499999999999995}]},{"osd":5,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59899999999999998,"15min":0.61799999999999999},"min":{"1min":0.47599999999999998,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.873,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.59799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93700000000000006,"5min":0.96399999999999997,"15min":1.6060000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.41599999999999998},"max":{"1min":0.88800000000000001,"5min":0.94199999999999995,"15min":1.4059999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.54000000000000004,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.93200000000000005,"15min":1.0289999999999999},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72399999999999998,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.49399999999999999,"15min":0.40699999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.248},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.32800000000000001},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.752}]},{"osd":1,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.39900000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.68700000000000006},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":0.97299999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.747,"15min":0.71599999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.432},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.56999999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.522,"5min":1.522,"15min":5.1989999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.47399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.008},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61099999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.374},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.38800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.66100000000000003},"min":{"1min":0.52400000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.497,"15min":0.437},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.77200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.86299999999999999},"min":{"1min":0.432,"5min":0.378,"15min":0.27300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":50.508000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69799999999999995,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.39800000000000002,"15min":0.376},"max":{"1min":0.88,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70199999999999996,"15min":0.68700000000000006},"min":{"1min":0.435,"5min":0.41299999999999998,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":1.024,"15min":8.6039999999999992},"last":0.625},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89200000000000002,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.46600000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93500000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.997,"15min":1.323},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.71299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":0.97299999999999998,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.97699999999999998},"min":{"1min":0.55600000000000005,"5min":0.46400000000000002,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.073,"15min":71.909000000000006},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.317},"max":{"1min":0.81799999999999995,"5min":0.88,"15min":1.0169999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.89100000000000001,"15min":0.95399999999999996},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.629},"min":{"1min":0.49199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84199999999999997,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.0529999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.70399999999999996},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.0329999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.54000000000000004,"5min":0.434,"15min":0.33200000000000002},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":8.0359999999999996},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.216},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.96499999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.50900000000000001,"15min":0.48899999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.77700000000000002,"5min":0.86299999999999999,"15min":1.198},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45100000000000001,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.27100000000000002},"max":{"1min":0.56000000000000005,"5min":0.68700000000000006,"15min":1.048},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.26000000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.85299999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41499999999999998,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.64800000000000002,"5min":0.77800000000000002,"15min":1.155},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.39500000000000002,"15min":0.35599999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":1.1040000000000001},"last":0.67900000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45300000000000001},"max":{"1min":1.0720000000000001,"5min":1.117,"15min":1.466},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77900000000000003,"15min":0.745},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.34000000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.3560000000000001},"last":0.92800000000000005}]},{"osd":5,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.40899999999999997},"max":{"1min":1.002,"5min":1.155,"15min":1.3420000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.435},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.2909999999999999},"last":0.99399999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":1.0529999999999999,"5min":1.177,"15min":1.4350000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":1.1459999999999999,"15min":1.5569999999999999},"last":0.86199999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.367},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.77500000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.47499999999999998},"max":{"1min":1.0609999999999999,"5min":1.0760000000000001,"15min":1.2569999999999999},"last":0.88}]}]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.624,"5min":0.84299999999999997,"15min":7.7450000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.49099999999999999,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.72599999999999998,"5min":0.78700000000000003,"15min":1.127},"last":0.44500000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":2.8879999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58399999999999996,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72299999999999998,"5min":0.90500000000000003,"15min":2.0600000000000001},"last":0.503}]},{"osd":3,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.755,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.58199999999999996,"5min":0.875,"15min":7.8710000000000004},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1140000000000001,"5min":1.218,"15min":7.7990000000000004},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.75800000000000001},"min":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.47899999999999998},"max":{"1min":0.99199999999999999,"5min":1.046,"15min":1.821},"last":0.76500000000000001}]},{"osd":5,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.496},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.046,"5min":1.093,"15min":7.8369999999999997},"last":0.89200000000000002}]},{"osd":6,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.48299999999999998},"max":{"1min":1.0680000000000001,"5min":1.3029999999999999,"15min":1.9790000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.82199999999999995},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.51500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.452},"last":0.99099999999999999}]},{"osd":7,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.165,"15min":1.9379999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81599999999999995,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.48699999999999999},"max":{"1min":1.1479999999999999,"5min":1.173,"15min":1.351},"last":0.94799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.439,"15min":0.44500000000000001},"min":{"1min":0.34000000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59399999999999997,"5min":0.64000000000000001,"15min":0.80300000000000005},"last":0.496},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.48699999999999999},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72399999999999998,"5min":0.79100000000000004,"15min":0.81599999999999995},"last":0.33900000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.86899999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.374,"15min":0.29399999999999998},"max":{"1min":0.71299999999999997,"5min":0.77300000000000002,"15min":1.1080000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.36699999999999999},"max":{"1min":0.79500000000000004,"5min":0.80800000000000005,"15min":0.85099999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51000000000000001,"15min":0.49299999999999999},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.77700000000000002,"15min":1.163},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76000000000000001,"15min":0.73999999999999999},"min":{"1min":0.55300000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.0680000000000001,"5min":1.069,"15min":1.0920000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.57399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0609999999999999,"5min":1.095,"15min":1.1779999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.61899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.1599999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.60399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.044,"5min":1.131,"15min":1.131},"last":0.71699999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79600000000000004,"15min":0.78500000000000003},"min":{"1min":0.59299999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.073,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82399999999999995,"15min":0.80700000000000005},"min":{"1min":0.66200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0920000000000001,"5min":1.171,"15min":1.2929999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80500000000000005,"15min":0.78300000000000003},"min":{"1min":0.67300000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"max":{"1min":1.016,"5min":1.105,"15min":1.105},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78400000000000003,"15min":0.77900000000000003},"min":{"1min":0.621,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1080000000000001,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.84999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1683,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193628,"statfs":{"total":200000000,"available":198275898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47699999999999998,"15min":0.44600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28000000000000003,"15min":0.22700000000000001},"max":{"1min":0.61499999999999999,"5min":0.72599999999999998,"15min":0.94999999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53500000000000003,"15min":0.503},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.3240000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.29899999999999999},"max":{"1min":0.67200000000000004,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.78300000000000003,"15min":1.4139999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.45500000000000002},"min":{"1min":0.33000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.74099999999999999,"5min":0.754,"15min":1.0189999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.53600000000000003},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80200000000000005,"5min":0.879,"15min":3.8929999999999998},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.80800000000000005,"15min":0.77600000000000002},"min":{"1min":0.65700000000000003,"5min":0.47299999999999998,"15min":0.46600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81200000000000006,"15min":0.78800000000000003},"min":{"1min":0.63300000000000001,"5min":0.54400000000000004,"15min":0.41499999999999998},"max":{"1min":1.004,"5min":1.1240000000000001,"15min":1.153},"last":0.78900000000000003}]},{"osd":5,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.79800000000000004},"min":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.1040000000000001,"15min":1.4350000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82799999999999996,"15min":0.79600000000000004},"min":{"1min":0.63800000000000001,"5min":0.51000000000000001,"15min":0.46100000000000002},"max":{"1min":1.0580000000000001,"5min":1.2050000000000001,"15min":1.238},"last":0.72699999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77800000000000002,"15min":0.752},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.47799999999999998},"max":{"1min":1.0529999999999999,"5min":1.117,"15min":1.117},"last":0.747},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.73699999999999999},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.46899999999999997},"max":{"1min":1.034,"5min":1.1200000000000001,"15min":1.7789999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:22:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.49099999999999999},"max":{"1min":1.034,"5min":1.079,"15min":1.8149999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78000000000000003,"15min":0.749},"min":{"1min":0.60199999999999998,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.1060000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.628}]}]}],"pool_statfs":[]}} 2023-07-09T02:23:36.912 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-09T02:11:07.076493+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=7, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.913 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-09T02:11:11.103465+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=11, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.913 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-09T02:11:11.103465+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=11, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.913 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-09T02:11:11.103465+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=11, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.913 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-09T02:11:11.103465+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=11, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.914 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-09T02:11:11.103465+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=11, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.914 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-09T02:11:11.103465+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=11, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.914 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-09T02:11:11.103465+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=11, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.914 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-09T02:11:11.103465+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=11, tm_sec=11, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=2, tm_min=23, tm_sec=31, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T02:23:36.915 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-09T02:23:50.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:23:50.330 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:23:56.916 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T02:23:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd26818640 1 Processor -- start 2023-07-09T02:23:57.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd26818640 1 -- start start 2023-07-09T02:23:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd26818640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 0x7fbd200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd26818640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd200d2620 0x7fbd200cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd26818640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd20160a50 con 0x7fbd200cd120 2023-07-09T02:23:57.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd26818640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2015c430 con 0x7fbd200d2620 2023-07-09T02:23:57.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd26818640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015fb60 con 0x7fbd2015c060 2023-07-09T02:23:57.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd24db5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd200d2620 0x7fbd200cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd24db5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd200d2620 0x7fbd200cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48458/0 (socket says 172.21.15.45:48458) 2023-07-09T02:23:57.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd24db5640 1 -- 172.21.15.45:0/1462808490 learned_addr learned my addr 172.21.15.45:0/1462808490 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd1ffff640 1 --2- 172.21.15.45:0/1462808490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 0x7fbd200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd24db5640 1 -- 172.21.15.45:0/1462808490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 msgr2=0x7fbd200b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T02:23:57.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd24db5640 1 --2- 172.21.15.45:0/1462808490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 0x7fbd200b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd24db5640 1 -- 172.21.15.45:0/1462808490 >> v1:172.21.15.155:6789/0 conn(0x7fbd200cd120 legacy=0x7fbd200d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.071+0000 7fbd24db5640 1 -- 172.21.15.45:0/1462808490 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2015fe40 con 0x7fbd200d2620 2023-07-09T02:23:57.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd24db5640 1 --2- 172.21.15.45:0/1462808490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200d2620 0x7fbd200cee30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009e80 tx=0x7fbd1801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311c5453b157d04f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd1effd640 1 -- 172.21.15.45:0/1462808490 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a5880 con 0x7fbd200d2620 2023-07-09T02:23:57.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd1effd640 1 -- 172.21.15.45:0/1462808490 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180a59e0 con 0x7fbd200d2620 2023-07-09T02:23:57.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd1effd640 1 -- 172.21.15.45:0/1462808490 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a5d70 con 0x7fbd200d2620 2023-07-09T02:23:57.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd26818640 1 -- 172.21.15.45:0/1462808490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200d2620 msgr2=0x7fbd200cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd26818640 1 --2- 172.21.15.45:0/1462808490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200d2620 0x7fbd200cee30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009e80 tx=0x7fbd1801c9c0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd26818640 1 -- 172.21.15.45:0/1462808490 shutdown_connections 2023-07-09T02:23:57.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd26818640 1 --2- 172.21.15.45:0/1462808490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200d2620 0x7fbd200cee30 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd26818640 1 --2- 172.21.15.45:0/1462808490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 0x7fbd200b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd26818640 1 -- 172.21.15.45:0/1462808490 >> 172.21.15.45:0/1462808490 conn(0x7fbd200698e0 msgr2=0x7fbd20069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:57.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd26818640 1 -- 172.21.15.45:0/1462808490 shutdown_connections 2023-07-09T02:23:57.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.075+0000 7fbd26818640 1 -- 172.21.15.45:0/1462808490 wait complete. 2023-07-09T02:23:57.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 Processor -- start 2023-07-09T02:23:57.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 -- start start 2023-07-09T02:23:57.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cd120 0x7fbd201532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd200d2620 0x7fbd200cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 0x7fbd200b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015c7a0 con 0x7fbd200cd120 2023-07-09T02:23:57.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20153830 con 0x7fbd200d2620 2023-07-09T02:23:57.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015dca0 con 0x7fbd2015c060 2023-07-09T02:23:57.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cd120 0x7fbd201532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cd120 0x7fbd201532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48460/0 (socket says 172.21.15.45:48460) 2023-07-09T02:23:57.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 -- 172.21.15.45:0/3951427514 learned_addr learned my addr 172.21.15.45:0/3951427514 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:57.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1f7fe640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd200d2620 0x7fbd200cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd24db5640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 0x7fbd200b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 -- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 msgr2=0x7fbd200b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 0x7fbd200b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 -- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd200d2620 msgr2=0x7fbd200cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd200d2620 0x7fbd200cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 -- 172.21.15.45:0/3951427514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009b30 con 0x7fbd200cd120 2023-07-09T02:23:57.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1f7fe640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd200d2620 0x7fbd200cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T02:23:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1ffff640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cd120 0x7fbd201532f0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000e870 tx=0x7fbd1000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1cff9640 1 -- 172.21.15.45:0/3951427514 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10009510 con 0x7fbd200cd120 2023-07-09T02:23:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1cff9640 1 -- 172.21.15.45:0/3951427514 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1000eec0 con 0x7fbd200cd120 2023-07-09T02:23:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd1cff9640 1 -- 172.21.15.45:0/3951427514 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000cb40 con 0x7fbd200cd120 2023-07-09T02:23:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd200b59f0 con 0x7fbd200cd120 2023-07-09T02:23:57.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2015e790 con 0x7fbd200cd120 2023-07-09T02:23:57.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.079+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd200cf170 con 0x7fbd200cd120 2023-07-09T02:23:57.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.083+0000 7fbd1cff9640 1 -- 172.21.15.45:0/3951427514 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd1000ccc0 con 0x7fbd200cd120 2023-07-09T02:23:57.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.083+0000 7fbd1cff9640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd0c066280 0x7fbd0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.083+0000 7fbd1cff9640 1 -- 172.21.15.45:0/3951427514 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbd10083a40 con 0x7fbd200cd120 2023-07-09T02:23:57.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.083+0000 7fbd1f7fe640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd0c066280 0x7fbd0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.083+0000 7fbd1f7fe640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd0c066280 0x7fbd0c068730 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b8860 tx=0x7fbd14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.087+0000 7fbd1cff9640 1 -- 172.21.15.45:0/3951427514 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd10054d10 con 0x7fbd200cd120 2023-07-09T02:23:57.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.243+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 --> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd200b5870 con 0x7fbd0c066280 2023-07-09T02:23:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd1cff9640 1 -- 172.21.15.45:0/3951427514 <== mgr.4100 v2:172.21.15.155:6832/3807220831 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70157 (secure 0 0 0) 0x7fbd140013f0 con 0x7fbd0c066280 2023-07-09T02:23:57.248 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:57.248 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-07-09T02:23:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd0c066280 msgr2=0x7fbd0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd0c066280 0x7fbd0c068730 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b8860 tx=0x7fbd14009040 comp rx=0 tx=0).stop 2023-07-09T02:23:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cd120 msgr2=0x7fbd201532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cd120 0x7fbd201532f0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000e870 tx=0x7fbd1000ec70 comp rx=0 tx=0).stop 2023-07-09T02:23:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 shutdown_connections 2023-07-09T02:23:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fbd0c066280 0x7fbd0c068730 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd2015c060 0x7fbd200b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd200d2620 0x7fbd200cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 --2- 172.21.15.45:0/3951427514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd200cd120 0x7fbd201532f0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 >> 172.21.15.45:0/3951427514 conn(0x7fbd200698e0 msgr2=0x7fbd200b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:57.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 shutdown_connections 2023-07-09T02:23:57.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.247+0000 7fbd26818640 1 -- 172.21.15.45:0/3951427514 wait complete. 2023-07-09T02:23:57.268 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":566,"stamp":"2023-07-09T02:23:56.715200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10010,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552489,"statfs":{"total":1600000000,"available":1589749392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002394"},"pg_stats":[{"pgid":"1.0","version":"189'119","reported_seq":472,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:38.815746+0000","last_change":"2023-07-09T02:23:38.815801+0000","last_active":"2023-07-09T02:23:38.815746+0000","last_peered":"2023-07-09T02:23:38.815746+0000","last_clean":"2023-07-09T02:23:38.815746+0000","last_became_active":"2023-07-09T02:11:08.094786+0000","last_became_peered":"2023-07-09T02:11:08.094786+0000","last_unstale":"2023-07-09T02:23:38.815746+0000","last_undegraded":"2023-07-09T02:23:38.815746+0000","last_fullsized":"2023-07-09T02:23:38.815746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'119","last_scrub_stamp":"2023-07-09T02:23:38.815702+0000","last_deep_scrub":"189'119","last_deep_scrub_stamp":"2023-07-09T02:23:38.815702+0000","last_clean_scrub_stamp":"2023-07-09T02:23:38.815702+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:59:30.673968+0000","scrub_duration":0.0034665339999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":358,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:38.107856+0000","last_change":"2023-07-09T02:23:38.107856+0000","last_active":"2023-07-09T02:23:38.107856+0000","last_peered":"2023-07-09T02:23:38.107856+0000","last_clean":"2023-07-09T02:23:38.107856+0000","last_became_active":"2023-07-09T02:11:12.121222+0000","last_became_peered":"2023-07-09T02:11:12.121222+0000","last_unstale":"2023-07-09T02:23:38.107856+0000","last_undegraded":"2023-07-09T02:23:38.107856+0000","last_fullsized":"2023-07-09T02:23:38.107856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:23:38.107760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:23:38.107760+0000","last_clean_scrub_stamp":"2023-07-09T02:23:38.107760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T09:49:59.379649+0000","scrub_duration":0.0018498150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":316,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:46.889192+0000","last_change":"2023-07-09T02:23:46.889239+0000","last_active":"2023-07-09T02:23:46.889192+0000","last_peered":"2023-07-09T02:23:46.889192+0000","last_clean":"2023-07-09T02:23:46.889192+0000","last_became_active":"2023-07-09T02:11:12.124122+0000","last_became_peered":"2023-07-09T02:11:12.124122+0000","last_unstale":"2023-07-09T02:23:46.889192+0000","last_undegraded":"2023-07-09T02:23:46.889192+0000","last_fullsized":"2023-07-09T02:23:46.889192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:23:46.889123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:23:46.889123+0000","last_clean_scrub_stamp":"2023-07-09T02:23:46.889123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T10:35:28.592425+0000","scrub_duration":0.001614751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":318,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:35.901237+0000","last_change":"2023-07-09T02:23:35.901237+0000","last_active":"2023-07-09T02:23:35.901237+0000","last_peered":"2023-07-09T02:23:35.901237+0000","last_clean":"2023-07-09T02:23:35.901237+0000","last_became_active":"2023-07-09T02:11:12.283598+0000","last_became_peered":"2023-07-09T02:11:12.283598+0000","last_unstale":"2023-07-09T02:23:35.901237+0000","last_undegraded":"2023-07-09T02:23:35.901237+0000","last_fullsized":"2023-07-09T02:23:35.901237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:23:35.901167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:23:35.901167+0000","last_clean_scrub_stamp":"2023-07-09T02:23:35.901167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T04:22:08.790431+0000","scrub_duration":0.00096063599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":358,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:36.107303+0000","last_change":"2023-07-09T02:23:36.107303+0000","last_active":"2023-07-09T02:23:36.107303+0000","last_peered":"2023-07-09T02:23:36.107303+0000","last_clean":"2023-07-09T02:23:36.107303+0000","last_became_active":"2023-07-09T02:11:12.121673+0000","last_became_peered":"2023-07-09T02:11:12.121673+0000","last_unstale":"2023-07-09T02:23:36.107303+0000","last_undegraded":"2023-07-09T02:23:36.107303+0000","last_fullsized":"2023-07-09T02:23:36.107303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:23:36.107212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:23:36.107212+0000","last_clean_scrub_stamp":"2023-07-09T02:23:36.107212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:46:54.814926+0000","scrub_duration":0.001317686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":336,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:35.799967+0000","last_change":"2023-07-09T02:23:35.799967+0000","last_active":"2023-07-09T02:23:35.799967+0000","last_peered":"2023-07-09T02:23:35.799967+0000","last_clean":"2023-07-09T02:23:35.799967+0000","last_became_active":"2023-07-09T02:11:12.120386+0000","last_became_peered":"2023-07-09T02:11:12.120386+0000","last_unstale":"2023-07-09T02:23:35.799967+0000","last_undegraded":"2023-07-09T02:23:35.799967+0000","last_fullsized":"2023-07-09T02:23:35.799967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:23:35.799894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:23:35.799894+0000","last_clean_scrub_stamp":"2023-07-09T02:23:35.799894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T06:23:53.247047+0000","scrub_duration":0.0010199269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":318,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:44.877769+0000","last_change":"2023-07-09T02:23:44.877769+0000","last_active":"2023-07-09T02:23:44.877769+0000","last_peered":"2023-07-09T02:23:44.877769+0000","last_clean":"2023-07-09T02:23:44.877769+0000","last_became_active":"2023-07-09T02:11:12.123649+0000","last_became_peered":"2023-07-09T02:11:12.123649+0000","last_unstale":"2023-07-09T02:23:44.877769+0000","last_undegraded":"2023-07-09T02:23:44.877769+0000","last_fullsized":"2023-07-09T02:23:44.877769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:23:44.877673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:23:44.877673+0000","last_clean_scrub_stamp":"2023-07-09T02:23:44.877673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T13:39:27.607716+0000","scrub_duration":0.001817139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":335,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:40.831436+0000","last_change":"2023-07-09T02:23:40.831505+0000","last_active":"2023-07-09T02:23:40.831436+0000","last_peered":"2023-07-09T02:23:40.831436+0000","last_clean":"2023-07-09T02:23:40.831436+0000","last_became_active":"2023-07-09T02:11:12.121898+0000","last_became_peered":"2023-07-09T02:11:12.121898+0000","last_unstale":"2023-07-09T02:23:40.831436+0000","last_undegraded":"2023-07-09T02:23:40.831436+0000","last_fullsized":"2023-07-09T02:23:40.831436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:23:40.831373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:23:40.831373+0000","last_clean_scrub_stamp":"2023-07-09T02:23:40.831373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T11:51:30.365483+0000","scrub_duration":0.0021049789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":313,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-07-09T02:23:38.267823+0000","last_change":"2023-07-09T02:23:38.267871+0000","last_active":"2023-07-09T02:23:38.267823+0000","last_peered":"2023-07-09T02:23:38.267823+0000","last_clean":"2023-07-09T02:23:38.267823+0000","last_became_active":"2023-07-09T02:11:12.123948+0000","last_became_peered":"2023-07-09T02:11:12.123948+0000","last_unstale":"2023-07-09T02:23:38.267823+0000","last_undegraded":"2023-07-09T02:23:38.267823+0000","last_fullsized":"2023-07-09T02:23:38.267823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T02:23:38.267784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T02:23:38.267784+0000","last_clean_scrub_stamp":"2023-07-09T02:23:38.267784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T08:03:33.386379+0000","scrub_duration":0.0011970450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1683,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193628,"statfs":{"total":200000000,"available":198275898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97199999999999998,"5min":0.97399999999999998,"15min":1.4950000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74299999999999999,"15min":0.72899999999999998},"min":{"1min":0.63600000000000001,"5min":0.435,"15min":0.35599999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.2110000000000001},"last":0.93600000000000005}]},{"osd":1,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89100000000000001,"5min":0.91400000000000003,"15min":1.423},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.80700000000000005},"min":{"1min":0.502,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95099999999999996,"5min":0.997,"15min":29.498999999999999},"last":0.76000000000000001}]},{"osd":2,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.435},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":5.0460000000000003},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.81100000000000005},"min":{"1min":0.54700000000000004,"5min":0.45900000000000002,"15min":0.42799999999999999},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":26.524000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.746,"15min":0.71499999999999997},"min":{"1min":0.496,"5min":0.438,"15min":0.374},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":4.3789999999999996},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73699999999999999,"15min":0.77200000000000002},"min":{"1min":0.56799999999999995,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":0.93500000000000005,"5min":0.97699999999999998,"15min":10.609999999999999},"last":0.95099999999999996}]},{"osd":4,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.376,"5min":0.31,"15min":0.31},"max":{"1min":0.87,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.38100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.95899999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.63700000000000001,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.048},"last":0.873}]},{"osd":6,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.70699999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.41199999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.37},"max":{"1min":0.91100000000000003,"5min":0.91800000000000004,"15min":1.1639999999999999},"last":0.73899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.68700000000000006},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.36299999999999999},"max":{"1min":0.94099999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72899999999999998,"15min":0.70999999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.36199999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0269999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.55200000000000005,"5min":0.47099999999999997,"15min":0.42699999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.4379999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75900000000000001,"15min":0.73399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":1.036,"15min":1.165},"last":0.98199999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.752,"15min":0.71699999999999997},"min":{"1min":0.56499999999999995,"5min":0.51300000000000001,"15min":0.46600000000000003},"max":{"1min":0.91200000000000003,"5min":1.01,"15min":1.01},"last":0.871},{"interface":"front","average":{"1min":0.747,"5min":0.755,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":1.0009999999999999}]},{"osd":3,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.754,"15min":0.72799999999999998},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.48799999999999999},"max":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":1.45},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.71099999999999997},"min":{"1min":0.59799999999999998,"5min":0.501,"15min":0.45700000000000002},"max":{"1min":0.95799999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.82099999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.51800000000000002,"5min":0.42399999999999999,"15min":0.35099999999999998},"max":{"1min":0.90400000000000003,"5min":0.92200000000000004,"15min":1.6499999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.54900000000000004,"5min":0.40999999999999998,"15min":0.38800000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59899999999999998,"15min":0.61799999999999999},"min":{"1min":0.47599999999999998,"5min":0.40999999999999998,"15min":0.35699999999999998},"max":{"1min":0.873,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.59799999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93700000000000006,"5min":0.96399999999999997,"15min":1.6060000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.41599999999999998},"max":{"1min":0.88800000000000001,"5min":0.94199999999999995,"15min":1.4059999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.67900000000000005},"min":{"1min":0.54000000000000004,"5min":0.45800000000000002,"15min":0.41199999999999998},"max":{"1min":0.91800000000000004,"5min":0.93200000000000005,"15min":1.0289999999999999},"last":0.629}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72399999999999998,"15min":0.67300000000000004},"min":{"1min":0.52600000000000002,"5min":0.49399999999999999,"15min":0.40699999999999997},"max":{"1min":1.04,"5min":1.04,"15min":1.248},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.32800000000000001},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.44700000000000001}]},{"osd":1,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.39900000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72299999999999998,"15min":0.68700000000000006},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":0.97299999999999998},"last":0.64900000000000002}]},{"osd":2,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.747,"15min":0.71599999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.432},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.498},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.56999999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.47399999999999998},"max":{"1min":1.522,"5min":1.522,"15min":5.1989999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76100000000000001,"15min":0.73799999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.47399999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.67100000000000004}]},{"osd":4,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.33700000000000002,"15min":0.314},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.008},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61099999999999999,"15min":0.61699999999999999},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.374},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.38800000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.63},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63800000000000001,"15min":0.66100000000000003},"min":{"1min":0.52400000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.46800000000000003}]},{"osd":7,"last update":"Sun Jul 9 02:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.73899999999999999,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.497,"15min":0.437},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.86299999999999999},"min":{"1min":0.432,"5min":0.378,"15min":0.27300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":50.508000000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69799999999999995,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.39800000000000002,"15min":0.376},"max":{"1min":0.88,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.499}]},{"osd":1,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70199999999999996,"15min":0.68700000000000006},"min":{"1min":0.435,"5min":0.41299999999999998,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":1.024,"15min":8.6039999999999992},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.49099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89200000000000002,"5min":0.95799999999999996,"15min":1.4550000000000001},"last":0.753}]},{"osd":2,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.46600000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93500000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.997,"15min":1.323},"last":0.70499999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.71299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":0.97299999999999998,"5min":0.98399999999999999,"15min":1.0369999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.97699999999999998},"min":{"1min":0.55600000000000005,"5min":0.46400000000000002,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":1.073,"15min":71.909000000000006},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.60499999999999998},"min":{"1min":0.379,"5min":0.35899999999999999,"15min":0.317},"max":{"1min":0.81799999999999995,"5min":0.88,"15min":1.0169999999999999},"last":0.627},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.61899999999999999},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":0.89100000000000001,"15min":0.95399999999999996},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.629},"min":{"1min":0.49199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84199999999999997,"5min":0.96599999999999997,"15min":7.9909999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64000000000000001,"15min":0.67600000000000005},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.35699999999999998},"max":{"1min":0.82999999999999996,"5min":0.94099999999999995,"15min":1.0529999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Sun Jul 9 02:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.70399999999999996},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.0329999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.54000000000000004,"5min":0.434,"15min":0.33200000000000002},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":8.0359999999999996},"last":0.73599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.216},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.96499999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.50900000000000001,"15min":0.48899999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.77700000000000002,"5min":0.86299999999999999,"15min":1.198},"last":0.40200000000000002}]},{"osd":1,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.45100000000000001,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.27100000000000002},"max":{"1min":0.56000000000000005,"5min":0.68700000000000006,"15min":1.048},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.26000000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.85299999999999998},"last":0.47899999999999998}]},{"osd":2,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41499999999999998,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.64800000000000002,"5min":0.77800000000000002,"15min":1.155},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.39500000000000002,"15min":0.35599999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":1.1040000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45300000000000001},"max":{"1min":1.0720000000000001,"5min":1.117,"15min":1.466},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77900000000000003,"15min":0.745},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.34000000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.3560000000000001},"last":0.97999999999999998}]},{"osd":5,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.40899999999999997},"max":{"1min":1.002,"5min":1.155,"15min":1.3420000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.435},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.2909999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.61599999999999999,"5min":0.52300000000000002,"15min":0.46600000000000003},"max":{"1min":1.0529999999999999,"5min":1.177,"15min":1.4350000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":1.1459999999999999,"15min":1.5569999999999999},"last":1.018}]},{"osd":7,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.367},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.77500000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.47499999999999998},"max":{"1min":1.0609999999999999,"5min":1.0760000000000001,"15min":1.2569999999999999},"last":0.93500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.436,"15min":0.44900000000000001},"min":{"1min":0.23999999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.624,"5min":0.84299999999999997,"15min":7.7450000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.49099999999999999,"15min":0.45400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":0.72599999999999998,"5min":0.78700000000000003,"15min":1.127},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.46899999999999997,"15min":0.46600000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":2.8879999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58399999999999996,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72299999999999998,"5min":0.90500000000000003,"15min":2.0600000000000001},"last":0.70299999999999996}]},{"osd":3,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32200000000000001},"max":{"1min":0.755,"5min":0.75800000000000001,"15min":1.6879999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51100000000000001,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.58199999999999996,"5min":0.875,"15min":7.8710000000000004},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.78500000000000003,"15min":0.77400000000000002},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1140000000000001,"5min":1.218,"15min":7.7990000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79400000000000004,"15min":0.75800000000000001},"min":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.47899999999999998},"max":{"1min":0.99199999999999999,"5min":1.046,"15min":1.821},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.751},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.496},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.046,"5min":1.093,"15min":7.8369999999999997},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.79100000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.48299999999999998},"max":{"1min":1.0680000000000001,"5min":1.3029999999999999,"15min":1.9790000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.82199999999999995},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.51500000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.452},"last":0.76100000000000001}]},{"osd":7,"last update":"Sun Jul 9 02:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.80300000000000005,"15min":0.76100000000000001},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.51700000000000002},"max":{"1min":0.92500000000000004,"5min":1.165,"15min":1.9379999999999999},"last":0.745},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81599999999999995,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.48699999999999999},"max":{"1min":1.1479999999999999,"5min":1.173,"15min":1.351},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.439,"15min":0.44500000000000001},"min":{"1min":0.34000000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59399999999999997,"5min":0.64000000000000001,"15min":0.80300000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51400000000000001,"15min":0.48699999999999999},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72399999999999998,"5min":0.79100000000000004,"15min":0.81599999999999995},"last":0.34599999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.86899999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.374,"15min":0.29399999999999998},"max":{"1min":0.71299999999999997,"5min":0.77300000000000002,"15min":1.1080000000000001},"last":0.501}]},{"osd":3,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.38600000000000001,"5min":0.38300000000000001,"15min":0.36699999999999999},"max":{"1min":0.79500000000000004,"5min":0.80800000000000005,"15min":0.85099999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.51000000000000001,"15min":0.49299999999999999},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.32600000000000001},"max":{"1min":0.65300000000000002,"5min":0.77700000000000002,"15min":1.163},"last":0.65400000000000003}]},{"osd":4,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76000000000000001,"15min":0.73999999999999999},"min":{"1min":0.55300000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.0680000000000001,"5min":1.069,"15min":1.0920000000000001},"last":0.87},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.57399999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0609999999999999,"5min":1.095,"15min":1.1779999999999999},"last":0.95599999999999996}]},{"osd":5,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77200000000000002,"15min":0.75},"min":{"1min":0.61899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.1599999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.60399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.044,"5min":1.131,"15min":1.131},"last":0.93200000000000005}]},{"osd":6,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79600000000000004,"15min":0.78500000000000003},"min":{"1min":0.59299999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.073,"5min":1.1639999999999999,"15min":1.1919999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82399999999999995,"15min":0.80700000000000005},"min":{"1min":0.66200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0920000000000001,"5min":1.171,"15min":1.2929999999999999},"last":0.97599999999999998}]},{"osd":7,"last update":"Sun Jul 9 02:23:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80500000000000005,"15min":0.78300000000000003},"min":{"1min":0.67300000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"max":{"1min":1.016,"5min":1.105,"15min":1.105},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78400000000000003,"15min":0.77900000000000003},"min":{"1min":0.621,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1080000000000001,"5min":1.2310000000000001,"15min":1.3600000000000001},"last":0.92200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1683,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193628,"statfs":{"total":200000000,"available":198275898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 02:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47499999999999998,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.28000000000000003,"15min":0.22700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.94999999999999996},"last":0.309},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.51000000000000001},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":1.3240000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Sun Jul 9 02:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.29899999999999999},"max":{"1min":0.69699999999999995,"5min":0.78800000000000003,"15min":0.88900000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52300000000000002,"15min":0.48299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":1.4139999999999999},"last":0.52100000000000002}]},{"osd":3,"last update":"Sun Jul 9 02:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51100000000000001,"15min":0.46200000000000002},"min":{"1min":0.375,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73499999999999999,"5min":0.754,"15min":1.0189999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.54000000000000004},"min":{"1min":0.42799999999999999,"5min":0.41299999999999998,"15min":0.38600000000000001},"max":{"1min":0.755,"5min":0.879,"15min":3.8929999999999998},"last":0.55900000000000005}]},{"osd":4,"last update":"Sun Jul 9 02:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81899999999999995,"15min":0.77700000000000002},"min":{"1min":0.55000000000000004,"5min":0.47299999999999998,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.149,"15min":1.149},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82299999999999995,"15min":0.79000000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.41499999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.153},"last":0.753}]},{"osd":5,"last update":"Sun Jul 9 02:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.82499999999999996,"15min":0.79800000000000004},"min":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.47199999999999998},"max":{"1min":1.093,"5min":1.1040000000000001,"15min":1.4350000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.83399999999999996,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.46100000000000002},"max":{"1min":1.111,"5min":1.2050000000000001,"15min":1.238},"last":0.84099999999999997}]},{"osd":6,"last update":"Sun Jul 9 02:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78700000000000003,"15min":0.752},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.47799999999999998},"max":{"1min":0.997,"5min":1.117,"15min":1.117},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.74199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":1.0980000000000001,"5min":1.1200000000000001,"15min":1.7789999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Jul 9 02:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79600000000000004,"15min":0.77900000000000003},"min":{"1min":0.51900000000000002,"5min":0.49399999999999999,"15min":0.49099999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.8149999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79400000000000004,"15min":0.752},"min":{"1min":0.57899999999999996,"5min":0.52400000000000002,"15min":0.42699999999999999},"max":{"1min":1.179,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.76500000000000001}]}]}],"pool_statfs":[]}} 2023-07-09T02:23:57.271 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-09T02:23:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36d5b11640 1 Processor -- start 2023-07-09T02:23:57.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36d5b11640 1 -- start start 2023-07-09T02:23:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36d5b11640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36d006c110 0x7f36d006c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36d5b11640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d006caa0 con 0x7f36d00caec0 2023-07-09T02:23:57.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36d5b11640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00ccf80 con 0x7f36d0158e30 2023-07-09T02:23:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36d5b11640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d00cd540 con 0x7f36d006c110 2023-07-09T02:23:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36ceffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36d006c110 0x7f36d006c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36ceffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36d006c110 0x7f36d006c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48462/0 (socket says 172.21.15.45:48462) 2023-07-09T02:23:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36cffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f36d00caec0 0x7f36d00cb300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59708/0 (socket says 172.21.15.45:59708) 2023-07-09T02:23:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36ceffd640 1 -- 172.21.15.45:0/1363638353 learned_addr learned my addr 172.21.15.45:0/1363638353 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36ceffd640 1 -- 172.21.15.45:0/1363638353 >> v1:172.21.15.155:6789/0 conn(0x7f36d0158e30 legacy=0x7f36d006f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36ceffd640 1 -- 172.21.15.45:0/1363638353 >> v1:172.21.15.45:6789/0 conn(0x7f36d00caec0 legacy=0x7f36d00cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.411+0000 7f36ceffd640 1 -- 172.21.15.45:0/1363638353 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00c8fb0 con 0x7f36d006c110 2023-07-09T02:23:57.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36ceffd640 1 --2- 172.21.15.45:0/1363638353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d006c560 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f36c400bb10 tx=0x7f36c401eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9712605e12dd153 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36ce7fc640 1 -- 172.21.15.45:0/1363638353 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c40a7c20 con 0x7f36d006c110 2023-07-09T02:23:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36ce7fc640 1 -- 172.21.15.45:0/1363638353 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c40a7d80 con 0x7f36d006c110 2023-07-09T02:23:57.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36ce7fc640 1 -- 172.21.15.45:0/1363638353 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c40af660 con 0x7f36d006c110 2023-07-09T02:23:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36d5b11640 1 -- 172.21.15.45:0/1363638353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 msgr2=0x7f36d006c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36d5b11640 1 --2- 172.21.15.45:0/1363638353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d006c560 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f36c400bb10 tx=0x7f36c401eb50 comp rx=0 tx=0).stop 2023-07-09T02:23:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36d5b11640 1 -- 172.21.15.45:0/1363638353 shutdown_connections 2023-07-09T02:23:57.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36d5b11640 1 --2- 172.21.15.45:0/1363638353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d006c560 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36d5b11640 1 -- 172.21.15.45:0/1363638353 >> 172.21.15.45:0/1363638353 conn(0x7f36d00694b0 msgr2=0x7f36d00698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36d5b11640 1 -- 172.21.15.45:0/1363638353 shutdown_connections 2023-07-09T02:23:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.415+0000 7f36d5b11640 1 -- 172.21.15.45:0/1363638353 wait complete. 2023-07-09T02:23:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 Processor -- start 2023-07-09T02:23:57.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 -- start start 2023-07-09T02:23:57.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d0141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00caec0 0x7f36d0143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d0158e30 0x7f36d00c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00c8640 con 0x7f36d006c110 2023-07-09T02:23:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d0141d40 con 0x7f36d0158e30 2023-07-09T02:23:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d014a430 con 0x7f36d00caec0 2023-07-09T02:23:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d0141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d0141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48474/0 (socket says 172.21.15.45:48474) 2023-07-09T02:23:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 -- 172.21.15.45:0/1885812173 learned_addr learned my addr 172.21.15.45:0/1885812173 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cffff640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d0158e30 0x7f36d00c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36ceffd640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00caec0 0x7f36d0143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 -- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00caec0 msgr2=0x7f36d0143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00caec0 0x7f36d0143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 -- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d0158e30 msgr2=0x7f36d00c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d0158e30 0x7f36d00c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 -- 172.21.15.45:0/1885812173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c400b770 con 0x7f36d006c110 2023-07-09T02:23:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36ceffd640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00caec0 0x7f36d0143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36cf7fe640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d0141800 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f36c000c3c0 tx=0x7f36c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36b7fff640 1 -- 172.21.15.45:0/1885812173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c00052d0 con 0x7f36d006c110 2023-07-09T02:23:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36b7fff640 1 -- 172.21.15.45:0/1885812173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c0005430 con 0x7f36d006c110 2023-07-09T02:23:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36b7fff640 1 -- 172.21.15.45:0/1885812173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0003840 con 0x7f36d006c110 2023-07-09T02:23:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d014a710 con 0x7f36d006c110 2023-07-09T02:23:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.419+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d014acd0 con 0x7f36d006c110 2023-07-09T02:23:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.423+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d004d7d0 con 0x7f36d006c110 2023-07-09T02:23:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.423+0000 7f36b7fff640 1 -- 172.21.15.45:0/1885812173 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36c00039a0 con 0x7f36d006c110 2023-07-09T02:23:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.423+0000 7f36b7fff640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36bc066280 0x7f36bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.423+0000 7f36b7fff640 1 -- 172.21.15.45:0/1885812173 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f36c0082f50 con 0x7f36d006c110 2023-07-09T02:23:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.423+0000 7f36ceffd640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36bc066280 0x7f36bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.423+0000 7f36ceffd640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36bc066280 0x7f36bc068730 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f36c40b1000 tx=0x7f36c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.427+0000 7f36b7fff640 1 -- 172.21.15.45:0/1885812173 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36c00506e0 con 0x7f36d006c110 2023-07-09T02:23:57.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.583+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f36d00ccb30 con 0x7f36d006c110 2023-07-09T02:23:57.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.587+0000 7f36b7fff640 1 -- 172.21.15.45:0/1885812173 <== mon.0 v2:172.21.15.45:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f36c0001130 con 0x7f36d006c110 2023-07-09T02:23:57.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36b7fff640 1 -- 172.21.15.45:0/1885812173 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f36c0053d00 con 0x7f36d006c110 2023-07-09T02:23:57.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36bc066280 msgr2=0x7f36bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36bc066280 0x7f36bc068730 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f36c40b1000 tx=0x7f36c4008040 comp rx=0 tx=0).stop 2023-07-09T02:23:57.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 msgr2=0x7f36d0141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d0141800 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f36c000c3c0 tx=0x7f36c000c880 comp rx=0 tx=0).stop 2023-07-09T02:23:57.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 shutdown_connections 2023-07-09T02:23:57.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d0158e30 0x7f36d00c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7f36bc066280 0x7f36bc068730 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36d00caec0 0x7f36d0143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 --2- 172.21.15.45:0/1885812173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36d006c110 0x7f36d0141800 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 >> 172.21.15.45:0/1885812173 conn(0x7f36d00694b0 msgr2=0x7f36d0155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 shutdown_connections 2023-07-09T02:23:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.591+0000 7f36d5b11640 1 -- 172.21.15.45:0/1885812173 wait complete. 2023-07-09T02:23:57.613 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T02:23:57.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T02:23:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaaeaf640 1 Processor -- start 2023-07-09T02:23:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaaeaf640 1 -- start start 2023-07-09T02:23:57.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaaeaf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b6c0 0x7fdba40d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaaeaf640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba40b2090 con 0x7fdba415c870 2023-07-09T02:23:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaaeaf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba4160520 con 0x7fdba406b240 2023-07-09T02:23:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaaeaf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4160800 con 0x7fdba406b6c0 2023-07-09T02:23:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdba9ead640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdba415c870 0x7fdba40b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59718/0 (socket says 172.21.15.45:59718) 2023-07-09T02:23:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdba9ead640 1 -- 172.21.15.45:0/4162168204 learned_addr learned my addr 172.21.15.45:0/4162168204 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-07-09T02:23:57.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaa6ae640 1 --2- 172.21.15.45:0/4162168204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b6c0 0x7fdba40d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdba8eab640 1 -- 172.21.15.45:0/4162168204 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647671129 0 0) 0x7fdba40b2090 con 0x7fdba415c870 2023-07-09T02:23:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdba8eab640 1 -- 172.21.15.45:0/4162168204 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb90003530 con 0x7fdba415c870 2023-07-09T02:23:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdba8eab640 1 -- 172.21.15.45:0/4162168204 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951473109 0 0) 0x7fdba4160520 con 0x7fdba406b240 2023-07-09T02:23:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdba8eab640 1 -- 172.21.15.45:0/4162168204 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba40b2090 con 0x7fdba406b240 2023-07-09T02:23:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaa6ae640 1 -- 172.21.15.45:0/4162168204 >> v1:172.21.15.155:6789/0 conn(0x7fdba406b240 legacy=0x7fdba40d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaa6ae640 1 -- 172.21.15.45:0/4162168204 >> v1:172.21.15.45:6789/0 conn(0x7fdba415c870 legacy=0x7fdba40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.755+0000 7fdbaa6ae640 1 -- 172.21.15.45:0/4162168204 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4160ae0 con 0x7fdba406b6c0 2023-07-09T02:23:57.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdbaa6ae640 1 --2- 172.21.15.45:0/4162168204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b6c0 0x7fdba40d1480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009dc0 tx=0x7fdb9c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dc2b548dd0d7457 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdba8eab640 1 -- 172.21.15.45:0/4162168204 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0a5910 con 0x7fdba406b6c0 2023-07-09T02:23:57.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdba8eab640 1 -- 172.21.15.45:0/4162168204 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdb9c0a5a70 con 0x7fdba406b6c0 2023-07-09T02:23:57.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdba8eab640 1 -- 172.21.15.45:0/4162168204 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0a5de0 con 0x7fdba406b6c0 2023-07-09T02:23:57.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/4162168204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b6c0 msgr2=0x7fdba40d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdbaaeaf640 1 --2- 172.21.15.45:0/4162168204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b6c0 0x7fdba40d1480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009dc0 tx=0x7fdb9c01c940 comp rx=0 tx=0).stop 2023-07-09T02:23:57.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/4162168204 shutdown_connections 2023-07-09T02:23:57.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdbaaeaf640 1 --2- 172.21.15.45:0/4162168204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b6c0 0x7fdba40d1480 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/4162168204 >> 172.21.15.45:0/4162168204 conn(0x7fdba4070be0 msgr2=0x7fdba4070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:57.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/4162168204 shutdown_connections 2023-07-09T02:23:57.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.759+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/4162168204 wait complete. 2023-07-09T02:23:57.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 Processor -- start 2023-07-09T02:23:57.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 -- start start 2023-07-09T02:23:57.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b240 0x7fdba40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdba406b6c0 0x7fdba40c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba415c870 0x7fdba40c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba41540d0 con 0x7fdba415c870 2023-07-09T02:23:57.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4154370 con 0x7fdba406b6c0 2023-07-09T02:23:57.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4154650 con 0x7fdba406b240 2023-07-09T02:23:57.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba415c870 0x7fdba40c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba415c870 0x7fdba40c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48482/0 (socket says 172.21.15.45:48482) 2023-07-09T02:23:57.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 -- 172.21.15.45:0/3224842364 learned_addr learned my addr 172.21.15.45:0/3224842364 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-07-09T02:23:57.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdba9ead640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b240 0x7fdba40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdba96ac640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdba406b6c0 0x7fdba40c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 -- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b240 msgr2=0x7fdba40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b240 0x7fdba40b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 -- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdba406b6c0 msgr2=0x7fdba40c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdba406b6c0 0x7fdba40c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 -- 172.21.15.45:0/3224842364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c009a70 con 0x7fdba415c870 2023-07-09T02:23:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdba96ac640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdba406b6c0 0x7fdba40c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T02:23:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaa6ae640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba415c870 0x7fdba40c9f70 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c01a570 tx=0x7fdb9c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdb9a7fc640 1 -- 172.21.15.45:0/3224842364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0ad850 con 0x7fdba415c870 2023-07-09T02:23:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdb9a7fc640 1 -- 172.21.15.45:0/3224842364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdb9c0ad9b0 con 0x7fdba415c870 2023-07-09T02:23:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba4154930 con 0x7fdba415c870 2023-07-09T02:23:57.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdb9a7fc640 1 -- 172.21.15.45:0/3224842364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0add80 con 0x7fdba415c870 2023-07-09T02:23:57.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba40b3700 con 0x7fdba415c870 2023-07-09T02:23:57.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.763+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba4154b70 con 0x7fdba415c870 2023-07-09T02:23:57.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.767+0000 7fdb9a7fc640 1 -- 172.21.15.45:0/3224842364 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb9c0b4070 con 0x7fdba415c870 2023-07-09T02:23:57.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.767+0000 7fdb9a7fc640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdb880662b0 0x7fdb88068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T02:23:57.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.767+0000 7fdb9a7fc640 1 -- 172.21.15.45:0/3224842364 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdb9c11e3e0 con 0x7fdba415c870 2023-07-09T02:23:57.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.767+0000 7fdba9ead640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdb880662b0 0x7fdb88068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T02:23:57.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.767+0000 7fdba9ead640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdb880662b0 0x7fdb88068760 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdba0000f70 tx=0x7fdba0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T02:23:57.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.771+0000 7fdb9a7fc640 1 -- 172.21.15.45:0/3224842364 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdba4154b70 con 0x7fdba415c870 2023-07-09T02:23:57.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.959+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdba4154b70 con 0x7fdba415c870 2023-07-09T02:23:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.959+0000 7fdb9a7fc640 1 -- 172.21.15.45:0/3224842364 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fdb9c0b2de0 con 0x7fdba415c870 2023-07-09T02:23:57.963 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-09T02:23:57.963 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":93,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8551,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1496357434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1496357434},{"type":"v1","addr":"172.21.15.45:6834","nonce":1496357434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8557,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/1954924284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1954924284},{"type":"v1","addr":"172.21.15.155:6836","nonce":1954924284}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/2142151412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":2142151412},{"type":"v1","addr":"172.21.15.155:6837","nonce":2142151412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":9504,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2117403302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2117403302},{"type":"v1","addr":"172.21.15.45:6835","nonce":2117403302}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[]} 2023-07-09T02:23:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 93 2023-07-09T02:23:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdb880662b0 msgr2=0x7fdb88068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdb880662b0 0x7fdb88068760 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdba0000f70 tx=0x7fdba0009040 comp rx=0 tx=0).stop 2023-07-09T02:23:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba415c870 msgr2=0x7fdba40c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T02:23:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba415c870 0x7fdba40c9f70 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c01a570 tx=0x7fdb9c0196e0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 shutdown_connections 2023-07-09T02:23:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdba415c870 0x7fdba40c9f70 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdba406b6c0 0x7fdba40c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:6832/3807220831,v1:172.21.15.155:6833/3807220831] conn(0x7fdb880662b0 0x7fdb88068760 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 --2- 172.21.15.45:0/3224842364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdba406b240 0x7fdba40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T02:23:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 >> 172.21.15.45:0/3224842364 conn(0x7fdba4070be0 msgr2=0x7fdba415a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T02:23:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 shutdown_connections 2023-07-09T02:23:57.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-07-09T02:23:57.963+0000 7fdbaaeaf640 1 -- 172.21.15.45:0/3224842364 wait complete. 2023-07-09T02:23:57.984 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-09T02:23:57.984 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-09T02:23:57.984 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T02:23:57.985 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:57.996 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T02:23:57.997 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T02:23:57.997 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.055 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T02:23:58.055 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T02:23:58.056 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.070 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T02:23:58.071 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T02:23:58.071 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.129 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T02:23:58.130 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-09T02:23:58.130 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-09T02:23:58.130 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.185 INFO:tasks.ceph.osd.0:Stopped 2023-07-09T02:23:58.186 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-09T02:23:58.186 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.239 INFO:tasks.ceph.osd.1:Stopped 2023-07-09T02:23:58.239 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-09T02:23:58.239 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.282 INFO:tasks.ceph.osd.2:Stopped 2023-07-09T02:23:58.283 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-09T02:23:58.283 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.332 INFO:tasks.ceph.osd.3:Stopped 2023-07-09T02:23:58.333 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-09T02:23:58.333 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.391 INFO:tasks.ceph.osd.4:Stopped 2023-07-09T02:23:58.392 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-09T02:23:58.392 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.434 INFO:tasks.ceph.osd.5:Stopped 2023-07-09T02:23:58.435 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-09T02:23:58.435 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.473 INFO:tasks.ceph.osd.6:Stopped 2023-07-09T02:23:58.474 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-09T02:23:58.474 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.559 INFO:tasks.ceph.osd.7:Stopped 2023-07-09T02:23:58.560 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-09T02:23:58.560 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-09T02:23:58.560 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.611 INFO:tasks.ceph.mgr.y:Stopped 2023-07-09T02:23:58.631 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-09T02:23:58.631 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.683 INFO:tasks.ceph.mgr.x:Stopped 2023-07-09T02:23:58.684 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-09T02:23:58.684 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-09T02:23:58.684 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.703 INFO:tasks.ceph.mon.a:Stopped 2023-07-09T02:23:58.704 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-09T02:23:58.704 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.719 INFO:tasks.ceph.mon.b:Stopped 2023-07-09T02:23:58.719 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-09T02:23:58.719 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T02:23:58.777 INFO:tasks.ceph.mon.c:Stopped 2023-07-09T02:23:58.778 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-09T02:23:58.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-07-09T02:23:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:2023-07-09T02:11:04.070052+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 138960.176746 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.0. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-07-09T02:23:58.813 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-07-09T02:23:58.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-07-09T02:23:58.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-07-09T02:23:58.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-07-09T02:23:59.048 INFO:teuthology.orchestra.run.smithi045.stdout:2023-07-09T02:11:04.070052+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 138960.176746 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.0. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-07-09T02:23:59.050 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:23:59.050 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-09T02:23:59.578 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:23:59.578 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-09T02:24:00.137 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:24:00.138 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-09T02:24:00.473 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:24:00.474 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-09T02:24:00.874 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:24:00.875 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-09T02:24:01.218 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:24:01.218 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-09T02:24:01.682 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:24:01.682 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-09T02:24:02.013 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:24:02.014 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-09T02:24:02.462 INFO:tasks.ceph:Archiving mon data... 2023-07-09T02:24:02.463 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/data/mon.a.tgz 2023-07-09T02:24:02.463 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-07-09T02:24:02.473 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.j7zVIYmKR6 2023-07-09T02:24:02.473 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.j7zVIYmKR6 2023-07-09T02:24:02.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.j7zVIYmKR6 2023-07-09T02:24:02.707 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.j7zVIYmKR6 is 442KB 2023-07-09T02:24:02.769 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.j7zVIYmKR6 2023-07-09T02:24:02.778 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/data/mon.b.tgz 2023-07-09T02:24:02.778 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-07-09T02:24:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.9p533JXIv6 2023-07-09T02:24:02.788 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9p533JXIv6 2023-07-09T02:24:02.943 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.9p533JXIv6 2023-07-09T02:24:03.019 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.9p533JXIv6 is 456KB 2023-07-09T02:24:03.081 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.9p533JXIv6 2023-07-09T02:24:03.089 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/data/mon.c.tgz 2023-07-09T02:24:03.090 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2023-07-09T02:24:03.138 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.Dajej7qWMc 2023-07-09T02:24:03.139 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Dajej7qWMc 2023-07-09T02:24:03.289 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.Dajej7qWMc 2023-07-09T02:24:03.362 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.Dajej7qWMc is 456KB 2023-07-09T02:24:03.429 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.Dajej7qWMc 2023-07-09T02:24:03.437 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-09T02:24:03.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-09T02:24:03.441 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-09T02:24:03.499 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-09T02:24:03.499 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-09T02:24:03.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-09T02:24:03.541 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-09T02:24:03.578 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-09T02:24:03.584 INFO:tasks.ceph:Archiving crash dumps... 2023-07-09T02:24:03.586 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/remote/smithi045/crash 2023-07-09T02:24:03.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-09T02:24:03.613 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/remote/smithi155/crash 2023-07-09T02:24:03.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-09T02:24:03.649 INFO:tasks.ceph:Shutting down logrotate 2023-07-09T02:24:03.650 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:24:03.665 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T02:24:03.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-09T02:24:03.780 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-09T02:24:03.799 INFO:tasks.ceph:Compressing logs... 2023-07-09T02:24:03.800 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-09T02:24:03.826 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-09T02:24:03.851 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33304.log 2023-07-09T02:24:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40573.log 2023-07-09T02:24:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35339.log 2023-07-09T02:24:03.853 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33304.log.gz 2023-07-09T02:24:03.854 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37990.log 2023-07-09T02:24:03.854 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40573.log.gz 2023-07-09T02:24:03.855 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34770.log 89.0% 2023-07-09T02:24:03.855 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35339.log.gz 2023-07-09T02:24:03.856 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2023-07-09T02:24:03.856 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37990.log.gz 2023-07-09T02:24:03.858 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45643.log 2023-07-09T02:24:03.858 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34770.log.gz 2023-07-09T02:24:03.859 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43268.log 2023-07-09T02:24:03.859 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz 2023-07-09T02:24:03.859 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48710.log 2023-07-09T02:24:03.860 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45643.log.gz 2023-07-09T02:24:03.860 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43268.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43268.log.gz 2023-07-09T02:24:03.860 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49708.log 2023-07-09T02:24:03.861 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38178.log 2023-07-09T02:24:03.862 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48710.log.gz 2023-07-09T02:24:03.862 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49708.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49708.log.gz 2023-07-09T02:24:03.863 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52669.log 2023-07-09T02:24:03.863 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2023-07-09T02:24:03.864 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38178.log.gz 2023-07-09T02:24:03.864 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38339.log 89.1% 2023-07-09T02:24:03.865 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52669.log.gz 2023-07-09T02:24:03.865 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47835.log 2023-07-09T02:24:03.866 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2023-07-09T02:24:03.866 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log 2023-07-09T02:24:03.867 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38339.log.gz 2023-07-09T02:24:03.868 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35548.log 2023-07-09T02:24:03.869 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47835.log.gz 2023-07-09T02:24:03.869 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42691.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2023-07-09T02:24:03.869 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49451.log 2023-07-09T02:24:03.870 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35548.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.35548.log.gz 2023-07-09T02:24:03.870 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.41640.log 2023-07-09T02:24:03.871 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49451.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49451.log.gz 2023-07-09T02:24:03.871 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40182.log 2023-07-09T02:24:03.872 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41640.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41640.log.gz 2023-07-09T02:24:03.872 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2023-07-09T02:24:03.873 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40182.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40182.log.gz 2023-07-09T02:24:03.873 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38884.log 2023-07-09T02:24:03.874 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46294.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2023-07-09T02:24:03.874 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36511.log 2023-07-09T02:24:03.875 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38884.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.38884.log.gz 2023-07-09T02:24:03.875 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.39595.log 2023-07-09T02:24:03.876 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36511.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36511.log.gz 2023-07-09T02:24:03.876 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45200.log 2023-07-09T02:24:03.877 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.39595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39595.log.gz 2023-07-09T02:24:03.877 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49866.log 2023-07-09T02:24:03.878 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48247.log 2023-07-09T02:24:03.878 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45200.log.gz 2023-07-09T02:24:03.879 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49866.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49866.log.gz 2023-07-09T02:24:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45117.log 2023-07-09T02:24:03.880 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33141.log 2023-07-09T02:24:03.881 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.48247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48247.log.gz 2023-07-09T02:24:03.881 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54219.log 2023-07-09T02:24:03.882 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34840.log 2023-07-09T02:24:03.882 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45117.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-09T02:24:03.882 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45117.log.gz 2023-07-09T02:24:03.883 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54219.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54219.log.gz 2023-07-09T02:24:03.883 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43954.log 2023-07-09T02:24:03.883 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33141.log: gzip -5 --verbose 88.6% -- -- replaced with /var/log/ceph/ceph-client.admin.33141.log.gz /var/log/ceph/ceph-client.admin.33237.log 2023-07-09T02:24:03.884 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-07-09T02:24:03.884 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34840.log.gz 2023-07-09T02:24:03.884 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33954.log 2023-07-09T02:24:03.885 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33237.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33237.log.gz 2023-07-09T02:24:03.885 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35123.log 2023-07-09T02:24:03.886 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.33954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33954.log.gz 2023-07-09T02:24:03.886 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-09T02:24:03.886 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54810.log 2023-07-09T02:24:03.886 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43954.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2023-07-09T02:24:03.887 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40208.log 2023-07-09T02:24:03.887 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42927.log 2023-07-09T02:24:03.887 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54810.log.gz 2023-07-09T02:24:03.888 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40208.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40208.log.gz 2023-07-09T02:24:03.888 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51031.log 2023-07-09T02:24:03.889 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42927.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42927.log.gz 2023-07-09T02:24:03.889 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51374.log 2023-07-09T02:24:03.890 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.35123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35123.log.gz 2023-07-09T02:24:03.890 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-09T02:24:03.890 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34690.log 2023-07-09T02:24:03.890 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33213.log 2023-07-09T02:24:03.890 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34690.log.gz 2023-07-09T02:24:03.890 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34294.log 2023-07-09T02:24:03.892 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34548.log 2023-07-09T02:24:03.892 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33213.log.gz 2023-07-09T02:24:03.892 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34294.log.gz 2023-07-09T02:24:03.892 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-09T02:24:03.893 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51031.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51031.log.gz 2023-07-09T02:24:03.893 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43351.log 2023-07-09T02:24:03.893 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47579.log 89.9% 2023-07-09T02:24:03.893 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51374.log.gz 2023-07-09T02:24:03.894 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43351.log: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-09T02:24:03.894 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43351.log.gz 2023-07-09T02:24:03.894 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2023-07-09T02:24:03.894 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47579.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47579.log.gz 2023-07-09T02:24:03.894 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2023-07-09T02:24:03.896 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33401.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2023-07-09T02:24:03.896 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42143.log 2023-07-09T02:24:03.896 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46347.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2023-07-09T02:24:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35678.log 2023-07-09T02:24:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42143.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42143.log.gz 2023-07-09T02:24:03.897 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54706.log 2023-07-09T02:24:03.897 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34548.log.gz 2023-07-09T02:24:03.897 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33841.log 2023-07-09T02:24:03.898 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-09T02:24:03.898 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.3.33841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33841.log.gz 2023-07-09T02:24:03.898 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34424.log 2023-07-09T02:24:03.898 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-09T02:24:03.898 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34424.log.gz 2023-07-09T02:24:03.898 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34169.log 2023-07-09T02:24:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35678.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35678.log.gz 2023-07-09T02:24:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45795.log 2023-07-09T02:24:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54706.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54706.log.gz 2023-07-09T02:24:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35944.log 2023-07-09T02:24:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45795.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45795.log.gz 2023-07-09T02:24:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39145.log 2023-07-09T02:24:03.902 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33756.log 2023-07-09T02:24:03.902 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34169.log.gz 2023-07-09T02:24:03.902 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-09T02:24:03.902 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.33756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33756.log.gz 2023-07-09T02:24:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35944.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35944.log.gz 2023-07-09T02:24:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49600.log 2023-07-09T02:24:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39145.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39145.log.gzgzip 2023-07-09T02:24:03.903 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51634.log 2023-07-09T02:24:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49600.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49600.log.gz 2023-07-09T02:24:03.903 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43508.log 2023-07-09T02:24:03.904 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34989.log 2023-07-09T02:24:03.905 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.c.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-09T02:24:03.905 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-09T02:24:03.905 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34989.log.gz 2023-07-09T02:24:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51478.log 2023-07-09T02:24:03.906 INFO:teuthology.orchestra.run.smithi045.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51634.log.gz 2023-07-09T02:24:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43508.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43508.log.gz 2023-07-09T02:24:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49054.log 2023-07-09T02:24:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51478.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51478.log.gz 2023-07-09T02:24:03.906 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2023-07-09T02:24:03.907 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49054.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49054.log.gz 2023-07-09T02:24:03.907 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33165.log 2023-07-09T02:24:03.907 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34059.log 2023-07-09T02:24:03.908 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33165.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33165.log.gz 2023-07-09T02:24:03.908 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2023-07-09T02:24:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52584.log 2023-07-09T02:24:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51684.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2023-07-09T02:24:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54472.log 2023-07-09T02:24:03.910 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34059.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33117.log 2023-07-09T02:24:03.911 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-07-09T02:24:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52584.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52584.log.gz 2023-07-09T02:24:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2023-07-09T02:24:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54472.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54472.log.gz 2023-07-09T02:24:03.911 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40934.log 2023-07-09T02:24:03.913 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38313.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2023-07-09T02:24:03.913 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40521.log 2023-07-09T02:24:03.913 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40934.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40934.log.gz 2023-07-09T02:24:03.913 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33782.log 2023-07-09T02:24:03.913 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33189.log 2023-07-09T02:24:03.913 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33117.log: 93.8% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2023-07-09T02:24:03.914 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-09T02:24:03.914 INFO:teuthology.orchestra.run.smithi155.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33117.log.gz 2023-07-09T02:24:03.914 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-09T02:24:03.915 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40521.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.40521.log.gz --verbose 2023-07-09T02:24:03.915 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.49314.log 2023-07-09T02:24:03.915 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33782.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33782.log.gz 2023-07-09T02:24:03.916 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40071.log 2023-07-09T02:24:03.917 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49314.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49314.log.gz 2023-07-09T02:24:03.917 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45978.log 2023-07-09T02:24:03.917 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33069.log 2023-07-09T02:24:03.917 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33189.log.gz 2023-07-09T02:24:03.917 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-09T02:24:03.918 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.33069.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-09T02:24:03.919 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33069.log.gz 2023-07-09T02:24:03.919 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40071.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40071.log.gz 2023-07-09T02:24:03.920 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44331.log 2023-07-09T02:24:03.920 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45978.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45978.log.gz 2023-07-09T02:24:03.920 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44947.log 2023-07-09T02:24:03.920 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44331.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44331.log.gz 2023-07-09T02:24:03.920 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38287.log 2023-07-09T02:24:03.921 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-09T02:24:03.922 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44947.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44947.log.gz 2023-07-09T02:24:03.922 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37904.log 2023-07-09T02:24:03.922 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38287.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38287.log.gz 2023-07-09T02:24:03.922 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38522.log 2023-07-09T02:24:03.923 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37904.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37904.log.gz 2023-07-09T02:24:03.923 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33640.log 2023-07-09T02:24:03.923 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41666.log 2023-07-09T02:24:03.923 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38522.log.gz 2023-07-09T02:24:03.924 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33640.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33640.log.gz 2023-07-09T02:24:03.924 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40391.log 2023-07-09T02:24:03.925 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41666.log: gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41666.log.gz /var/log/ceph/ceph-client.admin.54446.log 2023-07-09T02:24:03.925 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:03.926 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40391.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40391.log.gz 2023-07-09T02:24:03.926 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39821.log 2023-07-09T02:24:03.927 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54446.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54446.log.gz 2023-07-09T02:24:03.927 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-09T02:24:03.928 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39821.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39821.log.gz 2023-07-09T02:24:03.928 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36108.log 2023-07-09T02:24:03.929 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36376.log 2023-07-09T02:24:03.930 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36108.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36108.log.gz 2023-07-09T02:24:03.931 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37121.log 2023-07-09T02:24:03.931 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36376.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36376.log.gz 2023-07-09T02:24:03.932 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44866.log 2023-07-09T02:24:03.932 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37121.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37121.log.gz 2023-07-09T02:24:03.933 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41104.log 2023-07-09T02:24:03.933 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44866.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44866.log.gz 2023-07-09T02:24:03.934 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38574.log 2023-07-09T02:24:03.934 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41104.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41104.log.gz 2023-07-09T02:24:03.935 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35470.log 2023-07-09T02:24:03.936 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38574.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38574.log.gz 2023-07-09T02:24:03.936 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47389.log 2023-07-09T02:24:03.937 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51925.log 2023-07-09T02:24:03.937 INFO:teuthology.orchestra.run.smithi045.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35470.log.gz 2023-07-09T02:24:03.938 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47389.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47389.log.gz 2023-07-09T02:24:03.938 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42953.log 2023-07-09T02:24:03.939 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41314.log 2023-07-09T02:24:03.939 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51925.log.gz 2023-07-09T02:24:03.940 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42953.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42953.log.gzgzip 2023-07-09T02:24:03.940 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2023-07-09T02:24:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50074.log 2023-07-09T02:24:03.941 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41314.log.gz 2023-07-09T02:24:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2023-07-09T02:24:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40547.log 2023-07-09T02:24:03.943 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39849.log 2023-07-09T02:24:03.943 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50074.log.gz 2023-07-09T02:24:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40547.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40547.log.gz 2023-07-09T02:24:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51161.log 2023-07-09T02:24:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39849.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.39849.log.gz 2023-07-09T02:24:03.945 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50797.log 2023-07-09T02:24:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51161.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51161.log.gz 2023-07-09T02:24:03.946 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 2023-07-09T02:24:03.947 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48459.log 2023-07-09T02:24:03.947 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50797.log.gz 2023-07-09T02:24:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44413.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2023-07-09T02:24:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39343.log 2023-07-09T02:24:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33974.log 2023-07-09T02:24:03.949 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48459.log.gz 2023-07-09T02:24:03.950 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39343.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39343.log.gz 2023-07-09T02:24:03.950 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53454.log 2023-07-09T02:24:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44136.log 2023-07-09T02:24:03.951 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33974.log.gz 2023-07-09T02:24:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35860.log 2023-07-09T02:24:03.952 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53454.log.gz 2023-07-09T02:24:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47181.log 2023-07-09T02:24:03.953 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44136.log.gz 2023-07-09T02:24:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35860.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35860.log.gz 2023-07-09T02:24:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37382.log 2023-07-09T02:24:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47181.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47181.log.gz 2023-07-09T02:24:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51979.log 2023-07-09T02:24:03.956 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50901.log 2023-07-09T02:24:03.956 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37382.log.gz 2023-07-09T02:24:03.957 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51979.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51979.log.gz 2023-07-09T02:24:03.957 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48819.log 2023-07-09T02:24:03.958 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47415.log 2023-07-09T02:24:03.958 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50901.log.gz 2023-07-09T02:24:03.959 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48819.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48819.log.gz 2023-07-09T02:24:03.959 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40313.log 2023-07-09T02:24:03.960 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34796.log 2023-07-09T02:24:03.961 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47415.log.gz 2023-07-09T02:24:03.961 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43768.log 2023-07-09T02:24:03.962 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40313.log.gz 2023-07-09T02:24:03.963 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51213.log 2023-07-09T02:24:03.963 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34796.log.gz 2023-07-09T02:24:03.963 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43768.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43768.log.gz 2023-07-09T02:24:03.964 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42114.log 2023-07-09T02:24:03.965 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54550.log 2023-07-09T02:24:03.965 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51213.log.gz 2023-07-09T02:24:03.966 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42114.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42114.log.gzgzip 2023-07-09T02:24:03.966 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41262.log 2023-07-09T02:24:03.967 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54550.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54550.log.gz 2023-07-09T02:24:03.967 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51064.log 2023-07-09T02:24:03.968 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41262.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41262.log.gz 2023-07-09T02:24:03.968 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53362.log 2023-07-09T02:24:03.969 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51064.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51064.log.gz 2023-07-09T02:24:03.969 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47729.log 2023-07-09T02:24:03.970 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53362.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53362.log.gz 2023-07-09T02:24:03.970 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47807.log 2023-07-09T02:24:03.971 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47729.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47729.log.gz 2023-07-09T02:24:03.971 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46998.log 2023-07-09T02:24:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47807.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47807.log.gz 2023-07-09T02:24:03.972 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44517.log 2023-07-09T02:24:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46998.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46998.log.gz 2023-07-09T02:24:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36641.log 2023-07-09T02:24:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44517.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44517.log.gz 2023-07-09T02:24:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39875.log 2023-07-09T02:24:03.975 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40644.log 2023-07-09T02:24:03.975 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36641.log.gz 2023-07-09T02:24:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39875.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39875.log.gz 2023-07-09T02:24:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50849.log 2023-07-09T02:24:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40644.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40644.log.gz 2023-07-09T02:24:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54007.log 2023-07-09T02:24:03.978 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50849.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50849.log.gz 2023-07-09T02:24:03.978 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46082.log 2023-07-09T02:24:03.979 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54007.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54007.log.gz 2023-07-09T02:24:03.979 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41184.log 2023-07-09T02:24:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46082.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46082.log.gz 2023-07-09T02:24:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53346.log 2023-07-09T02:24:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41184.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41184.log.gz 2023-07-09T02:24:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55070.log 2023-07-09T02:24:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.53346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53346.log.gz 2023-07-09T02:24:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37226.log 2023-07-09T02:24:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.55070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38801.log 2023-07-09T02:24:03.984 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55070.log.gz 2023-07-09T02:24:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37226.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37226.log.gz 2023-07-09T02:24:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50243.log 2023-07-09T02:24:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38801.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38801.log.gz 2023-07-09T02:24:03.986 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37552.log 2023-07-09T02:24:03.986 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50243.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50243.log.gz 2023-07-09T02:24:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33453.log 2023-07-09T02:24:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37552.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.37552.log.gz 2023-07-09T02:24:03.988 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.47677.log 2023-07-09T02:24:03.988 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33453.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33453.log.gz 2023-07-09T02:24:03.989 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40785.log 2023-07-09T02:24:03.989 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47677.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47677.log.gz 2023-07-09T02:24:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2023-07-09T02:24:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40785.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40785.log.gz 2023-07-09T02:24:03.991 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53388.log 2023-07-09T02:24:03.991 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41906.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2023-07-09T02:24:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38444.log 2023-07-09T02:24:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53388.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53388.log.gz 2023-07-09T02:24:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34179.log 2023-07-09T02:24:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38444.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38444.log.gz 2023-07-09T02:24:03.994 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34200.log 2023-07-09T02:24:03.994 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37472.log 2023-07-09T02:24:03.995 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34179.log.gz 2023-07-09T02:24:03.995 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53068.log 2023-07-09T02:24:03.996 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34200.log.gz 2023-07-09T02:24:03.996 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37472.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37472.log.gz 2023-07-09T02:24:03.997 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47259.log 2023-07-09T02:24:03.998 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53094.log 2023-07-09T02:24:03.998 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53068.log.gz 2023-07-09T02:24:03.999 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47259.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47259.log.gz 2023-07-09T02:24:03.999 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38235.log 2023-07-09T02:24:04.000 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36693.log 2023-07-09T02:24:04.000 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53094.log.gz 2023-07-09T02:24:04.001 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38235.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38235.log.gz 2023-07-09T02:24:04.001 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2023-07-09T02:24:04.002 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44829.log 2023-07-09T02:24:04.002 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36693.log.gz 2023-07-09T02:24:04.003 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50823.log 2023-07-09T02:24:04.003 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2023-07-09T02:24:04.004 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43325.log 2023-07-09T02:24:04.004 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2023-07-09T02:24:04.005 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50823.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50823.log.gz 2023-07-09T02:24:04.005 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47024.log 2023-07-09T02:24:04.006 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43325.log: gzip -5 --verbose 88.3% -- -- replaced with /var/log/ceph/ceph-client.admin.43325.log.gz 2023-07-09T02:24:04.006 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.49210.log 2023-07-09T02:24:04.007 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40339.log 2023-07-09T02:24:04.007 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47024.log.gz 2023-07-09T02:24:04.008 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49210.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49210.log.gzgzip 2023-07-09T02:24:04.008 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51452.log 2023-07-09T02:24:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49548.log 2023-07-09T02:24:04.009 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40339.log.gz 2023-07-09T02:24:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51452.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51452.log.gz 2023-07-09T02:24:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54628.log 2023-07-09T02:24:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34392.log 2023-07-09T02:24:04.012 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49548.log.gz 2023-07-09T02:24:04.012 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54628.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54628.log.gz 2023-07-09T02:24:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2023-07-09T02:24:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40817.log 2023-07-09T02:24:04.014 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34392.log.gz 2023-07-09T02:24:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44019.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2023-07-09T02:24:04.015 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52376.log 2023-07-09T02:24:04.016 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40817.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-09T02:24:04.016 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40817.log.gz 2023-07-09T02:24:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52376.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52376.log.gz 2023-07-09T02:24:04.017 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43029.log 2023-07-09T02:24:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42531.log 2023-07-09T02:24:04.019 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43029.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43029.log.gz -5 2023-07-09T02:24:04.019 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46373.log 2023-07-09T02:24:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40696.log 2023-07-09T02:24:04.020 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42531.log.gz 2023-07-09T02:24:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46373.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46373.log.gz 2023-07-09T02:24:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42169.log 2023-07-09T02:24:04.022 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42847.log 2023-07-09T02:24:04.023 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40696.log.gz 2023-07-09T02:24:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42169.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42169.log.gz 2023-07-09T02:24:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50482.log 2023-07-09T02:24:04.025 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42847.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42847.log.gz -- 2023-07-09T02:24:04.025 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.52089.log 2023-07-09T02:24:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50482.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50482.log.gz 2023-07-09T02:24:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37498.log 2023-07-09T02:24:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52089.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52089.log.gz 2023-07-09T02:24:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45435.log 2023-07-09T02:24:04.028 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37498.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37498.log.gz /var/log/ceph/ceph-client.admin.52168.log 2023-07-09T02:24:04.029 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:04.030 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45435.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.45435.log.gz 2023-07-09T02:24:04.030 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39014.log 2023-07-09T02:24:04.030 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52168.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2023-07-09T02:24:04.031 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33756.log 2023-07-09T02:24:04.032 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39014.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39014.log.gz -5 2023-07-09T02:24:04.032 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33532.log 2023-07-09T02:24:04.033 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33756.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33756.log.gz 2023-07-09T02:24:04.033 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35978.log 2023-07-09T02:24:04.034 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42292.log 2023-07-09T02:24:04.034 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33532.log.gz 2023-07-09T02:24:04.035 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35978.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35978.log.gz 2023-07-09T02:24:04.036 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44491.log 2023-07-09T02:24:04.037 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49996.log 2023-07-09T02:24:04.037 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42292.log.gz 2023-07-09T02:24:04.038 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44491.log.gz 2023-07-09T02:24:04.038 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35886.log 2023-07-09T02:24:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49996.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49996.log.gz 2023-07-09T02:24:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55123.log 2023-07-09T02:24:04.040 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35886.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35886.log.gz 2023-07-09T02:24:04.040 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52037.log 2023-07-09T02:24:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.55123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42195.log 2023-07-09T02:24:04.041 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55123.log.gz 2023-07-09T02:24:04.042 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52037.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52037.log.gz 2023-07-09T02:24:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39395.log 2023-07-09T02:24:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2023-07-09T02:24:04.044 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42195.log.gz 2023-07-09T02:24:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39395.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39395.log.gz 2023-07-09T02:24:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39473.log 2023-07-09T02:24:04.046 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45039.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2023-07-09T02:24:04.046 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2023-07-09T02:24:04.047 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39473.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39473.log.gz 2023-07-09T02:24:04.047 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50347.log 2023-07-09T02:24:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39066.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2023-07-09T02:24:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33612.log 2023-07-09T02:24:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50347.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50347.log.gz 2023-07-09T02:24:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42407.log 2023-07-09T02:24:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33612.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33612.log.gz 2023-07-09T02:24:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51953.log 2023-07-09T02:24:04.052 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46523.log 2023-07-09T02:24:04.052 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42407.log.gz 2023-07-09T02:24:04.053 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51953.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51953.log.gz 2023-07-09T02:24:04.053 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38074.log 2023-07-09T02:24:04.053 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.46523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46523.log.gz 2023-07-09T02:24:04.054 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47755.log 2023-07-09T02:24:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38074.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38074.log.gz 2023-07-09T02:24:04.055 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54758.log 2023-07-09T02:24:04.056 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47755.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47755.log.gz 2023-07-09T02:24:04.056 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42062.log 2023-07-09T02:24:04.057 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54758.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54758.log.gz 2023-07-09T02:24:04.058 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38827.log 2023-07-09T02:24:04.058 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42062.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42062.log.gz 2023-07-09T02:24:04.059 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50534.log 2023-07-09T02:24:04.059 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38827.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38827.log.gz 2023-07-09T02:24:04.060 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50927.log 2023-07-09T02:24:04.060 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50534.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50534.log.gz 2023-07-09T02:24:04.061 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2023-07-09T02:24:04.062 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50927.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50927.log.gz 2023-07-09T02:24:04.062 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34926.log 2023-07-09T02:24:04.063 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42266.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2023-07-09T02:24:04.063 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54654.log 2023-07-09T02:24:04.064 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34926.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34926.log.gz 2023-07-09T02:24:04.064 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-09T02:24:04.065 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54654.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54654.log.gz 2023-07-09T02:24:04.066 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54862.log 2023-07-09T02:24:04.067 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46920.log 2023-07-09T02:24:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54862.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54862.log.gz 2023-07-09T02:24:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2023-07-09T02:24:04.069 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38365.log 2023-07-09T02:24:04.070 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46920.log.gz 2023-07-09T02:24:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47781.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2023-07-09T02:24:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36849.log 2023-07-09T02:24:04.072 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-09T02:24:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39677.log 2023-07-09T02:24:04.073 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38365.log.gz 2023-07-09T02:24:04.073 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36849.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36849.log.gz 2023-07-09T02:24:04.073 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54114.log 2023-07-09T02:24:04.075 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47155.log 2023-07-09T02:24:04.075 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39677.log.gz 2023-07-09T02:24:04.076 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54114.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54114.log.gz 2023-07-09T02:24:04.076 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37174.log 2023-07-09T02:24:04.077 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50404.log 2023-07-09T02:24:04.078 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47155.log.gz 2023-07-09T02:24:04.079 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37174.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37174.log.gz -5 2023-07-09T02:24:04.079 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50456.log 2023-07-09T02:24:04.080 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50404.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50404.log.gz 2023-07-09T02:24:04.080 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2023-07-09T02:24:04.081 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41013.log 2023-07-09T02:24:04.082 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50456.log.gz 2023-07-09T02:24:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45226.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2023-07-09T02:24:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33506.log 2023-07-09T02:24:04.084 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41013.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41013.log.gz 2023-07-09T02:24:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37410.log 2023-07-09T02:24:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47915.log 2023-07-09T02:24:04.086 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33506.log.gz 2023-07-09T02:24:04.087 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37410.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37410.log.gz 2023-07-09T02:24:04.087 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52953.log 2023-07-09T02:24:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33480.log 2023-07-09T02:24:04.089 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47915.log.gz 2023-07-09T02:24:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52953.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52953.log.gz 2023-07-09T02:24:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34718.log 2023-07-09T02:24:04.092 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52115.log 2023-07-09T02:24:04.092 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33480.log.gz 2023-07-09T02:24:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34718.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34718.log.gz 2023-07-09T02:24:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39237.log 2023-07-09T02:24:04.094 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52115.log.gz 2023-07-09T02:24:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44163.log 2023-07-09T02:24:04.096 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2023-07-09T02:24:04.096 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39237.log.gz 2023-07-09T02:24:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44163.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44163.log.gz 2023-07-09T02:24:04.098 INFO:teuthology.orchestra.run.smithi155.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-09T02:24:04.099 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40882.log 2023-07-09T02:24:04.099 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36298.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2023-07-09T02:24:04.099 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49366.log 2023-07-09T02:24:04.101 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40882.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40882.log.gz 2023-07-09T02:24:04.101 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50024.log 2023-07-09T02:24:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49366.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49366.log.gz 2023-07-09T02:24:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37147.log 2023-07-09T02:24:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49340.log 2023-07-09T02:24:04.105 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37147.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50024.log.gz 2023-07-09T02:24:04.105 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37147.log.gz 2023-07-09T02:24:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37658.log 2023-07-09T02:24:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42979.log 2023-07-09T02:24:04.107 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49340.log.gz 2023-07-09T02:24:04.108 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37658.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37658.log.gz 2023-07-09T02:24:04.108 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52246.log 2023-07-09T02:24:04.109 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38749.log 2023-07-09T02:24:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42979.log: /var/log/ceph/ceph-client.admin.52246.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52246.log.gz 2023-07-09T02:24:04.110 INFO:teuthology.orchestra.run.smithi045.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42979.log.gz 2023-07-09T02:24:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40130.log 2023-07-09T02:24:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38126.log 2023-07-09T02:24:04.112 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38749.log.gz 2023-07-09T02:24:04.113 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40130.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40130.log.gz 2023-07-09T02:24:04.113 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35444.log 2023-07-09T02:24:04.114 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48404.log 2023-07-09T02:24:04.115 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38126.log.gz 2023-07-09T02:24:04.115 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35444.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35444.log.gz 2023-07-09T02:24:04.116 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37330.log 2023-07-09T02:24:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37578.log 2023-07-09T02:24:04.117 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48404.log.gz 2023-07-09T02:24:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37330.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37330.log.gz 2023-07-09T02:24:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40261.log 2023-07-09T02:24:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40469.log 2023-07-09T02:24:04.120 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37578.log.gz 2023-07-09T02:24:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40261.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40261.log.gz 2023-07-09T02:24:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54836.log 2023-07-09T02:24:04.122 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49814.log 2023-07-09T02:24:04.122 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40469.log.gz 2023-07-09T02:24:04.123 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54836.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54836.log.gz 2023-07-09T02:24:04.123 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36797.log 2023-07-09T02:24:04.124 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2023-07-09T02:24:04.125 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49814.log.gz 2023-07-09T02:24:04.125 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36797.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36797.log.gz 2023-07-09T02:24:04.126 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49392.log 2023-07-09T02:24:04.127 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52987.log 2023-07-09T02:24:04.127 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2023-07-09T02:24:04.128 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49392.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49392.log.gz 2023-07-09T02:24:04.129 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47967.log 2023-07-09T02:24:04.130 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2023-07-09T02:24:04.130 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52987.log.gz 2023-07-09T02:24:04.131 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47967.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47967.log.gz 2023-07-09T02:24:04.131 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43716.log 2023-07-09T02:24:04.132 INFO:teuthology.orchestra.run.smithi045.stderr:gzip/var/log/ceph/ceph-client.admin.36428.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42717.log 2023-07-09T02:24:04.133 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43716.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2023-07-09T02:24:04.133 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43716.log.gz 2023-07-09T02:24:04.134 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43164.log 2023-07-09T02:24:04.135 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47363.log 2023-07-09T02:24:04.135 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42717.log.gz 2023-07-09T02:24:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43164.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43164.log.gz 2023-07-09T02:24:04.136 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38418.log 2023-07-09T02:24:04.138 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38652.log 2023-07-09T02:24:04.138 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47363.log.gz 2023-07-09T02:24:04.139 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38418.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38418.log.gz 2023-07-09T02:24:04.139 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 2023-07-09T02:24:04.140 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42609.log 2023-07-09T02:24:04.140 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38652.log.gz 2023-07-09T02:24:04.141 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44189.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2023-07-09T02:24:04.142 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37095.log 2023-07-09T02:24:04.143 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2023-07-09T02:24:04.143 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42609.log.gz 2023-07-09T02:24:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37095.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37095.log.gz 2023-07-09T02:24:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34640.log 2023-07-09T02:24:04.145 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54992.log 2023-07-09T02:24:04.146 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2023-07-09T02:24:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34640.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34640.log.gz 2023-07-09T02:24:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35418.log 2023-07-09T02:24:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37710.log 2023-07-09T02:24:04.148 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54992.log.gz 2023-07-09T02:24:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35418.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35418.log.gz 2023-07-09T02:24:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34614.log 2023-07-09T02:24:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53955.log 2023-07-09T02:24:04.151 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37710.log.gz 2023-07-09T02:24:04.151 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34614.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34614.log.gz 2023-07-09T02:24:04.152 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2023-07-09T02:24:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2023-07-09T02:24:04.153 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53955.log.gz 2023-07-09T02:24:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48378.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2023-07-09T02:24:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42036.log 2023-07-09T02:24:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39758.log 2023-07-09T02:24:04.156 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2023-07-09T02:24:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42036.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42036.log.gz 2023-07-09T02:24:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37630.log 2023-07-09T02:24:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2023-07-09T02:24:04.159 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39758.log.gz 2023-07-09T02:24:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37630.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37630.log.gz 2023-07-09T02:24:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47077.log 2023-07-09T02:24:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2023-07-09T02:24:04.161 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2023-07-09T02:24:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47077.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47077.log.gz 2023-07-09T02:24:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50136.log 2023-07-09T02:24:04.163 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41210.log 2023-07-09T02:24:04.164 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2023-07-09T02:24:04.165 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50136.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50136.log.gz 2023-07-09T02:24:04.165 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35522.log 2023-07-09T02:24:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54966.log 2023-07-09T02:24:04.167 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41210.log.gz 2023-07-09T02:24:04.167 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35522.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35522.log.gz 2023-07-09T02:24:04.168 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2023-07-09T02:24:04.169 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46190.log 2023-07-09T02:24:04.169 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54966.log.gz 2023-07-09T02:24:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2023-07-09T02:24:04.170 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54914.log 2023-07-09T02:24:04.171 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48658.log 2023-07-09T02:24:04.172 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46190.log.gz 2023-07-09T02:24:04.172 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54914.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54914.log.gz 2023-07-09T02:24:04.173 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40752.log 2023-07-09T02:24:04.174 INFO:teuthology.orchestra.run.smithi045.stderr:gzip/var/log/ceph/ceph-client.admin.48658.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33991.log 2023-07-09T02:24:04.174 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48658.log.gz 2023-07-09T02:24:04.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40752.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40752.log.gz 2023-07-09T02:24:04.175 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50875.log 2023-07-09T02:24:04.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48290.log 2023-07-09T02:24:04.177 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33991.log.gz 2023-07-09T02:24:04.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50875.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50875.log.gz 2023-07-09T02:24:04.178 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54375.log 2023-07-09T02:24:04.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40722.log 2023-07-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48290.log.gz 2023-07-09T02:24:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54375.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54375.log.gz 2023-07-09T02:24:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34380.log 2023-07-09T02:24:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52141.log 2023-07-09T02:24:04.182 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40722.log.gz 2023-07-09T02:24:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34380.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2023-07-09T02:24:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50269.log 2023-07-09T02:24:04.184 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41562.log 2023-07-09T02:24:04.185 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52141.log.gz 2023-07-09T02:24:04.185 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50269.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50269.log.gz 2023-07-09T02:24:04.186 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2023-07-09T02:24:04.187 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46475.log 2023-07-09T02:24:04.187 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41562.log.gz 2023-07-09T02:24:04.188 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48762.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2023-07-09T02:24:04.188 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55044.log 2023-07-09T02:24:04.189 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37874.log 2023-07-09T02:24:04.190 INFO:teuthology.orchestra.run.smithi045.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46475.log.gz 2023-07-09T02:24:04.190 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.55044.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55044.log.gz 2023-07-09T02:24:04.191 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37252.log 2023-07-09T02:24:04.192 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50321.log 2023-07-09T02:24:04.192 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37874.log.gz 2023-07-09T02:24:04.193 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37252.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37252.log.gz 2023-07-09T02:24:04.193 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38496.log 2023-07-09T02:24:04.194 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2023-07-09T02:24:04.195 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50321.log.gz 2023-07-09T02:24:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38496.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38496.log.gz 2023-07-09T02:24:04.196 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50508.log 2023-07-09T02:24:04.197 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50561.log 2023-07-09T02:24:04.197 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2023-07-09T02:24:04.198 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50508.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50508.log.gz 2023-07-09T02:24:04.199 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42795.log 2023-07-09T02:24:04.200 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43403.log 2023-07-09T02:24:04.200 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50561.log.gz 2023-07-09T02:24:04.201 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42795.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42795.log.gz 2023-07-09T02:24:04.202 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37964.log 2023-07-09T02:24:04.203 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51582.log 2023-07-09T02:24:04.203 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43403.log.gz 2023-07-09T02:24:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37964.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37964.log.gz 2023-07-09T02:24:04.204 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34978.log 2023-07-09T02:24:04.205 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48950.log 2023-07-09T02:24:04.206 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51582.log.gz 2023-07-09T02:24:04.206 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34978.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34978.log.gz 2023-07-09T02:24:04.207 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41801.log 2023-07-09T02:24:04.208 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46861.log 2023-07-09T02:24:04.208 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48950.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48950.log.gz 2023-07-09T02:24:04.209 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41801.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41801.log.gz 2023-07-09T02:24:04.209 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52636.log 2023-07-09T02:24:04.210 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2023-07-09T02:24:04.211 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46861.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46861.log.gz 2023-07-09T02:24:04.212 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52636.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52636.log.gz 2023-07-09T02:24:04.212 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46138.log 2023-07-09T02:24:04.213 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39289.log 2023-07-09T02:24:04.213 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2023-07-09T02:24:04.214 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46138.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46138.log.gz 2023-07-09T02:24:04.215 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47611.log 2023-07-09T02:24:04.216 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41853.log 2023-07-09T02:24:04.216 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39289.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39289.log.gz 2023-07-09T02:24:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47611.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47611.log.gz 2023-07-09T02:24:04.217 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34666.log 2023-07-09T02:24:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35317.log 2023-07-09T02:24:04.219 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41853.log.gz 2023-07-09T02:24:04.220 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34666.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34666.log.gz 2023-07-09T02:24:04.220 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2023-07-09T02:24:04.221 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.2.35317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43742.log 2023-07-09T02:24:04.221 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35317.log.gz 2023-07-09T02:24:04.222 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33808.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2023-07-09T02:24:04.223 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35365.log 2023-07-09T02:24:04.223 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40156.log 2023-07-09T02:24:04.224 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43742.log.gz 2023-07-09T02:24:04.224 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35365.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35365.log.gz 2023-07-09T02:24:04.225 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34406.log 2023-07-09T02:24:04.226 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48976.log 2023-07-09T02:24:04.226 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40156.log.gz 2023-07-09T02:24:04.227 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34406.log.gz 2023-07-09T02:24:04.228 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2023-07-09T02:24:04.228 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35600.log 2023-07-09T02:24:04.229 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48976.log.gz 2023-07-09T02:24:04.230 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52220.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2023-07-09T02:24:04.230 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37832.log 2023-07-09T02:24:04.231 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2023-07-09T02:24:04.232 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35600.log.gz 2023-07-09T02:24:04.233 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.37832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37832.log.gz 2023-07-09T02:24:04.233 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-09T02:24:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51899.log 2023-07-09T02:24:04.234 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2023-07-09T02:24:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52819.log 2023-07-09T02:24:04.237 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51899.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51899.log.gz 2023-07-09T02:24:04.237 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51400.log 2023-07-09T02:24:04.239 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52819.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52819.log.gz 2023-07-09T02:24:04.239 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43429.log 2023-07-09T02:24:04.241 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48684.log 2023-07-09T02:24:04.241 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51400.log.gz 2023-07-09T02:24:04.242 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43429.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43429.log.gz 2023-07-09T02:24:04.242 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52402.log 2023-07-09T02:24:04.243 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48684.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48684.log.gz 2023-07-09T02:24:04.244 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39637.log 2023-07-09T02:24:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52402.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52402.log.gz 2023-07-09T02:24:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52897.log 2023-07-09T02:24:04.246 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39637.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39637.log.gz 2023-07-09T02:24:04.247 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43560.log 2023-07-09T02:24:04.248 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52897.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52897.log.gz 2023-07-09T02:24:04.248 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38100.log 2023-07-09T02:24:04.249 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43560.log: gzip -5 --verbose 89.4% -- -- replaced with /var/log/ceph/ceph-client.admin.43560.log.gz /var/log/ceph/ceph-client.admin.36030.log 2023-07-09T02:24:04.250 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38100.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38100.log.gz 2023-07-09T02:24:04.251 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43091.log 2023-07-09T02:24:04.253 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36030.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45065.log 2023-07-09T02:24:04.253 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36030.log.gz 2023-07-09T02:24:04.254 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43091.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43091.log.gz 2023-07-09T02:24:04.254 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49970.log 2023-07-09T02:24:04.256 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 2023-07-09T02:24:04.256 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45065.log.gz 2023-07-09T02:24:04.258 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49970.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46972.log 2023-07-09T02:24:04.258 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49970.log.gz 2023-07-09T02:24:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43534.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2023-07-09T02:24:04.260 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45513.log 2023-07-09T02:24:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53597.log 2023-07-09T02:24:04.261 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46972.log.gz 2023-07-09T02:24:04.262 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40365.log 2023-07-09T02:24:04.263 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45513.log.gz 2023-07-09T02:24:04.263 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53597.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53597.log.gz 2023-07-09T02:24:04.265 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44215.log 2023-07-09T02:24:04.266 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40365.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40365.log.gz 2023-07-09T02:24:04.266 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54062.log 2023-07-09T02:24:04.267 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40104.log 2023-07-09T02:24:04.267 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44215.log.gz 2023-07-09T02:24:04.269 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54062.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54062.log.gz 2023-07-09T02:24:04.269 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48736.log 2023-07-09T02:24:04.270 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2023-07-09T02:24:04.270 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40104.log.gz 2023-07-09T02:24:04.272 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53300.log 2023-07-09T02:24:04.272 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48736.log.gz 2023-07-09T02:24:04.273 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36745.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2023-07-09T02:24:04.274 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34194.log 2023-07-09T02:24:04.275 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52506.log 2023-07-09T02:24:04.275 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53300.log.gz 2023-07-09T02:24:04.276 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53146.log 2023-07-09T02:24:04.276 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34194.log.gz 2023-07-09T02:24:04.278 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52506.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52506.log.gz 2023-07-09T02:24:04.278 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43820.log 2023-07-09T02:24:04.279 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2023-07-09T02:24:04.279 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53146.log.gz 2023-07-09T02:24:04.280 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35496.log 2023-07-09T02:24:04.281 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43820.log.gz 2023-07-09T02:24:04.282 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43898.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz 2023-07-09T02:24:04.282 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42635.log 2023-07-09T02:24:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47546.log 2023-07-09T02:24:04.284 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35496.log.gz 2023-07-09T02:24:04.285 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54245.log 2023-07-09T02:24:04.285 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42635.log.gz 2023-07-09T02:24:04.287 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47546.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47546.log.gz 2023-07-09T02:24:04.287 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41506.log 2023-07-09T02:24:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39369.log 2023-07-09T02:24:04.288 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54245.log.gz 2023-07-09T02:24:04.290 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2023-07-09T02:24:04.290 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41506.log.gz 2023-07-09T02:24:04.291 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39369.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39369.log.gz -5 2023-07-09T02:24:04.291 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52350.log 2023-07-09T02:24:04.293 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44774.log 2023-07-09T02:24:04.293 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz 2023-07-09T02:24:04.294 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53120.log 2023-07-09T02:24:04.294 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52350.log.gz 2023-07-09T02:24:04.296 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44774.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44774.log.gz 2023-07-09T02:24:04.296 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36875.log 2023-07-09T02:24:04.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2023-07-09T02:24:04.298 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53120.log.gz 2023-07-09T02:24:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38261.log 2023-07-09T02:24:04.299 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36875.log.gz 2023-07-09T02:24:04.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45617.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2023-07-09T02:24:04.301 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45357.log 2023-07-09T02:24:04.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45143.log 2023-07-09T02:24:04.303 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38261.log.gz 2023-07-09T02:24:04.304 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45357.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34822.log 2023-07-09T02:24:04.304 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45357.log.gz 2023-07-09T02:24:04.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45143.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45143.log.gz 2023-07-09T02:24:04.305 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45278.log 2023-07-09T02:24:04.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48151.log 2023-07-09T02:24:04.307 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34822.log.gz 2023-07-09T02:24:04.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45278.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45278.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43117.log 2023-07-09T02:24:04.308 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:04.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51426.log 2023-07-09T02:24:04.310 INFO:teuthology.orchestra.run.smithi045.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48151.log.gz 2023-07-09T02:24:04.311 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2023-07-09T02:24:04.312 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43117.log.gz 2023-07-09T02:24:04.312 INFO:teuthology.orchestra.run.smithi155.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-09T02:24:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51426.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51426.log.gz 2023-07-09T02:24:04.313 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39967.log 2023-07-09T02:24:04.315 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33558.log 2023-07-09T02:24:04.315 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2023-07-09T02:24:04.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37278.log 2023-07-09T02:24:04.316 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39967.log.gz 2023-07-09T02:24:04.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33558.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33558.log.gz 2023-07-09T02:24:04.318 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39317.log 2023-07-09T02:24:04.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33990.log 2023-07-09T02:24:04.320 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37278.log.gz 2023-07-09T02:24:04.321 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39317.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-09T02:24:04.321 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39317.log.gz 2023-07-09T02:24:04.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33990.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.33990.log.gz --verbose 2023-07-09T02:24:04.322 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.50162.log 2023-07-09T02:24:04.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53511.log 2023-07-09T02:24:04.325 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50162.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50162.log.gz 2023-07-09T02:24:04.326 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35030.log 2023-07-09T02:24:04.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53511.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53511.log.gz 2023-07-09T02:24:04.328 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36615.log 2023-07-09T02:24:04.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35030.log: gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35030.log.gz 2023-07-09T02:24:04.329 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.44543.log 2023-07-09T02:24:04.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36615.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36615.log.gz 2023-07-09T02:24:04.331 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44803.log 2023-07-09T02:24:04.332 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44543.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44543.log.gz 2023-07-09T02:24:04.333 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51005.log 2023-07-09T02:24:04.334 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44803.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44803.log.gz 2023-07-09T02:24:04.335 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2023-07-09T02:24:04.336 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51005.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51005.log.gz 2023-07-09T02:24:04.337 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40234.log 2023-07-09T02:24:04.338 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34588.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2023-07-09T02:24:04.338 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38548.log 2023-07-09T02:24:04.340 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40234.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40234.log.gz 2023-07-09T02:24:04.340 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49158.log 2023-07-09T02:24:04.341 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38548.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38548.log.gz 2023-07-09T02:24:04.342 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41958.log 2023-07-09T02:24:04.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49158.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49158.log.gz 2023-07-09T02:24:04.344 INFO:teuthology.orchestra.run.smithi155.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-09T02:24:04.344 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45252.log 2023-07-09T02:24:04.345 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41958.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41958.log.gz 2023-07-09T02:24:04.346 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37848.log 2023-07-09T02:24:04.347 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45252.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45252.log.gz 2023-07-09T02:24:04.348 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2023-07-09T02:24:04.349 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37848.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37848.log.gz 2023-07-09T02:24:04.350 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47337.log 2023-07-09T02:24:04.351 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48073.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2023-07-09T02:24:04.352 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53224.log 2023-07-09T02:24:04.353 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47337.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47337.log.gz 2023-07-09T02:24:04.354 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32965.log 2023-07-09T02:24:04.355 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53224.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53224.log.gz 2023-07-09T02:24:04.356 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46809.log 2023-07-09T02:24:04.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.32965.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32965.log.gz 2023-07-09T02:24:04.357 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48569.log 2023-07-09T02:24:04.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46809.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46809.log.gz 2023-07-09T02:24:04.360 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39447.log 2023-07-09T02:24:04.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48569.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48569.log.gz 2023-07-09T02:24:04.361 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2023-07-09T02:24:04.362 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39447.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39447.log.gz 2023-07-09T02:24:04.363 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39549.log 2023-07-09T02:24:04.364 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43455.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gz 2023-07-09T02:24:04.365 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54498.log 2023-07-09T02:24:04.366 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39549.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39549.log.gz 2023-07-09T02:24:04.367 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38917.log 2023-07-09T02:24:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54498.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54498.log.gz 2023-07-09T02:24:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40961.log 2023-07-09T02:24:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38917.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38917.log.gz 2023-07-09T02:24:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46320.log 2023-07-09T02:24:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40961.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40961.log.gz 2023-07-09T02:24:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2023-07-09T02:24:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46320.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46320.log.gz 2023-07-09T02:24:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33427.log 2023-07-09T02:24:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33676.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz 2023-07-09T02:24:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2023-07-09T02:24:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33427.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33427.log.gz 2023-07-09T02:24:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39173.log 2023-07-09T02:24:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35912.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gz 2023-07-09T02:24:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39499.log 2023-07-09T02:24:04.381 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39173.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39173.log.gz 2023-07-09T02:24:04.383 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54323.log 2023-07-09T02:24:04.384 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53846.log 91.4% -- replaced with /var/log/ceph/ceph-client.admin.39499.log.gz 2023-07-09T02:24:04.385 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54323.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54323.log.gz 2023-07-09T02:24:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48316.log 2023-07-09T02:24:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53846.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53846.log.gz 2023-07-09T02:24:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49627.log 2023-07-09T02:24:04.390 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48316.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48316.log.gz 2023-07-09T02:24:04.390 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46757.log 2023-07-09T02:24:04.391 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49627.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49627.log.gz 2023-07-09T02:24:04.392 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50691.log 2023-07-09T02:24:04.393 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46757.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46757.log.gz 2023-07-09T02:24:04.394 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43690.log 2023-07-09T02:24:04.395 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36563.log 2023-07-09T02:24:04.396 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50691.log.gz 2023-07-09T02:24:04.396 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43690.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43690.log.gz 2023-07-09T02:24:04.397 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35704.log 2023-07-09T02:24:04.398 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36563.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36563.log.gz 2023-07-09T02:24:04.399 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41464.log 2023-07-09T02:24:04.401 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35704.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41288.log 2023-07-09T02:24:04.401 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35704.log.gz 2023-07-09T02:24:04.402 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.41464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41464.log.gz 2023-07-09T02:24:04.402 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2023-07-09T02:24:04.404 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41288.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44243.log 2023-07-09T02:24:04.404 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41288.log.gz 2023-07-09T02:24:04.404 INFO:teuthology.orchestra.run.smithi155.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-09T02:24:04.405 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45383.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36139.log 2023-07-09T02:24:04.406 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gz 2023-07-09T02:24:04.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44243.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44243.log.gzgzip 2023-07-09T02:24:04.407 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46565.log 2023-07-09T02:24:04.409 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 2023-07-09T02:24:04.410 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46565.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36139.log.gz 2023-07-09T02:24:04.410 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52480.log 2023-07-09T02:24:04.410 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46565.log.gz 2023-07-09T02:24:04.411 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48433.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2023-07-09T02:24:04.413 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51240.log 2023-07-09T02:24:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54271.log 2023-07-09T02:24:04.415 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52480.log.gz 2023-07-09T02:24:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51873.log 2023-07-09T02:24:04.416 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51240.log.gz 2023-07-09T02:24:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37786.log 2023-07-09T02:24:04.418 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54271.log.gz 2023-07-09T02:24:04.419 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42240.log 2023-07-09T02:24:04.419 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz 2023-07-09T02:24:04.420 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37786.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37786.log.gz 2023-07-09T02:24:04.421 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34900.log 2023-07-09T02:24:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36243.log 2023-07-09T02:24:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34900.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42240.log.gz 2023-07-09T02:24:04.424 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34900.log.gzgzip 2023-07-09T02:24:04.424 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46110.log 2023-07-09T02:24:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34407.log 2023-07-09T02:24:04.426 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36243.log.gz 2023-07-09T02:24:04.427 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46110.log: gzip -5 --verbose 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46110.log.gz 2023-07-09T02:24:04.427 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.42769.log 2023-07-09T02:24:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34407.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34407.log.gz 2023-07-09T02:24:04.429 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43377.log 2023-07-09T02:24:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2023-07-09T02:24:04.430 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42769.log.gz 2023-07-09T02:24:04.432 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43377.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2023-07-09T02:24:04.432 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43377.log.gz 2023-07-09T02:24:04.433 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46004.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39201.log 2023-07-09T02:24:04.433 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2023-07-09T02:24:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49483.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz 2023-07-09T02:24:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33860.log 2023-07-09T02:24:04.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45821.log 2023-07-09T02:24:04.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33860.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39201.log.gz 2023-07-09T02:24:04.438 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54940.log 2023-07-09T02:24:04.438 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33860.log.gz 2023-07-09T02:24:04.440 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43987.log 2023-07-09T02:24:04.440 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2023-07-09T02:24:04.441 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54940.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54940.log.gz 2023-07-09T02:24:04.441 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41614.log 2023-07-09T02:24:04.442 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43987.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43987.log.gz 2023-07-09T02:24:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52871.log 2023-07-09T02:24:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41614.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.41614.log.gz --verbose 2023-07-09T02:24:04.444 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.46268.log 2023-07-09T02:24:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52871.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52871.log.gz 2023-07-09T02:24:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52272.log 2023-07-09T02:24:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46268.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46268.log.gz -5 2023-07-09T02:24:04.448 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51504.log 2023-07-09T02:24:04.449 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52272.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45091.log 2023-07-09T02:24:04.449 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52272.log.gz 2023-07-09T02:24:04.450 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51504.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51504.log.gz 2023-07-09T02:24:04.451 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49262.log 2023-07-09T02:24:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45091.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45091.log.gz 2023-07-09T02:24:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53418.log 2023-07-09T02:24:04.454 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49262.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42344.log 2023-07-09T02:24:04.454 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49262.log.gz 2023-07-09T02:24:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53418.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53418.log.gz 2023-07-09T02:24:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41480.log 2023-07-09T02:24:04.457 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33992.log 2023-07-09T02:24:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41480.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2023-07-09T02:24:04.459 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42583.log 2023-07-09T02:24:04.459 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41480.log.gz 2023-07-09T02:24:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36350.log 2023-07-09T02:24:04.460 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33992.log.gz 2023-07-09T02:24:04.461 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42583.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50587.log 2023-07-09T02:24:04.462 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42583.log.gz 2023-07-09T02:24:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36350.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36350.log.gz 2023-07-09T02:24:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44359.log 2023-07-09T02:24:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48923.log 2023-07-09T02:24:04.466 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44359.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50587.log.gz 2023-07-09T02:24:04.466 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54576.log 2023-07-09T02:24:04.466 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2023-07-09T02:24:04.467 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48923.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48923.log.gz 2023-07-09T02:24:04.468 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-09T02:24:04.470 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2023-07-09T02:24:04.470 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54576.log.gz 2023-07-09T02:24:04.471 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52454.log 2023-07-09T02:24:04.473 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47519.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33702.log 2023-07-09T02:24:04.473 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2023-07-09T02:24:04.474 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-09T02:24:04.474 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40495.log 2023-07-09T02:24:04.475 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8%/var/log/ceph/ceph-client.admin.33702.log: -- replaced with /var/log/ceph/ceph-client.admin.52454.log.gz 2023-07-09T02:24:04.476 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33702.log.gz 2023-07-09T02:24:04.477 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2023-07-09T02:24:04.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40495.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40495.log.gz 2023-07-09T02:24:04.478 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40908.log 2023-07-09T02:24:04.480 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33977.log 2023-07-09T02:24:04.480 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2023-07-09T02:24:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40908.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40908.log.gz 2023-07-09T02:24:04.481 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35004.log 2023-07-09T02:24:04.482 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33977.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33977.log.gz 2023-07-09T02:24:04.483 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52298.log 2023-07-09T02:24:04.484 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35004.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35004.log.gz -5 2023-07-09T02:24:04.485 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54193.log 2023-07-09T02:24:04.486 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52298.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52298.log.gz 2023-07-09T02:24:04.486 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53172.log 2023-07-09T02:24:04.487 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54193.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.54193.log.gz --verbose 2023-07-09T02:24:04.488 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.42318.log 2023-07-09T02:24:04.489 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53172.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53172.log.gz -5 2023-07-09T02:24:04.489 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53014.log 2023-07-09T02:24:04.490 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42318.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42318.log.gz 2023-07-09T02:24:04.491 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2023-07-09T02:24:04.492 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49574.log 2023-07-09T02:24:04.492 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53014.log.gz 2023-07-09T02:24:04.493 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47493.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54033.log 2023-07-09T02:24:04.494 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2023-07-09T02:24:04.495 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51772.log 2023-07-09T02:24:04.495 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49574.log.gz 2023-07-09T02:24:04.497 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52532.log 2023-07-09T02:24:04.497 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51772.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54033.log.gz 2023-07-09T02:24:04.498 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51746.log 2023-07-09T02:24:04.498 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51772.log.gz 2023-07-09T02:24:04.500 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52532.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52532.log.gz 2023-07-09T02:24:04.500 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52011.log 2023-07-09T02:24:04.501 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51746.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.51746.log.gz --verbose 2023-07-09T02:24:04.501 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.48595.log 2023-07-09T02:24:04.503 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52558.log 2023-07-09T02:24:04.503 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52011.log.gz 2023-07-09T02:24:04.504 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48595.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48595.log.gz 2023-07-09T02:24:04.505 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37938.log 2023-07-09T02:24:04.506 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52558.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51556.log 2023-07-09T02:24:04.506 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52558.log.gz 2023-07-09T02:24:04.507 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44973.log 2023-07-09T02:24:04.507 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37938.log.gz 2023-07-09T02:24:04.509 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46651.log 2023-07-09T02:24:04.510 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44973.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51556.log.gz 2023-07-09T02:24:04.511 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2023-07-09T02:24:04.511 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44973.log.gz 2023-07-09T02:24:04.512 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46651.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46651.log.gz 2023-07-09T02:24:04.513 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45591.log 2023-07-09T02:24:04.514 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47467.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47103.log 2023-07-09T02:24:04.514 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz 2023-07-09T02:24:04.515 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38470.log 2023-07-09T02:24:04.515 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45591.log.gz 2023-07-09T02:24:04.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39941.log 2023-07-09T02:24:04.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38470.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47103.log.gz 2023-07-09T02:24:04.518 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36771.log 2023-07-09T02:24:04.519 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38470.log.gz 2023-07-09T02:24:04.520 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2023-07-09T02:24:04.520 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39941.log.gz 2023-07-09T02:24:04.522 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36771.log: gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36771.log.gz /var/log/ceph/ceph-client.admin.45409.log 2023-07-09T02:24:04.522 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:04.523 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45743.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47233.log 2023-07-09T02:24:04.523 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2023-07-09T02:24:04.524 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41775.log 2023-07-09T02:24:04.525 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2023-07-09T02:24:04.526 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2023-07-09T02:24:04.527 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47233.log: /var/log/ceph/ceph-client.admin.41775.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47233.log.gz 2023-07-09T02:24:04.528 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50979.log 2023-07-09T02:24:04.528 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41775.log.gz 2023-07-09T02:24:04.530 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50188.log 2023-07-09T02:24:04.530 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2023-07-09T02:24:04.531 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50979.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50979.log.gz 2023-07-09T02:24:04.531 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36402.log 2023-07-09T02:24:04.533 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50188.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34198.log 2023-07-09T02:24:04.533 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50188.log.gz 2023-07-09T02:24:04.535 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47311.log 2023-07-09T02:24:04.535 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36402.log.gz 2023-07-09T02:24:04.536 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41156.log 2023-07-09T02:24:04.537 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47311.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34198.log.gz 2023-07-09T02:24:04.537 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38392.log 2023-07-09T02:24:04.537 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47311.log.gz 2023-07-09T02:24:04.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41156.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41156.log.gz 2023-07-09T02:24:04.539 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41749.log 2023-07-09T02:24:04.540 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38392.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38392.log.gz 2023-07-09T02:24:04.541 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47207.log 2023-07-09T02:24:04.543 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54088.log 2023-07-09T02:24:04.543 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41749.log.gz 2023-07-09T02:24:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50430.log 2023-07-09T02:24:04.544 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47207.log.gz 2023-07-09T02:24:04.545 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42743.log 2023-07-09T02:24:04.546 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50430.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54088.log.gz 2023-07-09T02:24:04.547 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36537.log 2023-07-09T02:24:04.547 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50430.log.gz 2023-07-09T02:24:04.548 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42743.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41042.log 2023-07-09T02:24:04.549 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42743.log.gz 2023-07-09T02:24:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36537.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36537.log.gz 2023-07-09T02:24:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34874.log 2023-07-09T02:24:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38949.log 2023-07-09T02:24:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34874.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41042.log.gz 2023-07-09T02:24:04.553 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43294.log 2023-07-09T02:24:04.554 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34874.log.gz 2023-07-09T02:24:04.555 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38949.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43794.log 2023-07-09T02:24:04.555 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38949.log.gz 2023-07-09T02:24:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47129.log 2023-07-09T02:24:04.557 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43294.log.gz 2023-07-09T02:24:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44748.log 2023-07-09T02:24:04.559 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43794.log.gz/var/log/ceph/ceph-client.admin.47129.log: 2023-07-09T02:24:04.560 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50745.log 2023-07-09T02:24:04.560 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47129.log.gz 2023-07-09T02:24:04.561 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44748.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53482.log 2023-07-09T02:24:04.561 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44748.log.gz 2023-07-09T02:24:04.562 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33834.log 2023-07-09T02:24:04.563 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50745.log.gz 2023-07-09T02:24:04.564 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2023-07-09T02:24:04.565 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33834.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53482.log.gz 2023-07-09T02:24:04.566 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38024.log 2023-07-09T02:24:04.566 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33834.log.gz 2023-07-09T02:24:04.567 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34408.log 2023-07-09T02:24:04.568 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2023-07-09T02:24:04.569 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39263.log 2023-07-09T02:24:04.569 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38024.log.gz 2023-07-09T02:24:04.571 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34408.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32523.log 2023-07-09T02:24:04.571 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34408.log.gz 2023-07-09T02:24:04.572 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39263.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39263.log.gz 2023-07-09T02:24:04.572 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36217.log 2023-07-09T02:24:04.573 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.tmp-client.admin.32523.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32523.log.gz 2023-07-09T02:24:04.574 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34199.log 2023-07-09T02:24:04.575 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36217.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35782.log 2023-07-09T02:24:04.575 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36217.log.gz 2023-07-09T02:24:04.577 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40443.log 2023-07-09T02:24:04.577 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34199.log.gz 2023-07-09T02:24:04.579 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33728.log 2023-07-09T02:24:04.581 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40443.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35782.log.gz 2023-07-09T02:24:04.581 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40443.log.gz 2023-07-09T02:24:04.581 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35235.log 2023-07-09T02:24:04.582 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33728.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33728.log.gz 2023-07-09T02:24:04.582 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53742.log 2023-07-09T02:24:04.584 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51730.log 2023-07-09T02:24:04.584 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35235.log.gz 2023-07-09T02:24:04.585 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53742.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45331.log 2023-07-09T02:24:04.585 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53742.log.gz 2023-07-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.51730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51730.log.gz 2023-07-09T02:24:04.586 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52925.log 2023-07-09T02:24:04.588 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43664.log 2023-07-09T02:24:04.589 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45331.log: /var/log/ceph/ceph-client.admin.52925.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2023-07-09T02:24:04.590 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39040.log 2023-07-09T02:24:04.590 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52925.log.gz 2023-07-09T02:24:04.591 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43664.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43664.log.gz 2023-07-09T02:24:04.591 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53903.log 2023-07-09T02:24:04.593 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39040.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45539.log 2023-07-09T02:24:04.593 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39040.log.gz 2023-07-09T02:24:04.594 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53903.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.36056.log -- replaced with /var/log/ceph/ceph-client.admin.53903.log.gz 2023-07-09T02:24:04.595 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2023-07-09T02:24:04.596 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45539.log.gz 2023-07-09T02:24:04.597 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36056.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36056.log.gz 2023-07-09T02:24:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50665.log 2023-07-09T02:24:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38204.log 2023-07-09T02:24:04.599 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2023-07-09T02:24:04.601 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49236.log 2023-07-09T02:24:04.601 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50665.log.gz 2023-07-09T02:24:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38204.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51608.log 2023-07-09T02:24:04.602 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38204.log.gz 2023-07-09T02:24:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49236.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49236.log.gz 2023-07-09T02:24:04.604 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2023-07-09T02:24:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50771.log 2023-07-09T02:24:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35090.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51608.log.gz 2023-07-09T02:24:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33886.log 2023-07-09T02:24:04.607 INFO:teuthology.orchestra.run.smithi045.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2023-07-09T02:24:04.609 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50771.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50771.log.gz 2023-07-09T02:24:04.609 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50613.log 2023-07-09T02:24:04.611 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2023-07-09T02:24:04.611 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50613.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33886.log.gz 2023-07-09T02:24:04.612 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50613.log.gz 2023-07-09T02:24:04.612 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36589.log 2023-07-09T02:24:04.614 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41880.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52793.log 2023-07-09T02:24:04.614 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 2023-07-09T02:24:04.615 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35574.log 2023-07-09T02:24:04.615 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36589.log.gz 2023-07-09T02:24:04.617 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47941.log 2023-07-09T02:24:04.618 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35574.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52793.log.gz 2023-07-09T02:24:04.618 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46399.log 2023-07-09T02:24:04.618 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35574.log.gz 2023-07-09T02:24:04.620 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2023-07-09T02:24:04.620 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47941.log.gz 2023-07-09T02:24:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46399.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43190.log 2023-07-09T02:24:04.622 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46399.log.gz 2023-07-09T02:24:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37304.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2023-07-09T02:24:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2023-07-09T02:24:04.624 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35834.log 2023-07-09T02:24:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43190.log: /var/log/ceph/ceph-client.admin.48845.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43190.log.gz 2023-07-09T02:24:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51266.log 2023-07-09T02:24:04.627 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2023-07-09T02:24:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2023-07-09T02:24:04.628 INFO:teuthology.orchestra.run.smithi045.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35834.log.gz 2023-07-09T02:24:04.629 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43872.log 2023-07-09T02:24:04.630 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51266.log.gz 2023-07-09T02:24:04.631 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45304.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36927.log 2023-07-09T02:24:04.631 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2023-07-09T02:24:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43872.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.43872.log.gz -5 2023-07-09T02:24:04.632 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39421.log 2023-07-09T02:24:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36972.log 2023-07-09T02:24:04.634 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36927.log.gz 2023-07-09T02:24:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53649.log 2023-07-09T02:24:04.636 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39421.log.gz 2023-07-09T02:24:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36972.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36972.log.gz 2023-07-09T02:24:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53537.log 2023-07-09T02:24:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49106.log 2023-07-09T02:24:04.639 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53649.log.gz 2023-07-09T02:24:04.640 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53537.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36998.log 2023-07-09T02:24:04.641 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53537.log.gz 2023-07-09T02:24:04.642 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34401.log 2023-07-09T02:24:04.642 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49106.log.gz 2023-07-09T02:24:04.644 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36998.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54680.log 2023-07-09T02:24:04.644 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36998.log.gz 2023-07-09T02:24:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46711.log 2023-07-09T02:24:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34401.log.gz 2023-07-09T02:24:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34952.log 2023-07-09T02:24:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46711.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54680.log.gz 2023-07-09T02:24:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2023-07-09T02:24:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46711.log.gz 2023-07-09T02:24:04.650 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2023-07-09T02:24:04.650 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34952.log.gz 2023-07-09T02:24:04.651 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42088.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42439.log 2023-07-09T02:24:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2023-07-09T02:24:04.653 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43612.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz -5 2023-07-09T02:24:04.653 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2023-07-09T02:24:04.654 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49944.log 2023-07-09T02:24:04.655 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.audit.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42439.log.gz 2023-07-09T02:24:04.656 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48125.log 2023-07-09T02:24:04.657 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49944.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49944.log.gz 2023-07-09T02:24:04.659 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-09T02:24:04.660 INFO:teuthology.orchestra.run.smithi045.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-09T02:24:04.661 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48125.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48125.log.gz 2023-07-09T02:24:04.661 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46425.log 2023-07-09T02:24:04.662 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2023-07-09T02:24:04.664 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48489.log 2023-07-09T02:24:04.665 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44387.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46425.log.gz 2023-07-09T02:24:04.666 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2023-07-09T02:24:04.669 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37030.log 2023-07-09T02:24:04.670 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49892.log 2023-07-09T02:24:04.671 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48489.log: /var/log/ceph/ceph-client.admin.37030.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48489.log.gz 2023-07-09T02:24:04.672 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37030.log.gz 2023-07-09T02:24:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41130.log 2023-07-09T02:24:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43638.log 2023-07-09T02:24:04.675 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41130.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49892.log.gz 2023-07-09T02:24:04.676 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41130.log.gz 2023-07-09T02:24:04.677 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-09T02:24:04.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36165.log 2023-07-09T02:24:04.679 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.a.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43638.log.gz 2023-07-09T02:24:04.681 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44707.log 2023-07-09T02:24:04.683 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36165.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36165.log.gz 2023-07-09T02:24:04.685 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53571.log 2023-07-09T02:24:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44707.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44707.log.gz 2023-07-09T02:24:04.689 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44271.log 2023-07-09T02:24:04.691 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53571.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53571.log.gz 2023-07-09T02:24:04.693 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36082.log 2023-07-09T02:24:04.695 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44271.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44271.log.gz 2023-07-09T02:24:04.696 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2023-07-09T02:24:04.698 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36082.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36082.log.gz 2023-07-09T02:24:04.700 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50120.log 2023-07-09T02:24:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36269.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz 2023-07-09T02:24:04.704 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38152.log 2023-07-09T02:24:04.705 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.50120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50120.log.gz 2023-07-09T02:24:04.707 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41692.log 2023-07-09T02:24:04.709 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38152.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38152.log.gz 2023-07-09T02:24:04.711 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39993.log 2023-07-09T02:24:04.713 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41692.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41692.log.gz 2023-07-09T02:24:04.715 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53981.log 2023-07-09T02:24:04.717 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39993.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39993.log.gz 2023-07-09T02:24:04.718 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48352.log 2023-07-09T02:24:04.720 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53981.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53981.log.gz 2023-07-09T02:24:04.722 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53820.log 2023-07-09T02:24:04.724 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48352.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2023-07-09T02:24:04.726 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33980.log 2023-07-09T02:24:04.728 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53820.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53820.log.gz 2023-07-09T02:24:04.730 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51320.log 2023-07-09T02:24:04.732 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33980.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33980.log.gz 2023-07-09T02:24:04.734 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36823.log 2023-07-09T02:24:04.735 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51320.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51320.log.gz 2023-07-09T02:24:04.737 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49002.log 2023-07-09T02:24:04.739 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36823.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36823.log.gz 2023-07-09T02:24:04.741 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40618.log 2023-07-09T02:24:04.743 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49002.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49002.log.gz 2023-07-09T02:24:04.745 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46946.log 2023-07-09T02:24:04.747 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40618.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40618.log.gz 2023-07-09T02:24:04.749 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41418.log 2023-07-09T02:24:04.751 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46946.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46946.log.gz 2023-07-09T02:24:04.753 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2023-07-09T02:24:04.756 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41418.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41418.log.gz 2023-07-09T02:24:04.757 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45769.log 2023-07-09T02:24:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51348.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2023-07-09T02:24:04.761 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54784.log 2023-07-09T02:24:04.763 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45769.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45769.log.gz 2023-07-09T02:24:04.765 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37200.log 2023-07-09T02:24:04.767 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54784.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54784.log.gz 2023-07-09T02:24:04.769 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33985.log 2023-07-09T02:24:04.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37200.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37200.log.gz 2023-07-09T02:24:04.772 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33336.log 2023-07-09T02:24:04.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33985.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33985.log.gz 2023-07-09T02:24:04.776 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41070.log 2023-07-09T02:24:04.778 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33336.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33336.log.gz 2023-07-09T02:24:04.780 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51530.log 2023-07-09T02:24:04.782 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41070.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41070.log.gz 2023-07-09T02:24:04.784 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42557.log 2023-07-09T02:24:04.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51530.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51530.log.gz 2023-07-09T02:24:04.786 INFO:teuthology.orchestra.run.smithi155.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-09T02:24:04.788 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47995.log 2023-07-09T02:24:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42557.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42557.log.gz 2023-07-09T02:24:04.792 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44084.log 2023-07-09T02:24:04.794 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47995.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47995.log.gz 2023-07-09T02:24:04.796 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45174.log 2023-07-09T02:24:04.797 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44084.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44084.log.gz 2023-07-09T02:24:04.799 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40045.log 2023-07-09T02:24:04.802 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45174.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45174.log.gz 2023-07-09T02:24:04.804 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45854.log 2023-07-09T02:24:04.805 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40045.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40045.log.gz 2023-07-09T02:24:04.807 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35808.log 2023-07-09T02:24:04.809 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45854.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45854.log.gz 2023-07-09T02:24:04.811 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2023-07-09T02:24:04.813 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35808.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35808.log.gz 2023-07-09T02:24:04.814 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49918.log 2023-07-09T02:24:04.815 INFO:teuthology.orchestra.run.smithi155.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-09T02:24:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54888.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2023-07-09T02:24:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50373.log 2023-07-09T02:24:04.820 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49918.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49918.log.gz 2023-07-09T02:24:04.822 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35205.log 2023-07-09T02:24:04.824 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50373.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50373.log.gz 2023-07-09T02:24:04.826 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44305.log 2023-07-09T02:24:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.35205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35205.log.gz 2023-07-09T02:24:04.829 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48632.log 2023-07-09T02:24:04.831 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44305.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44305.log.gz 2023-07-09T02:24:04.832 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33912.log 2023-07-09T02:24:04.834 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48632.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48632.log.gz 2023-07-09T02:24:04.836 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36667.log 2023-07-09T02:24:04.838 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33912.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33912.log.gz 2023-07-09T02:24:04.840 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39795.log 2023-07-09T02:24:04.841 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36667.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36667.log.gz 2023-07-09T02:24:04.844 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45013.log 2023-07-09T02:24:04.846 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39795.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39795.log.gz 2023-07-09T02:24:04.847 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50719.log 2023-07-09T02:24:04.849 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45013.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45013.log.gz 2023-07-09T02:24:04.851 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54140.log 2023-07-09T02:24:04.853 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50719.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50719.log.gz 2023-07-09T02:24:04.855 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2023-07-09T02:24:04.857 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54140.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54140.log.gz 2023-07-09T02:24:04.859 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49132.log 2023-07-09T02:24:04.861 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50639.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2023-07-09T02:24:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49736.log 2023-07-09T02:24:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49132.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49132.log.gz 2023-07-09T02:24:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47889.log 2023-07-09T02:24:04.868 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-09T02:24:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49736.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49736.log.gz 2023-07-09T02:24:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53794.log 2023-07-09T02:24:04.871 INFO:teuthology.orchestra.run.smithi045.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-09T02:24:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36004.log 2023-07-09T02:24:04.873 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47889.log.gz 2023-07-09T02:24:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53794.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53794.log.gz 2023-07-09T02:24:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44619.log 2023-07-09T02:24:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52194.log 2023-07-09T02:24:04.877 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36004.log.gz 2023-07-09T02:24:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36191.log 2023-07-09T02:24:04.879 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52194.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44619.log.gz 2023-07-09T02:24:04.880 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52194.log.gz 2023-07-09T02:24:04.881 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33984.log 2023-07-09T02:24:04.883 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44569.log 2023-07-09T02:24:04.883 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33984.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36191.log.gz 2023-07-09T02:24:04.884 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33984.log.gz 2023-07-09T02:24:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49028.log 2023-07-09T02:24:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39703.log 2023-07-09T02:24:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49028.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44569.log.gz 2023-07-09T02:24:04.889 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49028.log.gz 2023-07-09T02:24:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51847.log 2023-07-09T02:24:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43846.log 2023-07-09T02:24:04.892 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39703.log: /var/log/ceph/ceph-client.admin.51847.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39703.log.gz 2023-07-09T02:24:04.893 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51847.log.gz 2023-07-09T02:24:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43586.log 2023-07-09T02:24:04.894 INFO:teuthology.orchestra.run.smithi045.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-09T02:24:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54420.log 2023-07-09T02:24:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43586.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43846.log.gz 2023-07-09T02:24:04.897 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45886.log 2023-07-09T02:24:04.898 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43586.log.gz 2023-07-09T02:24:04.899 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54420.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35652.log 2023-07-09T02:24:04.899 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54420.log.gz 2023-07-09T02:24:04.899 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-09T02:24:04.900 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45886.log: gzip -5 --verbose -- 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45886.log.gz /var/log/ceph/ceph-client.admin.45688.log 2023-07-09T02:24:04.900 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:04.902 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41588.log 2023-07-09T02:24:04.904 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35652.log.gz 2023-07-09T02:24:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37684.log 2023-07-09T02:24:04.904 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45688.log.gz 2023-07-09T02:24:04.905 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-07-09T02:24:04.905 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m1.049s 2023-07-09T02:24:04.905 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m4.934s 2023-07-09T02:24:04.906 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.486s 2023-07-09T02:24:04.908 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41588.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52428.log 2023-07-09T02:24:04.909 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41588.log.gz 2023-07-09T02:24:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37684.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38854.log 2023-07-09T02:24:04.909 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37684.log.gz 2023-07-09T02:24:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52428.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45717.log 2023-07-09T02:24:04.910 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52428.log.gz 2023-07-09T02:24:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38854.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38854.log.gz -5 2023-07-09T02:24:04.911 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40417.log 2023-07-09T02:24:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45717.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45717.log.gz 2023-07-09T02:24:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38626.log 2023-07-09T02:24:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40417.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40417.log.gz 2023-07-09T02:24:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36459.log 2023-07-09T02:24:04.915 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38626.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42505.log 2023-07-09T02:24:04.916 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38626.log.gz 2023-07-09T02:24:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38775.log 2023-07-09T02:24:04.917 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36459.log.gz 2023-07-09T02:24:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37356.log 2023-07-09T02:24:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38775.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42505.log.gz 2023-07-09T02:24:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.38775.log.gz --verbose 2023-07-09T02:24:04.920 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.41827.log 2023-07-09T02:24:04.921 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43075.log 2023-07-09T02:24:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41827.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37356.log.gz 2023-07-09T02:24:04.923 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46056.log 2023-07-09T02:24:04.923 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2023-07-09T02:24:04.924 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.43075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43075.log.gz 2023-07-09T02:24:04.925 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48515.log 2023-07-09T02:24:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46056.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46056.log.gz 2023-07-09T02:24:04.926 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49680.log 2023-07-09T02:24:04.927 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48515.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48515.log.gz 2023-07-09T02:24:04.928 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46242.log 2023-07-09T02:24:04.929 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49680.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49680.log.gz 2023-07-09T02:24:04.929 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53040.log 2023-07-09T02:24:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39732.log 2023-07-09T02:24:04.931 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46242.log.gz 2023-07-09T02:24:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53040.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40287.log 2023-07-09T02:24:04.933 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53040.log.gz 2023-07-09T02:24:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53675.log 2023-07-09T02:24:04.934 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39732.log.gz 2023-07-09T02:24:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44439.log 2023-07-09T02:24:04.936 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40287.log.gz 2023-07-09T02:24:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53675.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53675.log.gz 2023-07-09T02:24:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48543.log 2023-07-09T02:24:04.939 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34394.log 2023-07-09T02:24:04.939 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44439.log.gz 2023-07-09T02:24:04.940 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48543.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45487.log 2023-07-09T02:24:04.941 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48543.log.gz 2023-07-09T02:24:04.942 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2023-07-09T02:24:04.942 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34394.log.gz 2023-07-09T02:24:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47441.log 2023-07-09T02:24:04.944 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45487.log: /var/log/ceph/ceph-client.admin.54732.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45487.log.gz 2023-07-09T02:24:04.945 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2023-07-09T02:24:04.945 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34692.log 2023-07-09T02:24:04.947 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40670.log 2023-07-09T02:24:04.947 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47441.log.gz 2023-07-09T02:24:04.949 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37526.log 2023-07-09T02:24:04.949 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34692.log.gz 2023-07-09T02:24:04.950 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50953.log 2023-07-09T02:24:04.950 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40670.log.gz 2023-07-09T02:24:04.951 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37526.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37526.log.gz 2023-07-09T02:24:04.952 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51292.log 2023-07-09T02:24:04.953 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33253.log 2023-07-09T02:24:04.953 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50953.log.gz 2023-07-09T02:24:04.954 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51292.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51292.log.gz 2023-07-09T02:24:04.955 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41984.log 2023-07-09T02:24:04.956 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33253.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.33253.log.gz -- 2023-07-09T02:24:04.957 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.46887.log 2023-07-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41984.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49184.log 2023-07-09T02:24:04.959 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41984.log.gz 2023-07-09T02:24:04.960 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52610.log 2023-07-09T02:24:04.960 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2023-07-09T02:24:04.961 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45461.log 2023-07-09T02:24:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52610.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49184.log.gz 2023-07-09T02:24:04.963 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2023-07-09T02:24:04.963 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52610.log.gz 2023-07-09T02:24:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52845.log 2023-07-09T02:24:04.966 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45461.log.gz 2023-07-09T02:24:04.966 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37736.log 2023-07-09T02:24:04.966 INFO:teuthology.orchestra.run.smithi045.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-09T02:24:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52845.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2023-07-09T02:24:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34405.log 2023-07-09T02:24:04.967 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52845.log.gz 2023-07-09T02:24:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44893.log 2023-07-09T02:24:04.969 INFO:teuthology.orchestra.run.smithi045.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37736.log.gz 2023-07-09T02:24:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36485.log 2023-07-09T02:24:04.970 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34405.log.gz 2023-07-09T02:24:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44893.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44893.log.gz 2023-07-09T02:24:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34195.log 2023-07-09T02:24:04.972 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38704.log 2023-07-09T02:24:04.973 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36485.log.gz 2023-07-09T02:24:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34195.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34195.log.gz 2023-07-09T02:24:04.974 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41236.log 2023-07-09T02:24:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48021.log 2023-07-09T02:24:04.975 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38704.log.gz 2023-07-09T02:24:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41236.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41236.log.gz 2023-07-09T02:24:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2023-07-09T02:24:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53250.log 2023-07-09T02:24:04.978 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48021.log.gz 2023-07-09T02:24:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43242.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz 2023-07-09T02:24:04.979 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41932.log 2023-07-09T02:24:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40019.log 2023-07-09T02:24:04.981 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41932.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.53250.log.gz 2023-07-09T02:24:04.981 INFO:teuthology.orchestra.run.smithi045.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41932.log.gz 2023-07-09T02:24:04.982 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2023-07-09T02:24:04.982 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52324.log 2023-07-09T02:24:04.983 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40019.log.gz 2023-07-09T02:24:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44465.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2023-07-09T02:24:04.984 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42821.log 2023-07-09T02:24:04.985 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46030.log 2023-07-09T02:24:04.986 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52324.log.gz 2023-07-09T02:24:04.987 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42821.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42821.log.gz 2023-07-09T02:24:04.987 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47285.log 2023-07-09T02:24:04.988 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49762.log 2023-07-09T02:24:04.988 INFO:teuthology.orchestra.run.smithi045.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46030.log.gz 2023-07-09T02:24:04.989 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47285.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47285.log.gz 2023-07-09T02:24:04.989 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38678.log 2023-07-09T02:24:04.990 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2023-07-09T02:24:04.991 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49762.log.gz 2023-07-09T02:24:04.991 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38678.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38678.log.gz 2023-07-09T02:24:04.992 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49654.log 2023-07-09T02:24:04.993 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37438.log 2023-07-09T02:24:04.993 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2023-07-09T02:24:04.994 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49654.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49654.log.gz 2023-07-09T02:24:04.994 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44681.log 2023-07-09T02:24:04.995 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2023-07-09T02:24:04.996 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37438.log.gz 2023-07-09T02:24:04.996 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44681.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44681.log.gz 2023-07-09T02:24:04.997 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55099.log 2023-07-09T02:24:04.998 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42010.log 2023-07-09T02:24:04.998 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2023-07-09T02:24:04.999 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.55099.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55099.log.gz 2023-07-09T02:24:04.999 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49788.log 2023-07-09T02:24:05.000 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54602.log 2023-07-09T02:24:05.001 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42010.log.gz 2023-07-09T02:24:05.001 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49788.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49788.log.gz 2023-07-09T02:24:05.002 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32855.log 2023-07-09T02:24:05.003 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48793.log 2023-07-09T02:24:05.003 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54602.log.gz 2023-07-09T02:24:05.004 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.32855.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32855.log.gz 2023-07-09T02:24:05.005 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53872.log 2023-07-09T02:24:05.005 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40987.log 2023-07-09T02:24:05.006 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2023-07-09T02:24:05.007 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53872.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53872.log.gz 2023-07-09T02:24:05.008 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37604.log 2023-07-09T02:24:05.009 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38600.log 2023-07-09T02:24:05.009 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40987.log.gz 2023-07-09T02:24:05.010 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37604.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37604.log.gz 2023-07-09T02:24:05.011 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52767.log 2023-07-09T02:24:05.011 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33584.log 2023-07-09T02:24:05.012 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38600.log.gz 2023-07-09T02:24:05.013 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52767.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52767.log.gz 2023-07-09T02:24:05.013 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53198.log 2023-07-09T02:24:05.014 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48047.log 2023-07-09T02:24:05.015 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33584.log.gz 2023-07-09T02:24:05.016 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53198.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53198.log.gz 2023-07-09T02:24:05.016 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48201.log 2023-07-09T02:24:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49080.log 2023-07-09T02:24:05.017 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48047.log.gz 2023-07-09T02:24:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48201.log.gz 2023-07-09T02:24:05.018 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45565.log 2023-07-09T02:24:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48264.log 2023-07-09T02:24:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49080.log: /var/log/ceph/ceph-client.admin.45565.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49080.log.gz 2023-07-09T02:24:05.021 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45565.log.gz 2023-07-09T02:24:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36901.log 2023-07-09T02:24:05.022 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48099.log 2023-07-09T02:24:05.022 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48264.log.gz 2023-07-09T02:24:05.023 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36901.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36901.log.gz 2023-07-09T02:24:05.024 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52063.log 2023-07-09T02:24:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39119.log 2023-07-09T02:24:05.025 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48099.log.gz 2023-07-09T02:24:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52063.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52063.log.gz 2023-07-09T02:24:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41340.log 2023-07-09T02:24:05.028 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53929.log 2023-07-09T02:24:05.028 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39119.log.gz 2023-07-09T02:24:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41340.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41340.log.gz 2023-07-09T02:24:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39901.log 2023-07-09T02:24:05.030 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51096.log 2023-07-09T02:24:05.030 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53929.log.gz 2023-07-09T02:24:05.031 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39901.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39901.log.gz 2023-07-09T02:24:05.032 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55149.log 2023-07-09T02:24:05.033 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35730.log 2023-07-09T02:24:05.033 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51096.log.gz 2023-07-09T02:24:05.034 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.55149.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55149.log.gz 2023-07-09T02:24:05.034 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41368.log 2023-07-09T02:24:05.035 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55018.log 2023-07-09T02:24:05.036 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35730.log.gz 2023-07-09T02:24:05.037 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41368.log: gzip -5 91.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.41368.log.gz 2023-07-09T02:24:05.037 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.35626.log 2023-07-09T02:24:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.55018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34184.log 2023-07-09T02:24:05.039 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55018.log.gz 2023-07-09T02:24:05.039 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35626.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35626.log.gz 2023-07-09T02:24:05.040 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36719.log 2023-07-09T02:24:05.041 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54297.log 2023-07-09T02:24:05.041 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34184.log.gz 2023-07-09T02:24:05.042 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.36719.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36719.log.gz 2023-07-09T02:24:05.042 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2023-07-09T02:24:05.043 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34848.log 2023-07-09T02:24:05.044 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54297.log.gz 2023-07-09T02:24:05.044 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42374.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2023-07-09T02:24:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53623.log 2023-07-09T02:24:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35756.log 2023-07-09T02:24:05.046 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34848.log.gz 2023-07-09T02:24:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53623.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53623.log.gz 2023-07-09T02:24:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50295.log 2023-07-09T02:24:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51798.log 2023-07-09T02:24:05.049 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35756.log.gz 2023-07-09T02:24:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50295.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50295.log.gz 2023-07-09T02:24:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2023-07-09T02:24:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35392.log 2023-07-09T02:24:05.052 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51798.log.gz 2023-07-09T02:24:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44921.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2023-07-09T02:24:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42663.log 2023-07-09T02:24:05.054 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.35392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47050.log 2023-07-09T02:24:05.055 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35392.log.gz 2023-07-09T02:24:05.055 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42663.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42663.log.gz 2023-07-09T02:24:05.056 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2023-07-09T02:24:05.057 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47050.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47050.log.gz 2023-07-09T02:24:05.057 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54349.log 2023-07-09T02:24:05.058 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33938.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2023-07-09T02:24:05.059 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42873.log 2023-07-09T02:24:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54349.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54349.log.gz 2023-07-09T02:24:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53768.log 2023-07-09T02:24:05.062 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42873.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42873.log.gz 2023-07-09T02:24:05.062 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48871.log 2023-07-09T02:24:05.063 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53768.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53768.log.gz 2023-07-09T02:24:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34187.log 2023-07-09T02:24:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48871.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48871.log.gz 2023-07-09T02:24:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49840.log 2023-07-09T02:24:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.34187.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34187.log.gz 2023-07-09T02:24:05.067 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54166.log 2023-07-09T02:24:05.068 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49840.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49840.log.gz 2023-07-09T02:24:05.069 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51187.log 2023-07-09T02:24:05.070 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.54166.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54166.log.gz 2023-07-09T02:24:05.070 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44665.log 2023-07-09T02:24:05.072 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.51187.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51187.log.gz 2023-07-09T02:24:05.072 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53701.log 2023-07-09T02:24:05.073 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.44665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44665.log.gz 2023-07-09T02:24:05.073 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2023-07-09T02:24:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.53701.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53701.log.gz 2023-07-09T02:24:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52701.log 2023-07-09T02:24:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46591.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2023-07-09T02:24:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49288.log 2023-07-09T02:24:05.077 INFO:teuthology.orchestra.run.smithi045.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-09T02:24:05.078 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.52701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52701.log.gz 2023-07-09T02:24:05.079 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44110.log 2023-07-09T02:24:05.079 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49288.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49288.log.gz 2023-07-09T02:24:05.080 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33220.log 2023-07-09T02:24:05.081 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44110.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44110.log.gz 2023-07-09T02:24:05.082 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33220.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33220.log.gz 2023-07-09T02:24:05.158 INFO:teuthology.orchestra.run.smithi045.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-09T02:24:05.306 INFO:teuthology.orchestra.run.smithi045.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-09T02:24:05.458 INFO:teuthology.orchestra.run.smithi045.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-09T02:24:05.460 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-07-09T02:24:05.460 INFO:teuthology.orchestra.run.smithi045.stderr:real 0m1.631s 2023-07-09T02:24:05.461 INFO:teuthology.orchestra.run.smithi045.stderr:user 0m6.158s 2023-07-09T02:24:05.461 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m2.096s 2023-07-09T02:24:05.462 INFO:tasks.ceph:Archiving logs... 2023-07-09T02:24:05.462 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/remote/smithi045/log 2023-07-09T02:24:05.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-09T02:24:06.487 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/remote/smithi155/log 2023-07-09T02:24:06.488 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-09T02:24:06.945 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-09T02:24:06.955 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-09T02:24:06.955 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-09T02:24:06.959 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-09T02:24:07.045 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-09T02:24:07.057 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-09T02:24:07.057 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T02:24:07.061 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T02:24:07.074 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-07-09T02:24:07.074 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-07-09T02:24:07.074 INFO:teuthology.orchestra.run.smithi045.stdout:*hv01.front.sepi 44.4.53.2 2 u 39 64 377 0.089 -4.068 0.596 2023-07-09T02:24:07.074 INFO:teuthology.orchestra.run.smithi045.stdout:+hv02.front.sepi 63.231.80.2 3 u 38 64 377 0.080 -2.055 0.611 2023-07-09T02:24:07.074 INFO:teuthology.orchestra.run.smithi045.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 377 0.082 -3.243 0.632 2023-07-09T02:24:07.075 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-07-09T02:24:07.076 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2023-07-09T02:24:07.077 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2023-07-09T02:24:07.077 INFO:teuthology.orchestra.run.smithi155.stdout:*hv01.front.sepi 44.4.53.2 2 u 32 64 377 0.091 -2.302 2.858 2023-07-09T02:24:07.077 INFO:teuthology.orchestra.run.smithi155.stdout:+hv02.front.sepi 63.231.80.2 3 u 42 64 377 0.100 -2.699 2.002 2023-07-09T02:24:07.077 INFO:teuthology.orchestra.run.smithi155.stdout:+hv03.front.sepi 74.6.168.72 3 u 42 64 377 0.101 -0.998 2.713 2023-07-09T02:24:07.077 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-07-09T02:24:07.078 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-09T02:24:07.092 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-09T02:24:07.093 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-09T02:24:07.103 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-09T02:24:07.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-09T02:24:07.120 INFO:teuthology.task.internal:Duration was 1472.842913 seconds 2023-07-09T02:24:07.121 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-09T02:24:07.130 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-09T02:24:07.130 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-09T02:24:07.134 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-09T02:24:07.269 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-09T02:24:07.270 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-07-09T02:24:07.270 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-09T02:24:07.292 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2023-07-09T02:24:07.293 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-09T02:24:07.314 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-09T02:24:07.315 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-09T02:24:07.342 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-09T02:24:07.392 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-09T02:24:07.393 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-09T02:24:07.425 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-09T02:24:07.510 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-09T02:24:07.524 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-09T02:24:07.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-09T02:24:07.546 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-09T02:24:07.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-09T02:24:07.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-09T02:24:07.590 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-09T02:24:07.605 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-07-09T02:24:07.628 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2023-07-09T02:24:07.647 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-09T02:24:07.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:24:07.675 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-09T02:24:07.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T02:24:07.702 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-09T02:24:07.716 INFO:teuthology.task.internal:Transferring archived files... 2023-07-09T02:24:07.717 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/remote/smithi045 2023-07-09T02:24:07.718 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-09T02:24:07.743 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258/remote/smithi155 2023-07-09T02:24:07.744 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-09T02:24:07.767 INFO:teuthology.task.internal:Removing archive directory... 2023-07-09T02:24:07.768 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-09T02:24:07.791 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-09T02:24:07.823 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-09T02:24:07.842 INFO:teuthology.task.internal:Not uploading archives. 2023-07-09T02:24:07.842 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-09T02:24:07.853 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-09T02:24:07.853 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-09T02:24:07.857 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-09T02:24:07.864 INFO:teuthology.orchestra.run.smithi045.stdout: 657842 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 9 02:24 /home/ubuntu/cephtest 2023-07-09T02:24:07.875 INFO:teuthology.orchestra.run.smithi155.stdout: 657843 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 9 02:24 /home/ubuntu/cephtest 2023-07-09T02:24:07.876 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-09T02:24:07.887 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-09T02:24:07.914 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T02:24:07.944 DEBUG:teuthology.nuke:shortname: smithi045 2023-07-09T02:24:07.944 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T02:24:07.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 01:49:47.206365', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNb5m0fWJWMgfekhzFMSSRi0tDoW9NldytSVIT87hG1H4558e9pBEHzcH44ohGExahrdouYBBthQ89E67WpA6tk='} 2023-07-09T02:24:07.975 DEBUG:teuthology.nuke:shortname: smithi155 2023-07-09T02:24:07.975 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T02:24:08.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331258', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 01:49:47.205171', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUISXnKBKQ2cR4u244Tk/vUZUCdZCv0mM9QS/GlwYer2Jy9DKFQapK4stXCBMPo7NChKjszTYzr2mTpZdvXfS8='} 2023-07-09T02:24:08.032 INFO:teuthology.orchestra.console:Power off smithi045 2023-07-09T02:24:08.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T02:24:08.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:24:08.077 INFO:teuthology.orchestra.console:Power off smithi155 2023-07-09T02:24:08.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T02:24:08.101 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:24:12.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:24:12.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:24:16.207 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:24:16.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:24:16.453 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2023-07-09T02:24:20.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:24:20.535 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-07-09T02:24:20.640 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd client.1-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1472.8429129123688 failure_reason: '"2023-07-09T02:11:04.070052+0000 osd.0 (osd.0) 3 : cluster [WRN] OSD bench result of 138960.176746 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.0. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-07-09T02:24:20.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:24:20.738 INFO:teuthology.run:FAIL